== sanity-flr test 70a: flr mode fsx test ================ 20:13:35 (1777421615) Seed set to 1616 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read truncating to largest ever: 0x28672 000005 1777421616.580802 trunc from 00000000 to 0x028671 (0x28672 bytes) 000009 1777421616.589456 read 0x016517 thru 0x020912 (0xa3fc bytes) 000012 1777421616.597749 read 0x023a37 thru 0x0282a3 (0x486d bytes) 000016 1777421616.605791 read 0x0274fe thru 0x028671 (0x1174 bytes) 000017 1777421616.606417 trunc from 0x028672 to 0x0035f7 (0x2507a bytes) 000020 1777421616.616267 read 0x002c0f thru 0x0035f7 (0x9e9 bytes) 000022 1777421616.617240 write 0x008ea7 thru 0x011c5d (0x8db7 bytes) 000023 1777421616.618244 write 0x01bc4a thru 0x02312b (0x74e2 bytes) 000025 1777421616.625579 mapread 0x013bae thru 0x014e3b (0x128e bytes) 000026 1777421616.631346 read 0x0037a5 thru 0x00d3a9 (0x9c05 bytes) 000027 1777421616.632054 trunc from 0x02312c to 0x02199d (0x178e bytes) 000030 1777421616.641310 write 0x0085ba thru 0x012594 (0x9fdb bytes) 000033 1777421616.643288 write 0x0372f8 thru 0x03e33b (0x7044 bytes) 000034 1777421616.644425 trunc from 0x03e33c to 0x0263b1 (0x17f8a bytes) 000035 1777421616.654207 read 0x01291e thru 0x013a7d (0x1160 bytes) 000036 1777421616.654756 mapread 0x01ce2c thru 0x02390e (0x6ae3 bytes) 000037 1777421616.659662 read 0x010079 thru 0x019347 (0x92cf bytes) truncating to largest ever: 0x2e4e5 000039 1777421616.661237 trunc from 0x0263b2 to 0x02e4e4 (0x8133 bytes) 000041 1777421616.670142 write 0x025d47 thru 0x02f9cc (0x9c86 bytes) 000042 1777421616.671239 write 0x007c76 thru 0x014220 (0xc5ab bytes) 000043 1777421616.672562 mapwrite 0x0276bb thru 0x031d83 (0xa6c9 bytes) 000045 1777421616.725675 trunc from 0x031d84 to 0x00b063 (0x26d20 bytes) 000047 1777421616.739224 write 0x01dd85 thru 0x02a973 (0xcbef bytes) 000050 1777421616.741863 read 0x02701b thru 0x02a973 (0x3959 bytes) 000051 1777421616.742482 read 0x0139c3 thru 0x01f445 (0xba83 bytes) 000052 1777421616.746915 read 0x028e41 thru 0x02a973 (0x1b33 bytes) 000055 1777421616.749108 read 0x004558 thru 0x005cd1 (0x177a bytes) 000056 1777421616.749701 mapwrite 0x014589 thru 0x021121 (0xcb99 bytes) 000058 1777421616.777220 trunc from 0x02a974 to 0x0231dc (0x7797 bytes) 000059 1777421616.804227 MIRROR_EXTEND to 2 mirrors 000060 1777421617.066167 read 0x019127 thru 0x0231dc (0xa0b6 bytes) 000062 1777421617.071332 trunc from 0x0231dd to 0x015667 (0xdb75 bytes) 000063 1777421617.115316 read 0x00e6b6 thru 0x015667 (0x6fb2 bytes) truncating to largest ever: 0x302bf 000066 1777421617.121238 trunc from 0x015668 to 0x0302be (0x1ac57 bytes) 000067 1777421617.132272 read 0x026c9f thru 0x02b22a (0x458c bytes) 000071 1777421617.138466 read 0x01e4ef thru 0x02d779 (0xf28b bytes) 000074 1777421617.140262 write 0x03f37c thru 0x03ffff (0xc84 bytes) 000076 1777421617.141655 trunc from 0x040000 to 0x025df8 (0x1a207 bytes) 000077 1777421617.150091 read 0x0037af thru 0x0078b2 (0x4104 bytes) 000078 1777421617.150806 read 0x009343 thru 0x00ffdd (0x6c9b bytes) 000079 1777421617.151405 mapwrite 0x02d18d thru 0x030399 (0x320d bytes) truncating to largest ever: 0x3923b 000080 1777421617.187475 trunc from 0x03039a to 0x03923a (0x8ea1 bytes) 000081 1777421617.199523 mapread 0x00276d thru 0x0028e4 (0x178 bytes) 000084 1777421617.204498 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) 000085 1777421617.287270 mapwrite 0x034ddd thru 0x0385a0 (0x37c4 bytes) 000087 1777421617.315783 MIRROR_EXTEND to 2 mirrors 000092 1777421617.582036 MIRROR_RESYNC 2 mirrors 000095 1777421617.758047 trunc from 0x03923b to 0x000eff (0x3833b bytes) 000098 1777421617.808029 read 0x000d29 thru 0x000eff (0x1d7 bytes) 000099 1777421617.813026 MIRROR_RESYNC 2 mirrors 000101 1777421618.088329 write 0x03bd34 thru 0x03ffff (0x42cc bytes) 000102 1777421618.121874 MIRROR_RESYNC 2 mirrors 000104 1777421618.409231 mapread 0x0365fd thru 0x03b715 (0x5119 bytes) 000107 1777421618.421482 write 0x03f5e8 thru 0x03ffff (0xa18 bytes) 000110 1777421618.452901 mapwrite 0x02f99a thru 0x03ad98 (0xb3ff bytes) 000111 1777421618.477773 read 0x018a11 thru 0x02171e (0x8d0e bytes) 000112 1777421618.485730 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) 000115 1777421618.574439 read 0x0119c4 thru 0x01e8ad (0xceea bytes) 000117 1777421618.585186 MIRROR_EXTEND to 2 mirrors 000118 1777421618.944777 mapwrite 0x003684 thru 0x010dd7 (0xd754 bytes) 000120 1777421619.075477 MIRROR_RESYNC 2 mirrors 000121 1777421619.360922 MIRROR_RESYNC 2 mirrors 000122 1777421619.519748 mapread 0x00098a thru 0x0026e0 (0x1d57 bytes) 000124 1777421619.530376 write 0x03054a thru 0x032a4c (0x2503 bytes) 000125 1777421619.563282 mapread 0x030c82 thru 0x0347a1 (0x3b20 bytes) 000127 1777421619.564882 trunc from 0x040000 to 0x005db1 (0x3a24e bytes) 000128 1777421619.581089 MIRROR_RESYNC 2 mirrors 000130 1777421619.917799 mapwrite 0x02a2b3 thru 0x02f179 (0x4ec7 bytes) 000131 1777421620.010791 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) 000132 1777421620.096542 mapwrite 0x0218c5 thru 0x022b6f (0x12ab bytes) 000134 1777421620.127631 read 0x0249f3 thru 0x02f179 (0xa787 bytes) 000135 1777421620.133212 mapwrite 0x028537 thru 0x033719 (0xb1e3 bytes) 000137 1777421620.173715 write 0x00cf58 thru 0x01a26e (0xd317 bytes) 000142 1777421620.183482 write 0x02e61a thru 0x02febb (0x18a2 bytes) 000143 1777421620.184328 read 0x02058d thru 0x0216e3 (0x1157 bytes) 000144 1777421620.189695 mapwrite 0x009982 thru 0x017591 (0xdc10 bytes) 000145 1777421620.218996 trunc from 0x03371a to 0x016e68 (0x1c8b1 bytes) 000147 1777421620.229771 mapwrite 0x00b32f thru 0x01849c (0xd16e bytes) 000149 1777421620.274237 write 0x012b81 thru 0x0226c5 (0xfb45 bytes) 000150 1777421620.275651 read 0x01836b thru 0x01b978 (0x360e bytes) 000151 1777421620.276409 mapread 0x00e04a thru 0x01759e (0x9555 bytes) 000153 1777421620.280170 MIRROR_EXTEND to 2 mirrors 000155 1777421620.535694 write 0x02c43c thru 0x02eac1 (0x2686 bytes) 000156 1777421620.566799 write 0x02589a thru 0x02ddb5 (0x851c bytes) 000159 1777421620.571596 mapwrite 0x02abfb thru 0x02ba1e (0xe24 bytes) 000160 1777421620.594481 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) 000162 1777421620.669990 mapwrite 0x013b62 thru 0x0223b3 (0xe852 bytes) 000163 1777421620.707022 trunc from 0x02eac2 to 0x02052c (0xe595 bytes) 000165 1777421620.724793 mapwrite 0x02606e thru 0x02c787 (0x671a bytes) 000166 1777421620.757669 mapread 0x008e5f thru 0x00b149 (0x22eb bytes) 000170 1777421620.766268 mapread 0x01bebc thru 0x02322e (0x7373 bytes) 000172 1777421620.768174 mapread 0x005c67 thru 0x00d0c9 (0x7463 bytes) 000173 1777421620.769283 mapread 0x0153c7 thru 0x01ed9a (0x99d4 bytes) 000175 1777421620.770784 read 0x01c156 thru 0x01ca60 (0x90b bytes) 000179 1777421620.773550 read 0x000054 thru 0x0087bb (0x8768 bytes) 000180 1777421620.780046 read 0x01bf0b thru 0x022049 (0x613f bytes) 000183 1777421620.781710 trunc from 0x02c788 to 0x009edf (0x228a8 bytes) 000184 1777421620.794914 MIRROR_EXTEND to 2 mirrors 000185 1777421621.047173 mapwrite 0x023633 thru 0x02f6da (0xc0a8 bytes) 000187 1777421621.148451 mapread 0x009e84 thru 0x00b780 (0x18fd bytes) 000188 1777421621.155304 read 0x01dea7 thru 0x024db9 (0x6f13 bytes) 000189 1777421621.159123 trunc from 0x02f6db to 0x01ba23 (0x13cb7 bytes) 000190 1777421621.174641 mapread 0x00b411 thru 0x00b639 (0x229 bytes) 000191 1777421621.180335 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1ba24): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ba24): Mirror 2: 0x5af5b948 (stale) CRC-32 checksum value for chunk [0, 0x1ba24): Mirror 1: 0x5af5b948 Mirror 3: 0x5af5b948 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ba24: skipped 000192 1777421621.495937 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) 000193 1777421621.630552 mapread 0x000202 thru 0x00918f (0x8f8e bytes) 000194 1777421621.642186 write 0x006945 thru 0x00c5d4 (0x5c90 bytes) 000195 1777421621.676899 trunc from 0x01ba24 to 0x01aa2a (0xff9 bytes) 000197 1777421621.692702 mapread 0x00b0b3 thru 0x015e53 (0xada1 bytes) 000200 1777421621.700802 mapwrite 0x03bac0 thru 0x03ffff (0x4540 bytes) 000201 1777421621.742060 mapread 0x0086f5 thru 0x01687f (0xe18b bytes) 000203 1777421621.743767 write 0x031c58 thru 0x03474f (0x2af8 bytes) 000204 1777421621.759263 trunc from 0x040000 to 0x016726 (0x298d9 bytes) 000206 1777421621.771787 read 0x013d04 thru 0x016726 (0x2a23 bytes) 000208 1777421621.773790 mapread 0x00fe4d thru 0x016726 (0x68da bytes) 000209 1777421621.774979 mapwrite 0x022a7e thru 0x02e19d (0xb720 bytes) 000210 1777421621.833427 write 0x011d04 thru 0x0189e0 (0x6cdd bytes) 000211 1777421621.836908 mapwrite 0x006b53 thru 0x01361a (0xcac8 bytes) 000212 1777421621.863712 read 0x027fb4 thru 0x02e19d (0x61ea bytes) 000214 1777421621.864793 mapwrite 0x0134de thru 0x01869b (0x51be bytes) 000217 1777421621.888043 mapread 0x013b15 thru 0x01be0e (0x82fa bytes) 000221 1777421621.894185 mapread 0x02751e thru 0x027e0e (0x8f1 bytes) 000223 1777421621.895486 mapwrite 0x00e6cd thru 0x00efc8 (0x8fc bytes) 000227 1777421621.917239 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2e19e): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e19e): Mirror 3: 0x1b917cac (stale) CRC-32 checksum value for chunk [0, 0x2e19e): Mirror 1: 0xb1af00a4 Mirror 4: 0xb1af00a4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e19e: skipped 000229 1777421622.219570 write 0x026b38 thru 0x0271bd (0x686 bytes) 000230 1777421622.255456 mapread 0x029219 thru 0x02ab81 (0x1969 bytes) 000231 1777421622.260255 read 0x010a30 thru 0x01aeca (0xa49b bytes) 000233 1777421622.264988 mapwrite 0x003797 thru 0x003849 (0xb3 bytes) 000234 1777421622.286334 mapwrite 0x029dae thru 0x02ffd8 (0x622b bytes) 000236 1777421622.320336 mapwrite 0x015be7 thru 0x0185e9 (0x2a03 bytes) 000237 1777421622.337253 trunc from 0x02ffd9 to 0x0089cf (0x27609 bytes) 000238 1777421622.344577 read 0x0041db thru 0x0089cf (0x47f5 bytes) 000241 1777421622.346177 write 0x02138f thru 0x02cda9 (0xba1b bytes) 000242 1777421622.347600 mapwrite 0x03d961 thru 0x03ffff (0x269f bytes) 000243 1777421622.379820 trunc from 0x040000 to 0x037c49 (0x83b6 bytes) 000245 1777421622.388303 trunc from 0x037c4a to 0x02915f (0xeaea bytes) 000246 1777421622.397597 write 0x025eee thru 0x02a588 (0x469b bytes) 000247 1777421622.402014 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2a589): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a589): Mirror 3: 0xb7d6fed7 (stale) Mirror 4: 0x8fb8a6e0 (stale) CRC-32 checksum value for chunk [0, 0x2a589): Mirror 1: 0x731f8079 Mirror 5: 0x731f8079 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a589: skipped 000248 1777421622.726934 read 0x003e3a thru 0x00a55d (0x6724 bytes) 000251 1777421622.738395 read 0x0115a7 thru 0x01ebc5 (0xd61f bytes) 000254 1777421622.749764 read 0x001b01 thru 0x0115e0 (0xfae0 bytes) 000257 1777421622.755563 mapwrite 0x00292c thru 0x007743 (0x4e18 bytes) 000258 1777421622.836727 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2a589): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a589): Mirror 3: 0xb7d6fed7 (stale) Mirror 4: 0x8fb8a6e0 (stale) Mirror 5: 0x731f8079 (stale) CRC-32 checksum value for chunk [0, 0x2a589): Mirror 1: 0x3cb659e1 Mirror 6: 0x3cb659e1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a589: skipped 000259 1777421623.165358 mapwrite 0x02228a thru 0x02892e (0x66a5 bytes) 000260 1777421623.233582 mapwrite 0x02f72c thru 0x03bdde (0xc6b3 bytes) 000261 1777421623.274254 read 0x027571 thru 0x0278c1 (0x351 bytes) 000266 1777421623.277101 read 0x01a1ff thru 0x0276c1 (0xd4c3 bytes) 000267 1777421623.286884 read 0x035bf7 thru 0x03bdde (0x61e8 bytes) 000271 1777421623.288960 mapwrite 0x038f8a thru 0x03ffff (0x7076 bytes) 000272 1777421623.319544 mapread 0x0163d2 thru 0x022c31 (0xc860 bytes) 000273 1777421623.320786 write 0x020540 thru 0x0241f2 (0x3cb3 bytes) 000276 1777421623.323026 mapread 0x030179 thru 0x03efd7 (0xee5f bytes) 000278 1777421623.324647 mapwrite 0x02de98 thru 0x03640e (0x8577 bytes) 000280 1777421623.355787 MIRROR_RESYNC 5 mirrors 000281 1777421623.707563 trunc from 0x040000 to 0x032269 (0xdd96 bytes) 000282 1777421623.750676 mapwrite 0x03a1a9 thru 0x03ffff (0x5e57 bytes) 000283 1777421623.794460 read 0x03e65f thru 0x03ffff (0x19a1 bytes) 000287 1777421623.796924 mapwrite 0x00bef3 thru 0x013988 (0x7a96 bytes) 000289 1777421623.822010 mapread 0x016ec6 thru 0x021ee7 (0xb022 bytes) 000290 1777421623.830171 read 0x021dbb thru 0x030407 (0xe64d bytes) 000291 1777421623.834293 read 0x0215d7 thru 0x02690e (0x5338 bytes) 000293 1777421623.837730 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x8af1ee18 (stale) Mirror 5: 0x8af1ee18 (stale) Mirror 6: 0x8af1ee18 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x8af1ee18 (stale) Mirror 5: 0x8af1ee18 (stale) Mirror 6: 0x8af1ee18 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000294 1777421623.982461 mapread 0x031d0c thru 0x03515a (0x344f bytes) 000297 1777421623.992098 trunc from 0x040000 to 0x027de2 (0x1821d bytes) 000298 1777421623.999597 read 0x001964 thru 0x00ecb2 (0xd34f bytes) 000299 1777421624.005089 read 0x0226ed thru 0x027de2 (0x56f6 bytes) 000301 1777421624.010817 read 0x010bc2 thru 0x0184e3 (0x7922 bytes) 000307 1777421624.014179 read 0x00ab41 thru 0x01066a (0x5b2a bytes) 000308 1777421624.015043 write 0x01e8f6 thru 0x02e60d (0xfd18 bytes) 000311 1777421624.022518 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2e60e): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e60e): Mirror 4: 0xbbc43c43 (stale) Mirror 5: 0xbbc43c43 (stale) Mirror 6: 0xbbc43c43 (stale) CRC-32 checksum value for chunk [0, 0x2e60e): Mirror 1: 0xea880f5c Mirror 7: 0xea880f5c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e60e: skipped 000312 1777421624.327461 mapread 0x010152 thru 0x0144cc (0x437b bytes) 000315 1777421624.338089 write 0x03e69d thru 0x03ffff (0x1963 bytes) 000317 1777421624.373818 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x8af1ee18 (stale) Mirror 6: 0x8af1ee18 (stale) Mirror 7: 0x33c52f41 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x8af1ee18 (stale) Mirror 6: 0x8af1ee18 (stale) Mirror 7: 0x33c52f41 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000319 1777421624.526700 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x8af1ee18 (stale) Mirror 6: 0x8af1ee18 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x8af1ee18 (stale) Mirror 6: 0x8af1ee18 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000320 1777421624.638205 mapread 0x030ce2 thru 0x038d53 (0x8072 bytes) 000323 1777421624.647965 write 0x01418b thru 0x022f1f (0xed95 bytes) 000324 1777421624.655901 trunc from 0x040000 to 0x02201e (0x1dfe1 bytes) 000326 1777421624.671268 read 0x01a2d7 thru 0x01c5fb (0x2325 bytes) 000327 1777421624.671813 mapwrite 0x03054f thru 0x032892 (0x2344 bytes) 000332 1777421624.716908 mapwrite 0x02746f thru 0x032ddf (0xb971 bytes) 000333 1777421624.749989 write 0x017cab thru 0x019bca (0x1f20 bytes) 000334 1777421624.750823 write 0x01a8ca thru 0x021733 (0x6e6a bytes) 000336 1777421624.752236 mapread 0x02c7a7 thru 0x032ddf (0x6639 bytes) 000337 1777421624.753311 write 0x0191cb thru 0x0238dc (0xa712 bytes) 000338 1777421624.754654 mapwrite 0x00d749 thru 0x011193 (0x3a4b bytes) 000340 1777421624.775109 mapread 0x0075c8 thru 0x012885 (0xb2be bytes) 000341 1777421624.782497 trunc from 0x032de0 to 0x02abae (0x8231 bytes) 000342 1777421624.791732 mapwrite 0x026cef thru 0x0341bc (0xd4ce bytes) 000348 1777421624.840215 mapread 0x01f797 thru 0x02c236 (0xcaa0 bytes) 000349 1777421624.841351 trunc from 0x0341bd to 0x032803 (0x19b9 bytes) 000350 1777421624.851413 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32804): Mirror 5: 0x1a67a76e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32804): Mirror 5: 0x1a67a76e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32804: skipped 000351 1777421624.963037 mapwrite 0x006917 thru 0x00767a (0xd64 bytes) 000355 1777421624.986942 write 0x0173f4 thru 0x0260cf (0xecdc bytes) 000356 1777421624.994566 mapwrite 0x00f4ab thru 0x0173bf (0x7f15 bytes) 000357 1777421625.017559 write 0x0027ef thru 0x0048fa (0x210c bytes) 000358 1777421625.022484 trunc from 0x032804 to 0x030513 (0x22f0 bytes) 000359 1777421625.030880 write 0x0081e6 thru 0x01603a (0xde55 bytes) 000360 1777421625.032280 trunc from 0x030514 to 0x01b5da (0x14f39 bytes) 000361 1777421625.040171 read 0x006260 thru 0x00d7b4 (0x7555 bytes) 000363 1777421625.041380 mapread 0x0157af thru 0x01b5da (0x5e2c bytes) 000364 1777421625.042345 mapread 0x012f38 thru 0x01877f (0x5848 bytes) 000365 1777421625.043359 write 0x02b0d3 thru 0x03179b (0x66c9 bytes) 000366 1777421625.044611 mapread 0x00890f thru 0x00d7b3 (0x4ea5 bytes) 000367 1777421625.045666 read 0x02d78c thru 0x03179b (0x4010 bytes) 000368 1777421625.046331 read 0x02ac3a thru 0x03179b (0x6b62 bytes) 000369 1777421625.051155 write 0x01c1e3 thru 0x01d777 (0x1595 bytes) 000371 1777421625.055085 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3179c): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3179c): Mirror 5: 0xab279e27 (stale) CRC-32 checksum value for chunk [0, 0x3179c): Mirror 1: 0xf0cc568b Mirror 6: 0xf0cc568b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3179c: skipped 000372 1777421625.314361 write 0x018f4c thru 0x01d68c (0x4741 bytes) 000373 1777421625.345581 mapwrite 0x039bdf thru 0x03ffff (0x6421 bytes) 000374 1777421625.391939 MIRROR_RESYNC 3 mirrors 000376 1777421625.659763 read 0x02988a thru 0x035eb8 (0xc62f bytes) 000377 1777421625.664345 mapwrite 0x0198e2 thru 0x023626 (0x9d45 bytes) 000379 1777421625.738294 mapwrite 0x0139ad thru 0x0211c5 (0xd819 bytes) 000380 1777421625.767772 write 0x0293da thru 0x02f81d (0x6444 bytes) 000381 1777421625.771376 mapwrite 0x02e941 thru 0x02ffde (0x169e bytes) 000382 1777421625.791785 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xc3ece924 (stale) Mirror 6: 0xc3ece924 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xeb92af2a Mirror 7: 0xeb92af2a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000384 1777421626.082277 mapread 0x039111 thru 0x03ffff (0x6eef bytes) 000385 1777421626.096174 mapread 0x01fa0f thru 0x0276b5 (0x7ca7 bytes) 000389 1777421626.110731 trunc from 0x040000 to 0x02e46d (0x11b92 bytes) 000393 1777421626.153118 mapread 0x027d17 thru 0x02e46d (0x6757 bytes) 000394 1777421626.157519 mapread 0x010b07 thru 0x017f7c (0x7476 bytes) 000395 1777421626.162136 trunc from 0x02e46e to 0x036a45 (0x85d8 bytes) 000397 1777421626.171286 mapread 0x024099 thru 0x0255d7 (0x153f bytes) 000399 1777421626.172691 write 0x01a468 thru 0x021d9f (0x7938 bytes) 000400 1777421626.177908 write 0x0374e7 thru 0x037df2 (0x90c bytes) 000401 1777421626.181049 MIRROR_RESYNC 4 mirrors 000405 1777421626.477645 mapread 0x030510 thru 0x037df2 (0x78e3 bytes) 000410 1777421626.491617 mapread 0x032a57 thru 0x037df2 (0x539c bytes) 000412 1777421626.492624 trunc from 0x037df3 to 0x02d184 (0xac6e bytes) 000413 1777421626.542812 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2d185): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d185): Mirror 5: 0x774c1f3a (stale) Mirror 6: 0x774c1f3a (stale) Mirror 7: 0x774c1f3a (stale) CRC-32 checksum value for chunk [0, 0x2d185): Mirror 1: 0x774c1f3a Mirror 8: 0x774c1f3a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d185: skipped 000414 1777421626.864152 read 0x00dbb3 thru 0x0109d5 (0x2e23 bytes) truncating to largest ever: 0x39a00 000415 1777421626.868099 trunc from 0x02d185 to 0x0399ff (0xc87b bytes) 000416 1777421626.910681 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39a00): Mirror 5: 0xcec69187 (stale) Mirror 6: 0xcec69187 (stale) Mirror 7: 0xcec69187 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39a00): Mirror 5: 0xcec69187 (stale) Mirror 6: 0xcec69187 (stale) Mirror 7: 0xcec69187 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39a00: skipped 000417 1777421627.078097 MIRROR_RESYNC 4 mirrors 000420 1777421627.486391 mapwrite 0x023ae5 thru 0x02468f (0xbab bytes) 000421 1777421627.573717 trunc from 0x039a00 to 0x02cd54 (0xccab bytes) 000422 1777421627.585306 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2cd55): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cd55): Mirror 5: 0x5b9b2ab0 (stale) Mirror 6: 0x5b9b2ab0 (stale) Mirror 7: 0x5b9b2ab0 (stale) CRC-32 checksum value for chunk [0, 0x2cd55): Mirror 1: 0xb5a2f7ea Mirror 8: 0xb5a2f7ea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cd55: skipped 000423 1777421628.040311 mapread 0x026f38 thru 0x029f85 (0x304e bytes) 000424 1777421628.049291 mapread 0x000aee thru 0x004f02 (0x4415 bytes) 000425 1777421628.054992 MIRROR_RESYNC 5 mirrors 000427 1777421628.395946 read 0x010d07 thru 0x01420e (0x3508 bytes) 000429 1777421628.402131 write 0x005031 thru 0x014243 (0xf213 bytes) 000433 1777421628.435739 read 0x022a9e thru 0x028272 (0x57d5 bytes) 000434 1777421628.440537 trunc from 0x02cd55 to 0x0313e9 (0x4695 bytes) 000436 1777421628.451640 mapwrite 0x02f640 thru 0x033365 (0x3d26 bytes) 000437 1777421628.495309 read 0x02378b thru 0x028da9 (0x561f bytes) 000438 1777421628.495791 write 0x01f0e3 thru 0x021ec1 (0x2ddf bytes) 000439 1777421628.498448 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33366): Mirror 6: 0x281bf273 (stale) Mirror 7: 0x281bf273 (stale) Mirror 8: 0x281bf273 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33366): Mirror 6: 0x281bf273 (stale) Mirror 7: 0x281bf273 (stale) Mirror 8: 0x281bf273 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33366: skipped 000442 1777421628.656977 trunc from 0x033366 to 0x02e22b (0x513a bytes) 000445 1777421628.665745 write 0x02854a thru 0x028f8e (0xa45 bytes) 000447 1777421628.675033 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2e22c): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e22c): Mirror 6: 0x9e5593fd (stale) Mirror 7: 0x9e5593fd (stale) Mirror 8: 0x9e5593fd (stale) CRC-32 checksum value for chunk [0, 0x2e22c): Mirror 1: 0xb72c7740 Mirror 9: 0xb72c7740 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e22c: skipped 000448 1777421628.991043 read 0x01041f thru 0x01292f (0x2511 bytes) 000449 1777421628.994349 trunc from 0x02e22c to 0x004abc (0x2976f bytes) 000450 1777421629.064097 MIRROR_RESYNC 5 mirrors 000451 1777421629.499707 write 0x0148e6 thru 0x023c87 (0xf3a2 bytes) 000452 1777421629.532822 mapwrite 0x02354f thru 0x03146c (0xdf1e bytes) 000454 1777421629.594783 mapread 0x018f89 thru 0x025844 (0xc8bc bytes) 000455 1777421629.596204 mapread 0x027b56 thru 0x02ce79 (0x5324 bytes) 000456 1777421629.597359 trunc from 0x03146d to 0x013de2 (0x1d68a bytes) 000457 1777421629.606803 mapread 0x012206 thru 0x013de2 (0x1bdd bytes) 000458 1777421629.612583 trunc from 0x013de3 to 0x02b50a (0x17728 bytes) 000460 1777421629.629464 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2b50b): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b50b): Mirror 6: 0xa11b5eac (stale) Mirror 7: 0xa11b5eac (stale) Mirror 8: 0xa11b5eac (stale) Mirror 9: 0xa11b5eac (stale) CRC-32 checksum value for chunk [0, 0x2b50b): Mirror 1: 0xa11b5eac Mirror 10: 0xa11b5eac lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b50b: skipped 000461 1777421630.041386 write 0x008e9c thru 0x009968 (0xacd bytes) 000462 1777421630.080995 write 0x036678 thru 0x03ffff (0x9988 bytes) 000463 1777421630.082431 write 0x00caee thru 0x019407 (0xc91a bytes) 000464 1777421630.094371 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xe10183ae (stale) Mirror 8: 0xe10183ae (stale) Mirror 9: 0xe10183ae (stale) Mirror 10: 0xe10183ae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xe10183ae (stale) Mirror 8: 0xe10183ae (stale) Mirror 9: 0xe10183ae (stale) Mirror 10: 0xe10183ae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000465 1777421630.291452 mapread 0x022e25 thru 0x026c83 (0x3e5f bytes) truncating to largest ever: 0x3dea1 000466 1777421630.303326 trunc from 0x040000 to 0x03dea0 (0x215f bytes) 000467 1777421630.313811 mapwrite 0x032855 thru 0x03c040 (0x97ec bytes) 000468 1777421630.367291 MIRROR_RESYNC 5 mirrors 000470 1777421630.829554 read 0x031fdd thru 0x03dea0 (0xbec4 bytes) 000471 1777421630.837343 MIRROR_EXTEND to 6 mirrors 000472 1777421631.101757 read 0x006d1e thru 0x0123cc (0xb6af bytes) 000473 1777421631.107382 read 0x00db8f thru 0x01db67 (0xffd9 bytes) 000474 1777421631.113965 trunc from 0x03dea1 to 0x00d4cf (0x309d1 bytes) 000475 1777421631.184610 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xd4d0): Mirror 6: 0x3e59ef71 (stale) Mirror 8: 0x3e59ef71 (stale) Mirror 9: 0x3e59ef71 (stale) Mirror 10: 0x3e59ef71 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd4d0): Mirror 6: 0x3e59ef71 (stale) Mirror 8: 0x3e59ef71 (stale) Mirror 9: 0x3e59ef71 (stale) Mirror 10: 0x3e59ef71 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd4d0: skipped 000476 1777421631.359157 read 0x0019e6 thru 0x004cbc (0x32d7 bytes) 000477 1777421631.362904 read 0x00a5d7 thru 0x00d4cf (0x2ef9 bytes) 000478 1777421631.367924 trunc from 0x00d4d0 to 0x00e25f (0xd90 bytes) 000479 1777421631.382729 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe260): Mirror 6: 0x34aa2956 (stale) Mirror 9: 0x34aa2956 (stale) Mirror 10: 0x34aa2956 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe260): Mirror 6: 0x34aa2956 (stale) Mirror 9: 0x34aa2956 (stale) Mirror 10: 0x34aa2956 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe260: skipped 000482 1777421631.540395 read 0x003fd4 thru 0x00e25f (0xa28c bytes) 000483 1777421631.545823 trunc from 0x00e260 to 0x00e42b (0x1cc bytes) 000484 1777421631.555075 mapread 0x007d0f thru 0x00dda9 (0x609b bytes) 000485 1777421631.556133 read 0x007743 thru 0x00d5d2 (0x5e90 bytes) 000488 1777421631.557757 mapread 0x00c7ab thru 0x00e42b (0x1c81 bytes) 000489 1777421631.558697 read 0x00ae79 thru 0x00e42b (0x35b3 bytes) 000490 1777421631.562159 MIRROR_RESYNC 4 mirrors 000491 1777421631.889963 read 0x00c7c2 thru 0x00e42b (0x1c6a bytes) 000493 1777421631.893928 trunc from 0x00e42c to 0x02a2e6 (0x1bebb bytes) 000495 1777421631.941902 mapwrite 0x00d351 thru 0x00d9fb (0x6ab bytes) 000498 1777421631.972422 write 0x011f00 thru 0x0123d6 (0x4d7 bytes) 000499 1777421631.980807 read 0x01df54 thru 0x02a2e6 (0xc393 bytes) 000504 1777421631.989337 write 0x019b01 thru 0x01a372 (0x872 bytes) 000505 1777421631.990370 write 0x01eab3 thru 0x026270 (0x77be bytes) 000506 1777421631.991347 mapread 0x026a52 thru 0x02a2e6 (0x3895 bytes) 000508 1777421631.992818 read 0x0233c5 thru 0x02a2e6 (0x6f22 bytes) 000509 1777421631.993573 read 0x018a38 thru 0x0234f9 (0xaac2 bytes) 000510 1777421631.994435 read 0x024530 thru 0x027957 (0x3428 bytes) 000512 1777421631.995688 trunc from 0x02a2e7 to 0x036734 (0xc44e bytes) 000513 1777421632.009037 mapread 0x017252 thru 0x018af7 (0x18a6 bytes) 000515 1777421632.010864 read 0x03351b thru 0x036734 (0x321a bytes) 000516 1777421632.024205 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36735): Mirror 6: 0xe1f4ca4 (stale) Mirror 10: 0xe1f4ca4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36735): Mirror 6: 0xe1f4ca4 (stale) Mirror 10: 0xe1f4ca4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36735: skipped 000517 1777421632.192262 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36735): Mirror 10: 0xe1f4ca4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36735): Mirror 10: 0xe1f4ca4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36735: skipped 000518 1777421632.307145 mapread 0x005155 thru 0x00f226 (0xa0d2 bytes) 000523 1777421632.321225 mapwrite 0x031cde thru 0x0368d1 (0x4bf4 bytes) 000526 1777421632.368965 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x368d2): Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x368d2): Mirror 10: 0xa34a86c1 (stale) CRC-32 checksum value for chunk [0, 0x368d2): Mirror 1: 0x99ad1260 Mirror 11: 0x99ad1260 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x368d2: skipped 000528 1777421632.743181 mapread 0x032a52 thru 0x033b7f (0x112e bytes) 000530 1777421632.761950 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x368d2): Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x368d2): Mirror 10: 0xa34a86c1 (stale) CRC-32 checksum value for chunk [0, 0x368d2): Mirror 1: 0x99ad1260 Mirror 11: 0x99ad1260 Mirror 12: 0x99ad1260 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x368d2: skipped 000532 1777421633.125766 read 0x01d0da thru 0x02814c (0xb073 bytes) 000533 1777421633.132320 write 0x01840b thru 0x019e06 (0x19fc bytes) 000535 1777421633.185794 trunc from 0x0368d2 to 0x00367d (0x33254 bytes) 000537 1777421633.206031 write 0x02f771 thru 0x0335a2 (0x3e32 bytes) 000538 1777421633.207359 mapwrite 0x006aec thru 0x016555 (0xfa6a bytes) 000539 1777421633.251963 write 0x03ce8b thru 0x03ead5 (0x1c4b bytes) 000540 1777421633.253309 write 0x03eb24 thru 0x03ffff (0x14dc bytes) 000541 1777421633.254160 read 0x03ab90 thru 0x03ffff (0x5470 bytes) 000542 1777421633.260177 trunc from 0x040000 to 0x032751 (0xd8ae bytes) 000543 1777421633.272484 write 0x02fc11 thru 0x03073f (0xb2f bytes) 000545 1777421633.273922 read 0x007275 thru 0x0120c4 (0xae50 bytes) 000546 1777421633.274539 write 0x03f93f thru 0x03ffff (0x6c1 bytes) 000547 1777421633.275452 trunc from 0x040000 to 0x00dee9 (0x32116 bytes) 000548 1777421633.284645 mapread 0x006a2a thru 0x00dee9 (0x74c0 bytes) 000549 1777421633.285812 trunc from 0x00deea to 0x019d98 (0xbeaf bytes) 000550 1777421633.293918 trunc from 0x019d99 to 0x0010a0 (0x18cf8 bytes) 000555 1777421633.309983 mapread 0x000cfb thru 0x0010a0 (0x3a6 bytes) 000556 1777421633.310942 trunc from 0x0010a1 to 0x01a8f1 (0x19851 bytes) 000557 1777421633.319445 mapwrite 0x01e676 thru 0x02bff6 (0xd981 bytes) 000558 1777421633.365038 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2bff7): Mirror 10: 0xdbda1498 (stale) Mirror 12: 0xee37cf52 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bff7): Mirror 10: 0xdbda1498 (stale) Mirror 12: 0xee37cf52 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bff7: skipped 000559 1777421633.479017 trunc from 0x02bff7 to 0x022dc9 (0x922d bytes) 000562 1777421633.486762 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x22dca): Mirror 10: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22dca): Mirror 10: 0xbb64cacd (stale) Mirror 12: 0x5d3edc0a (stale) CRC-32 checksum value for chunk [0, 0x22dca): Mirror 1: 0x5a9a139 Mirror 13: 0x5a9a139 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22dca: skipped 000563 1777421633.805479 mapwrite 0x010348 thru 0x013b62 (0x381b bytes) 000564 1777421633.873553 read 0x013987 thru 0x01c148 (0x87c2 bytes) 000565 1777421633.876665 read 0x01877a thru 0x02203b (0x98c2 bytes) 000566 1777421633.883031 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22dca): Mirror 10: 0xbb64cacd (stale) Mirror 13: 0x5a9a139 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22dca): Mirror 10: 0xbb64cacd (stale) Mirror 13: 0x5a9a139 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22dca: skipped 000567 1777421634.011432 read 0x0137e9 thru 0x021e06 (0xe61e bytes) 000571 1777421634.021903 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x22dca): Mirror 10: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22dca): Mirror 10: 0xbb64cacd (stale) Mirror 13: 0x5a9a139 (stale) CRC-32 checksum value for chunk [0, 0x22dca): Mirror 1: 0x506dbbbc Mirror 14: 0x506dbbbc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22dca: skipped 000574 1777421634.335611 read 0x018f4c thru 0x01b5d6 (0x268b bytes) 000575 1777421634.342532 mapwrite 0x03feba thru 0x03ffff (0x146 bytes) 000576 1777421634.394543 mapwrite 0x002f0d thru 0x00abe6 (0x7cda bytes) 000577 1777421634.429607 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xc2d61cf6 (stale) Mirror 13: 0xefeaf072 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xc2d61cf6 (stale) Mirror 13: 0xefeaf072 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000579 1777421634.589076 read 0x019464 thru 0x020ce7 (0x7884 bytes) 000580 1777421634.596321 write 0x0034d2 thru 0x0127ea (0xf319 bytes) 000581 1777421634.604192 write 0x01e628 thru 0x0235f9 (0x4fd2 bytes) 000583 1777421634.608262 write 0x032b11 thru 0x03e35e (0xb84e bytes) 000585 1777421634.619606 write 0x02a51a thru 0x03712a (0xcc11 bytes) 000586 1777421634.632709 MIRROR_RESYNC 3 mirrors 000587 1777421634.909423 mapread 0x009422 thru 0x00d588 (0x4167 bytes) 000588 1777421634.921343 trunc from 0x040000 to 0x007252 (0x38dad bytes) 000589 1777421634.961462 trunc from 0x007253 to 0x0073cb (0x179 bytes) 000591 1777421634.971013 mapwrite 0x002a7e thru 0x00d482 (0xaa05 bytes) 000592 1777421635.005491 read 0x00b5b0 thru 0x00d482 (0x1ed3 bytes) 000593 1777421635.006172 trunc from 0x00d483 to 0x004a3d (0x8a45 bytes) 000594 1777421635.013726 mapwrite 0x029ebf thru 0x02facc (0x5c0e bytes) 000595 1777421635.041933 mapwrite 0x00a2ac thru 0x0173f6 (0xd14b bytes) 000596 1777421635.066243 mapread 0x01e5c5 thru 0x01eca5 (0x6e1 bytes) 000597 1777421635.070437 write 0x01a51a thru 0x0280c3 (0xdbaa bytes) 000598 1777421635.071582 read 0x01a7bf thru 0x01f961 (0x51a3 bytes) 000600 1777421635.072574 write 0x015e1b thru 0x01e879 (0x8a5f bytes) 000601 1777421635.075679 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2facd): Mirror 10: 0x92f3ef1b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2facd): Mirror 10: 0x92f3ef1b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2facd: skipped 000605 1777421635.176015 mapread 0x020fba thru 0x028976 (0x79bd bytes) 000607 1777421635.185372 trunc from 0x02facd to 0x01dffa (0x11ad2 bytes) 000610 1777421635.196516 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1dffb): Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1dffb): Mirror 10: 0x83c195c6 (stale) CRC-32 checksum value for chunk [0, 0x1dffb): Mirror 1: 0x9786d2f6 Mirror 11: 0x9786d2f6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1dffb: skipped 000613 1777421635.495812 read 0x01b760 thru 0x01dffa (0x289b bytes) 000614 1777421635.503951 write 0x00625b thru 0x012cbd (0xca63 bytes) 000615 1777421635.552247 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1dffb): Mirror 11: 0x9786d2f6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1dffb): Mirror 11: 0x9786d2f6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1dffb: skipped 000617 1777421635.658553 MIRROR_RESYNC 2 mirrors 000618 1777421635.874749 write 0x027f5e thru 0x02b1e3 (0x3286 bytes) 000619 1777421635.901418 mapread 0x017f93 thru 0x01b0f5 (0x3163 bytes) 000620 1777421635.910523 mapread 0x002c1c thru 0x00ed74 (0xc159 bytes) 000621 1777421635.916955 write 0x0104eb thru 0x018170 (0x7c86 bytes) 000622 1777421635.918007 read 0x0132bb thru 0x0158b1 (0x25f7 bytes) 000623 1777421635.918528 mapwrite 0x03c8fd thru 0x03ffff (0x3703 bytes) 000624 1777421635.949423 mapwrite 0x025489 thru 0x02966a (0x41e2 bytes) 000625 1777421635.971446 MIRROR_RESYNC 2 mirrors 000626 1777421636.213793 read 0x00a12c thru 0x00c27e (0x2153 bytes) 000627 1777421636.218075 trunc from 0x040000 to 0x02f9e0 (0x1061f bytes) 000629 1777421636.244968 mapread 0x02958b thru 0x02f616 (0x608c bytes) 000630 1777421636.253801 mapwrite 0x01ace3 thru 0x0230dd (0x83fb bytes) 000632 1777421636.284462 read 0x0107fa thru 0x01156f (0xd76 bytes) 000637 1777421636.293530 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) 000639 1777421636.362879 write 0x012f66 thru 0x0217d7 (0xe872 bytes) 000640 1777421636.369120 read 0x0243a3 thru 0x027381 (0x2fdf bytes) 000642 1777421636.373703 write 0x00d776 thru 0x011082 (0x390d bytes) 000644 1777421636.378448 mapwrite 0x015885 thru 0x0190bb (0x3837 bytes) 000646 1777421636.395902 trunc from 0x02f9e1 to 0x02a509 (0x54d7 bytes) 000647 1777421636.404584 trunc from 0x02a50a to 0x02228d (0x827c bytes) 000648 1777421636.417218 mapwrite 0x02132c thru 0x02d269 (0xbf3e bytes) 000649 1777421636.459577 write 0x0025b8 thru 0x011ae2 (0xf52b bytes) 000650 1777421636.465395 mapwrite 0x00aa47 thru 0x00c46b (0x1a25 bytes) 000651 1777421636.483512 write 0x030673 thru 0x038f33 (0x88c1 bytes) 000652 1777421636.484757 mapread 0x038c24 thru 0x038f33 (0x310 bytes) 000653 1777421636.485609 write 0x0217c6 thru 0x02b53a (0x9d75 bytes) 000654 1777421636.486921 read 0x01d016 thru 0x01fed1 (0x2ebc bytes) 000656 1777421636.488136 read 0x013ce2 thru 0x01bccb (0x7fea bytes) 000659 1777421636.489772 mapread 0x004fad thru 0x00d44b (0x849f bytes) 000660 1777421636.490938 write 0x02738c thru 0x033acf (0xc744 bytes) 000662 1777421636.492997 read 0x00582a thru 0x00ba7b (0x6252 bytes) 000664 1777421636.494601 mapread 0x02aa80 thru 0x02c543 (0x1ac4 bytes) 000665 1777421636.495729 trunc from 0x038f34 to 0x025fc9 (0x12f6a bytes) 000666 1777421636.503254 trunc from 0x025fca to 0x011b89 (0x14440 bytes) 000667 1777421636.510998 write 0x011b81 thru 0x01f0a5 (0xd525 bytes) 000669 1777421636.512907 write 0x03f32f thru 0x03ffff (0xcd1 bytes) 000675 1777421636.516453 trunc from 0x040000 to 0x037608 (0x89f7 bytes) 000677 1777421636.526640 mapwrite 0x01ae8d thru 0x027c2e (0xcda2 bytes) 000679 1777421636.567545 mapwrite 0x020126 thru 0x02d8ce (0xd7a9 bytes) 000680 1777421636.593379 mapread 0x0053c1 thru 0x00a34c (0x4f8c bytes) 000681 1777421636.594172 read 0x018d1b thru 0x01bff0 (0x32d6 bytes) 000684 1777421636.595895 mapwrite 0x01fd31 thru 0x023b0b (0x3ddb bytes) 000688 1777421636.613202 write 0x035aa0 thru 0x03b94c (0x5ead bytes) 000689 1777421636.614264 mapwrite 0x00cc2b thru 0x0140a1 (0x7477 bytes) 000691 1777421636.632152 mapread 0x008ee4 thru 0x0106d3 (0x77f0 bytes) 000692 1777421636.633186 read 0x002d8a thru 0x00a5ac (0x7823 bytes) 000693 1777421636.633588 mapwrite 0x003c5d thru 0x00e210 (0xa5b4 bytes) 000694 1777421636.651880 read 0x014edd thru 0x01a391 (0x54b5 bytes) 000695 1777421636.652578 read 0x038b04 thru 0x03b94c (0x2e49 bytes) 000697 1777421636.653789 write 0x012dae thru 0x01cde3 (0xa036 bytes) 000698 1777421636.655041 trunc from 0x03b94d to 0x0259e3 (0x15f69 bytes) 000699 1777421636.661500 trunc from 0x0259e4 to 0x031634 (0xbc51 bytes) 000702 1777421636.669365 mapread 0x015417 thru 0x024246 (0xee30 bytes) 000703 1777421636.670593 mapread 0x0182d0 thru 0x023b72 (0xb8a3 bytes) 000704 1777421636.671677 mapread 0x02d78b thru 0x031634 (0x3eaa bytes) 000706 1777421636.676433 mapread 0x016513 thru 0x025178 (0xec66 bytes) 000707 1777421636.677896 trunc from 0x031635 to 0x001988 (0x2fcac bytes) 000708 1777421636.685200 mapwrite 0x01535a thru 0x0209a2 (0xb649 bytes) 000709 1777421636.732643 write 0x0345fb thru 0x03ffff (0xba05 bytes) 000710 1777421636.734028 read 0x03c0ef thru 0x03ffff (0x3f11 bytes) 000712 1777421636.734938 trunc from 0x040000 to 0x013449 (0x2cbb6 bytes) 000713 1777421636.743888 MIRROR_EXTEND to 2 mirrors 000714 1777421636.924169 trunc from 0x01344a to 0x0147d2 (0x1389 bytes) 000715 1777421636.960992 mapread 0x007c88 thru 0x00d117 (0x5490 bytes) 000717 1777421636.978041 MIRROR_RESYNC 2 mirrors 000718 1777421637.208466 MIRROR_RESYNC 2 mirrors 000719 1777421637.341140 trunc from 0x0147d3 to 0x02cfd1 (0x187ff bytes) 000721 1777421637.372154 mapread 0x029d39 thru 0x02cfd1 (0x3299 bytes) 000722 1777421637.385706 trunc from 0x02cfd2 to 0x0145ab (0x18a26 bytes) 000723 1777421637.397553 write 0x0209d3 thru 0x0210d9 (0x707 bytes) 000724 1777421637.398675 trunc from 0x0210da to 0x007f0f (0x191ca bytes) 000725 1777421637.408586 trunc from 0x007f10 to 0x039b21 (0x31c12 bytes) 000726 1777421637.419750 write 0x008872 thru 0x00c253 (0x39e2 bytes) 000727 1777421637.430554 mapwrite 0x00a71c thru 0x012f53 (0x8838 bytes) 000731 1777421637.457568 trunc from 0x039b22 to 0x010d4a (0x28dd7 bytes) 000732 1777421637.468122 mapwrite 0x03a59d thru 0x03ffff (0x5a63 bytes) 000734 1777421637.506636 read 0x000d1e thru 0x003dcc (0x30af bytes) 000736 1777421637.510532 trunc from 0x040000 to 0x02b8ac (0x14753 bytes) 000738 1777421637.523087 mapread 0x017304 thru 0x0200b3 (0x8db0 bytes) 000739 1777421637.538391 mapwrite 0x01fb71 thru 0x029aa3 (0x9f33 bytes) 000740 1777421637.570150 trunc from 0x02b8ad to 0x0062b9 (0x255f3 bytes) 000741 1777421637.580583 trunc from 0x0062ba to 0x00a18f (0x3ed6 bytes) 000744 1777421637.589555 write 0x03d41f thru 0x03ffff (0x2be1 bytes) 000745 1777421637.590710 trunc from 0x040000 to 0x017112 (0x28eed bytes) 000747 1777421637.604414 mapread 0x011288 thru 0x017112 (0x5e8b bytes) 000748 1777421637.611974 mapwrite 0x012611 thru 0x014b10 (0x2500 bytes) 000749 1777421637.639055 write 0x0030b3 thru 0x00c79d (0x96eb bytes) 000750 1777421637.640175 mapwrite 0x023799 thru 0x028814 (0x507c bytes) 000751 1777421637.684530 MIRROR_RESYNC 2 mirrors 000753 1777421637.915684 read 0x02107a thru 0x0252b6 (0x423d bytes) 000756 1777421637.921201 read 0x0062b3 thru 0x0091ad (0x2efb bytes) 000757 1777421637.927901 trunc from 0x028815 to 0x00e60f (0x1a205 bytes) 000758 1777421637.975210 trunc from 0x00e610 to 0x0098e3 (0x4d2c bytes) 000759 1777421637.985453 read 0x0041b5 thru 0x0098e3 (0x572f bytes) 000760 1777421637.992132 read 0x000eac thru 0x0098e3 (0x8a38 bytes) 000761 1777421637.992827 mapwrite 0x014717 thru 0x020a23 (0xc30d bytes) 000762 1777421638.033708 mapread 0x013d93 thru 0x01fb75 (0xbde3 bytes) 000763 1777421638.034947 mapread 0x014487 thru 0x01dc37 (0x97b1 bytes) 000764 1777421638.036271 mapwrite 0x001d24 thru 0x01115e (0xf43b bytes) 000765 1777421638.063209 mapread 0x017f9b thru 0x018b1f (0xb85 bytes) 000769 1777421638.065138 trunc from 0x020a24 to 0x019813 (0x7210 bytes) 000770 1777421638.074908 mapwrite 0x02799b thru 0x02b400 (0x3a66 bytes) 000771 1777421638.122691 write 0x03a1ad thru 0x03a731 (0x585 bytes) 000772 1777421638.123759 trunc from 0x03a732 to 0x02105a (0x196d7 bytes) 000774 1777421638.132769 trunc from 0x02105b to 0x001de9 (0x1f271 bytes) 000777 1777421638.143539 write 0x0052f8 thru 0x01422f (0xef38 bytes) 000781 1777421638.146723 mapread 0x00b483 thru 0x00c445 (0xfc3 bytes) 000782 1777421638.147675 trunc from 0x014230 to 0x031efa (0x1dccb bytes) 000783 1777421638.154826 trunc from 0x031efb to 0x027318 (0xabe2 bytes) 000784 1777421638.164409 mapwrite 0x0091bb thru 0x00f19f (0x5fe5 bytes) 000785 1777421638.190728 write 0x020214 thru 0x0266b9 (0x64a6 bytes) 000786 1777421638.197732 mapwrite 0x039a73 thru 0x03ffff (0x658d bytes) 000788 1777421638.233773 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) 000789 1777421638.310520 MIRROR_EXTEND to 2 mirrors truncating to largest ever: 0x3e01b 000790 1777421638.606230 trunc from 0x040000 to 0x03e01a (0x1fe5 bytes) 000791 1777421638.634555 mapwrite 0x02fca0 thru 0x038bdc (0x8f3d bytes) 000792 1777421638.666802 read 0x02dc01 thru 0x033e97 (0x6297 bytes) 000796 1777421638.669306 read 0x00e20a thru 0x0104ab (0x22a2 bytes) 000797 1777421638.675582 mapread 0x02885e thru 0x02e67b (0x5e1e bytes) 000798 1777421638.676628 read 0x018a2a thru 0x02552f (0xcb06 bytes) 000800 1777421638.677893 trunc from 0x03e01b to 0x03729e (0x6d7c bytes) 000802 1777421638.692153 mapread 0x02b719 thru 0x03001c (0x4904 bytes) 000803 1777421638.693550 mapread 0x028be6 thru 0x02cf6a (0x4385 bytes) 000809 1777421638.697366 read 0x026758 thru 0x0319a0 (0xb249 bytes) 000811 1777421638.698664 mapwrite 0x037ce4 thru 0x03cfc0 (0x52dd bytes) 000813 1777421638.735318 mapwrite 0x00d9ec thru 0x01b356 (0xd96b bytes) 000815 1777421638.757433 mapread 0x03a3a8 thru 0x03cfc0 (0x2c19 bytes) 000816 1777421638.758473 trunc from 0x03cfc1 to 0x02d3c1 (0xfbff bytes) 000820 1777421638.769879 write 0x033458 thru 0x03c99f (0x9548 bytes) 000822 1777421638.771658 mapwrite 0x001f07 thru 0x009dd0 (0x7eca bytes) 000824 1777421638.794801 read 0x03b132 thru 0x03c99f (0x186e bytes) 000826 1777421638.795951 read 0x0110be thru 0x01bd12 (0xac55 bytes) 000828 1777421638.800988 MIRROR_RESYNC 2 mirrors 000829 1777421639.064108 write 0x013ee9 thru 0x01f292 (0xb3aa bytes) 000830 1777421639.098256 write 0x01509c thru 0x019393 (0x42f8 bytes) 000831 1777421639.099393 trunc from 0x03c9a0 to 0x013ae8 (0x28eb7 bytes) 000832 1777421639.118654 write 0x01ba67 thru 0x0247f5 (0x8d8f bytes) 000834 1777421639.120502 mapwrite 0x015687 thru 0x024d1e (0xf698 bytes) 000835 1777421639.163401 read 0x01e760 thru 0x023885 (0x5126 bytes) 000836 1777421639.164188 trunc from 0x024d1f to 0x01522f (0xfaef bytes) 000837 1777421639.173254 write 0x007e22 thru 0x009fcc (0x21ab bytes) 000838 1777421639.180691 trunc from 0x015230 to 0x00fdf9 (0x5436 bytes) 000841 1777421639.194157 mapread 0x00e21c thru 0x00fdf9 (0x1bde bytes) 000843 1777421639.196518 write 0x022fcf thru 0x0297df (0x6811 bytes) 000846 1777421639.199304 mapwrite 0x02beec thru 0x039066 (0xd17b bytes) 000848 1777421639.268613 mapread 0x036174 thru 0x039066 (0x2ef3 bytes) 000850 1777421639.270282 mapwrite 0x038d64 thru 0x03ffff (0x729c bytes) 000853 1777421639.327156 mapread 0x027489 thru 0x035026 (0xdb9e bytes) 000855 1777421639.330939 trunc from 0x040000 to 0x02afa2 (0x1505d bytes) 000856 1777421639.346091 mapwrite 0x02e3e9 thru 0x03d59a (0xf1b2 bytes) 000857 1777421639.410496 mapread 0x032bc7 thru 0x036904 (0x3d3e bytes) 000858 1777421639.411625 mapread 0x008ef1 thru 0x017c99 (0xeda9 bytes) 000859 1777421639.419983 write 0x00198d thru 0x0030b8 (0x172c bytes) 000860 1777421639.421949 mapwrite 0x011139 thru 0x0189b6 (0x787e bytes) 000861 1777421639.454145 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d59b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d59b): Mirror 2: 0xef5d9cf3 (stale) CRC-32 checksum value for chunk [0, 0x3d59b): Mirror 1: 0xce99176 Mirror 3: 0xce99176 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d59b: skipped 000863 1777421639.820170 read 0x032806 thru 0x032851 (0x4c bytes) 000866 1777421639.842352 write 0x01dc82 thru 0x01f9c3 (0x1d42 bytes) 000868 1777421639.891923 MIRROR_RESYNC 3 mirrors 000870 1777421640.299682 trunc from 0x03d59b to 0x02aea8 (0x126f2 bytes) 000872 1777421640.321693 write 0x01689d thru 0x020ad5 (0xa239 bytes) 000876 1777421640.328680 mapread 0x02468f thru 0x027dc0 (0x3732 bytes) 000878 1777421640.334163 write 0x0350fe thru 0x03b0ac (0x5faf bytes) 000879 1777421640.335774 mapwrite 0x00d261 thru 0x01c165 (0xef05 bytes) 000882 1777421640.368900 trunc from 0x03b0ad to 0x0061c8 (0x34ee4 bytes) 000883 1777421640.385264 mapwrite 0x021cb4 thru 0x0263ee (0x473b bytes) 000884 1777421640.428674 mapwrite 0x00e46f thru 0x011bcf (0x3761 bytes) 000885 1777421640.464920 write 0x029300 thru 0x0310e1 (0x7de2 bytes) 000887 1777421640.467794 write 0x031ed5 thru 0x039b36 (0x7c62 bytes) 000888 1777421640.469564 read 0x0142ad thru 0x018eb7 (0x4c0b bytes) 000889 1777421640.474274 read 0x02a833 thru 0x031296 (0x6a64 bytes) 000891 1777421640.475984 write 0x012c1e thru 0x01cb2d (0x9f10 bytes) 000892 1777421640.477341 mapwrite 0x01d65f thru 0x02715e (0x9b00 bytes) 000893 1777421640.510225 read 0x029364 thru 0x02a972 (0x160f bytes) 000894 1777421640.510900 mapwrite 0x02b290 thru 0x02f462 (0x41d3 bytes) 000895 1777421640.535281 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x39b37): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39b37): Mirror 2: 0x5949e42c (stale) Mirror 3: 0x5949e42c (stale) CRC-32 checksum value for chunk [0, 0x39b37): Mirror 1: 0xf8c90c28 Mirror 4: 0xf8c90c28 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39b37: skipped 000896 1777421640.884021 trunc from 0x039b37 to 0x02d9e8 (0xc14e bytes) 000898 1777421640.941260 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d9e9): Mirror 3: 0xaae6f320 (stale) Mirror 4: 0x3aa46ab8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d9e9): Mirror 3: 0xaae6f320 (stale) Mirror 4: 0x3aa46ab8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d9e9: skipped 000899 1777421641.121579 write 0x008133 thru 0x00f3cd (0x729b bytes) 000902 1777421641.131662 read 0x024e2c thru 0x02d9e8 (0x8bbd bytes) 000905 1777421641.142578 mapwrite 0x00e277 thru 0x011686 (0x3410 bytes) 000906 1777421641.185692 write 0x028b93 thru 0x0313a3 (0x8811 bytes) 000907 1777421641.187662 trunc from 0x0313a4 to 0x02175e (0xfc45 bytes) 000908 1777421641.200199 mapwrite 0x0012ae thru 0x00b68b (0xa3de bytes) 000909 1777421641.238411 mapwrite 0x017621 thru 0x027554 (0xff34 bytes) 000912 1777421641.303037 read 0x001b28 thru 0x0115f0 (0xfac9 bytes) 000913 1777421641.303778 mapread 0x015b1c thru 0x015dc4 (0x2a9 bytes) 000914 1777421641.305065 write 0x020097 thru 0x02e80b (0xe775 bytes) 000915 1777421641.306462 trunc from 0x02e80c to 0x03746e (0x8c63 bytes) 000917 1777421641.316495 write 0x00699e thru 0x009d06 (0x3369 bytes) 000918 1777421641.317686 trunc from 0x03746f to 0x00aa90 (0x2c9de bytes) 000919 1777421641.327209 read 0x0066b7 thru 0x00aa90 (0x43da bytes) 000920 1777421641.327932 mapread 0x000d09 thru 0x00aa90 (0x9d88 bytes) 000922 1777421641.335503 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xaa91): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xaa91): Mirror 3: 0x17bc948f (stale) Mirror 4: 0x3189205e (stale) CRC-32 checksum value for chunk [0, 0xaa91): Mirror 1: 0x7d9aa239 Mirror 5: 0x7d9aa239 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xaa91: skipped 000925 1777421641.694395 write 0x014a71 thru 0x01cb1a (0x80aa bytes) 000926 1777421641.733421 mapread 0x01c27a thru 0x01cb1a (0x8a1 bytes) 000928 1777421641.734818 read 0x013eaa thru 0x01cb1a (0x8c71 bytes) 000930 1777421641.739990 read 0x0126e9 thru 0x01cb1a (0xa432 bytes) 000931 1777421641.745705 write 0x03f41a thru 0x03ffff (0xbe6 bytes) truncating to largest ever: 0x3e643 000932 1777421641.747011 trunc from 0x040000 to 0x03e642 (0x19bd bytes) 000934 1777421641.774357 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e643): Mirror 3: 0x6f430727 (stale) Mirror 4: 0x2622cef4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e643): Mirror 3: 0x6f430727 (stale) Mirror 4: 0x2622cef4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e643: skipped 000935 1777421641.937691 read 0x005c1d thru 0x00b6d4 (0x5ab8 bytes) 000936 1777421641.942343 trunc from 0x03e643 to 0x031fb2 (0xc690 bytes) 000937 1777421641.951020 trunc from 0x031fb3 to 0x024636 (0xd97c bytes) 000940 1777421641.959157 mapwrite 0x0308e0 thru 0x03b958 (0xb079 bytes) 000943 1777421642.016356 mapwrite 0x02ad2d thru 0x02e18d (0x3461 bytes) 000944 1777421642.047457 read 0x011132 thru 0x01ab26 (0x99f5 bytes) 000946 1777421642.055089 mapwrite 0x006819 thru 0x013802 (0xcfea bytes) 000948 1777421642.092344 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b959): Mirror 3: 0x741cbef9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b959): Mirror 3: 0x741cbef9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b959: skipped truncating to largest ever: 0x3ec44 000951 1777421642.236909 trunc from 0x03b959 to 0x03ec43 (0x32eb bytes) 000952 1777421642.247498 write 0x02b0f9 thru 0x03425c (0x9164 bytes) 000957 1777421642.260360 write 0x03bbb0 thru 0x03ffff (0x4450 bytes) 000958 1777421642.268727 write 0x03c7da thru 0x03ffff (0x3826 bytes) 000959 1777421642.269870 trunc from 0x040000 to 0x017fb6 (0x28049 bytes) 000961 1777421642.293509 MIRROR_RESYNC 2 mirrors 000962 1777421642.575057 mapwrite 0x03589e thru 0x03ffff (0xa762 bytes) 000964 1777421642.666472 MIRROR_RESYNC 2 mirrors 000967 1777421642.901903 write 0x02654b thru 0x02ed8c (0x8842 bytes) 000970 1777421642.933984 mapread 0x002e2d thru 0x011cfc (0xeed0 bytes) 000971 1777421642.947918 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xeeaf169a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x78dbef3c Mirror 4: 0x78dbef3c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000972 1777421643.276552 read 0x018a79 thru 0x023654 (0xabdc bytes) 000974 1777421643.289385 mapread 0x02a338 thru 0x02bf3e (0x1c07 bytes) 000975 1777421643.302605 write 0x010133 thru 0x016174 (0x6042 bytes) 000976 1777421643.344699 mapread 0x00788c thru 0x00b4e0 (0x3c55 bytes) 000977 1777421643.351039 write 0x00562f thru 0x00ca20 (0x73f2 bytes) 000978 1777421643.352325 trunc from 0x040000 to 0x00a247 (0x35db8 bytes) 000980 1777421643.366907 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xa248): Mirror 4: 0x573501e5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa248): Mirror 4: 0x573501e5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa248: skipped 000981 1777421643.487038 write 0x001f4e thru 0x003093 (0x1146 bytes) 000983 1777421643.492915 trunc from 0x00a248 to 0x03c019 (0x31dd2 bytes) 000988 1777421643.504250 mapwrite 0x00c232 thru 0x016684 (0xa453 bytes) 000989 1777421643.546602 read 0x0232a8 thru 0x02f8cb (0xc624 bytes) 000990 1777421643.554349 write 0x018780 thru 0x027bd1 (0xf452 bytes) 000991 1777421643.555400 mapread 0x001375 thru 0x00d8ec (0xc578 bytes) 000992 1777421643.562166 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x384:0x0]: Invalid argument (22) 000993 1777421643.654262 mapread 0x012c5b thru 0x022954 (0xfcfa bytes) 000994 1777421643.673448 trunc from 0x03c01a to 0x01cccc (0x1f34d bytes) 000995 1777421643.682349 mapwrite 0x00ddf0 thru 0x01d6a0 (0xf8b1 bytes) truncating to largest ever: 0x3f4e0 000996 1777421643.723362 trunc from 0x01d6a1 to 0x03f4df (0x21e3f bytes) 000998 1777421643.731504 read 0x000125 thru 0x00d184 (0xd060 bytes) 000999 1777421643.735748 trunc from 0x03f4e0 to 0x0095f1 (0x35eee bytes) 001000 1777421643.743755 mapwrite 0x01ebd3 thru 0x023435 (0x4863 bytes) All operations completed A-OK!