== sanity-flr test 70a: flr mode fsx test ================ 16:21:13 (1787862073) Seed set to 2075 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000002 1787862075.438185 mapwrite 0x02146b thru 0x0250d0 (0x3c66 bytes) 000003 1787862075.556622 write 0x03d32e thru 0x03ffff (0x2cd2 bytes) 000006 1787862075.558794 mapwrite 0x020d16 thru 0x024577 (0x3862 bytes) 000007 1787862075.651651 MIRROR_EXTEND to 2 mirrors 000010 1787862076.727269 write 0x034ef7 thru 0x038beb (0x3cf5 bytes) truncating to largest ever: 0x3bcf9 000011 1787862076.813581 trunc from 0x040000 to 0x03bcf8 (0x4307 bytes) 000013 1787862076.841149 read 0x0148f2 thru 0x02322c (0xe93b bytes) 000014 1787862076.854504 write 0x0029de thru 0x003d3a (0x135d bytes) 000015 1787862076.863767 mapread 0x020f21 thru 0x028847 (0x7927 bytes) 000016 1787862076.885147 write 0x022f61 thru 0x02eca4 (0xbd44 bytes) 000017 1787862076.891635 mapwrite 0x012191 thru 0x01ed97 (0xcc07 bytes) 000018 1787862076.969523 read 0x0112de thru 0x01fecd (0xebf0 bytes) 000019 1787862076.970882 mapread 0x01eec1 thru 0x01f4e0 (0x620 bytes) 000020 1787862076.985513 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3bcf9): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bcf9): Mirror 2: 0x2e8e5eb3 (stale) CRC-32 checksum value for chunk [0, 0x3bcf9): Mirror 1: 0x4011bacd Mirror 3: 0x4011bacd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bcf9: skipped 000021 1787862078.253511 mapwrite 0x03fc5f thru 0x03ffff (0x3a1 bytes) 000022 1787862078.352267 mapread 0x00c439 thru 0x00c742 (0x30a bytes) 000025 1787862078.358694 mapread 0x027203 thru 0x0322a9 (0xb0a7 bytes) 000026 1787862078.384591 read 0x017cb2 thru 0x025ff1 (0xe340 bytes) 000028 1787862078.398828 trunc from 0x040000 to 0x0376af (0x8950 bytes) 000029 1787862078.428081 read 0x01cd4a thru 0x01fcf7 (0x2fae bytes) 000030 1787862078.429618 read 0x019ec5 thru 0x0215d2 (0x770e bytes) 000032 1787862078.438275 MIRROR_RESYNC 3 mirrors 000033 1787862079.560963 mapread 0x02f166 thru 0x02f7c2 (0x65d bytes) 000035 1787862079.568520 write 0x030f95 thru 0x032e32 (0x1e9e bytes) 000037 1787862079.652220 mapwrite 0x03e5c9 thru 0x03ffff (0x1a37 bytes) 000044 1787862079.739845 write 0x00854c thru 0x014dbe (0xc873 bytes) 000045 1787862079.759926 trunc from 0x040000 to 0x037c4c (0x83b3 bytes) 000047 1787862079.785488 MIRROR_RESYNC 3 mirrors 000049 1787862080.602098 read 0x000f15 thru 0x00cb88 (0xbc74 bytes) truncating to largest ever: 0x3c1dc 000050 1787862080.621863 trunc from 0x037c4d to 0x03c1db (0x458f bytes) 000051 1787862080.697925 mapwrite 0x01c70b thru 0x024e94 (0x878a bytes) 000053 1787862080.842099 mapwrite 0x00b250 thru 0x01a880 (0xf631 bytes) 000054 1787862081.010587 trunc from 0x03c1dc to 0x02169b (0x1ab40 bytes) 000055 1787862081.086839 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x197:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2169c): Mirror 3: 0xa45abf10 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2169c): Mirror 3: 0xa45abf10 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2169c: skipped 000056 1787862081.440321 write 0x018a2e thru 0x019966 (0xf39 bytes) 000057 1787862081.453533 read 0x010519 thru 0x01d9a2 (0xd48a bytes) 000058 1787862081.462977 trunc from 0x02169c to 0x011ac7 (0xfbd4 bytes) 000059 1787862081.485238 mapread 0x00983b thru 0x011ac7 (0x828d bytes) 000061 1787862081.532712 mapread 0x00dd9a thru 0x011ac7 (0x3d2e bytes) 000062 1787862081.534499 trunc from 0x011ac8 to 0x031bf6 (0x2012f bytes) 000063 1787862081.565761 MIRROR_RESYNC 2 mirrors 000068 1787862082.378096 trunc from 0x031bf7 to 0x033647 (0x1a51 bytes) 000070 1787862082.441128 mapwrite 0x012abf thru 0x020bd1 (0xe113 bytes) 000071 1787862082.587074 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x197:0x0]: Invalid argument (22) 000073 1787862082.877829 mapwrite 0x01bd5e thru 0x01cf90 (0x1233 bytes) 000074 1787862083.020010 mapwrite 0x03c171 thru 0x03ffd9 (0x3e69 bytes) 000077 1787862083.143389 trunc from 0x03ffda to 0x007dab (0x3822e bytes) 000079 1787862083.163411 mapread 0x0018ed thru 0x002c5a (0x136e bytes) 000082 1787862083.173648 write 0x01165a thru 0x01f863 (0xe20a bytes) 000085 1787862083.176324 mapwrite 0x02fa3d thru 0x03ef11 (0xf4d5 bytes) 000086 1787862083.273955 trunc from 0x03ef12 to 0x00b71c (0x337f5 bytes) 000092 1787862083.301637 write 0x0292bb thru 0x03553a (0xc280 bytes) 000093 1787862083.308368 mapwrite 0x0367d7 thru 0x03ffff (0x9829 bytes) 000094 1787862083.540445 trunc from 0x040000 to 0x02dc35 (0x123ca bytes) 000096 1787862083.563614 mapwrite 0x01aec5 thru 0x02065a (0x5796 bytes) 000097 1787862083.647446 write 0x02299c thru 0x02d059 (0xa6be bytes) 000098 1787862083.650350 read 0x024567 thru 0x02dc35 (0x96cf bytes) 000099 1787862083.651428 trunc from 0x02dc36 to 0x017baa (0x1608b bytes) 000100 1787862083.686831 mapread 0x00e111 thru 0x017baa (0x9a9a bytes) 000101 1787862083.698025 write 0x01dd0f thru 0x01e197 (0x489 bytes) 000102 1787862083.702634 MIRROR_EXTEND to 2 mirrors 000104 1787862084.837584 trunc from 0x01e198 to 0x02fa8e (0x118f7 bytes) 000106 1787862085.015144 trunc from 0x02fa8f to 0x01aca3 (0x14deb bytes) 000107 1787862085.061425 mapread 0x0135b5 thru 0x014ed2 (0x191e bytes) 000108 1787862085.105536 trunc from 0x01aca4 to 0x03a87e (0x1fbdb bytes) 000109 1787862085.135634 write 0x00c221 thru 0x012154 (0x5f34 bytes) 000110 1787862085.163320 write 0x01f72b thru 0x02200d (0x28e3 bytes) 000111 1787862085.186492 mapwrite 0x026f18 thru 0x027eb4 (0xf9d bytes) 000112 1787862085.346518 mapwrite 0x0094b5 thru 0x019388 (0xfed4 bytes) 000114 1787862085.554335 mapwrite 0x00aff0 thru 0x00d91e (0x292f bytes) 000115 1787862085.709419 mapread 0x018fed thru 0x0264ad (0xd4c1 bytes) 000116 1787862085.729071 read 0x02ca05 thru 0x031ac6 (0x50c2 bytes) 000117 1787862085.751402 read 0x032316 thru 0x035db8 (0x3aa3 bytes) 000118 1787862085.816046 write 0x01d3bb thru 0x0242a1 (0x6ee7 bytes) 000121 1787862085.822010 write 0x01680c thru 0x0197a5 (0x2f9a bytes) 000122 1787862085.841379 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x197:0x0]: Invalid argument (22) 000123 1787862086.202368 mapwrite 0x02df28 thru 0x033007 (0x50e0 bytes) 000124 1787862086.353413 write 0x001e08 thru 0x00d97c (0xbb75 bytes) 000126 1787862086.378969 MIRROR_EXTEND to 2 mirrors 000127 1787862088.215778 trunc from 0x03a87f to 0x001198 (0x396e6 bytes) 000129 1787862088.304055 read 0x000f8c thru 0x001198 (0x20d bytes) 000131 1787862088.312408 read 0x000668 thru 0x0006e8 (0x81 bytes) 000132 1787862088.313011 write 0x005b84 thru 0x013bc1 (0xe03e bytes) 000134 1787862088.316760 trunc from 0x013bc2 to 0x011af3 (0x20ce bytes) 000135 1787862088.339233 write 0x00fa15 thru 0x0154bc (0x5aa8 bytes) 000136 1787862088.341208 mapwrite 0x00bd65 thru 0x016607 (0xa8a3 bytes) 000138 1787862088.422002 mapread 0x0144e4 thru 0x016607 (0x2124 bytes) 000143 1787862088.428588 write 0x024aa5 thru 0x02b6c3 (0x6c1f bytes) 000145 1787862088.432589 mapwrite 0x009719 thru 0x014d22 (0xb60a bytes) 000147 1787862088.493869 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x197:0x0]: Invalid argument (22) 000149 1787862088.674620 trunc from 0x02b6c4 to 0x0083bf (0x23304 bytes) 000150 1787862088.699801 read 0x001970 thru 0x0083bf (0x6a50 bytes) 000151 1787862088.711959 read 0x0017b9 thru 0x0053c3 (0x3c0b bytes) 000152 1787862088.717727 read 0x00603c thru 0x0083bf (0x2384 bytes) 000154 1787862088.719412 write 0x0159d3 thru 0x01c403 (0x6a31 bytes) 000156 1787862088.721364 mapread 0x0171bc thru 0x01c403 (0x5248 bytes) 000157 1787862088.722586 read 0x00b409 thru 0x015e66 (0xaa5e bytes) 000164 1787862088.758801 read 0x014c51 thru 0x019e35 (0x51e5 bytes) 000166 1787862088.770585 MIRROR_EXTEND to 2 mirrors 000168 1787862089.437790 trunc from 0x01c404 to 0x005669 (0x16d9a bytes) 000169 1787862089.545243 write 0x036905 thru 0x03fc93 (0x938f bytes) 000170 1787862089.547394 read 0x02cefe thru 0x035de6 (0x8ee9 bytes) 000171 1787862089.564109 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x197:0x0]: Invalid argument (22) 000172 1787862089.723390 trunc from 0x03fc94 to 0x01da0a (0x22289 bytes) 000174 1787862089.743782 mapread 0x0182df thru 0x01da0a (0x572c bytes) 000175 1787862089.758923 mapwrite 0x01ed20 thru 0x026807 (0x7ae8 bytes) 000176 1787862089.988182 trunc from 0x026808 to 0x032753 (0xbf4c bytes) 000177 1787862090.027613 mapread 0x02a72a thru 0x032753 (0x802a bytes) 000178 1787862090.040824 mapread 0x00d7b1 thru 0x01a1e9 (0xca39 bytes) 000182 1787862090.067688 read 0x01eda5 thru 0x02316c (0x43c8 bytes) 000183 1787862090.068318 write 0x018377 thru 0x01f769 (0x73f3 bytes) 000185 1787862090.093428 mapread 0x01a349 thru 0x022d80 (0x8a38 bytes) 000188 1787862090.095474 read 0x0173c1 thru 0x01927a (0x1eba bytes) 000189 1787862090.104969 mapread 0x018ae6 thru 0x026371 (0xd88c bytes) 000190 1787862090.109386 mapwrite 0x01b58c thru 0x01cde6 (0x185b bytes) 000194 1787862090.178413 mapwrite 0x002cc3 thru 0x00745b (0x4799 bytes) 000195 1787862090.308361 trunc from 0x032754 to 0x01652f (0x1c224 bytes) 000199 1787862090.346341 write 0x031265 thru 0x037728 (0x64c4 bytes) 000200 1787862090.353144 read 0x022874 thru 0x02b4f8 (0x8c85 bytes) 000201 1787862090.365483 write 0x033bf9 thru 0x03acbb (0x70c3 bytes) 000202 1787862090.366748 mapread 0x035b6c thru 0x038ea8 (0x333d bytes) 000203 1787862090.367557 trunc from 0x03acbc to 0x0227fd (0x184be bytes) 000205 1787862090.426933 read 0x022453 thru 0x0227fd (0x3ab bytes) 000206 1787862090.430783 write 0x011c85 thru 0x01303f (0x13bb bytes) 000207 1787862090.432768 write 0x0287ad thru 0x03827e (0xfad2 bytes) 000211 1787862090.444593 read 0x01f4ab thru 0x024c63 (0x57b9 bytes) 000213 1787862090.455040 read 0x01bf92 thru 0x029bbd (0xdc2c bytes) 000214 1787862090.455686 read 0x00bc74 thru 0x00e2fe (0x268b bytes) 000215 1787862090.456194 read 0x032088 thru 0x03827e (0x61f7 bytes) 000216 1787862090.456722 read 0x00a3f6 thru 0x01601d (0xbc28 bytes) 000217 1787862090.470533 read 0x0256b5 thru 0x026e45 (0x1791 bytes) 000218 1787862090.471280 write 0x02fda8 thru 0x033f77 (0x41d0 bytes) 000219 1787862090.473733 trunc from 0x03827f to 0x016888 (0x219f6 bytes) 000220 1787862090.503787 trunc from 0x016889 to 0x022e40 (0xc5b8 bytes) 000221 1787862090.547319 trunc from 0x022e41 to 0x004936 (0x1e50a bytes) 000222 1787862090.584732 mapwrite 0x00e91d thru 0x01da27 (0xf10b bytes) 000223 1787862090.794286 mapwrite 0x0398e4 thru 0x03e9e4 (0x5101 bytes) 000224 1787862090.977054 mapread 0x008aea thru 0x016c90 (0xe1a7 bytes) 000225 1787862090.978179 trunc from 0x03e9e5 to 0x004a29 (0x39fbb bytes) 000226 1787862091.000224 write 0x03aea4 thru 0x03ffff (0x515c bytes) 000227 1787862091.011853 MIRROR_EXTEND to 2 mirrors 000229 1787862092.026073 trunc from 0x040000 to 0x00b517 (0x34ae8 bytes) 000230 1787862092.120268 write 0x009bb2 thru 0x015bcc (0xc01b bytes) 000231 1787862092.130957 write 0x03d5e7 thru 0x03ffff (0x2a19 bytes) 000233 1787862092.134247 write 0x032e55 thru 0x038991 (0x5b3d bytes) 000238 1787862092.153175 write 0x024d32 thru 0x02d0e2 (0x83b1 bytes) 000239 1787862092.179530 read 0x02f397 thru 0x039541 (0xa1ab bytes) 000240 1787862092.196142 read 0x018a9a thru 0x01cec4 (0x442b bytes) 000241 1787862092.214391 read 0x02c189 thru 0x035a76 (0x98ee bytes) 000242 1787862092.215489 mapread 0x003579 thru 0x0043b3 (0xe3b bytes) 000244 1787862092.230225 MIRROR_RESYNC 2 mirrors 000245 1787862093.582567 write 0x00a615 thru 0x014743 (0xa12f bytes) 000250 1787862093.828476 mapwrite 0x012e86 thru 0x01835e (0x54d9 bytes) 000251 1787862094.168323 write 0x03499b thru 0x0365c8 (0x1c2e bytes) 000252 1787862094.194456 write 0x0305c2 thru 0x0346be (0x40fd bytes) 000253 1787862094.218542 mapwrite 0x01a388 thru 0x026955 (0xc5ce bytes) 000255 1787862094.388159 trunc from 0x040000 to 0x017372 (0x28c8d bytes) 000256 1787862094.466816 trunc from 0x017373 to 0x000f5d (0x16415 bytes) 000258 1787862094.505515 mapwrite 0x03b2bd thru 0x03ffff (0x4d43 bytes) 000261 1787862094.693772 write 0x022e66 thru 0x0324bf (0xf65a bytes) 000262 1787862094.707546 read 0x00bafb thru 0x015e31 (0xa337 bytes) 000265 1787862094.730469 write 0x03f6be thru 0x03ffff (0x942 bytes) 000267 1787862094.741817 MIRROR_RESYNC 2 mirrors 000271 1787862095.830916 trunc from 0x040000 to 0x01cf3f (0x230c0 bytes) 000272 1787862096.054597 read 0x0138aa thru 0x01cf3f (0x9696 bytes) 000273 1787862096.091989 read 0x013607 thru 0x01848d (0x4e87 bytes) 000278 1787862096.101827 mapread 0x00adaa thru 0x01a984 (0xfbdb bytes) 000279 1787862096.147390 mapread 0x005e6c thru 0x00963e (0x37d3 bytes) 000282 1787862096.153331 trunc from 0x01cf40 to 0x012977 (0xa5c8 bytes) 000283 1787862096.220836 read 0x00d922 thru 0x00f1d5 (0x18b4 bytes) 000284 1787862096.223412 trunc from 0x012978 to 0x034787 (0x21e10 bytes) 000285 1787862096.259965 read 0x00a072 thru 0x01936a (0xf2f9 bytes) 000286 1787862096.323919 mapwrite 0x0335c4 thru 0x03dbd1 (0xa60e bytes) 000288 1787862096.461411 trunc from 0x03dbd2 to 0x032332 (0xb89f bytes) 000291 1787862096.482502 trunc from 0x032333 to 0x038c09 (0x68d7 bytes) 000292 1787862096.500820 trunc from 0x038c0a to 0x017fc6 (0x20c43 bytes) 000294 1787862096.521522 mapwrite 0x01ff84 thru 0x02c904 (0xc981 bytes) 000296 1787862096.737483 mapwrite 0x036012 thru 0x03ffff (0x9fee bytes) 000298 1787862096.981426 mapread 0x00513f thru 0x005ec1 (0xd83 bytes) 000300 1787862096.985231 mapread 0x008cab thru 0x014790 (0xbae6 bytes) 000302 1787862096.986949 read 0x0251a0 thru 0x02d379 (0x81da bytes) 000303 1787862097.003900 mapwrite 0x00b8f5 thru 0x00e435 (0x2b41 bytes) 000304 1787862097.216878 mapwrite 0x03abec thru 0x03ffff (0x5414 bytes) 000305 1787862097.392278 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x197:0x0]: Invalid argument (22) 000307 1787862097.608879 write 0x01b303 thru 0x02a76a (0xf468 bytes) 000309 1787862097.668543 MIRROR_EXTEND to 2 mirrors 000311 1787862099.377138 trunc from 0x040000 to 0x026d74 (0x1928b bytes) 000312 1787862099.480969 read 0x0003e0 thru 0x00ce04 (0xca25 bytes) 000315 1787862099.493856 mapwrite 0x010e58 thru 0x01499a (0x3b43 bytes) 000318 1787862099.570271 trunc from 0x026d75 to 0x01227a (0x14afa bytes) 000320 1787862099.601314 read 0x005ea6 thru 0x00b233 (0x538e bytes) 000321 1787862099.603854 mapread 0x00cf84 thru 0x01227a (0x52f7 bytes) 000322 1787862099.605303 mapread 0x0071a4 thru 0x01227a (0xb0d7 bytes) 000324 1787862099.607907 read 0x0061e2 thru 0x00a7ea (0x4609 bytes) 000326 1787862099.609423 write 0x0018e0 thru 0x00c936 (0xb057 bytes) 000327 1787862099.611315 write 0x02390a thru 0x024ad5 (0x11cc bytes) 000329 1787862099.617944 MIRROR_RESYNC 2 mirrors 000330 1787862100.776846 write 0x025caa thru 0x033d05 (0xe05c bytes) 000332 1787862101.014387 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x197:0x0]: Invalid argument (22) 000333 1787862101.336272 MIRROR_EXTEND to 2 mirrors 000336 1787862102.942611 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x197:0x0]: Invalid argument (22) 000338 1787862103.152835 read 0x0112ba thru 0x01a744 (0x948b bytes) 000340 1787862103.168598 read 0x008ef3 thru 0x0155d1 (0xc6df bytes) 000343 1787862103.205346 write 0x000967 thru 0x008481 (0x7b1b bytes) 000344 1787862103.242251 trunc from 0x033d06 to 0x0399dd (0x5cd8 bytes) 000345 1787862103.266741 trunc from 0x0399de to 0x00a0aa (0x2f933 bytes) 000346 1787862103.295905 trunc from 0x00a0ab to 0x0309c4 (0x2691a bytes) 000347 1787862103.345247 write 0x0011ac thru 0x002f8c (0x1de1 bytes) 000348 1787862103.352963 mapwrite 0x00e429 thru 0x0102b4 (0x1e8c bytes) 000349 1787862103.600165 write 0x03ba1f thru 0x03fba6 (0x4188 bytes) 000350 1787862103.603995 mapread 0x02fcef thru 0x03aeea (0xb1fc bytes) 000351 1787862103.703560 mapread 0x018f2b thru 0x028c10 (0xfce6 bytes) 000354 1787862103.961100 mapwrite 0x0054da thru 0x00a863 (0x538a bytes) 000355 1787862104.113297 write 0x00a5d3 thru 0x00d694 (0x30c2 bytes) 000358 1787862104.121249 write 0x023a39 thru 0x02f36c (0xb934 bytes) 000359 1787862104.124416 mapwrite 0x03ef2a thru 0x03ffff (0x10d6 bytes) 000361 1787862104.248172 write 0x01c3a7 thru 0x027ea0 (0xbafa bytes) 000363 1787862104.253436 write 0x02c670 thru 0x03c64f (0xffe0 bytes) 000364 1787862104.257245 mapwrite 0x00cfbd thru 0x010713 (0x3757 bytes) 000365 1787862104.457606 MIRROR_EXTEND to 2 mirrors 000371 1787862105.834613 mapwrite 0x034dcf thru 0x039a8d (0x4cbf bytes) 000372 1787862106.062980 mapread 0x02f817 thru 0x034356 (0x4b40 bytes) 000373 1787862106.065751 mapwrite 0x01e0c8 thru 0x024c40 (0x6b79 bytes) 000375 1787862106.135838 mapread 0x026e01 thru 0x02ddac (0x6fac bytes) 000377 1787862106.151199 mapwrite 0x0146be thru 0x01933b (0x4c7e bytes) 000380 1787862106.233312 trunc from 0x040000 to 0x003328 (0x3ccd7 bytes) 000381 1787862106.266388 MIRROR_RESYNC 2 mirrors 000384 1787862107.179484 mapread 0x000214 thru 0x003328 (0x3115 bytes) 000385 1787862107.234545 mapwrite 0x02dc1b thru 0x032107 (0x44ed bytes) 000386 1787862107.654590 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x197:0x0]: Invalid argument (22) 000389 1787862107.904013 trunc from 0x032108 to 0x010541 (0x21bc6 bytes) 000391 1787862107.929213 trunc from 0x010542 to 0x0002c6 (0x1027b bytes) 000392 1787862107.950824 trunc from 0x0002c7 to 0x00621d (0x5f57 bytes) 000393 1787862107.972413 mapread 0x00088e thru 0x005708 (0x4e7b bytes) 000394 1787862107.999253 mapread 0x00108a thru 0x0038ff (0x2876 bytes) 000395 1787862108.000125 mapwrite 0x013f8f thru 0x0175c5 (0x3637 bytes) 000399 1787862108.130707 trunc from 0x0175c6 to 0x023136 (0xbb71 bytes) 000400 1787862108.179019 mapread 0x01df95 thru 0x023136 (0x51a2 bytes) 000402 1787862108.223201 mapwrite 0x011430 thru 0x01149b (0x6c bytes) 000404 1787862108.304978 mapwrite 0x022709 thru 0x030021 (0xd919 bytes) 000405 1787862108.536733 mapread 0x00d81a thru 0x00da41 (0x228 bytes) 000406 1787862108.542871 mapwrite 0x018797 thru 0x01ba2f (0x3299 bytes) 000408 1787862108.745134 write 0x01dd35 thru 0x01df32 (0x1fe bytes) 000410 1787862108.751423 read 0x006d57 thru 0x0094cb (0x2775 bytes) 000413 1787862108.770596 mapread 0x02952e thru 0x030021 (0x6af4 bytes) 000416 1787862108.779443 trunc from 0x030022 to 0x02ec19 (0x1408 bytes) 000419 1787862108.866502 mapread 0x00369c thru 0x00f0ba (0xba1f bytes) 000420 1787862108.900437 write 0x039e54 thru 0x03ea7a (0x4c27 bytes) 000421 1787862108.910572 mapwrite 0x0055a5 thru 0x00d3ac (0x7e08 bytes) 000423 1787862109.198231 write 0x03f27a thru 0x03ffff (0xd86 bytes) 000424 1787862109.216140 MIRROR_EXTEND to 2 mirrors 000425 1787862110.917814 mapwrite 0x01b149 thru 0x026d31 (0xbbe9 bytes) 000426 1787862111.556434 write 0x035eb8 thru 0x03aac5 (0x4c0e bytes) 000427 1787862111.582330 mapwrite 0x03c1e5 thru 0x03ffff (0x3e1b bytes) 000428 1787862111.775095 read 0x02f92e thru 0x03abdf (0xb2b2 bytes) 000429 1787862111.804105 read 0x03efea thru 0x03ffff (0x1016 bytes) 000430 1787862111.806057 mapwrite 0x006754 thru 0x00bbd8 (0x5485 bytes) 000431 1787862111.960248 trunc from 0x040000 to 0x033459 (0xcba6 bytes) 000434 1787862112.026105 mapread 0x003ef9 thru 0x004529 (0x631 bytes) 000437 1787862112.035634 write 0x0111f0 thru 0x01633f (0x5150 bytes) 000438 1787862112.040257 trunc from 0x03345a to 0x00c77a (0x26cdf bytes) 000440 1787862112.088384 read 0x00050f thru 0x00c77a (0xc26c bytes) 000443 1787862112.107300 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x197:0x0]: Invalid argument (22) 000447 1787862112.447351 read 0x005c93 thru 0x00b6d5 (0x5a43 bytes) 000448 1787862112.491530 read 0x00a173 thru 0x00c77a (0x2608 bytes) 000456 1787862112.534389 write 0x032f78 thru 0x03ffff (0xd088 bytes) 000459 1787862112.541522 mapwrite 0x024b7e thru 0x0281fd (0x3680 bytes) 000460 1787862112.610611 mapread 0x01cd0d thru 0x01cdd8 (0xcc bytes) 000461 1787862112.611861 mapwrite 0x03a407 thru 0x03ee5f (0x4a59 bytes) 000464 1787862112.675079 mapread 0x01f1c8 thru 0x029b8c (0xa9c5 bytes) 000465 1787862112.676336 read 0x00a837 thru 0x014402 (0x9bcc bytes) 000466 1787862112.678011 read 0x023202 thru 0x023fac (0xdab bytes) 000467 1787862112.679211 mapwrite 0x019d1e thru 0x01b42a (0x170d bytes) 000471 1787862112.731224 write 0x029bab thru 0x02c70e (0x2b64 bytes) 000472 1787862112.732904 read 0x02a190 thru 0x02ccf6 (0x2b67 bytes) 000477 1787862112.735449 trunc from 0x040000 to 0x030e6c (0xf193 bytes) 000480 1787862112.762216 mapwrite 0x00b08d thru 0x00dfc4 (0x2f38 bytes) 000481 1787862112.820947 mapwrite 0x0309b2 thru 0x03b06c (0xa6bb bytes) 000484 1787862112.931967 trunc from 0x03b06d to 0x035670 (0x59fc bytes) 000487 1787862112.960239 mapread 0x0322da thru 0x035670 (0x3397 bytes) 000492 1787862112.967608 write 0x023081 thru 0x0272f1 (0x4271 bytes) 000493 1787862112.970020 mapread 0x02f178 thru 0x0335fd (0x4486 bytes) 000496 1787862112.973355 mapread 0x0181cd thru 0x022d51 (0xab85 bytes) 000498 1787862112.976047 mapwrite 0x02d158 thru 0x033c49 (0x6af2 bytes) 000499 1787862113.052304 MIRROR_EXTEND to 2 mirrors 000500 1787862114.389970 write 0x0389c8 thru 0x03ffff (0x7638 bytes) 000502 1787862114.478535 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xfa99e8bc (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8ba526ef Mirror 3: 0x8ba526ef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000503 1787862116.481854 mapread 0x020a88 thru 0x0251bc (0x4735 bytes) 000504 1787862116.519307 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x197:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xfa99e8bc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xfa99e8bc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000507 1787862116.957640 write 0x017c74 thru 0x018e1a (0x11a7 bytes) 000508 1787862116.981895 trunc from 0x040000 to 0x01bea4 (0x2415b bytes) 000509 1787862117.004458 mapwrite 0x022ea1 thru 0x02de50 (0xafb0 bytes) 000510 1787862117.144118 trunc from 0x02de51 to 0x008128 (0x25d28 bytes) 000512 1787862117.178142 mapwrite 0x0107a6 thru 0x015a44 (0x529f bytes) 000513 1787862117.429266 trunc from 0x015a45 to 0x017b23 (0x20df bytes) 000514 1787862117.455867 trunc from 0x017b24 to 0x000d14 (0x16e0f bytes) 000516 1787862117.487326 mapread 0x000055 thru 0x000d14 (0xcc0 bytes) 000518 1787862117.506770 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xd15): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd15): Mirror 2: 0x4f57f824 (stale) CRC-32 checksum value for chunk [0, 0xd15): Mirror 1: 0x4f57f824 Mirror 3: 0x4f57f824 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd15: skipped 000520 1787862119.026165 trunc from 0x000d15 to 0x01b54a (0x1a836 bytes) 000521 1787862119.181971 mapread 0x00660d thru 0x010d81 (0xa775 bytes) 000522 1787862119.226979 mapread 0x004e57 thru 0x007ff1 (0x319b bytes) 000523 1787862119.229522 read 0x00bd6b thru 0x01b30b (0xf5a1 bytes) 000524 1787862119.255584 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x197:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b54b): Mirror 3: 0x33f7167d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b54b): Mirror 3: 0x33f7167d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b54b: skipped 000526 1787862119.715822 mapwrite 0x014acc thru 0x01acf9 (0x622e bytes) 000527 1787862119.902397 mapread 0x00df5f thru 0x010046 (0x20e8 bytes) 000528 1787862119.945714 MIRROR_RESYNC 2 mirrors 000530 1787862120.778795 MIRROR_EXTEND to 3 mirrors 000532 1787862122.612120 read 0x013dc3 thru 0x01a50c (0x674a bytes) 000533 1787862122.624133 read 0x005b34 thru 0x00cf9b (0x7468 bytes) 000535 1787862122.645149 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x197:0x0]: Invalid argument (22) 000537 1787862123.217292 mapread 0x00f095 thru 0x01b54a (0xc4b6 bytes) 000540 1787862123.268424 MIRROR_EXTEND to 3 mirrors 000541 1787862124.871785 MIRROR_RESYNC 3 mirrors 000543 1787862125.556836 mapread 0x01089e thru 0x017239 (0x699c bytes) 000544 1787862125.591398 mapread 0x010674 thru 0x01b54a (0xaed7 bytes) 000545 1787862125.602640 write 0x010cdd thru 0x015843 (0x4b67 bytes) truncating to largest ever: 0x3ca19 000546 1787862125.788763 trunc from 0x01b54b to 0x03ca18 (0x214ce bytes) 000549 1787862125.815730 read 0x018cd3 thru 0x01ed4a (0x6078 bytes) 000550 1787862125.826298 mapread 0x003508 thru 0x00b42c (0x7f25 bytes) 000552 1787862125.836405 trunc from 0x03ca19 to 0x008a66 (0x33fb2 bytes) 000555 1787862125.861230 write 0x0390ca thru 0x03ffff (0x6f36 bytes) 000556 1787862125.863628 trunc from 0x040000 to 0x00d3f9 (0x32c06 bytes) 000557 1787862125.885543 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x197:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xd3fa): Mirror 4: 0x6696c970 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd3fa): Mirror 4: 0x6696c970 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd3fa: skipped 000559 1787862126.492318 read 0x0015db thru 0x006984 (0x53aa bytes) 000560 1787862126.504478 read 0x00a286 thru 0x00d3f9 (0x3174 bytes) 000561 1787862126.514451 read 0x007a6d thru 0x00834e (0x8e2 bytes) 000564 1787862126.516323 write 0x02e83d thru 0x037bb3 (0x9377 bytes) 000565 1787862126.520581 read 0x02c9a7 thru 0x037bb3 (0xb20d bytes) 000566 1787862126.531716 write 0x02076c thru 0x021975 (0x120a bytes) 000569 1787862126.536826 mapwrite 0x007b3c thru 0x00acd9 (0x319e bytes) 000570 1787862126.602242 mapwrite 0x01b33b thru 0x01f047 (0x3d0d bytes) 000571 1787862126.660499 trunc from 0x037bb4 to 0x032a3e (0x5175 bytes) 000572 1787862126.681312 trunc from 0x032a3f to 0x00b242 (0x277fc bytes) 000573 1787862126.704713 read 0x002718 thru 0x00b242 (0x8b2b bytes) 000574 1787862126.707696 mapread 0x00263a thru 0x00b242 (0x8c09 bytes) 000575 1787862126.711415 mapwrite 0x036420 thru 0x03cf23 (0x6b04 bytes) 000576 1787862126.818599 mapwrite 0x000101 thru 0x00bc5b (0xbb5b bytes) 000578 1787862126.860407 mapwrite 0x0264c3 thru 0x02a14e (0x3c8c bytes) 000580 1787862126.920733 trunc from 0x03cf24 to 0x03c927 (0x5fc bytes) 000582 1787862126.959202 mapwrite 0x010bb8 thru 0x0152da (0x4723 bytes) 000583 1787862127.037000 write 0x037e28 thru 0x03ffff (0x81d8 bytes) 000584 1787862127.047377 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x197:0x0]: Invalid argument (22) 000589 1787862127.308222 mapread 0x01bc8e thru 0x01ed3b (0x30ae bytes) 000595 1787862127.344564 write 0x024c05 thru 0x02606f (0x146b bytes) 000600 1787862127.355604 mapread 0x02332c thru 0x026fd0 (0x3ca5 bytes) 000601 1787862127.356627 trunc from 0x040000 to 0x014241 (0x2bdbe bytes) 000602 1787862127.379972 MIRROR_EXTEND to 2 mirrors 000604 1787862127.951801 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x197:0x0]: Invalid argument (22) 000605 1787862128.167416 MIRROR_EXTEND to 2 mirrors 000606 1787862129.230867 trunc from 0x014242 to 0x03a1bd (0x25f7c bytes) 000608 1787862129.386523 MIRROR_RESYNC 2 mirrors 000609 1787862130.312496 mapread 0x027f47 thru 0x02e2b9 (0x6373 bytes) 000611 1787862130.337965 write 0x014369 thru 0x018022 (0x3cba bytes) 000614 1787862130.448029 read 0x030119 thru 0x030ee6 (0xdce bytes) 000615 1787862130.462167 mapwrite 0x026a7f thru 0x02df6d (0x74ef bytes) 000617 1787862130.630528 mapread 0x014d89 thru 0x024a0e (0xfc86 bytes) 000620 1787862130.643411 mapwrite 0x01aca6 thru 0x0276a7 (0xca02 bytes) 000624 1787862130.682154 mapread 0x01f660 thru 0x023cd4 (0x4675 bytes) 000626 1787862130.684184 trunc from 0x03a1be to 0x00ceba (0x2d303 bytes) 000628 1787862130.704399 trunc from 0x00cebb to 0x02cf0e (0x20054 bytes) 000629 1787862130.723177 mapread 0x025235 thru 0x02c85c (0x7628 bytes) 000632 1787862130.747077 write 0x003fea thru 0x00e819 (0xa830 bytes) 000633 1787862130.768407 MIRROR_RESYNC 2 mirrors 000634 1787862131.691835 MIRROR_RESYNC 2 mirrors 000636 1787862132.194352 mapread 0x018442 thru 0x018e61 (0xa20 bytes) 000637 1787862132.204321 MIRROR_RESYNC 2 mirrors 000638 1787862132.680780 mapread 0x0171e8 thru 0x022e91 (0xbcaa bytes) 000639 1787862132.699054 trunc from 0x02cf0f to 0x01a04f (0x12ebf bytes) 000640 1787862132.800073 trunc from 0x01a050 to 0x005237 (0x14e18 bytes) 000642 1787862132.877255 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x5238): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5238): Mirror 2: 0xccb72c42 (stale) CRC-32 checksum value for chunk [0, 0x5238): Mirror 1: 0xccb72c42 Mirror 3: 0xccb72c42 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5238: skipped 000643 1787862134.226349 trunc from 0x005238 to 0x02e9a2 (0x2976b bytes) 000645 1787862134.323847 mapwrite 0x036122 thru 0x03ffff (0x9ede bytes) 000647 1787862134.469993 mapread 0x025dcd thru 0x0305e2 (0xa816 bytes) 000648 1787862134.489718 mapwrite 0x03a505 thru 0x03ffff (0x5afb bytes) 000649 1787862134.526975 mapwrite 0x00eff0 thru 0x0153a8 (0x63b9 bytes) 000650 1787862134.561312 write 0x038c5a thru 0x03dc73 (0x501a bytes) 000651 1787862134.562177 trunc from 0x040000 to 0x01d0c9 (0x22f36 bytes) 000654 1787862134.581926 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1d0ca): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d0ca): Mirror 2: 0x80be8723 (stale) Mirror 3: 0xc4339424 (stale) CRC-32 checksum value for chunk [0, 0x1d0ca): Mirror 1: 0x372be15a Mirror 4: 0x372be15a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d0ca: skipped 000655 1787862135.268625 mapread 0x0122da thru 0x01559f (0x32c6 bytes) 000657 1787862135.285143 trunc from 0x01d0ca to 0x01b2e4 (0x1de5 bytes) 000658 1787862135.342104 read 0x01526a thru 0x01b2e4 (0x607b bytes) 000659 1787862135.351954 trunc from 0x01b2e5 to 0x011efa (0x93ea bytes) 000661 1787862135.377041 MIRROR_RESYNC 4 mirrors 000662 1787862136.042784 write 0x03a72c thru 0x03ffff (0x58d4 bytes) 000663 1787862136.093634 mapwrite 0x004af2 thru 0x006d1f (0x222e bytes) 000665 1787862136.158880 write 0x03826d thru 0x03ffff (0x7d93 bytes) 000666 1787862136.164440 mapwrite 0x009e84 thru 0x019536 (0xf6b3 bytes) 000669 1787862136.244960 read 0x03a421 thru 0x03ffff (0x5bdf bytes) 000670 1787862136.245559 write 0x024bcd thru 0x02feaf (0xb2e3 bytes) 000673 1787862136.258283 trunc from 0x040000 to 0x0317e7 (0xe818 bytes) 000675 1787862136.287950 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x317e8): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x317e8): Mirror 2: 0xe18b9515 (stale) Mirror 3: 0xe18b9515 (stale) Mirror 4: 0xe18b9515 (stale) CRC-32 checksum value for chunk [0, 0x317e8): Mirror 1: 0x384682d7 Mirror 5: 0x384682d7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x317e8: skipped truncating to largest ever: 0x3f8b6 000676 1787862137.255102 trunc from 0x0317e8 to 0x03f8b5 (0xe0ce bytes) 000678 1787862137.356410 read 0x016aa8 thru 0x0211e3 (0xa73c bytes) 000679 1787862137.369514 mapwrite 0x00c430 thru 0x011db2 (0x5983 bytes) 000686 1787862137.440531 trunc from 0x03f8b6 to 0x02397c (0x1bf39 bytes) 000687 1787862137.458020 trunc from 0x02397d to 0x012323 (0x11659 bytes) 000688 1787862137.468012 read 0x00e4cc thru 0x012323 (0x3e58 bytes) 000691 1787862137.469811 read 0x00a713 thru 0x012323 (0x7c11 bytes) 000693 1787862137.471410 trunc from 0x012324 to 0x006a20 (0xb903 bytes) 000695 1787862137.485844 read 0x004fc3 thru 0x006a20 (0x1a5e bytes) 000701 1787862137.499037 read 0x0027aa thru 0x006a20 (0x4277 bytes) 000702 1787862137.499992 mapread 0x001d1b thru 0x006a20 (0x4d06 bytes) 000703 1787862137.501272 read 0x000d5a thru 0x006a20 (0x5cc7 bytes) 000706 1787862137.507532 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x197:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x6a21): Mirror 3: 0x21b8382c (stale) Mirror 4: 0x21b8382c (stale) Mirror 5: 0x64d6590f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6a21): Mirror 3: 0x21b8382c (stale) Mirror 4: 0x21b8382c (stale) Mirror 5: 0x64d6590f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6a21: skipped 000710 1787862137.892376 write 0x0272eb thru 0x035449 (0xe15f bytes) 000711 1787862137.895502 mapwrite 0x0327a2 thru 0x03de0a (0xb669 bytes) 000713 1787862138.014086 trunc from 0x03de0b to 0x035e9f (0x7f6b bytes) 000720 1787862138.034508 read 0x021e13 thru 0x02a556 (0x8744 bytes) 000721 1787862138.045293 read 0x010888 thru 0x01812c (0x78a5 bytes) 000722 1787862138.060959 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x197:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35ea0): Mirror 3: 0x7b249f3e (stale) Mirror 5: 0x35ce6be (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35ea0): Mirror 3: 0x7b249f3e (stale) Mirror 5: 0x35ce6be (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35ea0: skipped 000724 1787862138.357467 write 0x0278dd thru 0x031b89 (0xa2ad bytes) 000726 1787862138.388528 mapread 0x031795 thru 0x035e9f (0x470b bytes) 000727 1787862138.409373 trunc from 0x035ea0 to 0x01013b (0x25d64 bytes) 000729 1787862138.438111 trunc from 0x01013c to 0x0374d4 (0x27399 bytes) 000731 1787862138.458193 write 0x038218 thru 0x03d8ff (0x56e8 bytes) 000732 1787862138.460810 read 0x029d7a thru 0x0311b7 (0x743e bytes) 000733 1787862138.470892 write 0x03110d thru 0x03c1eb (0xb0df bytes) 000735 1787862138.474315 read 0x0207ce thru 0x027253 (0x6a86 bytes) 000737 1787862138.485219 trunc from 0x03d900 to 0x01b38d (0x22572 bytes) 000738 1787862138.508247 write 0x037938 thru 0x03db70 (0x6239 bytes) 000739 1787862138.510949 write 0x01bd16 thru 0x021b6e (0x5e59 bytes) 000740 1787862138.518937 write 0x01d2b3 thru 0x027435 (0xa183 bytes) 000744 1787862138.536821 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x197:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3db71): Mirror 3: 0x41ed1b00 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3db71): Mirror 3: 0x41ed1b00 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3db71: skipped 000747 1787862138.903270 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x197:0x0]: Invalid argument (22) 000748 1787862139.026186 trunc from 0x03db71 to 0x03157a (0xc5f6 bytes) 000756 1787862139.060063 read 0x0100fe thru 0x01eb8b (0xea8e bytes) 000759 1787862139.071102 trunc from 0x03157b to 0x00cc41 (0x24939 bytes) 000761 1787862139.090233 mapread 0x00b6c8 thru 0x00cc41 (0x157a bytes) 000762 1787862139.108729 read 0x0090af thru 0x00cc41 (0x3b93 bytes) 000763 1787862139.119272 mapread 0x006f93 thru 0x00cc41 (0x5caf bytes) 000765 1787862139.121498 write 0x00ae23 thru 0x01320e (0x83ec bytes) 000769 1787862139.126086 read 0x00c797 thru 0x00cd6b (0x5d5 bytes) 000770 1787862139.127109 read 0x0011e3 thru 0x003bf3 (0x2a11 bytes) 000771 1787862139.127816 write 0x010e56 thru 0x013e6b (0x3016 bytes) 000774 1787862139.133083 read 0x010ab1 thru 0x013e6b (0x33bb bytes) 000775 1787862139.133898 mapwrite 0x031a63 thru 0x037bbc (0x615a bytes) 000777 1787862139.231759 write 0x030ebb thru 0x03533a (0x4480 bytes) 000778 1787862139.234952 mapread 0x003004 thru 0x003d3d (0xd3a bytes) 000782 1787862139.239883 trunc from 0x037bbd to 0x01a1fc (0x1d9c0 bytes) 000783 1787862139.263022 write 0x01d207 thru 0x024c8d (0x7a87 bytes) 000785 1787862139.264710 mapwrite 0x03d514 thru 0x03ffff (0x2aec bytes) 000786 1787862139.365997 mapwrite 0x01ba70 thru 0x0210d1 (0x5662 bytes) 000787 1787862139.444942 trunc from 0x040000 to 0x001407 (0x3ebf8 bytes) 000788 1787862139.471984 write 0x019220 thru 0x01d8e9 (0x46ca bytes) 000791 1787862139.475890 mapread 0x01c397 thru 0x01d8e9 (0x1553 bytes) 000795 1787862139.483936 write 0x0062ec thru 0x00911f (0x2e34 bytes) 000796 1787862139.499068 mapread 0x000b01 thru 0x00822d (0x772d bytes) 000798 1787862139.526478 read 0x013024 thru 0x01d8e9 (0xa8c6 bytes) 000800 1787862139.542413 write 0x00e48a thru 0x01cbe0 (0xe757 bytes) 000801 1787862139.545134 read 0x00ca40 thru 0x01041d (0x39de bytes) 000802 1787862139.546886 read 0x019767 thru 0x01d8e9 (0x4183 bytes) 000803 1787862139.548013 write 0x015357 thru 0x024d8a (0xfa34 bytes) 000807 1787862139.556051 mapwrite 0x01f468 thru 0x025b11 (0x66aa bytes) 000809 1787862139.663797 mapwrite 0x0302e7 thru 0x03acfc (0xaa16 bytes) 000811 1787862139.809338 trunc from 0x03acfd to 0x02864f (0x126ad bytes) 000812 1787862139.845983 trunc from 0x028650 to 0x013cfc (0x14953 bytes) 000814 1787862139.874249 mapread 0x0035f6 thru 0x0102e7 (0xccf2 bytes) 000819 1787862139.883377 trunc from 0x013cfd to 0x0060f8 (0xdc04 bytes) 000820 1787862139.920435 read 0x005e15 thru 0x0060f8 (0x2e4 bytes) 000824 1787862139.924520 read 0x001c12 thru 0x0060f8 (0x44e7 bytes) 000825 1787862139.926008 mapwrite 0x03f516 thru 0x03ffff (0xaea bytes) 000826 1787862140.043896 MIRROR_EXTEND to 2 mirrors 000828 1787862141.529916 mapwrite 0x02f034 thru 0x03cc55 (0xdc22 bytes) 000829 1787862141.974061 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1f7bbdc4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x96fd0bd6 Mirror 3: 0x96fd0bd6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000831 1787862143.588857 trunc from 0x040000 to 0x01b560 (0x24a9f bytes) 000832 1787862143.733558 read 0x00550f thru 0x00a12b (0x4c1d bytes) 000833 1787862143.747827 mapread 0x00e64e thru 0x01b560 (0xcf13 bytes) 000834 1787862143.790186 write 0x0062b0 thru 0x008c42 (0x2993 bytes) 000835 1787862143.792094 read 0x00ae3d thru 0x01457c (0x9740 bytes) 000838 1787862143.798168 write 0x01ddd1 thru 0x022340 (0x4570 bytes) 000839 1787862143.800937 mapread 0x010c4d thru 0x01a0b3 (0x9467 bytes) 000840 1787862143.802935 write 0x0079c1 thru 0x015f80 (0xe5c0 bytes) 000842 1787862143.806226 mapwrite 0x002204 thru 0x00a3d7 (0x81d4 bytes) 000843 1787862143.972089 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x197:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22341): Mirror 2: 0x8d95d45f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22341): Mirror 2: 0x8d95d45f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22341: skipped 000844 1787862144.253217 write 0x01e1d5 thru 0x0248ae (0x66da bytes) 000845 1787862144.261204 trunc from 0x0248af to 0x031e72 (0xd5c4 bytes) 000846 1787862144.279734 trunc from 0x031e73 to 0x0067ff (0x2b673 bytes) 000848 1787862144.307531 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x197:0x0]: Invalid argument (22) 000850 1787862144.448647 write 0x0363a3 thru 0x03ffff (0x9c5d bytes) 000851 1787862144.450095 trunc from 0x040000 to 0x02facc (0x10533 bytes) 000854 1787862144.480627 read 0x002771 thru 0x006c98 (0x4528 bytes) 000855 1787862144.489532 mapwrite 0x011634 thru 0x02042c (0xedf9 bytes) 000856 1787862144.578907 mapwrite 0x013dbc thru 0x019c89 (0x5ece bytes) 000857 1787862144.632737 trunc from 0x02facd to 0x000432 (0x2f69a bytes) 000858 1787862144.650645 read 0x000201 thru 0x000432 (0x232 bytes) 000860 1787862144.656920 trunc from 0x000433 to 0x01132c (0x10efa bytes) 000863 1787862144.679725 read 0x006744 thru 0x01132c (0xabe9 bytes) 000868 1787862144.700006 mapwrite 0x01887a thru 0x01cbd0 (0x4357 bytes) 000869 1787862144.791842 mapwrite 0x016db5 thru 0x021ce6 (0xaf32 bytes) 000870 1787862144.888899 write 0x02f6a4 thru 0x03e539 (0xee96 bytes) 000871 1787862144.896246 write 0x00dd4f thru 0x01cbf0 (0xeea2 bytes) 000876 1787862144.902017 read 0x00939c thru 0x018a45 (0xf6aa bytes) 000877 1787862144.902910 write 0x02ddb0 thru 0x03801a (0xa26b bytes) 000878 1787862144.911319 mapread 0x01e85e thru 0x02dd28 (0xf4cb bytes) 000879 1787862144.913271 mapwrite 0x02397e thru 0x028b02 (0x5185 bytes) 000881 1787862144.969452 trunc from 0x03e53a to 0x021d94 (0x1c7a5 bytes) 000882 1787862144.990000 mapwrite 0x021109 thru 0x0284ad (0x73a5 bytes) 000883 1787862145.089707 mapwrite 0x0356db thru 0x03bc2f (0x6555 bytes) 000886 1787862145.190799 read 0x02ae16 thru 0x03779a (0xc985 bytes) 000889 1787862145.203079 trunc from 0x03bc30 to 0x008a66 (0x331c9 bytes) 000890 1787862145.220570 read 0x0056ef thru 0x008a66 (0x3378 bytes) 000893 1787862145.221870 trunc from 0x008a67 to 0x015b6b (0xd105 bytes) 000896 1787862145.245903 trunc from 0x015b6c to 0x021d81 (0xc216 bytes) 000897 1787862145.265072 read 0x0005ad thru 0x002ce2 (0x2736 bytes) 000899 1787862145.266411 mapread 0x019484 thru 0x021d81 (0x88fe bytes) 000901 1787862145.278536 mapread 0x01413d thru 0x01dd46 (0x9c0a bytes) 000902 1787862145.279479 read 0x002f22 thru 0x00b248 (0x8327 bytes) 000904 1787862145.281357 mapwrite 0x03e1d0 thru 0x03ffff (0x1e30 bytes) 000905 1787862145.337487 write 0x03b66a thru 0x03ffff (0x4996 bytes) 000906 1787862145.339493 mapread 0x006544 thru 0x007c94 (0x1751 bytes) 000909 1787862145.343715 write 0x033b5e thru 0x0383ff (0x48a2 bytes) 000910 1787862145.345404 write 0x02f73a thru 0x02fc42 (0x509 bytes) 000912 1787862145.348500 trunc from 0x040000 to 0x009622 (0x369dd bytes) 000914 1787862145.368261 read 0x008683 thru 0x009622 (0xfa0 bytes) 000915 1787862145.369598 mapwrite 0x022baa thru 0x0287bb (0x5c12 bytes) 000918 1787862145.455933 write 0x026b71 thru 0x033a2d (0xcebd bytes) 000919 1787862145.458207 write 0x039393 thru 0x03ffff (0x6c6d bytes) 000923 1787862145.474148 read 0x00e23d thru 0x018cc4 (0xaa88 bytes) 000924 1787862145.475198 mapwrite 0x02202a thru 0x02ef46 (0xcf1d bytes) 000926 1787862145.537192 trunc from 0x040000 to 0x03b414 (0x4beb bytes) 000927 1787862145.561395 write 0x00aadf thru 0x00b0db (0x5fd bytes) 000928 1787862145.563237 mapread 0x021a05 thru 0x02a0af (0x86ab bytes) 000929 1787862145.564301 read 0x012242 thru 0x015083 (0x2e42 bytes) 000930 1787862145.564773 mapwrite 0x029bcc thru 0x032941 (0x8d76 bytes) 000931 1787862145.602734 write 0x03096f thru 0x037318 (0x69aa bytes) 000934 1787862145.617237 MIRROR_EXTEND to 2 mirrors 000936 1787862146.811360 mapwrite 0x03e5eb thru 0x03ffff (0x1a15 bytes) 000937 1787862147.128386 mapread 0x00b21f thru 0x011e6c (0x6c4e bytes) 000938 1787862147.153038 write 0x00b8c9 thru 0x014461 (0x8b99 bytes) 000939 1787862147.162039 write 0x00938a thru 0x017c5d (0xe8d4 bytes) 000940 1787862147.178233 MIRROR_RESYNC 2 mirrors 000941 1787862148.136403 read 0x03835b thru 0x03d0ee (0x4d94 bytes) 000944 1787862148.151396 trunc from 0x040000 to 0x01e2dc (0x21d23 bytes) 000946 1787862148.299180 write 0x005611 thru 0x005afe (0x4ee bytes) 000948 1787862148.307451 write 0x012cd5 thru 0x01e528 (0xb854 bytes) 000950 1787862148.320187 trunc from 0x01e529 to 0x016052 (0x84d6 bytes) 000952 1787862148.351149 read 0x00bf63 thru 0x012eae (0x6f4c bytes) 000953 1787862148.364072 trunc from 0x016053 to 0x01be37 (0x5de5 bytes) 000954 1787862148.385963 trunc from 0x01be38 to 0x01e925 (0x2aee bytes) 000956 1787862148.414463 trunc from 0x01e926 to 0x006c1a (0x17d0b bytes) 000957 1787862148.439417 write 0x03723c thru 0x03ffff (0x8dc4 bytes) 000958 1787862148.441868 mapwrite 0x009191 thru 0x014629 (0xb499 bytes) 000960 1787862148.729278 write 0x037cfd thru 0x03ffff (0x8303 bytes) 000961 1787862148.734932 trunc from 0x040000 to 0x00a8fc (0x35703 bytes) 000962 1787862148.766203 mapread 0x005da2 thru 0x00a8fc (0x4b5b bytes) 000964 1787862148.820970 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xa8fd): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa8fd): Mirror 2: 0xd5bbb72e (stale) CRC-32 checksum value for chunk [0, 0xa8fd): Mirror 1: 0x20174ce5 Mirror 3: 0x20174ce5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa8fd: skipped 000965 1787862149.783138 read 0x005ea6 thru 0x00a8fc (0x4a57 bytes) 000966 1787862149.792640 read 0x0060d0 thru 0x00a8fc (0x482d bytes) 000971 1787862149.795586 trunc from 0x00a8fd to 0x03443b (0x29b3f bytes) 000972 1787862149.938979 read 0x0244e0 thru 0x02de66 (0x9987 bytes) 000975 1787862149.956830 trunc from 0x03443c to 0x033d14 (0x727 bytes) 000976 1787862149.987182 mapwrite 0x036356 thru 0x03ffff (0x9caa bytes) 000977 1787862150.136738 MIRROR_RESYNC 3 mirrors 000979 1787862151.273434 read 0x01751f thru 0x025686 (0xe168 bytes) 000983 1787862151.287577 read 0x01d760 thru 0x029d41 (0xc5e2 bytes) 000984 1787862151.308841 mapwrite 0x005a85 thru 0x01472f (0xecab bytes) 000986 1787862151.541197 trunc from 0x040000 to 0x02f5d4 (0x10a2b bytes) 000987 1787862151.614652 write 0x01c0b4 thru 0x023b13 (0x7a60 bytes) 000988 1787862151.627268 mapread 0x01c9a9 thru 0x02b52b (0xeb83 bytes) 000989 1787862151.669963 trunc from 0x02f5d5 to 0x008946 (0x26c8e bytes) 000990 1787862151.715227 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x8947): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8947): Mirror 2: 0x366e8f77 (stale) Mirror 3: 0x366e8f77 (stale) CRC-32 checksum value for chunk [0, 0x8947): Mirror 1: 0x5bbb5d88 Mirror 4: 0x5bbb5d88 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8947: skipped 000999 1787862152.884727 mapwrite 0x02ea7a thru 0x03b9fc (0xcf83 bytes) 001000 1787862153.168864 read 0x021ead thru 0x02d540 (0xb694 bytes) All operations completed A-OK!