== sanity-flr test 70a: flr mode fsx test ================ 05:35:21 (1782207321) Seed set to 7323 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x996c 000005 1782207323.325151 trunc from 00000000 to 0x00996b (0x996c bytes) 000007 1782207323.352961 write 0x034ed3 thru 0x03729e (0x23cc bytes) 000013 1782207323.366771 mapwrite 0x0381b1 thru 0x03ffff (0x7e4f bytes) 000014 1782207323.472403 read 0x0092be thru 0x016143 (0xce86 bytes) 000015 1782207323.484060 write 0x01b192 thru 0x01cf8a (0x1df9 bytes) 000016 1782207323.499163 read 0x018781 thru 0x02507b (0xc8fb bytes) 000018 1782207323.515564 mapwrite 0x0235ff thru 0x026ca4 (0x36a6 bytes) 000019 1782207323.589311 write 0x024939 thru 0x033e11 (0xf4d9 bytes) 000021 1782207323.591309 mapwrite 0x000a57 thru 0x0050d9 (0x4683 bytes) truncating to largest ever: 0x10c5a 000024 1782207323.656996 trunc from 0x040000 to 0x010c59 (0x2f3a6 bytes) 000026 1782207323.679966 trunc from 0x010c5a to 0x000d6d (0xfeec bytes) 000027 1782207323.703636 write 0x00bd6a thru 0x00c732 (0x9c9 bytes) 000028 1782207323.704744 mapwrite 0x011781 thru 0x01630b (0x4b8b bytes) 000029 1782207323.808990 mapwrite 0x0283b0 thru 0x0338bb (0xb50c bytes) 000030 1782207323.957197 mapwrite 0x01d3d4 thru 0x025caf (0x88dc bytes) 000031 1782207324.066229 read 0x009ab1 thru 0x010cee (0x723e bytes) 000034 1782207324.076273 write 0x0305ec thru 0x034762 (0x4177 bytes) 000035 1782207324.077338 write 0x031228 thru 0x0369a2 (0x577b bytes) 000036 1782207324.081691 read 0x02a35e thru 0x0312bd (0x6f60 bytes) 000041 1782207324.088695 write 0x0256de thru 0x033cf5 (0xe618 bytes) 000045 1782207324.097923 write 0x01ab8b thru 0x01f4ff (0x4975 bytes) truncating to largest ever: 0x23eef 000046 1782207324.099381 trunc from 0x0369a3 to 0x023eee (0x12ab4 bytes) 000047 1782207324.121357 mapwrite 0x02589b thru 0x02b39d (0x5b03 bytes) 000048 1782207324.196916 mapwrite 0x0277b2 thru 0x032e2c (0xb67b bytes) 000051 1782207324.317047 write 0x015856 thru 0x01e365 (0x8b10 bytes) 000053 1782207324.323770 mapwrite 0x00cb36 thru 0x013d04 (0x71cf bytes) 000054 1782207324.407183 trunc from 0x032e2d to 0x01160f (0x2181d bytes) 000055 1782207324.438453 mapwrite 0x02c407 thru 0x0398f7 (0xd4f1 bytes) 000056 1782207324.588760 trunc from 0x0398f8 to 0x002eef (0x36a08 bytes) 000057 1782207324.617192 write 0x021104 thru 0x024e53 (0x3d50 bytes) truncating to largest ever: 0x385ba 000058 1782207324.619588 trunc from 0x024e54 to 0x0385b9 (0x13766 bytes) 000059 1782207324.646297 trunc from 0x0385ba to 0x03123f (0x737a bytes) 000060 1782207324.700936 trunc from 0x031240 to 0x023a44 (0xd7fb bytes) 000064 1782207324.733813 mapwrite 0x0044a3 thru 0x01039d (0xbefb bytes) 000067 1782207324.946558 mapread 0x0085dd thru 0x00dc59 (0x567d bytes) 000068 1782207324.971127 MIRROR_EXTEND to 2 mirrors 000069 1782207325.715649 read 0x0159a5 thru 0x015ade (0x13a bytes) 000070 1782207325.744065 read 0x012e60 thru 0x0145de (0x177f bytes) 000072 1782207325.776233 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) 000074 1782207325.911982 trunc from 0x023a45 to 0x0342a8 (0x10864 bytes) 000075 1782207325.933335 write 0x02fd1d thru 0x037c7a (0x7f5e bytes) 000078 1782207325.940713 write 0x004504 thru 0x00e66c (0xa169 bytes) 000079 1782207325.956932 write 0x030bc3 thru 0x03e50e (0xd94c bytes) 000080 1782207325.958799 write 0x00b553 thru 0x012062 (0x6b10 bytes) 000082 1782207325.975892 mapread 0x0329cd thru 0x03e50e (0xbb42 bytes) 000083 1782207325.985825 MIRROR_EXTEND to 2 mirrors 000085 1782207326.816086 read 0x02fcaf thru 0x03801c (0x836e bytes) 000086 1782207326.839263 read 0x01d216 thru 0x029d89 (0xcb74 bytes) truncating to largest ever: 0x38dd0 000089 1782207326.894592 trunc from 0x03e50f to 0x038dcf (0x573f bytes) 000093 1782207327.016276 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) 000094 1782207327.147384 mapwrite 0x02e6c5 thru 0x03ad73 (0xc6af bytes) 000095 1782207327.245328 write 0x027bb0 thru 0x031fe1 (0xa432 bytes) 000097 1782207327.255794 mapread 0x0008ad thru 0x00a611 (0x9d65 bytes) 000098 1782207327.273722 mapwrite 0x02f447 thru 0x03227c (0x2e36 bytes) 000099 1782207327.327394 write 0x02973b thru 0x03136f (0x7c35 bytes) 000100 1782207327.328707 trunc from 0x03ad74 to 0x028446 (0x1292d bytes) 000105 1782207327.353047 MIRROR_EXTEND to 2 mirrors 000109 1782207328.108727 trunc from 0x028447 to 0x021cd3 (0x6773 bytes) 000110 1782207328.214030 mapwrite 0x034682 thru 0x03958d (0x4f0c bytes) 000115 1782207328.302624 read 0x005536 thru 0x00bb2b (0x65f6 bytes) 000118 1782207328.314847 mapwrite 0x00d0ec thru 0x00d0fc (0x11 bytes) 000120 1782207328.419734 trunc from 0x03958e to 0x01591e (0x23c6f bytes) 000122 1782207328.457001 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1591f): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1591f): Mirror 2: 0xe7af9b8e (stale) CRC-32 checksum value for chunk [0, 0x1591f): Mirror 1: 0x5fba39ba Mirror 3: 0x5fba39ba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1591f: skipped 000126 1782207329.544704 write 0x038edb thru 0x03ffff (0x7125 bytes) 000127 1782207329.641773 mapwrite 0x01cce5 thru 0x020890 (0x3bac bytes) 000130 1782207329.715661 mapread 0x01dae4 thru 0x02b9dd (0xdefa bytes) 000131 1782207329.730889 mapread 0x01c4af thru 0x01d9b9 (0x150b bytes) 000133 1782207329.736895 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5bcec329 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5bcec329 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000134 1782207330.168565 write 0x0283df thru 0x033a99 (0xb6bb bytes) 000136 1782207330.199829 write 0x023ee4 thru 0x030c40 (0xcd5d bytes) 000137 1782207330.217011 write 0x026fd5 thru 0x027d96 (0xdc2 bytes) 000141 1782207330.232749 MIRROR_RESYNC 2 mirrors 000142 1782207331.173838 read 0x0163d4 thru 0x01763f (0x126c bytes) 000143 1782207331.182644 read 0x032396 thru 0x03f3ca (0xd035 bytes) 000144 1782207331.193742 mapwrite 0x001bfd thru 0x009e69 (0x826d bytes) 000147 1782207331.412735 mapread 0x005087 thru 0x00a61a (0x5594 bytes) 000149 1782207331.440593 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xdffa28e9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xec22fa66 Mirror 3: 0xec22fa66 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000151 1782207332.301276 read 0x032802 thru 0x03aed0 (0x86cf bytes) 000152 1782207332.310209 write 0x00dbbd thru 0x0194a0 (0xb8e4 bytes) 000153 1782207332.414136 mapread 0x0398d0 thru 0x039ffd (0x72e bytes) 000154 1782207332.420774 mapread 0x00ce87 thru 0x0100c9 (0x3243 bytes) 000156 1782207332.426644 write 0x03f0d4 thru 0x03ffff (0xf2c bytes) 000157 1782207332.432172 trunc from 0x040000 to 0x00dff1 (0x3200e bytes) 000158 1782207332.473223 read 0x00a69f thru 0x00dff1 (0x3953 bytes) 000159 1782207332.489113 MIRROR_RESYNC 3 mirrors 000161 1782207333.553398 write 0x00d1f5 thru 0x01b8fe (0xe70a bytes) 000162 1782207333.674441 trunc from 0x01b8ff to 0x013413 (0x84eb bytes) 000163 1782207333.696088 read 0x00efd3 thru 0x013413 (0x4441 bytes) 000165 1782207333.702432 MIRROR_RESYNC 3 mirrors 000166 1782207334.409360 write 0x014208 thru 0x019a61 (0x585a bytes) 000168 1782207334.479320 mapwrite 0x02d39c thru 0x0363e5 (0x904a bytes) 000170 1782207334.570248 mapread 0x01eea7 thru 0x02d4bc (0xe616 bytes) 000171 1782207334.588372 mapread 0x03553f thru 0x0363e5 (0xea7 bytes) truncating to largest ever: 0x3f921 000172 1782207334.590293 trunc from 0x0363e6 to 0x03f920 (0x953b bytes) 000174 1782207334.609100 write 0x02409d thru 0x03203c (0xdfa0 bytes) 000175 1782207334.612556 mapwrite 0x03f77e thru 0x03ffff (0x882 bytes) 000176 1782207334.688687 mapread 0x026cb1 thru 0x02da28 (0x6d78 bytes) 000177 1782207334.695825 MIRROR_RESYNC 3 mirrors 000178 1782207335.346005 read 0x03652c thru 0x036ab4 (0x589 bytes) 000181 1782207335.352667 mapread 0x038b39 thru 0x03ffff (0x74c7 bytes) 000182 1782207335.375684 write 0x01a1d4 thru 0x022a2d (0x885a bytes) 000184 1782207335.587058 read 0x030fbf thru 0x033fc1 (0x3003 bytes) 000185 1782207335.603855 read 0x01e4f3 thru 0x020b42 (0x2650 bytes) 000186 1782207335.604565 read 0x0170fa thru 0x01f9bd (0x88c4 bytes) 000189 1782207335.606367 write 0x008e7a thru 0x017949 (0xead0 bytes) 000190 1782207335.611163 trunc from 0x040000 to 0x00da6b (0x32594 bytes) 000192 1782207335.661489 write 0x02eb7b thru 0x031bf7 (0x307d bytes) 000193 1782207335.664279 write 0x038c9c thru 0x03ecd7 (0x603c bytes) 000194 1782207335.687453 MIRROR_RESYNC 3 mirrors 000195 1782207336.407789 write 0x025303 thru 0x033c8e (0xe98c bytes) 000196 1782207336.480527 read 0x028539 thru 0x02cf9e (0x4a66 bytes) 000197 1782207336.482424 read 0x00dbb2 thru 0x014bc9 (0x7018 bytes) 000199 1782207336.496814 MIRROR_RESYNC 3 mirrors 000200 1782207337.203604 trunc from 0x03ecd8 to 0x00a7fd (0x344da bytes) 000202 1782207337.339158 mapwrite 0x023c17 thru 0x025317 (0x1701 bytes) 000203 1782207337.438058 mapwrite 0x01306c thru 0x022623 (0xf5b8 bytes) 000207 1782207337.551593 write 0x0189d8 thru 0x0222d0 (0x98f9 bytes) 000210 1782207337.558403 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x25318): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25318): Mirror 2: 0xd9f82066 (stale) Mirror 3: 0xd9f82066 (stale) CRC-32 checksum value for chunk [0, 0x25318): Mirror 1: 0x59bc995e Mirror 4: 0x59bc995e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25318: skipped 000214 1782207338.605660 mapwrite 0x01575d thru 0x015e13 (0x6b7 bytes) 000216 1782207338.911164 mapread 0x0214b9 thru 0x024cef (0x3837 bytes) 000217 1782207338.923875 mapwrite 0x024093 thru 0x02b6c7 (0x7635 bytes) 000219 1782207339.069959 mapread 0x016e83 thru 0x017c70 (0xdee bytes) 000220 1782207339.092087 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b6c8): Mirror 2: 0x6152f98c (stale) Mirror 3: 0x6152f98c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b6c8): Mirror 2: 0x6152f98c (stale) Mirror 3: 0x6152f98c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b6c8: skipped 000222 1782207339.509553 write 0x03743a thru 0x03ffff (0x8bc6 bytes) 000223 1782207339.513508 trunc from 0x040000 to 0x01e645 (0x219ba bytes) 000224 1782207339.537055 mapread 0x00fa5c thru 0x013b56 (0x40fb bytes) 000225 1782207339.581053 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e646): Mirror 3: 0xc8ce90d4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e646): Mirror 3: 0xc8ce90d4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e646: skipped 000226 1782207340.031914 trunc from 0x01e646 to 0x039b4f (0x1b50a bytes) 000228 1782207340.060350 mapwrite 0x028dbb thru 0x036412 (0xd658 bytes) 000229 1782207340.266120 MIRROR_RESYNC 2 mirrors 000230 1782207341.225624 read 0x019bc6 thru 0x0255b2 (0xb9ed bytes) 000231 1782207341.239331 write 0x00b9b3 thru 0x011cb6 (0x6304 bytes) 000232 1782207341.377767 MIRROR_RESYNC 2 mirrors 000233 1782207342.128995 mapread 0x00f31d thru 0x012be5 (0x38c9 bytes) 000234 1782207342.151712 mapread 0x02fd00 thru 0x0344cb (0x47cc bytes) 000235 1782207342.189202 MIRROR_RESYNC 2 mirrors 000237 1782207342.674729 write 0x039132 thru 0x03e1fa (0x50c9 bytes) 000238 1782207342.768411 mapread 0x01da64 thru 0x02622c (0x87c9 bytes) 000240 1782207342.795711 write 0x0039d9 thru 0x008517 (0x4b3f bytes) 000241 1782207342.808141 trunc from 0x03e1fb to 0x007293 (0x36f67 bytes) 000244 1782207342.843027 mapwrite 0x03bce9 thru 0x03ffff (0x4317 bytes) 000246 1782207342.939773 write 0x01b545 thru 0x01d4b4 (0x1f70 bytes) 000247 1782207342.951284 read 0x03fde5 thru 0x03ffff (0x21b bytes) 000248 1782207342.952047 read 0x01e629 thru 0x02d174 (0xeb4c bytes) 000249 1782207342.968601 write 0x026a1a thru 0x03495d (0xdf44 bytes) 000250 1782207342.976199 MIRROR_RESYNC 2 mirrors 000254 1782207343.993125 read 0x01c436 thru 0x02af96 (0xeb61 bytes) 000256 1782207344.012035 mapwrite 0x003586 thru 0x00fd7e (0xc7f9 bytes) 000257 1782207344.243235 write 0x030e22 thru 0x0359ec (0x4bcb bytes) 000259 1782207344.258931 read 0x02a223 thru 0x037fca (0xdda8 bytes) 000260 1782207344.271485 trunc from 0x040000 to 0x037841 (0x87be bytes) 000261 1782207344.299452 trunc from 0x037842 to 0x031848 (0x5ff9 bytes) 000262 1782207344.319197 read 0x02ba6f thru 0x02d864 (0x1df6 bytes) 000264 1782207344.321313 trunc from 0x031849 to 0x025532 (0xc316 bytes) 000265 1782207344.346333 mapwrite 0x00098a thru 0x00e343 (0xd9ba bytes) 000268 1782207344.434574 read 0x017dc6 thru 0x01d04d (0x5288 bytes) 000269 1782207344.435601 mapread 0x011526 thru 0x017906 (0x63e1 bytes) 000270 1782207344.439127 read 0x020039 thru 0x025532 (0x54fa bytes) 000272 1782207344.452011 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) 000274 1782207344.722453 mapwrite 0x038fe4 thru 0x03b877 (0x2894 bytes) 000275 1782207344.854192 MIRROR_EXTEND to 2 mirrors 000276 1782207345.866900 MIRROR_RESYNC 2 mirrors 000277 1782207346.395094 mapread 0x01ac35 thru 0x023cb0 (0x907c bytes) 000280 1782207346.509388 mapread 0x01ca24 thru 0x01e076 (0x1653 bytes) 000282 1782207346.549516 mapread 0x027cb4 thru 0x034e70 (0xd1bd bytes) 000285 1782207346.631548 mapwrite 0x02950a thru 0x038ce6 (0xf7dd bytes) 000286 1782207346.940072 mapwrite 0x000b5a thru 0x002e5a (0x2301 bytes) 000288 1782207346.999623 read 0x01cb4a thru 0x02ba7a (0xef31 bytes) 000290 1782207347.010264 mapread 0x03a292 thru 0x03b877 (0x15e6 bytes) 000291 1782207347.024216 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) 000296 1782207347.194579 trunc from 0x03b878 to 0x01dc32 (0x1dc45 bytes) 000299 1782207347.211940 write 0x00cb8d thru 0x0125f6 (0x5a6a bytes) 000302 1782207347.226858 MIRROR_EXTEND to 2 mirrors 000303 1782207348.019413 trunc from 0x01dc33 to 0x025fec (0x83ba bytes) 000305 1782207348.120521 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x25fed): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25fed): Mirror 2: 0x45553b1c (stale) CRC-32 checksum value for chunk [0, 0x25fed): Mirror 1: 0x45553b1c Mirror 3: 0x45553b1c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25fed: skipped 000307 1782207349.201682 trunc from 0x025fed to 0x037790 (0x117a4 bytes) 000309 1782207349.405344 read 0x02a865 thru 0x034f0f (0xa6ab bytes) 000310 1782207349.418992 mapread 0x00edb9 thru 0x012517 (0x375f bytes) 000311 1782207349.466575 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37791): Mirror 3: 0xdafe6ab2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37791): Mirror 3: 0xdafe6ab2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37791: skipped 000313 1782207349.798605 write 0x02e212 thru 0x03a32a (0xc119 bytes) 000315 1782207349.807851 trunc from 0x03a32b to 0x00ec13 (0x2b717 bytes) 000316 1782207349.829549 MIRROR_RESYNC 2 mirrors 000318 1782207350.676551 mapwrite 0x01f37d thru 0x021228 (0x1eac bytes) 000320 1782207350.983682 mapwrite 0x023f8c thru 0x0282c4 (0x4339 bytes) 000321 1782207351.062123 write 0x03c9ff thru 0x03efe1 (0x25e3 bytes) 000323 1782207351.063969 mapwrite 0x007f79 thru 0x010530 (0x85b8 bytes) 000327 1782207351.140450 mapwrite 0x030b9c thru 0x03ca0c (0xbe71 bytes) 000328 1782207351.214435 mapread 0x01a659 thru 0x024a91 (0xa439 bytes) 000329 1782207351.215783 write 0x014de7 thru 0x01789e (0x2ab8 bytes) 000330 1782207351.236336 read 0x01b315 thru 0x0213cf (0x60bb bytes) 000332 1782207351.237788 mapwrite 0x02b77e thru 0x03046d (0x4cf0 bytes) 000333 1782207351.322739 trunc from 0x03efe2 to 0x0012ed (0x3dcf4 bytes) 000334 1782207351.343662 mapread 0x000882 thru 0x0012ed (0xa6c bytes) 000336 1782207351.361753 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) 000337 1782207351.593147 trunc from 0x0012ee to 0x02408d (0x22da0 bytes) 000338 1782207351.610992 write 0x0090c7 thru 0x012d57 (0x9c91 bytes) 000339 1782207351.623315 mapwrite 0x0006e2 thru 0x00c86b (0xc18a bytes) 000343 1782207351.729420 mapwrite 0x00b6fa thru 0x00d04e (0x1955 bytes) 000344 1782207351.786996 read 0x00aa5d thru 0x00dcd4 (0x3278 bytes) 000348 1782207351.789245 mapwrite 0x03085e thru 0x035890 (0x5033 bytes) 000350 1782207351.857541 mapread 0x005753 thru 0x0095c6 (0x3e74 bytes) 000352 1782207351.859743 mapwrite 0x03f113 thru 0x03ffff (0xeed bytes) 000354 1782207351.927674 read 0x008334 thru 0x00fda3 (0x7a70 bytes) 000359 1782207351.932739 read 0x01e3cd thru 0x028b0e (0xa742 bytes) 000360 1782207351.941298 read 0x0016ae thru 0x00bdf8 (0xa74b bytes) 000364 1782207351.944630 mapwrite 0x01187f thru 0x0161b6 (0x4938 bytes) 000365 1782207351.988788 mapwrite 0x011d33 thru 0x0164e4 (0x47b2 bytes) 000367 1782207352.095839 write 0x035665 thru 0x03a1cc (0x4b68 bytes) 000368 1782207352.098020 mapwrite 0x0257f5 thru 0x02bf76 (0x6782 bytes) 000369 1782207352.140621 mapwrite 0x025779 thru 0x02e1f3 (0x8a7b bytes) 000370 1782207352.202868 write 0x035024 thru 0x038489 (0x3466 bytes) 000373 1782207352.205969 trunc from 0x040000 to 0x01acce (0x25331 bytes) 000374 1782207352.226335 trunc from 0x01accf to 0x03c5e3 (0x21915 bytes) 000375 1782207352.242713 trunc from 0x03c5e4 to 0x02fd0b (0xc8d8 bytes) 000379 1782207352.263966 write 0x016095 thru 0x01744d (0x13b9 bytes) 000381 1782207352.266362 mapread 0x02341a thru 0x02fd0b (0xc8f2 bytes) 000384 1782207352.277998 mapread 0x00615c thru 0x0090b5 (0x2f5a bytes) 000385 1782207352.279572 mapread 0x02aadf thru 0x02acb2 (0x1d4 bytes) 000386 1782207352.281564 mapread 0x02ab73 thru 0x02fd0b (0x5199 bytes) 000390 1782207352.286668 mapread 0x0269b1 thru 0x02fd0b (0x935b bytes) 000393 1782207352.289595 write 0x03020b thru 0x0376cc (0x74c2 bytes) 000395 1782207352.292306 write 0x02ae1f thru 0x036857 (0xba39 bytes) 000396 1782207352.293946 mapread 0x0222c3 thru 0x02d8b6 (0xb5f4 bytes) 000398 1782207352.296255 trunc from 0x0376cd to 0x02c83c (0xae90 bytes) 000401 1782207352.319619 mapread 0x0182f6 thru 0x01c576 (0x4281 bytes) 000402 1782207352.321382 write 0x00e2e1 thru 0x00ffb9 (0x1cd9 bytes) 000403 1782207352.322980 mapread 0x025103 thru 0x02c83c (0x773a bytes) 000405 1782207352.325936 mapwrite 0x020456 thru 0x030309 (0xfeb4 bytes) 000407 1782207352.405301 trunc from 0x03030a to 0x0045d3 (0x2bd36 bytes) 000408 1782207352.442615 mapread 0x002ab6 thru 0x0045d3 (0x1b1e bytes) 000409 1782207352.445483 trunc from 0x0045d4 to 0x010b48 (0xc575 bytes) 000410 1782207352.476425 mapread 0x009d2f thru 0x010b48 (0x6e1a bytes) 000411 1782207352.535058 write 0x00fec8 thru 0x0141c9 (0x4302 bytes) 000412 1782207352.536510 write 0x019f39 thru 0x025ee7 (0xbfaf bytes) 000413 1782207352.540628 read 0x015664 thru 0x0157e6 (0x183 bytes) 000419 1782207352.561844 read 0x022118 thru 0x022afd (0x9e6 bytes) 000420 1782207352.566879 mapwrite 0x030373 thru 0x03fbe6 (0xf874 bytes) 000421 1782207352.683721 trunc from 0x03fbe7 to 0x002648 (0x3d59e bytes) 000422 1782207352.714724 mapread 0x0015b0 thru 0x002648 (0x1099 bytes) 000426 1782207352.730388 trunc from 0x002649 to 0x033a04 (0x313bc bytes) 000427 1782207352.772105 mapread 0x02da74 thru 0x033a04 (0x5f91 bytes) 000428 1782207352.844452 write 0x006d95 thru 0x01548b (0xe6f7 bytes) 000429 1782207352.860695 trunc from 0x033a05 to 0x0203b2 (0x13652 bytes) 000430 1782207352.877390 trunc from 0x0203b3 to 0x02803c (0x7c8a bytes) 000432 1782207352.918060 write 0x0188da thru 0x024274 (0xb99b bytes) 000433 1782207352.933024 mapread 0x00081a thru 0x00934a (0x8b31 bytes) 000434 1782207352.957637 write 0x0390a4 thru 0x03ffff (0x6f5c bytes) 000435 1782207352.962946 mapwrite 0x03c6ee thru 0x03ffff (0x3912 bytes) 000437 1782207353.075333 mapwrite 0x00aff3 thru 0x016bb9 (0xbbc7 bytes) 000438 1782207353.162156 write 0x02d718 thru 0x0339d7 (0x62c0 bytes) 000440 1782207353.176709 trunc from 0x040000 to 0x02051e (0x1fae1 bytes) 000443 1782207353.248771 mapread 0x01b76c thru 0x01e323 (0x2bb8 bytes) 000446 1782207353.252318 read 0x01b0c9 thru 0x02051e (0x5456 bytes) 000447 1782207353.253246 trunc from 0x02051f to 0x00d073 (0x134ab bytes) 000450 1782207353.291718 read 0x008b65 thru 0x00935f (0x7fb bytes) 000454 1782207353.307999 mapwrite 0x009073 thru 0x00fd19 (0x6ca7 bytes) 000458 1782207353.479692 write 0x00cba5 thru 0x0119f6 (0x4e52 bytes) 000459 1782207353.484385 write 0x034141 thru 0x03ffff (0xbebf bytes) 000462 1782207353.489400 mapwrite 0x03b4ec thru 0x03f36d (0x3e82 bytes) 000464 1782207353.587561 mapread 0x008549 thru 0x00fbc3 (0x767b bytes) 000465 1782207353.590840 write 0x02d5f8 thru 0x0386ac (0xb0b5 bytes) 000466 1782207353.609706 mapread 0x03cb47 thru 0x03ffff (0x34b9 bytes) 000469 1782207353.615555 trunc from 0x040000 to 0x02653e (0x19ac1 bytes) 000472 1782207353.671557 trunc from 0x02653f to 0x027b84 (0x1646 bytes) 000473 1782207353.692668 read 0x01ea8a thru 0x027b84 (0x90fb bytes) 000474 1782207353.700563 read 0x01e75b thru 0x027b84 (0x942a bytes) 000477 1782207353.707315 read 0x0039da thru 0x0126da (0xed01 bytes) 000479 1782207353.709657 mapwrite 0x03bb20 thru 0x03ffff (0x44e0 bytes) 000481 1782207353.861184 mapread 0x01def4 thru 0x02be5c (0xdf69 bytes) 000485 1782207353.868809 mapwrite 0x02ba4f thru 0x02dfa2 (0x2554 bytes) 000486 1782207353.956700 mapwrite 0x02cb0c thru 0x03a9e0 (0xded5 bytes) 000490 1782207354.036155 trunc from 0x040000 to 0x025781 (0x1a87e bytes) 000492 1782207354.069729 MIRROR_EXTEND to 2 mirrors 000494 1782207354.852137 mapread 0x0061eb thru 0x01180c (0xb622 bytes) 000495 1782207354.892721 write 0x01c38b thru 0x01e714 (0x238a bytes) 000496 1782207354.973575 trunc from 0x025782 to 0x030cbf (0xb53e bytes) 000497 1782207355.014404 trunc from 0x030cc0 to 0x0336a8 (0x29e9 bytes) 000498 1782207355.048996 MIRROR_RESYNC 2 mirrors 000500 1782207355.683060 trunc from 0x0336a9 to 0x02d1b4 (0x64f4 bytes) 000501 1782207355.768340 trunc from 0x02d1b5 to 0x01e714 (0xeaa0 bytes) 000502 1782207355.801157 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1e715): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e715): Mirror 2: 0x35749321 (stale) CRC-32 checksum value for chunk [0, 0x1e715): Mirror 1: 0x35749321 Mirror 3: 0x35749321 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e715: skipped 000503 1782207356.944535 mapwrite 0x000488 thru 0x007f44 (0x7abd bytes) 000504 1782207357.198706 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e715): Mirror 3: 0x35749321 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e715): Mirror 3: 0x35749321 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e715: skipped 000506 1782207357.474604 trunc from 0x01e715 to 0x0396b0 (0x1af9c bytes) 000507 1782207357.491388 read 0x034e50 thru 0x0396b0 (0x4861 bytes) 000508 1782207357.504996 mapwrite 0x032c54 thru 0x032cf0 (0x9d bytes) 000510 1782207357.561691 trunc from 0x0396b1 to 0x034f63 (0x474d bytes) 000512 1782207357.575762 mapwrite 0x00afd9 thru 0x019bf1 (0xec19 bytes) 000513 1782207357.641075 mapwrite 0x034ed2 thru 0x03c616 (0x7745 bytes) 000514 1782207357.737036 mapread 0x004264 thru 0x01157c (0xd319 bytes) 000515 1782207357.739582 read 0x016ee8 thru 0x01bbe4 (0x4cfd bytes) 000517 1782207357.741328 trunc from 0x03c617 to 0x00fd35 (0x2c8e1 bytes) 000518 1782207357.763484 mapread 0x006221 thru 0x00fb17 (0x98f7 bytes) 000520 1782207357.777059 MIRROR_RESYNC 2 mirrors 000521 1782207358.352836 read 0x00bf4f thru 0x00fd35 (0x3de7 bytes) 000522 1782207358.365799 mapwrite 0x02ed23 thru 0x035c68 (0x6f46 bytes) 000523 1782207358.576330 trunc from 0x035c69 to 0x0278d3 (0xe395 bytes) 000525 1782207358.628556 write 0x0364ed thru 0x03a442 (0x3f56 bytes) 000527 1782207358.644113 mapread 0x0387bf thru 0x03a442 (0x1c84 bytes) 000528 1782207358.646300 write 0x01e9aa thru 0x01f07c (0x6d3 bytes) 000532 1782207358.677694 trunc from 0x03a443 to 0x03c4d7 (0x2095 bytes) 000534 1782207358.742299 read 0x008d96 thru 0x016b14 (0xdd7f bytes) 000536 1782207358.777315 trunc from 0x03c4d8 to 0x0116f5 (0x2ade2 bytes) 000538 1782207358.798746 mapread 0x007f7f thru 0x0116f5 (0x9777 bytes) 000542 1782207358.807748 read 0x0106b9 thru 0x0116f5 (0x103d bytes) 000543 1782207358.817205 mapwrite 0x023d78 thru 0x02a7bc (0x6a45 bytes) 000544 1782207358.911055 read 0x011b58 thru 0x0124ed (0x996 bytes) 000545 1782207358.917570 mapwrite 0x039cd8 thru 0x03ffff (0x6328 bytes) 000546 1782207359.003873 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x7a09da86 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdfd0b4c7 Mirror 4: 0xdfd0b4c7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000547 1782207359.986676 write 0x00418c thru 0x00ec5e (0xaad3 bytes) 000549 1782207360.111617 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xdfd0b4c7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xdfd0b4c7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000551 1782207360.434800 trunc from 0x040000 to 0x01ca37 (0x235c8 bytes) 000552 1782207360.455189 read 0x016933 thru 0x01ca37 (0x6105 bytes) 000554 1782207360.476353 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) 000555 1782207360.619030 trunc from 0x01ca38 to 0x0254f3 (0x8abc bytes) 000556 1782207360.637504 mapwrite 0x00bb58 thru 0x010dbd (0x5266 bytes) 000558 1782207360.720050 mapwrite 0x034dd8 thru 0x03ffff (0xb228 bytes) 000559 1782207360.845068 MIRROR_EXTEND to 2 mirrors 000560 1782207361.515244 MIRROR_EXTEND to 3 mirrors 000561 1782207362.266833 read 0x02268e thru 0x02c292 (0x9c05 bytes) 000562 1782207362.278375 write 0x01bca2 thru 0x01bf47 (0x2a6 bytes) 000563 1782207362.363345 trunc from 0x040000 to 0x00df99 (0x32066 bytes) 000564 1782207362.387414 trunc from 0x00df9a to 0x024d7b (0x16de2 bytes) 000565 1782207362.407942 mapread 0x0031d0 thru 0x00e24e (0xb07f bytes) 000566 1782207362.440407 mapwrite 0x0011fd thru 0x00153a (0x33e bytes) 000569 1782207362.526277 MIRROR_RESYNC 3 mirrors 000570 1782207363.156671 mapread 0x022d4b thru 0x024d7b (0x2031 bytes) 000571 1782207363.176745 trunc from 0x024d7c to 0x025768 (0x9ed bytes) 000572 1782207363.277710 mapread 0x006658 thru 0x016469 (0xfe12 bytes) 000573 1782207363.305511 read 0x00e3b7 thru 0x018c19 (0xa863 bytes) 000574 1782207363.306549 mapwrite 0x00c53b thru 0x019c2c (0xd6f2 bytes) 000575 1782207363.367501 MIRROR_RESYNC 3 mirrors 000576 1782207364.171020 read 0x010e9b thru 0x01ec39 (0xdd9f bytes) 000577 1782207364.183260 mapread 0x01b9c7 thru 0x025768 (0x9da2 bytes) 000580 1782207364.229703 trunc from 0x025769 to 0x00ae3b (0x1a92d bytes) 000581 1782207364.462213 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xae3c): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xae3c): Mirror 2: 0x38e66bf7 (stale) Mirror 3: 0x38e66bf7 (stale) CRC-32 checksum value for chunk [0, 0xae3c): Mirror 1: 0x38e66bf7 Mirror 4: 0x38e66bf7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xae3c: skipped 000582 1782207365.357048 mapread 0x008e87 thru 0x00ae3b (0x1fb5 bytes) 000585 1782207365.418671 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xae3c): Mirror 2: 0x38e66bf7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xae3c): Mirror 2: 0x38e66bf7 (stale) CRC-32 checksum value for chunk [0, 0xae3c): Mirror 1: 0x38e66bf7 Mirror 4: 0x38e66bf7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xae3c: skipped 000587 1782207366.071450 mapwrite 0x006aa3 thru 0x00fdf3 (0x9351 bytes) 000588 1782207366.375664 trunc from 0x00fdf4 to 0x00b8e8 (0x450b bytes) 000589 1782207366.393517 trunc from 0x00b8e9 to 0x03e019 (0x32731 bytes) 000590 1782207366.418676 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3e01a): Mirror 2: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e01a): Mirror 2: 0xbc5759b7 (stale) Mirror 4: 0x175abdad (stale) CRC-32 checksum value for chunk [0, 0x3e01a): Mirror 1: 0x6a991560 Mirror 5: 0x6a991560 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e01a: skipped 000592 1782207367.553162 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e01a): Mirror 2: 0xbc5759b7 (stale) Mirror 4: 0x175abdad (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e01a): Mirror 2: 0xbc5759b7 (stale) Mirror 4: 0x175abdad (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e01a: skipped 000595 1782207367.965848 mapread 0x0222d0 thru 0x02e82b (0xc55c bytes) 000596 1782207367.991302 read 0x02e7f9 thru 0x0364c9 (0x7cd1 bytes) 000598 1782207367.997375 read 0x00b2ed thru 0x019ce3 (0xe9f7 bytes) 000599 1782207368.005950 mapread 0x00a40f thru 0x010891 (0x6483 bytes) 000600 1782207368.007691 write 0x03ae9a thru 0x03ffff (0x5166 bytes) 000602 1782207368.025637 write 0x001927 thru 0x00e4b5 (0xcb8f bytes) 000603 1782207368.034953 mapwrite 0x00b714 thru 0x00eff2 (0x38df bytes) 000606 1782207368.084809 trunc from 0x040000 to 0x02076b (0x1f894 bytes) 000607 1782207368.100716 mapread 0x01dc64 thru 0x02076b (0x2b08 bytes) 000608 1782207368.123129 mapread 0x01424c thru 0x0147f9 (0x5ae bytes) 000609 1782207368.128989 mapwrite 0x022eaf thru 0x02535f (0x24b1 bytes) 000612 1782207368.206445 read 0x0002e1 thru 0x00ded3 (0xdbf3 bytes) 000613 1782207368.219418 mapread 0x00cab1 thru 0x011fd9 (0x5529 bytes) 000614 1782207368.226322 MIRROR_RESYNC 3 mirrors 000616 1782207369.212704 mapread 0x01ac53 thru 0x02535f (0xa70d bytes) 000617 1782207369.277959 read 0x022862 thru 0x02535f (0x2afe bytes) 000618 1782207369.278578 read 0x00e39e thru 0x0130a6 (0x4d09 bytes) 000619 1782207369.305629 mapread 0x006a66 thru 0x013333 (0xc8ce bytes) 000622 1782207369.307532 mapread 0x01b42d thru 0x0243d3 (0x8fa7 bytes) 000624 1782207369.315026 mapwrite 0x02c7a7 thru 0x03c438 (0xfc92 bytes) 000625 1782207369.694581 write 0x02aace thru 0x02c3c2 (0x18f5 bytes) 000626 1782207369.703112 mapwrite 0x00107d thru 0x00e099 (0xd01d bytes) 000629 1782207369.899736 read 0x031707 thru 0x037fa8 (0x68a2 bytes) 000630 1782207369.900608 mapread 0x02312c thru 0x02b9ce (0x88a3 bytes) 000631 1782207369.920642 read 0x021fd9 thru 0x031181 (0xf1a9 bytes) 000636 1782207369.926595 write 0x004e20 thru 0x013411 (0xe5f2 bytes) 000637 1782207369.928099 mapread 0x0397f6 thru 0x03c438 (0x2c43 bytes) 000638 1782207369.941901 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3c439): Mirror 2: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c439): Mirror 2: 0x3a831c38 (stale) Mirror 4: 0x3a831c38 (stale) CRC-32 checksum value for chunk [0, 0x3c439): Mirror 1: 0xcfb1238f Mirror 5: 0xcfb1238f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c439: skipped 000641 1782207371.044235 MIRROR_RESYNC 4 mirrors 000643 1782207372.095971 mapwrite 0x007fcd thru 0x012c4d (0xac81 bytes) 000646 1782207372.302646 trunc from 0x03c439 to 0x0332be (0x917a bytes) 000649 1782207372.327812 MIRROR_RESYNC 4 mirrors 000650 1782207373.150423 trunc from 0x0332bf to 0x000881 (0x32a3d bytes) 000651 1782207373.284664 write 0x036ff6 thru 0x037165 (0x170 bytes) 000653 1782207373.286564 mapread 0x02d402 thru 0x02e4ab (0x10aa bytes) 000655 1782207373.345648 read 0x0257cc thru 0x027fed (0x2822 bytes) 000656 1782207373.357334 trunc from 0x037166 to 0x00145f (0x35d06 bytes) 000658 1782207373.405796 read 0x000275 thru 0x0012c3 (0x104f bytes) 000659 1782207373.416040 mapwrite 0x00cfc5 thru 0x0180b3 (0xb0ef bytes) 000660 1782207373.555551 read 0x011728 thru 0x0139b4 (0x228d bytes) 000662 1782207373.566532 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x180b4): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x180b4): Mirror 2: 0xb7eede0e (stale) Mirror 4: 0xb7eede0e (stale) Mirror 5: 0xb7eede0e (stale) CRC-32 checksum value for chunk [0, 0x180b4): Mirror 1: 0x3be6cc6c Mirror 6: 0x3be6cc6c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x180b4: skipped 000663 1782207374.778598 mapwrite 0x03fb20 thru 0x03ffff (0x4e0 bytes) 000665 1782207374.982680 read 0x001e0a thru 0x00fc7f (0xde76 bytes) 000666 1782207374.994883 write 0x03c115 thru 0x03ffff (0x3eeb bytes) 000667 1782207375.002627 read 0x0268f8 thru 0x02c348 (0x5a51 bytes) 000668 1782207375.020496 read 0x0337f7 thru 0x03cb2e (0x9338 bytes) 000669 1782207375.025614 MIRROR_RESYNC 5 mirrors 000676 1782207376.242229 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) 000679 1782207376.613559 MIRROR_RESYNC 4 mirrors 000680 1782207377.129806 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) 000681 1782207377.536389 MIRROR_RESYNC 3 mirrors 000682 1782207377.901130 trunc from 0x040000 to 0x020f58 (0x1f0a7 bytes) 000686 1782207378.019507 read 0x00e34b thru 0x014102 (0x5db8 bytes) 000688 1782207378.055187 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20f59): Mirror 5: 0xbb5a445e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20f59): Mirror 5: 0xbb5a445e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20f59: skipped 000691 1782207378.464183 mapwrite 0x026f80 thru 0x0288fc (0x197d bytes) 000693 1782207378.608592 write 0x027036 thru 0x02b2e4 (0x42af bytes) 000694 1782207378.622905 MIRROR_RESYNC 2 mirrors 000695 1782207379.390323 write 0x002fad thru 0x004acc (0x1b20 bytes) 000696 1782207379.484003 write 0x02476f thru 0x02cdc7 (0x8659 bytes) 000697 1782207379.493925 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) 000698 1782207379.685246 write 0x015598 thru 0x02004a (0xaab3 bytes) 000699 1782207379.700629 write 0x005e4c thru 0x00d758 (0x790d bytes) 000701 1782207379.712552 write 0x01d8fd thru 0x02739b (0x9a9f bytes) 000702 1782207379.718203 mapwrite 0x033471 thru 0x03ffff (0xcb8f bytes) 000706 1782207379.836688 read 0x00e580 thru 0x011fdf (0x3a60 bytes) 000709 1782207379.863296 MIRROR_EXTEND to 2 mirrors 000713 1782207380.802299 trunc from 0x040000 to 0x02457d (0x1ba82 bytes) 000714 1782207380.938552 trunc from 0x02457e to 0x01b347 (0x9236 bytes) 000715 1782207380.981435 mapwrite 0x01e61a thru 0x024aaf (0x6496 bytes) 000717 1782207381.165227 trunc from 0x024ab0 to 0x02c969 (0x7eba bytes) 000718 1782207381.195616 mapread 0x017a2b thru 0x01b0d0 (0x36a6 bytes) 000721 1782207381.219642 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2c96a): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c96a): Mirror 2: 0x361aa537 (stale) CRC-32 checksum value for chunk [0, 0x2c96a): Mirror 1: 0xc93346d Mirror 3: 0xc93346d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c96a: skipped 000723 1782207382.183406 trunc from 0x02c96a to 0x03c9a9 (0x10040 bytes) 000727 1782207382.328444 mapwrite 0x03e29c thru 0x03ffff (0x1d64 bytes) 000728 1782207382.537832 read 0x038c83 thru 0x03ffff (0x737d bytes) 000731 1782207382.563319 read 0x0065cc thru 0x00ee38 (0x886d bytes) 000733 1782207382.623258 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xf88c00e1 (stale) Mirror 3: 0x68958200 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe81ca14d Mirror 4: 0xe81ca14d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000738 1782207383.439178 mapwrite 0x03c62c thru 0x03ffff (0x39d4 bytes) 000740 1782207383.699972 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x68958200 (stale) Mirror 4: 0xe81ca14d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x68958200 (stale) Mirror 4: 0xe81ca14d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000745 1782207384.255130 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe81ca14d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe81ca14d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000747 1782207384.613680 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe81ca14d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd89e36ca Mirror 5: 0xd89e36ca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000748 1782207385.617527 write 0x0145e6 thru 0x01f8ef (0xb30a bytes) 000749 1782207385.741276 MIRROR_RESYNC 3 mirrors 000752 1782207386.828000 mapwrite 0x031827 thru 0x036122 (0x48fc bytes) 000753 1782207387.068905 write 0x02c4a2 thru 0x02cb59 (0x6b8 bytes) 000754 1782207387.075069 MIRROR_RESYNC 3 mirrors 000756 1782207387.916310 write 0x002931 thru 0x006ee4 (0x45b4 bytes) 000758 1782207388.070571 mapread 0x02a63b thru 0x02ce58 (0x281e bytes) 000761 1782207388.112133 read 0x02d9a9 thru 0x02e3d1 (0xa29 bytes) 000762 1782207388.115077 trunc from 0x040000 to 0x01a266 (0x25d99 bytes) 000764 1782207388.162071 mapwrite 0x034f40 thru 0x03ffff (0xb0c0 bytes) 000767 1782207388.319636 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x3bad0330 (stale) Mirror 5: 0x3bad0330 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd5553cc9 Mirror 6: 0xd5553cc9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000768 1782207389.534179 mapread 0x00d945 thru 0x015f79 (0x8635 bytes) 000769 1782207389.567410 read 0x039fef thru 0x03a523 (0x535 bytes) 000771 1782207389.585678 write 0x00c4d9 thru 0x01c46e (0xff96 bytes) 000772 1782207389.717792 mapread 0x0230aa thru 0x027edd (0x4e34 bytes) 000774 1782207389.728517 read 0x020764 thru 0x027d17 (0x75b4 bytes) 000776 1782207389.730551 trunc from 0x040000 to 0x031124 (0xeedb bytes) 000778 1782207389.779234 write 0x027bdc thru 0x0359ec (0xde11 bytes) 000779 1782207389.780780 read 0x0011a4 thru 0x007d76 (0x6bd3 bytes) 000780 1782207389.790167 read 0x0188cd thru 0x01d2f4 (0x4a28 bytes) 000781 1782207389.791847 trunc from 0x0359ed to 0x01e637 (0x173b5 bytes) 000782 1782207389.807288 mapread 0x009ea7 thru 0x01139f (0x74f9 bytes) 000783 1782207389.813453 MIRROR_RESYNC 4 mirrors 000785 1782207390.922329 mapwrite 0x03751e thru 0x03ffff (0x8ae2 bytes) 000786 1782207391.184308 mapwrite 0x029e53 thru 0x035590 (0xb73e bytes) 000788 1782207391.280927 read 0x006686 thru 0x013a20 (0xd39b bytes) 000790 1782207391.311717 trunc from 0x040000 to 0x02cc52 (0x133ad bytes) 000792 1782207391.360134 read 0x0051c2 thru 0x0106ae (0xb4ed bytes) 000795 1782207391.404199 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2cc53): Mirror 5: 0x2c4562b5 (stale) Mirror 6: 0x2c4562b5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cc53): Mirror 5: 0x2c4562b5 (stale) Mirror 6: 0x2c4562b5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cc53: skipped 000796 1782207391.997852 read 0x004a64 thru 0x012976 (0xdf13 bytes) 000797 1782207392.009306 write 0x00fd08 thru 0x013804 (0x3afd bytes) 000798 1782207392.027399 mapwrite 0x02c887 thru 0x031528 (0x4ca2 bytes) 000799 1782207392.150557 MIRROR_RESYNC 3 mirrors 000800 1782207392.953988 mapread 0x00cb5e thru 0x01b192 (0xe635 bytes) 000801 1782207393.064194 MIRROR_RESYNC 3 mirrors 000802 1782207393.616145 trunc from 0x031529 to 0x0076a5 (0x29e83 bytes) 000803 1782207393.838445 write 0x0246c7 thru 0x030225 (0xbb5f bytes) 000804 1782207393.849712 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x30226): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30226): Mirror 5: 0x9d519fd6 (stale) Mirror 6: 0x9d519fd6 (stale) CRC-32 checksum value for chunk [0, 0x30226): Mirror 1: 0xd78d9a1a Mirror 7: 0xd78d9a1a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30226: skipped 000806 1782207395.071352 trunc from 0x030226 to 0x00b8dc (0x24949 bytes) 000807 1782207395.162205 MIRROR_RESYNC 4 mirrors 000808 1782207396.136605 read 0x00173e thru 0x0080a3 (0x6966 bytes) 000812 1782207396.175704 MIRROR_EXTEND to 5 mirrors 000813 1782207396.932414 write 0x01b912 thru 0x01e91b (0x300a bytes) 000817 1782207397.022987 write 0x0214eb thru 0x025147 (0x3c5d bytes) 000818 1782207397.026013 read 0x01ae43 thru 0x01ec23 (0x3de1 bytes) 000819 1782207397.032921 read 0x0242ca thru 0x025147 (0xe7e bytes) 000820 1782207397.033727 read 0x01e071 thru 0x025147 (0x70d7 bytes) 000821 1782207397.047589 read 0x0198c7 thru 0x01f557 (0x5c91 bytes) 000823 1782207397.049489 read 0x01eb14 thru 0x025147 (0x6634 bytes) 000825 1782207397.051073 mapread 0x006179 thru 0x01162c (0xb4b4 bytes) 000829 1782207397.059781 write 0x02de0c thru 0x038c60 (0xae55 bytes) 000831 1782207397.065112 mapread 0x02180b thru 0x02eaa9 (0xd29f bytes) 000832 1782207397.085655 read 0x00fb1f thru 0x0182ad (0x878f bytes) 000833 1782207397.087650 mapread 0x032eff thru 0x038c60 (0x5d62 bytes) 000834 1782207397.095614 mapread 0x01f90a thru 0x02c285 (0xc97c bytes) 000840 1782207397.104805 mapwrite 0x009383 thru 0x018bf7 (0xf875 bytes) 000843 1782207397.169294 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38c61): Mirror 6: 0x8178d864 (stale) Mirror 7: 0x8178d864 (stale) Mirror 8: 0x8178d864 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38c61): Mirror 6: 0x8178d864 (stale) Mirror 7: 0x8178d864 (stale) Mirror 8: 0x8178d864 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38c61: skipped 000844 1782207397.560129 mapwrite 0x02c8ea thru 0x036e03 (0xa51a bytes) 000846 1782207397.632116 trunc from 0x038c61 to 0x00cd87 (0x2bed9 bytes) 000848 1782207397.651005 write 0x003301 thru 0x00a339 (0x7039 bytes) 000849 1782207397.662216 write 0x02b351 thru 0x036a2b (0xb6db bytes) 000851 1782207397.665841 mapwrite 0x0352dd thru 0x037bb5 (0x28d9 bytes) 000852 1782207397.720070 read 0x034c03 thru 0x037bb5 (0x2fb3 bytes) 000853 1782207397.743767 MIRROR_RESYNC 4 mirrors 000856 1782207398.705664 write 0x00157e thru 0x002263 (0xce6 bytes) 000857 1782207398.786670 mapread 0x03790c thru 0x037bb5 (0x2aa bytes) 000859 1782207398.801320 mapwrite 0x0271ed thru 0x02ac14 (0x3a28 bytes) 000861 1782207398.879682 read 0x02fc39 thru 0x03766b (0x7a33 bytes) 000863 1782207398.889285 mapread 0x02b289 thru 0x034b6e (0x98e6 bytes) 000864 1782207398.895165 MIRROR_RESYNC 4 mirrors 000865 1782207399.632766 MIRROR_EXTEND to 5 mirrors 000866 1782207400.194095 write 0x02adce thru 0x02dbfd (0x2e30 bytes) 000867 1782207400.253788 read 0x034789 thru 0x035321 (0xb99 bytes) 000868 1782207400.258610 mapwrite 0x0383d0 thru 0x03ffff (0x7c30 bytes) 000869 1782207400.328442 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x7cc04fb6 (stale) Mirror 7: 0x7cc04fb6 (stale) Mirror 8: 0x7cc04fb6 (stale) Mirror 9: 0x7cc04fb6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdbb640e2 Mirror 10: 0xdbb640e2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000870 1782207400.900382 mapwrite 0x014758 thru 0x018b2c (0x43d5 bytes) 000872 1782207401.069556 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x7cc04fb6 (stale) Mirror 7: 0x7cc04fb6 (stale) Mirror 8: 0x7cc04fb6 (stale) Mirror 9: 0x7cc04fb6 (stale) Mirror 10: 0xdbb640e2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1cdffa93 Mirror 11: 0x1cdffa93 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000873 1782207401.954667 mapwrite 0x0358ad thru 0x0396e5 (0x3e39 bytes) 000875 1782207402.177766 trunc from 0x040000 to 0x02cef8 (0x13107 bytes) 000876 1782207402.194546 read 0x00d1d9 thru 0x016199 (0x8fc1 bytes) 000878 1782207402.207712 trunc from 0x02cef9 to 0x007da2 (0x25156 bytes) 000881 1782207402.237844 MIRROR_RESYNC 7 mirrors 000883 1782207403.210446 mapread 0x007483 thru 0x007da2 (0x920 bytes) 000884 1782207403.214080 trunc from 0x007da3 to 0x0365e2 (0x2e840 bytes) 000886 1782207403.328598 trunc from 0x0365e3 to 0x029084 (0xd55e bytes) 000890 1782207403.361507 write 0x039e26 thru 0x03f8c5 (0x5aa0 bytes) 000891 1782207403.377180 MIRROR_RESYNC 7 mirrors 000895 1782207404.788768 MIRROR_RESYNC 7 mirrors 000897 1782207405.579331 mapread 0x01ab92 thru 0x01ffe0 (0x544f bytes) 000898 1782207405.601082 read 0x005d6b thru 0x00641d (0x6b3 bytes) 000899 1782207405.605958 trunc from 0x03f8c6 to 0x01d4d2 (0x223f3 bytes) 000901 1782207405.759943 mapread 0x015479 thru 0x01afaa (0x5b32 bytes) 000902 1782207405.802602 write 0x01cc8a thru 0x02be25 (0xf19c bytes) 000903 1782207405.804305 write 0x02a517 thru 0x0325b3 (0x809d bytes) 000905 1782207405.834399 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x325b4): Mirror 6: 0x1aa3b1eb (stale) Mirror 7: 0x1aa3b1eb (stale) Mirror 8: 0x1aa3b1eb (stale) Mirror 9: 0x1aa3b1eb (stale) Mirror 10: 0x1aa3b1eb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x325b4): Mirror 6: 0x1aa3b1eb (stale) Mirror 7: 0x1aa3b1eb (stale) Mirror 8: 0x1aa3b1eb (stale) Mirror 9: 0x1aa3b1eb (stale) Mirror 10: 0x1aa3b1eb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x325b4: skipped 000906 1782207406.410057 mapwrite 0x0322ce thru 0x03d3c3 (0xb0f6 bytes) 000908 1782207406.628918 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3d3c4): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d3c4): Mirror 6: 0x67947035 (stale) Mirror 7: 0x67947035 (stale) Mirror 8: 0x67947035 (stale) Mirror 9: 0x67947035 (stale) Mirror 10: 0x67947035 (stale) CRC-32 checksum value for chunk [0, 0x3d3c4): Mirror 1: 0x9b073c5c Mirror 11: 0x9b073c5c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d3c4: skipped 000909 1782207408.129322 mapwrite 0x00ab30 thru 0x0160af (0xb580 bytes) 000911 1782207408.538301 trunc from 0x03d3c4 to 0x006d95 (0x3662e bytes) 000913 1782207408.581954 read 0x005203 thru 0x006d95 (0x1b93 bytes) 000915 1782207408.599307 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x6d96): Mirror 6: 0xc1b2eee6 (stale) Mirror 7: 0xc1b2eee6 (stale) Mirror 8: 0xc1b2eee6 (stale) Mirror 9: 0xc1b2eee6 (stale) Mirror 11: 0xc1b2eee6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6d96): Mirror 6: 0xc1b2eee6 (stale) Mirror 7: 0xc1b2eee6 (stale) Mirror 8: 0xc1b2eee6 (stale) Mirror 9: 0xc1b2eee6 (stale) Mirror 11: 0xc1b2eee6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6d96: skipped 000918 1782207409.255369 mapread 0x000dba thru 0x006d95 (0x5fdc bytes) 000920 1782207409.289543 mapwrite 0x0191c8 thru 0x028870 (0xf6a9 bytes) 000921 1782207409.552816 MIRROR_RESYNC 6 mirrors 000922 1782207410.906676 mapwrite 0x013246 thru 0x01cc7d (0x9a38 bytes) 000925 1782207411.092579 trunc from 0x028871 to 0x03731d (0xeaad bytes) 000927 1782207411.118588 write 0x0010e3 thru 0x010924 (0xf842 bytes) 000929 1782207411.128623 mapread 0x0055f5 thru 0x0154b5 (0xfec1 bytes) 000930 1782207411.131860 read 0x009fc2 thru 0x01960f (0xf64e bytes) 000931 1782207411.132763 write 0x010c53 thru 0x01322e (0x25dc bytes) 000933 1782207411.135974 read 0x0215b6 thru 0x02f7c6 (0xe211 bytes) 000935 1782207411.163829 read 0x00728d thru 0x0154ae (0xe222 bytes) 000937 1782207411.166965 trunc from 0x03731e to 0x017669 (0x1fcb4 bytes) 000940 1782207411.189573 mapwrite 0x0279b1 thru 0x02826c (0x8bc bytes) 000942 1782207411.372534 read 0x014a47 thru 0x018eae (0x4468 bytes) 000944 1782207411.379397 mapread 0x01baa4 thru 0x02826c (0xc7c9 bytes) 000945 1782207411.390168 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2826d): Mirror 6: 0xe362a3c7 (stale) Mirror 7: 0xe362a3c7 (stale) Mirror 8: 0xe362a3c7 (stale) Mirror 9: 0xe362a3c7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2826d): Mirror 6: 0xe362a3c7 (stale) Mirror 7: 0xe362a3c7 (stale) Mirror 8: 0xe362a3c7 (stale) Mirror 9: 0xe362a3c7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2826d: skipped 000946 1782207411.934263 write 0x00f0dd thru 0x01b1d9 (0xc0fd bytes) 000948 1782207411.961918 MIRROR_RESYNC 5 mirrors 000949 1782207412.949627 mapread 0x022286 thru 0x0259ce (0x3749 bytes) 000950 1782207412.983230 write 0x02b9f1 thru 0x02daef (0x20ff bytes) 000954 1782207413.115423 mapread 0x015352 thru 0x0186cc (0x337b bytes) 000957 1782207413.149223 MIRROR_RESYNC 5 mirrors 000958 1782207414.499544 mapread 0x00ea97 thru 0x00f840 (0xdaa bytes) 000959 1782207414.511616 trunc from 0x02daf0 to 0x03e1c0 (0x106d1 bytes) 000960 1782207414.654568 read 0x02ea45 thru 0x03c269 (0xd825 bytes) 000962 1782207414.671654 read 0x034869 thru 0x0392d6 (0x4a6e bytes) 000963 1782207414.673222 write 0x03f6c1 thru 0x03ffff (0x93f bytes) 000964 1782207414.681431 trunc from 0x040000 to 0x0068e0 (0x3971f bytes) 000965 1782207414.715491 read 0x000fef thru 0x0016b6 (0x6c8 bytes) 000967 1782207414.739118 write 0x02dc27 thru 0x03171f (0x3af9 bytes) 000968 1782207414.745949 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31720): Mirror 7: 0xf90c5bdd (stale) Mirror 8: 0xf90c5bdd (stale) Mirror 9: 0xf90c5bdd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31720): Mirror 7: 0xf90c5bdd (stale) Mirror 8: 0xf90c5bdd (stale) Mirror 9: 0xf90c5bdd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31720: skipped 000970 1782207415.453861 mapwrite 0x00e58c thru 0x0167a8 (0x821d bytes) 000973 1782207415.608173 mapread 0x0217df thru 0x02b2bf (0x9ae1 bytes) 000974 1782207415.655894 read 0x00ceb2 thru 0x00e65f (0x17ae bytes) 000976 1782207415.662612 mapwrite 0x03beb0 thru 0x03cf60 (0x10b1 bytes) 000977 1782207415.838259 mapread 0x0213e9 thru 0x021de0 (0x9f8 bytes) 000978 1782207415.842353 read 0x033491 thru 0x0379aa (0x451a bytes) 000980 1782207415.868185 mapread 0x008198 thru 0x00857d (0x3e6 bytes) 000983 1782207415.873575 trunc from 0x03cf61 to 0x0331e7 (0x9d79 bytes) 000984 1782207415.900450 write 0x024c40 thru 0x02dd12 (0x90d3 bytes) 000985 1782207415.910493 trunc from 0x0331e8 to 0x02797e (0xb869 bytes) 000987 1782207415.969671 read 0x001119 thru 0x00798e (0x6876 bytes) 000989 1782207415.991030 MIRROR_RESYNC 4 mirrors 000990 1782207417.517980 mapwrite 0x00b108 thru 0x018c94 (0xdb8d bytes) 000992 1782207417.940720 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2797f): Mirror 8: 0xdfd486b8 (stale) Mirror 9: 0xdfd486b8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2797f): Mirror 8: 0xdfd486b8 (stale) Mirror 9: 0xdfd486b8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2797f: skipped 000993 1782207418.472351 read 0x007892 thru 0x00f50b (0x7c7a bytes) 000994 1782207418.481239 write 0x00dccf thru 0x00f947 (0x1c79 bytes) 000995 1782207418.482277 write 0x01462b thru 0x020369 (0xbd3f bytes) 000996 1782207418.498767 mapwrite 0x002dbd thru 0x0046f2 (0x1936 bytes) 000997 1782207418.583367 mapread 0x01a4d1 thru 0x02797e (0xd4ae bytes) 000998 1782207418.620807 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2797f): Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2797f): Mirror 8: 0xdfd486b8 (stale) Mirror 9: 0xdfd486b8 (stale) CRC-32 checksum value for chunk [0, 0x2797f): Mirror 1: 0xb7b13e0f Mirror 10: 0xb7b13e0f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2797f: skipped 000999 1782207419.696023 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x194:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2797f): Mirror 8: 0xdfd486b8 (stale) Mirror 9: 0xdfd486b8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2797f): Mirror 8: 0xdfd486b8 (stale) Mirror 9: 0xdfd486b8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2797f: skipped All operations completed A-OK!