== sanity-flr test 70a: flr mode fsx test ================ 03:37:27 (1779694647) Seed set to 4649 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000003 1779694650.517132 mapwrite 0x012e71 thru 0x0147cb (0x195b bytes) 000005 1779694650.778868 write 0x01a9d2 thru 0x026c38 (0xc267 bytes) 000007 1779694650.782628 mapread 0x009599 thru 0x00fa96 (0x64fe bytes) 000008 1779694650.803758 write 0x02abc5 thru 0x02c8e4 (0x1d20 bytes) 000011 1779694650.809039 write 0x022e8c thru 0x02344a (0x5bf bytes) 000012 1779694650.810393 mapwrite 0x028bb7 thru 0x037e62 (0xf2ac bytes) 000013 1779694650.966203 mapwrite 0x03d000 thru 0x03ffff (0x3000 bytes) 000019 1779694651.081044 mapread 0x019147 thru 0x020cb6 (0x7b70 bytes) 000020 1779694651.098529 mapwrite 0x03d875 thru 0x03ffff (0x278b bytes) 000023 1779694651.165091 write 0x01daae thru 0x02c4f0 (0xea43 bytes) truncating to largest ever: 0x4084 000024 1779694651.169897 trunc from 0x040000 to 0x004083 (0x3bf7c bytes) 000025 1779694651.191963 mapread 0x0012c4 thru 0x004083 (0x2dc0 bytes) 000027 1779694651.200345 write 0x0331f4 thru 0x03ab6e (0x797b bytes) truncating to largest ever: 0x6d1c 000028 1779694651.203656 trunc from 0x03ab6f to 0x006d1b (0x33e53 bytes) truncating to largest ever: 0x107c2 000032 1779694651.232220 trunc from 0x006d1c to 0x0107c1 (0x9aa6 bytes) 000033 1779694651.255618 mapread 0x00c259 thru 0x0107c1 (0x4569 bytes) 000034 1779694651.267430 write 0x02ea64 thru 0x03681a (0x7db7 bytes) 000036 1779694651.270067 read 0x026a10 thru 0x02eb0e (0x80ff bytes) truncating to largest ever: 0x2eb44 000039 1779694651.281453 trunc from 0x03681b to 0x02eb43 (0x7cd7 bytes) 000040 1779694651.313777 MIRROR_EXTEND to 2 mirrors 000041 1779694652.398100 mapread 0x013375 thru 0x013d84 (0xa10 bytes) 000044 1779694652.414441 write 0x006c7d thru 0x00f7a2 (0x8b26 bytes) 000046 1779694652.545556 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2eb44): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2eb44): Mirror 2: 0x99f6ec9 (stale) CRC-32 checksum value for chunk [0, 0x2eb44): Mirror 1: 0x26881a66 Mirror 3: 0x26881a66 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2eb44: skipped 000054 1779694653.901356 mapwrite 0x02b86f thru 0x02c4b9 (0xc4b bytes) 000056 1779694654.141933 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2eb44): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2eb44): Mirror 2: 0x99f6ec9 (stale) Mirror 3: 0x26881a66 (stale) CRC-32 checksum value for chunk [0, 0x2eb44): Mirror 1: 0x310888fb Mirror 4: 0x310888fb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2eb44: skipped truncating to largest ever: 0x314ce 000057 1779694655.585483 trunc from 0x02eb44 to 0x0314cd (0x298a bytes) 000058 1779694655.764345 MIRROR_RESYNC 4 mirrors 000059 1779694657.079868 write 0x03876b thru 0x03ffff (0x7895 bytes) 000060 1779694657.162566 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x8ef251b5 (stale) Mirror 4: 0x8ef251b5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x8ef251b5 (stale) Mirror 4: 0x8ef251b5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000062 1779694657.593936 write 0x0269b5 thru 0x036043 (0xf68f bytes) 000063 1779694657.607071 mapwrite 0x02a7dd thru 0x02db08 (0x332c bytes) 000065 1779694657.721454 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x8ef251b5 (stale) Mirror 4: 0x8ef251b5 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x64a3e4a1 Mirror 5: 0x64a3e4a1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000066 1779694659.003338 mapread 0x01e865 thru 0x02c77a (0xdf16 bytes) 000067 1779694659.070016 MIRROR_RESYNC 4 mirrors truncating to largest ever: 0x3a8c1 000068 1779694660.704545 trunc from 0x040000 to 0x03a8c0 (0x573f bytes) 000072 1779694660.828683 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a8c1): Mirror 4: 0x788b2899 (stale) Mirror 5: 0x788b2899 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a8c1): Mirror 4: 0x788b2899 (stale) Mirror 5: 0x788b2899 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a8c1: skipped 000073 1779694661.412909 write 0x02db98 thru 0x031e7c (0x42e5 bytes) 000075 1779694661.432363 mapread 0x035613 thru 0x03a8c0 (0x52ae bytes) 000076 1779694661.447644 write 0x03b58c thru 0x03ffff (0x4a74 bytes) 000077 1779694661.451247 mapwrite 0x03734a thru 0x03afa7 (0x3c5e bytes) 000079 1779694661.520120 mapread 0x030d89 thru 0x03160e (0x886 bytes) 000080 1779694661.521108 trunc from 0x040000 to 0x024ce0 (0x1b31f bytes) 000081 1779694661.542012 read 0x01d5de thru 0x024ce0 (0x7703 bytes) 000083 1779694661.553013 mapread 0x02329a thru 0x024305 (0x106c bytes) 000087 1779694661.557831 write 0x03fec9 thru 0x03ffff (0x137 bytes) 000091 1779694661.562663 mapwrite 0x02881d thru 0x038815 (0xfff9 bytes) 000094 1779694661.657819 mapwrite 0x0177ba thru 0x01cbb9 (0x5400 bytes) 000095 1779694661.740538 mapwrite 0x02a527 thru 0x03a363 (0xfe3d bytes) 000097 1779694661.852950 mapwrite 0x029d5c thru 0x032f26 (0x91cb bytes) 000100 1779694661.942557 mapread 0x0062a2 thru 0x00d5ca (0x7329 bytes) 000101 1779694661.961864 trunc from 0x040000 to 0x001a05 (0x3e5fa bytes) 000102 1779694661.987315 read 0x000c32 thru 0x001a05 (0xdd4 bytes) 000103 1779694661.997050 write 0x00b071 thru 0x01321c (0x81ac bytes) 000104 1779694662.001382 mapread 0x010131 thru 0x01321c (0x30ec bytes) 000105 1779694662.004460 trunc from 0x01321d to 0x02b4f8 (0x182dc bytes) 000107 1779694662.037966 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b4f9): Mirror 5: 0x23cb7efe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b4f9): Mirror 5: 0x23cb7efe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b4f9: skipped 000108 1779694662.630705 mapread 0x00be78 thru 0x00eaf6 (0x2c7f bytes) 000110 1779694662.659893 write 0x000282 thru 0x003774 (0x34f3 bytes) 000111 1779694662.675836 trunc from 0x02b4f9 to 0x02979e (0x1d5a bytes) 000112 1779694662.709099 trunc from 0x02979f to 0x03033b (0x6b9d bytes) 000115 1779694662.748361 trunc from 0x03033c to 0x0054ca (0x2ae71 bytes) 000116 1779694662.783247 MIRROR_RESYNC 2 mirrors 000117 1779694663.842608 write 0x030253 thru 0x03e3f6 (0xe1a4 bytes) 000118 1779694663.956593 write 0x00cef7 thru 0x01c4f3 (0xf5fd bytes) 000120 1779694663.970317 mapwrite 0x000153 thru 0x00494b (0x47f9 bytes) 000121 1779694664.106998 mapread 0x0224a7 thru 0x025baf (0x3709 bytes) 000124 1779694664.127273 mapread 0x030fd1 thru 0x0327ee (0x181e bytes) 000126 1779694664.135366 read 0x01e5d9 thru 0x024f75 (0x699d bytes) truncating to largest ever: 0x3fea3 000127 1779694664.137499 trunc from 0x03e3f7 to 0x03fea2 (0x1aac bytes) 000128 1779694664.171042 mapwrite 0x026a52 thru 0x02a3f0 (0x399f bytes) 000129 1779694664.229969 trunc from 0x03fea3 to 0x0306d2 (0xf7d0 bytes) 000130 1779694664.268262 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x306d3): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x306d3): Mirror 5: 0x80743820 (stale) CRC-32 checksum value for chunk [0, 0x306d3): Mirror 1: 0xaa51d0c Mirror 6: 0xaa51d0c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x306d3: skipped 000132 1779694665.156338 trunc from 0x0306d3 to 0x00b350 (0x25382 bytes) 000134 1779694665.277001 write 0x002634 thru 0x00abc8 (0x8595 bytes) 000137 1779694665.291263 read 0x003439 thru 0x0091e6 (0x5dae bytes) 000138 1779694665.293518 mapwrite 0x017abe thru 0x0186db (0xc1e bytes) 000140 1779694665.430692 mapwrite 0x01bc5e thru 0x02b2a6 (0xf649 bytes) 000142 1779694665.614443 trunc from 0x02b2a7 to 0x001d1d (0x29589 bytes) 000143 1779694665.686615 mapwrite 0x02a0ba thru 0x036d2d (0xcc74 bytes) 000145 1779694665.914069 MIRROR_RESYNC 3 mirrors 000147 1779694666.916640 mapread 0x01d865 thru 0x02936e (0xbb0a bytes) 000149 1779694666.973353 mapwrite 0x01e080 thru 0x028ec3 (0xae44 bytes) 000150 1779694667.180141 write 0x01e166 thru 0x02b915 (0xd7b0 bytes) 000151 1779694667.190440 MIRROR_RESYNC 3 mirrors 000154 1779694668.402449 mapwrite 0x0151c8 thru 0x023fe7 (0xee20 bytes) 000155 1779694668.776486 trunc from 0x036d2e to 0x0032c0 (0x33a6d bytes) 000156 1779694668.810321 write 0x009298 thru 0x009e4b (0xbb4 bytes) 000157 1779694668.811506 write 0x02a923 thru 0x036c08 (0xc2e6 bytes) 000158 1779694668.815861 mapread 0x010569 thru 0x019923 (0x93bb bytes) 000159 1779694668.835432 read 0x025650 thru 0x02bcf6 (0x66a7 bytes) 000160 1779694668.846569 mapwrite 0x02b896 thru 0x0399c3 (0xe12e bytes) 000161 1779694668.957594 mapread 0x008896 thru 0x013c06 (0xb371 bytes) 000162 1779694668.972038 read 0x02f73c thru 0x0399c3 (0xa288 bytes) 000164 1779694668.974395 read 0x00dafd thru 0x01936f (0xb873 bytes) 000166 1779694668.982884 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x399c4): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x399c4): Mirror 5: 0x1e54ee74 (stale) Mirror 6: 0x1e54ee74 (stale) CRC-32 checksum value for chunk [0, 0x399c4): Mirror 1: 0x74fd60d2 Mirror 7: 0x74fd60d2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x399c4: skipped 000169 1779694670.266566 read 0x0103fc thru 0x013706 (0x330b bytes) 000170 1779694670.282267 write 0x02f6db thru 0x0393a6 (0x9ccc bytes) 000171 1779694670.546771 MIRROR_RESYNC 4 mirrors 000172 1779694671.832290 trunc from 0x0399c4 to 0x030cc3 (0x8d00 bytes) 000175 1779694671.974304 trunc from 0x030cc4 to 0x03e6c7 (0xda04 bytes) 000176 1779694672.004877 trunc from 0x03e6c8 to 0x018c9b (0x25a2c bytes) 000177 1779694672.028547 read 0x008d66 thru 0x00f59b (0x6836 bytes) 000178 1779694672.049783 MIRROR_RESYNC 4 mirrors 000180 1779694673.400686 write 0x002731 thru 0x00e267 (0xbb37 bytes) 000183 1779694673.544018 MIRROR_RESYNC 4 mirrors 000184 1779694674.411143 mapread 0x0023ac thru 0x00354e (0x11a3 bytes) 000185 1779694674.430700 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) 000186 1779694674.940554 write 0x0108e6 thru 0x017892 (0x6fad bytes) 000187 1779694675.112427 trunc from 0x018c9c to 0x000c90 (0x1800b bytes) 000189 1779694675.166465 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xc91): Mirror 7: 0x843f576d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc91): Mirror 7: 0x843f576d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc91: skipped 000190 1779694675.623147 mapwrite 0x02f9b9 thru 0x038875 (0x8ebd bytes) 000192 1779694675.784532 read 0x02f79b thru 0x038875 (0x90db bytes) 000195 1779694675.798144 MIRROR_RESYNC 2 mirrors 000196 1779694676.571501 trunc from 0x038876 to 0x03f099 (0x6824 bytes) 000197 1779694676.695511 write 0x011425 thru 0x0159ad (0x4589 bytes) 000198 1779694676.712117 mapwrite 0x01f947 thru 0x02d121 (0xd7db bytes) 000199 1779694676.822990 mapread 0x01ef7a thru 0x02667f (0x7706 bytes) 000200 1779694676.829837 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) 000203 1779694677.006663 read 0x034013 thru 0x037032 (0x3020 bytes) 000206 1779694677.024972 read 0x00dd19 thru 0x01bace (0xddb6 bytes) 000207 1779694677.046645 trunc from 0x03f09a to 0x00006c (0x3f02d bytes) 000208 1779694677.075067 mapwrite 0x017baa thru 0x023c1f (0xc076 bytes) 000210 1779694677.247019 read 0x021065 thru 0x023c1f (0x2bbb bytes) 000218 1779694677.258428 read 0x00025b thru 0x00fe00 (0xfba6 bytes) 000219 1779694677.271673 read 0x009eda thru 0x00c6ba (0x27e1 bytes) 000221 1779694677.275508 write 0x007eba thru 0x014f3b (0xd082 bytes) 000222 1779694677.277463 write 0x039de0 thru 0x03ffff (0x6220 bytes) 000224 1779694677.284393 MIRROR_EXTEND to 2 mirrors 000228 1779694677.909873 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) 000231 1779694678.088472 trunc from 0x040000 to 0x008de0 (0x3721f bytes) 000232 1779694678.163528 mapwrite 0x019baf thru 0x0201a7 (0x65f9 bytes) 000234 1779694678.286847 mapread 0x009e2a thru 0x0154f6 (0xb6cd bytes) 000236 1779694678.309185 mapwrite 0x0300e1 thru 0x03ad0c (0xac2c bytes) 000240 1779694678.425481 read 0x016d55 thru 0x024adc (0xdd88 bytes) 000243 1779694678.435321 mapwrite 0x007e8c thru 0x017746 (0xf8bb bytes) 000244 1779694678.514234 mapwrite 0x0234c8 thru 0x030eee (0xda27 bytes) 000246 1779694678.582892 read 0x036d64 thru 0x03ad0c (0x3fa9 bytes) 000248 1779694678.595590 MIRROR_EXTEND to 2 mirrors 000249 1779694679.325319 mapread 0x034d78 thru 0x03ad0c (0x5f95 bytes) 000252 1779694679.347543 mapread 0x00979b thru 0x00d69a (0x3f00 bytes) 000255 1779694679.360026 mapwrite 0x025ec9 thru 0x0334b2 (0xd5ea bytes) 000257 1779694679.547958 mapwrite 0x023bc6 thru 0x033958 (0xfd93 bytes) 000258 1779694679.647869 mapwrite 0x02d414 thru 0x034ab3 (0x76a0 bytes) 000260 1779694679.747311 mapwrite 0x00bd75 thru 0x01b748 (0xf9d4 bytes) 000261 1779694679.841412 mapread 0x023163 thru 0x02b863 (0x8701 bytes) 000262 1779694679.849399 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3ad0d): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ad0d): Mirror 2: 0xb37046a8 (stale) CRC-32 checksum value for chunk [0, 0x3ad0d): Mirror 1: 0x3adb9987 Mirror 3: 0x3adb9987 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ad0d: skipped 000263 1779694681.250091 mapwrite 0x011c01 thru 0x019b5c (0x7f5c bytes) 000264 1779694681.643921 mapwrite 0x021eb4 thru 0x031c68 (0xfdb5 bytes) 000266 1779694681.799447 MIRROR_RESYNC 3 mirrors 000268 1779694683.149409 mapread 0x0035f2 thru 0x012921 (0xf330 bytes) 000276 1779694683.182168 trunc from 0x03ad0d to 0x026ded (0x13f1f bytes) 000278 1779694683.262144 read 0x021062 thru 0x0262a9 (0x5248 bytes) 000279 1779694683.277047 trunc from 0x026dee to 0x03fc7a (0x18e8d bytes) 000281 1779694683.299132 read 0x01757b thru 0x01ab25 (0x35ab bytes) 000284 1779694683.314013 mapwrite 0x033172 thru 0x03aba0 (0x7a2f bytes) 000287 1779694683.375633 write 0x006e4c thru 0x007434 (0x5e9 bytes) 000288 1779694683.377910 read 0x0368b5 thru 0x03a0cd (0x3819 bytes) 000289 1779694683.379081 write 0x018f21 thru 0x01a4aa (0x158a bytes) 000290 1779694683.385126 MIRROR_RESYNC 3 mirrors 000292 1779694684.125440 mapwrite 0x004c61 thru 0x007ad2 (0x2e72 bytes) 000293 1779694684.325963 read 0x01c168 thru 0x02a18b (0xe024 bytes) 000294 1779694684.357327 read 0x018cfe thru 0x02218e (0x9491 bytes) 000295 1779694684.389760 mapread 0x0195ca thru 0x01d172 (0x3ba9 bytes) 000296 1779694684.391116 write 0x0316bc thru 0x034986 (0x32cb bytes) 000297 1779694684.414076 read 0x01f532 thru 0x01f6b8 (0x187 bytes) 000301 1779694684.430884 mapread 0x005250 thru 0x0130f3 (0xdea4 bytes) 000302 1779694684.437153 trunc from 0x03fc7b to 0x00a935 (0x35345 bytes) 000303 1779694684.535973 trunc from 0x00a936 to 0x039dab (0x2f476 bytes) 000304 1779694684.584388 trunc from 0x039dac to 0x015638 (0x24773 bytes) 000305 1779694684.615514 mapread 0x004a1f thru 0x0143bd (0xf99f bytes) 000307 1779694684.638482 mapread 0x0141a3 thru 0x015638 (0x1496 bytes) 000309 1779694684.658860 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x15639): Mirror 3: 0x8f094b55 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15639): Mirror 3: 0x8f094b55 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15639: skipped 000310 1779694685.133038 mapwrite 0x03f00b thru 0x03ffff (0xff5 bytes) 000312 1779694685.258993 MIRROR_RESYNC 2 mirrors 000313 1779694686.305104 mapread 0x01e1f9 thru 0x02c2a4 (0xe0ac bytes) 000314 1779694686.340248 write 0x029166 thru 0x032d3b (0x9bd6 bytes) 000316 1779694686.538671 mapread 0x00203e thru 0x008463 (0x6426 bytes) 000317 1779694686.563025 mapread 0x0323da thru 0x03f47e (0xd0a5 bytes) 000320 1779694686.646884 mapwrite 0x00d066 thru 0x00f4cd (0x2468 bytes) 000321 1779694686.851955 write 0x03933f thru 0x03d9c2 (0x4684 bytes) 000324 1779694686.866690 mapread 0x03aa64 thru 0x03ffff (0x559c bytes) 000328 1779694686.891483 trunc from 0x040000 to 0x00c8da (0x33725 bytes) 000329 1779694687.005286 mapread 0x0009a3 thru 0x000b33 (0x191 bytes) 000330 1779694687.015070 mapwrite 0x01f898 thru 0x0264fe (0x6c67 bytes) 000331 1779694687.129544 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) 000333 1779694687.377661 mapwrite 0x01e92c thru 0x02a81e (0xbef3 bytes) 000335 1779694687.550312 read 0x017d2b thru 0x023091 (0xb367 bytes) 000336 1779694687.568407 MIRROR_EXTEND to 2 mirrors 000337 1779694688.708304 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) 000342 1779694689.021191 mapread 0x023253 thru 0x02a81e (0x75cc bytes) 000344 1779694689.061354 trunc from 0x02a81f to 0x02e5fd (0x3ddf bytes) 000345 1779694689.144780 read 0x0225fe thru 0x02e5fd (0xc000 bytes) 000347 1779694689.171490 mapwrite 0x036d78 thru 0x037b65 (0xdee bytes) 000348 1779694689.413055 read 0x02f102 thru 0x037b65 (0x8a64 bytes) 000350 1779694689.419340 mapwrite 0x02651c thru 0x031871 (0xb356 bytes) 000351 1779694689.630673 MIRROR_EXTEND to 2 mirrors 000352 1779694690.591135 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) 000353 1779694690.875670 write 0x028b1e thru 0x03740c (0xe8ef bytes) 000357 1779694690.934761 write 0x02b235 thru 0x02ea3b (0x3807 bytes) 000358 1779694690.936849 mapread 0x00e856 thru 0x01a232 (0xb9dd bytes) 000359 1779694690.985509 mapwrite 0x02e621 thru 0x0306cf (0x20af bytes) 000360 1779694691.180616 write 0x00f0b8 thru 0x018315 (0x925e bytes) 000362 1779694691.182795 read 0x008ea5 thru 0x011883 (0x89df bytes) 000363 1779694691.188628 read 0x01977b thru 0x019ad7 (0x35d bytes) 000364 1779694691.209306 MIRROR_EXTEND to 2 mirrors 000367 1779694692.172925 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) 000368 1779694692.415491 trunc from 0x037b66 to 0x03685e (0x1307 bytes) 000374 1779694692.548433 write 0x01146a thru 0x01fc83 (0xe81a bytes) 000380 1779694692.583234 read 0x00fe27 thru 0x016e06 (0x6fe0 bytes) 000381 1779694692.613292 trunc from 0x03685f to 0x001b07 (0x34d57 bytes) 000382 1779694692.656022 mapread 0x000be2 thru 0x001b07 (0xf26 bytes) 000383 1779694692.686086 trunc from 0x001b08 to 0x0086ec (0x6be5 bytes) 000385 1779694692.711706 mapread 0x002ed9 thru 0x0069cf (0x3af7 bytes) 000387 1779694692.755452 mapread 0x007f99 thru 0x0086ec (0x754 bytes) 000388 1779694692.768947 trunc from 0x0086ed to 0x007ade (0xc0e bytes) 000393 1779694692.827445 trunc from 0x007adf to 0x02f2bc (0x277de bytes) 000394 1779694692.877503 mapwrite 0x00a08f thru 0x012ca8 (0x8c1a bytes) 000395 1779694692.993225 write 0x02053b thru 0x02593b (0x5401 bytes) 000397 1779694693.015083 read 0x01c4ab thru 0x01e363 (0x1eb9 bytes) 000399 1779694693.021531 mapwrite 0x027c5f thru 0x037bcc (0xff6e bytes) 000400 1779694693.285294 mapread 0x01890c thru 0x01c231 (0x3926 bytes) 000401 1779694693.286739 read 0x005c10 thru 0x01152c (0xb91d bytes) 000403 1779694693.296889 trunc from 0x037bcd to 0x022148 (0x15a84 bytes) 000404 1779694693.340959 write 0x00e9c7 thru 0x01412f (0x5769 bytes) 000405 1779694693.345794 write 0x022c68 thru 0x031328 (0xe6c1 bytes) 000406 1779694693.354946 mapwrite 0x011f2f thru 0x01a852 (0x8924 bytes) 000407 1779694693.507316 read 0x00c99a thru 0x00e852 (0x1eb9 bytes) 000408 1779694693.508072 write 0x0278d1 thru 0x0330d6 (0xb806 bytes) 000410 1779694693.514579 mapread 0x013f3d thru 0x02004e (0xc112 bytes) 000412 1779694693.517986 read 0x023784 thru 0x02ff0d (0xc78a bytes) 000416 1779694693.525194 write 0x01f0d6 thru 0x0242e1 (0x520c bytes) 000418 1779694693.530322 mapwrite 0x024872 thru 0x0338ce (0xf05d bytes) 000419 1779694693.759015 read 0x00ce77 thru 0x0113a0 (0x452a bytes) 000423 1779694693.770513 read 0x002294 thru 0x00c098 (0x9e05 bytes) 000426 1779694693.776482 mapread 0x004253 thru 0x00b871 (0x761f bytes) 000429 1779694693.788344 write 0x0196ee thru 0x0273c1 (0xdcd4 bytes) 000430 1779694693.793886 write 0x02e5e8 thru 0x03e429 (0xfe42 bytes) 000432 1779694693.804581 trunc from 0x03e42a to 0x016ffc (0x2742d bytes) 000434 1779694693.859354 write 0x0182f7 thru 0x0273e8 (0xf0f2 bytes) 000435 1779694693.873270 MIRROR_EXTEND to 2 mirrors 000436 1779694695.193481 read 0x00f52a thru 0x0136cd (0x41a4 bytes) 000439 1779694695.231762 MIRROR_RESYNC 2 mirrors 000441 1779694695.820671 write 0x021d28 thru 0x02424d (0x2526 bytes) 000442 1779694696.021998 trunc from 0x0273e9 to 0x003ba6 (0x23842 bytes) 000445 1779694696.103032 mapread 0x002a7d thru 0x003ba6 (0x112a bytes) 000446 1779694696.117333 mapread 0x00085c thru 0x000d43 (0x4e8 bytes) 000447 1779694696.144211 mapwrite 0x03df1a thru 0x03ffff (0x20e6 bytes) 000449 1779694696.358155 mapwrite 0x0389cd thru 0x03da4c (0x5080 bytes) 000451 1779694696.506275 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) 000454 1779694696.915703 mapread 0x0070b7 thru 0x015a47 (0xe991 bytes) 000457 1779694697.004702 trunc from 0x040000 to 0x00de4b (0x321b4 bytes) 000460 1779694697.045999 write 0x001a6a thru 0x00d23e (0xb7d5 bytes) 000462 1779694697.059313 read 0x0090e3 thru 0x00de4b (0x4d69 bytes) 000466 1779694697.076598 trunc from 0x00de4c to 0x02b6dd (0x1d892 bytes) 000467 1779694697.111249 mapwrite 0x016fdd thru 0x0252ef (0xe313 bytes) 000468 1779694697.353498 mapread 0x022685 thru 0x023f18 (0x1894 bytes) 000469 1779694697.358043 trunc from 0x02b6de to 0x03d9cc (0x122ef bytes) 000471 1779694697.421623 mapwrite 0x03590f thru 0x03ffff (0xa6f1 bytes) 000472 1779694697.618883 write 0x013e6a thru 0x017786 (0x391d bytes) 000476 1779694697.627881 mapread 0x01feaf thru 0x025da8 (0x5efa bytes) 000480 1779694697.647484 trunc from 0x040000 to 0x0165c3 (0x29a3c bytes) 000482 1779694697.693344 read 0x007a8e thru 0x010d56 (0x92c9 bytes) 000483 1779694697.729235 mapread 0x00fd93 thru 0x0165c3 (0x6831 bytes) 000484 1779694697.732239 mapwrite 0x03caaa thru 0x03ffff (0x3556 bytes) 000494 1779694697.950359 trunc from 0x040000 to 0x03728c (0x8d73 bytes) 000495 1779694697.990776 mapwrite 0x0326f9 thru 0x03dd44 (0xb64c bytes) 000496 1779694698.254549 mapwrite 0x009ebb thru 0x00fbc5 (0x5d0b bytes) 000497 1779694698.357687 read 0x03acb2 thru 0x03dd44 (0x3093 bytes) 000499 1779694698.359410 trunc from 0x03dd45 to 0x01bbf0 (0x22154 bytes) 000504 1779694698.395674 mapwrite 0x033546 thru 0x03b5a4 (0x805f bytes) 000505 1779694698.526487 mapwrite 0x00d5d5 thru 0x012e9d (0x58c9 bytes) 000507 1779694698.621387 mapread 0x0210c6 thru 0x022398 (0x12d3 bytes) 000509 1779694698.631038 MIRROR_EXTEND to 2 mirrors 000511 1779694699.211893 read 0x025af8 thru 0x02fa52 (0x9f5b bytes) 000512 1779694699.225120 trunc from 0x03b5a5 to 0x03a530 (0x1074 bytes) 000513 1779694699.355625 trunc from 0x03a531 to 0x003f51 (0x365df bytes) 000514 1779694699.379680 write 0x027e7c thru 0x0372b8 (0xf43d bytes) 000515 1779694699.384285 trunc from 0x0372b9 to 0x011f25 (0x25393 bytes) 000516 1779694699.405095 trunc from 0x011f26 to 0x0053e9 (0xcb3c bytes) 000520 1779694699.423316 mapread 0x004370 thru 0x004405 (0x96 bytes) 000521 1779694699.430006 trunc from 0x0053ea to 0x00002e (0x53bb bytes) 000522 1779694699.453830 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) 000525 1779694699.607167 write 0x01dff3 thru 0x02a036 (0xc044 bytes) 000529 1779694699.623186 trunc from 0x02a037 to 0x029a47 (0x5ef bytes) 000532 1779694699.652545 read 0x0205db thru 0x027747 (0x716d bytes) 000533 1779694699.653704 mapread 0x023746 thru 0x029a47 (0x6302 bytes) 000534 1779694699.655219 mapread 0x00776f thru 0x0167e0 (0xf072 bytes) 000537 1779694699.710310 mapread 0x0227b1 thru 0x029a47 (0x7297 bytes) 000538 1779694699.716018 read 0x02774e thru 0x029a47 (0x22fa bytes) 000539 1779694699.718335 write 0x03aea9 thru 0x03ffff (0x5157 bytes) 000540 1779694699.726409 trunc from 0x040000 to 0x0217b7 (0x1e848 bytes) 000541 1779694699.767017 mapread 0x0165ff thru 0x0217b7 (0xb1b9 bytes) 000542 1779694699.787041 mapread 0x013472 thru 0x01be90 (0x8a1f bytes) 000543 1779694699.789250 read 0x01c648 thru 0x01ce7b (0x834 bytes) 000545 1779694699.792659 write 0x02a571 thru 0x031165 (0x6bf5 bytes) 000546 1779694699.798357 read 0x005c12 thru 0x009aff (0x3eee bytes) 000549 1779694699.808659 write 0x028643 thru 0x0367ad (0xe16b bytes) 000550 1779694699.823408 mapwrite 0x029964 thru 0x02fd19 (0x63b6 bytes) 000552 1779694699.979526 trunc from 0x0367ae to 0x0364f1 (0x2bc bytes) 000553 1779694700.018757 trunc from 0x0364f2 to 0x02ccf1 (0x9800 bytes) 000554 1779694700.054971 trunc from 0x02ccf2 to 0x035da8 (0x90b7 bytes) 000557 1779694700.116698 mapwrite 0x03b60c thru 0x03ffff (0x49f4 bytes) 000558 1779694700.290127 mapread 0x0387a9 thru 0x039c98 (0x14f0 bytes) 000559 1779694700.305669 MIRROR_EXTEND to 2 mirrors 000561 1779694701.229444 write 0x0095a9 thru 0x01075b (0x71b3 bytes) 000562 1779694701.409188 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) 000563 1779694701.648118 mapwrite 0x00c87d thru 0x011cb0 (0x5434 bytes) 000564 1779694701.819022 trunc from 0x040000 to 0x02278c (0x1d873 bytes) 000566 1779694701.877297 mapread 0x015379 thru 0x015cb6 (0x93e bytes) 000569 1779694701.903913 trunc from 0x02278d to 0x030bd3 (0xe447 bytes) 000570 1779694701.964286 trunc from 0x030bd4 to 0x0182d4 (0x188ff bytes) 000571 1779694701.999982 write 0x03f24f thru 0x03ffff (0xdb1 bytes) 000574 1779694702.016391 mapread 0x01fa3d thru 0x0252f5 (0x58b9 bytes) 000575 1779694702.028216 read 0x027946 thru 0x02b256 (0x3911 bytes) 000577 1779694702.038174 read 0x03ce4c thru 0x03ffff (0x31b4 bytes) 000579 1779694702.066302 write 0x002d68 thru 0x00d015 (0xa2ae bytes) 000581 1779694702.073308 mapread 0x009966 thru 0x01712e (0xd7c9 bytes) 000582 1779694702.078846 trunc from 0x040000 to 0x004da5 (0x3b25a bytes) 000584 1779694702.102909 mapwrite 0x038077 thru 0x03ffff (0x7f89 bytes) 000585 1779694702.301144 trunc from 0x040000 to 0x03cbf2 (0x340d bytes) 000586 1779694702.332680 trunc from 0x03cbf3 to 0x028fa4 (0x13c4e bytes) 000587 1779694702.361515 read 0x01f49d thru 0x028fa4 (0x9b08 bytes) 000588 1779694702.378859 mapwrite 0x037f1c thru 0x03a0db (0x21c0 bytes) 000589 1779694702.462687 mapread 0x035aa8 thru 0x03801f (0x2578 bytes) 000592 1779694702.467982 mapread 0x0000b5 thru 0x0003fd (0x349 bytes) 000595 1779694702.476119 trunc from 0x03a0dc to 0x01ce1e (0x1d2bd bytes) 000598 1779694702.502057 trunc from 0x01ce1f to 0x01a688 (0x2796 bytes) 000599 1779694702.544260 mapread 0x00141d thru 0x0083cc (0x6fb0 bytes) 000601 1779694702.555958 trunc from 0x01a689 to 0x02d9f5 (0x1336d bytes) 000603 1779694702.595636 mapwrite 0x03b94d thru 0x03ffff (0x46b3 bytes) 000604 1779694702.746676 trunc from 0x040000 to 0x03b42e (0x4bd1 bytes) 000606 1779694702.789835 trunc from 0x03b42f to 0x005660 (0x35dce bytes) 000607 1779694702.818473 mapread 0x0049c5 thru 0x005660 (0xc9c bytes) 000608 1779694702.823094 mapwrite 0x017748 thru 0x01c1d9 (0x4a92 bytes) 000609 1779694703.016467 trunc from 0x01c1da to 0x035160 (0x18f87 bytes) 000610 1779694703.048276 write 0x037be1 thru 0x03ffff (0x841f bytes) 000614 1779694703.056187 mapwrite 0x0247b1 thru 0x02b1c3 (0x6a13 bytes) 000616 1779694703.288216 read 0x036e95 thru 0x03ffff (0x916b bytes) 000617 1779694703.321953 read 0x03a87f thru 0x03b732 (0xeb4 bytes) 000621 1779694703.333844 trunc from 0x040000 to 0x02711f (0x18ee0 bytes) 000622 1779694703.385233 read 0x009e3f thru 0x00ddd7 (0x3f99 bytes) 000625 1779694703.392692 mapwrite 0x011865 thru 0x01bbe6 (0xa382 bytes) 000626 1779694703.546201 mapwrite 0x0267db thru 0x031ab1 (0xb2d7 bytes) 000627 1779694703.700042 write 0x00c753 thru 0x00cc60 (0x50e bytes) 000629 1779694703.702210 read 0x022812 thru 0x0275e7 (0x4dd6 bytes) 000630 1779694703.709574 mapread 0x00746e thru 0x016e43 (0xf9d6 bytes) 000631 1779694703.719064 mapread 0x020b80 thru 0x026957 (0x5dd8 bytes) 000632 1779694703.742793 MIRROR_EXTEND to 2 mirrors 000633 1779694705.079019 MIRROR_EXTEND to 3 mirrors 000635 1779694706.448617 mapread 0x007fe8 thru 0x008ac4 (0xadd bytes) 000637 1779694706.536910 read 0x0122ad thru 0x01c879 (0xa5cd bytes) 000638 1779694706.580541 write 0x024ffe thru 0x031998 (0xc99b bytes) 000639 1779694706.766227 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x31ab2): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31ab2): Mirror 2: 0x2d313b9c (stale) Mirror 3: 0x2d313b9c (stale) CRC-32 checksum value for chunk [0, 0x31ab2): Mirror 1: 0xe5fd51c5 Mirror 4: 0xe5fd51c5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31ab2: skipped 000640 1779694707.872027 MIRROR_RESYNC 4 mirrors 000641 1779694709.501394 mapwrite 0x02bd57 thru 0x039667 (0xd911 bytes) 000642 1779694709.705758 MIRROR_RESYNC 4 mirrors 000643 1779694710.724858 MIRROR_RESYNC 4 mirrors 000644 1779694711.415961 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) 000645 1779694711.871890 MIRROR_RESYNC 3 mirrors 000646 1779694712.418846 read 0x024493 thru 0x033375 (0xeee3 bytes) 000649 1779694712.437004 MIRROR_RESYNC 3 mirrors 000650 1779694712.959464 mapread 0x000a22 thru 0x002a8e (0x206d bytes) 000653 1779694712.990261 mapread 0x025cfa thru 0x02797d (0x1c84 bytes) 000654 1779694712.997293 MIRROR_RESYNC 3 mirrors 000656 1779694713.714705 mapwrite 0x03c247 thru 0x03ffff (0x3db9 bytes) 000657 1779694713.919157 trunc from 0x040000 to 0x0071d6 (0x38e29 bytes) 000658 1779694713.975341 read 0x001244 thru 0x002511 (0x12ce bytes) 000659 1779694713.987819 write 0x0226e8 thru 0x02b08a (0x89a3 bytes) 000660 1779694713.989624 mapwrite 0x009257 thru 0x00d24a (0x3ff4 bytes) 000661 1779694714.071487 MIRROR_RESYNC 3 mirrors 000662 1779694715.245850 trunc from 0x02b08b to 0x025e5b (0x522f bytes) 000663 1779694715.362035 mapread 0x007e49 thru 0x00c0ba (0x4272 bytes) 000665 1779694715.389018 mapread 0x0017c7 thru 0x00a8dd (0x9117 bytes) 000666 1779694715.407543 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x25e5c): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25e5c): Mirror 3: 0xcd16cc7e (stale) Mirror 4: 0xcd16cc7e (stale) CRC-32 checksum value for chunk [0, 0x25e5c): Mirror 1: 0xcd16cc7e Mirror 5: 0xcd16cc7e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25e5c: skipped 000667 1779694716.585429 mapread 0x016f39 thru 0x01ae7d (0x3f45 bytes) 000668 1779694716.650734 mapwrite 0x009818 thru 0x00a668 (0xe51 bytes) 000669 1779694716.925912 read 0x00959a thru 0x010ad2 (0x7539 bytes) 000670 1779694716.927920 mapread 0x021bf7 thru 0x022e95 (0x129f bytes) 000674 1779694716.942355 mapread 0x018639 thru 0x01e75e (0x6126 bytes) 000676 1779694716.970466 write 0x0085ac thru 0x00b684 (0x30d9 bytes) 000677 1779694716.977132 trunc from 0x025e5c to 0x019e80 (0xbfdb bytes) 000679 1779694717.102356 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x19e81): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19e81): Mirror 3: 0xbc025891 (stale) Mirror 4: 0xbc025891 (stale) Mirror 5: 0xbc025891 (stale) CRC-32 checksum value for chunk [0, 0x19e81): Mirror 1: 0xceca37f8 Mirror 6: 0xceca37f8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19e81: skipped 000681 1779694718.723804 MIRROR_RESYNC 5 mirrors 000682 1779694720.252807 write 0x036dc9 thru 0x03ffff (0x9237 bytes) 000685 1779694720.436914 mapread 0x029f1c thru 0x032e45 (0x8f2a bytes) 000686 1779694720.481891 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xee4fb80f (stale) Mirror 4: 0xee4fb80f (stale) Mirror 5: 0xee4fb80f (stale) Mirror 6: 0xee4fb80f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbdf254af Mirror 7: 0xbdf254af lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000687 1779694722.445472 mapread 0x02392a thru 0x02a667 (0x6d3e bytes) 000689 1779694722.565099 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xee4fb80f (stale) Mirror 4: 0xee4fb80f (stale) Mirror 5: 0xee4fb80f (stale) Mirror 6: 0xee4fb80f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbdf254af Mirror 7: 0xbdf254af Mirror 8: 0xbdf254af lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000690 1779694724.247644 trunc from 0x040000 to 0x011350 (0x2ecaf bytes) 000692 1779694724.345426 trunc from 0x011351 to 0x038e9d (0x27b4d bytes) 000694 1779694724.375365 trunc from 0x038e9e to 0x037c50 (0x124d bytes) 000696 1779694724.408445 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37c51): Mirror 3: 0x47c635d4 (stale) Mirror 4: 0x47c635d4 (stale) Mirror 6: 0x47c635d4 (stale) Mirror 7: 0x50996416 (stale) Mirror 8: 0x50996416 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37c51): Mirror 3: 0x47c635d4 (stale) Mirror 4: 0x47c635d4 (stale) Mirror 6: 0x47c635d4 (stale) Mirror 7: 0x50996416 (stale) Mirror 8: 0x50996416 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37c51: skipped 000697 1779694725.006838 mapread 0x023a7c thru 0x02e8d6 (0xae5b bytes) 000698 1779694725.053066 read 0x003954 thru 0x009a0e (0x60bb bytes) 000700 1779694725.082547 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37c51): Mirror 3: 0x47c635d4 (stale) Mirror 4: 0x47c635d4 (stale) Mirror 6: 0x47c635d4 (stale) Mirror 7: 0x50996416 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37c51): Mirror 3: 0x47c635d4 (stale) Mirror 4: 0x47c635d4 (stale) Mirror 6: 0x47c635d4 (stale) Mirror 7: 0x50996416 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37c51: skipped 000704 1779694725.678505 read 0x00cb06 thru 0x019147 (0xc642 bytes) 000709 1779694725.708278 mapwrite 0x0132d5 thru 0x02040e (0xd13a bytes) 000710 1779694725.863103 read 0x035540 thru 0x037c50 (0x2711 bytes) 000711 1779694725.890043 write 0x03a03f thru 0x03a05a (0x1c bytes) 000712 1779694725.892053 write 0x03b22c thru 0x03ba5b (0x830 bytes) 000715 1779694725.911267 mapread 0x006e3e thru 0x010fd5 (0xa198 bytes) 000716 1779694725.916923 read 0x01fe71 thru 0x02ea20 (0xebb0 bytes) 000717 1779694725.923400 MIRROR_RESYNC 5 mirrors 000718 1779694727.716457 MIRROR_EXTEND to 6 mirrors 000719 1779694728.638414 read 0x028a61 thru 0x0310bc (0x865c bytes) 000720 1779694728.655261 mapwrite 0x00f5d7 thru 0x016182 (0x6bac bytes) 000722 1779694728.862616 read 0x02e448 thru 0x0313e0 (0x2f99 bytes) 000725 1779694728.881331 mapread 0x021b41 thru 0x02d6a7 (0xbb67 bytes) 000726 1779694728.886371 read 0x007583 thru 0x010951 (0x93cf bytes) 000728 1779694728.888082 mapwrite 0x027d53 thru 0x02aee1 (0x318f bytes) 000729 1779694728.960895 write 0x02d5c0 thru 0x03be0d (0xe84e bytes) 000732 1779694728.967179 write 0x01c1f4 thru 0x01ebe6 (0x29f3 bytes) 000733 1779694728.974847 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3be0e): Mirror 3: 0x756fc99e (stale) Mirror 4: 0x756fc99e (stale) Mirror 6: 0x756fc99e (stale) Mirror 8: 0x756fc99e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3be0e): Mirror 3: 0x756fc99e (stale) Mirror 4: 0x756fc99e (stale) Mirror 6: 0x756fc99e (stale) Mirror 8: 0x756fc99e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3be0e: skipped 000734 1779694729.445877 mapread 0x030cff thru 0x0379e9 (0x6ceb bytes) 000736 1779694729.473659 mapwrite 0x02a7eb thru 0x0305e1 (0x5df7 bytes) 000737 1779694729.543691 mapwrite 0x0103c8 thru 0x02038e (0xffc7 bytes) 000738 1779694729.625570 write 0x00561a thru 0x00c0f3 (0x6ada bytes) 000741 1779694729.638194 read 0x0142d5 thru 0x016e79 (0x2ba5 bytes) 000743 1779694729.640389 mapwrite 0x037f2d thru 0x03ffff (0x80d3 bytes) 000746 1779694729.738690 mapwrite 0x03d59e thru 0x03ffff (0x2a62 bytes) 000747 1779694729.790658 mapwrite 0x03c8ec thru 0x03ffff (0x3714 bytes) 000748 1779694729.840105 write 0x02e5ea thru 0x033955 (0x536c bytes) 000751 1779694729.844225 write 0x00289d thru 0x00606a (0x37ce bytes) 000752 1779694729.846293 mapwrite 0x03ac1e thru 0x03eca7 (0x408a bytes) 000753 1779694729.919217 mapwrite 0x00a6b8 thru 0x017605 (0xcf4e bytes) 000754 1779694729.987939 read 0x01afb4 thru 0x01e736 (0x3783 bytes) 000755 1779694729.988639 read 0x018e26 thru 0x026391 (0xd56c bytes) 000758 1779694730.000988 trunc from 0x040000 to 0x001707 (0x3e8f8 bytes) 000759 1779694730.038824 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1708): Mirror 4: 0x26a238f4 (stale) Mirror 6: 0x26a238f4 (stale) Mirror 8: 0x26a238f4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1708): Mirror 4: 0x26a238f4 (stale) Mirror 6: 0x26a238f4 (stale) Mirror 8: 0x26a238f4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1708: skipped 000760 1779694730.392470 write 0x0295cd thru 0x031650 (0x8084 bytes) 000761 1779694730.399960 read 0x021c2f thru 0x02842c (0x67fe bytes) 000762 1779694730.408974 write 0x00724e thru 0x01421e (0xcfd1 bytes) 000763 1779694730.419930 trunc from 0x031651 to 0x016f49 (0x1a707 bytes) 000764 1779694730.439913 mapread 0x012ba6 thru 0x014332 (0x178d bytes) 000767 1779694730.443783 mapread 0x002d5a thru 0x012827 (0xface bytes) 000768 1779694730.454650 mapread 0x00e2a3 thru 0x00fcbe (0x1a1c bytes) 000769 1779694730.457203 write 0x019201 thru 0x022ec6 (0x9cc6 bytes) 000770 1779694730.459442 mapwrite 0x02abc3 thru 0x02d37f (0x27bd bytes) 000771 1779694730.572140 read 0x00808f thru 0x00f691 (0x7603 bytes) 000772 1779694730.573123 mapread 0x02132f thru 0x02421a (0x2eec bytes) 000773 1779694730.574194 mapwrite 0x031a93 thru 0x0343db (0x2949 bytes) 000774 1779694730.653653 mapwrite 0x017d78 thru 0x02430e (0xc597 bytes) 000775 1779694730.719340 trunc from 0x0343dc to 0x028dfc (0xb5df bytes) 000776 1779694730.739651 write 0x027aea thru 0x0346b8 (0xcbcf bytes) 000777 1779694730.743221 write 0x022ab1 thru 0x025ed4 (0x3424 bytes) 000779 1779694730.746839 trunc from 0x0346b9 to 0x017b00 (0x1cbb8 bytes) 000781 1779694730.770962 write 0x019fa9 thru 0x01f005 (0x505d bytes) 000783 1779694730.774760 read 0x00c4ce thru 0x017f45 (0xba78 bytes) 000784 1779694730.775599 mapwrite 0x038d7b thru 0x03d854 (0x4ada bytes) 000785 1779694730.852889 trunc from 0x03d855 to 0x010a8c (0x2cdc8 bytes) 000787 1779694730.875703 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x10a8d): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10a8d): Mirror 4: 0x99b5ff93 (stale) Mirror 6: 0x99b5ff93 (stale) Mirror 8: 0x99b5ff93 (stale) CRC-32 checksum value for chunk [0, 0x10a8d): Mirror 1: 0xa617a719 Mirror 9: 0xa617a719 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10a8d: skipped 000788 1779694731.686157 mapread 0x00f418 thru 0x010a8c (0x1675 bytes) 000791 1779694731.739986 trunc from 0x010a8d to 0x02ec1b (0x1e18f bytes) 000792 1779694731.812569 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2ec1c): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ec1c): Mirror 4: 0xd760699e (stale) Mirror 6: 0xd760699e (stale) Mirror 8: 0xd760699e (stale) Mirror 9: 0xc5fecd4b (stale) CRC-32 checksum value for chunk [0, 0x2ec1c): Mirror 1: 0xc5fecd4b Mirror 10: 0xc5fecd4b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ec1c: skipped 000795 1779694733.202429 trunc from 0x02ec1c to 0x01e322 (0x108f9 bytes) 000796 1779694733.450385 read 0x017c72 thru 0x01aa4b (0x2dda bytes) 000797 1779694733.461205 read 0x0069dc thru 0x00f0a1 (0x86c6 bytes) 000799 1779694733.489240 trunc from 0x01e323 to 0x03f90b (0x215e9 bytes) 000800 1779694733.507644 mapread 0x015c57 thru 0x015cb5 (0x5f bytes) 000801 1779694733.508969 mapwrite 0x01ecc1 thru 0x02392b (0x4c6b bytes) 000802 1779694733.643636 read 0x02ffa6 thru 0x032036 (0x2091 bytes) 000803 1779694733.645998 write 0x01082e thru 0x0133f5 (0x2bc8 bytes) 000804 1779694733.651775 read 0x03ae31 thru 0x03f724 (0x48f4 bytes) 000805 1779694733.659305 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3f90c): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f90c): Mirror 4: 0xb611e425 (stale) Mirror 6: 0xb611e425 (stale) Mirror 8: 0xb611e425 (stale) Mirror 9: 0xfde7a199 (stale) Mirror 10: 0xfde7a199 (stale) CRC-32 checksum value for chunk [0, 0x3f90c): Mirror 1: 0x1594406d Mirror 11: 0x1594406d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f90c: skipped 000808 1779694735.788407 write 0x03013b thru 0x037241 (0x7107 bytes) 000810 1779694736.007299 MIRROR_RESYNC 7 mirrors 000815 1779694738.765796 MIRROR_RESYNC 7 mirrors 000816 1779694739.644830 MIRROR_EXTEND to 8 mirrors 000817 1779694740.876103 mapwrite 0x02e4b0 thru 0x030d3e (0x288f bytes) 000818 1779694741.182100 write 0x0336db thru 0x033fc4 (0x8ea bytes) 000820 1779694741.192994 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f90c): Mirror 4: 0xab574290 (stale) Mirror 6: 0xab574290 (stale) Mirror 8: 0xab574290 (stale) Mirror 9: 0xab574290 (stale) Mirror 10: 0xab574290 (stale) Mirror 11: 0xab574290 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f90c): Mirror 4: 0xab574290 (stale) Mirror 6: 0xab574290 (stale) Mirror 8: 0xab574290 (stale) Mirror 9: 0xab574290 (stale) Mirror 10: 0xab574290 (stale) Mirror 11: 0xab574290 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f90c: skipped 000821 1779694741.844917 write 0x012ff3 thru 0x0186d2 (0x56e0 bytes) 000822 1779694741.857552 mapread 0x002c00 thru 0x0051b1 (0x25b2 bytes) 000823 1779694741.875128 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f90c): Mirror 4: 0xab574290 (stale) Mirror 6: 0xab574290 (stale) Mirror 9: 0xab574290 (stale) Mirror 10: 0xab574290 (stale) Mirror 11: 0xab574290 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f90c): Mirror 4: 0xab574290 (stale) Mirror 6: 0xab574290 (stale) Mirror 9: 0xab574290 (stale) Mirror 10: 0xab574290 (stale) Mirror 11: 0xab574290 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f90c: skipped 000824 1779694742.654351 mapwrite 0x011147 thru 0x01180c (0x6c6 bytes) 000825 1779694742.702589 mapwrite 0x01aa9a thru 0x01ee01 (0x4368 bytes) 000827 1779694742.771524 mapwrite 0x021233 thru 0x02a895 (0x9663 bytes) 000829 1779694742.855335 mapwrite 0x01a5a0 thru 0x01f774 (0x51d5 bytes) 000830 1779694742.913549 mapwrite 0x00e145 thru 0x0173c9 (0x9285 bytes) 000831 1779694742.997983 MIRROR_RESYNC 6 mirrors 000832 1779694744.133800 mapread 0x01d076 thru 0x025a8d (0x8a18 bytes) 000834 1779694744.191573 trunc from 0x03f90c to 0x001cb0 (0x3dc5b bytes) 000835 1779694744.437677 mapwrite 0x014702 thru 0x0193b7 (0x4cb6 bytes) 000836 1779694744.642776 write 0x01c30f thru 0x028de3 (0xcad5 bytes) 000838 1779694744.645228 write 0x022c99 thru 0x023cb4 (0x101c bytes) 000840 1779694744.648859 read 0x00f2b8 thru 0x01ea49 (0xf792 bytes) 000841 1779694744.667225 MIRROR_RESYNC 6 mirrors 000843 1779694746.264497 mapread 0x001e83 thru 0x0119de (0xfb5c bytes) 000844 1779694746.311167 write 0x036ed0 thru 0x03cb66 (0x5c97 bytes) 000845 1779694746.392621 mapwrite 0x008a0f thru 0x00af84 (0x2576 bytes) 000846 1779694746.496206 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3cb67): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cb67): Mirror 4: 0xf5dc4e03 (stale) Mirror 6: 0xf5dc4e03 (stale) Mirror 9: 0xf5dc4e03 (stale) Mirror 10: 0xf5dc4e03 (stale) Mirror 11: 0xf5dc4e03 (stale) CRC-32 checksum value for chunk [0, 0x3cb67): Mirror 1: 0xf7b55538 Mirror 12: 0xf7b55538 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cb67: skipped 000847 1779694747.592635 mapwrite 0x019d00 thru 0x01e5ea (0x48eb bytes) 000848 1779694747.842092 read 0x0210b8 thru 0x030fce (0xff17 bytes) 000852 1779694747.869414 mapwrite 0x029f31 thru 0x032512 (0x85e2 bytes) 000853 1779694747.981025 read 0x0295c6 thru 0x035cb2 (0xc6ed bytes) 000854 1779694747.989805 MIRROR_RESYNC 7 mirrors 000855 1779694749.819071 mapwrite 0x0268df thru 0x035746 (0xee68 bytes) 000858 1779694750.093425 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3cb67): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cb67): Mirror 4: 0xfd59b370 (stale) Mirror 6: 0xfd59b370 (stale) Mirror 9: 0xfd59b370 (stale) Mirror 10: 0xfd59b370 (stale) Mirror 11: 0xfd59b370 (stale) Mirror 12: 0xfd59b370 (stale) CRC-32 checksum value for chunk [0, 0x3cb67): Mirror 1: 0x4530a003 Mirror 13: 0x4530a003 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cb67: skipped 000859 1779694751.566253 trunc from 0x03cb67 to 0x02b70a (0x1145c bytes) 000860 1779694751.683131 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b70b): Mirror 4: 0x5bf230f5 (stale) Mirror 9: 0x5bf230f5 (stale) Mirror 10: 0x5bf230f5 (stale) Mirror 11: 0x5bf230f5 (stale) Mirror 12: 0x5bf230f5 (stale) Mirror 13: 0x3d151be1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b70b): Mirror 4: 0x5bf230f5 (stale) Mirror 9: 0x5bf230f5 (stale) Mirror 10: 0x5bf230f5 (stale) Mirror 11: 0x5bf230f5 (stale) Mirror 12: 0x5bf230f5 (stale) Mirror 13: 0x3d151be1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b70b: skipped 000861 1779694752.140059 write 0x005c9d thru 0x012f13 (0xd277 bytes) 000862 1779694752.156496 mapwrite 0x007266 thru 0x00f66e (0x8409 bytes) 000863 1779694752.245206 mapwrite 0x038698 thru 0x03acda (0x2643 bytes) 000865 1779694752.327813 trunc from 0x03acdb to 0x023509 (0x177d1 bytes) 000866 1779694752.371562 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2350a): Mirror 4: 0xc8ebbbbe (stale) Mirror 10: 0xc8ebbbbe (stale) Mirror 11: 0xc8ebbbbe (stale) Mirror 12: 0xc8ebbbbe (stale) Mirror 13: 0xc8ebbbbe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2350a): Mirror 4: 0xc8ebbbbe (stale) Mirror 10: 0xc8ebbbbe (stale) Mirror 11: 0xc8ebbbbe (stale) Mirror 12: 0xc8ebbbbe (stale) Mirror 13: 0xc8ebbbbe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2350a: skipped 000869 1779694752.919010 mapwrite 0x034b88 thru 0x03d58b (0x8a04 bytes) 000870 1779694753.006280 mapread 0x039cb3 thru 0x03d58b (0x38d9 bytes) 000872 1779694753.012082 mapwrite 0x0222a4 thru 0x0276c5 (0x5422 bytes) 000874 1779694753.076617 write 0x03967a thru 0x03f5fb (0x5f82 bytes) 000875 1779694753.079245 read 0x023352 thru 0x028bf8 (0x58a7 bytes) 000876 1779694753.080419 write 0x012965 thru 0x01e907 (0xbfa3 bytes) 000877 1779694753.092131 trunc from 0x03f5fc to 0x0059d6 (0x39c25 bytes) 000878 1779694753.114169 trunc from 0x0059d7 to 0x026411 (0x20a3b bytes) 000879 1779694753.133917 mapread 0x01388e thru 0x01d313 (0x9a86 bytes) 000881 1779694753.160693 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26412): Mirror 4: 0xd831f008 (stale) Mirror 10: 0xd831f008 (stale) Mirror 12: 0xd831f008 (stale) Mirror 13: 0xd831f008 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26412): Mirror 4: 0xd831f008 (stale) Mirror 10: 0xd831f008 (stale) Mirror 12: 0xd831f008 (stale) Mirror 13: 0xd831f008 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26412: skipped 000882 1779694753.680194 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26412): Mirror 4: 0xd831f008 (stale) Mirror 10: 0xd831f008 (stale) Mirror 13: 0xd831f008 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26412): Mirror 4: 0xd831f008 (stale) Mirror 10: 0xd831f008 (stale) Mirror 13: 0xd831f008 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26412: skipped 000884 1779694754.069830 mapread 0x01f0a5 thru 0x026411 (0x736d bytes) 000886 1779694754.108889 write 0x030606 thru 0x03faf5 (0xf4f0 bytes) 000887 1779694754.118478 read 0x024b71 thru 0x027d8d (0x321d bytes) 000891 1779694754.133168 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3faf6): Mirror 10: 0x63240bfe (stale) Mirror 13: 0xb3bdfe9a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3faf6): Mirror 10: 0x63240bfe (stale) Mirror 13: 0xb3bdfe9a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3faf6: skipped 000892 1779694754.548315 write 0x0217e0 thru 0x028959 (0x717a bytes) 000893 1779694754.560948 mapwrite 0x01847f thru 0x02239c (0x9f1e bytes) 000895 1779694754.646746 read 0x03bf7a thru 0x03faf5 (0x3b7c bytes) 000896 1779694754.657649 read 0x01b335 thru 0x0261f8 (0xaec4 bytes) 000898 1779694754.661152 read 0x031dc5 thru 0x039b28 (0x7d64 bytes) 000900 1779694754.675707 read 0x03a047 thru 0x03e77f (0x4739 bytes) 000901 1779694754.679181 mapwrite 0x0053ee thru 0x00ebc1 (0x97d4 bytes) 000902 1779694754.752007 mapwrite 0x0100d6 thru 0x01189d (0x17c8 bytes) 000903 1779694754.811936 mapwrite 0x009ed2 thru 0x00d61a (0x3749 bytes) 000908 1779694754.948242 mapread 0x0250d2 thru 0x02b82f (0x675e bytes) 000909 1779694754.960384 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3faf6): Mirror 10: 0x63240bfe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3faf6): Mirror 10: 0x63240bfe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3faf6: skipped 000910 1779694755.520689 trunc from 0x03faf6 to 0x030a61 (0xf094 bytes) 000911 1779694755.550592 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) 000912 1779694755.708054 trunc from 0x030a62 to 0x01ec0a (0x11e57 bytes) 000913 1779694755.729942 mapread 0x01730a thru 0x01ec0a (0x7901 bytes) 000914 1779694755.753968 write 0x027af8 thru 0x02d5ff (0x5b08 bytes) 000916 1779694755.756439 mapread 0x02c206 thru 0x02d5ff (0x13fa bytes) 000918 1779694755.761441 write 0x0033e6 thru 0x007319 (0x3f34 bytes) 000919 1779694755.774645 read 0x00a33d thru 0x00ada9 (0xa6d bytes) 000922 1779694755.778557 read 0x026b6f thru 0x02d5ff (0x6a91 bytes) 000923 1779694755.789942 trunc from 0x02d600 to 0x00c7fa (0x20e05 bytes) 000924 1779694755.824833 MIRROR_EXTEND to 2 mirrors 000927 1779694756.762695 MIRROR_EXTEND to 3 mirrors 000928 1779694757.425465 MIRROR_EXTEND to 4 mirrors 000929 1779694758.111808 trunc from 0x00c7fb to 0x0199e5 (0xd1eb bytes) 000930 1779694758.236322 mapread 0x004b41 thru 0x013c2d (0xf0ed bytes) 000931 1779694758.294475 mapwrite 0x0209e9 thru 0x022a97 (0x20af bytes) 000932 1779694758.462644 read 0x01d77e thru 0x0213ef (0x3c72 bytes) 000933 1779694758.472979 MIRROR_RESYNC 4 mirrors 000935 1779694759.635085 read 0x018724 thru 0x01f2e1 (0x6bbe bytes) 000936 1779694759.654402 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) 000937 1779694760.018482 write 0x036ee5 thru 0x03ce4f (0x5f6b bytes) 000938 1779694760.154369 mapwrite 0x03adae thru 0x03f4d9 (0x472c bytes) 000940 1779694760.301070 mapread 0x035f2f thru 0x037c06 (0x1cd8 bytes) 000942 1779694760.316052 mapwrite 0x03fada thru 0x03ffff (0x526 bytes) 000945 1779694760.444367 read 0x01fce1 thru 0x0214fe (0x181e bytes) 000947 1779694760.453872 mapwrite 0x0364d8 thru 0x03ffff (0x9b28 bytes) 000948 1779694760.509347 trunc from 0x040000 to 0x02f2c4 (0x10d3b bytes) 000949 1779694760.527703 mapwrite 0x01a4cd thru 0x026b4a (0xc67e bytes) 000951 1779694760.621435 MIRROR_RESYNC 3 mirrors 000952 1779694761.499363 MIRROR_RESYNC 3 mirrors 000953 1779694761.888918 read 0x01a921 thru 0x022966 (0x8046 bytes) 000954 1779694761.897970 write 0x02c9f9 thru 0x030296 (0x389e bytes) 000955 1779694761.984652 trunc from 0x030297 to 0x01c5b8 (0x13cde bytes) 000957 1779694762.024503 read 0x010b9e thru 0x0112cf (0x732 bytes) 000958 1779694762.042425 trunc from 0x01c5b9 to 0x03377f (0x171c7 bytes) 000960 1779694762.065518 mapwrite 0x00369e thru 0x00fe3e (0xc7a1 bytes) 000961 1779694762.151952 trunc from 0x033780 to 0x009019 (0x2a766 bytes) 000963 1779694762.189039 mapwrite 0x0261d7 thru 0x02c56f (0x6399 bytes) 000964 1779694762.355119 trunc from 0x02c570 to 0x00392c (0x28c43 bytes) 000966 1779694762.392972 MIRROR_RESYNC 3 mirrors 000968 1779694763.119869 read 0x002297 thru 0x00392c (0x1696 bytes) 000979 1779694763.135538 mapwrite 0x009165 thru 0x00ceb7 (0x3d53 bytes) 000980 1779694763.412798 mapwrite 0x0080a3 thru 0x00df1a (0x5e78 bytes) 000982 1779694763.523831 trunc from 0x00df1b to 0x029335 (0x1b41b bytes) 000984 1779694763.579525 mapwrite 0x0243c8 thru 0x02f63d (0xb276 bytes) 000986 1779694763.742321 trunc from 0x02f63e to 0x01d35e (0x122df bytes) 000988 1779694763.770189 mapread 0x01afc6 thru 0x01d35e (0x2399 bytes) 000991 1779694763.791622 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x156:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1d35f): Mirror 3: 0x4bdccdfe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d35f): Mirror 3: 0x4bdccdfe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d35f: skipped 000992 1779694764.219220 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1d35f): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d35f): Mirror 3: 0x4bdccdfe (stale) CRC-32 checksum value for chunk [0, 0x1d35f): Mirror 1: 0x327f743b Mirror 4: 0x327f743b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d35f: skipped 000993 1779694765.621043 read 0x00a8a4 thru 0x0198e5 (0xf042 bytes) 000994 1779694765.657646 mapread 0x006816 thru 0x00b067 (0x4852 bytes) 000995 1779694765.727509 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1d35f): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d35f): Mirror 3: 0x4bdccdfe (stale) CRC-32 checksum value for chunk [0, 0x1d35f): Mirror 1: 0x327f743b Mirror 4: 0x327f743b Mirror 5: 0x327f743b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d35f: skipped 000996 1779694767.090790 trunc from 0x01d35f to 0x013c7c (0x96e2 bytes) 000997 1779694767.305643 trunc from 0x013c7d to 0x00ecb5 (0x4fc7 bytes) 000998 1779694767.358486 mapread 0x0021f3 thru 0x00e9f6 (0xc804 bytes) 001000 1779694767.401244 read 0x00b5b0 thru 0x00ecb5 (0x3706 bytes) All operations completed A-OK!