== sanity-flr test 70a: flr mode fsx test ================ 04:34:56 (1769074496) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 4498 truncating to largest ever: 0x8bd8 000001 1769074498.826596 trunc from 00000000 to 0x008bd7 (0x8bd8 bytes) 000002 1769074498.869898 read 0x0055d5 thru 0x0062dc (0xd08 bytes) 000004 1769074498.895659 mapread 0x003be2 thru 0x008bd7 (0x4ff6 bytes) 000005 1769074498.937276 mapwrite 0x039352 thru 0x03ffff (0x6cae bytes) 000006 1769074499.064289 mapwrite 0x027eeb thru 0x031dc5 (0x9edb bytes) fallocating to largest ever: 0x2baa1 000007 1769074499.101474 fallocate 0x01c880 thru 0x02baa0 (0xf221 bytes) 000009 1769074499.115997 mapwrite 0x00fc73 thru 0x01b429 (0xb7b7 bytes) 000010 1769074499.189967 mapread 0x00f1dc thru 0x01d25a (0xe07f bytes) 000011 1769074499.191516 trunc from 0x040000 to 0x005a8d (0x3a572 bytes) 000012 1769074499.226404 trunc from 0x005a8e to 0x01f448 (0x199bb bytes) 000013 1769074499.262712 trunc from 0x01b610 to 0x01f448 (0x3e39 bytes) 000014 1769074499.270910 read 0x00f43e thru 0x01ae00 (0xb9c3 bytes) 000015 1769074499.299623 mapwrite 0x0246c2 thru 0x030040 (0xb97f bytes) 000016 1769074499.390501 punch from 0x015228 to 0x0173d7 (0x21b0 bytes) 000017 1769074499.398898 read 0x013ae4 thru 0x022bdb (0xf0f8 bytes) 000018 1769074499.417444 trunc from 0x01d908 to 0x01f2c1 (0x19ba bytes) 000019 1769074499.422382 punch from 0x028f34 to 0x02a0ee (0x11bb bytes) 000020 1769074499.433167 trunc from 0x0121b9 to 0x021f6c (0xfdb4 bytes) 000021 1769074499.454676 mapread 0x009491 thru 0x00b5bd (0x212d bytes) 000022 1769074499.455608 punch from 0x004fcb to 0x00d1f2 (0x8228 bytes) 000023 1769074499.460821 read 0x01d335 thru 0x024e07 (0x7ad3 bytes) 000024 1769074499.484333 punch from 0x01f32c to 0x02e48c (0xf161 bytes) 000025 1769074499.491340 read 0x023758 thru 0x030040 (0xc8e9 bytes) 000026 1769074499.501756 punch from 0x020a0f to 0x023472 (0x2a64 bytes) 000027 1769074499.506300 trunc from 0x030041 to 0x021680 (0xe9c0 bytes) 000028 1769074499.524345 mapwrite 0x03adc8 thru 0x03ffff (0x5238 bytes) 000029 1769074499.568331 trunc from 0x040000 to 0x023c67 (0x1c398 bytes) 000030 1769074499.581800 punch from 0x00c40d to 0x01951c (0xd110 bytes) 000031 1769074499.587361 trunc from 0x023c68 to 0x01aca1 (0x8fc6 bytes) 000032 1769074499.602477 trunc from 0x01aca2 to 0x00c379 (0xe928 bytes) 000033 1769074499.621186 trunc from 0x00c37a to 0x0256b9 (0x19340 bytes) 000035 1769074499.643385 write 0x037de6 thru 0x03ffff (0x821a bytes) 000038 1769074499.648203 punch from 0x00cc10 to 0x00f519 (0x290a bytes) 000039 1769074499.653282 mapread 0x021974 thru 0x02d216 (0xb8a3 bytes) 000040 1769074499.706013 punch from 0x0194b4 to 0x0260e3 (0xcc30 bytes) 000041 1769074499.710757 trunc from 0x040000 to 0x00e731 (0x318ce bytes) 000042 1769074499.728710 fallocate 0x00ec7a thru 0x01afe1 (0xc368 bytes) 000043 1769074499.732633 trunc from 0x005f07 to 0x014b81 (0xec7b bytes) 000044 1769074499.740216 mapread 0x003e0e thru 0x00bf0d (0x8100 bytes) 000045 1769074499.777434 write 0x0189c1 thru 0x0213f4 (0x8a34 bytes) 000046 1769074499.782596 trunc from 0x0213f5 to 0x00c6b1 (0x14d43 bytes) 000048 1769074499.801447 read 0x00983c thru 0x0099bb (0x180 bytes) truncating to largest ever: 0x2f394 000049 1769074499.803361 trunc from 0x00c6b2 to 0x02f393 (0x22ce2 bytes) 000050 1769074499.825657 punch from 0x0147ba to 0x02143c (0xcc83 bytes) 000051 1769074499.830339 mapread 0x02dfa4 thru 0x02f393 (0x13f0 bytes) 000052 1769074499.846210 read 0x0058c5 thru 0x014d2f (0xf46b bytes) 000053 1769074499.847806 mapwrite 0x039a0f thru 0x03ffff (0x65f1 bytes) 000054 1769074499.908216 write 0x02a229 thru 0x031fb6 (0x7d8e bytes) 000056 1769074499.910989 write 0x01d083 thru 0x020c7e (0x3bfc bytes) 000057 1769074499.912610 trunc from 0x036689 to 0x0390d9 (0x2a51 bytes) 000058 1769074499.917699 write 0x03db8c thru 0x03ffff (0x2474 bytes) 000059 1769074499.918772 trunc from 0x019825 to 0x01bbd7 (0x23b3 bytes) 000061 1769074499.924768 punch from 0x00a495 to 0x00ffa8 (0x5b14 bytes) 000062 1769074499.929802 mapwrite 0x01ada8 thru 0x023996 (0x8bef bytes) 000063 1769074499.963302 punch from 0x031093 to 0x0362ed (0x525b bytes) 000064 1769074499.968451 mapread 0x01959f thru 0x027929 (0xe38b bytes) 000065 1769074499.974914 fallocate 0x0047d5 thru 0x00cd65 (0x8591 bytes) 000067 1769074499.980583 punch from 0x01e0e7 to 0x023d90 (0x5caa bytes) 000068 1769074499.985183 mapread 0x01a7fa thru 0x01eb08 (0x430f bytes) 000069 1769074499.990784 trunc from 0x040000 to 0x017c5c (0x283a3 bytes) 000070 1769074500.008388 write 0x009648 thru 0x00c778 (0x3131 bytes) 000071 1769074500.013917 mapread 0x00b8cb thru 0x013696 (0x7dcc bytes) fallocating to largest ever: 0x3e648 000072 1769074500.028794 fallocate 0x031ed2 thru 0x03e647 (0xc776 bytes) 000073 1769074500.033781 trunc from 0x00182b to 0x008f06 (0x76dc bytes) 000076 1769074500.039613 read 0x016d11 thru 0x017c5c (0xf4c bytes) 000078 1769074500.041164 punch from 0x0059cc to 0x009fe2 (0x4617 bytes) 000079 1769074500.054006 trunc from 0x017c5d to 0x028bd6 (0x10f7a bytes) 000080 1769074500.080794 fallocate 0x018b55 thru 0x0272c5 (0xe771 bytes) 000082 1769074500.096318 MIRROR_EXTEND to 2 mirrors 000083 1769074500.695802 mapwrite 0x02f522 thru 0x03216e (0x2c4d bytes) 000084 1769074500.773438 fallocate 0x009338 thru 0x0177b4 (0xe47d bytes) 000085 1769074500.778942 trunc from 0x03216f to 0x02ebe8 (0x3586 bytes) 000086 1769074500.796705 write 0x01cfcd thru 0x02ae47 (0xde7b bytes) 000087 1769074500.809389 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2ebe9): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ebe9): Mirror 2: 0xb1d9bd27 (stale) CRC-32 checksum value for chunk [0, 0x2ebe9): Mirror 1: 0x81db3262 Mirror 3: 0x81db3262 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ebe9: skipped 000088 1769074501.989196 write 0x0300a1 thru 0x03540b (0x536b bytes) 000089 1769074502.093182 mapwrite 0x024d45 thru 0x03206c (0xd328 bytes) 000090 1769074502.200973 fallocate 0x020a7a thru 0x02e59b (0xdb22 bytes) 000091 1769074502.219797 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3540c): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3540c): Mirror 2: 0x3d26a980 (stale) Mirror 3: 0x9ab77f04 (stale) CRC-32 checksum value for chunk [0, 0x3540c): Mirror 1: 0x1b73fd8a Mirror 4: 0x1b73fd8a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3540c: skipped 000093 1769074503.583562 read 0x01f16b thru 0x02e103 (0xef99 bytes) 000094 1769074503.612091 fallocate 0x02b3f9 thru 0x02c82a (0x1432 bytes) 000095 1769074503.700864 punch from 0x0092ca to 0x00a460 (0x1197 bytes) 000096 1769074503.718097 read 0x025d67 thru 0x028d72 (0x300c bytes) 000097 1769074503.763228 fallocate 0x014819 thru 0x0216ba (0xcea2 bytes) 000098 1769074503.776875 write 0x01626c thru 0x018a6e (0x2803 bytes) 000099 1769074503.830563 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3540c): Mirror 2: 0x3d26a980 (stale) Mirror 4: 0x1b73fd8a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3540c): Mirror 2: 0x3d26a980 (stale) Mirror 4: 0x1b73fd8a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3540c: skipped 000100 1769074504.404733 trunc from 0x03540c to 0x008c77 (0x2c794 bytes) 000102 1769074504.452305 trunc from 0x008c78 to 0x02cadb (0x23e64 bytes) 000103 1769074504.466608 write 0x0359a9 thru 0x03ffff (0xa657 bytes) 000104 1769074504.469569 read 0x003d33 thru 0x005970 (0x1c3e bytes) 000105 1769074504.478544 read 0x02e848 thru 0x02ec27 (0x3e0 bytes) 000106 1769074504.494632 mapread 0x03f857 thru 0x03ffff (0x7a9 bytes) 000107 1769074504.500994 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xd4ba71fd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xd4ba71fd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000108 1769074504.851792 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xd4ba71fd (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbdd1c713 Mirror 5: 0xbdd1c713 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000109 1769074505.730192 mapwrite 0x00fe3c thru 0x0124dd (0x26a2 bytes) 000110 1769074505.902954 mapread 0x00e993 thru 0x01071b (0x1d89 bytes) 000111 1769074505.903909 fallocate 0x029fd9 thru 0x033f47 (0x9f6f bytes) 000112 1769074505.925354 read 0x0248ac thru 0x030b76 (0xc2cb bytes) 000113 1769074505.958003 MIRROR_RESYNC 3 mirrors 000114 1769074506.934159 read 0x028da5 thru 0x030205 (0x7461 bytes) 000115 1769074506.949560 punch from 0x00c623 to 0x00e9c3 (0x23a1 bytes) 000116 1769074506.988952 punch from 0x03023c to 0x03316b (0x2f30 bytes) 000117 1769074507.000769 mapread 0x03fbbb thru 0x03ffff (0x445 bytes) 000118 1769074507.010856 write 0x036011 thru 0x03ffff (0x9fef bytes) 000119 1769074507.023637 MIRROR_RESYNC 3 mirrors 000120 1769074508.003128 mapread 0x01121a thru 0x0147e7 (0x35ce bytes) 000121 1769074508.030585 punch from 0x03e19c to 0x03ffff (0x1e64 bytes) 000122 1769074508.084682 trunc from 0x040000 to 0x00dae8 (0x32517 bytes) 000123 1769074508.130591 mapwrite 0x0277ec thru 0x02d13a (0x594f bytes) 000124 1769074508.169328 trunc from 0x021bf6 to 0x027cf2 (0x60fd bytes) 000126 1769074508.175286 punch from 0x0271e3 to 0x02d13a (0x5f58 bytes) 000127 1769074508.180992 trunc from 0x01431c to 0x0200dc (0xbdc1 bytes) 000128 1769074508.188984 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2d13b): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d13b): Mirror 4: 0xfe262b59 (stale) Mirror 5: 0xfe262b59 (stale) CRC-32 checksum value for chunk [0, 0x2d13b): Mirror 1: 0x711025f9 Mirror 6: 0x711025f9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d13b: skipped 000129 1769074509.233163 mapwrite 0x0258ab thru 0x02e885 (0x8fdb bytes) 000130 1769074509.387420 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e886): Mirror 4: 0xc9222dd (stale) Mirror 6: 0xd3ba6597 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e886): Mirror 4: 0xc9222dd (stale) Mirror 6: 0xd3ba6597 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e886: skipped 000131 1769074509.921342 MIRROR_RESYNC 3 mirrors 000132 1769074510.708083 MIRROR_RESYNC 3 mirrors 000133 1769074511.067789 fallocate 0x028160 thru 0x034876 (0xc717 bytes) 000134 1769074511.113005 read 0x0340f8 thru 0x034876 (0x77f bytes) 000135 1769074511.118667 punch from 0x01aea8 to 0x020edf (0x6038 bytes) 000136 1769074511.124201 read 0x00b69a thru 0x016b41 (0xb4a8 bytes) 000137 1769074511.133944 mapread 0x018e1a thru 0x01f719 (0x6900 bytes) 000138 1769074511.136730 punch from 0x03104d to 0x034876 (0x382a bytes) 000139 1769074511.145993 punch from 0x00935c to 0x0153e0 (0xc085 bytes) 000140 1769074511.151753 trunc from 0x007447 to 0x008a28 (0x15e2 bytes) 000141 1769074511.156055 trunc from 0x034877 to 0x032ba9 (0x1ccd bytes) 000142 1769074511.175170 mapread 0x00aab8 thru 0x00d26f (0x27b8 bytes) 000143 1769074511.193223 mapwrite 0x031067 thru 0x039901 (0x889b bytes) 000144 1769074511.247218 mapread 0x027d94 thru 0x032e25 (0xb092 bytes) 000145 1769074511.250586 mapread 0x020543 thru 0x0302f4 (0xfdb2 bytes) 000146 1769074511.258938 MIRROR_RESYNC 3 mirrors 000148 1769074511.893564 mapwrite 0x003225 thru 0x00d918 (0xa6f4 bytes) 000149 1769074511.992408 fallocate 0x024d15 thru 0x0252a7 (0x593 bytes) 000150 1769074511.998383 trunc from 0x039902 to 0x013cc2 (0x25c3f bytes) 000151 1769074512.054769 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x13cc3): Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13cc3): Mirror 4: 0xe849337f (stale) Mirror 6: 0xe849337f (stale) CRC-32 checksum value for chunk [0, 0x13cc3): Mirror 1: 0xf53908da Mirror 7: 0xf53908da lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13cc3: skipped 000152 1769074512.772742 fallocate 0x02e15d thru 0x03dd49 (0xfbed bytes) 000154 1769074512.811786 fallocate 0x01dd9d thru 0x02955e (0xb7c2 bytes) 000155 1769074512.817969 read 0x0136c7 thru 0x013cc2 (0x5fc bytes) 000156 1769074512.823493 fallocate 0x025e97 thru 0x027fc8 (0x2132 bytes) 000157 1769074512.828327 punch from 0x0098b8 to 0x017399 (0xdae2 bytes) 000158 1769074512.833342 trunc from 0x00b942 to 0x00cd7c (0x143b bytes) 000159 1769074512.838603 mapread 0x020ff5 thru 0x027fc8 (0x6fd4 bytes) 000160 1769074512.855761 write 0x014d4b thru 0x01617c (0x1432 bytes) 000161 1769074512.871649 punch from 0x016a54 to 0x01adf7 (0x43a4 bytes) 000162 1769074512.883912 read 0x00fa27 thru 0x01bb27 (0xc101 bytes) 000163 1769074512.895498 trunc from 0x000b7d to 0x00ce73 (0xc2f7 bytes) truncating to largest ever: 0x3f5bb 000164 1769074512.902225 trunc from 0x027fc9 to 0x03f5ba (0x175f2 bytes) 000165 1769074512.930593 mapread 0x02a066 thru 0x02d7fc (0x3797 bytes) 000167 1769074512.944997 trunc from 0x02c3cf to 0x03ad38 (0xe96a bytes) 000168 1769074512.951189 trunc from 0x03f5bb to 0x0226a2 (0x1cf18 bytes) 000169 1769074512.969516 punch from 0x0125a9 to 0x01ac93 (0x86eb bytes) 000170 1769074512.976152 mapread 0x00d063 thru 0x015f1d (0x8ebb bytes) 000171 1769074512.994143 read 0x016be7 thru 0x016d6c (0x186 bytes) 000172 1769074513.008302 write 0x00d5db thru 0x01b3ed (0xde13 bytes) 000174 1769074513.010179 mapwrite 0x01b6a2 thru 0x0205ec (0x4f4b bytes) 000177 1769074513.028834 mapwrite 0x003172 thru 0x004984 (0x1813 bytes) 000178 1769074513.038996 trunc from 0x0226a3 to 0x011ec7 (0x107db bytes) 000179 1769074513.055134 read 0x00db39 thru 0x0103ee (0x28b6 bytes) 000180 1769074513.055899 write 0x02122f thru 0x025d90 (0x4b62 bytes) 000181 1769074513.057807 trunc from 0x00712c to 0x00cb44 (0x5a19 bytes) 000182 1769074513.063658 fallocate 0x036158 thru 0x03b3fe (0x52a7 bytes) 000183 1769074513.071067 trunc from 0x01ab27 to 0x025c45 (0xb11f bytes) 000184 1769074513.082979 read 0x0155aa thru 0x017dd4 (0x282b bytes) 000185 1769074513.092461 write 0x033a87 thru 0x03587d (0x1df7 bytes) 000186 1769074513.093609 punch from 0x020aaf to 0x02dd55 (0xd2a7 bytes) 000187 1769074513.098491 punch from 0x02147e to 0x02a3b0 (0x8f33 bytes) 000188 1769074513.104112 punch from 0x005675 to 0x012edc (0xd868 bytes) 000189 1769074513.116069 fallocate 0x01544d thru 0x016f94 (0x1b48 bytes) 000191 1769074513.129408 mapread 0x032ce3 thru 0x03587d (0x2b9b bytes) 000192 1769074513.139092 fallocate 0x02641d thru 0x02907b (0x2c5f bytes) 000193 1769074513.155991 mapwrite 0x01e152 thru 0x020c8c (0x2b3b bytes) 000194 1769074513.182150 trunc from 0x03587e to 0x01a98a (0x1aef3 bytes) 000195 1769074513.224860 write 0x02e580 thru 0x03ccc7 (0xe748 bytes) 000197 1769074513.251597 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ccc8): Mirror 6: 0x7e14bd93 (stale) Mirror 7: 0x756e6a88 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ccc8): Mirror 6: 0x7e14bd93 (stale) Mirror 7: 0x756e6a88 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ccc8: skipped 000198 1769074513.582552 punch from 0x022ec7 to 0x0275ca (0x4704 bytes) 000199 1769074513.593691 MIRROR_RESYNC 3 mirrors 000200 1769074514.306631 read 0x01ac67 thru 0x01baa3 (0xe3d bytes) fallocating to largest ever: 0x40000 000201 1769074514.312176 fallocate 0x0326e8 thru 0x03ffff (0xd918 bytes) 000202 1769074514.336122 write 0x01e39d thru 0x021346 (0x2faa bytes) 000203 1769074514.346531 fallocate 0x020bca thru 0x02bc16 (0xb04d bytes) 000204 1769074514.354750 MIRROR_RESYNC 3 mirrors 000205 1769074515.247018 fallocate 0x016879 thru 0x0188a6 (0x202e bytes) 000207 1769074515.303566 punch from 0x012ca2 to 0x016ca6 (0x4005 bytes) 000208 1769074515.310355 read 0x033f46 thru 0x03fbdd (0xbc98 bytes) 000209 1769074515.325582 read 0x00c632 thru 0x01b43a (0xee09 bytes) 000210 1769074515.338486 punch from 0x0068c8 to 0x00e4da (0x7c13 bytes) 000211 1769074515.344198 trunc from 0x02dbe2 to 0x031ce9 (0x4108 bytes) 000213 1769074515.364080 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x7234f760 (stale) Mirror 7: 0x7234f760 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5820fbfb Mirror 8: 0x5820fbfb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000214 1769074516.322865 trunc from 0x00cdd5 to 0x0178b4 (0xaae0 bytes) 000216 1769074516.368889 punch from 0x013d24 to 0x01fdc5 (0xc0a2 bytes) 000217 1769074516.381324 read 0x01028b thru 0x013dff (0x3b75 bytes) 000218 1769074516.401162 fallocate 0x03a597 thru 0x03ffff (0x5a69 bytes) 000219 1769074516.415541 fallocate 0x0349b0 thru 0x03ac59 (0x62aa bytes) 000220 1769074516.420076 fallocate 0x033f8c thru 0x034b9f (0xc14 bytes) 000221 1769074516.427051 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x7234f760 (stale) Mirror 7: 0x7234f760 (stale) Mirror 8: 0x5820fbfb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7db1559c Mirror 9: 0x7db1559c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000222 1769074517.667408 mapwrite 0x01987f thru 0x023a1f (0xa1a1 bytes) 000223 1769074517.781170 mapwrite 0x039adf thru 0x03ffff (0x6521 bytes) 000224 1769074517.815479 trunc from 0x033ef0 to 0x03ffff (0xc110 bytes) 000225 1769074517.821101 punch from 0x032b32 to 0x03ffff (0xd4ce bytes) 000226 1769074517.829915 punch from 0x0199a2 to 0x02549d (0xbafc bytes) 000227 1769074517.835268 fallocate 0x00dd95 thru 0x014136 (0x63a2 bytes) 000228 1769074517.840904 mapwrite 0x017ee7 thru 0x024f47 (0xd061 bytes) 000229 1769074517.878672 fallocate 0x03a7a7 thru 0x03ffff (0x5859 bytes) 000230 1769074517.884435 punch from 0x01079c to 0x018cf9 (0x855e bytes) 000231 1769074517.890056 punch from 0x016131 to 0x01f24b (0x911b bytes) 000232 1769074517.900748 MIRROR_RESYNC 5 mirrors 000235 1769074519.232579 read 0x0279ee thru 0x029964 (0x1f77 bytes) 000236 1769074519.238664 mapread 0x000fdb thru 0x00b1d5 (0xa1fb bytes) 000237 1769074519.258933 trunc from 0x002bcb to 0x00db7f (0xafb5 bytes) 000238 1769074519.288322 trunc from 0x040000 to 0x001db8 (0x3e247 bytes) 000239 1769074519.318597 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1db9): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1db9): Mirror 6: 0x3fcd9571 (stale) Mirror 7: 0x3fcd9571 (stale) Mirror 8: 0x3fcd9571 (stale) Mirror 9: 0x3fcd9571 (stale) CRC-32 checksum value for chunk [0, 0x1db9): Mirror 1: 0x3fcd9571 Mirror 10: 0x3fcd9571 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1db9: skipped 000240 1769074519.972552 MIRROR_RESYNC 6 mirrors 000241 1769074520.632989 write 0x014a68 thru 0x022b56 (0xe0ef bytes) 000242 1769074520.679031 punch from 0x005bdb to 0x005da3 (0x1c9 bytes) 000243 1769074520.685639 fallocate 0x006c88 thru 0x00c642 (0x59bb bytes) 000244 1769074520.691792 trunc from 0x00013c to 0x009583 (0x9448 bytes) 000245 1769074520.698745 punch from 0x018334 to 0x020a1c (0x86e9 bytes) 000246 1769074520.712946 trunc from 0x022b57 to 0x00c711 (0x16445 bytes) 000247 1769074520.732978 trunc from 0x000592 to 0x002d82 (0x27f1 bytes) 000248 1769074520.738054 mapread 0x0062d4 thru 0x00bb14 (0x5841 bytes) 000249 1769074520.759882 write 0x01af38 thru 0x0219ac (0x6a75 bytes) 000250 1769074520.761115 trunc from 0x0219ad to 0x007690 (0x1a31c bytes) 000251 1769074520.789900 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x7691): Mirror 7: 0xc2047949 (stale) Mirror 8: 0xc2047949 (stale) Mirror 9: 0xc2047949 (stale) Mirror 10: 0xc2047949 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7691): Mirror 7: 0xc2047949 (stale) Mirror 8: 0xc2047949 (stale) Mirror 9: 0xc2047949 (stale) Mirror 10: 0xc2047949 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7691: skipped 000252 1769074521.080285 trunc from 0x0012b5 to 0x007690 (0x63dc bytes) 000253 1769074521.084034 trunc from 0x00471b to 0x007690 (0x2f76 bytes) 000254 1769074521.087533 trunc from 0x007691 to 0x01483c (0xd1ac bytes) 000255 1769074521.111527 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1483d): Mirror 7: 0x5a8d58e9 (stale) Mirror 8: 0x5a8d58e9 (stale) Mirror 10: 0x5a8d58e9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1483d): Mirror 7: 0x5a8d58e9 (stale) Mirror 8: 0x5a8d58e9 (stale) Mirror 10: 0x5a8d58e9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1483d: skipped 000256 1769074521.427874 fallocate 0x01734b thru 0x01f608 (0x82be bytes) 000257 1769074521.433682 trunc from 0x01f609 to 0x016bfb (0x8a0d bytes) 000258 1769074521.461888 read 0x000954 thru 0x010818 (0xfec5 bytes) 000259 1769074521.478081 trunc from 0x016bfc to 0x018d70 (0x2175 bytes) 000260 1769074521.497045 punch from 0x003dcc to 0x00e306 (0xa53b bytes) 000261 1769074521.507745 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x18d71): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18d71): Mirror 7: 0x60b7c328 (stale) Mirror 8: 0x60b7c328 (stale) Mirror 10: 0x60b7c328 (stale) CRC-32 checksum value for chunk [0, 0x18d71): Mirror 1: 0x60b7c328 Mirror 11: 0x60b7c328 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18d71: skipped 000262 1769074522.221372 mapread 0x011aec thru 0x014a72 (0x2f87 bytes) 000263 1769074522.254769 write 0x03f9ad thru 0x03ffff (0x653 bytes) 000264 1769074522.309074 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xe20eea22 (stale) Mirror 8: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 11: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf6e11f0b Mirror 12: 0xf6e11f0b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000265 1769074523.060413 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 11: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 11: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf6e11f0b Mirror 12: 0xf6e11f0b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000266 1769074523.629829 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 11: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) Mirror 11: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000267 1769074523.955908 mapread 0x03b6f8 thru 0x03ffff (0x4908 bytes) 000268 1769074523.977036 read 0x019530 thru 0x01f53f (0x6010 bytes) 000269 1769074523.984500 mapread 0x03894b thru 0x03b431 (0x2ae7 bytes) 000270 1769074523.985871 punch from 0x017a97 to 0x01e58d (0x6af7 bytes) 000271 1769074523.999848 trunc from 0x040000 to 0x01c634 (0x239cb bytes) 000272 1769074524.020361 mapread 0x015d0a thru 0x01aa03 (0x4cfa bytes) 000273 1769074524.030363 trunc from 0x01c635 to 0x00d14d (0xf4e7 bytes) 000274 1769074524.053586 MIRROR_RESYNC 4 mirrors 000275 1769074524.685216 punch from 0x004239 to 0x00d14d (0x8f15 bytes) 000276 1769074524.715218 write 0x01c362 thru 0x020cce (0x496d bytes) 000277 1769074524.718463 write 0x02adaf thru 0x02b59e (0x7f0 bytes) 000279 1769074524.722516 trunc from 0x02b59f to 0x039ef2 (0xe954 bytes) 000280 1769074524.745897 write 0x02387e thru 0x02a2a8 (0x6a2b bytes) 000281 1769074524.752541 write 0x01eae2 thru 0x023139 (0x4658 bytes) 000282 1769074524.754428 mapread 0x013f67 thru 0x01771f (0x37b9 bytes) 000283 1769074524.774562 trunc from 0x039ef3 to 0x0213d9 (0x18b19 bytes) 000284 1769074524.791833 mapwrite 0x01e102 thru 0x02521d (0x711c bytes) 000285 1769074524.831335 mapread 0x01be3e thru 0x0239e0 (0x7ba3 bytes) 000286 1769074524.832986 read 0x01706c thru 0x02521d (0xe1b2 bytes) 000287 1769074524.833921 punch from 0x01ecbd to 0x01f3b3 (0x6f7 bytes) 000288 1769074524.838833 write 0x039339 thru 0x03ffff (0x6cc7 bytes) 000289 1769074524.840401 punch from 0x005b19 to 0x00ceb3 (0x739b bytes) 000290 1769074524.844598 read 0x00147e thru 0x0086a6 (0x7229 bytes) 000291 1769074524.853492 punch from 0x013113 to 0x01d450 (0xa33e bytes) 000292 1769074524.862428 MIRROR_RESYNC 4 mirrors 000294 1769074525.734714 write 0x007a61 thru 0x00e661 (0x6c01 bytes) 000295 1769074525.776732 mapread 0x02fdbb thru 0x02ff23 (0x169 bytes) 000296 1769074525.791014 trunc from 0x014623 to 0x01a3f5 (0x5dd3 bytes) 000297 1769074525.799129 mapwrite 0x00a7f2 thru 0x010284 (0x5a93 bytes) 000299 1769074525.828985 mapwrite 0x0091cf thru 0x015409 (0xc23b bytes) 000300 1769074525.851508 write 0x01493b thru 0x02188c (0xcf52 bytes) 000301 1769074525.861553 trunc from 0x040000 to 0x0199bc (0x26643 bytes) 000302 1769074525.896870 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x199bd): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x199bd): Mirror 8: 0xd4039c7e (stale) Mirror 10: 0xd4039c7e (stale) Mirror 11: 0xd4039c7e (stale) CRC-32 checksum value for chunk [0, 0x199bd): Mirror 1: 0x21483dad Mirror 12: 0x21483dad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x199bd: skipped 000303 1769074526.964287 read 0x018d75 thru 0x0199bc (0xc48 bytes) 000304 1769074526.978743 punch from 0x0009b9 to 0x001f3d (0x1585 bytes) 000305 1769074527.036211 trunc from 0x0199bd to 0x003eb0 (0x15b0c bytes) 000306 1769074527.063074 trunc from 0x003eb1 to 0x0223c1 (0x1e511 bytes) 000307 1769074527.090159 mapwrite 0x02e33f thru 0x03641c (0x80de bytes) 000308 1769074527.141756 trunc from 0x03641d to 0x028f4b (0xd4d1 bytes) 000309 1769074527.156897 punch from 0x01eb15 to 0x0274cc (0x89b8 bytes) 000310 1769074527.162945 mapwrite 0x01d729 thru 0x021c65 (0x453d bytes) 000311 1769074527.195523 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x28f4c): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28f4c): Mirror 8: 0xf1204cab (stale) Mirror 10: 0xf1204cab (stale) Mirror 11: 0xf1204cab (stale) Mirror 12: 0x656b1524 (stale) CRC-32 checksum value for chunk [0, 0x28f4c): Mirror 1: 0xddcf82db Mirror 13: 0xddcf82db lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28f4c: skipped 000313 1769074528.077513 mapread 0x01117e thru 0x01e788 (0xd60b bytes) 000314 1769074528.126188 trunc from 0x004f17 to 0x00aa93 (0x5b7d bytes) 000315 1769074528.170823 read 0x024e9c thru 0x028f4b (0x40b0 bytes) 000317 1769074528.183529 trunc from 0x028f4c to 0x029631 (0x6e6 bytes) 000318 1769074528.241505 punch from 0x00153d to 0x00324a (0x1d0e bytes) 000320 1769074528.249429 mapread 0x00b221 thru 0x00c30c (0x10ec bytes) 000321 1769074528.265131 write 0x02497f thru 0x033613 (0xec95 bytes) 000322 1769074528.267796 write 0x02ba7c thru 0x0329c5 (0x6f4a bytes) 000323 1769074528.270519 fallocate 0x001a1f thru 0x0067aa (0x4d8c bytes) 000324 1769074528.277372 punch from 0x0333a5 to 0x033613 (0x26f bytes) 000325 1769074528.294722 fallocate 0x02ee75 thru 0x034b81 (0x5d0d bytes) 000326 1769074528.300498 mapwrite 0x00fe18 thru 0x01e1f4 (0xe3dd bytes) 000327 1769074528.363966 fallocate 0x00b6dc thru 0x00cec4 (0x17e9 bytes) 000328 1769074528.370372 mapread 0x012d5e thru 0x017fa2 (0x5245 bytes) 000329 1769074528.373408 write 0x0159be thru 0x020d08 (0xb34b bytes) 000330 1769074528.375898 punch from 0x02ebdb to 0x033613 (0x4a39 bytes) 000331 1769074528.383224 mapread 0x00fb54 thru 0x0100e7 (0x594 bytes) 000332 1769074528.384706 write 0x037e3c thru 0x03ffff (0x81c4 bytes) 000333 1769074528.387397 read 0x02fa99 thru 0x03d606 (0xdb6e bytes) 000334 1769074528.400533 punch from 0x035163 to 0x03c5e3 (0x7481 bytes) 000335 1769074528.420417 mapwrite 0x00258b thru 0x008fbd (0x6a33 bytes) 000336 1769074528.447183 punch from 0x023fbe to 0x0252e3 (0x1326 bytes) 000337 1769074528.454771 punch from 0x014e75 to 0x01c38c (0x7518 bytes) 000338 1769074528.461794 trunc from 0x00834d to 0x00dabf (0x5773 bytes) 000339 1769074528.469481 punch from 0x00f480 to 0x01ecbb (0xf83c bytes) 000340 1769074528.481465 trunc from 0x040000 to 0x029cbc (0x16343 bytes) 000341 1769074528.509316 trunc from 0x029cbd to 0x034c8c (0xafd0 bytes) 000343 1769074528.530410 write 0x03a27a thru 0x03c855 (0x25dc bytes) 000344 1769074528.532614 read 0x030bdf thru 0x03b0ea (0xa50c bytes) 000345 1769074528.545398 mapread 0x0069e1 thru 0x00ed93 (0x83b3 bytes) 000346 1769074528.548330 read 0x025768 thru 0x032930 (0xd1c9 bytes) 000347 1769074528.549854 mapread 0x033074 thru 0x03a886 (0x7813 bytes) 000348 1769074528.552152 trunc from 0x03c856 to 0x039fcb (0x288a bytes) 000350 1769074528.578378 trunc from 0x007b3f to 0x00bfdb (0x449d bytes) 000351 1769074528.584549 trunc from 0x02fc43 to 0x039fcb (0xa389 bytes) 000352 1769074528.591674 fallocate 0x0076c0 thru 0x016f25 (0xf866 bytes) 000353 1769074528.603996 MIRROR_RESYNC 6 mirrors 000355 1769074530.301397 MIRROR_RESYNC 6 mirrors 000357 1769074530.750770 mapwrite 0x028f2f thru 0x03093b (0x7a0d bytes) 000359 1769074530.842038 mapread 0x0003b5 thru 0x0076df (0x732b bytes) 000360 1769074530.853697 trunc from 0x00d796 to 0x012ea4 (0x570f bytes) 000361 1769074530.859037 trunc from 0x039fcc to 0x012a38 (0x27593 bytes) 000363 1769074530.877952 write 0x0303cd thru 0x031acf (0x1703 bytes) 000364 1769074530.879769 mapwrite 0x007c44 thru 0x01483a (0xcbf7 bytes) 000365 1769074530.915850 trunc from 0x026f31 to 0x02f3ef (0x84bf bytes) 000367 1769074530.921645 write 0x002103 thru 0x00ca26 (0xa924 bytes) 000368 1769074530.922910 mapwrite 0x027c6e thru 0x02be42 (0x41d5 bytes) 000369 1769074530.958620 fallocate 0x038174 thru 0x03ffff (0x7e8c bytes) 000370 1769074530.965376 trunc from 0x031ad0 to 0x03d335 (0xb866 bytes) 000372 1769074531.007902 mapwrite 0x036332 thru 0x03ffff (0x9cce bytes) 000373 1769074531.079849 punch from 0x0346f8 to 0x035b1f (0x1428 bytes) 000374 1769074531.090438 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x5cb27a62 (stale) Mirror 10: 0x5cb27a62 (stale) Mirror 11: 0x5cb27a62 (stale) Mirror 12: 0x5cb27a62 (stale) Mirror 13: 0x5cb27a62 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x70882ce Mirror 14: 0x70882ce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000375 1769074531.915423 read 0x019dc9 thru 0x01cc74 (0x2eac bytes) 000376 1769074531.933040 mapread 0x02a0cc thru 0x02bee1 (0x1e16 bytes) 000377 1769074531.963780 punch from 0x03274b to 0x03e38c (0xbc42 bytes) 000378 1769074532.008083 punch from 0x038428 to 0x03ffff (0x7bd8 bytes) 000379 1769074532.012787 trunc from 0x040000 to 0x03331b (0xcce4 bytes) 000380 1769074532.059947 mapread 0x02c54e thru 0x030aa0 (0x4553 bytes) 000381 1769074532.068679 read 0x0031c6 thru 0x00f5e8 (0xc423 bytes) 000382 1769074532.078583 read 0x013687 thru 0x02188f (0xe209 bytes) 000383 1769074532.079338 punch from 0x01fced to 0x029214 (0x9528 bytes) 000384 1769074532.085127 fallocate 0x030c57 thru 0x03107c (0x426 bytes) 000385 1769074532.089796 trunc from 0x01d5df to 0x027c82 (0xa6a4 bytes) 000386 1769074532.094321 punch from 0x01cfab to 0x022517 (0x556d bytes) 000387 1769074532.098420 trunc from 0x00f96f to 0x019599 (0x9c2b bytes) 000388 1769074532.103610 read 0x01af16 thru 0x0224ba (0x75a5 bytes) 000389 1769074532.120212 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3331c): Mirror 8: 0xd3732351 (stale) Mirror 10: 0xd3732351 (stale) Mirror 11: 0xd3732351 (stale) Mirror 13: 0xd3732351 (stale) Mirror 14: 0xa98e28d7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3331c): Mirror 8: 0xd3732351 (stale) Mirror 10: 0xd3732351 (stale) Mirror 11: 0xd3732351 (stale) Mirror 13: 0xd3732351 (stale) Mirror 14: 0xa98e28d7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3331c: skipped 000390 1769074532.516069 punch from 0x024427 to 0x030963 (0xc53d bytes) 000391 1769074532.528583 MIRROR_RESYNC 6 mirrors 000392 1769074534.039110 read 0x023a73 thru 0x02d6f6 (0x9c84 bytes) 000393 1769074534.051510 fallocate 0x039b22 thru 0x03a43a (0x919 bytes) 000394 1769074534.116593 fallocate 0x002a55 thru 0x00a74b (0x7cf7 bytes) 000396 1769074534.124768 write 0x025441 thru 0x02a803 (0x53c3 bytes) 000397 1769074534.136581 trunc from 0x0047fd to 0x006634 (0x1e38 bytes) 000399 1769074534.147597 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3a43b): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a43b): Mirror 8: 0xf46dc2cf (stale) Mirror 10: 0xf46dc2cf (stale) Mirror 11: 0xf46dc2cf (stale) Mirror 13: 0xf46dc2cf (stale) Mirror 14: 0xf46dc2cf (stale) CRC-32 checksum value for chunk [0, 0x3a43b): Mirror 1: 0x8daf9f49 Mirror 15: 0x8daf9f49 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a43b: skipped 000400 1769074535.925075 mapread 0x0302f6 thru 0x031895 (0x15a0 bytes) 000401 1769074535.975817 mapwrite 0x00bae4 thru 0x00da89 (0x1fa6 bytes) 000402 1769074536.146652 fallocate 0x03c69b thru 0x03f227 (0x2b8d bytes) 000403 1769074536.154955 trunc from 0x03a43b to 0x0218ca (0x18b70 bytes) 000404 1769074536.186469 trunc from 0x018b4b to 0x0218ca (0x8d80 bytes) 000405 1769074536.192361 write 0x03fd2d thru 0x03ffff (0x2d3 bytes) 000406 1769074536.194665 trunc from 0x040000 to 0x0345b1 (0xba4e bytes) 000407 1769074536.216188 read 0x021efb thru 0x02f1a1 (0xd2a7 bytes) 000408 1769074536.228745 read 0x007a8f thru 0x011164 (0x96d6 bytes) 000409 1769074536.229952 write 0x03c11d thru 0x03ffff (0x3ee3 bytes) 000410 1769074536.232006 fallocate 0x028df9 thru 0x031322 (0x852a bytes) 000411 1769074536.239099 mapread 0x0286cb thru 0x02da48 (0x537e bytes) 000412 1769074536.249655 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x1dce833f (stale) Mirror 10: 0x1dce833f (stale) Mirror 11: 0x1dce833f (stale) Mirror 13: 0x1dce833f (stale) Mirror 15: 0xaa10a86 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x1dce833f (stale) Mirror 10: 0x1dce833f (stale) Mirror 11: 0x1dce833f (stale) Mirror 13: 0x1dce833f (stale) Mirror 15: 0xaa10a86 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000413 1769074537.071987 trunc from 0x0137ce to 0x01df72 (0xa7a5 bytes) 000414 1769074537.082806 mapread 0x00b2f1 thru 0x014a28 (0x9738 bytes) 000415 1769074537.132983 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x1dce833f (stale) Mirror 10: 0x1dce833f (stale) Mirror 11: 0x1dce833f (stale) Mirror 13: 0x1dce833f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x1dce833f (stale) Mirror 10: 0x1dce833f (stale) Mirror 11: 0x1dce833f (stale) Mirror 13: 0x1dce833f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000416 1769074537.732428 read 0x0224bb thru 0x02837f (0x5ec5 bytes) 000418 1769074537.743453 trunc from 0x03d07c to 0x03ffff (0x2f84 bytes) 000419 1769074537.750098 trunc from 0x040000 to 0x03e763 (0x189c bytes) 000420 1769074537.785979 trunc from 0x027f21 to 0x033ea7 (0xbf87 bytes) 000421 1769074537.793839 fallocate 0x029ffc thru 0x02d418 (0x341d bytes) 000422 1769074537.802319 trunc from 0x025ad2 to 0x030407 (0xa936 bytes) 000424 1769074537.810494 trunc from 0x03e764 to 0x0235e0 (0x1b183 bytes) 000425 1769074537.830535 trunc from 0x012d3d to 0x0178c1 (0x4b85 bytes) 000426 1769074537.842220 MIRROR_RESYNC 5 mirrors 000428 1769074539.541149 MIRROR_RESYNC 5 mirrors 000429 1769074539.931608 MIRROR_RESYNC 5 mirrors 000430 1769074540.268070 trunc from 0x0235e1 to 0x03394f (0x1036f bytes) 000431 1769074540.314146 fallocate 0x029077 thru 0x03219d (0x9127 bytes) 000432 1769074540.320154 punch from 0x015703 to 0x024330 (0xec2e bytes) 000433 1769074540.324034 fallocate 0x021041 thru 0x023ca8 (0x2c68 bytes) 000434 1769074540.329355 fallocate 0x001552 thru 0x010d41 (0xf7f0 bytes) 000435 1769074540.334318 trunc from 0x0307c9 to 0x03394f (0x3187 bytes) 000436 1769074540.342547 MIRROR_RESYNC 5 mirrors 000437 1769074541.311544 mapwrite 0x03b693 thru 0x03c508 (0xe76 bytes) 000438 1769074541.366558 read 0x01c42c thru 0x02830b (0xbee0 bytes) 000439 1769074541.374326 mapwrite 0x026743 thru 0x0350ad (0xe96b bytes) 000440 1769074541.409031 mapwrite 0x00656a thru 0x00f903 (0x939a bytes) 000441 1769074541.433545 read 0x01ffe0 thru 0x028556 (0x8577 bytes) 000442 1769074541.434147 trunc from 0x03c509 to 0x02faa2 (0xca66 bytes) 000443 1769074541.455297 fallocate 0x007c7b thru 0x013d01 (0xc087 bytes) 000444 1769074541.460577 mapwrite 0x03af5e thru 0x03ffff (0x50a2 bytes) 000445 1769074541.502171 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xc0013cd1 (stale) Mirror 10: 0xc0013cd1 (stale) Mirror 11: 0xc0013cd1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xc0013cd1 (stale) Mirror 10: 0xc0013cd1 (stale) Mirror 11: 0xc0013cd1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000446 1769074541.819026 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xc0013cd1 (stale) Mirror 11: 0xc0013cd1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xc0013cd1 (stale) Mirror 11: 0xc0013cd1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000447 1769074542.145207 mapwrite 0x026f5f thru 0x029952 (0x29f4 bytes) 000448 1769074542.181600 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xc0013cd1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xc0013cd1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000449 1769074542.485506 trunc from 0x040000 to 0x01bdcb (0x24234 bytes) 000450 1769074542.509162 mapwrite 0x0061ed thru 0x015ea3 (0xfcb7 bytes) 000451 1769074542.560008 read 0x0078c9 thru 0x0154ec (0xdc24 bytes) 000452 1769074542.560722 mapread 0x018742 thru 0x01bdcb (0x368a bytes) 000453 1769074542.566764 mapwrite 0x0310e1 thru 0x031f74 (0xe94 bytes) 000454 1769074542.612595 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x31f75): Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31f75): Mirror 10: 0x751a4db6 (stale) CRC-32 checksum value for chunk [0, 0x31f75): Mirror 1: 0x7d6bc07d Mirror 11: 0x7d6bc07d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31f75: skipped 000455 1769074543.608042 write 0x026cfd thru 0x02718a (0x48e bytes) 000456 1769074543.691442 MIRROR_RESYNC 3 mirrors 000457 1769074544.550447 write 0x0059c4 thru 0x00f945 (0x9f82 bytes) 000458 1769074544.587486 trunc from 0x02ee0e to 0x02f3e3 (0x5d6 bytes) 000459 1769074544.593142 trunc from 0x0238d5 to 0x030c6c (0xd398 bytes) 000460 1769074544.598172 punch from 0x012679 to 0x021bf6 (0xf57e bytes) 000462 1769074544.603487 read 0x007b35 thru 0x008e17 (0x12e3 bytes) 000463 1769074544.605387 mapread 0x0218b8 thru 0x02b145 (0x988e bytes) 000464 1769074544.620953 trunc from 0x031f75 to 0x02566d (0xc907 bytes) 000465 1769074544.641137 fallocate 0x017730 thru 0x02307f (0xb950 bytes) 000466 1769074544.647057 write 0x005d99 thru 0x008b18 (0x2d80 bytes) 000467 1769074544.648646 write 0x03bce1 thru 0x03ffff (0x431f bytes) 000468 1769074544.650180 trunc from 0x040000 to 0x0039ae (0x3c651 bytes) 000469 1769074544.667273 read 0x00115e thru 0x003041 (0x1ee4 bytes) 000470 1769074544.674046 trunc from 0x0010fb to 0x0039ae (0x28b4 bytes) 000472 1769074544.679175 mapwrite 0x01e1e0 thru 0x029a42 (0xb863 bytes) 000473 1769074544.726875 write 0x01a7e1 thru 0x021f02 (0x7722 bytes) 000475 1769074544.730496 mapread 0x000caa thru 0x006dc1 (0x6118 bytes) 000476 1769074544.743617 trunc from 0x029a43 to 0x012483 (0x175bf bytes) 000477 1769074544.762092 read 0x005842 thru 0x00e4cd (0x8c8c bytes) 000478 1769074544.762789 punch from 0x00d287 to 0x012483 (0x51fd bytes) 000479 1769074544.767914 mapwrite 0x015ecd thru 0x018eef (0x3023 bytes) 000480 1769074544.810753 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x18ef0): Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18ef0): Mirror 10: 0xb6646dfd (stale) Mirror 11: 0xb6646dfd (stale) CRC-32 checksum value for chunk [0, 0x18ef0): Mirror 1: 0x6d454597 Mirror 12: 0x6d454597 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18ef0: skipped 000481 1769074545.484597 mapread 0x003dde thru 0x005359 (0x157c bytes) 000482 1769074545.523864 write 0x0086e7 thru 0x01810f (0xfa29 bytes) 000483 1769074545.575865 mapwrite 0x026dec thru 0x02e739 (0x794e bytes) 000484 1769074545.619970 trunc from 0x022276 to 0x029255 (0x6fe0 bytes) 000485 1769074545.625572 trunc from 0x00d630 to 0x01a513 (0xcee4 bytes) 000486 1769074545.630331 mapread 0x02c891 thru 0x02e739 (0x1ea9 bytes) 000487 1769074545.632067 mapwrite 0x034550 thru 0x03dd6e (0x981f bytes) 000488 1769074545.687367 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dd6f): Mirror 11: 0x45a87daa (stale) Mirror 12: 0xeb5693f8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd6f): Mirror 11: 0x45a87daa (stale) Mirror 12: 0xeb5693f8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd6f: skipped 000489 1769074545.998007 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3dd6f): Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd6f): Mirror 11: 0x45a87daa (stale) Mirror 12: 0xeb5693f8 (stale) CRC-32 checksum value for chunk [0, 0x3dd6f): Mirror 1: 0xa2f70f1e Mirror 13: 0xa2f70f1e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd6f: skipped 000490 1769074546.831909 trunc from 0x00e10c to 0x016c41 (0x8b36 bytes) 000491 1769074546.881910 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dd6f): Mirror 12: 0xeb5693f8 (stale) Mirror 13: 0xa2f70f1e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd6f): Mirror 12: 0xeb5693f8 (stale) Mirror 13: 0xa2f70f1e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd6f: skipped 000492 1769074547.154992 fallocate 0x008e88 thru 0x00e411 (0x558a bytes) 000494 1769074547.165554 fallocate 0x024f8b thru 0x034b32 (0xfba8 bytes) 000495 1769074547.172151 trunc from 0x03dd6f to 0x0378c6 (0x64a8 bytes) 000496 1769074547.204897 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x378c7): Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x378c7): Mirror 12: 0xef542572 (stale) Mirror 13: 0x4ab0484a (stale) CRC-32 checksum value for chunk [0, 0x378c7): Mirror 1: 0x4ab0484a Mirror 14: 0x4ab0484a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x378c7: skipped 000497 1769074548.055139 trunc from 0x0378c7 to 0x01b942 (0x1bf84 bytes) 000498 1769074548.102802 write 0x038bfe thru 0x03ffff (0x7402 bytes) 000500 1769074548.106795 write 0x03ea88 thru 0x03ffff (0x1578 bytes) 000501 1769074548.108230 punch from 0x017f3f to 0x022798 (0xa85a bytes) 000502 1769074548.113635 mapwrite 0x02175b thru 0x030033 (0xe8d9 bytes) 000504 1769074548.154953 fallocate 0x029fbb thru 0x033dfc (0x9e42 bytes) 000506 1769074548.164618 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x4794dd0b (stale) Mirror 14: 0xd29728fc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x4794dd0b (stale) Mirror 14: 0xd29728fc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000507 1769074548.460066 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x4794dd0b (stale) Mirror 14: 0xd29728fc (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x11cb6c54 Mirror 15: 0x11cb6c54 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000508 1769074549.328627 fallocate 0x000947 thru 0x004a60 (0x411a bytes) 000509 1769074549.410613 read 0x0132e4 thru 0x02295a (0xf677 bytes) 000511 1769074549.430200 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x4794dd0b (stale) Mirror 14: 0xd29728fc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x4794dd0b (stale) Mirror 14: 0xd29728fc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000512 1769074549.873996 trunc from 0x01fec4 to 0x0241b0 (0x42ed bytes) 000514 1769074549.889341 mapwrite 0x0056be thru 0x0143eb (0xed2e bytes) 000515 1769074550.056734 trunc from 0x0052f1 to 0x00778f (0x249f bytes) 000516 1769074550.066139 punch from 0x01396a to 0x013c29 (0x2c0 bytes) 000517 1769074550.076996 write 0x03dcd6 thru 0x03ffff (0x232a bytes) 000518 1769074550.115141 trunc from 0x040000 to 0x01b9e0 (0x2461f bytes) 000519 1769074550.156707 mapwrite 0x021f91 thru 0x02b173 (0x91e3 bytes) 000520 1769074550.329785 trunc from 0x02269d to 0x02b173 (0x8ad7 bytes) 000521 1769074550.357638 punch from 0x01534d to 0x022e88 (0xdb3c bytes) 000522 1769074550.372129 trunc from 0x02b174 to 0x03f87b (0x14708 bytes) 000523 1769074550.443863 mapwrite 0x00ef17 thru 0x0198e9 (0xa9d3 bytes) 000524 1769074550.534680 trunc from 0x03f87c to 0x0328d2 (0xcfa9 bytes) 000526 1769074550.608919 mapwrite 0x0024e2 thru 0x005595 (0x30b4 bytes) 000527 1769074550.654623 fallocate 0x022e09 thru 0x031d27 (0xef1f bytes) 000528 1769074550.680864 MIRROR_RESYNC 3 mirrors 000529 1769074552.273028 MIRROR_EXTEND to 4 mirrors 000530 1769074553.237140 mapread 0x004279 thru 0x007361 (0x30e9 bytes) 000531 1769074553.287531 punch from 0x0032d1 to 0x0038bb (0x5eb bytes) 000532 1769074553.356202 mapwrite 0x02edad thru 0x03c7a1 (0xd9f5 bytes) 000534 1769074553.521996 trunc from 0x013120 to 0x021452 (0xe333 bytes) 000535 1769074553.529906 mapwrite 0x0251ea thru 0x032b40 (0xd957 bytes) 000537 1769074553.583980 trunc from 0x03c7a2 to 0x024373 (0x1842e bytes) 000538 1769074553.604744 trunc from 0x024374 to 0x0292b5 (0x4f42 bytes) 000540 1769074553.647484 read 0x00f3f8 thru 0x01182b (0x2434 bytes) 000541 1769074553.668895 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x292b6): Mirror 13: 0xb3cd3ecd (stale) Mirror 15: 0xb3cd3ecd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x292b6): Mirror 13: 0xb3cd3ecd (stale) Mirror 15: 0xb3cd3ecd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x292b6: skipped 000542 1769074554.150051 read 0x026827 thru 0x0292b5 (0x2a8f bytes) 000543 1769074554.156681 mapwrite 0x005413 thru 0x00d8ca (0x84b8 bytes) 000544 1769074554.192824 read 0x014c85 thru 0x01a816 (0x5b92 bytes) 000545 1769074554.201929 mapwrite 0x02b7aa thru 0x0393b4 (0xdc0b bytes) 000546 1769074554.260145 MIRROR_RESYNC 3 mirrors 000547 1769074554.983938 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) 000548 1769074555.260503 mapwrite 0x02b55d thru 0x031343 (0x5de7 bytes) 000549 1769074555.365411 read 0x0160f3 thru 0x022122 (0xc030 bytes) 000550 1769074555.374920 mapwrite 0x03b351 thru 0x03ffff (0x4caf bytes) 000551 1769074555.448811 mapwrite 0x012482 thru 0x020e67 (0xe9e6 bytes) 000552 1769074555.475199 read 0x009b37 thru 0x017ce5 (0xe1af bytes) 000553 1769074555.483642 write 0x021cc1 thru 0x026416 (0x4756 bytes) 000554 1769074555.484859 read 0x03182f thru 0x03d66d (0xbe3f bytes) 000555 1769074555.486054 trunc from 0x021151 to 0x023144 (0x1ff4 bytes) 000556 1769074555.499521 mapread 0x00944a thru 0x00bd9b (0x2952 bytes) 000557 1769074555.500843 read 0x00c64e thru 0x00f8e6 (0x3299 bytes) 000558 1769074555.501499 punch from 0x00cfc6 to 0x018fb2 (0xbfed bytes) 000559 1769074555.507882 read 0x034094 thru 0x0393e4 (0x5351 bytes) 000560 1769074555.512447 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) 000561 1769074555.641870 read 0x0011a5 thru 0x009471 (0x82cd bytes) 000562 1769074555.653382 trunc from 0x040000 to 0x002c0e (0x3d3f1 bytes) 000563 1769074555.677178 punch from 0x000a03 to 0x002c0e (0x220c bytes) 000564 1769074555.687851 MIRROR_EXTEND to 2 mirrors 000565 1769074556.136311 punch from 0x001472 to 0x002c0e (0x179d bytes) 000567 1769074556.188331 write 0x019526 thru 0x01993c (0x417 bytes) 000568 1769074556.193368 read 0x01216c thru 0x017850 (0x56e5 bytes) 000569 1769074556.205087 trunc from 0x01993d to 0x001d7d (0x17bbf bytes) 000570 1769074556.258875 read 0x0005e2 thru 0x001d7d (0x179c bytes) 000571 1769074556.265834 trunc from 0x001d7e to 0x036893 (0x34b16 bytes) 000573 1769074556.279495 mapread 0x0307db thru 0x035143 (0x4969 bytes) 000574 1769074556.291403 trunc from 0x024ba1 to 0x032a7a (0xdeda bytes) 000575 1769074556.296810 mapwrite 0x0294d0 thru 0x033fb3 (0xaae4 bytes) 000576 1769074556.360473 mapread 0x00d4a9 thru 0x01754d (0xa0a5 bytes) 000577 1769074556.361636 mapread 0x01d0aa thru 0x028c4e (0xbba5 bytes) 000578 1769074556.384860 trunc from 0x036894 to 0x03a5f8 (0x3d65 bytes) 000579 1769074556.399099 read 0x019a2f thru 0x026630 (0xcc02 bytes) 000580 1769074556.400426 write 0x0136d3 thru 0x022345 (0xec73 bytes) 000581 1769074556.402348 mapread 0x0374b5 thru 0x03a5f8 (0x3144 bytes) 000582 1769074556.410792 write 0x005933 thru 0x00e476 (0x8b44 bytes) 000583 1769074556.412431 punch from 0x02746d to 0x028f5c (0x1af0 bytes) 000584 1769074556.424176 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) 000586 1769074556.569299 fallocate 0x002ecd thru 0x005063 (0x2197 bytes) 000587 1769074556.575928 trunc from 0x03a5f9 to 0x007f4f (0x326a9 bytes) 000588 1769074556.601809 mapwrite 0x029fb7 thru 0x030f76 (0x6fc0 bytes) 000589 1769074556.645394 mapread 0x01ea56 thru 0x024602 (0x5bad bytes) 000590 1769074556.654030 fallocate 0x03a401 thru 0x03ffff (0x5bff bytes) 000591 1769074556.659380 write 0x026af3 thru 0x028b95 (0x20a3 bytes) 000592 1769074556.661013 mapread 0x00d394 thru 0x014beb (0x7858 bytes) 000593 1769074556.670665 mapwrite 0x026bdc thru 0x02a70d (0x3b32 bytes) 000594 1769074556.685355 read 0x01e764 thru 0x022f42 (0x47df bytes) 000595 1769074556.690122 MIRROR_EXTEND to 2 mirrors 000596 1769074557.196525 fallocate 0x020ef9 thru 0x02a7e9 (0x98f1 bytes) 000598 1769074557.232361 punch from 0x03fb21 to 0x03ffff (0x4df bytes) 000599 1769074557.237834 trunc from 0x040000 to 0x0202c1 (0x1fd3e bytes) 000600 1769074557.285644 trunc from 0x00a232 to 0x011021 (0x6df0 bytes) 000601 1769074557.290887 read 0x01e62a thru 0x0202c1 (0x1c98 bytes) 000602 1769074557.296809 mapread 0x01b404 thru 0x0202c1 (0x4ebe bytes) 000603 1769074557.320601 MIRROR_RESYNC 2 mirrors 000604 1769074557.781889 fallocate 0x021e80 thru 0x024ad2 (0x2c53 bytes) 000605 1769074557.823201 punch from 0x00c196 to 0x018b87 (0xc9f2 bytes) 000606 1769074557.833606 MIRROR_RESYNC 2 mirrors 000607 1769074558.359643 punch from 0x00e7e0 to 0x015bb5 (0x73d6 bytes) 000608 1769074558.397501 write 0x03c236 thru 0x03d0be (0xe89 bytes) 000609 1769074558.399863 write 0x01d5c1 thru 0x01f530 (0x1f70 bytes) 000610 1769074558.417123 fallocate 0x0202c5 thru 0x02e5f8 (0xe334 bytes) 000611 1769074558.424151 mapwrite 0x02b3ec thru 0x03a224 (0xee39 bytes) 000612 1769074558.482424 MIRROR_RESYNC 2 mirrors 000613 1769074559.470978 mapwrite 0x0000c4 thru 0x002017 (0x1f54 bytes) 000615 1769074559.576848 trunc from 0x03d0bf to 0x014593 (0x28b2b bytes) 000616 1769074559.598378 mapread 0x00ce24 thru 0x014593 (0x7770 bytes) 000617 1769074559.607813 punch from 0x008327 to 0x014593 (0xc26d bytes) 000618 1769074559.616624 MIRROR_RESYNC 2 mirrors 000619 1769074560.122110 MIRROR_EXTEND to 3 mirrors 000620 1769074560.780976 fallocate 0x00366d thru 0x00481f (0x11b3 bytes) 000621 1769074560.825929 trunc from 0x00c571 to 0x00f9b0 (0x3440 bytes) 000622 1769074560.830976 trunc from 0x014594 to 0x037b72 (0x235df bytes) 000623 1769074560.891548 MIRROR_RESYNC 3 mirrors 000624 1769074561.521000 write 0x032b8b thru 0x03ee88 (0xc2fe bytes) 000625 1769074561.574428 fallocate 0x021912 thru 0x02bd9c (0xa48b bytes) 000627 1769074561.585734 write 0x031cf5 thru 0x03a41c (0x8728 bytes) 000628 1769074561.603434 read 0x013452 thru 0x01dc3d (0xa7ec bytes) 000629 1769074561.637395 fallocate 0x033182 thru 0x03ffff (0xce7e bytes) 000630 1769074561.644630 trunc from 0x01189c to 0x011de7 (0x54c bytes) 000631 1769074561.657492 mapread 0x00e63f thru 0x01c373 (0xdd35 bytes) 000632 1769074561.679199 punch from 0x02ae72 to 0x032619 (0x77a8 bytes) 000634 1769074561.699061 mapread 0x01a3fd thru 0x020bbd (0x67c1 bytes) 000635 1769074561.721047 mapwrite 0x01e130 thru 0x02c1b7 (0xe088 bytes) 000636 1769074561.773091 MIRROR_RESYNC 3 mirrors 000637 1769074562.649768 write 0x0045fb thru 0x00d220 (0x8c26 bytes) 000638 1769074562.701128 trunc from 0x040000 to 0x01ca71 (0x2358e bytes) 000639 1769074562.749917 read 0x0121cd thru 0x015076 (0x2eaa bytes) 000640 1769074562.758895 mapread 0x017a87 thru 0x018aef (0x1069 bytes) 000641 1769074562.765850 mapwrite 0x031417 thru 0x035f52 (0x4b3c bytes) 000642 1769074562.800905 write 0x02e08f thru 0x032cca (0x4c3c bytes) 000643 1769074562.802189 write 0x0204b0 thru 0x02d27a (0xcdcb bytes) 000644 1769074562.813722 mapread 0x0354d8 thru 0x035f52 (0xa7b bytes) 000645 1769074562.814564 trunc from 0x035f53 to 0x02b88b (0xa6c7 bytes) 000646 1769074562.831730 write 0x02d83c thru 0x03cd24 (0xf4e9 bytes) 000647 1769074562.833511 trunc from 0x000ead to 0x00ee8d (0xdfe1 bytes) 000648 1769074562.844359 mapread 0x013dd6 thru 0x0209c4 (0xcbef bytes) 000649 1769074562.845806 fallocate 0x014c0c thru 0x018595 (0x398a bytes) 000650 1769074562.851330 mapread 0x00d07e thru 0x018128 (0xb0ab bytes) 000651 1769074562.867760 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cd25): Mirror 3: 0xd51ede4a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cd25): Mirror 3: 0xd51ede4a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cd25: skipped 000652 1769074563.139795 read 0x01c5b6 thru 0x01d5df (0x102a bytes) 000653 1769074563.146158 trunc from 0x0064f7 to 0x011566 (0xb070 bytes) 000654 1769074563.150885 punch from 0x019238 to 0x02505a (0xbe23 bytes) 000655 1769074563.157357 mapread 0x00ed38 thru 0x01ec87 (0xff50 bytes) 000656 1769074563.184923 mapwrite 0x01f49a thru 0x020052 (0xbb9 bytes) 000657 1769074563.198145 write 0x01b8bf thru 0x020d50 (0x5492 bytes) 000658 1769074563.204393 trunc from 0x01db30 to 0x0252fa (0x77cb bytes) 000659 1769074563.217153 trunc from 0x03cd25 to 0x024b39 (0x181eb bytes) 000660 1769074563.230130 write 0x033014 thru 0x03ecd1 (0xbcbe bytes) 000661 1769074563.236859 fallocate 0x0072bc thru 0x007599 (0x2de bytes) 000663 1769074563.246285 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3ecd2): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ecd2): Mirror 3: 0xab642dfa (stale) CRC-32 checksum value for chunk [0, 0x3ecd2): Mirror 1: 0xe15e6d30 Mirror 4: 0xe15e6d30 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ecd2: skipped 000664 1769074564.105951 mapread 0x039a6b thru 0x03ecd1 (0x5267 bytes) 000665 1769074564.147184 mapread 0x033239 thru 0x03ab79 (0x7941 bytes) 000666 1769074564.169137 trunc from 0x03ecd2 to 0x0072ca (0x37a07 bytes) 000667 1769074564.246052 mapread 0x000f64 thru 0x0072ca (0x6367 bytes) 000668 1769074564.254125 fallocate 0x03c873 thru 0x03ffff (0x378d bytes) 000669 1769074564.259041 mapwrite 0x007587 thru 0x0104cd (0x8f47 bytes) 000670 1769074564.282967 fallocate 0x025bb1 thru 0x03372d (0xdb7d bytes) 000671 1769074564.287737 mapread 0x017bb7 thru 0x0267ff (0xec49 bytes) 000672 1769074564.302814 trunc from 0x040000 to 0x027090 (0x18f6f bytes) 000673 1769074564.320121 mapread 0x026c64 thru 0x027090 (0x42d bytes) 000674 1769074564.321855 punch from 0x015b55 to 0x020b70 (0xb01c bytes) 000675 1769074564.327489 fallocate 0x037fe8 thru 0x03aa36 (0x2a4f bytes) 000676 1769074564.331749 fallocate 0x01d551 thru 0x022883 (0x5333 bytes) 000677 1769074564.336323 punch from 0x025535 to 0x027090 (0x1b5c bytes) 000678 1769074564.341618 trunc from 0x027091 to 0x004926 (0x2276a bytes) 000679 1769074564.363288 trunc from 0x004927 to 0x025682 (0x20d5c bytes) 000680 1769074564.379215 write 0x03609b thru 0x038363 (0x22c9 bytes) 000681 1769074564.380602 mapwrite 0x011f9c thru 0x0182bf (0x6324 bytes) 000682 1769074564.405682 trunc from 0x038364 to 0x01e6d9 (0x19c8a bytes) 000683 1769074564.420567 punch from 0x00d266 to 0x01c6a2 (0xf43d bytes) 000684 1769074564.427164 write 0x021353 thru 0x0248bc (0x356a bytes) 000685 1769074564.428425 read 0x01cd4e thru 0x0248bc (0x7b6f bytes) 000686 1769074564.437959 trunc from 0x0248bd to 0x01d258 (0x7664 bytes) 000687 1769074564.458360 trunc from 0x0192f4 to 0x01d258 (0x3f65 bytes) 000688 1769074564.464211 punch from 0x011909 to 0x015166 (0x385e bytes) 000689 1769074564.469335 trunc from 0x01d259 to 0x033a11 (0x167b9 bytes) 000690 1769074564.488902 read 0x004caa thru 0x00671f (0x1a76 bytes) 000691 1769074564.503686 trunc from 0x033a12 to 0x00b25d (0x287b4 bytes) 000693 1769074564.529864 fallocate 0x0030eb thru 0x00739c (0x42b2 bytes) 000694 1769074564.537372 read 0x005a49 thru 0x005cbb (0x273 bytes) 000695 1769074564.538205 mapread 0x007856 thru 0x008826 (0xfd1 bytes) 000697 1769074564.541328 trunc from 0x009d16 to 0x00b25d (0x1548 bytes) 000698 1769074564.546355 trunc from 0x00b25e to 0x037a11 (0x2c7b4 bytes) 000699 1769074564.564930 trunc from 0x037a12 to 0x024657 (0x133ba bytes) 000701 1769074564.584106 trunc from 0x004eff to 0x00fa51 (0xab53 bytes) 000702 1769074564.591068 read 0x0126d0 thru 0x01d3de (0xad0f bytes) 000704 1769074564.614883 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x24658): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24658): Mirror 3: 0xf44498b4 (stale) Mirror 4: 0xf74de0ac (stale) CRC-32 checksum value for chunk [0, 0x24658): Mirror 1: 0x15787f3b Mirror 5: 0x15787f3b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24658: skipped 000705 1769074566.208721 read 0x022bb7 thru 0x024657 (0x1aa1 bytes) 000707 1769074566.236501 punch from 0x023de9 to 0x024657 (0x86f bytes) 000708 1769074566.286094 write 0x008f7f thru 0x012c6b (0x9ced bytes) 000709 1769074566.307613 mapread 0x011ab3 thru 0x020c9d (0xf1eb bytes) 000710 1769074566.363178 trunc from 0x024658 to 0x025ee1 (0x188a bytes) 000711 1769074566.406149 mapread 0x022fc8 thru 0x025ee1 (0x2f1a bytes) 000713 1769074566.423657 write 0x00ebc6 thru 0x01c4ab (0xd8e6 bytes) 000714 1769074566.429207 mapread 0x0020b0 thru 0x0113c0 (0xf311 bytes) 000715 1769074566.447049 trunc from 0x025ee2 to 0x032ac4 (0xcbe3 bytes) 000716 1769074566.487700 mapwrite 0x02eff9 thru 0x03d06f (0xe077 bytes) 000717 1769074566.647572 MIRROR_RESYNC 4 mirrors 000718 1769074567.938005 read 0x013276 thru 0x01c444 (0x91cf bytes) 000719 1769074567.949995 trunc from 0x03d070 to 0x00e6b9 (0x2e9b6 bytes) 000720 1769074567.993630 fallocate 0x008434 thru 0x017cfb (0xf8c8 bytes) 000721 1769074567.998886 trunc from 0x00b30f to 0x00e6b9 (0x33ab bytes) 000722 1769074568.006154 write 0x016d3a thru 0x022cbe (0xbf85 bytes) 000723 1769074568.008077 trunc from 0x0083f3 to 0x01222e (0x9e3c bytes) 000724 1769074568.016178 trunc from 0x022cbf to 0x006560 (0x1c75e bytes) 000725 1769074568.051220 mapwrite 0x039877 thru 0x03ffff (0x6789 bytes) 000726 1769074568.115760 mapread 0x039131 thru 0x03ffff (0x6ecf bytes) 000727 1769074568.119268 trunc from 0x040000 to 0x022333 (0x1dccc bytes) 000728 1769074568.144158 trunc from 0x022334 to 0x02e9ab (0xc678 bytes) 000729 1769074568.171597 write 0x002b09 thru 0x010315 (0xd80d bytes) 000732 1769074568.196018 MIRROR_RESYNC 4 mirrors 000733 1769074568.953792 write 0x026363 thru 0x0296ed (0x338b bytes) 000734 1769074568.993717 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e9ac): Mirror 4: 0xaafb2919 (stale) Mirror 5: 0xaafb2919 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e9ac): Mirror 4: 0xaafb2919 (stale) Mirror 5: 0xaafb2919 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e9ac: skipped 000735 1769074569.353782 trunc from 0x02e9ac to 0x010832 (0x1e179 bytes) 000736 1769074569.386288 punch from 0x000520 to 0x00c9ad (0xc48e bytes) 000737 1769074569.394006 read 0x00844c thru 0x00f894 (0x7449 bytes) 000738 1769074569.403653 punch from 0x00e1a2 to 0x010832 (0x2691 bytes) 000739 1769074569.411161 punch from 0x007e6e to 0x00f527 (0x76ba bytes) 000740 1769074569.417804 trunc from 0x010833 to 0x03e595 (0x2dd63 bytes) 000741 1769074569.437367 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3e596): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e596): Mirror 4: 0xe897ae6 (stale) Mirror 5: 0xe897ae6 (stale) CRC-32 checksum value for chunk [0, 0x3e596): Mirror 1: 0x7ef0b2ed Mirror 6: 0x7ef0b2ed lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e596: skipped 000744 1769074570.239776 fallocate 0x0164a7 thru 0x021e9f (0xb9f9 bytes) 000745 1769074570.317105 punch from 0x0136cf to 0x01be55 (0x8787 bytes) 000746 1769074570.326088 trunc from 0x022059 to 0x02f986 (0xd92e bytes) 000747 1769074570.335223 mapread 0x010981 thru 0x011c92 (0x1312 bytes) 000748 1769074570.352484 punch from 0x0365b6 to 0x03e595 (0x7fe0 bytes) 000750 1769074570.362169 fallocate 0x010a72 thru 0x013d0d (0x329c bytes) 000751 1769074570.372593 write 0x00b5b9 thru 0x0157ba (0xa202 bytes) 000752 1769074570.404819 write 0x016072 thru 0x020a02 (0xa991 bytes) 000754 1769074570.423955 trunc from 0x03e596 to 0x035218 (0x937d bytes) 000755 1769074570.486993 write 0x00d7b0 thru 0x017004 (0x9855 bytes) 000756 1769074570.488477 mapwrite 0x0302e2 thru 0x036f75 (0x6c94 bytes) 000757 1769074570.556967 fallocate 0x0105b5 thru 0x01c162 (0xbbae bytes) 000758 1769074570.564991 mapwrite 0x003a4e thru 0x005b30 (0x20e3 bytes) 000759 1769074570.593430 MIRROR_RESYNC 4 mirrors 000760 1769074572.293213 trunc from 0x003b88 to 0x00a8fb (0x6d74 bytes) 000761 1769074572.335165 write 0x034722 thru 0x035179 (0xa58 bytes) 000762 1769074572.345368 read 0x0236e5 thru 0x02e9e5 (0xb301 bytes) 000763 1769074572.357508 read 0x013509 thru 0x01b9e3 (0x84db bytes) 000764 1769074572.368423 trunc from 0x036f76 to 0x01b0ca (0x1beab bytes) 000765 1769074572.390566 read 0x011899 thru 0x015b37 (0x429f bytes) 000766 1769074572.392482 mapwrite 0x01e9a6 thru 0x020edf (0x253a bytes) 000767 1769074572.434029 read 0x018689 thru 0x020edf (0x8857 bytes) 000768 1769074572.435178 read 0x01c975 thru 0x020edf (0x456b bytes) 000769 1769074572.435942 trunc from 0x020ee0 to 0x003d5b (0x1d184 bytes) 000771 1769074572.463847 mapread 0x000e17 thru 0x003d5b (0x2f45 bytes) 000772 1769074572.464583 mapread 0x002ca5 thru 0x003d5b (0x10b7 bytes) 000773 1769074572.465291 read 0x003a0f thru 0x003d5b (0x34d bytes) 000774 1769074572.466816 trunc from 0x003d5c to 0x034719 (0x309be bytes) 000775 1769074572.487193 mapread 0x00a75e thru 0x018e1f (0xe6c2 bytes) 000776 1769074572.502976 mapwrite 0x01f2e8 thru 0x022c7c (0x3995 bytes) 000778 1769074572.519840 fallocate 0x00d4b6 thru 0x01bffe (0xeb49 bytes) 000780 1769074572.524922 mapwrite 0x0058fd thru 0x01282e (0xcf32 bytes) 000781 1769074572.548924 mapwrite 0x0293c6 thru 0x02c219 (0x2e54 bytes) 000782 1769074572.561765 punch from 0x01555b to 0x016047 (0xaed bytes) 000783 1769074572.565023 fallocate 0x032cf5 thru 0x03ffff (0xd30b bytes) 000784 1769074572.570823 punch from 0x024dd3 to 0x03342a (0xe658 bytes) 000785 1769074572.577894 write 0x029ff1 thru 0x02c1e6 (0x21f6 bytes) 000786 1769074572.594218 trunc from 0x0087ed to 0x01719e (0xe9b2 bytes) 000787 1769074572.600445 write 0x00e441 thru 0x00f306 (0xec6 bytes) 000788 1769074572.612689 trunc from 0x040000 to 0x015e78 (0x2a187 bytes) 000789 1769074572.630002 trunc from 0x015e79 to 0x002a7d (0x133fb bytes) 000790 1769074572.646168 mapwrite 0x027de2 thru 0x029430 (0x164f bytes) 000791 1769074572.701918 punch from 0x00f59c to 0x010897 (0x12fc bytes) 000792 1769074572.711010 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29431): Mirror 4: 0x514972d2 (stale) Mirror 5: 0x514972d2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29431): Mirror 4: 0x514972d2 (stale) Mirror 5: 0x514972d2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29431: skipped 000793 1769074572.982454 mapread 0x004903 thru 0x00dcdd (0x93db bytes) 000794 1769074573.004584 write 0x03f61c thru 0x03ffff (0x9e4 bytes) 000795 1769074573.013565 punch from 0x018ea3 to 0x024541 (0xb69f bytes) 000796 1769074573.018177 read 0x017dd7 thru 0x020562 (0x878c bytes) 000797 1769074573.027075 mapread 0x03b004 thru 0x03ffff (0x4ffc bytes) 000798 1769074573.038776 trunc from 0x040000 to 0x02a06c (0x15f93 bytes) 000799 1769074573.056788 punch from 0x01f397 to 0x02a06c (0xacd6 bytes) 000800 1769074573.065957 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2a06d): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a06d): Mirror 4: 0x9c7e113d (stale) Mirror 5: 0x9c7e113d (stale) CRC-32 checksum value for chunk [0, 0x2a06d): Mirror 1: 0x7964d566 Mirror 6: 0x7964d566 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a06d: skipped 000801 1769074573.787530 mapread 0x005e7e thru 0x014c0a (0xed8d bytes) 000802 1769074573.866070 trunc from 0x02a06d to 0x03c9b8 (0x1294c bytes) 000803 1769074574.014363 read 0x0063d0 thru 0x00ea2e (0x865f bytes) 000804 1769074574.037283 MIRROR_RESYNC 4 mirrors 000805 1769074575.179311 fallocate 0x0121aa thru 0x02065b (0xe4b2 bytes) 000806 1769074575.237974 mapwrite 0x03b28a thru 0x03f62b (0x43a2 bytes) 000807 1769074575.335986 mapwrite 0x009957 thru 0x0178ea (0xdf94 bytes) 000808 1769074575.378478 read 0x006e08 thru 0x0074fd (0x6f6 bytes) 000809 1769074575.379167 mapwrite 0x033e93 thru 0x03ffff (0xc16d bytes) 000811 1769074575.447486 fallocate 0x029a99 thru 0x02fa60 (0x5fc8 bytes) 000812 1769074575.455386 trunc from 0x040000 to 0x018624 (0x279db bytes) 000813 1769074575.480877 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x18625): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18625): Mirror 4: 0xe925da2 (stale) Mirror 5: 0xe925da2 (stale) Mirror 6: 0xe925da2 (stale) CRC-32 checksum value for chunk [0, 0x18625): Mirror 1: 0x7424935b Mirror 7: 0x7424935b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18625: skipped 000814 1769074576.372897 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18625): Mirror 4: 0xe925da2 (stale) Mirror 6: 0xe925da2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18625): Mirror 4: 0xe925da2 (stale) Mirror 6: 0xe925da2 (stale) CRC-32 checksum value for chunk [0, 0x18625): Mirror 1: 0x7424935b Mirror 7: 0x7424935b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18625: skipped 000815 1769074576.974891 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x18625): Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18625): Mirror 4: 0xe925da2 (stale) Mirror 6: 0xe925da2 (stale) CRC-32 checksum value for chunk [0, 0x18625): Mirror 1: 0x7424935b Mirror 7: 0x7424935b Mirror 8: 0x7424935b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18625: skipped 000816 1769074577.842670 mapwrite 0x00fbd0 thru 0x019d2a (0xa15b bytes) 000818 1769074577.967611 write 0x0130c6 thru 0x015d34 (0x2c6f bytes) 000819 1769074577.969508 write 0x006061 thru 0x015806 (0xf7a6 bytes) 000820 1769074577.983616 mapread 0x00c051 thru 0x015836 (0x97e6 bytes) 000821 1769074577.985944 fallocate 0x029c35 thru 0x035e8f (0xc25b bytes) 000822 1769074577.999159 mapread 0x02cd28 thru 0x02d072 (0x34b bytes) 000823 1769074578.016641 mapread 0x028a9d thru 0x035e8f (0xd3f3 bytes) 000824 1769074578.037584 MIRROR_RESYNC 5 mirrors 000826 1769074579.464697 mapwrite 0x0149b9 thru 0x022192 (0xd7da bytes) 000827 1769074579.663110 write 0x014186 thru 0x01a5ef (0x646a bytes) 000828 1769074579.671944 punch from 0x00ab22 to 0x010b63 (0x6042 bytes) 000829 1769074579.685847 read 0x00d98a thru 0x014a1f (0x7096 bytes) 000830 1769074579.699315 write 0x03ab2f thru 0x03bddc (0x12ae bytes) 000831 1769074579.703934 trunc from 0x03bddd to 0x013697 (0x28745 bytes) 000832 1769074579.760973 write 0x00cbf2 thru 0x012f80 (0x638f bytes) 000833 1769074579.784606 mapwrite 0x00a2b8 thru 0x00dc92 (0x39db bytes) 000835 1769074579.823504 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x13698): Mirror 4: 0xe3acf129 (stale) Mirror 6: 0xe3acf129 (stale) Mirror 7: 0xe3acf129 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13698): Mirror 4: 0xe3acf129 (stale) Mirror 6: 0xe3acf129 (stale) Mirror 7: 0xe3acf129 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13698: skipped 000836 1769074580.384514 fallocate 0x02047d thru 0x028824 (0x83a8 bytes) 000837 1769074580.390513 mapread 0x00f658 thru 0x013697 (0x4040 bytes) 000838 1769074580.414290 MIRROR_RESYNC 4 mirrors 000840 1769074581.594829 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) 000842 1769074581.922795 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) 000843 1769074582.246942 MIRROR_RESYNC 2 mirrors 000844 1769074582.616006 trunc from 0x013698 to 0x01dc7a (0xa5e3 bytes) 000845 1769074582.727908 trunc from 0x01b905 to 0x01dc7a (0x2376 bytes) 000846 1769074582.734009 fallocate 0x0304d3 thru 0x03231c (0x1e4a bytes) 000847 1769074582.742092 punch from 0x010422 to 0x01bcc9 (0xb8a8 bytes) 000848 1769074582.750088 fallocate 0x03afc6 thru 0x03ffff (0x503a bytes) 000849 1769074582.761028 write 0x00d8d9 thru 0x00e493 (0xbbb bytes) 000850 1769074582.788048 trunc from 0x003eda to 0x00ffb1 (0xc0d8 bytes) 000851 1769074582.803838 write 0x00e3bc thru 0x014cdf (0x6924 bytes) 000852 1769074582.817036 mapwrite 0x03f420 thru 0x03ffff (0xbe0 bytes) 000853 1769074582.847406 mapread 0x005fa2 thru 0x00882e (0x288d bytes) 000854 1769074582.873178 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x7f2a8d2b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3ff22189 Mirror 5: 0x3ff22189 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000855 1769074583.770545 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x7f2a8d2b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3ff22189 Mirror 5: 0x3ff22189 Mirror 6: 0x3ff22189 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000856 1769074584.412899 write 0x0260e0 thru 0x033b63 (0xda84 bytes) 000857 1769074584.464546 read 0x01cbb5 thru 0x02c0c8 (0xf514 bytes) 000858 1769074584.473305 fallocate 0x02e106 thru 0x0335e4 (0x54df bytes) 000859 1769074584.479312 write 0x0195b0 thru 0x0267de (0xd22f bytes) 000860 1769074584.495918 MIRROR_RESYNC 4 mirrors 000861 1769074585.892494 mapwrite 0x00f45d thru 0x017534 (0x80d8 bytes) 000862 1769074586.075287 read 0x01445c thru 0x01d776 (0x931b bytes) 000863 1769074586.114219 MIRROR_RESYNC 4 mirrors 000864 1769074587.111138 write 0x0390d8 thru 0x03e8cc (0x57f5 bytes) 000865 1769074587.160461 trunc from 0x01684a to 0x0254c2 (0xec79 bytes) 000867 1769074587.166782 trunc from 0x039ccf to 0x03ffff (0x6331 bytes) 000868 1769074587.178172 fallocate 0x030f22 thru 0x0343c2 (0x34a1 bytes) 000869 1769074587.183018 trunc from 0x040000 to 0x007188 (0x38e77 bytes) 000870 1769074587.225433 punch from 0x00368f to 0x00616a (0x2adc bytes) 000871 1769074587.232182 mapread 0x002e42 thru 0x004852 (0x1a11 bytes) 000872 1769074587.241372 trunc from 0x007189 to 0x01cb4a (0x159c2 bytes) 000874 1769074587.260804 punch from 0x0079ec to 0x00c86e (0x4e83 bytes) 000875 1769074587.265976 mapwrite 0x033921 thru 0x03ffff (0xc6df bytes) 000876 1769074587.319414 punch from 0x0187d1 to 0x01e394 (0x5bc4 bytes) 000877 1769074587.323771 mapread 0x00247d thru 0x00e9a0 (0xc524 bytes) 000878 1769074587.331779 fallocate 0x015f22 thru 0x016735 (0x814 bytes) 000879 1769074587.336866 trunc from 0x0313ca to 0x03d56b (0xc1a2 bytes) 000881 1769074587.342993 trunc from 0x0196fe to 0x01da05 (0x4308 bytes) 000882 1769074587.351806 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x4f403f8b (stale) Mirror 6: 0x4f403f8b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x4f403f8b (stale) Mirror 6: 0x4f403f8b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000883 1769074587.629902 trunc from 0x040000 to 0x01b1b3 (0x24e4c bytes) 000884 1769074587.666641 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b1b4): Mirror 6: 0xb13fbb8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b1b4): Mirror 6: 0xb13fbb8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b1b4: skipped 000885 1769074588.074772 trunc from 0x01b1b4 to 0x0048a7 (0x1690c bytes) 000886 1769074588.102955 mapwrite 0x0027f6 thru 0x00cd3a (0xa545 bytes) 000887 1769074588.234030 punch from 0x008bcc to 0x009138 (0x56d bytes) 000888 1769074588.244946 write 0x027d26 thru 0x0362fc (0xe5d7 bytes) 000889 1769074588.246744 punch from 0x025d1d to 0x02d81f (0x7b03 bytes) 000890 1769074588.279669 read 0x02e63e thru 0x0308fc (0x22bf bytes) 000891 1769074588.290140 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x362fd): Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x362fd): Mirror 6: 0x873b96e3 (stale) CRC-32 checksum value for chunk [0, 0x362fd): Mirror 1: 0x6ddf713 Mirror 7: 0x6ddf713 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x362fd: skipped 000892 1769074589.155474 mapread 0x00ae88 thru 0x016748 (0xb8c1 bytes) 000893 1769074589.213473 read 0x002920 thru 0x0079f0 (0x50d1 bytes) 000894 1769074589.270440 read 0x0039c0 thru 0x012f27 (0xf568 bytes) 000895 1769074589.280113 mapread 0x02d2c8 thru 0x030e72 (0x3bab bytes) 000896 1769074589.309809 read 0x02082e thru 0x02ab49 (0xa31c bytes) 000897 1769074589.324781 punch from 0x02b5f6 to 0x0362fc (0xad07 bytes) 000899 1769074589.382828 write 0x02f1c8 thru 0x03499a (0x57d3 bytes) 000900 1769074589.401788 trunc from 0x0362fd to 0x011456 (0x24ea6 bytes) 000901 1769074589.449351 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x11457): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11457): Mirror 6: 0x98ecbd06 (stale) Mirror 7: 0x24978d52 (stale) CRC-32 checksum value for chunk [0, 0x11457): Mirror 1: 0x24978d52 Mirror 8: 0x24978d52 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11457: skipped 000904 1769074590.198878 punch from 0x0011f1 to 0x00147f (0x28f bytes) 000905 1769074590.237294 punch from 0x00cd2a to 0x010ed3 (0x41aa bytes) 000906 1769074590.246676 trunc from 0x011457 to 0x027ad4 (0x1667e bytes) 000907 1769074590.271610 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x27ad5): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27ad5): Mirror 6: 0x33280450 (stale) Mirror 7: 0xbb884ead (stale) Mirror 8: 0xbb884ead (stale) CRC-32 checksum value for chunk [0, 0x27ad5): Mirror 1: 0xee29ddec Mirror 9: 0xee29ddec lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27ad5: skipped 000908 1769074591.387095 trunc from 0x00f9ed to 0x01902c (0x9640 bytes) 000909 1769074591.484760 mapread 0x00c239 thru 0x014bfc (0x89c4 bytes) 000910 1769074591.524761 fallocate 0x01a317 thru 0x029343 (0xf02d bytes) 000911 1769074591.535375 punch from 0x014f95 to 0x018fc8 (0x4034 bytes) 000913 1769074591.544941 punch from 0x026a3c to 0x028d49 (0x230e bytes) 000914 1769074591.561536 read 0x01e4ad thru 0x026681 (0x81d5 bytes) 000915 1769074591.576229 MIRROR_RESYNC 5 mirrors 000916 1769074592.837204 mapwrite 0x031d98 thru 0x038aa5 (0x6d0e bytes) 000917 1769074592.935029 trunc from 0x032f16 to 0x03314f (0x23a bytes) 000918 1769074592.950677 MIRROR_RESYNC 5 mirrors 000919 1769074594.784365 mapread 0x013156 thru 0x014496 (0x1341 bytes) 000920 1769074594.795382 trunc from 0x011d76 to 0x016f12 (0x519d bytes) 000921 1769074594.827469 mapwrite 0x0035ed thru 0x00b6c4 (0x80d8 bytes) 000922 1769074594.847898 fallocate 0x00d46d thru 0x017c71 (0xa805 bytes) 000923 1769074594.852418 mapwrite 0x0256fd thru 0x02abad (0x54b1 bytes) 000924 1769074594.873594 mapwrite 0x03bb4b thru 0x03ffff (0x44b5 bytes) 000925 1769074594.932818 trunc from 0x039d54 to 0x03ad0a (0xfb7 bytes) 000926 1769074594.946787 trunc from 0x0052b2 to 0x010ac3 (0xb812 bytes) 000927 1769074594.953832 trunc from 0x030a2c to 0x03518d (0x4762 bytes) 000928 1769074594.965047 read 0x0329cb thru 0x03ffff (0xd635 bytes) 000929 1769074594.977817 punch from 0x00e294 to 0x017487 (0x91f4 bytes) 000930 1769074594.983887 read 0x014c96 thru 0x018eac (0x4217 bytes) 000931 1769074594.996842 trunc from 0x040000 to 0x03d8a1 (0x275e bytes) 000933 1769074595.015073 trunc from 0x02f809 to 0x03d8a1 (0xe099 bytes) 000934 1769074595.039448 MIRROR_RESYNC 5 mirrors 000935 1769074596.139337 trunc from 0x01e286 to 0x02b24e (0xcfc9 bytes) 000936 1769074596.169771 mapread 0x010752 thru 0x01b290 (0xab3f bytes) 000937 1769074596.203655 mapwrite 0x01f29d thru 0x02be26 (0xcb8a bytes) 000938 1769074596.240201 mapwrite 0x00b409 thru 0x019216 (0xde0e bytes) 000939 1769074596.260224 mapread 0x0031f8 thru 0x0122c5 (0xf0ce bytes) 000940 1769074596.268115 read 0x00741b thru 0x00933f (0x1f25 bytes) 000941 1769074596.268696 read 0x02caf0 thru 0x03a88a (0xdd9b bytes) 000942 1769074596.282600 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3d8a2): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d8a2): Mirror 6: 0x554f3118 (stale) Mirror 7: 0x554f3118 (stale) Mirror 8: 0x554f3118 (stale) Mirror 9: 0x554f3118 (stale) CRC-32 checksum value for chunk [0, 0x3d8a2): Mirror 1: 0x96e78808 Mirror 10: 0x96e78808 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d8a2: skipped 000943 1769074597.258865 trunc from 0x03d8a2 to 0x03fa53 (0x21b2 bytes) 000944 1769074597.393690 mapread 0x036f49 thru 0x03fa53 (0x8b0b bytes) 000945 1769074597.428380 punch from 0x023be0 to 0x02c112 (0x8533 bytes) 000946 1769074597.434372 mapwrite 0x003925 thru 0x01373c (0xfe18 bytes) 000947 1769074597.519740 read 0x02d1ed thru 0x03a406 (0xd21a bytes) 000948 1769074597.530288 read 0x003058 thru 0x0031a9 (0x152 bytes) 000950 1769074597.544675 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3fa54): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fa54): Mirror 6: 0xeeea551b (stale) Mirror 7: 0xeeea551b (stale) Mirror 8: 0xeeea551b (stale) Mirror 9: 0xeeea551b (stale) Mirror 10: 0x559e2ad8 (stale) CRC-32 checksum value for chunk [0, 0x3fa54): Mirror 1: 0xec5a672d Mirror 11: 0xec5a672d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fa54: skipped 000951 1769074598.787087 fallocate 0x02b966 thru 0x0399e4 (0xe07f bytes) 000952 1769074598.817147 punch from 0x03b9f9 to 0x03fa53 (0x405b bytes) 000953 1769074598.820939 fallocate 0x01580e thru 0x021d1c (0xc50f bytes) 000954 1769074598.826131 punch from 0x02e9a7 to 0x03166a (0x2cc4 bytes) 000955 1769074598.830189 trunc from 0x024d0d to 0x0345b7 (0xf8ab bytes) 000956 1769074598.835567 read 0x031ec9 thru 0x03fa53 (0xdb8b bytes) 000957 1769074598.842764 read 0x01efb1 thru 0x01f8a0 (0x8f0 bytes) 000958 1769074598.853725 fallocate 0x000d45 thru 0x00255f (0x181b bytes) 000959 1769074598.860818 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fa54): Mirror 6: 0xeeea551b (stale) Mirror 7: 0xeeea551b (stale) Mirror 8: 0xeeea551b (stale) Mirror 10: 0x559e2ad8 (stale) Mirror 11: 0xec5a672d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fa54): Mirror 6: 0xeeea551b (stale) Mirror 7: 0xeeea551b (stale) Mirror 8: 0xeeea551b (stale) Mirror 10: 0x559e2ad8 (stale) Mirror 11: 0xec5a672d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fa54: skipped 000963 1769074599.291670 MIRROR_RESYNC 6 mirrors 000964 1769074600.890585 trunc from 0x01baee to 0x02a6bd (0xebd0 bytes) 000965 1769074600.928631 punch from 0x02167d to 0x02520d (0x3b91 bytes) 000966 1769074600.936034 read 0x0113e9 thru 0x01250a (0x1122 bytes) 000967 1769074600.940965 read 0x0268fa thru 0x035ca6 (0xf3ad bytes) 000968 1769074600.951622 mapread 0x00d125 thru 0x01b2b9 (0xe195 bytes) 000969 1769074600.953316 trunc from 0x03fa54 to 0x00b8c0 (0x34193 bytes) 000970 1769074600.970111 trunc from 0x00b8c1 to 0x008d3c (0x2b84 bytes) 000971 1769074600.991114 read 0x001344 thru 0x0053fd (0x40ba bytes) 000972 1769074600.992117 trunc from 0x002c2d to 0x008d3c (0x6110 bytes) 000973 1769074601.001680 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x8d3d): Mirror 6: 0xf5e916b9 (stale) Mirror 8: 0xf5e916b9 (stale) Mirror 10: 0xf5e916b9 (stale) Mirror 11: 0xf5e916b9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8d3d): Mirror 6: 0xf5e916b9 (stale) Mirror 8: 0xf5e916b9 (stale) Mirror 10: 0xf5e916b9 (stale) Mirror 11: 0xf5e916b9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8d3d: skipped 000974 1769074601.429890 trunc from 0x008d3d to 0x009054 (0x318 bytes) 000975 1769074601.472114 trunc from 0x009055 to 0x024013 (0x1afbf bytes) 000976 1769074601.501280 read 0x011405 thru 0x01ab84 (0x9780 bytes) 000977 1769074601.513829 read 0x012f80 thru 0x01839d (0x541e bytes) 000979 1769074601.514735 fallocate 0x0138e9 thru 0x01894e (0x5066 bytes) 000980 1769074601.519997 trunc from 0x024014 to 0x03e937 (0x1a924 bytes) 000981 1769074601.540699 write 0x013ea3 thru 0x01893e (0x4a9c bytes) 000982 1769074601.541851 read 0x0041d6 thru 0x00a102 (0x5f2d bytes) 000983 1769074601.568812 mapread 0x00302d thru 0x012806 (0xf7da bytes) 000984 1769074601.569932 mapread 0x03a0bf thru 0x03e937 (0x4879 bytes) 000985 1769074601.572626 mapwrite 0x03b55d thru 0x03ffff (0x4aa3 bytes) 000986 1769074601.635060 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x3f5c997c (stale) Mirror 8: 0x3f5c997c (stale) Mirror 10: 0x3f5c997c (stale) Mirror 11: 0x3f5c997c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x74f75a9e Mirror 12: 0x74f75a9e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000987 1769074602.681053 read 0x01a793 thru 0x01ff90 (0x57fe bytes) 000989 1769074602.706983 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x3f5c997c (stale) Mirror 10: 0x3f5c997c (stale) Mirror 11: 0x3f5c997c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x3f5c997c (stale) Mirror 10: 0x3f5c997c (stale) Mirror 11: 0x3f5c997c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x74f75a9e Mirror 12: 0x74f75a9e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000990 1769074603.584201 read 0x0002f5 thru 0x00a582 (0xa28e bytes) 000991 1769074603.613929 trunc from 0x040000 to 0x00859a (0x37a65 bytes) 000992 1769074603.704631 write 0x03de95 thru 0x03ffff (0x216b bytes) 000993 1769074603.705900 mapwrite 0x00ec5e thru 0x017c2c (0x8fcf bytes) 000994 1769074603.778225 write 0x02bece thru 0x03b1b0 (0xf2e3 bytes) 000995 1769074603.819467 mapwrite 0x0036a6 thru 0x00e91f (0xb27a bytes) 000996 1769074603.859329 punch from 0x02c776 to 0x02ea53 (0x22de bytes) 000997 1769074603.866450 trunc from 0x040000 to 0x01ce1a (0x231e5 bytes) 000998 1769074603.907439 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x1a9:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ce1b): Mirror 10: 0xa8d1e9ee (stale) Mirror 11: 0xa8d1e9ee (stale) Mirror 12: 0x36d1cbed (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ce1b): Mirror 10: 0xa8d1e9ee (stale) Mirror 11: 0xa8d1e9ee (stale) Mirror 12: 0x36d1cbed (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ce1b: skipped 000999 1769074604.644116 fallocate 0x00ae63 thru 0x00af27 (0xc5 bytes) 001000 1769074604.655996 write 0x00e750 thru 0x01a2be (0xbb6f bytes) All operations completed A-OK!