== sanity-flr test 70a: flr mode fsx test ================ 02:00:11 (1790920811) Seed set to 814 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x6162 000003 1790920814.390832 trunc from 00000000 to 0x006161 (0x6162 bytes) truncating to largest ever: 0x39844 000005 1790920814.418137 trunc from 0x006162 to 0x039843 (0x336e2 bytes) 000010 1790920814.439279 trunc from 0x039844 to 0x034cba (0x4b89 bytes) 000011 1790920814.454829 write 0x03417c thru 0x03de35 (0x9cba bytes) 000014 1790920814.469526 mapread 0x00dd15 thru 0x01164d (0x3939 bytes) 000015 1790920814.491890 trunc from 0x03de36 to 0x0317e7 (0xc64e bytes) 000017 1790920814.516319 read 0x013476 thru 0x021a17 (0xe5a2 bytes) 000018 1790920814.527294 trunc from 0x0317e8 to 0x03546e (0x3c87 bytes) 000021 1790920814.554122 trunc from 0x03546f to 0x024087 (0x113e7 bytes) 000022 1790920814.580356 trunc from 0x024088 to 0x008668 (0x1ba1f bytes) 000024 1790920814.602774 trunc from 0x008669 to 0x02bc5f (0x235f7 bytes) 000026 1790920814.623372 punch from 0x027cfc to 0x02bc5f (0x3f64 bytes) 000027 1790920814.628819 punch from 0x01c7af to 0x0270c3 (0xa915 bytes) 000028 1790920814.634834 punch from 0x00960e to 0x00cbef (0x35e2 bytes) 000032 1790920814.648338 MIRROR_EXTEND to 2 mirrors 000033 1790920815.822072 write 0x0373e8 thru 0x03ffff (0x8c18 bytes) 000034 1790920815.915050 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xde4fcf71 Mirror 3: 0xde4fcf71 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000036 1790920817.294683 mapwrite 0x039e29 thru 0x03a4a0 (0x678 bytes) 000037 1790920817.702871 read 0x01f30e thru 0x0202b2 (0xfa5 bytes) 000038 1790920817.735078 mapwrite 0x020a51 thru 0x02598b (0x4f3b bytes) 000042 1790920817.912343 write 0x026590 thru 0x034a73 (0xe4e4 bytes) 000045 1790920817.926255 mapwrite 0x003a5f thru 0x00886f (0x4e11 bytes) 000048 1790920818.124011 mapread 0x0314de thru 0x034782 (0x32a5 bytes) 000049 1790920818.127407 mapwrite 0x00e458 thru 0x00e488 (0x31 bytes) 000050 1790920818.260498 mapwrite 0x017273 thru 0x01fd33 (0x8ac1 bytes) 000052 1790920818.422468 write 0x00446e thru 0x004fd0 (0xb63 bytes) 000053 1790920818.425052 mapwrite 0x01019b thru 0x01b42d (0xb293 bytes) 000054 1790920818.504716 mapwrite 0x034993 thru 0x03ffff (0xb66d bytes) 000056 1790920818.566682 punch from 0x0260b3 to 0x0303d7 (0xa325 bytes) 000057 1790920818.579960 MIRROR_RESYNC 3 mirrors 000058 1790920820.227431 read 0x01096e thru 0x019e12 (0x94a5 bytes) 000059 1790920820.265143 mapread 0x01ca3c thru 0x0203e2 (0x39a7 bytes) 000061 1790920820.294059 mapwrite 0x006ad0 thru 0x0144f4 (0xda25 bytes) 000062 1790920820.632824 mapread 0x00bb96 thru 0x00f770 (0x3bdb bytes) 000063 1790920820.644362 MIRROR_RESYNC 3 mirrors 000064 1790920822.435807 MIRROR_EXTEND to 4 mirrors 000065 1790920823.514717 MIRROR_EXTEND to 5 mirrors 000066 1790920824.820989 mapread 0x000a49 thru 0x00d873 (0xce2b bytes) 000068 1790920824.847042 punch from 0x004ba6 to 0x007882 (0x2cdd bytes) 000069 1790920824.927852 mapread 0x02456b thru 0x025c04 (0x169a bytes) 000070 1790920824.938576 read 0x03b1f8 thru 0x03ffff (0x4e08 bytes) 000073 1790920824.946991 trunc from 0x040000 to 0x035b2d (0xa4d2 bytes) 000074 1790920824.975359 MIRROR_RESYNC 5 mirrors 000075 1790920826.225881 write 0x010ce4 thru 0x020a4f (0xfd6c bytes) 000076 1790920826.332159 write 0x021acf thru 0x02ea51 (0xcf83 bytes) 000077 1790920826.357522 mapread 0x0254a8 thru 0x027cbf (0x2818 bytes) 000079 1790920826.360377 read 0x01a779 thru 0x01d253 (0x2adb bytes) 000084 1790920826.366581 write 0x015b9e thru 0x015dde (0x241 bytes) 000085 1790920826.375749 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x35b2e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35b2e): Mirror 2: 0xf4ea4589 (stale) Mirror 3: 0xf4ea4589 (stale) Mirror 4: 0xf4ea4589 (stale) Mirror 5: 0xf4ea4589 (stale) CRC-32 checksum value for chunk [0, 0x35b2e): Mirror 1: 0x4501a741 Mirror 6: 0x4501a741 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35b2e: skipped 000089 1790920827.678582 mapwrite 0x020a90 thru 0x0210d8 (0x649 bytes) 000090 1790920828.009191 mapwrite 0x03eee9 thru 0x03ffff (0x1117 bytes) 000091 1790920828.298681 write 0x00c928 thru 0x00f4a9 (0x2b82 bytes) 000092 1790920828.335138 trunc from 0x040000 to 0x02ea2c (0x115d3 bytes) 000094 1790920828.383037 trunc from 0x02ea2d to 0x026695 (0x8397 bytes) 000097 1790920828.432326 write 0x023001 thru 0x02828f (0x528f bytes) 000100 1790920828.435126 punch from 0x021eba to 0x024881 (0x29c8 bytes) 000101 1790920828.462970 read 0x008ed5 thru 0x00e7f6 (0x5922 bytes) 000103 1790920828.472660 trunc from 0x028290 to 0x033b12 (0xb883 bytes) 000105 1790920828.500376 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33b13): Mirror 2: 0xcc75441c (stale) Mirror 3: 0xcc75441c (stale) Mirror 4: 0xcc75441c (stale) Mirror 6: 0x8cc7bad4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33b13): Mirror 2: 0xcc75441c (stale) Mirror 3: 0xcc75441c (stale) Mirror 4: 0xcc75441c (stale) Mirror 6: 0x8cc7bad4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33b13: skipped 000106 1790920829.264504 MIRROR_RESYNC 5 mirrors 000109 1790920830.833763 mapwrite 0x020b5a thru 0x02fb6a (0xf011 bytes) 000111 1790920831.120248 mapwrite 0x00437b thru 0x00691d (0x25a3 bytes) 000112 1790920831.319310 trunc from 0x033b13 to 0x008dd2 (0x2ad40 bytes) 000113 1790920831.381979 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x8dd3): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8dd3): Mirror 2: 0x5733c74d (stale) Mirror 3: 0x5733c74d (stale) Mirror 4: 0x5733c74d (stale) Mirror 6: 0x5733c74d (stale) CRC-32 checksum value for chunk [0, 0x8dd3): Mirror 1: 0x64e4014c Mirror 7: 0x64e4014c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8dd3: skipped 000114 1790920832.740830 mapwrite 0x037476 thru 0x03ffff (0x8b8a bytes) 000116 1790920833.044042 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xfd663c89 (stale) Mirror 4: 0xfd663c89 (stale) Mirror 6: 0xfd663c89 (stale) Mirror 7: 0x9214393 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xfd663c89 (stale) Mirror 4: 0xfd663c89 (stale) Mirror 6: 0xfd663c89 (stale) Mirror 7: 0x9214393 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000118 1790920833.706078 mapread 0x00f0f2 thru 0x0115da (0x24e9 bytes) 000122 1790920833.740849 mapwrite 0x01030e thru 0x013097 (0x2d8a bytes) 000123 1790920833.827114 punch from 0x0155c6 to 0x02278d (0xd1c8 bytes) 000124 1790920833.837211 mapread 0x02df7a thru 0x031ed9 (0x3f60 bytes) 000125 1790920833.853484 punch from 0x01df4b to 0x01f366 (0x141c bytes) 000126 1790920833.858851 trunc from 0x040000 to 0x003967 (0x3c698 bytes) 000127 1790920833.892556 trunc from 0x003968 to 0x009d8e (0x6427 bytes) 000129 1790920833.938328 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x9d8f): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9d8f): Mirror 3: 0xe33726fd (stale) Mirror 4: 0xe33726fd (stale) Mirror 6: 0xe33726fd (stale) Mirror 7: 0xcb3e5ff9 (stale) CRC-32 checksum value for chunk [0, 0x9d8f): Mirror 1: 0x3cab9fda Mirror 8: 0x3cab9fda lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9d8f: skipped 000130 1790920835.389965 trunc from 0x009d8f to 0x001378 (0x8a16 bytes) 000131 1790920835.515477 write 0x013cc8 thru 0x015bfa (0x1f33 bytes) 000132 1790920835.530868 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x15bfb): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15bfb): Mirror 3: 0xd1adac52 (stale) Mirror 4: 0xd1adac52 (stale) Mirror 6: 0xd1adac52 (stale) Mirror 7: 0x73fc58e5 (stale) Mirror 8: 0x221f3704 (stale) CRC-32 checksum value for chunk [0, 0x15bfb): Mirror 1: 0xd952f50 Mirror 9: 0xd952f50 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15bfb: skipped 000133 1790920836.980788 punch from 0x001e06 to 0x0052a9 (0x34a4 bytes) 000134 1790920837.227583 mapwrite 0x0029bd thru 0x007143 (0x4787 bytes) 000135 1790920837.347468 mapread 0x014f4d thru 0x015bfa (0xcae bytes) 000136 1790920837.362821 read 0x007b58 thru 0x011f58 (0xa401 bytes) 000137 1790920837.363719 mapread 0x003fb5 thru 0x00d677 (0x96c3 bytes) 000138 1790920837.366851 read 0x012959 thru 0x015782 (0x2e2a bytes) 000139 1790920837.368521 punch from 0x005a3d to 0x006ca8 (0x126c bytes) 000141 1790920837.380823 trunc from 0x015bfb to 0x0370fb (0x21501 bytes) 000142 1790920837.416122 read 0x0181f0 thru 0x0191ba (0xfcb bytes) 000144 1790920837.435691 trunc from 0x0370fc to 0x035e1e (0x12dd bytes) 000145 1790920837.469234 punch from 0x00bbb8 to 0x012177 (0x65c0 bytes) 000146 1790920837.487969 MIRROR_RESYNC 7 mirrors 000147 1790920839.235613 read 0x031bbe thru 0x035e1e (0x4261 bytes) 000150 1790920839.245390 mapread 0x02e50c thru 0x035e1e (0x7913 bytes) 000151 1790920839.264442 trunc from 0x035e1f to 0x028913 (0xd50b bytes) 000152 1790920839.329070 trunc from 0x028914 to 0x0260c4 (0x284f bytes) 000153 1790920839.348074 mapread 0x01ebf6 thru 0x0260c4 (0x74cf bytes) 000154 1790920839.362385 trunc from 0x0260c5 to 0x015837 (0x1088d bytes) 000155 1790920839.393404 MIRROR_RESYNC 7 mirrors 000157 1790920840.764660 punch from 0x00b914 to 0x015837 (0x9f24 bytes) 000158 1790920840.867301 write 0x02a2fa thru 0x036e50 (0xcb57 bytes) 000160 1790920840.870329 mapwrite 0x03234a thru 0x0377e5 (0x549c bytes) 000162 1790920841.033070 mapread 0x015992 thru 0x01a67f (0x4cee bytes) 000164 1790920841.051697 punch from 0x024661 to 0x03389c (0xf23c bytes) 000165 1790920841.057454 mapwrite 0x00b498 thru 0x00f376 (0x3edf bytes) 000166 1790920841.136892 read 0x0015da thru 0x009cab (0x86d2 bytes) 000167 1790920841.151406 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x377e6): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x377e6): Mirror 3: 0x4d453171 (stale) Mirror 4: 0x4d453171 (stale) Mirror 6: 0x4d453171 (stale) Mirror 7: 0x4d453171 (stale) Mirror 8: 0x4d453171 (stale) Mirror 9: 0x4d453171 (stale) CRC-32 checksum value for chunk [0, 0x377e6): Mirror 1: 0x275c886e Mirror 10: 0x275c886e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x377e6: skipped 000169 1790920842.678846 punch from 0x00a949 to 0x00fda9 (0x5461 bytes) 000171 1790920842.768010 mapread 0x01e20c thru 0x0241ba (0x5faf bytes) 000172 1790920842.791812 mapread 0x0330fd thru 0x0348c1 (0x17c5 bytes) 000174 1790920842.843410 mapwrite 0x022b31 thru 0x025e0e (0x32de bytes) 000175 1790920842.922234 read 0x01636b thru 0x0169d6 (0x66c bytes) 000176 1790920842.928224 trunc from 0x0377e6 to 0x03948c (0x1ca7 bytes) 000177 1790920842.975581 punch from 0x01590b to 0x016dc5 (0x14bb bytes) 000178 1790920842.980989 punch from 0x01592a to 0x01df10 (0x85e7 bytes) 000179 1790920842.986322 read 0x00612f thru 0x014d17 (0xebe9 bytes) 000181 1790920842.997569 write 0x03613c thru 0x037616 (0x14db bytes) 000183 1790920842.999700 read 0x0019a7 thru 0x008950 (0x6faa bytes) 000186 1790920843.006099 MIRROR_RESYNC 8 mirrors 000188 1790920845.135639 mapread 0x02996f thru 0x0369a5 (0xd037 bytes) 000190 1790920845.185972 MIRROR_RESYNC 8 mirrors 000193 1790920845.812080 trunc from 0x03948d to 0x035029 (0x4463 bytes) 000194 1790920845.890781 write 0x00ce48 thru 0x0102ac (0x3465 bytes) 000196 1790920845.905522 punch from 0x010076 to 0x01fc30 (0xfbbb bytes) 000197 1790920845.918730 mapwrite 0x01a00e thru 0x01f2c2 (0x52b5 bytes) 000198 1790920845.984817 trunc from 0x03502a to 0x00ac47 (0x2a3e2 bytes) 000200 1790920846.005565 trunc from 0x00ac48 to 0x037add (0x2ce96 bytes) 000203 1790920846.028019 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37ade): Mirror 3: 0x7a13f82b (stale) Mirror 4: 0x7a13f82b (stale) Mirror 6: 0x7a13f82b (stale) Mirror 7: 0x7a13f82b (stale) Mirror 8: 0x7a13f82b (stale) Mirror 10: 0x7a13f82b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37ade): Mirror 3: 0x7a13f82b (stale) Mirror 4: 0x7a13f82b (stale) Mirror 6: 0x7a13f82b (stale) Mirror 7: 0x7a13f82b (stale) Mirror 8: 0x7a13f82b (stale) Mirror 10: 0x7a13f82b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37ade: skipped 000206 1790920846.523399 punch from 0x00c3de to 0x010b75 (0x4798 bytes) 000207 1790920846.532958 punch from 0x03017e to 0x036825 (0x66a8 bytes) 000208 1790920846.538664 trunc from 0x037ade to 0x00bb6d (0x2bf70 bytes) 000210 1790920846.557767 trunc from 0x00bb6e to 0x003333 (0x883a bytes) 000211 1790920846.575805 write 0x03605d thru 0x03ffff (0x9fa3 bytes) 000213 1790920846.579899 write 0x0174e7 thru 0x0235b2 (0xc0cc bytes) 000215 1790920846.591380 read 0x03eeee thru 0x03ffff (0x1112 bytes) 000219 1790920846.594149 read 0x013c6a thru 0x018933 (0x4cca bytes) 000221 1790920846.602843 mapread 0x0373ca thru 0x03ffff (0x8c36 bytes) 000222 1790920846.604380 trunc from 0x040000 to 0x0014b9 (0x3eb46 bytes) 000224 1790920846.625376 punch from 0x001258 to 0x0014b9 (0x262 bytes) 000225 1790920846.632575 mapread 0x000a27 thru 0x0014b9 (0xa93 bytes) 000227 1790920846.640333 write 0x02318f thru 0x02dfab (0xae1d bytes) 000228 1790920846.642098 write 0x024f73 thru 0x0270ad (0x213b bytes) 000232 1790920846.645666 write 0x03d3e4 thru 0x03ffff (0x2c1c bytes) 000233 1790920846.647056 mapwrite 0x0108e5 thru 0x017d9f (0x74bb bytes) 000234 1790920846.730155 mapwrite 0x0212c1 thru 0x02d581 (0xc2c1 bytes) 000236 1790920846.786989 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x184f084d (stale) Mirror 4: 0x184f084d (stale) Mirror 6: 0x184f084d (stale) Mirror 7: 0x184f084d (stale) Mirror 8: 0x184f084d (stale) Mirror 10: 0x184f084d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4a0bf980 Mirror 11: 0x4a0bf980 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000240 1790920847.908999 read 0x022006 thru 0x02e5ed (0xc5e8 bytes) 000241 1790920847.940293 write 0x0284bb thru 0x033f3f (0xba85 bytes) 000242 1790920848.113670 mapwrite 0x02bed9 thru 0x02dc7d (0x1da5 bytes) 000243 1790920848.169229 MIRROR_RESYNC 8 mirrors 000244 1790920850.156967 punch from 0x000b24 to 0x00f6da (0xebb7 bytes) 000246 1790920850.222219 trunc from 0x040000 to 0x023a30 (0x1c5cf bytes) 000247 1790920850.242312 trunc from 0x023a31 to 0x01979d (0xa293 bytes) 000248 1790920850.269965 MIRROR_RESYNC 8 mirrors 000249 1790920851.596024 trunc from 0x01979e to 0x03167d (0x17ee0 bytes) 000250 1790920851.676490 punch from 0x0021d2 to 0x005354 (0x3183 bytes) 000251 1790920851.684916 mapwrite 0x01fd77 thru 0x02e56d (0xe7f7 bytes) 000252 1790920851.787115 mapwrite 0x02e684 thru 0x0317c7 (0x3144 bytes) 000253 1790920851.857246 read 0x0046c5 thru 0x00fdd4 (0xb710 bytes) 000254 1790920851.869922 mapread 0x00a3bf thru 0x00ff00 (0x5b42 bytes) 000255 1790920851.876000 MIRROR_RESYNC 8 mirrors 000257 1790920853.186708 mapread 0x00681d thru 0x006fa2 (0x786 bytes) 000259 1790920853.192668 mapwrite 0x033ddd thru 0x0360b9 (0x22dd bytes) 000262 1790920853.321865 write 0x01200e thru 0x013846 (0x1839 bytes) 000263 1790920853.335363 mapwrite 0x023a93 thru 0x032ba9 (0xf117 bytes) 000264 1790920853.413925 mapread 0x009310 thru 0x013ea9 (0xab9a bytes) 000265 1790920853.431598 read 0x0094c6 thru 0x009910 (0x44b bytes) 000266 1790920853.432919 mapread 0x00b3fb thru 0x017390 (0xbf96 bytes) 000267 1790920853.446514 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x360ba): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x360ba): Mirror 3: 0x1bb30961 (stale) Mirror 4: 0x1bb30961 (stale) Mirror 6: 0x1bb30961 (stale) Mirror 7: 0x1bb30961 (stale) Mirror 8: 0x1bb30961 (stale) Mirror 10: 0x1bb30961 (stale) Mirror 11: 0x1bb30961 (stale) CRC-32 checksum value for chunk [0, 0x360ba): Mirror 1: 0x14f6d916 Mirror 12: 0x14f6d916 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x360ba: skipped 000268 1790920854.677796 punch from 0x0095e5 to 0x00d358 (0x3d74 bytes) 000269 1790920854.795523 mapwrite 0x005724 thru 0x006e4d (0x172a bytes) 000270 1790920854.868938 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x360ba): Mirror 3: 0x1bb30961 (stale) Mirror 4: 0x1bb30961 (stale) Mirror 6: 0x1bb30961 (stale) Mirror 7: 0x1bb30961 (stale) Mirror 8: 0x1bb30961 (stale) Mirror 10: 0x1bb30961 (stale) Mirror 11: 0x1bb30961 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x360ba): Mirror 3: 0x1bb30961 (stale) Mirror 4: 0x1bb30961 (stale) Mirror 6: 0x1bb30961 (stale) Mirror 7: 0x1bb30961 (stale) Mirror 8: 0x1bb30961 (stale) Mirror 10: 0x1bb30961 (stale) Mirror 11: 0x1bb30961 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x360ba: skipped 000271 1790920855.388764 write 0x02c92a thru 0x033956 (0x702d bytes) 000272 1790920855.400148 punch from 0x023886 to 0x02c8e4 (0x905f bytes) 000273 1790920855.414617 read 0x0024a6 thru 0x00a17d (0x7cd8 bytes) 000274 1790920855.424398 mapread 0x018f6c thru 0x01d3e9 (0x447e bytes) 000275 1790920855.443378 punch from 0x032c22 to 0x034827 (0x1c06 bytes) 000276 1790920855.448033 mapwrite 0x01f675 thru 0x025142 (0x5ace bytes) 000277 1790920855.500747 mapread 0x017175 thru 0x0223ce (0xb25a bytes) 000278 1790920855.506312 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x360ba): Mirror 3: 0x1bb30961 (stale) Mirror 4: 0x1bb30961 (stale) Mirror 6: 0x1bb30961 (stale) Mirror 7: 0x1bb30961 (stale) Mirror 8: 0x1bb30961 (stale) Mirror 11: 0x1bb30961 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x360ba): Mirror 3: 0x1bb30961 (stale) Mirror 4: 0x1bb30961 (stale) Mirror 6: 0x1bb30961 (stale) Mirror 7: 0x1bb30961 (stale) Mirror 8: 0x1bb30961 (stale) Mirror 11: 0x1bb30961 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x360ba: skipped 000279 1790920856.114114 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x360ba): Mirror 3: 0x1bb30961 (stale) Mirror 4: 0x1bb30961 (stale) Mirror 7: 0x1bb30961 (stale) Mirror 8: 0x1bb30961 (stale) Mirror 11: 0x1bb30961 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x360ba): Mirror 3: 0x1bb30961 (stale) Mirror 4: 0x1bb30961 (stale) Mirror 7: 0x1bb30961 (stale) Mirror 8: 0x1bb30961 (stale) Mirror 11: 0x1bb30961 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x360ba: skipped 000280 1790920856.731939 punch from 0x01c730 to 0x01cc06 (0x4d7 bytes) 000281 1790920856.737657 punch from 0x01b8f2 to 0x022cbc (0x73cb bytes) 000282 1790920856.749987 MIRROR_RESYNC 6 mirrors 000283 1790920858.080870 mapwrite 0x00d561 thru 0x00f5f6 (0x2096 bytes) 000284 1790920858.343988 punch from 0x015390 to 0x01d102 (0x7d73 bytes) 000286 1790920858.355636 write 0x008fba thru 0x00c7c9 (0x3810 bytes) 000287 1790920858.356830 mapread 0x003228 thru 0x007eca (0x4ca3 bytes) 000288 1790920858.373840 mapread 0x0208e1 thru 0x02278f (0x1eaf bytes) 000289 1790920858.390107 trunc from 0x0360ba to 0x0326cc (0x39ed bytes) 000294 1790920858.448370 punch from 0x004907 to 0x0094a5 (0x4b9f bytes) 000295 1790920858.464930 punch from 0x010588 to 0x015e7b (0x58f4 bytes) 000297 1790920858.475326 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x326cd): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x326cd): Mirror 3: 0x5acfc711 (stale) Mirror 4: 0x5acfc711 (stale) Mirror 7: 0x5acfc711 (stale) Mirror 8: 0x5acfc711 (stale) Mirror 11: 0x5acfc711 (stale) CRC-32 checksum value for chunk [0, 0x326cd): Mirror 1: 0x3a904cda Mirror 12: 0x3a904cda lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x326cd: skipped 000300 1790920859.524829 MIRROR_RESYNC 7 mirrors 000301 1790920861.401343 MIRROR_EXTEND to 8 mirrors 000302 1790920863.277911 read 0x000d2d thru 0x0080c2 (0x7396 bytes) 000305 1790920863.306518 punch from 0x005947 to 0x01564e (0xfd08 bytes) 000306 1790920863.497516 mapwrite 0x021d8e thru 0x030a39 (0xecac bytes) 000308 1790920863.634368 mapread 0x01af32 thru 0x0286e0 (0xd7af bytes) 000310 1790920863.654323 read 0x007131 thru 0x0103ff (0x92cf bytes) 000312 1790920863.680039 mapwrite 0x03386f thru 0x0347bf (0xf51 bytes) 000313 1790920863.803521 trunc from 0x0347c0 to 0x008e65 (0x2b95a bytes) 000315 1790920863.878357 read 0x0004e5 thru 0x007ada (0x75f6 bytes) 000316 1790920863.879075 punch from 0x006082 to 0x008e65 (0x2de4 bytes) 000317 1790920863.896460 trunc from 0x008e66 to 0x035169 (0x2c304 bytes) 000318 1790920863.960782 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3516a): Mirror 3: 0xb930e0a3 (stale) Mirror 4: 0xb930e0a3 (stale) Mirror 7: 0xb930e0a3 (stale) Mirror 8: 0xb930e0a3 (stale) Mirror 11: 0xb930e0a3 (stale) Mirror 13: 0xb930e0a3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3516a): Mirror 3: 0xb930e0a3 (stale) Mirror 4: 0xb930e0a3 (stale) Mirror 7: 0xb930e0a3 (stale) Mirror 8: 0xb930e0a3 (stale) Mirror 11: 0xb930e0a3 (stale) Mirror 13: 0xb930e0a3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3516a: skipped 000319 1790920864.733599 read 0x01d4ac thru 0x028212 (0xad67 bytes) 000321 1790920864.747355 mapwrite 0x01015c thru 0x019454 (0x92f9 bytes) 000323 1790920864.810101 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3516a): Mirror 4: 0xb930e0a3 (stale) Mirror 7: 0xb930e0a3 (stale) Mirror 8: 0xb930e0a3 (stale) Mirror 11: 0xb930e0a3 (stale) Mirror 13: 0xb930e0a3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3516a): Mirror 4: 0xb930e0a3 (stale) Mirror 7: 0xb930e0a3 (stale) Mirror 8: 0xb930e0a3 (stale) Mirror 11: 0xb930e0a3 (stale) Mirror 13: 0xb930e0a3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3516a: skipped 000324 1790920865.266834 write 0x00442e thru 0x00c7d6 (0x83a9 bytes) 000327 1790920865.283051 read 0x001305 thru 0x001ac0 (0x7bc bytes) truncating to largest ever: 0x3ec92 000328 1790920865.288494 trunc from 0x03516a to 0x03ec91 (0x9b28 bytes) 000329 1790920865.306018 mapwrite 0x03bf54 thru 0x03eb17 (0x2bc4 bytes) 000330 1790920865.378489 punch from 0x011aa1 to 0x013ca1 (0x2201 bytes) 000332 1790920865.383712 write 0x02401a thru 0x02b1df (0x71c6 bytes) 000333 1790920865.394643 write 0x03f6fb thru 0x03ffff (0x905 bytes) 000334 1790920865.395798 trunc from 0x040000 to 0x034c0d (0xb3f2 bytes) 000335 1790920865.420309 trunc from 0x034c0e to 0x03b985 (0x6d78 bytes) 000336 1790920865.445381 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3b986): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b986): Mirror 4: 0x25ef245c (stale) Mirror 7: 0x25ef245c (stale) Mirror 8: 0x25ef245c (stale) Mirror 11: 0x25ef245c (stale) Mirror 13: 0x25ef245c (stale) CRC-32 checksum value for chunk [0, 0x3b986): Mirror 1: 0xd0d1db1e Mirror 14: 0xd0d1db1e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b986: skipped 000337 1790920866.639080 MIRROR_RESYNC 7 mirrors 000338 1790920868.200331 write 0x00e014 thru 0x019ad3 (0xbac0 bytes) 000340 1790920868.284443 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3b986): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b986): Mirror 4: 0xd0d1db1e (stale) Mirror 7: 0xd0d1db1e (stale) Mirror 8: 0xd0d1db1e (stale) Mirror 11: 0xd0d1db1e (stale) Mirror 13: 0xd0d1db1e (stale) Mirror 14: 0xd0d1db1e (stale) CRC-32 checksum value for chunk [0, 0x3b986): Mirror 1: 0xe842acf Mirror 15: 0xe842acf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b986: skipped 000345 1790920869.779150 mapread 0x01ae54 thru 0x028e95 (0xe042 bytes) 000346 1790920869.834996 read 0x0062c5 thru 0x00e19d (0x7ed9 bytes) 000347 1790920869.854771 mapread 0x02ecb1 thru 0x031ba9 (0x2ef9 bytes) 000350 1790920869.921810 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b986): Mirror 4: 0xd0d1db1e (stale) Mirror 7: 0xd0d1db1e (stale) Mirror 8: 0xd0d1db1e (stale) Mirror 13: 0xd0d1db1e (stale) Mirror 14: 0xd0d1db1e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b986): Mirror 4: 0xd0d1db1e (stale) Mirror 7: 0xd0d1db1e (stale) Mirror 8: 0xd0d1db1e (stale) Mirror 13: 0xd0d1db1e (stale) Mirror 14: 0xd0d1db1e (stale) CRC-32 checksum value for chunk [0, 0x3b986): Mirror 1: 0xe842acf Mirror 15: 0xe842acf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b986: skipped 000351 1790920871.179272 mapread 0x0023d2 thru 0x006e22 (0x4a51 bytes) 000352 1790920871.247937 write 0x0189bb thru 0x01bd77 (0x33bd bytes) 000353 1790920871.419130 MIRROR_RESYNC 7 mirrors 000354 1790920873.035859 mapwrite 0x00a716 thru 0x00e471 (0x3d5c bytes) 000357 1790920873.298957 MIRROR_RESYNC 7 mirrors 000359 1790920875.025682 punch from 0x001a6f to 0x006952 (0x4ee4 bytes) 000362 1790920875.191763 mapwrite 0x0286cf thru 0x028f24 (0x856 bytes) 000364 1790920875.332957 punch from 0x0053fe to 0x007598 (0x219b bytes) 000365 1790920875.356669 read 0x01bbfc thru 0x02a8eb (0xecf0 bytes) 000367 1790920875.416383 punch from 0x012c85 to 0x01e525 (0xb8a1 bytes) 000369 1790920875.429158 mapwrite 0x02c693 thru 0x03683f (0xa1ad bytes) 000370 1790920875.591138 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3b986): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b986): Mirror 4: 0x25477d2 (stale) Mirror 7: 0x25477d2 (stale) Mirror 8: 0x25477d2 (stale) Mirror 13: 0x25477d2 (stale) Mirror 14: 0x25477d2 (stale) Mirror 15: 0x25477d2 (stale) CRC-32 checksum value for chunk [0, 0x3b986): Mirror 1: 0x5b7600bf Mirror 16: 0x5b7600bf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b986: skipped 000371 1790920876.823443 mapwrite 0x00e9b3 thru 0x010ed1 (0x251f bytes) 000372 1790920877.131654 write 0x0196ae thru 0x0244db (0xae2e bytes) 000373 1790920877.146087 read 0x00b237 thru 0x011d5e (0x6b28 bytes) 000375 1790920877.147645 write 0x01dc95 thru 0x026b3d (0x8ea9 bytes) 000376 1790920877.161973 MIRROR_RESYNC 8 mirrors 000377 1790920879.645509 mapread 0x035378 thru 0x03b985 (0x660e bytes) 000378 1790920879.677801 punch from 0x01b223 to 0x0287d1 (0xd5af bytes) 000379 1790920879.830595 read 0x01070e thru 0x0170e5 (0x69d8 bytes) 000380 1790920879.860393 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3b986): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b986): Mirror 4: 0xb0290de7 (stale) Mirror 7: 0xb0290de7 (stale) Mirror 8: 0xb0290de7 (stale) Mirror 13: 0xb0290de7 (stale) Mirror 14: 0xb0290de7 (stale) Mirror 15: 0xb0290de7 (stale) Mirror 16: 0xb0290de7 (stale) CRC-32 checksum value for chunk [0, 0x3b986): Mirror 1: 0xb0993bcf Mirror 17: 0xb0993bcf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b986: skipped 000381 1790920881.779448 punch from 0x037a62 to 0x03b985 (0x3f24 bytes) 000382 1790920881.936393 mapread 0x022da7 thru 0x026324 (0x357e bytes) 000383 1790920881.957888 mapread 0x011d97 thru 0x018a3e (0x6ca8 bytes) 000384 1790920881.969014 punch from 0x00222e to 0x00d170 (0xaf43 bytes) 000385 1790920881.975069 write 0x022ab0 thru 0x02b260 (0x87b1 bytes) 000386 1790920881.988569 punch from 0x008fe5 to 0x012417 (0x9433 bytes) 000387 1790920882.013700 trunc from 0x03b986 to 0x0356fa (0x628b bytes) 000388 1790920882.082874 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x356fb): Mirror 4: 0xa96b12f8 (stale) Mirror 7: 0xa96b12f8 (stale) Mirror 13: 0xa96b12f8 (stale) Mirror 14: 0xa96b12f8 (stale) Mirror 15: 0xa96b12f8 (stale) Mirror 16: 0xa96b12f8 (stale) Mirror 17: 0x7af5e3d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x356fb): Mirror 4: 0xa96b12f8 (stale) Mirror 7: 0xa96b12f8 (stale) Mirror 13: 0xa96b12f8 (stale) Mirror 14: 0xa96b12f8 (stale) Mirror 15: 0xa96b12f8 (stale) Mirror 16: 0xa96b12f8 (stale) Mirror 17: 0x7af5e3d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x356fb: skipped 000389 1790920882.903004 MIRROR_RESYNC 8 mirrors 000392 1790920885.058697 MIRROR_RESYNC 8 mirrors 000395 1790920885.842855 mapwrite 0x01843d thru 0x0259b2 (0xd576 bytes) 000396 1790920886.055514 mapread 0x02a207 thru 0x032337 (0x8131 bytes) 000397 1790920886.069112 trunc from 0x0356fb to 0x001cbe (0x33a3c bytes) 000398 1790920886.100451 mapwrite 0x03a118 thru 0x03ffff (0x5ee8 bytes) 000399 1790920886.183948 mapwrite 0x001093 thru 0x00be70 (0xadde bytes) 000400 1790920886.251607 write 0x01fcb7 thru 0x027c3f (0x7f89 bytes) 000402 1790920886.269539 mapwrite 0x016882 thru 0x02460a (0xdd89 bytes) 000403 1790920886.396507 mapwrite 0x00e3f5 thru 0x015bfb (0x7807 bytes) 000404 1790920886.557473 mapread 0x01db44 thru 0x01ea9e (0xf5b bytes) 000405 1790920886.559007 punch from 0x01e977 to 0x024762 (0x5dec bytes) 000406 1790920886.565136 read 0x00b3a2 thru 0x0148f9 (0x9558 bytes) 000407 1790920886.566358 write 0x01e193 thru 0x02dfbd (0xfe2b bytes) 000408 1790920886.578527 punch from 0x005a0b to 0x00f9c9 (0x9fbf bytes) 000409 1790920886.597969 trunc from 0x040000 to 0x021b63 (0x1e49c bytes) 000410 1790920886.625426 read 0x006094 thru 0x00d7d9 (0x7746 bytes) 000411 1790920886.639054 punch from 0x01ec05 to 0x021b63 (0x2f5f bytes) 000412 1790920886.649045 mapread 0x009cb3 thru 0x00e46e (0x47bc bytes) 000414 1790920886.650600 read 0x01c495 thru 0x021b63 (0x56cf bytes) 000415 1790920886.661003 mapwrite 0x0245c8 thru 0x02d1e2 (0x8c1b bytes) 000416 1790920886.752487 mapread 0x020270 thru 0x024642 (0x43d3 bytes) 000417 1790920886.754076 write 0x0120bf thru 0x012256 (0x198 bytes) truncating to largest ever: 0x3f4a5 000418 1790920886.756369 trunc from 0x02d1e3 to 0x03f4a4 (0x122c2 bytes) 000419 1790920886.780793 write 0x0276c0 thru 0x02d094 (0x59d5 bytes) 000420 1790920886.783471 mapread 0x02426f thru 0x02c9dc (0x876e bytes) 000422 1790920886.785990 trunc from 0x03f4a5 to 0x03eecc (0x5d8 bytes) 000423 1790920886.805443 punch from 0x0287a0 to 0x0368e6 (0xe147 bytes) 000425 1790920886.819585 mapwrite 0x01a07e thru 0x01a86e (0x7f1 bytes) 000427 1790920886.863538 trunc from 0x03eecd to 0x017c68 (0x27264 bytes) 000428 1790920886.884038 read 0x005ea0 thru 0x014d51 (0xeeb2 bytes) 000429 1790920886.885158 read 0x0044e2 thru 0x00e5dd (0xa0fc bytes) 000430 1790920886.886656 mapwrite 0x01693a thru 0x016947 (0xe bytes) 000431 1790920886.930701 punch from 0x00e373 to 0x017c68 (0x98f6 bytes) 000432 1790920886.958142 MIRROR_RESYNC 8 mirrors 000433 1790920888.613612 trunc from 0x017c69 to 0x01a14c (0x24e4 bytes) 000434 1790920888.733979 write 0x00b4da thru 0x014859 (0x9380 bytes) 000435 1790920888.745787 read 0x01556a thru 0x01a14c (0x4be3 bytes) 000436 1790920888.758531 mapwrite 0x012ac0 thru 0x014278 (0x17b9 bytes) 000437 1790920888.808742 write 0x021493 thru 0x0259e3 (0x4551 bytes) 000439 1790920888.816452 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x259e4): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x259e4): Mirror 4: 0x16bcf9ae (stale) Mirror 7: 0x16bcf9ae (stale) Mirror 13: 0x16bcf9ae (stale) Mirror 14: 0x16bcf9ae (stale) Mirror 15: 0x16bcf9ae (stale) Mirror 16: 0x16bcf9ae (stale) Mirror 17: 0x16bcf9ae (stale) CRC-32 checksum value for chunk [0, 0x259e4): Mirror 1: 0xb045f182 Mirror 18: 0xb045f182 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x259e4: skipped 000440 1790920890.660498 read 0x018420 thru 0x020c4f (0x8830 bytes) 000441 1790920890.681248 punch from 0x024951 to 0x0259e3 (0x1093 bytes) 000442 1790920890.762966 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x259e4): Mirror 4: 0x16bcf9ae (stale) Mirror 7: 0x16bcf9ae (stale) Mirror 13: 0x16bcf9ae (stale) Mirror 14: 0x16bcf9ae (stale) Mirror 15: 0x16bcf9ae (stale) Mirror 16: 0x16bcf9ae (stale) Mirror 17: 0x16bcf9ae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x259e4): Mirror 4: 0x16bcf9ae (stale) Mirror 7: 0x16bcf9ae (stale) Mirror 13: 0x16bcf9ae (stale) Mirror 14: 0x16bcf9ae (stale) Mirror 15: 0x16bcf9ae (stale) Mirror 16: 0x16bcf9ae (stale) Mirror 17: 0x16bcf9ae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x259e4: skipped 000444 1790920891.643066 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x259e4): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x259e4): Mirror 4: 0x16bcf9ae (stale) Mirror 7: 0x16bcf9ae (stale) Mirror 13: 0x16bcf9ae (stale) Mirror 14: 0x16bcf9ae (stale) Mirror 15: 0x16bcf9ae (stale) Mirror 16: 0x16bcf9ae (stale) Mirror 17: 0x16bcf9ae (stale) CRC-32 checksum value for chunk [0, 0x259e4): Mirror 1: 0x6a42b75a Mirror 18: 0x6a42b75a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x259e4: skipped 000445 1790920892.956869 read 0x020c88 thru 0x021198 (0x511 bytes) 000447 1790920892.980321 read 0x01bc0e thru 0x0259e3 (0x9dd6 bytes) 000448 1790920893.021499 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x259e4): Mirror 4: 0x16bcf9ae (stale) Mirror 7: 0x16bcf9ae (stale) Mirror 13: 0x16bcf9ae (stale) Mirror 14: 0x16bcf9ae (stale) Mirror 15: 0x16bcf9ae (stale) Mirror 16: 0x16bcf9ae (stale) Mirror 17: 0x16bcf9ae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x259e4): Mirror 4: 0x16bcf9ae (stale) Mirror 7: 0x16bcf9ae (stale) Mirror 13: 0x16bcf9ae (stale) Mirror 14: 0x16bcf9ae (stale) Mirror 15: 0x16bcf9ae (stale) Mirror 16: 0x16bcf9ae (stale) Mirror 17: 0x16bcf9ae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x259e4: skipped 000450 1790920893.711671 punch from 0x007df1 to 0x00c94d (0x4b5d bytes) 000452 1790920893.732142 trunc from 0x0259e4 to 0x005dbe (0x1fc25 bytes) 000453 1790920893.762595 write 0x000d3b thru 0x00b2e0 (0xa5a6 bytes) 000454 1790920893.774082 mapread 0x001ee8 thru 0x00b2e0 (0x93f9 bytes) 000455 1790920893.779000 mapread 0x00803c thru 0x00b2e0 (0x32a5 bytes) 000456 1790920893.781852 mapread 0x006e7d thru 0x00b2e0 (0x4464 bytes) 000457 1790920893.790116 mapwrite 0x00e8f2 thru 0x01046b (0x1b7a bytes) 000458 1790920893.974813 punch from 0x00c02f to 0x01046b (0x443d bytes) 000459 1790920893.987244 MIRROR_RESYNC 8 mirrors 000460 1790920896.011645 read 0x008a89 thru 0x00d38b (0x4903 bytes) 000462 1790920896.021257 mapwrite 0x026249 thru 0x030484 (0xa23c bytes) 000463 1790920896.189492 punch from 0x01db1e to 0x02c289 (0xe76c bytes) 000465 1790920896.196714 trunc from 0x030485 to 0x0107c5 (0x1fcbf bytes) 000467 1790920896.221289 mapread 0x003811 thru 0x00beca (0x86ba bytes) 000468 1790920896.237353 mapread 0x00a0b7 thru 0x0107c5 (0x670f bytes) 000469 1790920896.238673 punch from 0x004c1b to 0x0107c5 (0xbbab bytes) 000470 1790920896.243819 read 0x000f45 thru 0x00f702 (0xe7be bytes) 000471 1790920896.254942 write 0x007b93 thru 0x009d2d (0x219b bytes) 000472 1790920896.256510 trunc from 0x0107c6 to 0x025489 (0x14cc4 bytes) 000473 1790920896.291855 write 0x03745e thru 0x0377b5 (0x358 bytes) 000474 1790920896.299778 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x377b6): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x377b6): Mirror 4: 0x37b68bfa (stale) Mirror 7: 0x37b68bfa (stale) Mirror 13: 0x37b68bfa (stale) Mirror 14: 0x37b68bfa (stale) Mirror 15: 0x37b68bfa (stale) Mirror 16: 0x37b68bfa (stale) Mirror 17: 0x37b68bfa (stale) CRC-32 checksum value for chunk [0, 0x377b6): Mirror 1: 0xecc254ca Mirror 18: 0xecc254ca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x377b6: skipped 000476 1790920898.044415 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x377b6): Mirror 4: 0x37b68bfa (stale) Mirror 7: 0x37b68bfa (stale) Mirror 14: 0x37b68bfa (stale) Mirror 15: 0x37b68bfa (stale) Mirror 16: 0x37b68bfa (stale) Mirror 17: 0x37b68bfa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x377b6): Mirror 4: 0x37b68bfa (stale) Mirror 7: 0x37b68bfa (stale) Mirror 14: 0x37b68bfa (stale) Mirror 15: 0x37b68bfa (stale) Mirror 16: 0x37b68bfa (stale) Mirror 17: 0x37b68bfa (stale) CRC-32 checksum value for chunk [0, 0x377b6): Mirror 1: 0xecc254ca Mirror 18: 0xecc254ca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x377b6: skipped 000477 1790920899.318641 mapwrite 0x003c59 thru 0x00e26d (0xa615 bytes) 000478 1790920899.517389 trunc from 0x0377b6 to 0x00672a (0x3108b bytes) 000479 1790920899.536897 write 0x02f6fe thru 0x03f564 (0xfe67 bytes) 000480 1790920899.540664 mapwrite 0x00f619 thru 0x011608 (0x1ff0 bytes) 000481 1790920899.610647 punch from 0x01be36 to 0x026fb8 (0xb183 bytes) 000482 1790920899.643447 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f565): Mirror 4: 0x15503271 (stale) Mirror 7: 0x15503271 (stale) Mirror 14: 0x15503271 (stale) Mirror 15: 0x15503271 (stale) Mirror 17: 0x15503271 (stale) Mirror 18: 0xae674f06 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f565): Mirror 4: 0x15503271 (stale) Mirror 7: 0x15503271 (stale) Mirror 14: 0x15503271 (stale) Mirror 15: 0x15503271 (stale) Mirror 17: 0x15503271 (stale) Mirror 18: 0xae674f06 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f565: skipped 000483 1790920900.139416 mapread 0x03b7cd thru 0x03f564 (0x3d98 bytes) 000484 1790920900.172028 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3f565): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f565): Mirror 4: 0x15503271 (stale) Mirror 7: 0x15503271 (stale) Mirror 14: 0x15503271 (stale) Mirror 15: 0x15503271 (stale) Mirror 17: 0x15503271 (stale) Mirror 18: 0xae674f06 (stale) CRC-32 checksum value for chunk [0, 0x3f565): Mirror 1: 0x6f19af65 Mirror 19: 0x6f19af65 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f565: skipped 000485 1790920901.190244 mapwrite 0x0243c6 thru 0x02e8f1 (0xa52c bytes) 000486 1790920901.423053 mapwrite 0x03533f thru 0x03a2d7 (0x4f99 bytes) 000487 1790920901.472372 mapread 0x01b77b thru 0x028da1 (0xd627 bytes) 000488 1790920901.487283 MIRROR_RESYNC 8 mirrors 000490 1790920903.306139 mapwrite 0x00a36a thru 0x011c84 (0x791b bytes) 000491 1790920903.561538 write 0x0055e2 thru 0x00e973 (0x9392 bytes) 000493 1790920903.564524 mapread 0x005940 thru 0x00e49c (0x8b5d bytes) 000495 1790920903.568245 trunc from 0x03f565 to 0x012ea4 (0x2c6c0 bytes) 000496 1790920903.613802 mapread 0x00ee60 thru 0x012ea4 (0x4045 bytes) 000498 1790920903.627725 mapread 0x003a31 thru 0x0095de (0x5bae bytes) 000500 1790920903.660624 mapread 0x0061dd thru 0x0086b6 (0x24da bytes) 000501 1790920903.667786 mapwrite 0x02dc9c thru 0x030069 (0x23ce bytes) 000502 1790920903.818718 mapread 0x009b2a thru 0x00b897 (0x1d6e bytes) 000503 1790920903.825118 mapwrite 0x033f5e thru 0x0369c5 (0x2a68 bytes) 000504 1790920904.004034 mapread 0x02f427 thru 0x0332bf (0x3e99 bytes) 000505 1790920904.005223 read 0x0239a4 thru 0x032b0f (0xf16c bytes) 000507 1790920904.028508 read 0x00dc22 thru 0x016cf9 (0x90d8 bytes) 000508 1790920904.069036 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x369c6): Mirror 4: 0x3279768 (stale) Mirror 7: 0x3279768 (stale) Mirror 14: 0x3279768 (stale) Mirror 15: 0x3279768 (stale) Mirror 17: 0x3279768 (stale) Mirror 19: 0x3279768 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x369c6): Mirror 4: 0x3279768 (stale) Mirror 7: 0x3279768 (stale) Mirror 14: 0x3279768 (stale) Mirror 15: 0x3279768 (stale) Mirror 17: 0x3279768 (stale) Mirror 19: 0x3279768 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x369c6: skipped 000510 1790920904.594929 mapread 0x022f89 thru 0x0283aa (0x5422 bytes) 000511 1790920904.620946 trunc from 0x0369c6 to 0x03bae8 (0x5123 bytes) 000512 1790920904.655113 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3bae9): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bae9): Mirror 4: 0x37f4c1c0 (stale) Mirror 7: 0x37f4c1c0 (stale) Mirror 14: 0x37f4c1c0 (stale) Mirror 15: 0x37f4c1c0 (stale) Mirror 17: 0x37f4c1c0 (stale) Mirror 19: 0x37f4c1c0 (stale) CRC-32 checksum value for chunk [0, 0x3bae9): Mirror 1: 0x1d764f77 Mirror 20: 0x1d764f77 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bae9: skipped 000513 1790920905.665262 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3bae9): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bae9): Mirror 4: 0x37f4c1c0 (stale) Mirror 7: 0x37f4c1c0 (stale) Mirror 14: 0x37f4c1c0 (stale) Mirror 15: 0x37f4c1c0 (stale) Mirror 17: 0x37f4c1c0 (stale) Mirror 19: 0x37f4c1c0 (stale) CRC-32 checksum value for chunk [0, 0x3bae9): Mirror 1: 0x1d764f77 Mirror 20: 0x1d764f77 Mirror 21: 0x1d764f77 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bae9: skipped 000514 1790920906.654974 mapread 0x0011a3 thru 0x00d294 (0xc0f2 bytes) 000516 1790920906.675375 write 0x034e25 thru 0x03e91f (0x9afb bytes) 000517 1790920906.774535 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e920): Mirror 4: 0xe2b1a28f (stale) Mirror 7: 0xe2b1a28f (stale) Mirror 14: 0xe2b1a28f (stale) Mirror 15: 0xe2b1a28f (stale) Mirror 19: 0xe2b1a28f (stale) Mirror 20: 0xe9215b84 (stale) Mirror 21: 0xe9215b84 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e920): Mirror 4: 0xe2b1a28f (stale) Mirror 7: 0xe2b1a28f (stale) Mirror 14: 0xe2b1a28f (stale) Mirror 15: 0xe2b1a28f (stale) Mirror 19: 0xe2b1a28f (stale) Mirror 20: 0xe9215b84 (stale) Mirror 21: 0xe9215b84 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e920: skipped 000518 1790920907.339135 mapwrite 0x019301 thru 0x0215e5 (0x82e5 bytes) 000519 1790920907.405997 read 0x026da8 thru 0x028153 (0x13ac bytes) 000520 1790920907.412873 write 0x0276ea thru 0x02dd6b (0x6682 bytes) 000521 1790920907.422881 mapread 0x035065 thru 0x03e91f (0x98bb bytes) 000524 1790920907.446874 MIRROR_RESYNC 8 mirrors 000527 1790920908.915340 read 0x0223f2 thru 0x028441 (0x6050 bytes) 000528 1790920908.943144 mapwrite 0x017893 thru 0x01bbbb (0x4329 bytes) 000530 1790920909.271242 punch from 0x008515 to 0x0171b3 (0xec9f bytes) 000533 1790920909.281254 read 0x0188d1 thru 0x027581 (0xecb1 bytes) 000534 1790920909.296931 punch from 0x0341b5 to 0x03e91f (0xa76b bytes) 000535 1790920909.317439 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3e920): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e920): Mirror 4: 0x7724fb38 (stale) Mirror 7: 0x7724fb38 (stale) Mirror 14: 0x7724fb38 (stale) Mirror 15: 0x7724fb38 (stale) Mirror 19: 0x7724fb38 (stale) Mirror 20: 0x7724fb38 (stale) Mirror 21: 0x7724fb38 (stale) CRC-32 checksum value for chunk [0, 0x3e920): Mirror 1: 0x9d1d297 Mirror 22: 0x9d1d297 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e920: skipped 000536 1790920910.587540 mapwrite 0x016c47 thru 0x026add (0xfe97 bytes) 000537 1790920911.035089 write 0x000779 thru 0x00830a (0x7b92 bytes) 000539 1790920911.061482 read 0x03d4de thru 0x03e91f (0x1442 bytes) 000540 1790920911.068564 trunc from 0x03e920 to 0x02b597 (0x13388 bytes) 000542 1790920911.126487 mapread 0x021766 thru 0x02b597 (0x9e32 bytes) 000543 1790920911.135047 trunc from 0x02b598 to 0x0037ab (0x27dec bytes) 000544 1790920911.173656 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x37ac): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37ac): Mirror 4: 0x666d11b5 (stale) Mirror 7: 0x666d11b5 (stale) Mirror 14: 0x666d11b5 (stale) Mirror 15: 0x666d11b5 (stale) Mirror 19: 0x666d11b5 (stale) Mirror 20: 0x666d11b5 (stale) Mirror 21: 0x666d11b5 (stale) Mirror 22: 0x666d11b5 (stale) CRC-32 checksum value for chunk [0, 0x37ac): Mirror 1: 0x9bb2d77a Mirror 23: 0x9bb2d77a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37ac: skipped 000545 1790920912.212949 write 0x00f223 thru 0x0149b9 (0x5797 bytes) 000546 1790920912.368330 trunc from 0x0149ba to 0x02d795 (0x18ddc bytes) 000547 1790920912.425095 mapread 0x0100b2 thru 0x01f805 (0xf754 bytes) 000548 1790920912.448873 trunc from 0x02d796 to 0x00392e (0x29e67 bytes) 000549 1790920912.471513 read 0x00261b thru 0x00392e (0x1314 bytes) 000550 1790920912.479564 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x392f): Mirror 4: 0xda0ec1b5 (stale) Mirror 7: 0xda0ec1b5 (stale) Mirror 15: 0xda0ec1b5 (stale) Mirror 19: 0xda0ec1b5 (stale) Mirror 20: 0xda0ec1b5 (stale) Mirror 21: 0xda0ec1b5 (stale) Mirror 22: 0xda0ec1b5 (stale) Mirror 23: 0x8753a8a6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x392f): Mirror 4: 0xda0ec1b5 (stale) Mirror 7: 0xda0ec1b5 (stale) Mirror 15: 0xda0ec1b5 (stale) Mirror 19: 0xda0ec1b5 (stale) Mirror 20: 0xda0ec1b5 (stale) Mirror 21: 0xda0ec1b5 (stale) Mirror 22: 0xda0ec1b5 (stale) Mirror 23: 0x8753a8a6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x392f: skipped 000551 1790920912.848037 punch from 0x001086 to 0x00392e (0x28a9 bytes) 000552 1790920912.853896 punch from 0x00116c to 0x00392e (0x27c3 bytes) 000553 1790920912.861633 mapread 0x001929 thru 0x00392e (0x2006 bytes) 000554 1790920912.876083 mapwrite 0x028c14 thru 0x029a90 (0xe7d bytes) 000555 1790920912.997468 mapwrite 0x03f595 thru 0x03ffff (0xa6b bytes) 000556 1790920913.106923 trunc from 0x040000 to 0x0325e5 (0xda1a bytes) 000557 1790920913.126724 mapread 0x02c398 thru 0x0325e5 (0x624e bytes) 000558 1790920913.136716 punch from 0x030216 to 0x0325e5 (0x23d0 bytes) 000559 1790920913.141789 punch from 0x010f41 to 0x0183f8 (0x74b8 bytes) 000560 1790920913.146828 punch from 0x02afb4 to 0x0325e5 (0x7632 bytes) 000561 1790920913.152427 write 0x009455 thru 0x0171d9 (0xdd85 bytes) 000563 1790920913.163471 mapwrite 0x019c81 thru 0x0297cf (0xfb4f bytes) 000564 1790920913.201039 read 0x00ae50 thru 0x017c54 (0xce05 bytes) 000565 1790920913.201617 write 0x02bec5 thru 0x02bfd3 (0x10f bytes) 000568 1790920913.206456 punch from 0x012ae5 to 0x01a0cf (0x75eb bytes) 000569 1790920913.215950 mapread 0x001aa3 thru 0x0026cc (0xc2a bytes) 000570 1790920913.216990 trunc from 0x0325e6 to 0x011966 (0x20c7f bytes) 000571 1790920913.238197 mapread 0x0009e6 thru 0x00603b (0x5656 bytes) 000572 1790920913.246645 trunc from 0x011967 to 0x03bca3 (0x2a33d bytes) 000573 1790920913.271565 trunc from 0x03bca4 to 0x02f225 (0xca7e bytes) 000574 1790920913.303052 mapread 0x012878 thru 0x01fd5e (0xd4e7 bytes) 000575 1790920913.321497 punch from 0x00db45 to 0x019c0a (0xc0c6 bytes) 000576 1790920913.329947 write 0x0118eb thru 0x01d7cc (0xbee2 bytes) 000578 1790920913.338578 mapwrite 0x017e42 thru 0x024c59 (0xce18 bytes) 000579 1790920913.401966 mapwrite 0x01c1d8 thru 0x0206b5 (0x44de bytes) 000581 1790920913.440994 mapread 0x00c687 thru 0x011ad2 (0x544c bytes) 000582 1790920913.445640 mapwrite 0x03e640 thru 0x03e7a3 (0x164 bytes) 000584 1790920913.516030 mapread 0x006112 thru 0x00e5cf (0x84be bytes) 000585 1790920913.523401 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e7a4): Mirror 4: 0x4b8eacb2 (stale) Mirror 7: 0x4b8eacb2 (stale) Mirror 15: 0x4b8eacb2 (stale) Mirror 20: 0x4b8eacb2 (stale) Mirror 21: 0x4b8eacb2 (stale) Mirror 22: 0x472ca5bb (stale) Mirror 23: 0x188b0b62 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e7a4): Mirror 4: 0x4b8eacb2 (stale) Mirror 7: 0x4b8eacb2 (stale) Mirror 15: 0x4b8eacb2 (stale) Mirror 20: 0x4b8eacb2 (stale) Mirror 21: 0x4b8eacb2 (stale) Mirror 22: 0x472ca5bb (stale) Mirror 23: 0x188b0b62 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e7a4: skipped 000588 1790920914.283886 mapwrite 0x01f995 thru 0x02933f (0x99ab bytes) 000589 1790920914.356600 trunc from 0x03e7a4 to 0x0047c0 (0x39fe3 bytes) 000591 1790920914.379520 punch from 0x001d79 to 0x0047c0 (0x2a48 bytes) 000592 1790920914.385266 write 0x026ac1 thru 0x02e8c2 (0x7e02 bytes) 000594 1790920914.387511 punch from 0x005d94 to 0x00fcc2 (0x9f2f bytes) 000595 1790920914.401438 trunc from 0x02e8c3 to 0x015bbb (0x18d07 bytes) 000596 1790920914.420055 mapwrite 0x02b379 thru 0x03a716 (0xf39e bytes) 000598 1790920914.500018 mapread 0x013f07 thru 0x0206e8 (0xc7e2 bytes) 000601 1790920914.535135 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a717): Mirror 7: 0x3c4c585c (stale) Mirror 15: 0x3c4c585c (stale) Mirror 20: 0x3c4c585c (stale) Mirror 21: 0x3c4c585c (stale) Mirror 22: 0xdbb95e93 (stale) Mirror 23: 0x60cc031b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a717): Mirror 7: 0x3c4c585c (stale) Mirror 15: 0x3c4c585c (stale) Mirror 20: 0x3c4c585c (stale) Mirror 21: 0x3c4c585c (stale) Mirror 22: 0xdbb95e93 (stale) Mirror 23: 0x60cc031b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a717: skipped 000602 1790920915.058876 trunc from 0x03a717 to 0x00c7b5 (0x2df61 bytes) 000603 1790920915.083643 mapwrite 0x034bdb thru 0x03b27a (0x66a0 bytes) 000604 1790920915.175053 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3b27b): Mirror 7: (stale - read error) Mirror 15: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b27b): Mirror 7: 0x20718710 (stale) Mirror 15: 0x20718710 (stale) Mirror 20: 0x20718710 (stale) Mirror 21: 0x20718710 (stale) Mirror 22: 0x366d7258 (stale) Mirror 23: 0x7815deb8 (stale) CRC-32 checksum value for chunk [0, 0x3b27b): Mirror 1: 0x82359bb1 Mirror 24: 0x82359bb1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b27b: skipped 000605 1790920916.512752 read 0x033990 thru 0x03b27a (0x78eb bytes) 000606 1790920916.529090 punch from 0x036eae to 0x03b27a (0x43cd bytes) 000608 1790920916.619551 write 0x036cf9 thru 0x039042 (0x234a bytes) 000609 1790920916.631902 punch from 0x02d746 to 0x036957 (0x9212 bytes) 000610 1790920916.647317 punch from 0x026ebd to 0x02ac82 (0x3dc6 bytes) 000611 1790920916.657143 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3b27b): Mirror 7: (stale - read error) Mirror 15: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b27b): Mirror 7: 0x20718710 (stale) Mirror 15: 0x20718710 (stale) Mirror 20: 0x20718710 (stale) Mirror 21: 0x20718710 (stale) Mirror 22: 0x366d7258 (stale) Mirror 23: 0x7815deb8 (stale) Mirror 24: 0x82359bb1 (stale) CRC-32 checksum value for chunk [0, 0x3b27b): Mirror 1: 0xbac611fc Mirror 25: 0xbac611fc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b27b: skipped 000613 1790920918.352068 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3b27b): Mirror 7: (stale - read error) Mirror 15: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b27b): Mirror 7: 0x20718710 (stale) Mirror 15: 0x20718710 (stale) Mirror 20: 0x20718710 (stale) Mirror 21: 0x20718710 (stale) Mirror 22: 0x366d7258 (stale) Mirror 23: 0x7815deb8 (stale) Mirror 24: 0x82359bb1 (stale) CRC-32 checksum value for chunk [0, 0x3b27b): Mirror 1: 0xbac611fc Mirror 25: 0xbac611fc Mirror 26: 0xbac611fc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b27b: skipped 000614 1790920919.993937 punch from 0x002f5b to 0x009326 (0x63cc bytes) 000615 1790920920.106630 punch from 0x00da5b to 0x01be8f (0xe435 bytes) 000616 1790920920.118004 write 0x00fc08 thru 0x01e9f3 (0xedec bytes) 000617 1790920920.130959 mapwrite 0x00cff6 thru 0x01a2b8 (0xd2c3 bytes) 000618 1790920920.261030 trunc from 0x03b27b to 0x0249c3 (0x168b7 bytes) 000619 1790920920.314369 trunc from 0x0249c4 to 0x018a7f (0xbf44 bytes) 000620 1790920920.347767 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18a80): Mirror 15: 0x414f43a3 (stale) Mirror 20: 0x414f43a3 (stale) Mirror 21: 0x414f43a3 (stale) Mirror 22: 0xfeeb7a90 (stale) Mirror 23: 0xc4022fc4 (stale) Mirror 24: 0x36f3a4bf (stale) Mirror 25: 0x36f3a4bf (stale) Mirror 26: 0x36f3a4bf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18a80): Mirror 15: 0x414f43a3 (stale) Mirror 20: 0x414f43a3 (stale) Mirror 21: 0x414f43a3 (stale) Mirror 22: 0xfeeb7a90 (stale) Mirror 23: 0xc4022fc4 (stale) Mirror 24: 0x36f3a4bf (stale) Mirror 25: 0x36f3a4bf (stale) Mirror 26: 0x36f3a4bf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18a80: skipped 000621 1790920921.426518 mapread 0x018581 thru 0x018a7f (0x4ff bytes) 000622 1790920921.447488 mapwrite 0x00904d thru 0x00dd74 (0x4d28 bytes) 000624 1790920921.545489 punch from 0x014232 to 0x018a7f (0x484e bytes) 000626 1790920921.563243 MIRROR_RESYNC 9 mirrors 000627 1790920923.897482 mapread 0x0113b8 thru 0x015e42 (0x4a8b bytes) 000630 1790920923.938027 mapread 0x0136fb thru 0x018a7f (0x5385 bytes) 000631 1790920923.939360 mapread 0x0173a3 thru 0x018120 (0xd7e bytes) 000633 1790920923.940044 punch from 0x00aa7c to 0x010db8 (0x633d bytes) 000635 1790920924.168478 punch from 0x012077 to 0x018a7f (0x6a09 bytes) 000637 1790920924.182822 write 0x02a240 thru 0x032c8b (0x8a4c bytes) 000638 1790920924.218390 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x32c8c): Mirror 15: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32c8c): Mirror 15: 0xa7931ed4 (stale) Mirror 20: 0xa7931ed4 (stale) Mirror 21: 0xa7931ed4 (stale) Mirror 22: 0xa7931ed4 (stale) Mirror 23: 0xa7931ed4 (stale) Mirror 24: 0xa7931ed4 (stale) Mirror 25: 0xa7931ed4 (stale) Mirror 26: 0xa7931ed4 (stale) CRC-32 checksum value for chunk [0, 0x32c8c): Mirror 1: 0xd3dc8ff7 Mirror 27: 0xd3dc8ff7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32c8c: skipped 000639 1790920925.880912 write 0x03669d thru 0x03ffff (0x9963 bytes) 000640 1790920925.994911 mapread 0x026656 thru 0x032fe5 (0xc990 bytes) 000641 1790920926.033669 write 0x0042eb thru 0x01237d (0xe093 bytes) 000642 1790920926.049086 mapread 0x028083 thru 0x0287f0 (0x76e bytes) 000645 1790920926.053444 write 0x01efb0 thru 0x02addd (0xbe2e bytes) 000646 1790920926.072922 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xe03e7920 (stale) Mirror 20: 0xe03e7920 (stale) Mirror 21: 0xe03e7920 (stale) Mirror 22: 0xe03e7920 (stale) Mirror 23: 0xe03e7920 (stale) Mirror 24: 0xe03e7920 (stale) Mirror 26: 0xe03e7920 (stale) Mirror 27: 0xe9303dda (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xe03e7920 (stale) Mirror 20: 0xe03e7920 (stale) Mirror 21: 0xe03e7920 (stale) Mirror 22: 0xe03e7920 (stale) Mirror 23: 0xe03e7920 (stale) Mirror 24: 0xe03e7920 (stale) Mirror 26: 0xe03e7920 (stale) Mirror 27: 0xe9303dda (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000647 1790920926.734930 MIRROR_RESYNC 9 mirrors 000648 1790920928.184512 mapwrite 0x02910e thru 0x034189 (0xb07c bytes) 000649 1790920928.483212 trunc from 0x040000 to 0x02d2b0 (0x12d4f bytes) 000650 1790920928.541412 punch from 0x009391 to 0x009aec (0x75c bytes) 000651 1790920928.569394 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2d2b1): Mirror 15: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d2b1): Mirror 15: 0x286c5c69 (stale) Mirror 20: 0x286c5c69 (stale) Mirror 21: 0x286c5c69 (stale) Mirror 22: 0x286c5c69 (stale) Mirror 23: 0x286c5c69 (stale) Mirror 24: 0x286c5c69 (stale) Mirror 26: 0x286c5c69 (stale) Mirror 27: 0x286c5c69 (stale) CRC-32 checksum value for chunk [0, 0x2d2b1): Mirror 1: 0x5b74e218 Mirror 28: 0x5b74e218 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d2b1: skipped 000652 1790920930.478096 write 0x02f39d thru 0x035334 (0x5f98 bytes) 000654 1790920930.594776 punch from 0x01f9b2 to 0x02a58b (0xabda bytes) 000655 1790920930.617715 mapread 0x02326a thru 0x024258 (0xfef bytes) 000657 1790920930.632678 write 0x03ead5 thru 0x03ffff (0x152b bytes) 000659 1790920930.635918 trunc from 0x040000 to 0x02052a (0x1fad5 bytes) 000663 1790920930.670944 mapread 0x01b33d thru 0x02052a (0x51ee bytes) 000664 1790920930.689997 write 0x00d205 thru 0x019606 (0xc402 bytes) 000665 1790920930.700691 punch from 0x003173 to 0x004460 (0x12ee bytes) 000668 1790920930.737337 mapread 0x00195a thru 0x002fd2 (0x1679 bytes) 000669 1790920930.759657 read 0x00ef0c thru 0x01dad1 (0xebc6 bytes) 000671 1790920930.762627 trunc from 0x02052b to 0x02d74b (0xd221 bytes) 000672 1790920930.787506 write 0x022ed2 thru 0x02ed24 (0xbe53 bytes) 000673 1790920930.802232 write 0x0338cc thru 0x0375bd (0x3cf2 bytes) 000674 1790920930.803402 read 0x034fe2 thru 0x0375bd (0x25dc bytes) 000675 1790920930.805774 write 0x00366c thru 0x008bd9 (0x556e bytes) 000676 1790920930.808469 mapwrite 0x03dae6 thru 0x03ffff (0x251a bytes) 000677 1790920931.015259 read 0x005785 thru 0x012a67 (0xd2e3 bytes) 000679 1790920931.028338 read 0x01484a thru 0x01f61d (0xadd4 bytes) 000680 1790920931.043432 MIRROR_RESYNC 10 mirrors 000681 1790920933.345304 read 0x02b896 thru 0x02d766 (0x1ed1 bytes) 000683 1790920933.358759 read 0x033a4b thru 0x03ffff (0xc5b5 bytes) 000684 1790920933.409292 write 0x0144e2 thru 0x014c5a (0x779 bytes) 000685 1790920933.571785 read 0x000f1f thru 0x00f37b (0xe45d bytes) 000686 1790920933.619018 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x6483e431 (stale) Mirror 20: 0x6483e431 (stale) Mirror 21: 0x6483e431 (stale) Mirror 22: 0x6483e431 (stale) Mirror 23: 0x6483e431 (stale) Mirror 24: 0x6483e431 (stale) Mirror 26: 0x6483e431 (stale) Mirror 27: 0x6483e431 (stale) Mirror 28: 0x6483e431 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x36c09b9 Mirror 29: 0x36c09b9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000687 1790920935.826523 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x6483e431 (stale) Mirror 20: 0x6483e431 (stale) Mirror 21: 0x6483e431 (stale) Mirror 22: 0x6483e431 (stale) Mirror 23: 0x6483e431 (stale) Mirror 24: 0x6483e431 (stale) Mirror 26: 0x6483e431 (stale) Mirror 27: 0x6483e431 (stale) Mirror 28: 0x6483e431 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x36c09b9 Mirror 29: 0x36c09b9 Mirror 30: 0x36c09b9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000688 1790920937.570087 punch from 0x007920 to 0x0173d6 (0xfab7 bytes) 000689 1790920937.683774 write 0x0307b1 thru 0x03e93a (0xe18a bytes) 000690 1790920937.700554 write 0x03fa48 thru 0x03ffff (0x5b8 bytes) 000691 1790920937.710148 read 0x00f092 thru 0x01690c (0x787b bytes) 000693 1790920937.727506 mapread 0x01d1e3 thru 0x01f075 (0x1e93 bytes) 000694 1790920937.768540 punch from 0x019088 to 0x020df6 (0x7d6f bytes) 000695 1790920937.789051 punch from 0x03c72c to 0x03ffff (0x38d4 bytes) 000697 1790920937.800583 punch from 0x001046 to 0x00eb9a (0xdb55 bytes) 000698 1790920937.807728 write 0x024676 thru 0x02b661 (0x6fec bytes) 000699 1790920937.828786 punch from 0x014b8b to 0x020e6c (0xc2e2 bytes) 000701 1790920937.853748 trunc from 0x040000 to 0x00f3bc (0x30c43 bytes) 000702 1790920937.891633 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xf3bd): Mirror 20: 0x9207675d (stale) Mirror 21: 0x9207675d (stale) Mirror 22: 0x9207675d (stale) Mirror 23: 0x9207675d (stale) Mirror 24: 0x9207675d (stale) Mirror 26: 0x9207675d (stale) Mirror 27: 0x9207675d (stale) Mirror 28: 0x9207675d (stale) Mirror 29: 0x9207675d (stale) Mirror 30: 0x9207675d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf3bd): Mirror 20: 0x9207675d (stale) Mirror 21: 0x9207675d (stale) Mirror 22: 0x9207675d (stale) Mirror 23: 0x9207675d (stale) Mirror 24: 0x9207675d (stale) Mirror 26: 0x9207675d (stale) Mirror 27: 0x9207675d (stale) Mirror 28: 0x9207675d (stale) Mirror 29: 0x9207675d (stale) Mirror 30: 0x9207675d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf3bd: skipped 000703 1790920938.714624 mapwrite 0x03e562 thru 0x03ffff (0x1a9e bytes) 000704 1790920938.818118 write 0x033ccd thru 0x034d9d (0x10d1 bytes) 000705 1790920938.830060 mapread 0x017254 thru 0x01ea92 (0x783f bytes) 000706 1790920938.842564 punch from 0x03d036 to 0x03ffff (0x2fca bytes) 000707 1790920938.855971 MIRROR_RESYNC 11 mirrors 000708 1790920943.076533 mapwrite 0x03af3a thru 0x03e821 (0x38e8 bytes) 000711 1790920943.269982 write 0x021c4f thru 0x02440c (0x27be bytes) 000712 1790920943.282554 trunc from 0x040000 to 0x02350a (0x1caf5 bytes) 000713 1790920943.307527 read 0x011402 thru 0x011ecb (0xaca bytes) 000714 1790920943.319402 MIRROR_RESYNC 11 mirrors 000715 1790920946.324821 trunc from 0x02350b to 0x02efd7 (0xbacd bytes) 000717 1790920946.397104 trunc from 0x02efd8 to 0x010489 (0x1eb4e bytes) 000718 1790920946.420018 read 0x001bd4 thru 0x010489 (0xe8b6 bytes) 000719 1790920946.430930 read 0x005363 thru 0x010489 (0xb127 bytes) 000720 1790920946.431723 read 0x000c88 thru 0x007baa (0x6f23 bytes) 000721 1790920946.437287 punch from 0x007567 to 0x00da0a (0x64a4 bytes) 000722 1790920946.441782 read 0x00d43b thru 0x010489 (0x304f bytes) 000723 1790920946.451027 write 0x008c86 thru 0x014095 (0xb410 bytes) 000724 1790920946.452626 read 0x00db6e thru 0x0101f1 (0x2684 bytes) 000725 1790920946.453240 write 0x03f584 thru 0x03ffff (0xa7c bytes) 000727 1790920946.456090 trunc from 0x040000 to 0x00c9a0 (0x3365f bytes) 000728 1790920946.484998 punch from 0x008478 to 0x00c9a0 (0x4529 bytes) 000729 1790920946.498977 read 0x00678f thru 0x00c9a0 (0x6212 bytes) 000731 1790920946.509439 write 0x015124 thru 0x023b46 (0xea23 bytes) 000733 1790920946.513389 mapwrite 0x016404 thru 0x016cff (0x8fc bytes) 000734 1790920946.580402 MIRROR_SPLIT mirror 5 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23b47): Mirror 20: 0xd7f3702a (stale) Mirror 21: 0xd7f3702a (stale) Mirror 22: 0xd7f3702a (stale) Mirror 23: 0xd7f3702a (stale) Mirror 26: 0xd7f3702a (stale) Mirror 27: 0xd7f3702a (stale) Mirror 28: 0xd7f3702a (stale) Mirror 29: 0xd7f3702a (stale) Mirror 30: 0xd7f3702a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23b47): Mirror 20: 0xd7f3702a (stale) Mirror 21: 0xd7f3702a (stale) Mirror 22: 0xd7f3702a (stale) Mirror 23: 0xd7f3702a (stale) Mirror 26: 0xd7f3702a (stale) Mirror 27: 0xd7f3702a (stale) Mirror 28: 0xd7f3702a (stale) Mirror 29: 0xd7f3702a (stale) Mirror 30: 0xd7f3702a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23b47: skipped 000735 1790920947.531424 mapread 0x020fe9 thru 0x023b46 (0x2b5e bytes) 000737 1790920947.573209 read 0x023647 thru 0x023b46 (0x500 bytes) truncating to largest ever: 0x3fea1 000741 1790920947.578701 trunc from 0x023b47 to 0x03fea0 (0x1c35a bytes) 000742 1790920947.607955 punch from 0x017aaf to 0x020809 (0x8d5b bytes) 000743 1790920947.615615 trunc from 0x03fea1 to 0x03cd45 (0x315b bytes) 000744 1790920947.637833 punch from 0x01bc4e to 0x02536b (0x971e bytes) 000745 1790920947.646486 punch from 0x010645 to 0x01adbf (0xa77b bytes) 000746 1790920947.651929 write 0x03a023 thru 0x03d1c3 (0x31a1 bytes) 000747 1790920947.662628 write 0x003970 thru 0x008b38 (0x51c9 bytes) 000748 1790920947.681507 mapwrite 0x019f84 thru 0x020ee2 (0x6f5f bytes) 000749 1790920947.791856 mapwrite 0x01ad6b thru 0x02a314 (0xf5aa bytes) 000750 1790920947.986950 read 0x03b4ec thru 0x03d1c3 (0x1cd8 bytes) 000752 1790920948.001448 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3d1c4): Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d1c4): Mirror 20: 0xf57c6051 (stale) Mirror 21: 0xf57c6051 (stale) Mirror 22: 0xf57c6051 (stale) Mirror 23: 0xf57c6051 (stale) Mirror 26: 0xf57c6051 (stale) Mirror 27: 0xf57c6051 (stale) Mirror 28: 0xf57c6051 (stale) Mirror 29: 0xf57c6051 (stale) Mirror 30: 0xf57c6051 (stale) CRC-32 checksum value for chunk [0, 0x3d1c4): Mirror 1: 0x863b78de Mirror 31: 0x863b78de lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d1c4: skipped 000755 1790920949.577828 read 0x03bfa8 thru 0x03d1c3 (0x121c bytes) 000756 1790920949.598671 trunc from 0x03d1c4 to 0x00f3ee (0x2ddd5 bytes) 000759 1790920949.719329 trunc from 0x00f3ef to 0x006b30 (0x88be bytes) 000760 1790920949.781998 mapwrite 0x001363 thru 0x00cbf6 (0xb894 bytes) 000762 1790920949.933791 write 0x006705 thru 0x009e5d (0x3759 bytes) 000764 1790920949.936480 punch from 0x0011cf to 0x00829e (0x70d0 bytes) 000765 1790920949.952090 read 0x007e86 thru 0x009142 (0x12bd bytes) 000766 1790920949.964695 read 0x0016c3 thru 0x001a3d (0x37b bytes) 000767 1790920949.974569 MIRROR_RESYNC 11 mirrors 000768 1790920952.027634 read 0x001d4a thru 0x00382f (0x1ae6 bytes) 000770 1790920952.048880 punch from 0x003514 to 0x00a9b5 (0x74a2 bytes) 000772 1790920952.213491 write 0x01c8ef thru 0x0205a1 (0x3cb3 bytes) 000773 1790920952.218285 punch from 0x00dda4 to 0x01370a (0x5967 bytes) 000775 1790920952.242683 write 0x002d06 thru 0x008af1 (0x5dec bytes) 000776 1790920952.286670 MIRROR_RESYNC 11 mirrors 000777 1790920954.426365 mapread 0x006de8 thru 0x00ee40 (0x8059 bytes) 000778 1790920954.447560 punch from 0x000db6 to 0x00f5c9 (0xe814 bytes) 000779 1790920954.520711 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x205a2): Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x205a2): Mirror 20: 0x69bc3b80 (stale) Mirror 21: 0x69bc3b80 (stale) Mirror 22: 0x69bc3b80 (stale) Mirror 23: 0x69bc3b80 (stale) Mirror 26: 0x69bc3b80 (stale) Mirror 27: 0x69bc3b80 (stale) Mirror 28: 0x69bc3b80 (stale) Mirror 29: 0x69bc3b80 (stale) Mirror 30: 0x69bc3b80 (stale) Mirror 31: 0x69bc3b80 (stale) CRC-32 checksum value for chunk [0, 0x205a2): Mirror 1: 0xca0b7a3d Mirror 32: 0xca0b7a3d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x205a2: skipped 000780 1790920955.766892 mapwrite 0x01cf8e thru 0x021291 (0x4304 bytes) 000782 1790920955.962793 punch from 0x01c865 to 0x01ccaf (0x44b bytes) 000783 1790920955.972858 mapread 0x0202a4 thru 0x021291 (0xfee bytes) 000784 1790920955.976370 mapwrite 0x007c45 thru 0x008429 (0x7e5 bytes) 000785 1790920956.038321 mapread 0x0130be thru 0x015bac (0x2aef bytes) 000786 1790920956.058589 MIRROR_RESYNC 12 mirrors 000788 1790920958.921058 read 0x01e576 thru 0x021291 (0x2d1c bytes) 000789 1790920958.937650 MIRROR_SPLIT mirror 2 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) 000791 1790920959.528863 trunc from 0x021292 to 0x02e06f (0xcdde bytes) 000792 1790920959.620273 mapread 0x0242e6 thru 0x02b8ec (0x7607 bytes) 000793 1790920959.646099 punch from 0x023cbc to 0x024034 (0x379 bytes) 000797 1790920959.652788 punch from 0x00f71c to 0x01863f (0x8f24 bytes) 000799 1790920959.661049 trunc from 0x02e070 to 0x027cf4 (0x637b bytes) 000800 1790920959.693751 mapwrite 0x02141a thru 0x02fd14 (0xe8fb bytes) 000801 1790920959.874821 punch from 0x006e4c to 0x0168fa (0xfaaf bytes) 000803 1790920959.885817 write 0x03096a thru 0x036d21 (0x63b8 bytes) 000807 1790920959.892052 write 0x0381e7 thru 0x03b7e8 (0x3602 bytes) 000808 1790920959.894313 mapwrite 0x002490 thru 0x00d0d4 (0xac45 bytes) 000811 1790920960.012771 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b7e9): Mirror 20: 0xd34d1416 (stale) Mirror 22: 0xd34d1416 (stale) Mirror 23: 0xd34d1416 (stale) Mirror 26: 0xd34d1416 (stale) Mirror 27: 0xd34d1416 (stale) Mirror 28: 0xd34d1416 (stale) Mirror 29: 0xd34d1416 (stale) Mirror 30: 0xd34d1416 (stale) Mirror 32: 0xd34d1416 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b7e9): Mirror 20: 0xd34d1416 (stale) Mirror 22: 0xd34d1416 (stale) Mirror 23: 0xd34d1416 (stale) Mirror 26: 0xd34d1416 (stale) Mirror 27: 0xd34d1416 (stale) Mirror 28: 0xd34d1416 (stale) Mirror 29: 0xd34d1416 (stale) Mirror 30: 0xd34d1416 (stale) Mirror 32: 0xd34d1416 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b7e9: skipped 000812 1790920960.739136 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3b7e9): Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b7e9): Mirror 20: 0xd34d1416 (stale) Mirror 22: 0xd34d1416 (stale) Mirror 23: 0xd34d1416 (stale) Mirror 26: 0xd34d1416 (stale) Mirror 27: 0xd34d1416 (stale) Mirror 28: 0xd34d1416 (stale) Mirror 29: 0xd34d1416 (stale) Mirror 30: 0xd34d1416 (stale) Mirror 32: 0xd34d1416 (stale) CRC-32 checksum value for chunk [0, 0x3b7e9): Mirror 1: 0xd6ae0ed3 Mirror 33: 0xd6ae0ed3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b7e9: skipped 000813 1790920962.059037 MIRROR_RESYNC 11 mirrors 000814 1790920964.184056 mapwrite 0x0161f8 thru 0x01b22c (0x5035 bytes) 000815 1790920964.471387 punch from 0x03915a to 0x03b7e8 (0x268f bytes) 000817 1790920964.479893 write 0x00f551 thru 0x0144cd (0x4f7d bytes) 000819 1790920964.489981 mapread 0x01b8dc thru 0x0209dc (0x5101 bytes) 000820 1790920964.510598 mapwrite 0x01e97d thru 0x022549 (0x3bcd bytes) 000821 1790920964.662078 punch from 0x02bb0b to 0x039e3b (0xe331 bytes) 000822 1790920964.686657 mapwrite 0x033fd9 thru 0x03d43f (0x9467 bytes) 000823 1790920964.884602 trunc from 0x03d440 to 0x029510 (0x13f2f bytes) 000825 1790920964.913428 trunc from 0x029511 to 0x0058cf (0x23c41 bytes) 000826 1790920964.942217 write 0x038608 thru 0x03ffff (0x79f8 bytes) 000832 1790920964.958632 trunc from 0x040000 to 0x01b460 (0x24b9f bytes) 000833 1790920964.989716 read 0x00d029 thru 0x00d8d7 (0x8af bytes) 000834 1790920965.008272 write 0x013825 thru 0x017f6d (0x4749 bytes) 000836 1790920965.025261 punch from 0x0089e8 to 0x00d918 (0x4f31 bytes) 000837 1790920965.039135 mapread 0x00af83 thru 0x015cf2 (0xad70 bytes) 000839 1790920965.051065 trunc from 0x01b461 to 0x0030a9 (0x183b7 bytes) 000840 1790920965.073029 write 0x029481 thru 0x02e724 (0x52a4 bytes) 000841 1790920965.074674 mapread 0x0296a3 thru 0x02e724 (0x5082 bytes) 000843 1790920965.077284 write 0x02f4a2 thru 0x032fac (0x3b0b bytes) 000844 1790920965.079102 write 0x00bebc thru 0x013850 (0x7995 bytes) 000845 1790920965.086507 mapwrite 0x016676 thru 0x024450 (0xdddb bytes) 000846 1790920965.180424 write 0x019449 thru 0x01954c (0x104 bytes) 000847 1790920965.189671 MIRROR_RESYNC 11 mirrors 000848 1790920967.477988 MIRROR_RESYNC 11 mirrors 000849 1790920968.416520 trunc from 0x032fad to 0x03c8aa (0x98fe bytes) 000850 1790920968.568336 write 0x0109cb thru 0x010cd7 (0x30d bytes) 000851 1790920968.571676 trunc from 0x03c8ab to 0x03bb47 (0xd63 bytes) 000852 1790920968.605091 mapwrite 0x034f2a thru 0x03cf66 (0x803d bytes) 000854 1790920968.810778 mapwrite 0x01b2ed thru 0x020d0f (0x5a23 bytes) 000855 1790920968.933075 mapread 0x000809 thru 0x0047fb (0x3ff3 bytes) 000856 1790920968.962570 write 0x02df91 thru 0x03279d (0x480d bytes) 000858 1790920968.982746 mapwrite 0x03de9d thru 0x03ffff (0x2163 bytes) 000859 1790920969.144630 trunc from 0x040000 to 0x00d722 (0x328dd bytes) 000860 1790920969.181622 punch from 0x00cac0 to 0x00d722 (0xc63 bytes) 000863 1790920969.190003 trunc from 0x00d723 to 0x00faf9 (0x23d7 bytes) 000865 1790920969.213388 mapread 0x001e4b thru 0x00e955 (0xcb0b bytes) 000867 1790920969.222718 trunc from 0x00fafa to 0x009688 (0x6471 bytes) 000869 1790920969.246541 mapread 0x00193b thru 0x007f4b (0x6611 bytes) 000870 1790920969.247418 read 0x0010a7 thru 0x006d5c (0x5cb6 bytes) 000871 1790920969.258444 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x9689): Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9689): Mirror 20: 0x50d252a6 (stale) Mirror 22: 0x50d252a6 (stale) Mirror 23: 0x50d252a6 (stale) Mirror 26: 0x50d252a6 (stale) Mirror 27: 0x50d252a6 (stale) Mirror 28: 0x50d252a6 (stale) Mirror 29: 0x50d252a6 (stale) Mirror 30: 0x50d252a6 (stale) Mirror 32: 0x50d252a6 (stale) Mirror 33: 0x50d252a6 (stale) CRC-32 checksum value for chunk [0, 0x9689): Mirror 1: 0x50d252a6 Mirror 34: 0x50d252a6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9689: skipped 000872 1790920970.859447 mapread 0x004d42 thru 0x0054da (0x799 bytes) 000873 1790920970.889442 trunc from 0x009689 to 0x02ea11 (0x25389 bytes) 000874 1790920971.208119 punch from 0x003b2f to 0x00b07f (0x7551 bytes) 000875 1790920971.221395 trunc from 0x02ea12 to 0x01d43b (0x115d6 bytes) 000877 1790920971.273454 read 0x00f9dc thru 0x014cd4 (0x52f9 bytes) 000878 1790920971.290447 mapread 0x006a8f thru 0x00d2d3 (0x6845 bytes) 000879 1790920971.310096 write 0x0059f1 thru 0x00bca9 (0x62b9 bytes) 000881 1790920971.313545 punch from 0x009e03 to 0x00cc81 (0x2e7f bytes) 000886 1790920971.341470 read 0x00cb33 thru 0x014703 (0x7bd1 bytes) 000887 1790920971.369441 trunc from 0x01d43c to 0x02249d (0x5062 bytes) 000888 1790920971.405488 mapwrite 0x008863 thru 0x017b8f (0xf32d bytes) 000890 1790920971.511881 trunc from 0x02249e to 0x02beac (0x9a0f bytes) 000892 1790920971.540328 mapwrite 0x015dec thru 0x01bb38 (0x5d4d bytes) 000893 1790920971.647867 trunc from 0x02bead to 0x03c0b8 (0x1020c bytes) 000894 1790920971.678650 trunc from 0x03c0b9 to 0x00c239 (0x2fe7f bytes) 000895 1790920971.698652 punch from 0x00a908 to 0x00c239 (0x1932 bytes) 000896 1790920971.706249 trunc from 0x00c23a to 0x013c71 (0x7a38 bytes) 000898 1790920971.741983 trunc from 0x013c72 to 0x030c34 (0x1cfc3 bytes) 000900 1790920971.787852 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x30c35): Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30c35): Mirror 20: 0xc14d6b5f (stale) Mirror 22: 0xc14d6b5f (stale) Mirror 23: 0xc14d6b5f (stale) Mirror 26: 0xc14d6b5f (stale) Mirror 27: 0xc14d6b5f (stale) Mirror 28: 0xc14d6b5f (stale) Mirror 29: 0xc14d6b5f (stale) Mirror 30: 0xc14d6b5f (stale) Mirror 32: 0xc14d6b5f (stale) Mirror 33: 0xc14d6b5f (stale) Mirror 34: 0xdd3417a (stale) CRC-32 checksum value for chunk [0, 0x30c35): Mirror 1: 0x2978d268 Mirror 35: 0x2978d268 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30c35: skipped 000901 1790920973.464655 punch from 0x01fccb to 0x022eb9 (0x31ef bytes) 000904 1790920973.566029 write 0x017100 thru 0x021b0a (0xaa0b bytes) 000909 1790920973.579396 trunc from 0x030c35 to 0x02113b (0xfaf9 bytes) 000910 1790920973.603408 read 0x01d6b9 thru 0x01edb7 (0x16ff bytes) 000912 1790920973.604879 punch from 0x00d3d6 to 0x00f390 (0x1fbb bytes) 000913 1790920973.618944 punch from 0x007a06 to 0x00bc9d (0x4298 bytes) 000916 1790920973.626147 mapwrite 0x031f51 thru 0x034237 (0x22e7 bytes) 000917 1790920973.749564 mapread 0x01f0ce thru 0x02dcc5 (0xebf8 bytes) 000918 1790920973.772965 mapread 0x001b87 thru 0x001f53 (0x3cd bytes) 000919 1790920973.786783 mapwrite 0x018ec9 thru 0x01c457 (0x358f bytes) 000921 1790920973.852828 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x34238): Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34238): Mirror 20: 0xe4adc4e2 (stale) Mirror 22: 0xe4adc4e2 (stale) Mirror 23: 0xe4adc4e2 (stale) Mirror 26: 0xe4adc4e2 (stale) Mirror 27: 0xe4adc4e2 (stale) Mirror 28: 0xe4adc4e2 (stale) Mirror 29: 0xe4adc4e2 (stale) Mirror 30: 0xe4adc4e2 (stale) Mirror 32: 0xe4adc4e2 (stale) Mirror 33: 0xe4adc4e2 (stale) Mirror 34: 0x3eb56eb9 (stale) Mirror 35: 0xfd2b19b0 (stale) CRC-32 checksum value for chunk [0, 0x34238): Mirror 1: 0xa94715d6 Mirror 36: 0xa94715d6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34238: skipped 000922 1790920975.327390 punch from 0x00fd23 to 0x01dba1 (0xde7f bytes) 000923 1790920975.453602 MIRROR_RESYNC 14 mirrors 000924 1790920978.164421 MIRROR_EXTEND to 15 mirrors 000925 1790920979.830633 write 0x03c5ec thru 0x03dadf (0x14f4 bytes) 000926 1790920980.045340 punch from 0x00dde8 to 0x00e2a5 (0x4be bytes) 000928 1790920980.060207 punch from 0x01e498 to 0x02d9be (0xf527 bytes) 000929 1790920980.066250 mapwrite 0x013123 thru 0x0230af (0xff8d bytes) 000930 1790920980.199675 trunc from 0x03dae0 to 0x01724d (0x26892 bytes) 000932 1790920980.228109 mapread 0x015f65 thru 0x01724d (0x12e9 bytes) 000933 1790920980.231549 mapwrite 0x001861 thru 0x00547c (0x3c1c bytes) 000934 1790920980.307142 mapwrite 0x0041f3 thru 0x0081fb (0x4009 bytes) 000935 1790920980.363391 mapwrite 0x00b7b3 thru 0x0136b4 (0x7f02 bytes) 000936 1790920980.422223 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x1724e): Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1724e): Mirror 20: 0x32224bc0 (stale) Mirror 22: 0x32224bc0 (stale) Mirror 23: 0x32224bc0 (stale) Mirror 26: 0x32224bc0 (stale) Mirror 27: 0x32224bc0 (stale) Mirror 28: 0x32224bc0 (stale) Mirror 29: 0x32224bc0 (stale) Mirror 30: 0x32224bc0 (stale) Mirror 32: 0x32224bc0 (stale) Mirror 33: 0x32224bc0 (stale) Mirror 34: 0x32224bc0 (stale) Mirror 35: 0x32224bc0 (stale) Mirror 36: 0x32224bc0 (stale) Mirror 37: 0x32224bc0 (stale) CRC-32 checksum value for chunk [0, 0x1724e): Mirror 1: 0x4792a8b6 Mirror 38: 0x4792a8b6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1724e: skipped 000937 1790920982.062564 mapwrite 0x01bb3f thru 0x01d14c (0x160e bytes) 000940 1790920982.577499 MIRROR_SPLIT mirror 12 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1d14d): Mirror 20: 0x6e4aca2b (stale) Mirror 22: 0x6e4aca2b (stale) Mirror 23: 0x6e4aca2b (stale) Mirror 26: 0x6e4aca2b (stale) Mirror 27: 0x6e4aca2b (stale) Mirror 28: 0x6e4aca2b (stale) Mirror 29: 0x6e4aca2b (stale) Mirror 30: 0x6e4aca2b (stale) Mirror 32: 0x6e4aca2b (stale) Mirror 33: 0x6e4aca2b (stale) Mirror 34: 0x6e4aca2b (stale) Mirror 36: 0x6e4aca2b (stale) Mirror 37: 0x6e4aca2b (stale) Mirror 38: 0xc60143f2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d14d): Mirror 20: 0x6e4aca2b (stale) Mirror 22: 0x6e4aca2b (stale) Mirror 23: 0x6e4aca2b (stale) Mirror 26: 0x6e4aca2b (stale) Mirror 27: 0x6e4aca2b (stale) Mirror 28: 0x6e4aca2b (stale) Mirror 29: 0x6e4aca2b (stale) Mirror 30: 0x6e4aca2b (stale) Mirror 32: 0x6e4aca2b (stale) Mirror 33: 0x6e4aca2b (stale) Mirror 34: 0x6e4aca2b (stale) Mirror 36: 0x6e4aca2b (stale) Mirror 37: 0x6e4aca2b (stale) Mirror 38: 0xc60143f2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d14d: skipped 000942 1790920983.679916 write 0x0136d1 thru 0x01eaaf (0xb3df bytes) 000943 1790920983.689002 mapread 0x005c07 thru 0x01440d (0xe807 bytes) 000944 1790920983.720542 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x1eab0): Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) Mirror 38: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1eab0): Mirror 20: 0x2c53b860 (stale) Mirror 22: 0x2c53b860 (stale) Mirror 23: 0x2c53b860 (stale) Mirror 26: 0x2c53b860 (stale) Mirror 27: 0x2c53b860 (stale) Mirror 28: 0x2c53b860 (stale) Mirror 29: 0x2c53b860 (stale) Mirror 30: 0x2c53b860 (stale) Mirror 32: 0x2c53b860 (stale) Mirror 33: 0x2c53b860 (stale) Mirror 34: 0x2c53b860 (stale) Mirror 36: 0x2c53b860 (stale) Mirror 37: 0x2c53b860 (stale) Mirror 38: 0xe91cb218 (stale) CRC-32 checksum value for chunk [0, 0x1eab0): Mirror 1: 0x83cb877f Mirror 39: 0x83cb877f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1eab0: skipped 000945 1790920985.666878 mapwrite 0x01aa79 thru 0x026cd1 (0xc259 bytes) 000946 1790920985.981114 trunc from 0x026cd2 to 0x01f0a8 (0x7c29 bytes) 000948 1790920986.018226 read 0x0116c3 thru 0x01c1df (0xab1d bytes) 000949 1790920986.027613 mapread 0x00a5bb thru 0x00a723 (0x169 bytes) 000950 1790920986.075138 punch from 0x00730c to 0x012f8a (0xbc7f bytes) 000953 1790920986.089076 write 0x031d2d thru 0x036bdd (0x4eb1 bytes) 000954 1790920986.090925 read 0x022e06 thru 0x02c58f (0x978a bytes) 000955 1790920986.104274 write 0x0221ec thru 0x02251b (0x330 bytes) 000956 1790920986.106554 read 0x02fa47 thru 0x031bc1 (0x217b bytes) 000959 1790920986.109632 trunc from 0x036bde to 0x026cfe (0xfedf bytes) 000960 1790920986.130354 punch from 0x022ca5 to 0x026cfe (0x405a bytes) 000962 1790920986.142385 mapwrite 0x003230 thru 0x007d09 (0x4ada bytes) 000963 1790920986.239333 punch from 0x007b1c to 0x00a810 (0x2cf5 bytes) 000968 1790920986.251726 mapread 0x00811a thru 0x01514b (0xd032 bytes) 000971 1790920986.268854 write 0x00b179 thru 0x017400 (0xc288 bytes) 000972 1790920986.270426 punch from 0x019765 to 0x022816 (0x90b2 bytes) 000973 1790920986.287865 mapwrite 0x036718 thru 0x03d1de (0x6ac7 bytes) 000975 1790920986.395213 MIRROR_SPLIT mirror 5 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d1df): Mirror 20: 0x4f50fd72 (stale) Mirror 22: 0x4f50fd72 (stale) Mirror 23: 0x4f50fd72 (stale) Mirror 26: 0x4f50fd72 (stale) Mirror 28: 0x4f50fd72 (stale) Mirror 29: 0x4f50fd72 (stale) Mirror 30: 0x4f50fd72 (stale) Mirror 32: 0x4f50fd72 (stale) Mirror 33: 0x4f50fd72 (stale) Mirror 34: 0x4f50fd72 (stale) Mirror 36: 0x4f50fd72 (stale) Mirror 37: 0x4f50fd72 (stale) Mirror 38: 0x972495e7 (stale) Mirror 39: 0x7995fa51 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d1df): Mirror 20: 0x4f50fd72 (stale) Mirror 22: 0x4f50fd72 (stale) Mirror 23: 0x4f50fd72 (stale) Mirror 26: 0x4f50fd72 (stale) Mirror 28: 0x4f50fd72 (stale) Mirror 29: 0x4f50fd72 (stale) Mirror 30: 0x4f50fd72 (stale) Mirror 32: 0x4f50fd72 (stale) Mirror 33: 0x4f50fd72 (stale) Mirror 34: 0x4f50fd72 (stale) Mirror 36: 0x4f50fd72 (stale) Mirror 37: 0x4f50fd72 (stale) Mirror 38: 0x972495e7 (stale) Mirror 39: 0x7995fa51 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d1df: skipped 000980 1790920987.611847 read 0x033b39 thru 0x034e7e (0x1346 bytes) 000982 1790920987.619083 mapwrite 0x0338d4 thru 0x03fdae (0xc4db bytes) 000984 1790920987.723061 write 0x00a3a9 thru 0x010a01 (0x6659 bytes) 000985 1790920987.736063 punch from 0x018b31 to 0x025dda (0xd2aa bytes) 000986 1790920987.756343 mapread 0x03d437 thru 0x03fdae (0x2978 bytes) 000988 1790920987.757944 read 0x03014d thru 0x03a436 (0xa2ea bytes) 000990 1790920987.759845 mapread 0x01c27d thru 0x01f0f7 (0x2e7b bytes) 000991 1790920987.794830 MIRROR_RESYNC 15 mirrors 000993 1790920991.662850 mapwrite 0x03977e thru 0x03b3ee (0x1c71 bytes) 000994 1790920991.886848 read 0x03dee4 thru 0x03fdae (0x1ecb bytes) 000995 1790920991.888062 punch from 0x01f0b3 to 0x0238e2 (0x4830 bytes) 000996 1790920991.897043 MIRROR_SPLIT mirror 4 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fdaf): Mirror 20: 0x2e9abffb (stale) Mirror 22: 0x2e9abffb (stale) Mirror 23: 0x2e9abffb (stale) Mirror 28: 0x2e9abffb (stale) Mirror 29: 0x2e9abffb (stale) Mirror 30: 0x2e9abffb (stale) Mirror 32: 0x2e9abffb (stale) Mirror 33: 0x2e9abffb (stale) Mirror 34: 0x2e9abffb (stale) Mirror 36: 0x2e9abffb (stale) Mirror 37: 0x2e9abffb (stale) Mirror 38: 0x2e9abffb (stale) Mirror 39: 0x2e9abffb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fdaf): Mirror 20: 0x2e9abffb (stale) Mirror 22: 0x2e9abffb (stale) Mirror 23: 0x2e9abffb (stale) Mirror 28: 0x2e9abffb (stale) Mirror 29: 0x2e9abffb (stale) Mirror 30: 0x2e9abffb (stale) Mirror 32: 0x2e9abffb (stale) Mirror 33: 0x2e9abffb (stale) Mirror 34: 0x2e9abffb (stale) Mirror 36: 0x2e9abffb (stale) Mirror 37: 0x2e9abffb (stale) Mirror 38: 0x2e9abffb (stale) Mirror 39: 0x2e9abffb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fdaf: skipped 000997 1790920992.808148 mapwrite 0x03f1d5 thru 0x03ffff (0xe2b bytes) 000998 1790920992.923088 trunc from 0x040000 to 0x014d45 (0x2b2ba bytes) All operations completed A-OK!