== sanity-flr test 70a: flr mode fsx test ================ 07:15:58 (1788866158) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 6161 truncating to largest ever: 0x1e6c3 000001 1788866161.274406 trunc from 00000000 to 0x01e6c2 (0x1e6c3 bytes) 000002 1788866161.295656 trunc from 0x01e6c3 to 0x00781d (0x16ea5 bytes) 000003 1788866161.316307 trunc from 0x00278f to 0x00781d (0x508f bytes) 000004 1788866161.320656 mapwrite 0x00b47b thru 0x01211d (0x6ca3 bytes) 000005 1788866161.396931 punch from 0x009e51 to 0x00a35d (0x50d bytes) 000006 1788866161.406329 MIRROR_EXTEND to 2 mirrors 000007 1788866161.945158 read 0x000929 thru 0x00b90e (0xafe6 bytes) 000008 1788866161.957218 punch from 0x00c363 to 0x00e713 (0x23b1 bytes) 000010 1788866162.000372 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1211e): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1211e): Mirror 2: 0x148fe40a (stale) CRC-32 checksum value for chunk [0, 0x1211e): Mirror 1: 0x2fa2b214 Mirror 3: 0x2fa2b214 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1211e: skipped 000012 1788866162.828944 mapwrite 0x032834 thru 0x0396e5 (0x6eb2 bytes) 000013 1788866162.913551 read 0x02624b thru 0x031d3d (0xbaf3 bytes) 000014 1788866162.921997 read 0x025889 thru 0x030cd2 (0xb44a bytes) 000015 1788866162.931776 trunc from 0x0396e6 to 0x000ff8 (0x386ed bytes) 000016 1788866162.954365 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xff9): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xff9): Mirror 2: 0xd67d7f17 (stale) Mirror 3: 0xd67d7f17 (stale) CRC-32 checksum value for chunk [0, 0xff9): Mirror 1: 0xd67d7f17 Mirror 4: 0xd67d7f17 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xff9: skipped 000017 1788866164.005985 trunc from 0x000713 to 0x000ff8 (0x8e6 bytes) 000019 1788866164.074169 mapread 0x0006ff thru 0x000ff8 (0x8fa bytes) 000020 1788866164.086645 mapread 0x000f9f thru 0x000ff8 (0x5a bytes) 000022 1788866164.088697 fallocate 0x0071e1 thru 0x00a156 (0x2f76 bytes) 000023 1788866164.093647 punch from 0x0082a9 to 0x00a156 (0x1eae bytes) 000024 1788866164.097973 punch from 0x001aec to 0x009d2e (0x8243 bytes) 000025 1788866164.102891 read 0x00448d thru 0x00a156 (0x5cca bytes) 000026 1788866164.121792 MIRROR_RESYNC 4 mirrors 000027 1788866164.872025 MIRROR_EXTEND to 5 mirrors 000028 1788866165.451388 write 0x004f4f thru 0x00707e (0x2130 bytes) 000029 1788866165.497583 trunc from 0x00a157 to 0x01d1b6 (0x13060 bytes) 000030 1788866165.513843 read 0x0005ce thru 0x01038e (0xfdc1 bytes) 000031 1788866165.522904 mapwrite 0x03d00e thru 0x03eeeb (0x1ede bytes) 000032 1788866165.556037 punch from 0x01d9d4 to 0x0213f2 (0x3a1f bytes) 000033 1788866165.559167 mapread 0x004f4c thru 0x00a2b9 (0x536e bytes) truncating to largest ever: 0x2b1df 000035 1788866165.561447 trunc from 0x03eeec to 0x02b1de (0x13d0d bytes) 000036 1788866165.574902 mapwrite 0x0249f7 thru 0x028faa (0x45b4 bytes) 000038 1788866165.603814 MIRROR_RESYNC 5 mirrors 000040 1788866166.982875 MIRROR_RESYNC 5 mirrors 000041 1788866167.439314 write 0x002821 thru 0x00d9df (0xb1bf bytes) 000043 1788866167.514169 punch from 0x016580 to 0x017cdf (0x1760 bytes) 000044 1788866167.519853 trunc from 0x02b1df to 0x012564 (0x18c7a bytes) 000045 1788866167.575722 mapread 0x002260 thru 0x00e403 (0xc1a4 bytes) 000046 1788866167.586787 fallocate 0x01f745 thru 0x024283 (0x4b3f bytes) 000047 1788866167.597542 punch from 0x003a8f to 0x0050e8 (0x165a bytes) 000048 1788866167.639830 mapread 0x002b55 thru 0x00cea7 (0xa353 bytes) 000049 1788866167.669396 punch from 0x00e0db to 0x012564 (0x448a bytes) 000050 1788866167.681239 mapwrite 0x02872c thru 0x0288bc (0x191 bytes) 000051 1788866167.754818 punch from 0x002e23 to 0x004785 (0x1963 bytes) 000052 1788866167.760113 trunc from 0x0072a7 to 0x012a9a (0xb7f4 bytes) fallocating to largest ever: 0x2c9e6 000053 1788866167.777152 fallocate 0x01ccfe thru 0x02c9e5 (0xfce8 bytes) 000054 1788866167.795720 mapwrite 0x0360bc thru 0x03ffff (0x9f44 bytes) 000055 1788866167.862498 trunc from 0x02508c to 0x02b049 (0x5fbe bytes) truncating to largest ever: 0x39624 000056 1788866167.871868 trunc from 0x040000 to 0x039623 (0x69dc bytes) 000057 1788866167.895561 mapread 0x038104 thru 0x039623 (0x1520 bytes) 000058 1788866167.896696 trunc from 0x01aade to 0x027c8d (0xd1b0 bytes) 000059 1788866167.904490 mapread 0x019f3e thru 0x024af2 (0xabb5 bytes) 000060 1788866167.934564 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x39624): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39624): Mirror 2: 0x9dfad7d8 (stale) Mirror 3: 0x9dfad7d8 (stale) Mirror 4: 0x9dfad7d8 (stale) Mirror 5: 0x9dfad7d8 (stale) CRC-32 checksum value for chunk [0, 0x39624): Mirror 1: 0xf1895214 Mirror 6: 0xf1895214 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39624: skipped 000061 1788866168.993871 read 0x02e700 thru 0x039623 (0xaf24 bytes) 000062 1788866169.014701 trunc from 0x028415 to 0x0289ac (0x598 bytes) 000064 1788866169.076281 MIRROR_RESYNC 6 mirrors 000065 1788866170.848600 MIRROR_EXTEND to 7 mirrors 000066 1788866172.008634 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) 000067 1788866172.554233 punch from 0x014b45 to 0x01d5cb (0x8a87 bytes) 000068 1788866172.658322 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x39624): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39624): Mirror 2: 0xf1895214 (stale) Mirror 4: 0xf1895214 (stale) Mirror 5: 0xf1895214 (stale) Mirror 6: 0xf1895214 (stale) Mirror 7: 0xf1895214 (stale) CRC-32 checksum value for chunk [0, 0x39624): Mirror 1: 0xf1895214 Mirror 8: 0xf1895214 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39624: skipped 000069 1788866174.097918 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39624): Mirror 2: 0xf1895214 (stale) Mirror 4: 0xf1895214 (stale) Mirror 5: 0xf1895214 (stale) Mirror 6: 0xf1895214 (stale) Mirror 7: 0xf1895214 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39624): Mirror 2: 0xf1895214 (stale) Mirror 4: 0xf1895214 (stale) Mirror 5: 0xf1895214 (stale) Mirror 6: 0xf1895214 (stale) Mirror 7: 0xf1895214 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39624: skipped 000070 1788866174.658283 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x39624): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39624): Mirror 2: 0xf1895214 (stale) Mirror 4: 0xf1895214 (stale) Mirror 5: 0xf1895214 (stale) Mirror 6: 0xf1895214 (stale) Mirror 7: 0xf1895214 (stale) CRC-32 checksum value for chunk [0, 0x39624): Mirror 1: 0xf1895214 Mirror 8: 0xf1895214 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39624: skipped 000071 1788866175.948726 mapread 0x01b30e thru 0x01b687 (0x37a bytes) 000072 1788866175.975977 mapread 0x026c6f thru 0x036a6e (0xfe00 bytes) fallocating to largest ever: 0x40000 000073 1788866176.066853 fallocate 0x03e917 thru 0x03ffff (0x16e9 bytes) 000074 1788866176.139898 write 0x03705d thru 0x037e37 (0xddb bytes) 000075 1788866176.149787 fallocate 0x00d63f thru 0x0174ec (0x9eae bytes) 000077 1788866176.155660 read 0x006af4 thru 0x012669 (0xbb76 bytes) 000079 1788866176.169657 write 0x03fb7f thru 0x03ffff (0x481 bytes) 000080 1788866176.170639 punch from 0x039461 to 0x03a0da (0xc7a bytes) 000081 1788866176.178921 trunc from 0x03e6b3 to 0x03ffff (0x194d bytes) 000082 1788866176.194497 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x131c5841 (stale) Mirror 4: 0x131c5841 (stale) Mirror 5: 0x131c5841 (stale) Mirror 7: 0x131c5841 (stale) Mirror 8: 0x131c5841 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x131c5841 (stale) Mirror 4: 0x131c5841 (stale) Mirror 5: 0x131c5841 (stale) Mirror 7: 0x131c5841 (stale) Mirror 8: 0x131c5841 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000084 1788866176.723235 MIRROR_RESYNC 6 mirrors 000085 1788866179.203886 trunc from 0x040000 to 0x037061 (0x8f9e bytes) 000086 1788866179.293900 mapwrite 0x017543 thru 0x01c681 (0x513f bytes) 000088 1788866179.389499 read 0x028812 thru 0x034c67 (0xc456 bytes) 000089 1788866179.421925 trunc from 0x00b277 to 0x016ac8 (0xb852 bytes) 000090 1788866179.440840 mapread 0x00ef54 thru 0x018b2e (0x9bdb bytes) 000091 1788866179.477804 trunc from 0x037062 to 0x01ac0d (0x1c454 bytes) 000092 1788866179.548438 fallocate 0x03f569 thru 0x03ffff (0xa97 bytes) 000093 1788866179.554904 fallocate 0x010062 thru 0x01dbb9 (0xdb58 bytes) 000094 1788866179.561105 mapwrite 0x00e60c thru 0x01d1f9 (0xebee bytes) 000095 1788866179.610662 fallocate 0x01a697 thru 0x02021e (0x5b88 bytes) 000096 1788866179.623037 trunc from 0x03f8a5 to 0x03ffff (0x75b bytes) 000097 1788866179.636415 trunc from 0x040000 to 0x03ce13 (0x31ec bytes) 000098 1788866179.718136 trunc from 0x017dae to 0x01b07e (0x32d1 bytes) 000099 1788866179.725492 fallocate 0x01c290 thru 0x01f456 (0x31c7 bytes) 000100 1788866179.733261 mapread 0x012a70 thru 0x012cb2 (0x243 bytes) 000101 1788866179.739942 trunc from 0x03ce14 to 0x020f0a (0x1bf09 bytes) 000102 1788866179.784876 mapread 0x00b301 thru 0x017d79 (0xca79 bytes) 000103 1788866179.798178 fallocate 0x00c9e1 thru 0x00e917 (0x1f37 bytes) 000104 1788866179.806868 punch from 0x01a175 to 0x020f0a (0x6d96 bytes) 000105 1788866179.812573 mapread 0x020eb1 thru 0x020f0a (0x5a bytes) 000106 1788866179.832988 trunc from 0x015daf to 0x01ec15 (0x8e67 bytes) 000107 1788866179.837707 mapwrite 0x00bee7 thru 0x01a2e6 (0xe400 bytes) 000108 1788866179.879856 trunc from 0x020f0b to 0x010944 (0x105c6 bytes) 000109 1788866179.913782 mapwrite 0x03544f thru 0x035abf (0x671 bytes) 000110 1788866179.979439 read 0x00fa78 thru 0x01207c (0x2605 bytes) 000112 1788866180.000845 MIRROR_RESYNC 6 mirrors 000113 1788866182.614873 fallocate 0x016668 thru 0x019ee5 (0x387e bytes) 000114 1788866182.689794 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35ac0): Mirror 4: 0xd1a02c1c (stale) Mirror 5: 0xd1a02c1c (stale) Mirror 7: 0xd1a02c1c (stale) Mirror 8: 0xd1a02c1c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35ac0): Mirror 4: 0xd1a02c1c (stale) Mirror 5: 0xd1a02c1c (stale) Mirror 7: 0xd1a02c1c (stale) Mirror 8: 0xd1a02c1c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35ac0: skipped 000116 1788866183.482256 mapread 0x023ba3 thru 0x02e93b (0xad99 bytes) 000117 1788866183.522407 trunc from 0x035ac0 to 0x01d9c2 (0x180fd bytes) 000118 1788866183.568990 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1d9c3): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d9c3): Mirror 4: 0x19af519c (stale) Mirror 5: 0x19af519c (stale) Mirror 7: 0x19af519c (stale) Mirror 8: 0x19af519c (stale) CRC-32 checksum value for chunk [0, 0x1d9c3): Mirror 1: 0x19af519c Mirror 9: 0x19af519c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d9c3: skipped 000119 1788866185.520960 fallocate 0x02fae2 thru 0x03caa7 (0xcfc6 bytes) 000121 1788866185.611792 punch from 0x01e58c to 0x01fbcd (0x1642 bytes) 000122 1788866185.641296 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3caa8): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3caa8): Mirror 4: 0xa1bbf55c (stale) Mirror 5: 0xa1bbf55c (stale) Mirror 7: 0xa1bbf55c (stale) Mirror 8: 0xa1bbf55c (stale) Mirror 9: 0xe9f22870 (stale) CRC-32 checksum value for chunk [0, 0x3caa8): Mirror 1: 0xe9f22870 Mirror 10: 0xe9f22870 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3caa8: skipped 000123 1788866186.903404 write 0x03c88d thru 0x03ffff (0x3773 bytes) 000124 1788866186.979523 trunc from 0x040000 to 0x02fecf (0x10130 bytes) 000125 1788866187.022426 mapwrite 0x03f562 thru 0x03ffff (0xa9e bytes) 000126 1788866187.092229 MIRROR_RESYNC 7 mirrors 000127 1788866190.106232 punch from 0x028240 to 0x03533d (0xd0fe bytes) 000128 1788866190.232511 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xd3764868 (stale) Mirror 5: 0xd3764868 (stale) Mirror 7: 0xd3764868 (stale) Mirror 8: 0xd3764868 (stale) Mirror 9: 0xd3764868 (stale) Mirror 10: 0xd3764868 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd3764868 Mirror 11: 0xd3764868 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000129 1788866191.905644 trunc from 0x01cbd2 to 0x01fecc (0x32fb bytes) 000130 1788866191.984549 trunc from 0x040000 to 0x020535 (0x1faca bytes) 000131 1788866192.022882 mapread 0x0198e4 thru 0x01ec82 (0x539f bytes) 000132 1788866192.061834 trunc from 0x0167a1 to 0x020535 (0x9d95 bytes) 000133 1788866192.080168 write 0x03afff thru 0x03ffff (0x5001 bytes) 000134 1788866192.083544 trunc from 0x036e23 to 0x03ffff (0x91dd bytes) 000135 1788866192.120818 mapread 0x018e3c thru 0x01a60f (0x17d4 bytes) 000136 1788866192.134962 mapwrite 0x036aba thru 0x03982f (0x2d76 bytes) 000137 1788866192.154710 trunc from 0x040000 to 0x03c9d5 (0x362a bytes) 000139 1788866192.164801 fallocate 0x00d924 thru 0x00fe78 (0x2555 bytes) 000140 1788866192.168304 fallocate 0x013544 thru 0x01de52 (0xa90f bytes) 000141 1788866192.171243 fallocate 0x01382a thru 0x021dbf (0xe596 bytes) 000142 1788866192.179566 mapwrite 0x036c77 thru 0x0378e9 (0xc73 bytes) 000143 1788866192.194378 read 0x012d4b thru 0x01b3f1 (0x86a7 bytes) 000144 1788866192.194851 trunc from 0x03c9d6 to 0x021442 (0x1b593 bytes) 000145 1788866192.206603 fallocate 0x01c841 thru 0x01cd4b (0x50b bytes) 000146 1788866192.218358 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x21443): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21443): Mirror 4: 0x434f2eca (stale) Mirror 5: 0x434f2eca (stale) Mirror 7: 0x434f2eca (stale) Mirror 8: 0x434f2eca (stale) Mirror 9: 0x434f2eca (stale) Mirror 10: 0x434f2eca (stale) Mirror 11: 0x434f2eca (stale) CRC-32 checksum value for chunk [0, 0x21443): Mirror 1: 0x434f2eca Mirror 12: 0x434f2eca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21443: skipped 000147 1788866193.241362 write 0x024578 thru 0x027428 (0x2eb1 bytes) 000148 1788866193.321673 mapread 0x01b4a7 thru 0x027428 (0xbf82 bytes) 000149 1788866193.365375 mapwrite 0x00190f thru 0x004b7c (0x326e bytes) 000150 1788866193.393319 write 0x02451e thru 0x031ad6 (0xd5b9 bytes) 000151 1788866193.394944 trunc from 0x003faa to 0x005b96 (0x1bed bytes) 000152 1788866193.402337 mapread 0x0163b7 thru 0x023e6d (0xdab7 bytes) 000153 1788866193.403688 read 0x0046b1 thru 0x008a3c (0x438c bytes) 000154 1788866193.415862 punch from 0x0170c7 to 0x0218b9 (0xa7f3 bytes) 000155 1788866193.424008 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x31ad7): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31ad7): Mirror 4: 0x152fa90d (stale) Mirror 5: 0x152fa90d (stale) Mirror 7: 0x152fa90d (stale) Mirror 8: 0x152fa90d (stale) Mirror 9: 0x152fa90d (stale) Mirror 10: 0x152fa90d (stale) Mirror 11: 0x152fa90d (stale) Mirror 12: 0x152fa90d (stale) CRC-32 checksum value for chunk [0, 0x31ad7): Mirror 1: 0x2bb647a3 Mirror 13: 0x2bb647a3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31ad7: skipped 000156 1788866194.897935 trunc from 0x031ad7 to 0x03517e (0x36a8 bytes) 000157 1788866194.949602 mapread 0x023d7b thru 0x030519 (0xc79f bytes) 000158 1788866194.988212 mapread 0x01e158 thru 0x029fe4 (0xbe8d bytes) 000159 1788866194.989493 mapread 0x03226e thru 0x033e3a (0x1bcd bytes) 000160 1788866194.991362 fallocate 0x02c6d1 thru 0x03a1c3 (0xdaf3 bytes) 000161 1788866194.996326 read 0x010651 thru 0x01193e (0x12ee bytes) 000163 1788866195.002234 write 0x00cb18 thru 0x018c5c (0xc145 bytes) 000165 1788866195.016948 trunc from 0x024c6f to 0x02c287 (0x7619 bytes) 000166 1788866195.028902 MIRROR_RESYNC 10 mirrors 000167 1788866198.826254 read 0x00839a thru 0x0096dc (0x1343 bytes) 000168 1788866198.832040 trunc from 0x010e8d to 0x0135b2 (0x2726 bytes) 000169 1788866198.886541 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3517f): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3517f): Mirror 4: 0x4db6a0ea (stale) Mirror 5: 0x4db6a0ea (stale) Mirror 7: 0x4db6a0ea (stale) Mirror 8: 0x4db6a0ea (stale) Mirror 9: 0x4db6a0ea (stale) Mirror 10: 0x4db6a0ea (stale) Mirror 11: 0x4db6a0ea (stale) Mirror 12: 0x4db6a0ea (stale) Mirror 13: 0x4db6a0ea (stale) CRC-32 checksum value for chunk [0, 0x3517f): Mirror 1: 0xc86c21aa Mirror 14: 0xc86c21aa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3517f: skipped 000170 1788866200.656628 mapwrite 0x00fd3d thru 0x017a8a (0x7d4e bytes) 000171 1788866200.876561 read 0x01de23 thru 0x022a3f (0x4c1d bytes) 000173 1788866200.903026 punch from 0x0223a7 to 0x028081 (0x5cdb bytes) 000174 1788866200.908374 read 0x02c1d4 thru 0x03517e (0x8fab bytes) 000176 1788866200.924217 mapwrite 0x01d4b6 thru 0x02025a (0x2da5 bytes) 000177 1788866200.947042 write 0x030b60 thru 0x037ae2 (0x6f83 bytes) 000178 1788866200.959337 mapread 0x034a43 thru 0x037ae2 (0x30a0 bytes) 000179 1788866200.961047 write 0x02c794 thru 0x03474f (0x7fbc bytes) 000180 1788866200.973334 fallocate 0x005e1c thru 0x00c6cc (0x68b1 bytes) 000181 1788866200.986434 trunc from 0x017f25 to 0x022729 (0xa805 bytes) 000182 1788866200.994657 fallocate 0x036150 thru 0x036b58 (0xa09 bytes) 000183 1788866201.004450 punch from 0x009085 to 0x018814 (0xf790 bytes) 000184 1788866201.013554 fallocate 0x00a494 thru 0x019de9 (0xf956 bytes) 000185 1788866201.030503 mapread 0x03742d thru 0x037ae2 (0x6b6 bytes) 000186 1788866201.036361 write 0x001f9a thru 0x00484a (0x28b1 bytes) 000187 1788866201.040712 fallocate 0x0237ec thru 0x029264 (0x5a79 bytes) 000188 1788866201.068531 punch from 0x036526 to 0x037ae2 (0x15bd bytes) 000191 1788866201.122971 write 0x001a49 thru 0x00e23c (0xc7f4 bytes) 000192 1788866201.142969 write 0x03e479 thru 0x03ffff (0x1b87 bytes) 000193 1788866201.143937 trunc from 0x040000 to 0x02e300 (0x11cff bytes) 000194 1788866201.215603 fallocate 0x0222fe thru 0x031ffc (0xfcff bytes) 000195 1788866201.235487 read 0x01fd7b thru 0x0220e4 (0x236a bytes) 000196 1788866201.268398 punch from 0x017b7c to 0x01ddcb (0x6250 bytes) 000197 1788866201.294261 mapread 0x01f087 thru 0x02468b (0x5605 bytes) 000198 1788866201.334972 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x31ffd): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31ffd): Mirror 4: 0x8702fb3e (stale) Mirror 5: 0x8702fb3e (stale) Mirror 7: 0x8702fb3e (stale) Mirror 8: 0x8702fb3e (stale) Mirror 9: 0x8702fb3e (stale) Mirror 10: 0x8702fb3e (stale) Mirror 11: 0x8702fb3e (stale) Mirror 12: 0x8702fb3e (stale) Mirror 13: 0x8702fb3e (stale) Mirror 14: 0x93a1914a (stale) CRC-32 checksum value for chunk [0, 0x31ffd): Mirror 1: 0xe82fe5f1 Mirror 15: 0xe82fe5f1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31ffd: skipped 000199 1788866203.275059 read 0x020517 thru 0x02d416 (0xcf00 bytes) 000202 1788866203.320503 write 0x02b19d thru 0x0369ed (0xb851 bytes) 000203 1788866203.377236 trunc from 0x0369ee to 0x00dc3e (0x28daf bytes) 000204 1788866203.403514 punch from 0x008af4 to 0x00cd1e (0x422b bytes) 000205 1788866203.411359 write 0x028f2c thru 0x033d5f (0xae34 bytes) 000206 1788866203.413810 punch from 0x00cef6 to 0x0117c6 (0x48d1 bytes) 000207 1788866203.423255 mapwrite 0x01173e thru 0x019a95 (0x8358 bytes) 000208 1788866203.491063 mapread 0x00f8cd thru 0x01f550 (0xfc84 bytes) 000209 1788866203.501608 trunc from 0x033d60 to 0x00394a (0x30415 bytes) 000210 1788866203.538888 write 0x037cb8 thru 0x03cec5 (0x520e bytes) 000211 1788866203.546954 read 0x037729 thru 0x039cba (0x2592 bytes) 000212 1788866203.550620 write 0x009b15 thru 0x014ebe (0xb3aa bytes) 000213 1788866203.569704 trunc from 0x021e68 to 0x02f416 (0xd5af bytes) 000214 1788866203.585722 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3cec6): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cec6): Mirror 4: 0x9ed92eee (stale) Mirror 5: 0x9ed92eee (stale) Mirror 7: 0x9ed92eee (stale) Mirror 8: 0x9ed92eee (stale) Mirror 9: 0x9ed92eee (stale) Mirror 10: 0x9ed92eee (stale) Mirror 11: 0x9ed92eee (stale) Mirror 12: 0x9ed92eee (stale) Mirror 13: 0x9ed92eee (stale) Mirror 14: 0xe97774c3 (stale) Mirror 15: 0x5c74bf43 (stale) CRC-32 checksum value for chunk [0, 0x3cec6): Mirror 1: 0x6e217e9b Mirror 16: 0x6e217e9b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cec6: skipped 000215 1788866205.522923 trunc from 0x03cec6 to 0x001327 (0x3bb9e bytes) 000216 1788866205.633776 read 0x0005ad thru 0x001327 (0xd7b bytes) 000217 1788866205.651742 write 0x0260b9 thru 0x030371 (0xa2b9 bytes) 000218 1788866205.655886 trunc from 0x030372 to 0x016175 (0x1a1fc bytes) 000220 1788866205.702695 fallocate 0x03f993 thru 0x03ffff (0x66d bytes) 000222 1788866205.715005 write 0x02db5e thru 0x03760b (0x9aae bytes) 000223 1788866205.734292 mapwrite 0x00c27c thru 0x00cf82 (0xd07 bytes) 000226 1788866205.774163 trunc from 0x040000 to 0x0316d5 (0xe92a bytes) 000227 1788866205.791766 trunc from 0x0142d7 to 0x020d49 (0xca73 bytes) 000228 1788866205.797867 mapwrite 0x02db37 thru 0x031ff8 (0x44c2 bytes) 000229 1788866205.834270 trunc from 0x031ff9 to 0x01874e (0x198aa bytes) 000230 1788866205.858185 read 0x00c707 thru 0x012936 (0x6230 bytes) 000231 1788866205.877906 trunc from 0x01874f to 0x00fa6b (0x8ce3 bytes) 000232 1788866205.892894 mapwrite 0x0365a9 thru 0x03ffff (0x9a57 bytes) 000233 1788866205.981336 read 0x03b3c0 thru 0x03ffff (0x4c40 bytes) 000234 1788866205.982022 read 0x019640 thru 0x01c4ba (0x2e7b bytes) 000235 1788866205.989110 trunc from 0x040000 to 0x01200a (0x2dff5 bytes) 000236 1788866206.058235 punch from 0x00765d to 0x009d46 (0x26ea bytes) 000237 1788866206.069549 mapread 0x003e9e thru 0x009d2c (0x5e8f bytes) 000238 1788866206.115323 write 0x0386e0 thru 0x03c5f0 (0x3f11 bytes) 000239 1788866206.120361 write 0x0383b1 thru 0x03cb19 (0x4769 bytes) 000240 1788866206.122493 mapread 0x015a1c thru 0x0238fa (0xdedf bytes) 000243 1788866206.141363 mapwrite 0x039466 thru 0x03ffff (0x6b9a bytes) 000244 1788866206.286242 punch from 0x015278 to 0x01e29b (0x9024 bytes) 000245 1788866206.298950 trunc from 0x03e59b to 0x03ffff (0x1a65 bytes) 000246 1788866206.311606 mapwrite 0x0269de thru 0x033519 (0xcb3c bytes) 000247 1788866206.366301 trunc from 0x02b8e7 to 0x02c8c8 (0xfe2 bytes) 000248 1788866206.387909 mapread 0x00d28a thru 0x012a62 (0x57d9 bytes) 000249 1788866206.395591 fallocate 0x03386f thru 0x03decf (0xa661 bytes) 000250 1788866206.411206 trunc from 0x00c78c to 0x01bebf (0xf734 bytes) 000251 1788866206.422502 write 0x031b9d thru 0x037b58 (0x5fbc bytes) 000252 1788866206.425177 punch from 0x001126 to 0x0092f8 (0x81d3 bytes) 000253 1788866206.445419 mapread 0x005422 thru 0x00cfb2 (0x7b91 bytes) 000254 1788866206.537857 read 0x015d5b thru 0x01dbcc (0x7e72 bytes) 000255 1788866206.556959 trunc from 0x038be4 to 0x03ffff (0x741c bytes) 000257 1788866206.570882 read 0x0268a3 thru 0x034a3d (0xe19b bytes) 000259 1788866206.576781 mapread 0x0117e7 thru 0x018a39 (0x7253 bytes) 000261 1788866206.590020 MIRROR_RESYNC 13 mirrors 000262 1788866210.659901 mapread 0x030230 thru 0x03aca9 (0xaa7a bytes) 000263 1788866210.683368 trunc from 0x02a8e4 to 0x02f088 (0x47a5 bytes) 000264 1788866210.727042 mapread 0x0062c7 thru 0x0091a2 (0x2edc bytes) 000265 1788866210.740894 mapwrite 0x01ee46 thru 0x02d22d (0xe3e8 bytes) 000266 1788866210.795953 punch from 0x037a86 to 0x03ffff (0x857a bytes) 000267 1788866210.809377 MIRROR_SPLIT mirror 7 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe6da221b (stale) Mirror 5: 0xe6da221b (stale) Mirror 7: 0xe6da221b (stale) Mirror 8: 0xe6da221b (stale) Mirror 9: 0xe6da221b (stale) Mirror 10: 0xe6da221b (stale) Mirror 12: 0xe6da221b (stale) Mirror 13: 0xe6da221b (stale) Mirror 14: 0xe6da221b (stale) Mirror 15: 0xe6da221b (stale) Mirror 16: 0xe6da221b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe6da221b (stale) Mirror 5: 0xe6da221b (stale) Mirror 7: 0xe6da221b (stale) Mirror 8: 0xe6da221b (stale) Mirror 9: 0xe6da221b (stale) Mirror 10: 0xe6da221b (stale) Mirror 12: 0xe6da221b (stale) Mirror 13: 0xe6da221b (stale) Mirror 14: 0xe6da221b (stale) Mirror 15: 0xe6da221b (stale) Mirror 16: 0xe6da221b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000268 1788866211.563844 fallocate 0x02f420 thru 0x035403 (0x5fe4 bytes) 000269 1788866211.572562 mapread 0x02e89f thru 0x034e1c (0x657e bytes) 000270 1788866211.652902 trunc from 0x040000 to 0x01e42a (0x21bd5 bytes) 000272 1788866211.679283 trunc from 0x00fd0d to 0x013dd5 (0x40c9 bytes) 000273 1788866211.686681 mapread 0x00f5d3 thru 0x0143cd (0x4dfb bytes) 000274 1788866211.715929 mapread 0x009ba6 thru 0x00e614 (0x4a6f bytes) 000275 1788866211.717161 trunc from 0x01e42b to 0x01c7e4 (0x1c46 bytes) 000276 1788866211.734824 fallocate 0x00fd35 thru 0x01c0f1 (0xc3bd bytes) 000277 1788866211.744830 MIRROR_SPLIT mirror 6 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1c7e5): Mirror 4: 0x9c4fe1b5 (stale) Mirror 5: 0x9c4fe1b5 (stale) Mirror 7: 0x9c4fe1b5 (stale) Mirror 8: 0x9c4fe1b5 (stale) Mirror 9: 0x9c4fe1b5 (stale) Mirror 12: 0x9c4fe1b5 (stale) Mirror 13: 0x9c4fe1b5 (stale) Mirror 14: 0x9c4fe1b5 (stale) Mirror 15: 0x9c4fe1b5 (stale) Mirror 16: 0x9c4fe1b5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c7e5): Mirror 4: 0x9c4fe1b5 (stale) Mirror 5: 0x9c4fe1b5 (stale) Mirror 7: 0x9c4fe1b5 (stale) Mirror 8: 0x9c4fe1b5 (stale) Mirror 9: 0x9c4fe1b5 (stale) Mirror 12: 0x9c4fe1b5 (stale) Mirror 13: 0x9c4fe1b5 (stale) Mirror 14: 0x9c4fe1b5 (stale) Mirror 15: 0x9c4fe1b5 (stale) Mirror 16: 0x9c4fe1b5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c7e5: skipped 000278 1788866212.341301 trunc from 0x01c7e5 to 0x03bdc1 (0x1f5dd bytes) 000279 1788866212.373713 trunc from 0x03bdc2 to 0x010c4e (0x2b173 bytes) 000280 1788866212.401240 MIRROR_RESYNC 11 mirrors 000281 1788866214.721858 MIRROR_EXTEND to 12 mirrors 000282 1788866215.411325 fallocate 0x029e16 thru 0x02cc9f (0x2e8a bytes) 000283 1788866215.465884 punch from 0x00f0cc to 0x010c4e (0x1b83 bytes) 000284 1788866215.500691 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x10c4f): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10c4f): Mirror 4: 0xf43ded9c (stale) Mirror 5: 0xf43ded9c (stale) Mirror 7: 0xf43ded9c (stale) Mirror 8: 0xf43ded9c (stale) Mirror 9: 0xf43ded9c (stale) Mirror 12: 0xf43ded9c (stale) Mirror 13: 0xf43ded9c (stale) Mirror 14: 0xf43ded9c (stale) Mirror 15: 0xf43ded9c (stale) Mirror 16: 0xf43ded9c (stale) Mirror 17: 0xf43ded9c (stale) CRC-32 checksum value for chunk [0, 0x10c4f): Mirror 1: 0xf43ded9c Mirror 18: 0xf43ded9c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10c4f: skipped 000285 1788866216.635615 trunc from 0x010c4f to 0x03cb1e (0x2bed0 bytes) 000286 1788866216.688029 mapread 0x00083e thru 0x002e0d (0x25d0 bytes) 000287 1788866216.704230 trunc from 0x03cb1f to 0x01a669 (0x224b5 bytes) 000288 1788866216.730580 MIRROR_SPLIT mirror 6 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1a66a): Mirror 4: 0xec3a0ace (stale) Mirror 5: 0xec3a0ace (stale) Mirror 7: 0xec3a0ace (stale) Mirror 8: 0xec3a0ace (stale) Mirror 9: 0xec3a0ace (stale) Mirror 13: 0xec3a0ace (stale) Mirror 14: 0xec3a0ace (stale) Mirror 15: 0xec3a0ace (stale) Mirror 16: 0xec3a0ace (stale) Mirror 17: 0xec3a0ace (stale) Mirror 18: 0xec3a0ace (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a66a): Mirror 4: 0xec3a0ace (stale) Mirror 5: 0xec3a0ace (stale) Mirror 7: 0xec3a0ace (stale) Mirror 8: 0xec3a0ace (stale) Mirror 9: 0xec3a0ace (stale) Mirror 13: 0xec3a0ace (stale) Mirror 14: 0xec3a0ace (stale) Mirror 15: 0xec3a0ace (stale) Mirror 16: 0xec3a0ace (stale) Mirror 17: 0xec3a0ace (stale) Mirror 18: 0xec3a0ace (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a66a: skipped 000289 1788866217.542529 MIRROR_RESYNC 12 mirrors 000290 1788866220.060436 write 0x0154fb thru 0x01b797 (0x629d bytes) 000291 1788866220.087788 write 0x036efd thru 0x03ffff (0x9103 bytes) 000292 1788866220.092001 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xbe61a544 (stale) Mirror 7: 0xbe61a544 (stale) Mirror 8: 0xbe61a544 (stale) Mirror 9: 0xbe61a544 (stale) Mirror 13: 0xbe61a544 (stale) Mirror 14: 0xbe61a544 (stale) Mirror 15: 0xbe61a544 (stale) Mirror 16: 0xbe61a544 (stale) Mirror 17: 0xbe61a544 (stale) Mirror 18: 0xbe61a544 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xbe61a544 (stale) Mirror 7: 0xbe61a544 (stale) Mirror 8: 0xbe61a544 (stale) Mirror 9: 0xbe61a544 (stale) Mirror 13: 0xbe61a544 (stale) Mirror 14: 0xbe61a544 (stale) Mirror 15: 0xbe61a544 (stale) Mirror 16: 0xbe61a544 (stale) Mirror 17: 0xbe61a544 (stale) Mirror 18: 0xbe61a544 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000293 1788866220.587042 trunc from 0x040000 to 0x02ff28 (0x100d7 bytes) 000294 1788866220.603027 trunc from 0x016569 to 0x01d1e6 (0x6c7e bytes) 000296 1788866220.613220 write 0x03e775 thru 0x03ffff (0x188b bytes) 000297 1788866220.618708 MIRROR_SPLIT mirror 9 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xbe61a544 (stale) Mirror 7: 0xbe61a544 (stale) Mirror 8: 0xbe61a544 (stale) Mirror 9: 0xbe61a544 (stale) Mirror 13: 0xbe61a544 (stale) Mirror 14: 0xbe61a544 (stale) Mirror 15: 0xbe61a544 (stale) Mirror 16: 0xbe61a544 (stale) Mirror 18: 0xbe61a544 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xbe61a544 (stale) Mirror 7: 0xbe61a544 (stale) Mirror 8: 0xbe61a544 (stale) Mirror 9: 0xbe61a544 (stale) Mirror 13: 0xbe61a544 (stale) Mirror 14: 0xbe61a544 (stale) Mirror 15: 0xbe61a544 (stale) Mirror 16: 0xbe61a544 (stale) Mirror 18: 0xbe61a544 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000298 1788866221.160400 MIRROR_SPLIT mirror 5 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xbe61a544 (stale) Mirror 7: 0xbe61a544 (stale) Mirror 8: 0xbe61a544 (stale) Mirror 9: 0xbe61a544 (stale) Mirror 14: 0xbe61a544 (stale) Mirror 15: 0xbe61a544 (stale) Mirror 16: 0xbe61a544 (stale) Mirror 18: 0xbe61a544 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xbe61a544 (stale) Mirror 7: 0xbe61a544 (stale) Mirror 8: 0xbe61a544 (stale) Mirror 9: 0xbe61a544 (stale) Mirror 14: 0xbe61a544 (stale) Mirror 15: 0xbe61a544 (stale) Mirror 16: 0xbe61a544 (stale) Mirror 18: 0xbe61a544 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000299 1788866221.622946 trunc from 0x040000 to 0x024a2a (0x1b5d5 bytes) 000300 1788866221.650320 punch from 0x011a79 to 0x01884f (0x6dd7 bytes) 000301 1788866221.656573 mapwrite 0x01ff8c thru 0x0268de (0x6953 bytes) 000302 1788866221.723211 mapread 0x01cf70 thru 0x0268de (0x996f bytes) 000303 1788866221.724207 trunc from 0x0268df to 0x03660d (0xfd2f bytes) 000304 1788866221.754953 fallocate 0x00bd91 thru 0x01672d (0xa99d bytes) 000305 1788866221.765223 mapread 0x02db93 thru 0x030247 (0x26b5 bytes) 000306 1788866221.795612 fallocate 0x02822f thru 0x02924e (0x1020 bytes) 000307 1788866221.804152 punch from 0x0285db to 0x02a33a (0x1d60 bytes) 000308 1788866221.815476 trunc from 0x03660e to 0x002e32 (0x337db bytes) 000309 1788866221.860202 trunc from 0x001ef3 to 0x002e32 (0xf40 bytes) 000310 1788866221.877930 punch from 0x001c93 to 0x002e32 (0x11a0 bytes) 000311 1788866221.888289 fallocate 0x03e44f thru 0x03ffff (0x1bb1 bytes) 000312 1788866221.894736 fallocate 0x01c72b thru 0x026c9c (0xa572 bytes) 000313 1788866221.908157 read 0x001a4a thru 0x00980e (0x7dc5 bytes) 000314 1788866221.930136 mapread 0x00a311 thru 0x010412 (0x6102 bytes) 000315 1788866221.955875 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x26c9d): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26c9d): Mirror 5: 0x959e647 (stale) Mirror 7: 0x959e647 (stale) Mirror 8: 0x959e647 (stale) Mirror 9: 0x959e647 (stale) Mirror 14: 0x959e647 (stale) Mirror 15: 0x959e647 (stale) Mirror 16: 0x959e647 (stale) Mirror 18: 0x959e647 (stale) CRC-32 checksum value for chunk [0, 0x26c9d): Mirror 1: 0xf4c82f5d Mirror 19: 0xf4c82f5d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26c9d: skipped 000316 1788866223.003041 trunc from 0x026c9d to 0x03a658 (0x139bc bytes) 000317 1788866223.034683 mapwrite 0x026728 thru 0x02eff2 (0x88cb bytes) 000318 1788866223.082039 MIRROR_RESYNC 10 mirrors 000319 1788866225.384335 trunc from 0x0392dd to 0x03a205 (0xf29 bytes) 000320 1788866225.413374 trunc from 0x0141fd to 0x014cd5 (0xad9 bytes) 000321 1788866225.417551 write 0x004054 thru 0x013ce0 (0xfc8d bytes) 000322 1788866225.424332 mapread 0x0032d2 thru 0x00b559 (0x8288 bytes) 000324 1788866225.428701 write 0x037f82 thru 0x03ffff (0x807e bytes) 000325 1788866225.433689 read 0x01fde5 thru 0x023bb8 (0x3dd4 bytes) 000326 1788866225.438944 read 0x008aaf thru 0x009e28 (0x137a bytes) 000327 1788866225.439764 fallocate 0x00ccb1 thru 0x00ea60 (0x1db0 bytes) 000328 1788866225.446740 MIRROR_RESYNC 10 mirrors 000329 1788866228.254997 MIRROR_EXTEND to 11 mirrors 000330 1788866228.966771 write 0x038e6c thru 0x03bfe5 (0x317a bytes) 000331 1788866228.998387 read 0x0356aa thru 0x03fc57 (0xa5ae bytes) 000333 1788866229.006694 trunc from 0x040000 to 0x025144 (0x1aebb bytes) 000334 1788866229.026040 read 0x00de88 thru 0x00e4fd (0x676 bytes) 000335 1788866229.047931 read 0x000135 thru 0x00cef0 (0xcdbc bytes) 000337 1788866229.048783 mapread 0x00a75b thru 0x0131d1 (0x8a77 bytes) 000338 1788866229.052580 mapwrite 0x02d961 thru 0x038439 (0xaad9 bytes) 000339 1788866229.085586 fallocate 0x001a64 thru 0x00b841 (0x9dde bytes) 000340 1788866229.089477 write 0x021c8c thru 0x0316ce (0xfa43 bytes) 000341 1788866229.090823 trunc from 0x03843a to 0x019c40 (0x1e7f9 bytes) 000342 1788866229.101557 write 0x00daf4 thru 0x015369 (0x7876 bytes) 000344 1788866229.102668 mapread 0x00649b thru 0x0124ad (0xc013 bytes) 000345 1788866229.103917 fallocate 0x017ab4 thru 0x01af0d (0x345a bytes) 000346 1788866229.107116 trunc from 0x00a1f7 to 0x00f674 (0x547e bytes) 000347 1788866229.114486 trunc from 0x01767a to 0x018ff5 (0x197c bytes) 000348 1788866229.117304 mapread 0x019ebd thru 0x01af0d (0x1051 bytes) 000350 1788866229.122771 read 0x0118e8 thru 0x0123dd (0xaf6 bytes) 000351 1788866229.123404 trunc from 0x00efeb to 0x01a318 (0xb32e bytes) 000352 1788866229.128593 mapwrite 0x015920 thru 0x01a229 (0x490a bytes) 000353 1788866229.154974 write 0x0197c1 thru 0x02452e (0xad6e bytes) 000354 1788866229.156629 fallocate 0x037691 thru 0x03a3e5 (0x2d55 bytes) 000355 1788866229.161914 mapread 0x00a753 thru 0x00fc63 (0x5511 bytes) 000356 1788866229.162900 fallocate 0x02ef08 thru 0x02f27a (0x373 bytes) 000357 1788866229.166544 fallocate 0x003cf2 thru 0x00825c (0x456b bytes) 000358 1788866229.170023 trunc from 0x03a3e6 to 0x03faa7 (0x56c2 bytes) 000359 1788866229.183369 read 0x0104de thru 0x016894 (0x63b7 bytes) 000360 1788866229.183904 punch from 0x015567 to 0x025139 (0xfbd3 bytes) 000361 1788866229.194346 mapread 0x03c431 thru 0x03faa7 (0x3677 bytes) 000362 1788866229.200600 mapwrite 0x000863 thru 0x00667d (0x5e1b bytes) 000363 1788866229.212212 read 0x004efe thru 0x01433a (0xf43d bytes) 000364 1788866229.212638 write 0x01f73a thru 0x027c80 (0x8547 bytes) 000365 1788866229.213421 write 0x02c071 thru 0x035fa1 (0x9f31 bytes) 000366 1788866229.214062 punch from 0x00a9a4 to 0x013232 (0x888f bytes) 000367 1788866229.219937 trunc from 0x03faa8 to 0x033bcc (0xbedb bytes) 000369 1788866229.242601 mapread 0x0100a2 thru 0x010561 (0x4c0 bytes) 000370 1788866229.253666 mapread 0x02717c thru 0x02ff82 (0x8e07 bytes) 000371 1788866229.254727 write 0x035d16 thru 0x03c593 (0x687e bytes) 000372 1788866229.257558 mapwrite 0x02a170 thru 0x037632 (0xd4c3 bytes) 000374 1788866229.276537 fallocate 0x019359 thru 0x021b50 (0x87f8 bytes) 000375 1788866229.279946 write 0x027cea thru 0x02d983 (0x5c9a bytes) 000376 1788866229.281024 mapread 0x007dbf thru 0x0146e7 (0xc929 bytes) 000377 1788866229.282631 write 0x0085ee thru 0x0108ab (0x82be bytes) 000378 1788866229.283697 trunc from 0x0074c4 to 0x00cd74 (0x58b1 bytes) 000379 1788866229.295018 mapwrite 0x02acce thru 0x02af6b (0x29e bytes) 000380 1788866229.305943 mapwrite 0x01c6b0 thru 0x022f88 (0x68d9 bytes) 000381 1788866229.321716 mapread 0x0180b9 thru 0x01a0c0 (0x2008 bytes) 000382 1788866229.322630 trunc from 0x03c594 to 0x029c28 (0x1296b bytes) 000383 1788866229.340713 MIRROR_RESYNC 11 mirrors 000384 1788866231.485087 read 0x022316 thru 0x0285dd (0x62c8 bytes) 000385 1788866231.497885 mapread 0x010775 thru 0x0123d4 (0x1c60 bytes) 000386 1788866231.532854 MIRROR_EXTEND to 12 mirrors 000387 1788866232.494540 MIRROR_EXTEND to 13 mirrors 000388 1788866233.469495 write 0x025d4f thru 0x02c3dc (0x668e bytes) 000389 1788866233.526963 mapwrite 0x033661 thru 0x0338f4 (0x294 bytes) 000390 1788866233.572142 mapwrite 0x034543 thru 0x03e889 (0xa347 bytes) 000391 1788866233.703199 trunc from 0x00e8fe to 0x01c057 (0xd75a bytes) 000392 1788866233.710099 punch from 0x005aa8 to 0x008e9e (0x33f7 bytes) 000393 1788866233.717842 mapwrite 0x03f15a thru 0x03ffff (0xea6 bytes) 000394 1788866233.790805 trunc from 0x040000 to 0x0126af (0x2d950 bytes) 000396 1788866233.826848 MIRROR_RESYNC 13 mirrors 000397 1788866235.568821 trunc from 0x0126b0 to 0x037422 (0x24d73 bytes) 000399 1788866235.621740 trunc from 0x037423 to 0x010573 (0x26eaf bytes) 000400 1788866235.649342 read 0x00a36b thru 0x00c18f (0x1e25 bytes) 000401 1788866235.656688 fallocate 0x015590 thru 0x016559 (0xfca bytes) 000402 1788866235.662234 write 0x01f1ba thru 0x0211b2 (0x1ff9 bytes) 000405 1788866235.666412 fallocate 0x023e41 thru 0x02ddda (0x9f9a bytes) 000406 1788866235.671991 mapread 0x01f33c thru 0x024835 (0x54fa bytes) 000407 1788866235.697583 MIRROR_SPLIT mirror 7 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2dddb): Mirror 5: 0x78c5993f (stale) Mirror 7: 0x78c5993f (stale) Mirror 8: 0x78c5993f (stale) Mirror 9: 0x78c5993f (stale) Mirror 14: 0x78c5993f (stale) Mirror 15: 0x78c5993f (stale) Mirror 18: 0x78c5993f (stale) Mirror 19: 0x78c5993f (stale) Mirror 20: 0x78c5993f (stale) Mirror 21: 0x78c5993f (stale) Mirror 22: 0x78c5993f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2dddb): Mirror 5: 0x78c5993f (stale) Mirror 7: 0x78c5993f (stale) Mirror 8: 0x78c5993f (stale) Mirror 9: 0x78c5993f (stale) Mirror 14: 0x78c5993f (stale) Mirror 15: 0x78c5993f (stale) Mirror 18: 0x78c5993f (stale) Mirror 19: 0x78c5993f (stale) Mirror 20: 0x78c5993f (stale) Mirror 21: 0x78c5993f (stale) Mirror 22: 0x78c5993f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2dddb: skipped 000408 1788866236.518960 mapread 0x0027e1 thru 0x00e45e (0xbc7e bytes) 000409 1788866236.557065 mapwrite 0x032491 thru 0x03ffff (0xdb6f bytes) 000410 1788866236.723595 fallocate 0x021a6b thru 0x025fbe (0x4554 bytes) 000411 1788866236.728665 mapread 0x029ebb thru 0x039b6b (0xfcb1 bytes) 000412 1788866236.743641 trunc from 0x040000 to 0x0073bb (0x38c44 bytes) 000413 1788866236.775020 punch from 0x0018fc to 0x0073bb (0x5ac0 bytes) 000414 1788866236.781608 mapwrite 0x0309ac thru 0x03d527 (0xcb7c bytes) 000415 1788866236.847835 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3d528): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d528): Mirror 5: 0xd1deac61 (stale) Mirror 7: 0xd1deac61 (stale) Mirror 8: 0xd1deac61 (stale) Mirror 9: 0xd1deac61 (stale) Mirror 14: 0xd1deac61 (stale) Mirror 15: 0xd1deac61 (stale) Mirror 18: 0xd1deac61 (stale) Mirror 19: 0xd1deac61 (stale) Mirror 20: 0xd1deac61 (stale) Mirror 21: 0xd1deac61 (stale) Mirror 22: 0xd1deac61 (stale) CRC-32 checksum value for chunk [0, 0x3d528): Mirror 1: 0x12a8deb3 Mirror 23: 0x12a8deb3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d528: skipped 000416 1788866237.870188 trunc from 0x00c543 to 0x017587 (0xb045 bytes) 000417 1788866237.939136 mapread 0x015d3e thru 0x016c3b (0xefe bytes) 000418 1788866237.952441 punch from 0x022506 to 0x028c48 (0x6743 bytes) 000419 1788866237.956931 fallocate 0x03a776 thru 0x03ffff (0x588a bytes) 000420 1788866237.966414 punch from 0x02e0ca to 0x035d0d (0x7c44 bytes) 000421 1788866237.972545 trunc from 0x0377f8 to 0x03ffff (0x8808 bytes) 000422 1788866237.980693 mapwrite 0x00a053 thru 0x015425 (0xb3d3 bytes) 000423 1788866238.030962 read 0x036338 thru 0x03ffff (0x9cc8 bytes) 000424 1788866238.044640 write 0x011758 thru 0x01cc9d (0xb546 bytes) 000425 1788866238.059849 MIRROR_RESYNC 13 mirrors 000426 1788866241.409211 read 0x030855 thru 0x0355e6 (0x4d92 bytes) 000427 1788866241.425851 mapread 0x032cfe thru 0x03618f (0x3492 bytes) 000428 1788866241.437585 read 0x00d3e3 thru 0x01cc54 (0xf872 bytes) 000429 1788866241.454626 punch from 0x01e7e0 to 0x0261dc (0x79fd bytes) 000430 1788866241.492975 read 0x01f3e5 thru 0x0290a8 (0x9cc4 bytes) 000431 1788866241.504464 fallocate 0x019037 thru 0x024ab0 (0xba7a bytes) 000432 1788866241.509810 read 0x03c307 thru 0x03ffff (0x3cf9 bytes) 000433 1788866241.510995 trunc from 0x040000 to 0x001dba (0x3e245 bytes) 000434 1788866241.529985 write 0x0017a1 thru 0x00c484 (0xace4 bytes) 000435 1788866241.531606 fallocate 0x02e53c thru 0x037906 (0x93cb bytes) 000436 1788866241.538862 read 0x003195 thru 0x00a89d (0x7709 bytes) 000437 1788866241.544180 MIRROR_RESYNC 13 mirrors 000439 1788866243.164400 mapwrite 0x0205a3 thru 0x02a2cb (0x9d29 bytes) 000440 1788866243.296719 trunc from 0x01629a to 0x01deaf (0x7c16 bytes) 000441 1788866243.305610 mapread 0x006e04 thru 0x00af37 (0x4134 bytes) 000442 1788866243.322977 write 0x01421b thru 0x023183 (0xef69 bytes) 000443 1788866243.330205 mapwrite 0x013459 thru 0x01d02e (0x9bd6 bytes) 000444 1788866243.355355 trunc from 0x01a251 to 0x01e7c2 (0x4572 bytes) 000446 1788866243.360559 trunc from 0x037907 to 0x028f68 (0xe99e bytes) 000447 1788866243.379344 punch from 0x018db8 to 0x01d4c8 (0x4711 bytes) 000448 1788866243.383517 trunc from 0x01b1bc to 0x027546 (0xc38b bytes) 000450 1788866243.387852 trunc from 0x00b0fb to 0x00e2e5 (0x31eb bytes) 000451 1788866243.392041 mapread 0x019fcc thru 0x01a63f (0x674 bytes) 000452 1788866243.399333 write 0x009f67 thru 0x0136d7 (0x9771 bytes) 000453 1788866243.403768 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x28f69): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28f69): Mirror 5: 0xa44474f4 (stale) Mirror 7: 0xa44474f4 (stale) Mirror 8: 0xa44474f4 (stale) Mirror 9: 0xa44474f4 (stale) Mirror 14: 0xa44474f4 (stale) Mirror 15: 0xa44474f4 (stale) Mirror 18: 0xa44474f4 (stale) Mirror 19: 0xa44474f4 (stale) Mirror 20: 0xa44474f4 (stale) Mirror 21: 0xa44474f4 (stale) Mirror 22: 0xa44474f4 (stale) Mirror 23: 0xa44474f4 (stale) CRC-32 checksum value for chunk [0, 0x28f69): Mirror 1: 0x93a7bece Mirror 24: 0x93a7bece lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28f69: skipped 000454 1788866244.137679 fallocate 0x03e504 thru 0x03ffff (0x1afc bytes) 000455 1788866244.207434 punch from 0x021b29 to 0x028f68 (0x7440 bytes) 000456 1788866244.218949 mapwrite 0x02657f thru 0x02ebdd (0x865f bytes) 000457 1788866244.347404 read 0x02334d thru 0x0280b9 (0x4d6d bytes) 000460 1788866244.352864 trunc from 0x02ebde to 0x01268c (0x1c551 bytes) 000461 1788866244.384497 punch from 0x0012e8 to 0x00cbae (0xb8c7 bytes) 000462 1788866244.394111 fallocate 0x02f7df thru 0x03d920 (0xe142 bytes) 000464 1788866244.407022 trunc from 0x00b542 to 0x01268c (0x714b bytes) 000465 1788866244.420781 MIRROR_SPLIT mirror 13 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1268d): Mirror 5: 0x34eaf4db (stale) Mirror 7: 0x34eaf4db (stale) Mirror 8: 0x34eaf4db (stale) Mirror 9: 0x34eaf4db (stale) Mirror 14: 0x34eaf4db (stale) Mirror 15: 0x34eaf4db (stale) Mirror 18: 0x34eaf4db (stale) Mirror 19: 0x34eaf4db (stale) Mirror 20: 0x34eaf4db (stale) Mirror 21: 0x34eaf4db (stale) Mirror 22: 0x34eaf4db (stale) Mirror 23: 0x34eaf4db (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1268d): Mirror 5: 0x34eaf4db (stale) Mirror 7: 0x34eaf4db (stale) Mirror 8: 0x34eaf4db (stale) Mirror 9: 0x34eaf4db (stale) Mirror 14: 0x34eaf4db (stale) Mirror 15: 0x34eaf4db (stale) Mirror 18: 0x34eaf4db (stale) Mirror 19: 0x34eaf4db (stale) Mirror 20: 0x34eaf4db (stale) Mirror 21: 0x34eaf4db (stale) Mirror 22: 0x34eaf4db (stale) Mirror 23: 0x34eaf4db (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1268d: skipped 000466 1788866244.904387 punch from 0x00ba75 to 0x01268c (0x6c18 bytes) 000467 1788866244.908183 write 0x0370e7 thru 0x039d86 (0x2ca0 bytes) 000468 1788866244.911490 punch from 0x02eb07 to 0x02f093 (0x58d bytes) 000469 1788866244.914533 mapread 0x03779d thru 0x039d86 (0x25ea bytes) 000470 1788866244.915183 trunc from 0x00da39 to 0x01231f (0x48e7 bytes) 000471 1788866244.918677 read 0x020108 thru 0x0282f8 (0x81f1 bytes) 000472 1788866244.923168 read 0x01a6d8 thru 0x01b627 (0xf50 bytes) 000474 1788866244.932918 trunc from 0x02bf15 to 0x02e569 (0x2655 bytes) 000475 1788866244.935837 fallocate 0x032970 thru 0x032b67 (0x1f8 bytes) 000476 1788866244.939194 write 0x03bf44 thru 0x03ffff (0x40bc bytes) 000477 1788866244.940972 mapwrite 0x00732b thru 0x00d08f (0x5d65 bytes) 000479 1788866244.954710 read 0x017f43 thru 0x02042a (0x84e8 bytes) 000480 1788866244.955294 fallocate 0x017c80 thru 0x01f409 (0x778a bytes) 000481 1788866244.959253 trunc from 0x040000 to 0x02d034 (0x12fcb bytes) 000482 1788866244.972376 write 0x007748 thru 0x014592 (0xce4b bytes) 000483 1788866244.974026 mapread 0x01208d thru 0x01405e (0x1fd2 bytes) 000484 1788866244.975143 mapwrite 0x02452c thru 0x02983f (0x5314 bytes) 000485 1788866244.990167 read 0x00f4c0 thru 0x014c31 (0x5772 bytes) 000486 1788866244.990889 trunc from 0x00cca8 to 0x0105f3 (0x394c bytes) 000487 1788866244.994568 trunc from 0x02d035 to 0x0195e3 (0x13a51 bytes) 000488 1788866245.005234 trunc from 0x0195e4 to 0x02fb58 (0x16575 bytes) 000489 1788866245.013585 punch from 0x003508 to 0x011968 (0xe461 bytes) 000490 1788866245.022710 MIRROR_RESYNC 13 mirrors 000491 1788866247.403654 fallocate 0x016db8 thru 0x024823 (0xda6c bytes) 000492 1788866247.447202 mapread 0x001e75 thru 0x00d842 (0xb9ce bytes) 000493 1788866247.491222 mapread 0x007b18 thru 0x0111fe (0x96e7 bytes) 000494 1788866247.502237 punch from 0x0228d8 to 0x02448e (0x1bb7 bytes) 000496 1788866247.515352 punch from 0x01b15a to 0x029640 (0xe4e7 bytes) 000498 1788866247.522099 write 0x0283f6 thru 0x037072 (0xec7d bytes) 000499 1788866247.543660 write 0x002dd1 thru 0x009cc0 (0x6ef0 bytes) 000501 1788866247.545421 trunc from 0x02aecc to 0x037072 (0xc1a7 bytes) 000502 1788866247.575229 mapwrite 0x0333d0 thru 0x037002 (0x3c33 bytes) 000503 1788866247.618906 trunc from 0x013ba4 to 0x021edb (0xe338 bytes) 000504 1788866247.624416 trunc from 0x037073 to 0x013b53 (0x2351f bytes) 000505 1788866247.647879 punch from 0x00fdc5 to 0x013b53 (0x3d8f bytes) 000506 1788866247.654677 fallocate 0x030cff thru 0x0349ae (0x3cb0 bytes) 000507 1788866247.659508 trunc from 0x019a87 to 0x01b9bf (0x1f39 bytes) 000508 1788866247.664403 fallocate 0x02ea78 thru 0x0378ad (0x8e36 bytes) 000509 1788866247.676093 mapwrite 0x01d924 thru 0x027bc4 (0xa2a1 bytes) 000510 1788866247.723521 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x349af): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x349af): Mirror 5: 0x685c1791 (stale) Mirror 7: 0x685c1791 (stale) Mirror 8: 0x685c1791 (stale) Mirror 9: 0x685c1791 (stale) Mirror 14: 0x685c1791 (stale) Mirror 15: 0x685c1791 (stale) Mirror 18: 0x685c1791 (stale) Mirror 19: 0x685c1791 (stale) Mirror 20: 0x685c1791 (stale) Mirror 21: 0x685c1791 (stale) Mirror 22: 0x685c1791 (stale) Mirror 23: 0x685c1791 (stale) CRC-32 checksum value for chunk [0, 0x349af): Mirror 1: 0x93181219 Mirror 24: 0x93181219 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x349af: skipped 000511 1788866248.926995 mapwrite 0x010c17 thru 0x01d188 (0xc572 bytes) 000512 1788866249.062187 punch from 0x01ebd0 to 0x0247bf (0x5bf0 bytes) 000513 1788866249.076157 MIRROR_RESYNC 14 mirrors 000514 1788866252.245451 read 0x011a57 thru 0x016211 (0x47bb bytes) 000515 1788866252.257214 trunc from 0x032f4d to 0x0349ae (0x1a62 bytes) 000517 1788866252.307340 MIRROR_RESYNC 14 mirrors 000518 1788866256.518794 trunc from 0x0020d6 to 0x00aa02 (0x892d bytes) 000519 1788866256.597123 mapread 0x005363 thru 0x006eae (0x1b4c bytes) 000520 1788866256.626822 trunc from 0x0349af to 0x0338b0 (0x10fe bytes) 000521 1788866256.693708 trunc from 0x003aed to 0x011f68 (0xe47c bytes) 000522 1788866256.707925 punch from 0x010f03 to 0x01ffd2 (0xf0d0 bytes) 000523 1788866256.725785 mapwrite 0x02200b thru 0x030ffd (0xeff3 bytes) 000524 1788866256.838922 mapread 0x0258ca thru 0x02b6c8 (0x5dff bytes) 000526 1788866256.844174 mapwrite 0x01a100 thru 0x021a43 (0x7944 bytes) 000528 1788866256.884454 trunc from 0x0338b1 to 0x019390 (0x1a520 bytes) 000529 1788866256.917434 mapwrite 0x026e30 thru 0x02a19a (0x336b bytes) 000530 1788866256.966122 fallocate 0x03ad8e thru 0x03db1b (0x2d8e bytes) 000531 1788866256.987394 MIRROR_RESYNC 14 mirrors 000532 1788866259.375270 trunc from 0x02a19b to 0x001c1d (0x2857d bytes) 000533 1788866259.498229 trunc from 0x0004ad to 0x001c1d (0x1771 bytes) 000534 1788866259.507399 mapread 0x00020b thru 0x001c1d (0x1a13 bytes) 000535 1788866259.529695 fallocate 0x023b77 thru 0x024549 (0x9d3 bytes) 000536 1788866259.536351 mapread 0x00019f thru 0x001c1d (0x1a7f bytes) 000537 1788866259.538320 fallocate 0x00cd8b thru 0x01065f (0x38d5 bytes) 000538 1788866259.546361 fallocate 0x0297f0 thru 0x02e7da (0x4feb bytes) 000540 1788866259.571463 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x2e7db): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e7db): Mirror 5: 0xd61de31b (stale) Mirror 7: 0xd61de31b (stale) Mirror 8: 0xd61de31b (stale) Mirror 9: 0xd61de31b (stale) Mirror 14: 0xd61de31b (stale) Mirror 15: 0xd61de31b (stale) Mirror 18: 0xd61de31b (stale) Mirror 19: 0xd61de31b (stale) Mirror 20: 0xd61de31b (stale) Mirror 21: 0xd61de31b (stale) Mirror 22: 0xd61de31b (stale) Mirror 23: 0xd61de31b (stale) Mirror 24: 0xd61de31b (stale) CRC-32 checksum value for chunk [0, 0x2e7db): Mirror 1: 0x5b161a90 Mirror 25: 0x5b161a90 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e7db: skipped 000541 1788866260.630615 fallocate 0x031a08 thru 0x03c983 (0xaf7c bytes) 000543 1788866260.681721 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x3c984): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c984): Mirror 5: 0x22d59d11 (stale) Mirror 7: 0x22d59d11 (stale) Mirror 8: 0x22d59d11 (stale) Mirror 9: 0x22d59d11 (stale) Mirror 14: 0x22d59d11 (stale) Mirror 15: 0x22d59d11 (stale) Mirror 18: 0x22d59d11 (stale) Mirror 19: 0x22d59d11 (stale) Mirror 20: 0x22d59d11 (stale) Mirror 21: 0x22d59d11 (stale) Mirror 22: 0x22d59d11 (stale) Mirror 23: 0x22d59d11 (stale) Mirror 24: 0x22d59d11 (stale) Mirror 25: 0x3a24c348 (stale) CRC-32 checksum value for chunk [0, 0x3c984): Mirror 1: 0x3a24c348 Mirror 26: 0x3a24c348 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c984: skipped 000544 1788866261.762810 mapread 0x034bda thru 0x038e92 (0x42b9 bytes) 000545 1788866261.802740 write 0x00983b thru 0x0196f4 (0xfeba bytes) 000546 1788866261.857892 fallocate 0x0017fb thru 0x0023f5 (0xbfb bytes) 000547 1788866261.863832 trunc from 0x03c984 to 0x02e507 (0xe47c bytes) 000548 1788866261.889467 MIRROR_SPLIT mirror 1 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e508): Mirror 7: 0x8129f2ac (stale) Mirror 8: 0x8129f2ac (stale) Mirror 9: 0x8129f2ac (stale) Mirror 14: 0x8129f2ac (stale) Mirror 15: 0x8129f2ac (stale) Mirror 18: 0x8129f2ac (stale) Mirror 19: 0x8129f2ac (stale) Mirror 20: 0x8129f2ac (stale) Mirror 21: 0x8129f2ac (stale) Mirror 22: 0x8129f2ac (stale) Mirror 23: 0x8129f2ac (stale) Mirror 24: 0x8129f2ac (stale) Mirror 25: 0x550df003 (stale) Mirror 26: 0x550df003 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e508): Mirror 7: 0x8129f2ac (stale) Mirror 8: 0x8129f2ac (stale) Mirror 9: 0x8129f2ac (stale) Mirror 14: 0x8129f2ac (stale) Mirror 15: 0x8129f2ac (stale) Mirror 18: 0x8129f2ac (stale) Mirror 19: 0x8129f2ac (stale) Mirror 20: 0x8129f2ac (stale) Mirror 21: 0x8129f2ac (stale) Mirror 22: 0x8129f2ac (stale) Mirror 23: 0x8129f2ac (stale) Mirror 24: 0x8129f2ac (stale) Mirror 25: 0x550df003 (stale) Mirror 26: 0x550df003 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e508: skipped 000549 1788866262.696981 trunc from 0x007bb2 to 0x0116ba (0x9b09 bytes) 000550 1788866262.714913 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x2e508): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e508): Mirror 7: 0x8129f2ac (stale) Mirror 8: 0x8129f2ac (stale) Mirror 9: 0x8129f2ac (stale) Mirror 14: 0x8129f2ac (stale) Mirror 15: 0x8129f2ac (stale) Mirror 18: 0x8129f2ac (stale) Mirror 19: 0x8129f2ac (stale) Mirror 20: 0x8129f2ac (stale) Mirror 21: 0x8129f2ac (stale) Mirror 22: 0x8129f2ac (stale) Mirror 23: 0x8129f2ac (stale) Mirror 24: 0x8129f2ac (stale) Mirror 25: 0x550df003 (stale) Mirror 26: 0x550df003 (stale) CRC-32 checksum value for chunk [0, 0x2e508): Mirror 1: 0xf8d6c414 Mirror 27: 0xf8d6c414 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e508: skipped 000551 1788866264.299779 write 0x02ab74 thru 0x031e47 (0x72d4 bytes) 000552 1788866264.383376 mapread 0x00ede4 thru 0x012815 (0x3a32 bytes) 000553 1788866264.416636 fallocate 0x038f5b thru 0x03e978 (0x5a1e bytes) 000554 1788866264.429290 trunc from 0x03e979 to 0x00d6fe (0x3127a bytes) 000555 1788866264.459308 trunc from 0x00d6ff to 0x0362f3 (0x28bf5 bytes) 000556 1788866264.493180 mapread 0x01cc41 thru 0x02c7ef (0xfbaf bytes) 000557 1788866264.523702 trunc from 0x012165 to 0x0203e3 (0xe27f bytes) 000558 1788866264.528416 mapwrite 0x00f337 thru 0x01dbe8 (0xe8b2 bytes) 000560 1788866264.578463 trunc from 0x0362f4 to 0x006238 (0x300bb bytes) 000561 1788866264.602122 mapwrite 0x02fbd1 thru 0x03a4bf (0xa8ef bytes) 000562 1788866264.680357 mapread 0x037723 thru 0x03a4bf (0x2d9d bytes) 000563 1788866264.682639 punch from 0x01ce0c to 0x01d447 (0x63c bytes) 000564 1788866264.699201 fallocate 0x002764 thru 0x004e5f (0x26fc bytes) 000565 1788866264.705741 trunc from 0x03a4c0 to 0x03e93c (0x447d bytes) 000566 1788866264.737516 mapwrite 0x02e8c8 thru 0x03d7ed (0xef26 bytes) 000567 1788866264.789389 trunc from 0x03e93d to 0x03883d (0x60ff bytes) 000568 1788866264.817375 fallocate 0x038b58 thru 0x039137 (0x5e0 bytes) 000569 1788866264.845358 MIRROR_SPLIT mirror 5 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39138): Mirror 7: 0xe01c7e60 (stale) Mirror 8: 0xe01c7e60 (stale) Mirror 9: 0xe01c7e60 (stale) Mirror 14: 0xe01c7e60 (stale) Mirror 18: 0xe01c7e60 (stale) Mirror 19: 0xe01c7e60 (stale) Mirror 20: 0xe01c7e60 (stale) Mirror 21: 0xe01c7e60 (stale) Mirror 22: 0xe01c7e60 (stale) Mirror 23: 0xe01c7e60 (stale) Mirror 24: 0xe01c7e60 (stale) Mirror 25: 0x2d8f6c04 (stale) Mirror 26: 0x2d8f6c04 (stale) Mirror 27: 0xafb4023b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39138): Mirror 7: 0xe01c7e60 (stale) Mirror 8: 0xe01c7e60 (stale) Mirror 9: 0xe01c7e60 (stale) Mirror 14: 0xe01c7e60 (stale) Mirror 18: 0xe01c7e60 (stale) Mirror 19: 0xe01c7e60 (stale) Mirror 20: 0xe01c7e60 (stale) Mirror 21: 0xe01c7e60 (stale) Mirror 22: 0xe01c7e60 (stale) Mirror 23: 0xe01c7e60 (stale) Mirror 24: 0xe01c7e60 (stale) Mirror 25: 0x2d8f6c04 (stale) Mirror 26: 0x2d8f6c04 (stale) Mirror 27: 0xafb4023b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39138: skipped 000570 1788866265.918752 write 0x03d688 thru 0x03ffff (0x2978 bytes) 000571 1788866265.927240 punch from 0x029837 to 0x02a558 (0xd22 bytes) 000572 1788866265.938042 mapread 0x01aab0 thru 0x022498 (0x79e9 bytes) 000573 1788866265.966822 trunc from 0x040000 to 0x02d402 (0x12bfd bytes) 000574 1788866265.993806 MIRROR_RESYNC 15 mirrors 000575 1788866267.984460 trunc from 0x025acc to 0x02ca9c (0x6fd1 bytes) 000576 1788866268.031505 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x2d403): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d403): Mirror 7: 0x5286be17 (stale) Mirror 8: 0x5286be17 (stale) Mirror 9: 0x5286be17 (stale) Mirror 14: 0x5286be17 (stale) Mirror 18: 0x5286be17 (stale) Mirror 19: 0x5286be17 (stale) Mirror 20: 0x5286be17 (stale) Mirror 21: 0x5286be17 (stale) Mirror 22: 0x5286be17 (stale) Mirror 23: 0x5286be17 (stale) Mirror 24: 0x5286be17 (stale) Mirror 25: 0x5286be17 (stale) Mirror 26: 0x5286be17 (stale) Mirror 27: 0x5286be17 (stale) CRC-32 checksum value for chunk [0, 0x2d403): Mirror 1: 0x5286be17 Mirror 28: 0x5286be17 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d403: skipped 000577 1788866269.661827 write 0x0051fb thru 0x00d9e4 (0x87ea bytes) 000578 1788866269.721401 write 0x00fd24 thru 0x015db2 (0x608f bytes) 000580 1788866269.733004 trunc from 0x02d403 to 0x02e7f6 (0x13f4 bytes) 000581 1788866269.754485 read 0x0286b5 thru 0x02c50b (0x3e57 bytes) 000582 1788866269.768984 trunc from 0x01fddd to 0x02d2a6 (0xd4ca bytes) 000583 1788866269.774881 punch from 0x0185db to 0x02779e (0xf1c4 bytes) 000584 1788866269.779933 read 0x0169c1 thru 0x023f27 (0xd567 bytes) 000585 1788866269.790543 fallocate 0x03e8e3 thru 0x03ffff (0x171d bytes) 000586 1788866269.796038 read 0x032afb thru 0x03e18e (0xb694 bytes) 000588 1788866269.808288 mapwrite 0x00edee thru 0x017d43 (0x8f56 bytes) 000590 1788866269.835371 punch from 0x038665 to 0x03ffff (0x799b bytes) 000591 1788866269.840909 trunc from 0x040000 to 0x01100d (0x2eff2 bytes) 000592 1788866269.859123 mapread 0x003ccc thru 0x00e26e (0xa5a3 bytes) 000593 1788866269.862046 mapwrite 0x03ad7e thru 0x03e40f (0x3692 bytes) 000594 1788866269.938389 MIRROR_SPLIT mirror 7 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e410): Mirror 7: 0xd27b26c9 (stale) Mirror 8: 0xd27b26c9 (stale) Mirror 9: 0xd27b26c9 (stale) Mirror 14: 0xd27b26c9 (stale) Mirror 18: 0xd27b26c9 (stale) Mirror 19: 0xd27b26c9 (stale) Mirror 21: 0xd27b26c9 (stale) Mirror 22: 0xd27b26c9 (stale) Mirror 23: 0xd27b26c9 (stale) Mirror 24: 0xd27b26c9 (stale) Mirror 25: 0xd27b26c9 (stale) Mirror 26: 0xd27b26c9 (stale) Mirror 27: 0xd27b26c9 (stale) Mirror 28: 0xd27b26c9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e410): Mirror 7: 0xd27b26c9 (stale) Mirror 8: 0xd27b26c9 (stale) Mirror 9: 0xd27b26c9 (stale) Mirror 14: 0xd27b26c9 (stale) Mirror 18: 0xd27b26c9 (stale) Mirror 19: 0xd27b26c9 (stale) Mirror 21: 0xd27b26c9 (stale) Mirror 22: 0xd27b26c9 (stale) Mirror 23: 0xd27b26c9 (stale) Mirror 24: 0xd27b26c9 (stale) Mirror 25: 0xd27b26c9 (stale) Mirror 26: 0xd27b26c9 (stale) Mirror 27: 0xd27b26c9 (stale) Mirror 28: 0xd27b26c9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e410: skipped 000596 1788866270.851500 mapread 0x01524b thru 0x0219ab (0xc761 bytes) 000597 1788866270.903140 trunc from 0x01220b to 0x01f5b3 (0xd3a9 bytes) 000598 1788866270.908127 mapwrite 0x01436f thru 0x020b70 (0xc802 bytes) 000599 1788866271.000870 mapwrite 0x02134f thru 0x0262ff (0x4fb1 bytes) 000601 1788866271.042995 trunc from 0x006d45 to 0x00b12b (0x43e7 bytes) 000602 1788866271.053557 mapwrite 0x03c1db thru 0x03ffff (0x3e25 bytes) 000603 1788866271.161775 write 0x009f56 thru 0x00d2fa (0x33a5 bytes) 000605 1788866271.176326 write 0x032ad2 thru 0x03da5a (0xaf89 bytes) 000606 1788866271.190865 mapread 0x01a3a0 thru 0x027b31 (0xd792 bytes) 000607 1788866271.192064 write 0x02f757 thru 0x039b08 (0xa3b2 bytes) 000608 1788866271.229150 mapread 0x032b88 thru 0x03ffff (0xd478 bytes) 000609 1788866271.230169 write 0x00055c thru 0x0011bd (0xc62 bytes) 000610 1788866271.264760 MIRROR_SPLIT mirror 7 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xe20eea22 (stale) Mirror 8: 0xe20eea22 (stale) Mirror 9: 0xe20eea22 (stale) Mirror 14: 0xe20eea22 (stale) Mirror 18: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) Mirror 22: 0xe20eea22 (stale) Mirror 23: 0xe20eea22 (stale) Mirror 24: 0xe20eea22 (stale) Mirror 25: 0xe20eea22 (stale) Mirror 26: 0xe20eea22 (stale) Mirror 27: 0xe20eea22 (stale) Mirror 28: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xe20eea22 (stale) Mirror 8: 0xe20eea22 (stale) Mirror 9: 0xe20eea22 (stale) Mirror 14: 0xe20eea22 (stale) Mirror 18: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) Mirror 22: 0xe20eea22 (stale) Mirror 23: 0xe20eea22 (stale) Mirror 24: 0xe20eea22 (stale) Mirror 25: 0xe20eea22 (stale) Mirror 26: 0xe20eea22 (stale) Mirror 27: 0xe20eea22 (stale) Mirror 28: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000611 1788866272.228277 write 0x01d625 thru 0x025e66 (0x8842 bytes) 000612 1788866272.247876 fallocate 0x006dbd thru 0x011258 (0xa49c bytes) 000613 1788866272.255142 mapwrite 0x008424 thru 0x014f92 (0xcb6f bytes) 000614 1788866272.330137 MIRROR_SPLIT mirror 1 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xe20eea22 (stale) Mirror 9: 0xe20eea22 (stale) Mirror 14: 0xe20eea22 (stale) Mirror 18: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) Mirror 22: 0xe20eea22 (stale) Mirror 23: 0xe20eea22 (stale) Mirror 24: 0xe20eea22 (stale) Mirror 25: 0xe20eea22 (stale) Mirror 26: 0xe20eea22 (stale) Mirror 27: 0xe20eea22 (stale) Mirror 28: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xe20eea22 (stale) Mirror 9: 0xe20eea22 (stale) Mirror 14: 0xe20eea22 (stale) Mirror 18: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) Mirror 22: 0xe20eea22 (stale) Mirror 23: 0xe20eea22 (stale) Mirror 24: 0xe20eea22 (stale) Mirror 25: 0xe20eea22 (stale) Mirror 26: 0xe20eea22 (stale) Mirror 27: 0xe20eea22 (stale) Mirror 28: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000615 1788866273.538606 trunc from 0x010a9f to 0x0133d8 (0x293a bytes) 000616 1788866273.552191 trunc from 0x040000 to 0x00c61e (0x339e1 bytes) 000617 1788866273.590307 trunc from 0x00c61f to 0x029ba5 (0x1d587 bytes) 000618 1788866273.619243 punch from 0x0262c8 to 0x029ba5 (0x38de bytes) 000619 1788866273.625731 trunc from 0x029ba6 to 0x000bcb (0x28fda bytes) 000620 1788866273.657150 mapwrite 0x009757 thru 0x00f2ae (0x5b58 bytes) 000621 1788866273.764655 fallocate 0x0067c1 thru 0x0146a3 (0xdee3 bytes) 000623 1788866273.770627 write 0x01a535 thru 0x024af2 (0xa5be bytes) 000624 1788866273.795982 mapread 0x001d58 thru 0x00d524 (0xb7cd bytes) 000625 1788866273.814058 mapread 0x0121bb thru 0x018d8e (0x6bd4 bytes) 000626 1788866273.822140 mapread 0x00064c thru 0x008857 (0x820c bytes) 000627 1788866273.830001 fallocate 0x017132 thru 0x02124a (0xa119 bytes) 000629 1788866273.841259 mapwrite 0x02af2c thru 0x03005f (0x5134 bytes) 000630 1788866273.934851 trunc from 0x030060 to 0x0062a0 (0x29dbf bytes) 000631 1788866273.958885 trunc from 0x0062a1 to 0x02e866 (0x285c6 bytes) 000632 1788866274.024941 mapwrite 0x02776e thru 0x031088 (0x991b bytes) 000633 1788866274.121044 trunc from 0x00146f to 0x009b9d (0x872f bytes) 000634 1788866274.135979 write 0x0236e6 thru 0x02efe9 (0xb904 bytes) 000635 1788866274.165276 MIRROR_RESYNC 13 mirrors 000636 1788866277.194584 MIRROR_EXTEND to 14 mirrors 000637 1788866278.094405 write 0x03057b thru 0x039781 (0x9207 bytes) 000638 1788866278.181616 fallocate 0x0238dd thru 0x02f2cb (0xb9ef bytes) 000639 1788866278.192727 mapwrite 0x0314a2 thru 0x03613a (0x4c99 bytes) 000640 1788866278.227358 fallocate 0x0155b4 thru 0x023fb3 (0xea00 bytes) 000642 1788866278.236347 trunc from 0x039782 to 0x00bae6 (0x2dc9b bytes) 000643 1788866278.265962 fallocate 0x003654 thru 0x00e73b (0xb0e8 bytes) 000644 1788866278.270831 fallocate 0x03fbe6 thru 0x03ffff (0x41a bytes) 000645 1788866278.275776 read 0x0021ed thru 0x00bae6 (0x98fa bytes) 000646 1788866278.287166 fallocate 0x03f321 thru 0x03ffff (0xcdf bytes) 000648 1788866278.295622 fallocate 0x0261a0 thru 0x029755 (0x35b6 bytes) 000649 1788866278.303634 fallocate 0x03127e thru 0x03e28c (0xd00f bytes) 000650 1788866278.316452 fallocate 0x0116c0 thru 0x01978f (0x80d0 bytes) 000651 1788866278.320751 fallocate 0x0185c9 thru 0x01ea50 (0x6488 bytes) 000652 1788866278.327402 trunc from 0x01eb2e to 0x02a9c4 (0xbe97 bytes) 000653 1788866278.332554 fallocate 0x02279c thru 0x02af22 (0x8787 bytes) 000655 1788866278.341174 MIRROR_SPLIT mirror 3 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e28d): Mirror 8: 0xaf010759 (stale) Mirror 9: 0xaf010759 (stale) Mirror 18: 0xaf010759 (stale) Mirror 19: 0xaf010759 (stale) Mirror 22: 0xaf010759 (stale) Mirror 23: 0xaf010759 (stale) Mirror 24: 0xaf010759 (stale) Mirror 25: 0xaf010759 (stale) Mirror 26: 0xaf010759 (stale) Mirror 27: 0xaf010759 (stale) Mirror 28: 0xaf010759 (stale) Mirror 29: 0xaf010759 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e28d): Mirror 8: 0xaf010759 (stale) Mirror 9: 0xaf010759 (stale) Mirror 18: 0xaf010759 (stale) Mirror 19: 0xaf010759 (stale) Mirror 22: 0xaf010759 (stale) Mirror 23: 0xaf010759 (stale) Mirror 24: 0xaf010759 (stale) Mirror 25: 0xaf010759 (stale) Mirror 26: 0xaf010759 (stale) Mirror 27: 0xaf010759 (stale) Mirror 28: 0xaf010759 (stale) Mirror 29: 0xaf010759 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e28d: skipped 000656 1788866279.236777 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3e28d): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e28d): Mirror 8: 0xaf010759 (stale) Mirror 9: 0xaf010759 (stale) Mirror 18: 0xaf010759 (stale) Mirror 19: 0xaf010759 (stale) Mirror 22: 0xaf010759 (stale) Mirror 23: 0xaf010759 (stale) Mirror 24: 0xaf010759 (stale) Mirror 25: 0xaf010759 (stale) Mirror 26: 0xaf010759 (stale) Mirror 27: 0xaf010759 (stale) Mirror 28: 0xaf010759 (stale) Mirror 29: 0xaf010759 (stale) CRC-32 checksum value for chunk [0, 0x3e28d): Mirror 1: 0xe91fda34 Mirror 30: 0xe91fda34 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e28d: skipped 000657 1788866280.583184 trunc from 0x03e28d to 0x0302e7 (0xdfa5 bytes) 000658 1788866280.636456 trunc from 0x0000d3 to 0x0076cd (0x75fb bytes) 000659 1788866280.641502 trunc from 0x0302e8 to 0x03fcc7 (0xf9e0 bytes) 000661 1788866280.671567 mapread 0x0117ab thru 0x01d62a (0xbe80 bytes) 000662 1788866280.723797 trunc from 0x03f048 to 0x03fcc7 (0xc80 bytes) 000663 1788866280.729795 write 0x03ce24 thru 0x03ffff (0x31dc bytes) 000664 1788866280.736740 trunc from 0x013b29 to 0x0203db (0xc8b3 bytes) 000665 1788866280.741609 mapread 0x039752 thru 0x03ffff (0x68ae bytes) 000666 1788866280.752569 trunc from 0x040000 to 0x039aee (0x6511 bytes) 000667 1788866280.773124 trunc from 0x00062a to 0x00d63e (0xd015 bytes) 000668 1788866280.787344 MIRROR_SPLIT mirror 10 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39aef): Mirror 8: 0xcf8224c (stale) Mirror 9: 0xcf8224c (stale) Mirror 18: 0xcf8224c (stale) Mirror 19: 0xcf8224c (stale) Mirror 22: 0xcf8224c (stale) Mirror 23: 0xcf8224c (stale) Mirror 24: 0xcf8224c (stale) Mirror 25: 0xcf8224c (stale) Mirror 26: 0xcf8224c (stale) Mirror 28: 0xcf8224c (stale) Mirror 29: 0xcf8224c (stale) Mirror 30: 0xc28f00bc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39aef): Mirror 8: 0xcf8224c (stale) Mirror 9: 0xcf8224c (stale) Mirror 18: 0xcf8224c (stale) Mirror 19: 0xcf8224c (stale) Mirror 22: 0xcf8224c (stale) Mirror 23: 0xcf8224c (stale) Mirror 24: 0xcf8224c (stale) Mirror 25: 0xcf8224c (stale) Mirror 26: 0xcf8224c (stale) Mirror 28: 0xcf8224c (stale) Mirror 29: 0xcf8224c (stale) Mirror 30: 0xc28f00bc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39aef: skipped 000669 1788866281.998209 mapread 0x01da0e thru 0x023296 (0x5889 bytes) 000670 1788866282.046807 write 0x01ccb3 thru 0x022ad0 (0x5e1e bytes) 000671 1788866282.069967 write 0x03b26f thru 0x03ffff (0x4d91 bytes) 000672 1788866282.071851 mapwrite 0x001e02 thru 0x0082a9 (0x64a8 bytes) 000673 1788866282.131568 mapwrite 0x02eb04 thru 0x0306f6 (0x1bf3 bytes) 000674 1788866282.188963 write 0x009933 thru 0x00c611 (0x2cdf bytes) 000676 1788866282.190579 fallocate 0x012d10 thru 0x01eaf8 (0xbde9 bytes) 000677 1788866282.208238 trunc from 0x0032b9 to 0x0123bb (0xf103 bytes) 000678 1788866282.290336 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x3e23d5ec (stale) Mirror 9: 0x3e23d5ec (stale) Mirror 18: 0x3e23d5ec (stale) Mirror 19: 0x3e23d5ec (stale) Mirror 22: 0x3e23d5ec (stale) Mirror 23: 0x3e23d5ec (stale) Mirror 24: 0x3e23d5ec (stale) Mirror 25: 0x3e23d5ec (stale) Mirror 26: 0x3e23d5ec (stale) Mirror 28: 0x3e23d5ec (stale) Mirror 29: 0x3e23d5ec (stale) Mirror 30: 0x37634f6a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xafd33c0a Mirror 31: 0xafd33c0a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000679 1788866284.819867 MIRROR_SPLIT mirror 7 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x3e23d5ec (stale) Mirror 9: 0x3e23d5ec (stale) Mirror 18: 0x3e23d5ec (stale) Mirror 19: 0x3e23d5ec (stale) Mirror 22: 0x3e23d5ec (stale) Mirror 23: 0x3e23d5ec (stale) Mirror 25: 0x3e23d5ec (stale) Mirror 26: 0x3e23d5ec (stale) Mirror 28: 0x3e23d5ec (stale) Mirror 29: 0x3e23d5ec (stale) Mirror 30: 0x37634f6a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x3e23d5ec (stale) Mirror 9: 0x3e23d5ec (stale) Mirror 18: 0x3e23d5ec (stale) Mirror 19: 0x3e23d5ec (stale) Mirror 22: 0x3e23d5ec (stale) Mirror 23: 0x3e23d5ec (stale) Mirror 25: 0x3e23d5ec (stale) Mirror 26: 0x3e23d5ec (stale) Mirror 28: 0x3e23d5ec (stale) Mirror 29: 0x3e23d5ec (stale) Mirror 30: 0x37634f6a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xafd33c0a Mirror 31: 0xafd33c0a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000680 1788866286.737045 mapwrite 0x017636 thru 0x01d511 (0x5edc bytes) 000682 1788866287.048615 trunc from 0x026360 to 0x0341c9 (0xde6a bytes) 000684 1788866287.054243 trunc from 0x0027c5 to 0x007ce5 (0x5521 bytes) 000685 1788866287.065734 mapread 0x010fbf thru 0x01cccb (0xbd0d bytes) 000686 1788866287.089264 read 0x01bd3c thru 0x022c61 (0x6f26 bytes) 000687 1788866287.098466 mapwrite 0x00b02f thru 0x00e1ac (0x317e bytes) 000689 1788866287.141828 mapread 0x002a05 thru 0x00dc0e (0xb20a bytes) 000690 1788866287.169735 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x3e23d5ec (stale) Mirror 9: 0x3e23d5ec (stale) Mirror 18: 0x3e23d5ec (stale) Mirror 19: 0x3e23d5ec (stale) Mirror 22: 0x3e23d5ec (stale) Mirror 23: 0x3e23d5ec (stale) Mirror 25: 0x3e23d5ec (stale) Mirror 26: 0x3e23d5ec (stale) Mirror 28: 0x3e23d5ec (stale) Mirror 29: 0x3e23d5ec (stale) Mirror 30: 0x37634f6a (stale) Mirror 31: 0xafd33c0a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x38278f0a Mirror 32: 0x38278f0a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000691 1788866289.467176 trunc from 0x040000 to 0x015af0 (0x2a50f bytes) 000692 1788866289.628663 trunc from 0x015af1 to 0x02c8f3 (0x16e03 bytes) 000693 1788866289.662541 read 0x02c3fe thru 0x02c8f3 (0x4f6 bytes) 000694 1788866289.674921 write 0x03dbaa thru 0x03ffff (0x2456 bytes) 000695 1788866289.685167 mapwrite 0x02d3ca thru 0x036f07 (0x9b3e bytes) 000696 1788866289.750492 fallocate 0x001d37 thru 0x00b206 (0x94d0 bytes) 000697 1788866289.755003 punch from 0x00791c to 0x009c83 (0x2368 bytes) 000699 1788866289.760755 read 0x01d868 thru 0x023b62 (0x62fb bytes) 000700 1788866289.773182 punch from 0x017b52 to 0x01ab16 (0x2fc5 bytes) 000701 1788866289.778629 fallocate 0x00f5f7 thru 0x0199b6 (0xa3c0 bytes) 000702 1788866289.789812 MIRROR_RESYNC 14 mirrors 000703 1788866294.195623 read 0x026ad4 thru 0x030255 (0x9782 bytes) 000704 1788866294.214325 trunc from 0x040000 to 0x027093 (0x18f6c bytes) 000705 1788866294.267969 read 0x00ae0a thru 0x014e81 (0xa078 bytes) 000706 1788866294.279627 write 0x00c839 thru 0x0181cf (0xb997 bytes) 000707 1788866294.281853 mapwrite 0x03aa03 thru 0x03ffff (0x55fd bytes) 000708 1788866294.339395 trunc from 0x040000 to 0x02ce5c (0x131a3 bytes) 000709 1788866294.361385 trunc from 0x02ce5d to 0x004d12 (0x2814a bytes) 000710 1788866294.393466 mapread 0x004064 thru 0x004d12 (0xcaf bytes) 000711 1788866294.395837 fallocate 0x02fb1f thru 0x03bd7c (0xc25e bytes) 000712 1788866294.404582 read 0x001cad thru 0x004d12 (0x3066 bytes) 000713 1788866294.406325 write 0x01fdf4 thru 0x022b54 (0x2d61 bytes) 000714 1788866294.407911 read 0x004e39 thru 0x0137f3 (0xe9bb bytes) 000715 1788866294.426845 write 0x014181 thru 0x0168d9 (0x2759 bytes) 000716 1788866294.428546 write 0x02608f thru 0x02cdd3 (0x6d45 bytes) 000717 1788866294.430183 trunc from 0x02cdd4 to 0x01f453 (0xd980 bytes) 000719 1788866294.452167 mapwrite 0x018b75 thru 0x023ea5 (0xb331 bytes) 000720 1788866294.516869 fallocate 0x020923 thru 0x02cc8f (0xc36d bytes) 000721 1788866294.523707 trunc from 0x023ea6 to 0x038b1a (0x14c75 bytes) 000722 1788866294.541772 mapwrite 0x00d527 thru 0x010c20 (0x36fa bytes) 000723 1788866294.556547 trunc from 0x0321ee to 0x038b1a (0x692d bytes) 000724 1788866294.566532 MIRROR_RESYNC 14 mirrors 000725 1788866298.423706 trunc from 0x038b1b to 0x01cd83 (0x1bd97 bytes) 000726 1788866298.451852 mapwrite 0x017c1b thru 0x027766 (0xfb4c bytes) 000727 1788866298.503750 read 0x000824 thru 0x0008e8 (0xc5 bytes) 000728 1788866298.509303 trunc from 0x027767 to 0x02d97e (0x6218 bytes) 000729 1788866298.528979 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x2d97f): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d97f): Mirror 8: 0xf7a0e4cd (stale) Mirror 9: 0xf7a0e4cd (stale) Mirror 18: 0xf7a0e4cd (stale) Mirror 19: 0xf7a0e4cd (stale) Mirror 22: 0xf7a0e4cd (stale) Mirror 23: 0xf7a0e4cd (stale) Mirror 25: 0xf7a0e4cd (stale) Mirror 26: 0xf7a0e4cd (stale) Mirror 28: 0xf7a0e4cd (stale) Mirror 29: 0xf7a0e4cd (stale) Mirror 30: 0xf7a0e4cd (stale) Mirror 31: 0xf7a0e4cd (stale) Mirror 32: 0xf7a0e4cd (stale) CRC-32 checksum value for chunk [0, 0x2d97f): Mirror 1: 0x94135c95 Mirror 33: 0x94135c95 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d97f: skipped 000730 1788866299.334356 read 0x0027cc thru 0x00d831 (0xb066 bytes) 000731 1788866299.345837 trunc from 0x02d97f to 0x02df9a (0x61c bytes) 000732 1788866299.420675 MIRROR_SPLIT mirror 1 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2df9b): Mirror 9: 0x932e5ac8 (stale) Mirror 18: 0x932e5ac8 (stale) Mirror 19: 0x932e5ac8 (stale) Mirror 22: 0x932e5ac8 (stale) Mirror 23: 0x932e5ac8 (stale) Mirror 25: 0x932e5ac8 (stale) Mirror 26: 0x932e5ac8 (stale) Mirror 28: 0x932e5ac8 (stale) Mirror 29: 0x932e5ac8 (stale) Mirror 30: 0x932e5ac8 (stale) Mirror 31: 0x932e5ac8 (stale) Mirror 32: 0x932e5ac8 (stale) Mirror 33: 0x57df71bc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2df9b): Mirror 9: 0x932e5ac8 (stale) Mirror 18: 0x932e5ac8 (stale) Mirror 19: 0x932e5ac8 (stale) Mirror 22: 0x932e5ac8 (stale) Mirror 23: 0x932e5ac8 (stale) Mirror 25: 0x932e5ac8 (stale) Mirror 26: 0x932e5ac8 (stale) Mirror 28: 0x932e5ac8 (stale) Mirror 29: 0x932e5ac8 (stale) Mirror 30: 0x932e5ac8 (stale) Mirror 31: 0x932e5ac8 (stale) Mirror 32: 0x932e5ac8 (stale) Mirror 33: 0x57df71bc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2df9b: skipped 000733 1788866300.553024 write 0x000b24 thru 0x002050 (0x152d bytes) 000734 1788866300.584534 punch from 0x0103c4 to 0x01ff79 (0xfbb6 bytes) 000735 1788866300.602663 mapread 0x00af6f thru 0x01281a (0x78ac bytes) 000736 1788866300.638436 fallocate 0x02bb77 thru 0x031f7e (0x6408 bytes) 000737 1788866300.648711 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x2df9b): Mirror 9: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2df9b): Mirror 9: 0x932e5ac8 (stale) Mirror 18: 0x932e5ac8 (stale) Mirror 19: 0x932e5ac8 (stale) Mirror 22: 0x932e5ac8 (stale) Mirror 23: 0x932e5ac8 (stale) Mirror 25: 0x932e5ac8 (stale) Mirror 26: 0x932e5ac8 (stale) Mirror 28: 0x932e5ac8 (stale) Mirror 29: 0x932e5ac8 (stale) Mirror 30: 0x932e5ac8 (stale) Mirror 31: 0x932e5ac8 (stale) Mirror 32: 0x932e5ac8 (stale) Mirror 33: 0x57df71bc (stale) CRC-32 checksum value for chunk [0, 0x2df9b): Mirror 1: 0x14212ffa Mirror 34: 0x14212ffa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2df9b: skipped 000738 1788866301.848526 trunc from 0x01eb69 to 0x02b59a (0xca32 bytes) 000739 1788866301.877922 trunc from 0x02df9b to 0x02c53e (0x1a5c bytes) 000741 1788866301.894275 punch from 0x01a4f2 to 0x01f008 (0x4b17 bytes) 000742 1788866301.897194 read 0x007c6c thru 0x016dd4 (0xf169 bytes) 000743 1788866301.903012 trunc from 0x02c53f to 0x007f15 (0x24629 bytes) 000745 1788866301.913802 MIRROR_RESYNC 15 mirrors 000746 1788866303.930480 mapread 0x0051ff thru 0x007f15 (0x2d17 bytes) 000747 1788866303.956887 read 0x0044ff thru 0x006d6d (0x286f bytes) 000748 1788866303.958429 punch from 0x0051cc to 0x007f15 (0x2d4a bytes) 000749 1788866304.028519 punch from 0x00724c to 0x007f15 (0xcca bytes) 000750 1788866304.048578 MIRROR_RESYNC 15 mirrors 000751 1788866305.474599 read 0x0007c6 thru 0x00464f (0x3e8a bytes) 000752 1788866305.492379 write 0x0220c4 thru 0x02423b (0x2178 bytes) 000753 1788866305.553665 write 0x02d2ee thru 0x0355aa (0x82bd bytes) 000754 1788866305.558678 read 0x01a0db thru 0x027095 (0xcfbb bytes) 000755 1788866305.575102 fallocate 0x02e679 thru 0x03120e (0x2b96 bytes) 000756 1788866305.581147 fallocate 0x0115cd thru 0x0177b7 (0x61eb bytes) 000757 1788866305.593858 trunc from 0x024c1b to 0x025b7a (0xf60 bytes) 000758 1788866305.613722 punch from 0x00d5d1 to 0x015066 (0x7a96 bytes) 000759 1788866305.617737 trunc from 0x00822a to 0x01407b (0xbe52 bytes) 000760 1788866305.622695 punch from 0x02cddb to 0x0355aa (0x87d0 bytes) 000761 1788866305.627610 read 0x021c20 thru 0x031040 (0xf421 bytes) 000762 1788866305.635919 fallocate 0x0102c7 thru 0x01532e (0x5068 bytes) 000763 1788866305.639566 mapread 0x030c29 thru 0x0355aa (0x4982 bytes) 000764 1788866305.640472 punch from 0x0071b4 to 0x0097ab (0x25f8 bytes) 000765 1788866305.644433 fallocate 0x03a56a thru 0x03e6a5 (0x413c bytes) 000766 1788866305.649766 MIRROR_SPLIT mirror 12 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x355ab): Mirror 9: 0x42092910 (stale) Mirror 18: 0x42092910 (stale) Mirror 19: 0x42092910 (stale) Mirror 22: 0x42092910 (stale) Mirror 23: 0x42092910 (stale) Mirror 25: 0x42092910 (stale) Mirror 26: 0x42092910 (stale) Mirror 28: 0x42092910 (stale) Mirror 29: 0x42092910 (stale) Mirror 30: 0x42092910 (stale) Mirror 31: 0x42092910 (stale) Mirror 33: 0x42092910 (stale) Mirror 34: 0x42092910 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x355ab): Mirror 9: 0x42092910 (stale) Mirror 18: 0x42092910 (stale) Mirror 19: 0x42092910 (stale) Mirror 22: 0x42092910 (stale) Mirror 23: 0x42092910 (stale) Mirror 25: 0x42092910 (stale) Mirror 26: 0x42092910 (stale) Mirror 28: 0x42092910 (stale) Mirror 29: 0x42092910 (stale) Mirror 30: 0x42092910 (stale) Mirror 31: 0x42092910 (stale) Mirror 33: 0x42092910 (stale) Mirror 34: 0x42092910 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x355ab: skipped 000767 1788866306.170344 read 0x0190df thru 0x027846 (0xe768 bytes) 000768 1788866306.177322 punch from 0x031a08 to 0x0355aa (0x3ba3 bytes) 000769 1788866306.187386 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x355ab): Mirror 9: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x355ab): Mirror 9: 0x42092910 (stale) Mirror 18: 0x42092910 (stale) Mirror 19: 0x42092910 (stale) Mirror 22: 0x42092910 (stale) Mirror 23: 0x42092910 (stale) Mirror 25: 0x42092910 (stale) Mirror 26: 0x42092910 (stale) Mirror 28: 0x42092910 (stale) Mirror 29: 0x42092910 (stale) Mirror 30: 0x42092910 (stale) Mirror 31: 0x42092910 (stale) Mirror 33: 0x42092910 (stale) Mirror 34: 0x42092910 (stale) CRC-32 checksum value for chunk [0, 0x355ab): Mirror 1: 0x4ca266d4 Mirror 35: 0x4ca266d4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x355ab: skipped 000771 1788866307.640213 trunc from 0x011fae to 0x01388e (0x18e1 bytes) 000776 1788866307.702437 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x355ab): Mirror 9: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x355ab): Mirror 9: 0x42092910 (stale) Mirror 18: 0x42092910 (stale) Mirror 19: 0x42092910 (stale) Mirror 22: 0x42092910 (stale) Mirror 23: 0x42092910 (stale) Mirror 25: 0x42092910 (stale) Mirror 26: 0x42092910 (stale) Mirror 28: 0x42092910 (stale) Mirror 29: 0x42092910 (stale) Mirror 30: 0x42092910 (stale) Mirror 31: 0x42092910 (stale) Mirror 33: 0x42092910 (stale) Mirror 34: 0x42092910 (stale) Mirror 35: 0x4ca266d4 (stale) CRC-32 checksum value for chunk [0, 0x355ab): Mirror 1: 0x4ca266d4 Mirror 36: 0x4ca266d4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x355ab: skipped 000777 1788866308.751155 read 0x034920 thru 0x0350a9 (0x78a bytes) 000778 1788866308.761615 write 0x03048a thru 0x035b99 (0x5710 bytes) 000779 1788866308.845144 punch from 0x00e98d to 0x010775 (0x1de9 bytes) 000780 1788866308.850434 punch from 0x00bae7 to 0x016424 (0xa93e bytes) 000781 1788866308.856406 fallocate 0x03915f thru 0x03ffff (0x6ea1 bytes) 000782 1788866308.862206 read 0x011d11 thru 0x01d3aa (0xb69a bytes) 000783 1788866308.875792 read 0x030bcb thru 0x035b99 (0x4fcf bytes) 000784 1788866308.876249 trunc from 0x010e44 to 0x0132da (0x2497 bytes) 000785 1788866308.886458 MIRROR_SPLIT mirror 14 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35b9a): Mirror 9: 0x1b11e424 (stale) Mirror 18: 0x1b11e424 (stale) Mirror 19: 0x1b11e424 (stale) Mirror 22: 0x1b11e424 (stale) Mirror 23: 0x1b11e424 (stale) Mirror 25: 0x1b11e424 (stale) Mirror 26: 0x1b11e424 (stale) Mirror 28: 0x1b11e424 (stale) Mirror 29: 0x1b11e424 (stale) Mirror 30: 0x1b11e424 (stale) Mirror 31: 0x1b11e424 (stale) Mirror 33: 0x1b11e424 (stale) Mirror 34: 0x1b11e424 (stale) Mirror 36: 0x46d70fed (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35b9a): Mirror 9: 0x1b11e424 (stale) Mirror 18: 0x1b11e424 (stale) Mirror 19: 0x1b11e424 (stale) Mirror 22: 0x1b11e424 (stale) Mirror 23: 0x1b11e424 (stale) Mirror 25: 0x1b11e424 (stale) Mirror 26: 0x1b11e424 (stale) Mirror 28: 0x1b11e424 (stale) Mirror 29: 0x1b11e424 (stale) Mirror 30: 0x1b11e424 (stale) Mirror 31: 0x1b11e424 (stale) Mirror 33: 0x1b11e424 (stale) Mirror 34: 0x1b11e424 (stale) Mirror 36: 0x46d70fed (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35b9a: skipped 000786 1788866309.720888 trunc from 0x00e135 to 0x01c5a7 (0xe473 bytes) 000788 1788866309.725908 punch from 0x005783 to 0x009bd7 (0x4455 bytes) 000789 1788866309.732538 trunc from 0x035b9a to 0x00ecf2 (0x26ea7 bytes) 000790 1788866309.753684 trunc from 0x003ab7 to 0x00ecf2 (0xb23c bytes) 000792 1788866309.761159 mapwrite 0x01af41 thru 0x022a80 (0x7b40 bytes) 000793 1788866309.801777 fallocate 0x00064c thru 0x0098ee (0x92a3 bytes) 000794 1788866309.805058 write 0x00fd33 thru 0x01940f (0x96dd bytes) 000795 1788866309.812139 MIRROR_SPLIT mirror 12 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22a81): Mirror 9: 0xc647746f (stale) Mirror 18: 0xc647746f (stale) Mirror 19: 0xc647746f (stale) Mirror 22: 0xc647746f (stale) Mirror 23: 0xc647746f (stale) Mirror 25: 0xc647746f (stale) Mirror 26: 0xc647746f (stale) Mirror 28: 0xc647746f (stale) Mirror 29: 0xc647746f (stale) Mirror 30: 0xc647746f (stale) Mirror 31: 0xc647746f (stale) Mirror 34: 0xc647746f (stale) Mirror 36: 0x6d6cde7f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22a81): Mirror 9: 0xc647746f (stale) Mirror 18: 0xc647746f (stale) Mirror 19: 0xc647746f (stale) Mirror 22: 0xc647746f (stale) Mirror 23: 0xc647746f (stale) Mirror 25: 0xc647746f (stale) Mirror 26: 0xc647746f (stale) Mirror 28: 0xc647746f (stale) Mirror 29: 0xc647746f (stale) Mirror 30: 0xc647746f (stale) Mirror 31: 0xc647746f (stale) Mirror 34: 0xc647746f (stale) Mirror 36: 0x6d6cde7f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22a81: skipped 000796 1788866310.444230 mapread 0x01114e thru 0x01ee0a (0xdcbd bytes) 000798 1788866310.473440 fallocate 0x00df68 thru 0x01a84a (0xc8e3 bytes) 000799 1788866310.478808 mapwrite 0x0042fc thru 0x00c748 (0x844d bytes) 000800 1788866310.509941 MIRROR_SPLIT mirror 11 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22a81): Mirror 9: 0xc647746f (stale) Mirror 18: 0xc647746f (stale) Mirror 19: 0xc647746f (stale) Mirror 22: 0xc647746f (stale) Mirror 23: 0xc647746f (stale) Mirror 25: 0xc647746f (stale) Mirror 26: 0xc647746f (stale) Mirror 28: 0xc647746f (stale) Mirror 29: 0xc647746f (stale) Mirror 30: 0xc647746f (stale) Mirror 34: 0xc647746f (stale) Mirror 36: 0x6d6cde7f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22a81): Mirror 9: 0xc647746f (stale) Mirror 18: 0xc647746f (stale) Mirror 19: 0xc647746f (stale) Mirror 22: 0xc647746f (stale) Mirror 23: 0xc647746f (stale) Mirror 25: 0xc647746f (stale) Mirror 26: 0xc647746f (stale) Mirror 28: 0xc647746f (stale) Mirror 29: 0xc647746f (stale) Mirror 30: 0xc647746f (stale) Mirror 34: 0xc647746f (stale) Mirror 36: 0x6d6cde7f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22a81: skipped 000801 1788866311.159902 trunc from 0x022a81 to 0x033dab (0x1132b bytes) 000802 1788866311.208845 punch from 0x033826 to 0x033dab (0x586 bytes) 000804 1788866311.220688 write 0x0135c2 thru 0x01da22 (0xa461 bytes) 000805 1788866311.237044 write 0x01715f thru 0x01e54a (0x73ec bytes) 000806 1788866311.259157 trunc from 0x019a86 to 0x02389b (0x9e16 bytes) 000807 1788866311.285586 trunc from 0x010139 to 0x015673 (0x553b bytes) 000809 1788866311.302646 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x33dac): Mirror 9: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 34: (stale - read error) Mirror 36: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33dac): Mirror 9: 0xa3540b57 (stale) Mirror 18: 0xa3540b57 (stale) Mirror 19: 0xa3540b57 (stale) Mirror 22: 0xa3540b57 (stale) Mirror 23: 0xa3540b57 (stale) Mirror 25: 0xa3540b57 (stale) Mirror 26: 0xa3540b57 (stale) Mirror 28: 0xa3540b57 (stale) Mirror 29: 0xa3540b57 (stale) Mirror 30: 0xa3540b57 (stale) Mirror 34: 0xa3540b57 (stale) Mirror 36: 0xe2b8aa80 (stale) CRC-32 checksum value for chunk [0, 0x33dac): Mirror 1: 0xf133f47d Mirror 37: 0xf133f47d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33dac: skipped 000810 1788866312.669301 fallocate 0x017daa thru 0x018393 (0x5ea bytes) 000812 1788866312.743478 mapread 0x0249bd thru 0x033972 (0xefb6 bytes) 000813 1788866312.801494 write 0x014b1e thru 0x022ba4 (0xe087 bytes) 000814 1788866312.818430 trunc from 0x00d14b to 0x0182d5 (0xb18b bytes) 000815 1788866312.852936 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x33dac): Mirror 9: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 34: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33dac): Mirror 9: 0xa3540b57 (stale) Mirror 18: 0xa3540b57 (stale) Mirror 19: 0xa3540b57 (stale) Mirror 22: 0xa3540b57 (stale) Mirror 23: 0xa3540b57 (stale) Mirror 25: 0xa3540b57 (stale) Mirror 26: 0xa3540b57 (stale) Mirror 28: 0xa3540b57 (stale) Mirror 29: 0xa3540b57 (stale) Mirror 30: 0xa3540b57 (stale) Mirror 34: 0xa3540b57 (stale) Mirror 36: 0xe2b8aa80 (stale) Mirror 37: 0xf133f47d (stale) CRC-32 checksum value for chunk [0, 0x33dac): Mirror 1: 0x64fa5a0b Mirror 38: 0x64fa5a0b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33dac: skipped 000816 1788866314.386530 mapwrite 0x02c907 thru 0x03c629 (0xfd23 bytes) 000818 1788866314.535364 trunc from 0x03c62a to 0x00746b (0x351be bytes) 000819 1788866314.564388 mapwrite 0x02732a thru 0x02cb43 (0x581a bytes) 000820 1788866314.608784 punch from 0x02859f to 0x02cb43 (0x45a5 bytes) 000821 1788866314.618472 MIRROR_RESYNC 15 mirrors 000822 1788866317.563031 mapwrite 0x03b000 thru 0x03ffff (0x5000 bytes) 000823 1788866317.638530 mapread 0x03081f thru 0x032964 (0x2146 bytes) 000825 1788866317.648631 trunc from 0x040000 to 0x03ac2d (0x53d2 bytes) 000826 1788866317.670586 MIRROR_RESYNC 15 mirrors 000827 1788866321.858403 fallocate 0x0074c0 thru 0x0145d3 (0xd114 bytes) 000828 1788866321.914839 write 0x01ca0e thru 0x02c528 (0xfb1b bytes) 000829 1788866321.926473 write 0x03ec59 thru 0x03ffff (0x13a7 bytes) 000830 1788866321.927513 fallocate 0x03b326 thru 0x03ffff (0x4cda bytes) 000831 1788866321.932378 mapread 0x0025b1 thru 0x0038c7 (0x1317 bytes) 000832 1788866321.941914 mapwrite 0x02789c thru 0x02bcf1 (0x4456 bytes) 000833 1788866321.964331 punch from 0x037315 to 0x03dd93 (0x6a7f bytes) 000834 1788866321.969246 punch from 0x0237cc to 0x0254e0 (0x1d15 bytes) 000835 1788866321.975141 mapwrite 0x03d5a6 thru 0x03ffff (0x2a5a bytes) 000836 1788866321.996912 punch from 0x0311ff to 0x03f5af (0xe3b1 bytes) 000838 1788866322.003860 write 0x0315c2 thru 0x032298 (0xcd7 bytes) 000839 1788866322.018013 MIRROR_SPLIT mirror 13 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xff10db6d (stale) Mirror 18: 0xff10db6d (stale) Mirror 19: 0xff10db6d (stale) Mirror 22: 0xff10db6d (stale) Mirror 23: 0xff10db6d (stale) Mirror 25: 0xff10db6d (stale) Mirror 26: 0xff10db6d (stale) Mirror 28: 0xff10db6d (stale) Mirror 29: 0xff10db6d (stale) Mirror 30: 0xff10db6d (stale) Mirror 34: 0xff10db6d (stale) Mirror 36: 0xff10db6d (stale) Mirror 38: 0xff10db6d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xff10db6d (stale) Mirror 18: 0xff10db6d (stale) Mirror 19: 0xff10db6d (stale) Mirror 22: 0xff10db6d (stale) Mirror 23: 0xff10db6d (stale) Mirror 25: 0xff10db6d (stale) Mirror 26: 0xff10db6d (stale) Mirror 28: 0xff10db6d (stale) Mirror 29: 0xff10db6d (stale) Mirror 30: 0xff10db6d (stale) Mirror 34: 0xff10db6d (stale) Mirror 36: 0xff10db6d (stale) Mirror 38: 0xff10db6d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000840 1788866322.679308 read 0x02101a thru 0x0241b2 (0x3199 bytes) 000841 1788866322.685513 trunc from 0x008880 to 0x009889 (0x100a bytes) 000842 1788866322.691161 read 0x027f01 thru 0x02d971 (0x5a71 bytes) 000844 1788866322.722027 trunc from 0x02ccd8 to 0x0316e4 (0x4a0d bytes) 000845 1788866322.727342 read 0x03202b thru 0x032ea6 (0xe7c bytes) 000846 1788866322.729042 mapwrite 0x03acf6 thru 0x03ffff (0x530a bytes) 000847 1788866322.745826 fallocate 0x035834 thru 0x036dd4 (0x15a1 bytes) 000848 1788866322.751053 read 0x03ed37 thru 0x03ffff (0x12c9 bytes) 000849 1788866322.756923 MIRROR_SPLIT mirror 13 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xff10db6d (stale) Mirror 18: 0xff10db6d (stale) Mirror 19: 0xff10db6d (stale) Mirror 22: 0xff10db6d (stale) Mirror 23: 0xff10db6d (stale) Mirror 25: 0xff10db6d (stale) Mirror 26: 0xff10db6d (stale) Mirror 28: 0xff10db6d (stale) Mirror 29: 0xff10db6d (stale) Mirror 30: 0xff10db6d (stale) Mirror 34: 0xff10db6d (stale) Mirror 36: 0xff10db6d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xff10db6d (stale) Mirror 18: 0xff10db6d (stale) Mirror 19: 0xff10db6d (stale) Mirror 22: 0xff10db6d (stale) Mirror 23: 0xff10db6d (stale) Mirror 25: 0xff10db6d (stale) Mirror 26: 0xff10db6d (stale) Mirror 28: 0xff10db6d (stale) Mirror 29: 0xff10db6d (stale) Mirror 30: 0xff10db6d (stale) Mirror 34: 0xff10db6d (stale) Mirror 36: 0xff10db6d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000850 1788866323.415370 fallocate 0x027ab9 thru 0x027e27 (0x36f bytes) 000851 1788866323.422005 fallocate 0x01c78b thru 0x01e9ed (0x2263 bytes) 000852 1788866323.428228 mapread 0x02f5cc thru 0x03b196 (0xbbcb bytes) 000853 1788866323.462940 trunc from 0x040000 to 0x022086 (0x1df79 bytes) 000854 1788866323.482465 read 0x00f8c1 thru 0x019fa0 (0xa6e0 bytes) 000855 1788866323.492494 mapread 0x002a07 thru 0x00cd4a (0xa344 bytes) 000856 1788866323.502172 fallocate 0x01956f thru 0x0222c9 (0x8d5b bytes) 000857 1788866323.507998 read 0x01c4ca thru 0x0222c9 (0x5e00 bytes) 000858 1788866323.516606 trunc from 0x0010a5 to 0x001a4a (0x9a6 bytes) 000859 1788866323.522376 trunc from 0x013968 to 0x01fbee (0xc287 bytes) 000860 1788866323.528226 read 0x00d2bd thru 0x00ecdc (0x1a20 bytes) 000862 1788866323.530332 mapread 0x00d4d3 thru 0x01bc48 (0xe776 bytes) 000863 1788866323.545633 trunc from 0x0222ca to 0x035443 (0x1317a bytes) 000865 1788866323.562578 write 0x014af2 thru 0x01ec89 (0xa198 bytes) 000866 1788866323.564356 trunc from 0x035444 to 0x02a050 (0xb3f3 bytes) 000867 1788866323.588330 fallocate 0x03676a thru 0x03ffff (0x9896 bytes) 000869 1788866323.594607 mapwrite 0x037b20 thru 0x03ffff (0x84e0 bytes) 000870 1788866323.681001 trunc from 0x002b87 to 0x00ac09 (0x8083 bytes) 000872 1788866323.693298 trunc from 0x029136 to 0x0306fa (0x75c5 bytes) 000873 1788866323.700314 punch from 0x009997 to 0x00be8b (0x24f5 bytes) 000874 1788866323.713620 write 0x00539c thru 0x00dfd1 (0x8c36 bytes) 000875 1788866323.729242 mapread 0x037596 thru 0x03ffff (0x8a6a bytes) 000877 1788866323.732027 mapread 0x024afe thru 0x02cc3e (0x8141 bytes) 000878 1788866323.755833 punch from 0x0182f4 to 0x022244 (0x9f51 bytes) 000879 1788866323.764605 punch from 0x03a21f to 0x03ffff (0x5de1 bytes) 000881 1788866323.783160 mapread 0x0250bc thru 0x033fce (0xef13 bytes) 000882 1788866323.807770 write 0x02c651 thru 0x02f60a (0x2fba bytes) 000883 1788866323.809972 fallocate 0x01db48 thru 0x0297dd (0xbc96 bytes) 000884 1788866323.815986 mapread 0x018cf2 thru 0x022f8f (0xa29e bytes) 000885 1788866323.869963 trunc from 0x02429d to 0x030f6a (0xccce bytes) 000887 1788866323.890535 trunc from 0x0168c8 to 0x024df0 (0xe529 bytes) 000888 1788866323.898396 mapread 0x001d95 thru 0x003b56 (0x1dc2 bytes) 000889 1788866323.909423 trunc from 0x040000 to 0x006db9 (0x39246 bytes) 000890 1788866323.927162 fallocate 0x0054af thru 0x00b484 (0x5fd6 bytes) 000891 1788866323.933013 trunc from 0x00555a to 0x00b484 (0x5f2b bytes) 000892 1788866323.939246 fallocate 0x01cb18 thru 0x02a758 (0xdc41 bytes) 000893 1788866323.945118 read 0x025910 thru 0x028719 (0x2e0a bytes) 000894 1788866323.960233 fallocate 0x02a2c0 thru 0x02c17c (0x1ebd bytes) 000895 1788866323.967053 mapwrite 0x001825 thru 0x0055a5 (0x3d81 bytes) 000896 1788866323.989818 mapread 0x014fdf thru 0x01926b (0x428d bytes) 000897 1788866323.991841 fallocate 0x025dd6 thru 0x02f70d (0x9938 bytes) 000898 1788866323.997525 read 0x01a916 thru 0x020c13 (0x62fe bytes) 000899 1788866323.998950 mapwrite 0x02a571 thru 0x039bb1 (0xf641 bytes) 000900 1788866324.099590 write 0x000276 thru 0x0024a2 (0x222d bytes) 000901 1788866324.104579 read 0x003f00 thru 0x00bf4d (0x804e bytes) 000902 1788866324.107252 punch from 0x02fb38 to 0x039bb1 (0xa07a bytes) 000903 1788866324.125786 mapread 0x038b46 thru 0x039bb1 (0x106c bytes) 000904 1788866324.145170 read 0x0356f1 thru 0x039bb1 (0x44c1 bytes) 000905 1788866324.147138 trunc from 0x0231d9 to 0x02b353 (0x817b bytes) 000906 1788866324.155848 mapread 0x02d507 thru 0x039bb1 (0xc6ab bytes) 000907 1788866324.166135 fallocate 0x038653 thru 0x03c621 (0x3fcf bytes) 000908 1788866324.184046 read 0x038674 thru 0x039bb1 (0x153e bytes) 000909 1788866324.185779 write 0x01df49 thru 0x026c90 (0x8d48 bytes) 000910 1788866324.202305 punch from 0x0362f7 to 0x036319 (0x23 bytes) 000911 1788866324.216623 write 0x022da8 thru 0x02d229 (0xa482 bytes) 000912 1788866324.226861 mapread 0x0054be thru 0x01023c (0xad7f bytes) 000913 1788866324.229340 fallocate 0x012fcb thru 0x0219f5 (0xea2b bytes) 000914 1788866324.245457 MIRROR_RESYNC 13 mirrors 000915 1788866327.101193 MIRROR_RESYNC 13 mirrors 000917 1788866327.849214 trunc from 0x039bb2 to 0x00b353 (0x2e85e bytes) 000918 1788866327.919160 trunc from 0x0059fb to 0x00ae4a (0x5450 bytes) 000919 1788866327.928276 read 0x005311 thru 0x007338 (0x2028 bytes) 000920 1788866327.934015 read 0x00358b thru 0x00b353 (0x7dc9 bytes) 000921 1788866327.948135 trunc from 0x004f12 to 0x00b353 (0x6442 bytes) 000923 1788866327.955579 punch from 0x0025eb to 0x002ff7 (0xa0d bytes) 000924 1788866327.962026 mapread 0x00574f thru 0x00b353 (0x5c05 bytes) 000925 1788866328.010036 trunc from 0x0077e1 to 0x00b353 (0x3b73 bytes) 000926 1788866328.016056 mapwrite 0x0160c0 thru 0x01f1a6 (0x90e7 bytes) 000927 1788866328.084732 trunc from 0x003027 to 0x00961d (0x65f7 bytes) 000928 1788866328.098323 trunc from 0x01870d to 0x01f1a6 (0x6a9a bytes) 000929 1788866328.104301 fallocate 0x01a89f thru 0x01eeb5 (0x4617 bytes) 000930 1788866328.111202 mapread 0x00f433 thru 0x01cfba (0xdb88 bytes) 000931 1788866328.137005 mapwrite 0x005e27 thru 0x0139b2 (0xdb8c bytes) 000932 1788866328.206046 trunc from 0x01805e to 0x01f1a6 (0x7149 bytes) 000933 1788866328.214339 read 0x018b25 thru 0x01ca80 (0x3f5c bytes) 000934 1788866328.229986 read 0x017685 thru 0x01cb59 (0x54d5 bytes) 000935 1788866328.230650 fallocate 0x0072c8 thru 0x011e96 (0xabcf bytes) 000937 1788866328.238269 mapwrite 0x032837 thru 0x03d471 (0xac3b bytes) 000938 1788866328.329926 mapread 0x019047 thru 0x01f63f (0x65f9 bytes) 000939 1788866328.334967 punch from 0x02d6cb to 0x03ca8c (0xf3c2 bytes) 000940 1788866328.347305 trunc from 0x0375c3 to 0x03a235 (0x2c73 bytes) 000942 1788866328.360920 trunc from 0x03d472 to 0x029b69 (0x13908 bytes) 000943 1788866328.390065 trunc from 0x029b6a to 0x023dd9 (0x5d90 bytes) 000945 1788866328.447385 read 0x01a59a thru 0x023dd9 (0x9840 bytes) 000946 1788866328.448025 mapread 0x0026ca thru 0x00ac74 (0x85ab bytes) 000947 1788866328.448970 mapread 0x015a2e thru 0x01b5f3 (0x5bc6 bytes) 000948 1788866328.454049 trunc from 0x019369 to 0x023dd9 (0xaa71 bytes) 000949 1788866328.459163 mapread 0x01c05f thru 0x023dd9 (0x7d7b bytes) 000950 1788866328.471663 punch from 0x01be43 to 0x023dd9 (0x7f97 bytes) 000951 1788866328.479128 mapread 0x003ee4 thru 0x0057ee (0x190b bytes) 000952 1788866328.490571 read 0x0225ce thru 0x023dd9 (0x180c bytes) 000954 1788866328.507241 mapread 0x0006e5 thru 0x00f4f3 (0xee0f bytes) 000955 1788866328.508658 mapread 0x00dd14 thru 0x01c0de (0xe3cb bytes) 000956 1788866328.515284 punch from 0x01af6f to 0x023dd9 (0x8e6b bytes) 000957 1788866328.530581 mapread 0x01e9b9 thru 0x023dd9 (0x5421 bytes) 000959 1788866328.587684 read 0x00ac8b thru 0x01109c (0x6412 bytes) 000960 1788866328.589320 trunc from 0x00576b to 0x008b0a (0x33a0 bytes) 000961 1788866328.598924 read 0x0238c3 thru 0x023dd9 (0x517 bytes) 000962 1788866328.605674 read 0x002e57 thru 0x00c921 (0x9acb bytes) 000963 1788866328.629374 mapwrite 0x0241b2 thru 0x02df3d (0x9d8c bytes) 000964 1788866328.684251 trunc from 0x025235 to 0x0285ad (0x3379 bytes) 000965 1788866328.690873 trunc from 0x02df3e to 0x02d7ed (0x750 bytes) 000966 1788866328.719632 trunc from 0x02d7ee to 0x01ac9e (0x12b4f bytes) 000967 1788866328.739346 fallocate 0x0257e7 thru 0x0302cf (0xaae9 bytes) 000968 1788866328.745935 mapwrite 0x00c278 thru 0x0112e1 (0x506a bytes) 000969 1788866328.764027 read 0x019018 thru 0x01ac9e (0x1c87 bytes) 000970 1788866328.768933 MIRROR_SPLIT mirror 4 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ac9f): Mirror 9: 0xed613d52 (stale) Mirror 18: 0xed613d52 (stale) Mirror 19: 0xed613d52 (stale) Mirror 23: 0xed613d52 (stale) Mirror 25: 0xed613d52 (stale) Mirror 26: 0xed613d52 (stale) Mirror 28: 0xed613d52 (stale) Mirror 29: 0xed613d52 (stale) Mirror 30: 0xed613d52 (stale) Mirror 34: 0xed613d52 (stale) Mirror 36: 0xed613d52 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ac9f): Mirror 9: 0xed613d52 (stale) Mirror 18: 0xed613d52 (stale) Mirror 19: 0xed613d52 (stale) Mirror 23: 0xed613d52 (stale) Mirror 25: 0xed613d52 (stale) Mirror 26: 0xed613d52 (stale) Mirror 28: 0xed613d52 (stale) Mirror 29: 0xed613d52 (stale) Mirror 30: 0xed613d52 (stale) Mirror 34: 0xed613d52 (stale) Mirror 36: 0xed613d52 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ac9f: skipped 000971 1788866329.692509 trunc from 0x00aa62 to 0x00f1ef (0x478e bytes) 000972 1788866329.702238 punch from 0x0051a6 to 0x006713 (0x156e bytes) 000973 1788866329.722734 MIRROR_RESYNC 12 mirrors 000974 1788866334.055228 trunc from 0x01ac9f to 0x039676 (0x1e9d8 bytes) 000975 1788866334.116982 read 0x024eaf thru 0x033b6d (0xecbf bytes) 000976 1788866334.129658 write 0x03b9e0 thru 0x03ffff (0x4620 bytes) 000977 1788866334.131064 write 0x00c021 thru 0x00d3df (0x13bf bytes) 000980 1788866334.145022 trunc from 0x040000 to 0x002533 (0x3dacc bytes) 000981 1788866334.173163 trunc from 0x002534 to 0x02a8ba (0x28387 bytes) 000982 1788866334.197956 trunc from 0x01f6cf to 0x029a53 (0xa385 bytes) 000983 1788866334.204590 read 0x00b38a thru 0x014bca (0x9841 bytes) 000984 1788866334.217296 trunc from 0x02a8bb to 0x01b4b6 (0xf404 bytes) 000985 1788866334.233064 read 0x011c5a thru 0x013ad6 (0x1e7d bytes) 000986 1788866334.234652 fallocate 0x01d6f9 thru 0x02b362 (0xdc6a bytes) 000987 1788866334.240960 punch from 0x0179c6 to 0x0197da (0x1e15 bytes) 000988 1788866334.245421 mapread 0x00d0ae thru 0x01aae7 (0xda3a bytes) 000989 1788866334.262962 MIRROR_SPLIT mirror 3 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1b8:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b363): Mirror 9: 0x456d0c5c (stale) Mirror 18: 0x456d0c5c (stale) Mirror 23: 0x456d0c5c (stale) Mirror 25: 0x456d0c5c (stale) Mirror 26: 0x456d0c5c (stale) Mirror 28: 0x456d0c5c (stale) Mirror 29: 0x456d0c5c (stale) Mirror 30: 0x456d0c5c (stale) Mirror 34: 0x456d0c5c (stale) Mirror 36: 0x456d0c5c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b363): Mirror 9: 0x456d0c5c (stale) Mirror 18: 0x456d0c5c (stale) Mirror 23: 0x456d0c5c (stale) Mirror 25: 0x456d0c5c (stale) Mirror 26: 0x456d0c5c (stale) Mirror 28: 0x456d0c5c (stale) Mirror 29: 0x456d0c5c (stale) Mirror 30: 0x456d0c5c (stale) Mirror 34: 0x456d0c5c (stale) Mirror 36: 0x456d0c5c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b363: skipped 000990 1788866334.882571 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x2b363): Mirror 9: (stale - read error) Mirror 18: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 34: (stale - read error) Mirror 36: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b363): Mirror 9: 0x456d0c5c (stale) Mirror 18: 0x456d0c5c (stale) Mirror 23: 0x456d0c5c (stale) Mirror 25: 0x456d0c5c (stale) Mirror 26: 0x456d0c5c (stale) Mirror 28: 0x456d0c5c (stale) Mirror 29: 0x456d0c5c (stale) Mirror 30: 0x456d0c5c (stale) Mirror 34: 0x456d0c5c (stale) Mirror 36: 0x456d0c5c (stale) CRC-32 checksum value for chunk [0, 0x2b363): Mirror 1: 0x415f32b6 Mirror 37: 0x415f32b6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b363: skipped 000991 1788866336.344334 write 0x02cbb2 thru 0x0353fa (0x8849 bytes) 000992 1788866336.428839 trunc from 0x033826 to 0x0353fa (0x1bd5 bytes) 000993 1788866336.454720 trunc from 0x021394 to 0x02e54a (0xd1b7 bytes) 000994 1788866336.462055 fallocate 0x00b807 thru 0x017f30 (0xc72a bytes) 000995 1788866336.470777 write 0x03d259 thru 0x03ffff (0x2da7 bytes) 000996 1788866336.472472 punch from 0x025900 to 0x028ecb (0x35cc bytes) 000997 1788866336.487177 MIRROR_RESYNC 12 mirrors 000998 1788866339.851484 write 0x039d53 thru 0x03efae (0x525c bytes) 000999 1788866339.886904 trunc from 0x040000 to 0x026fe6 (0x19019 bytes) 001000 1788866339.914609 fallocate 0x010ab0 thru 0x011413 (0x964 bytes) All operations completed A-OK!