== sanity-flr test 70a: flr mode fsx test ================ 16:23:56 (1788639836) Seed set to 9838 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1788639838.963420 write 0x013888 thru 0x016b40 (0x32b9 bytes) 000002 1788639838.984039 read 0x0000b1 thru 0x00da78 (0xd9c8 bytes) 000004 1788639839.029417 MIRROR_EXTEND to 2 mirrors 000005 1788639840.376623 MIRROR_RESYNC 2 mirrors 000008 1788639840.960901 mapread 0x0024a2 thru 0x00c4ed (0xa04c bytes) 000009 1788639840.987135 punch from 0x006518 to 0x015cec (0xf7d5 bytes) 000015 1788639841.110105 punch from 0x00cf6f to 0x016b40 (0x9bd2 bytes) 000016 1788639841.134400 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) truncating to largest ever: 0x2ab15 000018 1788639841.421231 trunc from 0x016b41 to 0x02ab14 (0x13fd4 bytes) 000020 1788639841.457895 mapwrite 0x02c887 thru 0x039cbd (0xd437 bytes) 000021 1788639841.677735 punch from 0x017cbc to 0x01b873 (0x3bb8 bytes) 000022 1788639841.689475 mapwrite 0x02f3a8 thru 0x03a0b4 (0xad0d bytes) 000024 1788639841.967347 read 0x0256e7 thru 0x030c13 (0xb52d bytes) 000025 1788639841.979030 mapwrite 0x021ce8 thru 0x022cf0 (0x1009 bytes) 000026 1788639842.140298 mapread 0x02b395 thru 0x03081f (0x548b bytes) 000027 1788639842.142471 write 0x014259 thru 0x01679b (0x2543 bytes) 000028 1788639842.201442 mapwrite 0x01e127 thru 0x0256c4 (0x759e bytes) 000031 1788639842.370433 mapwrite 0x009a58 thru 0x0176e6 (0xdc8f bytes) 000032 1788639842.588687 mapread 0x00c544 thru 0x00e4b4 (0x1f71 bytes) 000037 1788639842.593752 mapwrite 0x02b286 thru 0x02dee8 (0x2c63 bytes) 000040 1788639842.694455 MIRROR_EXTEND to 2 mirrors 000043 1788639843.883718 punch from 0x0072fb to 0x00be8c (0x4b92 bytes) 000044 1788639843.968766 write 0x00d9a0 thru 0x0195d3 (0xbc34 bytes) 000046 1788639843.994974 MIRROR_RESYNC 2 mirrors 000048 1788639845.383641 mapread 0x00c6e4 thru 0x0134bf (0x6ddc bytes) 000049 1788639845.414080 read 0x02cb14 thru 0x02d0bc (0x5a9 bytes) 000050 1788639845.424448 trunc from 0x03a0b5 to 0x01b7d2 (0x1e8e2 bytes) 000051 1788639845.532362 mapwrite 0x00599b thru 0x00867f (0x2ce5 bytes) 000054 1788639845.719677 punch from 0x010e55 to 0x015e4d (0x4ff9 bytes) 000055 1788639845.742798 write 0x0155ea thru 0x0224c1 (0xced8 bytes) 000056 1788639845.773553 trunc from 0x0224c2 to 0x024e7a (0x29b9 bytes) 000058 1788639845.837004 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x24e7b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24e7b): Mirror 2: 0x2f4d760f (stale) CRC-32 checksum value for chunk [0, 0x24e7b): Mirror 1: 0x92c7d5af Mirror 3: 0x92c7d5af lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24e7b: skipped 000059 1788639848.011758 punch from 0x016d60 to 0x01a847 (0x3ae8 bytes) 000060 1788639848.200971 punch from 0x0247fc to 0x024e7a (0x67f bytes) 000062 1788639848.214164 trunc from 0x024e7b to 0x0257aa (0x930 bytes) 000064 1788639848.271895 mapread 0x00198b thru 0x00d397 (0xba0d bytes) 000066 1788639848.315725 write 0x006857 thru 0x006ed7 (0x681 bytes) 000068 1788639848.318361 punch from 0x0062e3 to 0x007514 (0x1232 bytes) 000069 1788639848.335825 punch from 0x0164b1 to 0x01cc9a (0x67ea bytes) truncating to largest ever: 0x38f3c 000070 1788639848.346184 trunc from 0x0257ab to 0x038f3b (0x13791 bytes) 000071 1788639848.394338 mapread 0x02b8ba thru 0x02e361 (0x2aa8 bytes) 000073 1788639848.425607 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x38f3c): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38f3c): Mirror 2: 0x561bc1ea (stale) Mirror 3: 0xb2f497dc (stale) CRC-32 checksum value for chunk [0, 0x38f3c): Mirror 1: 0x522d2243 Mirror 4: 0x522d2243 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38f3c: skipped 000074 1788639850.367198 punch from 0x01dc5b to 0x02c1e2 (0xe588 bytes) 000076 1788639850.553421 mapwrite 0x00576c thru 0x006ea4 (0x1739 bytes) 000077 1788639850.667278 punch from 0x02bf8a to 0x038f3b (0xcfb2 bytes) 000078 1788639850.675390 read 0x024d17 thru 0x026c77 (0x1f61 bytes) 000079 1788639850.685343 mapread 0x01b5eb thru 0x0260e6 (0xaafc bytes) 000081 1788639850.708874 mapwrite 0x0265b9 thru 0x02d014 (0x6a5c bytes) 000082 1788639850.806538 read 0x02ca58 thru 0x031273 (0x481c bytes) 000083 1788639850.842597 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38f3c): Mirror 2: 0x561bc1ea (stale) Mirror 4: 0x522d2243 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38f3c): Mirror 2: 0x561bc1ea (stale) Mirror 4: 0x522d2243 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38f3c: skipped 000084 1788639851.359435 read 0x003317 thru 0x00e2a8 (0xaf92 bytes) 000085 1788639851.386365 mapwrite 0x03c170 thru 0x03ffff (0x3e90 bytes) 000086 1788639851.601829 write 0x023ccf thru 0x024981 (0xcb3 bytes) 000087 1788639851.625330 punch from 0x007c4a to 0x010fab (0x9362 bytes) 000089 1788639851.650228 mapread 0x03fb5c thru 0x03ffff (0x4a4 bytes) 000090 1788639851.651253 punch from 0x011399 to 0x017692 (0x62fa bytes) 000092 1788639851.664618 write 0x0026b1 thru 0x0104d8 (0xde28 bytes) 000093 1788639851.705325 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x52c6f9fe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x52c6f9fe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000094 1788639852.154824 trunc from 0x040000 to 0x0208ea (0x1f715 bytes) 000095 1788639852.217085 mapread 0x01c656 thru 0x0208ea (0x4295 bytes) 000096 1788639852.261448 mapread 0x008afc thru 0x0134fc (0xaa01 bytes) 000097 1788639852.355898 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) 000098 1788639852.628173 write 0x00dfbf thru 0x00fb1a (0x1b5c bytes) 000099 1788639852.647217 mapread 0x010f25 thru 0x01ec07 (0xdce3 bytes) 000101 1788639852.718776 mapwrite 0x01370b thru 0x01dd69 (0xa65f bytes) 000102 1788639852.882397 mapwrite 0x0388e6 thru 0x03ba1b (0x3136 bytes) 000106 1788639853.077925 trunc from 0x03ba1c to 0x003ccb (0x37d50 bytes) 000108 1788639853.112685 trunc from 0x003ccc to 0x01589b (0x11bd0 bytes) 000109 1788639853.157894 mapread 0x012ed0 thru 0x01589b (0x29cc bytes) 000110 1788639853.169960 punch from 0x001c09 to 0x00bd07 (0xa0ff bytes) 000111 1788639853.175213 trunc from 0x01589c to 0x00e87e (0x701d bytes) 000112 1788639853.198157 read 0x00c10b thru 0x00e87e (0x2774 bytes) 000113 1788639853.199981 trunc from 0x00e87f to 0x035c62 (0x273e4 bytes) 000114 1788639853.231819 write 0x01b12b thru 0x02a752 (0xf628 bytes) 000115 1788639853.251667 write 0x02fb3a thru 0x034aea (0x4fb1 bytes) 000116 1788639853.267095 read 0x011ec1 thru 0x01a99f (0x8adf bytes) 000117 1788639853.290710 read 0x025e56 thru 0x02de4f (0x7ffa bytes) 000118 1788639853.291635 write 0x0134bd thru 0x013e78 (0x9bc bytes) 000119 1788639853.297373 trunc from 0x035c63 to 0x021168 (0x14afa bytes) 000121 1788639853.340438 mapread 0x009307 thru 0x010c5f (0x7959 bytes) 000122 1788639853.351095 read 0x00aba2 thru 0x017033 (0xc492 bytes) 000123 1788639853.354649 read 0x003c08 thru 0x00902a (0x5423 bytes) 000124 1788639853.360886 punch from 0x01e650 to 0x021168 (0x2b19 bytes) 000125 1788639853.394704 mapread 0x0008bf thru 0x002b4a (0x228c bytes) 000126 1788639853.395571 write 0x02e3ba thru 0x032600 (0x4247 bytes) 000127 1788639853.411077 MIRROR_EXTEND to 2 mirrors 000129 1788639854.861102 read 0x01048a thru 0x0107a3 (0x31a bytes) 000133 1788639854.939254 read 0x00a2ee thru 0x01a2c0 (0xffd3 bytes) 000135 1788639855.016042 MIRROR_RESYNC 2 mirrors 000139 1788639855.516108 MIRROR_RESYNC 2 mirrors 000141 1788639855.937950 mapread 0x01a649 thru 0x021249 (0x6c01 bytes) 000142 1788639855.989341 read 0x01ed53 thru 0x02862e (0x98dc bytes) 000143 1788639856.022444 punch from 0x007893 to 0x013a9e (0xc20c bytes) 000145 1788639856.177368 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x32601): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32601): Mirror 2: 0x8c677a (stale) CRC-32 checksum value for chunk [0, 0x32601): Mirror 1: 0x969b301a Mirror 3: 0x969b301a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32601: skipped 000146 1788639858.290919 punch from 0x027d63 to 0x02f07c (0x731a bytes) 000147 1788639858.416561 write 0x00cfea thru 0x015681 (0x8698 bytes) 000148 1788639858.442439 write 0x00fb05 thru 0x01531d (0x5819 bytes) 000150 1788639858.444410 mapread 0x022b3b thru 0x031a6d (0xef33 bytes) 000152 1788639858.484997 mapread 0x01c5bb thru 0x022d3f (0x6785 bytes) 000153 1788639858.500801 mapwrite 0x03ddb9 thru 0x03ffff (0x2247 bytes) 000154 1788639858.638359 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xf15c187a (stale) Mirror 3: 0xc772781f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x42b0bb19 Mirror 4: 0x42b0bb19 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000155 1788639860.257372 write 0x01d62b thru 0x02b603 (0xdfd9 bytes) 000157 1788639860.401976 mapread 0x02b665 thru 0x037c8c (0xc628 bytes) 000159 1788639860.469119 trunc from 0x040000 to 0x00d0e7 (0x32f18 bytes) 000160 1788639860.515349 mapread 0x00b66f thru 0x00d0e7 (0x1a79 bytes) 000162 1788639860.531347 punch from 0x0054a5 to 0x00d0e7 (0x7c43 bytes) 000163 1788639860.538364 punch from 0x005a5a to 0x00b136 (0x56dd bytes) 000164 1788639860.545118 punch from 0x00783f to 0x008dad (0x156f bytes) 000165 1788639860.575044 MIRROR_RESYNC 4 mirrors 000166 1788639861.809318 mapread 0x005bae thru 0x00d0e7 (0x753a bytes) 000167 1788639861.859057 MIRROR_EXTEND to 5 mirrors 000168 1788639863.128621 trunc from 0x00d0e8 to 0x02b91e (0x1e837 bytes) 000169 1788639863.308242 write 0x018c3f thru 0x0243fc (0xb7be bytes) truncating to largest ever: 0x3f2b3 000170 1788639863.334596 trunc from 0x02b91f to 0x03f2b2 (0x13994 bytes) 000171 1788639863.403824 mapwrite 0x03bd4a thru 0x03ca30 (0xce7 bytes) 000172 1788639863.515645 write 0x030c2e thru 0x03e1f5 (0xd5c8 bytes) 000173 1788639863.548138 read 0x01157b thru 0x014771 (0x31f7 bytes) 000174 1788639863.573484 trunc from 0x03f2b3 to 0x02b3fb (0x13eb7 bytes) 000175 1788639863.599898 punch from 0x0126a6 to 0x01c7f1 (0xa14c bytes) 000176 1788639863.616212 punch from 0x021947 to 0x02b3fb (0x9ab5 bytes) 000177 1788639863.639916 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b3fc): Mirror 3: 0xf521b833 (stale) Mirror 4: 0xf521b833 (stale) Mirror 5: 0xf521b833 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b3fc): Mirror 3: 0xf521b833 (stale) Mirror 4: 0xf521b833 (stale) Mirror 5: 0xf521b833 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b3fc: skipped 000178 1788639864.437217 mapread 0x00ff52 thru 0x01c9af (0xca5e bytes) 000179 1788639864.543319 mapread 0x020258 thru 0x02691e (0x66c7 bytes) 000180 1788639864.551366 mapwrite 0x010e74 thru 0x0116f5 (0x882 bytes) 000182 1788639864.613467 write 0x0174da thru 0x0266e1 (0xf208 bytes) 000183 1788639864.615027 trunc from 0x02b3fc to 0x03859c (0xd1a1 bytes) 000184 1788639864.650049 trunc from 0x03859d to 0x027d24 (0x10878 bytes) 000185 1788639864.676194 mapwrite 0x03294e thru 0x03fee6 (0xd599 bytes) 000186 1788639864.827903 trunc from 0x03fee7 to 0x02d92c (0x125ba bytes) 000187 1788639864.870677 punch from 0x02a984 to 0x02d92c (0x2fa9 bytes) 000188 1788639864.885018 read 0x025c59 thru 0x026c94 (0x103c bytes) 000190 1788639864.887019 write 0x02d701 thru 0x037bdb (0xa4db bytes) 000191 1788639864.911138 read 0x000070 thru 0x002039 (0x1fca bytes) 000192 1788639864.925684 write 0x0045ce thru 0x006c4e (0x2681 bytes) 000193 1788639864.927926 write 0x02052d thru 0x0239f9 (0x34cd bytes) 000194 1788639864.929958 read 0x010b24 thru 0x01d37b (0xc858 bytes) 000195 1788639864.931344 trunc from 0x037bdc to 0x011c02 (0x25fd9 bytes) 000196 1788639864.966817 trunc from 0x011c03 to 0x00f701 (0x2501 bytes) 000197 1788639864.988068 trunc from 0x00f702 to 0x023031 (0x13930 bytes) 000198 1788639865.009925 trunc from 0x023032 to 0x03851e (0x154ed bytes) 000205 1788639865.040062 read 0x00ce4a thru 0x01b774 (0xe92b bytes) 000207 1788639865.060451 mapwrite 0x0253cc thru 0x0275ad (0x21e2 bytes) 000208 1788639865.132416 punch from 0x016f18 to 0x0192b6 (0x239f bytes) 000209 1788639865.137881 mapread 0x03529c thru 0x03851e (0x3283 bytes) 000210 1788639865.140017 trunc from 0x03851f to 0x006f95 (0x31589 bytes) 000211 1788639865.171878 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x6f96): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6f96): Mirror 3: 0x16ad08b7 (stale) Mirror 4: 0x16ad08b7 (stale) Mirror 5: 0x16ad08b7 (stale) CRC-32 checksum value for chunk [0, 0x6f96): Mirror 1: 0xa623b66 Mirror 6: 0xa623b66 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6f96: skipped 000213 1788639865.999829 read 0x0000e4 thru 0x006f95 (0x6eb2 bytes) 000214 1788639866.008899 mapread 0x00013e thru 0x006f95 (0x6e58 bytes) 000216 1788639866.010224 mapwrite 0x017e8f thru 0x01bc02 (0x3d74 bytes) 000218 1788639866.324786 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1bc03): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1bc03): Mirror 3: 0x3e0cacf3 (stale) Mirror 4: 0x3e0cacf3 (stale) Mirror 5: 0x3e0cacf3 (stale) Mirror 6: 0x4c83e03c (stale) CRC-32 checksum value for chunk [0, 0x1bc03): Mirror 1: 0x1a3f62e3 Mirror 7: 0x1a3f62e3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1bc03: skipped 000219 1788639867.988940 trunc from 0x01bc03 to 0x027efe (0xc2fc bytes) 000220 1788639868.224913 read 0x006b94 thru 0x009ab1 (0x2f1e bytes) 000221 1788639868.251394 trunc from 0x027eff to 0x02c69e (0x47a0 bytes) 000222 1788639868.307655 read 0x0107a3 thru 0x020356 (0xfbb4 bytes) 000224 1788639868.325891 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2c69f): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c69f): Mirror 3: 0x8b6e4519 (stale) Mirror 4: 0x8b6e4519 (stale) Mirror 5: 0x8b6e4519 (stale) Mirror 6: 0x53627d73 (stale) Mirror 7: 0x62de00ad (stale) CRC-32 checksum value for chunk [0, 0x2c69f): Mirror 1: 0x62de00ad Mirror 8: 0x62de00ad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c69f: skipped 000225 1788639870.294122 trunc from 0x02c69f to 0x0297a3 (0x2efb bytes) 000228 1788639870.386836 write 0x026dbe thru 0x02b3a9 (0x45ec bytes) 000229 1788639870.397977 punch from 0x017155 to 0x0206d3 (0x957f bytes) 000230 1788639870.429728 mapwrite 0x0028cc thru 0x00e05b (0xb790 bytes) 000231 1788639870.505905 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b3aa): Mirror 3: 0x2afd0707 (stale) Mirror 5: 0x2afd0707 (stale) Mirror 6: 0xac9fbf09 (stale) Mirror 7: 0xeca8ed7c (stale) Mirror 8: 0xeca8ed7c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b3aa): Mirror 3: 0x2afd0707 (stale) Mirror 5: 0x2afd0707 (stale) Mirror 6: 0xac9fbf09 (stale) Mirror 7: 0xeca8ed7c (stale) Mirror 8: 0xeca8ed7c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b3aa: skipped 000232 1788639871.072708 punch from 0x021806 to 0x02b3a9 (0x9ba4 bytes) 000234 1788639871.078980 mapwrite 0x020bdc thru 0x029106 (0x852b bytes) 000235 1788639871.142053 read 0x00174d thru 0x0062ba (0x4b6e bytes) 000236 1788639871.150927 mapwrite 0x007c39 thru 0x014686 (0xca4e bytes) 000237 1788639871.315690 mapread 0x0266f1 thru 0x02b3a9 (0x4cb9 bytes) 000238 1788639871.328786 trunc from 0x02b3aa to 0x000fbc (0x2a3ed bytes) 000241 1788639871.363887 trunc from 0x000fbd to 0x0257b6 (0x247fa bytes) 000243 1788639871.411175 punch from 0x00dccf to 0x01af24 (0xd256 bytes) 000245 1788639871.423155 mapread 0x020574 thru 0x0257b6 (0x5243 bytes) 000246 1788639871.440675 trunc from 0x0257b7 to 0x01fa5d (0x5d59 bytes) 000249 1788639871.480360 mapread 0x0042bf thru 0x00fe99 (0xbbdb bytes) 000250 1788639871.505933 punch from 0x003e53 to 0x0061f5 (0x23a3 bytes) 000251 1788639871.516747 mapwrite 0x037202 thru 0x03ffff (0x8dfe bytes) 000252 1788639871.753018 read 0x016142 thru 0x01863f (0x24fe bytes) 000253 1788639871.787589 write 0x03792a thru 0x03ffff (0x86d6 bytes) 000254 1788639871.788925 punch from 0x00d2da to 0x00e2b1 (0xfd8 bytes) 000256 1788639871.822124 punch from 0x0164c3 to 0x016892 (0x3d0 bytes) 000257 1788639871.845957 trunc from 0x040000 to 0x0140e0 (0x2bf1f bytes) 000259 1788639871.876462 write 0x030ef6 thru 0x035e38 (0x4f43 bytes) 000260 1788639871.885805 punch from 0x017288 to 0x01eb0b (0x7884 bytes) 000262 1788639871.922542 write 0x000676 thru 0x00c8e0 (0xc26b bytes) 000263 1788639871.930712 trunc from 0x035e39 to 0x00ee18 (0x27020 bytes) 000265 1788639871.980903 mapwrite 0x034558 thru 0x0377fb (0x32a4 bytes) 000266 1788639872.233486 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x377fc): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x377fc): Mirror 3: 0x48b291ca (stale) Mirror 5: 0x48b291ca (stale) Mirror 6: 0xa0ad6781 (stale) Mirror 7: 0xdb2b3012 (stale) Mirror 8: 0xdb2b3012 (stale) CRC-32 checksum value for chunk [0, 0x377fc): Mirror 1: 0x59894ad9 Mirror 9: 0x59894ad9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x377fc: skipped 000267 1788639873.901814 read 0x01ddff thru 0x0224b5 (0x46b7 bytes) 000268 1788639873.920655 read 0x008ac1 thru 0x018887 (0xfdc7 bytes) 000269 1788639873.947914 punch from 0x01fc0d to 0x020af6 (0xeea bytes) 000270 1788639874.075165 punch from 0x023b79 to 0x02511a (0x15a2 bytes) 000271 1788639874.083902 punch from 0x026884 to 0x030214 (0x9991 bytes) 000272 1788639874.091107 trunc from 0x0377fc to 0x01c1bc (0x1b63f bytes) 000273 1788639874.133221 read 0x003544 thru 0x00bbe4 (0x86a1 bytes) 000274 1788639874.149058 punch from 0x0081ec to 0x009d96 (0x1bab bytes) 000276 1788639874.157911 read 0x004da4 thru 0x00c8b1 (0x7b0e bytes) 000278 1788639874.168303 punch from 0x0085d2 to 0x0143cd (0xbdfc bytes) 000281 1788639874.177947 trunc from 0x01c1bd to 0x024acc (0x8910 bytes) 000283 1788639874.200196 mapread 0x0040f7 thru 0x013532 (0xf43c bytes) 000284 1788639874.268824 mapwrite 0x0325c6 thru 0x034874 (0x22af bytes) 000285 1788639874.367368 write 0x01d56f thru 0x02a7c4 (0xd256 bytes) 000287 1788639874.369089 mapwrite 0x0246af thru 0x02c6cd (0x801f bytes) 000288 1788639874.437966 mapread 0x02275d thru 0x02ecec (0xc590 bytes) 000289 1788639874.441636 trunc from 0x034875 to 0x0287a6 (0xc0ce bytes) 000291 1788639874.468011 write 0x03eb0b thru 0x03ffff (0x14f5 bytes) 000292 1788639874.470152 read 0x00daef thru 0x011431 (0x3943 bytes) 000293 1788639874.476907 MIRROR_RESYNC 7 mirrors 000294 1788639877.686229 read 0x023121 thru 0x028d5a (0x5c3a bytes) 000297 1788639877.699265 mapread 0x02c9d7 thru 0x0305ad (0x3bd7 bytes) 000298 1788639877.747454 mapread 0x010e1f thru 0x01a1f5 (0x93d7 bytes) 000300 1788639877.791440 trunc from 0x040000 to 0x0363ec (0x9c13 bytes) 000301 1788639877.903236 punch from 0x015e92 to 0x01f503 (0x9672 bytes) 000302 1788639877.909644 trunc from 0x0363ed to 0x023d7f (0x1266d bytes) 000304 1788639877.943621 mapread 0x011b29 thru 0x01885f (0x6d37 bytes) 000305 1788639877.957769 mapwrite 0x009cbd thru 0x01003a (0x637e bytes) 000306 1788639878.080211 punch from 0x0134cc to 0x01cde3 (0x9918 bytes) 000307 1788639878.087084 trunc from 0x023d80 to 0x024bc0 (0xe41 bytes) 000308 1788639878.139368 mapwrite 0x029dc5 thru 0x032ab6 (0x8cf2 bytes) 000309 1788639878.354561 mapread 0x0307f8 thru 0x0309f3 (0x1fc bytes) 000310 1788639878.361025 write 0x017ed6 thru 0x0215cb (0x96f6 bytes) 000311 1788639878.403373 read 0x00ee38 thru 0x01a0ae (0xb277 bytes) 000312 1788639878.424060 mapread 0x01642c thru 0x01a921 (0x44f6 bytes) 000313 1788639878.427127 mapwrite 0x0114e6 thru 0x0202a6 (0xedc1 bytes) 000314 1788639878.619959 trunc from 0x032ab7 to 0x02d863 (0x5253 bytes) 000315 1788639878.665013 mapread 0x01e99d thru 0x02780e (0x8e72 bytes) 000317 1788639878.672931 punch from 0x0202de to 0x029bbe (0x98e1 bytes) 000318 1788639878.680466 mapread 0x007ae8 thru 0x00f37b (0x7894 bytes) 000319 1788639878.692615 mapread 0x013910 thru 0x022ef9 (0xf5ea bytes) 000320 1788639878.756474 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d864): Mirror 3: 0x4bf9a535 (stale) Mirror 5: 0x4bf9a535 (stale) Mirror 6: 0x4bf9a535 (stale) Mirror 7: 0x4bf9a535 (stale) Mirror 8: 0x4bf9a535 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d864): Mirror 3: 0x4bf9a535 (stale) Mirror 5: 0x4bf9a535 (stale) Mirror 6: 0x4bf9a535 (stale) Mirror 7: 0x4bf9a535 (stale) Mirror 8: 0x4bf9a535 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d864: skipped 000322 1788639879.628556 punch from 0x009976 to 0x00a822 (0xead bytes) 000324 1788639879.638835 punch from 0x004a42 to 0x00c58c (0x7b4b bytes) 000325 1788639879.644693 mapwrite 0x02ecd4 thru 0x037cd9 (0x9006 bytes) 000326 1788639879.786079 mapread 0x015bef thru 0x0220b9 (0xc4cb bytes) 000327 1788639879.844084 read 0x016bed thru 0x02502b (0xe43f bytes) 000328 1788639879.844767 mapread 0x033e8e thru 0x037cd9 (0x3e4c bytes) 000330 1788639879.845906 mapwrite 0x002825 thru 0x0096eb (0x6ec7 bytes) 000331 1788639879.978259 mapread 0x0295ff thru 0x032ed9 (0x98db bytes) 000332 1788639879.979230 punch from 0x029a91 to 0x030cac (0x721c bytes) 000335 1788639879.993720 read 0x010440 thru 0x012c1d (0x27de bytes) 000336 1788639879.994683 read 0x024764 thru 0x030218 (0xbab5 bytes) 000337 1788639880.014021 mapwrite 0x01f2cc thru 0x026c07 (0x793c bytes) 000338 1788639880.111865 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x37cda): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37cda): Mirror 3: 0xd2edd7ba (stale) Mirror 5: 0xd2edd7ba (stale) Mirror 6: 0xd2edd7ba (stale) Mirror 7: 0xd2edd7ba (stale) Mirror 8: 0xd2edd7ba (stale) CRC-32 checksum value for chunk [0, 0x37cda): Mirror 1: 0x4fde0ce Mirror 9: 0x4fde0ce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37cda: skipped 000339 1788639882.747337 mapwrite 0x00a3c9 thru 0x01497e (0xa5b6 bytes) 000341 1788639883.143832 read 0x01d486 thru 0x024043 (0x6bbe bytes) 000343 1788639883.165692 mapread 0x02f51f thru 0x037cd9 (0x87bb bytes) 000344 1788639883.182980 mapwrite 0x00af4f thru 0x00d654 (0x2706 bytes) 000345 1788639883.291481 punch from 0x00533e to 0x013e78 (0xeb3b bytes) 000348 1788639883.302970 trunc from 0x037cda to 0x0251fe (0x12adb bytes) 000350 1788639883.341480 read 0x013262 thru 0x021ba7 (0xe946 bytes) 000351 1788639883.353865 read 0x0068bd thru 0x013cf4 (0xd438 bytes) 000353 1788639883.355184 mapread 0x007494 thru 0x013b76 (0xc6e3 bytes) 000354 1788639883.358989 trunc from 0x0251ff to 0x020989 (0x4875 bytes) 000355 1788639883.382297 mapread 0x000c2f thru 0x0093c1 (0x8793 bytes) 000356 1788639883.383472 mapwrite 0x0299a1 thru 0x02d074 (0x36d4 bytes) 000357 1788639883.547889 write 0x02bd13 thru 0x033673 (0x7961 bytes) 000360 1788639883.556590 mapread 0x0037d7 thru 0x01190b (0xe135 bytes) 000361 1788639883.562670 punch from 0x00879f to 0x010c95 (0x84f7 bytes) 000362 1788639883.581402 mapwrite 0x01cae0 thru 0x02bcb8 (0xf1d9 bytes) 000364 1788639883.691685 punch from 0x02c565 to 0x033673 (0x710f bytes) 000365 1788639883.698765 punch from 0x02d5fa to 0x033673 (0x607a bytes) 000367 1788639883.707963 mapread 0x0317aa thru 0x033673 (0x1eca bytes) 000372 1788639883.720782 write 0x01edd1 thru 0x028739 (0x9969 bytes) 000373 1788639883.723800 trunc from 0x033674 to 0x0297f0 (0x9e83 bytes) 000374 1788639883.755243 read 0x0081d9 thru 0x0147c0 (0xc5e8 bytes) 000376 1788639883.771029 MIRROR_RESYNC 7 mirrors 000377 1788639886.609390 MIRROR_EXTEND to 8 mirrors 000379 1788639888.086674 trunc from 0x0297f1 to 0x039215 (0xfa25 bytes) 000382 1788639888.264676 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39216): Mirror 3: 0xc3093336 (stale) Mirror 5: 0xc3093336 (stale) Mirror 6: 0xc3093336 (stale) Mirror 8: 0xc3093336 (stale) Mirror 9: 0xc3093336 (stale) Mirror 10: 0xc3093336 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39216): Mirror 3: 0xc3093336 (stale) Mirror 5: 0xc3093336 (stale) Mirror 6: 0xc3093336 (stale) Mirror 8: 0xc3093336 (stale) Mirror 9: 0xc3093336 (stale) Mirror 10: 0xc3093336 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39216: skipped 000383 1788639888.843233 trunc from 0x039216 to 0x031878 (0x799d bytes) 000385 1788639888.861329 mapread 0x00cce1 thru 0x013ef3 (0x7213 bytes) 000387 1788639888.879865 mapwrite 0x01f9d1 thru 0x02b2f9 (0xb929 bytes) 000389 1788639888.950452 read 0x01a29c thru 0x020c44 (0x69a9 bytes) 000390 1788639888.951246 trunc from 0x031879 to 0x02df3a (0x393e bytes) 000391 1788639888.974084 write 0x032799 thru 0x03a5f8 (0x7e60 bytes) 000392 1788639888.980696 mapread 0x00c5fd thru 0x01458b (0x7f8f bytes) 000393 1788639888.983409 read 0x021f52 thru 0x02e320 (0xc3cf bytes) 000395 1788639888.999304 write 0x02921b thru 0x03798c (0xe772 bytes) 000396 1788639889.000907 read 0x0153b5 thru 0x01d98b (0x85d7 bytes) 000398 1788639889.010803 read 0x01f9af thru 0x021266 (0x18b8 bytes) 000399 1788639889.012675 mapread 0x01ff36 thru 0x02cd73 (0xce3e bytes) 000400 1788639889.014353 punch from 0x0383e9 to 0x03a5f8 (0x2210 bytes) 000402 1788639889.032564 write 0x010588 thru 0x0171c9 (0x6c42 bytes) 000403 1788639889.034798 mapread 0x00d77d thru 0x018f71 (0xb7f5 bytes) 000404 1788639889.036609 write 0x00f056 thru 0x01a82a (0xb7d5 bytes) 000405 1788639889.041857 mapwrite 0x039a72 thru 0x03ffff (0x658e bytes) 000407 1788639889.130213 mapread 0x0118a2 thru 0x017424 (0x5b83 bytes) 000408 1788639889.131144 write 0x0231e4 thru 0x024d7f (0x1b9c bytes) 000410 1788639889.133226 trunc from 0x040000 to 0x0279d8 (0x18627 bytes) 000414 1788639889.145599 mapwrite 0x0200ba thru 0x02ca9f (0xc9e6 bytes) 000415 1788639889.218233 punch from 0x013649 to 0x01e690 (0xb048 bytes) 000416 1788639889.224247 punch from 0x02091d to 0x02268a (0x1d6e bytes) 000417 1788639889.228499 mapwrite 0x0034df thru 0x00dd30 (0xa852 bytes) 000420 1788639889.276742 write 0x00e464 thru 0x017293 (0x8e30 bytes) 000422 1788639889.283306 mapwrite 0x03f4f8 thru 0x03ffff (0xb08 bytes) 000424 1788639889.378255 mapwrite 0x00c450 thru 0x014c36 (0x87e7 bytes) 000428 1788639889.460457 mapread 0x00d0aa thru 0x01cd85 (0xfcdc bytes) 000430 1788639889.498277 read 0x018d18 thru 0x018e09 (0xf2 bytes) 000432 1788639889.499386 punch from 0x01277e to 0x01ec01 (0xc484 bytes) 000433 1788639889.507039 punch from 0x03dc95 to 0x03ffff (0x236b bytes) 000434 1788639889.511892 mapread 0x031d81 thru 0x03d3b5 (0xb635 bytes) 000436 1788639889.527699 write 0x0016c2 thru 0x00a30b (0x8c4a bytes) 000437 1788639889.529201 read 0x029bc5 thru 0x03169d (0x7ad9 bytes) 000438 1788639889.530759 mapwrite 0x0382d4 thru 0x03ffff (0x7d2c bytes) 000439 1788639889.576002 punch from 0x030132 to 0x03788d (0x775c bytes) 000440 1788639889.582947 write 0x0310c3 thru 0x03dc62 (0xcba0 bytes) 000442 1788639889.601590 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x2e8b845d (stale) Mirror 5: 0x2e8b845d (stale) Mirror 6: 0x2e8b845d (stale) Mirror 8: 0x2e8b845d (stale) Mirror 10: 0x2e8b845d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x2e8b845d (stale) Mirror 5: 0x2e8b845d (stale) Mirror 6: 0x2e8b845d (stale) Mirror 8: 0x2e8b845d (stale) Mirror 10: 0x2e8b845d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000444 1788639890.197211 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x2e8b845d (stale) Mirror 6: 0x2e8b845d (stale) Mirror 8: 0x2e8b845d (stale) Mirror 10: 0x2e8b845d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x2e8b845d (stale) Mirror 6: 0x2e8b845d (stale) Mirror 8: 0x2e8b845d (stale) Mirror 10: 0x2e8b845d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000445 1788639890.937909 trunc from 0x040000 to 0x010a7f (0x2f580 bytes) 000446 1788639890.980923 read 0x00c529 thru 0x010a7f (0x4557 bytes) 000448 1788639890.995290 write 0x01b52f thru 0x028697 (0xd169 bytes) 000452 1788639891.003281 read 0x01e40a thru 0x0246fc (0x62f3 bytes) 000453 1788639891.004717 write 0x00c15f thru 0x01844b (0xc2ed bytes) 000456 1788639891.026395 mapwrite 0x02c579 thru 0x02c761 (0x1e9 bytes) 000457 1788639891.243085 punch from 0x00dc89 to 0x01775d (0x9ad5 bytes) 000459 1788639891.274667 mapread 0x029495 thru 0x02c761 (0x32cd bytes) 000460 1788639891.283971 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2c762): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c762): Mirror 5: 0xdd6a59e5 (stale) Mirror 6: 0xdd6a59e5 (stale) Mirror 8: 0xdd6a59e5 (stale) Mirror 10: 0xdd6a59e5 (stale) CRC-32 checksum value for chunk [0, 0x2c762): Mirror 1: 0x9efcf4c6 Mirror 11: 0x9efcf4c6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c762: skipped 000462 1788639892.573234 mapread 0x007a04 thru 0x0139c0 (0xbfbd bytes) 000463 1788639892.647809 read 0x02a605 thru 0x02c761 (0x215d bytes) 000464 1788639892.707993 write 0x032a7e thru 0x039a69 (0x6fec bytes) 000465 1788639892.912450 mapwrite 0x0130b2 thru 0x01f411 (0xc360 bytes) 000466 1788639893.202772 mapread 0x00a1c0 thru 0x012dc4 (0x8c05 bytes) 000469 1788639893.254761 MIRROR_RESYNC 6 mirrors 000470 1788639895.197815 MIRROR_EXTEND to 7 mirrors 000472 1788639896.272351 trunc from 0x039a6a to 0x003dd1 (0x35c98 bytes) 000475 1788639896.388282 mapread 0x0031d1 thru 0x003dd1 (0xc01 bytes) 000476 1788639896.406470 MIRROR_RESYNC 7 mirrors 000477 1788639898.610827 mapread 0x001aa4 thru 0x003dd1 (0x232e bytes) 000479 1788639898.641542 read 0x003cda thru 0x003dd1 (0xf8 bytes) 000480 1788639898.642848 trunc from 0x003dd2 to 0x020b98 (0x1cdc7 bytes) 000482 1788639898.903418 write 0x02d0ff thru 0x03469e (0x75a0 bytes) 000483 1788639898.906717 read 0x02c5b6 thru 0x03017f (0x3bca bytes) 000484 1788639898.927483 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3469f): Mirror 5: 0x5084a0 (stale) Mirror 6: 0x5084a0 (stale) Mirror 8: 0x5084a0 (stale) Mirror 10: 0x5084a0 (stale) Mirror 11: 0x5084a0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3469f): Mirror 5: 0x5084a0 (stale) Mirror 6: 0x5084a0 (stale) Mirror 8: 0x5084a0 (stale) Mirror 10: 0x5084a0 (stale) Mirror 11: 0x5084a0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3469f: skipped 000485 1788639899.673075 mapwrite 0x01ea39 thru 0x02232c (0x38f4 bytes) 000486 1788639899.789375 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3469f): Mirror 5: 0x5084a0 (stale) Mirror 8: 0x5084a0 (stale) Mirror 10: 0x5084a0 (stale) Mirror 11: 0x5084a0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3469f): Mirror 5: 0x5084a0 (stale) Mirror 8: 0x5084a0 (stale) Mirror 10: 0x5084a0 (stale) Mirror 11: 0x5084a0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3469f: skipped 000487 1788639900.490497 write 0x001388 thru 0x00b77e (0xa3f7 bytes) 000488 1788639900.508549 trunc from 0x03469f to 0x025a20 (0xec7e bytes) 000489 1788639900.539218 read 0x01e70c thru 0x024c12 (0x6507 bytes) 000491 1788639900.555717 MIRROR_RESYNC 5 mirrors 000492 1788639903.213646 mapread 0x00dc41 thru 0x013a09 (0x5dc9 bytes) 000493 1788639903.245681 punch from 0x0236fc to 0x025a20 (0x2325 bytes) 000494 1788639903.418065 punch from 0x013904 to 0x01f959 (0xc056 bytes) 000496 1788639903.443103 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x25a21): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25a21): Mirror 5: 0x4e520f12 (stale) Mirror 8: 0x4e520f12 (stale) Mirror 10: 0x4e520f12 (stale) Mirror 11: 0x4e520f12 (stale) CRC-32 checksum value for chunk [0, 0x25a21): Mirror 1: 0x72026554 Mirror 12: 0x72026554 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25a21: skipped 000497 1788639905.511258 trunc from 0x025a21 to 0x02483a (0x11e6 bytes) 000498 1788639905.708283 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2483b): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2483b): Mirror 5: 0xd2ba60c5 (stale) Mirror 8: 0xd2ba60c5 (stale) Mirror 10: 0xd2ba60c5 (stale) Mirror 11: 0xd2ba60c5 (stale) Mirror 12: 0xcf5fb0d1 (stale) CRC-32 checksum value for chunk [0, 0x2483b): Mirror 1: 0xcf5fb0d1 Mirror 13: 0xcf5fb0d1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2483b: skipped 000499 1788639908.280198 read 0x01ba70 thru 0x0227a6 (0x6d37 bytes) 000500 1788639908.341181 punch from 0x00133a to 0x0075b8 (0x627f bytes) 000501 1788639908.511444 mapwrite 0x01e66a thru 0x01f5eb (0xf82 bytes) 000503 1788639908.657618 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2483b): Mirror 5: 0xd2ba60c5 (stale) Mirror 8: 0xd2ba60c5 (stale) Mirror 10: 0xd2ba60c5 (stale) Mirror 12: 0xcf5fb0d1 (stale) Mirror 13: 0xcf5fb0d1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2483b): Mirror 5: 0xd2ba60c5 (stale) Mirror 8: 0xd2ba60c5 (stale) Mirror 10: 0xd2ba60c5 (stale) Mirror 12: 0xcf5fb0d1 (stale) Mirror 13: 0xcf5fb0d1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2483b: skipped 000504 1788639909.537064 punch from 0x019310 to 0x02483a (0xb52b bytes) 000506 1788639909.548472 write 0x030c44 thru 0x039990 (0x8d4d bytes) 000507 1788639909.565457 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39991): Mirror 5: 0xe459d24a (stale) Mirror 8: 0xe459d24a (stale) Mirror 10: 0xe459d24a (stale) Mirror 13: 0xe20989f2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39991): Mirror 5: 0xe459d24a (stale) Mirror 8: 0xe459d24a (stale) Mirror 10: 0xe459d24a (stale) Mirror 13: 0xe20989f2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39991: skipped 000508 1788639910.076331 read 0x026437 thru 0x030fea (0xabb4 bytes) 000509 1788639910.112422 trunc from 0x039991 to 0x004c55 (0x34d3b bytes) 000511 1788639910.169805 punch from 0x00277c to 0x004c55 (0x24da bytes) 000512 1788639910.185349 trunc from 0x004c56 to 0x0374de (0x32889 bytes) 000513 1788639910.241589 mapread 0x0002e5 thru 0x00cd86 (0xcaa2 bytes) 000515 1788639910.300443 mapwrite 0x014dc7 thru 0x02342e (0xe668 bytes) 000516 1788639910.537638 read 0x020499 thru 0x02a1ba (0x9d22 bytes) 000517 1788639910.563011 read 0x02952e thru 0x03079d (0x7270 bytes) 000518 1788639910.564062 write 0x0101f9 thru 0x018ed3 (0x8cdb bytes) 000519 1788639910.579142 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x374df): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x374df): Mirror 5: 0x4572b547 (stale) Mirror 8: 0x4572b547 (stale) Mirror 10: 0x4572b547 (stale) Mirror 13: 0xcb66f324 (stale) CRC-32 checksum value for chunk [0, 0x374df): Mirror 1: 0x51217e85 Mirror 14: 0x51217e85 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x374df: skipped 000521 1788639912.428735 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x374df): Mirror 5: 0x4572b547 (stale) Mirror 8: 0x4572b547 (stale) Mirror 10: 0x4572b547 (stale) Mirror 13: 0xcb66f324 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x374df): Mirror 5: 0x4572b547 (stale) Mirror 8: 0x4572b547 (stale) Mirror 10: 0x4572b547 (stale) Mirror 13: 0xcb66f324 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x374df: skipped 000525 1788639913.061174 read 0x02b8ae thru 0x02bf00 (0x653 bytes) 000528 1788639913.097032 read 0x018dd0 thru 0x0272c6 (0xe4f7 bytes) 000529 1788639913.133000 write 0x033f43 thru 0x03ffff (0xc0bd bytes) 000530 1788639913.178601 read 0x02c713 thru 0x02d20b (0xaf9 bytes) 000531 1788639913.194482 trunc from 0x040000 to 0x017502 (0x28afd bytes) 000532 1788639913.221388 mapread 0x0138fb thru 0x01651b (0x2c21 bytes) 000534 1788639913.222575 trunc from 0x017503 to 0x03dcc4 (0x267c2 bytes) 000537 1788639913.241679 read 0x03b18f thru 0x03c7a3 (0x1615 bytes) 000538 1788639913.262411 punch from 0x0047b3 to 0x00f073 (0xa8c1 bytes) 000539 1788639913.268057 mapread 0x00f580 thru 0x01ec8a (0xf70b bytes) 000540 1788639913.277459 write 0x0066c8 thru 0x014727 (0xe060 bytes) 000541 1788639913.302897 read 0x0090e6 thru 0x00f526 (0x6441 bytes) 000542 1788639913.306204 trunc from 0x03dcc5 to 0x03d254 (0xa70 bytes) truncating to largest ever: 0x3f771 000543 1788639913.338360 trunc from 0x03d255 to 0x03f770 (0x251c bytes) 000548 1788639913.403361 mapread 0x019ca9 thru 0x01a5f8 (0x950 bytes) 000550 1788639913.407452 mapread 0x03494a thru 0x03983c (0x4ef3 bytes) 000551 1788639913.410219 read 0x02a8d6 thru 0x02adf4 (0x51f bytes) 000552 1788639913.412530 mapread 0x0237ad thru 0x02dff3 (0xa847 bytes) 000553 1788639913.426137 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3f771): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f771): Mirror 5: 0x94378238 (stale) Mirror 8: 0x94378238 (stale) Mirror 10: 0x94378238 (stale) Mirror 13: 0x8e9551f7 (stale) CRC-32 checksum value for chunk [0, 0x3f771): Mirror 1: 0x7765574f Mirror 14: 0x7765574f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f771: skipped 000554 1788639915.510135 MIRROR_RESYNC 6 mirrors 000556 1788639916.584738 punch from 0x0096e6 to 0x012f89 (0x98a4 bytes) 000558 1788639916.671413 mapread 0x02e0a5 thru 0x03857d (0xa4d9 bytes) 000559 1788639916.687714 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f771): Mirror 5: 0x7765574f (stale) Mirror 8: 0x7765574f (stale) Mirror 13: 0x7765574f (stale) Mirror 14: 0x7765574f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f771): Mirror 5: 0x7765574f (stale) Mirror 8: 0x7765574f (stale) Mirror 13: 0x7765574f (stale) Mirror 14: 0x7765574f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f771: skipped 000561 1788639917.010103 punch from 0x0223e4 to 0x02b90d (0x952a bytes) 000562 1788639917.014495 mapwrite 0x0049b1 thru 0x013c3d (0xf28d bytes) 000564 1788639917.096762 trunc from 0x03f771 to 0x03a05f (0x5711 bytes) 000565 1788639917.108407 read 0x027fee thru 0x031054 (0x9067 bytes) 000567 1788639917.114694 punch from 0x00a0f6 to 0x00c088 (0x1f93 bytes) 000568 1788639917.118597 trunc from 0x03a060 to 0x019932 (0x2072d bytes) 000570 1788639917.133019 mapwrite 0x03bffa thru 0x03c6c6 (0x6cd bytes) 000571 1788639917.190098 read 0x029150 thru 0x02a966 (0x1817 bytes) 000573 1788639917.201891 mapwrite 0x01a540 thru 0x0243bb (0x9e7c bytes) 000575 1788639917.244787 trunc from 0x03c6c7 to 0x01e500 (0x1e1c6 bytes) 000576 1788639917.259123 write 0x022f95 thru 0x023b64 (0xbd0 bytes) 000578 1788639917.260915 punch from 0x01a778 to 0x01e09e (0x3927 bytes) 000580 1788639917.275264 mapread 0x019a42 thru 0x01e45a (0x4a19 bytes) 000582 1788639917.290395 punch from 0x0221cf to 0x023b64 (0x1996 bytes) 000583 1788639917.295296 write 0x0013ee thru 0x007d51 (0x6964 bytes) 000584 1788639917.296654 mapread 0x007ece thru 0x00d5f5 (0x5728 bytes) 000585 1788639917.297273 mapread 0x018b89 thru 0x0228c8 (0x9d40 bytes) 000586 1788639917.313590 mapread 0x022c76 thru 0x023b64 (0xeef bytes) 000587 1788639917.318972 write 0x0023e9 thru 0x00f254 (0xce6c bytes) 000589 1788639917.323480 read 0x00d536 thru 0x0189da (0xb4a5 bytes) 000590 1788639917.325216 write 0x01c8dc thru 0x025faf (0x96d4 bytes) 000592 1788639917.328991 read 0x0003da thru 0x00aad4 (0xa6fb bytes) 000596 1788639917.331386 write 0x039c71 thru 0x03d9a2 (0x3d32 bytes) 000597 1788639917.332753 read 0x026b50 thru 0x02f28b (0x873c bytes) 000599 1788639917.340184 trunc from 0x03d9a3 to 0x028e9f (0x14b03 bytes) 000601 1788639917.355478 punch from 0x02601f to 0x028e9f (0x2e81 bytes) 000602 1788639917.368938 read 0x011a35 thru 0x01cb39 (0xb105 bytes) 000604 1788639917.370280 write 0x016324 thru 0x02197e (0xb65b bytes) 000605 1788639917.372245 mapread 0x005bc2 thru 0x013015 (0xd454 bytes) 000606 1788639917.376261 read 0x01622b thru 0x01858d (0x2363 bytes) 000607 1788639917.377069 mapwrite 0x008994 thru 0x011a7d (0x90ea bytes) 000608 1788639917.503090 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28ea0): Mirror 5: 0x66605ddc (stale) Mirror 13: 0x66605ddc (stale) Mirror 14: 0x66605ddc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28ea0): Mirror 5: 0x66605ddc (stale) Mirror 13: 0x66605ddc (stale) Mirror 14: 0x66605ddc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28ea0: skipped 000609 1788639917.863918 read 0x007f61 thru 0x008e9f (0xf3f bytes) 000612 1788639917.870775 trunc from 0x028ea0 to 0x026ff7 (0x1ea8 bytes) 000613 1788639917.884329 mapwrite 0x011ef4 thru 0x013cc3 (0x1dd0 bytes) 000614 1788639917.942261 read 0x01444e thru 0x0151cb (0xd7e bytes) 000617 1788639917.943869 read 0x01ae71 thru 0x026ff7 (0xc187 bytes) 000618 1788639917.959173 mapread 0x026a0a thru 0x026ff7 (0x5ee bytes) 000620 1788639917.960287 mapwrite 0x03000a thru 0x039b27 (0x9b1e bytes) 000621 1788639918.078211 punch from 0x0319fc to 0x039b27 (0x812c bytes) 000622 1788639918.093600 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39b28): Mirror 5: 0x155b2074 (stale) Mirror 13: 0x155b2074 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39b28): Mirror 5: 0x155b2074 (stale) Mirror 13: 0x155b2074 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39b28: skipped 000624 1788639918.438531 write 0x02d2d0 thru 0x038827 (0xb558 bytes) 000625 1788639918.452340 read 0x02987c thru 0x02f060 (0x57e5 bytes) 000626 1788639918.461022 write 0x02deac thru 0x02f61c (0x1771 bytes) 000627 1788639918.472873 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x39b28): Mirror 5: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39b28): Mirror 5: 0x155b2074 (stale) Mirror 13: 0x155b2074 (stale) CRC-32 checksum value for chunk [0, 0x39b28): Mirror 1: 0x3a905d46 Mirror 14: 0x3a905d46 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39b28: skipped 000629 1788639919.620196 mapread 0x01ad51 thru 0x0210be (0x636e bytes) 000630 1788639919.667077 mapread 0x0178a2 thru 0x021c35 (0xa394 bytes) 000631 1788639919.690698 trunc from 0x039b28 to 0x01b0b8 (0x1ea6f bytes) 000632 1788639919.810438 write 0x019b1b thru 0x027502 (0xd9e8 bytes) 000634 1788639919.818826 read 0x01f381 thru 0x027502 (0x8182 bytes) 000636 1788639919.825825 MIRROR_RESYNC 4 mirrors 000637 1788639921.050998 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) 000638 1788639921.345031 punch from 0x016df4 to 0x01ab8e (0x3d9b bytes) 000641 1788639921.481208 write 0x02ac42 thru 0x032020 (0x73df bytes) 000646 1788639921.493929 punch from 0x014782 to 0x018098 (0x3917 bytes) 000649 1788639921.524254 punch from 0x024661 to 0x032020 (0xd9c0 bytes) 000651 1788639921.539374 read 0x00c7a6 thru 0x00ee7d (0x26d8 bytes) 000653 1788639921.555829 write 0x03213b thru 0x036543 (0x4409 bytes) 000655 1788639921.564190 punch from 0x0341db to 0x036543 (0x2369 bytes) 000656 1788639921.611989 mapread 0x0144e2 thru 0x01b63c (0x715b bytes) 000657 1788639921.653058 punch from 0x027e59 to 0x02be31 (0x3fd9 bytes) 000658 1788639921.665997 trunc from 0x036544 to 0x00345c (0x330e7 bytes) 000661 1788639921.712396 trunc from 0x00345d to 0x001d1f (0x173d bytes) 000662 1788639921.762861 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1d20): Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d20): Mirror 13: 0x6b8527c4 (stale) Mirror 14: 0x6b8527c4 (stale) CRC-32 checksum value for chunk [0, 0x1d20): Mirror 1: 0x6b8527c4 Mirror 15: 0x6b8527c4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d20: skipped 000665 1788639923.021240 trunc from 0x001d20 to 0x012877 (0x10b58 bytes) 000666 1788639923.170235 mapread 0x011d94 thru 0x012877 (0xae4 bytes) 000667 1788639923.185334 read 0x01102b thru 0x012877 (0x184d bytes) 000670 1788639923.189597 mapwrite 0x02ddf1 thru 0x0357db (0x79eb bytes) 000671 1788639923.314999 write 0x032fd5 thru 0x03ed32 (0xbd5e bytes) 000672 1788639923.320003 mapwrite 0x01bd01 thru 0x01f8ea (0x3bea bytes) 000675 1788639923.394361 punch from 0x03e134 to 0x03ed32 (0xbff bytes) 000676 1788639923.400714 mapread 0x010bc0 thru 0x01ce66 (0xc2a7 bytes) 000681 1788639923.416460 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ed33): Mirror 13: 0x1c25ef90 (stale) Mirror 14: 0x1c25ef90 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ed33): Mirror 13: 0x1c25ef90 (stale) Mirror 14: 0x1c25ef90 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ed33: skipped 000683 1788639923.809457 mapwrite 0x0359e8 thru 0x037dc3 (0x23dc bytes) 000685 1788639923.865127 write 0x015f70 thru 0x0176f9 (0x178a bytes) 000686 1788639923.878361 write 0x004a5b thru 0x00c3ad (0x7953 bytes) 000687 1788639923.901794 read 0x029664 thru 0x02a95c (0x12f9 bytes) 000689 1788639923.908627 read 0x01b274 thru 0x0221e3 (0x6f70 bytes) 000690 1788639923.919633 mapread 0x01ae35 thru 0x01f702 (0x48ce bytes) 000691 1788639923.921552 mapwrite 0x03f622 thru 0x03ffff (0x9de bytes) 000692 1788639923.993195 trunc from 0x040000 to 0x007456 (0x38ba9 bytes) 000695 1788639924.010923 MIRROR_RESYNC 3 mirrors 000696 1788639924.723539 read 0x0010d7 thru 0x001fd4 (0xefe bytes) 000699 1788639924.735134 mapread 0x000fd4 thru 0x007456 (0x6483 bytes) 000700 1788639924.765338 MIRROR_EXTEND to 4 mirrors 000701 1788639925.695803 punch from 0x00600b to 0x007456 (0x144c bytes) 000702 1788639925.770637 trunc from 0x007457 to 0x00debf (0x6a69 bytes) 000703 1788639925.787080 trunc from 0x00dec0 to 0x02b5af (0x1d6f0 bytes) 000704 1788639925.803979 mapwrite 0x022e58 thru 0x02a2cc (0x7475 bytes) 000705 1788639925.918062 write 0x0100ae thru 0x01e34a (0xe29d bytes) 000706 1788639925.928183 mapread 0x0253da thru 0x029579 (0x41a0 bytes) 000707 1788639925.929392 punch from 0x000d9e to 0x00865c (0x78bf bytes) 000708 1788639925.949928 mapread 0x00672e thru 0x00b9e0 (0x52b3 bytes) 000709 1788639925.994492 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2b5b0): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b5b0): Mirror 13: 0x1e13b5b9 (stale) Mirror 14: 0x1e13b5b9 (stale) Mirror 15: 0x1e13b5b9 (stale) CRC-32 checksum value for chunk [0, 0x2b5b0): Mirror 1: 0x7c095b6c Mirror 16: 0x7c095b6c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b5b0: skipped 000712 1788639927.244052 mapread 0x0120ff thru 0x01680e (0x4710 bytes) 000713 1788639927.256919 punch from 0x0219c3 to 0x023776 (0x1db4 bytes) 000714 1788639927.321199 punch from 0x019acd to 0x019bbf (0xf3 bytes) 000715 1788639927.326808 read 0x01b6e2 thru 0x021662 (0x5f81 bytes) 000716 1788639927.333113 punch from 0x01751c to 0x02416f (0xcc54 bytes) 000717 1788639927.336959 mapwrite 0x002625 thru 0x00c735 (0xa111 bytes) 000718 1788639927.376319 trunc from 0x02b5b0 to 0x024542 (0x706d bytes) 000720 1788639927.388305 trunc from 0x024543 to 0x002bfd (0x21945 bytes) 000721 1788639927.400584 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2bfe): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bfe): Mirror 13: 0x7e45b4a4 (stale) Mirror 14: 0x7e45b4a4 (stale) Mirror 15: 0x7e45b4a4 (stale) Mirror 16: 0x3a86fec7 (stale) CRC-32 checksum value for chunk [0, 0x2bfe): Mirror 1: 0x2ec3fb35 Mirror 17: 0x2ec3fb35 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bfe: skipped 000722 1788639927.998199 punch from 0x001145 to 0x002bfd (0x1ab9 bytes) 000723 1788639928.082445 trunc from 0x002bfe to 0x023ae9 (0x20eec bytes) 000724 1788639928.208047 read 0x00d3c5 thru 0x012101 (0x4d3d bytes) 000725 1788639928.238290 trunc from 0x023aea to 0x02d1de (0x96f5 bytes) 000726 1788639928.257073 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2d1df): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d1df): Mirror 13: 0x3fe1bc20 (stale) Mirror 14: 0x3fe1bc20 (stale) Mirror 15: 0x3fe1bc20 (stale) Mirror 16: 0x9066f217 (stale) Mirror 17: 0xc087e4a2 (stale) CRC-32 checksum value for chunk [0, 0x2d1df): Mirror 1: 0xa145979 Mirror 18: 0xa145979 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d1df: skipped 000727 1788639929.409040 mapread 0x001d71 thru 0x004dfb (0x308b bytes) 000729 1788639929.454668 punch from 0x023323 to 0x026efb (0x3bd9 bytes) 000730 1788639929.559940 trunc from 0x02d1df to 0x022776 (0xaa68 bytes) 000731 1788639929.636367 MIRROR_RESYNC 7 mirrors 000732 1788639931.925474 trunc from 0x022777 to 0x001cc5 (0x20ab1 bytes) 000733 1788639932.089435 punch from 0x001235 to 0x001cc5 (0xa91 bytes) 000734 1788639932.103682 punch from 0x00078a to 0x001cc5 (0x153c bytes) 000735 1788639932.112844 read 0x001b55 thru 0x001cc5 (0x171 bytes) 000737 1788639932.128870 trunc from 0x001cc6 to 0x0207af (0x1eaea bytes) 000739 1788639932.166896 trunc from 0x0207b0 to 0x000293 (0x2051c bytes) 000744 1788639932.211909 mapwrite 0x01fe90 thru 0x02aece (0xb03f bytes) 000745 1788639932.395838 read 0x012d5f thru 0x016026 (0x32c8 bytes) 000748 1788639932.418628 read 0x021993 thru 0x0250ac (0x371a bytes) 000749 1788639932.419222 trunc from 0x02aecf to 0x0082ce (0x22c00 bytes) 000750 1788639932.502330 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x82cf): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x82cf): Mirror 13: 0x7a0d6d1 (stale) Mirror 14: 0x7a0d6d1 (stale) Mirror 15: 0x7a0d6d1 (stale) Mirror 16: 0x7a0d6d1 (stale) Mirror 17: 0x7a0d6d1 (stale) Mirror 18: 0x7a0d6d1 (stale) CRC-32 checksum value for chunk [0, 0x82cf): Mirror 1: 0xd23a2275 Mirror 19: 0xd23a2275 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x82cf: skipped 000752 1788639934.038020 mapread 0x007b07 thru 0x0082ce (0x7c8 bytes) 000755 1788639934.150061 mapwrite 0x004159 thru 0x00fabb (0xb963 bytes) 000756 1788639934.369063 read 0x000f48 thru 0x007ce8 (0x6da1 bytes) 000758 1788639934.379582 read 0x00282b thru 0x00fabb (0xd291 bytes) 000759 1788639934.381628 read 0x00c35d thru 0x00fabb (0x375f bytes) 000760 1788639934.386276 mapread 0x00d32d thru 0x00fabb (0x278f bytes) 000761 1788639934.392818 write 0x01fe3c thru 0x02877c (0x8941 bytes) 000762 1788639934.394185 punch from 0x023d71 to 0x02877c (0x4a0c bytes) 000763 1788639934.408144 mapread 0x00e788 thru 0x01cb7a (0xe3f3 bytes) 000766 1788639934.425073 mapwrite 0x022bda thru 0x026e90 (0x42b7 bytes) 000767 1788639934.483931 read 0x01f74e thru 0x02624c (0x6aff bytes) 000768 1788639934.484617 mapread 0x01bf48 thru 0x02877c (0xc835 bytes) 000769 1788639934.497854 MIRROR_RESYNC 8 mirrors 000770 1788639938.019976 trunc from 0x02877d to 0x03a9ac (0x12230 bytes) 000771 1788639938.157008 write 0x023d66 thru 0x02aba0 (0x6e3b bytes) 000772 1788639938.180088 read 0x023ba1 thru 0x02bf8e (0x83ee bytes) 000774 1788639938.197101 read 0x0015cf thru 0x00612f (0x4b61 bytes) 000775 1788639938.219039 read 0x003ed8 thru 0x00ff42 (0xc06b bytes) 000777 1788639938.222665 trunc from 0x03a9ad to 0x02638d (0x1461f bytes) 000779 1788639938.273788 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2638e): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2638e): Mirror 13: 0x5b68d5ed (stale) Mirror 14: 0x5b68d5ed (stale) Mirror 15: 0x5b68d5ed (stale) Mirror 16: 0x5b68d5ed (stale) Mirror 17: 0x5b68d5ed (stale) Mirror 18: 0x5b68d5ed (stale) Mirror 19: 0x5b68d5ed (stale) CRC-32 checksum value for chunk [0, 0x2638e): Mirror 1: 0x8533c6e1 Mirror 20: 0x8533c6e1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2638e: skipped 000780 1788639939.256843 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2638e): Mirror 13: 0x5b68d5ed (stale) Mirror 14: 0x5b68d5ed (stale) Mirror 15: 0x5b68d5ed (stale) Mirror 16: 0x5b68d5ed (stale) Mirror 17: 0x5b68d5ed (stale) Mirror 18: 0x5b68d5ed (stale) Mirror 19: 0x5b68d5ed (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2638e): Mirror 13: 0x5b68d5ed (stale) Mirror 14: 0x5b68d5ed (stale) Mirror 15: 0x5b68d5ed (stale) Mirror 16: 0x5b68d5ed (stale) Mirror 17: 0x5b68d5ed (stale) Mirror 18: 0x5b68d5ed (stale) Mirror 19: 0x5b68d5ed (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2638e: skipped 000781 1788639940.173369 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2638e): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2638e): Mirror 13: 0x5b68d5ed (stale) Mirror 14: 0x5b68d5ed (stale) Mirror 15: 0x5b68d5ed (stale) Mirror 16: 0x5b68d5ed (stale) Mirror 17: 0x5b68d5ed (stale) Mirror 18: 0x5b68d5ed (stale) Mirror 19: 0x5b68d5ed (stale) CRC-32 checksum value for chunk [0, 0x2638e): Mirror 1: 0x8533c6e1 Mirror 20: 0x8533c6e1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2638e: skipped 000782 1788639941.886653 mapread 0x0044eb thru 0x008051 (0x3b67 bytes) 000783 1788639941.928193 punch from 0x00397a to 0x00f4e0 (0xbb67 bytes) 000784 1788639942.088463 mapread 0x00d7cc thru 0x014e30 (0x7665 bytes) 000785 1788639942.106006 mapwrite 0x018e98 thru 0x01bb86 (0x2cef bytes) 000786 1788639942.283537 trunc from 0x02638e to 0x03be26 (0x15a99 bytes) 000790 1788639942.327229 read 0x012b06 thru 0x01fbc1 (0xd0bc bytes) 000792 1788639942.345757 mapwrite 0x00987b thru 0x017d55 (0xe4db bytes) 000793 1788639942.470341 read 0x01e766 thru 0x02cc12 (0xe4ad bytes) 000794 1788639942.484888 trunc from 0x03be27 to 0x017599 (0x2488d bytes) 000796 1788639942.511282 trunc from 0x01759a to 0x007c09 (0xf990 bytes) 000797 1788639942.541305 punch from 0x003222 to 0x00552d (0x230c bytes) 000798 1788639942.547578 punch from 0x005485 to 0x007c09 (0x2785 bytes) 000799 1788639942.555591 trunc from 0x007c0a to 0x02e066 (0x2645d bytes) 000800 1788639942.621367 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2e067): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e067): Mirror 13: 0x55b80659 (stale) Mirror 14: 0x55b80659 (stale) Mirror 15: 0x55b80659 (stale) Mirror 16: 0x55b80659 (stale) Mirror 17: 0x55b80659 (stale) Mirror 18: 0x55b80659 (stale) Mirror 19: 0x55b80659 (stale) Mirror 20: 0xaf1e9f97 (stale) CRC-32 checksum value for chunk [0, 0x2e067): Mirror 1: 0x6845ace0 Mirror 21: 0x6845ace0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e067: skipped 000801 1788639944.536441 mapwrite 0x025def thru 0x02d908 (0x7b1a bytes) 000802 1788639944.864031 mapread 0x02a10d thru 0x02e066 (0x3f5a bytes) 000803 1788639944.864995 write 0x01fc98 thru 0x02ab64 (0xaecd bytes) 000804 1788639944.871638 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e067): Mirror 13: 0x55b80659 (stale) Mirror 14: 0x55b80659 (stale) Mirror 15: 0x55b80659 (stale) Mirror 16: 0x55b80659 (stale) Mirror 17: 0x55b80659 (stale) Mirror 18: 0x55b80659 (stale) Mirror 19: 0x55b80659 (stale) Mirror 21: 0x6845ace0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e067): Mirror 13: 0x55b80659 (stale) Mirror 14: 0x55b80659 (stale) Mirror 15: 0x55b80659 (stale) Mirror 16: 0x55b80659 (stale) Mirror 17: 0x55b80659 (stale) Mirror 18: 0x55b80659 (stale) Mirror 19: 0x55b80659 (stale) Mirror 21: 0x6845ace0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e067: skipped 000805 1788639945.566661 read 0x0125df thru 0x013488 (0xeaa bytes) 000806 1788639945.574696 read 0x01fde8 thru 0x022c08 (0x2e21 bytes) 000807 1788639945.592562 MIRROR_RESYNC 9 mirrors 000808 1788639949.462245 trunc from 0x02e067 to 0x00b35f (0x22d07 bytes) 000809 1788639949.588181 trunc from 0x00b360 to 0x014f64 (0x9c05 bytes) 000810 1788639949.609625 mapread 0x005fde thru 0x014f64 (0xef87 bytes) 000811 1788639949.652688 punch from 0x00daa5 to 0x014b93 (0x70ef bytes) 000813 1788639949.658687 punch from 0x00126f to 0x00dce1 (0xca73 bytes) 000815 1788639949.675794 write 0x00b69e thru 0x0118d1 (0x6234 bytes) 000816 1788639949.715423 read 0x00681b thru 0x00be18 (0x55fe bytes) 000817 1788639949.742139 read 0x000e8a thru 0x001dc5 (0xf3c bytes) 000820 1788639949.776108 read 0x008943 thru 0x00fbd8 (0x7296 bytes) 000821 1788639949.777121 mapwrite 0x01c0cd thru 0x01daaa (0x19de bytes) 000822 1788639949.922677 punch from 0x01773f to 0x01daaa (0x636c bytes) 000823 1788639949.931634 mapread 0x00ac7e thru 0x00f66d (0x49f0 bytes) 000828 1788639949.937469 mapwrite 0x01608f thru 0x0166e1 (0x653 bytes) 000829 1788639950.074745 trunc from 0x01daab to 0x028f4b (0xb4a1 bytes) 000831 1788639950.089929 trunc from 0x028f4c to 0x01f1eb (0x9d60 bytes) 000833 1788639950.130172 punch from 0x01b692 to 0x01f1eb (0x3b5a bytes) 000834 1788639950.142444 read 0x010bed thru 0x01a160 (0x9574 bytes) 000836 1788639950.158150 read 0x0064f5 thru 0x00a42e (0x3f3a bytes) 000837 1788639950.164954 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f1ec): Mirror 13: 0xfa0c43c7 (stale) Mirror 14: 0xfa0c43c7 (stale) Mirror 15: 0xfa0c43c7 (stale) Mirror 16: 0xfa0c43c7 (stale) Mirror 18: 0xfa0c43c7 (stale) Mirror 19: 0xfa0c43c7 (stale) Mirror 21: 0xfa0c43c7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f1ec): Mirror 13: 0xfa0c43c7 (stale) Mirror 14: 0xfa0c43c7 (stale) Mirror 15: 0xfa0c43c7 (stale) Mirror 16: 0xfa0c43c7 (stale) Mirror 18: 0xfa0c43c7 (stale) Mirror 19: 0xfa0c43c7 (stale) Mirror 21: 0xfa0c43c7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f1ec: skipped 000838 1788639950.810800 write 0x03778c thru 0x03ffff (0x8874 bytes) 000839 1788639950.816487 write 0x039379 thru 0x03ffff (0x6c87 bytes) 000840 1788639950.818669 write 0x021c22 thru 0x0289bd (0x6d9c bytes) 000841 1788639950.833213 trunc from 0x040000 to 0x0060fe (0x39f01 bytes) 000843 1788639950.861246 mapwrite 0x0064ac thru 0x0068af (0x404 bytes) 000844 1788639950.934440 mapwrite 0x013f2d thru 0x018ae6 (0x4bba bytes) 000845 1788639951.031786 mapwrite 0x00017a thru 0x00f163 (0xefea bytes) 000847 1788639951.199494 read 0x00de5d thru 0x018ae6 (0xac8a bytes) 000849 1788639951.209877 write 0x038eb0 thru 0x03ffff (0x7150 bytes) 000850 1788639951.218887 trunc from 0x040000 to 0x034026 (0xbfd9 bytes) 000851 1788639951.250059 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x34027): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34027): Mirror 13: 0x6582e74a (stale) Mirror 14: 0x6582e74a (stale) Mirror 15: 0x6582e74a (stale) Mirror 16: 0x6582e74a (stale) Mirror 18: 0x6582e74a (stale) Mirror 19: 0x6582e74a (stale) Mirror 21: 0x6582e74a (stale) CRC-32 checksum value for chunk [0, 0x34027): Mirror 1: 0x6eb47953 Mirror 22: 0x6eb47953 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34027: skipped 000852 1788639953.163371 mapwrite 0x032f99 thru 0x03ffff (0xd067 bytes) 000853 1788639953.544467 read 0x02c635 thru 0x02f26f (0x2c3b bytes) 000856 1788639953.555163 trunc from 0x040000 to 0x008930 (0x376cf bytes) 000858 1788639953.597490 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x8931): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8931): Mirror 13: 0x47c5f4e8 (stale) Mirror 14: 0x47c5f4e8 (stale) Mirror 15: 0x47c5f4e8 (stale) Mirror 16: 0x47c5f4e8 (stale) Mirror 18: 0x47c5f4e8 (stale) Mirror 19: 0x47c5f4e8 (stale) Mirror 21: 0x47c5f4e8 (stale) Mirror 22: 0xa12568d9 (stale) CRC-32 checksum value for chunk [0, 0x8931): Mirror 1: 0xa12568d9 Mirror 23: 0xa12568d9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8931: skipped 000860 1788639955.010667 MIRROR_RESYNC 10 mirrors 000861 1788639956.446038 trunc from 0x008931 to 0x031239 (0x28909 bytes) 000862 1788639956.551315 mapwrite 0x036267 thru 0x03921b (0x2fb5 bytes) 000863 1788639956.658423 punch from 0x032cee to 0x03921b (0x652e bytes) 000864 1788639956.664456 mapread 0x0183d9 thru 0x01ca8b (0x46b3 bytes) 000866 1788639956.679560 trunc from 0x03921c to 0x00d794 (0x2ba87 bytes) 000867 1788639956.699204 mapread 0x003717 thru 0x00821e (0x4b08 bytes) 000868 1788639956.708027 read 0x00547f thru 0x00d794 (0x8316 bytes) 000872 1788639956.711310 punch from 0x00173f to 0x00d794 (0xc056 bytes) 000873 1788639956.716495 mapread 0x008f68 thru 0x00d794 (0x482d bytes) 000874 1788639956.726075 punch from 0x008612 to 0x00c9ce (0x43bd bytes) 000875 1788639956.730907 read 0x00d625 thru 0x00d794 (0x170 bytes) 000876 1788639956.732077 mapwrite 0x031f06 thru 0x03f098 (0xd193 bytes) 000878 1788639956.809400 write 0x02f668 thru 0x032413 (0x2dac bytes) 000879 1788639956.810578 mapread 0x02d8ac thru 0x038823 (0xaf78 bytes) 000882 1788639956.814648 mapwrite 0x005ee0 thru 0x00aca3 (0x4dc4 bytes) 000884 1788639956.872476 punch from 0x01e27f to 0x026824 (0x85a6 bytes) 000885 1788639956.881075 write 0x002016 thru 0x005d9b (0x3d86 bytes) 000886 1788639956.883360 punch from 0x0391c5 to 0x03b115 (0x1f51 bytes) 000888 1788639956.894373 punch from 0x01dd49 to 0x02205d (0x4315 bytes) 000889 1788639956.899341 punch from 0x01454b to 0x01cfd6 (0x8a8c bytes) 000890 1788639956.903656 write 0x02e26e thru 0x038e8e (0xac21 bytes) 000892 1788639956.906796 mapread 0x00301f thru 0x00d40e (0xa3f0 bytes) 000895 1788639956.909354 read 0x019ea7 thru 0x0284a5 (0xe5ff bytes) 000896 1788639956.922584 punch from 0x02c254 to 0x02da54 (0x1801 bytes) 000898 1788639956.949040 trunc from 0x03f099 to 0x007032 (0x38066 bytes) 000899 1788639956.965796 mapread 0x00540a thru 0x007032 (0x1c29 bytes) 000900 1788639956.967498 mapwrite 0x030978 thru 0x0314f9 (0xb82 bytes) 000901 1788639957.045549 punch from 0x02bb76 to 0x02eadc (0x2f67 bytes) 000902 1788639957.050381 mapread 0x012253 thru 0x01e588 (0xc336 bytes) 000903 1788639957.104281 mapwrite 0x03a908 thru 0x03e6a0 (0x3d99 bytes) 000904 1788639957.205291 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3e6a1): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e6a1): Mirror 13: 0x6218f05f (stale) Mirror 14: 0x6218f05f (stale) Mirror 15: 0x6218f05f (stale) Mirror 16: 0x6218f05f (stale) Mirror 18: 0x6218f05f (stale) Mirror 19: 0x6218f05f (stale) Mirror 21: 0x6218f05f (stale) Mirror 22: 0x6218f05f (stale) Mirror 23: 0x6218f05f (stale) CRC-32 checksum value for chunk [0, 0x3e6a1): Mirror 1: 0x4ad6a9b6 Mirror 24: 0x4ad6a9b6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e6a1: skipped 000905 1788639958.712390 punch from 0x008d26 to 0x00eeb5 (0x6190 bytes) 000908 1788639958.915179 read 0x004816 thru 0x00879b (0x3f86 bytes) 000909 1788639958.924152 read 0x023f8a thru 0x02db5f (0x9bd6 bytes) 000910 1788639958.937446 write 0x01e969 thru 0x02ad63 (0xc3fb bytes) 000911 1788639958.938657 mapwrite 0x003678 thru 0x010bf3 (0xd57c bytes) 000912 1788639958.985860 punch from 0x00f738 to 0x0180f0 (0x89b9 bytes) 000914 1788639958.996030 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e6a1): Mirror 13: 0x6218f05f (stale) Mirror 14: 0x6218f05f (stale) Mirror 15: 0x6218f05f (stale) Mirror 16: 0x6218f05f (stale) Mirror 18: 0x6218f05f (stale) Mirror 19: 0x6218f05f (stale) Mirror 22: 0x6218f05f (stale) Mirror 23: 0x6218f05f (stale) Mirror 24: 0x4ad6a9b6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e6a1): Mirror 13: 0x6218f05f (stale) Mirror 14: 0x6218f05f (stale) Mirror 15: 0x6218f05f (stale) Mirror 16: 0x6218f05f (stale) Mirror 18: 0x6218f05f (stale) Mirror 19: 0x6218f05f (stale) Mirror 22: 0x6218f05f (stale) Mirror 23: 0x6218f05f (stale) Mirror 24: 0x4ad6a9b6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e6a1: skipped 000916 1788639959.575491 MIRROR_RESYNC 10 mirrors 000918 1788639963.973414 write 0x0139a1 thru 0x01ae8d (0x74ed bytes) 000920 1788639964.080307 trunc from 0x03e6a1 to 0x009cfb (0x349a5 bytes) 000923 1788639964.114433 write 0x0377f2 thru 0x03ffff (0x880e bytes) 000924 1788639964.118124 mapwrite 0x02c0cd thru 0x0309ed (0x4921 bytes) 000926 1788639964.215182 mapwrite 0x03d4b2 thru 0x03ffff (0x2b4e bytes) 000927 1788639964.280089 write 0x00edf1 thru 0x017faf (0x91bf bytes) 000929 1788639964.293743 read 0x003ff3 thru 0x01155e (0xd56c bytes) 000931 1788639964.305719 trunc from 0x040000 to 0x010a33 (0x2f5cc bytes) 000933 1788639964.341112 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x10a34): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10a34): Mirror 13: 0x854f1575 (stale) Mirror 14: 0x854f1575 (stale) Mirror 15: 0x854f1575 (stale) Mirror 16: 0x854f1575 (stale) Mirror 18: 0x854f1575 (stale) Mirror 19: 0x854f1575 (stale) Mirror 22: 0x854f1575 (stale) Mirror 23: 0x854f1575 (stale) Mirror 24: 0x854f1575 (stale) CRC-32 checksum value for chunk [0, 0x10a34): Mirror 1: 0x5c5d61b Mirror 25: 0x5c5d61b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10a34: skipped 000934 1788639965.566558 read 0x0045a9 thru 0x0079c1 (0x3419 bytes) 000935 1788639965.580998 write 0x0059b9 thru 0x0156eb (0xfd33 bytes) 000938 1788639965.680548 trunc from 0x0156ec to 0x03c695 (0x26faa bytes) 000939 1788639965.738346 write 0x0379da thru 0x03ffff (0x8626 bytes) 000940 1788639965.746940 trunc from 0x040000 to 0x00f102 (0x30efd bytes) 000941 1788639965.765083 mapread 0x00b700 thru 0x00f102 (0x3a03 bytes) 000943 1788639965.768416 mapwrite 0x00fea2 thru 0x015e9c (0x5ffb bytes) 000944 1788639965.870583 read 0x0019f6 thru 0x00b1c1 (0x97cc bytes) 000945 1788639965.879133 mapread 0x012d21 thru 0x015e9c (0x317c bytes) 000946 1788639965.880306 punch from 0x00514e to 0x01062b (0xb4de bytes) 000947 1788639965.886548 trunc from 0x015e9d to 0x0278c5 (0x11a29 bytes) 000948 1788639965.914179 read 0x01e98a thru 0x026701 (0x7d78 bytes) 000949 1788639965.922108 write 0x03b581 thru 0x03ed82 (0x3802 bytes) 000951 1788639965.924457 trunc from 0x03ed83 to 0x032a0b (0xc377 bytes) 000953 1788639965.940863 mapread 0x0053a0 thru 0x00d783 (0x83e4 bytes) 000954 1788639965.943217 read 0x02ac89 thru 0x032a0b (0x7d83 bytes) 000955 1788639965.958962 MIRROR_RESYNC 11 mirrors 000956 1788639969.498366 mapwrite 0x0325e3 thru 0x0329e9 (0x407 bytes) 000957 1788639969.708083 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x32a0c): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32a0c): Mirror 13: 0x4ca070ce (stale) Mirror 14: 0x4ca070ce (stale) Mirror 15: 0x4ca070ce (stale) Mirror 16: 0x4ca070ce (stale) Mirror 18: 0x4ca070ce (stale) Mirror 19: 0x4ca070ce (stale) Mirror 22: 0x4ca070ce (stale) Mirror 23: 0x4ca070ce (stale) Mirror 24: 0x4ca070ce (stale) Mirror 25: 0x4ca070ce (stale) CRC-32 checksum value for chunk [0, 0x32a0c): Mirror 1: 0x248115da Mirror 26: 0x248115da lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32a0c: skipped 000961 1788639971.264840 mapread 0x008b8d thru 0x0133c3 (0xa837 bytes) 000962 1788639971.311178 punch from 0x006099 to 0x01119e (0xb106 bytes) 000964 1788639971.448036 punch from 0x00cf85 to 0x0125c4 (0x5640 bytes) 000967 1788639971.455925 punch from 0x01cb55 to 0x01fcaa (0x3156 bytes) 000968 1788639971.465229 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x32a0c): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32a0c): Mirror 13: 0x4ca070ce (stale) Mirror 14: 0x4ca070ce (stale) Mirror 15: 0x4ca070ce (stale) Mirror 16: 0x4ca070ce (stale) Mirror 18: 0x4ca070ce (stale) Mirror 19: 0x4ca070ce (stale) Mirror 22: 0x4ca070ce (stale) Mirror 23: 0x4ca070ce (stale) Mirror 24: 0x4ca070ce (stale) Mirror 25: 0x4ca070ce (stale) Mirror 26: 0x248115da (stale) CRC-32 checksum value for chunk [0, 0x32a0c): Mirror 1: 0x47ec021e Mirror 27: 0x47ec021e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32a0c: skipped 000969 1788639973.166686 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32a0c): Mirror 14: 0x4ca070ce (stale) Mirror 15: 0x4ca070ce (stale) Mirror 16: 0x4ca070ce (stale) Mirror 18: 0x4ca070ce (stale) Mirror 19: 0x4ca070ce (stale) Mirror 22: 0x4ca070ce (stale) Mirror 23: 0x4ca070ce (stale) Mirror 24: 0x4ca070ce (stale) Mirror 25: 0x4ca070ce (stale) Mirror 26: 0x248115da (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32a0c): Mirror 14: 0x4ca070ce (stale) Mirror 15: 0x4ca070ce (stale) Mirror 16: 0x4ca070ce (stale) Mirror 18: 0x4ca070ce (stale) Mirror 19: 0x4ca070ce (stale) Mirror 22: 0x4ca070ce (stale) Mirror 23: 0x4ca070ce (stale) Mirror 24: 0x4ca070ce (stale) Mirror 25: 0x4ca070ce (stale) Mirror 26: 0x248115da (stale) CRC-32 checksum value for chunk [0, 0x32a0c): Mirror 1: 0x47ec021e Mirror 27: 0x47ec021e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32a0c: skipped 000970 1788639974.579303 MIRROR_SPLIT mirror 2 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x172:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32a0c): Mirror 14: 0x4ca070ce (stale) Mirror 16: 0x4ca070ce (stale) Mirror 18: 0x4ca070ce (stale) Mirror 19: 0x4ca070ce (stale) Mirror 22: 0x4ca070ce (stale) Mirror 23: 0x4ca070ce (stale) Mirror 24: 0x4ca070ce (stale) Mirror 25: 0x4ca070ce (stale) Mirror 26: 0x248115da (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32a0c): Mirror 14: 0x4ca070ce (stale) Mirror 16: 0x4ca070ce (stale) Mirror 18: 0x4ca070ce (stale) Mirror 19: 0x4ca070ce (stale) Mirror 22: 0x4ca070ce (stale) Mirror 23: 0x4ca070ce (stale) Mirror 24: 0x4ca070ce (stale) Mirror 25: 0x4ca070ce (stale) Mirror 26: 0x248115da (stale) CRC-32 checksum value for chunk [0, 0x32a0c): Mirror 1: 0x47ec021e Mirror 27: 0x47ec021e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32a0c: skipped 000972 1788639975.774288 read 0x02ed8b thru 0x032a0b (0x3c81 bytes) 000973 1788639975.817777 mapwrite 0x02b25b thru 0x033c24 (0x89ca bytes) 000974 1788639976.134741 trunc from 0x033c25 to 0x00ec2f (0x24ff5 bytes) 000975 1788639976.200210 trunc from 0x00ec30 to 0x02d285 (0x1e656 bytes) 000976 1788639976.225043 read 0x01f72d thru 0x02d285 (0xdb59 bytes) 000978 1788639976.248097 trunc from 0x02d286 to 0x03990d (0xc688 bytes) 000979 1788639976.267114 write 0x03c75d thru 0x03ffff (0x38a3 bytes) 000981 1788639976.271339 read 0x035d6e thru 0x03fa1e (0x9cb1 bytes) 000983 1788639976.289232 write 0x019318 thru 0x025fdc (0xccc5 bytes) 000988 1788639976.301483 punch from 0x0117d0 to 0x01f297 (0xdac8 bytes) 000989 1788639976.322670 write 0x014903 thru 0x01e003 (0x9701 bytes) 000990 1788639976.339019 punch from 0x03eb9b to 0x03ffff (0x1465 bytes) 000991 1788639976.366388 mapread 0x03bd90 thru 0x03ffff (0x4270 bytes) 000992 1788639976.380765 mapread 0x02166c thru 0x02dbf3 (0xc588 bytes) 000993 1788639976.400487 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x5c45489e (stale) Mirror 16: 0x5c45489e (stale) Mirror 18: 0x5c45489e (stale) Mirror 19: 0x5c45489e (stale) Mirror 22: 0x5c45489e (stale) Mirror 23: 0x5c45489e (stale) Mirror 24: 0x5c45489e (stale) Mirror 25: 0x5c45489e (stale) Mirror 26: 0x741390fc (stale) Mirror 27: 0x6405357d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xad31ee18 Mirror 28: 0xad31ee18 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000994 1788639978.294052 mapwrite 0x01c9d9 thru 0x02348f (0x6ab7 bytes) 000997 1788639978.564424 trunc from 0x040000 to 0x012d8d (0x2d272 bytes) 000998 1788639978.597050 mapwrite 0x034e18 thru 0x036b39 (0x1d22 bytes) 000999 1788639978.791259 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x36b3a): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36b3a): Mirror 14: 0xf4f493b5 (stale) Mirror 16: 0xf4f493b5 (stale) Mirror 18: 0xf4f493b5 (stale) Mirror 19: 0xf4f493b5 (stale) Mirror 22: 0xf4f493b5 (stale) Mirror 23: 0xf4f493b5 (stale) Mirror 24: 0xf4f493b5 (stale) Mirror 25: 0xf4f493b5 (stale) Mirror 26: 0x8698d8e0 (stale) Mirror 27: 0x853b54cd (stale) Mirror 28: 0x79f57103 (stale) CRC-32 checksum value for chunk [0, 0x36b3a): Mirror 1: 0x7785518f Mirror 29: 0x7785518f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36b3a: skipped All operations completed A-OK!