== sanity-flr test 70a: flr mode fsx test ================ 12:30:07 (1772472607) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 2609 truncating to largest ever: 0x1d715 000001 1772472609.985862 trunc from 00000000 to 0x01d714 (0x1d715 bytes) truncating to largest ever: 0x1e0a8 000002 1772472610.010655 trunc from 0x01d715 to 0x01e0a7 (0x993 bytes) 000003 1772472610.035468 read 0x015c03 thru 0x01e0a7 (0x84a5 bytes) 000004 1772472610.051279 trunc from 0x01e0a8 to 0x007f53 (0x16154 bytes) truncating to largest ever: 0x3d8bc 000005 1772472610.067253 trunc from 0x007f54 to 0x03d8bb (0x35968 bytes) 000006 1772472610.096306 trunc from 0x014beb to 0x01781d (0x2c33 bytes) 000007 1772472610.102293 trunc from 0x01c379 to 0x01d349 (0xfd1 bytes) 000009 1772472610.109229 mapwrite 0x033948 thru 0x0391ce (0x5887 bytes) 000010 1772472610.154445 MIRROR_EXTEND to 2 mirrors 000011 1772472610.677275 write 0x02f2f5 thru 0x039372 (0xa07e bytes) 000012 1772472610.727369 punch from 0x02a2e8 to 0x032461 (0x817a bytes) 000013 1772472610.743410 write 0x035704 thru 0x03ffff (0xa8fc bytes) 000014 1772472610.751382 fallocate 0x019594 thru 0x0201b8 (0x6c25 bytes) 000015 1772472610.757942 mapwrite 0x020bb0 thru 0x0223bf (0x1810 bytes) 000016 1772472610.794647 read 0x01b213 thru 0x0265ae (0xb39c bytes) 000017 1772472610.795724 mapread 0x00e3cf thru 0x01c0e2 (0xdd14 bytes) 000018 1772472610.819310 punch from 0x02efda to 0x03a0e4 (0xb10b bytes) 000019 1772472610.828386 trunc from 0x040000 to 0x0345da (0xba25 bytes) 000020 1772472610.882792 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x345db): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x345db): Mirror 2: 0x4ac7ba17 (stale) CRC-32 checksum value for chunk [0, 0x345db): Mirror 1: 0x4b5220b5 Mirror 3: 0x4b5220b5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x345db: skipped 000021 1772472611.719351 punch from 0x02d352 to 0x032950 (0x55ff bytes) 000022 1772472611.765758 mapread 0x020fd1 thru 0x02b7b6 (0xa7e6 bytes) 000023 1772472611.824672 MIRROR_RESYNC 3 mirrors 000024 1772472612.925341 mapread 0x0320f7 thru 0x0345da (0x24e4 bytes) 000026 1772472612.944053 mapread 0x01ae61 thru 0x01fa6e (0x4c0e bytes) 000027 1772472612.960382 mapread 0x001249 thru 0x00c445 (0xb1fd bytes) 000028 1772472612.973444 write 0x014880 thru 0x01aa88 (0x6209 bytes) 000029 1772472613.056784 mapwrite 0x0207dd thru 0x02583e (0x5062 bytes) 000030 1772472613.100682 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x345db): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x345db): Mirror 2: 0x4b5220b5 (stale) Mirror 3: 0x4b5220b5 (stale) CRC-32 checksum value for chunk [0, 0x345db): Mirror 1: 0x212908d2 Mirror 4: 0x212908d2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x345db: skipped 000031 1772472613.974284 mapread 0x013a07 thru 0x01ff05 (0xc4ff bytes) 000032 1772472614.074701 write 0x02db48 thru 0x03b653 (0xdb0c bytes) 000033 1772472614.165888 trunc from 0x03b654 to 0x0384fb (0x3158 bytes) 000034 1772472614.254206 write 0x035c60 thru 0x03c08a (0x642b bytes) 000035 1772472614.255738 fallocate 0x01f4f9 thru 0x028e79 (0x9981 bytes) 000036 1772472614.273167 trunc from 0x007f21 to 0x013ee3 (0xbfc3 bytes) 000037 1772472614.279109 trunc from 0x03c08b to 0x03549f (0x6beb bytes) 000038 1772472614.304424 mapread 0x02527d thru 0x032aab (0xd82f bytes) 000039 1772472614.341364 trunc from 0x00923e to 0x0154a9 (0xc26c bytes) 000040 1772472614.372473 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x354a0): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x354a0): Mirror 2: 0xdc18ea4e (stale) Mirror 3: 0xdc18ea4e (stale) Mirror 4: 0x221ca7cf (stale) CRC-32 checksum value for chunk [0, 0x354a0): Mirror 1: 0xbb270d87 Mirror 5: 0xbb270d87 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x354a0: skipped 000041 1772472615.532922 trunc from 0x0354a0 to 0x035e3c (0x99d bytes) 000042 1772472615.599685 trunc from 0x0087c3 to 0x014a8d (0xc2cb bytes) 000044 1772472615.606694 punch from 0x023954 to 0x02dae5 (0xa192 bytes) 000045 1772472615.611839 read 0x02132b thru 0x02bfcb (0xaca1 bytes) 000046 1772472615.624507 write 0x03470c thru 0x03e925 (0xa21a bytes) truncating to largest ever: 0x3ed72 000048 1772472615.634247 trunc from 0x03e926 to 0x03ed71 (0x44c bytes) 000049 1772472615.685124 mapread 0x03bb1d thru 0x03ed71 (0x3255 bytes) 000050 1772472615.689731 mapwrite 0x022c13 thru 0x026e4e (0x423c bytes) 000051 1772472615.730623 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3ed72): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ed72): Mirror 2: 0xb0d8b8d2 (stale) Mirror 3: 0xb0d8b8d2 (stale) Mirror 4: 0xcb031180 (stale) Mirror 5: 0xc4371066 (stale) CRC-32 checksum value for chunk [0, 0x3ed72): Mirror 1: 0xe4007a7 Mirror 6: 0xe4007a7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ed72: skipped 000053 1772472617.223851 mapread 0x02a814 thru 0x02bc23 (0x1410 bytes) 000054 1772472617.258751 mapwrite 0x021c73 thru 0x02a44b (0x87d9 bytes) 000055 1772472617.502262 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3ed72): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ed72): Mirror 2: 0xb0d8b8d2 (stale) Mirror 3: 0xb0d8b8d2 (stale) Mirror 4: 0xcb031180 (stale) Mirror 5: 0xc4371066 (stale) Mirror 6: 0xe4007a7 (stale) CRC-32 checksum value for chunk [0, 0x3ed72): Mirror 1: 0xc7674c47 Mirror 7: 0xc7674c47 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ed72: skipped 000056 1772472618.884204 trunc from 0x03ed72 to 0x031acf (0xd2a2 bytes) 000058 1772472618.950957 mapwrite 0x0253e8 thru 0x02d3bc (0x7fd5 bytes) 000059 1772472618.989733 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x31ad0): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31ad0): Mirror 2: 0x4a29a068 (stale) Mirror 3: 0x4a29a068 (stale) Mirror 4: 0xa76df6c0 (stale) Mirror 5: 0x38a8e71 (stale) Mirror 6: 0xb41e49e7 (stale) Mirror 7: 0x4fc74386 (stale) CRC-32 checksum value for chunk [0, 0x31ad0): Mirror 1: 0x251f97f0 Mirror 8: 0x251f97f0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31ad0: skipped 000060 1772472620.333162 trunc from 0x031ad0 to 0x02f216 (0x28b9 bytes) 000061 1772472620.398027 trunc from 0x02f217 to 0x029972 (0x58a4 bytes) 000062 1772472620.426114 trunc from 0x028033 to 0x029972 (0x1940 bytes) 000063 1772472620.432088 trunc from 0x015abf to 0x01ff2f (0xa471 bytes) 000064 1772472620.443216 trunc from 0x029973 to 0x00b385 (0x1e5ed bytes) 000065 1772472620.456893 write 0x022d3c thru 0x02f13e (0xc403 bytes) 000067 1772472620.459098 mapread 0x021212 thru 0x02ae63 (0x9c52 bytes) 000068 1772472620.465196 mapread 0x019240 thru 0x01ff8e (0x6d4f bytes) 000069 1772472620.480804 trunc from 0x02ba86 to 0x02f13e (0x36b9 bytes) 000070 1772472620.497502 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f13f): Mirror 2: 0x495ff959 (stale) Mirror 3: 0x495ff959 (stale) Mirror 4: 0x3a92107d (stale) Mirror 5: 0x6dd51977 (stale) Mirror 7: 0x52a9c4a6 (stale) Mirror 8: 0x9a560c02 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f13f): Mirror 2: 0x495ff959 (stale) Mirror 3: 0x495ff959 (stale) Mirror 4: 0x3a92107d (stale) Mirror 5: 0x6dd51977 (stale) Mirror 7: 0x52a9c4a6 (stale) Mirror 8: 0x9a560c02 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f13f: skipped 000071 1772472621.007398 trunc from 0x0065ad to 0x00fe6c (0x98c0 bytes) 000072 1772472621.012906 trunc from 0x018be8 to 0x01d969 (0x4d82 bytes) 000073 1772472621.017646 mapwrite 0x01d768 thru 0x024054 (0x68ed bytes) 000074 1772472621.056206 mapread 0x02c736 thru 0x02edbe (0x2689 bytes) 000075 1772472621.064415 write 0x02b370 thru 0x038ec7 (0xdb58 bytes) 000076 1772472621.071830 punch from 0x00d94b to 0x0150c7 (0x777d bytes) 000077 1772472621.080175 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38ec8): Mirror 2: 0x5b9eb559 (stale) Mirror 4: 0x138ade80 (stale) Mirror 5: 0x30447746 (stale) Mirror 7: 0x8eee6ad4 (stale) Mirror 8: 0xec1afa3d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38ec8): Mirror 2: 0x5b9eb559 (stale) Mirror 4: 0x138ade80 (stale) Mirror 5: 0x30447746 (stale) Mirror 7: 0x8eee6ad4 (stale) Mirror 8: 0xec1afa3d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38ec8: skipped 000078 1772472621.540695 mapread 0x036229 thru 0x038ec7 (0x2c9f bytes) 000079 1772472621.591408 MIRROR_RESYNC 6 mirrors 000080 1772472622.827381 read 0x000d5d thru 0x0023b0 (0x1654 bytes) 000081 1772472622.834987 fallocate 0x02f958 thru 0x03aefa (0xb5a3 bytes) 000082 1772472622.862012 mapread 0x019943 thru 0x02666d (0xcd2b bytes) 000083 1772472622.883088 write 0x03caf5 thru 0x03ffff (0x350b bytes) 000084 1772472622.884020 read 0x01652b thru 0x02180d (0xb2e3 bytes) 000085 1772472622.884497 write 0x003db6 thru 0x00e741 (0xa98c bytes) 000086 1772472622.895863 mapwrite 0x007082 thru 0x00764d (0x5cc bytes) 000087 1772472622.917149 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xc425e2d7 (stale) Mirror 4: 0xc425e2d7 (stale) Mirror 5: 0xc425e2d7 (stale) Mirror 7: 0xc425e2d7 (stale) Mirror 8: 0xc425e2d7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x291fa286 Mirror 9: 0x291fa286 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000088 1772472623.938429 read 0x01869b thru 0x0276f0 (0xf056 bytes) 000089 1772472623.963109 write 0x02f958 thru 0x037e3a (0x84e3 bytes) 000090 1772472624.029114 read 0x027cf2 thru 0x02aec0 (0x31cf bytes) 000091 1772472624.040448 trunc from 0x040000 to 0x0056e2 (0x3a91d bytes) 000093 1772472624.068325 write 0x02e910 thru 0x03aa42 (0xc133 bytes) 000094 1772472624.076033 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3aa43): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aa43): Mirror 2: 0xe390b259 (stale) Mirror 4: 0xe390b259 (stale) Mirror 5: 0xe390b259 (stale) Mirror 7: 0xe390b259 (stale) Mirror 8: 0xe390b259 (stale) Mirror 9: 0x9ad25b7c (stale) CRC-32 checksum value for chunk [0, 0x3aa43): Mirror 1: 0xda39f32c Mirror 10: 0xda39f32c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aa43: skipped 000095 1772472624.958087 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3aa43): Mirror 2: 0xe390b259 (stale) Mirror 4: 0xe390b259 (stale) Mirror 7: 0xe390b259 (stale) Mirror 8: 0xe390b259 (stale) Mirror 9: 0x9ad25b7c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aa43): Mirror 2: 0xe390b259 (stale) Mirror 4: 0xe390b259 (stale) Mirror 7: 0xe390b259 (stale) Mirror 8: 0xe390b259 (stale) Mirror 9: 0x9ad25b7c (stale) CRC-32 checksum value for chunk [0, 0x3aa43): Mirror 1: 0xda39f32c Mirror 10: 0xda39f32c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aa43: skipped 000096 1772472625.651713 trunc from 0x003dad to 0x00c967 (0x8bbb bytes) 000097 1772472625.702445 mapwrite 0x037410 thru 0x03cc93 (0x5884 bytes) 000098 1772472625.807923 mapwrite 0x021f2a thru 0x02b7f5 (0x98cc bytes) 000099 1772472625.867879 trunc from 0x0113af to 0x01f17d (0xddcf bytes) 000100 1772472625.873826 fallocate 0x0057bf thru 0x0123f2 (0xcc34 bytes) 000101 1772472625.881445 read 0x00a58f thru 0x010c5e (0x66d0 bytes) 000102 1772472625.896891 mapwrite 0x011239 thru 0x013a17 (0x27df bytes) 000103 1772472625.924537 mapread 0x02a16b thru 0x035b66 (0xb9fc bytes) 000104 1772472625.926939 punch from 0x036fd7 to 0x03cc93 (0x5cbd bytes) 000106 1772472625.934311 trunc from 0x03254e to 0x036fe7 (0x4a9a bytes) 000107 1772472625.941472 trunc from 0x03cc94 to 0x00958f (0x33704 bytes) 000108 1772472625.965109 fallocate 0x009a99 thru 0x015a69 (0xbfd1 bytes) 000110 1772472625.972306 read 0x00c672 thru 0x014ff2 (0x8981 bytes) 000111 1772472625.981044 mapwrite 0x028f05 thru 0x02e9ae (0x5aaa bytes) 000113 1772472626.041153 mapwrite 0x0236a6 thru 0x031615 (0xdf70 bytes) 000114 1772472626.089060 read 0x022f07 thru 0x02d353 (0xa44d bytes) 000115 1772472626.089944 write 0x034b28 thru 0x03ffff (0xb4d8 bytes) 000116 1772472626.093059 write 0x03cd34 thru 0x03ffff (0x32cc bytes) 000117 1772472626.094980 mapwrite 0x015d5e thru 0x019e72 (0x4115 bytes) 000118 1772472626.116491 read 0x030cc9 thru 0x03ffff (0xf337 bytes) 000119 1772472626.127394 MIRROR_RESYNC 7 mirrors 000120 1772472627.998411 fallocate 0x018f23 thru 0x0214b3 (0x8591 bytes) 000121 1772472628.061420 fallocate 0x035b02 thru 0x03803c (0x253b bytes) 000122 1772472628.069526 mapread 0x0249a1 thru 0x025836 (0xe96 bytes) 000123 1772472628.086486 read 0x03a2a9 thru 0x03cf26 (0x2c7e bytes) 000124 1772472628.094366 trunc from 0x036924 to 0x03bd2b (0x5408 bytes) 000125 1772472628.102460 write 0x037ba0 thru 0x03a284 (0x26e5 bytes) 000126 1772472628.117049 trunc from 0x040000 to 0x0225bb (0x1da44 bytes) 000127 1772472628.141784 trunc from 0x0213e9 to 0x0225bb (0x11d3 bytes) 000128 1772472628.149023 trunc from 0x015fe6 to 0x0225bb (0xc5d6 bytes) 000130 1772472628.166443 mapread 0x01c0eb thru 0x0225bb (0x64d1 bytes) 000131 1772472628.179843 trunc from 0x0225bc to 0x0156f9 (0xcec2 bytes) 000132 1772472628.205737 write 0x0179d7 thru 0x0227d6 (0xae00 bytes) 000133 1772472628.216491 fallocate 0x01b1d1 thru 0x02661d (0xb44d bytes) 000134 1772472628.226296 mapwrite 0x011f51 thru 0x012401 (0x4b1 bytes) 000135 1772472628.278477 fallocate 0x00d2db thru 0x01c127 (0xee4d bytes) 000136 1772472628.287691 mapread 0x0175ce thru 0x01fad3 (0x8506 bytes) 000137 1772472628.288988 fallocate 0x02a182 thru 0x02af0f (0xd8e bytes) 000139 1772472628.302513 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2661e): Mirror 2: 0x7e880957 (stale) Mirror 4: 0x7e880957 (stale) Mirror 7: 0x7e880957 (stale) Mirror 8: 0x7e880957 (stale) Mirror 9: 0x7e880957 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2661e): Mirror 2: 0x7e880957 (stale) Mirror 4: 0x7e880957 (stale) Mirror 7: 0x7e880957 (stale) Mirror 8: 0x7e880957 (stale) Mirror 9: 0x7e880957 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2661e: skipped 000140 1772472628.795448 write 0x02f002 thru 0x03d255 (0xe254 bytes) 000141 1772472628.807646 mapread 0x03a725 thru 0x03d255 (0x2b31 bytes) 000143 1772472628.811113 read 0x011e96 thru 0x016a57 (0x4bc2 bytes) 000144 1772472628.841480 read 0x004d73 thru 0x00f1b5 (0xa443 bytes) 000145 1772472628.856255 punch from 0x02525d to 0x02ef71 (0x9d15 bytes) 000146 1772472628.865869 fallocate 0x010a2e thru 0x01b493 (0xaa66 bytes) fallocating to largest ever: 0x40000 000147 1772472628.873103 fallocate 0x03699b thru 0x03ffff (0x9665 bytes) 000148 1772472628.881302 trunc from 0x0388a3 to 0x03ffff (0x775d bytes) 000149 1772472628.898732 trunc from 0x0267ad to 0x02cc44 (0x6498 bytes) 000150 1772472628.907177 punch from 0x0204fc to 0x02f365 (0xee6a bytes) 000152 1772472628.915204 punch from 0x0157b3 to 0x018a30 (0x327e bytes) 000153 1772472628.922404 mapread 0x024d17 thru 0x024e0d (0xf7 bytes) 000154 1772472628.932729 punch from 0x02076d to 0x026842 (0x60d6 bytes) 000155 1772472628.939363 mapwrite 0x015247 thru 0x01848c (0x3246 bytes) 000157 1772472628.989775 mapwrite 0x0072a1 thru 0x00e413 (0x7173 bytes) 000158 1772472629.016255 fallocate 0x016823 thru 0x025953 (0xf131 bytes) 000159 1772472629.033415 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa17e246d (stale) Mirror 4: 0xa17e246d (stale) Mirror 7: 0xa17e246d (stale) Mirror 8: 0xa17e246d (stale) Mirror 9: 0xa17e246d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb608d167 Mirror 10: 0xb608d167 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000160 1772472630.168287 mapwrite 0x00a7cc thru 0x01a430 (0xfc65 bytes) 000161 1772472630.349536 trunc from 0x014b5d to 0x01f833 (0xacd7 bytes) 000162 1772472630.357357 fallocate 0x018a5f thru 0x0259c8 (0xcf6a bytes) 000163 1772472630.363441 write 0x0380f1 thru 0x03ffff (0x7f0f bytes) 000164 1772472630.383726 mapwrite 0x0351ea thru 0x035666 (0x47d bytes) 000165 1772472630.411665 write 0x015b0b thru 0x01aa9c (0x4f92 bytes) 000166 1772472630.426471 trunc from 0x02f30c to 0x039342 (0xa037 bytes) 000167 1772472630.434139 mapwrite 0x0337e5 thru 0x039318 (0x5b34 bytes) 000168 1772472630.470417 trunc from 0x027d01 to 0x0344a7 (0xc7a7 bytes) 000169 1772472630.478320 mapwrite 0x01741d thru 0x019c2d (0x2811 bytes) 000170 1772472630.503429 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa17e246d (stale) Mirror 4: 0xa17e246d (stale) Mirror 7: 0xa17e246d (stale) Mirror 8: 0xa17e246d (stale) Mirror 9: 0xa17e246d (stale) Mirror 10: 0xb608d167 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3ef714a6 Mirror 11: 0x3ef714a6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000171 1772472631.739989 write 0x001aab thru 0x009e9d (0x83f3 bytes) 000172 1772472631.810858 mapread 0x005f4f thru 0x01273c (0xc7ee bytes) 000173 1772472631.819756 trunc from 0x040000 to 0x0034c7 (0x3cb38 bytes) 000174 1772472631.848811 mapread 0x0020b6 thru 0x0034c7 (0x1412 bytes) 000175 1772472631.849701 write 0x01861a thru 0x025a14 (0xd3fb bytes) 000176 1772472631.857101 punch from 0x01d217 to 0x0256e7 (0x84d1 bytes) 000177 1772472631.890450 read 0x019b8f thru 0x024b4b (0xafbd bytes) 000178 1772472631.903152 read 0x00d16c thru 0x0112ef (0x4184 bytes) 000179 1772472631.919416 trunc from 0x025a15 to 0x036aa5 (0x11091 bytes) 000180 1772472631.937451 mapwrite 0x02b68f thru 0x02ebbe (0x3530 bytes) 000181 1772472631.964214 mapwrite 0x02ccf4 thru 0x038da6 (0xc0b3 bytes) 000184 1772472632.018198 MIRROR_RESYNC 8 mirrors 000185 1772472634.992758 trunc from 0x013b05 to 0x0225ba (0xeab6 bytes) 000186 1772472635.036891 trunc from 0x028e94 to 0x03537a (0xc4e7 bytes) 000187 1772472635.042662 fallocate 0x00743b thru 0x00ad23 (0x38e9 bytes) 000188 1772472635.049232 fallocate 0x01b561 thru 0x02b206 (0xfca6 bytes) 000189 1772472635.056874 punch from 0x01e641 to 0x026a30 (0x83f0 bytes) 000190 1772472635.068328 read 0x037242 thru 0x038da6 (0x1b65 bytes) 000191 1772472635.079917 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x38da7): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38da7): Mirror 2: 0x3005d74f (stale) Mirror 4: 0x3005d74f (stale) Mirror 7: 0x3005d74f (stale) Mirror 8: 0x3005d74f (stale) Mirror 9: 0x3005d74f (stale) Mirror 10: 0x3005d74f (stale) Mirror 11: 0x3005d74f (stale) CRC-32 checksum value for chunk [0, 0x38da7): Mirror 1: 0xb75025bc Mirror 12: 0xb75025bc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38da7: skipped 000192 1772472636.423482 fallocate 0x01e6d3 thru 0x029ded (0xb71b bytes) 000193 1772472636.487753 trunc from 0x014336 to 0x015555 (0x1220 bytes) 000194 1772472636.496175 fallocate 0x037bf4 thru 0x03d7fd (0x5c0a bytes) 000195 1772472636.507772 fallocate 0x016a9b thru 0x01ad7a (0x42e0 bytes) 000196 1772472636.520347 read 0x012a8d thru 0x01e494 (0xba08 bytes) 000197 1772472636.537522 write 0x000c9b thru 0x008031 (0x7397 bytes) 000198 1772472636.552674 read 0x003d2f thru 0x00f531 (0xb803 bytes) 000199 1772472636.564016 punch from 0x0175ff to 0x01c841 (0x5243 bytes) 000200 1772472636.576218 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x38da7): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38da7): Mirror 2: 0x3005d74f (stale) Mirror 4: 0x3005d74f (stale) Mirror 7: 0x3005d74f (stale) Mirror 8: 0x3005d74f (stale) Mirror 9: 0x3005d74f (stale) Mirror 10: 0x3005d74f (stale) Mirror 11: 0x3005d74f (stale) Mirror 12: 0xb75025bc (stale) CRC-32 checksum value for chunk [0, 0x38da7): Mirror 1: 0x939dc547 Mirror 13: 0x939dc547 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38da7: skipped 000201 1772472637.706902 trunc from 0x02940b to 0x031e4e (0x8a44 bytes) 000202 1772472637.760051 write 0x0172ec thru 0x022679 (0xb38e bytes) 000203 1772472637.777912 trunc from 0x038da7 to 0x010f6d (0x27e39 bytes) 000204 1772472637.839059 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x10f6e): Mirror 4: 0xb018718 (stale) Mirror 7: 0xb018718 (stale) Mirror 8: 0xb018718 (stale) Mirror 9: 0xb018718 (stale) Mirror 10: 0xb018718 (stale) Mirror 11: 0xb018718 (stale) Mirror 12: 0xb018718 (stale) Mirror 13: 0x77249232 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10f6e): Mirror 4: 0xb018718 (stale) Mirror 7: 0xb018718 (stale) Mirror 8: 0xb018718 (stale) Mirror 9: 0xb018718 (stale) Mirror 10: 0xb018718 (stale) Mirror 11: 0xb018718 (stale) Mirror 12: 0xb018718 (stale) Mirror 13: 0x77249232 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10f6e: skipped 000205 1772472638.436831 read 0x002ad7 thru 0x00f652 (0xcb7c bytes) 000206 1772472638.448043 trunc from 0x0013a0 to 0x009115 (0x7d76 bytes) 000207 1772472638.456519 trunc from 0x010f6e to 0x01ba35 (0xaac8 bytes) 000208 1772472638.480342 mapwrite 0x00d9c1 thru 0x01b4c3 (0xdb03 bytes) 000209 1772472638.539156 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x1ba36): Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ba36): Mirror 4: 0x44f19756 (stale) Mirror 7: 0x44f19756 (stale) Mirror 8: 0x44f19756 (stale) Mirror 9: 0x44f19756 (stale) Mirror 10: 0x44f19756 (stale) Mirror 11: 0x44f19756 (stale) Mirror 12: 0x4f93e7af (stale) Mirror 13: 0xbfd73d6f (stale) CRC-32 checksum value for chunk [0, 0x1ba36): Mirror 1: 0x87158578 Mirror 14: 0x87158578 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ba36: skipped 000210 1772472639.807430 fallocate 0x02fa94 thru 0x032554 (0x2ac1 bytes) 000211 1772472639.857971 MIRROR_RESYNC 10 mirrors 000212 1772472642.473064 MIRROR_EXTEND to 11 mirrors 000213 1772472643.472000 punch from 0x014c10 to 0x01973f (0x4b30 bytes) 000214 1772472643.539447 punch from 0x0155ce to 0x015d38 (0x76b bytes) 000215 1772472643.553138 trunc from 0x017785 to 0x01d2a3 (0x5b1f bytes) 000216 1772472643.561105 trunc from 0x032555 to 0x01c023 (0x16531 bytes) 000217 1772472643.604471 read 0x00f1c4 thru 0x01c023 (0xce60 bytes) 000218 1772472643.618229 mapwrite 0x01489b thru 0x02267d (0xdde3 bytes) 000219 1772472643.700883 fallocate 0x00962c thru 0x013876 (0xa24b bytes) 000220 1772472643.713724 mapread 0x00fbf2 thru 0x0187fb (0x8c0a bytes) 000221 1772472643.719446 trunc from 0x01eaf0 to 0x02267d (0x3b8e bytes) 000222 1772472643.725474 trunc from 0x02267e to 0x000ac6 (0x21bb7 bytes) 000223 1772472643.745520 punch from 0x0002ec to 0x000ac6 (0x7db bytes) 000225 1772472643.756736 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xac7): Mirror 7: 0x3df34ad4 (stale) Mirror 8: 0x3df34ad4 (stale) Mirror 9: 0x3df34ad4 (stale) Mirror 10: 0x3df34ad4 (stale) Mirror 11: 0x3df34ad4 (stale) Mirror 12: 0x3df34ad4 (stale) Mirror 13: 0x3df34ad4 (stale) Mirror 14: 0x3df34ad4 (stale) Mirror 15: 0x3df34ad4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xac7): Mirror 7: 0x3df34ad4 (stale) Mirror 8: 0x3df34ad4 (stale) Mirror 9: 0x3df34ad4 (stale) Mirror 10: 0x3df34ad4 (stale) Mirror 11: 0x3df34ad4 (stale) Mirror 12: 0x3df34ad4 (stale) Mirror 13: 0x3df34ad4 (stale) Mirror 14: 0x3df34ad4 (stale) Mirror 15: 0x3df34ad4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xac7: skipped 000226 1772472644.239722 read 0x00079b thru 0x000ac6 (0x32c bytes) 000227 1772472644.245653 read 0x0004f8 thru 0x000ac6 (0x5cf bytes) 000228 1772472644.246367 mapwrite 0x01f532 thru 0x02c4b2 (0xcf81 bytes) 000229 1772472644.347908 write 0x00cf13 thru 0x01b5c6 (0xe6b4 bytes) 000230 1772472644.359349 MIRROR_RESYNC 10 mirrors 000231 1772472646.899115 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) 000232 1772472647.367314 punch from 0x004a0e to 0x00e629 (0x9c1c bytes) 000233 1772472647.426135 trunc from 0x02c4b3 to 0x00ca2e (0x1fa84 bytes) 000234 1772472647.469019 trunc from 0x009da5 to 0x00ca2e (0x2c8a bytes) 000235 1772472647.483017 write 0x00f26c thru 0x01ecd6 (0xfa6b bytes) 000236 1772472647.485653 fallocate 0x02d381 thru 0x02e4a5 (0x1125 bytes) 000237 1772472647.496281 write 0x01dd31 thru 0x0293cf (0xb69f bytes) 000238 1772472647.500313 trunc from 0x0293d0 to 0x002054 (0x2737b bytes) 000239 1772472647.540723 read 0x0002f4 thru 0x002054 (0x1d61 bytes) 000240 1772472647.552037 mapread 0x000b16 thru 0x002054 (0x153f bytes) 000241 1772472647.553589 mapwrite 0x030938 thru 0x03e57e (0xdc47 bytes) 000242 1772472647.677439 write 0x021dc9 thru 0x0280b9 (0x62f1 bytes) 000243 1772472647.691726 trunc from 0x03e57f to 0x03a084 (0x44fa bytes) 000244 1772472647.726043 write 0x027d22 thru 0x034e61 (0xd140 bytes) 000245 1772472647.730958 write 0x02c62f thru 0x031e35 (0x5807 bytes) 000246 1772472647.734102 trunc from 0x00dcda to 0x010681 (0x29a8 bytes) 000247 1772472647.748065 trunc from 0x006b0f to 0x007e5e (0x1350 bytes) 000248 1772472647.755210 mapwrite 0x002403 thru 0x007944 (0x5542 bytes) 000249 1772472647.793635 mapread 0x007d9d thru 0x012743 (0xa9a7 bytes) 000251 1772472647.805189 mapwrite 0x00448f thru 0x00ce16 (0x8988 bytes) 000252 1772472647.827107 write 0x009f74 thru 0x00e2c5 (0x4352 bytes) 000253 1772472647.829097 trunc from 0x03a085 to 0x03cb92 (0x2b0e bytes) 000254 1772472647.851775 mapread 0x03a87c thru 0x03cb92 (0x2317 bytes) 000255 1772472647.863501 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cb93): Mirror 7: 0x262e504f (stale) Mirror 9: 0x262e504f (stale) Mirror 10: 0x262e504f (stale) Mirror 11: 0x262e504f (stale) Mirror 12: 0x262e504f (stale) Mirror 14: 0x262e504f (stale) Mirror 15: 0x262e504f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cb93): Mirror 7: 0x262e504f (stale) Mirror 9: 0x262e504f (stale) Mirror 10: 0x262e504f (stale) Mirror 11: 0x262e504f (stale) Mirror 12: 0x262e504f (stale) Mirror 14: 0x262e504f (stale) Mirror 15: 0x262e504f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cb93: skipped 000256 1772472648.663155 read 0x025b91 thru 0x0293ac (0x381c bytes) 000257 1772472648.677155 trunc from 0x03cb93 to 0x009a49 (0x33149 bytes) 000258 1772472648.715840 fallocate 0x01f149 thru 0x01fa0d (0x8c5 bytes) 000259 1772472648.726335 trunc from 0x009a4a to 0x0371bd (0x2d774 bytes) 000260 1772472648.750137 write 0x03713f thru 0x03ffff (0x8ec1 bytes) 000261 1772472648.774428 MIRROR_RESYNC 8 mirrors 000262 1772472651.594111 write 0x00f123 thru 0x019c60 (0xab3e bytes) 000263 1772472651.644630 read 0x01c2cb thru 0x01e2de (0x2014 bytes) 000264 1772472651.653260 mapread 0x001698 thru 0x002684 (0xfed bytes) 000265 1772472651.664875 fallocate 0x03ba17 thru 0x03db6a (0x2154 bytes) 000268 1772472651.678249 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xbb9636be (stale) Mirror 10: 0xbb9636be (stale) Mirror 11: 0xbb9636be (stale) Mirror 12: 0xbb9636be (stale) Mirror 14: 0xbb9636be (stale) Mirror 15: 0xbb9636be (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xbb9636be (stale) Mirror 10: 0xbb9636be (stale) Mirror 11: 0xbb9636be (stale) Mirror 12: 0xbb9636be (stale) Mirror 14: 0xbb9636be (stale) Mirror 15: 0xbb9636be (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000269 1772472652.170360 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xbb9636be (stale) Mirror 10: 0xbb9636be (stale) Mirror 11: 0xbb9636be (stale) Mirror 12: 0xbb9636be (stale) Mirror 14: 0xbb9636be (stale) Mirror 15: 0xbb9636be (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe09f08fe Mirror 16: 0xe09f08fe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000270 1772472653.401354 trunc from 0x00a5ff to 0x011fa3 (0x79a5 bytes) 000271 1772472653.453811 mapwrite 0x039887 thru 0x0399e3 (0x15d bytes) 000272 1772472653.471970 mapread 0x033d73 thru 0x034bb4 (0xe42 bytes) 000273 1772472653.494776 trunc from 0x029cf7 to 0x0392d7 (0xf5e1 bytes) 000274 1772472653.501124 mapread 0x024e92 thru 0x02bf19 (0x7088 bytes) 000275 1772472653.522049 trunc from 0x02b87a to 0x02f906 (0x408d bytes) 000276 1772472653.529614 trunc from 0x0132ce to 0x0178ae (0x45e1 bytes) 000277 1772472653.537464 read 0x01c5d2 thru 0x02a305 (0xdd34 bytes) 000278 1772472653.544484 punch from 0x01fc45 to 0x020e4b (0x1207 bytes) 000279 1772472653.552605 punch from 0x008785 to 0x016885 (0xe101 bytes) 000281 1772472653.560881 trunc from 0x032087 to 0x039364 (0x72de bytes) 000282 1772472653.567035 write 0x03368d thru 0x038eeb (0x585f bytes) 000283 1772472653.587731 trunc from 0x040000 to 0x016053 (0x29fac bytes) 000284 1772472653.621873 trunc from 0x016054 to 0x00915c (0xcef7 bytes) 000286 1772472653.645760 write 0x003b7f thru 0x00b87b (0x7cfd bytes) 000287 1772472653.664298 MIRROR_RESYNC 8 mirrors 000288 1772472655.371662 MIRROR_EXTEND to 9 mirrors 000289 1772472656.352102 fallocate 0x000bce thru 0x004b00 (0x3f33 bytes) 000291 1772472656.512109 write 0x02ea90 thru 0x039201 (0xa772 bytes) 000292 1772472656.528426 trunc from 0x02578b to 0x02e56c (0x8de2 bytes) 000293 1772472656.570649 read 0x034e74 thru 0x039201 (0x438e bytes) 000294 1772472656.571695 write 0x0309a6 thru 0x033bfd (0x3258 bytes) 000296 1772472656.576638 write 0x02d667 thru 0x03216a (0x4b04 bytes) 000297 1772472656.593328 mapread 0x024887 thru 0x0329a2 (0xe11c bytes) 000298 1772472656.635916 punch from 0x031e89 to 0x039201 (0x7379 bytes) 000299 1772472656.662177 trunc from 0x035525 to 0x039201 (0x3cdd bytes) 000300 1772472656.676940 punch from 0x018921 to 0x026e8d (0xe56d bytes) 000301 1772472656.681898 fallocate 0x01299e thru 0x01914e (0x67b1 bytes) 000302 1772472656.689834 write 0x0093c9 thru 0x0151d2 (0xbe0a bytes) 000303 1772472656.711148 punch from 0x019a0f to 0x01e918 (0x4f0a bytes) 000304 1772472656.729223 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39202): Mirror 9: 0xb3eead01 (stale) Mirror 10: 0xb3eead01 (stale) Mirror 11: 0xb3eead01 (stale) Mirror 14: 0xb3eead01 (stale) Mirror 15: 0xb3eead01 (stale) Mirror 16: 0xb3eead01 (stale) Mirror 17: 0xb3eead01 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39202): Mirror 9: 0xb3eead01 (stale) Mirror 10: 0xb3eead01 (stale) Mirror 11: 0xb3eead01 (stale) Mirror 14: 0xb3eead01 (stale) Mirror 15: 0xb3eead01 (stale) Mirror 16: 0xb3eead01 (stale) Mirror 17: 0xb3eead01 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39202: skipped 000305 1772472657.443416 read 0x035bc4 thru 0x036d18 (0x1155 bytes) 000306 1772472657.456676 trunc from 0x039202 to 0x03b5b0 (0x23af bytes) 000307 1772472657.498267 write 0x0160f4 thru 0x01a1fa (0x4107 bytes) 000308 1772472657.517246 mapwrite 0x000b4b thru 0x005121 (0x45d7 bytes) 000309 1772472657.567659 fallocate 0x032200 thru 0x03261d (0x41e bytes) 000310 1772472657.577673 read 0x0284c4 thru 0x0284fa (0x37 bytes) 000311 1772472657.602212 MIRROR_RESYNC 8 mirrors 000312 1772472659.629526 trunc from 0x030c07 to 0x039677 (0x8a71 bytes) 000313 1772472659.681053 write 0x03f62c thru 0x03ffff (0x9d4 bytes) 000314 1772472659.684082 mapread 0x02fa63 thru 0x0356e7 (0x5c85 bytes) 000315 1772472659.707360 punch from 0x028fea to 0x034600 (0xb617 bytes) 000317 1772472659.719545 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x1573d410 (stale) Mirror 10: 0x1573d410 (stale) Mirror 11: 0x1573d410 (stale) Mirror 14: 0x1573d410 (stale) Mirror 15: 0x1573d410 (stale) Mirror 16: 0x1573d410 (stale) Mirror 17: 0x1573d410 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7a2c3fdd Mirror 18: 0x7a2c3fdd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000318 1772472660.770162 write 0x005473 thru 0x00a97b (0x5509 bytes) 000319 1772472660.853033 mapread 0x0140fc thru 0x022f8c (0xee91 bytes) 000321 1772472660.879230 trunc from 0x040000 to 0x016fa4 (0x2905b bytes) 000322 1772472660.926376 mapwrite 0x026248 thru 0x02d189 (0x6f42 bytes) 000323 1772472660.986481 trunc from 0x02d18a to 0x004fe7 (0x281a2 bytes) 000324 1772472661.005982 trunc from 0x004fe8 to 0x00d311 (0x832a bytes) 000325 1772472661.027762 fallocate 0x00ed5d thru 0x011c52 (0x2ef6 bytes) 000326 1772472661.033519 mapwrite 0x02bd37 thru 0x033722 (0x79ec bytes) 000327 1772472661.077139 punch from 0x029209 to 0x033722 (0xa51a bytes) 000329 1772472661.085479 read 0x006234 thru 0x010194 (0x9f61 bytes) 000330 1772472661.096194 write 0x000b49 thru 0x005a88 (0x4f40 bytes) 000331 1772472661.107374 write 0x01e955 thru 0x02a2c8 (0xb974 bytes) 000332 1772472661.122713 fallocate 0x033a68 thru 0x03ec01 (0xb19a bytes) 000333 1772472661.129287 fallocate 0x01090a thru 0x019d08 (0x93ff bytes) 000334 1772472661.153847 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33723): Mirror 10: 0x69394332 (stale) Mirror 11: 0x69394332 (stale) Mirror 14: 0x69394332 (stale) Mirror 15: 0x69394332 (stale) Mirror 16: 0x69394332 (stale) Mirror 17: 0x69394332 (stale) Mirror 18: 0x32bb6bde (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33723): Mirror 10: 0x69394332 (stale) Mirror 11: 0x69394332 (stale) Mirror 14: 0x69394332 (stale) Mirror 15: 0x69394332 (stale) Mirror 16: 0x69394332 (stale) Mirror 17: 0x69394332 (stale) Mirror 18: 0x32bb6bde (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33723: skipped 000335 1772472662.073014 read 0x032046 thru 0x033722 (0x16dd bytes) 000336 1772472662.083197 trunc from 0x033723 to 0x026aac (0xcc76 bytes) 000337 1772472662.119248 trunc from 0x026aad to 0x03c0ed (0x15641 bytes) 000338 1772472662.160485 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c0ee): Mirror 10: 0x33857efb (stale) Mirror 11: 0x33857efb (stale) Mirror 14: 0x33857efb (stale) Mirror 15: 0x33857efb (stale) Mirror 16: 0x33857efb (stale) Mirror 17: 0x33857efb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c0ee): Mirror 10: 0x33857efb (stale) Mirror 11: 0x33857efb (stale) Mirror 14: 0x33857efb (stale) Mirror 15: 0x33857efb (stale) Mirror 16: 0x33857efb (stale) Mirror 17: 0x33857efb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c0ee: skipped 000340 1772472662.738228 fallocate 0x00f241 thru 0x01516d (0x5f2d bytes) 000341 1772472662.743462 trunc from 0x00101a to 0x00744e (0x6435 bytes) 000343 1772472662.749502 write 0x01e094 thru 0x01ffd0 (0x1f3d bytes) 000344 1772472662.763809 trunc from 0x03c0ee to 0x02239d (0x19d50 bytes) 000345 1772472662.790626 trunc from 0x02239e to 0x004b8d (0x1d810 bytes) 000347 1772472662.812276 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x4b8e): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4b8e): Mirror 10: 0xfba3136d (stale) Mirror 11: 0xfba3136d (stale) Mirror 14: 0xfba3136d (stale) Mirror 15: 0xfba3136d (stale) Mirror 16: 0xfba3136d (stale) Mirror 17: 0xfba3136d (stale) CRC-32 checksum value for chunk [0, 0x4b8e): Mirror 1: 0xeb928de1 Mirror 18: 0xeb928de1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4b8e: skipped 000348 1772472663.673597 read 0x001e22 thru 0x004b8d (0x2d6c bytes) 000349 1772472663.702139 read 0x000d9e thru 0x004549 (0x37ac bytes) 000350 1772472663.735814 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x4b8e): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4b8e): Mirror 10: 0xfba3136d (stale) Mirror 11: 0xfba3136d (stale) Mirror 14: 0xfba3136d (stale) Mirror 15: 0xfba3136d (stale) Mirror 16: 0xfba3136d (stale) Mirror 17: 0xfba3136d (stale) CRC-32 checksum value for chunk [0, 0x4b8e): Mirror 1: 0xeb928de1 Mirror 18: 0xeb928de1 Mirror 19: 0xeb928de1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4b8e: skipped 000351 1772472664.722026 fallocate 0x0284f6 thru 0x02d988 (0x5493 bytes) 000352 1772472664.802971 fallocate 0x01237a thru 0x01f0ad (0xcd34 bytes) 000354 1772472664.819053 punch from 0x013467 to 0x01f2c4 (0xbe5e bytes) 000355 1772472664.828663 punch from 0x00bd22 to 0x015fc5 (0xa2a4 bytes) 000356 1772472664.844378 MIRROR_RESYNC 9 mirrors 000357 1772472666.215419 read 0x01dd3f thru 0x029886 (0xbb48 bytes) 000358 1772472666.236388 trunc from 0x01ce51 to 0x01df52 (0x1102 bytes) 000360 1772472666.336714 trunc from 0x002e9c to 0x005994 (0x2af9 bytes) 000361 1772472666.352516 trunc from 0x02d989 to 0x01753f (0x16449 bytes) 000362 1772472666.401727 trunc from 0x00b9a2 to 0x0111d2 (0x5831 bytes) 000363 1772472666.415920 punch from 0x0049c0 to 0x006d58 (0x2399 bytes) 000364 1772472666.432051 MIRROR_RESYNC 9 mirrors 000365 1772472668.066599 mapwrite 0x011c03 thru 0x017bf3 (0x5ff1 bytes) 000366 1772472668.214827 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x17bf4): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17bf4): Mirror 10: 0xf2aae2ba (stale) Mirror 11: 0xf2aae2ba (stale) Mirror 14: 0xf2aae2ba (stale) Mirror 15: 0xf2aae2ba (stale) Mirror 16: 0xf2aae2ba (stale) Mirror 17: 0xf2aae2ba (stale) Mirror 18: 0xf2aae2ba (stale) Mirror 19: 0xf2aae2ba (stale) CRC-32 checksum value for chunk [0, 0x17bf4): Mirror 1: 0xd2f7813a Mirror 20: 0xd2f7813a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17bf4: skipped 000367 1772472669.257598 mapread 0x004dc8 thru 0x010185 (0xb3be bytes) 000368 1772472669.303695 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x17bf4): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17bf4): Mirror 10: 0xf2aae2ba (stale) Mirror 11: 0xf2aae2ba (stale) Mirror 14: 0xf2aae2ba (stale) Mirror 15: 0xf2aae2ba (stale) Mirror 16: 0xf2aae2ba (stale) Mirror 17: 0xf2aae2ba (stale) Mirror 18: 0xf2aae2ba (stale) Mirror 19: 0xf2aae2ba (stale) CRC-32 checksum value for chunk [0, 0x17bf4): Mirror 1: 0xd2f7813a Mirror 20: 0xd2f7813a Mirror 21: 0xd2f7813a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17bf4: skipped 000369 1772472670.623541 punch from 0x0097d6 to 0x0149dd (0xb208 bytes) 000371 1772472670.688429 trunc from 0x00fe45 to 0x013e98 (0x4054 bytes) 000372 1772472670.696653 trunc from 0x016275 to 0x017bf3 (0x197f bytes) 000373 1772472670.706042 write 0x032fd0 thru 0x03d35c (0xa38d bytes) 000374 1772472670.713467 mapread 0x03248a thru 0x039605 (0x717c bytes) 000375 1772472670.716217 trunc from 0x00e854 to 0x01c4cc (0xdc79 bytes) 000376 1772472670.723881 mapread 0x01bbd3 thru 0x01c42c (0x85a bytes) 000377 1772472670.741412 punch from 0x02014b to 0x02f12c (0xefe2 bytes) 000378 1772472670.747069 mapwrite 0x01bb4b thru 0x026111 (0xa5c7 bytes) 000380 1772472670.815828 mapwrite 0x022338 thru 0x0229ad (0x676 bytes) 000382 1772472670.846323 trunc from 0x01669e to 0x01672c (0x8f bytes) 000384 1772472670.854322 trunc from 0x0373f8 to 0x03d35c (0x5f65 bytes) 000385 1772472670.865209 write 0x03d14e thru 0x03ffff (0x2eb2 bytes) 000387 1772472670.913054 mapwrite 0x02ac15 thru 0x02bcd4 (0x10c0 bytes) 000388 1772472670.965758 mapread 0x023764 thru 0x02a580 (0x6e1d bytes) 000389 1772472670.969016 trunc from 0x0077db to 0x0143ee (0xcc14 bytes) 000390 1772472670.994176 fallocate 0x014e10 thru 0x01ebab (0x9d9c bytes) 000391 1772472671.018941 fallocate 0x009911 thru 0x00ed21 (0x5411 bytes) 000393 1772472671.030854 mapread 0x01ba52 thru 0x01cc6e (0x121d bytes) 000394 1772472671.033875 trunc from 0x029e91 to 0x03180b (0x797b bytes) 000395 1772472671.039941 mapwrite 0x037125 thru 0x03880d (0x16e9 bytes) 000396 1772472671.083665 fallocate 0x0397b9 thru 0x03ffff (0x6847 bytes) 000398 1772472671.105115 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xaa669f5a (stale) Mirror 11: 0xaa669f5a (stale) Mirror 14: 0xaa669f5a (stale) Mirror 15: 0xaa669f5a (stale) Mirror 16: 0xaa669f5a (stale) Mirror 17: 0xaa669f5a (stale) Mirror 18: 0xaa669f5a (stale) Mirror 19: 0xaa669f5a (stale) Mirror 20: 0x563786b9 (stale) Mirror 21: 0x563786b9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3a15022c Mirror 22: 0x3a15022c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000399 1772472672.612982 trunc from 0x040000 to 0x035ffc (0xa003 bytes) 000401 1772472672.747868 write 0x01a505 thru 0x01f490 (0x4f8c bytes) 000402 1772472672.762160 MIRROR_SPLIT mirror 5 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35ffd): Mirror 10: 0xf7b829df (stale) Mirror 11: 0xf7b829df (stale) Mirror 14: 0xf7b829df (stale) Mirror 15: 0xf7b829df (stale) Mirror 17: 0xf7b829df (stale) Mirror 18: 0xf7b829df (stale) Mirror 19: 0xf7b829df (stale) Mirror 20: 0xdf9e3513 (stale) Mirror 21: 0xdf9e3513 (stale) Mirror 22: 0x44faf983 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35ffd): Mirror 10: 0xf7b829df (stale) Mirror 11: 0xf7b829df (stale) Mirror 14: 0xf7b829df (stale) Mirror 15: 0xf7b829df (stale) Mirror 17: 0xf7b829df (stale) Mirror 18: 0xf7b829df (stale) Mirror 19: 0xf7b829df (stale) Mirror 20: 0xdf9e3513 (stale) Mirror 21: 0xdf9e3513 (stale) Mirror 22: 0x44faf983 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35ffd: skipped 000404 1772472673.587506 trunc from 0x035ffd to 0x027b52 (0xe4aa bytes) 000406 1772472673.628593 trunc from 0x01f8c6 to 0x025b05 (0x6240 bytes) 000407 1772472673.636180 read 0x002e3f thru 0x01002d (0xd1ef bytes) 000408 1772472673.666366 read 0x005a02 thru 0x00f63d (0x9c3c bytes) 000409 1772472673.667315 trunc from 0x027b53 to 0x034284 (0xc732 bytes) 000410 1772472673.697064 read 0x02446d thru 0x02e8b6 (0xa44a bytes) 000411 1772472673.736693 read 0x02e083 thru 0x034284 (0x6202 bytes) 000413 1772472673.738394 trunc from 0x034285 to 0x035815 (0x1591 bytes) 000414 1772472673.770593 mapwrite 0x02bd88 thru 0x031878 (0x5af1 bytes) 000415 1772472673.786706 fallocate 0x008319 thru 0x010439 (0x8121 bytes) 000416 1772472673.790622 fallocate 0x022ad6 thru 0x027c5e (0x5189 bytes) 000417 1772472673.794530 fallocate 0x012f41 thru 0x017fcd (0x508d bytes) 000419 1772472673.810439 mapread 0x011c68 thru 0x0127d5 (0xb6e bytes) 000420 1772472673.813750 read 0x0157b4 thru 0x01795e (0x21ab bytes) 000421 1772472673.814934 read 0x028399 thru 0x02cc58 (0x48c0 bytes) 000423 1772472673.820983 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x35816): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35816): Mirror 10: 0x2f92bbb9 (stale) Mirror 11: 0x2f92bbb9 (stale) Mirror 14: 0x2f92bbb9 (stale) Mirror 15: 0x2f92bbb9 (stale) Mirror 17: 0x2f92bbb9 (stale) Mirror 18: 0x2f92bbb9 (stale) Mirror 19: 0x2f92bbb9 (stale) Mirror 20: 0x97f7d1eb (stale) Mirror 21: 0x97f7d1eb (stale) Mirror 22: 0x6543cfc1 (stale) CRC-32 checksum value for chunk [0, 0x35816): Mirror 1: 0x9b435244 Mirror 23: 0x9b435244 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35816: skipped 000424 1772472675.036502 trunc from 0x01bee6 to 0x022e89 (0x6fa4 bytes) 000425 1772472675.115134 punch from 0x00ba93 to 0x01a58c (0xeafa bytes) 000426 1772472675.129647 punch from 0x02c03c to 0x034006 (0x7fcb bytes) 000427 1772472675.142838 trunc from 0x035816 to 0x00aa56 (0x2adbf bytes) 000428 1772472675.209092 fallocate 0x016a19 thru 0x01f5cc (0x8bb4 bytes) 000429 1772472675.217106 write 0x03a2e5 thru 0x03ffff (0x5d1b bytes) 000430 1772472675.222160 punch from 0x03479c to 0x034d19 (0x57e bytes) 000431 1772472675.232317 write 0x0032e8 thru 0x006c2b (0x3944 bytes) 000433 1772472675.267775 read 0x030c4a thru 0x033b60 (0x2f17 bytes) 000434 1772472675.276241 mapread 0x0389e0 thru 0x03ffff (0x7620 bytes) 000435 1772472675.301400 trunc from 0x02a696 to 0x02f9f5 (0x5360 bytes) 000436 1772472675.310029 punch from 0x0149f9 to 0x01b74a (0x6d52 bytes) 000438 1772472675.326844 MIRROR_RESYNC 12 mirrors 000439 1772472678.637849 MIRROR_EXTEND to 13 mirrors 000440 1772472679.683459 mapwrite 0x00901b thru 0x018199 (0xf17f bytes) 000441 1772472679.904181 mapwrite 0x02fce8 thru 0x038e79 (0x9192 bytes) 000442 1772472679.973470 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x332a04f3 (stale) Mirror 11: 0x332a04f3 (stale) Mirror 14: 0x332a04f3 (stale) Mirror 15: 0x332a04f3 (stale) Mirror 17: 0x332a04f3 (stale) Mirror 18: 0x332a04f3 (stale) Mirror 19: 0x332a04f3 (stale) Mirror 20: 0x332a04f3 (stale) Mirror 21: 0x332a04f3 (stale) Mirror 22: 0x332a04f3 (stale) Mirror 23: 0x332a04f3 (stale) Mirror 24: 0x332a04f3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbccf7cc Mirror 25: 0xbccf7cc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000443 1772472681.520153 mapread 0x029237 thru 0x030653 (0x741d bytes) 000444 1772472681.558320 trunc from 0x017534 to 0x0181bb (0xc88 bytes) 000445 1772472681.615739 mapwrite 0x000329 thru 0x00ab51 (0xa829 bytes) 000446 1772472681.645043 trunc from 0x00ff9c to 0x015595 (0x55fa bytes) 000447 1772472681.649417 trunc from 0x040000 to 0x00ff65 (0x3009a bytes) 000448 1772472681.678197 mapread 0x00b3f8 thru 0x00ff65 (0x4b6e bytes) 000449 1772472681.694139 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0xff66): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xff66): Mirror 10: 0x216d661b (stale) Mirror 11: 0x216d661b (stale) Mirror 14: 0x216d661b (stale) Mirror 15: 0x216d661b (stale) Mirror 17: 0x216d661b (stale) Mirror 18: 0x216d661b (stale) Mirror 19: 0x216d661b (stale) Mirror 20: 0x216d661b (stale) Mirror 21: 0x216d661b (stale) Mirror 22: 0x216d661b (stale) Mirror 23: 0x216d661b (stale) Mirror 24: 0x216d661b (stale) Mirror 25: 0x4e62d3a0 (stale) CRC-32 checksum value for chunk [0, 0xff66): Mirror 1: 0x9832213b Mirror 26: 0x9832213b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xff66: skipped 000450 1772472682.979552 trunc from 0x00a482 to 0x00ff65 (0x5ae4 bytes) 000451 1772472683.052490 read 0x00f962 thru 0x00ff65 (0x604 bytes) 000452 1772472683.061517 fallocate 0x00cb2d thru 0x016085 (0x9559 bytes) 000453 1772472683.071313 mapwrite 0x037386 thru 0x039e91 (0x2b0c bytes) 000454 1772472683.251545 punch from 0x00af70 to 0x017e36 (0xcec7 bytes) 000456 1772472683.261508 punch from 0x00cb4e to 0x00e239 (0x16ec bytes) 000457 1772472683.269845 write 0x0363ec thru 0x03a80c (0x4421 bytes) 000458 1772472683.275366 mapwrite 0x0032eb thru 0x004753 (0x1469 bytes) 000459 1772472683.315735 trunc from 0x033643 to 0x03a80c (0x71ca bytes) 000460 1772472683.328005 mapread 0x0113e2 thru 0x01d444 (0xc063 bytes) 000461 1772472683.359809 trunc from 0x00a763 to 0x012c6a (0x8508 bytes) 000462 1772472683.365960 mapread 0x02ad07 thru 0x031232 (0x652c bytes) 000463 1772472683.380220 punch from 0x001629 to 0x00eece (0xd8a6 bytes) 000464 1772472683.394501 MIRROR_RESYNC 15 mirrors 000465 1772472686.948651 mapwrite 0x039684 thru 0x03ee1f (0x579c bytes) 000466 1772472687.107841 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x3ee20): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ee20): Mirror 10: 0x6ccf0494 (stale) Mirror 11: 0x6ccf0494 (stale) Mirror 14: 0x6ccf0494 (stale) Mirror 15: 0x6ccf0494 (stale) Mirror 17: 0x6ccf0494 (stale) Mirror 18: 0x6ccf0494 (stale) Mirror 19: 0x6ccf0494 (stale) Mirror 20: 0x6ccf0494 (stale) Mirror 21: 0x6ccf0494 (stale) Mirror 22: 0x6ccf0494 (stale) Mirror 23: 0x6ccf0494 (stale) Mirror 24: 0x6ccf0494 (stale) Mirror 25: 0x6ccf0494 (stale) Mirror 26: 0x6ccf0494 (stale) CRC-32 checksum value for chunk [0, 0x3ee20): Mirror 1: 0xf1190fd3 Mirror 27: 0xf1190fd3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ee20: skipped 000467 1772472688.399245 punch from 0x00d70b to 0x01335e (0x5c54 bytes) 000469 1772472688.502878 read 0x020756 thru 0x026820 (0x60cb bytes) 000470 1772472688.526453 mapread 0x0018f8 thru 0x00c403 (0xab0c bytes) 000472 1772472688.588525 write 0x022926 thru 0x024a18 (0x20f3 bytes) 000473 1772472688.598407 punch from 0x018af5 to 0x01fd18 (0x7224 bytes) 000474 1772472688.614818 trunc from 0x02135f to 0x025220 (0x3ec2 bytes) 000475 1772472688.647252 trunc from 0x030fef to 0x031b77 (0xb89 bytes) 000476 1772472688.659250 punch from 0x02b381 to 0x0389c8 (0xd648 bytes) 000477 1772472688.665329 write 0x02803a thru 0x035c7d (0xdc44 bytes) 000479 1772472688.682406 mapwrite 0x017897 thru 0x01a4fa (0x2c64 bytes) 000480 1772472688.742208 read 0x01cb35 thru 0x022a23 (0x5eef bytes) 000481 1772472688.743748 fallocate 0x03720f thru 0x03977f (0x2571 bytes) 000482 1772472688.758925 MIRROR_SPLIT mirror 15 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ee20): Mirror 10: 0x6ccf0494 (stale) Mirror 11: 0x6ccf0494 (stale) Mirror 14: 0x6ccf0494 (stale) Mirror 15: 0x6ccf0494 (stale) Mirror 17: 0x6ccf0494 (stale) Mirror 18: 0x6ccf0494 (stale) Mirror 19: 0x6ccf0494 (stale) Mirror 20: 0x6ccf0494 (stale) Mirror 21: 0x6ccf0494 (stale) Mirror 22: 0x6ccf0494 (stale) Mirror 23: 0x6ccf0494 (stale) Mirror 24: 0x6ccf0494 (stale) Mirror 25: 0x6ccf0494 (stale) Mirror 26: 0x6ccf0494 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ee20): Mirror 10: 0x6ccf0494 (stale) Mirror 11: 0x6ccf0494 (stale) Mirror 14: 0x6ccf0494 (stale) Mirror 15: 0x6ccf0494 (stale) Mirror 17: 0x6ccf0494 (stale) Mirror 18: 0x6ccf0494 (stale) Mirror 19: 0x6ccf0494 (stale) Mirror 20: 0x6ccf0494 (stale) Mirror 21: 0x6ccf0494 (stale) Mirror 22: 0x6ccf0494 (stale) Mirror 23: 0x6ccf0494 (stale) Mirror 24: 0x6ccf0494 (stale) Mirror 25: 0x6ccf0494 (stale) Mirror 26: 0x6ccf0494 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ee20: skipped 000483 1772472689.616860 fallocate 0x031336 thru 0x036f9a (0x5c65 bytes) 000484 1772472689.628520 MIRROR_SPLIT mirror 1 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ee20): Mirror 11: 0x6ccf0494 (stale) Mirror 14: 0x6ccf0494 (stale) Mirror 15: 0x6ccf0494 (stale) Mirror 17: 0x6ccf0494 (stale) Mirror 18: 0x6ccf0494 (stale) Mirror 19: 0x6ccf0494 (stale) Mirror 20: 0x6ccf0494 (stale) Mirror 21: 0x6ccf0494 (stale) Mirror 22: 0x6ccf0494 (stale) Mirror 23: 0x6ccf0494 (stale) Mirror 24: 0x6ccf0494 (stale) Mirror 25: 0x6ccf0494 (stale) Mirror 26: 0x6ccf0494 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ee20): Mirror 11: 0x6ccf0494 (stale) Mirror 14: 0x6ccf0494 (stale) Mirror 15: 0x6ccf0494 (stale) Mirror 17: 0x6ccf0494 (stale) Mirror 18: 0x6ccf0494 (stale) Mirror 19: 0x6ccf0494 (stale) Mirror 20: 0x6ccf0494 (stale) Mirror 21: 0x6ccf0494 (stale) Mirror 22: 0x6ccf0494 (stale) Mirror 23: 0x6ccf0494 (stale) Mirror 24: 0x6ccf0494 (stale) Mirror 25: 0x6ccf0494 (stale) Mirror 26: 0x6ccf0494 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ee20: skipped 000485 1772472690.907173 read 0x0344c1 thru 0x03ee1f (0xa95f bytes) 000486 1772472690.932818 mapwrite 0x01d204 thru 0x02c052 (0xee4f bytes) 000487 1772472691.061801 punch from 0x00742c to 0x00c8ed (0x54c2 bytes) 000488 1772472691.067037 fallocate 0x01c0d8 thru 0x0230fd (0x7026 bytes) 000489 1772472691.073207 fallocate 0x00e807 thru 0x01658a (0x7d84 bytes) 000490 1772472691.080066 trunc from 0x03ee20 to 0x03375f (0xb6c0 bytes) 000491 1772472691.137325 mapwrite 0x00c3aa thru 0x00e43a (0x2091 bytes) 000492 1772472691.165835 read 0x032091 thru 0x03375f (0x16cf bytes) 000493 1772472691.176670 trunc from 0x02afdd to 0x02c97e (0x19a2 bytes) 000494 1772472691.182475 read 0x010911 thru 0x015e66 (0x5556 bytes) 000495 1772472691.183902 punch from 0x02955a to 0x03375f (0xa206 bytes) 000496 1772472691.190969 punch from 0x012442 to 0x018a9a (0x6659 bytes) 000497 1772472691.195805 punch from 0x00bfef to 0x00e646 (0x2658 bytes) 000498 1772472691.203238 write 0x03c646 thru 0x03ffff (0x39ba bytes) 000499 1772472691.210340 read 0x00d48e thru 0x016bf0 (0x9763 bytes) 000500 1772472691.232970 mapwrite 0x02eac4 thru 0x034980 (0x5ebd bytes) 000501 1772472691.256321 trunc from 0x040000 to 0x036620 (0x99df bytes) 000502 1772472691.275533 mapread 0x00f1d7 thru 0x017d3a (0x8b64 bytes) 000504 1772472691.277371 write 0x008bef thru 0x00ce6d (0x427f bytes) 000505 1772472691.286112 MIRROR_SPLIT mirror 13 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36621): Mirror 11: 0xcd2d6b6c (stale) Mirror 14: 0xcd2d6b6c (stale) Mirror 15: 0xcd2d6b6c (stale) Mirror 17: 0xcd2d6b6c (stale) Mirror 18: 0xcd2d6b6c (stale) Mirror 19: 0xcd2d6b6c (stale) Mirror 20: 0xcd2d6b6c (stale) Mirror 21: 0xcd2d6b6c (stale) Mirror 22: 0xcd2d6b6c (stale) Mirror 23: 0xcd2d6b6c (stale) Mirror 24: 0xcd2d6b6c (stale) Mirror 25: 0xcd2d6b6c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36621): Mirror 11: 0xcd2d6b6c (stale) Mirror 14: 0xcd2d6b6c (stale) Mirror 15: 0xcd2d6b6c (stale) Mirror 17: 0xcd2d6b6c (stale) Mirror 18: 0xcd2d6b6c (stale) Mirror 19: 0xcd2d6b6c (stale) Mirror 20: 0xcd2d6b6c (stale) Mirror 21: 0xcd2d6b6c (stale) Mirror 22: 0xcd2d6b6c (stale) Mirror 23: 0xcd2d6b6c (stale) Mirror 24: 0xcd2d6b6c (stale) Mirror 25: 0xcd2d6b6c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36621: skipped 000506 1772472692.274180 mapread 0x01f4b0 thru 0x0294c0 (0xa011 bytes) 000507 1772472692.318187 mapread 0x0200c7 thru 0x02c0b1 (0xbfeb bytes) 000508 1772472692.333298 read 0x01ef0b thru 0x02414d (0x5243 bytes) 000509 1772472692.336832 trunc from 0x01b202 to 0x0202c8 (0x50c7 bytes) 000510 1772472692.351355 mapwrite 0x009092 thru 0x00e0bc (0x502b bytes) 000511 1772472692.416776 trunc from 0x000778 to 0x00f0c1 (0xe94a bytes) 000512 1772472692.439847 trunc from 0x036621 to 0x03548d (0x1193 bytes) 000514 1772472692.459706 punch from 0x000ff8 to 0x004634 (0x363d bytes) 000515 1772472692.474844 mapread 0x009e49 thru 0x00eb67 (0x4d1f bytes) 000516 1772472692.512114 MIRROR_SPLIT mirror 5 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3548e): Mirror 11: 0xcbb8e0cc (stale) Mirror 14: 0xcbb8e0cc (stale) Mirror 15: 0xcbb8e0cc (stale) Mirror 17: 0xcbb8e0cc (stale) Mirror 19: 0xcbb8e0cc (stale) Mirror 20: 0xcbb8e0cc (stale) Mirror 21: 0xcbb8e0cc (stale) Mirror 22: 0xcbb8e0cc (stale) Mirror 23: 0xcbb8e0cc (stale) Mirror 24: 0xcbb8e0cc (stale) Mirror 25: 0xcbb8e0cc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3548e): Mirror 11: 0xcbb8e0cc (stale) Mirror 14: 0xcbb8e0cc (stale) Mirror 15: 0xcbb8e0cc (stale) Mirror 17: 0xcbb8e0cc (stale) Mirror 19: 0xcbb8e0cc (stale) Mirror 20: 0xcbb8e0cc (stale) Mirror 21: 0xcbb8e0cc (stale) Mirror 22: 0xcbb8e0cc (stale) Mirror 23: 0xcbb8e0cc (stale) Mirror 24: 0xcbb8e0cc (stale) Mirror 25: 0xcbb8e0cc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3548e: skipped 000517 1772472693.426362 MIRROR_SPLIT mirror 9 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3548e): Mirror 11: 0xcbb8e0cc (stale) Mirror 14: 0xcbb8e0cc (stale) Mirror 15: 0xcbb8e0cc (stale) Mirror 17: 0xcbb8e0cc (stale) Mirror 19: 0xcbb8e0cc (stale) Mirror 20: 0xcbb8e0cc (stale) Mirror 21: 0xcbb8e0cc (stale) Mirror 22: 0xcbb8e0cc (stale) Mirror 24: 0xcbb8e0cc (stale) Mirror 25: 0xcbb8e0cc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3548e): Mirror 11: 0xcbb8e0cc (stale) Mirror 14: 0xcbb8e0cc (stale) Mirror 15: 0xcbb8e0cc (stale) Mirror 17: 0xcbb8e0cc (stale) Mirror 19: 0xcbb8e0cc (stale) Mirror 20: 0xcbb8e0cc (stale) Mirror 21: 0xcbb8e0cc (stale) Mirror 22: 0xcbb8e0cc (stale) Mirror 24: 0xcbb8e0cc (stale) Mirror 25: 0xcbb8e0cc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3548e: skipped 000518 1772472694.242659 mapwrite 0x01f5d6 thru 0x020eec (0x1917 bytes) 000519 1772472694.268552 write 0x01217c thru 0x019a9c (0x7921 bytes) 000520 1772472694.282535 trunc from 0x03161b to 0x03548d (0x3e73 bytes) 000521 1772472694.294477 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3548e): Mirror 11: 0xcbb8e0cc (stale) Mirror 14: 0xcbb8e0cc (stale) Mirror 17: 0xcbb8e0cc (stale) Mirror 19: 0xcbb8e0cc (stale) Mirror 20: 0xcbb8e0cc (stale) Mirror 21: 0xcbb8e0cc (stale) Mirror 22: 0xcbb8e0cc (stale) Mirror 24: 0xcbb8e0cc (stale) Mirror 25: 0xcbb8e0cc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3548e): Mirror 11: 0xcbb8e0cc (stale) Mirror 14: 0xcbb8e0cc (stale) Mirror 17: 0xcbb8e0cc (stale) Mirror 19: 0xcbb8e0cc (stale) Mirror 20: 0xcbb8e0cc (stale) Mirror 21: 0xcbb8e0cc (stale) Mirror 22: 0xcbb8e0cc (stale) Mirror 24: 0xcbb8e0cc (stale) Mirror 25: 0xcbb8e0cc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3548e: skipped 000522 1772472695.347756 punch from 0x000a82 to 0x00954b (0x8aca bytes) 000524 1772472695.356180 mapread 0x01f7ed thru 0x02a72d (0xaf41 bytes) 000525 1772472695.408043 mapread 0x00f539 thru 0x0164c7 (0x6f8f bytes) 000526 1772472695.421425 write 0x005b94 thru 0x00e7c6 (0x8c33 bytes) 000527 1772472695.450189 mapwrite 0x03f066 thru 0x03ffff (0xf9a bytes) 000528 1772472695.522142 mapwrite 0x00b2ff thru 0x0145a1 (0x92a3 bytes) 000529 1772472695.545132 write 0x034fb7 thru 0x038c6b (0x3cb5 bytes) 000530 1772472695.555975 mapwrite 0x014a56 thru 0x01d3cf (0x897a bytes) 000531 1772472695.592314 trunc from 0x02fdc9 to 0x032ad9 (0x2d11 bytes) 000532 1772472695.604439 fallocate 0x033eaf thru 0x034d7a (0xecc bytes) 000533 1772472695.610329 fallocate 0x00a604 thru 0x00d941 (0x333e bytes) 000534 1772472695.617072 read 0x01496a thru 0x01c3b5 (0x7a4c bytes) 000535 1772472695.618766 punch from 0x006dab to 0x014646 (0xd89c bytes) 000536 1772472695.630199 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x4b3e71b5 (stale) Mirror 14: 0x4b3e71b5 (stale) Mirror 17: 0x4b3e71b5 (stale) Mirror 19: 0x4b3e71b5 (stale) Mirror 20: 0x4b3e71b5 (stale) Mirror 21: 0x4b3e71b5 (stale) Mirror 22: 0x4b3e71b5 (stale) Mirror 25: 0x4b3e71b5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x4b3e71b5 (stale) Mirror 14: 0x4b3e71b5 (stale) Mirror 17: 0x4b3e71b5 (stale) Mirror 19: 0x4b3e71b5 (stale) Mirror 20: 0x4b3e71b5 (stale) Mirror 21: 0x4b3e71b5 (stale) Mirror 22: 0x4b3e71b5 (stale) Mirror 25: 0x4b3e71b5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000537 1772472696.337241 punch from 0x00345d to 0x01229d (0xee41 bytes) 000539 1772472696.347004 mapread 0x0000a9 thru 0x007f27 (0x7e7f bytes) 000540 1772472696.380802 read 0x025e2c thru 0x02f2fe (0x94d3 bytes) 000541 1772472696.398887 trunc from 0x040000 to 0x03abc0 (0x543f bytes) 000542 1772472696.425103 fallocate 0x03fdd7 thru 0x03ffff (0x229 bytes) 000543 1772472696.432349 read 0x00f93c thru 0x01eb2a (0xf1ef bytes) 000544 1772472696.447791 write 0x00d925 thru 0x01436a (0x6a46 bytes) 000545 1772472696.450169 trunc from 0x03abc1 to 0x000978 (0x3a248 bytes) 000546 1772472696.472882 trunc from 0x000979 to 0x0153da (0x14a62 bytes) 000548 1772472696.496508 trunc from 0x0153db to 0x03a06c (0x24c92 bytes) 000550 1772472696.524305 fallocate 0x022859 thru 0x028393 (0x5b3b bytes) 000551 1772472696.531108 punch from 0x01b6b3 to 0x01efad (0x38fb bytes) 000552 1772472696.540937 read 0x00336c thru 0x00e588 (0xb21d bytes) 000553 1772472696.556175 mapwrite 0x001974 thru 0x002bea (0x1277 bytes) 000554 1772472696.569442 mapread 0x012e00 thru 0x01ba77 (0x8c78 bytes) 000555 1772472696.571327 mapwrite 0x00bb4d thru 0x0102d7 (0x478b bytes) 000556 1772472696.591196 trunc from 0x0106df to 0x014a9b (0x43bd bytes) 000557 1772472696.599619 mapread 0x0244e5 thru 0x02d9b9 (0x94d5 bytes) 000558 1772472696.601215 trunc from 0x03a06d to 0x0163ae (0x23cbe bytes) 000559 1772472696.632482 trunc from 0x0163af to 0x002933 (0x13a7b bytes) 000560 1772472696.663959 mapread 0x001e91 thru 0x002933 (0xaa3 bytes) 000561 1772472696.665291 mapwrite 0x03fe30 thru 0x03ffff (0x1d0 bytes) 000562 1772472696.715214 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x4b3e71b5 (stale) Mirror 14: 0x4b3e71b5 (stale) Mirror 17: 0x4b3e71b5 (stale) Mirror 19: 0x4b3e71b5 (stale) Mirror 20: 0x4b3e71b5 (stale) Mirror 21: 0x4b3e71b5 (stale) Mirror 25: 0x4b3e71b5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x4b3e71b5 (stale) Mirror 14: 0x4b3e71b5 (stale) Mirror 17: 0x4b3e71b5 (stale) Mirror 19: 0x4b3e71b5 (stale) Mirror 20: 0x4b3e71b5 (stale) Mirror 21: 0x4b3e71b5 (stale) Mirror 25: 0x4b3e71b5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000563 1772472697.363548 trunc from 0x040000 to 0x00c45a (0x33ba5 bytes) 000564 1772472697.396710 trunc from 0x00c45b to 0x0275a6 (0x1b14c bytes) 000565 1772472697.420475 read 0x0155bb thru 0x01f857 (0xa29d bytes) 000566 1772472697.435833 punch from 0x00b3ae to 0x00c168 (0xdbb bytes) 000567 1772472697.441960 mapwrite 0x016201 thru 0x019d65 (0x3b65 bytes) 000568 1772472697.463277 fallocate 0x00a2e5 thru 0x015280 (0xaf9c bytes) 000569 1772472697.468511 read 0x0138f9 thru 0x01896a (0x5072 bytes) 000570 1772472697.478491 punch from 0x0259d1 to 0x0275a6 (0x1bd6 bytes) 000571 1772472697.483301 trunc from 0x0275a7 to 0x000bc4 (0x269e2 bytes) 000572 1772472697.509005 write 0x0109b3 thru 0x01afec (0xa63a bytes) 000573 1772472697.512010 mapread 0x0119ce thru 0x01afec (0x961f bytes) 000574 1772472697.514548 write 0x008c76 thru 0x013bf4 (0xaf7f bytes) 000575 1772472697.521277 punch from 0x018dff to 0x01afec (0x21ee bytes) 000576 1772472697.537504 fallocate 0x014f85 thru 0x01bdd9 (0x6e55 bytes) 000578 1772472697.544501 mapread 0x011478 thru 0x01afec (0x9b75 bytes) 000579 1772472697.561284 mapread 0x0122b3 thru 0x014661 (0x23af bytes) 000580 1772472697.563900 read 0x0168a0 thru 0x01afec (0x474d bytes) 000581 1772472697.565499 trunc from 0x010ed8 to 0x019b83 (0x8cac bytes) 000582 1772472697.571083 trunc from 0x01afed to 0x022858 (0x786c bytes) 000583 1772472697.588055 mapwrite 0x033915 thru 0x03ffff (0xc6eb bytes) 000584 1772472697.638281 fallocate 0x025c8d thru 0x026e27 (0x119b bytes) 000585 1772472697.644982 read 0x03557c thru 0x03a6a4 (0x5129 bytes) 000586 1772472697.646090 trunc from 0x040000 to 0x0097cb (0x36834 bytes) 000587 1772472697.664054 fallocate 0x0005ef thru 0x010104 (0xfb16 bytes) 000588 1772472697.670978 trunc from 0x0097cc to 0x0391ec (0x2fa21 bytes) 000589 1772472697.692177 trunc from 0x0391ed to 0x01a592 (0x1ec5a bytes) 000591 1772472697.716495 punch from 0x005057 to 0x008dcb (0x3d75 bytes) 000592 1772472697.723452 trunc from 0x002e0e to 0x00a56b (0x775e bytes) 000593 1772472697.730442 write 0x021cc4 thru 0x02b0d7 (0x9414 bytes) 000594 1772472697.733479 read 0x014a9e thru 0x021937 (0xce9a bytes) 000595 1772472697.744452 read 0x00f686 thru 0x018634 (0x8faf bytes) 000596 1772472697.745272 trunc from 0x021b46 to 0x026c88 (0x5143 bytes) 000597 1772472697.766113 read 0x018f23 thru 0x01f689 (0x6767 bytes) 000598 1772472697.767188 write 0x02bcdf thru 0x02cb6b (0xe8d bytes) 000599 1772472697.768334 mapread 0x004006 thru 0x0062ff (0x22fa bytes) 000600 1772472697.770088 punch from 0x01407e to 0x0185bb (0x453e bytes) 000601 1772472697.775201 trunc from 0x0043b5 to 0x00bf10 (0x7b5c bytes) 000602 1772472697.779930 write 0x030fd4 thru 0x037097 (0x60c4 bytes) 000603 1772472697.782945 mapread 0x005005 thru 0x01338a (0xe386 bytes) 000604 1772472697.801221 read 0x00129d thru 0x0105c5 (0xf329 bytes) 000605 1772472697.802263 trunc from 0x022454 to 0x025eab (0x3a58 bytes) 000606 1772472697.809178 punch from 0x015762 to 0x01e3e1 (0x8c80 bytes) 000607 1772472697.821119 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37098): Mirror 11: 0x38a887f (stale) Mirror 17: 0x38a887f (stale) Mirror 19: 0x38a887f (stale) Mirror 20: 0x38a887f (stale) Mirror 21: 0x38a887f (stale) Mirror 25: 0x38a887f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37098): Mirror 11: 0x38a887f (stale) Mirror 17: 0x38a887f (stale) Mirror 19: 0x38a887f (stale) Mirror 20: 0x38a887f (stale) Mirror 21: 0x38a887f (stale) Mirror 25: 0x38a887f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37098: skipped 000608 1772472698.265114 mapwrite 0x03ffed thru 0x03ffff (0x13 bytes) 000609 1772472698.306171 mapwrite 0x017d49 thru 0x022928 (0xabe0 bytes) 000611 1772472698.406671 MIRROR_RESYNC 7 mirrors 000612 1772472702.069365 trunc from 0x00e645 to 0x01be08 (0xd7c4 bytes) 000613 1772472702.119003 write 0x00a583 thru 0x00b153 (0xbd1 bytes) 000614 1772472702.137161 mapread 0x03656b thru 0x03f28f (0x8d25 bytes) 000618 1772472702.167265 write 0x025c1d thru 0x028e91 (0x3275 bytes) 000619 1772472702.186898 fallocate 0x029d01 thru 0x02f4a4 (0x57a4 bytes) 000620 1772472702.197712 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x2dea268 (stale) Mirror 17: 0x2dea268 (stale) Mirror 19: 0x2dea268 (stale) Mirror 21: 0x2dea268 (stale) Mirror 25: 0x2dea268 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x2dea268 (stale) Mirror 17: 0x2dea268 (stale) Mirror 19: 0x2dea268 (stale) Mirror 21: 0x2dea268 (stale) Mirror 25: 0x2dea268 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000621 1772472702.850025 MIRROR_RESYNC 6 mirrors 000622 1772472705.326256 read 0x014ff5 thru 0x017f08 (0x2f14 bytes) 000624 1772472705.335384 trunc from 0x040000 to 0x02f26b (0x10d94 bytes) 000625 1772472705.373167 fallocate 0x03df64 thru 0x03ffff (0x209c bytes) 000626 1772472705.378800 mapread 0x025c61 thru 0x0296b1 (0x3a51 bytes) 000627 1772472705.397412 trunc from 0x02f26c to 0x0082c7 (0x26fa4 bytes) 000628 1772472705.417291 mapwrite 0x00561a thru 0x0112a6 (0xbc8d bytes) 000629 1772472705.481021 mapwrite 0x002651 thru 0x00e876 (0xc226 bytes) 000630 1772472705.501859 mapwrite 0x0318ef thru 0x039893 (0x7fa5 bytes) 000631 1772472705.547003 write 0x01aa9e thru 0x01ffab (0x550e bytes) 000632 1772472705.562678 read 0x0058c2 thru 0x013559 (0xdc98 bytes) 000633 1772472705.571868 mapwrite 0x0244c1 thru 0x024e48 (0x988 bytes) 000634 1772472705.588020 write 0x02d245 thru 0x030b29 (0x38e5 bytes) 000636 1772472705.591115 read 0x008229 thru 0x0176d5 (0xf4ad bytes) 000637 1772472705.592634 write 0x02d466 thru 0x02e9e4 (0x157f bytes) 000638 1772472705.593790 mapread 0x031370 thru 0x037833 (0x64c4 bytes) 000639 1772472705.600102 MIRROR_RESYNC 6 mirrors 000641 1772472707.830916 mapread 0x006dd0 thru 0x008872 (0x1aa3 bytes) 000642 1772472707.859346 fallocate 0x030c56 thru 0x03ffff (0xf3aa bytes) 000643 1772472707.909950 read 0x034c28 thru 0x03b481 (0x685a bytes) 000644 1772472707.928982 punch from 0x0276a2 to 0x028ccf (0x162e bytes) 000645 1772472707.939806 trunc from 0x040000 to 0x029498 (0x16b67 bytes) 000646 1772472707.977875 read 0x01f6e4 thru 0x01fdfe (0x71b bytes) 000647 1772472707.994318 punch from 0x00270e to 0x00f3a6 (0xcc99 bytes) 000648 1772472708.000213 punch from 0x01a421 to 0x01ccd8 (0x28b8 bytes) 000649 1772472708.015894 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29499): Mirror 11: 0x99524265 (stale) Mirror 17: 0x99524265 (stale) Mirror 19: 0x99524265 (stale) Mirror 21: 0x99524265 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29499): Mirror 11: 0x99524265 (stale) Mirror 17: 0x99524265 (stale) Mirror 19: 0x99524265 (stale) Mirror 21: 0x99524265 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29499: skipped 000650 1772472708.484935 trunc from 0x029499 to 0x03f517 (0x1607f bytes) 000651 1772472708.541792 punch from 0x02f6e2 to 0x03378e (0x40ad bytes) 000652 1772472708.550396 MIRROR_RESYNC 5 mirrors 000653 1772472710.653322 fallocate 0x007aa8 thru 0x008202 (0x75b bytes) 000654 1772472710.706073 mapread 0x0337ca thru 0x03e1c3 (0xa9fa bytes) 000655 1772472710.737377 fallocate 0x001854 thru 0x00f1bb (0xd968 bytes) 000656 1772472710.745202 trunc from 0x00460a to 0x014122 (0xfb19 bytes) 000657 1772472710.750846 fallocate 0x0329c5 thru 0x03d109 (0xa745 bytes) 000658 1772472710.758081 trunc from 0x03f518 to 0x01f708 (0x1fe0f bytes) 000659 1772472710.785536 trunc from 0x015950 to 0x01c418 (0x6ac9 bytes) 000660 1772472710.798557 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1f709): Mirror 11: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f709): Mirror 11: 0xe452963a (stale) Mirror 17: 0xe452963a (stale) Mirror 19: 0xe452963a (stale) Mirror 21: 0xe452963a (stale) CRC-32 checksum value for chunk [0, 0x1f709): Mirror 1: 0x2adbca71 Mirror 22: 0x2adbca71 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f709: skipped 000661 1772472711.909986 read 0x012d7e thru 0x013736 (0x9b9 bytes) 000662 1772472711.925443 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f709): Mirror 11: 0xe452963a (stale) Mirror 17: 0xe452963a (stale) Mirror 19: 0xe452963a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f709): Mirror 11: 0xe452963a (stale) Mirror 17: 0xe452963a (stale) Mirror 19: 0xe452963a (stale) CRC-32 checksum value for chunk [0, 0x1f709): Mirror 1: 0x2adbca71 Mirror 22: 0x2adbca71 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f709: skipped 000663 1772472712.462931 MIRROR_RESYNC 5 mirrors 000664 1772472713.343230 trunc from 0x000ed3 to 0x00b548 (0xa676 bytes) 000665 1772472713.395810 write 0x01d4cd thru 0x01e698 (0x11cc bytes) 000666 1772472713.408720 punch from 0x0175a0 to 0x01f708 (0x8169 bytes) 000667 1772472713.437214 trunc from 0x011116 to 0x01520f (0x40fa bytes) 000668 1772472713.446195 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f709): Mirror 11: 0x2adbca71 (stale) Mirror 19: 0x2adbca71 (stale) Mirror 22: 0x2adbca71 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f709): Mirror 11: 0x2adbca71 (stale) Mirror 19: 0x2adbca71 (stale) Mirror 22: 0x2adbca71 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f709: skipped 000669 1772472713.716072 write 0x03683d thru 0x03ffff (0x97c3 bytes) 000671 1772472713.722817 trunc from 0x040000 to 0x03df02 (0x20fd bytes) 000672 1772472713.741891 mapread 0x012728 thru 0x014188 (0x1a61 bytes) 000673 1772472713.768857 write 0x00665d thru 0x007f79 (0x191d bytes) 000674 1772472713.780554 read 0x0217ce thru 0x0259f8 (0x422b bytes) 000675 1772472713.790205 mapwrite 0x00aad3 thru 0x012771 (0x7c9f bytes) 000676 1772472713.811090 read 0x029b99 thru 0x0337e1 (0x9c49 bytes) 000677 1772472713.819451 trunc from 0x008c16 to 0x00e21c (0x5607 bytes) 000678 1772472713.824176 mapread 0x0344c8 thru 0x03946f (0x4fa8 bytes) 000679 1772472713.825194 write 0x02bf96 thru 0x02d0e9 (0x1154 bytes) 000680 1772472713.828815 MIRROR_RESYNC 4 mirrors 000681 1772472714.982553 fallocate 0x02b39a thru 0x0306ad (0x5314 bytes) 000682 1772472715.012160 read 0x011cb8 thru 0x013aeb (0x1e34 bytes) 000683 1772472715.018142 write 0x015003 thru 0x016aa0 (0x1a9e bytes) 000684 1772472715.028136 mapwrite 0x02ae77 thru 0x033cc9 (0x8e53 bytes) 000685 1772472715.071722 read 0x014080 thru 0x020e55 (0xcdd6 bytes) 000686 1772472715.082232 fallocate 0x0119f9 thru 0x017d56 (0x635e bytes) 000687 1772472715.089227 mapread 0x013170 thru 0x01fa99 (0xc92a bytes) 000688 1772472715.091241 punch from 0x026548 to 0x0299f0 (0x34a9 bytes) 000689 1772472715.095683 read 0x02ceb9 thru 0x03303b (0x6183 bytes) 000690 1772472715.097186 trunc from 0x0110ba to 0x015d4f (0x4c96 bytes) 000691 1772472715.102093 write 0x00cae9 thru 0x018386 (0xb89e bytes) 000692 1772472715.103706 trunc from 0x007e77 to 0x00adf7 (0x2f81 bytes) 000693 1772472715.109120 trunc from 0x03df03 to 0x03dbfa (0x308 bytes) 000694 1772472715.126971 fallocate 0x034ce0 thru 0x035ab7 (0xdd8 bytes) 000695 1772472715.131923 trunc from 0x03dbfb to 0x0028a4 (0x3b356 bytes) 000696 1772472715.147049 punch from 0x0020f7 to 0x0028a4 (0x7ae bytes) 000697 1772472715.151901 read 0x001319 thru 0x0019fe (0x6e6 bytes) 000698 1772472715.153763 read 0x000610 thru 0x0028a4 (0x2295 bytes) 000699 1772472715.159481 write 0x02bfb4 thru 0x036cc8 (0xad15 bytes) 000700 1772472715.161879 read 0x034dfb thru 0x036cc8 (0x1ece bytes) 000701 1772472715.163619 trunc from 0x036cc9 to 0x0295fb (0xd6cd bytes) 000702 1772472715.178984 read 0x027212 thru 0x0295fb (0x23ea bytes) 000703 1772472715.190602 mapwrite 0x0345b1 thru 0x038663 (0x40b3 bytes) 000704 1772472715.233500 write 0x006a26 thru 0x00f256 (0x8831 bytes) 000705 1772472715.235951 punch from 0x013366 to 0x0149c5 (0x1660 bytes) 000706 1772472715.241848 trunc from 0x038664 to 0x006fd3 (0x31690 bytes) 000707 1772472715.258988 read 0x004324 thru 0x006fd3 (0x2cb0 bytes) 000708 1772472715.259689 write 0x0094a2 thru 0x0140fc (0xac5b bytes) 000710 1772472715.264674 write 0x005068 thru 0x010f2a (0xbec3 bytes) 000712 1772472715.271900 trunc from 0x0140fd to 0x035c71 (0x21b75 bytes) 000713 1772472715.284913 write 0x03bf3c thru 0x03ffff (0x40c4 bytes) 000714 1772472715.287390 fallocate 0x0034c5 thru 0x004358 (0xe94 bytes) 000715 1772472715.294645 mapread 0x039f50 thru 0x03ffff (0x60b0 bytes) 000716 1772472715.305386 fallocate 0x02e044 thru 0x032b50 (0x4b0d bytes) 000717 1772472715.310773 mapwrite 0x0110db thru 0x01698a (0x58b0 bytes) 000718 1772472715.326779 punch from 0x02fa71 to 0x039a69 (0x9ff9 bytes) 000719 1772472715.331869 punch from 0x002e6c to 0x010544 (0xd6d9 bytes) 000720 1772472715.337012 trunc from 0x01f3aa to 0x02e5ac (0xf203 bytes) 000721 1772472715.346910 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0x8f5cf8b4 (stale) Mirror 22: 0x8f5cf8b4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0x8f5cf8b4 (stale) Mirror 22: 0x8f5cf8b4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000722 1772472715.602230 MIRROR_RESYNC 3 mirrors 000723 1772472716.882405 read 0x00cb2c thru 0x011a95 (0x4f6a bytes) 000724 1772472716.898908 mapwrite 0x02750b thru 0x028a85 (0x157b bytes) 000725 1772472716.994085 trunc from 0x02f7a4 to 0x03d21d (0xda7a bytes) 000726 1772472717.021746 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0x87985c69 (stale) Mirror 22: 0x87985c69 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x583e412d Mirror 23: 0x583e412d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000727 1772472718.314346 mapread 0x034e19 thru 0x03b2d6 (0x64be bytes) 000728 1772472718.363791 trunc from 0x00aa56 to 0x012515 (0x7ac0 bytes) 000729 1772472718.438893 punch from 0x016a07 to 0x01de7e (0x7478 bytes) 000730 1772472718.447658 punch from 0x03b634 to 0x03ffff (0x49cc bytes) 000731 1772472718.452871 trunc from 0x040000 to 0x024cb4 (0x1b34b bytes) 000732 1772472718.481081 read 0x0175c7 thru 0x01f30e (0x7d48 bytes) 000733 1772472718.503246 trunc from 0x024cb5 to 0x0085e9 (0x1c6cb bytes) 000734 1772472718.550144 mapread 0x000e9b thru 0x0014d4 (0x63a bytes) 000735 1772472718.572286 trunc from 0x007ec7 to 0x0085e9 (0x723 bytes) 000736 1772472718.587209 read 0x00046a thru 0x005e4f (0x59e6 bytes) 000737 1772472718.590219 punch from 0x00728a to 0x0085e9 (0x1360 bytes) 000738 1772472718.596697 trunc from 0x0006f3 to 0x0085e9 (0x7ef7 bytes) 000739 1772472718.610541 fallocate 0x03ae35 thru 0x03ffff (0x51cb bytes) 000740 1772472718.618411 mapread 0x0071ce thru 0x0085e9 (0x141c bytes) 000741 1772472718.675648 mapwrite 0x000bfd thru 0x007fed (0x73f1 bytes) 000742 1772472718.756703 punch from 0x003043 to 0x004f0c (0x1eca bytes) 000743 1772472718.776183 mapwrite 0x01a03f thru 0x01e901 (0x48c3 bytes) 000744 1772472718.847380 trunc from 0x011e89 to 0x0160c2 (0x423a bytes) 000745 1772472718.868860 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e902): Mirror 22: 0x9463d967 (stale) Mirror 23: 0x9463d967 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e902): Mirror 22: 0x9463d967 (stale) Mirror 23: 0x9463d967 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e902: skipped 000747 1772472719.308880 trunc from 0x01cc07 to 0x01e901 (0x1cfb bytes) 000748 1772472719.319717 trunc from 0x00dc90 to 0x0110d9 (0x344a bytes) 000749 1772472719.330552 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1e902): Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e902): Mirror 22: 0x9463d967 (stale) Mirror 23: 0x9463d967 (stale) CRC-32 checksum value for chunk [0, 0x1e902): Mirror 1: 0x6b245c9 Mirror 24: 0x6b245c9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e902: skipped 000750 1772472720.527336 trunc from 0x01e902 to 0x008365 (0x1659c bytes) 000751 1772472720.582820 punch from 0x007b34 to 0x008365 (0x832 bytes) 000752 1772472720.588112 read 0x003707 thru 0x008365 (0x4c5f bytes) 000753 1772472720.597109 write 0x0067f0 thru 0x00dac1 (0x72d2 bytes) 000754 1772472720.599368 punch from 0x00967e to 0x00dac1 (0x4444 bytes) 000755 1772472720.614290 mapwrite 0x03f7c3 thru 0x03ffff (0x83d bytes) 000756 1772472720.651786 punch from 0x002a19 to 0x00a914 (0x7efc bytes) 000757 1772472720.658172 punch from 0x00e7c1 to 0x0161cf (0x7a0f bytes) 000758 1772472720.663147 trunc from 0x040000 to 0x03298f (0xd670 bytes) 000759 1772472720.686008 punch from 0x02fbed to 0x03298f (0x2da3 bytes) 000761 1772472720.692262 trunc from 0x02d519 to 0x03298f (0x5477 bytes) 000762 1772472720.696090 mapread 0x01c9f9 thru 0x020677 (0x3c7f bytes) 000763 1772472720.714720 trunc from 0x032990 to 0x014313 (0x1e67c bytes) 000764 1772472720.736086 mapwrite 0x025f08 thru 0x02a9d8 (0x4ad1 bytes) 000765 1772472720.791182 trunc from 0x02a54e to 0x02a9d8 (0x48b bytes) 000768 1772472720.797964 punch from 0x023ddc to 0x025505 (0x172a bytes) 000769 1772472720.806171 read 0x008d0b thru 0x008e64 (0x15a bytes) 000770 1772472720.819495 trunc from 0x02a9d9 to 0x018d10 (0x11cc8 bytes) 000771 1772472720.835602 trunc from 0x018d11 to 0x01d345 (0x4635 bytes) 000772 1772472720.855387 mapread 0x004ec8 thru 0x011ad4 (0xcc0d bytes) 000773 1772472720.857703 write 0x004ea5 thru 0x012d5e (0xdeba bytes) 000774 1772472720.868100 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1d346): Mirror 22: 0xf46adfbc (stale) Mirror 24: 0xc8fe5fbf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d346): Mirror 22: 0xf46adfbc (stale) Mirror 24: 0xc8fe5fbf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d346: skipped 000776 1772472721.331912 mapread 0x011a59 thru 0x016934 (0x4edc bytes) 000777 1772472721.394507 punch from 0x0076be to 0x014ec1 (0xd804 bytes) 000778 1772472721.414449 read 0x01bcb8 thru 0x01d345 (0x168e bytes) 000779 1772472721.433855 mapread 0x00b797 thru 0x01950d (0xdd77 bytes) 000780 1772472721.465255 read 0x005044 thru 0x010a21 (0xb9de bytes) 000781 1772472721.466754 fallocate 0x018286 thru 0x027699 (0xf414 bytes) 000782 1772472721.477692 mapread 0x01cdb9 thru 0x01d345 (0x58d bytes) 000783 1772472721.488757 punch from 0x0162fc to 0x01d345 (0x704a bytes) 000784 1772472721.501696 mapwrite 0x024c50 thru 0x030db5 (0xc166 bytes) 000785 1772472721.627118 punch from 0x003b70 to 0x007be9 (0x407a bytes) 000786 1772472721.643715 trunc from 0x030db6 to 0x01ac14 (0x161a1 bytes) 000787 1772472721.690160 write 0x037b8a thru 0x03e7df (0x6c56 bytes) 000788 1772472721.691799 trunc from 0x0300df to 0x035458 (0x537a bytes) 000789 1772472721.698469 mapwrite 0x014784 thru 0x020cf2 (0xc56f bytes) 000790 1772472721.778641 trunc from 0x03e7e0 to 0x035762 (0x907d bytes) 000791 1772472721.834145 fallocate 0x014953 thru 0x017731 (0x2ddf bytes) 000792 1772472721.842051 mapread 0x000a9b thru 0x0042b0 (0x3816 bytes) 000793 1772472721.866154 mapwrite 0x0076fa thru 0x01135f (0x9c66 bytes) 000795 1772472721.903887 mapread 0x02105b thru 0x02dd69 (0xcd0f bytes) 000796 1772472722.038473 mapread 0x02d810 thru 0x035762 (0x7f53 bytes) 000798 1772472722.056488 mapwrite 0x01fb52 thru 0x0287bb (0x8c6a bytes) 000799 1772472722.090886 punch from 0x01174b to 0x011cfc (0x5b2 bytes) 000800 1772472722.098817 fallocate 0x025bc2 thru 0x031037 (0xb476 bytes) 000802 1772472722.108863 trunc from 0x0178c7 to 0x01d8da (0x6014 bytes) 000803 1772472722.117550 fallocate 0x03d28d thru 0x03ffff (0x2d73 bytes) 000804 1772472722.135251 fallocate 0x00ccbb thru 0x00ddb3 (0x10f9 bytes) 000805 1772472722.140864 trunc from 0x0088b6 to 0x0158ec (0xd037 bytes) 000806 1772472722.149346 fallocate 0x00f838 thru 0x01358d (0x3d56 bytes) 000807 1772472722.154401 read 0x01d086 thru 0x01ff22 (0x2e9d bytes) 000808 1772472722.187468 punch from 0x02bf26 to 0x035762 (0x983d bytes) 000809 1772472722.198679 punch from 0x001c8b to 0x00a058 (0x83ce bytes) 000810 1772472722.220553 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35763): Mirror 22: 0xf4076f73 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35763): Mirror 22: 0xf4076f73 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35763: skipped 000811 1772472722.761621 punch from 0x02afb4 to 0x02f91b (0x4968 bytes) 000812 1772472722.774367 mapread 0x0189d9 thru 0x01a161 (0x1789 bytes) 000813 1772472722.817939 trunc from 0x035763 to 0x018c63 (0x1caff bytes) 000814 1772472722.851256 trunc from 0x018c64 to 0x01a703 (0x1aa0 bytes) 000815 1772472722.903224 trunc from 0x0175ee to 0x01a703 (0x3116 bytes) 000816 1772472722.930233 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) 000817 1772472723.295454 punch from 0x0077e9 to 0x011367 (0x9b7f bytes) 000818 1772472723.311222 mapwrite 0x035616 thru 0x03ffff (0xa9ea bytes) 000820 1772472723.544099 read 0x003a71 thru 0x0111d4 (0xd764 bytes) 000821 1772472723.592133 mapread 0x031e1c thru 0x03a5ef (0x87d4 bytes) 000823 1772472723.609926 read 0x00be40 thru 0x01887d (0xca3e bytes) 000824 1772472723.625451 trunc from 0x0025f3 to 0x00aa73 (0x8481 bytes) 000825 1772472723.644539 punch from 0x01da55 to 0x02d399 (0xf945 bytes) 000826 1772472723.669670 punch from 0x01e49f to 0x027d92 (0x98f4 bytes) 000827 1772472723.678499 fallocate 0x012305 thru 0x01fd6a (0xda66 bytes) 000828 1772472723.692697 mapread 0x01848c thru 0x01a42c (0x1fa1 bytes) 000829 1772472723.695820 trunc from 0x040000 to 0x028603 (0x179fc bytes) 000831 1772472723.758613 fallocate 0x018a10 thru 0x0238c5 (0xaeb6 bytes) 000832 1772472723.771157 punch from 0x0211a0 to 0x028603 (0x7464 bytes) 000833 1772472723.779865 write 0x03fe6f thru 0x03ffff (0x191 bytes) 000834 1772472723.781072 read 0x01f66d thru 0x028e7d (0x9811 bytes) 000835 1772472723.803091 write 0x005473 thru 0x012c92 (0xd820 bytes) 000836 1772472723.804743 mapread 0x01e6f7 thru 0x028c0a (0xa514 bytes) 000838 1772472723.806798 read 0x01b1b9 thru 0x0255ad (0xa3f5 bytes) 000839 1772472723.820015 write 0x011b61 thru 0x01f6ca (0xdb6a bytes) 000841 1772472723.832929 fallocate 0x02535b thru 0x0298ce (0x4574 bytes) 000842 1772472723.842319 punch from 0x027ca6 to 0x02f766 (0x7ac1 bytes) 000843 1772472723.850767 write 0x02e5d2 thru 0x030831 (0x2260 bytes) 000844 1772472723.867415 mapread 0x031b98 thru 0x03ffff (0xe468 bytes) 000846 1772472723.874728 punch from 0x02618f to 0x028d59 (0x2bcb bytes) 000847 1772472723.892859 fallocate 0x029c72 thru 0x039c64 (0xfff3 bytes) 000848 1772472723.906962 trunc from 0x037978 to 0x03ff62 (0x85eb bytes) 000849 1772472723.949399 trunc from 0x040000 to 0x037de6 (0x8219 bytes) 000850 1772472724.015295 punch from 0x0021a4 to 0x003ccc (0x1b29 bytes) 000851 1772472724.037694 read 0x02d63f thru 0x037de6 (0xa7a8 bytes) 000852 1772472724.068231 fallocate 0x006fe4 thru 0x00ab57 (0x3b74 bytes) 000853 1772472724.094923 MIRROR_EXTEND to 2 mirrors 000855 1772472725.172800 trunc from 0x02abd2 to 0x036744 (0xbb73 bytes) 000856 1772472725.211283 trunc from 0x030bf7 to 0x0375a4 (0x69ae bytes) 000857 1772472725.223969 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) 000858 1772472725.385519 read 0x007e8a thru 0x0160f1 (0xe268 bytes) 000860 1772472725.414542 mapwrite 0x0345a1 thru 0x03ffff (0xba5f bytes) 000861 1772472725.500738 mapread 0x01852f thru 0x02699c (0xe46e bytes) 000862 1772472725.519492 punch from 0x021ffd to 0x0284d0 (0x64d4 bytes) 000863 1772472725.525399 trunc from 0x01bff8 to 0x0221d9 (0x61e2 bytes) 000864 1772472725.530967 write 0x00bd6b thru 0x010319 (0x45af bytes) 000865 1772472725.532508 mapwrite 0x01323d thru 0x01d6c4 (0xa488 bytes) 000866 1772472725.561339 read 0x02642a thru 0x03233d (0xbf14 bytes) 000867 1772472725.571080 trunc from 0x040000 to 0x029028 (0x16fd7 bytes) 000868 1772472725.587506 read 0x017531 thru 0x01cc5d (0x572d bytes) 000869 1772472725.589118 read 0x01affc thru 0x023f78 (0x8f7d bytes) 000870 1772472725.590145 mapwrite 0x036994 thru 0x03ffff (0x966c bytes) 000873 1772472725.660704 mapread 0x007902 thru 0x00dc52 (0x6351 bytes) 000874 1772472725.662108 mapwrite 0x039645 thru 0x03cf73 (0x392f bytes) 000875 1772472725.692922 write 0x027923 thru 0x0281fc (0x8da bytes) 000876 1772472725.699273 trunc from 0x040000 to 0x0089e1 (0x3761e bytes) 000877 1772472725.722259 trunc from 0x001867 to 0x0089e1 (0x717b bytes) 000879 1772472725.731034 read 0x006123 thru 0x0089e1 (0x28bf bytes) 000880 1772472725.744179 trunc from 0x0089e2 to 0x032cf0 (0x2a30f bytes) 000881 1772472725.762958 punch from 0x0102b1 to 0x0103c7 (0x117 bytes) 000882 1772472725.768683 trunc from 0x032cf1 to 0x011ca6 (0x2104a bytes) 000883 1772472725.797701 mapwrite 0x004ee0 thru 0x00a3a1 (0x54c2 bytes) 000884 1772472725.836597 read 0x00fe3a thru 0x010fd2 (0x1199 bytes) 000886 1772472725.837928 fallocate 0x034057 thru 0x03a7be (0x6768 bytes) 000887 1772472725.843435 read 0x003e86 thru 0x00e89b (0xaa16 bytes) 000888 1772472725.844668 trunc from 0x011ca7 to 0x01deda (0xc234 bytes) 000889 1772472725.867481 trunc from 0x01dedb to 0x01ed9c (0xec2 bytes) 000890 1772472725.889754 fallocate 0x02a308 thru 0x02f8d1 (0x55ca bytes) 000891 1772472725.897499 fallocate 0x01ef3b thru 0x029b05 (0xabcb bytes) 000892 1772472725.905211 read 0x00deba thru 0x01bff3 (0xe13a bytes) 000893 1772472725.922416 write 0x02b66b thru 0x035627 (0x9fbd bytes) 000894 1772472725.930747 read 0x033e52 thru 0x035627 (0x17d6 bytes) 000895 1772472725.932290 read 0x00e417 thru 0x018543 (0xa12d bytes) 000896 1772472725.933816 trunc from 0x035628 to 0x033a9f (0x1b88 bytes) 000897 1772472725.957678 trunc from 0x022d8f to 0x029055 (0x62c7 bytes) 000898 1772472725.964925 fallocate 0x035ea2 thru 0x039c03 (0x3d62 bytes) 000899 1772472725.972914 fallocate 0x00a81a thru 0x01713f (0xc926 bytes) 000900 1772472725.982239 mapwrite 0x021371 thru 0x02f7e3 (0xe473 bytes) 000901 1772472726.018103 read 0x030760 thru 0x039a64 (0x9305 bytes) 000903 1772472726.019822 write 0x023eda thru 0x032df6 (0xef1d bytes) 000904 1772472726.024289 write 0x0142ec thru 0x0205cd (0xc2e2 bytes) 000905 1772472726.027690 read 0x018d60 thru 0x0212a6 (0x8547 bytes) 000906 1772472726.028480 trunc from 0x032cde to 0x039c03 (0x6f26 bytes) 000907 1772472726.063040 write 0x02b957 thru 0x02c475 (0xb1f bytes) 000908 1772472726.064101 trunc from 0x00cd03 to 0x013012 (0x6310 bytes) 000909 1772472726.072802 read 0x00a05b thru 0x019b86 (0xfb2c bytes) 000911 1772472726.090994 mapread 0x016b48 thru 0x0194cd (0x2986 bytes) 000912 1772472726.095678 punch from 0x023548 to 0x0314fe (0xdfb7 bytes) 000913 1772472726.111298 trunc from 0x039c04 to 0x01f69d (0x1a566 bytes) 000915 1772472726.152171 punch from 0x001244 to 0x00a290 (0x904d bytes) 000916 1772472726.168419 punch from 0x016c71 to 0x019190 (0x2520 bytes) 000917 1772472726.177967 punch from 0x01791d to 0x01aa03 (0x30e7 bytes) 000918 1772472726.202883 trunc from 0x01d6de to 0x01f577 (0x1e9a bytes) 000919 1772472726.209532 mapwrite 0x003256 thru 0x010d28 (0xdad3 bytes) 000920 1772472726.283446 mapwrite 0x02800d thru 0x02ec16 (0x6c0a bytes) 000921 1772472726.383225 mapread 0x00ac6f thru 0x01032d (0x56bf bytes) 000922 1772472726.384380 write 0x00f8b5 thru 0x01e47a (0xebc6 bytes) 000923 1772472726.392122 trunc from 0x02ec17 to 0x006557 (0x286bf bytes) 000924 1772472726.416763 mapread 0x004f15 thru 0x006557 (0x1643 bytes) 000925 1772472726.419785 read 0x005275 thru 0x006557 (0x12e3 bytes) 000926 1772472726.423792 trunc from 0x00194a to 0x006557 (0x4c0e bytes) 000927 1772472726.432901 trunc from 0x001b94 to 0x006557 (0x49c4 bytes) 000928 1772472726.446109 MIRROR_EXTEND to 2 mirrors 000929 1772472727.387968 fallocate 0x021b84 thru 0x026fb4 (0x5431 bytes) 000930 1772472727.437012 write 0x03f396 thru 0x03ffff (0xc6a bytes) 000931 1772472727.445557 punch from 0x0347b5 to 0x03f02e (0xa87a bytes) 000933 1772472727.474168 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x98728f83 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x44048495 Mirror 3: 0x44048495 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000934 1772472729.369054 write 0x00f0e6 thru 0x018933 (0x984e bytes) 000935 1772472729.458392 mapread 0x012061 thru 0x0171d3 (0x5173 bytes) 000936 1772472729.482976 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x98728f83 (stale) Mirror 3: 0x44048495 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x28adcb3f Mirror 4: 0x28adcb3f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000937 1772472731.139813 MIRROR_RESYNC 4 mirrors 000939 1772472732.210008 MIRROR_RESYNC 4 mirrors 000940 1772472732.467961 trunc from 0x040000 to 0x021b35 (0x1e4ca bytes) 000941 1772472732.512703 mapread 0x018424 thru 0x01cf4d (0x4b2a bytes) 000942 1772472732.542286 write 0x03f78e thru 0x03ffff (0x872 bytes) 000944 1772472732.552088 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x28adcb3f (stale) Mirror 4: 0x28adcb3f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x28adcb3f (stale) Mirror 4: 0x28adcb3f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000945 1772472733.074787 fallocate 0x02c274 thru 0x035401 (0x918e bytes) 000946 1772472733.095229 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x28adcb3f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x28adcb3f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000947 1772472733.457125 trunc from 0x03a070 to 0x03ffff (0x5f90 bytes) 000948 1772472733.461428 fallocate 0x018258 thru 0x02433c (0xc0e5 bytes) 000949 1772472733.466275 trunc from 0x0250ba to 0x032cc4 (0xdc0b bytes) 000950 1772472733.470291 mapwrite 0x025c3e thru 0x02a006 (0x43c9 bytes) 000951 1772472733.497754 fallocate 0x009298 thru 0x00cea4 (0x3c0d bytes) 000952 1772472733.502446 punch from 0x0310f6 to 0x03bf0c (0xae17 bytes) 000953 1772472733.573827 trunc from 0x02ee95 to 0x037c01 (0x8d6d bytes) 000954 1772472733.595478 write 0x009497 thru 0x00e323 (0x4e8d bytes) 000955 1772472733.624689 mapwrite 0x027532 thru 0x02c49b (0x4f6a bytes) 000956 1772472733.677425 write 0x034bf4 thru 0x03e508 (0x9915 bytes) 000957 1772472733.698627 write 0x022750 thru 0x02a627 (0x7ed8 bytes) 000958 1772472733.706810 trunc from 0x003e07 to 0x00fd5e (0xbf58 bytes) 000959 1772472733.731361 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x28adcb3f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2c2ad4a Mirror 5: 0x2c2ad4a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000960 1772472735.676727 write 0x00bd50 thru 0x01aa4b (0xecfc bytes) 000961 1772472735.787602 read 0x029439 thru 0x0340fe (0xacc6 bytes) 000962 1772472735.799838 mapread 0x023cb2 thru 0x02ad3f (0x708e bytes) 000963 1772472735.817417 trunc from 0x040000 to 0x0319b9 (0xe646 bytes) 000964 1772472735.888841 write 0x039dea thru 0x03d228 (0x343f bytes) 000965 1772472735.894360 trunc from 0x02fc83 to 0x030f8d (0x130b bytes) 000966 1772472735.902816 read 0x007cd4 thru 0x00b6c5 (0x39f2 bytes) 000967 1772472735.966551 write 0x0039ef thru 0x00b760 (0x7d72 bytes) 000968 1772472735.968112 trunc from 0x0328ae to 0x03bdf1 (0x9544 bytes) 000969 1772472736.021708 read 0x013914 thru 0x015352 (0x1a3f bytes) 000971 1772472736.029433 read 0x01bd48 thru 0x023d82 (0x803b bytes) 000972 1772472736.030457 mapwrite 0x02587d thru 0x02f784 (0x9f08 bytes) 000973 1772472736.102318 mapread 0x038471 thru 0x03d228 (0x4db8 bytes) 000974 1772472736.134066 fallocate 0x03ca24 thru 0x03ffff (0x35dc bytes) 000975 1772472736.151397 mapwrite 0x00e113 thru 0x013152 (0x5040 bytes) 000976 1772472736.232687 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x2c2ad4a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x2c2ad4a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000977 1772472736.961790 read 0x03768e thru 0x03c5af (0x4f22 bytes) 000978 1772472736.996529 punch from 0x01ff51 to 0x027950 (0x7a00 bytes) 000979 1772472737.008628 write 0x03d0b3 thru 0x03ffff (0x2f4d bytes) 000980 1772472737.041508 fallocate 0x0086a3 thru 0x00fd5a (0x76b8 bytes) 000981 1772472737.062834 mapread 0x00b80f thru 0x00cb98 (0x138a bytes) 000983 1772472737.089043 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a7:0x0]: Invalid argument (22) 000984 1772472737.479409 trunc from 0x00a39c to 0x00ee9f (0x4b04 bytes) 000985 1772472737.498729 fallocate 0x03050c thru 0x0335cf (0x30c4 bytes) 000986 1772472737.510543 fallocate 0x0054b4 thru 0x0101db (0xad28 bytes) 000987 1772472737.531752 punch from 0x02bcdf to 0x03af16 (0xf238 bytes) 000988 1772472737.546678 mapwrite 0x020212 thru 0x02fdaa (0xfb99 bytes) 000990 1772472737.718784 trunc from 0x01f4dc to 0x0280a9 (0x8bce bytes) 000991 1772472737.736448 mapwrite 0x0184bb thru 0x01fcd5 (0x781b bytes) 000992 1772472737.815845 write 0x0093e0 thru 0x00d37c (0x3f9d bytes) 000993 1772472737.840448 trunc from 0x040000 to 0x00ff14 (0x300eb bytes) 000994 1772472737.863699 read 0x00b4f0 thru 0x00ff14 (0x4a25 bytes) 000995 1772472737.864652 trunc from 0x00ff15 to 0x020a40 (0x10b2c bytes) 000997 1772472737.894345 punch from 0x0141a2 to 0x01ea8f (0xa8ee bytes) 000998 1772472737.902793 mapread 0x002c27 thru 0x00654f (0x3929 bytes) 000999 1772472737.904901 write 0x02758e thru 0x029f50 (0x29c3 bytes) 001000 1772472737.906451 punch from 0x00b5f5 to 0x00c3c9 (0xdd5 bytes) All operations completed A-OK!