== sanity-flr test 70a: flr mode fsx test ================ 19:55:02 (1789430102) Seed set to 104 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1789430105.035276 MIRROR_EXTEND to 2 mirrors skipping zero length punch hole 000003 1789430105.467910 write 0x01d1df thru 0x01ebef (0x1a11 bytes) 000004 1789430105.537433 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1ebf0): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ebf0): Mirror 2: 0xf066d0f2 (stale) CRC-32 checksum value for chunk [0, 0x1ebf0): Mirror 1: 0x7c2f1147 Mirror 3: 0x7c2f1147 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ebf0: skipped 000005 1789430106.506198 MIRROR_RESYNC 3 mirrors 000006 1789430107.457714 mapread 0x003ba1 thru 0x012530 (0xe990 bytes) 000007 1789430107.516408 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) 000008 1789430108.072381 MIRROR_EXTEND to 3 mirrors 000009 1789430109.093088 MIRROR_RESYNC 3 mirrors 000010 1789430109.604084 read 0x00fc6d thru 0x01335c (0x36f0 bytes) 000011 1789430109.616466 write 0x02e479 thru 0x0315d0 (0x3158 bytes) 000012 1789430109.731601 mapwrite 0x0121d4 thru 0x01511b (0x2f48 bytes) 000017 1789430109.824440 mapwrite 0x02d642 thru 0x0327ea (0x51a9 bytes) 000019 1789430109.914768 write 0x022c08 thru 0x026bc6 (0x3fbf bytes) 000021 1789430109.921024 mapwrite 0x029eff thru 0x038a8d (0xeb8f bytes) 000022 1789430110.049768 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38a8e): Mirror 4: 0x674876e6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38a8e): Mirror 4: 0x674876e6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38a8e: skipped 000025 1789430110.635829 read 0x03838c thru 0x038a8d (0x702 bytes) 000026 1789430110.656381 punch from 0x034aa2 to 0x038a8d (0x3fec bytes) 000029 1789430110.682235 mapwrite 0x02543e thru 0x027fcf (0x2b92 bytes) 000030 1789430110.815772 mapread 0x0270d2 thru 0x029546 (0x2475 bytes) 000032 1789430110.817269 mapwrite 0x01b6d8 thru 0x021de1 (0x670a bytes) 000033 1789430110.897245 write 0x0347e6 thru 0x03ffff (0xb81a bytes) 000034 1789430110.925547 MIRROR_RESYNC 2 mirrors truncating to largest ever: 0x1c3af 000037 1789430112.034097 trunc from 0x040000 to 0x01c3ae (0x23c51 bytes) 000039 1789430112.183212 mapread 0x0005a7 thru 0x004485 (0x3edf bytes) 000041 1789430112.230216 mapread 0x007ecd thru 0x0170fe (0xf232 bytes) 000042 1789430112.249216 write 0x03566d thru 0x03ffff (0xa993 bytes) 000043 1789430112.250766 write 0x008d1e thru 0x010e26 (0x8109 bytes) 000044 1789430112.258003 mapread 0x0020a8 thru 0x0046d7 (0x2630 bytes) 000045 1789430112.260874 read 0x00c44e thru 0x00fa7f (0x3632 bytes) 000048 1789430112.269383 write 0x01de82 thru 0x01e1b3 (0x332 bytes) 000051 1789430112.306397 read 0x015d6b thru 0x024971 (0xec07 bytes) 000052 1789430112.332931 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) truncating to largest ever: 0x27e9e 000053 1789430112.673857 trunc from 0x040000 to 0x027e9d (0x18162 bytes) 000054 1789430112.708398 punch from 0x00edfa to 0x00fd99 (0xfa0 bytes) 000055 1789430112.716709 mapwrite 0x03598d thru 0x03c222 (0x6896 bytes) 000058 1789430112.919538 punch from 0x01efcd to 0x022eab (0x3edf bytes) 000059 1789430112.931977 read 0x00f635 thru 0x01f4ec (0xfeb8 bytes) 000060 1789430112.958498 write 0x00c545 thru 0x014320 (0x7ddc bytes) 000061 1789430112.976044 read 0x024a54 thru 0x02a525 (0x5ad2 bytes) truncating to largest ever: 0x39b05 000062 1789430113.006248 trunc from 0x03c223 to 0x039b04 (0x271e bytes) 000063 1789430113.113795 MIRROR_EXTEND to 2 mirrors 000064 1789430115.514700 mapwrite 0x001c37 thru 0x00efdf (0xd3a9 bytes) 000065 1789430115.851609 read 0x00e72f thru 0x00e9ac (0x27e bytes) 000066 1789430115.852452 punch from 0x002247 to 0x0120d0 (0xfe8a bytes) 000067 1789430115.874579 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) 000069 1789430116.148490 punch from 0x02ce1a to 0x039b04 (0xcceb bytes) 000070 1789430116.160797 trunc from 0x039b05 to 0x0197c5 (0x2033f bytes) 000071 1789430116.207079 read 0x00bfc4 thru 0x00cab4 (0xaf1 bytes) 000072 1789430116.219479 mapread 0x00caf8 thru 0x00e6c7 (0x1bd0 bytes) 000074 1789430116.242033 mapread 0x00810d thru 0x017604 (0xf4f8 bytes) 000075 1789430116.270629 write 0x00b3d6 thru 0x018d53 (0xd97e bytes) 000076 1789430116.273267 mapwrite 0x001bdb thru 0x00da41 (0xbe67 bytes) 000077 1789430116.445603 punch from 0x0182bc to 0x018c97 (0x9dc bytes) 000078 1789430116.452171 write 0x02f22d thru 0x03da3a (0xe80e bytes) 000080 1789430116.464246 punch from 0x0383cb to 0x03da3a (0x5670 bytes) 000082 1789430116.507147 punch from 0x02c087 to 0x03717f (0xb0f9 bytes) 000083 1789430116.535087 punch from 0x018952 to 0x023597 (0xac46 bytes) 000084 1789430116.569063 write 0x003d78 thru 0x013a3c (0xfcc5 bytes) 000087 1789430116.576769 write 0x01501e thru 0x024af8 (0xfadb bytes) 000088 1789430116.607016 mapwrite 0x019e88 thru 0x029474 (0xf5ed bytes) 000090 1789430116.726139 write 0x0139b7 thru 0x020a09 (0xd053 bytes) 000092 1789430116.729233 write 0x00e3bd thru 0x013b84 (0x57c8 bytes) 000094 1789430116.731525 mapwrite 0x00a592 thru 0x014d52 (0xa7c1 bytes) 000095 1789430116.814374 punch from 0x017de3 to 0x0223ca (0xa5e8 bytes) 000096 1789430116.821790 trunc from 0x03da3b to 0x00c675 (0x313c5 bytes) 000097 1789430116.848004 write 0x008c22 thru 0x018aee (0xfecd bytes) 000098 1789430116.850594 read 0x00a6e9 thru 0x011cbc (0x75d4 bytes) 000099 1789430116.852078 trunc from 0x018aef to 0x02f887 (0x16d99 bytes) 000100 1789430116.874521 read 0x001dcb thru 0x0088dd (0x6b13 bytes) 000102 1789430116.876096 punch from 0x00f666 to 0x012ae3 (0x347e bytes) 000104 1789430116.895580 trunc from 0x02f888 to 0x037c77 (0x83f0 bytes) 000106 1789430116.919474 trunc from 0x037c78 to 0x00815a (0x2fb1d bytes) 000107 1789430116.938295 mapwrite 0x01899c thru 0x0195f4 (0xc59 bytes) 000108 1789430117.037292 read 0x0112ed thru 0x0195f4 (0x8308 bytes) truncating to largest ever: 0x3eedf 000111 1789430117.040471 trunc from 0x0195f5 to 0x03eede (0x258ea bytes) 000114 1789430117.068497 punch from 0x00f105 to 0x01e102 (0xeffe bytes) 000115 1789430117.075753 mapwrite 0x006003 thru 0x00ee0b (0x8e09 bytes) 000117 1789430117.145029 trunc from 0x03eedf to 0x014f96 (0x29f48 bytes) 000118 1789430117.167339 punch from 0x010028 to 0x014f96 (0x4f6f bytes) 000119 1789430117.181174 MIRROR_EXTEND to 2 mirrors 000120 1789430118.772702 MIRROR_RESYNC 2 mirrors 000121 1789430119.563582 MIRROR_EXTEND to 3 mirrors 000123 1789430120.904431 mapwrite 0x034ac5 thru 0x03acd4 (0x6210 bytes) 000125 1789430121.080301 write 0x03446b thru 0x036438 (0x1fce bytes) 000127 1789430121.083083 punch from 0x02e10d to 0x02e4d6 (0x3ca bytes) 000129 1789430121.094790 mapread 0x00e769 thru 0x018194 (0x9a2c bytes) 000130 1789430121.122124 MIRROR_RESYNC 3 mirrors 000131 1789430122.689197 write 0x012c6e thru 0x01d0e4 (0xa477 bytes) 000133 1789430122.886127 mapwrite 0x025e80 thru 0x03501f (0xf1a0 bytes) 000134 1789430122.993046 write 0x00af91 thru 0x01a864 (0xf8d4 bytes) 000136 1789430123.020019 read 0x0205a4 thru 0x026fca (0x6a27 bytes) 000138 1789430123.022535 mapwrite 0x0168c9 thru 0x018e81 (0x25b9 bytes) 000139 1789430123.148141 mapwrite 0x0119e1 thru 0x01a32f (0x894f bytes) 000141 1789430123.256467 punch from 0x008f1d to 0x0174b3 (0xe597 bytes) 000142 1789430123.294135 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3acd5): Mirror 3: 0x30f24f94 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3acd5): Mirror 3: 0x30f24f94 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3acd5: skipped 000143 1789430123.696411 write 0x0270fa thru 0x029dc8 (0x2ccf bytes) 000144 1789430123.711523 mapwrite 0x03ab9e thru 0x03ffff (0x5462 bytes) 000145 1789430123.827006 mapwrite 0x02f10c thru 0x032b32 (0x3a27 bytes) 000146 1789430123.905422 read 0x0205db thru 0x02c3d8 (0xbdfe bytes) 000147 1789430123.914015 read 0x022ec0 thru 0x031af1 (0xec32 bytes) 000150 1789430123.915663 trunc from 0x040000 to 0x037af5 (0x850a bytes) 000151 1789430123.935767 punch from 0x00c562 to 0x011feb (0x5a8a bytes) 000154 1789430123.945961 read 0x036131 thru 0x037af5 (0x19c5 bytes) 000155 1789430123.947003 punch from 0x00478c to 0x00b40d (0x6c82 bytes) 000156 1789430123.962075 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) 000157 1789430124.098042 read 0x0248e9 thru 0x026ca8 (0x23c0 bytes) 000159 1789430124.103661 trunc from 0x037af6 to 0x0011b4 (0x36941 bytes) truncating to largest ever: 0x3fb2e 000161 1789430124.136422 trunc from 0x0011b5 to 0x03fb2d (0x3e979 bytes) 000166 1789430124.161102 read 0x02fe2c thru 0x03a289 (0xa45e bytes) 000167 1789430124.176354 write 0x02c970 thru 0x02e7c9 (0x1e5a bytes) 000168 1789430124.190508 punch from 0x0017af to 0x004f99 (0x37eb bytes) 000172 1789430124.212179 MIRROR_EXTEND to 2 mirrors 000173 1789430125.260173 trunc from 0x03fb2e to 0x0178b9 (0x28274 bytes) 000174 1789430125.479965 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x178ba): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x178ba): Mirror 2: 0x5bf71ef3 (stale) CRC-32 checksum value for chunk [0, 0x178ba): Mirror 1: 0x5bf71ef3 Mirror 3: 0x5bf71ef3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x178ba: skipped 000178 1789430126.794879 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x178ba): Mirror 2: 0x5bf71ef3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x178ba): Mirror 2: 0x5bf71ef3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x178ba: skipped 000179 1789430127.182457 punch from 0x002646 to 0x008149 (0x5b04 bytes) 000180 1789430127.197696 mapread 0x0154a6 thru 0x0178b9 (0x2414 bytes) 000181 1789430127.220948 mapread 0x00dde4 thru 0x00eae5 (0xd02 bytes) 000182 1789430127.246598 read 0x0149f6 thru 0x0178b9 (0x2ec4 bytes) 000185 1789430127.248176 mapread 0x00b180 thru 0x00fe0c (0x4c8d bytes) 000187 1789430127.253768 trunc from 0x0178ba to 0x023497 (0xbbde bytes) 000188 1789430127.294594 write 0x013a92 thru 0x023674 (0xfbe3 bytes) 000189 1789430127.305535 write 0x01270a thru 0x013a9b (0x1392 bytes) 000191 1789430127.306972 mapread 0x004ecb thru 0x007158 (0x228e bytes) 000193 1789430127.321550 mapread 0x00b33b thru 0x00da38 (0x26fe bytes) 000194 1789430127.322791 read 0x01a13e thru 0x01b627 (0x14ea bytes) truncating to largest ever: 0x3fd68 000195 1789430127.324463 trunc from 0x023675 to 0x03fd67 (0x1c6f3 bytes) 000196 1789430127.349351 read 0x006c17 thru 0x00d138 (0x6522 bytes) 000197 1789430127.350280 mapread 0x034818 thru 0x03a22f (0x5a18 bytes) 000198 1789430127.362785 write 0x01f3f4 thru 0x01f892 (0x49f bytes) 000199 1789430127.363455 write 0x0123c5 thru 0x0160ed (0x3d29 bytes) 000200 1789430127.368258 MIRROR_RESYNC 2 mirrors 000201 1789430128.251071 trunc from 0x03fd68 to 0x02b778 (0x145ef bytes) 000203 1789430128.416542 trunc from 0x02b779 to 0x016298 (0x154e0 bytes) 000204 1789430128.465420 mapwrite 0x02d187 thru 0x034af5 (0x796f bytes) 000206 1789430128.611191 mapwrite 0x02808d thru 0x02a433 (0x23a7 bytes) 000207 1789430128.701687 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) 000211 1789430128.907405 mapread 0x031ac9 thru 0x034af5 (0x302d bytes) 000214 1789430128.932725 read 0x02e45e thru 0x033450 (0x4ff3 bytes) 000215 1789430128.933413 mapwrite 0x02bf85 thru 0x038854 (0xc8d0 bytes) 000216 1789430129.027351 punch from 0x0168fe to 0x01d0b1 (0x67b4 bytes) 000217 1789430129.038601 mapread 0x02ecb1 thru 0x038854 (0x9ba4 bytes) 000218 1789430129.039596 mapread 0x010ef7 thru 0x01389a (0x29a4 bytes) 000221 1789430129.052069 trunc from 0x038855 to 0x014c23 (0x23c31 bytes) 000222 1789430129.077712 write 0x00b154 thru 0x01b097 (0xff44 bytes) 000225 1789430129.080381 mapread 0x0155ca thru 0x01b097 (0x5ace bytes) 000226 1789430129.081300 write 0x03e105 thru 0x03ffff (0x1efb bytes) 000227 1789430129.084342 mapwrite 0x02f472 thru 0x03e2bb (0xee4a bytes) 000228 1789430129.173729 punch from 0x00eaf2 to 0x01620e (0x771d bytes) 000229 1789430129.179572 trunc from 0x040000 to 0x002620 (0x3d9df bytes) 000231 1789430129.199174 write 0x028ca8 thru 0x031462 (0x87bb bytes) truncating to largest ever: 0x3fee9 000232 1789430129.200496 trunc from 0x031463 to 0x03fee8 (0xea86 bytes) 000233 1789430129.226092 trunc from 0x03fee9 to 0x039147 (0x6da1 bytes) 000235 1789430129.247381 mapwrite 0x018db1 thru 0x024f35 (0xc185 bytes) 000237 1789430129.341165 trunc from 0x039148 to 0x001ff2 (0x37155 bytes) 000238 1789430129.365626 punch from 0x000fad to 0x001ff2 (0x1046 bytes) 000239 1789430129.370841 write 0x0294c2 thru 0x02ca61 (0x35a0 bytes) 000240 1789430129.383593 MIRROR_EXTEND to 2 mirrors 000241 1789430130.453065 MIRROR_RESYNC 2 mirrors 000243 1789430130.827755 read 0x00a07d thru 0x010ad0 (0x6a54 bytes) 000246 1789430130.843315 mapread 0x01ac24 thru 0x025de8 (0xb1c5 bytes) 000247 1789430130.878303 read 0x01a5ff thru 0x01b389 (0xd8b bytes) 000248 1789430130.878869 mapread 0x025960 thru 0x025997 (0x38 bytes) 000249 1789430130.880261 read 0x01ad25 thru 0x026b53 (0xbe2f bytes) 000251 1789430130.885280 MIRROR_EXTEND to 3 mirrors 000252 1789430131.752254 mapwrite 0x03ec6f thru 0x03ffff (0x1391 bytes) 000254 1789430131.892272 mapread 0x010b83 thru 0x01d83b (0xccb9 bytes) 000256 1789430131.904200 read 0x03d43b thru 0x03db7f (0x745 bytes) 000257 1789430131.910777 trunc from 0x040000 to 0x024cd5 (0x1b32a bytes) 000258 1789430131.929198 mapread 0x01f5d2 thru 0x024cd5 (0x5704 bytes) 000260 1789430131.934078 mapread 0x01ef57 thru 0x024cd5 (0x5d7f bytes) 000261 1789430131.934621 write 0x03a0e6 thru 0x03d6ae (0x35c9 bytes) 000262 1789430131.935336 write 0x03bf6d thru 0x03ffff (0x4093 bytes) 000263 1789430131.936006 mapwrite 0x027c13 thru 0x02cf46 (0x5334 bytes) 000264 1789430131.986760 mapwrite 0x030af1 thru 0x03689f (0x5daf bytes) 000266 1789430132.066197 mapwrite 0x010fd9 thru 0x015fcc (0x4ff4 bytes) 000267 1789430132.134259 mapwrite 0x019555 thru 0x01f45e (0x5f0a bytes) 000268 1789430132.200410 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x53c8bcfe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x53c8bcfe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000269 1789430132.466064 punch from 0x02abfb to 0x0350c7 (0xa4cd bytes) 000270 1789430132.470056 trunc from 0x040000 to 0x007f58 (0x380a7 bytes) 000272 1789430132.482184 write 0x00b8a4 thru 0x0130b6 (0x7813 bytes) 000273 1789430132.484047 read 0x0010d5 thru 0x00ee28 (0xdd54 bytes) 000274 1789430132.497189 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) 000278 1789430132.671721 trunc from 0x0130b7 to 0x01fdb1 (0xccfb bytes) 000279 1789430132.694586 trunc from 0x01fdb2 to 0x000bb9 (0x1f1f8 bytes) 000281 1789430132.724302 MIRROR_EXTEND to 2 mirrors 000282 1789430133.394677 MIRROR_RESYNC 2 mirrors 000283 1789430133.756242 trunc from 0x000bba to 0x01bddf (0x1b226 bytes) 000284 1789430133.858245 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) 000285 1789430134.029484 mapread 0x000577 thru 0x00dc37 (0xd6c1 bytes) 000286 1789430134.084303 read 0x00dad1 thru 0x01b65c (0xdb8c bytes) 000288 1789430134.111137 mapread 0x01a1f4 thru 0x01bddf (0x1bec bytes) 000291 1789430134.115603 mapread 0x018bb3 thru 0x019edc (0x132a bytes) 000293 1789430134.123921 MIRROR_EXTEND to 2 mirrors 000295 1789430135.151887 write 0x0000ea thru 0x000621 (0x538 bytes) 000296 1789430135.267274 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1bde0): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1bde0): Mirror 2: 0xaed6472c (stale) CRC-32 checksum value for chunk [0, 0x1bde0): Mirror 1: 0x661dd6e0 Mirror 3: 0x661dd6e0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1bde0: skipped 000298 1789430136.586444 write 0x023ac3 thru 0x02ad1c (0x725a bytes) 000299 1789430136.710565 mapread 0x006e59 thru 0x00b33c (0x44e4 bytes) 000300 1789430136.731548 write 0x00266e thru 0x00fa3c (0xd3cf bytes) 000301 1789430136.732840 trunc from 0x02ad1d to 0x023811 (0x750b bytes) 000303 1789430136.755493 mapread 0x000cd3 thru 0x00e88c (0xdbba bytes) 000304 1789430136.763152 read 0x008c3e thru 0x015357 (0xc71a bytes) 000305 1789430136.776898 MIRROR_RESYNC 3 mirrors 000306 1789430138.610756 trunc from 0x023812 to 0x024bd0 (0x13bf bytes) 000307 1789430138.803022 mapwrite 0x02f91e thru 0x0355a1 (0x5c84 bytes) 000308 1789430139.033764 write 0x0114c6 thru 0x016c15 (0x5750 bytes) 000309 1789430139.068917 mapread 0x024843 thru 0x02b6e4 (0x6ea2 bytes) 000310 1789430139.099045 trunc from 0x0355a2 to 0x010ce5 (0x248bc bytes) 000312 1789430139.154519 write 0x0050b8 thru 0x012117 (0xd060 bytes) 000313 1789430139.179859 mapwrite 0x011d28 thru 0x01defc (0xc1d5 bytes) 000314 1789430139.432715 punch from 0x014c88 to 0x01defc (0x9275 bytes) 000315 1789430139.440610 read 0x00827c thru 0x009540 (0x12c5 bytes) 000316 1789430139.441947 write 0x032f82 thru 0x03f8c0 (0xc93f bytes) 000319 1789430139.447111 read 0x01add8 thru 0x023cf4 (0x8f1d bytes) 000321 1789430139.460106 read 0x000bcf thru 0x00d118 (0xc54a bytes) 000322 1789430139.462537 mapread 0x0312b0 thru 0x03a204 (0x8f55 bytes) 000326 1789430139.471744 write 0x03b17e thru 0x03ffff (0x4e82 bytes) 000327 1789430139.475546 read 0x0164fb thru 0x01a3fd (0x3f03 bytes) 000329 1789430139.483485 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa63406a0 (stale) Mirror 3: 0xa63406a0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcbf142f0 Mirror 4: 0xcbf142f0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000330 1789430141.161686 read 0x029e1a thru 0x0373ee (0xd5d5 bytes) 000331 1789430141.201283 punch from 0x009844 to 0x016175 (0xc932 bytes) 000332 1789430141.456209 trunc from 0x040000 to 0x003e74 (0x3c18b bytes) 000335 1789430141.503167 mapwrite 0x0323d1 thru 0x03dc5b (0xb88b bytes) 000336 1789430141.613470 mapread 0x018a64 thru 0x02802e (0xf5cb bytes) 000337 1789430141.636876 trunc from 0x03dc5c to 0x026bb9 (0x170a2 bytes) 000338 1789430141.661196 punch from 0x013e1d to 0x01cbc6 (0x8daa bytes) 000339 1789430141.669822 mapwrite 0x036a66 thru 0x03ffff (0x959a bytes) 000340 1789430141.771723 trunc from 0x040000 to 0x024018 (0x1bfe7 bytes) 000341 1789430141.802155 write 0x01d8a3 thru 0x028b12 (0xb270 bytes) 000343 1789430141.806505 mapwrite 0x037338 thru 0x03ffff (0x8cc8 bytes) 000345 1789430141.910314 read 0x02ee17 thru 0x02f125 (0x30f bytes) 000346 1789430141.929766 punch from 0x03e42a to 0x03ffff (0x1bd6 bytes) 000347 1789430141.936773 punch from 0x02b4c5 to 0x034c39 (0x9775 bytes) 000348 1789430141.946802 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa63406a0 (stale) Mirror 3: 0xa63406a0 (stale) Mirror 4: 0xcbf142f0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x65438783 Mirror 5: 0x65438783 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000349 1789430143.525178 punch from 0x026cae to 0x029a0b (0x2d5e bytes) 000350 1789430143.616379 read 0x021a53 thru 0x027f03 (0x64b1 bytes) 000351 1789430143.628328 mapread 0x014246 thru 0x01d9d0 (0x978b bytes) 000352 1789430143.657370 mapread 0x01a376 thru 0x025df3 (0xba7e bytes) 000354 1789430143.670964 punch from 0x034e9c to 0x03ffff (0xb164 bytes) 000355 1789430143.683062 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa63406a0 (stale) Mirror 4: 0xcbf142f0 (stale) Mirror 5: 0x65438783 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa63406a0 (stale) Mirror 4: 0xcbf142f0 (stale) Mirror 5: 0x65438783 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000356 1789430144.172573 punch from 0x03e828 to 0x03ffff (0x17d8 bytes) 000357 1789430144.181578 mapwrite 0x03a2d7 thru 0x03d94e (0x3678 bytes) 000362 1789430144.261366 read 0x01eaa7 thru 0x024a66 (0x5fc0 bytes) 000363 1789430144.269524 trunc from 0x040000 to 0x004ed6 (0x3b129 bytes) 000364 1789430144.296372 read 0x001579 thru 0x004ed6 (0x395e bytes) 000365 1789430144.305988 punch from 0x001848 to 0x004ed6 (0x368f bytes) 000366 1789430144.311743 read 0x000599 thru 0x004ed6 (0x493e bytes) 000367 1789430144.326371 write 0x00b281 thru 0x011c6b (0x69eb bytes) 000369 1789430144.329151 write 0x02e05b thru 0x031944 (0x38ea bytes) 000370 1789430144.331044 mapwrite 0x00d435 thru 0x00e595 (0x1161 bytes) 000371 1789430144.387502 MIRROR_RESYNC 4 mirrors 000373 1789430146.319360 read 0x0068e5 thru 0x006ded (0x509 bytes) 000374 1789430146.331400 read 0x013730 thru 0x0206dd (0xcfae bytes) 000377 1789430146.353106 read 0x015337 thru 0x01d293 (0x7f5d bytes) 000378 1789430146.353485 read 0x029036 thru 0x02eeff (0x5eca bytes) 000379 1789430146.366056 MIRROR_EXTEND to 5 mirrors 000380 1789430147.266407 trunc from 0x031945 to 0x02936a (0x85da bytes) 000381 1789430147.396091 write 0x004bd8 thru 0x0060c7 (0x14f0 bytes) 000382 1789430147.413459 write 0x020322 thru 0x02d812 (0xd4f1 bytes) 000383 1789430147.422630 punch from 0x0014f1 to 0x001c10 (0x720 bytes) 000384 1789430147.439739 punch from 0x02d31e to 0x02d812 (0x4f5 bytes) 000385 1789430147.446079 write 0x039606 thru 0x03d5ed (0x3fe8 bytes) 000386 1789430147.448415 punch from 0x03c657 to 0x03d5ed (0xf97 bytes) 000387 1789430147.466700 mapwrite 0x01ea79 thru 0x01f1d6 (0x75e bytes) 000388 1789430147.531325 MIRROR_RESYNC 5 mirrors 000389 1789430150.200610 write 0x033104 thru 0x03ffff (0xcefc bytes) 000390 1789430150.299602 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x204dae24 (stale) Mirror 4: 0x204dae24 (stale) Mirror 5: 0x204dae24 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x204dae24 (stale) Mirror 4: 0x204dae24 (stale) Mirror 5: 0x204dae24 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000391 1789430150.885722 MIRROR_RESYNC 4 mirrors 000392 1789430153.122618 punch from 0x017ab8 to 0x020e10 (0x9359 bytes) 000393 1789430153.238294 mapwrite 0x007b9f thru 0x00e4da (0x693c bytes) 000394 1789430153.376193 punch from 0x0390dd to 0x03ffff (0x6f23 bytes) 000395 1789430153.409117 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x6f6a5377 (stale) Mirror 5: 0x6f6a5377 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x6f6a5377 (stale) Mirror 5: 0x6f6a5377 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000396 1789430153.958353 mapwrite 0x01bba5 thru 0x024cda (0x9136 bytes) 000397 1789430154.124789 write 0x015d6c thru 0x01961e (0x38b3 bytes) 000399 1789430154.136512 punch from 0x01d86e to 0x021cd6 (0x4469 bytes) 000401 1789430154.161268 punch from 0x006966 to 0x00adfb (0x4496 bytes) 000402 1789430154.174158 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x6f6a5377 (stale) Mirror 5: 0x6f6a5377 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x81d38348 Mirror 6: 0x81d38348 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000405 1789430155.839514 trunc from 0x040000 to 0x016e4c (0x291b3 bytes) 000406 1789430155.943201 write 0x00c7be thru 0x0150e9 (0x892c bytes) 000409 1789430155.956421 mapread 0x0089a4 thru 0x0101a9 (0x7806 bytes) 000410 1789430155.978365 punch from 0x011292 to 0x016e4c (0x5bbb bytes) 000412 1789430155.995956 punch from 0x00a094 to 0x00e904 (0x4871 bytes) 000414 1789430156.007147 punch from 0x00e581 to 0x016e4c (0x88cc bytes) 000415 1789430156.013352 mapwrite 0x001dc0 thru 0x001e64 (0xa5 bytes) 000416 1789430156.078861 mapread 0x00aa9d thru 0x01696c (0xbed0 bytes) 000417 1789430156.089475 read 0x001ca8 thru 0x00e0c4 (0xc41d bytes) 000419 1789430156.091357 trunc from 0x016e4d to 0x01db90 (0x6d44 bytes) 000420 1789430156.115874 trunc from 0x01db91 to 0x016f15 (0x6c7b bytes) 000421 1789430156.137172 punch from 0x00abf4 to 0x016f15 (0xc322 bytes) 000422 1789430156.144478 read 0x00d2d2 thru 0x014b17 (0x7846 bytes) 000423 1789430156.155113 mapread 0x0049ed thru 0x013c1e (0xf232 bytes) 000424 1789430156.156449 punch from 0x00af81 to 0x011e29 (0x6ea9 bytes) 000425 1789430156.163081 write 0x00a80c thru 0x015679 (0xae6e bytes) 000427 1789430156.173275 read 0x002a89 thru 0x01150e (0xea86 bytes) 000429 1789430156.183629 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x16f16): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16f16): Mirror 4: 0x2ac5198 (stale) Mirror 5: 0x2ac5198 (stale) Mirror 6: 0x8c6d9115 (stale) CRC-32 checksum value for chunk [0, 0x16f16): Mirror 1: 0x15619d3b Mirror 7: 0x15619d3b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16f16: skipped 000430 1789430157.727583 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x16f16): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16f16): Mirror 4: 0x2ac5198 (stale) Mirror 5: 0x2ac5198 (stale) Mirror 6: 0x8c6d9115 (stale) CRC-32 checksum value for chunk [0, 0x16f16): Mirror 1: 0x15619d3b Mirror 7: 0x15619d3b Mirror 8: 0x15619d3b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16f16: skipped 000433 1789430159.637541 punch from 0x00dad7 to 0x0123bb (0x48e5 bytes) 000434 1789430159.740590 write 0x014862 thru 0x01d768 (0x8f07 bytes) 000435 1789430159.754885 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1d769): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d769): Mirror 4: 0x1dbfff66 (stale) Mirror 5: 0x1dbfff66 (stale) Mirror 6: 0x42cb0a93 (stale) Mirror 7: 0x5ad32447 (stale) Mirror 8: 0x5ad32447 (stale) CRC-32 checksum value for chunk [0, 0x1d769): Mirror 1: 0xaf523eb8 Mirror 9: 0xaf523eb8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d769: skipped 000437 1789430161.360551 trunc from 0x01d769 to 0x0234f0 (0x5d88 bytes) 000438 1789430161.466959 trunc from 0x0234f1 to 0x02dc36 (0xa746 bytes) 000439 1789430161.500170 mapwrite 0x010f9c thru 0x01ff8a (0xefef bytes) 000440 1789430161.576069 punch from 0x00a534 to 0x015b2a (0xb5f7 bytes) 000441 1789430161.583162 trunc from 0x02dc37 to 0x0296dd (0x4559 bytes) 000443 1789430161.605592 mapread 0x018a6e thru 0x0230d6 (0xa669 bytes) 000444 1789430161.607698 read 0x00fe33 thru 0x0133f0 (0x35be bytes) 000445 1789430161.617335 read 0x00cdda thru 0x00ff6f (0x3196 bytes) 000446 1789430161.628167 write 0x016a16 thru 0x01bddf (0x53ca bytes) 000447 1789430161.629365 mapread 0x002b4d thru 0x00468d (0x1b41 bytes) 000448 1789430161.630271 read 0x00abf0 thru 0x0172a3 (0xc6b4 bytes) 000450 1789430161.637765 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x296de): Mirror 5: 0xaa2aea91 (stale) Mirror 6: 0x8679caf1 (stale) Mirror 7: 0x7c63b87a (stale) Mirror 8: 0x7c63b87a (stale) Mirror 9: 0x6d7e6b21 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x296de): Mirror 5: 0xaa2aea91 (stale) Mirror 6: 0x8679caf1 (stale) Mirror 7: 0x7c63b87a (stale) Mirror 8: 0x7c63b87a (stale) Mirror 9: 0x6d7e6b21 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x296de: skipped 000452 1789430162.375122 mapread 0x006295 thru 0x00bb5f (0x58cb bytes) 000453 1789430162.392703 mapwrite 0x022159 thru 0x03168e (0xf536 bytes) 000455 1789430162.490227 write 0x0174d5 thru 0x01c763 (0x528f bytes) 000456 1789430162.498033 mapread 0x00c7f3 thru 0x017713 (0xaf21 bytes) 000457 1789430162.512538 mapwrite 0x020c39 thru 0x02a68a (0x9a52 bytes) 000458 1789430162.587981 trunc from 0x03168f to 0x0190ec (0x185a2 bytes) 000459 1789430162.614491 mapread 0x013971 thru 0x015a1d (0x20ad bytes) 000461 1789430162.619339 trunc from 0x0190ed to 0x002315 (0x16dd7 bytes) 000462 1789430162.650414 mapread 0x001366 thru 0x001ac2 (0x75d bytes) 000463 1789430162.653419 mapwrite 0x03c884 thru 0x03e240 (0x19bd bytes) 000464 1789430162.806930 mapwrite 0x016bd5 thru 0x019f93 (0x33bf bytes) 000465 1789430162.960689 mapread 0x034610 thru 0x0397ba (0x51ab bytes) 000466 1789430162.976205 read 0x02f2c9 thru 0x03d32d (0xe065 bytes) 000467 1789430162.977379 punch from 0x02a08f to 0x02cb72 (0x2ae4 bytes) 000468 1789430162.982396 punch from 0x010c0e to 0x020312 (0xf705 bytes) 000469 1789430162.988432 write 0x010395 thru 0x018c56 (0x88c2 bytes) 000470 1789430163.009753 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e241): Mirror 6: 0xd2f5921f (stale) Mirror 7: 0xef0f6d7 (stale) Mirror 8: 0xef0f6d7 (stale) Mirror 9: 0x4e80d9de (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e241): Mirror 6: 0xd2f5921f (stale) Mirror 7: 0xef0f6d7 (stale) Mirror 8: 0xef0f6d7 (stale) Mirror 9: 0x4e80d9de (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e241: skipped 000471 1789430163.385540 punch from 0x01e2fd to 0x027b6f (0x9873 bytes) 000474 1789430163.396173 mapread 0x01a897 thru 0x0221d0 (0x793a bytes) 000475 1789430163.421687 mapread 0x01e80a thru 0x0218f4 (0x30eb bytes) 000477 1789430163.423140 mapread 0x012020 thru 0x01b11f (0x9100 bytes) 000478 1789430163.433914 punch from 0x01a39d to 0x01de0c (0x3a70 bytes) 000480 1789430163.444164 mapwrite 0x033af8 thru 0x035001 (0x150a bytes) 000481 1789430163.505521 mapwrite 0x00db88 thru 0x013f39 (0x63b2 bytes) 000482 1789430163.558435 read 0x01c8d1 thru 0x01cf11 (0x641 bytes) 000483 1789430163.578513 mapwrite 0x00307a thru 0x00e2b8 (0xb23f bytes) 000484 1789430163.686999 write 0x00596a thru 0x011d40 (0xc3d7 bytes) 000485 1789430163.692726 read 0x02519c thru 0x026ade (0x1943 bytes) 000486 1789430163.706070 punch from 0x03dd24 to 0x03e240 (0x51d bytes) 000487 1789430163.728344 write 0x01dd1b thru 0x02d9db (0xfcc1 bytes) 000488 1789430163.730540 punch from 0x02208d to 0x0316fd (0xf671 bytes) 000492 1789430163.758782 MIRROR_RESYNC 5 mirrors 000493 1789430167.761887 mapread 0x01dab8 thru 0x0276a9 (0x9bf2 bytes) 000497 1789430167.817348 MIRROR_EXTEND to 6 mirrors 000498 1789430169.100046 read 0x004aa7 thru 0x00b72a (0x6c84 bytes) 000499 1789430169.109260 write 0x009013 thru 0x00bc1e (0x2c0c bytes) 000501 1789430169.220296 read 0x00a13b thru 0x0133b4 (0x927a bytes) 000502 1789430169.235558 mapread 0x035d47 thru 0x03e240 (0x84fa bytes) 000503 1789430169.244923 MIRROR_RESYNC 6 mirrors 000504 1789430173.100563 trunc from 0x03e241 to 0x02bb86 (0x126ba bytes) 000506 1789430173.290965 write 0x0082e7 thru 0x014e49 (0xcb63 bytes) 000507 1789430173.321368 mapwrite 0x0270f9 thru 0x029bfb (0x2b03 bytes) 000508 1789430173.455442 mapread 0x01cf77 thru 0x020a0c (0x3a96 bytes) 000510 1789430173.471238 write 0x02b216 thru 0x03907d (0xde68 bytes) 000511 1789430173.474880 punch from 0x02d051 to 0x03907d (0xc02d bytes) 000514 1789430173.508922 mapwrite 0x0055f7 thru 0x014676 (0xf080 bytes) 000515 1789430173.635078 read 0x027c62 thru 0x034320 (0xc6bf bytes) 000517 1789430173.650012 write 0x02134c thru 0x0311d5 (0xfe8a bytes) 000520 1789430173.667312 MIRROR_RESYNC 6 mirrors 000522 1789430175.780803 trunc from 0x03907e to 0x018d57 (0x20326 bytes) 000523 1789430175.887686 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18d58): Mirror 7: 0x466ad2cf (stale) Mirror 8: 0x466ad2cf (stale) Mirror 9: 0x466ad2cf (stale) Mirror 10: 0x466ad2cf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18d58): Mirror 7: 0x466ad2cf (stale) Mirror 8: 0x466ad2cf (stale) Mirror 9: 0x466ad2cf (stale) Mirror 10: 0x466ad2cf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18d58: skipped 000524 1789430176.379418 trunc from 0x018d58 to 0x00b4b9 (0xd89e bytes) 000525 1789430176.396092 punch from 0x0093f1 to 0x00b4b9 (0x20c9 bytes) 000526 1789430176.403732 mapread 0x004c01 thru 0x00b4b9 (0x68b9 bytes) 000527 1789430176.417365 punch from 0x000ffb to 0x007136 (0x613c bytes) 000529 1789430176.421264 write 0x03f910 thru 0x03ffff (0x6f0 bytes) 000530 1789430176.427061 MIRROR_RESYNC 5 mirrors 000531 1789430178.941832 trunc from 0x040000 to 0x008192 (0x37e6d bytes) 000534 1789430179.062417 mapwrite 0x02a2c1 thru 0x02b199 (0xed9 bytes) 000535 1789430179.174966 read 0x0006d3 thru 0x006c69 (0x6597 bytes) 000536 1789430179.197573 trunc from 0x02b19a to 0x00dcd5 (0x1d4c4 bytes) 000537 1789430179.221339 punch from 0x00ac7b to 0x00dcd5 (0x305b bytes) 000538 1789430179.226766 read 0x0015b1 thru 0x0096d5 (0x8125 bytes) 000539 1789430179.268849 mapread 0x00a0f9 thru 0x00dcd5 (0x3bdd bytes) 000540 1789430179.269796 trunc from 0x00dcd6 to 0x00c8eb (0x13ea bytes) 000544 1789430179.343483 MIRROR_RESYNC 5 mirrors 000545 1789430181.189815 read 0x0002d2 thru 0x005456 (0x5185 bytes) 000546 1789430181.206094 MIRROR_EXTEND to 6 mirrors 000547 1789430182.015385 punch from 0x004122 to 0x00c8eb (0x87ca bytes) 000548 1789430182.109092 mapwrite 0x0384ff thru 0x03ffff (0x7b01 bytes) 000549 1789430182.231997 read 0x00ea0a thru 0x01e516 (0xfb0d bytes) 000550 1789430182.249051 trunc from 0x040000 to 0x0042d0 (0x3bd2f bytes) 000552 1789430182.273125 write 0x007a7a thru 0x015e6d (0xe3f4 bytes) 000555 1789430182.277183 punch from 0x00d66b to 0x013a2e (0x63c4 bytes) 000557 1789430182.302469 mapwrite 0x00f0a0 thru 0x01c9ba (0xd91b bytes) 000558 1789430182.475956 read 0x01115d thru 0x01c76f (0xb613 bytes) 000559 1789430182.477861 mapread 0x018c4c thru 0x01c9ba (0x3d6f bytes) 000560 1789430182.479393 read 0x002584 thru 0x002b55 (0x5d2 bytes) 000562 1789430182.501552 mapwrite 0x01c56d thru 0x01cf04 (0x998 bytes) 000564 1789430182.603548 mapread 0x01568f thru 0x01cbb8 (0x752a bytes) 000567 1789430182.606587 mapread 0x01a2c2 thru 0x01cf04 (0x2c43 bytes) 000568 1789430182.608187 write 0x038dbf thru 0x03a045 (0x1287 bytes) 000571 1789430182.612716 write 0x02cc4f thru 0x0366f8 (0x9aaa bytes) 000572 1789430182.622178 mapwrite 0x02d607 thru 0x03614b (0x8b45 bytes) 000575 1789430182.719252 trunc from 0x03a046 to 0x03e230 (0x41eb bytes) 000576 1789430182.743930 punch from 0x01ae2e to 0x01be05 (0xfd8 bytes) 000577 1789430182.751129 mapread 0x019f04 thru 0x024d1b (0xae18 bytes) 000578 1789430182.768400 trunc from 0x03e231 to 0x00be48 (0x323e8 bytes) 000579 1789430182.803141 read 0x003158 thru 0x00be48 (0x8cf1 bytes) 000581 1789430182.804850 mapwrite 0x019f86 thru 0x01cdeb (0x2e66 bytes) 000585 1789430182.896707 punch from 0x00ee63 to 0x019f2c (0xb0ca bytes) 000586 1789430182.902686 read 0x00aacf thru 0x00af0b (0x43d bytes) 000590 1789430182.904884 mapwrite 0x03fcef thru 0x03ffff (0x311 bytes) 000591 1789430183.005903 read 0x037035 thru 0x03a5be (0x358a bytes) 000592 1789430183.007133 write 0x011f2a thru 0x01e64b (0xc722 bytes) 000593 1789430183.010320 mapread 0x03de8c thru 0x03ffff (0x2174 bytes) 000594 1789430183.011817 read 0x03a3c5 thru 0x03e2ff (0x3f3b bytes) 000595 1789430183.012580 write 0x039663 thru 0x03ffff (0x699d bytes) 000598 1789430183.015229 write 0x011609 thru 0x01817f (0x6b77 bytes) 000599 1789430183.017216 read 0x038578 thru 0x03ffff (0x7a88 bytes) 000600 1789430183.018433 write 0x006b3e thru 0x011710 (0xabd3 bytes) 000601 1789430183.020470 read 0x02196e thru 0x02b348 (0x99db bytes) 000602 1789430183.022089 mapread 0x028daa thru 0x030cec (0x7f43 bytes) 000603 1789430183.023672 write 0x031cc0 thru 0x03534d (0x368e bytes) 000606 1789430183.026418 mapwrite 0x03bbc2 thru 0x03ffff (0x443e bytes) 000608 1789430183.082485 write 0x01a51e thru 0x01d6b2 (0x3195 bytes) 000609 1789430183.083621 mapwrite 0x03e7ce thru 0x03ffff (0x1832 bytes) 000610 1789430183.137101 write 0x030d00 thru 0x039684 (0x8985 bytes) 000611 1789430183.140711 trunc from 0x040000 to 0x017e68 (0x28197 bytes) 000613 1789430183.178456 trunc from 0x017e69 to 0x00461f (0x13849 bytes) 000615 1789430183.202775 read 0x00181b thru 0x00461f (0x2e05 bytes) 000616 1789430183.204885 read 0x003fc7 thru 0x00461f (0x659 bytes) 000617 1789430183.206088 mapwrite 0x021ad5 thru 0x0260e3 (0x460f bytes) 000618 1789430183.292723 punch from 0x0118c8 to 0x013c42 (0x237b bytes) 000619 1789430183.309303 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x260e4): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x260e4): Mirror 7: 0xc2e6d0d3 (stale) Mirror 8: 0xc2e6d0d3 (stale) Mirror 9: 0xc2e6d0d3 (stale) Mirror 10: 0xc2e6d0d3 (stale) Mirror 11: 0xc2e6d0d3 (stale) CRC-32 checksum value for chunk [0, 0x260e4): Mirror 1: 0xc4e66824 Mirror 12: 0xc4e66824 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x260e4: skipped 000620 1789430184.711977 read 0x023488 thru 0x0260e3 (0x2c5c bytes) 000621 1789430184.740072 read 0x006723 thru 0x00ca39 (0x6317 bytes) 000622 1789430184.826598 write 0x0234b4 thru 0x02bbc4 (0x8711 bytes) 000623 1789430185.086846 mapwrite 0x02bc1f thru 0x02d600 (0x19e2 bytes) 000625 1789430185.278172 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2d601): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d601): Mirror 7: 0x504b44d0 (stale) Mirror 8: 0x504b44d0 (stale) Mirror 9: 0x504b44d0 (stale) Mirror 10: 0x504b44d0 (stale) Mirror 11: 0x504b44d0 (stale) Mirror 12: 0xedf69e74 (stale) CRC-32 checksum value for chunk [0, 0x2d601): Mirror 1: 0xe4599f34 Mirror 13: 0xe4599f34 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d601: skipped 000626 1789430186.762352 write 0x00c53a thru 0x00d0aa (0xb71 bytes) 000628 1789430186.874508 trunc from 0x02d601 to 0x02ffb1 (0x29b1 bytes) 000629 1789430186.896704 mapwrite 0x003c24 thru 0x004a0c (0xde9 bytes) 000630 1789430186.960270 mapwrite 0x03d92f thru 0x03ffff (0x26d1 bytes) 000632 1789430187.061188 read 0x03d960 thru 0x03dda9 (0x44a bytes) 000635 1789430187.065248 read 0x0292b6 thru 0x031a22 (0x876d bytes) 000636 1789430187.083917 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x8bdd1211 (stale) Mirror 9: 0x8bdd1211 (stale) Mirror 10: 0x8bdd1211 (stale) Mirror 11: 0x8bdd1211 (stale) Mirror 12: 0x38869986 (stale) Mirror 13: 0xb4f50fff (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x8bdd1211 (stale) Mirror 9: 0x8bdd1211 (stale) Mirror 10: 0x8bdd1211 (stale) Mirror 11: 0x8bdd1211 (stale) Mirror 12: 0x38869986 (stale) Mirror 13: 0xb4f50fff (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000637 1789430187.573322 read 0x03c1b4 thru 0x03ffff (0x3e4c bytes) 000638 1789430187.583571 read 0x02d7ab thru 0x03ab18 (0xd36e bytes) 000639 1789430187.609355 MIRROR_RESYNC 7 mirrors 000642 1789430190.741722 punch from 0x011916 to 0x0180b3 (0x679e bytes) 000643 1789430190.810931 write 0x0002a8 thru 0x003b0f (0x3868 bytes) 000644 1789430190.826772 mapread 0x022d3f thru 0x0260ed (0x33af bytes) 000645 1789430190.847104 write 0x01bfb8 thru 0x023f7c (0x7fc5 bytes) 000646 1789430190.854594 write 0x02a1b9 thru 0x0323c9 (0x8211 bytes) 000648 1789430190.886496 MIRROR_RESYNC 7 mirrors 000650 1789430194.830317 read 0x001131 thru 0x006f10 (0x5de0 bytes) 000651 1789430194.840840 read 0x015be7 thru 0x01c3f5 (0x680f bytes) 000654 1789430194.863727 mapwrite 0x017b97 thru 0x0194f2 (0x195c bytes) 000655 1789430195.014255 read 0x00ca1c thru 0x00f017 (0x25fc bytes) 000656 1789430195.024528 punch from 0x009466 to 0x00bf45 (0x2ae0 bytes) 000659 1789430195.040792 mapread 0x023658 thru 0x0273e2 (0x3d8b bytes) 000660 1789430195.041947 write 0x019d31 thru 0x024517 (0xa7e7 bytes) 000661 1789430195.043300 write 0x03f52f thru 0x03ffff (0xad1 bytes) 000663 1789430195.053617 mapwrite 0x00a705 thru 0x0100a1 (0x599d bytes) 000664 1789430195.158996 read 0x032c70 thru 0x0363d4 (0x3765 bytes) 000665 1789430195.160388 mapread 0x021623 thru 0x0269d2 (0x53b0 bytes) 000666 1789430195.162009 read 0x03110d thru 0x032cb8 (0x1bac bytes) 000669 1789430195.166139 trunc from 0x040000 to 0x013be6 (0x2c419 bytes) 000670 1789430195.196446 trunc from 0x013be7 to 0x035d24 (0x2213e bytes) 000671 1789430195.219225 trunc from 0x035d25 to 0x007799 (0x2e58b bytes) 000672 1789430195.241191 punch from 0x00401e to 0x007799 (0x377c bytes) 000673 1789430195.247554 punch from 0x006ef3 to 0x007799 (0x8a7 bytes) 000675 1789430195.264839 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x779a): Mirror 8: 0x9722406c (stale) Mirror 9: 0x9722406c (stale) Mirror 10: 0x9722406c (stale) Mirror 11: 0x9722406c (stale) Mirror 12: 0x9722406c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x779a): Mirror 8: 0x9722406c (stale) Mirror 9: 0x9722406c (stale) Mirror 10: 0x9722406c (stale) Mirror 11: 0x9722406c (stale) Mirror 12: 0x9722406c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x779a: skipped 000676 1789430195.749516 write 0x020f24 thru 0x0299c5 (0x8aa2 bytes) 000677 1789430195.757732 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x299c6): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x299c6): Mirror 8: 0x8e6a248 (stale) Mirror 9: 0x8e6a248 (stale) Mirror 10: 0x8e6a248 (stale) Mirror 11: 0x8e6a248 (stale) Mirror 12: 0x8e6a248 (stale) CRC-32 checksum value for chunk [0, 0x299c6): Mirror 1: 0x8912420c Mirror 13: 0x8912420c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x299c6: skipped 000678 1789430197.603510 MIRROR_RESYNC 7 mirrors 000682 1789430199.380901 write 0x02bb87 thru 0x02ea6c (0x2ee6 bytes) 000685 1789430199.503076 trunc from 0x02ea6d to 0x0118a0 (0x1d1cc bytes) 000686 1789430199.549516 write 0x00610f thru 0x00cf8f (0x6e81 bytes) 000687 1789430199.562230 write 0x0161a3 thru 0x018973 (0x27d1 bytes) 000689 1789430199.568014 punch from 0x00c44e to 0x010efc (0x4aaf bytes) 000690 1789430199.589478 write 0x003229 thru 0x0106aa (0xd482 bytes) 000691 1789430199.607114 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x18974): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18974): Mirror 8: 0xf7aa6467 (stale) Mirror 9: 0xf7aa6467 (stale) Mirror 10: 0xf7aa6467 (stale) Mirror 11: 0xf7aa6467 (stale) Mirror 12: 0xf7aa6467 (stale) Mirror 13: 0xf7aa6467 (stale) CRC-32 checksum value for chunk [0, 0x18974): Mirror 1: 0xb50649d Mirror 14: 0xb50649d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18974: skipped 000692 1789430200.764865 trunc from 0x018974 to 0x00a39a (0xe5d9 bytes) 000693 1789430200.888717 trunc from 0x00a39b to 0x0200e0 (0x15d46 bytes) 000694 1789430200.914329 mapread 0x00968b thru 0x013b6d (0xa4e3 bytes) 000695 1789430200.937806 mapread 0x0072c0 thru 0x00845b (0x119c bytes) 000701 1789430200.942367 mapwrite 0x038f3c thru 0x03cee4 (0x3fa9 bytes) 000702 1789430201.029444 write 0x03c47b thru 0x03c93c (0x4c2 bytes) 000703 1789430201.031584 mapwrite 0x008430 thru 0x0118ce (0x949f bytes) 000704 1789430201.086783 mapwrite 0x034bb4 thru 0x03f513 (0xa960 bytes) 000705 1789430201.177225 read 0x02e4b7 thru 0x03c081 (0xdbcb bytes) 000706 1789430201.185562 mapwrite 0x002962 thru 0x00a57d (0x7c1c bytes) 000707 1789430201.243534 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3f514): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f514): Mirror 8: 0x9608f468 (stale) Mirror 9: 0x9608f468 (stale) Mirror 10: 0x9608f468 (stale) Mirror 11: 0x9608f468 (stale) Mirror 12: 0x9608f468 (stale) Mirror 13: 0x9608f468 (stale) Mirror 14: 0x7252df08 (stale) CRC-32 checksum value for chunk [0, 0x3f514): Mirror 1: 0x230bcff9 Mirror 15: 0x230bcff9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f514: skipped 000708 1789430203.249167 punch from 0x005aab to 0x00cb61 (0x70b7 bytes) 000709 1789430203.354593 write 0x007956 thru 0x00a7f6 (0x2ea1 bytes) 000710 1789430203.366431 punch from 0x02f9ad to 0x038ddf (0x9433 bytes) 000711 1789430203.379729 punch from 0x02a408 to 0x02f3d2 (0x4fcb bytes) 000712 1789430203.385823 trunc from 0x03f514 to 0x005415 (0x3a0fe bytes) 000713 1789430203.419572 mapread 0x000053 thru 0x005415 (0x53c3 bytes) 000714 1789430203.445604 trunc from 0x005416 to 0x01269e (0xd289 bytes) 000715 1789430203.464608 read 0x001a87 thru 0x00990e (0x7e88 bytes) 000716 1789430203.475299 trunc from 0x01269f to 0x01a3f9 (0x7d5b bytes) 000718 1789430203.499418 punch from 0x0144f6 to 0x01a3f9 (0x5f04 bytes) 000719 1789430203.505820 punch from 0x0197d1 to 0x01a3f9 (0xc29 bytes) 000720 1789430203.511943 trunc from 0x01a3fa to 0x030187 (0x15d8e bytes) 000721 1789430203.530397 mapread 0x006bab thru 0x00fef2 (0x9348 bytes) 000723 1789430203.543562 mapread 0x02b359 thru 0x030187 (0x4e2f bytes) 000724 1789430203.554962 trunc from 0x030188 to 0x023f55 (0xc232 bytes) 000726 1789430203.577614 write 0x038805 thru 0x03ffff (0x77fb bytes) 000727 1789430203.585826 MIRROR_RESYNC 9 mirrors 000728 1789430206.365696 MIRROR_EXTEND to 10 mirrors 000729 1789430208.086076 trunc from 0x040000 to 0x02b9b3 (0x1464c bytes) 000730 1789430208.283856 trunc from 0x02b9b4 to 0x028c3b (0x2d78 bytes) 000731 1789430208.313948 read 0x00a11c thru 0x00cbb6 (0x2a9b bytes) 000732 1789430208.326085 punch from 0x0258d9 to 0x028c3b (0x3363 bytes) 000733 1789430208.335981 trunc from 0x028c3c to 0x02e761 (0x5b26 bytes) 000734 1789430208.368057 punch from 0x02d57a to 0x02e761 (0x11e8 bytes) 000735 1789430208.376131 mapwrite 0x01e8b3 thru 0x02d084 (0xe7d2 bytes) 000737 1789430208.481063 write 0x03de0f thru 0x03ffff (0x21f1 bytes) 000738 1789430208.486173 MIRROR_RESYNC 10 mirrors 000740 1789430212.136143 read 0x0291c4 thru 0x0348e6 (0xb723 bytes) 000741 1789430212.180078 MIRROR_RESYNC 10 mirrors 000742 1789430212.986761 trunc from 0x040000 to 0x00ed00 (0x312ff bytes) 000746 1789430213.066337 read 0x00eada thru 0x00ed00 (0x227 bytes) 000747 1789430213.086127 trunc from 0x00ed01 to 0x03f6bc (0x309bc bytes) 000748 1789430213.133512 trunc from 0x03f6bd to 0x0273fc (0x182c0 bytes) 000749 1789430213.186292 write 0x03fd7f thru 0x03ffff (0x281 bytes) 000750 1789430213.187298 punch from 0x03deca to 0x03ffff (0x2136 bytes) 000753 1789430213.220262 punch from 0x00ce28 to 0x019238 (0xc411 bytes) 000755 1789430213.231308 mapwrite 0x016ee2 thru 0x023bda (0xccf9 bytes) 000756 1789430213.417706 punch from 0x00a0fb to 0x00de1d (0x3d23 bytes) 000757 1789430213.434871 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xeeba9fc3 (stale) Mirror 9: 0xeeba9fc3 (stale) Mirror 10: 0xeeba9fc3 (stale) Mirror 11: 0xeeba9fc3 (stale) Mirror 12: 0xeeba9fc3 (stale) Mirror 13: 0xeeba9fc3 (stale) Mirror 14: 0xeeba9fc3 (stale) Mirror 15: 0xeeba9fc3 (stale) Mirror 16: 0xeeba9fc3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8f2a441b Mirror 17: 0x8f2a441b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000759 1789430215.914200 punch from 0x01e84e to 0x02433f (0x5af2 bytes) 000761 1789430216.030490 punch from 0x013519 to 0x01aad3 (0x75bb bytes) 000762 1789430216.035298 write 0x019056 thru 0x01c7da (0x3785 bytes) 000765 1789430216.057268 trunc from 0x040000 to 0x02ad3d (0x152c2 bytes) 000766 1789430216.091716 read 0x019a78 thru 0x01bc0b (0x2194 bytes) 000768 1789430216.092879 write 0x0329d4 thru 0x03364c (0xc79 bytes) 000769 1789430216.093946 write 0x010e85 thru 0x02067c (0xf7f8 bytes) 000772 1789430216.112440 mapwrite 0x01ee95 thru 0x024331 (0x549d bytes) 000773 1789430216.250961 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3364d): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3364d): Mirror 8: 0xcaeeb528 (stale) Mirror 9: 0xcaeeb528 (stale) Mirror 10: 0xcaeeb528 (stale) Mirror 11: 0xcaeeb528 (stale) Mirror 12: 0xcaeeb528 (stale) Mirror 13: 0xcaeeb528 (stale) Mirror 14: 0xcaeeb528 (stale) Mirror 15: 0xcaeeb528 (stale) Mirror 16: 0xcaeeb528 (stale) Mirror 17: 0x2008ffff (stale) CRC-32 checksum value for chunk [0, 0x3364d): Mirror 1: 0x263c5695 Mirror 18: 0x263c5695 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3364d: skipped 000774 1789430217.732377 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3364d): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3364d): Mirror 8: 0xcaeeb528 (stale) Mirror 9: 0xcaeeb528 (stale) Mirror 10: 0xcaeeb528 (stale) Mirror 11: 0xcaeeb528 (stale) Mirror 12: 0xcaeeb528 (stale) Mirror 13: 0xcaeeb528 (stale) Mirror 14: 0xcaeeb528 (stale) Mirror 15: 0xcaeeb528 (stale) Mirror 16: 0xcaeeb528 (stale) Mirror 17: 0x2008ffff (stale) CRC-32 checksum value for chunk [0, 0x3364d): Mirror 1: 0x263c5695 Mirror 18: 0x263c5695 Mirror 19: 0x263c5695 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3364d: skipped 000775 1789430219.939138 punch from 0x0232fb to 0x0314bc (0xe1c2 bytes) 000776 1789430220.101902 read 0x013426 thru 0x014239 (0xe14 bytes) 000778 1789430220.112180 trunc from 0x03364d to 0x021884 (0x11dc8 bytes) 000779 1789430220.179467 mapwrite 0x007ae5 thru 0x00c039 (0x4555 bytes) 000780 1789430220.281755 punch from 0x001aaf to 0x00787e (0x5dd0 bytes) 000783 1789430220.291603 write 0x027c4b thru 0x030143 (0x84f9 bytes) 000784 1789430220.294202 trunc from 0x030144 to 0x000c1e (0x2f525 bytes) 000785 1789430220.327074 mapwrite 0x00d9dd thru 0x01d695 (0xfcb9 bytes) 000786 1789430220.447924 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x1d696): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d696): Mirror 8: 0xc9ec2ef4 (stale) Mirror 9: 0xc9ec2ef4 (stale) Mirror 10: 0xc9ec2ef4 (stale) Mirror 11: 0xc9ec2ef4 (stale) Mirror 12: 0xc9ec2ef4 (stale) Mirror 13: 0xc9ec2ef4 (stale) Mirror 14: 0xc9ec2ef4 (stale) Mirror 15: 0xc9ec2ef4 (stale) Mirror 16: 0xc9ec2ef4 (stale) Mirror 17: 0x9bceeabe (stale) Mirror 18: 0x451038e (stale) Mirror 19: 0x451038e (stale) CRC-32 checksum value for chunk [0, 0x1d696): Mirror 1: 0x3d9023e6 Mirror 20: 0x3d9023e6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d696: skipped 000787 1789430222.178459 mapread 0x00577b thru 0x009fc5 (0x484b bytes) 000788 1789430222.285977 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x1d696): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d696): Mirror 8: 0xc9ec2ef4 (stale) Mirror 9: 0xc9ec2ef4 (stale) Mirror 10: 0xc9ec2ef4 (stale) Mirror 11: 0xc9ec2ef4 (stale) Mirror 12: 0xc9ec2ef4 (stale) Mirror 13: 0xc9ec2ef4 (stale) Mirror 14: 0xc9ec2ef4 (stale) Mirror 15: 0xc9ec2ef4 (stale) Mirror 16: 0xc9ec2ef4 (stale) Mirror 17: 0x9bceeabe (stale) Mirror 18: 0x451038e (stale) Mirror 19: 0x451038e (stale) CRC-32 checksum value for chunk [0, 0x1d696): Mirror 1: 0x3d9023e6 Mirror 20: 0x3d9023e6 Mirror 21: 0x3d9023e6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d696: skipped 000790 1789430223.702118 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x1d696): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d696): Mirror 8: 0xc9ec2ef4 (stale) Mirror 9: 0xc9ec2ef4 (stale) Mirror 10: 0xc9ec2ef4 (stale) Mirror 11: 0xc9ec2ef4 (stale) Mirror 12: 0xc9ec2ef4 (stale) Mirror 13: 0xc9ec2ef4 (stale) Mirror 14: 0xc9ec2ef4 (stale) Mirror 15: 0xc9ec2ef4 (stale) Mirror 16: 0xc9ec2ef4 (stale) Mirror 17: 0x9bceeabe (stale) Mirror 18: 0x451038e (stale) Mirror 19: 0x451038e (stale) CRC-32 checksum value for chunk [0, 0x1d696): Mirror 1: 0x3d9023e6 Mirror 20: 0x3d9023e6 Mirror 21: 0x3d9023e6 Mirror 22: 0x3d9023e6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d696: skipped 000791 1789430225.318895 punch from 0x00b0ea to 0x016223 (0xb13a bytes) 000792 1789430225.511574 MIRROR_RESYNC 16 mirrors 000795 1789430230.140104 read 0x00afe6 thru 0x013539 (0x8554 bytes) 000797 1789430230.150978 read 0x00ec5e thru 0x01d695 (0xea38 bytes) 000799 1789430230.170777 trunc from 0x01d696 to 0x0374b4 (0x19e1f bytes) 000800 1789430230.355832 read 0x0088fd thru 0x013aed (0xb1f1 bytes) 000801 1789430230.378033 read 0x008734 thru 0x0157ab (0xd078 bytes) 000802 1789430230.379954 punch from 0x02a3a4 to 0x033887 (0x94e4 bytes) 000803 1789430230.384880 punch from 0x00ff66 to 0x0199ad (0x9a48 bytes) 000804 1789430230.395030 trunc from 0x0374b5 to 0x026181 (0x11333 bytes) 000805 1789430230.456457 write 0x008a8d thru 0x01187a (0x8dee bytes) 000807 1789430230.473083 read 0x006d65 thru 0x00b0fd (0x4399 bytes) 000808 1789430230.476529 read 0x023908 thru 0x026181 (0x287a bytes) 000809 1789430230.480078 mapwrite 0x011010 thru 0x01e46d (0xd45e bytes) 000810 1789430230.617406 trunc from 0x026182 to 0x0345ca (0xe449 bytes) 000812 1789430230.635910 mapread 0x01048e thru 0x01b076 (0xabe9 bytes) 000813 1789430230.638601 mapwrite 0x0362a8 thru 0x03ce9f (0x6bf8 bytes) 000814 1789430230.745798 trunc from 0x03cea0 to 0x038fe4 (0x3ebb bytes) 000816 1789430230.781181 MIRROR_RESYNC 16 mirrors 000817 1789430236.195095 trunc from 0x038fe5 to 0x033337 (0x5cad bytes) 000818 1789430236.304953 MIRROR_SPLIT mirror 2 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33338): Mirror 8: 0x2bdf6ea6 (stale) Mirror 10: 0x2bdf6ea6 (stale) Mirror 11: 0x2bdf6ea6 (stale) Mirror 12: 0x2bdf6ea6 (stale) Mirror 13: 0x2bdf6ea6 (stale) Mirror 14: 0x2bdf6ea6 (stale) Mirror 15: 0x2bdf6ea6 (stale) Mirror 16: 0x2bdf6ea6 (stale) Mirror 17: 0x2bdf6ea6 (stale) Mirror 18: 0x2bdf6ea6 (stale) Mirror 19: 0x2bdf6ea6 (stale) Mirror 20: 0x2bdf6ea6 (stale) Mirror 21: 0x2bdf6ea6 (stale) Mirror 22: 0x2bdf6ea6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33338): Mirror 8: 0x2bdf6ea6 (stale) Mirror 10: 0x2bdf6ea6 (stale) Mirror 11: 0x2bdf6ea6 (stale) Mirror 12: 0x2bdf6ea6 (stale) Mirror 13: 0x2bdf6ea6 (stale) Mirror 14: 0x2bdf6ea6 (stale) Mirror 15: 0x2bdf6ea6 (stale) Mirror 16: 0x2bdf6ea6 (stale) Mirror 17: 0x2bdf6ea6 (stale) Mirror 18: 0x2bdf6ea6 (stale) Mirror 19: 0x2bdf6ea6 (stale) Mirror 20: 0x2bdf6ea6 (stale) Mirror 21: 0x2bdf6ea6 (stale) Mirror 22: 0x2bdf6ea6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33338: skipped 000820 1789430237.157347 mapwrite 0x0103ad thru 0x014073 (0x3cc7 bytes) 000821 1789430237.268864 mapread 0x02db00 thru 0x033337 (0x5838 bytes) 000822 1789430237.283766 read 0x028fd7 thru 0x0323fd (0x9427 bytes) 000823 1789430237.286911 mapwrite 0x00e6fe thru 0x0113c2 (0x2cc5 bytes) 000825 1789430237.337983 mapwrite 0x01259e thru 0x0168c3 (0x4326 bytes) 000826 1789430237.380008 mapwrite 0x038e06 thru 0x03ffff (0x71fa bytes) 000827 1789430237.480036 write 0x001bfe thru 0x00544f (0x3852 bytes) 000828 1789430237.507422 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x14b4a13d (stale) Mirror 10: 0x14b4a13d (stale) Mirror 11: 0x14b4a13d (stale) Mirror 12: 0x14b4a13d (stale) Mirror 13: 0x14b4a13d (stale) Mirror 14: 0x14b4a13d (stale) Mirror 15: 0x14b4a13d (stale) Mirror 16: 0x14b4a13d (stale) Mirror 17: 0x14b4a13d (stale) Mirror 18: 0x14b4a13d (stale) Mirror 19: 0x14b4a13d (stale) Mirror 20: 0x14b4a13d (stale) Mirror 21: 0x14b4a13d (stale) Mirror 22: 0x14b4a13d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x573437e1 Mirror 23: 0x573437e1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000829 1789430239.366985 mapread 0x03bd5d thru 0x03ffff (0x42a3 bytes) 000830 1789430239.419595 punch from 0x00dcad to 0x013507 (0x585b bytes) 000833 1789430239.539876 mapwrite 0x000430 thru 0x00ba5d (0xb62e bytes) 000834 1789430239.616250 mapread 0x01e1de thru 0x0265b3 (0x83d6 bytes) 000837 1789430239.628788 punch from 0x033616 to 0x033d26 (0x711 bytes) 000838 1789430239.636039 read 0x01baea thru 0x023ed0 (0x83e7 bytes) 000839 1789430239.637056 mapwrite 0x0163b9 thru 0x01cf2f (0x6b77 bytes) 000840 1789430239.700888 punch from 0x00dd7f to 0x01769e (0x9920 bytes) 000842 1789430239.708043 mapread 0x02f96b thru 0x0371fb (0x7891 bytes) 000844 1789430239.719701 trunc from 0x040000 to 0x0249d2 (0x1b62d bytes) 000845 1789430239.747664 trunc from 0x0249d3 to 0x0116a8 (0x1332a bytes) 000846 1789430239.778777 read 0x000b60 thru 0x00b777 (0xac18 bytes) 000847 1789430239.780109 mapwrite 0x035d89 thru 0x03ffff (0xa277 bytes) 000848 1789430239.886830 trunc from 0x040000 to 0x033b60 (0xc49f bytes) 000849 1789430239.912419 mapread 0x01b073 thru 0x021b09 (0x6a97 bytes) 000850 1789430239.914532 mapwrite 0x009f92 thru 0x017866 (0xd8d5 bytes) 000854 1789430239.977345 mapread 0x004be6 thru 0x00f961 (0xad7c bytes) 000856 1789430239.979920 trunc from 0x033b61 to 0x007b42 (0x2c01e bytes) 000858 1789430240.010889 trunc from 0x007b43 to 0x0317d9 (0x29c97 bytes) 000859 1789430240.035425 punch from 0x0215db to 0x023ac0 (0x24e6 bytes) 000860 1789430240.042855 read 0x01fd83 thru 0x029d08 (0x9f86 bytes) 000861 1789430240.054809 write 0x01e182 thru 0x0231d6 (0x5055 bytes) 000862 1789430240.056783 mapread 0x0286df thru 0x0317d9 (0x90fb bytes) 000864 1789430240.058924 trunc from 0x0317da to 0x0395c9 (0x7df0 bytes) 000866 1789430240.082047 mapread 0x017393 thru 0x01ec49 (0x78b7 bytes) 000868 1789430240.090994 MIRROR_RESYNC 16 mirrors 000869 1789430245.162272 punch from 0x01dc65 to 0x01edc3 (0x115f bytes) 000870 1789430245.259365 trunc from 0x0395ca to 0x03626c (0x335d bytes) 000871 1789430245.287439 punch from 0x00a6bd to 0x010ecd (0x6811 bytes) 000872 1789430245.294501 read 0x030df4 thru 0x03626c (0x5479 bytes) 000873 1789430245.303111 punch from 0x017d3d to 0x019f19 (0x21dd bytes) 000874 1789430245.308166 trunc from 0x03626d to 0x01ca25 (0x19847 bytes) 000876 1789430245.325251 read 0x014790 thru 0x01ada4 (0x6615 bytes) 000877 1789430245.336790 trunc from 0x01ca26 to 0x0020e9 (0x1a93c bytes) 000878 1789430245.357600 mapread 0x000409 thru 0x0020e9 (0x1ce1 bytes) 000879 1789430245.359369 write 0x02a39a thru 0x038ee7 (0xeb4e bytes) 000880 1789430245.366901 punch from 0x02e376 to 0x033d90 (0x5a1b bytes) 000881 1789430245.385776 trunc from 0x038ee8 to 0x007263 (0x31c84 bytes) 000885 1789430245.438689 MIRROR_RESYNC 16 mirrors 000887 1789430250.398001 MIRROR_RESYNC 16 mirrors 000888 1789430251.228276 mapwrite 0x02eb02 thru 0x02ed0c (0x20b bytes) 000889 1789430251.431238 mapread 0x01384f thru 0x014a44 (0x11f6 bytes) 000890 1789430251.456322 mapwrite 0x030223 thru 0x03d044 (0xce22 bytes) 000891 1789430251.595698 MIRROR_SPLIT mirror 13 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d045): Mirror 8: 0xe66ac01f (stale) Mirror 10: 0xe66ac01f (stale) Mirror 11: 0xe66ac01f (stale) Mirror 12: 0xe66ac01f (stale) Mirror 13: 0xe66ac01f (stale) Mirror 14: 0xe66ac01f (stale) Mirror 15: 0xe66ac01f (stale) Mirror 16: 0xe66ac01f (stale) Mirror 17: 0xe66ac01f (stale) Mirror 18: 0xe66ac01f (stale) Mirror 19: 0xe66ac01f (stale) Mirror 20: 0xe66ac01f (stale) Mirror 22: 0xe66ac01f (stale) Mirror 23: 0xe66ac01f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d045): Mirror 8: 0xe66ac01f (stale) Mirror 10: 0xe66ac01f (stale) Mirror 11: 0xe66ac01f (stale) Mirror 12: 0xe66ac01f (stale) Mirror 13: 0xe66ac01f (stale) Mirror 14: 0xe66ac01f (stale) Mirror 15: 0xe66ac01f (stale) Mirror 16: 0xe66ac01f (stale) Mirror 17: 0xe66ac01f (stale) Mirror 18: 0xe66ac01f (stale) Mirror 19: 0xe66ac01f (stale) Mirror 20: 0xe66ac01f (stale) Mirror 22: 0xe66ac01f (stale) Mirror 23: 0xe66ac01f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d045: skipped 000892 1789430252.537414 mapwrite 0x002efe thru 0x0034a3 (0x5a6 bytes) 000896 1789430252.642557 mapwrite 0x026945 thru 0x0366ff (0xfdbb bytes) 000897 1789430252.790540 mapread 0x033f82 thru 0x03d044 (0x90c3 bytes) 000898 1789430252.802393 mapread 0x0227c7 thru 0x02db11 (0xb34b bytes) 000901 1789430252.814138 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x3d045): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d045): Mirror 8: 0xe66ac01f (stale) Mirror 10: 0xe66ac01f (stale) Mirror 11: 0xe66ac01f (stale) Mirror 12: 0xe66ac01f (stale) Mirror 13: 0xe66ac01f (stale) Mirror 14: 0xe66ac01f (stale) Mirror 15: 0xe66ac01f (stale) Mirror 16: 0xe66ac01f (stale) Mirror 17: 0xe66ac01f (stale) Mirror 18: 0xe66ac01f (stale) Mirror 19: 0xe66ac01f (stale) Mirror 20: 0xe66ac01f (stale) Mirror 22: 0xe66ac01f (stale) Mirror 23: 0xe66ac01f (stale) CRC-32 checksum value for chunk [0, 0x3d045): Mirror 1: 0x957ac501 Mirror 24: 0x957ac501 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d045: skipped 000902 1789430254.936507 punch from 0x006aef to 0x00f54d (0x8a5f bytes) 000903 1789430255.149774 mapwrite 0x03586f thru 0x03cbfd (0x738f bytes) 000904 1789430255.300290 read 0x0281ba thru 0x02fd6d (0x7bb4 bytes) 000905 1789430255.317085 read 0x036b64 thru 0x03aa45 (0x3ee2 bytes) 000907 1789430255.318977 mapwrite 0x037707 thru 0x03ffff (0x88f9 bytes) 000909 1789430255.507246 read 0x02462c thru 0x02a1ff (0x5bd4 bytes) 000910 1789430255.510107 trunc from 0x040000 to 0x035278 (0xad87 bytes) 000912 1789430255.557747 MIRROR_SPLIT mirror 13 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35279): Mirror 8: 0xfc61d21a (stale) Mirror 10: 0xfc61d21a (stale) Mirror 11: 0xfc61d21a (stale) Mirror 12: 0xfc61d21a (stale) Mirror 13: 0xfc61d21a (stale) Mirror 14: 0xfc61d21a (stale) Mirror 15: 0xfc61d21a (stale) Mirror 16: 0xfc61d21a (stale) Mirror 17: 0xfc61d21a (stale) Mirror 18: 0xfc61d21a (stale) Mirror 19: 0xfc61d21a (stale) Mirror 20: 0xfc61d21a (stale) Mirror 23: 0xfc61d21a (stale) Mirror 24: 0x8ad22472 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35279): Mirror 8: 0xfc61d21a (stale) Mirror 10: 0xfc61d21a (stale) Mirror 11: 0xfc61d21a (stale) Mirror 12: 0xfc61d21a (stale) Mirror 13: 0xfc61d21a (stale) Mirror 14: 0xfc61d21a (stale) Mirror 15: 0xfc61d21a (stale) Mirror 16: 0xfc61d21a (stale) Mirror 17: 0xfc61d21a (stale) Mirror 18: 0xfc61d21a (stale) Mirror 19: 0xfc61d21a (stale) Mirror 20: 0xfc61d21a (stale) Mirror 23: 0xfc61d21a (stale) Mirror 24: 0x8ad22472 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35279: skipped 000913 1789430256.536478 mapread 0x03375e thru 0x035278 (0x1b1b bytes) 000914 1789430256.561918 read 0x027c96 thru 0x02df9f (0x630a bytes) 000915 1789430256.580411 write 0x007cb0 thru 0x007ff7 (0x348 bytes) 000916 1789430256.591797 mapwrite 0x002f9c thru 0x00781c (0x4881 bytes) 000917 1789430256.737316 write 0x0367db thru 0x0383b0 (0x1bd6 bytes) 000918 1789430256.738502 mapwrite 0x012c4f thru 0x018187 (0x5539 bytes) 000919 1789430256.852407 trunc from 0x0383b1 to 0x023607 (0x14da9 bytes) 000921 1789430256.880576 write 0x038542 thru 0x03ffff (0x7abe bytes) 000922 1789430256.884038 mapwrite 0x022251 thru 0x022b7b (0x92b bytes) 000923 1789430256.961474 mapwrite 0x004d89 thru 0x0136e2 (0xe95a bytes) 000924 1789430257.034759 read 0x01e43d thru 0x025760 (0x7324 bytes) 000925 1789430257.035570 read 0x015af1 thru 0x01d7e8 (0x7cf8 bytes) 000927 1789430257.045976 MIRROR_RESYNC 15 mirrors 000928 1789430263.952196 trunc from 0x040000 to 0x018faf (0x27050 bytes) 000930 1789430264.110187 mapwrite 0x011a6a thru 0x016655 (0x4bec bytes) 000932 1789430264.251509 write 0x0094f5 thru 0x00eb80 (0x568c bytes) 000933 1789430264.262006 read 0x012887 thru 0x018faf (0x6729 bytes) 000934 1789430264.263712 mapread 0x002484 thru 0x010a80 (0xe5fd bytes) 000935 1789430264.277480 mapwrite 0x02a2d5 thru 0x036ed7 (0xcc03 bytes) 000937 1789430264.411895 trunc from 0x036ed8 to 0x02fd65 (0x7172 bytes) 000938 1789430264.433514 mapwrite 0x03bfed thru 0x03ffff (0x4013 bytes) 000939 1789430264.579852 mapwrite 0x015bca thru 0x01cd51 (0x7188 bytes) 000940 1789430264.727510 read 0x034f99 thru 0x03b061 (0x60c9 bytes) 000941 1789430264.728343 punch from 0x03966a to 0x03ffff (0x6996 bytes) 000942 1789430264.737075 read 0x01c208 thru 0x01ca88 (0x881 bytes) 000943 1789430264.738143 punch from 0x005759 to 0x00713e (0x19e6 bytes) 000944 1789430264.745792 mapwrite 0x038031 thru 0x03c5e5 (0x45b5 bytes) 000945 1789430264.850684 read 0x0278a1 thru 0x033e4c (0xc5ac bytes) 000946 1789430264.856953 read 0x037daf thru 0x03a6e8 (0x293a bytes) 000947 1789430264.858615 mapread 0x005189 thru 0x012b16 (0xd98e bytes) 000948 1789430264.860940 read 0x01e9d2 thru 0x021cee (0x331d bytes) 000949 1789430264.862676 write 0x033b1d thru 0x03c025 (0x8509 bytes) 000950 1789430264.865670 mapread 0x025f44 thru 0x034120 (0xe1dd bytes) 000952 1789430264.872001 mapwrite 0x02512e thru 0x031ede (0xcdb1 bytes) 000953 1789430265.000143 read 0x003d04 thru 0x006e12 (0x310f bytes) 000954 1789430265.000875 read 0x03bea2 thru 0x03d510 (0x166f bytes) 000957 1789430265.002371 read 0x00bc2a thru 0x013040 (0x7417 bytes) 000958 1789430265.009180 read 0x01eb6d thru 0x02b45b (0xc8ef bytes) 000959 1789430265.011088 mapread 0x00d275 thru 0x0186e8 (0xb474 bytes) 000960 1789430265.014805 mapread 0x00082b thru 0x0040c1 (0x3897 bytes) 000961 1789430265.018705 trunc from 0x040000 to 0x03e4c3 (0x1b3c bytes) 000962 1789430265.060265 mapwrite 0x00f74e thru 0x0150f1 (0x59a4 bytes) 000963 1789430265.149743 trunc from 0x03e4c4 to 0x01f3e9 (0x1f0da bytes) 000964 1789430265.188629 mapread 0x00439d thru 0x005d3e (0x19a2 bytes) 000966 1789430265.193618 trunc from 0x01f3ea to 0x01caa3 (0x2946 bytes) 000967 1789430265.235066 read 0x01118f thru 0x013803 (0x2675 bytes) 000968 1789430265.236326 write 0x024c79 thru 0x02ea0d (0x9d95 bytes) 000969 1789430265.239531 trunc from 0x02ea0e to 0x02d161 (0x18ac bytes) 000971 1789430265.301222 write 0x032ef5 thru 0x039248 (0x6354 bytes) 000975 1789430265.308415 mapwrite 0x003c8f thru 0x00a680 (0x69f2 bytes) 000979 1789430265.442802 mapwrite 0x016e47 thru 0x0181a5 (0x135f bytes) 000980 1789430265.502468 punch from 0x0350c5 to 0x039248 (0x4184 bytes) 000984 1789430265.528941 read 0x030ed1 thru 0x038ad2 (0x7c02 bytes) 000985 1789430265.551735 punch from 0x033c64 to 0x039248 (0x55e5 bytes) 000987 1789430265.562920 mapwrite 0x039824 thru 0x03ffff (0x67dc bytes) 000988 1789430265.677020 read 0x02911d thru 0x0380aa (0xef8e bytes) 000989 1789430265.690044 MIRROR_RESYNC 15 mirrors 000990 1789430273.995598 mapwrite 0x0258d4 thru 0x02dc0b (0x8338 bytes) 000992 1789430274.198764 read 0x002ec6 thru 0x00fcec (0xce27 bytes) 000993 1789430274.209967 mapread 0x004899 thru 0x009ae3 (0x524b bytes) 000994 1789430274.211087 write 0x035dd1 thru 0x03ffff (0xa22f bytes) 000995 1789430274.219872 write 0x026a47 thru 0x02f72e (0x8ce8 bytes) 000997 1789430274.230566 punch from 0x01ff87 to 0x023286 (0x3300 bytes) 000998 1789430274.255312 MIRROR_SPLIT mirror 2 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x183:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x6516983c (stale) Mirror 11: 0x6516983c (stale) Mirror 12: 0x6516983c (stale) Mirror 13: 0x6516983c (stale) Mirror 14: 0x6516983c (stale) Mirror 15: 0x6516983c (stale) Mirror 16: 0x6516983c (stale) Mirror 17: 0x6516983c (stale) Mirror 18: 0x6516983c (stale) Mirror 19: 0x6516983c (stale) Mirror 20: 0x6516983c (stale) Mirror 23: 0x6516983c (stale) Mirror 24: 0x6516983c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x6516983c (stale) Mirror 11: 0x6516983c (stale) Mirror 12: 0x6516983c (stale) Mirror 13: 0x6516983c (stale) Mirror 14: 0x6516983c (stale) Mirror 15: 0x6516983c (stale) Mirror 16: 0x6516983c (stale) Mirror 17: 0x6516983c (stale) Mirror 18: 0x6516983c (stale) Mirror 19: 0x6516983c (stale) Mirror 20: 0x6516983c (stale) Mirror 23: 0x6516983c (stale) Mirror 24: 0x6516983c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 001000 1789430275.397117 trunc from 0x040000 to 0x00bda5 (0x3425a bytes) All operations completed A-OK!