== sanity-flr test 70a: flr mode fsx test ================ 08:10:55 (1787573455) Seed set to 3457 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000002 1787573457.717747 MIRROR_EXTEND to 2 mirrors 000003 1787573458.498353 MIRROR_EXTEND to 3 mirrors truncating to largest ever: 0x3827c 000005 1787573459.107234 trunc from 00000000 to 0x03827b (0x3827c bytes) 000007 1787573459.204904 mapread 0x02dd31 thru 0x03827b (0xa54b bytes) 000008 1787573459.251684 mapwrite 0x03a8ad thru 0x03ffff (0x5753 bytes) 000009 1787573459.520255 mapread 0x03301d thru 0x03ffff (0xcfe3 bytes) 000010 1787573459.532292 mapread 0x03b794 thru 0x03ffff (0x486c bytes) 000012 1787573459.533969 trunc from 0x040000 to 0x02d867 (0x12798 bytes) 000013 1787573459.598756 read 0x00baae thru 0x00e791 (0x2ce4 bytes) 000014 1787573459.617289 mapwrite 0x016e31 thru 0x01a054 (0x3224 bytes) 000016 1787573459.760539 mapwrite 0x021381 thru 0x02a198 (0x8e18 bytes) 000017 1787573459.926262 trunc from 0x02d868 to 0x00e9e4 (0x1ee83 bytes) 000019 1787573459.970943 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe9e5): Mirror 3: 0x271e57fb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe9e5): Mirror 3: 0x271e57fb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe9e5: skipped 000021 1787573460.689932 read 0x009d74 thru 0x00e9e4 (0x4c71 bytes) 000022 1787573460.717131 write 0x03e0a2 thru 0x03e2be (0x21d bytes) 000023 1787573460.718718 trunc from 0x03e2bf to 0x007e8c (0x36432 bytes) 000026 1787573460.750067 mapwrite 0x0141cb thru 0x01994c (0x5782 bytes) 000027 1787573460.870181 mapread 0x0014d5 thru 0x009255 (0x7d81 bytes) 000029 1787573460.891827 mapwrite 0x03bd19 thru 0x03ffff (0x42e7 bytes) 000030 1787573461.081492 mapwrite 0x0312b1 thru 0x03eb40 (0xd890 bytes) 000031 1787573461.237295 trunc from 0x040000 to 0x034b60 (0xb49f bytes) 000032 1787573461.280784 mapwrite 0x017cef thru 0x01c59d (0x48af bytes) 000033 1787573461.389414 read 0x01d89c thru 0x025ec1 (0x8626 bytes) 000034 1787573461.404815 trunc from 0x034b61 to 0x01c9f4 (0x1816c bytes) 000035 1787573461.451161 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1c9f5): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c9f5): Mirror 3: 0xc43b14e4 (stale) CRC-32 checksum value for chunk [0, 0x1c9f5): Mirror 1: 0xb623828 Mirror 4: 0xb623828 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c9f5: skipped 000037 1787573462.873652 mapwrite 0x03de6e thru 0x03ffff (0x2192 bytes) 000039 1787573463.115326 trunc from 0x040000 to 0x035586 (0xaa79 bytes) 000040 1787573463.170426 read 0x019b47 thru 0x01d1d8 (0x3692 bytes) 000041 1787573463.185502 mapread 0x005ca2 thru 0x012b23 (0xce82 bytes) 000042 1787573463.224301 MIRROR_RESYNC 3 mirrors 000043 1787573464.340112 read 0x00c5ad thru 0x01b9fe (0xf452 bytes) 000047 1787573464.367465 trunc from 0x035587 to 0x003b82 (0x31a04 bytes) 000049 1787573464.499706 read 0x000eb0 thru 0x003b82 (0x2cd3 bytes) 000050 1787573464.512162 mapwrite 0x039eef thru 0x03eb6d (0x4c7f bytes) 000051 1787573464.642574 mapread 0x02ee5b thru 0x036c8c (0x7e32 bytes) 000052 1787573464.643741 mapwrite 0x0281f5 thru 0x033081 (0xae8d bytes) 000053 1787573464.694866 trunc from 0x03eb6e to 0x02d046 (0x11b27 bytes) 000054 1787573464.733583 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2d047): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d047): Mirror 3: 0x48e501c9 (stale) Mirror 4: 0x48e501c9 (stale) CRC-32 checksum value for chunk [0, 0x2d047): Mirror 1: 0x74eefd28 Mirror 5: 0x74eefd28 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d047: skipped 000056 1787573466.265792 mapwrite 0x01cee4 thru 0x021c2d (0x4d4a bytes) 000057 1787573466.500363 MIRROR_RESYNC 4 mirrors 000059 1787573468.834890 mapwrite 0x011a17 thru 0x016285 (0x486f bytes) 000061 1787573469.148907 trunc from 0x02d047 to 0x029eac (0x319a bytes) 000062 1787573469.190511 trunc from 0x029ead to 0x0275c5 (0x28e7 bytes) 000063 1787573469.227371 read 0x0001cc thru 0x00afff (0xae34 bytes) 000065 1787573469.254450 write 0x01b8a5 thru 0x01c72f (0xe8b bytes) 000069 1787573469.274242 mapwrite 0x0022c8 thru 0x008b37 (0x6870 bytes) 000070 1787573469.345048 read 0x022da6 thru 0x0275c5 (0x4820 bytes) 000071 1787573469.353480 write 0x033846 thru 0x039593 (0x5d4e bytes) 000073 1787573469.356056 mapwrite 0x01806a thru 0x023f1b (0xbeb2 bytes) 000075 1787573469.468287 mapread 0x030a3c thru 0x039593 (0x8b58 bytes) 000077 1787573469.497042 mapwrite 0x014dd1 thru 0x0176dd (0x290d bytes) 000078 1787573469.566031 trunc from 0x039594 to 0x000ec9 (0x386ca bytes) 000079 1787573469.595514 mapwrite 0x003382 thru 0x00dd73 (0xa9f2 bytes) 000080 1787573469.835285 mapwrite 0x00fe15 thru 0x016157 (0x6343 bytes) 000081 1787573470.055927 trunc from 0x016158 to 0x00e66c (0x7aeb bytes) 000082 1787573470.083467 mapread 0x005501 thru 0x00e66c (0x916c bytes) 000084 1787573470.105852 trunc from 0x00e66d to 0x02ff43 (0x218d7 bytes) 000085 1787573470.177131 MIRROR_RESYNC 4 mirrors 000086 1787573471.782230 trunc from 0x02ff44 to 0x02f5b1 (0x992 bytes) 000087 1787573471.961965 write 0x01bde6 thru 0x0252bf (0x94da bytes) 000088 1787573471.995007 mapwrite 0x00a59b thru 0x010e9d (0x6903 bytes) 000089 1787573472.127267 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2f5b2): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f5b2): Mirror 3: 0x502c33bb (stale) Mirror 4: 0x502c33bb (stale) Mirror 5: 0x502c33bb (stale) CRC-32 checksum value for chunk [0, 0x2f5b2): Mirror 1: 0x30b77b4 Mirror 6: 0x30b77b4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f5b2: skipped 000090 1787573473.832509 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2f5b2): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f5b2): Mirror 3: 0x502c33bb (stale) Mirror 4: 0x502c33bb (stale) Mirror 5: 0x502c33bb (stale) CRC-32 checksum value for chunk [0, 0x2f5b2): Mirror 1: 0x30b77b4 Mirror 6: 0x30b77b4 Mirror 7: 0x30b77b4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f5b2: skipped 000091 1787573475.110092 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f5b2): Mirror 3: 0x502c33bb (stale) Mirror 4: 0x502c33bb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f5b2): Mirror 3: 0x502c33bb (stale) Mirror 4: 0x502c33bb (stale) CRC-32 checksum value for chunk [0, 0x2f5b2): Mirror 1: 0x30b77b4 Mirror 6: 0x30b77b4 Mirror 7: 0x30b77b4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f5b2: skipped 000092 1787573476.246012 mapwrite 0x007cd1 thru 0x0102cb (0x85fb bytes) 000095 1787573476.612928 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2f5b2): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f5b2): Mirror 3: 0x502c33bb (stale) Mirror 4: 0x502c33bb (stale) Mirror 6: 0x30b77b4 (stale) Mirror 7: 0x30b77b4 (stale) CRC-32 checksum value for chunk [0, 0x2f5b2): Mirror 1: 0x1a79931e Mirror 8: 0x1a79931e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f5b2: skipped 000097 1787573478.615948 mapread 0x029523 thru 0x02dae3 (0x45c1 bytes) 000098 1787573478.646431 mapread 0x010154 thru 0x01d259 (0xd106 bytes) 000099 1787573478.694976 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f5b2): Mirror 3: 0x502c33bb (stale) Mirror 6: 0x30b77b4 (stale) Mirror 7: 0x30b77b4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f5b2): Mirror 3: 0x502c33bb (stale) Mirror 6: 0x30b77b4 (stale) Mirror 7: 0x30b77b4 (stale) CRC-32 checksum value for chunk [0, 0x2f5b2): Mirror 1: 0x1a79931e Mirror 8: 0x1a79931e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f5b2: skipped 000100 1787573479.759348 mapwrite 0x00d2f3 thru 0x01c821 (0xf52f bytes) 000101 1787573480.148055 write 0x00fb3f thru 0x017476 (0x7938 bytes) 000102 1787573480.149993 mapwrite 0x0017fd thru 0x00274a (0xf4e bytes) 000103 1787573480.361922 mapwrite 0x00f682 thru 0x011bfa (0x2579 bytes) 000104 1787573480.475290 write 0x01d93f thru 0x0292a5 (0xb967 bytes) 000106 1787573480.494483 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f5b2): Mirror 6: 0x30b77b4 (stale) Mirror 7: 0x30b77b4 (stale) Mirror 8: 0x1a79931e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f5b2): Mirror 6: 0x30b77b4 (stale) Mirror 7: 0x30b77b4 (stale) Mirror 8: 0x1a79931e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f5b2: skipped 000109 1787573481.224353 write 0x02e138 thru 0x039cf0 (0xbbb9 bytes) 000115 1787573481.247772 mapwrite 0x0040f3 thru 0x00f0c8 (0xafd6 bytes) 000116 1787573481.396147 MIRROR_RESYNC 4 mirrors 000117 1787573483.349307 mapwrite 0x01dae5 thru 0x02d95b (0xfe77 bytes) 000119 1787573483.563888 mapread 0x01dac4 thru 0x01e482 (0x9bf bytes) 000120 1787573483.564998 trunc from 0x039cf1 to 0x00a19b (0x2fb55 bytes) 000122 1787573483.598080 write 0x019162 thru 0x01f786 (0x6625 bytes) 000124 1787573483.602082 write 0x039ddf thru 0x03ffff (0x6221 bytes) 000126 1787573483.606044 mapwrite 0x03835a thru 0x03c682 (0x4329 bytes) 000127 1787573483.815823 write 0x034116 thru 0x03d69b (0x9586 bytes) 000129 1787573483.819663 mapwrite 0x00b352 thru 0x00e57c (0x322b bytes) 000132 1787573483.945189 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xf458b273 (stale) Mirror 8: 0xf458b273 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xf458b273 (stale) Mirror 8: 0xf458b273 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000133 1787573484.432456 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xf458b273 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xf458b273 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000136 1787573484.968153 mapread 0x01e221 thru 0x024b74 (0x6954 bytes) 000141 1787573485.016301 read 0x03f060 thru 0x03ffff (0xfa0 bytes) 000142 1787573485.027748 write 0x00b7d5 thru 0x00b7de (0xa bytes) 000143 1787573485.048735 mapread 0x0347d4 thru 0x03e547 (0x9d74 bytes) 000145 1787573485.131834 MIRROR_RESYNC 2 mirrors 000146 1787573487.297070 write 0x02ead0 thru 0x039ba0 (0xb0d1 bytes) 000147 1787573487.498022 trunc from 0x040000 to 0x029e2b (0x161d4 bytes) 000149 1787573487.531790 trunc from 0x029e2c to 0x00c894 (0x1d597 bytes) 000150 1787573487.562195 mapwrite 0x0099f9 thru 0x00a2ea (0x8f2 bytes) 000151 1787573487.656437 read 0x00a394 thru 0x00c894 (0x2501 bytes) 000152 1787573487.668746 trunc from 0x00c895 to 0x01c729 (0xfe95 bytes) 000153 1787573487.697932 write 0x03c5bd thru 0x03ffff (0x3a43 bytes) 000156 1787573487.709156 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xcb16e2ca (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5a0e1d36 Mirror 9: 0x5a0e1d36 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000157 1787573489.869072 read 0x019e47 thru 0x01fb7a (0x5d34 bytes) 000158 1787573489.891933 trunc from 0x040000 to 0x007698 (0x38967 bytes) 000160 1787573490.198852 mapwrite 0x016919 thru 0x01c57b (0x5c63 bytes) 000165 1787573490.476752 read 0x00c6f3 thru 0x01048e (0x3d9c bytes) 000166 1787573490.521752 mapwrite 0x028ab8 thru 0x036db6 (0xe2ff bytes) 000170 1787573490.742206 mapwrite 0x001e1a thru 0x00413d (0x2324 bytes) 000171 1787573490.878234 write 0x012474 thru 0x01a9c4 (0x8551 bytes) 000172 1787573490.896212 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x36db7): Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36db7): Mirror 8: 0x202d772a (stale) Mirror 9: 0x95b768fe (stale) CRC-32 checksum value for chunk [0, 0x36db7): Mirror 1: 0x36ffac04 Mirror 10: 0x36ffac04 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36db7: skipped 000173 1787573493.419468 write 0x031aa2 thru 0x03321d (0x177c bytes) 000175 1787573493.530973 mapread 0x02c26e thru 0x036db6 (0xab49 bytes) 000176 1787573493.551632 write 0x0007a3 thru 0x00682c (0x608a bytes) 000177 1787573493.565150 read 0x00da4f thru 0x00fb7a (0x212c bytes) 000178 1787573493.576808 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36db7): Mirror 8: 0x202d772a (stale) Mirror 9: 0x95b768fe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36db7): Mirror 8: 0x202d772a (stale) Mirror 9: 0x95b768fe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36db7: skipped 000179 1787573494.021303 mapread 0x00de43 thru 0x015147 (0x7305 bytes) 000180 1787573494.052565 write 0x00d414 thru 0x016271 (0x8e5e bytes) 000181 1787573494.054702 trunc from 0x036db7 to 0x024caf (0x12107 bytes) 000182 1787573494.101535 trunc from 0x024cb0 to 0x008ca7 (0x1c008 bytes) 000183 1787573494.153330 write 0x03b537 thru 0x03ffff (0x4ac9 bytes) 000185 1787573494.155318 mapread 0x011518 thru 0x014864 (0x334d bytes) 000186 1787573494.166944 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x5a0e1d36 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x5a0e1d36 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000187 1787573494.472964 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x5a0e1d36 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x82e32637 Mirror 10: 0x82e32637 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000188 1787573496.004061 mapwrite 0x024063 thru 0x027e31 (0x3dcf bytes) 000191 1787573496.512469 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x5a0e1d36 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x5a0e1d36 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000192 1787573497.084879 trunc from 0x040000 to 0x014897 (0x2b768 bytes) 000197 1787573497.106842 mapwrite 0x01672f thru 0x02635d (0xfc2f bytes) 000198 1787573497.263511 mapread 0x0056bd thru 0x00c4e7 (0x6e2b bytes) 000199 1787573497.296313 mapread 0x005d4e thru 0x00be0b (0x60be bytes) 000201 1787573497.301322 mapread 0x023247 thru 0x02635d (0x3117 bytes) 000202 1787573497.303172 read 0x000c43 thru 0x008c32 (0x7ff0 bytes) 000203 1787573497.311166 write 0x02020e thru 0x02f315 (0xf108 bytes) 000204 1787573497.312822 trunc from 0x02f316 to 0x035b1a (0x6805 bytes) 000205 1787573497.364964 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x35b1b): Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35b1b): Mirror 9: 0xa8963536 (stale) CRC-32 checksum value for chunk [0, 0x35b1b): Mirror 1: 0xa73dd992 Mirror 10: 0xa73dd992 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35b1b: skipped truncating to largest ever: 0x3d6b0 000207 1787573499.221061 trunc from 0x035b1b to 0x03d6af (0x7b95 bytes) 000208 1787573499.434367 mapread 0x036985 thru 0x03d6af (0x6d2b bytes) 000211 1787573499.502209 trunc from 0x03d6b0 to 0x03c6bd (0xff2 bytes) 000213 1787573499.564022 mapread 0x00de50 thru 0x0137c6 (0x5977 bytes) 000216 1787573499.594055 trunc from 0x03c6be to 0x01d8e2 (0x1eddb bytes) 000218 1787573499.639981 mapread 0x01274e thru 0x0132c0 (0xb73 bytes) 000219 1787573499.640980 trunc from 0x01d8e3 to 0x016df2 (0x6af0 bytes) 000220 1787573499.684975 mapwrite 0x003d7e thru 0x00f3ba (0xb63d bytes) 000221 1787573499.811237 MIRROR_RESYNC 3 mirrors 000223 1787573501.398210 trunc from 0x016df3 to 0x0181e6 (0x13f4 bytes) 000224 1787573501.569749 mapwrite 0x03e40b thru 0x03ffff (0x1bf5 bytes) 000226 1787573501.715724 trunc from 0x040000 to 0x026139 (0x19ec6 bytes) 000229 1787573501.768603 MIRROR_RESYNC 3 mirrors 000232 1787573503.522929 MIRROR_RESYNC 3 mirrors 000233 1787573504.217306 MIRROR_EXTEND to 4 mirrors 000235 1787573505.359501 mapwrite 0x03e8b9 thru 0x03ffff (0x1747 bytes) 000238 1787573505.677299 mapread 0x00c350 thru 0x00db48 (0x17f9 bytes) 000239 1787573505.691191 read 0x005baf thru 0x009fad (0x43ff bytes) 000241 1787573505.693572 trunc from 0x040000 to 0x035d45 (0xa2ba bytes) 000242 1787573505.720715 trunc from 0x035d46 to 0x0366dc (0x997 bytes) 000245 1787573505.746018 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x366dd): Mirror 10: 0x752802f8 (stale) Mirror 11: 0x752802f8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x366dd): Mirror 10: 0x752802f8 (stale) Mirror 11: 0x752802f8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x366dd: skipped 000246 1787573506.407132 read 0x008452 thru 0x00ae03 (0x29b2 bytes) 000249 1787573506.424028 MIRROR_RESYNC 3 mirrors 000250 1787573507.819185 MIRROR_RESYNC 3 mirrors 000251 1787573508.429138 read 0x02cefd thru 0x033127 (0x622b bytes) 000256 1787573508.464602 mapread 0x01a14d thru 0x01a6d5 (0x589 bytes) 000257 1787573508.476031 write 0x006567 thru 0x008442 (0x1edc bytes) 000258 1787573508.586494 write 0x03108a thru 0x03186b (0x7e2 bytes) 000259 1787573508.595760 read 0x008a88 thru 0x016905 (0xde7e bytes) 000260 1787573508.627878 mapwrite 0x02eeba thru 0x035cb3 (0x6dfa bytes) 000262 1787573508.739211 trunc from 0x0366dd to 0x007359 (0x2f383 bytes) 000263 1787573508.814692 read 0x0048e1 thru 0x007359 (0x2a79 bytes) 000266 1787573508.816519 mapwrite 0x00b528 thru 0x01862d (0xd106 bytes) 000267 1787573509.042711 trunc from 0x01862e to 0x023fc9 (0xb99c bytes) 000269 1787573509.097358 mapwrite 0x031239 thru 0x034e2f (0x3bf7 bytes) 000270 1787573509.295082 trunc from 0x034e30 to 0x00cfa8 (0x27e87 bytes) 000271 1787573509.343104 mapwrite 0x019121 thru 0x0284cb (0xf3ab bytes) 000273 1787573509.685870 trunc from 0x0284cc to 0x02f5d5 (0x710a bytes) 000275 1787573509.717510 mapread 0x0188c7 thru 0x0208d3 (0x800d bytes) 000279 1787573509.730692 trunc from 0x02f5d6 to 0x03b00c (0xba37 bytes) 000280 1787573509.755193 mapwrite 0x00ca84 thru 0x0124a9 (0x5a26 bytes) 000281 1787573509.852695 mapread 0x004ec0 thru 0x005d75 (0xeb6 bytes) 000282 1787573509.853670 read 0x038049 thru 0x0397d8 (0x1790 bytes) 000283 1787573509.854258 read 0x01526c thru 0x018707 (0x349c bytes) 000284 1787573509.872438 MIRROR_RESYNC 3 mirrors 000285 1787573511.408162 MIRROR_EXTEND to 4 mirrors 000287 1787573512.711670 write 0x037e74 thru 0x03c3cb (0x4558 bytes) 000289 1787573512.798728 read 0x01f903 thru 0x02f738 (0xfe36 bytes) 000290 1787573512.822215 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c3cc): Mirror 10: 0x7c28fcb3 (stale) Mirror 12: 0x7c28fcb3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c3cc): Mirror 10: 0x7c28fcb3 (stale) Mirror 12: 0x7c28fcb3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c3cc: skipped 000291 1787573513.187806 mapread 0x000618 thru 0x00648f (0x5e78 bytes) 000294 1787573513.215016 read 0x039bf2 thru 0x03c3cb (0x27da bytes) 000296 1787573513.225645 mapwrite 0x01956b thru 0x025232 (0xbcc8 bytes) 000297 1787573513.311634 mapwrite 0x02924a thru 0x02984c (0x603 bytes) 000298 1787573513.390479 write 0x010aff thru 0x01a608 (0x9b0a bytes) 000300 1787573513.400747 mapread 0x00e112 thru 0x016dde (0x8ccd bytes) 000301 1787573513.402774 read 0x029c5b thru 0x0334d0 (0x9876 bytes) 000302 1787573513.420126 read 0x02ca9b thru 0x02cdee (0x354 bytes) 000304 1787573513.432877 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c3cc): Mirror 10: 0x7c28fcb3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c3cc): Mirror 10: 0x7c28fcb3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c3cc: skipped 000306 1787573513.961054 write 0x0342d2 thru 0x036ae6 (0x2815 bytes) 000307 1787573514.002724 MIRROR_RESYNC 2 mirrors 000308 1787573515.239259 trunc from 0x03c3cc to 0x0177f8 (0x24bd3 bytes) 000309 1787573515.471220 read 0x008529 thru 0x00890f (0x3e7 bytes) 000311 1787573515.507176 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x177f9): Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x177f9): Mirror 10: 0x529452a4 (stale) CRC-32 checksum value for chunk [0, 0x177f9): Mirror 1: 0x529452a4 Mirror 11: 0x529452a4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x177f9: skipped 000312 1787573517.318718 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x177f9): Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x177f9): Mirror 10: 0x529452a4 (stale) CRC-32 checksum value for chunk [0, 0x177f9): Mirror 1: 0x529452a4 Mirror 11: 0x529452a4 Mirror 12: 0x529452a4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x177f9: skipped 000315 1787573518.722698 trunc from 0x0177f9 to 0x008cf1 (0xeb07 bytes) 000316 1787573518.844577 trunc from 0x008cf2 to 0x028a78 (0x1fd87 bytes) 000317 1787573518.910593 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28a79): Mirror 11: 0x3d7f4b3b (stale) Mirror 12: 0x3d7f4b3b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28a79): Mirror 11: 0x3d7f4b3b (stale) Mirror 12: 0x3d7f4b3b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28a79: skipped 000318 1787573519.432359 trunc from 0x028a79 to 0x0128c2 (0x161b6 bytes) 000322 1787573519.467657 MIRROR_RESYNC 3 mirrors 000323 1787573521.040276 mapwrite 0x00b53a thru 0x018888 (0xd34f bytes) 000327 1787573521.286746 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x18889): Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18889): Mirror 11: 0x3ea2c8c7 (stale) Mirror 12: 0x3ea2c8c7 (stale) CRC-32 checksum value for chunk [0, 0x18889): Mirror 1: 0xcd854691 Mirror 13: 0xcd854691 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18889: skipped 000328 1787573522.725282 read 0x001c48 thru 0x00b3e8 (0x97a1 bytes) 000329 1787573522.737806 mapread 0x007f47 thru 0x0134bd (0xb577 bytes) 000330 1787573522.773607 trunc from 0x018889 to 0x007298 (0x115f0 bytes) 000331 1787573522.878985 read 0x005860 thru 0x007298 (0x1a39 bytes) 000332 1787573522.885558 trunc from 0x007299 to 0x01574f (0xe4b7 bytes) 000333 1787573522.906957 write 0x001728 thru 0x00a62f (0x8f08 bytes) 000334 1787573522.915799 write 0x03aeee thru 0x03ffff (0x5112 bytes) 000335 1787573522.917223 write 0x01e248 thru 0x021ce9 (0x3aa2 bytes) 000336 1787573522.925567 mapread 0x0196c8 thru 0x01db06 (0x443f bytes) 000337 1787573522.927053 mapwrite 0x010c3e thru 0x018189 (0x754c bytes) 000339 1787573522.972597 read 0x006c00 thru 0x0148cc (0xdccd bytes) 000340 1787573522.973819 mapread 0x01ca25 thru 0x0295f6 (0xcbd2 bytes) 000341 1787573522.975845 mapwrite 0x01b1c5 thru 0x01b984 (0x7c0 bytes) 000342 1787573523.060312 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x6e34bf1c (stale) Mirror 13: 0x4b90d143 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x6e34bf1c (stale) Mirror 13: 0x4b90d143 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000343 1787573523.470577 trunc from 0x040000 to 0x023c8f (0x1c370 bytes) 000344 1787573523.487645 mapwrite 0x0322bd thru 0x0398c5 (0x7609 bytes) 000346 1787573523.573913 mapwrite 0x03a937 thru 0x03ffff (0x56c9 bytes) 000348 1787573523.656931 mapwrite 0x02e1f9 thru 0x03ddb1 (0xfbb9 bytes) 000349 1787573523.759266 write 0x036569 thru 0x03d4c3 (0x6f5b bytes) 000351 1787573523.761545 write 0x008536 thru 0x011cf6 (0x97c1 bytes) 000353 1787573523.775724 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x6e34bf1c (stale) Mirror 13: 0x4b90d143 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe43a6cb5 Mirror 14: 0xe43a6cb5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000354 1787573525.256155 write 0x003ac0 thru 0x00c64b (0x8b8c bytes) 000358 1787573525.396443 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x6e34bf1c (stale) Mirror 14: 0xe43a6cb5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x6e34bf1c (stale) Mirror 14: 0xe43a6cb5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000359 1787573525.863225 trunc from 0x040000 to 0x00d656 (0x329a9 bytes) 000360 1787573525.894937 read 0x005655 thru 0x00d656 (0x8002 bytes) 000361 1787573525.920952 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xd657): Mirror 12: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd657): Mirror 12: 0xd7dc0d0f (stale) Mirror 14: 0xf510e2bc (stale) CRC-32 checksum value for chunk [0, 0xd657): Mirror 1: 0x6a15ff0f Mirror 15: 0x6a15ff0f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd657: skipped 000362 1787573526.949501 read 0x005091 thru 0x009da6 (0x4d16 bytes) 000364 1787573526.960370 read 0x0036f2 thru 0x008320 (0x4c2f bytes) truncating to largest ever: 0x3f098 000365 1787573526.967690 trunc from 0x00d657 to 0x03f097 (0x31a41 bytes) 000366 1787573527.103904 mapwrite 0x027e6d thru 0x02bb49 (0x3cdd bytes) 000368 1787573527.214425 trunc from 0x03f098 to 0x00220b (0x3ce8c bytes) 000371 1787573527.260159 read 0x001f3b thru 0x00220b (0x2d1 bytes) 000373 1787573527.276177 mapread 0x000b1a thru 0x00220b (0x16f2 bytes) 000376 1787573527.282921 MIRROR_RESYNC 4 mirrors 000378 1787573528.156050 read 0x0000c8 thru 0x00220b (0x2144 bytes) 000379 1787573528.161554 mapread 0x001f0f thru 0x00220b (0x2fd bytes) 000381 1787573528.162488 trunc from 0x00220c to 0x0141c9 (0x11fbe bytes) 000383 1787573528.274691 write 0x03f1f4 thru 0x03ffff (0xe0c bytes) 000384 1787573528.280061 write 0x02473e thru 0x03078f (0xc052 bytes) 000386 1787573528.299918 MIRROR_RESYNC 4 mirrors 000389 1787573529.756834 read 0x032055 thru 0x03b4ae (0x945a bytes) 000390 1787573529.768616 write 0x0316f7 thru 0x03ffff (0xe909 bytes) 000391 1787573529.837262 read 0x014f2f thru 0x019b3d (0x4c0f bytes) 000393 1787573529.848997 mapwrite 0x004af5 thru 0x00aa2c (0x5f38 bytes) 000397 1787573529.982884 mapwrite 0x02070f thru 0x029190 (0x8a82 bytes) 000398 1787573530.062464 read 0x023a4b thru 0x02d0dd (0x9693 bytes) 000399 1787573530.063051 mapwrite 0x02b9b7 thru 0x02c84a (0xe94 bytes) 000400 1787573530.112514 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x2393f93e (stale) Mirror 14: 0x2393f93e (stale) Mirror 15: 0x2393f93e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x571a5507 Mirror 16: 0x571a5507 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000401 1787573531.083977 read 0x00aed2 thru 0x011fd9 (0x7108 bytes) 000404 1787573531.127195 mapwrite 0x01e7f1 thru 0x02cc30 (0xe440 bytes) 000405 1787573531.429441 mapwrite 0x009d04 thru 0x01948f (0xf78c bytes) 000407 1787573531.523692 write 0x03a079 thru 0x03ffff (0x5f87 bytes) 000409 1787573531.540547 trunc from 0x040000 to 0x01742b (0x28bd4 bytes) 000410 1787573531.618616 write 0x0021e7 thru 0x0120da (0xfef4 bytes) 000411 1787573531.629138 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1742c): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1742c): Mirror 12: 0xfbd4a85c (stale) Mirror 14: 0xfbd4a85c (stale) Mirror 15: 0xfbd4a85c (stale) Mirror 16: 0x478aee63 (stale) CRC-32 checksum value for chunk [0, 0x1742c): Mirror 1: 0xe83b88b Mirror 17: 0xe83b88b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1742c: skipped 000412 1787573532.481261 read 0x00c042 thru 0x00f778 (0x3737 bytes) 000413 1787573532.488814 mapread 0x009237 thru 0x0132b7 (0xa081 bytes) 000414 1787573532.505733 write 0x03f533 thru 0x03ffff (0xacd bytes) 000415 1787573532.571164 mapread 0x02212d thru 0x02ffa4 (0xde78 bytes) 000417 1787573532.586263 write 0x00f9f2 thru 0x016a98 (0x70a7 bytes) 000418 1787573532.600869 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x2393f93e (stale) Mirror 15: 0x2393f93e (stale) Mirror 16: 0x571a5507 (stale) Mirror 17: 0xe7cdfb01 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x2393f93e (stale) Mirror 15: 0x2393f93e (stale) Mirror 16: 0x571a5507 (stale) Mirror 17: 0xe7cdfb01 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000419 1787573533.159607 mapwrite 0x029bd4 thru 0x03265d (0x8a8a bytes) 000421 1787573533.240758 read 0x00b061 thru 0x010e39 (0x5dd9 bytes) 000424 1787573533.249848 mapread 0x000515 thru 0x00d467 (0xcf53 bytes) 000426 1787573533.264451 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x2393f93e (stale) Mirror 15: 0x2393f93e (stale) Mirror 16: 0x571a5507 (stale) Mirror 17: 0xe7cdfb01 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1dba2748 Mirror 18: 0x1dba2748 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000427 1787573534.836857 mapread 0x022dac thru 0x02fe78 (0xd0cd bytes) 000429 1787573534.902013 read 0x004ebe thru 0x009650 (0x4793 bytes) 000432 1787573534.947849 mapread 0x03eac2 thru 0x03ffff (0x153e bytes) 000433 1787573534.974581 mapwrite 0x004f72 thru 0x013f3c (0xefcb bytes) 000434 1787573535.263846 trunc from 0x040000 to 0x034592 (0xba6d bytes) 000435 1787573535.302640 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34593): Mirror 12: 0xfb31352 (stale) Mirror 15: 0xfb31352 (stale) Mirror 17: 0xd5899876 (stale) Mirror 18: 0x37abc284 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34593): Mirror 12: 0xfb31352 (stale) Mirror 15: 0xfb31352 (stale) Mirror 17: 0xd5899876 (stale) Mirror 18: 0x37abc284 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34593: skipped 000436 1787573535.929629 write 0x0029d9 thru 0x010609 (0xdc31 bytes) 000438 1787573535.947302 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34593): Mirror 12: 0xfb31352 (stale) Mirror 15: 0xfb31352 (stale) Mirror 18: 0x37abc284 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34593): Mirror 12: 0xfb31352 (stale) Mirror 15: 0xfb31352 (stale) Mirror 18: 0x37abc284 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34593: skipped 000443 1787573536.390052 write 0x02aa51 thru 0x0312c5 (0x6875 bytes) 000444 1787573536.413791 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x34593): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34593): Mirror 12: 0xfb31352 (stale) Mirror 15: 0xfb31352 (stale) Mirror 18: 0x37abc284 (stale) CRC-32 checksum value for chunk [0, 0x34593): Mirror 1: 0xa910f1d5 Mirror 19: 0xa910f1d5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34593: skipped 000448 1787573538.326903 MIRROR_RESYNC 5 mirrors 000450 1787573540.226928 trunc from 0x034593 to 0x00a15d (0x2a435 bytes) 000451 1787573540.353269 write 0x02f80b thru 0x033b64 (0x435a bytes) 000452 1787573540.362957 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x33b65): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33b65): Mirror 12: 0x8e2099eb (stale) Mirror 15: 0x8e2099eb (stale) Mirror 18: 0x8e2099eb (stale) Mirror 19: 0x8e2099eb (stale) CRC-32 checksum value for chunk [0, 0x33b65): Mirror 1: 0xd33d3ce3 Mirror 20: 0xd33d3ce3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33b65: skipped 000455 1787573541.902863 MIRROR_RESYNC 6 mirrors 000458 1787573544.163990 mapwrite 0x00e8c1 thru 0x01a07d (0xb7bd bytes) 000459 1787573544.657741 read 0x0311b5 thru 0x033b64 (0x29b0 bytes) 000460 1787573544.665692 trunc from 0x033b65 to 0x01b9a0 (0x181c4 bytes) 000464 1787573544.702256 write 0x00e0b0 thru 0x013063 (0x4fb4 bytes) 000465 1787573544.706846 mapwrite 0x02993e thru 0x0389a2 (0xf065 bytes) 000468 1787573545.033174 mapread 0x023f3d thru 0x027367 (0x342b bytes) 000469 1787573545.039854 read 0x031659 thru 0x0389a2 (0x734a bytes) 000470 1787573545.054837 MIRROR_RESYNC 6 mirrors 000471 1787573548.161567 write 0x016ff1 thru 0x01cd29 (0x5d39 bytes) 000472 1787573548.297412 mapwrite 0x02bdf3 thru 0x030b9e (0x4dac bytes) 000475 1787573548.381331 mapwrite 0x0225c3 thru 0x025764 (0x31a2 bytes) 000479 1787573548.503499 read 0x007f1f thru 0x00fd31 (0x7e13 bytes) 000481 1787573548.521678 mapwrite 0x002f94 thru 0x010fd9 (0xe046 bytes) 000482 1787573548.613556 write 0x010002 thru 0x0151ac (0x51ab bytes) 000485 1787573548.626766 read 0x01645c thru 0x01ffce (0x9b73 bytes) 000487 1787573548.637296 MIRROR_RESYNC 6 mirrors 000488 1787573552.194089 mapread 0x0244cc thru 0x030867 (0xc39c bytes) 000490 1787573552.224921 MIRROR_EXTEND to 7 mirrors 000494 1787573553.600957 write 0x029b30 thru 0x02b1a7 (0x1678 bytes) 000495 1787573553.819833 read 0x00cc3c thru 0x013db8 (0x717d bytes) 000496 1787573553.848687 MIRROR_RESYNC 7 mirrors 000497 1787573556.585863 mapwrite 0x00c227 thru 0x01306d (0x6e47 bytes) 000498 1787573556.890718 mapwrite 0x00bac3 thru 0x00da61 (0x1f9f bytes) 000501 1787573557.029952 trunc from 0x0389a3 to 0x023f27 (0x14a7b bytes) 000502 1787573557.108922 trunc from 0x023f28 to 0x0283a3 (0x447c bytes) 000505 1787573557.146750 mapwrite 0x02d411 thru 0x03b109 (0xdcf9 bytes) 000507 1787573557.367604 trunc from 0x03b10a to 0x00c3aa (0x2ed5f bytes) 000508 1787573557.386491 mapread 0x00a701 thru 0x00c3aa (0x1caa bytes) 000509 1787573557.387373 mapwrite 0x003ede thru 0x00c94e (0x8a71 bytes) 000510 1787573557.495303 read 0x002466 thru 0x00c94e (0xa4e9 bytes) 000511 1787573557.498499 read 0x00b5a7 thru 0x00c94e (0x13a8 bytes) 000512 1787573557.499317 mapread 0x00aa76 thru 0x00c94e (0x1ed9 bytes) 000513 1787573557.502576 write 0x011ced thru 0x016774 (0x4a88 bytes) 000514 1787573557.505623 write 0x0160ab thru 0x0215d3 (0xb529 bytes) 000516 1787573557.508048 trunc from 0x0215d4 to 0x025bf2 (0x461f bytes) 000517 1787573557.561970 read 0x015134 thru 0x01c3b7 (0x7284 bytes) 000518 1787573557.565864 trunc from 0x025bf3 to 0x02abf9 (0x5007 bytes) 000519 1787573557.628810 write 0x017fd8 thru 0x01f37b (0x73a4 bytes) 000520 1787573557.630822 mapread 0x00252c thru 0x00ef7b (0xca50 bytes) 000522 1787573557.650128 mapread 0x026503 thru 0x02abf9 (0x46f7 bytes) 000523 1787573557.651859 mapread 0x0287ae thru 0x0291f0 (0xa43 bytes) 000524 1787573557.653586 mapread 0x00d28e thru 0x016357 (0x90ca bytes) 000525 1787573557.654535 trunc from 0x02abfa to 0x0105ea (0x1a60f bytes) 000526 1787573557.683565 read 0x007e54 thru 0x0105ea (0x8797 bytes) 000527 1787573557.690362 mapwrite 0x02ba71 thru 0x02efdd (0x356d bytes) 000529 1787573557.882800 write 0x0294e0 thru 0x02c7d1 (0x32f2 bytes) 000530 1787573557.901103 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2efde): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2efde): Mirror 12: 0x4ba57093 (stale) Mirror 15: 0x4ba57093 (stale) Mirror 18: 0x4ba57093 (stale) Mirror 19: 0x4ba57093 (stale) Mirror 20: 0x4ba57093 (stale) Mirror 21: 0x4ba57093 (stale) CRC-32 checksum value for chunk [0, 0x2efde): Mirror 1: 0xdad3911e Mirror 22: 0xdad3911e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2efde: skipped 000532 1787573559.981321 mapwrite 0x009d7a thru 0x00e3e7 (0x466e bytes) 000533 1787573560.337863 mapread 0x007715 thru 0x0170b5 (0xf9a1 bytes) 000539 1787573560.366859 trunc from 0x02efde to 0x02a134 (0x4ea9 bytes) 000541 1787573560.429105 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a135): Mirror 15: 0xc07e349d (stale) Mirror 18: 0xc07e349d (stale) Mirror 19: 0xc07e349d (stale) Mirror 20: 0xc07e349d (stale) Mirror 21: 0xc07e349d (stale) Mirror 22: 0xd651c482 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a135): Mirror 15: 0xc07e349d (stale) Mirror 18: 0xc07e349d (stale) Mirror 19: 0xc07e349d (stale) Mirror 20: 0xc07e349d (stale) Mirror 21: 0xc07e349d (stale) Mirror 22: 0xd651c482 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a135: skipped 000542 1787573561.222662 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2a135): Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a135): Mirror 15: 0xc07e349d (stale) Mirror 18: 0xc07e349d (stale) Mirror 19: 0xc07e349d (stale) Mirror 20: 0xc07e349d (stale) Mirror 21: 0xc07e349d (stale) Mirror 22: 0xd651c482 (stale) CRC-32 checksum value for chunk [0, 0x2a135): Mirror 1: 0xf7478e80 Mirror 23: 0xf7478e80 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a135: skipped 000544 1787573563.269122 mapread 0x00f621 thru 0x01d792 (0xe172 bytes) 000545 1787573563.352794 MIRROR_RESYNC 8 mirrors 000546 1787573565.369184 mapwrite 0x00ee58 thru 0x014703 (0x58ac bytes) 000549 1787573565.617834 mapread 0x009802 thru 0x011c14 (0x8413 bytes) 000550 1787573565.620770 mapread 0x025a85 thru 0x02a134 (0x46b0 bytes) 000553 1787573565.647149 mapread 0x00f33f thru 0x016bb1 (0x7873 bytes) 000556 1787573565.657715 write 0x018fdc thru 0x01e2db (0x5300 bytes) 000557 1787573565.682802 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a135): Mirror 15: 0xf7478e80 (stale) Mirror 18: 0xf7478e80 (stale) Mirror 19: 0xf7478e80 (stale) Mirror 21: 0xf7478e80 (stale) Mirror 22: 0xf7478e80 (stale) Mirror 23: 0xf7478e80 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a135): Mirror 15: 0xf7478e80 (stale) Mirror 18: 0xf7478e80 (stale) Mirror 19: 0xf7478e80 (stale) Mirror 21: 0xf7478e80 (stale) Mirror 22: 0xf7478e80 (stale) Mirror 23: 0xf7478e80 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a135: skipped 000560 1787573566.663107 write 0x03561d thru 0x038f10 (0x38f4 bytes) 000561 1787573566.664192 mapwrite 0x0199b5 thru 0x0202a2 (0x68ee bytes) 000562 1787573566.823364 mapread 0x022534 thru 0x02e5f3 (0xc0c0 bytes) 000565 1787573566.861327 read 0x033b72 thru 0x038f10 (0x539f bytes) 000566 1787573566.863751 mapwrite 0x02f19c thru 0x03c9f0 (0xd855 bytes) 000568 1787573566.963485 MIRROR_RESYNC 7 mirrors 000572 1787573570.934113 read 0x021914 thru 0x0233b6 (0x1aa3 bytes) 000573 1787573570.962348 mapwrite 0x02d865 thru 0x0392c9 (0xba65 bytes) 000578 1787573571.315864 trunc from 0x03c9f1 to 0x03ecc1 (0x22d1 bytes) 000580 1787573571.379368 read 0x001346 thru 0x00ed4b (0xda06 bytes) 000581 1787573571.396633 mapread 0x036da7 thru 0x039530 (0x278a bytes) 000584 1787573571.414124 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3ecc2): Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ecc2): Mirror 15: 0x1aba3d96 (stale) Mirror 18: 0x1aba3d96 (stale) Mirror 19: 0x1aba3d96 (stale) Mirror 21: 0x1aba3d96 (stale) Mirror 22: 0x1aba3d96 (stale) Mirror 23: 0x1aba3d96 (stale) CRC-32 checksum value for chunk [0, 0x3ecc2): Mirror 1: 0xd5f277b1 Mirror 24: 0xd5f277b1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ecc2: skipped 000585 1787573573.669792 read 0x0337cc thru 0x036629 (0x2e5e bytes) 000586 1787573573.694219 mapread 0x01c520 thru 0x029e77 (0xd958 bytes) 000587 1787573573.797026 mapwrite 0x01ba30 thru 0x02a08c (0xe65d bytes) 000588 1787573574.085312 mapwrite 0x00d8e8 thru 0x019b97 (0xc2b0 bytes) 000591 1787573574.151689 read 0x03687b thru 0x03ecc1 (0x8447 bytes) 000592 1787573574.166573 mapread 0x015aa3 thru 0x0250c7 (0xf625 bytes) 000594 1787573574.172252 mapread 0x039c39 thru 0x03ecc1 (0x5089 bytes) 000598 1787573574.182135 trunc from 0x03ecc2 to 0x03d8b0 (0x1411 bytes) 000600 1787573574.215612 read 0x02ab8d thru 0x032df1 (0x8265 bytes) 000603 1787573574.221030 read 0x00e9c2 thru 0x00fe54 (0x1493 bytes) 000605 1787573574.223784 read 0x00eaf4 thru 0x011461 (0x296e bytes) 000607 1787573574.227583 read 0x03380c thru 0x03b92e (0x8123 bytes) 000608 1787573574.229639 mapread 0x01ff83 thru 0x02a45b (0xa4d9 bytes) 000609 1787573574.230849 trunc from 0x03d8b1 to 0x01ca9b (0x20e15 bytes) 000610 1787573574.270505 mapread 0x013839 thru 0x01ca9b (0x9263 bytes) 000612 1787573574.277938 trunc from 0x01ca9c to 0x02721e (0xa783 bytes) 000614 1787573574.308996 trunc from 0x02721f to 0x01d6be (0x9b60 bytes) 000615 1787573574.329495 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1d6bf): Mirror 15: 0x6bdb757a (stale) Mirror 18: 0x6bdb757a (stale) Mirror 21: 0x6bdb757a (stale) Mirror 22: 0x6bdb757a (stale) Mirror 23: 0x6bdb757a (stale) Mirror 24: 0x6bdb757a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d6bf): Mirror 15: 0x6bdb757a (stale) Mirror 18: 0x6bdb757a (stale) Mirror 21: 0x6bdb757a (stale) Mirror 22: 0x6bdb757a (stale) Mirror 23: 0x6bdb757a (stale) Mirror 24: 0x6bdb757a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d6bf: skipped 000619 1787573574.784433 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1d6bf): Mirror 15: 0x6bdb757a (stale) Mirror 18: 0x6bdb757a (stale) Mirror 21: 0x6bdb757a (stale) Mirror 22: 0x6bdb757a (stale) Mirror 23: 0x6bdb757a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d6bf): Mirror 15: 0x6bdb757a (stale) Mirror 18: 0x6bdb757a (stale) Mirror 21: 0x6bdb757a (stale) Mirror 22: 0x6bdb757a (stale) Mirror 23: 0x6bdb757a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d6bf: skipped 000621 1787573575.264988 mapwrite 0x03d070 thru 0x03ffff (0x2f90 bytes) 000624 1787573575.439495 write 0x0129e2 thru 0x01d59c (0xabbb bytes) 000625 1787573575.461046 mapwrite 0x03839c thru 0x03ffff (0x7c64 bytes) 000626 1787573575.534303 mapwrite 0x021bb0 thru 0x02819f (0x65f0 bytes) 000630 1787573575.593771 write 0x039a4f thru 0x03ffff (0x65b1 bytes) 000631 1787573575.594899 mapwrite 0x0147f6 thru 0x018357 (0x3b62 bytes) 000633 1787573575.640275 write 0x037a57 thru 0x03ffff (0x85a9 bytes) 000634 1787573575.646518 read 0x031384 thru 0x03598b (0x4608 bytes) 000635 1787573575.656642 read 0x034e6d thru 0x039333 (0x44c7 bytes) 000637 1787573575.670049 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x2447fe2a (stale) Mirror 18: 0x2447fe2a (stale) Mirror 21: 0x2447fe2a (stale) Mirror 22: 0x2447fe2a (stale) Mirror 23: 0x2447fe2a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x93c26668 Mirror 24: 0x93c26668 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000640 1787573577.459765 MIRROR_RESYNC 7 mirrors 000641 1787573580.005645 mapread 0x01f569 thru 0x024488 (0x4f20 bytes) 000642 1787573580.043990 write 0x0248dd thru 0x0295cb (0x4cef bytes) 000643 1787573580.213249 write 0x001a57 thru 0x00fff7 (0xe5a1 bytes) 000645 1787573580.227048 mapwrite 0x02f9a8 thru 0x0323de (0x2a37 bytes) 000648 1787573580.365691 mapread 0x00e77b thru 0x011f5a (0x37e0 bytes) 000649 1787573580.385700 mapwrite 0x022261 thru 0x030ccb (0xea6b bytes) 000651 1787573580.476355 write 0x026e16 thru 0x031f16 (0xb101 bytes) 000652 1787573580.478247 trunc from 0x040000 to 0x00452a (0x3bad5 bytes) 000654 1787573580.524154 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x452b): Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x452b): Mirror 15: 0xd39abb38 (stale) Mirror 18: 0xd39abb38 (stale) Mirror 21: 0xd39abb38 (stale) Mirror 22: 0xd39abb38 (stale) Mirror 23: 0xd39abb38 (stale) Mirror 24: 0xd39abb38 (stale) CRC-32 checksum value for chunk [0, 0x452b): Mirror 1: 0xaa36c604 Mirror 25: 0xaa36c604 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x452b: skipped 000656 1787573581.682862 mapread 0x000534 thru 0x00452a (0x3ff7 bytes) 000660 1787573581.805121 trunc from 0x00452b to 0x024f6b (0x20a41 bytes) 000661 1787573581.955909 read 0x012f32 thru 0x01ac33 (0x7d02 bytes) 000662 1787573581.979232 MIRROR_RESYNC 8 mirrors 000665 1787573583.790464 MIRROR_EXTEND to 9 mirrors 000667 1787573584.839564 write 0x01dcff thru 0x02669e (0x89a0 bytes) 000668 1787573584.939135 mapwrite 0x00447e thru 0x00a35e (0x5ee1 bytes) 000670 1787573585.079649 write 0x021c2a thru 0x0242c5 (0x269c bytes) 000671 1787573585.080778 read 0x004ad8 thru 0x006244 (0x176d bytes) 000672 1787573585.083147 trunc from 0x02669f to 0x01e371 (0x832d bytes) 000674 1787573585.119171 write 0x00fbf0 thru 0x01b6a9 (0xbaba bytes) 000675 1787573585.135125 read 0x0022a2 thru 0x0074a9 (0x5208 bytes) 000676 1787573585.143371 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e372): Mirror 18: 0xba69b3e9 (stale) Mirror 21: 0xba69b3e9 (stale) Mirror 22: 0xba69b3e9 (stale) Mirror 23: 0xba69b3e9 (stale) Mirror 24: 0xba69b3e9 (stale) Mirror 25: 0xba69b3e9 (stale) Mirror 26: 0xba69b3e9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e372): Mirror 18: 0xba69b3e9 (stale) Mirror 21: 0xba69b3e9 (stale) Mirror 22: 0xba69b3e9 (stale) Mirror 23: 0xba69b3e9 (stale) Mirror 24: 0xba69b3e9 (stale) Mirror 25: 0xba69b3e9 (stale) Mirror 26: 0xba69b3e9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e372: skipped 000677 1787573585.917789 trunc from 0x01e372 to 0x003aed (0x1a884 bytes) 000678 1787573585.943123 mapwrite 0x03c33b thru 0x03ffff (0x3cc5 bytes) 000680 1787573586.077019 trunc from 0x040000 to 0x02f979 (0x10686 bytes) 000681 1787573586.104214 read 0x00aab0 thru 0x0175b8 (0xcb09 bytes) 000683 1787573586.117147 read 0x00e458 thru 0x0126dd (0x4286 bytes) 000684 1787573586.118589 read 0x02e771 thru 0x02f979 (0x1209 bytes) 000685 1787573586.130612 mapwrite 0x01aa31 thru 0x02779e (0xcd6e bytes) 000686 1787573586.236444 MIRROR_RESYNC 8 mirrors 000687 1787573589.061146 trunc from 0x02f97a to 0x00b399 (0x245e0 bytes) 000688 1787573589.159965 trunc from 0x00b39a to 0x03470e (0x29375 bytes) 000689 1787573589.181646 mapwrite 0x00119c thru 0x007781 (0x65e6 bytes) 000690 1787573589.244314 mapread 0x00093f thru 0x00a965 (0xa027 bytes) 000691 1787573589.251641 read 0x00c7b3 thru 0x01472d (0x7f7b bytes) 000693 1787573589.261666 mapread 0x033806 thru 0x03470e (0xf09 bytes) 000696 1787573589.275940 trunc from 0x03470f to 0x02c2c6 (0x8448 bytes) 000697 1787573589.296619 mapread 0x02b919 thru 0x02c2c6 (0x9ae bytes) 000700 1787573589.313748 trunc from 0x02c2c7 to 0x0280a2 (0x4224 bytes) 000701 1787573589.341671 write 0x01b9ce thru 0x02a8d9 (0xef0c bytes) 000703 1787573589.361700 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2a8da): Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a8da): Mirror 18: 0xf7f198ce (stale) Mirror 21: 0xf7f198ce (stale) Mirror 22: 0xf7f198ce (stale) Mirror 23: 0xf7f198ce (stale) Mirror 24: 0xf7f198ce (stale) Mirror 25: 0xf7f198ce (stale) Mirror 26: 0xf7f198ce (stale) CRC-32 checksum value for chunk [0, 0x2a8da): Mirror 1: 0xa01ed7e4 Mirror 27: 0xa01ed7e4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a8da: skipped 000705 1787573590.971127 write 0x022c5f thru 0x0253ed (0x278f bytes) 000706 1787573591.074987 write 0x00622f thru 0x013647 (0xd419 bytes) 000707 1787573591.089218 write 0x0114a5 thru 0x020c9b (0xf7f7 bytes) 000708 1787573591.096499 mapread 0x027599 thru 0x02a8d9 (0x3341 bytes) 000709 1787573591.118338 mapwrite 0x01f189 thru 0x02297a (0x37f2 bytes) 000712 1787573591.179548 mapread 0x0231d7 thru 0x0234e2 (0x30c bytes) 000714 1787573591.180928 read 0x006c65 thru 0x00feb7 (0x9253 bytes) 000716 1787573591.184840 mapwrite 0x004e50 thru 0x00ebdc (0x9d8d bytes) 000718 1787573591.253047 MIRROR_RESYNC 9 mirrors 000719 1787573593.526900 read 0x00f9c7 thru 0x018496 (0x8ad0 bytes) 000720 1787573593.543543 write 0x033f16 thru 0x03cec2 (0x8fad bytes) 000721 1787573593.678964 trunc from 0x03cec3 to 0x01ad62 (0x22160 bytes) 000722 1787573593.743784 mapwrite 0x030840 thru 0x03bffc (0xb7bd bytes) 000723 1787573593.911637 trunc from 0x03bffd to 0x010a7c (0x2b580 bytes) 000725 1787573593.942990 write 0x030578 thru 0x035510 (0x4f99 bytes) 000728 1787573593.953434 read 0x029df5 thru 0x035510 (0xb71c bytes) 000729 1787573593.968657 mapread 0x01308c thru 0x01d516 (0xa48b bytes) 000732 1787573593.970921 mapwrite 0x009354 thru 0x00de0b (0x4ab8 bytes) 000733 1787573594.035485 mapread 0x028a6e thru 0x02d437 (0x49ca bytes) 000734 1787573594.038071 mapread 0x0086ea thru 0x0132fc (0xac13 bytes) 000735 1787573594.040044 mapwrite 0x02168b thru 0x023ef8 (0x286e bytes) 000736 1787573594.084239 read 0x02d7e1 thru 0x0313e2 (0x3c02 bytes) 000737 1787573594.086057 trunc from 0x035511 to 0x0090a3 (0x2c46d bytes) 000738 1787573594.127487 mapwrite 0x026702 thru 0x03335f (0xcc5e bytes) 000739 1787573594.228849 write 0x01fc80 thru 0x0299c1 (0x9d42 bytes) 000742 1787573594.232725 read 0x00cb4b thru 0x010436 (0x38ec bytes) 000743 1787573594.233769 mapread 0x017b9a thru 0x01867d (0xae4 bytes) 000744 1787573594.235882 mapwrite 0x0338b2 thru 0x03b5d0 (0x7d1f bytes) 000745 1787573594.332800 MIRROR_RESYNC 9 mirrors 000746 1787573596.671896 mapwrite 0x0115ec thru 0x01bd8a (0xa79f bytes) 000747 1787573596.905528 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3b5d1): Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b5d1): Mirror 18: 0xff65389c (stale) Mirror 21: 0xff65389c (stale) Mirror 22: 0xff65389c (stale) Mirror 23: 0xff65389c (stale) Mirror 24: 0xff65389c (stale) Mirror 25: 0xff65389c (stale) Mirror 26: 0xff65389c (stale) Mirror 27: 0xff65389c (stale) CRC-32 checksum value for chunk [0, 0x3b5d1): Mirror 1: 0x64275042 Mirror 28: 0x64275042 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b5d1: skipped 000748 1787573598.430913 mapwrite 0x003896 thru 0x005fed (0x2758 bytes) 000751 1787573598.701096 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3b5d1): Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b5d1): Mirror 18: 0xff65389c (stale) Mirror 21: 0xff65389c (stale) Mirror 22: 0xff65389c (stale) Mirror 23: 0xff65389c (stale) Mirror 24: 0xff65389c (stale) Mirror 25: 0xff65389c (stale) Mirror 26: 0xff65389c (stale) Mirror 27: 0xff65389c (stale) Mirror 28: 0x64275042 (stale) CRC-32 checksum value for chunk [0, 0x3b5d1): Mirror 1: 0xba0542f8 Mirror 29: 0xba0542f8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b5d1: skipped 000752 1787573600.459358 read 0x035bc4 thru 0x03b5d0 (0x5a0d bytes) 000754 1787573600.497921 mapwrite 0x03473f thru 0x0395fb (0x4ebd bytes) 000755 1787573600.822761 read 0x025f96 thru 0x026dc3 (0xe2e bytes) 000756 1787573600.862195 write 0x0122c7 thru 0x01bb18 (0x9852 bytes) 000757 1787573600.865513 mapwrite 0x009fa9 thru 0x00c524 (0x257c bytes) 000760 1787573600.966566 write 0x0107e4 thru 0x0198ab (0x90c8 bytes) 000762 1787573600.974273 read 0x01d73e thru 0x02b9d1 (0xe294 bytes) 000765 1787573600.980099 mapread 0x033b37 thru 0x033d67 (0x231 bytes) 000766 1787573600.982985 write 0x00e29f thru 0x01ccb8 (0xea1a bytes) 000768 1787573600.985736 read 0x01c7ff thru 0x02215b (0x595d bytes) 000769 1787573600.988035 trunc from 0x03b5d1 to 0x01e428 (0x1d1a8 bytes) 000770 1787573601.013563 mapwrite 0x0385d7 thru 0x03fb5a (0x7584 bytes) 000771 1787573601.090844 read 0x03d5cd thru 0x03fb5a (0x258e bytes) 000773 1787573601.091998 read 0x0352b8 thru 0x03fb5a (0xa8a3 bytes) 000775 1787573601.093984 write 0x0169da thru 0x01dbd5 (0x71fc bytes) 000776 1787573601.096437 mapread 0x0086d4 thru 0x01194a (0x9277 bytes) 000777 1787573601.099116 mapwrite 0x00d71f thru 0x01297a (0x525c bytes) 000778 1787573601.144625 mapwrite 0x0081c5 thru 0x00a483 (0x22bf bytes) 000779 1787573601.191489 write 0x014ecd thru 0x01657a (0x16ae bytes) 000780 1787573601.192906 write 0x0006bc thru 0x00d0b7 (0xc9fc bytes) 000782 1787573601.196200 mapwrite 0x030a1d thru 0x03c2ff (0xb8e3 bytes) 000783 1787573601.264234 mapread 0x012a18 thru 0x01c26f (0x9858 bytes) 000784 1787573601.265187 mapwrite 0x016bfe thru 0x01e422 (0x7825 bytes) 000786 1787573601.322332 trunc from 0x03fb5b to 0x01c3ec (0x2376e bytes) 000790 1787573601.344078 write 0x0329c7 thru 0x03dc9b (0xb2d5 bytes) 000792 1787573601.346825 mapwrite 0x003043 thru 0x012a37 (0xf9f5 bytes) 000794 1787573601.397358 read 0x03d4ca thru 0x03dc9b (0x7d2 bytes) 000795 1787573601.398031 write 0x02f1cb thru 0x03ce92 (0xdcc8 bytes) 000796 1787573601.408954 mapread 0x018ca4 thru 0x0267cb (0xdb28 bytes) 000798 1787573601.412151 mapread 0x0278fa thru 0x03358f (0xbc96 bytes) 000800 1787573601.413718 mapread 0x0350ea thru 0x03dc9b (0x8bb2 bytes) 000805 1787573601.422300 MIRROR_SPLIT mirror 5 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dc9c): Mirror 18: 0x302a361f (stale) Mirror 21: 0x302a361f (stale) Mirror 22: 0x302a361f (stale) Mirror 23: 0x302a361f (stale) Mirror 25: 0x302a361f (stale) Mirror 26: 0x302a361f (stale) Mirror 27: 0x302a361f (stale) Mirror 28: 0xaabc9424 (stale) Mirror 29: 0xa0b987a0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dc9c): Mirror 18: 0x302a361f (stale) Mirror 21: 0x302a361f (stale) Mirror 22: 0x302a361f (stale) Mirror 23: 0x302a361f (stale) Mirror 25: 0x302a361f (stale) Mirror 26: 0x302a361f (stale) Mirror 27: 0x302a361f (stale) Mirror 28: 0xaabc9424 (stale) Mirror 29: 0xa0b987a0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dc9c: skipped 000806 1787573602.075338 read 0x01ed3b thru 0x02a535 (0xb7fb bytes) 000807 1787573602.083780 write 0x00b387 thru 0x01a3c2 (0xf03c bytes) 000810 1787573602.095912 read 0x00d1d0 thru 0x01b778 (0xe5a9 bytes) 000812 1787573602.110756 MIRROR_RESYNC 10 mirrors 000813 1787573604.924142 mapread 0x01d96a thru 0x026871 (0x8f08 bytes) 000814 1787573604.945914 write 0x03a591 thru 0x03fb05 (0x5575 bytes) 000817 1787573605.043322 read 0x010acc thru 0x0130de (0x2613 bytes) 000818 1787573605.051202 read 0x03701c thru 0x03e912 (0x78f7 bytes) 000822 1787573605.071310 read 0x0042cc thru 0x006b62 (0x2897 bytes) 000823 1787573605.072894 read 0x026e54 thru 0x02913a (0x22e7 bytes) 000824 1787573605.073663 trunc from 0x03fb06 to 0x0272d5 (0x18830 bytes) 000826 1787573605.140342 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x272d6): Mirror 18: 0xedeac2b3 (stale) Mirror 21: 0xedeac2b3 (stale) Mirror 22: 0xedeac2b3 (stale) Mirror 23: 0xedeac2b3 (stale) Mirror 25: 0xedeac2b3 (stale) Mirror 26: 0xedeac2b3 (stale) Mirror 27: 0xedeac2b3 (stale) Mirror 29: 0xedeac2b3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x272d6): Mirror 18: 0xedeac2b3 (stale) Mirror 21: 0xedeac2b3 (stale) Mirror 22: 0xedeac2b3 (stale) Mirror 23: 0xedeac2b3 (stale) Mirror 25: 0xedeac2b3 (stale) Mirror 26: 0xedeac2b3 (stale) Mirror 27: 0xedeac2b3 (stale) Mirror 29: 0xedeac2b3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x272d6: skipped 000828 1787573605.961601 mapwrite 0x02904c thru 0x03781a (0xe7cf bytes) 000829 1787573606.182533 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3781b): Mirror 18: 0xc287b0d9 (stale) Mirror 21: 0xc287b0d9 (stale) Mirror 22: 0xc287b0d9 (stale) Mirror 25: 0xc287b0d9 (stale) Mirror 26: 0xc287b0d9 (stale) Mirror 27: 0xc287b0d9 (stale) Mirror 29: 0xc287b0d9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3781b): Mirror 18: 0xc287b0d9 (stale) Mirror 21: 0xc287b0d9 (stale) Mirror 22: 0xc287b0d9 (stale) Mirror 25: 0xc287b0d9 (stale) Mirror 26: 0xc287b0d9 (stale) Mirror 27: 0xc287b0d9 (stale) Mirror 29: 0xc287b0d9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3781b: skipped 000832 1787573606.777451 MIRROR_RESYNC 8 mirrors 000833 1787573609.616013 mapread 0x01dd83 thru 0x02add0 (0xd04e bytes) 000834 1787573609.644147 write 0x03e681 thru 0x03ff43 (0x18c3 bytes) 000838 1787573609.709820 trunc from 0x03ff44 to 0x0072da (0x38c69 bytes) 000841 1787573609.742304 write 0x012b06 thru 0x01f0bc (0xc5b7 bytes) 000842 1787573609.744372 mapread 0x01b21f thru 0x01f0bc (0x3e9e bytes) 000844 1787573609.746122 mapwrite 0x037ce5 thru 0x03ffff (0x831b bytes) 000845 1787573609.881730 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0x16afc745 (stale) Mirror 21: 0x16afc745 (stale) Mirror 22: 0x16afc745 (stale) Mirror 25: 0x16afc745 (stale) Mirror 26: 0x16afc745 (stale) Mirror 27: 0x16afc745 (stale) Mirror 29: 0x16afc745 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4f6cf465 Mirror 30: 0x4f6cf465 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000846 1787573611.348531 mapread 0x00f814 thru 0x0153bc (0x5ba9 bytes) 000849 1787573611.427104 read 0x028248 thru 0x0308b9 (0x8672 bytes) 000850 1787573611.453975 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0x16afc745 (stale) Mirror 21: 0x16afc745 (stale) Mirror 22: 0x16afc745 (stale) Mirror 25: 0x16afc745 (stale) Mirror 26: 0x16afc745 (stale) Mirror 27: 0x16afc745 (stale) Mirror 29: 0x16afc745 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4f6cf465 Mirror 30: 0x4f6cf465 Mirror 31: 0x4f6cf465 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000851 1787573612.781298 read 0x03d981 thru 0x03ffff (0x267f bytes) 000852 1787573612.805137 read 0x031ee8 thru 0x03ad78 (0x8e91 bytes) 000853 1787573612.824800 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0x16afc745 (stale) Mirror 21: 0x16afc745 (stale) Mirror 22: 0x16afc745 (stale) Mirror 25: 0x16afc745 (stale) Mirror 26: 0x16afc745 (stale) Mirror 27: 0x16afc745 (stale) Mirror 29: 0x16afc745 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4f6cf465 Mirror 30: 0x4f6cf465 Mirror 31: 0x4f6cf465 Mirror 32: 0x4f6cf465 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000854 1787573614.150115 trunc from 0x040000 to 0x01e470 (0x21b8f bytes) 000859 1787573614.243475 write 0x014693 thru 0x01844e (0x3dbc bytes) 000860 1787573614.256954 mapread 0x00097e thru 0x00b39f (0xaa22 bytes) 000861 1787573614.282368 write 0x012ea1 thru 0x021a1d (0xeb7d bytes) 000862 1787573614.289111 trunc from 0x021a1e to 0x0179f8 (0xa025 bytes) 000864 1787573614.320217 trunc from 0x0179f9 to 0x02a5b2 (0x12bba bytes) 000866 1787573614.342802 read 0x014d3e thru 0x01fbac (0xae6f bytes) 000867 1787573614.351303 mapread 0x020818 thru 0x028014 (0x77fd bytes) 000868 1787573614.366254 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a5b3): Mirror 18: 0x6835eaeb (stale) Mirror 21: 0x6835eaeb (stale) Mirror 22: 0x6835eaeb (stale) Mirror 25: 0x6835eaeb (stale) Mirror 26: 0x6835eaeb (stale) Mirror 27: 0x6835eaeb (stale) Mirror 30: 0xc93c1baa (stale) Mirror 31: 0xc93c1baa (stale) Mirror 32: 0xc93c1baa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a5b3): Mirror 18: 0x6835eaeb (stale) Mirror 21: 0x6835eaeb (stale) Mirror 22: 0x6835eaeb (stale) Mirror 25: 0x6835eaeb (stale) Mirror 26: 0x6835eaeb (stale) Mirror 27: 0x6835eaeb (stale) Mirror 30: 0xc93c1baa (stale) Mirror 31: 0xc93c1baa (stale) Mirror 32: 0xc93c1baa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a5b3: skipped 000870 1787573614.903113 write 0x015774 thru 0x024f58 (0xf7e5 bytes) 000874 1787573614.915866 write 0x011078 thru 0x015d8b (0x4d14 bytes) 000875 1787573614.922362 write 0x015922 thru 0x01e432 (0x8b11 bytes) 000876 1787573614.923804 read 0x025c10 thru 0x02a5b2 (0x49a3 bytes) 000877 1787573614.942147 MIRROR_RESYNC 10 mirrors 000880 1787573618.182992 write 0x001083 thru 0x010bde (0xfb5c bytes) 000884 1787573618.281334 mapwrite 0x0217e7 thru 0x02876c (0x6f86 bytes) 000886 1787573618.384514 write 0x012ab6 thru 0x01e8e6 (0xbe31 bytes) 000888 1787573618.391902 read 0x0287d5 thru 0x02a5b2 (0x1dde bytes) 000889 1787573618.392727 trunc from 0x02a5b3 to 0x0147e9 (0x15dc9 bytes) 000890 1787573618.416006 trunc from 0x0147ea to 0x003d2e (0x10abb bytes) 000891 1787573618.434338 write 0x007f78 thru 0x01093b (0x89c4 bytes) 000893 1787573618.439721 mapread 0x003a57 thru 0x008504 (0x4aae bytes) 000895 1787573618.448711 trunc from 0x01093c to 0x03a02a (0x296ef bytes) 000897 1787573618.466102 trunc from 0x03a02b to 0x003246 (0x36de4 bytes) 000899 1787573618.482220 write 0x03fd79 thru 0x03ffff (0x287 bytes) 000900 1787573618.483654 trunc from 0x040000 to 0x00e7a0 (0x3185f bytes) 000902 1787573618.507324 trunc from 0x00e7a1 to 0x01fd45 (0x115a5 bytes) 000904 1787573618.534848 mapwrite 0x0091a7 thru 0x011a59 (0x88b3 bytes) 000905 1787573618.646892 mapread 0x01d8df thru 0x01fd45 (0x2467 bytes) 000908 1787573618.665589 read 0x00cbaf thru 0x01a078 (0xd4ca bytes) 000913 1787573618.690319 trunc from 0x01fd46 to 0x0224c9 (0x2784 bytes) 000914 1787573618.717725 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x224ca): Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x224ca): Mirror 18: 0x5632fb46 (stale) Mirror 21: 0x5632fb46 (stale) Mirror 22: 0x5632fb46 (stale) Mirror 25: 0x5632fb46 (stale) Mirror 26: 0x5632fb46 (stale) Mirror 27: 0x5632fb46 (stale) Mirror 30: 0x5632fb46 (stale) Mirror 31: 0x5632fb46 (stale) Mirror 32: 0x5632fb46 (stale) CRC-32 checksum value for chunk [0, 0x224ca): Mirror 1: 0xa9dca34e Mirror 33: 0xa9dca34e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x224ca: skipped 000915 1787573620.254941 MIRROR_RESYNC 11 mirrors 000918 1787573623.154120 MIRROR_EXTEND to 12 mirrors 000919 1787573624.456811 mapwrite 0x021d6e thru 0x028f35 (0x71c8 bytes) 000920 1787573624.694461 trunc from 0x028f36 to 0x0177db (0x1175a bytes) 000923 1787573624.733347 mapwrite 0x003ede thru 0x00c46e (0x8591 bytes) 000924 1787573624.816866 mapread 0x005e5b thru 0x0108e3 (0xaa89 bytes) 000925 1787573624.824930 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x177dc): Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x177dc): Mirror 18: 0x16d34841 (stale) Mirror 21: 0x16d34841 (stale) Mirror 22: 0x16d34841 (stale) Mirror 25: 0x16d34841 (stale) Mirror 26: 0x16d34841 (stale) Mirror 27: 0x16d34841 (stale) Mirror 30: 0x16d34841 (stale) Mirror 31: 0x16d34841 (stale) Mirror 32: 0x16d34841 (stale) Mirror 33: 0x16d34841 (stale) Mirror 34: 0x16d34841 (stale) CRC-32 checksum value for chunk [0, 0x177dc): Mirror 1: 0xb4dac3bc Mirror 35: 0xb4dac3bc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x177dc: skipped 000926 1787573626.496975 trunc from 0x0177dc to 0x01edcb (0x75f0 bytes) 000927 1787573626.582103 mapwrite 0x01a9ef thru 0x01d681 (0x2c93 bytes) 000928 1787573626.635002 trunc from 0x01edcc to 0x01e628 (0x7a3 bytes) 000929 1787573626.674933 mapread 0x015369 thru 0x01e012 (0x8caa bytes) 000930 1787573626.676921 write 0x010005 thru 0x014b23 (0x4b1f bytes) 000931 1787573626.701508 mapread 0x010076 thru 0x0130eb (0x3076 bytes) 000934 1787573626.703615 mapwrite 0x01047d thru 0x012278 (0x1dfc bytes) 000935 1787573626.769008 mapread 0x015694 thru 0x01be6a (0x67d7 bytes) 000937 1787573626.771918 write 0x029b2e thru 0x034594 (0xaa67 bytes) 000938 1787573626.775239 mapread 0x011273 thru 0x01a270 (0x8ffe bytes) 000939 1787573626.786872 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34595): Mirror 21: 0x8156efb6 (stale) Mirror 22: 0x8156efb6 (stale) Mirror 25: 0x8156efb6 (stale) Mirror 26: 0x8156efb6 (stale) Mirror 27: 0x8156efb6 (stale) Mirror 30: 0x8156efb6 (stale) Mirror 31: 0x8156efb6 (stale) Mirror 32: 0x8156efb6 (stale) Mirror 33: 0x8156efb6 (stale) Mirror 34: 0x8156efb6 (stale) Mirror 35: 0x10ad989a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34595): Mirror 21: 0x8156efb6 (stale) Mirror 22: 0x8156efb6 (stale) Mirror 25: 0x8156efb6 (stale) Mirror 26: 0x8156efb6 (stale) Mirror 27: 0x8156efb6 (stale) Mirror 30: 0x8156efb6 (stale) Mirror 31: 0x8156efb6 (stale) Mirror 32: 0x8156efb6 (stale) Mirror 33: 0x8156efb6 (stale) Mirror 34: 0x8156efb6 (stale) Mirror 35: 0x10ad989a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34595: skipped 000941 1787573627.476973 MIRROR_SPLIT mirror 9 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34595): Mirror 21: 0x8156efb6 (stale) Mirror 22: 0x8156efb6 (stale) Mirror 25: 0x8156efb6 (stale) Mirror 26: 0x8156efb6 (stale) Mirror 27: 0x8156efb6 (stale) Mirror 30: 0x8156efb6 (stale) Mirror 31: 0x8156efb6 (stale) Mirror 32: 0x8156efb6 (stale) Mirror 34: 0x8156efb6 (stale) Mirror 35: 0x10ad989a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34595): Mirror 21: 0x8156efb6 (stale) Mirror 22: 0x8156efb6 (stale) Mirror 25: 0x8156efb6 (stale) Mirror 26: 0x8156efb6 (stale) Mirror 27: 0x8156efb6 (stale) Mirror 30: 0x8156efb6 (stale) Mirror 31: 0x8156efb6 (stale) Mirror 32: 0x8156efb6 (stale) Mirror 34: 0x8156efb6 (stale) Mirror 35: 0x10ad989a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34595: skipped 000942 1787573628.125673 mapwrite 0x02a21c thru 0x0379cd (0xd7b2 bytes) 000943 1787573628.266152 mapread 0x03315c thru 0x0346d4 (0x1579 bytes) 000945 1787573628.267946 mapread 0x02b969 thru 0x02d2fb (0x1993 bytes) 000947 1787573628.271902 mapread 0x02b076 thru 0x0379cd (0xc958 bytes) 000950 1787573628.275934 write 0x023d45 thru 0x031713 (0xd9cf bytes) 000952 1787573628.284264 mapwrite 0x02a727 thru 0x0341cb (0x9aa5 bytes) 000953 1787573628.362748 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x379ce): Mirror 22: 0xe7581e0f (stale) Mirror 25: 0xe7581e0f (stale) Mirror 26: 0xe7581e0f (stale) Mirror 27: 0xe7581e0f (stale) Mirror 30: 0xe7581e0f (stale) Mirror 31: 0xe7581e0f (stale) Mirror 32: 0xe7581e0f (stale) Mirror 34: 0xe7581e0f (stale) Mirror 35: 0xd714ff53 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x379ce): Mirror 22: 0xe7581e0f (stale) Mirror 25: 0xe7581e0f (stale) Mirror 26: 0xe7581e0f (stale) Mirror 27: 0xe7581e0f (stale) Mirror 30: 0xe7581e0f (stale) Mirror 31: 0xe7581e0f (stale) Mirror 32: 0xe7581e0f (stale) Mirror 34: 0xe7581e0f (stale) Mirror 35: 0xd714ff53 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x379ce: skipped 000954 1787573628.989919 trunc from 0x0379ce to 0x017c54 (0x1fd79 bytes) 000955 1787573629.002981 trunc from 0x017c55 to 0x01f578 (0x7924 bytes) 000956 1787573629.017054 mapread 0x013ec4 thru 0x01f578 (0xb6b5 bytes) 000958 1787573629.070136 mapread 0x01d81f thru 0x01eac6 (0x12a8 bytes) 000960 1787573629.072673 write 0x01ef51 thru 0x02df04 (0xefb4 bytes) 000961 1787573629.076266 write 0x00b968 thru 0x0135c4 (0x7c5d bytes) 000962 1787573629.093750 mapread 0x007395 thru 0x013d46 (0xc9b2 bytes) 000965 1787573629.135323 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2df05): Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2df05): Mirror 22: 0xdeb36d7c (stale) Mirror 25: 0xdeb36d7c (stale) Mirror 26: 0xdeb36d7c (stale) Mirror 27: 0xdeb36d7c (stale) Mirror 30: 0xdeb36d7c (stale) Mirror 31: 0xdeb36d7c (stale) Mirror 32: 0xdeb36d7c (stale) Mirror 34: 0xdeb36d7c (stale) Mirror 35: 0x83a3ad3b (stale) CRC-32 checksum value for chunk [0, 0x2df05): Mirror 1: 0x3752253c Mirror 36: 0x3752253c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2df05: skipped 000966 1787573630.393129 write 0x02d836 thru 0x03282f (0x4ffa bytes) 000967 1787573630.520159 mapwrite 0x02f619 thru 0x03defa (0xe8e2 bytes) 000968 1787573630.696046 trunc from 0x03defb to 0x011cc3 (0x2c237 bytes) 000970 1787573630.711444 read 0x00935e thru 0x010c17 (0x78ba bytes) 000971 1787573630.722281 read 0x003be8 thru 0x00bb8b (0x7fa4 bytes) 000974 1787573630.745542 read 0x004275 thru 0x011cc3 (0xda4f bytes) 000976 1787573630.749360 mapread 0x00c976 thru 0x011cc3 (0x534e bytes) 000977 1787573630.750370 write 0x03dee8 thru 0x03ffff (0x2118 bytes) 000980 1787573630.752775 trunc from 0x040000 to 0x020cf0 (0x1f30f bytes) 000981 1787573630.782547 write 0x01ed09 thru 0x021abd (0x2db5 bytes) 000982 1787573630.798917 write 0x03161e thru 0x03f0ca (0xdaad bytes) 000983 1787573630.800730 mapread 0x01a2be thru 0x026d97 (0xcada bytes) 000984 1787573630.822069 read 0x020c4d thru 0x02e595 (0xd949 bytes) 000987 1787573630.823799 mapwrite 0x003ec6 thru 0x004911 (0xa4c bytes) 000989 1787573630.894927 write 0x01b4c7 thru 0x0219df (0x6519 bytes) 000992 1787573630.899666 write 0x015350 thru 0x01d552 (0x8203 bytes) 000993 1787573630.901861 write 0x003877 thru 0x01256e (0xecf8 bytes) 000994 1787573630.906188 mapwrite 0x03ebf1 thru 0x03ffff (0x140f bytes) 000996 1787573631.048629 mapwrite 0x001b86 thru 0x00cb1f (0xaf9a bytes) 000997 1787573631.119933 trunc from 0x040000 to 0x029cfd (0x16302 bytes) 000999 1787573631.190021 mapwrite 0x017255 thru 0x01c0c8 (0x4e74 bytes) 001000 1787573631.275891 trunc from 0x029cfe to 0x002e4a (0x26eb3 bytes) All operations completed A-OK!