== sanity-flr test 70a: flr mode fsx test ================ 05:59:48 (1783072788) Seed set to 2789 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1783072789.722779 write 0x0145c6 thru 0x01c58d (0x7fc8 bytes) 000002 1783072789.731980 mapwrite 0x00685b thru 0x015f53 (0xf6f9 bytes) 000005 1783072789.827156 read 0x0112d5 thru 0x01a694 (0x93c0 bytes) 000006 1783072789.831009 mapwrite 0x028ab4 thru 0x0290cb (0x618 bytes) 000007 1783072789.909665 mapwrite 0x02c425 thru 0x02f72c (0x3308 bytes) 000009 1783072790.013293 read 0x010e68 thru 0x01faed (0xec86 bytes) 000010 1783072790.042880 write 0x022dab thru 0x02e3ab (0xb601 bytes) 000011 1783072790.046474 mapwrite 0x0099ab thru 0x00eeb7 (0x550d bytes) 000013 1783072790.095445 read 0x006a93 thru 0x00d312 (0x6880 bytes) 000016 1783072790.098305 mapread 0x01afb2 thru 0x01cb87 (0x1bd6 bytes) 000018 1783072790.100914 read 0x023421 thru 0x02f72c (0xc30c bytes) truncating to largest ever: 0x3644e 000021 1783072790.104275 trunc from 0x02f72d to 0x03644d (0x6d21 bytes) 000022 1783072790.118144 trunc from 0x03644e to 0x0203e5 (0x16068 bytes) 000024 1783072790.134014 mapwrite 0x020607 thru 0x02f1af (0xeba9 bytes) 000026 1783072790.201956 mapread 0x015d0b thru 0x01eed3 (0x91c9 bytes) 000027 1783072790.203101 mapread 0x0228db thru 0x0233dd (0xb03 bytes) 000028 1783072790.203971 mapwrite 0x012c12 thru 0x01e439 (0xb828 bytes) 000031 1783072790.248198 MIRROR_EXTEND to 2 mirrors 000034 1783072790.727974 read 0x01547a thru 0x0206b0 (0xb237 bytes) 000035 1783072790.739590 write 0x037e76 thru 0x03ffff (0x818a bytes) 000036 1783072790.806881 read 0x026dd9 thru 0x027943 (0xb6b bytes) 000037 1783072790.814135 mapread 0x0048d7 thru 0x0099c3 (0x50ed bytes) 000039 1783072790.819552 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x97bc0baf (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x65f32e9c Mirror 3: 0x65f32e9c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000040 1783072791.490205 read 0x03f62f thru 0x03ffff (0x9d1 bytes) 000046 1783072791.499726 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x97bc0baf (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x65f32e9c Mirror 3: 0x65f32e9c Mirror 4: 0x65f32e9c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000047 1783072792.225888 mapwrite 0x03e696 thru 0x03ffff (0x196a bytes) 000049 1783072792.402867 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x65f32e9c (stale) Mirror 4: 0x65f32e9c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x65f32e9c (stale) Mirror 4: 0x65f32e9c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000051 1783072792.741112 mapwrite 0x00fb1a thru 0x01b0fb (0xb5e2 bytes) 000052 1783072792.829444 mapread 0x028b65 thru 0x035352 (0xc7ee bytes) 000054 1783072792.849819 mapwrite 0x019e9b thru 0x021e96 (0x7ffc bytes) 000058 1783072792.897095 trunc from 0x040000 to 0x00e185 (0x31e7a bytes) 000059 1783072792.927341 write 0x011601 thru 0x01966b (0x806b bytes) 000060 1783072792.931379 write 0x0093ab thru 0x012427 (0x907d bytes) 000062 1783072792.944232 write 0x00a8aa thru 0x01563f (0xad96 bytes) 000063 1783072792.951293 read 0x00d677 thru 0x011341 (0x3ccb bytes) 000066 1783072792.956659 write 0x03201e thru 0x03ccd8 (0xacbb bytes) 000067 1783072792.959534 mapread 0x00f2e4 thru 0x0156f8 (0x6415 bytes) 000069 1783072792.961935 trunc from 0x03ccd9 to 0x013ff2 (0x28ce6 bytes) 000070 1783072793.000856 mapread 0x0102ca thru 0x011eac (0x1be3 bytes) 000071 1783072793.003269 mapread 0x001d89 thru 0x001ebb (0x133 bytes) 000072 1783072793.022719 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x13ff3): Mirror 4: 0xb3621b45 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13ff3): Mirror 4: 0xb3621b45 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13ff3: skipped 000074 1783072793.288498 read 0x00409f thru 0x011b05 (0xda67 bytes) 000076 1783072793.298918 write 0x0194ae thru 0x02618c (0xccdf bytes) 000078 1783072793.302050 read 0x0070fe thru 0x015fae (0xeeb1 bytes) 000080 1783072793.311365 mapread 0x00f756 thru 0x014377 (0x4c22 bytes) 000082 1783072793.316631 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) 000083 1783072793.474736 mapread 0x013926 thru 0x014e25 (0x1500 bytes) 000084 1783072793.488581 write 0x03da3b thru 0x03ffff (0x25c5 bytes) 000085 1783072793.494712 mapread 0x029ce7 thru 0x02fe8e (0x61a8 bytes) 000086 1783072793.510884 mapread 0x03375e thru 0x03db54 (0xa3f7 bytes) 000087 1783072793.530145 mapread 0x00e0ce thru 0x019f08 (0xbe3b bytes) 000088 1783072793.563706 read 0x02a27e thru 0x02afc9 (0xd4c bytes) 000089 1783072793.564741 write 0x0161b3 thru 0x020104 (0x9f52 bytes) 000091 1783072793.572668 write 0x036a59 thru 0x03bd63 (0x530b bytes) 000092 1783072793.574553 mapread 0x0183f3 thru 0x018c3e (0x84c bytes) 000093 1783072793.576655 read 0x0263bc thru 0x02936d (0x2fb2 bytes) 000094 1783072793.577437 write 0x015fd9 thru 0x025e18 (0xfe40 bytes) 000095 1783072793.580369 trunc from 0x040000 to 0x017279 (0x28d86 bytes) 000099 1783072793.601725 write 0x01dd8b thru 0x02880e (0xaa84 bytes) 000100 1783072793.607821 mapwrite 0x017ce3 thru 0x01b700 (0x3a1e bytes) 000101 1783072793.692043 mapwrite 0x00f6ff thru 0x00f8bf (0x1c1 bytes) 000102 1783072793.763364 write 0x03c35d thru 0x03ffff (0x3ca3 bytes) 000104 1783072793.765674 mapwrite 0x021a78 thru 0x030202 (0xe78b bytes) 000105 1783072793.863680 trunc from 0x040000 to 0x010d6c (0x2f293 bytes) 000106 1783072793.882840 mapwrite 0x02c278 thru 0x035803 (0x958c bytes) 000108 1783072794.053827 write 0x02cfe7 thru 0x02ef52 (0x1f6c bytes) truncating to largest ever: 0x3d6ad 000109 1783072794.055227 trunc from 0x035804 to 0x03d6ac (0x7ea9 bytes) 000111 1783072794.077947 trunc from 0x03d6ad to 0x0249d4 (0x18cd8 bytes) 000112 1783072794.100596 MIRROR_EXTEND to 2 mirrors 000116 1783072794.812561 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) 000121 1783072795.008975 trunc from 0x0249d5 to 0x01869b (0xc339 bytes) 000122 1783072795.047918 mapread 0x001efd thru 0x011d1e (0xfe22 bytes) 000123 1783072795.089088 mapread 0x007a00 thru 0x0137bd (0xbdbe bytes) 000124 1783072795.091358 write 0x036b20 thru 0x03ffff (0x94e0 bytes) 000126 1783072795.095100 trunc from 0x040000 to 0x00863a (0x379c5 bytes) 000131 1783072795.128593 write 0x013880 thru 0x01af93 (0x7714 bytes) 000132 1783072795.129887 write 0x03b4f5 thru 0x03ffff (0x4b0b bytes) 000133 1783072795.131171 mapread 0x00675d thru 0x00ea1c (0x82c0 bytes) 000135 1783072795.138921 mapwrite 0x02dc30 thru 0x03b40c (0xd7dd bytes) 000137 1783072795.273518 mapread 0x032d6a thru 0x037d02 (0x4f99 bytes) 000139 1783072795.277911 write 0x025fe9 thru 0x02888b (0x28a3 bytes) 000140 1783072795.292619 read 0x00f280 thru 0x019f22 (0xaca3 bytes) 000142 1783072795.299254 mapwrite 0x01b54f thru 0x025ee2 (0xa994 bytes) 000145 1783072795.362101 read 0x011e0c thru 0x01572f (0x3924 bytes) 000146 1783072795.362839 trunc from 0x040000 to 0x028bef (0x17410 bytes) 000148 1783072795.380377 mapread 0x00a0d8 thru 0x011b24 (0x7a4d bytes) 000149 1783072795.381493 mapwrite 0x0272d5 thru 0x02b0ae (0x3dda bytes) 000153 1783072795.464780 write 0x000877 thru 0x008f15 (0x869f bytes) 000157 1783072795.474832 MIRROR_EXTEND to 2 mirrors 000159 1783072795.971449 MIRROR_EXTEND to 3 mirrors 000160 1783072796.560877 trunc from 0x02b0af to 0x007369 (0x23d45 bytes) 000161 1783072796.654814 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x736a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x736a): Mirror 2: 0xed5c16f2 (stale) Mirror 3: 0xed5c16f2 (stale) CRC-32 checksum value for chunk [0, 0x736a): Mirror 1: 0xed5c16f2 Mirror 4: 0xed5c16f2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x736a: skipped 000162 1783072797.372668 mapwrite 0x005e68 thru 0x012e79 (0xd012 bytes) 000164 1783072797.576665 mapread 0x000815 thru 0x00dcda (0xd4c6 bytes) 000165 1783072797.583925 trunc from 0x012e7a to 0x020ca5 (0xde2c bytes) 000167 1783072797.607999 mapwrite 0x03419e thru 0x037e80 (0x3ce3 bytes) 000168 1783072797.699910 read 0x024be9 thru 0x028281 (0x3699 bytes) 000169 1783072797.715926 trunc from 0x037e81 to 0x032956 (0x552a bytes) 000171 1783072797.734905 write 0x000e6f thru 0x00a453 (0x95e5 bytes) 000174 1783072797.738639 mapwrite 0x001d26 thru 0x009f3f (0x821a bytes) 000178 1783072797.783066 write 0x014576 thru 0x019542 (0x4fcd bytes) 000179 1783072797.791811 read 0x03288c thru 0x032956 (0xcb bytes) 000181 1783072797.793960 mapwrite 0x01bd11 thru 0x02ba67 (0xfd57 bytes) 000182 1783072797.855992 mapread 0x02ad87 thru 0x031407 (0x6681 bytes) 000183 1783072797.857692 read 0x020dad thru 0x023a43 (0x2c97 bytes) 000184 1783072797.858589 write 0x003afd thru 0x007a60 (0x3f64 bytes) 000185 1783072797.859884 trunc from 0x032957 to 0x01f546 (0x13410 bytes) 000188 1783072797.880844 read 0x012d65 thru 0x0173ca (0x4666 bytes) 000193 1783072797.901246 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f547): Mirror 3: 0x16a7f5cc (stale) Mirror 4: 0x23b2f848 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f547): Mirror 3: 0x16a7f5cc (stale) Mirror 4: 0x23b2f848 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f547: skipped 000197 1783072798.283977 write 0x00e1f1 thru 0x00e55e (0x36e bytes) 000198 1783072798.296534 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1f547): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f547): Mirror 3: 0x16a7f5cc (stale) Mirror 4: 0x23b2f848 (stale) CRC-32 checksum value for chunk [0, 0x1f547): Mirror 1: 0x96691c7 Mirror 5: 0x96691c7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f547: skipped 000200 1783072799.169950 mapwrite 0x03bc69 thru 0x03ffff (0x4397 bytes) 000201 1783072799.349552 mapwrite 0x01c900 thru 0x024820 (0x7f21 bytes) 000202 1783072799.417861 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd870e3bf (stale) Mirror 4: 0x5b1c263b (stale) Mirror 5: 0xad931d0d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc7beceda Mirror 6: 0xc7beceda lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000203 1783072800.283823 mapread 0x004dde thru 0x008fc4 (0x41e7 bytes) 000204 1783072800.306713 mapread 0x022346 thru 0x025c99 (0x3954 bytes) 000206 1783072800.323882 write 0x006985 thru 0x015ab6 (0xf132 bytes) 000207 1783072800.410068 mapread 0x00aad7 thru 0x017288 (0xc7b2 bytes) 000208 1783072800.424344 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd870e3bf (stale) Mirror 4: 0x5b1c263b (stale) Mirror 6: 0xc7beceda (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd870e3bf (stale) Mirror 4: 0x5b1c263b (stale) Mirror 6: 0xc7beceda (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000209 1783072800.842669 mapwrite 0x010d08 thru 0x01cc5f (0xbf58 bytes) 000210 1783072800.968185 mapwrite 0x02e0e0 thru 0x0323b9 (0x42da bytes) 000212 1783072801.068600 trunc from 0x040000 to 0x03af00 (0x50ff bytes) 000213 1783072801.125085 MIRROR_RESYNC 4 mirrors 000214 1783072802.090767 write 0x03e304 thru 0x03ffff (0x1cfc bytes) 000217 1783072802.153255 mapwrite 0x03975f thru 0x03ffff (0x68a1 bytes) 000220 1783072802.236094 mapwrite 0x03d808 thru 0x03ffff (0x27f8 bytes) 000222 1783072802.306944 MIRROR_RESYNC 4 mirrors 000224 1783072803.164242 trunc from 0x040000 to 0x01432e (0x2bcd1 bytes) 000225 1783072803.268330 read 0x004fc0 thru 0x006af5 (0x1b36 bytes) 000226 1783072803.274083 write 0x03f016 thru 0x03ffff (0xfea bytes) 000228 1783072803.276677 write 0x00b1ec thru 0x00c83a (0x164f bytes) 000229 1783072803.285699 read 0x02afc8 thru 0x03864d (0xd686 bytes) 000231 1783072803.302627 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x2988543a (stale) Mirror 4: 0x2988543a (stale) Mirror 6: 0x2988543a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc68ede3a Mirror 7: 0xc68ede3a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000232 1783072803.972476 mapwrite 0x00748f thru 0x015280 (0xddf2 bytes) 000233 1783072804.211632 write 0x01fdf0 thru 0x02e900 (0xeb11 bytes) 000235 1783072804.221580 mapread 0x00477a thru 0x0142f7 (0xfb7e bytes) 000237 1783072804.223902 read 0x03743d thru 0x03fdd4 (0x8998 bytes) 000239 1783072804.233836 write 0x00543b thru 0x00dfc0 (0x8b86 bytes) 000242 1783072804.236919 read 0x00fa5b thru 0x013a7d (0x4023 bytes) 000243 1783072804.238005 write 0x00999b thru 0x017985 (0xdfeb bytes) 000244 1783072804.240589 trunc from 0x040000 to 0x01c205 (0x23dfa bytes) 000245 1783072804.281305 mapwrite 0x01d457 thru 0x029401 (0xbfab bytes) 000251 1783072804.407483 write 0x00a30c thru 0x014174 (0x9e69 bytes) 000252 1783072804.409018 trunc from 0x029402 to 0x039f37 (0x10b36 bytes) 000253 1783072804.432107 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x39f38): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39f38): Mirror 3: 0xa353afc (stale) Mirror 4: 0xa353afc (stale) Mirror 6: 0xa353afc (stale) Mirror 7: 0x75630223 (stale) CRC-32 checksum value for chunk [0, 0x39f38): Mirror 1: 0x3ee3b483 Mirror 8: 0x3ee3b483 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39f38: skipped 000256 1783072805.300535 mapwrite 0x033eae thru 0x037461 (0x35b4 bytes) 000260 1783072805.525833 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x39f38): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39f38): Mirror 3: 0xa353afc (stale) Mirror 4: 0xa353afc (stale) Mirror 6: 0xa353afc (stale) Mirror 7: 0x75630223 (stale) Mirror 8: 0x3ee3b483 (stale) CRC-32 checksum value for chunk [0, 0x39f38): Mirror 1: 0xfade455c Mirror 9: 0xfade455c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39f38: skipped 000261 1783072806.377853 mapread 0x02d199 thru 0x03145e (0x42c6 bytes) 000262 1783072806.415954 MIRROR_RESYNC 7 mirrors 000263 1783072807.543787 mapwrite 0x039df3 thru 0x03ffff (0x620d bytes) 000269 1783072807.729968 trunc from 0x040000 to 0x011cad (0x2e352 bytes) 000270 1783072807.759437 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x11cae): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11cae): Mirror 3: 0xb4a41202 (stale) Mirror 4: 0xb4a41202 (stale) Mirror 6: 0xb4a41202 (stale) Mirror 7: 0xb4a41202 (stale) Mirror 8: 0xb4a41202 (stale) Mirror 9: 0xb4a41202 (stale) CRC-32 checksum value for chunk [0, 0x11cae): Mirror 1: 0xb4a41202 Mirror 10: 0xb4a41202 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11cae: skipped 000271 1783072808.555589 trunc from 0x011cae to 0x036989 (0x24cdc bytes) 000272 1783072808.684021 MIRROR_RESYNC 8 mirrors 000273 1783072810.050215 write 0x036b8a thru 0x03cc6f (0x60e6 bytes) 000275 1783072810.126232 write 0x03889d thru 0x03ffff (0x7763 bytes) 000276 1783072810.129000 trunc from 0x040000 to 0x028dfd (0x17202 bytes) 000277 1783072810.163190 write 0x01640b thru 0x01d4b7 (0x70ad bytes) 000279 1783072810.175643 read 0x015162 thru 0x015404 (0x2a3 bytes) 000280 1783072810.186313 MIRROR_RESYNC 8 mirrors 000283 1783072811.365165 read 0x01bdf9 thru 0x01fcd6 (0x3ede bytes) 000284 1783072811.375972 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) 000287 1783072811.705972 read 0x016e51 thru 0x01b63e (0x47ee bytes) 000288 1783072811.720249 mapwrite 0x00cf55 thru 0x010cea (0x3d96 bytes) 000291 1783072811.926102 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x28dfe): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28dfe): Mirror 3: 0x3b700e1a (stale) Mirror 4: 0x3b700e1a (stale) Mirror 6: 0x3b700e1a (stale) Mirror 7: 0x3b700e1a (stale) Mirror 9: 0x3b700e1a (stale) Mirror 10: 0x3b700e1a (stale) CRC-32 checksum value for chunk [0, 0x28dfe): Mirror 1: 0x9935631 Mirror 11: 0x9935631 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28dfe: skipped 000293 1783072812.815869 trunc from 0x028dfe to 0x01a759 (0xe6a4 bytes) 000294 1783072812.905684 write 0x0179e7 thru 0x01e8be (0x6ed8 bytes) 000295 1783072812.919005 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x1e8bf): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e8bf): Mirror 3: 0xf0c725a3 (stale) Mirror 4: 0xf0c725a3 (stale) Mirror 6: 0xf0c725a3 (stale) Mirror 7: 0xf0c725a3 (stale) Mirror 9: 0xf0c725a3 (stale) Mirror 10: 0xf0c725a3 (stale) Mirror 11: 0x4205cc8b (stale) CRC-32 checksum value for chunk [0, 0x1e8bf): Mirror 1: 0x2190d6ba Mirror 12: 0x2190d6ba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e8bf: skipped 000296 1783072813.746328 write 0x001a3e thru 0x008820 (0x6de3 bytes) 000298 1783072813.824942 mapread 0x001759 thru 0x00e162 (0xca0a bytes) 000299 1783072813.861320 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x1e8bf): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e8bf): Mirror 3: 0xf0c725a3 (stale) Mirror 4: 0xf0c725a3 (stale) Mirror 6: 0xf0c725a3 (stale) Mirror 7: 0xf0c725a3 (stale) Mirror 9: 0xf0c725a3 (stale) Mirror 10: 0xf0c725a3 (stale) Mirror 11: 0x4205cc8b (stale) Mirror 12: 0x2190d6ba (stale) CRC-32 checksum value for chunk [0, 0x1e8bf): Mirror 1: 0x259aff3d Mirror 13: 0x259aff3d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e8bf: skipped 000301 1783072814.869676 write 0x00c1cd thru 0x013d8e (0x7bc2 bytes) 000303 1783072814.961292 write 0x01adeb thru 0x02490f (0x9b25 bytes) 000305 1783072814.966122 trunc from 0x024910 to 0x01b3a9 (0x9566 bytes) 000306 1783072814.978886 trunc from 0x01b3aa to 0x02d1e5 (0x11e3c bytes) 000307 1783072815.011304 MIRROR_RESYNC 10 mirrors 000308 1783072816.314832 MIRROR_EXTEND to 11 mirrors 000309 1783072816.992265 write 0x03efe9 thru 0x03ffff (0x1017 bytes) 000310 1783072817.061336 read 0x03b7a5 thru 0x03c399 (0xbf5 bytes) 000312 1783072817.068365 read 0x024552 thru 0x02bdd2 (0x7881 bytes) 000314 1783072817.078577 write 0x006e89 thru 0x00fc3c (0x8db4 bytes) 000315 1783072817.079989 read 0x029671 thru 0x0319f6 (0x8386 bytes) 000316 1783072817.081084 mapwrite 0x00b7f8 thru 0x014b62 (0x936b bytes) 000317 1783072817.122093 trunc from 0x040000 to 0x007e33 (0x381cc bytes) 000318 1783072817.146918 MIRROR_RESYNC 11 mirrors 000319 1783072818.586850 mapread 0x006ec6 thru 0x007e33 (0xf6e bytes) 000321 1783072818.602279 read 0x00643b thru 0x007e33 (0x19f9 bytes) 000323 1783072818.602920 mapwrite 0x027cfe thru 0x034085 (0xc388 bytes) 000325 1783072818.775254 read 0x002276 thru 0x00e192 (0xbf1d bytes) 000329 1783072818.788299 read 0x02b09f thru 0x02ed95 (0x3cf7 bytes) 000330 1783072818.789778 trunc from 0x034086 to 0x019296 (0x1adef bytes) 000332 1783072818.824341 write 0x021a03 thru 0x02c009 (0xa607 bytes) 000334 1783072818.829124 trunc from 0x02c00a to 0x01cf39 (0xf0d0 bytes) 000335 1783072818.841988 read 0x018ac2 thru 0x01ad4a (0x2289 bytes) 000336 1783072818.848965 read 0x000315 thru 0x00a898 (0xa584 bytes) 000338 1783072818.855220 MIRROR_SPLIT mirror 2 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1cf3a): Mirror 3: 0xe1121ed4 (stale) Mirror 6: 0xe1121ed4 (stale) Mirror 7: 0xe1121ed4 (stale) Mirror 9: 0xe1121ed4 (stale) Mirror 10: 0xe1121ed4 (stale) Mirror 11: 0xe1121ed4 (stale) Mirror 12: 0xe1121ed4 (stale) Mirror 13: 0xe1121ed4 (stale) Mirror 14: 0xe1121ed4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1cf3a): Mirror 3: 0xe1121ed4 (stale) Mirror 6: 0xe1121ed4 (stale) Mirror 7: 0xe1121ed4 (stale) Mirror 9: 0xe1121ed4 (stale) Mirror 10: 0xe1121ed4 (stale) Mirror 11: 0xe1121ed4 (stale) Mirror 12: 0xe1121ed4 (stale) Mirror 13: 0xe1121ed4 (stale) Mirror 14: 0xe1121ed4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1cf3a: skipped 000340 1783072819.316860 trunc from 0x01cf3a to 0x02419e (0x7265 bytes) 000341 1783072819.345942 mapwrite 0x0079ca thru 0x00c961 (0x4f98 bytes) 000342 1783072819.483144 mapwrite 0x035ffd thru 0x03c376 (0x637a bytes) 000344 1783072819.645811 mapwrite 0x033a1d thru 0x03f242 (0xb826 bytes) 000345 1783072819.760440 mapwrite 0x026292 thru 0x027dcf (0x1b3e bytes) 000346 1783072819.852780 mapread 0x034a0f thru 0x034fbe (0x5b0 bytes) 000347 1783072819.855642 mapread 0x03b87a thru 0x03ccf5 (0x147c bytes) 000348 1783072819.858840 mapread 0x023497 thru 0x027718 (0x4282 bytes) 000351 1783072819.871949 mapread 0x000a22 thru 0x008d63 (0x8342 bytes) 000352 1783072819.886357 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f243): Mirror 3: 0x30e6cd55 (stale) Mirror 6: 0x30e6cd55 (stale) Mirror 7: 0x30e6cd55 (stale) Mirror 9: 0x30e6cd55 (stale) Mirror 10: 0x30e6cd55 (stale) Mirror 11: 0x30e6cd55 (stale) Mirror 12: 0x30e6cd55 (stale) Mirror 13: 0x30e6cd55 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f243): Mirror 3: 0x30e6cd55 (stale) Mirror 6: 0x30e6cd55 (stale) Mirror 7: 0x30e6cd55 (stale) Mirror 9: 0x30e6cd55 (stale) Mirror 10: 0x30e6cd55 (stale) Mirror 11: 0x30e6cd55 (stale) Mirror 12: 0x30e6cd55 (stale) Mirror 13: 0x30e6cd55 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f243: skipped 000353 1783072820.471804 trunc from 0x03f243 to 0x038459 (0x6de9 bytes) 000356 1783072820.491647 trunc from 0x03845a to 0x02700f (0x1144a bytes) 000360 1783072820.511245 read 0x016833 thru 0x0224b8 (0xbc86 bytes) 000362 1783072820.526964 write 0x01813a thru 0x01bd42 (0x3c09 bytes) 000365 1783072820.530313 mapwrite 0x002171 thru 0x00558f (0x341f bytes) 000367 1783072820.626334 trunc from 0x027010 to 0x0351f5 (0xe1e6 bytes) 000371 1783072820.644924 read 0x02b5cc thru 0x0351f5 (0x9c2a bytes) 000373 1783072820.654292 mapwrite 0x02525e thru 0x034de4 (0xfb87 bytes) 000374 1783072820.715559 read 0x014276 thru 0x015b43 (0x18ce bytes) 000375 1783072820.724548 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x351f6): Mirror 3: 0x5372ad64 (stale) Mirror 6: 0x5372ad64 (stale) Mirror 7: 0x5372ad64 (stale) Mirror 9: 0x5372ad64 (stale) Mirror 10: 0x5372ad64 (stale) Mirror 11: 0x5372ad64 (stale) Mirror 13: 0x5372ad64 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x351f6): Mirror 3: 0x5372ad64 (stale) Mirror 6: 0x5372ad64 (stale) Mirror 7: 0x5372ad64 (stale) Mirror 9: 0x5372ad64 (stale) Mirror 10: 0x5372ad64 (stale) Mirror 11: 0x5372ad64 (stale) Mirror 13: 0x5372ad64 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x351f6: skipped 000377 1783072821.349166 mapread 0x0283f1 thru 0x029ffc (0x1c0c bytes) 000378 1783072821.369569 mapread 0x01ff8f thru 0x027961 (0x79d3 bytes) 000380 1783072821.382915 read 0x006376 thru 0x00faf5 (0x9780 bytes) 000381 1783072821.392735 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x351f6): Mirror 3: 0x5372ad64 (stale) Mirror 6: 0x5372ad64 (stale) Mirror 9: 0x5372ad64 (stale) Mirror 10: 0x5372ad64 (stale) Mirror 11: 0x5372ad64 (stale) Mirror 13: 0x5372ad64 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x351f6): Mirror 3: 0x5372ad64 (stale) Mirror 6: 0x5372ad64 (stale) Mirror 9: 0x5372ad64 (stale) Mirror 10: 0x5372ad64 (stale) Mirror 11: 0x5372ad64 (stale) Mirror 13: 0x5372ad64 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x351f6: skipped 000382 1783072821.801305 mapread 0x0176f4 thru 0x023677 (0xbf84 bytes) 000383 1783072821.825161 mapread 0x020474 thru 0x02ed24 (0xe8b1 bytes) 000388 1783072821.839949 write 0x00d399 thru 0x01c819 (0xf481 bytes) 000389 1783072821.845442 write 0x03050c thru 0x0350a9 (0x4b9e bytes) 000391 1783072821.854823 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x351f6): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x351f6): Mirror 3: 0x5372ad64 (stale) Mirror 6: 0x5372ad64 (stale) Mirror 9: 0x5372ad64 (stale) Mirror 10: 0x5372ad64 (stale) Mirror 11: 0x5372ad64 (stale) Mirror 13: 0x5372ad64 (stale) CRC-32 checksum value for chunk [0, 0x351f6): Mirror 1: 0xa7425568 Mirror 14: 0xa7425568 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x351f6: skipped 000392 1783072822.714003 trunc from 0x0351f6 to 0x010361 (0x24e94 bytes) 000393 1783072822.803858 mapread 0x007b80 thru 0x00bfad (0x442e bytes) 000395 1783072822.836108 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x10362): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10362): Mirror 3: 0x2007b61a (stale) Mirror 6: 0x2007b61a (stale) Mirror 9: 0x2007b61a (stale) Mirror 10: 0x2007b61a (stale) Mirror 11: 0x2007b61a (stale) Mirror 13: 0x2007b61a (stale) Mirror 14: 0x31c736b0 (stale) CRC-32 checksum value for chunk [0, 0x10362): Mirror 1: 0x31c736b0 Mirror 15: 0x31c736b0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10362: skipped 000396 1783072823.736978 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x10362): Mirror 6: 0x2007b61a (stale) Mirror 9: 0x2007b61a (stale) Mirror 10: 0x2007b61a (stale) Mirror 11: 0x2007b61a (stale) Mirror 13: 0x2007b61a (stale) Mirror 14: 0x31c736b0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10362): Mirror 6: 0x2007b61a (stale) Mirror 9: 0x2007b61a (stale) Mirror 10: 0x2007b61a (stale) Mirror 11: 0x2007b61a (stale) Mirror 13: 0x2007b61a (stale) Mirror 14: 0x31c736b0 (stale) CRC-32 checksum value for chunk [0, 0x10362): Mirror 1: 0x31c736b0 Mirror 15: 0x31c736b0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10362: skipped 000397 1783072824.210268 read 0x00261d thru 0x004fe9 (0x29cd bytes) 000398 1783072824.224279 mapwrite 0x03806b thru 0x03dffd (0x5f93 bytes) 000399 1783072824.377140 read 0x026e44 thru 0x033fa4 (0xd161 bytes) 000402 1783072824.401739 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dffe): Mirror 9: 0x529d3728 (stale) Mirror 10: 0x529d3728 (stale) Mirror 11: 0x529d3728 (stale) Mirror 13: 0x529d3728 (stale) Mirror 14: 0x91706d6b (stale) Mirror 15: 0x8c714ee2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dffe): Mirror 9: 0x529d3728 (stale) Mirror 10: 0x529d3728 (stale) Mirror 11: 0x529d3728 (stale) Mirror 13: 0x529d3728 (stale) Mirror 14: 0x91706d6b (stale) Mirror 15: 0x8c714ee2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dffe: skipped 000403 1783072824.819052 mapread 0x0179e5 thru 0x01ea23 (0x703f bytes) 000405 1783072824.841492 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dffe): Mirror 10: 0x529d3728 (stale) Mirror 11: 0x529d3728 (stale) Mirror 13: 0x529d3728 (stale) Mirror 14: 0x91706d6b (stale) Mirror 15: 0x8c714ee2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dffe): Mirror 10: 0x529d3728 (stale) Mirror 11: 0x529d3728 (stale) Mirror 13: 0x529d3728 (stale) Mirror 14: 0x91706d6b (stale) Mirror 15: 0x8c714ee2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dffe: skipped 000407 1783072825.274239 write 0x00ba89 thru 0x0152d3 (0x984b bytes) 000408 1783072825.287197 read 0x00105b thru 0x008f80 (0x7f26 bytes) 000409 1783072825.301179 trunc from 0x03dffe to 0x014dc6 (0x29237 bytes) 000410 1783072825.325968 write 0x001497 thru 0x00d551 (0xc0bb bytes) 000411 1783072825.328486 mapwrite 0x02a317 thru 0x02d143 (0x2e2d bytes) 000412 1783072825.440303 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2d144): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d144): Mirror 10: 0x55d9f5c5 (stale) Mirror 11: 0x55d9f5c5 (stale) Mirror 13: 0x55d9f5c5 (stale) Mirror 14: 0x7bbc59a6 (stale) Mirror 15: 0xca1b0af (stale) CRC-32 checksum value for chunk [0, 0x2d144): Mirror 1: 0xc24d5e8f Mirror 16: 0xc24d5e8f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d144: skipped 000413 1783072826.136509 read 0x0173f8 thru 0x01c9cf (0x55d8 bytes) 000416 1783072826.180924 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d144): Mirror 11: 0x55d9f5c5 (stale) Mirror 13: 0x55d9f5c5 (stale) Mirror 14: 0x7bbc59a6 (stale) Mirror 15: 0xca1b0af (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d144): Mirror 11: 0x55d9f5c5 (stale) Mirror 13: 0x55d9f5c5 (stale) Mirror 14: 0x7bbc59a6 (stale) Mirror 15: 0xca1b0af (stale) CRC-32 checksum value for chunk [0, 0x2d144): Mirror 1: 0xc24d5e8f Mirror 16: 0xc24d5e8f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d144: skipped 000417 1783072826.766653 trunc from 0x02d144 to 0x025f62 (0x71e1 bytes) 000419 1783072826.856887 trunc from 0x025f63 to 0x0098ad (0x1c6b5 bytes) 000420 1783072826.888704 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x98ae): Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x98ae): Mirror 11: 0x5e5653b8 (stale) Mirror 13: 0x5e5653b8 (stale) Mirror 14: 0x11ec2228 (stale) Mirror 15: 0x11ec2228 (stale) Mirror 16: 0x42cc90e5 (stale) CRC-32 checksum value for chunk [0, 0x98ae): Mirror 1: 0x42cc90e5 Mirror 17: 0x42cc90e5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x98ae: skipped 000421 1783072827.703840 read 0x0059e5 thru 0x0098ad (0x3ec9 bytes) 000422 1783072827.716238 read 0x004cab thru 0x0098ad (0x4c03 bytes) 000424 1783072827.734863 read 0x007e65 thru 0x0098ad (0x1a49 bytes) 000425 1783072827.744902 read 0x004f34 thru 0x009504 (0x45d1 bytes) 000426 1783072827.753179 mapread 0x007678 thru 0x0098ad (0x2236 bytes) 000430 1783072827.808771 trunc from 0x0098ae to 0x02be02 (0x22555 bytes) 000431 1783072827.938259 write 0x01a5a4 thru 0x01f713 (0x5170 bytes) 000433 1783072827.953827 write 0x034093 thru 0x035ccb (0x1c39 bytes) 000434 1783072827.956237 read 0x02de45 thru 0x035ccb (0x7e87 bytes) 000439 1783072827.977126 write 0x0288d3 thru 0x03494a (0xc078 bytes) 000440 1783072827.979154 mapread 0x001cc1 thru 0x00395e (0x1c9e bytes) 000441 1783072827.982989 trunc from 0x035ccc to 0x02bd83 (0x9f48 bytes) 000442 1783072828.017102 write 0x03d9c6 thru 0x03ffff (0x263a bytes) 000444 1783072828.018942 mapread 0x01a8da thru 0x026369 (0xba90 bytes) 000445 1783072828.022893 trunc from 0x040000 to 0x000108 (0x3fef7 bytes) 000446 1783072828.039743 mapwrite 0x026d93 thru 0x02abb8 (0x3e26 bytes) 000447 1783072828.136915 trunc from 0x02abb9 to 0x016eb4 (0x13d04 bytes) 000449 1783072828.154128 trunc from 0x016eb5 to 0x033559 (0x1c6a5 bytes) 000453 1783072828.170814 mapwrite 0x03a4a3 thru 0x03afa5 (0xb03 bytes) 000455 1783072828.228314 read 0x020634 thru 0x022413 (0x1de0 bytes) 000456 1783072828.237252 read 0x00eeb0 thru 0x01d03c (0xe18d bytes) 000457 1783072828.238033 write 0x01e444 thru 0x026d5f (0x891c bytes) 000458 1783072828.239284 mapwrite 0x032904 thru 0x03c346 (0x9a43 bytes) 000459 1783072828.309235 mapwrite 0x022c85 thru 0x02bd75 (0x90f1 bytes) 000461 1783072828.359624 trunc from 0x03c347 to 0x027ebe (0x14488 bytes) 000462 1783072828.380678 mapwrite 0x02ba0b thru 0x031ee2 (0x64d8 bytes) 000463 1783072828.484836 mapread 0x01d121 thru 0x0280ab (0xaf8b bytes) 000464 1783072828.489323 mapread 0x0060ad thru 0x0090d1 (0x3025 bytes) 000467 1783072828.491462 mapread 0x0219f7 thru 0x021fde (0x5e8 bytes) 000469 1783072828.499888 write 0x0045ff thru 0x006c59 (0x265b bytes) 000471 1783072828.504379 write 0x000b3e thru 0x003b39 (0x2ffc bytes) 000472 1783072828.514609 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31ee3): Mirror 11: 0x23b9656d (stale) Mirror 14: 0x51665048 (stale) Mirror 15: 0xeef58fb3 (stale) Mirror 16: 0x8590c510 (stale) Mirror 17: 0x8a8ea560 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31ee3): Mirror 11: 0x23b9656d (stale) Mirror 14: 0x51665048 (stale) Mirror 15: 0xeef58fb3 (stale) Mirror 16: 0x8590c510 (stale) Mirror 17: 0x8a8ea560 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31ee3: skipped 000473 1783072828.975128 trunc from 0x031ee3 to 0x027ca4 (0xa23e bytes) 000475 1783072828.998113 mapwrite 0x0310f3 thru 0x03b0cf (0x9fdd bytes) 000476 1783072829.092870 read 0x01a4f3 thru 0x01b344 (0xe52 bytes) 000481 1783072829.104943 mapwrite 0x026039 thru 0x032668 (0xc630 bytes) 000482 1783072829.150323 read 0x028489 thru 0x02ebf3 (0x676b bytes) 000484 1783072829.152231 write 0x007aff thru 0x0157be (0xdcc0 bytes) 000485 1783072829.165274 mapread 0x00db54 thru 0x0180c0 (0xa56d bytes) 000486 1783072829.167292 write 0x018ea1 thru 0x01bfd8 (0x3138 bytes) 000487 1783072829.169484 write 0x02cb82 thru 0x0369d2 (0x9e51 bytes) 000488 1783072829.171062 write 0x015e1a thru 0x01a62c (0x4813 bytes) 000489 1783072829.175231 write 0x02317b thru 0x0258aa (0x2730 bytes) 000490 1783072829.178117 mapread 0x00d0e5 thru 0x01d079 (0xff95 bytes) 000491 1783072829.181253 read 0x03a3b8 thru 0x03b0cf (0xd18 bytes) 000492 1783072829.182171 mapread 0x011aa5 thru 0x01ef52 (0xd4ae bytes) 000493 1783072829.183883 read 0x011e11 thru 0x017f28 (0x6118 bytes) 000494 1783072829.188461 MIRROR_RESYNC 6 mirrors 000495 1783072830.090225 read 0x0067f7 thru 0x010bd7 (0xa3e1 bytes) 000496 1783072830.100001 read 0x0011f3 thru 0x00edc9 (0xdbd7 bytes) 000497 1783072830.114698 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) 000498 1783072830.494592 mapwrite 0x003f5a thru 0x01119d (0xd244 bytes) 000499 1783072830.706125 mapwrite 0x015abd thru 0x01e028 (0x856c bytes) 000500 1783072830.771500 write 0x016b6e thru 0x018fcf (0x2462 bytes) 000501 1783072830.777464 MIRROR_RESYNC 5 mirrors 000502 1783072831.590687 write 0x0023e4 thru 0x004379 (0x1f96 bytes) 000503 1783072831.660842 trunc from 0x03b0d0 to 0x038a19 (0x26b6 bytes) 000505 1783072831.694529 mapwrite 0x0196e7 thru 0x025e70 (0xc78a bytes) 000507 1783072831.789458 trunc from 0x038a1a to 0x00c526 (0x2c4f3 bytes) 000509 1783072831.821715 read 0x006e14 thru 0x00c526 (0x5713 bytes) 000512 1783072831.843571 trunc from 0x00c527 to 0x032350 (0x25e2a bytes) 000516 1783072831.901924 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32351): Mirror 14: 0x992ee3b6 (stale) Mirror 15: 0x992ee3b6 (stale) Mirror 16: 0x992ee3b6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32351): Mirror 14: 0x992ee3b6 (stale) Mirror 15: 0x992ee3b6 (stale) Mirror 16: 0x992ee3b6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32351: skipped 000519 1783072832.263256 mapwrite 0x0162fc thru 0x022a04 (0xc709 bytes) 000520 1783072832.349661 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32351): Mirror 15: 0x992ee3b6 (stale) Mirror 16: 0x992ee3b6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32351): Mirror 15: 0x992ee3b6 (stale) Mirror 16: 0x992ee3b6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32351: skipped 000521 1783072832.659544 read 0x01436e thru 0x0212cd (0xcf60 bytes) 000522 1783072832.692539 trunc from 0x032351 to 0x0026d9 (0x2fc77 bytes) 000524 1783072832.732063 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x26da): Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26da): Mirror 15: 0x9239943f (stale) Mirror 16: 0x9239943f (stale) CRC-32 checksum value for chunk [0, 0x26da): Mirror 1: 0xc3e102c4 Mirror 17: 0xc3e102c4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26da: skipped 000525 1783072833.459280 mapwrite 0x0138e9 thru 0x016503 (0x2c1b bytes) 000526 1783072833.632973 write 0x036e51 thru 0x03ffff (0x91af bytes) 000527 1783072833.635236 trunc from 0x040000 to 0x015443 (0x2abbc bytes) 000530 1783072833.668237 write 0x039c40 thru 0x03ffff (0x63c0 bytes) 000532 1783072833.674202 mapwrite 0x02ac9f thru 0x0340c8 (0x942a bytes) 000533 1783072833.790880 mapwrite 0x039a0a thru 0x03d5c0 (0x3bb7 bytes) 000535 1783072833.871105 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x920ec743 (stale) Mirror 16: 0x920ec743 (stale) Mirror 17: 0xcbe29a7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe69ba411 Mirror 18: 0xe69ba411 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000536 1783072834.643239 mapwrite 0x037db5 thru 0x03e348 (0x6594 bytes) 000537 1783072834.850721 write 0x038f23 thru 0x03f5ce (0x66ac bytes) 000540 1783072834.857011 read 0x02b745 thru 0x0332b0 (0x7b6c bytes) 000541 1783072834.869538 MIRROR_RESYNC 5 mirrors 000542 1783072835.816203 trunc from 0x040000 to 0x03be6e (0x4191 bytes) 000544 1783072835.881121 write 0x03092f thru 0x03e3f0 (0xdac2 bytes) 000545 1783072835.886619 trunc from 0x03e3f1 to 0x03a0f8 (0x42f8 bytes) 000551 1783072835.917039 write 0x01d0b8 thru 0x029739 (0xc682 bytes) 000552 1783072835.940030 read 0x011a97 thru 0x017882 (0x5dec bytes) 000553 1783072835.953975 trunc from 0x03a0f9 to 0x03cd93 (0x2c9b bytes) 000554 1783072835.968686 read 0x0247b6 thru 0x02eb3f (0xa38a bytes) 000557 1783072835.994223 MIRROR_RESYNC 5 mirrors 000559 1783072836.909255 write 0x036aa1 thru 0x03ffff (0x955f bytes) 000560 1783072836.991412 mapread 0x022fed thru 0x027c0a (0x4c1e bytes) 000565 1783072837.012099 read 0x0192c9 thru 0x01fa5c (0x6794 bytes) 000566 1783072837.020051 mapread 0x032657 thru 0x03a4a5 (0x7e4f bytes) 000567 1783072837.031254 write 0x028a80 thru 0x02b13a (0x26bb bytes) 000569 1783072837.038295 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xcb8dbaec (stale) Mirror 17: 0xcb8dbaec (stale) Mirror 18: 0xcb8dbaec (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xcb8dbaec (stale) Mirror 17: 0xcb8dbaec (stale) Mirror 18: 0xcb8dbaec (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000570 1783072837.406371 trunc from 0x040000 to 0x02a517 (0x15ae8 bytes) 000572 1783072837.431960 write 0x03bddd thru 0x03ffff (0x4223 bytes) 000575 1783072837.437299 trunc from 0x040000 to 0x012cd9 (0x2d326 bytes) 000579 1783072837.479880 mapread 0x012b93 thru 0x012cd9 (0x147 bytes) 000582 1783072837.488342 read 0x00081a thru 0x0019e6 (0x11cd bytes) 000585 1783072837.498217 write 0x03528e thru 0x03bd31 (0x6aa4 bytes) 000587 1783072837.506683 mapwrite 0x00ba6b thru 0x00e56b (0x2b01 bytes) 000588 1783072837.586650 mapwrite 0x03bfdb thru 0x03ce5a (0xe80 bytes) 000589 1783072837.707778 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3ce5b): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ce5b): Mirror 15: 0xb7ab2f81 (stale) Mirror 17: 0xb7ab2f81 (stale) Mirror 18: 0xb7ab2f81 (stale) CRC-32 checksum value for chunk [0, 0x3ce5b): Mirror 1: 0xf07aa19a Mirror 19: 0xf07aa19a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ce5b: skipped 000591 1783072838.401347 write 0x0090e5 thru 0x00aa65 (0x1981 bytes) 000592 1783072838.486578 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ce5b): Mirror 17: 0xb7ab2f81 (stale) Mirror 18: 0xb7ab2f81 (stale) Mirror 19: 0xf07aa19a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ce5b): Mirror 17: 0xb7ab2f81 (stale) Mirror 18: 0xb7ab2f81 (stale) Mirror 19: 0xf07aa19a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ce5b: skipped 000593 1783072838.889574 trunc from 0x03ce5b to 0x00aa32 (0x32428 bytes) 000594 1783072838.924680 mapread 0x004cb9 thru 0x00aa32 (0x5d7a bytes) 000595 1783072838.943129 write 0x020820 thru 0x0301c6 (0xf9a7 bytes) 000599 1783072838.948031 mapwrite 0x0173f2 thru 0x018b6b (0x177a bytes) 000600 1783072839.001808 trunc from 0x0301c7 to 0x0329ef (0x2829 bytes) 000601 1783072839.018357 write 0x03f91f thru 0x03ffff (0x6e1 bytes) 000603 1783072839.020079 mapread 0x03ca8f thru 0x03ffff (0x3571 bytes) 000604 1783072839.036574 mapread 0x01430b thru 0x01cb68 (0x885e bytes) 000605 1783072839.037923 read 0x012de2 thru 0x01bad8 (0x8cf7 bytes) 000608 1783072839.041346 trunc from 0x040000 to 0x00593e (0x3a6c1 bytes) 000611 1783072839.066831 mapread 0x002b4a thru 0x00593e (0x2df5 bytes) 000614 1783072839.070535 read 0x000fdd thru 0x00593e (0x4962 bytes) 000617 1783072839.077145 trunc from 0x00593f to 0x013633 (0xdcf5 bytes) 000619 1783072839.097061 mapwrite 0x01fd57 thru 0x0213aa (0x1654 bytes) 000622 1783072839.186971 mapwrite 0x007566 thru 0x012611 (0xb0ac bytes) 000623 1783072839.254624 read 0x002422 thru 0x0056eb (0x32ca bytes) 000624 1783072839.258107 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x213ab): Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x213ab): Mirror 17: 0xa32f7fe7 (stale) Mirror 18: 0xa32f7fe7 (stale) Mirror 19: 0x9c4dcf5c (stale) CRC-32 checksum value for chunk [0, 0x213ab): Mirror 1: 0xd40d3972 Mirror 20: 0xd40d3972 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x213ab: skipped 000625 1783072839.895816 mapwrite 0x020e4d thru 0x0307cf (0xf983 bytes) 000626 1783072840.103439 mapwrite 0x03aeda thru 0x03e9ae (0x3ad5 bytes) 000628 1783072840.184299 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e9af): Mirror 18: 0xa4f04ef3 (stale) Mirror 19: 0xe25cd900 (stale) Mirror 20: 0x1381911f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e9af): Mirror 18: 0xa4f04ef3 (stale) Mirror 19: 0xe25cd900 (stale) Mirror 20: 0x1381911f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e9af: skipped 000629 1783072840.618845 mapread 0x02d7f8 thru 0x0311d7 (0x39e0 bytes) 000630 1783072840.637590 read 0x03838b thru 0x03e9ae (0x6624 bytes) 000635 1783072840.648160 mapread 0x0132a2 thru 0x013e26 (0xb85 bytes) 000637 1783072840.658068 read 0x039dea thru 0x03e9ae (0x4bc5 bytes) 000641 1783072840.664860 mapwrite 0x00bcf2 thru 0x01afb4 (0xf2c3 bytes) 000643 1783072840.749675 write 0x02658f thru 0x02fd2d (0x979f bytes) 000644 1783072840.755839 MIRROR_RESYNC 4 mirrors 000645 1783072841.635732 trunc from 0x03e9af to 0x039e32 (0x4b7c bytes) 000647 1783072841.747854 read 0x032cb1 thru 0x039e32 (0x7182 bytes) 000648 1783072841.768229 MIRROR_RESYNC 4 mirrors 000649 1783072842.542004 write 0x00afc1 thru 0x018f89 (0xdfc9 bytes) 000651 1783072842.596487 write 0x0231ec thru 0x0268f3 (0x3708 bytes) 000652 1783072842.605654 read 0x001782 thru 0x00c013 (0xa892 bytes) 000653 1783072842.616812 read 0x02b355 thru 0x02bf46 (0xbf2 bytes) 000656 1783072842.638722 trunc from 0x039e33 to 0x0098fa (0x30538 bytes) 000659 1783072842.690171 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x98fb): Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x98fb): Mirror 18: 0x18329ece (stale) Mirror 19: 0x18329ece (stale) Mirror 20: 0x18329ece (stale) CRC-32 checksum value for chunk [0, 0x98fb): Mirror 1: 0x18329ece Mirror 21: 0x18329ece lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x98fb: skipped 000661 1783072843.314323 mapwrite 0x00b37f thru 0x017fbe (0xcc40 bytes) 000663 1783072843.534744 trunc from 0x017fbf to 0x01799c (0x622 bytes) 000664 1783072843.565879 trunc from 0x01799d to 0x031981 (0x19fe5 bytes) 000665 1783072843.577237 mapwrite 0x0204c3 thru 0x023c5f (0x379d bytes) 000666 1783072843.627183 write 0x02dbf4 thru 0x0372e8 (0x96f5 bytes) 000667 1783072843.632292 mapwrite 0x026758 thru 0x02fb9d (0x9446 bytes) 000668 1783072843.675745 write 0x038fb1 thru 0x03ffff (0x704f bytes) 000670 1783072843.681376 mapwrite 0x00f7d6 thru 0x015830 (0x605b bytes) 000673 1783072843.744938 read 0x03d113 thru 0x03ffff (0x2eed bytes) 000674 1783072843.746029 trunc from 0x040000 to 0x033988 (0xc677 bytes) 000675 1783072843.766076 MIRROR_RESYNC 5 mirrors 000677 1783072844.675570 MIRROR_RESYNC 5 mirrors 000680 1783072845.016559 mapread 0x0304a4 thru 0x033988 (0x34e5 bytes) 000681 1783072845.032854 trunc from 0x033989 to 0x02e6b4 (0x52d4 bytes) 000682 1783072845.096458 trunc from 0x02e6b5 to 0x031766 (0x30b2 bytes) 000686 1783072845.116714 trunc from 0x031767 to 0x0370b1 (0x594b bytes) 000690 1783072845.135056 mapwrite 0x01b6aa thru 0x021dac (0x6703 bytes) 000692 1783072845.204842 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x370b2): Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x370b2): Mirror 18: 0x4fda1e5e (stale) Mirror 19: 0x4fda1e5e (stale) Mirror 20: 0x4fda1e5e (stale) Mirror 21: 0x4fda1e5e (stale) CRC-32 checksum value for chunk [0, 0x370b2): Mirror 1: 0x745e92f5 Mirror 22: 0x745e92f5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x370b2: skipped 000694 1783072845.802095 trunc from 0x0370b2 to 0x0101ee (0x26ec3 bytes) 000695 1783072845.898866 mapwrite 0x03d87a thru 0x03ffff (0x2786 bytes) 000697 1783072846.001242 write 0x00bf65 thru 0x017337 (0xb3d3 bytes) truncating to largest ever: 0x3fdbf 000699 1783072846.015825 trunc from 0x040000 to 0x03fdbe (0x241 bytes) 000703 1783072846.032182 mapwrite 0x0065b9 thru 0x006fd1 (0xa19 bytes) 000704 1783072846.079625 read 0x02eec6 thru 0x03977b (0xa8b6 bytes) 000706 1783072846.088103 trunc from 0x03fdbf to 0x02e0da (0x11ce4 bytes) 000708 1783072846.101841 write 0x02e2c7 thru 0x034aec (0x6826 bytes) 000710 1783072846.105367 trunc from 0x034aed to 0x039c6f (0x5183 bytes) 000712 1783072846.129539 trunc from 0x039c70 to 0x00a8b9 (0x2f3b6 bytes) 000713 1783072846.150034 mapwrite 0x008739 thru 0x0144e5 (0xbdad bytes) 000714 1783072846.262322 mapwrite 0x022251 thru 0x02c51f (0xa2cf bytes) 000716 1783072846.365279 read 0x029249 thru 0x02c51f (0x32d7 bytes) 000717 1783072846.370204 MIRROR_RESYNC 6 mirrors 000719 1783072847.141990 trunc from 0x02c520 to 0x001942 (0x2abdd bytes) 000720 1783072847.253182 mapread 0x000227 thru 0x001942 (0x171c bytes) 000721 1783072847.260825 mapwrite 0x000ef9 thru 0x002219 (0x1321 bytes) 000722 1783072847.323067 trunc from 0x00221a to 0x01f22d (0x1d014 bytes) 000725 1783072847.350911 MIRROR_RESYNC 6 mirrors 000727 1783072848.108520 mapread 0x008151 thru 0x010a1c (0x88cc bytes) 000728 1783072848.128538 mapread 0x0192b7 thru 0x01e82e (0x5578 bytes) 000729 1783072848.143037 read 0x019c55 thru 0x01cb22 (0x2ece bytes) 000730 1783072848.143624 mapwrite 0x02d631 thru 0x02e419 (0xde9 bytes) 000731 1783072848.258459 trunc from 0x02e41a to 0x0251ac (0x926d bytes) 000733 1783072848.275157 write 0x01f721 thru 0x02d54f (0xde2f bytes) 000734 1783072848.282463 read 0x0024e8 thru 0x0085e2 (0x60fb bytes) 000735 1783072848.296539 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d550): Mirror 19: 0x28af064 (stale) Mirror 20: 0x28af064 (stale) Mirror 21: 0x28af064 (stale) Mirror 22: 0x28af064 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d550): Mirror 19: 0x28af064 (stale) Mirror 20: 0x28af064 (stale) Mirror 21: 0x28af064 (stale) Mirror 22: 0x28af064 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d550: skipped 000736 1783072848.621248 trunc from 0x02d550 to 0x00aa76 (0x22ad9 bytes) 000738 1783072848.634995 mapwrite 0x01a999 thru 0x01eda3 (0x440b bytes) 000741 1783072848.738671 read 0x002431 thru 0x00f871 (0xd441 bytes) 000742 1783072848.747111 trunc from 0x01eda4 to 0x03f5d2 (0x2082f bytes) 000743 1783072848.763781 mapread 0x0060ce thru 0x014e8d (0xedc0 bytes) 000746 1783072848.777627 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3f5d3): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f5d3): Mirror 19: 0x18f8ddfb (stale) Mirror 20: 0x18f8ddfb (stale) Mirror 21: 0x18f8ddfb (stale) Mirror 22: 0x18f8ddfb (stale) CRC-32 checksum value for chunk [0, 0x3f5d3): Mirror 1: 0x619932a Mirror 23: 0x619932a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f5d3: skipped 000748 1783072849.447160 write 0x01c94e thru 0x028dbc (0xc46f bytes) 000749 1783072849.502405 trunc from 0x03f5d3 to 0x0255ac (0x1a026 bytes) 000751 1783072849.526512 MIRROR_RESYNC 6 mirrors 000752 1783072850.205606 mapread 0x012638 thru 0x021364 (0xed2d bytes) 000753 1783072850.248763 read 0x0077e2 thru 0x00dad5 (0x62f4 bytes) 000755 1783072850.272491 trunc from 0x0255ad to 0x02a2d9 (0x4d2d bytes) 000756 1783072850.368913 mapread 0x00fe67 thru 0x0171f0 (0x738a bytes) 000757 1783072850.387472 trunc from 0x02a2da to 0x00d87d (0x1ca5c bytes) 000758 1783072850.422466 mapwrite 0x039763 thru 0x03ffff (0x689d bytes) 000759 1783072850.542673 write 0x01ea43 thru 0x028df7 (0xa3b5 bytes) 000760 1783072850.559411 mapread 0x0117b6 thru 0x01302a (0x1875 bytes) 000762 1783072850.573580 write 0x037d03 thru 0x03e47b (0x6779 bytes) 000763 1783072850.578600 mapread 0x02cf90 thru 0x03a6a4 (0xd715 bytes) 000765 1783072850.610452 mapread 0x03bcbd thru 0x03ffff (0x4343 bytes) 000767 1783072850.616117 write 0x00aa8a thru 0x01a744 (0xfcbb bytes) 000768 1783072850.625020 trunc from 0x040000 to 0x01e0f1 (0x21f0e bytes) 000769 1783072850.651524 mapwrite 0x018cb0 thru 0x01e91d (0x5c6e bytes) 000771 1783072850.732623 mapwrite 0x009964 thru 0x00c23a (0x28d7 bytes) 000773 1783072850.775717 mapwrite 0x02d0cb thru 0x0309f6 (0x392c bytes) 000775 1783072850.860629 trunc from 0x0309f7 to 0x00837c (0x2867a bytes) 000777 1783072850.878242 read 0x005020 thru 0x00837c (0x335d bytes) 000778 1783072850.893121 mapwrite 0x005562 thru 0x00cb83 (0x7622 bytes) 000779 1783072850.975265 trunc from 0x00cb84 to 0x0106ba (0x3b37 bytes) 000783 1783072850.994777 read 0x0012bc thru 0x00336f (0x20b4 bytes) 000784 1783072850.995664 mapwrite 0x01271f thru 0x01aa1b (0x82fd bytes) 000787 1783072851.088061 read 0x010566 thru 0x0109a9 (0x444 bytes) 000788 1783072851.088975 trunc from 0x01aa1c to 0x00bd04 (0xed17 bytes) 000790 1783072851.110702 read 0x002030 thru 0x004b1c (0x2aed bytes) 000792 1783072851.117449 MIRROR_RESYNC 6 mirrors 000795 1783072851.937678 trunc from 0x00bd05 to 0x01d78b (0x11a87 bytes) 000796 1783072852.040050 MIRROR_RESYNC 6 mirrors 000798 1783072852.889036 read 0x0140fe thru 0x01d78b (0x968e bytes) 000800 1783072852.900210 mapwrite 0x010a62 thru 0x01f629 (0xebc8 bytes) 000801 1783072853.091466 mapread 0x001673 thru 0x00c3e8 (0xad76 bytes) 000803 1783072853.112286 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1f62a): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f62a): Mirror 19: 0x9e6c1537 (stale) Mirror 20: 0x9e6c1537 (stale) Mirror 21: 0x9e6c1537 (stale) Mirror 22: 0x9e6c1537 (stale) Mirror 23: 0x9e6c1537 (stale) CRC-32 checksum value for chunk [0, 0x1f62a): Mirror 1: 0x4a094ed2 Mirror 24: 0x4a094ed2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f62a: skipped 000804 1783072853.771249 mapwrite 0x006c88 thru 0x010bb5 (0x9f2e bytes) 000807 1783072853.954322 mapread 0x0090c6 thru 0x0189f8 (0xf933 bytes) 000809 1783072853.967620 read 0x018506 thru 0x01f629 (0x7124 bytes) 000812 1783072853.983003 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1f62a): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f62a): Mirror 19: 0x9e6c1537 (stale) Mirror 20: 0x9e6c1537 (stale) Mirror 21: 0x9e6c1537 (stale) Mirror 22: 0x9e6c1537 (stale) Mirror 23: 0x9e6c1537 (stale) Mirror 24: 0x4a094ed2 (stale) CRC-32 checksum value for chunk [0, 0x1f62a): Mirror 1: 0x59bab45b Mirror 25: 0x59bab45b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f62a: skipped 000813 1783072854.715805 trunc from 0x01f62a to 0x03c9d0 (0x1d3a7 bytes) 000814 1783072854.815192 write 0x02a372 thru 0x0375bf (0xd24e bytes) 000817 1783072854.825222 mapread 0x028549 thru 0x0369c7 (0xe47f bytes) 000818 1783072854.838947 trunc from 0x03c9d1 to 0x02cb24 (0xfeac bytes) 000819 1783072854.864114 mapwrite 0x03c2f1 thru 0x03ffff (0x3d0f bytes) 000820 1783072854.953855 read 0x021379 thru 0x025aae (0x4736 bytes) 000823 1783072854.984448 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0xb419c94f (stale) Mirror 20: 0xb419c94f (stale) Mirror 21: 0xb419c94f (stale) Mirror 22: 0xb419c94f (stale) Mirror 23: 0xb419c94f (stale) Mirror 25: 0xee2ae69d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0xb419c94f (stale) Mirror 20: 0xb419c94f (stale) Mirror 21: 0xb419c94f (stale) Mirror 22: 0xb419c94f (stale) Mirror 23: 0xb419c94f (stale) Mirror 25: 0xee2ae69d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000824 1783072855.462613 MIRROR_RESYNC 7 mirrors 000825 1783072856.449450 read 0x021290 thru 0x02160a (0x37b bytes) 000826 1783072856.453880 trunc from 0x040000 to 0x038e1d (0x71e2 bytes) 000827 1783072856.516946 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x38e1e): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38e1e): Mirror 19: 0xa1c3336d (stale) Mirror 20: 0xa1c3336d (stale) Mirror 21: 0xa1c3336d (stale) Mirror 22: 0xa1c3336d (stale) Mirror 23: 0xa1c3336d (stale) Mirror 25: 0xa1c3336d (stale) CRC-32 checksum value for chunk [0, 0x38e1e): Mirror 1: 0xa1c3336d Mirror 26: 0xa1c3336d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38e1e: skipped 000828 1783072857.276302 trunc from 0x038e1e to 0x0066b5 (0x32768 bytes) 000831 1783072857.357093 write 0x03b883 thru 0x03ffff (0x477d bytes) 000832 1783072857.360152 read 0x0218c1 thru 0x02becf (0xa60f bytes) 000833 1783072857.366755 mapwrite 0x03e3ba thru 0x03ffff (0x1c46 bytes) 000834 1783072857.422488 mapread 0x02475e thru 0x026934 (0x21d7 bytes) 000836 1783072857.426118 read 0x01f68c thru 0x024331 (0x4ca6 bytes) 000837 1783072857.448923 mapwrite 0x01cc9f thru 0x02439b (0x76fd bytes) 000840 1783072857.520623 mapread 0x024e85 thru 0x02958f (0x470b bytes) 000841 1783072857.522101 mapread 0x008a04 thru 0x00914c (0x749 bytes) 000843 1783072857.524893 mapwrite 0x0348d1 thru 0x03526a (0x99a bytes) 000846 1783072857.559730 trunc from 0x040000 to 0x03692d (0x96d2 bytes) 000847 1783072857.577808 mapwrite 0x013d69 thru 0x020313 (0xc5ab bytes) 000848 1783072857.634114 mapwrite 0x01a047 thru 0x01a967 (0x921 bytes) 000849 1783072857.674092 trunc from 0x03692e to 0x00d62e (0x292ff bytes) 000850 1783072857.687492 write 0x02eda6 thru 0x03d6af (0xe90a bytes) 000852 1783072857.690744 write 0x0231dd thru 0x024aaa (0x18ce bytes) 000853 1783072857.704499 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d6b0): Mirror 19: 0xbc0462fb (stale) Mirror 20: 0xbc0462fb (stale) Mirror 21: 0xbc0462fb (stale) Mirror 22: 0xbc0462fb (stale) Mirror 23: 0xbc0462fb (stale) Mirror 26: 0x518e9095 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d6b0): Mirror 19: 0xbc0462fb (stale) Mirror 20: 0xbc0462fb (stale) Mirror 21: 0xbc0462fb (stale) Mirror 22: 0xbc0462fb (stale) Mirror 23: 0xbc0462fb (stale) Mirror 26: 0x518e9095 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d6b0: skipped 000855 1783072858.105624 read 0x0325df thru 0x03370c (0x112e bytes) 000856 1783072858.109607 trunc from 0x03d6b0 to 0x02fa2c (0xdc83 bytes) 000860 1783072858.128311 mapwrite 0x03471b thru 0x03cc2a (0x8510 bytes) 000861 1783072858.205308 write 0x03b4f7 thru 0x03ffff (0x4b09 bytes) 000863 1783072858.206857 mapread 0x0318e8 thru 0x03b570 (0x9c89 bytes) 000864 1783072858.211884 MIRROR_RESYNC 7 mirrors 000865 1783072859.024912 write 0x0138a1 thru 0x022fcd (0xf72d bytes) 000866 1783072859.088283 write 0x006028 thru 0x008453 (0x242c bytes) 000869 1783072859.098659 trunc from 0x040000 to 0x02cca6 (0x13359 bytes) 000871 1783072859.142254 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2cca7): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cca7): Mirror 19: 0x8d16e9db (stale) Mirror 20: 0x8d16e9db (stale) Mirror 21: 0x8d16e9db (stale) Mirror 22: 0x8d16e9db (stale) Mirror 23: 0x8d16e9db (stale) Mirror 26: 0x8d16e9db (stale) CRC-32 checksum value for chunk [0, 0x2cca7): Mirror 1: 0x87e620c1 Mirror 27: 0x87e620c1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cca7: skipped 000872 1783072859.958904 write 0x00b1d2 thru 0x0141cf (0x8ffe bytes) 000873 1783072860.036212 mapwrite 0x01f933 thru 0x025e34 (0x6502 bytes) 000874 1783072860.124018 mapread 0x0028d1 thru 0x003f6c (0x169c bytes) 000876 1783072860.140728 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2cca7): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cca7): Mirror 19: 0x8d16e9db (stale) Mirror 20: 0x8d16e9db (stale) Mirror 21: 0x8d16e9db (stale) Mirror 22: 0x8d16e9db (stale) Mirror 23: 0x8d16e9db (stale) Mirror 26: 0x8d16e9db (stale) Mirror 27: 0x87e620c1 (stale) CRC-32 checksum value for chunk [0, 0x2cca7): Mirror 1: 0xec26a9c6 Mirror 28: 0xec26a9c6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cca7: skipped 000877 1783072860.900961 read 0x0289d3 thru 0x02cca6 (0x42d4 bytes) 000879 1783072860.912786 mapread 0x0039a1 thru 0x00d46e (0x9ace bytes) 000880 1783072860.937631 mapread 0x00dbc4 thru 0x00deb5 (0x2f2 bytes) 000882 1783072860.959128 write 0x02e080 thru 0x038f04 (0xae85 bytes) 000883 1783072861.076224 trunc from 0x038f05 to 0x0302d0 (0x8c34 bytes) 000884 1783072861.123113 mapwrite 0x0201ac thru 0x028cc7 (0x8b1c bytes) 000885 1783072861.197009 write 0x010ab8 thru 0x013ce5 (0x322e bytes) 000886 1783072861.215002 MIRROR_RESYNC 9 mirrors 000888 1783072862.774536 mapwrite 0x014a73 thru 0x01b7f1 (0x6d7f bytes) 000889 1783072862.920516 MIRROR_RESYNC 9 mirrors 000891 1783072864.145522 MIRROR_RESYNC 9 mirrors 000892 1783072864.626605 trunc from 0x0302d1 to 0x033de6 (0x3b16 bytes) 000893 1783072864.678430 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33de7): Mirror 19: 0x70b17f7b (stale) Mirror 20: 0x70b17f7b (stale) Mirror 21: 0x70b17f7b (stale) Mirror 22: 0x70b17f7b (stale) Mirror 23: 0x70b17f7b (stale) Mirror 26: 0x70b17f7b (stale) Mirror 28: 0x70b17f7b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33de7): Mirror 19: 0x70b17f7b (stale) Mirror 20: 0x70b17f7b (stale) Mirror 21: 0x70b17f7b (stale) Mirror 22: 0x70b17f7b (stale) Mirror 23: 0x70b17f7b (stale) Mirror 26: 0x70b17f7b (stale) Mirror 28: 0x70b17f7b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33de7: skipped 000899 1783072865.187091 mapread 0x018bc6 thru 0x01e282 (0x56bd bytes) 000900 1783072865.208371 read 0x030ab4 thru 0x033de6 (0x3333 bytes) 000902 1783072865.216762 read 0x0262b4 thru 0x02f826 (0x9573 bytes) 000903 1783072865.227177 mapwrite 0x01700d thru 0x026464 (0xf458 bytes) 000904 1783072865.287170 write 0x013033 thru 0x016e6b (0x3e39 bytes) 000905 1783072865.288989 mapread 0x0205ec thru 0x022290 (0x1ca5 bytes) 000906 1783072865.297225 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x33de7): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33de7): Mirror 19: 0x70b17f7b (stale) Mirror 20: 0x70b17f7b (stale) Mirror 21: 0x70b17f7b (stale) Mirror 22: 0x70b17f7b (stale) Mirror 23: 0x70b17f7b (stale) Mirror 26: 0x70b17f7b (stale) Mirror 28: 0x70b17f7b (stale) CRC-32 checksum value for chunk [0, 0x33de7): Mirror 1: 0x5e905127 Mirror 29: 0x5e905127 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33de7: skipped 000907 1783072866.033652 MIRROR_RESYNC 9 mirrors 000908 1783072867.141273 trunc from 0x033de7 to 0x01b30b (0x18adb bytes) 000909 1783072867.237229 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b30c): Mirror 19: 0x71cfeb1c (stale) Mirror 20: 0x71cfeb1c (stale) Mirror 21: 0x71cfeb1c (stale) Mirror 22: 0x71cfeb1c (stale) Mirror 23: 0x71cfeb1c (stale) Mirror 28: 0x71cfeb1c (stale) Mirror 29: 0x71cfeb1c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b30c): Mirror 19: 0x71cfeb1c (stale) Mirror 20: 0x71cfeb1c (stale) Mirror 21: 0x71cfeb1c (stale) Mirror 22: 0x71cfeb1c (stale) Mirror 23: 0x71cfeb1c (stale) Mirror 28: 0x71cfeb1c (stale) Mirror 29: 0x71cfeb1c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b30c: skipped 000912 1783072867.674147 mapwrite 0x00232f thru 0x00a6de (0x83b0 bytes) 000913 1783072867.741543 write 0x002a0d thru 0x0128de (0xfed2 bytes) 000914 1783072867.751774 mapwrite 0x014ac3 thru 0x01bd57 (0x7295 bytes) 000917 1783072867.820551 mapread 0x0033fa thru 0x004984 (0x158b bytes) 000918 1783072867.821974 write 0x010033 thru 0x01587c (0x584a bytes) 000919 1783072867.824568 read 0x01382b thru 0x01bd57 (0x852d bytes) 000920 1783072867.826278 mapwrite 0x017dc0 thru 0x020769 (0x89aa bytes) 000922 1783072867.905554 read 0x01b7a1 thru 0x020769 (0x4fc9 bytes) 000925 1783072867.911559 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2076a): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2076a): Mirror 19: 0xe3b5cc8e (stale) Mirror 20: 0xe3b5cc8e (stale) Mirror 21: 0xe3b5cc8e (stale) Mirror 22: 0xe3b5cc8e (stale) Mirror 23: 0xe3b5cc8e (stale) Mirror 28: 0xe3b5cc8e (stale) Mirror 29: 0xe3b5cc8e (stale) CRC-32 checksum value for chunk [0, 0x2076a): Mirror 1: 0x501b5be4 Mirror 30: 0x501b5be4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2076a: skipped 000926 1783072868.723286 write 0x01998b thru 0x023b84 (0xa1fa bytes) 000927 1783072868.808647 read 0x01f749 thru 0x023b84 (0x443c bytes) 000928 1783072868.809320 mapread 0x0024d7 thru 0x00bfd2 (0x9afc bytes) 000933 1783072868.828867 read 0x005516 thru 0x013f46 (0xea31 bytes) 000934 1783072868.836623 mapread 0x012408 thru 0x01b132 (0x8d2b bytes) 000935 1783072868.838375 mapread 0x014046 thru 0x01d055 (0x9010 bytes) 000938 1783072868.841030 mapread 0x006af5 thru 0x00d9f6 (0x6f02 bytes) 000941 1783072868.843472 mapwrite 0x01b460 thru 0x0241e9 (0x8d8a bytes) 000943 1783072868.907021 mapread 0x00cf11 thru 0x01a40a (0xd4fa bytes) 000945 1783072868.912571 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x241ea): Mirror 19: 0x5f63d485 (stale) Mirror 20: 0x5f63d485 (stale) Mirror 22: 0x5f63d485 (stale) Mirror 23: 0x5f63d485 (stale) Mirror 28: 0x5f63d485 (stale) Mirror 29: 0x5f63d485 (stale) Mirror 30: 0x464c43ff (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x241ea): Mirror 19: 0x5f63d485 (stale) Mirror 20: 0x5f63d485 (stale) Mirror 22: 0x5f63d485 (stale) Mirror 23: 0x5f63d485 (stale) Mirror 28: 0x5f63d485 (stale) Mirror 29: 0x5f63d485 (stale) Mirror 30: 0x464c43ff (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x241ea: skipped 000946 1783072869.280054 write 0x00036f thru 0x002d63 (0x29f5 bytes) 000947 1783072869.294153 read 0x01a7ea thru 0x021093 (0x68aa bytes) 000948 1783072869.307733 write 0x02be81 thru 0x039e61 (0xdfe1 bytes) 000950 1783072869.314881 read 0x00a897 thru 0x013426 (0x8b90 bytes) 000951 1783072869.326944 write 0x015834 thru 0x01ec24 (0x93f1 bytes) 000952 1783072869.330585 trunc from 0x039e62 to 0x018b52 (0x2130f bytes) 000953 1783072869.350053 mapwrite 0x0129ff thru 0x0153c0 (0x29c2 bytes) 000955 1783072869.411938 mapwrite 0x030f67 thru 0x03e40e (0xd4a8 bytes) 000957 1783072869.568595 read 0x0112af thru 0x01f0ab (0xddfd bytes) 000958 1783072869.587335 MIRROR_RESYNC 8 mirrors 000961 1783072870.646027 write 0x03ecef thru 0x03ffff (0x1311 bytes) 000962 1783072870.702848 write 0x011580 thru 0x015930 (0x43b1 bytes) 000967 1783072870.712318 mapread 0x024d6c thru 0x033fb3 (0xf248 bytes) 000968 1783072870.744697 read 0x007f11 thru 0x009287 (0x1377 bytes) 000970 1783072870.752779 mapwrite 0x012b36 thru 0x014868 (0x1d33 bytes) 000972 1783072870.811881 read 0x037c74 thru 0x03c5ca (0x4957 bytes) 000974 1783072870.830132 trunc from 0x040000 to 0x02e2e7 (0x11d18 bytes) 000975 1783072870.845536 read 0x02a141 thru 0x02e2e7 (0x41a7 bytes) 000977 1783072870.846891 read 0x00fff0 thru 0x01b85d (0xb86e bytes) 000982 1783072870.855232 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1e5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e2e8): Mirror 19: 0x4e95dc16 (stale) Mirror 20: 0x4e95dc16 (stale) Mirror 22: 0x4e95dc16 (stale) Mirror 23: 0x4e95dc16 (stale) Mirror 29: 0x4e95dc16 (stale) Mirror 30: 0x4e95dc16 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e2e8): Mirror 19: 0x4e95dc16 (stale) Mirror 20: 0x4e95dc16 (stale) Mirror 22: 0x4e95dc16 (stale) Mirror 23: 0x4e95dc16 (stale) Mirror 29: 0x4e95dc16 (stale) Mirror 30: 0x4e95dc16 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e2e8: skipped 000983 1783072871.275145 trunc from 0x02e2e8 to 0x02a9c4 (0x3923 bytes) 000985 1783072871.291053 read 0x006e3e thru 0x0163fd (0xf5c0 bytes) 000988 1783072871.313728 trunc from 0x02a9c5 to 0x03939b (0xe9d7 bytes) 000989 1783072871.337339 trunc from 0x03939c to 0x01b8aa (0x1daf1 bytes) 000990 1783072871.355510 read 0x0166ec thru 0x01b8aa (0x51bf bytes) 000991 1783072871.374164 read 0x00c963 thru 0x01329b (0x6939 bytes) 000993 1783072871.377921 mapwrite 0x01b205 thru 0x02829b (0xd097 bytes) 000994 1783072871.484565 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2829c): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2829c): Mirror 19: 0x7ff9c8e0 (stale) Mirror 20: 0x7ff9c8e0 (stale) Mirror 22: 0x7ff9c8e0 (stale) Mirror 23: 0x7ff9c8e0 (stale) Mirror 29: 0x7ff9c8e0 (stale) Mirror 30: 0x7ff9c8e0 (stale) CRC-32 checksum value for chunk [0, 0x2829c): Mirror 1: 0x89f4eef0 Mirror 31: 0x89f4eef0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2829c: skipped 000996 1783072872.194211 mapread 0x00abe0 thru 0x014b83 (0x9fa4 bytes) 000997 1783072872.213707 mapwrite 0x014dbb thru 0x0156fb (0x941 bytes) 000999 1783072872.372946 write 0x02cd26 thru 0x02e190 (0x146b bytes) 001000 1783072872.376972 trunc from 0x02e191 to 0x00224b (0x2bf45 bytes) All operations completed A-OK!