== sanity-flr test 70a: flr mode fsx test ================ 13:20:34 (1786036834) Seed set to 6836 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1786036836.925820 mapwrite 0x000d36 thru 0x004946 (0x3c11 bytes) truncating to largest ever: 0x1a3eb 000003 1786036837.084034 trunc from 0x004947 to 0x01a3ea (0x15aa4 bytes) 000005 1786036837.111889 read 0x012023 thru 0x01a3ea (0x83c8 bytes) 000006 1786036837.128004 write 0x024d34 thru 0x030d73 (0xc040 bytes) 000008 1786036837.134284 mapread 0x00e676 thru 0x01ae09 (0xc794 bytes) truncating to largest ever: 0x1fef3 000010 1786036837.165572 trunc from 0x030d74 to 0x01fef2 (0x10e81 bytes) 000011 1786036837.201425 mapread 0x0025e4 thru 0x00b727 (0x9144 bytes) truncating to largest ever: 0x3d7a4 000012 1786036837.216764 trunc from 0x01fef3 to 0x03d7a3 (0x1d8b1 bytes) 000013 1786036837.287930 MIRROR_EXTEND to 2 mirrors 000015 1786036838.712145 mapread 0x032a44 thru 0x038622 (0x5bdf bytes) 000018 1786036838.821124 write 0x01292f thru 0x013577 (0xc49 bytes) 000020 1786036838.964328 write 0x036cfb thru 0x03b560 (0x4866 bytes) 000021 1786036838.986066 mapread 0x02f588 thru 0x03d7a3 (0xe21c bytes) 000022 1786036839.015898 write 0x0016e4 thru 0x00cfbd (0xb8da bytes) 000023 1786036839.046277 mapread 0x013e0d thru 0x0219d1 (0xdbc5 bytes) 000025 1786036839.142277 mapread 0x02afa4 thru 0x031e95 (0x6ef2 bytes) 000026 1786036839.155598 write 0x0186f5 thru 0x01de2f (0x573b bytes) 000027 1786036839.175393 MIRROR_RESYNC 2 mirrors 000028 1786036840.360776 trunc from 0x03d7a4 to 0x00cb34 (0x30c6f bytes) 000029 1786036840.547701 read 0x006b2c thru 0x00cb34 (0x6009 bytes) 000030 1786036840.569281 mapread 0x009d6e thru 0x00cb34 (0x2dc7 bytes) 000033 1786036840.571485 write 0x02855a thru 0x033cb2 (0xb759 bytes) 000034 1786036840.586947 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x33cb3): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33cb3): Mirror 2: 0xffc8c95a (stale) CRC-32 checksum value for chunk [0, 0x33cb3): Mirror 1: 0x52c2908e Mirror 3: 0x52c2908e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33cb3: skipped 000035 1786036842.084511 mapwrite 0x0364ca thru 0x03ffff (0x9b36 bytes) 000036 1786036842.357567 mapread 0x035be8 thru 0x03b7f3 (0x5c0c bytes) 000039 1786036842.364606 mapread 0x0387bb thru 0x03c6a2 (0x3ee8 bytes) 000041 1786036842.382900 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x188:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa714a078 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa714a078 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000044 1786036842.766858 write 0x033733 thru 0x03b3ac (0x7c7a bytes) 000045 1786036842.791299 write 0x03842d thru 0x03ffff (0x7bd3 bytes) 000046 1786036842.800990 read 0x023555 thru 0x02cfcf (0x9a7b bytes) 000047 1786036842.831556 mapwrite 0x015063 thru 0x0214e5 (0xc483 bytes) 000048 1786036843.002089 read 0x038649 thru 0x03aa8e (0x2446 bytes) 000049 1786036843.014217 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa714a078 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9ee564b3 Mirror 4: 0x9ee564b3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000050 1786036844.101136 mapwrite 0x022361 thru 0x027674 (0x5314 bytes) 000051 1786036844.346386 write 0x03282f thru 0x034876 (0x2048 bytes) 000052 1786036844.374487 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa714a078 (stale) Mirror 4: 0x9ee564b3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1c7c2873 Mirror 5: 0x1c7c2873 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000053 1786036845.861602 trunc from 0x040000 to 0x029667 (0x16998 bytes) 000055 1786036845.992178 read 0x0001fc thru 0x00a613 (0xa418 bytes) 000056 1786036846.014418 mapread 0x00a7d3 thru 0x010231 (0x5a5f bytes) 000057 1786036846.046216 read 0x01a265 thru 0x01ad28 (0xac4 bytes) 000058 1786036846.060631 mapread 0x0187ce thru 0x025d6d (0xd5a0 bytes) 000059 1786036846.062265 trunc from 0x029668 to 0x00a54c (0x1f11b bytes) 000060 1786036846.096034 trunc from 0x00a54d to 0x03d2f7 (0x32dab bytes) 000061 1786036846.127250 mapread 0x00c359 thru 0x016924 (0xa5cc bytes) 000062 1786036846.251568 MIRROR_RESYNC 4 mirrors 000063 1786036847.729028 read 0x02b1ab thru 0x033875 (0x86cb bytes) 000064 1786036847.746869 read 0x035eff thru 0x03d2f7 (0x73f9 bytes) 000065 1786036847.762592 mapread 0x01497d thru 0x021563 (0xcbe7 bytes) 000066 1786036847.765435 write 0x0004c8 thru 0x00156a (0x10a3 bytes) 000067 1786036847.863291 read 0x01ee85 thru 0x02d5ee (0xe76a bytes) 000068 1786036847.880051 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x188:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d2f8): Mirror 4: 0xd2d6b4e9 (stale) Mirror 5: 0xd2d6b4e9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d2f8): Mirror 4: 0xd2d6b4e9 (stale) Mirror 5: 0xd2d6b4e9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d2f8: skipped 000070 1786036848.224444 write 0x01a20c thru 0x021a29 (0x781e bytes) 000072 1786036848.241973 mapwrite 0x03b430 thru 0x03fff5 (0x4bc6 bytes) 000073 1786036848.360429 write 0x03e556 thru 0x03ffff (0x1aaa bytes) 000074 1786036848.362480 trunc from 0x040000 to 0x017cda (0x28325 bytes) 000075 1786036848.386037 read 0x010823 thru 0x0124ad (0x1c8b bytes) 000077 1786036848.395404 mapwrite 0x03df8a thru 0x03ffff (0x2076 bytes) 000079 1786036848.479628 read 0x0181e6 thru 0x026830 (0xe64b bytes) 000080 1786036848.496901 MIRROR_RESYNC 3 mirrors 000082 1786036849.758302 mapwrite 0x033188 thru 0x038cb0 (0x5b29 bytes) 000087 1786036850.002790 read 0x02d402 thru 0x037bd0 (0xa7cf bytes) 000088 1786036850.004930 trunc from 0x040000 to 0x00920d (0x36df2 bytes) 000089 1786036850.057275 read 0x000b82 thru 0x008bf3 (0x8072 bytes) 000090 1786036850.087218 trunc from 0x00920e to 0x019c94 (0x10a87 bytes) 000093 1786036850.123225 trunc from 0x019c95 to 0x02b087 (0x113f3 bytes) 000096 1786036850.161080 MIRROR_RESYNC 3 mirrors 000098 1786036851.171052 trunc from 0x02b088 to 0x01fdd9 (0xb2ae bytes) 000099 1786036851.366633 trunc from 0x01fdda to 0x03a63e (0x1a865 bytes) 000102 1786036851.403945 mapwrite 0x009dbd thru 0x011811 (0x7a55 bytes) 000105 1786036851.499874 mapwrite 0x000c18 thru 0x009558 (0x8941 bytes) 000106 1786036851.571145 mapwrite 0x035292 thru 0x03fe77 (0xabe6 bytes) 000107 1786036851.674845 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x188:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fe78): Mirror 5: 0x5d9599e2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fe78): Mirror 5: 0x5d9599e2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fe78: skipped 000111 1786036851.920141 trunc from 0x03fe78 to 0x03c729 (0x374e bytes) 000113 1786036851.950544 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3c72a): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c72a): Mirror 5: 0x721864f6 (stale) CRC-32 checksum value for chunk [0, 0x3c72a): Mirror 1: 0xe7e3883c Mirror 6: 0xe7e3883c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c72a: skipped 000115 1786036853.348118 write 0x035d9b thru 0x039cfc (0x3f62 bytes) 000119 1786036853.502637 trunc from 0x03c72a to 0x014edb (0x2784e bytes) 000123 1786036853.531473 read 0x00132c thru 0x009e72 (0x8b47 bytes) 000124 1786036853.543922 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x14edc): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14edc): Mirror 5: 0xa4e8ca96 (stale) Mirror 6: 0xaf031787 (stale) CRC-32 checksum value for chunk [0, 0x14edc): Mirror 1: 0xaf031787 Mirror 7: 0xaf031787 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14edc: skipped 000127 1786036854.852638 write 0x03e8c1 thru 0x03ffff (0x173f bytes) 000128 1786036854.977972 mapwrite 0x0384e1 thru 0x03ffff (0x7b1f bytes) 000130 1786036855.154146 read 0x0087ae thru 0x015cba (0xd50d bytes) 000131 1786036855.175285 MIRROR_RESYNC 4 mirrors 000132 1786036856.526637 trunc from 0x040000 to 0x010b4b (0x2f4b4 bytes) 000134 1786036856.601473 mapread 0x010347 thru 0x010b4b (0x805 bytes) 000136 1786036856.614006 MIRROR_RESYNC 4 mirrors 000137 1786036857.847820 write 0x037222 thru 0x03ffff (0x8dde bytes) 000140 1786036857.941980 mapwrite 0x00d874 thru 0x00f84c (0x1fd9 bytes) 000141 1786036858.155489 read 0x02bff1 thru 0x02f7f8 (0x3808 bytes) 000142 1786036858.187551 mapwrite 0x019a07 thru 0x0258e2 (0xbedc bytes) 000146 1786036858.396404 mapwrite 0x03beb9 thru 0x03ffff (0x4147 bytes) 000149 1786036858.507863 read 0x013512 thru 0x01bd42 (0x8831 bytes) 000153 1786036858.522085 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xc2add0a9 (stale) Mirror 6: 0xc2add0a9 (stale) Mirror 7: 0xc2add0a9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcab34ee1 Mirror 8: 0xcab34ee1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000156 1786036859.981306 write 0x008134 thru 0x0108bc (0x8789 bytes) 000158 1786036860.190169 MIRROR_RESYNC 5 mirrors 000162 1786036861.894972 mapwrite 0x025d96 thru 0x031b3b (0xbda6 bytes) 000163 1786036862.214934 read 0x00122f thru 0x00ab54 (0x9926 bytes) 000164 1786036862.228221 trunc from 0x040000 to 0x00a8e3 (0x3571c bytes) 000166 1786036862.252605 mapread 0x007711 thru 0x00a8e3 (0x31d3 bytes) 000167 1786036862.254800 trunc from 0x00a8e4 to 0x002893 (0x8050 bytes) 000168 1786036862.274300 write 0x03706b thru 0x03ad68 (0x3cfe bytes) 000170 1786036862.277229 write 0x02f94f thru 0x03bde0 (0xc492 bytes) 000173 1786036862.284279 write 0x01037a thru 0x014e45 (0x4acc bytes) 000176 1786036862.298808 trunc from 0x03bde1 to 0x002627 (0x397b9 bytes) 000178 1786036862.317831 write 0x00774e thru 0x00a1d7 (0x2a8a bytes) 000179 1786036862.327274 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x188:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xa1d8): Mirror 5: 0xcad41e8d (stale) Mirror 6: 0xcad41e8d (stale) Mirror 8: 0xcad41e8d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa1d8): Mirror 5: 0xcad41e8d (stale) Mirror 6: 0xcad41e8d (stale) Mirror 8: 0xcad41e8d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa1d8: skipped 000181 1786036862.793173 mapread 0x00928f thru 0x00a1d7 (0xf49 bytes) 000182 1786036862.814872 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xa1d8): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa1d8): Mirror 5: 0xcad41e8d (stale) Mirror 6: 0xcad41e8d (stale) Mirror 8: 0xcad41e8d (stale) CRC-32 checksum value for chunk [0, 0xa1d8): Mirror 1: 0xdae3c719 Mirror 9: 0xdae3c719 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa1d8: skipped 000184 1786036864.479019 mapwrite 0x02a927 thru 0x03945e (0xeb38 bytes) 000185 1786036864.815304 mapread 0x009fe7 thru 0x00d12c (0x3146 bytes) 000190 1786036864.840351 trunc from 0x03945f to 0x02ce38 (0xc626 bytes) 000191 1786036864.877620 read 0x02bc1a thru 0x02c9a9 (0xd90 bytes) 000192 1786036864.879605 mapread 0x0205c4 thru 0x024819 (0x4256 bytes) 000193 1786036864.892237 mapwrite 0x00b287 thru 0x01347c (0x81f6 bytes) 000194 1786036864.960796 write 0x00abb6 thru 0x011487 (0x68d2 bytes) 000198 1786036864.966298 mapwrite 0x0126fe thru 0x014e6e (0x2771 bytes) 000200 1786036865.012332 mapwrite 0x008640 thru 0x012936 (0xa2f7 bytes) 000201 1786036865.106424 read 0x00c7aa thru 0x00f9c4 (0x321b bytes) 000203 1786036865.108146 read 0x002705 thru 0x0080e1 (0x59dd bytes) 000205 1786036865.114049 write 0x01ae12 thru 0x02016e (0x535d bytes) 000206 1786036865.126389 trunc from 0x02ce39 to 0x014ffa (0x17e3e bytes) 000207 1786036865.166802 write 0x0223e2 thru 0x0322ab (0xfeca bytes) 000208 1786036865.170116 mapwrite 0x003a63 thru 0x00c275 (0x8813 bytes) 000210 1786036865.251832 mapwrite 0x033246 thru 0x03f1bb (0xbf76 bytes) 000211 1786036865.395199 mapwrite 0x005bc4 thru 0x00e32f (0x876c bytes) 000213 1786036865.517369 MIRROR_RESYNC 5 mirrors 000215 1786036867.164593 trunc from 0x03f1bc to 0x00acf3 (0x344c8 bytes) 000217 1786036867.260821 trunc from 0x00acf4 to 0x005374 (0x597f bytes) 000218 1786036867.291583 read 0x0030fa thru 0x003e53 (0xd5a bytes) 000221 1786036867.303101 trunc from 0x005375 to 0x02746d (0x220f9 bytes) 000227 1786036867.344340 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2746e): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2746e): Mirror 5: 0x2a19b0ec (stale) Mirror 6: 0x2a19b0ec (stale) Mirror 8: 0x2a19b0ec (stale) Mirror 9: 0x2a19b0ec (stale) CRC-32 checksum value for chunk [0, 0x2746e): Mirror 1: 0x8a627a8b Mirror 10: 0x8a627a8b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2746e: skipped 000231 1786036868.917186 mapwrite 0x033e2c thru 0x034209 (0x3de bytes) 000234 1786036869.085991 write 0x023994 thru 0x02b853 (0x7ec0 bytes) 000236 1786036869.101148 mapread 0x00aad8 thru 0x00cd2c (0x2255 bytes) 000237 1786036869.113359 mapwrite 0x007ad8 thru 0x016455 (0xe97e bytes) 000238 1786036869.213636 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x188:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3420a): Mirror 6: 0xc4a22d6d (stale) Mirror 8: 0xc4a22d6d (stale) Mirror 9: 0xc4a22d6d (stale) Mirror 10: 0xecb19e1d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3420a): Mirror 6: 0xc4a22d6d (stale) Mirror 8: 0xc4a22d6d (stale) Mirror 9: 0xc4a22d6d (stale) Mirror 10: 0xecb19e1d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3420a: skipped 000243 1786036869.599935 mapwrite 0x03d0c8 thru 0x03ec4d (0x1b86 bytes) 000244 1786036869.676581 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3ec4e): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ec4e): Mirror 6: 0x3473b587 (stale) Mirror 8: 0x3473b587 (stale) Mirror 9: 0x3473b587 (stale) Mirror 10: 0x1e46d26f (stale) CRC-32 checksum value for chunk [0, 0x3ec4e): Mirror 1: 0x64751895 Mirror 11: 0x64751895 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ec4e: skipped 000245 1786036870.815625 read 0x026981 thru 0x02e680 (0x7d00 bytes) 000246 1786036870.851963 mapread 0x004547 thru 0x01031f (0xbdd9 bytes) 000247 1786036870.937294 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3ec4e): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ec4e): Mirror 6: 0x3473b587 (stale) Mirror 8: 0x3473b587 (stale) Mirror 9: 0x3473b587 (stale) Mirror 10: 0x1e46d26f (stale) CRC-32 checksum value for chunk [0, 0x3ec4e): Mirror 1: 0x64751895 Mirror 11: 0x64751895 Mirror 12: 0x64751895 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ec4e: skipped 000250 1786036872.119943 write 0x02914e thru 0x0385a5 (0xf458 bytes) 000251 1786036872.283529 write 0x01a4bf thru 0x0229f5 (0x8537 bytes) 000253 1786036872.300448 mapwrite 0x0198b4 thru 0x022e64 (0x95b1 bytes) 000257 1786036872.387883 mapwrite 0x02169d thru 0x027efd (0x6861 bytes) 000261 1786036872.495420 write 0x019b8a thru 0x01c4ef (0x2966 bytes) 000264 1786036872.497898 mapwrite 0x035ad4 thru 0x03ffff (0xa52c bytes) 000265 1786036872.631477 read 0x02be37 thru 0x02fbfe (0x3dc8 bytes) 000268 1786036872.639191 write 0x034cf8 thru 0x03dcc8 (0x8fd1 bytes) 000269 1786036872.644279 read 0x01dc2f thru 0x021a92 (0x3e64 bytes) 000272 1786036872.646487 trunc from 0x040000 to 0x014083 (0x2bf7c bytes) 000273 1786036872.689296 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x188:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x14084): Mirror 6: 0x50fe7ea7 (stale) Mirror 8: 0x50fe7ea7 (stale) Mirror 9: 0x50fe7ea7 (stale) Mirror 11: 0x53fc6e28 (stale) Mirror 12: 0x53fc6e28 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14084): Mirror 6: 0x50fe7ea7 (stale) Mirror 8: 0x50fe7ea7 (stale) Mirror 9: 0x50fe7ea7 (stale) Mirror 11: 0x53fc6e28 (stale) Mirror 12: 0x53fc6e28 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14084: skipped 000276 1786036873.141284 mapwrite 0x03b560 thru 0x03bcb2 (0x753 bytes) 000277 1786036873.284153 read 0x03234a thru 0x03863f (0x62f6 bytes) 000278 1786036873.315865 trunc from 0x03bcb3 to 0x033f3c (0x7d76 bytes) 000281 1786036873.371434 mapread 0x013bcf thru 0x01dad2 (0x9f04 bytes) 000282 1786036873.439552 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x33f3d): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33f3d): Mirror 6: 0x7c76a7cc (stale) Mirror 8: 0x7c76a7cc (stale) Mirror 9: 0x7c76a7cc (stale) Mirror 11: 0xfc983db (stale) Mirror 12: 0xfc983db (stale) CRC-32 checksum value for chunk [0, 0x33f3d): Mirror 1: 0xa0eeb819 Mirror 13: 0xa0eeb819 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33f3d: skipped 000285 1786036874.649624 mapwrite 0x035377 thru 0x03bfd3 (0x6c5d bytes) 000288 1786036875.069535 mapwrite 0x020ea3 thru 0x02939d (0x84fb bytes) 000289 1786036875.163805 mapwrite 0x00cb3b thru 0x01457f (0x7a45 bytes) 000290 1786036875.376707 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3bfd4): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bfd4): Mirror 6: 0xe11bb4fb (stale) Mirror 8: 0xe11bb4fb (stale) Mirror 9: 0xe11bb4fb (stale) Mirror 11: 0x16bcb3bc (stale) Mirror 12: 0x16bcb3bc (stale) Mirror 13: 0x36cc6c20 (stale) CRC-32 checksum value for chunk [0, 0x3bfd4): Mirror 1: 0xf1e0881b Mirror 14: 0xf1e0881b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bfd4: skipped 000291 1786036876.562872 write 0x03bb81 thru 0x03ffff (0x447f bytes) 000292 1786036876.727166 read 0x01bde5 thru 0x022934 (0x6b50 bytes) 000293 1786036876.739627 mapread 0x0019f3 thru 0x00de43 (0xc451 bytes) 000294 1786036876.768088 mapread 0x037fee thru 0x03ffff (0x8012 bytes) 000296 1786036876.819066 trunc from 0x040000 to 0x02cfc0 (0x1303f bytes) 000299 1786036876.917449 mapread 0x0104ff thru 0x010632 (0x134 bytes) 000300 1786036876.918488 mapwrite 0x01761d thru 0x01966f (0x2053 bytes) 000302 1786036876.993112 write 0x00e35e thru 0x011063 (0x2d06 bytes) 000303 1786036876.998075 mapread 0x016620 thru 0x01ff9e (0x997f bytes) 000305 1786036877.008064 write 0x02fcc2 thru 0x031065 (0x13a4 bytes) 000306 1786036877.010148 write 0x01ff37 thru 0x029709 (0x97d3 bytes) 000307 1786036877.021602 read 0x00b041 thru 0x0182d9 (0xd299 bytes) 000308 1786036877.027905 write 0x011f6e thru 0x01d4ac (0xb53f bytes) 000309 1786036877.032544 mapread 0x028f3d thru 0x02b512 (0x25d6 bytes) 000312 1786036877.069510 mapwrite 0x032c49 thru 0x033fb6 (0x136e bytes) 000313 1786036877.163347 mapwrite 0x0118a2 thru 0x013e88 (0x25e7 bytes) 000316 1786036877.218436 mapread 0x00c422 thru 0x00f448 (0x3027 bytes) 000317 1786036877.237466 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x188:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33fb7): Mirror 8: 0xda82e94f (stale) Mirror 9: 0xda82e94f (stale) Mirror 11: 0xb5b6f41 (stale) Mirror 12: 0xb5b6f41 (stale) Mirror 13: 0xa08c5d98 (stale) Mirror 14: 0xec819ccf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33fb7): Mirror 8: 0xda82e94f (stale) Mirror 9: 0xda82e94f (stale) Mirror 11: 0xb5b6f41 (stale) Mirror 12: 0xb5b6f41 (stale) Mirror 13: 0xa08c5d98 (stale) Mirror 14: 0xec819ccf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33fb7: skipped 000318 1786036877.947625 trunc from 0x033fb7 to 0x037838 (0x3882 bytes) 000322 1786036877.967609 read 0x023a31 thru 0x0309a1 (0xcf71 bytes) 000323 1786036877.979559 mapwrite 0x02b182 thru 0x02c7c4 (0x1643 bytes) 000325 1786036878.020061 read 0x00dff9 thru 0x01a2a3 (0xc2ab bytes) 000327 1786036878.045013 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x188:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37839): Mirror 8: 0xc7536753 (stale) Mirror 9: 0xc7536753 (stale) Mirror 11: 0x965c0a90 (stale) Mirror 13: 0x1cfc0a94 (stale) Mirror 14: 0x29fbc293 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37839): Mirror 8: 0xc7536753 (stale) Mirror 9: 0xc7536753 (stale) Mirror 11: 0x965c0a90 (stale) Mirror 13: 0x1cfc0a94 (stale) Mirror 14: 0x29fbc293 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37839: skipped 000329 1786036878.628888 read 0x01cb7b thru 0x025289 (0x870f bytes) 000332 1786036878.639904 mapread 0x02d217 thru 0x037838 (0xa622 bytes) 000334 1786036878.660974 read 0x036482 thru 0x037838 (0x13b7 bytes) 000337 1786036878.663009 mapread 0x028862 thru 0x02f057 (0x67f6 bytes) 000340 1786036878.665877 mapread 0x01742f thru 0x0192e8 (0x1eba bytes) 000341 1786036878.675721 write 0x017ea1 thru 0x01aeba (0x301a bytes) 000342 1786036878.678233 mapwrite 0x0334b7 thru 0x03621c (0x2d66 bytes) 000345 1786036878.809544 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x188:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37839): Mirror 8: 0xc7536753 (stale) Mirror 11: 0x965c0a90 (stale) Mirror 13: 0x1cfc0a94 (stale) Mirror 14: 0x29fbc293 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37839): Mirror 8: 0xc7536753 (stale) Mirror 11: 0x965c0a90 (stale) Mirror 13: 0x1cfc0a94 (stale) Mirror 14: 0x29fbc293 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37839: skipped 000346 1786036879.375839 mapread 0x002b8f thru 0x00f886 (0xccf8 bytes) 000348 1786036879.404114 mapwrite 0x019333 thru 0x019fc7 (0xc95 bytes) 000349 1786036879.470986 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x37839): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37839): Mirror 8: 0xc7536753 (stale) Mirror 11: 0x965c0a90 (stale) Mirror 13: 0x1cfc0a94 (stale) Mirror 14: 0x29fbc293 (stale) CRC-32 checksum value for chunk [0, 0x37839): Mirror 1: 0xcdc8eeed Mirror 15: 0xcdc8eeed lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37839: skipped 000350 1786036880.701858 write 0x038e3d thru 0x03ffff (0x71c3 bytes) 000351 1786036880.785843 trunc from 0x040000 to 0x02895e (0x176a1 bytes) 000354 1786036880.822516 mapwrite 0x008272 thru 0x008749 (0x4d8 bytes) 000357 1786036880.914140 write 0x032219 thru 0x03f6e5 (0xd4cd bytes) 000360 1786036880.917763 write 0x01f4dd thru 0x02ae8d (0xb9b1 bytes) 000361 1786036880.930459 write 0x020277 thru 0x02aee7 (0xac71 bytes) 000362 1786036880.933091 mapwrite 0x0083fb thru 0x00e5a3 (0x61a9 bytes) 000366 1786036881.005577 mapread 0x01c59a thru 0x022ecc (0x6933 bytes) 000368 1786036881.041892 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x188:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f6e6): Mirror 8: 0xb3f433cb (stale) Mirror 11: 0x3795040b (stale) Mirror 13: 0xc17cfa0a (stale) Mirror 14: 0xde0ed9de (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f6e6): Mirror 8: 0xb3f433cb (stale) Mirror 11: 0x3795040b (stale) Mirror 13: 0xc17cfa0a (stale) Mirror 14: 0xde0ed9de (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f6e6: skipped 000369 1786036881.830471 write 0x001900 thru 0x008478 (0x6b79 bytes) 000375 1786036881.850954 read 0x038b53 thru 0x03e929 (0x5dd7 bytes) 000376 1786036881.864510 mapwrite 0x029b6e thru 0x02b6ac (0x1b3f bytes) 000377 1786036881.942497 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3f6e6): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f6e6): Mirror 8: 0xb3f433cb (stale) Mirror 11: 0x3795040b (stale) Mirror 13: 0xc17cfa0a (stale) Mirror 14: 0xde0ed9de (stale) CRC-32 checksum value for chunk [0, 0x3f6e6): Mirror 1: 0xb10ac5b1 Mirror 15: 0xb10ac5b1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f6e6: skipped 000378 1786036883.538465 mapread 0x019841 thru 0x021ccf (0x848f bytes) 000379 1786036883.625529 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x188:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f6e6): Mirror 8: 0xb3f433cb (stale) Mirror 11: 0x3795040b (stale) Mirror 13: 0xc17cfa0a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f6e6): Mirror 8: 0xb3f433cb (stale) Mirror 11: 0x3795040b (stale) Mirror 13: 0xc17cfa0a (stale) CRC-32 checksum value for chunk [0, 0x3f6e6): Mirror 1: 0xb10ac5b1 Mirror 15: 0xb10ac5b1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f6e6: skipped 000382 1786036885.038909 read 0x0148ba thru 0x01d64d (0x8d94 bytes) 000384 1786036885.092585 trunc from 0x03f6e6 to 0x030f4b (0xe79a bytes) 000385 1786036885.296845 mapwrite 0x008fcf thru 0x009324 (0x356 bytes) 000387 1786036885.470356 MIRROR_RESYNC 5 mirrors 000390 1786036886.892296 trunc from 0x030f4c to 0x012c90 (0x1e2bb bytes) 000392 1786036886.955812 read 0x004590 thru 0x0065f1 (0x2062 bytes) 000394 1786036886.960442 trunc from 0x012c91 to 0x027abe (0x14e2e bytes) 000395 1786036886.978448 mapwrite 0x013e19 thru 0x01a075 (0x625d bytes) 000398 1786036887.066345 mapread 0x02736d thru 0x027abe (0x752 bytes) 000399 1786036887.075241 mapwrite 0x0306ef thru 0x033bf4 (0x3506 bytes) 000400 1786036887.171729 mapwrite 0x011e4b thru 0x020ac4 (0xec7a bytes) 000402 1786036887.264995 mapwrite 0x0271b5 thru 0x02d95c (0x67a8 bytes) 000403 1786036887.326892 trunc from 0x033bf5 to 0x0001f2 (0x33a02 bytes) 000404 1786036887.355309 write 0x0262a7 thru 0x026cc5 (0xa1f bytes) 000405 1786036887.357991 read 0x017b43 thru 0x01dc5a (0x6118 bytes) 000406 1786036887.374270 mapread 0x0198c8 thru 0x01b9db (0x2114 bytes) 000408 1786036887.377434 mapwrite 0x01d095 thru 0x02c03e (0xefaa bytes) 000409 1786036887.492555 MIRROR_RESYNC 5 mirrors 000411 1786036889.341714 write 0x036822 thru 0x03ffff (0x97de bytes) 000412 1786036889.444064 read 0x01dba6 thru 0x0275a8 (0x9a03 bytes) 000413 1786036889.474998 read 0x03e15a thru 0x03ffff (0x1ea6 bytes) 000414 1786036889.475718 read 0x01d829 thru 0x0299e6 (0xc1be bytes) 000415 1786036889.494319 read 0x039401 thru 0x03ea22 (0x5622 bytes) 000416 1786036889.495117 read 0x016e51 thru 0x018b11 (0x1cc1 bytes) 000417 1786036889.495769 mapread 0x02c123 thru 0x02dcdc (0x1bba bytes) 000418 1786036889.496754 read 0x037960 thru 0x03ffff (0x86a0 bytes) 000420 1786036889.503623 read 0x02e043 thru 0x038c99 (0xac57 bytes) 000421 1786036889.509908 mapread 0x0094dd thru 0x00ff75 (0x6a99 bytes) 000422 1786036889.514181 write 0x000a42 thru 0x0063a6 (0x5965 bytes) 000423 1786036889.518548 write 0x0352c5 thru 0x038ac3 (0x37ff bytes) 000425 1786036889.521208 trunc from 0x040000 to 0x026ca7 (0x19358 bytes) 000426 1786036889.566848 write 0x0373c7 thru 0x03b947 (0x4581 bytes) 000427 1786036889.582485 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3b948): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b948): Mirror 8: 0xc0a90f3b (stale) Mirror 11: 0xc0a90f3b (stale) Mirror 13: 0xc0a90f3b (stale) Mirror 15: 0xc0a90f3b (stale) CRC-32 checksum value for chunk [0, 0x3b948): Mirror 1: 0x2b5a782f Mirror 16: 0x2b5a782f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b948: skipped 000428 1786036891.715796 trunc from 0x03b948 to 0x02f3fc (0xc54b bytes) 000430 1786036891.949427 mapwrite 0x038e49 thru 0x03a466 (0x161e bytes) 000432 1786036892.112824 read 0x01265b thru 0x01f9d5 (0xd37b bytes) 000433 1786036892.126794 mapwrite 0x01f029 thru 0x025017 (0x5fef bytes) 000434 1786036892.249366 write 0x02eb10 thru 0x03d3c2 (0xe8b3 bytes) 000435 1786036892.265034 MIRROR_RESYNC 6 mirrors 000436 1786036894.264481 mapwrite 0x0260dc thru 0x028c13 (0x2b38 bytes) 000437 1786036894.513766 mapwrite 0x006bab thru 0x006e9f (0x2f5 bytes) 000439 1786036894.579769 read 0x02e0cd thru 0x03c88d (0xe7c1 bytes) 000442 1786036894.602220 write 0x0064de thru 0x00b95b (0x547e bytes) 000446 1786036894.614728 mapread 0x02dcb6 thru 0x02f21f (0x156a bytes) 000448 1786036894.619874 trunc from 0x03d3c3 to 0x03a135 (0x328d bytes) 000451 1786036894.688848 trunc from 0x03a136 to 0x039768 (0x9cd bytes) 000453 1786036894.741301 write 0x00b17d thru 0x00ce6b (0x1cef bytes) 000454 1786036894.744202 mapread 0x00ee87 thru 0x0133c4 (0x453e bytes) 000457 1786036894.761686 trunc from 0x039769 to 0x013495 (0x262d3 bytes) 000459 1786036894.831211 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x13496): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13496): Mirror 8: 0xbaec6473 (stale) Mirror 11: 0xbaec6473 (stale) Mirror 13: 0xbaec6473 (stale) Mirror 15: 0xbaec6473 (stale) Mirror 16: 0xbaec6473 (stale) CRC-32 checksum value for chunk [0, 0x13496): Mirror 1: 0x5a90daba Mirror 17: 0x5a90daba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13496: skipped 000460 1786036896.601706 mapread 0x0101d7 thru 0x013495 (0x32bf bytes) 000462 1786036896.663899 MIRROR_RESYNC 7 mirrors 000463 1786036898.473233 mapread 0x005851 thru 0x010894 (0xb044 bytes) 000465 1786036898.596883 mapread 0x00b95a thru 0x01052f (0x4bd6 bytes) 000467 1786036898.602594 trunc from 0x013496 to 0x006e74 (0xc621 bytes) 000470 1786036898.761145 trunc from 0x006e75 to 0x03b519 (0x346a5 bytes) 000471 1786036898.828477 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3b51a): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b51a): Mirror 8: 0x66e7d16d (stale) Mirror 11: 0x66e7d16d (stale) Mirror 13: 0x66e7d16d (stale) Mirror 15: 0x66e7d16d (stale) Mirror 16: 0x66e7d16d (stale) Mirror 17: 0x66e7d16d (stale) CRC-32 checksum value for chunk [0, 0x3b51a): Mirror 1: 0x48a5d886 Mirror 18: 0x48a5d886 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b51a: skipped 000473 1786036901.037412 read 0x02d807 thru 0x02d97f (0x179 bytes) 000475 1786036901.063377 mapwrite 0x038de0 thru 0x03ffff (0x7220 bytes) 000476 1786036901.377473 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xb1acfe2a (stale) Mirror 11: 0xb1acfe2a (stale) Mirror 13: 0xb1acfe2a (stale) Mirror 15: 0xb1acfe2a (stale) Mirror 16: 0xb1acfe2a (stale) Mirror 17: 0xb1acfe2a (stale) Mirror 18: 0xe64285f1 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3179220c Mirror 19: 0x3179220c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000478 1786036903.733913 read 0x0149f2 thru 0x022d3b (0xe34a bytes) 000480 1786036903.793437 trunc from 0x040000 to 0x032709 (0xd8f6 bytes) 000481 1786036903.902881 mapwrite 0x039da4 thru 0x03ffff (0x625c bytes) 000482 1786036904.040270 MIRROR_RESYNC 9 mirrors 000484 1786036906.614079 read 0x014a6f thru 0x01a6aa (0x5c3c bytes) 000486 1786036906.641978 read 0x02bc66 thru 0x037aa8 (0xbe43 bytes) 000487 1786036906.671113 read 0x03b739 thru 0x03f92f (0x41f7 bytes) 000488 1786036906.672013 write 0x01e35f thru 0x02b2c0 (0xcf62 bytes) 000490 1786036906.764000 write 0x0325ec thru 0x0360ac (0x3ac1 bytes) 000493 1786036906.765887 mapwrite 0x022066 thru 0x02d243 (0xb1de bytes) 000496 1786036906.826498 write 0x009486 thru 0x0181de (0xed59 bytes) 000499 1786036906.829760 read 0x038f14 thru 0x03ffff (0x70ec bytes) 000500 1786036906.830464 mapread 0x016616 thru 0x017777 (0x1162 bytes) 000501 1786036906.833110 write 0x038544 thru 0x03ffff (0x7abc bytes) 000503 1786036906.836210 mapwrite 0x005996 thru 0x00c3fa (0x6a65 bytes) 000504 1786036906.944845 write 0x039c39 thru 0x03a37a (0x742 bytes) 000507 1786036906.948343 read 0x0009fc thru 0x002819 (0x1e1e bytes) 000508 1786036906.949437 write 0x02a1dd thru 0x03866a (0xe48e bytes) 000509 1786036906.958587 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x9af96f71 (stale) Mirror 11: 0x9af96f71 (stale) Mirror 13: 0x9af96f71 (stale) Mirror 15: 0x9af96f71 (stale) Mirror 16: 0x9af96f71 (stale) Mirror 17: 0x9af96f71 (stale) Mirror 18: 0x9af96f71 (stale) Mirror 19: 0x9af96f71 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x458b1214 Mirror 20: 0x458b1214 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000511 1786036908.801574 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x9af96f71 (stale) Mirror 11: 0x9af96f71 (stale) Mirror 13: 0x9af96f71 (stale) Mirror 15: 0x9af96f71 (stale) Mirror 16: 0x9af96f71 (stale) Mirror 17: 0x9af96f71 (stale) Mirror 18: 0x9af96f71 (stale) Mirror 19: 0x9af96f71 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x458b1214 Mirror 20: 0x458b1214 Mirror 21: 0x458b1214 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000512 1786036910.539423 read 0x038b6c thru 0x03d8d9 (0x4d6e bytes) 000513 1786036910.551976 trunc from 0x040000 to 0x01ed37 (0x212c8 bytes) 000516 1786036910.667889 mapread 0x00cbfd thru 0x014636 (0x7a3a bytes) 000517 1786036910.688993 mapread 0x0133a7 thru 0x019d4c (0x69a6 bytes) 000520 1786036910.699920 read 0x017270 thru 0x01ed37 (0x7ac8 bytes) 000521 1786036910.701575 trunc from 0x01ed38 to 0x019312 (0x5a25 bytes) 000522 1786036910.729808 mapread 0x00b635 thru 0x00e3fb (0x2dc7 bytes) 000524 1786036910.738628 trunc from 0x019313 to 0x01d049 (0x3d37 bytes) 000525 1786036910.761394 mapread 0x00fd00 thru 0x012150 (0x2451 bytes) 000527 1786036910.765352 write 0x036fac thru 0x03ffff (0x9054 bytes) 000528 1786036910.769397 write 0x00daa9 thru 0x011aba (0x4012 bytes) 000530 1786036910.771488 mapread 0x00ff2a thru 0x01742f (0x7506 bytes) 000532 1786036910.780165 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x188:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x9af96f71 (stale) Mirror 13: 0x9af96f71 (stale) Mirror 15: 0x9af96f71 (stale) Mirror 16: 0x9af96f71 (stale) Mirror 17: 0x9af96f71 (stale) Mirror 18: 0x9af96f71 (stale) Mirror 19: 0x9af96f71 (stale) Mirror 20: 0x458b1214 (stale) Mirror 21: 0x458b1214 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x9af96f71 (stale) Mirror 13: 0x9af96f71 (stale) Mirror 15: 0x9af96f71 (stale) Mirror 16: 0x9af96f71 (stale) Mirror 17: 0x9af96f71 (stale) Mirror 18: 0x9af96f71 (stale) Mirror 19: 0x9af96f71 (stale) Mirror 20: 0x458b1214 (stale) Mirror 21: 0x458b1214 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000533 1786036911.396974 mapread 0x02cb7f thru 0x03a4d5 (0xd957 bytes) 000537 1786036911.444343 mapread 0x016c16 thru 0x025075 (0xe460 bytes) 000540 1786036911.478638 trunc from 0x040000 to 0x003f12 (0x3c0ed bytes) 000542 1786036911.508383 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3f13): Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f13): Mirror 11: 0xe4c2349e (stale) Mirror 13: 0xe4c2349e (stale) Mirror 15: 0xe4c2349e (stale) Mirror 16: 0xe4c2349e (stale) Mirror 17: 0xe4c2349e (stale) Mirror 18: 0xe4c2349e (stale) Mirror 19: 0xe4c2349e (stale) Mirror 20: 0xe4c2349e (stale) Mirror 21: 0xe4c2349e (stale) CRC-32 checksum value for chunk [0, 0x3f13): Mirror 1: 0xe4c2349e Mirror 22: 0xe4c2349e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f13: skipped 000546 1786036912.672332 read 0x002bca thru 0x003f12 (0x1349 bytes) 000549 1786036912.755974 trunc from 0x003f13 to 0x01593a (0x11a28 bytes) 000550 1786036913.001996 trunc from 0x01593b to 0x01105b (0x48df bytes) truncating to largest ever: 0x3f6f1 000552 1786036913.063198 trunc from 0x01105c to 0x03f6f0 (0x2e695 bytes) 000553 1786036913.125140 read 0x032bf4 thru 0x0347c8 (0x1bd5 bytes) 000554 1786036913.156371 mapwrite 0x026fc0 thru 0x02aa42 (0x3a83 bytes) 000555 1786036913.230400 mapread 0x012485 thru 0x020425 (0xdfa1 bytes) 000557 1786036913.241021 read 0x023bdc thru 0x0254d5 (0x18fa bytes) 000558 1786036913.248874 MIRROR_RESYNC 11 mirrors 000559 1786036919.099904 mapread 0x010472 thru 0x013293 (0x2e22 bytes) 000560 1786036919.144704 mapwrite 0x00f8af thru 0x013a95 (0x41e7 bytes) 000563 1786036919.543283 mapwrite 0x01c2eb thru 0x026be0 (0xa8f6 bytes) 000564 1786036919.650710 trunc from 0x03f6f1 to 0x00b7c1 (0x33f2f bytes) 000565 1786036919.698074 trunc from 0x00b7c2 to 0x02391c (0x1815b bytes) 000566 1786036919.730534 mapwrite 0x02902a thru 0x02ea99 (0x5a70 bytes) 000568 1786036919.917467 write 0x01ab76 thru 0x02350b (0x8996 bytes) 000570 1786036919.930485 mapread 0x00fecc thru 0x0109e9 (0xb1e bytes) 000571 1786036919.955002 mapwrite 0x006048 thru 0x00dd8f (0x7d48 bytes) 000573 1786036920.087196 write 0x028f13 thru 0x034b1c (0xbc0a bytes) 000574 1786036920.112253 MIRROR_RESYNC 11 mirrors 000575 1786036923.206481 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x188:0x0]: Invalid argument (22) 000576 1786036924.124373 read 0x00ec91 thru 0x017ad2 (0x8e42 bytes) 000577 1786036924.191358 MIRROR_RESYNC 10 mirrors 000578 1786036925.237277 MIRROR_EXTEND to 11 mirrors 000579 1786036926.977813 mapwrite 0x02125a thru 0x02f8cf (0xe676 bytes) 000581 1786036927.373624 write 0x029e64 thru 0x02bbce (0x1d6b bytes) 000582 1786036927.383076 trunc from 0x034b1d to 0x0336d9 (0x1443 bytes) 000583 1786036927.488456 trunc from 0x0336da to 0x00a07e (0x2965b bytes) 000584 1786036927.553579 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0xa07f): Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa07f): Mirror 11: 0xfd357665 (stale) Mirror 13: 0xfd357665 (stale) Mirror 15: 0xfd357665 (stale) Mirror 16: 0xfd357665 (stale) Mirror 17: 0xfd357665 (stale) Mirror 18: 0xfd357665 (stale) Mirror 20: 0xfd357665 (stale) Mirror 21: 0xfd357665 (stale) Mirror 22: 0xfd357665 (stale) Mirror 23: 0xfd357665 (stale) CRC-32 checksum value for chunk [0, 0xa07f): Mirror 1: 0xfd357665 Mirror 24: 0xfd357665 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa07f: skipped 000587 1786036929.450284 mapread 0x0020cc thru 0x002ae0 (0xa15 bytes) 000588 1786036929.477453 trunc from 0x00a07f to 0x002599 (0x7ae5 bytes) 000590 1786036929.632059 trunc from 0x00259a to 0x0074ae (0x4f15 bytes) 000592 1786036929.655978 read 0x00216d thru 0x0074ae (0x5342 bytes) 000593 1786036929.667970 mapread 0x003b67 thru 0x0074ae (0x3948 bytes) 000594 1786036929.677140 MIRROR_RESYNC 12 mirrors 000595 1786036931.953503 read 0x001f99 thru 0x0074ae (0x5516 bytes) 000598 1786036931.973552 read 0x003761 thru 0x0074ae (0x3d4e bytes) 000599 1786036931.974247 write 0x0243f4 thru 0x02bedd (0x7aea bytes) 000600 1786036932.093811 mapwrite 0x00dd67 thru 0x013e87 (0x6121 bytes) 000602 1786036932.313734 trunc from 0x02bede to 0x00bbc4 (0x20319 bytes) 000604 1786036932.383409 mapread 0x00a763 thru 0x00bbc4 (0x1462 bytes) 000605 1786036932.389092 write 0x03c767 thru 0x03ffff (0x3899 bytes) 000606 1786036932.391916 read 0x00d3ad thru 0x00f405 (0x2059 bytes) 000610 1786036932.455645 write 0x031696 thru 0x03b4b4 (0x9e1f bytes) 000611 1786036932.474908 MIRROR_RESYNC 12 mirrors 000613 1786036936.467388 write 0x002a5e thru 0x00b1fd (0x87a0 bytes) 000614 1786036936.561602 write 0x016add thru 0x0239e3 (0xcf07 bytes) 000616 1786036936.575905 trunc from 0x040000 to 0x031c5e (0xe3a1 bytes) 000617 1786036936.610201 trunc from 0x031c5f to 0x03de33 (0xc1d5 bytes) 000620 1786036936.644967 MIRROR_RESYNC 12 mirrors 000621 1786036938.646142 mapwrite 0x03f9ad thru 0x03ffff (0x653 bytes) 000622 1786036938.821623 mapread 0x01bf59 thru 0x02b2ff (0xf3a7 bytes) 000623 1786036938.849783 trunc from 0x040000 to 0x02086f (0x1f790 bytes) 000624 1786036938.879848 write 0x002d04 thru 0x0105a0 (0xd89d bytes) 000626 1786036938.892999 mapwrite 0x03319a thru 0x0351ec (0x2053 bytes) 000627 1786036939.011506 MIRROR_RESYNC 12 mirrors 000629 1786036940.880815 mapread 0x00670f thru 0x00bdc9 (0x56bb bytes) 000631 1786036940.934035 read 0x01951f thru 0x01c835 (0x3317 bytes) 000636 1786036940.942751 read 0x0193e0 thru 0x02669a (0xd2bb bytes) 000637 1786036940.961854 mapread 0x03119e thru 0x0351ec (0x404f bytes) 000639 1786036940.962987 write 0x012a7e thru 0x01d986 (0xaf09 bytes) 000640 1786036941.184938 MIRROR_SPLIT mirror 11 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x188:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x351ed): Mirror 11: 0x5f239fda (stale) Mirror 13: 0x5f239fda (stale) Mirror 15: 0x5f239fda (stale) Mirror 16: 0x5f239fda (stale) Mirror 17: 0x5f239fda (stale) Mirror 18: 0x5f239fda (stale) Mirror 20: 0x5f239fda (stale) Mirror 21: 0x5f239fda (stale) Mirror 22: 0x5f239fda (stale) Mirror 23: 0x5f239fda (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x351ed): Mirror 11: 0x5f239fda (stale) Mirror 13: 0x5f239fda (stale) Mirror 15: 0x5f239fda (stale) Mirror 16: 0x5f239fda (stale) Mirror 17: 0x5f239fda (stale) Mirror 18: 0x5f239fda (stale) Mirror 20: 0x5f239fda (stale) Mirror 21: 0x5f239fda (stale) Mirror 22: 0x5f239fda (stale) Mirror 23: 0x5f239fda (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x351ed: skipped 000641 1786036942.209093 read 0x0088a7 thru 0x00fc97 (0x73f1 bytes) 000643 1786036942.246537 mapwrite 0x03fb57 thru 0x03ffff (0x4a9 bytes) 000644 1786036942.354275 mapread 0x004280 thru 0x00508b (0xe0c bytes) 000645 1786036942.391789 MIRROR_RESYNC 11 mirrors 000646 1786036943.917193 MIRROR_EXTEND to 12 mirrors 000647 1786036945.038600 mapwrite 0x01b474 thru 0x029333 (0xdec0 bytes) 000648 1786036945.277404 read 0x01c553 thru 0x01d8a9 (0x1357 bytes) 000650 1786036945.279340 mapread 0x03f874 thru 0x03ffff (0x78c bytes) 000654 1786036945.292326 read 0x02c92d thru 0x032049 (0x571d bytes) 000655 1786036945.303143 mapwrite 0x03fc3d thru 0x03ffff (0x3c3 bytes) 000656 1786036945.342543 read 0x01dde7 thru 0x02b8af (0xdac9 bytes) 000657 1786036945.343498 read 0x02fa8e thru 0x0398ea (0x9e5d bytes) 000661 1786036945.353343 MIRROR_SPLIT mirror 2 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x188:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x9471a008 (stale) Mirror 15: 0x9471a008 (stale) Mirror 16: 0x9471a008 (stale) Mirror 17: 0x9471a008 (stale) Mirror 18: 0x9471a008 (stale) Mirror 20: 0x9471a008 (stale) Mirror 21: 0x9471a008 (stale) Mirror 22: 0x9471a008 (stale) Mirror 23: 0x9471a008 (stale) Mirror 24: 0x9471a008 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x9471a008 (stale) Mirror 15: 0x9471a008 (stale) Mirror 16: 0x9471a008 (stale) Mirror 17: 0x9471a008 (stale) Mirror 18: 0x9471a008 (stale) Mirror 20: 0x9471a008 (stale) Mirror 21: 0x9471a008 (stale) Mirror 22: 0x9471a008 (stale) Mirror 23: 0x9471a008 (stale) Mirror 24: 0x9471a008 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000662 1786036946.264105 mapread 0x01345f thru 0x022122 (0xecc4 bytes) 000664 1786036946.333031 write 0x039eef thru 0x03ffff (0x6111 bytes) 000666 1786036946.356737 MIRROR_RESYNC 11 mirrors 000667 1786036949.223339 read 0x037de8 thru 0x03a3a0 (0x25b9 bytes) 000669 1786036949.239076 mapwrite 0x0215fe thru 0x03118c (0xfb8f bytes) 000671 1786036949.660632 MIRROR_RESYNC 11 mirrors 000672 1786036952.350167 mapwrite 0x0109a2 thru 0x01d0ed (0xc74c bytes) 000673 1786036952.842703 trunc from 0x040000 to 0x03b526 (0x4ad9 bytes) 000675 1786036952.903464 trunc from 0x03b527 to 0x025ac6 (0x15a60 bytes) 000676 1786036952.935837 mapwrite 0x008d5b thru 0x010d49 (0x7fef bytes) 000677 1786036953.140120 read 0x011fb1 thru 0x0155fe (0x364e bytes) 000679 1786036953.141504 mapread 0x004673 thru 0x0079e4 (0x3372 bytes) 000681 1786036953.144167 read 0x00c9a7 thru 0x00ef1a (0x2574 bytes) 000683 1786036953.145694 write 0x01193f thru 0x0188a0 (0x6f62 bytes) 000684 1786036953.147891 mapread 0x0164ae thru 0x022341 (0xbe94 bytes) 000685 1786036953.149812 read 0x014262 thru 0x020ec4 (0xcc63 bytes) 000686 1786036953.151097 write 0x03f863 thru 0x03ffff (0x79d bytes) 000689 1786036953.153912 trunc from 0x040000 to 0x007956 (0x386a9 bytes) 000690 1786036953.176286 read 0x0023a0 thru 0x007956 (0x55b7 bytes) 000691 1786036953.177156 write 0x001d1e thru 0x00c7e6 (0xaac9 bytes) 000692 1786036953.178576 write 0x0135da thru 0x0205ba (0xcfe1 bytes) 000693 1786036953.182453 read 0x01da15 thru 0x01da5c (0x48 bytes) 000694 1786036953.183513 trunc from 0x0205bb to 0x02c272 (0xbcb8 bytes) 000695 1786036953.207622 write 0x0035a4 thru 0x00fb78 (0xc5d5 bytes) 000698 1786036953.224305 read 0x027fa3 thru 0x02c272 (0x42d0 bytes) 000700 1786036953.225895 mapwrite 0x02e569 thru 0x034836 (0x62ce bytes) 000701 1786036953.312487 write 0x0334d8 thru 0x03ffff (0xcb28 bytes) 000704 1786036953.317493 write 0x02b0b5 thru 0x030aeb (0x5a37 bytes) 000706 1786036953.320575 trunc from 0x040000 to 0x013105 (0x2cefa bytes) 000707 1786036953.349192 mapread 0x00b405 thru 0x00e6f3 (0x32ef bytes) 000708 1786036953.350800 mapread 0x0087bb thru 0x013105 (0xa94b bytes) 000711 1786036953.359110 read 0x0088f3 thru 0x013105 (0xa813 bytes) 000712 1786036953.367270 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x13106): Mirror 11: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13106): Mirror 11: 0x5fe1f469 (stale) Mirror 15: 0x5fe1f469 (stale) Mirror 16: 0x5fe1f469 (stale) Mirror 17: 0x5fe1f469 (stale) Mirror 18: 0x5fe1f469 (stale) Mirror 20: 0x5fe1f469 (stale) Mirror 21: 0x5fe1f469 (stale) Mirror 22: 0x5fe1f469 (stale) Mirror 23: 0x5fe1f469 (stale) Mirror 24: 0x5fe1f469 (stale) CRC-32 checksum value for chunk [0, 0x13106): Mirror 1: 0x47f5aa6e Mirror 25: 0x47f5aa6e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13106: skipped 000717 1786036955.022177 MIRROR_SPLIT mirror 2 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x188:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x13106): Mirror 11: 0x5fe1f469 (stale) Mirror 16: 0x5fe1f469 (stale) Mirror 17: 0x5fe1f469 (stale) Mirror 18: 0x5fe1f469 (stale) Mirror 20: 0x5fe1f469 (stale) Mirror 21: 0x5fe1f469 (stale) Mirror 22: 0x5fe1f469 (stale) Mirror 23: 0x5fe1f469 (stale) Mirror 24: 0x5fe1f469 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13106): Mirror 11: 0x5fe1f469 (stale) Mirror 16: 0x5fe1f469 (stale) Mirror 17: 0x5fe1f469 (stale) Mirror 18: 0x5fe1f469 (stale) Mirror 20: 0x5fe1f469 (stale) Mirror 21: 0x5fe1f469 (stale) Mirror 22: 0x5fe1f469 (stale) Mirror 23: 0x5fe1f469 (stale) Mirror 24: 0x5fe1f469 (stale) CRC-32 checksum value for chunk [0, 0x13106): Mirror 1: 0x47f5aa6e Mirror 25: 0x47f5aa6e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13106: skipped 000718 1786036956.176801 mapwrite 0x014398 thru 0x016412 (0x207b bytes) 000722 1786036956.445153 mapread 0x005ab5 thru 0x00c059 (0x65a5 bytes) 000723 1786036956.461706 trunc from 0x016413 to 0x03d59b (0x27189 bytes) 000725 1786036956.490167 mapread 0x0188a3 thru 0x024159 (0xb8b7 bytes) 000726 1786036956.509025 mapwrite 0x02d657 thru 0x03494f (0x72f9 bytes) 000727 1786036956.567553 mapwrite 0x03afb6 thru 0x03ffff (0x504a bytes) 000729 1786036956.652216 trunc from 0x040000 to 0x03acc7 (0x5338 bytes) 000730 1786036956.671130 read 0x025710 thru 0x02c58d (0x6e7e bytes) 000731 1786036956.673434 trunc from 0x03acc8 to 0x012212 (0x28ab5 bytes) 000735 1786036956.697982 write 0x004bcb thru 0x012d11 (0xe147 bytes) 000736 1786036956.701082 write 0x035330 thru 0x03d0ab (0x7d7c bytes) 000737 1786036956.708244 MIRROR_RESYNC 11 mirrors 000738 1786036960.549437 trunc from 0x03d0ac to 0x007b0b (0x355a0 bytes) 000739 1786036960.671776 mapread 0x0060e2 thru 0x007b0b (0x1a2a bytes) 000740 1786036960.692167 MIRROR_RESYNC 11 mirrors 000743 1786036963.348491 mapread 0x007061 thru 0x007b0b (0xaab bytes) 000746 1786036963.355900 trunc from 0x007b0c to 0x028741 (0x20c36 bytes) 000747 1786036963.525252 trunc from 0x028742 to 0x026b6a (0x1bd7 bytes) 000748 1786036963.558261 read 0x00bc91 thru 0x00cf08 (0x1278 bytes) 000749 1786036963.566230 mapwrite 0x034d6b thru 0x0378f3 (0x2b89 bytes) 000750 1786036963.792994 mapread 0x031273 thru 0x0328c8 (0x1656 bytes) 000752 1786036963.800223 mapwrite 0x01e01d thru 0x027073 (0x9057 bytes) 000753 1786036963.998038 read 0x00498f thru 0x01353f (0xebb1 bytes) 000754 1786036964.024209 trunc from 0x0378f4 to 0x025d6d (0x11b86 bytes) 000755 1786036964.090005 mapwrite 0x032379 thru 0x035fda (0x3c62 bytes) 000756 1786036964.321359 write 0x0199a6 thru 0x0220b3 (0x870e bytes) 000758 1786036964.323308 read 0x01319a thru 0x01d9a9 (0xa810 bytes) 000759 1786036964.326569 mapread 0x015f5e thru 0x0205d8 (0xa67b bytes) 000761 1786036964.332209 write 0x011488 thru 0x01c8ab (0xb424 bytes) 000762 1786036964.335044 trunc from 0x035fdb to 0x023d6e (0x1226c bytes) 000765 1786036964.376812 MIRROR_RESYNC 11 mirrors 000767 1786036967.006322 mapwrite 0x03e166 thru 0x03e190 (0x2b bytes) 000768 1786036967.200094 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3e191): Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e191): Mirror 11: 0xfc659132 (stale) Mirror 16: 0xfc659132 (stale) Mirror 17: 0xfc659132 (stale) Mirror 18: 0xfc659132 (stale) Mirror 20: 0xfc659132 (stale) Mirror 21: 0xfc659132 (stale) Mirror 22: 0xfc659132 (stale) Mirror 23: 0xfc659132 (stale) Mirror 24: 0xfc659132 (stale) Mirror 25: 0xfc659132 (stale) CRC-32 checksum value for chunk [0, 0x3e191): Mirror 1: 0xcfab9658 Mirror 26: 0xcfab9658 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e191: skipped 000769 1786036969.184451 mapwrite 0x018583 thru 0x01ec72 (0x66f0 bytes) 000770 1786036969.521012 read 0x027f52 thru 0x02bd7a (0x3e29 bytes) 000772 1786036969.538096 mapread 0x02f2ec thru 0x0389ed (0x9702 bytes) 000773 1786036969.580576 write 0x004e84 thru 0x00769a (0x2817 bytes) 000774 1786036969.603440 write 0x020bca thru 0x02fcb6 (0xf0ed bytes) 000777 1786036969.609315 mapread 0x0095b7 thru 0x0188a1 (0xf2eb bytes) 000778 1786036969.623150 read 0x02399a thru 0x031e72 (0xe4d9 bytes) 000779 1786036969.631774 write 0x01ce7a thru 0x029288 (0xc40f bytes) 000780 1786036969.642816 mapwrite 0x01e18f thru 0x01fab0 (0x1922 bytes) 000782 1786036969.797331 MIRROR_RESYNC 12 mirrors 000784 1786036972.382519 mapwrite 0x0242ca thru 0x028aff (0x4836 bytes) 000785 1786036972.695067 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3e191): Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e191): Mirror 11: 0xe6388d2a (stale) Mirror 16: 0xe6388d2a (stale) Mirror 17: 0xe6388d2a (stale) Mirror 18: 0xe6388d2a (stale) Mirror 20: 0xe6388d2a (stale) Mirror 21: 0xe6388d2a (stale) Mirror 22: 0xe6388d2a (stale) Mirror 23: 0xe6388d2a (stale) Mirror 24: 0xe6388d2a (stale) Mirror 25: 0xe6388d2a (stale) Mirror 26: 0xe6388d2a (stale) CRC-32 checksum value for chunk [0, 0x3e191): Mirror 1: 0x8b7c5792 Mirror 27: 0x8b7c5792 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e191: skipped 000786 1786036974.418404 write 0x034a37 thru 0x03d015 (0x85df bytes) 000787 1786036974.653099 read 0x031df5 thru 0x03e190 (0xc39c bytes) 000789 1786036974.680188 trunc from 0x03e191 to 0x0126f8 (0x2ba98 bytes) 000790 1786036974.728754 MIRROR_RESYNC 13 mirrors 000792 1786036978.227959 MIRROR_EXTEND to 14 mirrors 000794 1786036979.789831 mapwrite 0x017534 thru 0x01fcf2 (0x87bf bytes) 000799 1786036980.032565 MIRROR_RESYNC 14 mirrors 000800 1786036982.276365 mapread 0x00ae6b thru 0x0109a8 (0x5b3e bytes) 000801 1786036982.296716 mapread 0x01e4d4 thru 0x01fcf2 (0x181f bytes) 000806 1786036982.308099 mapread 0x000aec thru 0x0052a4 (0x47b9 bytes) 000807 1786036982.317267 write 0x038a90 thru 0x03ffff (0x7570 bytes) 000810 1786036982.393181 read 0x01c1ae thru 0x029c47 (0xda9a bytes) 000811 1786036982.405361 trunc from 0x040000 to 0x009073 (0x36f8c bytes) 000812 1786036982.434451 trunc from 0x009074 to 0x0306c7 (0x27654 bytes) 000813 1786036982.455777 trunc from 0x0306c8 to 0x03a9d0 (0xa309 bytes) 000814 1786036982.476256 write 0x01f134 thru 0x026fdd (0x7eaa bytes) 000815 1786036982.487468 write 0x0309c4 thru 0x0346b0 (0x3ced bytes) 000817 1786036982.513068 MIRROR_RESYNC 14 mirrors 000818 1786036985.150909 MIRROR_RESYNC 14 mirrors 000820 1786036986.023125 trunc from 0x03a9d1 to 0x039afc (0xed4 bytes) 000821 1786036986.308927 read 0x032b53 thru 0x039afc (0x6faa bytes) 000822 1786036986.360394 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x39afd): Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39afd): Mirror 11: 0xd1469285 (stale) Mirror 16: 0xd1469285 (stale) Mirror 17: 0xd1469285 (stale) Mirror 18: 0xd1469285 (stale) Mirror 20: 0xd1469285 (stale) Mirror 21: 0xd1469285 (stale) Mirror 22: 0xd1469285 (stale) Mirror 23: 0xd1469285 (stale) Mirror 24: 0xd1469285 (stale) Mirror 25: 0xd1469285 (stale) Mirror 26: 0xd1469285 (stale) Mirror 27: 0xd1469285 (stale) Mirror 28: 0xd1469285 (stale) CRC-32 checksum value for chunk [0, 0x39afd): Mirror 1: 0xd1469285 Mirror 29: 0xd1469285 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39afd: skipped 000824 1786036988.156481 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x39afd): Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39afd): Mirror 11: 0xd1469285 (stale) Mirror 16: 0xd1469285 (stale) Mirror 17: 0xd1469285 (stale) Mirror 18: 0xd1469285 (stale) Mirror 20: 0xd1469285 (stale) Mirror 21: 0xd1469285 (stale) Mirror 22: 0xd1469285 (stale) Mirror 23: 0xd1469285 (stale) Mirror 24: 0xd1469285 (stale) Mirror 25: 0xd1469285 (stale) Mirror 26: 0xd1469285 (stale) Mirror 27: 0xd1469285 (stale) Mirror 28: 0xd1469285 (stale) CRC-32 checksum value for chunk [0, 0x39afd): Mirror 1: 0xd1469285 Mirror 29: 0xd1469285 Mirror 30: 0xd1469285 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39afd: skipped 000825 1786036989.832760 write 0x03a592 thru 0x03ffff (0x5a6e bytes) 000826 1786036989.977210 read 0x00d209 thru 0x011468 (0x4260 bytes) 000827 1786036989.982642 mapread 0x021999 thru 0x030aa6 (0xf10e bytes) 000828 1786036990.021735 mapwrite 0x01047f thru 0x01a95d (0xa4df bytes) 000829 1786036990.161246 write 0x03d068 thru 0x03ffff (0x2f98 bytes) 000830 1786036990.162935 mapwrite 0x0194bc thru 0x01a8c6 (0x140b bytes) 000831 1786036990.222373 write 0x030cd2 thru 0x03ec3e (0xdf6d bytes) 000832 1786036990.226411 mapread 0x02842c thru 0x036885 (0xe45a bytes) 000834 1786036990.242350 MIRROR_SPLIT mirror 2 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x188:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x42d705e4 (stale) Mirror 17: 0x42d705e4 (stale) Mirror 18: 0x42d705e4 (stale) Mirror 20: 0x42d705e4 (stale) Mirror 21: 0x42d705e4 (stale) Mirror 22: 0x42d705e4 (stale) Mirror 23: 0x42d705e4 (stale) Mirror 24: 0x42d705e4 (stale) Mirror 25: 0x42d705e4 (stale) Mirror 26: 0x42d705e4 (stale) Mirror 27: 0x42d705e4 (stale) Mirror 28: 0x42d705e4 (stale) Mirror 29: 0x42d705e4 (stale) Mirror 30: 0x42d705e4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x42d705e4 (stale) Mirror 17: 0x42d705e4 (stale) Mirror 18: 0x42d705e4 (stale) Mirror 20: 0x42d705e4 (stale) Mirror 21: 0x42d705e4 (stale) Mirror 22: 0x42d705e4 (stale) Mirror 23: 0x42d705e4 (stale) Mirror 24: 0x42d705e4 (stale) Mirror 25: 0x42d705e4 (stale) Mirror 26: 0x42d705e4 (stale) Mirror 27: 0x42d705e4 (stale) Mirror 28: 0x42d705e4 (stale) Mirror 29: 0x42d705e4 (stale) Mirror 30: 0x42d705e4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000835 1786036991.575823 MIRROR_RESYNC 15 mirrors 000836 1786036995.631698 mapread 0x00529a thru 0x01007f (0xade6 bytes) 000837 1786036995.655514 mapwrite 0x00c38e thru 0x0122d1 (0x5f44 bytes) 000839 1786036995.889630 write 0x03e9e8 thru 0x03ffff (0x1618 bytes) 000840 1786036995.903400 write 0x00f2cd thru 0x016446 (0x717a bytes) 000841 1786036995.909747 mapwrite 0x01162f thru 0x0136d5 (0x20a7 bytes) 000845 1786036995.994264 write 0x03a3d9 thru 0x03ffff (0x5c27 bytes) 000846 1786036996.008120 write 0x02ae6a thru 0x02b380 (0x517 bytes) 000849 1786036996.027762 trunc from 0x040000 to 0x03b6eb (0x4914 bytes) 000851 1786036996.076257 trunc from 0x03b6ec to 0x0103e8 (0x2b303 bytes) 000853 1786036996.127973 mapwrite 0x007fcb thru 0x0103e2 (0x8418 bytes) 000856 1786036996.277065 read 0x001585 thru 0x002547 (0xfc3 bytes) 000857 1786036996.295956 write 0x014503 thru 0x021616 (0xd114 bytes) 000859 1786036996.302730 trunc from 0x021617 to 0x02e877 (0xd261 bytes) 000861 1786036996.372842 trunc from 0x02e878 to 0x0236b8 (0xb1bf bytes) 000862 1786036996.400629 write 0x01ea47 thru 0x02783a (0x8df4 bytes) 000863 1786036996.404508 write 0x03eb60 thru 0x03ffff (0x14a0 bytes) 000864 1786036996.406457 mapread 0x008d9b thru 0x00b534 (0x279a bytes) 000866 1786036996.413332 write 0x039707 thru 0x03d61f (0x3f19 bytes) 000868 1786036996.431754 mapread 0x000750 thru 0x003338 (0x2be9 bytes) 000870 1786036996.441570 mapread 0x02fafd thru 0x030f54 (0x1458 bytes) 000873 1786036996.454553 trunc from 0x040000 to 0x03142d (0xebd2 bytes) 000874 1786036996.477262 trunc from 0x03142e to 0x00e4c7 (0x22f66 bytes) 000875 1786036996.512465 MIRROR_SPLIT mirror 12 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x188:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe4c8): Mirror 11: 0x79cb4d2a (stale) Mirror 17: 0x79cb4d2a (stale) Mirror 18: 0x79cb4d2a (stale) Mirror 20: 0x79cb4d2a (stale) Mirror 21: 0x79cb4d2a (stale) Mirror 22: 0x79cb4d2a (stale) Mirror 23: 0x79cb4d2a (stale) Mirror 24: 0x79cb4d2a (stale) Mirror 25: 0x79cb4d2a (stale) Mirror 26: 0x79cb4d2a (stale) Mirror 27: 0x79cb4d2a (stale) Mirror 29: 0x79cb4d2a (stale) Mirror 30: 0x79cb4d2a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe4c8): Mirror 11: 0x79cb4d2a (stale) Mirror 17: 0x79cb4d2a (stale) Mirror 18: 0x79cb4d2a (stale) Mirror 20: 0x79cb4d2a (stale) Mirror 21: 0x79cb4d2a (stale) Mirror 22: 0x79cb4d2a (stale) Mirror 23: 0x79cb4d2a (stale) Mirror 24: 0x79cb4d2a (stale) Mirror 25: 0x79cb4d2a (stale) Mirror 26: 0x79cb4d2a (stale) Mirror 27: 0x79cb4d2a (stale) Mirror 29: 0x79cb4d2a (stale) Mirror 30: 0x79cb4d2a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe4c8: skipped 000876 1786036997.752858 mapwrite 0x028994 thru 0x03194d (0x8fba bytes) 000877 1786036997.955554 write 0x0346bd thru 0x037170 (0x2ab4 bytes) 000879 1786036997.957496 read 0x037049 thru 0x037170 (0x128 bytes) 000880 1786036997.958829 mapread 0x0059a9 thru 0x012d8e (0xd3e6 bytes) 000882 1786036997.978480 mapread 0x0185cd thru 0x01fc69 (0x769d bytes) 000883 1786036997.985450 trunc from 0x037171 to 0x0302f2 (0x6e7e bytes) 000887 1786036998.004011 mapwrite 0x0184e5 thru 0x019d10 (0x182c bytes) 000889 1786036998.043846 read 0x014a37 thru 0x01bf55 (0x751f bytes) 000891 1786036998.045236 read 0x00e002 thru 0x0122c5 (0x42c4 bytes) 000893 1786036998.055198 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x302f3): Mirror 11: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x302f3): Mirror 11: 0x74d2a93b (stale) Mirror 17: 0x74d2a93b (stale) Mirror 18: 0x74d2a93b (stale) Mirror 20: 0x74d2a93b (stale) Mirror 21: 0x74d2a93b (stale) Mirror 22: 0x74d2a93b (stale) Mirror 23: 0x74d2a93b (stale) Mirror 24: 0x74d2a93b (stale) Mirror 25: 0x74d2a93b (stale) Mirror 26: 0x74d2a93b (stale) Mirror 27: 0x74d2a93b (stale) Mirror 29: 0x74d2a93b (stale) Mirror 30: 0x74d2a93b (stale) CRC-32 checksum value for chunk [0, 0x302f3): Mirror 1: 0xae7505a9 Mirror 31: 0xae7505a9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x302f3: skipped 000896 1786036999.642065 write 0x005cee thru 0x00e526 (0x8839 bytes) 000897 1786036999.882970 mapwrite 0x01b98c thru 0x024258 (0x88cd bytes) 000898 1786036999.971803 write 0x0152ad thru 0x015a60 (0x7b4 bytes) 000899 1786036999.990560 read 0x00ecf2 thru 0x013254 (0x4563 bytes) 000900 1786037000.006352 trunc from 0x0302f3 to 0x02f870 (0xa82 bytes) 000901 1786037000.054296 mapwrite 0x03cfa6 thru 0x03e3e9 (0x1444 bytes) 000904 1786037000.124548 mapread 0x00d2b2 thru 0x015dd3 (0x8b22 bytes) 000906 1786037000.131612 trunc from 0x03e3ea to 0x02c2cf (0x1211a bytes) 000907 1786037000.157907 write 0x00f29e thru 0x00f672 (0x3d5 bytes) 000908 1786037000.159225 mapwrite 0x02b260 thru 0x03a4ad (0xf24e bytes) 000910 1786037000.263028 trunc from 0x03a4ae to 0x031049 (0x9464 bytes) 000914 1786037000.280968 read 0x015acc thru 0x01a127 (0x465c bytes) 000916 1786037000.282830 write 0x01ce3c thru 0x02129a (0x445f bytes) 000917 1786037000.284125 trunc from 0x03104a to 0x002de1 (0x2e268 bytes) 000918 1786037000.305235 MIRROR_SPLIT mirror 12 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x188:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2de2): Mirror 11: 0xa586fafb (stale) Mirror 17: 0xa586fafb (stale) Mirror 18: 0xa586fafb (stale) Mirror 20: 0xa586fafb (stale) Mirror 21: 0xa586fafb (stale) Mirror 22: 0xa586fafb (stale) Mirror 23: 0xa586fafb (stale) Mirror 24: 0xa586fafb (stale) Mirror 25: 0xa586fafb (stale) Mirror 26: 0xa586fafb (stale) Mirror 27: 0xa586fafb (stale) Mirror 30: 0xa586fafb (stale) Mirror 31: 0xa586fafb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2de2): Mirror 11: 0xa586fafb (stale) Mirror 17: 0xa586fafb (stale) Mirror 18: 0xa586fafb (stale) Mirror 20: 0xa586fafb (stale) Mirror 21: 0xa586fafb (stale) Mirror 22: 0xa586fafb (stale) Mirror 23: 0xa586fafb (stale) Mirror 24: 0xa586fafb (stale) Mirror 25: 0xa586fafb (stale) Mirror 26: 0xa586fafb (stale) Mirror 27: 0xa586fafb (stale) Mirror 30: 0xa586fafb (stale) Mirror 31: 0xa586fafb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2de2: skipped 000919 1786037000.935222 trunc from 0x002de2 to 0x01b62c (0x1884b bytes) 000920 1786037000.957876 mapread 0x01b494 thru 0x01b62c (0x199 bytes) 000921 1786037000.965053 read 0x0013fd thru 0x002612 (0x1216 bytes) 000922 1786037000.970873 mapread 0x008989 thru 0x00be7e (0x34f6 bytes) 000923 1786037000.986321 mapwrite 0x004c35 thru 0x008192 (0x355e bytes) 000924 1786037001.023897 mapread 0x015939 thru 0x01b62c (0x5cf4 bytes) 000926 1786037001.036898 read 0x00c35c thru 0x00eced (0x2992 bytes) 000927 1786037001.042464 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x1b62d): Mirror 11: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b62d): Mirror 11: 0xc3a31bad (stale) Mirror 17: 0xc3a31bad (stale) Mirror 18: 0xc3a31bad (stale) Mirror 20: 0xc3a31bad (stale) Mirror 21: 0xc3a31bad (stale) Mirror 22: 0xc3a31bad (stale) Mirror 23: 0xc3a31bad (stale) Mirror 24: 0xc3a31bad (stale) Mirror 25: 0xc3a31bad (stale) Mirror 26: 0xc3a31bad (stale) Mirror 27: 0xc3a31bad (stale) Mirror 30: 0xc3a31bad (stale) Mirror 31: 0xb07a9e6b (stale) CRC-32 checksum value for chunk [0, 0x1b62d): Mirror 1: 0xfd0e196d Mirror 32: 0xfd0e196d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b62d: skipped 000929 1786037002.739117 mapwrite 0x015c61 thru 0x021373 (0xb713 bytes) 000931 1786037003.049623 MIRROR_RESYNC 15 mirrors 000932 1786037006.138937 mapread 0x008d5c thru 0x00d943 (0x4be8 bytes) 000933 1786037006.167872 MIRROR_EXTEND to 16 mirrors 000934 1786037007.266990 read 0x01c12c thru 0x021373 (0x5248 bytes) 000936 1786037007.278496 mapwrite 0x004c3a thru 0x007f25 (0x32ec bytes) 000939 1786037007.452852 mapread 0x00cfe7 thru 0x015b17 (0x8b31 bytes) 000940 1786037007.463791 write 0x036b14 thru 0x03ccd1 (0x61be bytes) 000941 1786037007.465514 mapwrite 0x02d631 thru 0x038301 (0xacd1 bytes) 000942 1786037007.514163 write 0x025a58 thru 0x02b824 (0x5dcd bytes) 000944 1786037007.518530 read 0x00a543 thru 0x00baa5 (0x1563 bytes) 000945 1786037007.519181 read 0x01cfe1 thru 0x02bce2 (0xed02 bytes) 000947 1786037007.525689 mapread 0x00bc58 thru 0x01b6d0 (0xfa79 bytes) 000949 1786037007.527748 trunc from 0x03ccd2 to 0x0064a8 (0x36829 bytes) 000950 1786037007.554591 write 0x000987 thru 0x0081ad (0x7827 bytes) 000951 1786037007.555777 mapread 0x007ebf thru 0x0081ad (0x2ef bytes) 000952 1786037007.556615 trunc from 0x0081ae to 0x01f7d5 (0x17628 bytes) 000953 1786037007.569205 mapwrite 0x01f1b2 thru 0x0214a9 (0x22f8 bytes) 000954 1786037007.642030 MIRROR_SPLIT mirror 7 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x188:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x214aa): Mirror 11: 0x57680e12 (stale) Mirror 17: 0x57680e12 (stale) Mirror 18: 0x57680e12 (stale) Mirror 20: 0x57680e12 (stale) Mirror 21: 0x57680e12 (stale) Mirror 22: 0x57680e12 (stale) Mirror 24: 0x57680e12 (stale) Mirror 25: 0x57680e12 (stale) Mirror 26: 0x57680e12 (stale) Mirror 27: 0x57680e12 (stale) Mirror 30: 0x57680e12 (stale) Mirror 31: 0x57680e12 (stale) Mirror 32: 0x57680e12 (stale) Mirror 33: 0x57680e12 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x214aa): Mirror 11: 0x57680e12 (stale) Mirror 17: 0x57680e12 (stale) Mirror 18: 0x57680e12 (stale) Mirror 20: 0x57680e12 (stale) Mirror 21: 0x57680e12 (stale) Mirror 22: 0x57680e12 (stale) Mirror 24: 0x57680e12 (stale) Mirror 25: 0x57680e12 (stale) Mirror 26: 0x57680e12 (stale) Mirror 27: 0x57680e12 (stale) Mirror 30: 0x57680e12 (stale) Mirror 31: 0x57680e12 (stale) Mirror 32: 0x57680e12 (stale) Mirror 33: 0x57680e12 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x214aa: skipped 000956 1786037008.476820 read 0x0089a0 thru 0x00e5f5 (0x5c56 bytes) 000958 1786037008.490817 write 0x013453 thru 0x01892b (0x54d9 bytes) 000959 1786037008.502863 read 0x00cedf thru 0x00d469 (0x58b bytes) 000961 1786037008.504433 read 0x009f33 thru 0x00ed8b (0x4e59 bytes) 000963 1786037008.511076 mapread 0x016880 thru 0x0198c4 (0x3045 bytes) 000964 1786037008.524897 mapread 0x00d087 thru 0x00e9fd (0x1977 bytes) 000965 1786037008.534127 MIRROR_SPLIT mirror 5 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x188:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x214aa): Mirror 11: 0x57680e12 (stale) Mirror 17: 0x57680e12 (stale) Mirror 18: 0x57680e12 (stale) Mirror 20: 0x57680e12 (stale) Mirror 22: 0x57680e12 (stale) Mirror 24: 0x57680e12 (stale) Mirror 25: 0x57680e12 (stale) Mirror 26: 0x57680e12 (stale) Mirror 27: 0x57680e12 (stale) Mirror 30: 0x57680e12 (stale) Mirror 31: 0x57680e12 (stale) Mirror 32: 0x57680e12 (stale) Mirror 33: 0x57680e12 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x214aa): Mirror 11: 0x57680e12 (stale) Mirror 17: 0x57680e12 (stale) Mirror 18: 0x57680e12 (stale) Mirror 20: 0x57680e12 (stale) Mirror 22: 0x57680e12 (stale) Mirror 24: 0x57680e12 (stale) Mirror 25: 0x57680e12 (stale) Mirror 26: 0x57680e12 (stale) Mirror 27: 0x57680e12 (stale) Mirror 30: 0x57680e12 (stale) Mirror 31: 0x57680e12 (stale) Mirror 32: 0x57680e12 (stale) Mirror 33: 0x57680e12 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x214aa: skipped 000966 1786037009.670052 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x214aa): Mirror 11: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x214aa): Mirror 11: 0x57680e12 (stale) Mirror 17: 0x57680e12 (stale) Mirror 18: 0x57680e12 (stale) Mirror 20: 0x57680e12 (stale) Mirror 22: 0x57680e12 (stale) Mirror 24: 0x57680e12 (stale) Mirror 25: 0x57680e12 (stale) Mirror 26: 0x57680e12 (stale) Mirror 27: 0x57680e12 (stale) Mirror 30: 0x57680e12 (stale) Mirror 31: 0x57680e12 (stale) Mirror 32: 0x57680e12 (stale) Mirror 33: 0x57680e12 (stale) CRC-32 checksum value for chunk [0, 0x214aa): Mirror 1: 0x9d51116f Mirror 34: 0x9d51116f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x214aa: skipped 000967 1786037011.607203 trunc from 0x0214aa to 0x03471f (0x13276 bytes) 000970 1786037011.790770 read 0x01d960 thru 0x024a13 (0x70b4 bytes) 000972 1786037011.816150 read 0x023c0e thru 0x02f679 (0xba6c bytes) 000973 1786037011.829166 read 0x0052a1 thru 0x00eb70 (0x98d0 bytes) 000974 1786037011.830194 read 0x029f7d thru 0x02d306 (0x338a bytes) 000975 1786037011.831791 mapwrite 0x02c536 thru 0x036c09 (0xa6d4 bytes) 000976 1786037011.969492 MIRROR_SPLIT mirror 11 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x188:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36c0a): Mirror 11: 0xb01676d6 (stale) Mirror 17: 0xb01676d6 (stale) Mirror 18: 0xb01676d6 (stale) Mirror 20: 0xb01676d6 (stale) Mirror 22: 0xb01676d6 (stale) Mirror 24: 0xb01676d6 (stale) Mirror 25: 0xb01676d6 (stale) Mirror 26: 0xb01676d6 (stale) Mirror 27: 0xb01676d6 (stale) Mirror 30: 0xb01676d6 (stale) Mirror 32: 0xb01676d6 (stale) Mirror 33: 0xb01676d6 (stale) Mirror 34: 0x7f5d927d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36c0a): Mirror 11: 0xb01676d6 (stale) Mirror 17: 0xb01676d6 (stale) Mirror 18: 0xb01676d6 (stale) Mirror 20: 0xb01676d6 (stale) Mirror 22: 0xb01676d6 (stale) Mirror 24: 0xb01676d6 (stale) Mirror 25: 0xb01676d6 (stale) Mirror 26: 0xb01676d6 (stale) Mirror 27: 0xb01676d6 (stale) Mirror 30: 0xb01676d6 (stale) Mirror 32: 0xb01676d6 (stale) Mirror 33: 0xb01676d6 (stale) Mirror 34: 0x7f5d927d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36c0a: skipped 000977 1786037012.794098 MIRROR_RESYNC 14 mirrors 000982 1786037015.461381 MIRROR_EXTEND to 15 mirrors 000983 1786037016.722022 mapwrite 0x026edc thru 0x027cf4 (0xe19 bytes) 000984 1786037016.992764 mapwrite 0x022d53 thru 0x032836 (0xfae4 bytes) 000985 1786037017.059339 mapwrite 0x0034d7 thru 0x00ca33 (0x955d bytes) 000986 1786037017.118566 mapwrite 0x016e21 thru 0x01de5a (0x703a bytes) 000992 1786037017.237443 mapwrite 0x026d90 thru 0x034dc4 (0xe035 bytes) 000996 1786037017.322834 write 0x02a2b9 thru 0x03252d (0x8275 bytes) 000998 1786037017.330506 MIRROR_RESYNC 15 mirrors All operations completed A-OK!