== sanity-flr test 70a: flr mode fsx test ================ 00:06:40 (1781237200) Seed set to 7202 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1781237202.527326 MIRROR_EXTEND to 2 mirrors truncating to largest ever: 0x3fd5b 000002 1781237203.069993 trunc from 00000000 to 0x03fd5a (0x3fd5b bytes) 000003 1781237203.206386 trunc from 0x03fd5b to 0x00314a (0x3cc10 bytes) 000004 1781237203.255265 read 0x0007ce thru 0x00314a (0x297d bytes) 000005 1781237203.270409 write 0x00daac thru 0x010401 (0x2956 bytes) 000009 1781237203.294883 MIRROR_RESYNC 2 mirrors 000010 1781237204.146648 MIRROR_EXTEND to 3 mirrors 000011 1781237204.937164 mapread 0x007d26 thru 0x010401 (0x86dc bytes) 000012 1781237204.956876 MIRROR_RESYNC 3 mirrors 000013 1781237205.272437 mapread 0x00aabe thru 0x010401 (0x5944 bytes) 000014 1781237205.274254 read 0x0087df thru 0x010401 (0x7c23 bytes) 000015 1781237205.279549 MIRROR_RESYNC 3 mirrors 000016 1781237205.540979 mapread 0x00c434 thru 0x01014c (0x3d19 bytes) 000020 1781237205.543456 mapread 0x00e8a7 thru 0x010401 (0x1b5b bytes) 000021 1781237205.544917 trunc from 0x010402 to 0x02e52d (0x1e12c bytes) 000022 1781237205.623521 write 0x00ae4f thru 0x00b8c2 (0xa74 bytes) 000023 1781237205.630169 mapread 0x022584 thru 0x0290a2 (0x6b1f bytes) 000025 1781237205.643310 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2e52e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e52e): Mirror 2: 0x11e4d59c (stale) Mirror 3: 0x11e4d59c (stale) CRC-32 checksum value for chunk [0, 0x2e52e): Mirror 1: 0x54da8e00 Mirror 4: 0x54da8e00 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e52e: skipped 000026 1781237206.275366 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e52e): Mirror 3: 0x11e4d59c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e52e): Mirror 3: 0x11e4d59c (stale) CRC-32 checksum value for chunk [0, 0x2e52e): Mirror 1: 0x54da8e00 Mirror 4: 0x54da8e00 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e52e: skipped 000027 1781237206.723316 mapwrite 0x037c2a thru 0x03ffff (0x83d6 bytes) 000028 1781237206.931588 write 0x0157a4 thru 0x02032f (0xab8c bytes) 000030 1781237206.951695 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x3bc7a0dc (stale) Mirror 4: 0x3125ae91 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x63441077 Mirror 5: 0x63441077 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000031 1781237207.732630 mapread 0x01a7db thru 0x0220d5 (0x78fb bytes) 000035 1781237207.748724 write 0x03830b thru 0x03ffff (0x7cf5 bytes) 000037 1781237207.825314 read 0x034d33 thru 0x03a905 (0x5bd3 bytes) 000039 1781237207.830839 mapwrite 0x03dcb4 thru 0x03ffff (0x234c bytes) 000040 1781237207.908795 MIRROR_RESYNC 4 mirrors 000041 1781237208.554004 trunc from 0x040000 to 0x035080 (0xaf7f bytes) 000045 1781237208.610992 MIRROR_RESYNC 4 mirrors 000046 1781237209.074550 MIRROR_RESYNC 4 mirrors 000047 1781237209.428234 trunc from 0x035081 to 0x021f1a (0x13166 bytes) 000049 1781237209.580931 trunc from 0x021f1b to 0x03e2a0 (0x1c386 bytes) 000050 1781237209.636242 trunc from 0x03e2a1 to 0x005445 (0x38e5b bytes) 000051 1781237209.670240 read 0x00100c thru 0x005445 (0x443a bytes) 000052 1781237209.685369 write 0x0386a4 thru 0x03ce25 (0x4782 bytes) 000053 1781237209.686755 write 0x036302 thru 0x03f2dd (0x8fdc bytes) 000057 1781237209.701175 read 0x00bad5 thru 0x013c1a (0x8146 bytes) 000059 1781237209.729693 read 0x01b89a thru 0x02643e (0xaba5 bytes) 000063 1781237209.738664 mapread 0x01fb07 thru 0x020e1e (0x1318 bytes) 000065 1781237209.761027 MIRROR_RESYNC 4 mirrors 000066 1781237210.785610 mapread 0x036b29 thru 0x03d7d9 (0x6cb1 bytes) 000067 1781237210.813930 mapread 0x0055f0 thru 0x0104b5 (0xaec6 bytes) 000070 1781237210.832990 trunc from 0x03f2de to 0x01542c (0x29eb1 bytes) 000071 1781237211.040459 mapwrite 0x0298ac thru 0x02a371 (0xac6 bytes) 000073 1781237211.264361 write 0x01e12b thru 0x02a7f7 (0xc6cd bytes) 000074 1781237211.280144 read 0x00b062 thru 0x00f7a9 (0x4748 bytes) 000075 1781237211.330327 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a7f8): Mirror 3: 0xb6626d80 (stale) Mirror 4: 0xb6626d80 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a7f8): Mirror 3: 0xb6626d80 (stale) Mirror 4: 0xb6626d80 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a7f8: skipped 000076 1781237211.903883 trunc from 0x02a7f8 to 0x033e4a (0x9653 bytes) 000077 1781237211.925641 trunc from 0x033e4b to 0x02375b (0x106ef bytes) 000078 1781237211.961956 trunc from 0x02375c to 0x02c4ca (0x8d6f bytes) 000079 1781237211.983137 mapread 0x00e7b8 thru 0x012364 (0x3bad bytes) 000080 1781237212.010526 MIRROR_RESYNC 3 mirrors 000081 1781237213.012091 MIRROR_EXTEND to 4 mirrors 000082 1781237213.836006 read 0x026f6c thru 0x02a720 (0x37b5 bytes) 000083 1781237213.846586 mapwrite 0x01a59a thru 0x01d4a9 (0x2f10 bytes) 000084 1781237214.092949 read 0x022221 thru 0x024be6 (0x29c6 bytes) 000085 1781237214.110969 write 0x02c35f thru 0x02f01b (0x2cbd bytes) 000087 1781237214.112211 mapread 0x02851d thru 0x029802 (0x12e6 bytes) 000088 1781237214.113218 mapwrite 0x006608 thru 0x014005 (0xd9fe bytes) 000089 1781237214.230577 mapread 0x003b4a thru 0x012259 (0xe710 bytes) 000090 1781237214.238986 MIRROR_RESYNC 4 mirrors 000092 1781237215.278490 trunc from 0x02f01c to 0x017878 (0x177a3 bytes) 000093 1781237215.418678 read 0x01745d thru 0x017878 (0x41c bytes) 000095 1781237215.425956 trunc from 0x017879 to 0x03ee3d (0x275c5 bytes) 000098 1781237215.451398 mapwrite 0x02873d thru 0x02ddd2 (0x5696 bytes) 000099 1781237215.600505 mapwrite 0x039636 thru 0x03ffff (0x69ca bytes) 000102 1781237215.703679 mapread 0x00ed1f thru 0x0178f9 (0x8bdb bytes) 000103 1781237215.723096 write 0x0126ad thru 0x0131a4 (0xaf8 bytes) 000104 1781237215.726546 read 0x01eb9b thru 0x0235f5 (0x4a5b bytes) 000105 1781237215.739041 mapread 0x007495 thru 0x01265f (0xb1cb bytes) 000107 1781237215.741155 mapread 0x02f36e thru 0x033592 (0x4225 bytes) 000109 1781237215.745702 write 0x01c475 thru 0x024d77 (0x8903 bytes) 000113 1781237215.754555 read 0x026d53 thru 0x02a4d7 (0x3785 bytes) 000114 1781237215.757788 mapread 0x02fd66 thru 0x03083c (0xad7 bytes) 000115 1781237215.762085 mapwrite 0x0055c8 thru 0x00f0c7 (0x9b00 bytes) 000116 1781237215.854095 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xb6cc0ad8 (stale) Mirror 4: 0xb6cc0ad8 (stale) Mirror 5: 0xb6cc0ad8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x496fe8c3 Mirror 6: 0x496fe8c3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000117 1781237216.819911 MIRROR_RESYNC 5 mirrors 000118 1781237218.301850 mapread 0x01399f thru 0x01b37c (0x79de bytes) 000119 1781237218.339997 trunc from 0x040000 to 0x00b508 (0x34af7 bytes) 000120 1781237218.501215 write 0x02e753 thru 0x0387a7 (0xa055 bytes) 000122 1781237218.507119 read 0x01b4af thru 0x021a61 (0x65b3 bytes) 000126 1781237218.522482 mapread 0x008f4a thru 0x017e67 (0xef1e bytes) 000127 1781237218.558719 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x387a8): Mirror 4: 0x1809beec (stale) Mirror 5: 0x1809beec (stale) Mirror 6: 0x1809beec (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x387a8): Mirror 4: 0x1809beec (stale) Mirror 5: 0x1809beec (stale) Mirror 6: 0x1809beec (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x387a8: skipped 000128 1781237219.057909 trunc from 0x0387a8 to 0x00f6f1 (0x290b6 bytes) 000129 1781237219.072042 read 0x00c5c6 thru 0x00cbf6 (0x631 bytes) 000130 1781237219.076800 trunc from 0x00f6f2 to 0x03d7c9 (0x2e0d8 bytes) 000133 1781237219.095202 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3d7ca): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d7ca): Mirror 4: 0xf2d0db21 (stale) Mirror 5: 0xf2d0db21 (stale) Mirror 6: 0xf2d0db21 (stale) CRC-32 checksum value for chunk [0, 0x3d7ca): Mirror 1: 0xdaf74479 Mirror 7: 0xdaf74479 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d7ca: skipped 000135 1781237220.033892 mapread 0x03679e thru 0x03cee6 (0x6749 bytes) 000138 1781237220.051924 write 0x00f8c3 thru 0x016311 (0x6a4f bytes) 000139 1781237220.145048 trunc from 0x03d7ca to 0x025c6d (0x17b5c bytes) 000140 1781237220.250583 read 0x01ed04 thru 0x021f04 (0x3201 bytes) 000144 1781237220.281863 mapread 0x015066 thru 0x01be88 (0x6e23 bytes) 000146 1781237220.308474 mapread 0x009665 thru 0x0186f8 (0xf094 bytes) 000149 1781237220.315455 write 0x01973c thru 0x0229f7 (0x92bc bytes) 000150 1781237220.339392 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x25c6e): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25c6e): Mirror 4: 0x7bb49a76 (stale) Mirror 5: 0x7bb49a76 (stale) Mirror 6: 0x7bb49a76 (stale) Mirror 7: 0xd801cc00 (stale) CRC-32 checksum value for chunk [0, 0x25c6e): Mirror 1: 0xff89275b Mirror 8: 0xff89275b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25c6e: skipped 000151 1781237221.363937 trunc from 0x025c6e to 0x001b50 (0x2411d bytes) 000152 1781237221.497903 trunc from 0x001b51 to 0x01442b (0x128db bytes) 000153 1781237221.522468 trunc from 0x01442c to 0x01aeae (0x6a83 bytes) 000154 1781237221.552851 MIRROR_RESYNC 6 mirrors 000155 1781237222.739832 read 0x013120 thru 0x0193e4 (0x62c5 bytes) 000157 1781237222.749580 write 0x012bca thru 0x01e851 (0xbc88 bytes) 000158 1781237222.866472 MIRROR_RESYNC 6 mirrors 000159 1781237223.737502 mapread 0x01c232 thru 0x01e851 (0x2620 bytes) 000160 1781237223.756503 trunc from 0x01e852 to 0x01533a (0x9517 bytes) 000161 1781237223.844889 read 0x00128e thru 0x007a9f (0x6812 bytes) 000164 1781237223.859918 trunc from 0x01533b to 0x00a1dd (0xb15d bytes) 000166 1781237223.881521 mapwrite 0x015190 thru 0x016b86 (0x19f7 bytes) 000168 1781237223.959290 mapread 0x00a3ab thru 0x00b965 (0x15bb bytes) 000169 1781237223.970815 mapwrite 0x027dbb thru 0x030958 (0x8b9e bytes) 000170 1781237224.063472 trunc from 0x030959 to 0x036ccc (0x6374 bytes) 000171 1781237224.085658 MIRROR_RESYNC 6 mirrors 000172 1781237225.131815 MIRROR_EXTEND to 7 mirrors 000173 1781237226.201228 mapwrite 0x02b096 thru 0x03045e (0x53c9 bytes) 000175 1781237226.432765 trunc from 0x036ccd to 0x035d3f (0xf8d bytes) 000176 1781237226.461583 read 0x004abf thru 0x01108e (0xc5d0 bytes) 000177 1781237226.470682 trunc from 0x035d40 to 0x00e62c (0x27713 bytes) 000178 1781237226.488709 mapwrite 0x01f362 thru 0x028d2d (0x99cc bytes) 000179 1781237226.594040 mapwrite 0x02449e thru 0x027113 (0x2c76 bytes) 000180 1781237226.639846 write 0x009a1c thru 0x016342 (0xc927 bytes) 000181 1781237226.648096 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x28d2e): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28d2e): Mirror 4: 0xc7c62766 (stale) Mirror 5: 0xc7c62766 (stale) Mirror 6: 0xc7c62766 (stale) Mirror 7: 0xc7c62766 (stale) Mirror 8: 0xc7c62766 (stale) Mirror 9: 0xc7c62766 (stale) CRC-32 checksum value for chunk [0, 0x28d2e): Mirror 1: 0xd914692d Mirror 10: 0xd914692d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28d2e: skipped 000183 1781237227.721030 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x28d2e): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28d2e): Mirror 4: 0xc7c62766 (stale) Mirror 5: 0xc7c62766 (stale) Mirror 6: 0xc7c62766 (stale) Mirror 7: 0xc7c62766 (stale) Mirror 8: 0xc7c62766 (stale) Mirror 9: 0xc7c62766 (stale) CRC-32 checksum value for chunk [0, 0x28d2e): Mirror 1: 0xd914692d Mirror 10: 0xd914692d Mirror 11: 0xd914692d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28d2e: skipped 000186 1781237228.603629 read 0x00ab39 thru 0x00c8e5 (0x1dad bytes) 000187 1781237228.609792 mapwrite 0x022ed2 thru 0x025404 (0x2533 bytes) 000192 1781237228.768036 mapread 0x0214e4 thru 0x028d2d (0x784a bytes) 000193 1781237228.775413 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28d2e): Mirror 4: 0xc7c62766 (stale) Mirror 5: 0xc7c62766 (stale) Mirror 6: 0xc7c62766 (stale) Mirror 8: 0xc7c62766 (stale) Mirror 9: 0xc7c62766 (stale) Mirror 10: 0xd914692d (stale) Mirror 11: 0xd914692d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28d2e): Mirror 4: 0xc7c62766 (stale) Mirror 5: 0xc7c62766 (stale) Mirror 6: 0xc7c62766 (stale) Mirror 8: 0xc7c62766 (stale) Mirror 9: 0xc7c62766 (stale) Mirror 10: 0xd914692d (stale) Mirror 11: 0xd914692d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28d2e: skipped 000194 1781237229.392310 mapwrite 0x01fbc5 thru 0x020191 (0x5cd bytes) 000196 1781237229.444377 mapread 0x0102c0 thru 0x01c4d4 (0xc215 bytes) 000197 1781237229.459422 write 0x0307b4 thru 0x034714 (0x3f61 bytes) 000198 1781237229.460900 mapread 0x01843c thru 0x022288 (0x9e4d bytes) 000200 1781237229.470619 trunc from 0x034715 to 0x03a534 (0x5e20 bytes) 000201 1781237229.489033 read 0x00e9b2 thru 0x012453 (0x3aa2 bytes) 000202 1781237229.489781 write 0x01f922 thru 0x020d22 (0x1401 bytes) 000204 1781237229.497216 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3a535): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a535): Mirror 4: 0xcbdd6ba2 (stale) Mirror 5: 0xcbdd6ba2 (stale) Mirror 6: 0xcbdd6ba2 (stale) Mirror 8: 0xcbdd6ba2 (stale) Mirror 9: 0xcbdd6ba2 (stale) Mirror 10: 0xc1cac55e (stale) Mirror 11: 0xc1cac55e (stale) CRC-32 checksum value for chunk [0, 0x3a535): Mirror 1: 0x9d7c2d2e Mirror 12: 0x9d7c2d2e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a535: skipped 000208 1781237230.661215 mapwrite 0x02f798 thru 0x033f9b (0x4804 bytes) 000209 1781237230.991464 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a535): Mirror 4: 0xcbdd6ba2 (stale) Mirror 5: 0xcbdd6ba2 (stale) Mirror 8: 0xcbdd6ba2 (stale) Mirror 9: 0xcbdd6ba2 (stale) Mirror 10: 0xc1cac55e (stale) Mirror 11: 0xc1cac55e (stale) Mirror 12: 0x9d7c2d2e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a535): Mirror 4: 0xcbdd6ba2 (stale) Mirror 5: 0xcbdd6ba2 (stale) Mirror 8: 0xcbdd6ba2 (stale) Mirror 9: 0xcbdd6ba2 (stale) Mirror 10: 0xc1cac55e (stale) Mirror 11: 0xc1cac55e (stale) Mirror 12: 0x9d7c2d2e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a535: skipped 000212 1781237231.492823 mapread 0x029aaa thru 0x030c21 (0x7178 bytes) 000216 1781237231.518279 trunc from 0x03a535 to 0x03a2da (0x25a bytes) 000218 1781237231.558120 mapwrite 0x02c5ce thru 0x02e563 (0x1f96 bytes) 000219 1781237231.629143 read 0x02cb90 thru 0x032aa1 (0x5f12 bytes) 000220 1781237231.645418 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a2db): Mirror 4: 0xcd29f10b (stale) Mirror 5: 0xcd29f10b (stale) Mirror 8: 0xcd29f10b (stale) Mirror 9: 0xcd29f10b (stale) Mirror 10: 0x32aa2d70 (stale) Mirror 12: 0xd6bd533c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a2db): Mirror 4: 0xcd29f10b (stale) Mirror 5: 0xcd29f10b (stale) Mirror 8: 0xcd29f10b (stale) Mirror 9: 0xcd29f10b (stale) Mirror 10: 0x32aa2d70 (stale) Mirror 12: 0xd6bd533c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a2db: skipped 000222 1781237232.092696 write 0x02ea7d thru 0x032403 (0x3987 bytes) 000224 1781237232.116150 read 0x013b05 thru 0x0218dd (0xddd9 bytes) 000225 1781237232.130649 read 0x00d076 thru 0x019b27 (0xcab2 bytes) 000227 1781237232.149282 mapread 0x00de7e thru 0x01a074 (0xc1f7 bytes) 000228 1781237232.150542 mapread 0x0259a6 thru 0x031433 (0xba8e bytes) 000229 1781237232.154616 write 0x02bbd7 thru 0x03666e (0xaa98 bytes) 000231 1781237232.168714 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3a2db): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a2db): Mirror 4: 0xcd29f10b (stale) Mirror 5: 0xcd29f10b (stale) Mirror 8: 0xcd29f10b (stale) Mirror 9: 0xcd29f10b (stale) Mirror 10: 0x32aa2d70 (stale) Mirror 12: 0xd6bd533c (stale) CRC-32 checksum value for chunk [0, 0x3a2db): Mirror 1: 0x68fa5430 Mirror 13: 0x68fa5430 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a2db: skipped 000233 1781237233.486501 mapread 0x02ddad thru 0x032184 (0x43d8 bytes) 000237 1781237233.507435 mapwrite 0x01b642 thru 0x01ddc5 (0x2784 bytes) 000238 1781237233.659856 mapwrite 0x00c1e7 thru 0x01a1eb (0xe005 bytes) 000243 1781237233.764928 read 0x01f34d thru 0x020d9f (0x1a53 bytes) 000245 1781237233.771737 MIRROR_RESYNC 8 mirrors 000246 1781237235.268582 write 0x003d68 thru 0x0132de (0xf577 bytes) 000247 1781237235.365804 mapread 0x01b2f6 thru 0x01e22b (0x2f36 bytes) 000248 1781237235.373975 read 0x02dbaa thru 0x03a2da (0xc731 bytes) 000252 1781237235.385955 read 0x01cc5f thru 0x027a12 (0xadb4 bytes) 000253 1781237235.394200 trunc from 0x03a2db to 0x00be3d (0x2e49d bytes) 000254 1781237235.408427 trunc from 0x00be3e to 0x0012d5 (0xab68 bytes) 000255 1781237235.421977 read 0x0001cb thru 0x0012d5 (0x110b bytes) 000256 1781237235.422559 write 0x031902 thru 0x03467f (0x2d7e bytes) 000260 1781237235.424933 trunc from 0x034680 to 0x012b7e (0x21b01 bytes) 000261 1781237235.436044 write 0x033aea thru 0x03ffff (0xc516 bytes) 000262 1781237235.444578 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x3cdb497 (stale) Mirror 8: 0x3cdb497 (stale) Mirror 9: 0x3cdb497 (stale) Mirror 10: 0x3cdb497 (stale) Mirror 12: 0x3cdb497 (stale) Mirror 13: 0x3cdb497 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x3cdb497 (stale) Mirror 8: 0x3cdb497 (stale) Mirror 9: 0x3cdb497 (stale) Mirror 10: 0x3cdb497 (stale) Mirror 12: 0x3cdb497 (stale) Mirror 13: 0x3cdb497 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000263 1781237235.839482 trunc from 0x040000 to 0x0061ec (0x39e13 bytes) 000264 1781237235.855168 mapread 0x004e94 thru 0x006055 (0x11c2 bytes) 000266 1781237235.878103 MIRROR_RESYNC 7 mirrors 000268 1781237237.042484 MIRROR_RESYNC 7 mirrors 000269 1781237237.461674 MIRROR_RESYNC 7 mirrors 000270 1781237237.852414 read 0x004bc4 thru 0x0061ec (0x1629 bytes) 000272 1781237237.861296 trunc from 0x0061ed to 0x037e8c (0x31ca0 bytes) 000275 1781237237.944779 trunc from 0x037e8d to 0x032181 (0x5d0b bytes) 000277 1781237237.979504 MIRROR_RESYNC 7 mirrors 000279 1781237238.956487 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) 000280 1781237239.302425 read 0x005dd4 thru 0x012087 (0xc2b4 bytes) 000281 1781237239.312273 trunc from 0x032182 to 0x02ecef (0x3492 bytes) 000282 1781237239.387487 trunc from 0x02ecf0 to 0x003123 (0x2bbcc bytes) 000284 1781237239.407192 mapwrite 0x014f3a thru 0x0183a7 (0x346e bytes) 000285 1781237239.499579 mapread 0x017287 thru 0x0183a7 (0x1121 bytes) 000286 1781237239.501338 mapwrite 0x0061e9 thru 0x015424 (0xf23c bytes) 000287 1781237239.555243 write 0x02c2a5 thru 0x034bcb (0x8927 bytes) 000288 1781237239.556968 read 0x0191fd thru 0x01f7e1 (0x65e5 bytes) 000289 1781237239.565371 write 0x026723 thru 0x0308da (0xa1b8 bytes) 000291 1781237239.569183 write 0x00508f thru 0x00ef9b (0x9f0d bytes) 000292 1781237239.571166 trunc from 0x034bcc to 0x019897 (0x1b334 bytes) 000293 1781237239.590148 mapread 0x000e2f thru 0x003bde (0x2db0 bytes) 000294 1781237239.591545 mapread 0x00afb3 thru 0x017df7 (0xce45 bytes) 000295 1781237239.593721 mapread 0x011002 thru 0x019897 (0x8896 bytes) 000298 1781237239.596680 trunc from 0x019898 to 0x020f9e (0x7707 bytes) 000299 1781237239.612119 read 0x0168fb thru 0x019dca (0x34d0 bytes) 000300 1781237239.618181 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x20f9f): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20f9f): Mirror 5: 0xfd5c5807 (stale) Mirror 8: 0xfd5c5807 (stale) Mirror 9: 0xfd5c5807 (stale) Mirror 10: 0xfd5c5807 (stale) Mirror 12: 0xfd5c5807 (stale) CRC-32 checksum value for chunk [0, 0x20f9f): Mirror 1: 0x800428ac Mirror 13: 0x800428ac lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20f9f: skipped 000303 1781237240.389640 mapwrite 0x02dec6 thru 0x03342f (0x556a bytes) 000304 1781237240.620331 MIRROR_RESYNC 7 mirrors 000305 1781237242.330230 mapread 0x03192a thru 0x03342f (0x1b06 bytes) 000306 1781237242.367731 write 0x008a62 thru 0x00eb6b (0x610a bytes) 000307 1781237242.465955 read 0x0319d2 thru 0x03342f (0x1a5e bytes) 000308 1781237242.475015 read 0x02f03b thru 0x03293e (0x3904 bytes) 000309 1781237242.487010 write 0x026f52 thru 0x029468 (0x2517 bytes) 000310 1781237242.488499 write 0x03cf1c thru 0x03ffff (0x30e4 bytes) 000311 1781237242.490213 trunc from 0x040000 to 0x018355 (0x27caa bytes) 000315 1781237242.537199 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x18356): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18356): Mirror 5: 0xbfccb876 (stale) Mirror 8: 0xbfccb876 (stale) Mirror 9: 0xbfccb876 (stale) Mirror 10: 0xbfccb876 (stale) Mirror 12: 0xbfccb876 (stale) Mirror 13: 0xbfccb876 (stale) CRC-32 checksum value for chunk [0, 0x18356): Mirror 1: 0xe129802e Mirror 14: 0xe129802e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18356: skipped 000317 1781237243.452605 mapwrite 0x01deb9 thru 0x025b3c (0x7c84 bytes) 000318 1781237243.683967 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25b3d): Mirror 8: 0xd82051c4 (stale) Mirror 9: 0xd82051c4 (stale) Mirror 10: 0xd82051c4 (stale) Mirror 12: 0xd82051c4 (stale) Mirror 13: 0xd82051c4 (stale) Mirror 14: 0xeb258048 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25b3d): Mirror 8: 0xd82051c4 (stale) Mirror 9: 0xd82051c4 (stale) Mirror 10: 0xd82051c4 (stale) Mirror 12: 0xd82051c4 (stale) Mirror 13: 0xd82051c4 (stale) Mirror 14: 0xeb258048 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25b3d: skipped 000319 1781237244.111247 read 0x004804 thru 0x006c3f (0x243c bytes) 000323 1781237244.129911 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25b3d): Mirror 8: 0xd82051c4 (stale) Mirror 9: 0xd82051c4 (stale) Mirror 10: 0xd82051c4 (stale) Mirror 12: 0xd82051c4 (stale) Mirror 14: 0xeb258048 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25b3d): Mirror 8: 0xd82051c4 (stale) Mirror 9: 0xd82051c4 (stale) Mirror 10: 0xd82051c4 (stale) Mirror 12: 0xd82051c4 (stale) Mirror 14: 0xeb258048 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25b3d: skipped 000324 1781237244.591438 mapwrite 0x01e0ad thru 0x028a8e (0xa9e2 bytes) 000325 1781237244.673892 trunc from 0x028a8f to 0x0074e7 (0x215a7 bytes) 000327 1781237244.689429 trunc from 0x0074e8 to 0x02131a (0x19e33 bytes) 000328 1781237244.702857 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2131b): Mirror 8: 0xd584f3c2 (stale) Mirror 9: 0xd584f3c2 (stale) Mirror 10: 0xd584f3c2 (stale) Mirror 12: 0xd584f3c2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2131b): Mirror 8: 0xd584f3c2 (stale) Mirror 9: 0xd584f3c2 (stale) Mirror 10: 0xd584f3c2 (stale) Mirror 12: 0xd584f3c2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2131b: skipped 000329 1781237245.030149 write 0x03c12e thru 0x03ffff (0x3ed2 bytes) 000332 1781237245.034784 write 0x010720 thru 0x011cf4 (0x15d5 bytes) 000333 1781237245.044481 read 0x03b37c thru 0x03ffff (0x4c84 bytes) 000334 1781237245.050889 trunc from 0x040000 to 0x01ead9 (0x21526 bytes) 000335 1781237245.066729 write 0x0269e5 thru 0x034973 (0xdf8f bytes) 000338 1781237245.070638 write 0x033902 thru 0x03765f (0x3d5e bytes) 000339 1781237245.076655 MIRROR_RESYNC 5 mirrors 000341 1781237245.898413 MIRROR_EXTEND to 6 mirrors 000347 1781237246.440170 MIRROR_RESYNC 6 mirrors 000349 1781237246.844342 read 0x018850 thru 0x01eb12 (0x62c3 bytes) 000351 1781237246.853613 mapread 0x00e5af thru 0x00fd0f (0x1761 bytes) 000352 1781237246.863329 write 0x03ae28 thru 0x03ffff (0x51d8 bytes) 000356 1781237246.938165 trunc from 0x040000 to 0x003a67 (0x3c598 bytes) 000357 1781237246.953398 write 0x033e5f thru 0x03ffff (0xc1a1 bytes) 000359 1781237246.954966 read 0x019c86 thru 0x026227 (0xc5a2 bytes) 000360 1781237246.964377 MIRROR_RESYNC 6 mirrors 000361 1781237247.872699 mapwrite 0x02b848 thru 0x02e71a (0x2ed3 bytes) 000362 1781237248.124602 mapread 0x02f0a3 thru 0x03e6ba (0xf618 bytes) 000364 1781237248.143642 read 0x03ebbe thru 0x03ffff (0x1442 bytes) 000365 1781237248.153959 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x4e3440c9 (stale) Mirror 10: 0x4e3440c9 (stale) Mirror 12: 0x4e3440c9 (stale) Mirror 13: 0x4e3440c9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x4e3440c9 (stale) Mirror 10: 0x4e3440c9 (stale) Mirror 12: 0x4e3440c9 (stale) Mirror 13: 0x4e3440c9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000366 1781237248.522438 mapread 0x00546e thru 0x00c253 (0x6de6 bytes) 000367 1781237248.554236 MIRROR_RESYNC 5 mirrors 000369 1781237249.318367 mapread 0x033638 thru 0x03d90d (0xa2d6 bytes) 000370 1781237249.338016 read 0x02165d thru 0x022e0f (0x17b3 bytes) 000373 1781237249.343707 mapread 0x03e606 thru 0x03ffff (0x19fa bytes) 000376 1781237249.350415 mapwrite 0x00c48f thru 0x015917 (0x9489 bytes) 000377 1781237249.531286 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xac9e982c (stale) Mirror 10: 0xac9e982c (stale) Mirror 12: 0xac9e982c (stale) Mirror 13: 0xac9e982c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa5b9cd98 Mirror 14: 0xa5b9cd98 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000378 1781237250.497494 MIRROR_RESYNC 6 mirrors 000380 1781237251.213365 MIRROR_EXTEND to 7 mirrors 000382 1781237251.943341 MIRROR_EXTEND to 8 mirrors 000383 1781237252.560117 mapread 0x03177c thru 0x03b679 (0x9efe bytes) 000384 1781237252.580485 read 0x0007e1 thru 0x00ae30 (0xa650 bytes) 000385 1781237252.588406 write 0x029e3b thru 0x038c49 (0xee0f bytes) 000386 1781237252.689181 trunc from 0x040000 to 0x010bb6 (0x2f449 bytes) 000390 1781237252.714210 mapwrite 0x02bf58 thru 0x02d9d9 (0x1a82 bytes) 000391 1781237252.777101 mapwrite 0x032614 thru 0x03aafb (0x84e8 bytes) 000393 1781237252.844328 mapread 0x02fed6 thru 0x03aafb (0xac26 bytes) 000398 1781237252.849435 read 0x01c1f7 thru 0x02b0c9 (0xeed3 bytes) 000399 1781237252.861884 trunc from 0x03aafc to 0x002081 (0x38a7a bytes) 000400 1781237252.887984 MIRROR_RESYNC 8 mirrors 000404 1781237254.264834 mapwrite 0x0193bc thru 0x01f455 (0x609a bytes) 000405 1781237254.427043 mapread 0x002f33 thru 0x0121e4 (0xf2b2 bytes) 000406 1781237254.447345 mapwrite 0x025128 thru 0x03297f (0xd858 bytes) 000410 1781237254.537991 mapread 0x0057d3 thru 0x00a4f3 (0x4d21 bytes) 000412 1781237254.546692 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32980): Mirror 9: 0xda94c61e (stale) Mirror 12: 0xda94c61e (stale) Mirror 13: 0xda94c61e (stale) Mirror 14: 0xda94c61e (stale) Mirror 15: 0xda94c61e (stale) Mirror 16: 0xda94c61e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32980): Mirror 9: 0xda94c61e (stale) Mirror 12: 0xda94c61e (stale) Mirror 13: 0xda94c61e (stale) Mirror 14: 0xda94c61e (stale) Mirror 15: 0xda94c61e (stale) Mirror 16: 0xda94c61e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32980: skipped 000413 1781237254.886586 read 0x01a982 thru 0x022472 (0x7af1 bytes) 000415 1781237254.896968 mapread 0x00e48e thru 0x010cd7 (0x284a bytes) 000416 1781237254.912925 read 0x020b22 thru 0x021878 (0xd57 bytes) 000417 1781237254.913709 trunc from 0x032980 to 0x01854b (0x1a434 bytes) 000418 1781237254.936947 trunc from 0x01854c to 0x030066 (0x17b1b bytes) 000420 1781237254.952800 trunc from 0x030067 to 0x02b46f (0x4bf7 bytes) 000421 1781237254.971289 MIRROR_RESYNC 7 mirrors 000422 1781237256.077332 mapwrite 0x0102a1 thru 0x01fa21 (0xf781 bytes) 000424 1781237256.253477 trunc from 0x02b470 to 0x00ee22 (0x1c64d bytes) 000425 1781237256.280390 write 0x0222fa thru 0x02ea18 (0xc71f bytes) 000430 1781237256.285601 mapwrite 0x00215b thru 0x0090bc (0x6f62 bytes) 000432 1781237256.347554 read 0x00be3a thru 0x018e3a (0xd001 bytes) 000435 1781237256.361912 trunc from 0x02ea19 to 0x02605b (0x89bd bytes) 000437 1781237256.382274 write 0x03d8d7 thru 0x03f764 (0x1e8e bytes) 000438 1781237256.383441 mapwrite 0x031650 thru 0x03ffd4 (0xe985 bytes) 000439 1781237256.473608 MIRROR_RESYNC 7 mirrors 000440 1781237257.349998 write 0x029455 thru 0x02f3ee (0x5f9a bytes) 000445 1781237257.450699 mapread 0x0096c5 thru 0x00c738 (0x3074 bytes) 000446 1781237257.466186 read 0x006b21 thru 0x00a0b2 (0x3592 bytes) 000447 1781237257.467337 write 0x01c91d thru 0x01f9b2 (0x3096 bytes) 000454 1781237257.489155 read 0x010617 thru 0x01875e (0x8148 bytes) 000455 1781237257.517845 write 0x031003 thru 0x03d0f1 (0xc0ef bytes) 000459 1781237257.527349 mapread 0x0247f3 thru 0x0342d4 (0xfae2 bytes) 000461 1781237257.540327 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ffd5): Mirror 12: 0x744f80fe (stale) Mirror 13: 0x744f80fe (stale) Mirror 14: 0x744f80fe (stale) Mirror 15: 0x744f80fe (stale) Mirror 16: 0x744f80fe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ffd5): Mirror 12: 0x744f80fe (stale) Mirror 13: 0x744f80fe (stale) Mirror 14: 0x744f80fe (stale) Mirror 15: 0x744f80fe (stale) Mirror 16: 0x744f80fe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ffd5: skipped 000462 1781237258.083923 read 0x008b4b thru 0x00d534 (0x49ea bytes) 000464 1781237258.099924 trunc from 0x03ffd5 to 0x025785 (0x1a84f bytes) 000465 1781237258.139242 write 0x03aaf7 thru 0x03ffff (0x5509 bytes) 000467 1781237258.142326 write 0x02f418 thru 0x03d11f (0xdd08 bytes) 000468 1781237258.152209 MIRROR_RESYNC 6 mirrors 000471 1781237259.301881 trunc from 0x040000 to 0x001960 (0x3e69f bytes) 000472 1781237259.523841 read 0x000269 thru 0x001960 (0x16f8 bytes) 000473 1781237259.538759 read 0x000a3f thru 0x001960 (0xf22 bytes) 000474 1781237259.544217 read 0x00087a thru 0x000e95 (0x61c bytes) 000475 1781237259.549218 trunc from 0x001961 to 0x019268 (0x17908 bytes) 000476 1781237259.612839 trunc from 0x019269 to 0x039873 (0x2060b bytes) 000477 1781237259.657354 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39874): Mirror 13: 0xd9e75ce5 (stale) Mirror 14: 0xd9e75ce5 (stale) Mirror 15: 0xd9e75ce5 (stale) Mirror 16: 0xd9e75ce5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39874): Mirror 13: 0xd9e75ce5 (stale) Mirror 14: 0xd9e75ce5 (stale) Mirror 15: 0xd9e75ce5 (stale) Mirror 16: 0xd9e75ce5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39874: skipped 000478 1781237260.262463 trunc from 0x039874 to 0x00a2ba (0x2f5b9 bytes) 000479 1781237260.291923 read 0x002eae thru 0x00a2ba (0x740d bytes) 000480 1781237260.325468 trunc from 0x00a2bb to 0x02e366 (0x240ac bytes) 000482 1781237260.345171 trunc from 0x02e367 to 0x011312 (0x1d054 bytes) 000484 1781237260.370242 write 0x02ac47 thru 0x03722d (0xc5e7 bytes) 000485 1781237260.383916 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3722e): Mirror 13: 0x50e368df (stale) Mirror 15: 0x50e368df (stale) Mirror 16: 0x50e368df (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3722e): Mirror 13: 0x50e368df (stale) Mirror 15: 0x50e368df (stale) Mirror 16: 0x50e368df (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3722e: skipped 000487 1781237260.974739 MIRROR_RESYNC 4 mirrors 000488 1781237262.345744 trunc from 0x03722e to 0x01f837 (0x179f6 bytes) 000489 1781237262.518170 write 0x0130cb thru 0x014015 (0xf4b bytes) 000491 1781237262.549177 trunc from 0x01f838 to 0x00b0c2 (0x14775 bytes) 000495 1781237262.614484 mapread 0x00a623 thru 0x00b0c2 (0xaa0 bytes) 000496 1781237262.643765 MIRROR_RESYNC 4 mirrors 000497 1781237263.941133 mapread 0x00aa18 thru 0x00b0c2 (0x6ab bytes) 000499 1781237263.951761 mapread 0x007a9d thru 0x00b0c2 (0x3626 bytes) 000501 1781237263.962490 trunc from 0x00b0c3 to 0x01d08c (0x11fca bytes) 000503 1781237264.049634 trunc from 0x01d08d to 0x023d07 (0x6c7b bytes) 000505 1781237264.086627 mapwrite 0x02c1b2 thru 0x0364a1 (0xa2f0 bytes) 000507 1781237264.269739 trunc from 0x0364a2 to 0x0203ec (0x160b5 bytes) 000508 1781237264.302008 mapread 0x005ee4 thru 0x015b88 (0xfca5 bytes) 000510 1781237264.350824 read 0x0183bd thru 0x0203ec (0x8030 bytes) 000511 1781237264.368748 trunc from 0x0203ed to 0x0346cf (0x142e3 bytes) 000512 1781237264.411954 read 0x01ea6e thru 0x01f511 (0xaa4 bytes) 000514 1781237264.413369 read 0x028ee9 thru 0x02d2a3 (0x43bb bytes) 000515 1781237264.435845 mapwrite 0x00e8d5 thru 0x0159ae (0x70da bytes) 000518 1781237264.571703 mapwrite 0x034e21 thru 0x03dd74 (0x8f54 bytes) 000521 1781237264.708992 write 0x02c41f thru 0x0317c2 (0x53a4 bytes) 000523 1781237264.740816 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3dd75): Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd75): Mirror 13: 0x73cdcbd4 (stale) Mirror 15: 0x73cdcbd4 (stale) Mirror 16: 0x73cdcbd4 (stale) CRC-32 checksum value for chunk [0, 0x3dd75): Mirror 1: 0x2fb7e129 Mirror 17: 0x2fb7e129 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd75: skipped 000524 1781237266.366891 MIRROR_RESYNC 5 mirrors 000525 1781237268.051979 mapwrite 0x017d41 thru 0x01d63b (0x58fb bytes) 000527 1781237268.393250 mapread 0x00f5d1 thru 0x0161b4 (0x6be4 bytes) 000529 1781237268.426470 write 0x033afb thru 0x03ffff (0xc505 bytes) 000530 1781237268.463199 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x5213214e (stale) Mirror 16: 0x5213214e (stale) Mirror 17: 0x5213214e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x5213214e (stale) Mirror 16: 0x5213214e (stale) Mirror 17: 0x5213214e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000532 1781237269.203476 mapwrite 0x020080 thru 0x02dc89 (0xdc0a bytes) 000534 1781237269.515741 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x5213214e (stale) Mirror 16: 0x5213214e (stale) Mirror 17: 0x5213214e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe4c94ff4 Mirror 18: 0xe4c94ff4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000535 1781237271.211461 write 0x011c31 thru 0x021bee (0xffbe bytes) 000536 1781237271.354494 read 0x018b50 thru 0x024500 (0xb9b1 bytes) 000539 1781237271.365046 mapread 0x0259c0 thru 0x02c7d9 (0x6e1a bytes) 000541 1781237271.377120 mapwrite 0x005142 thru 0x00ebc4 (0x9a83 bytes) 000544 1781237271.468542 mapread 0x03c7a8 thru 0x03e835 (0x208e bytes) 000545 1781237271.485974 write 0x018df6 thru 0x024676 (0xb881 bytes) 000548 1781237271.491670 trunc from 0x040000 to 0x011884 (0x2e77b bytes) 000549 1781237271.562681 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x11885): Mirror 16: 0x100081f2 (stale) Mirror 17: 0x100081f2 (stale) Mirror 18: 0x100081f2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11885): Mirror 16: 0x100081f2 (stale) Mirror 17: 0x100081f2 (stale) Mirror 18: 0x100081f2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11885: skipped 000550 1781237272.227945 write 0x002143 thru 0x0105e5 (0xe4a3 bytes) 000556 1781237272.265804 trunc from 0x011885 to 0x01e6d2 (0xce4e bytes) 000558 1781237272.290769 read 0x017ce8 thru 0x01c75a (0x4a73 bytes) 000559 1781237272.315914 write 0x00b12e thru 0x00ff2a (0x4dfd bytes) 000560 1781237272.324172 mapread 0x01c076 thru 0x01e6d2 (0x265d bytes) 000561 1781237272.344270 mapwrite 0x0082c5 thru 0x015115 (0xce51 bytes) 000564 1781237272.500313 read 0x0148a9 thru 0x01928e (0x49e6 bytes) 000569 1781237272.506940 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1e6d3): Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e6d3): Mirror 16: 0x1b4bcf32 (stale) Mirror 17: 0x1b4bcf32 (stale) Mirror 18: 0x1e810fbd (stale) CRC-32 checksum value for chunk [0, 0x1e6d3): Mirror 1: 0x7b8e7ce9 Mirror 19: 0x7b8e7ce9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e6d3: skipped 000570 1781237273.896522 trunc from 0x01e6d3 to 0x001b6f (0x1cb63 bytes) 000573 1781237274.006112 mapwrite 0x02f3f6 thru 0x035a7f (0x668a bytes) 000574 1781237274.098973 mapwrite 0x000b52 thru 0x00e71a (0xdbc9 bytes) 000575 1781237274.190519 mapread 0x02703e thru 0x0299e0 (0x29a3 bytes) 000576 1781237274.200754 write 0x0108f3 thru 0x01a8b6 (0x9fc4 bytes) 000579 1781237274.218269 read 0x002668 thru 0x00e190 (0xbb29 bytes) 000581 1781237274.224640 MIRROR_RESYNC 5 mirrors 000582 1781237275.341321 trunc from 0x035a80 to 0x00efa1 (0x26ade bytes) 000584 1781237275.513729 write 0x00cb6c thru 0x011dda (0x526f bytes) 000585 1781237275.525737 mapread 0x006a0d thru 0x011dda (0xb3ce bytes) 000586 1781237275.554655 mapwrite 0x01b216 thru 0x026b4b (0xb936 bytes) 000587 1781237275.702586 mapread 0x00d6fa thru 0x00ed54 (0x165b bytes) 000588 1781237275.704844 mapread 0x01fede thru 0x026b4b (0x6c6e bytes) 000589 1781237275.707477 write 0x01701c thru 0x018081 (0x1066 bytes) 000591 1781237275.714131 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x26b4c): Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26b4c): Mirror 16: 0x67557449 (stale) Mirror 17: 0x67557449 (stale) Mirror 18: 0x67557449 (stale) Mirror 19: 0x67557449 (stale) CRC-32 checksum value for chunk [0, 0x26b4c): Mirror 1: 0xb31792d2 Mirror 20: 0xb31792d2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26b4c: skipped 000595 1781237276.739111 read 0x023211 thru 0x02624e (0x303e bytes) 000596 1781237276.751939 trunc from 0x026b4c to 0x03a244 (0x136f9 bytes) 000597 1781237276.862942 mapread 0x02d0cb thru 0x02f68d (0x25c3 bytes) 000598 1781237276.881864 trunc from 0x03a245 to 0x03bcbb (0x1a77 bytes) 000599 1781237276.907021 mapread 0x02142f thru 0x022fbb (0x1b8d bytes) 000605 1781237276.927122 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bcbc): Mirror 16: 0xf0b4f8b0 (stale) Mirror 18: 0xf0b4f8b0 (stale) Mirror 19: 0xf0b4f8b0 (stale) Mirror 20: 0xf300bacd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bcbc): Mirror 16: 0xf0b4f8b0 (stale) Mirror 18: 0xf0b4f8b0 (stale) Mirror 19: 0xf0b4f8b0 (stale) Mirror 20: 0xf300bacd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bcbc: skipped 000607 1781237277.336473 read 0x004752 thru 0x0090b2 (0x4961 bytes) 000608 1781237277.349470 mapread 0x00af45 thru 0x017505 (0xc5c1 bytes) 000609 1781237277.383013 trunc from 0x03bcbc to 0x029f80 (0x11d3b bytes) 000610 1781237277.403328 trunc from 0x029f81 to 0x007401 (0x22b7f bytes) 000611 1781237277.424585 read 0x000a08 thru 0x003d99 (0x3392 bytes) 000612 1781237277.433618 trunc from 0x007402 to 0x0216bc (0x1a2bb bytes) 000613 1781237277.454153 write 0x0065a0 thru 0x0068ed (0x34e bytes) 000614 1781237277.456662 write 0x0062ef thru 0x00ac04 (0x4916 bytes) 000618 1781237277.467189 mapwrite 0x024e84 thru 0x029b07 (0x4c84 bytes) 000620 1781237277.554865 read 0x011bd1 thru 0x01c816 (0xac46 bytes) 000621 1781237277.556302 read 0x000147 thru 0x0062d2 (0x618c bytes) 000622 1781237277.558327 mapwrite 0x025dd3 thru 0x029754 (0x3982 bytes) 000623 1781237277.601642 mapwrite 0x02c819 thru 0x03a632 (0xde1a bytes) 000628 1781237277.691867 trunc from 0x03a633 to 0x032273 (0x83bf bytes) 000629 1781237277.707474 trunc from 0x032274 to 0x02df72 (0x4301 bytes) 000630 1781237277.726618 trunc from 0x02df73 to 0x026c15 (0x735d bytes) 000631 1781237277.741603 read 0x0251e1 thru 0x026c15 (0x1a35 bytes) 000632 1781237277.743047 mapread 0x00ee3e thru 0x013886 (0x4a49 bytes) 000633 1781237277.747435 mapwrite 0x01374d thru 0x01a1d2 (0x6a86 bytes) 000636 1781237277.797952 mapread 0x01b550 thru 0x02376e (0x821f bytes) 000637 1781237277.799242 mapread 0x00e311 thru 0x00fc86 (0x1976 bytes) 000638 1781237277.801747 read 0x023d56 thru 0x026c15 (0x2ec0 bytes) 000640 1781237277.803633 write 0x00ab5b thru 0x00d5f6 (0x2a9c bytes) 000642 1781237277.806192 trunc from 0x026c16 to 0x0291c9 (0x25b4 bytes) 000646 1781237277.826047 mapwrite 0x034590 thru 0x03ffff (0xba70 bytes) 000647 1781237277.924995 mapwrite 0x039187 thru 0x03b6b9 (0x2533 bytes) 000654 1781237277.982971 trunc from 0x040000 to 0x012a7e (0x2d581 bytes) 000656 1781237277.998524 read 0x009d25 thru 0x00bc8f (0x1f6b bytes) 000658 1781237278.003849 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x12a7f): Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12a7f): Mirror 16: 0xa6246442 (stale) Mirror 18: 0xa6246442 (stale) Mirror 19: 0xa6246442 (stale) Mirror 20: 0x4e4f3181 (stale) CRC-32 checksum value for chunk [0, 0x12a7f): Mirror 1: 0xf1c59bf1 Mirror 21: 0xf1c59bf1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12a7f: skipped 000659 1781237278.830772 trunc from 0x012a7f to 0x02fc12 (0x1d194 bytes) 000662 1781237278.981776 trunc from 0x02fc13 to 0x00c494 (0x2377e bytes) 000664 1781237279.018623 write 0x01d857 thru 0x02a78c (0xcf36 bytes) 000667 1781237279.022494 read 0x0278b3 thru 0x0283b1 (0xaff bytes) 000668 1781237279.024289 trunc from 0x02a78d to 0x02fed0 (0x5744 bytes) 000669 1781237279.056318 write 0x03e16b thru 0x03ffff (0x1e95 bytes) 000671 1781237279.073558 write 0x02e24a thru 0x033ca3 (0x5a5a bytes) 000672 1781237279.084657 mapread 0x02f90d thru 0x033bae (0x42a2 bytes) 000673 1781237279.096917 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x2893afa4 (stale) Mirror 18: 0x2893afa4 (stale) Mirror 19: 0x2893afa4 (stale) Mirror 20: 0x99fea8ca (stale) Mirror 21: 0x466639 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3f1d7b80 Mirror 22: 0x3f1d7b80 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000675 1781237279.915952 mapread 0x012cbb thru 0x0165f3 (0x3939 bytes) 000676 1781237279.939443 read 0x016da1 thru 0x02677b (0xf9db bytes) 000677 1781237279.947633 mapwrite 0x01bd1c thru 0x0206d9 (0x49be bytes) 000678 1781237280.121103 mapwrite 0x02bc1f thru 0x037b48 (0xbf2a bytes) 000680 1781237280.257882 mapwrite 0x0327b5 thru 0x035f37 (0x3783 bytes) 000681 1781237280.303610 mapwrite 0x02d73b thru 0x03851d (0xade3 bytes) 000682 1781237280.361024 read 0x026cbd thru 0x02c7d6 (0x5b1a bytes) 000684 1781237280.367527 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0x2893afa4 (stale) Mirror 18: 0x2893afa4 (stale) Mirror 19: 0x2893afa4 (stale) Mirror 20: 0x99fea8ca (stale) Mirror 21: 0x466639 (stale) Mirror 22: 0x3f1d7b80 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd9276e63 Mirror 23: 0xd9276e63 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000685 1781237281.321518 read 0x0271df thru 0x029b97 (0x29b9 bytes) 000688 1781237281.333814 mapread 0x034a27 thru 0x038ddc (0x43b6 bytes) 000689 1781237281.354908 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0x2893afa4 (stale) Mirror 19: 0x2893afa4 (stale) Mirror 20: 0x99fea8ca (stale) Mirror 21: 0x466639 (stale) Mirror 22: 0x3f1d7b80 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0x2893afa4 (stale) Mirror 19: 0x2893afa4 (stale) Mirror 20: 0x99fea8ca (stale) Mirror 21: 0x466639 (stale) Mirror 22: 0x3f1d7b80 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd9276e63 Mirror 23: 0xd9276e63 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000690 1781237281.955270 trunc from 0x040000 to 0x03a513 (0x5aec bytes) 000692 1781237282.104374 read 0x02359b thru 0x026f33 (0x3999 bytes) 000693 1781237282.113542 trunc from 0x03a514 to 0x010853 (0x29cc0 bytes) 000697 1781237282.138032 write 0x02be7c thru 0x02f055 (0x31da bytes) 000698 1781237282.141489 mapwrite 0x039e2a thru 0x03ffff (0x61d6 bytes) 000703 1781237282.243478 write 0x038775 thru 0x03ffff (0x788b bytes) 000706 1781237282.247398 trunc from 0x040000 to 0x0062a6 (0x39d59 bytes) 000707 1781237282.263333 trunc from 0x0062a7 to 0x03c25e (0x35fb8 bytes) 000710 1781237282.280031 read 0x001c55 thru 0x0061c8 (0x4574 bytes) 000711 1781237282.289874 mapwrite 0x0343ca thru 0x0394d4 (0x510b bytes) 000715 1781237282.338805 mapwrite 0x031e80 thru 0x038efb (0x707c bytes) 000716 1781237282.388513 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c25f): Mirror 18: 0x6ed3cf7f (stale) Mirror 19: 0x6ed3cf7f (stale) Mirror 20: 0x7818df93 (stale) Mirror 22: 0x7d27e20b (stale) Mirror 23: 0xb578288a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c25f): Mirror 18: 0x6ed3cf7f (stale) Mirror 19: 0x6ed3cf7f (stale) Mirror 20: 0x7818df93 (stale) Mirror 22: 0x7d27e20b (stale) Mirror 23: 0xb578288a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c25f: skipped 000718 1781237282.731931 write 0x006511 thru 0x00c56f (0x605f bytes) 000720 1781237282.746931 trunc from 0x03c25f to 0x0010f4 (0x3b16a bytes) 000721 1781237282.776463 read 0x000ccb thru 0x0010f4 (0x42a bytes) 000724 1781237282.784292 write 0x014006 thru 0x020b1f (0xcb1a bytes) 000726 1781237282.787391 mapread 0x0130b8 thru 0x015c0c (0x2b55 bytes) 000727 1781237282.794082 mapread 0x01c6dc thru 0x020b1f (0x4444 bytes) 000728 1781237282.795455 trunc from 0x020b20 to 0x000ff0 (0x1fb2f bytes) 000730 1781237282.812377 read 0x000eef thru 0x000ff0 (0x102 bytes) 000731 1781237282.812973 mapwrite 0x02f670 thru 0x0377d0 (0x8161 bytes) 000732 1781237282.940974 mapwrite 0x02cd9e thru 0x036485 (0x96e8 bytes) 000733 1781237283.011807 write 0x00f1d0 thru 0x0116bb (0x24ec bytes) 000734 1781237283.012987 mapread 0x014775 thru 0x01f0ce (0xa95a bytes) 000738 1781237283.024540 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x377d1): Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x377d1): Mirror 18: 0x89a7605e (stale) Mirror 19: 0x89a7605e (stale) Mirror 20: 0x2b04c0bd (stale) Mirror 22: 0xc1bf65cf (stale) Mirror 23: 0xb60c2984 (stale) CRC-32 checksum value for chunk [0, 0x377d1): Mirror 1: 0x547b2f2f Mirror 24: 0x547b2f2f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x377d1: skipped 000742 1781237283.749531 mapread 0x005950 thru 0x0144db (0xeb8c bytes) 000744 1781237283.775359 trunc from 0x0377d1 to 0x026427 (0x113a9 bytes) 000748 1781237283.892423 mapwrite 0x021967 thru 0x023437 (0x1ad1 bytes) 000749 1781237283.949550 mapwrite 0x00a713 thru 0x00e306 (0x3bf4 bytes) 000752 1781237284.006256 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x26428): Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26428): Mirror 18: 0x16c08953 (stale) Mirror 19: 0x16c08953 (stale) Mirror 20: 0x848a7e03 (stale) Mirror 22: 0xd2d3bffd (stale) Mirror 23: 0x5a5aec2a (stale) Mirror 24: 0x23adfd97 (stale) CRC-32 checksum value for chunk [0, 0x26428): Mirror 1: 0x869d752d Mirror 25: 0x869d752d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26428: skipped 000753 1781237285.006375 trunc from 0x026428 to 0x00c047 (0x1a3e0 bytes) 000754 1781237285.141337 mapwrite 0x027e07 thru 0x02b025 (0x321f bytes) 000755 1781237285.233608 read 0x0161c0 thru 0x01ea62 (0x88a3 bytes) 000758 1781237285.241450 write 0x028684 thru 0x02adf3 (0x2770 bytes) 000763 1781237285.245896 read 0x017cff thru 0x022331 (0xa633 bytes) 000767 1781237285.258648 mapread 0x003e77 thru 0x00b846 (0x79d0 bytes) 000769 1781237285.264588 MIRROR_RESYNC 8 mirrors 000770 1781237286.341080 mapread 0x024827 thru 0x02b025 (0x67ff bytes) 000772 1781237286.368369 mapread 0x016c8f thru 0x01e988 (0x7cfa bytes) 000773 1781237286.386398 trunc from 0x02b026 to 0x022585 (0x8aa0 bytes) 000774 1781237286.524547 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x22586): Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22586): Mirror 18: 0xede8058f (stale) Mirror 19: 0xede8058f (stale) Mirror 20: 0xede8058f (stale) Mirror 22: 0xede8058f (stale) Mirror 23: 0xede8058f (stale) Mirror 24: 0xede8058f (stale) Mirror 25: 0xede8058f (stale) CRC-32 checksum value for chunk [0, 0x22586): Mirror 1: 0xede8058f Mirror 26: 0xede8058f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22586: skipped 000775 1781237287.303824 trunc from 0x022586 to 0x03fcdc (0x1d757 bytes) 000776 1781237287.473031 trunc from 0x03fcdd to 0x001f9c (0x3dd40 bytes) 000777 1781237287.503150 write 0x00b902 thru 0x019cd6 (0xe3d5 bytes) 000778 1781237287.513533 trunc from 0x019cd7 to 0x0228f0 (0x8c1a bytes) 000779 1781237287.534907 mapread 0x00eb33 thru 0x01775d (0x8c2b bytes) 000780 1781237287.537691 trunc from 0x0228f1 to 0x003b45 (0x1edab bytes) 000784 1781237287.557431 read 0x00300b thru 0x003b45 (0xb3b bytes) 000786 1781237287.565430 write 0x00e5e3 thru 0x017bc8 (0x95e6 bytes) 000789 1781237287.571761 read 0x000a94 thru 0x00579d (0x4d0a bytes) 000790 1781237287.580733 write 0x028e91 thru 0x0358d8 (0xca48 bytes) 000792 1781237287.582963 trunc from 0x0358d9 to 0x036d1f (0x1447 bytes) 000793 1781237287.605370 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x36d20): Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36d20): Mirror 18: 0x54d3e41c (stale) Mirror 19: 0x54d3e41c (stale) Mirror 20: 0x54d3e41c (stale) Mirror 22: 0x54d3e41c (stale) Mirror 23: 0x54d3e41c (stale) Mirror 24: 0x54d3e41c (stale) Mirror 25: 0x54d3e41c (stale) Mirror 26: 0x90a73422 (stale) CRC-32 checksum value for chunk [0, 0x36d20): Mirror 1: 0xd6c0dc99 Mirror 27: 0xd6c0dc99 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36d20: skipped 000799 1781237289.096853 read 0x00584f thru 0x005bf9 (0x3ab bytes) 000800 1781237289.101374 mapread 0x00f74c thru 0x01f3bf (0xfc74 bytes) 000801 1781237289.140731 trunc from 0x036d20 to 0x015f7f (0x20da0 bytes) 000802 1781237289.322525 mapread 0x00f6ec thru 0x015f7f (0x6894 bytes) 000804 1781237289.344870 write 0x0266dc thru 0x02758a (0xeaf bytes) 000805 1781237289.354390 mapread 0x00b68c thru 0x01147e (0x5df3 bytes) 000806 1781237289.378482 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2758b): Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2758b): Mirror 18: 0xe853dbb7 (stale) Mirror 19: 0xe853dbb7 (stale) Mirror 20: 0xe853dbb7 (stale) Mirror 22: 0xe853dbb7 (stale) Mirror 23: 0xe853dbb7 (stale) Mirror 24: 0xe853dbb7 (stale) Mirror 25: 0xe853dbb7 (stale) Mirror 26: 0xe853dbb7 (stale) Mirror 27: 0xf7295566 (stale) CRC-32 checksum value for chunk [0, 0x2758b): Mirror 1: 0x5124829a Mirror 28: 0x5124829a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2758b: skipped 000808 1781237291.009412 read 0x013f1d thru 0x01ab27 (0x6c0b bytes) 000809 1781237291.025836 mapwrite 0x00ab55 thru 0x00f8ab (0x4d57 bytes) 000810 1781237291.277434 mapread 0x01dc72 thru 0x0247dd (0x6b6c bytes) 000811 1781237291.300653 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x2758b): Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2758b): Mirror 18: 0xe853dbb7 (stale) Mirror 19: 0xe853dbb7 (stale) Mirror 20: 0xe853dbb7 (stale) Mirror 22: 0xe853dbb7 (stale) Mirror 23: 0xe853dbb7 (stale) Mirror 24: 0xe853dbb7 (stale) Mirror 25: 0xe853dbb7 (stale) Mirror 26: 0xe853dbb7 (stale) Mirror 27: 0xf7295566 (stale) Mirror 28: 0x5124829a (stale) CRC-32 checksum value for chunk [0, 0x2758b): Mirror 1: 0x567e4e81 Mirror 29: 0x567e4e81 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2758b: skipped 000812 1781237292.761896 mapwrite 0x022f1b thru 0x0280bc (0x51a2 bytes) 000815 1781237293.068196 MIRROR_RESYNC 12 mirrors 000818 1781237295.875275 mapread 0x004848 thru 0x00b64e (0x6e07 bytes) 000819 1781237295.893448 read 0x001367 thru 0x004bdc (0x3876 bytes) 000821 1781237295.898550 MIRROR_EXTEND to 13 mirrors 000824 1781237297.030599 mapwrite 0x010f92 thru 0x01d132 (0xc1a1 bytes) 000825 1781237297.211786 trunc from 0x0280bd to 0x01fdf4 (0x82c8 bytes) 000826 1781237297.233446 mapwrite 0x00f879 thru 0x013c65 (0x43ed bytes) 000829 1781237297.305009 read 0x003b84 thru 0x0119c8 (0xde45 bytes) 000830 1781237297.344804 write 0x00d038 thru 0x00ec1c (0x1be5 bytes) 000831 1781237297.346639 mapwrite 0x03f8cd thru 0x03ffff (0x733 bytes) 000832 1781237297.416393 mapread 0x026445 thru 0x02d0b5 (0x6c71 bytes) 000833 1781237297.426564 trunc from 0x040000 to 0x038386 (0x7c79 bytes) 000834 1781237297.447779 read 0x006753 thru 0x009694 (0x2f42 bytes) 000836 1781237297.452002 mapwrite 0x00cb7c thru 0x015408 (0x888d bytes) 000838 1781237297.508455 read 0x008cbe thru 0x012ae4 (0x9e27 bytes) 000841 1781237297.515010 mapwrite 0x02ca52 thru 0x038bce (0xc17d bytes) 000843 1781237297.589689 write 0x0247a6 thru 0x026179 (0x19d4 bytes) 000844 1781237297.595820 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x38bcf): Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38bcf): Mirror 18: 0x48c4fa21 (stale) Mirror 19: 0x48c4fa21 (stale) Mirror 20: 0x48c4fa21 (stale) Mirror 22: 0x48c4fa21 (stale) Mirror 23: 0x48c4fa21 (stale) Mirror 24: 0x48c4fa21 (stale) Mirror 25: 0x48c4fa21 (stale) Mirror 26: 0x48c4fa21 (stale) Mirror 27: 0x48c4fa21 (stale) Mirror 28: 0x48c4fa21 (stale) Mirror 29: 0x48c4fa21 (stale) Mirror 30: 0x48c4fa21 (stale) CRC-32 checksum value for chunk [0, 0x38bcf): Mirror 1: 0x1be0ca8e Mirror 31: 0x1be0ca8e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38bcf: skipped 000845 1781237299.097557 read 0x00542f thru 0x0151d7 (0xfda9 bytes) 000849 1781237299.106566 trunc from 0x038bcf to 0x00f297 (0x29937 bytes) 000851 1781237299.193424 mapwrite 0x02194d thru 0x028815 (0x6ec9 bytes) 000852 1781237299.277299 trunc from 0x028816 to 0x037225 (0xea10 bytes) 000854 1781237299.294452 read 0x02dc91 thru 0x037225 (0x9595 bytes) 000855 1781237299.304468 read 0x001e68 thru 0x00698c (0x4b25 bytes) 000857 1781237299.309581 MIRROR_RESYNC 14 mirrors 000860 1781237301.289307 mapwrite 0x03a881 thru 0x03dc3f (0x33bf bytes) 000861 1781237301.464604 MIRROR_SPLIT mirror 12 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dc40): Mirror 18: 0x7f02dac7 (stale) Mirror 19: 0x7f02dac7 (stale) Mirror 20: 0x7f02dac7 (stale) Mirror 22: 0x7f02dac7 (stale) Mirror 23: 0x7f02dac7 (stale) Mirror 24: 0x7f02dac7 (stale) Mirror 25: 0x7f02dac7 (stale) Mirror 26: 0x7f02dac7 (stale) Mirror 27: 0x7f02dac7 (stale) Mirror 28: 0x7f02dac7 (stale) Mirror 29: 0x7f02dac7 (stale) Mirror 31: 0x7f02dac7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dc40): Mirror 18: 0x7f02dac7 (stale) Mirror 19: 0x7f02dac7 (stale) Mirror 20: 0x7f02dac7 (stale) Mirror 22: 0x7f02dac7 (stale) Mirror 23: 0x7f02dac7 (stale) Mirror 24: 0x7f02dac7 (stale) Mirror 25: 0x7f02dac7 (stale) Mirror 26: 0x7f02dac7 (stale) Mirror 27: 0x7f02dac7 (stale) Mirror 28: 0x7f02dac7 (stale) Mirror 29: 0x7f02dac7 (stale) Mirror 31: 0x7f02dac7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dc40: skipped 000864 1781237302.128291 MIRROR_SPLIT mirror 7 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dc40): Mirror 18: 0x7f02dac7 (stale) Mirror 19: 0x7f02dac7 (stale) Mirror 20: 0x7f02dac7 (stale) Mirror 22: 0x7f02dac7 (stale) Mirror 23: 0x7f02dac7 (stale) Mirror 24: 0x7f02dac7 (stale) Mirror 26: 0x7f02dac7 (stale) Mirror 27: 0x7f02dac7 (stale) Mirror 28: 0x7f02dac7 (stale) Mirror 29: 0x7f02dac7 (stale) Mirror 31: 0x7f02dac7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dc40): Mirror 18: 0x7f02dac7 (stale) Mirror 19: 0x7f02dac7 (stale) Mirror 20: 0x7f02dac7 (stale) Mirror 22: 0x7f02dac7 (stale) Mirror 23: 0x7f02dac7 (stale) Mirror 24: 0x7f02dac7 (stale) Mirror 26: 0x7f02dac7 (stale) Mirror 27: 0x7f02dac7 (stale) Mirror 28: 0x7f02dac7 (stale) Mirror 29: 0x7f02dac7 (stale) Mirror 31: 0x7f02dac7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dc40: skipped 000865 1781237303.012494 mapwrite 0x03f51d thru 0x03ffff (0xae3 bytes) 000867 1781237303.085211 write 0x00f88c thru 0x012d00 (0x3475 bytes) 000870 1781237303.096085 trunc from 0x040000 to 0x014486 (0x2bb79 bytes) 000872 1781237303.115259 MIRROR_SPLIT mirror 3 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x14487): Mirror 18: 0x204716f6 (stale) Mirror 19: 0x204716f6 (stale) Mirror 22: 0x204716f6 (stale) Mirror 23: 0x204716f6 (stale) Mirror 24: 0x204716f6 (stale) Mirror 26: 0x204716f6 (stale) Mirror 27: 0x204716f6 (stale) Mirror 28: 0x204716f6 (stale) Mirror 29: 0x204716f6 (stale) Mirror 31: 0x204716f6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14487): Mirror 18: 0x204716f6 (stale) Mirror 19: 0x204716f6 (stale) Mirror 22: 0x204716f6 (stale) Mirror 23: 0x204716f6 (stale) Mirror 24: 0x204716f6 (stale) Mirror 26: 0x204716f6 (stale) Mirror 27: 0x204716f6 (stale) Mirror 28: 0x204716f6 (stale) Mirror 29: 0x204716f6 (stale) Mirror 31: 0x204716f6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14487: skipped 000875 1781237303.675743 mapread 0x0003be thru 0x00d6ec (0xd32f bytes) 000876 1781237303.709364 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x14487): Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14487): Mirror 18: 0x204716f6 (stale) Mirror 19: 0x204716f6 (stale) Mirror 22: 0x204716f6 (stale) Mirror 23: 0x204716f6 (stale) Mirror 24: 0x204716f6 (stale) Mirror 26: 0x204716f6 (stale) Mirror 27: 0x204716f6 (stale) Mirror 28: 0x204716f6 (stale) Mirror 29: 0x204716f6 (stale) Mirror 31: 0x204716f6 (stale) CRC-32 checksum value for chunk [0, 0x14487): Mirror 1: 0x31f57bd5 Mirror 32: 0x31f57bd5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14487: skipped 000877 1781237304.580435 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x14487): Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14487): Mirror 18: 0x204716f6 (stale) Mirror 19: 0x204716f6 (stale) Mirror 22: 0x204716f6 (stale) Mirror 23: 0x204716f6 (stale) Mirror 24: 0x204716f6 (stale) Mirror 26: 0x204716f6 (stale) Mirror 27: 0x204716f6 (stale) Mirror 28: 0x204716f6 (stale) Mirror 29: 0x204716f6 (stale) Mirror 31: 0x204716f6 (stale) CRC-32 checksum value for chunk [0, 0x14487): Mirror 1: 0x31f57bd5 Mirror 32: 0x31f57bd5 Mirror 33: 0x31f57bd5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14487: skipped 000879 1781237305.711931 mapwrite 0x024fea thru 0x031fc7 (0xcfde bytes) 000881 1781237305.882716 trunc from 0x031fc8 to 0x01d940 (0x14687 bytes) 000883 1781237305.902173 read 0x00e555 thru 0x017e00 (0x98ac bytes) 000884 1781237305.910489 read 0x01a3dd thru 0x01d940 (0x3564 bytes) 000886 1781237305.920110 read 0x004baf thru 0x01162d (0xca7f bytes) 000889 1781237305.922641 read 0x0176df thru 0x01d940 (0x6262 bytes) 000890 1781237305.923464 mapwrite 0x030d15 thru 0x03751e (0x680a bytes) 000891 1781237305.994794 write 0x02d352 thru 0x039e75 (0xcb24 bytes) 000892 1781237305.996510 trunc from 0x039e76 to 0x02cb07 (0xd36e bytes) 000893 1781237306.018048 MIRROR_SPLIT mirror 2 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x189:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2cb08): Mirror 18: 0xfa6e7fae (stale) Mirror 22: 0xfa6e7fae (stale) Mirror 23: 0xfa6e7fae (stale) Mirror 24: 0xfa6e7fae (stale) Mirror 26: 0xfa6e7fae (stale) Mirror 27: 0xfa6e7fae (stale) Mirror 28: 0xfa6e7fae (stale) Mirror 29: 0xfa6e7fae (stale) Mirror 31: 0xfa6e7fae (stale) Mirror 32: 0x7e20d109 (stale) Mirror 33: 0x7e20d109 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cb08): Mirror 18: 0xfa6e7fae (stale) Mirror 22: 0xfa6e7fae (stale) Mirror 23: 0xfa6e7fae (stale) Mirror 24: 0xfa6e7fae (stale) Mirror 26: 0xfa6e7fae (stale) Mirror 27: 0xfa6e7fae (stale) Mirror 28: 0xfa6e7fae (stale) Mirror 29: 0xfa6e7fae (stale) Mirror 31: 0xfa6e7fae (stale) Mirror 32: 0x7e20d109 (stale) Mirror 33: 0x7e20d109 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cb08: skipped 000895 1781237306.593662 write 0x0181f7 thru 0x025b5a (0xd964 bytes) 000896 1781237306.605961 mapread 0x0142ec thru 0x02068c (0xc3a1 bytes) 000899 1781237306.635545 read 0x01bfc7 thru 0x01cbf4 (0xc2e bytes) 000901 1781237306.639548 trunc from 0x02cb08 to 0x001533 (0x2b5d4 bytes) 000902 1781237306.664116 trunc from 0x001534 to 0x0222f7 (0x20dc4 bytes) 000904 1781237306.682272 mapread 0x00aba7 thru 0x00d870 (0x2cca bytes) 000905 1781237306.691692 mapwrite 0x00e0fd thru 0x01dbcf (0xfad3 bytes) 000906 1781237306.777478 read 0x007e62 thru 0x00baac (0x3c4b bytes) 000907 1781237306.778257 read 0x00602f thru 0x006790 (0x762 bytes) 000908 1781237306.778843 write 0x011b91 thru 0x01eb9f (0xd00f bytes) 000909 1781237306.782879 mapread 0x00201b thru 0x00e9d4 (0xc9ba bytes) 000911 1781237306.797376 mapread 0x005412 thru 0x0150d6 (0xfcc5 bytes) 000912 1781237306.800459 mapread 0x01a693 thru 0x01d7c7 (0x3135 bytes) 000913 1781237306.811445 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x222f8): Mirror 18: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x222f8): Mirror 18: 0xd7549576 (stale) Mirror 22: 0xd7549576 (stale) Mirror 23: 0xd7549576 (stale) Mirror 24: 0xd7549576 (stale) Mirror 26: 0xd7549576 (stale) Mirror 27: 0xd7549576 (stale) Mirror 28: 0xd7549576 (stale) Mirror 29: 0xd7549576 (stale) Mirror 31: 0xd7549576 (stale) Mirror 32: 0xc584f5ee (stale) Mirror 33: 0xc584f5ee (stale) CRC-32 checksum value for chunk [0, 0x222f8): Mirror 1: 0x55966ba1 Mirror 34: 0x55966ba1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x222f8: skipped 000915 1781237307.749300 MIRROR_RESYNC 13 mirrors 000919 1781237309.710868 mapread 0x00df55 thru 0x01d04c (0xf0f8 bytes) 000920 1781237309.741754 mapwrite 0x0320f1 thru 0x03c899 (0xa7a9 bytes) 000922 1781237309.967267 write 0x00c704 thru 0x0163d2 (0x9ccf bytes) 000924 1781237309.980936 write 0x00986c thru 0x010e75 (0x760a bytes) 000925 1781237309.981953 write 0x00764a thru 0x015d75 (0xe72c bytes) 000926 1781237309.984235 mapread 0x007ec0 thru 0x00d61a (0x575b bytes) 000929 1781237309.986446 mapread 0x02d986 thru 0x03c1cc (0xe847 bytes) 000930 1781237309.988286 write 0x00d2c6 thru 0x0158c1 (0x85fc bytes) 000931 1781237309.989441 trunc from 0x03c89a to 0x014ffb (0x2789e bytes) 000932 1781237310.010200 write 0x00bcaa thru 0x0170bc (0xb413 bytes) 000934 1781237310.013230 read 0x00257b thru 0x00d5b2 (0xb038 bytes) 000935 1781237310.021839 MIRROR_RESYNC 13 mirrors 000936 1781237311.901013 trunc from 0x0170bd to 0x011a97 (0x5625 bytes) 000938 1781237312.041348 trunc from 0x011a98 to 0x024ad3 (0x1303c bytes) 000939 1781237312.060674 mapread 0x005fc9 thru 0x014c0b (0xec43 bytes) 000942 1781237312.088836 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x24ad4): Mirror 18: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24ad4): Mirror 18: 0xf4e573ec (stale) Mirror 22: 0xf4e573ec (stale) Mirror 23: 0xf4e573ec (stale) Mirror 24: 0xf4e573ec (stale) Mirror 26: 0xf4e573ec (stale) Mirror 27: 0xf4e573ec (stale) Mirror 28: 0xf4e573ec (stale) Mirror 29: 0xf4e573ec (stale) Mirror 31: 0xf4e573ec (stale) Mirror 32: 0xf4e573ec (stale) Mirror 33: 0xf4e573ec (stale) Mirror 34: 0xf4e573ec (stale) CRC-32 checksum value for chunk [0, 0x24ad4): Mirror 1: 0xb054294a Mirror 35: 0xb054294a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24ad4: skipped 000943 1781237313.354349 MIRROR_RESYNC 14 mirrors 000946 1781237315.386327 write 0x02a24a thru 0x0380a4 (0xde5b bytes) 000950 1781237315.459150 mapread 0x00f421 thru 0x01cfcc (0xdbac bytes) 000951 1781237315.482660 write 0x03f4c0 thru 0x03ffff (0xb40 bytes) 000954 1781237315.485386 write 0x013577 thru 0x01b669 (0x80f3 bytes) 000955 1781237315.486871 trunc from 0x040000 to 0x00aba3 (0x3545c bytes) 000957 1781237315.506792 write 0x03e9bb thru 0x03ffff (0x1645 bytes) 000958 1781237315.508004 mapwrite 0x0175bc thru 0x01dee8 (0x692d bytes) 000962 1781237315.566401 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0xc218e65a (stale) Mirror 22: 0xc218e65a (stale) Mirror 23: 0xc218e65a (stale) Mirror 24: 0xc218e65a (stale) Mirror 26: 0xc218e65a (stale) Mirror 27: 0xc218e65a (stale) Mirror 28: 0xc218e65a (stale) Mirror 29: 0xc218e65a (stale) Mirror 31: 0xc218e65a (stale) Mirror 32: 0xc218e65a (stale) Mirror 33: 0xc218e65a (stale) Mirror 34: 0xc218e65a (stale) Mirror 35: 0xc218e65a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x634cc6cc Mirror 36: 0x634cc6cc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000966 1781237316.456660 mapread 0x01f0d1 thru 0x0278db (0x880b bytes) 000967 1781237316.477802 write 0x008a64 thru 0x018478 (0xfa15 bytes) 000968 1781237316.592217 MIRROR_RESYNC 15 mirrors 000971 1781237319.311988 trunc from 0x040000 to 0x03e2e3 (0x1d1c bytes) 000974 1781237319.410772 trunc from 0x03e2e4 to 0x014045 (0x2a29e bytes) 000975 1781237319.432308 trunc from 0x014046 to 0x00aa46 (0x95ff bytes) 000976 1781237319.447977 read 0x002e67 thru 0x00aa46 (0x7be0 bytes) 000979 1781237319.456360 read 0x002c9e thru 0x00a092 (0x73f5 bytes) 000980 1781237319.457087 write 0x0210c5 thru 0x02b436 (0xa372 bytes) 000981 1781237319.459827 mapread 0x01e4f2 thru 0x0293e7 (0xaef6 bytes) 000982 1781237319.468562 trunc from 0x02b437 to 0x031502 (0x60cc bytes) 000985 1781237319.488607 read 0x029f1f thru 0x031502 (0x75e4 bytes) 000989 1781237319.497656 read 0x02095c thru 0x02d377 (0xca1c bytes) 000993 1781237319.501748 read 0x0083a2 thru 0x009e9d (0x1afc bytes) 000999 1781237319.507019 write 0x01b5a4 thru 0x01cf95 (0x19f2 bytes) 001000 1781237319.508782 mapread 0x002be3 thru 0x00749f (0x48bd bytes) All operations completed A-OK!