== sanity-flr test 70a: flr mode fsx test ================ 09:34:28 (1784122468) Seed set to 2469 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000002 1784122469.412897 write 0x032b74 thru 0x03c20e (0x969b bytes) 000004 1784122469.416214 mapwrite 0x016c6b thru 0x02515e (0xe4f4 bytes) truncating to largest ever: 0x11320 000005 1784122469.458346 trunc from 0x03c20f to 0x01131f (0x2aeef bytes) 000006 1784122469.465115 trunc from 0x011320 to 0x010d41 (0x5de bytes) 000007 1784122469.472774 mapread 0x0007c8 thru 0x00c866 (0xc09f bytes) 000008 1784122469.480183 read 0x00b908 thru 0x010d41 (0x543a bytes) 000009 1784122469.482815 mapread 0x008de6 thru 0x010d41 (0x7f5c bytes) truncating to largest ever: 0x3decc 000010 1784122469.483962 trunc from 0x010d42 to 0x03decb (0x2d18a bytes) 000011 1784122469.490072 trunc from 0x03decc to 0x02799e (0x1652d bytes) 000013 1784122469.496436 write 0x01c25a thru 0x02ac6c (0xea13 bytes) 000017 1784122469.500543 read 0x01d62e thru 0x02ac6c (0xd63f bytes) 000019 1784122469.501554 trunc from 0x02ac6d to 0x01c8c6 (0xe3a6 bytes) 000021 1784122469.508199 mapread 0x003097 thru 0x00a423 (0x738d bytes) 000022 1784122469.509433 read 0x00c83b thru 0x01301f (0x67e5 bytes) 000027 1784122469.515144 mapread 0x00e2a4 thru 0x014549 (0x62a6 bytes) 000028 1784122469.516040 write 0x01c3c1 thru 0x026ec0 (0xab00 bytes) 000030 1784122469.517573 mapwrite 0x017675 thru 0x026122 (0xeaae bytes) 000031 1784122469.536208 mapread 0x005938 thru 0x00cfb3 (0x767c bytes) 000032 1784122469.537056 mapread 0x019577 thru 0x01bc24 (0x26ae bytes) 000033 1784122469.537795 mapwrite 0x021bda thru 0x02a10f (0x8536 bytes) 000035 1784122469.561003 mapwrite 0x01daf7 thru 0x02d823 (0xfd2d bytes) 000037 1784122469.587840 MIRROR_EXTEND to 2 mirrors 000039 1784122469.768809 MIRROR_EXTEND to 3 mirrors 000041 1784122469.921646 mapwrite 0x0330be thru 0x03c644 (0x9587 bytes) 000043 1784122469.973854 mapread 0x03a3fc thru 0x03c644 (0x2249 bytes) 000044 1784122469.974862 mapwrite 0x00d428 thru 0x01c27f (0xee58 bytes) 000045 1784122469.998211 read 0x02ad77 thru 0x037805 (0xca8f bytes) 000046 1784122470.001217 mapwrite 0x02dd2f thru 0x02fb50 (0x1e22 bytes) 000047 1784122470.014468 mapwrite 0x03df04 thru 0x03ffff (0x20fc bytes) 000048 1784122470.033623 read 0x01e44a thru 0x024b85 (0x673c bytes) 000049 1784122470.036760 mapread 0x003a6a thru 0x008cb7 (0x524e bytes) 000050 1784122470.037374 trunc from 0x040000 to 0x03d8c5 (0x273a bytes) 000051 1784122470.043899 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3d8c6): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d8c6): Mirror 2: 0x64b93ad5 (stale) Mirror 3: 0x64b93ad5 (stale) CRC-32 checksum value for chunk [0, 0x3d8c6): Mirror 1: 0xf51a5285 Mirror 4: 0xf51a5285 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d8c6: skipped 000053 1784122470.276493 write 0x02c6dc thru 0x030823 (0x4148 bytes) 000054 1784122470.297970 mapwrite 0x023531 thru 0x02eafd (0xb5cd bytes) 000055 1784122470.322061 MIRROR_RESYNC 4 mirrors 000056 1784122470.538071 mapwrite 0x0394e2 thru 0x039520 (0x3f bytes) 000057 1784122470.580967 read 0x029257 thru 0x037c19 (0xe9c3 bytes) 000058 1784122470.584057 mapwrite 0x012605 thru 0x022142 (0xfb3e bytes) 000059 1784122470.607542 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3d8c6): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d8c6): Mirror 2: 0x9c2e689d (stale) Mirror 3: 0x9c2e689d (stale) Mirror 4: 0x9c2e689d (stale) CRC-32 checksum value for chunk [0, 0x3d8c6): Mirror 1: 0x9560b463 Mirror 5: 0x9560b463 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d8c6: skipped 000060 1784122470.854113 read 0x0290dc thru 0x02d420 (0x4345 bytes) 000061 1784122470.858224 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3d8c6): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d8c6): Mirror 2: 0x9c2e689d (stale) Mirror 3: 0x9c2e689d (stale) Mirror 4: 0x9c2e689d (stale) CRC-32 checksum value for chunk [0, 0x3d8c6): Mirror 1: 0x9560b463 Mirror 5: 0x9560b463 Mirror 6: 0x9560b463 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d8c6: skipped 000066 1784122471.111497 trunc from 0x03d8c6 to 0x0108b5 (0x2d010 bytes) 000068 1784122471.141688 write 0x01ed45 thru 0x020fd5 (0x2291 bytes) 000070 1784122471.143126 write 0x00a3e8 thru 0x00a4f0 (0x109 bytes) 000071 1784122471.145367 trunc from 0x020fd6 to 0x00e99b (0x1263a bytes) 000075 1784122471.153077 mapread 0x0058d4 thru 0x00e99b (0x90c8 bytes) 000076 1784122471.159747 trunc from 0x00e99c to 0x027e69 (0x194ce bytes) 000077 1784122471.164872 trunc from 0x027e6a to 0x03b854 (0x139eb bytes) 000078 1784122471.170145 MIRROR_RESYNC 6 mirrors 000080 1784122471.481171 write 0x033b73 thru 0x037e48 (0x42d6 bytes) 000082 1784122471.502160 write 0x039efd thru 0x03ffff (0x6103 bytes) 000083 1784122471.504349 mapread 0x0274c5 thru 0x02d67d (0x61b9 bytes) 000084 1784122471.512135 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa05a7ffd (stale) Mirror 3: 0xa05a7ffd (stale) Mirror 5: 0xa05a7ffd (stale) Mirror 6: 0xa05a7ffd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa05a7ffd (stale) Mirror 3: 0xa05a7ffd (stale) Mirror 5: 0xa05a7ffd (stale) Mirror 6: 0xa05a7ffd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000085 1784122471.624464 read 0x033f18 thru 0x03ffff (0xc0e8 bytes) 000089 1784122471.628335 write 0x00a799 thru 0x0116db (0x6f43 bytes) 000090 1784122471.631752 read 0x00e490 thru 0x00eb14 (0x685 bytes) 000091 1784122471.632137 mapwrite 0x01bd40 thru 0x02b95a (0xfc1b bytes) 000092 1784122471.650968 write 0x02fd91 thru 0x035268 (0x54d8 bytes) 000093 1784122471.651955 read 0x02c18a thru 0x02d491 (0x1308 bytes) 000094 1784122471.652505 mapwrite 0x033761 thru 0x035b1b (0x23bb bytes) 000095 1784122471.665947 trunc from 0x040000 to 0x0100c9 (0x2ff36 bytes) 000099 1784122471.672367 write 0x0093a7 thru 0x013c44 (0xa89e bytes) 000101 1784122471.673967 write 0x02e958 thru 0x0397ba (0xae63 bytes) 000102 1784122471.675260 write 0x034f60 thru 0x03f090 (0xa131 bytes) 000103 1784122471.676228 write 0x000e02 thru 0x002f20 (0x211f bytes) 000107 1784122471.678052 mapwrite 0x022321 thru 0x02c1e8 (0x9ec8 bytes) 000108 1784122471.697617 MIRROR_RESYNC 5 mirrors 000109 1784122471.936460 MIRROR_RESYNC 5 mirrors 000110 1784122472.058560 trunc from 0x03f091 to 0x022b15 (0x1c57b bytes) 000111 1784122472.080277 mapread 0x016cd4 thru 0x0184dc (0x1809 bytes) 000113 1784122472.086061 mapwrite 0x00af6a thru 0x01ad74 (0xfe0b bytes) 000115 1784122472.105153 mapwrite 0x003519 thru 0x00470e (0x11f6 bytes) 000116 1784122472.116179 mapread 0x0227e3 thru 0x022b15 (0x333 bytes) 000117 1784122472.118419 write 0x0184a6 thru 0x01db90 (0x56eb bytes) 000118 1784122472.119222 mapwrite 0x01df32 thru 0x02ac54 (0xcd23 bytes) 000121 1784122472.151571 MIRROR_RESYNC 5 mirrors 000122 1784122472.388948 mapwrite 0x0288de thru 0x028ea0 (0x5c3 bytes) 000125 1784122472.436536 read 0x004454 thru 0x00cce9 (0x8896 bytes) 000127 1784122472.440452 write 0x0271b5 thru 0x033ce7 (0xcb33 bytes) 000128 1784122472.442834 read 0x02355c thru 0x023e39 (0x8de bytes) 000133 1784122472.447252 trunc from 0x033ce8 to 0x0054e2 (0x2e805 bytes) 000134 1784122472.457755 read 0x003cef thru 0x0054e2 (0x17f4 bytes) 000135 1784122472.458221 write 0x03099f thru 0x03e81c (0xde7e bytes) 000137 1784122472.461243 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e81d): Mirror 3: 0x9ea8211d (stale) Mirror 5: 0x9ea8211d (stale) Mirror 6: 0x9ea8211d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e81d): Mirror 3: 0x9ea8211d (stale) Mirror 5: 0x9ea8211d (stale) Mirror 6: 0x9ea8211d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e81d: skipped 000139 1784122472.570454 write 0x02b8c6 thru 0x032258 (0x6993 bytes) 000145 1784122472.577775 MIRROR_RESYNC 4 mirrors 000147 1784122472.796278 write 0x0208b7 thru 0x02c70c (0xbe56 bytes) 000149 1784122472.817753 write 0x024aab thru 0x034930 (0xfe86 bytes) 000150 1784122472.820918 mapread 0x00e115 thru 0x018544 (0xa430 bytes) 000151 1784122472.828638 mapwrite 0x01f961 thru 0x020158 (0x7f8 bytes) 000152 1784122472.847496 read 0x02a9da thru 0x02c89c (0x1ec3 bytes) 000153 1784122472.847980 mapwrite 0x023366 thru 0x02b3a0 (0x803b bytes) 000154 1784122472.861809 mapread 0x00938d thru 0x00ef0b (0x5b7f bytes) 000155 1784122472.862687 write 0x024a80 thru 0x026e7e (0x23ff bytes) 000156 1784122472.863360 mapread 0x0338ee thru 0x0372ec (0x39ff bytes) 000159 1784122472.869887 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3e81d): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e81d): Mirror 3: 0x3583dc21 (stale) Mirror 5: 0x3583dc21 (stale) Mirror 6: 0x3583dc21 (stale) CRC-32 checksum value for chunk [0, 0x3e81d): Mirror 1: 0x660b9661 Mirror 7: 0x660b9661 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e81d: skipped 000160 1784122473.106287 trunc from 0x03e81d to 0x02fbd8 (0xec44 bytes) 000161 1784122473.129062 write 0x00739a thru 0x00a08f (0x2cf6 bytes) 000163 1784122473.132029 trunc from 0x02fbd9 to 0x019159 (0x16a7f bytes) 000164 1784122473.138343 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1915a): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1915a): Mirror 3: 0xd3e4155a (stale) Mirror 5: 0xd3e4155a (stale) Mirror 6: 0xd3e4155a (stale) Mirror 7: 0xd3e4155a (stale) CRC-32 checksum value for chunk [0, 0x1915a): Mirror 1: 0x988dc34a Mirror 8: 0x988dc34a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1915a: skipped 000165 1784122473.392242 trunc from 0x01915a to 0x000542 (0x18c17 bytes) 000166 1784122473.416204 mapwrite 0x01450c thru 0x0234f9 (0xefee bytes) 000167 1784122473.444798 read 0x00b65e thru 0x00f497 (0x3e3a bytes) 000168 1784122473.447478 mapwrite 0x001619 thru 0x004c32 (0x361a bytes) 000169 1784122473.464378 mapread 0x00c624 thru 0x019d78 (0xd755 bytes) 000171 1784122473.465711 mapwrite 0x001797 thru 0x00de72 (0xc6dc bytes) 000172 1784122473.491004 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x234fa): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x234fa): Mirror 3: 0xff817af2 (stale) Mirror 5: 0xff817af2 (stale) Mirror 6: 0xff817af2 (stale) Mirror 7: 0xfcb7fb35 (stale) Mirror 8: 0xd3a3f90 (stale) CRC-32 checksum value for chunk [0, 0x234fa): Mirror 1: 0xf9ec877d Mirror 9: 0xf9ec877d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x234fa: skipped 000173 1784122473.731819 read 0x022a04 thru 0x0234f9 (0xaf6 bytes) 000174 1784122473.735264 mapwrite 0x03b920 thru 0x03ffff (0x46e0 bytes) 000175 1784122473.793884 trunc from 0x040000 to 0x036330 (0x9ccf bytes) 000176 1784122473.803564 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36331): Mirror 5: 0xdf662213 (stale) Mirror 6: 0xdf662213 (stale) Mirror 7: 0x3a7087fa (stale) Mirror 8: 0x9887065d (stale) Mirror 9: 0x185d8923 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36331): Mirror 5: 0xdf662213 (stale) Mirror 6: 0xdf662213 (stale) Mirror 7: 0x3a7087fa (stale) Mirror 8: 0x9887065d (stale) Mirror 9: 0x185d8923 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36331: skipped 000177 1784122473.937548 write 0x0363c5 thru 0x03c747 (0x6383 bytes) 000178 1784122473.941439 write 0x03048d thru 0x03ecb8 (0xe82c bytes) 000181 1784122473.945361 trunc from 0x03ecb9 to 0x022f40 (0x1bd78 bytes) 000182 1784122473.950020 write 0x004804 thru 0x0081ff (0x39fc bytes) 000183 1784122473.952882 trunc from 0x022f41 to 0x0100c9 (0x12e77 bytes) 000185 1784122473.959062 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x100ca): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x100ca): Mirror 5: 0x39d609df (stale) Mirror 6: 0x39d609df (stale) Mirror 7: 0x39d609df (stale) Mirror 8: 0xa506c202 (stale) Mirror 9: 0x96187033 (stale) CRC-32 checksum value for chunk [0, 0x100ca): Mirror 1: 0x167facd0 Mirror 10: 0x167facd0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x100ca: skipped 000186 1784122474.204578 write 0x03213f thru 0x03b41e (0x92e0 bytes) 000188 1784122474.226454 read 0x01d23b thru 0x029a9b (0xc861 bytes) 000189 1784122474.229827 read 0x008089 thru 0x0132a8 (0xb220 bytes) 000190 1784122474.233014 write 0x010bee thru 0x01fc45 (0xf058 bytes) 000191 1784122474.233918 trunc from 0x03b41f to 0x038aff (0x291f bytes) 000194 1784122474.240583 mapwrite 0x031a9b thru 0x038b04 (0x706a bytes) 000195 1784122474.258768 MIRROR_RESYNC 7 mirrors 000196 1784122474.544920 trunc from 0x038b05 to 0x026aff (0x12005 bytes) 000197 1784122474.570579 read 0x00f84b thru 0x01f155 (0xf90b bytes) 000198 1784122474.573673 trunc from 0x026b00 to 0x03a7bc (0x13cbd bytes) 000200 1784122474.580125 mapwrite 0x030a53 thru 0x03eab6 (0xe064 bytes) 000201 1784122474.612560 mapread 0x006084 thru 0x00d1fd (0x717a bytes) 000203 1784122474.617376 mapread 0x0019ba thru 0x008bad (0x71f4 bytes) 000207 1784122474.619818 write 0x010f2f thru 0x01b6ff (0xa7d1 bytes) 000208 1784122474.620904 write 0x00c5f3 thru 0x01ad2f (0xe73d bytes) 000209 1784122474.621915 trunc from 0x03eab7 to 0x00b299 (0x3381d bytes) 000210 1784122474.628060 write 0x014d05 thru 0x01a901 (0x5bfd bytes) 000211 1784122474.629105 trunc from 0x01a902 to 0x0057a5 (0x1515c bytes) 000213 1784122474.634289 write 0x0032cc thru 0x012138 (0xee6d bytes) 000215 1784122474.637955 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x12139): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12139): Mirror 5: 0xd5c158f (stale) Mirror 6: 0xd5c158f (stale) Mirror 7: 0xd5c158f (stale) Mirror 8: 0xd5c158f (stale) Mirror 9: 0xd5c158f (stale) Mirror 10: 0xd5c158f (stale) CRC-32 checksum value for chunk [0, 0x12139): Mirror 1: 0xbbe5cc4c Mirror 11: 0xbbe5cc4c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12139: skipped 000216 1784122474.890965 write 0x03d302 thru 0x03f899 (0x2598 bytes) 000217 1784122474.912801 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f89a): Mirror 5: 0xf22a6715 (stale) Mirror 6: 0xf22a6715 (stale) Mirror 8: 0xf22a6715 (stale) Mirror 9: 0xf22a6715 (stale) Mirror 10: 0xf22a6715 (stale) Mirror 11: 0xe6d13b23 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f89a): Mirror 5: 0xf22a6715 (stale) Mirror 6: 0xf22a6715 (stale) Mirror 8: 0xf22a6715 (stale) Mirror 9: 0xf22a6715 (stale) Mirror 10: 0xf22a6715 (stale) Mirror 11: 0xe6d13b23 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f89a: skipped 000218 1784122475.062222 trunc from 0x03f89a to 0x02ff11 (0xf988 bytes) 000219 1784122475.072111 write 0x01f697 thru 0x02d9b3 (0xe31d bytes) 000222 1784122475.078683 MIRROR_RESYNC 7 mirrors 000223 1784122475.445005 write 0x024a51 thru 0x032613 (0xdbc3 bytes) 000227 1784122475.472219 read 0x00d999 thru 0x0167c4 (0x8e2c bytes) 000228 1784122475.476761 write 0x03d221 thru 0x03fd53 (0x2b33 bytes) 000229 1784122475.477892 mapread 0x0281f4 thru 0x029f77 (0x1d84 bytes) 000230 1784122475.478851 mapread 0x01239e thru 0x01349c (0x10ff bytes) 000234 1784122475.481324 mapwrite 0x0117a1 thru 0x01e9c2 (0xd222 bytes) 000235 1784122475.504457 trunc from 0x03fd54 to 0x01e57b (0x217d8 bytes) 000237 1784122475.512685 read 0x01d0f4 thru 0x01e57b (0x1488 bytes) 000239 1784122475.513428 read 0x0155c2 thru 0x01dcdb (0x871a bytes) 000240 1784122475.513970 mapread 0x002482 thru 0x0067a1 (0x4320 bytes) 000241 1784122475.518124 mapread 0x00c8ee thru 0x016f12 (0xa625 bytes) 000242 1784122475.521968 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e57c): Mirror 5: 0x67dbde48 (stale) Mirror 6: 0x67dbde48 (stale) Mirror 8: 0x67dbde48 (stale) Mirror 9: 0x67dbde48 (stale) Mirror 11: 0x67dbde48 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e57c): Mirror 5: 0x67dbde48 (stale) Mirror 6: 0x67dbde48 (stale) Mirror 8: 0x67dbde48 (stale) Mirror 9: 0x67dbde48 (stale) Mirror 11: 0x67dbde48 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e57c: skipped 000243 1784122475.659840 write 0x00973a thru 0x016ee5 (0xd7ac bytes) 000245 1784122475.664757 mapread 0x01918f thru 0x01e57b (0x53ed bytes) 000246 1784122475.671861 trunc from 0x01e57c to 0x014da8 (0x97d3 bytes) 000247 1784122475.678166 read 0x005582 thru 0x0137d0 (0xe24f bytes) 000249 1784122475.681542 mapread 0x007995 thru 0x00a566 (0x2bd2 bytes) 000251 1784122475.682946 mapread 0x0134b0 thru 0x014da8 (0x18f9 bytes) 000253 1784122475.684192 write 0x021da3 thru 0x025258 (0x34b6 bytes) 000254 1784122475.686928 write 0x02b5b2 thru 0x0380f5 (0xcb44 bytes) 000257 1784122475.689439 mapread 0x014c12 thru 0x01cf48 (0x8337 bytes) 000259 1784122475.694249 write 0x01d0e7 thru 0x022f9d (0x5eb7 bytes) 000261 1784122475.696016 trunc from 0x0380f6 to 0x00b66d (0x2ca88 bytes) 000262 1784122475.705169 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0xb66e): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb66e): Mirror 5: 0x7355714d (stale) Mirror 6: 0x7355714d (stale) Mirror 8: 0x7355714d (stale) Mirror 9: 0x7355714d (stale) Mirror 11: 0x7355714d (stale) CRC-32 checksum value for chunk [0, 0xb66e): Mirror 1: 0x2696b9c2 Mirror 12: 0x2696b9c2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb66e: skipped 000263 1784122475.982455 write 0x003fde thru 0x013847 (0xf86a bytes) 000264 1784122476.005436 MIRROR_RESYNC 7 mirrors 000265 1784122476.363314 write 0x00dae2 thru 0x010171 (0x2690 bytes) 000267 1784122476.392243 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x13848): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13848): Mirror 5: 0xbc46c790 (stale) Mirror 6: 0xbc46c790 (stale) Mirror 8: 0xbc46c790 (stale) Mirror 9: 0xbc46c790 (stale) Mirror 11: 0xbc46c790 (stale) Mirror 12: 0xbc46c790 (stale) CRC-32 checksum value for chunk [0, 0x13848): Mirror 1: 0xc8eeda80 Mirror 13: 0xc8eeda80 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13848: skipped 000268 1784122476.722766 write 0x00dded thru 0x015349 (0x755d bytes) 000269 1784122476.745259 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1534a): Mirror 5: 0x640bfa7 (stale) Mirror 6: 0x640bfa7 (stale) Mirror 8: 0x640bfa7 (stale) Mirror 11: 0x640bfa7 (stale) Mirror 12: 0x640bfa7 (stale) Mirror 13: 0x96187e44 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1534a): Mirror 5: 0x640bfa7 (stale) Mirror 6: 0x640bfa7 (stale) Mirror 8: 0x640bfa7 (stale) Mirror 11: 0x640bfa7 (stale) Mirror 12: 0x640bfa7 (stale) Mirror 13: 0x96187e44 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1534a: skipped 000271 1784122476.878317 mapwrite 0x000fae thru 0x00cb59 (0xbbac bytes) 000272 1784122476.904951 mapread 0x00ab0d thru 0x015349 (0xa83d bytes) 000274 1784122476.911158 mapread 0x003c0f thru 0x00dc29 (0xa01b bytes) 000275 1784122476.912102 mapread 0x006fe4 thru 0x008cf8 (0x1d15 bytes) 000276 1784122476.913023 mapread 0x00f456 thru 0x015349 (0x5ef4 bytes) 000278 1784122476.914493 write 0x02b76f thru 0x02b8a5 (0x137 bytes) 000280 1784122476.915569 mapread 0x0237fd thru 0x02b8a5 (0x80a9 bytes) 000281 1784122476.919531 mapread 0x00574c thru 0x00bf40 (0x67f5 bytes) 000282 1784122476.920759 mapwrite 0x01cf9b thru 0x02ced1 (0xff37 bytes) 000283 1784122476.945580 mapwrite 0x02d387 thru 0x038bc2 (0xb83c bytes) 000284 1784122476.974143 trunc from 0x038bc3 to 0x02ed45 (0x9e7d bytes) 000286 1784122476.981174 mapwrite 0x020b6c thru 0x02fddc (0xf271 bytes) 000287 1784122477.009020 mapwrite 0x031450 thru 0x031bf9 (0x7aa bytes) 000288 1784122477.030578 read 0x021c73 thru 0x03046c (0xe7fa bytes) 000289 1784122477.031175 trunc from 0x031bfa to 0x02fb5f (0x209a bytes) 000292 1784122477.036730 mapread 0x02e340 thru 0x02ea42 (0x703 bytes) 000293 1784122477.037411 trunc from 0x02fb60 to 0x00e934 (0x2122b bytes) 000294 1784122477.042394 mapwrite 0x039835 thru 0x03c614 (0x2de0 bytes) 000296 1784122477.065136 write 0x02aa03 thru 0x033978 (0x8f76 bytes) 000297 1784122477.068358 trunc from 0x03c615 to 0x02472a (0x17eea bytes) 000298 1784122477.076087 mapread 0x0212eb thru 0x02472a (0x3440 bytes) 000302 1784122477.082339 read 0x0085ea thru 0x00bf9f (0x39b6 bytes) 000305 1784122477.084207 write 0x030fd7 thru 0x03426e (0x3298 bytes) 000306 1784122477.088718 MIRROR_RESYNC 7 mirrors 000308 1784122477.419719 write 0x0267dc thru 0x02731f (0xb44 bytes) 000311 1784122477.444979 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3426f): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3426f): Mirror 5: 0x7203f29a (stale) Mirror 6: 0x7203f29a (stale) Mirror 8: 0x7203f29a (stale) Mirror 11: 0x7203f29a (stale) Mirror 12: 0x7203f29a (stale) Mirror 13: 0x7203f29a (stale) CRC-32 checksum value for chunk [0, 0x3426f): Mirror 1: 0x588febd9 Mirror 14: 0x588febd9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3426f: skipped 000315 1784122477.710544 mapwrite 0x00b78a thru 0x00c590 (0xe07 bytes) 000316 1784122477.774550 mapread 0x00ff0a thru 0x01c85a (0xc951 bytes) 000317 1784122477.779833 trunc from 0x03426f to 0x0068a9 (0x2d9c5 bytes) 000318 1784122477.793374 mapread 0x002226 thru 0x0062d4 (0x40af bytes) 000319 1784122477.797339 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x68aa): Mirror 5: 0x10f869fe (stale) Mirror 6: 0x10f869fe (stale) Mirror 8: 0x10f869fe (stale) Mirror 11: 0x10f869fe (stale) Mirror 12: 0x10f869fe (stale) Mirror 13: 0x10f869fe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x68aa): Mirror 5: 0x10f869fe (stale) Mirror 6: 0x10f869fe (stale) Mirror 8: 0x10f869fe (stale) Mirror 11: 0x10f869fe (stale) Mirror 12: 0x10f869fe (stale) Mirror 13: 0x10f869fe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x68aa: skipped 000323 1784122477.911875 mapwrite 0x03cc9c thru 0x03ffff (0x3364 bytes) 000327 1784122477.941161 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xf98cc9a0 (stale) Mirror 8: 0xf98cc9a0 (stale) Mirror 11: 0xf98cc9a0 (stale) Mirror 12: 0xf98cc9a0 (stale) Mirror 13: 0xf98cc9a0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xf98cc9a0 (stale) Mirror 8: 0xf98cc9a0 (stale) Mirror 11: 0xf98cc9a0 (stale) Mirror 12: 0xf98cc9a0 (stale) Mirror 13: 0xf98cc9a0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000328 1784122478.068742 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xf98cc9a0 (stale) Mirror 8: 0xf98cc9a0 (stale) Mirror 11: 0xf98cc9a0 (stale) Mirror 12: 0xf98cc9a0 (stale) Mirror 13: 0xf98cc9a0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xebc2f0a9 Mirror 14: 0xebc2f0a9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000329 1784122478.346251 mapwrite 0x017efc thru 0x026163 (0xe268 bytes) 000330 1784122478.411057 read 0x0185df thru 0x018bd2 (0x5f4 bytes) 000332 1784122478.411995 mapwrite 0x01f9d3 thru 0x02f626 (0xfc54 bytes) 000333 1784122478.439914 write 0x038727 thru 0x03f38c (0x6c66 bytes) 000334 1784122478.447553 MIRROR_RESYNC 7 mirrors 000335 1784122478.767618 write 0x02a9c3 thru 0x038e82 (0xe4c0 bytes) 000336 1784122478.792160 read 0x01f44d thru 0x02e7ab (0xf35f bytes) 000339 1784122478.796856 read 0x00db79 thru 0x0141a2 (0x662a bytes) 000340 1784122478.802774 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x48d963c1 (stale) Mirror 8: 0x48d963c1 (stale) Mirror 11: 0x48d963c1 (stale) Mirror 12: 0x48d963c1 (stale) Mirror 13: 0x48d963c1 (stale) Mirror 14: 0x48d963c1 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x185c4513 Mirror 15: 0x185c4513 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000341 1784122479.072195 trunc from 0x040000 to 0x033fde (0xc021 bytes) 000342 1784122479.101880 read 0x02a13e thru 0x02d9bc (0x387f bytes) 000343 1784122479.103961 mapread 0x000212 thru 0x004b21 (0x4910 bytes) 000345 1784122479.109755 trunc from 0x033fdf to 0x0383eb (0x440d bytes) 000346 1784122479.115318 write 0x02b10c thru 0x02df1d (0x2e12 bytes) 000348 1784122479.116430 mapread 0x030e5b thru 0x03318f (0x2335 bytes) 000349 1784122479.119342 mapread 0x017637 thru 0x01d06e (0x5a38 bytes) 000350 1784122479.122403 write 0x0388ec thru 0x03e11f (0x5834 bytes) 000353 1784122479.123865 mapwrite 0x020b4f thru 0x029b3e (0x8ff0 bytes) 000354 1784122479.138430 write 0x02f2ff thru 0x039066 (0x9d68 bytes) 000355 1784122479.139483 trunc from 0x03e120 to 0x01e35f (0x1fdc0 bytes) 000359 1784122479.145790 mapwrite 0x02b8bc thru 0x02bfad (0x6f2 bytes) 000364 1784122479.166881 write 0x024dd3 thru 0x02f583 (0xa7b1 bytes) 000365 1784122479.168366 write 0x008e9d thru 0x00a49f (0x1603 bytes) 000371 1784122479.171384 write 0x00802c thru 0x01760c (0xf5e1 bytes) 000372 1784122479.174918 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f584): Mirror 8: 0xdd884243 (stale) Mirror 11: 0xdd884243 (stale) Mirror 12: 0xdd884243 (stale) Mirror 13: 0xdd884243 (stale) Mirror 14: 0xdd884243 (stale) Mirror 15: 0xdc4fdac0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f584): Mirror 8: 0xdd884243 (stale) Mirror 11: 0xdd884243 (stale) Mirror 12: 0xdd884243 (stale) Mirror 13: 0xdd884243 (stale) Mirror 14: 0xdd884243 (stale) Mirror 15: 0xdc4fdac0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f584: skipped 000373 1784122479.302588 read 0x02766f thru 0x02b405 (0x3d97 bytes) 000374 1784122479.304998 trunc from 0x02f584 to 0x025345 (0xa23e bytes) 000375 1784122479.309639 trunc from 0x025346 to 0x011d85 (0x135c0 bytes) 000376 1784122479.314368 write 0x014b0d thru 0x021505 (0xc9f9 bytes) 000377 1784122479.317265 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x21506): Mirror 8: 0xe59593ab (stale) Mirror 12: 0xe59593ab (stale) Mirror 13: 0xe59593ab (stale) Mirror 14: 0xe59593ab (stale) Mirror 15: 0xe59593ab (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21506): Mirror 8: 0xe59593ab (stale) Mirror 12: 0xe59593ab (stale) Mirror 13: 0xe59593ab (stale) Mirror 14: 0xe59593ab (stale) Mirror 15: 0xe59593ab (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21506: skipped 000378 1784122479.444124 mapwrite 0x02c8c9 thru 0x03816d (0xb8a5 bytes) 000381 1784122479.476110 mapread 0x00374a thru 0x00e93f (0xb1f6 bytes) 000382 1784122479.479300 read 0x019106 thru 0x0267cc (0xd6c7 bytes) 000385 1784122479.484712 write 0x032647 thru 0x03ffff (0xd9b9 bytes) 000386 1784122479.486227 mapread 0x0346d2 thru 0x0376c4 (0x2ff3 bytes) 000387 1784122479.487290 write 0x01061c thru 0x01f382 (0xed67 bytes) 000388 1784122479.488831 trunc from 0x040000 to 0x039256 (0x6da9 bytes) 000390 1784122479.496944 write 0x00d23f thru 0x0115ce (0x4390 bytes) 000392 1784122479.498075 write 0x031c53 thru 0x03395a (0x1d08 bytes) 000394 1784122479.499031 trunc from 0x039257 to 0x0102ce (0x28f88 bytes) 000397 1784122479.506571 trunc from 0x0102cf to 0x01be07 (0xbb39 bytes) 000398 1784122479.512241 write 0x0096de thru 0x00ee9c (0x57bf bytes) 000399 1784122479.513468 read 0x016034 thru 0x01be07 (0x5dd4 bytes) 000402 1784122479.518013 mapread 0x013027 thru 0x01be07 (0x8de1 bytes) 000403 1784122479.519135 write 0x0198be thru 0x01e561 (0x4ca4 bytes) 000404 1784122479.519878 write 0x01c5a2 thru 0x02b6c3 (0xf122 bytes) 000405 1784122479.520879 mapwrite 0x00809b thru 0x00dd7c (0x5ce2 bytes) 000406 1784122479.537412 trunc from 0x02b6c4 to 0x03c2cb (0x10c08 bytes) 000412 1784122479.546390 write 0x01f100 thru 0x02ecce (0xfbcf bytes) truncating to largest ever: 0x3f54b 000414 1784122479.550034 trunc from 0x03c2cc to 0x03f54a (0x327f bytes) 000417 1784122479.556720 mapread 0x004679 thru 0x00e706 (0xa08e bytes) 000420 1784122479.558409 write 0x017cb9 thru 0x0221d5 (0xa51d bytes) 000421 1784122479.559438 read 0x0326ab thru 0x037cb6 (0x560c bytes) 000422 1784122479.566609 MIRROR_RESYNC 6 mirrors 000425 1784122479.851303 write 0x019afc thru 0x01add3 (0x12d8 bytes) 000426 1784122479.871647 mapwrite 0x0141bb thru 0x01ca7c (0x88c2 bytes) 000431 1784122479.893087 write 0x01f510 thru 0x02b6ad (0xc19e bytes) 000434 1784122479.898089 trunc from 0x03f54b to 0x03c1d3 (0x3377 bytes) 000437 1784122479.911177 trunc from 0x03c1d4 to 0x002e49 (0x3938a bytes) 000439 1784122479.918551 trunc from 0x002e4a to 0x002979 (0x4d0 bytes) 000440 1784122479.923808 write 0x02b660 thru 0x03754f (0xbef0 bytes) 000443 1784122479.925535 mapread 0x024b8d thru 0x0326f0 (0xdb64 bytes) 000445 1784122479.929094 write 0x0282c9 thru 0x030a24 (0x875c bytes) 000447 1784122479.930857 mapwrite 0x01428a thru 0x01522d (0xfa4 bytes) 000448 1784122479.947280 write 0x02f363 thru 0x036c39 (0x78d7 bytes) 000449 1784122479.948421 read 0x02f373 thru 0x03754f (0x81dd bytes) 000450 1784122479.949064 write 0x03a6fa thru 0x03ffff (0x5906 bytes) 000452 1784122479.951915 MIRROR_RESYNC 6 mirrors 000456 1784122480.241889 trunc from 0x040000 to 0x00e6a3 (0x3195c bytes) 000457 1784122480.267124 mapwrite 0x00ab69 thru 0x013477 (0x890f bytes) 000460 1784122480.293112 mapread 0x00232b thru 0x0078e4 (0x55ba bytes) 000461 1784122480.296064 mapread 0x000d8d thru 0x006679 (0x58ed bytes) 000463 1784122480.298749 mapread 0x0020cf thru 0x00ff4c (0xde7e bytes) 000464 1784122480.299867 write 0x026dd9 thru 0x028576 (0x179e bytes) 000465 1784122480.301061 mapwrite 0x033072 thru 0x037228 (0x41b7 bytes) 000466 1784122480.320897 trunc from 0x037229 to 0x01c5a3 (0x1ac85 bytes) 000467 1784122480.325362 read 0x0080ae thru 0x009c64 (0x1bb7 bytes) 000468 1784122480.327637 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1c5a4): Mirror 12: 0xf513705a (stale) Mirror 13: 0xf513705a (stale) Mirror 14: 0xf513705a (stale) Mirror 15: 0xf513705a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c5a4): Mirror 12: 0xf513705a (stale) Mirror 13: 0xf513705a (stale) Mirror 14: 0xf513705a (stale) Mirror 15: 0xf513705a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c5a4: skipped 000469 1784122480.452519 write 0x00405a thru 0x011de6 (0xdd8d bytes) 000471 1784122480.457238 mapwrite 0x0377fa thru 0x03cd4b (0x5552 bytes) 000473 1784122480.482714 mapread 0x02c9f3 thru 0x03077e (0x3d8c bytes) 000474 1784122480.486029 write 0x02ab78 thru 0x036193 (0xb61c bytes) 000475 1784122480.487186 mapread 0x03959a thru 0x039ca4 (0x70b bytes) 000478 1784122480.488931 read 0x01e002 thru 0x028e21 (0xae20 bytes) 000479 1784122480.492895 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cd4c): Mirror 13: 0xfb9c1109 (stale) Mirror 14: 0xfb9c1109 (stale) Mirror 15: 0xfb9c1109 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cd4c): Mirror 13: 0xfb9c1109 (stale) Mirror 14: 0xfb9c1109 (stale) Mirror 15: 0xfb9c1109 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cd4c: skipped 000481 1784122480.591984 mapwrite 0x01dd39 thru 0x01fdbb (0x2083 bytes) 000483 1784122480.608598 trunc from 0x03cd4c to 0x026784 (0x165c7 bytes) 000485 1784122480.614962 MIRROR_RESYNC 4 mirrors 000487 1784122480.824021 mapwrite 0x018598 thru 0x02350f (0xaf78 bytes) 000492 1784122480.888145 mapread 0x0132a2 thru 0x017954 (0x46b3 bytes) 000494 1784122480.889581 mapwrite 0x038f52 thru 0x039139 (0x1e8 bytes) 000496 1784122480.917538 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3913a): Mirror 13: 0x1bd4c2e0 (stale) Mirror 14: 0x1bd4c2e0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3913a): Mirror 13: 0x1bd4c2e0 (stale) Mirror 14: 0x1bd4c2e0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3913a: skipped 000497 1784122481.021083 mapwrite 0x013447 thru 0x01fda9 (0xc963 bytes) 000499 1784122481.044446 write 0x03442f thru 0x03e080 (0x9c52 bytes) 000501 1784122481.047747 mapwrite 0x009363 thru 0x017e3e (0xeadc bytes) 000503 1784122481.065773 read 0x00268d thru 0x011017 (0xe98b bytes) 000504 1784122481.068291 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e081): Mirror 14: 0xa8460b7d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e081): Mirror 14: 0xa8460b7d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e081: skipped 000506 1784122481.145792 mapread 0x020369 thru 0x02c913 (0xc5ab bytes) 000507 1784122481.155480 mapwrite 0x01993d thru 0x02686f (0xcf33 bytes) 000508 1784122481.175093 mapwrite 0x005e82 thru 0x011851 (0xb9d0 bytes) 000509 1784122481.194509 write 0x036eea thru 0x038ee5 (0x1ffc bytes) 000512 1784122481.197976 write 0x0244ea thru 0x02b79f (0x72b6 bytes) 000513 1784122481.198583 mapwrite 0x016abd thru 0x019623 (0x2b67 bytes) 000514 1784122481.210415 mapread 0x00dadd thru 0x018925 (0xae49 bytes) 000516 1784122481.213991 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) 000517 1784122481.251822 mapwrite 0x03762c thru 0x03ffff (0x89d4 bytes) 000520 1784122481.280082 mapread 0x035824 thru 0x03b278 (0x5a55 bytes) 000521 1784122481.281356 mapwrite 0x020c6c thru 0x0221e3 (0x1578 bytes) 000522 1784122481.297398 mapread 0x038ba9 thru 0x039ea4 (0x12fc bytes) 000524 1784122481.298365 trunc from 0x040000 to 0x036c46 (0x93b9 bytes) 000526 1784122481.305797 MIRROR_EXTEND to 2 mirrors 000527 1784122481.494195 MIRROR_EXTEND to 3 mirrors 000528 1784122481.687344 write 0x013beb thru 0x01e4fc (0xa912 bytes) 000531 1784122481.709413 trunc from 0x036c47 to 0x011972 (0x252d4 bytes) 000532 1784122481.715403 write 0x01b55b thru 0x01d662 (0x2108 bytes) 000533 1784122481.716325 mapread 0x003b3c thru 0x00ee26 (0xb2eb bytes) 000535 1784122481.723001 trunc from 0x01d663 to 0x02d597 (0xff35 bytes) 000538 1784122481.728867 mapread 0x017610 thru 0x0179f1 (0x3e2 bytes) 000542 1784122481.733443 write 0x02288b thru 0x025234 (0x29aa bytes) 000543 1784122481.736421 read 0x01581e thru 0x022cce (0xd4b1 bytes) 000544 1784122481.740232 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d598): Mirror 3: 0x632d1a29 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d598): Mirror 3: 0x632d1a29 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d598: skipped 000545 1784122481.844036 trunc from 0x02d598 to 0x001f13 (0x2b684 bytes) 000547 1784122481.849578 mapwrite 0x01505a thru 0x0199c4 (0x496b bytes) 000548 1784122481.874716 mapwrite 0x0308dc thru 0x03239f (0x1ac4 bytes) 000550 1784122481.893002 read 0x029ce0 thru 0x029fdb (0x2fc bytes) 000552 1784122481.893880 mapwrite 0x03f26d thru 0x03ffff (0xd93 bytes) 000554 1784122481.911675 trunc from 0x040000 to 0x02d77c (0x12883 bytes) 000555 1784122481.917117 read 0x024011 thru 0x02533a (0x132a bytes) 000561 1784122481.925043 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) 000562 1784122481.970087 write 0x028db3 thru 0x02b797 (0x29e5 bytes) 000564 1784122481.975437 write 0x00a629 thru 0x014f97 (0xa96f bytes) 000565 1784122481.979865 read 0x01aa13 thru 0x01e1bf (0x37ad bytes) 000568 1784122481.986696 trunc from 0x02d77d to 0x03186b (0x40ef bytes) 000570 1784122481.996240 MIRROR_EXTEND to 2 mirrors 000571 1784122482.205426 MIRROR_RESYNC 2 mirrors 000572 1784122482.321885 write 0x01dfe8 thru 0x01f91c (0x1935 bytes) 000574 1784122482.347190 trunc from 0x03186c to 0x02bc1b (0x5c50 bytes) 000575 1784122482.354162 trunc from 0x02bc1c to 0x03d33a (0x1171f bytes) 000576 1784122482.360018 mapwrite 0x01c187 thru 0x028007 (0xbe81 bytes) 000588 1784122482.388213 mapread 0x02793c thru 0x036b40 (0xf205 bytes) 000589 1784122482.395389 read 0x02e5b3 thru 0x035276 (0x6cc4 bytes) 000590 1784122482.396038 mapwrite 0x03d521 thru 0x03ffff (0x2adf bytes) 000591 1784122482.413032 write 0x018900 thru 0x027188 (0xe889 bytes) 000592 1784122482.415058 read 0x004288 thru 0x013412 (0xf18b bytes) 000596 1784122482.420867 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xc6d11664 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2f5abb9b Mirror 3: 0x2f5abb9b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000597 1784122482.659176 trunc from 0x040000 to 0x0271e9 (0x18e16 bytes) 000598 1784122482.691522 write 0x035af3 thru 0x03ffff (0xa50d bytes) 000600 1784122482.693322 read 0x03947b thru 0x03ffff (0x6b85 bytes) 000601 1784122482.695925 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xc6d11664 (stale) Mirror 3: 0x2f5abb9b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe8da950c Mirror 4: 0xe8da950c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000604 1784122482.965232 trunc from 0x040000 to 0x01f7b8 (0x20847 bytes) 000605 1784122483.009058 read 0x00df7c thru 0x0126e0 (0x4765 bytes) 000607 1784122483.013524 trunc from 0x01f7b9 to 0x03bbac (0x1c3f4 bytes) 000608 1784122483.021442 read 0x038c8e thru 0x03bbac (0x2f1f bytes) 000609 1784122483.029155 MIRROR_RESYNC 4 mirrors 000610 1784122483.294166 mapwrite 0x01bd73 thru 0x026e9d (0xb12b bytes) 000611 1784122483.355921 trunc from 0x03bbad to 0x00c44f (0x2f75d bytes) 000612 1784122483.368347 write 0x009291 thru 0x00ee3c (0x5bac bytes) 000614 1784122483.371364 trunc from 0x00ee3d to 0x0225f2 (0x137b6 bytes) 000619 1784122483.379265 mapwrite 0x0288aa thru 0x033fcf (0xb726 bytes) 000622 1784122483.406792 write 0x038221 thru 0x03ffff (0x7ddf bytes) 000623 1784122483.407872 write 0x006a9e thru 0x00cdc4 (0x6327 bytes) 000624 1784122483.410643 read 0x016aba thru 0x022b6c (0xc0b3 bytes) 000625 1784122483.414014 trunc from 0x040000 to 0x00e38d (0x31c72 bytes) 000626 1784122483.420086 read 0x00db4f thru 0x00e38d (0x83f bytes) 000627 1784122483.422333 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe38e): Mirror 2: 0x6f724bd9 (stale) Mirror 3: 0x6f724bd9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe38e): Mirror 2: 0x6f724bd9 (stale) Mirror 3: 0x6f724bd9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe38e: skipped 000631 1784122483.524915 trunc from 0x00e38e to 0x01800a (0x9c7d bytes) 000632 1784122483.530298 read 0x0166eb thru 0x01800a (0x1920 bytes) 000634 1784122483.533950 read 0x00b119 thru 0x00baa3 (0x98b bytes) 000636 1784122483.538289 read 0x014263 thru 0x017a42 (0x37e0 bytes) 000637 1784122483.538928 trunc from 0x01800b to 0x02fa0e (0x17a04 bytes) 000638 1784122483.547842 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fa0f): Mirror 3: 0x28ae341e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fa0f): Mirror 3: 0x28ae341e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fa0f: skipped 000639 1784122483.644643 read 0x0205e0 thru 0x02fa0e (0xf42f bytes) 000640 1784122483.650403 MIRROR_RESYNC 2 mirrors 000641 1784122483.836107 trunc from 0x02fa0f to 0x0257c3 (0xa24b bytes) 000642 1784122483.861586 write 0x03357f thru 0x0344a8 (0xf2a bytes) 000647 1784122483.863980 mapread 0x01f5d6 thru 0x021086 (0x1ab1 bytes) 000649 1784122483.872014 trunc from 0x0344a9 to 0x03b869 (0x73c1 bytes) 000650 1784122483.881747 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) 000651 1784122483.929162 write 0x0177f2 thru 0x024df3 (0xd602 bytes) 000653 1784122483.933548 mapread 0x029231 thru 0x02df9c (0x4d6c bytes) 000654 1784122483.939090 write 0x038473 thru 0x03ffff (0x7b8d bytes) truncating to largest ever: 0x3fd07 000656 1784122483.941769 trunc from 0x040000 to 0x03fd06 (0x2f9 bytes) 000657 1784122483.946482 mapwrite 0x02c659 thru 0x036f5d (0xa905 bytes) 000659 1784122483.963552 mapwrite 0x010235 thru 0x01e357 (0xe123 bytes) 000660 1784122483.981584 read 0x008980 thru 0x0173c7 (0xea48 bytes) 000661 1784122483.984297 mapread 0x037727 thru 0x03bb5e (0x4438 bytes) 000662 1784122483.985148 write 0x016652 thru 0x0186f1 (0x20a0 bytes) 000667 1784122483.987605 read 0x008428 thru 0x013f2c (0xbb05 bytes) 000669 1784122483.991029 MIRROR_EXTEND to 2 mirrors 000670 1784122484.159191 MIRROR_RESYNC 2 mirrors 000671 1784122484.260602 mapread 0x03bb87 thru 0x03fd06 (0x4180 bytes) 000673 1784122484.266328 mapread 0x00ab9a thru 0x019f6b (0xf3d2 bytes) 000674 1784122484.271548 read 0x028049 thru 0x0314fc (0x94b4 bytes) 000675 1784122484.274218 write 0x01d8f1 thru 0x020b66 (0x3276 bytes) 000677 1784122484.296498 mapread 0x037faf thru 0x03fd06 (0x7d58 bytes) 000679 1784122484.300189 trunc from 0x03fd07 to 0x0010c1 (0x3ec45 bytes) 000680 1784122484.306777 trunc from 0x0010c2 to 0x0264c7 (0x25406 bytes) 000681 1784122484.311732 mapread 0x025514 thru 0x0264c7 (0xfb4 bytes) 000683 1784122484.315714 read 0x00bf2d thru 0x0197f9 (0xd8cd bytes) 000685 1784122484.321521 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x264c8): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x264c8): Mirror 2: 0x41b31976 (stale) CRC-32 checksum value for chunk [0, 0x264c8): Mirror 1: 0x60ede3dc Mirror 3: 0x60ede3dc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x264c8: skipped 000686 1784122484.530678 mapwrite 0x033b93 thru 0x03ffff (0xc46d bytes) 000687 1784122484.572363 write 0x035d0c thru 0x03ffff (0xa2f4 bytes) 000689 1784122484.573476 mapread 0x010aea thru 0x016051 (0x5568 bytes) 000692 1784122484.577372 mapread 0x03bdef thru 0x03ffff (0x4211 bytes) 000694 1784122484.578310 trunc from 0x040000 to 0x0058b9 (0x3a746 bytes) 000696 1784122484.585181 trunc from 0x0058ba to 0x021425 (0x1bb6c bytes) 000697 1784122484.590242 mapwrite 0x01e2ff thru 0x0279f1 (0x96f3 bytes) 000700 1784122484.615211 mapread 0x01b108 thru 0x023197 (0x8090 bytes) 000703 1784122484.616886 write 0x01b326 thru 0x021aab (0x6786 bytes) 000704 1784122484.617880 read 0x00068f thru 0x003d0b (0x367d bytes) 000705 1784122484.622473 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x279f2): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x279f2): Mirror 2: 0x3477081e (stale) Mirror 3: 0x486c9bfb (stale) CRC-32 checksum value for chunk [0, 0x279f2): Mirror 1: 0x81b8364 Mirror 4: 0x81b8364 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x279f2: skipped 000706 1784122484.835400 write 0x0241a5 thru 0x02e8fb (0xa757 bytes) 000707 1784122484.855044 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2e8fc): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e8fc): Mirror 2: 0x8b093c98 (stale) Mirror 3: 0xd9babd7e (stale) Mirror 4: 0x66a41cb2 (stale) CRC-32 checksum value for chunk [0, 0x2e8fc): Mirror 1: 0xd2d26524 Mirror 5: 0xd2d26524 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e8fc: skipped 000708 1784122485.081573 mapread 0x0076e5 thru 0x0099af (0x22cb bytes) 000709 1784122485.090364 mapwrite 0x032a4a thru 0x03ef28 (0xc4df bytes) 000710 1784122485.137198 trunc from 0x03ef29 to 0x01d286 (0x21ca2 bytes) 000711 1784122485.143561 mapwrite 0x02f473 thru 0x03409a (0x4c28 bytes) 000712 1784122485.163369 write 0x019228 thru 0x02741b (0xe1f4 bytes) 000713 1784122485.167563 mapwrite 0x032655 thru 0x0344f6 (0x1ea2 bytes) 000714 1784122485.189542 MIRROR_RESYNC 5 mirrors 000715 1784122485.461147 MIRROR_RESYNC 5 mirrors 000716 1784122485.598554 trunc from 0x0344f7 to 0x009899 (0x2ac5d bytes) 000717 1784122485.625266 read 0x00122a thru 0x009899 (0x8670 bytes) 000718 1784122485.628290 mapwrite 0x0024f8 thru 0x011c07 (0xf710 bytes) 000720 1784122485.656913 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x11c08): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11c08): Mirror 2: 0xae88b02d (stale) Mirror 3: 0xae88b02d (stale) Mirror 4: 0xae88b02d (stale) Mirror 5: 0xae88b02d (stale) CRC-32 checksum value for chunk [0, 0x11c08): Mirror 1: 0x7ee19cb6 Mirror 6: 0x7ee19cb6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11c08: skipped 000721 1784122485.874181 read 0x0026ac thru 0x009dc6 (0x771b bytes) 000723 1784122485.877605 trunc from 0x011c08 to 0x024a82 (0x12e7b bytes) 000724 1784122485.905987 mapread 0x009ffc thru 0x00f81a (0x581f bytes) 000725 1784122485.912256 mapwrite 0x0073c0 thru 0x007ce6 (0x927 bytes) 000726 1784122485.923188 write 0x02666a thru 0x031670 (0xb007 bytes) 000728 1784122485.925003 mapwrite 0x02172e thru 0x02d374 (0xbc47 bytes) 000730 1784122485.945613 MIRROR_RESYNC 6 mirrors 000731 1784122486.221366 MIRROR_EXTEND to 7 mirrors 000732 1784122486.417131 read 0x01fca3 thru 0x02284c (0x2baa bytes) 000734 1784122486.419930 mapwrite 0x03aff6 thru 0x03ffff (0x500a bytes) 000736 1784122486.462514 mapread 0x02f5ba thru 0x035ec6 (0x690d bytes) 000737 1784122486.466116 mapread 0x01806e thru 0x023032 (0xafc5 bytes) 000740 1784122486.472499 read 0x02ac36 thru 0x039f9f (0xf36a bytes) 000741 1784122486.474580 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1697bc09 (stale) Mirror 3: 0x1697bc09 (stale) Mirror 4: 0x1697bc09 (stale) Mirror 5: 0x1697bc09 (stale) Mirror 6: 0x1697bc09 (stale) Mirror 7: 0x1697bc09 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x10d3eab9 Mirror 8: 0x10d3eab9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000742 1784122486.699484 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1697bc09 (stale) Mirror 3: 0x1697bc09 (stale) Mirror 4: 0x1697bc09 (stale) Mirror 5: 0x1697bc09 (stale) Mirror 6: 0x1697bc09 (stale) Mirror 7: 0x1697bc09 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x10d3eab9 Mirror 8: 0x10d3eab9 Mirror 9: 0x10d3eab9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000744 1784122486.939261 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1697bc09 (stale) Mirror 3: 0x1697bc09 (stale) Mirror 4: 0x1697bc09 (stale) Mirror 6: 0x1697bc09 (stale) Mirror 7: 0x1697bc09 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1697bc09 (stale) Mirror 3: 0x1697bc09 (stale) Mirror 4: 0x1697bc09 (stale) Mirror 6: 0x1697bc09 (stale) Mirror 7: 0x1697bc09 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x10d3eab9 Mirror 8: 0x10d3eab9 Mirror 9: 0x10d3eab9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000745 1784122487.189536 mapwrite 0x033f98 thru 0x03ffff (0xc068 bytes) 000749 1784122487.254506 MIRROR_RESYNC 8 mirrors 000750 1784122487.656548 trunc from 0x040000 to 0x02f94f (0x106b0 bytes) 000752 1784122487.682293 mapread 0x003618 thru 0x008657 (0x5040 bytes) 000753 1784122487.695480 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f950): Mirror 2: 0x87a99cdc (stale) Mirror 3: 0x87a99cdc (stale) Mirror 6: 0x87a99cdc (stale) Mirror 7: 0x87a99cdc (stale) Mirror 8: 0x87a99cdc (stale) Mirror 9: 0x87a99cdc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f950): Mirror 2: 0x87a99cdc (stale) Mirror 3: 0x87a99cdc (stale) Mirror 6: 0x87a99cdc (stale) Mirror 7: 0x87a99cdc (stale) Mirror 8: 0x87a99cdc (stale) Mirror 9: 0x87a99cdc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f950: skipped 000755 1784122487.876849 trunc from 0x02f950 to 0x002b82 (0x2cdcd bytes) 000758 1784122487.885929 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b83): Mirror 3: 0x423fcd4c (stale) Mirror 6: 0x423fcd4c (stale) Mirror 7: 0x423fcd4c (stale) Mirror 8: 0x423fcd4c (stale) Mirror 9: 0x423fcd4c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b83): Mirror 3: 0x423fcd4c (stale) Mirror 6: 0x423fcd4c (stale) Mirror 7: 0x423fcd4c (stale) Mirror 8: 0x423fcd4c (stale) Mirror 9: 0x423fcd4c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b83: skipped 000761 1784122487.981395 trunc from 0x002b83 to 0x01ce4f (0x1a2cd bytes) 000763 1784122487.987517 write 0x004143 thru 0x0045b6 (0x474 bytes) 000764 1784122487.990097 read 0x00783e thru 0x01523a (0xd9fd bytes) 000769 1784122487.995750 read 0x01381b thru 0x01ce4f (0x9635 bytes) 000770 1784122487.999813 write 0x014d10 thru 0x019cab (0x4f9c bytes) 000771 1784122488.000842 mapwrite 0x007bd3 thru 0x00ecbd (0x70eb bytes) 000772 1784122488.020898 mapread 0x0197de thru 0x01ce4f (0x3672 bytes) 000773 1784122488.023735 MIRROR_RESYNC 6 mirrors 000774 1784122488.307184 read 0x009e90 thru 0x013f1c (0xa08d bytes) 000775 1784122488.309877 write 0x0054d7 thru 0x00833d (0x2e67 bytes) 000776 1784122488.331464 mapwrite 0x036a0c thru 0x03ffff (0x95f4 bytes) 000777 1784122488.359263 trunc from 0x040000 to 0x03503e (0xafc1 bytes) 000778 1784122488.364289 mapread 0x01acb2 thru 0x01c550 (0x189f bytes) 000779 1784122488.367978 mapwrite 0x01e9fd thru 0x024103 (0x5707 bytes) 000780 1784122488.386178 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3503f): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3503f): Mirror 3: 0x3ad92ce1 (stale) Mirror 6: 0x3ad92ce1 (stale) Mirror 7: 0x3ad92ce1 (stale) Mirror 8: 0x3ad92ce1 (stale) Mirror 9: 0x3ad92ce1 (stale) CRC-32 checksum value for chunk [0, 0x3503f): Mirror 1: 0x645aa464 Mirror 10: 0x645aa464 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3503f: skipped 000782 1784122488.653849 read 0x0178d9 thru 0x020cb8 (0x93e0 bytes) 000783 1784122488.658207 mapread 0x027cd2 thru 0x03503e (0xd36d bytes) 000784 1784122488.670245 read 0x00d4b9 thru 0x015dd3 (0x891b bytes) 000785 1784122488.674822 mapwrite 0x021970 thru 0x025d1c (0x43ad bytes) 000786 1784122488.729911 read 0x003c23 thru 0x010731 (0xcb0f bytes) 000787 1784122488.733571 mapread 0x01c4e1 thru 0x01e1cb (0x1ceb bytes) 000788 1784122488.734335 mapread 0x03068f thru 0x03503e (0x49b0 bytes) 000791 1784122488.736016 write 0x02bdf0 thru 0x030468 (0x4679 bytes) 000792 1784122488.736862 trunc from 0x03503f to 0x0313f3 (0x3c4b bytes) 000796 1784122488.749789 trunc from 0x0313f4 to 0x024d85 (0xc66e bytes) 000797 1784122488.754786 write 0x03fce8 thru 0x03ffff (0x318 bytes) 000798 1784122488.755564 write 0x016688 thru 0x01d319 (0x6c92 bytes) 000799 1784122488.756353 mapread 0x00a4d3 thru 0x00cd98 (0x28c6 bytes) 000800 1784122488.757255 mapwrite 0x01e01c thru 0x029b5a (0xbb3f bytes) 000803 1784122488.783065 read 0x0355a3 thru 0x03ffff (0xaa5d bytes) 000805 1784122488.787597 mapwrite 0x000b9e thru 0x0026f5 (0x1b58 bytes) 000806 1784122488.800882 mapwrite 0x007114 thru 0x00d002 (0x5eef bytes) 000809 1784122488.821858 trunc from 0x040000 to 0x016fba (0x29045 bytes) 000810 1784122488.828861 mapwrite 0x0031ab thru 0x0044b9 (0x130f bytes) 000815 1784122488.847791 write 0x027993 thru 0x02b791 (0x3dff bytes) 000818 1784122488.849713 mapwrite 0x00a2ab thru 0x0185b9 (0xe30f bytes) 000820 1784122488.870814 read 0x006150 thru 0x006d76 (0xc27 bytes) 000821 1784122488.873822 MIRROR_RESYNC 7 mirrors 000822 1784122489.202961 write 0x0228e7 thru 0x028e8c (0x65a6 bytes) 000825 1784122489.224439 write 0x021f2a thru 0x02cec0 (0xaf97 bytes) 000826 1784122489.226797 trunc from 0x02cec1 to 0x02ee1b (0x1f5b bytes) 000827 1784122489.233557 read 0x007de6 thru 0x009797 (0x19b2 bytes) 000828 1784122489.236094 write 0x00e67a thru 0x01bda7 (0xd72e bytes) 000830 1784122489.242556 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2ee1c): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ee1c): Mirror 3: 0x3a87f85a (stale) Mirror 6: 0x3a87f85a (stale) Mirror 7: 0x3a87f85a (stale) Mirror 8: 0x3a87f85a (stale) Mirror 9: 0x3a87f85a (stale) Mirror 10: 0x3a87f85a (stale) CRC-32 checksum value for chunk [0, 0x2ee1c): Mirror 1: 0xf4373ccf Mirror 11: 0xf4373ccf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ee1c: skipped 000831 1784122489.495322 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2ee1c): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ee1c): Mirror 3: 0x3a87f85a (stale) Mirror 6: 0x3a87f85a (stale) Mirror 7: 0x3a87f85a (stale) Mirror 8: 0x3a87f85a (stale) Mirror 9: 0x3a87f85a (stale) Mirror 10: 0x3a87f85a (stale) CRC-32 checksum value for chunk [0, 0x2ee1c): Mirror 1: 0xf4373ccf Mirror 11: 0xf4373ccf Mirror 12: 0xf4373ccf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ee1c: skipped 000832 1784122489.774837 trunc from 0x02ee1c to 0x0212a4 (0xdb77 bytes) 000833 1784122489.800275 trunc from 0x0212a5 to 0x02b6df (0xa43b bytes) 000835 1784122489.806228 write 0x010a24 thru 0x020955 (0xff32 bytes) 000837 1784122489.810189 write 0x037e7e thru 0x03e9ce (0x6b51 bytes) 000838 1784122489.813158 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e9cf): Mirror 3: 0x59ece219 (stale) Mirror 6: 0x59ece219 (stale) Mirror 7: 0x59ece219 (stale) Mirror 8: 0x59ece219 (stale) Mirror 9: 0x59ece219 (stale) Mirror 11: 0xb12d16cc (stale) Mirror 12: 0xb12d16cc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e9cf): Mirror 3: 0x59ece219 (stale) Mirror 6: 0x59ece219 (stale) Mirror 7: 0x59ece219 (stale) Mirror 8: 0x59ece219 (stale) Mirror 9: 0x59ece219 (stale) Mirror 11: 0xb12d16cc (stale) Mirror 12: 0xb12d16cc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e9cf: skipped 000840 1784122490.002451 trunc from 0x03e9cf to 0x017842 (0x2718c bytes) 000841 1784122490.009966 mapread 0x0142d8 thru 0x017842 (0x356b bytes) 000843 1784122490.019553 write 0x007c12 thru 0x009a5b (0x1e4a bytes) 000845 1784122490.027384 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17843): Mirror 3: 0x3a8db304 (stale) Mirror 6: 0x3a8db304 (stale) Mirror 7: 0x3a8db304 (stale) Mirror 8: 0x3a8db304 (stale) Mirror 11: 0xef5398e5 (stale) Mirror 12: 0xef5398e5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17843): Mirror 3: 0x3a8db304 (stale) Mirror 6: 0x3a8db304 (stale) Mirror 7: 0x3a8db304 (stale) Mirror 8: 0x3a8db304 (stale) Mirror 11: 0xef5398e5 (stale) Mirror 12: 0xef5398e5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17843: skipped 000847 1784122490.279759 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17843): Mirror 3: 0x3a8db304 (stale) Mirror 7: 0x3a8db304 (stale) Mirror 8: 0x3a8db304 (stale) Mirror 11: 0xef5398e5 (stale) Mirror 12: 0xef5398e5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17843): Mirror 3: 0x3a8db304 (stale) Mirror 7: 0x3a8db304 (stale) Mirror 8: 0x3a8db304 (stale) Mirror 11: 0xef5398e5 (stale) Mirror 12: 0xef5398e5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17843: skipped 000850 1784122490.429697 write 0x01e171 thru 0x028716 (0xa5a6 bytes) 000852 1784122490.431541 trunc from 0x028717 to 0x01f5da (0x913c bytes) 000853 1784122490.438855 mapwrite 0x02b1a2 thru 0x035fd4 (0xae33 bytes) 000854 1784122490.470852 MIRROR_RESYNC 6 mirrors 000856 1784122490.798277 mapwrite 0x0121ad thru 0x016a54 (0x48a8 bytes) 000857 1784122490.852233 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x35fd5): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35fd5): Mirror 3: 0xfac57b40 (stale) Mirror 7: 0xfac57b40 (stale) Mirror 8: 0xfac57b40 (stale) Mirror 11: 0xfac57b40 (stale) Mirror 12: 0xfac57b40 (stale) CRC-32 checksum value for chunk [0, 0x35fd5): Mirror 1: 0xeea3d6ba Mirror 13: 0xeea3d6ba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35fd5: skipped 000858 1784122491.107991 read 0x00697f thru 0x00864d (0x1ccf bytes) 000859 1784122491.110899 read 0x019545 thru 0x0263db (0xce97 bytes) 000860 1784122491.115091 mapread 0x026e4c thru 0x02ddfc (0x6fb1 bytes) 000863 1784122491.121305 MIRROR_RESYNC 7 mirrors 000864 1784122491.411259 mapwrite 0x00f617 thru 0x015064 (0x5a4e bytes) 000865 1784122491.470115 mapread 0x000368 thru 0x00f816 (0xf4af bytes) 000869 1784122491.476328 write 0x02822d thru 0x029884 (0x1658 bytes) 000871 1784122491.481258 trunc from 0x035fd5 to 0x0144a5 (0x21b2f bytes) 000873 1784122491.495046 mapwrite 0x010961 thru 0x01b70d (0xadad bytes) 000874 1784122491.523262 mapwrite 0x032624 thru 0x03878e (0x616b bytes) 000875 1784122491.544476 mapread 0x01b9a5 thru 0x02ac20 (0xf27c bytes) 000876 1784122491.552004 mapwrite 0x02794c thru 0x035ef1 (0xe5a6 bytes) 000877 1784122491.568750 write 0x039cf1 thru 0x03ffff (0x630f bytes) 000878 1784122491.569750 mapread 0x030cb8 thru 0x03e783 (0xdacc bytes) 000879 1784122491.572748 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1ffc2af0 (stale) Mirror 7: 0x1ffc2af0 (stale) Mirror 11: 0x1ffc2af0 (stale) Mirror 12: 0x1ffc2af0 (stale) Mirror 13: 0x1ffc2af0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1ffc2af0 (stale) Mirror 7: 0x1ffc2af0 (stale) Mirror 11: 0x1ffc2af0 (stale) Mirror 12: 0x1ffc2af0 (stale) Mirror 13: 0x1ffc2af0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000880 1784122491.702489 mapread 0x02d801 thru 0x03bac7 (0xe2c7 bytes) 000881 1784122491.711801 mapwrite 0x003c06 thru 0x010dd7 (0xd1d2 bytes) 000883 1784122491.730746 mapread 0x018cf0 thru 0x01b73d (0x2a4e bytes) 000884 1784122491.734251 trunc from 0x040000 to 0x0224b4 (0x1db4b bytes) 000885 1784122491.739356 trunc from 0x0224b5 to 0x019ec6 (0x85ee bytes) 000887 1784122491.745030 mapwrite 0x00965c thru 0x015bea (0xc58f bytes) 000888 1784122491.760775 trunc from 0x019ec7 to 0x01e9a6 (0x4ae0 bytes) 000889 1784122491.768925 MIRROR_RESYNC 6 mirrors 000891 1784122492.053564 mapwrite 0x02748d thru 0x028296 (0xe0a bytes) 000893 1784122492.096636 mapread 0x016e91 thru 0x017f83 (0x10f3 bytes) 000894 1784122492.100975 trunc from 0x028297 to 0x008594 (0x1fd02 bytes) 000895 1784122492.109215 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x8595): Mirror 3: 0x4e351db6 (stale) Mirror 11: 0x4e351db6 (stale) Mirror 12: 0x4e351db6 (stale) Mirror 13: 0x4e351db6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8595): Mirror 3: 0x4e351db6 (stale) Mirror 11: 0x4e351db6 (stale) Mirror 12: 0x4e351db6 (stale) Mirror 13: 0x4e351db6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8595: skipped 000896 1784122492.217017 mapread 0x00046d thru 0x008594 (0x8128 bytes) 000897 1784122492.228106 write 0x021491 thru 0x0232f0 (0x1e60 bytes) 000900 1784122492.229939 write 0x03db19 thru 0x03ffff (0x24e7 bytes) 000901 1784122492.230978 read 0x026233 thru 0x0349b6 (0xe784 bytes) 000902 1784122492.234592 mapread 0x01af0e thru 0x024b7d (0x9c70 bytes) 000903 1784122492.242851 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xef713ff7 (stale) Mirror 12: 0xef713ff7 (stale) Mirror 13: 0xef713ff7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xef713ff7 (stale) Mirror 12: 0xef713ff7 (stale) Mirror 13: 0xef713ff7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000904 1784122492.360789 mapwrite 0x004d5a thru 0x004f48 (0x1ef bytes) 000906 1784122492.375997 read 0x0143b0 thru 0x019d83 (0x59d4 bytes) 000907 1784122492.379612 mapread 0x00383b thru 0x00df2c (0xa6f2 bytes) 000908 1784122492.384798 read 0x03f09c thru 0x03ffff (0xf64 bytes) 000910 1784122492.390193 write 0x03babe thru 0x03bcc3 (0x206 bytes) 000911 1784122492.391083 write 0x019df5 thru 0x026e8d (0xd099 bytes) 000912 1784122492.392023 trunc from 0x040000 to 0x02a711 (0x158ee bytes) 000913 1784122492.397948 trunc from 0x02a712 to 0x0152ea (0x15427 bytes) 000914 1784122492.402879 mapread 0x009bd0 thru 0x00ef28 (0x5359 bytes) 000916 1784122492.406770 MIRROR_RESYNC 4 mirrors 000918 1784122492.626344 mapwrite 0x01f562 thru 0x02747b (0x7f1a bytes) 000919 1784122492.673088 read 0x0070bf thru 0x0129df (0xb921 bytes) 000921 1784122492.676413 trunc from 0x02747c to 0x016706 (0x10d75 bytes) 000922 1784122492.683913 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16707): Mirror 12: 0x34a01649 (stale) Mirror 13: 0x34a01649 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16707): Mirror 12: 0x34a01649 (stale) Mirror 13: 0x34a01649 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16707: skipped 000923 1784122492.774807 write 0x00212a thru 0x004f3e (0x2e15 bytes) 000925 1784122492.778823 mapread 0x00d23f thru 0x016706 (0x94c8 bytes) 000928 1784122492.785232 mapwrite 0x02a624 thru 0x033bee (0x95cb bytes) 000929 1784122492.813121 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x33bef): Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33bef): Mirror 12: 0x3a4590f (stale) Mirror 13: 0x3a4590f (stale) CRC-32 checksum value for chunk [0, 0x33bef): Mirror 1: 0x436aa5fe Mirror 14: 0x436aa5fe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33bef: skipped 000931 1784122493.039187 mapwrite 0x02c6c7 thru 0x030172 (0x3aac bytes) 000932 1784122493.088223 mapread 0x0168c6 thru 0x01865c (0x1d97 bytes) 000933 1784122493.093198 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x33bef): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33bef): Mirror 12: 0x3a4590f (stale) Mirror 13: 0x3a4590f (stale) Mirror 14: 0x436aa5fe (stale) CRC-32 checksum value for chunk [0, 0x33bef): Mirror 1: 0xcfc4f8aa Mirror 15: 0xcfc4f8aa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33bef: skipped 000934 1784122493.323959 read 0x026700 thru 0x031898 (0xb199 bytes) 000935 1784122493.328906 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33bef): Mirror 13: 0x3a4590f (stale) Mirror 14: 0x436aa5fe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33bef): Mirror 13: 0x3a4590f (stale) Mirror 14: 0x436aa5fe (stale) CRC-32 checksum value for chunk [0, 0x33bef): Mirror 1: 0xcfc4f8aa Mirror 15: 0xcfc4f8aa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33bef: skipped 000942 1784122493.507279 write 0x036a74 thru 0x03ffff (0x958c bytes) 000945 1784122493.533396 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x2f7cb7ee (stale) Mirror 14: 0x60086cb0 (stale) Mirror 15: 0xa4dd354f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe7e4ee06 Mirror 16: 0xe7e4ee06 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000946 1784122493.755990 read 0x006c44 thru 0x0124e8 (0xb8a5 bytes) 000947 1784122493.759679 mapread 0x0157f5 thru 0x021422 (0xbc2e bytes) 000949 1784122493.770170 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x2f7cb7ee (stale) Mirror 14: 0x60086cb0 (stale) Mirror 15: 0xa4dd354f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x2f7cb7ee (stale) Mirror 14: 0x60086cb0 (stale) Mirror 15: 0xa4dd354f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000950 1784122493.860732 trunc from 0x040000 to 0x01a34e (0x25cb1 bytes) 000951 1784122493.871630 trunc from 0x01a34f to 0x00dedd (0xc471 bytes) 000952 1784122493.876632 read 0x003803 thru 0x00b722 (0x7f20 bytes) 000953 1784122493.879733 trunc from 0x00dede to 0x02506a (0x1718d bytes) 000954 1784122493.884131 mapwrite 0x0199f3 thru 0x028577 (0xeb85 bytes) 000955 1784122493.911812 mapread 0x01da77 thru 0x028577 (0xab01 bytes) 000956 1784122493.914135 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28578): Mirror 14: 0x64560a7c (stale) Mirror 15: 0x64560a7c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28578): Mirror 14: 0x64560a7c (stale) Mirror 15: 0x64560a7c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28578: skipped 000958 1784122493.994131 mapwrite 0x02475a thru 0x028020 (0x38c7 bytes) 000960 1784122494.012520 read 0x00b6bd thru 0x00deb4 (0x27f8 bytes) 000961 1784122494.015056 mapwrite 0x03e90a thru 0x03ffff (0x16f6 bytes) 000962 1784122494.037325 mapwrite 0x0398ce thru 0x03ffff (0x6732 bytes) 000963 1784122494.051474 trunc from 0x040000 to 0x01c00a (0x23ff5 bytes) 000964 1784122494.058248 MIRROR_RESYNC 3 mirrors 000965 1784122494.260198 mapread 0x019aed thru 0x01c00a (0x251e bytes) 000967 1784122494.266723 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) 000969 1784122494.353203 write 0x01b0b3 thru 0x027bf0 (0xcb3e bytes) 000970 1784122494.372648 mapwrite 0x03e403 thru 0x03ffff (0x1bfd bytes) 000971 1784122494.398246 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x594:0x0]: Invalid argument (22) 000972 1784122494.434182 mapwrite 0x022748 thru 0x027d53 (0x560c bytes) 000975 1784122494.451901 mapread 0x01e7ba thru 0x01ecd5 (0x51c bytes) 000979 1784122494.454559 write 0x01412d thru 0x020099 (0xbf6d bytes) 000981 1784122494.458023 trunc from 0x040000 to 0x00a772 (0x3588d bytes) 000983 1784122494.463720 read 0x000e3b thru 0x003be4 (0x2daa bytes) 000984 1784122494.465735 mapwrite 0x0124e0 thru 0x012694 (0x1b5 bytes) 000987 1784122494.482608 trunc from 0x012695 to 0x0324c0 (0x1fe2c bytes) 000988 1784122494.486399 mapread 0x01d9f1 thru 0x023877 (0x5e87 bytes) 000989 1784122494.489212 mapwrite 0x006455 thru 0x00a17b (0x3d27 bytes) 000990 1784122494.501867 read 0x02b5f3 thru 0x0324c0 (0x6ece bytes) 000991 1784122494.504895 mapwrite 0x013ed3 thru 0x01f176 (0xb2a4 bytes) 000992 1784122494.517318 read 0x007660 thru 0x01051c (0x8ebd bytes) 000994 1784122494.518562 write 0x03b8eb thru 0x03f40f (0x3b25 bytes) 000995 1784122494.519649 write 0x0292ff thru 0x0384d0 (0xf1d2 bytes) 000997 1784122494.523118 mapwrite 0x02deaa thru 0x03bab1 (0xdc08 bytes) All operations completed A-OK!