== sanity-flr test 70a: flr mode fsx test ================ 12:41:02 (1789576862) Seed set to 6864 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1789576864.548742 MIRROR_EXTEND to 2 mirrors skipping zero size read skipping zero size read skipping zero length punch hole 000006 1789576864.987293 MIRROR_EXTEND to 3 mirrors skipping zero size read skipping zero size read skipping zero size read skipping zero size read skipping zero size read skipping zero size read 000015 1789576865.492836 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) 000016 1789576865.715699 MIRROR_EXTEND to 3 mirrors skipping zero length punch hole 000019 1789576866.248606 write 0x03df21 thru 0x03e7f7 (0x8d7 bytes) truncating to largest ever: 0x23e9a 000020 1789576866.301718 trunc from 0x03e7f8 to 0x023e99 (0x1a95e bytes) 000021 1789576866.331388 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23e9a): Mirror 4: 0x43eff7b8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23e9a): Mirror 4: 0x43eff7b8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23e9a: skipped 000023 1789576866.639858 mapread 0x0110da thru 0x011ea3 (0xdca bytes) 000025 1789576866.649183 punch from 0x015fd6 to 0x020d00 (0xad2b bytes) 000026 1789576866.659604 punch from 0x008841 to 0x009f9d (0x175d bytes) 000029 1789576866.668996 mapwrite 0x01b3eb thru 0x01b8ec (0x502 bytes) 000030 1789576866.789117 mapread 0x014ccc thru 0x015059 (0x38e bytes) 000031 1789576866.800288 write 0x00155f thru 0x00b03a (0x9adc bytes) 000032 1789576866.811992 mapwrite 0x01ad93 thru 0x02794f (0xcbbd bytes) 000033 1789576866.913292 mapread 0x0118af thru 0x01fad4 (0xe226 bytes) 000035 1789576866.915133 write 0x01dad3 thru 0x027d1f (0xa24d bytes) 000036 1789576866.918696 punch from 0x025447 to 0x027d1f (0x28d9 bytes) 000039 1789576866.943800 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) 000041 1789576867.125044 trunc from 0x027d20 to 0x0017ee (0x26531 bytes) truncating to largest ever: 0x300a6 000044 1789576867.146394 trunc from 0x0017ef to 0x0300a5 (0x2e8b7 bytes) 000045 1789576867.164301 punch from 0x0159bf to 0x02196c (0xbfae bytes) 000046 1789576867.174496 read 0x029a07 thru 0x0300a5 (0x669f bytes) 000049 1789576867.185593 mapread 0x002240 thru 0x00c297 (0xa058 bytes) 000051 1789576867.210706 trunc from 0x0300a6 to 0x005fab (0x2a0fa bytes) 000052 1789576867.232762 read 0x0013e8 thru 0x004072 (0x2c8b bytes) 000053 1789576867.233801 write 0x01be5d thru 0x0267c2 (0xa966 bytes) 000054 1789576867.238286 read 0x00b776 thru 0x015f76 (0xa801 bytes) 000061 1789576867.256761 write 0x037d7c thru 0x03f997 (0x7c1c bytes) 000062 1789576867.258487 mapwrite 0x00abf7 thru 0x014e70 (0xa27a bytes) 000063 1789576867.314781 write 0x02874b thru 0x0295ff (0xeb5 bytes) 000064 1789576867.327195 mapwrite 0x03b5a5 thru 0x03ffff (0x4a5b bytes) 000065 1789576867.392112 write 0x039c3f thru 0x03ffff (0x63c1 bytes) 000068 1789576867.394404 mapwrite 0x004a73 thru 0x00ed53 (0xa2e1 bytes) 000069 1789576867.452679 mapread 0x01aa80 thru 0x022d42 (0x82c3 bytes) 000070 1789576867.455068 mapread 0x03c81b thru 0x03d5f3 (0xdd9 bytes) 000071 1789576867.456798 trunc from 0x040000 to 0x015bf5 (0x2a40a bytes) 000073 1789576867.479473 punch from 0x0074c4 to 0x00bb58 (0x4695 bytes) 000074 1789576867.485333 mapread 0x0104e8 thru 0x012910 (0x2429 bytes) 000076 1789576867.488049 trunc from 0x015bf6 to 0x0014df (0x14716 bytes) 000079 1789576867.506902 mapread 0x000b0f thru 0x0014df (0x9d1 bytes) 000080 1789576867.509372 mapread 0x0002e1 thru 0x0014df (0x11ff bytes) 000081 1789576867.511427 write 0x036cfe thru 0x03ffff (0x9302 bytes) 000085 1789576867.517781 mapwrite 0x00c7ff thru 0x011ae0 (0x52e2 bytes) 000086 1789576867.599833 punch from 0x02fb4f to 0x03c95c (0xce0e bytes) 000087 1789576867.606714 write 0x025d1a thru 0x032bde (0xcec5 bytes) 000089 1789576867.619412 write 0x02c97c thru 0x032010 (0x5695 bytes) 000090 1789576867.622422 write 0x009d71 thru 0x015177 (0xb407 bytes) 000091 1789576867.633983 mapread 0x017146 thru 0x0203b4 (0x926f bytes) 000092 1789576867.729333 mapread 0x00425c thru 0x013b0d (0xf8b2 bytes) 000093 1789576867.768747 write 0x008118 thru 0x011394 (0x927d bytes) 000094 1789576867.772809 trunc from 0x040000 to 0x029753 (0x168ac bytes) 000095 1789576867.795773 trunc from 0x029754 to 0x020484 (0x92cf bytes) 000098 1789576867.817522 read 0x00c1db thru 0x014d4a (0x8b70 bytes) 000099 1789576867.819442 mapwrite 0x0273d7 thru 0x036d9b (0xf9c5 bytes) truncating to largest ever: 0x32bf4 000101 1789576867.916130 trunc from 0x036d9c to 0x032bf3 (0x41a8 bytes) 000102 1789576867.948643 punch from 0x00003a to 0x00defb (0xdec2 bytes) 000103 1789576867.954596 mapread 0x002db7 thru 0x0032ea (0x534 bytes) 000105 1789576867.970039 trunc from 0x032bf4 to 0x02bb6a (0x7089 bytes) 000106 1789576867.993830 read 0x025994 thru 0x0269a4 (0x1011 bytes) 000108 1789576867.995048 mapread 0x016752 thru 0x0239fa (0xd2a9 bytes) 000109 1789576868.002729 read 0x00fae8 thru 0x0171a6 (0x76bf bytes) truncating to largest ever: 0x33bf8 000110 1789576868.005981 trunc from 0x02bb6b to 0x033bf7 (0x808d bytes) 000112 1789576868.025763 write 0x02dc65 thru 0x02fcf2 (0x208e bytes) 000114 1789576868.049060 MIRROR_EXTEND to 2 mirrors 000116 1789576869.207509 MIRROR_EXTEND to 3 mirrors 000117 1789576870.413347 punch from 0x02b21a to 0x031462 (0x6249 bytes) 000118 1789576870.514762 punch from 0x008520 to 0x0085d6 (0xb7 bytes) 000119 1789576870.527647 mapread 0x025cd0 thru 0x026038 (0x369 bytes) 000120 1789576870.546448 read 0x01fc6c thru 0x029f0b (0xa2a0 bytes) 000122 1789576870.562749 write 0x01cfa7 thru 0x01d343 (0x39d bytes) 000123 1789576870.578269 mapread 0x02edec thru 0x033bf7 (0x4e0c bytes) 000124 1789576870.606702 mapread 0x01df51 thru 0x02ddb6 (0xfe66 bytes) 000125 1789576870.627467 mapwrite 0x002f50 thru 0x00be00 (0x8eb1 bytes) 000127 1789576870.798177 write 0x016bee thru 0x026843 (0xfc56 bytes) 000128 1789576870.813393 trunc from 0x033bf8 to 0x017059 (0x1cb9e bytes) 000129 1789576870.867422 write 0x034579 thru 0x0347be (0x246 bytes) 000131 1789576870.870320 mapwrite 0x021dd5 thru 0x02a9bf (0x8beb bytes) 000132 1789576871.021721 write 0x02a9de thru 0x03339b (0x89be bytes) 000133 1789576871.032707 mapread 0x01f9a9 thru 0x02bc12 (0xc26a bytes) 000135 1789576871.037321 read 0x02c9a7 thru 0x0347be (0x7e18 bytes) 000136 1789576871.039049 mapread 0x018e10 thru 0x01dd13 (0x4f04 bytes) 000137 1789576871.054029 write 0x0047f2 thru 0x00de4b (0x965a bytes) 000138 1789576871.060169 write 0x02bd05 thru 0x02ffdb (0x42d7 bytes) 000139 1789576871.065443 punch from 0x001f48 to 0x00dbfb (0xbcb4 bytes) 000140 1789576871.094057 read 0x0156a3 thru 0x01e2d2 (0x8c30 bytes) 000141 1789576871.095233 mapread 0x015543 thru 0x01b643 (0x6101 bytes) 000144 1789576871.099063 read 0x02a7da thru 0x0347be (0x9fe5 bytes) 000146 1789576871.103107 mapread 0x00257d thru 0x012562 (0xffe6 bytes) 000149 1789576871.116923 punch from 0x001e70 to 0x00c36b (0xa4fc bytes) 000150 1789576871.131708 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x347bf): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x347bf): Mirror 2: 0x826bd611 (stale) Mirror 3: 0x826bd611 (stale) CRC-32 checksum value for chunk [0, 0x347bf): Mirror 1: 0x6ec113d6 Mirror 4: 0x6ec113d6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x347bf: skipped 000151 1789576872.428109 mapwrite 0x0155f5 thru 0x02378d (0xe199 bytes) 000152 1789576872.730164 read 0x030e9b thru 0x0347be (0x3924 bytes) 000153 1789576872.745492 read 0x017828 thru 0x0225e4 (0xadbd bytes) 000154 1789576872.747661 mapread 0x02a554 thru 0x0347be (0xa26b bytes) 000155 1789576872.760718 punch from 0x023312 to 0x025b2b (0x281a bytes) 000157 1789576872.772094 mapread 0x02dd6e thru 0x0347be (0x6a51 bytes) 000158 1789576872.777351 mapwrite 0x028581 thru 0x02d811 (0x5291 bytes) 000161 1789576872.833996 mapwrite 0x003ae7 thru 0x00460d (0xb27 bytes) 000162 1789576872.892264 write 0x022e32 thru 0x02aec8 (0x8097 bytes) 000164 1789576872.894390 mapread 0x01bf80 thru 0x020bf0 (0x4c71 bytes) 000166 1789576872.902655 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x347bf): Mirror 2: 0x826bd611 (stale) Mirror 3: 0x826bd611 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x347bf): Mirror 2: 0x826bd611 (stale) Mirror 3: 0x826bd611 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x347bf: skipped 000169 1789576873.295280 trunc from 0x0347bf to 0x02bf94 (0x882a bytes) 000171 1789576873.342983 trunc from 0x02bf95 to 0x01aa02 (0x11592 bytes) 000173 1789576873.368381 trunc from 0x01aa03 to 0x01b6aa (0xca8 bytes) 000175 1789576873.389408 write 0x011b06 thru 0x01e97f (0xce7a bytes) truncating to largest ever: 0x3ce8a 000179 1789576873.411234 trunc from 0x01e980 to 0x03ce89 (0x1e50a bytes) 000182 1789576873.431402 write 0x03debf thru 0x03ffff (0x2141 bytes) 000184 1789576873.434843 read 0x011bf3 thru 0x0162ee (0x46fc bytes) 000185 1789576873.435918 write 0x03711a thru 0x03d18f (0x6076 bytes) 000186 1789576873.441917 read 0x02f1d7 thru 0x03de18 (0xec42 bytes) 000187 1789576873.454525 punch from 0x00c979 to 0x010d68 (0x43f0 bytes) 000189 1789576873.470077 mapwrite 0x00596d thru 0x011c98 (0xc32c bytes) 000190 1789576873.571403 MIRROR_RESYNC 3 mirrors 000191 1789576875.416593 MIRROR_RESYNC 3 mirrors 000192 1789576876.103785 mapread 0x00e6ed thru 0x00fbb1 (0x14c5 bytes) 000193 1789576876.129219 trunc from 0x040000 to 0x03c488 (0x3b77 bytes) 000195 1789576876.287050 MIRROR_RESYNC 3 mirrors 000196 1789576878.023378 mapread 0x02e2e5 thru 0x02eb96 (0x8b2 bytes) 000198 1789576878.032133 punch from 0x03bd36 to 0x03c488 (0x753 bytes) 000199 1789576878.107752 write 0x01d105 thru 0x0243cf (0x72cb bytes) 000202 1789576878.119884 punch from 0x01640b to 0x025121 (0xed17 bytes) 000204 1789576878.134370 punch from 0x030a25 to 0x037a38 (0x7014 bytes) 000207 1789576878.140992 read 0x000eff thru 0x00cf24 (0xc026 bytes) 000208 1789576878.149904 punch from 0x0189c4 to 0x020596 (0x7bd3 bytes) 000211 1789576878.157098 punch from 0x02ecde to 0x030cb2 (0x1fd5 bytes) 000212 1789576878.162323 trunc from 0x03c489 to 0x01181d (0x2ac6b bytes) 000214 1789576878.184941 trunc from 0x01181e to 0x00d60b (0x4212 bytes) 000217 1789576878.212843 MIRROR_RESYNC 3 mirrors 000218 1789576879.755850 write 0x022aa6 thru 0x024cd2 (0x222d bytes) 000219 1789576879.864778 MIRROR_RESYNC 3 mirrors 000220 1789576881.315052 trunc from 0x024cd3 to 0x0335fc (0xe92a bytes) 000222 1789576881.399335 mapread 0x01f198 thru 0x021573 (0x23dc bytes) 000223 1789576881.418345 punch from 0x009890 to 0x013ed1 (0xa642 bytes) 000224 1789576881.423938 trunc from 0x0335fd to 0x00c400 (0x271fc bytes) 000226 1789576881.447830 trunc from 0x00c401 to 0x032e9e (0x26a9e bytes) 000227 1789576881.469354 punch from 0x03249e to 0x032e9e (0xa01 bytes) 000230 1789576881.475520 trunc from 0x032e9f to 0x004c74 (0x2e22a bytes) 000232 1789576881.497850 mapwrite 0x00be5e thru 0x01885f (0xca02 bytes) 000235 1789576881.589777 trunc from 0x018860 to 0x00def2 (0xa96d bytes) 000236 1789576881.610116 write 0x026200 thru 0x030585 (0xa386 bytes) 000237 1789576881.611925 punch from 0x02dc1e to 0x030585 (0x2968 bytes) 000238 1789576881.628184 write 0x011316 thru 0x020146 (0xee31 bytes) 000240 1789576881.643372 mapread 0x01adc9 thru 0x01cca2 (0x1eda bytes) 000241 1789576881.644520 read 0x015c5a thru 0x01afa7 (0x534e bytes) 000242 1789576881.645909 mapread 0x022143 thru 0x02a959 (0x8817 bytes) 000243 1789576881.659291 MIRROR_RESYNC 3 mirrors 000246 1789576883.220850 read 0x010a59 thru 0x019cbe (0x9266 bytes) 000248 1789576883.235831 mapwrite 0x036e4b thru 0x03b030 (0x41e6 bytes) 000252 1789576883.372090 punch from 0x0125db to 0x012975 (0x39b bytes) 000253 1789576883.382801 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b031): Mirror 3: 0x1a1cfc25 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b031): Mirror 3: 0x1a1cfc25 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b031: skipped 000255 1789576883.749146 trunc from 0x03b031 to 0x005c3c (0x353f4 bytes) 000256 1789576883.771080 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x5c3d): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5c3d): Mirror 3: 0x77f71fb4 (stale) CRC-32 checksum value for chunk [0, 0x5c3d): Mirror 1: 0x77f71fb4 Mirror 4: 0x77f71fb4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5c3d: skipped 000257 1789576884.703886 punch from 0x0030c0 to 0x0048e8 (0x1829 bytes) 000260 1789576884.806869 read 0x002ff4 thru 0x00539f (0x23ac bytes) 000261 1789576884.816154 trunc from 0x005c3d to 0x00103f (0x4bfd bytes) 000262 1789576884.851644 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1040): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1040): Mirror 3: 0x50d087bd (stale) Mirror 4: 0x50d087bd (stale) CRC-32 checksum value for chunk [0, 0x1040): Mirror 1: 0x50d087bd Mirror 5: 0x50d087bd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1040: skipped 000264 1789576886.230776 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1040): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1040): Mirror 3: 0x50d087bd (stale) Mirror 4: 0x50d087bd (stale) CRC-32 checksum value for chunk [0, 0x1040): Mirror 1: 0x50d087bd Mirror 5: 0x50d087bd Mirror 6: 0x50d087bd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1040: skipped 000266 1789576887.811277 mapwrite 0x0298f6 thru 0x037656 (0xdd61 bytes) 000268 1789576888.045795 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37657): Mirror 3: 0x5cae6ccc (stale) Mirror 4: 0xcc54936d (stale) Mirror 5: 0x2b320d6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37657): Mirror 3: 0x5cae6ccc (stale) Mirror 4: 0xcc54936d (stale) Mirror 5: 0x2b320d6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37657: skipped 000269 1789576888.414032 mapread 0x0169fe thru 0x0180ca (0x16cd bytes) 000270 1789576888.444396 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37657): Mirror 4: 0xcc54936d (stale) Mirror 5: 0x2b320d6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37657): Mirror 4: 0xcc54936d (stale) Mirror 5: 0x2b320d6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37657: skipped 000272 1789576888.907655 read 0x000c35 thru 0x00aa14 (0x9de0 bytes) 000273 1789576888.936475 trunc from 0x037657 to 0x02cd43 (0xa913 bytes) 000274 1789576888.964355 mapread 0x02790a thru 0x02cd43 (0x543a bytes) 000276 1789576889.000034 mapread 0x01e345 thru 0x026173 (0x7e2f bytes) 000277 1789576889.030964 write 0x0187ec thru 0x022481 (0x9c96 bytes) 000278 1789576889.045017 read 0x02270e thru 0x02a1b4 (0x7aa7 bytes) 000280 1789576889.052634 trunc from 0x02cd44 to 0x03727f (0xa53c bytes) 000281 1789576889.095836 punch from 0x0284f0 to 0x02d3b3 (0x4ec4 bytes) 000282 1789576889.140719 punch from 0x016c06 to 0x020291 (0x968c bytes) 000283 1789576889.158770 mapread 0x00e83a thru 0x016587 (0x7d4e bytes) 000284 1789576889.206261 read 0x02988a thru 0x03606c (0xc7e3 bytes) 000287 1789576889.219356 write 0x033e14 thru 0x03ffff (0xc1ec bytes) 000288 1789576889.224507 trunc from 0x040000 to 0x0284aa (0x17b55 bytes) 000290 1789576889.265800 MIRROR_RESYNC 3 mirrors 000291 1789576890.951000 read 0x00fc4a thru 0x01064e (0xa05 bytes) 000292 1789576890.957853 read 0x018966 thru 0x01b2fc (0x2997 bytes) 000295 1789576890.985664 punch from 0x000ad0 to 0x00842f (0x7960 bytes) 000297 1789576891.132643 trunc from 0x0284ab to 0x0077c3 (0x20ce7 bytes) 000298 1789576891.160417 write 0x0085d8 thru 0x00d9c5 (0x53ee bytes) 000299 1789576891.162286 write 0x00d7a2 thru 0x01adc5 (0xd624 bytes) 000300 1789576891.167051 read 0x0172de thru 0x01adc5 (0x3ae8 bytes) 000301 1789576891.178775 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1adc6): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1adc6): Mirror 4: 0xf51fbfb4 (stale) Mirror 5: 0xf51fbfb4 (stale) CRC-32 checksum value for chunk [0, 0x1adc6): Mirror 1: 0x6d408ff4 Mirror 6: 0x6d408ff4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1adc6: skipped 000302 1789576892.237376 punch from 0x00c6d6 to 0x01a9da (0xe305 bytes) 000303 1789576892.471911 mapread 0x007527 thru 0x0166a4 (0xf17e bytes) 000306 1789576892.537156 mapwrite 0x00e749 thru 0x01c097 (0xd94f bytes) 000309 1789576892.811490 read 0x009720 thru 0x00cfae (0x388f bytes) 000310 1789576892.819841 MIRROR_RESYNC 4 mirrors 000313 1789576894.228003 punch from 0x01af97 to 0x01c097 (0x1101 bytes) 000314 1789576894.301511 punch from 0x005be2 to 0x00ed31 (0x9150 bytes) 000315 1789576894.320951 read 0x01b5c1 thru 0x01c097 (0xad7 bytes) 000316 1789576894.344869 write 0x021062 thru 0x029500 (0x849f bytes) 000317 1789576894.346498 punch from 0x006b59 to 0x00949e (0x2946 bytes) 000318 1789576894.370697 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29501): Mirror 4: 0xfb771a74 (stale) Mirror 5: 0xfb771a74 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29501): Mirror 4: 0xfb771a74 (stale) Mirror 5: 0xfb771a74 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29501: skipped 000319 1789576895.005742 write 0x02040f thru 0x029431 (0x9023 bytes) 000320 1789576895.024405 trunc from 0x029501 to 0x018eb0 (0x10650 bytes) 000321 1789576895.081845 mapwrite 0x01b755 thru 0x023fa2 (0x884e bytes) 000322 1789576895.265620 mapwrite 0x01a919 thru 0x0292d2 (0xe9ba bytes) 000324 1789576895.412528 mapwrite 0x014c8d thru 0x01f74c (0xaac0 bytes) 000325 1789576895.497328 trunc from 0x0292d3 to 0x038345 (0xf073 bytes) 000326 1789576895.528884 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x38346): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38346): Mirror 4: 0x158adaad (stale) Mirror 5: 0x158adaad (stale) CRC-32 checksum value for chunk [0, 0x38346): Mirror 1: 0x5792438c Mirror 6: 0x5792438c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38346: skipped 000328 1789576896.733408 trunc from 0x038346 to 0x008498 (0x2fead bytes) 000329 1789576896.826322 mapwrite 0x00c4d1 thru 0x019dbc (0xd8ec bytes) 000330 1789576896.930976 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19dbd): Mirror 4: 0x6538d82e (stale) Mirror 5: 0x6538d82e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19dbd): Mirror 4: 0x6538d82e (stale) Mirror 5: 0x6538d82e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19dbd: skipped 000332 1789576897.260780 write 0x007e25 thru 0x00b8e6 (0x3ac2 bytes) 000333 1789576897.275253 trunc from 0x019dbd to 0x031010 (0x17254 bytes) 000337 1789576897.302950 trunc from 0x031011 to 0x0277d2 (0x983e bytes) 000339 1789576897.327714 punch from 0x01e6a5 to 0x01ef92 (0x8ee bytes) 000340 1789576897.342091 trunc from 0x0277d3 to 0x038691 (0x10ebf bytes) 000341 1789576897.364992 mapread 0x02cef4 thru 0x038691 (0xb79e bytes) 000342 1789576897.402277 mapwrite 0x001b28 thru 0x005f6f (0x4448 bytes) 000344 1789576897.453943 mapread 0x0107d8 thru 0x0162e4 (0x5b0d bytes) 000345 1789576897.464161 write 0x006a9d thru 0x00ad66 (0x42ca bytes) 000346 1789576897.465436 mapread 0x0208ed thru 0x0245ac (0x3cc0 bytes) 000348 1789576897.482234 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x38692): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38692): Mirror 4: 0x2570fd02 (stale) Mirror 5: 0x2570fd02 (stale) CRC-32 checksum value for chunk [0, 0x38692): Mirror 1: 0x9ef35d03 Mirror 6: 0x9ef35d03 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38692: skipped 000349 1789576898.498831 write 0x02a3ef thru 0x02e928 (0x453a bytes) 000350 1789576898.605524 trunc from 0x038692 to 0x02c6a3 (0xbfee bytes) 000351 1789576898.661424 write 0x03e6b6 thru 0x03ffff (0x194a bytes) 000352 1789576898.668739 mapread 0x00ee7a thru 0x01cc14 (0xdd9b bytes) 000353 1789576898.705993 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x604a6deb (stale) Mirror 5: 0x604a6deb (stale) Mirror 6: 0x60eacdb6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf9bcc9e1 Mirror 7: 0xf9bcc9e1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000354 1789576900.024839 trunc from 0x040000 to 0x0055cc (0x3aa33 bytes) 000356 1789576900.129363 read 0x002f7c thru 0x0055cc (0x2651 bytes) 000357 1789576900.139389 mapread 0x000408 thru 0x0055cc (0x51c5 bytes) 000359 1789576900.154476 write 0x00decf thru 0x01407f (0x61b1 bytes) 000360 1789576900.157272 write 0x02cda2 thru 0x02f75c (0x29bb bytes) 000361 1789576900.160095 punch from 0x0057f5 to 0x00e1e4 (0x89f0 bytes) 000362 1789576900.177516 write 0x012670 thru 0x014762 (0x20f3 bytes) 000363 1789576900.185831 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2f75d): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f75d): Mirror 4: 0xc8ba99bb (stale) Mirror 5: 0xc8ba99bb (stale) Mirror 6: 0xad1811fd (stale) Mirror 7: 0xb3153c92 (stale) CRC-32 checksum value for chunk [0, 0x2f75d): Mirror 1: 0x91741fa1 Mirror 8: 0x91741fa1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f75d: skipped 000364 1789576902.199838 punch from 0x005dc6 to 0x0110cd (0xb308 bytes) 000365 1789576902.476798 trunc from 0x02f75d to 0x020130 (0xf62c bytes) 000366 1789576902.540860 write 0x01a5ab thru 0x0238be (0x9314 bytes) 000367 1789576902.554151 mapread 0x00475c thru 0x00dd51 (0x95f6 bytes) 000369 1789576902.584308 punch from 0x00f726 to 0x00fc8e (0x569 bytes) 000370 1789576902.616023 mapread 0x01816b thru 0x02368a (0xb520 bytes) 000371 1789576902.628073 mapread 0x00a720 thru 0x016964 (0xc245 bytes) 000373 1789576902.637731 read 0x009278 thru 0x00a376 (0x10ff bytes) 000375 1789576902.639510 read 0x009736 thru 0x014f48 (0xb813 bytes) 000376 1789576902.641581 read 0x002469 thru 0x007d44 (0x58dc bytes) 000379 1789576902.644165 punch from 0x00ed29 to 0x01162b (0x2903 bytes) 000381 1789576902.663848 trunc from 0x0238bf to 0x02746b (0x3bad bytes) 000383 1789576902.698277 trunc from 0x02746c to 0x034ccb (0xd860 bytes) 000384 1789576902.765918 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x34ccc): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34ccc): Mirror 4: 0x2b040b2b (stale) Mirror 5: 0x2b040b2b (stale) Mirror 6: 0x11f17efb (stale) Mirror 7: 0x91d35a83 (stale) Mirror 8: 0xf9e2cfcd (stale) CRC-32 checksum value for chunk [0, 0x34ccc): Mirror 1: 0x3302e25e Mirror 9: 0x3302e25e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34ccc: skipped 000385 1789576905.270665 mapread 0x021c8c thru 0x025ad4 (0x3e49 bytes) 000386 1789576905.363437 punch from 0x024ee7 to 0x025d59 (0xe73 bytes) 000387 1789576905.428944 punch from 0x0234aa to 0x027bff (0x4756 bytes) 000388 1789576905.435356 mapwrite 0x01bbaa thru 0x029083 (0xd4da bytes) 000389 1789576905.549182 MIRROR_RESYNC 7 mirrors 000391 1789576909.734328 mapwrite 0x00418a thru 0x0046a0 (0x517 bytes) 000392 1789576909.860948 trunc from 0x034ccc to 0x00a5de (0x2a6ed bytes) 000394 1789576909.905470 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0xa5df): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa5df): Mirror 4: 0xee913e2c (stale) Mirror 5: 0xee913e2c (stale) Mirror 6: 0xee913e2c (stale) Mirror 7: 0xee913e2c (stale) Mirror 8: 0xee913e2c (stale) Mirror 9: 0xee913e2c (stale) CRC-32 checksum value for chunk [0, 0xa5df): Mirror 1: 0xae748468 Mirror 10: 0xae748468 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa5df: skipped 000395 1789576911.622596 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xa5df): Mirror 5: 0xee913e2c (stale) Mirror 6: 0xee913e2c (stale) Mirror 7: 0xee913e2c (stale) Mirror 8: 0xee913e2c (stale) Mirror 9: 0xee913e2c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa5df): Mirror 5: 0xee913e2c (stale) Mirror 6: 0xee913e2c (stale) Mirror 7: 0xee913e2c (stale) Mirror 8: 0xee913e2c (stale) Mirror 9: 0xee913e2c (stale) CRC-32 checksum value for chunk [0, 0xa5df): Mirror 1: 0xae748468 Mirror 10: 0xae748468 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa5df: skipped 000396 1789576912.814933 read 0x0001fe thru 0x0044c1 (0x42c4 bytes) 000398 1789576912.881749 trunc from 0x00a5df to 0x02f7fd (0x2521f bytes) 000399 1789576913.032281 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f7fe): Mirror 5: 0xa70aeb5d (stale) Mirror 6: 0xa70aeb5d (stale) Mirror 8: 0xa70aeb5d (stale) Mirror 9: 0xa70aeb5d (stale) Mirror 10: 0x51fb0cc2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f7fe): Mirror 5: 0xa70aeb5d (stale) Mirror 6: 0xa70aeb5d (stale) Mirror 8: 0xa70aeb5d (stale) Mirror 9: 0xa70aeb5d (stale) Mirror 10: 0x51fb0cc2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f7fe: skipped 000400 1789576913.913271 write 0x00b1b6 thru 0x00d2de (0x2129 bytes) 000402 1789576913.927957 read 0x0121da thru 0x015b2b (0x3952 bytes) 000404 1789576913.941735 punch from 0x01f5ff to 0x01feaa (0x8ac bytes) 000405 1789576913.955834 write 0x01fe79 thru 0x02a36c (0xa4f4 bytes) 000406 1789576913.975940 mapread 0x023d13 thru 0x02f7fd (0xbaeb bytes) 000407 1789576914.019366 mapwrite 0x02447e thru 0x032c40 (0xe7c3 bytes) 000408 1789576914.218617 mapwrite 0x033a64 thru 0x03694e (0x2eeb bytes) 000409 1789576914.360984 mapread 0x02175a thru 0x024765 (0x300c bytes) 000411 1789576914.362604 trunc from 0x03694f to 0x01d385 (0x195c9 bytes) 000412 1789576914.461139 MIRROR_RESYNC 6 mirrors 000413 1789576916.995615 punch from 0x0047f0 to 0x012804 (0xe015 bytes) 000414 1789576917.063714 write 0x018132 thru 0x025e48 (0xdd17 bytes) 000415 1789576917.075944 punch from 0x0028f1 to 0x00bfc1 (0x96d1 bytes) 000418 1789576917.100801 mapread 0x01eeb0 thru 0x025e48 (0x6f99 bytes) 000420 1789576917.105591 write 0x00d327 thru 0x00e1ae (0xe88 bytes) 000421 1789576917.137294 punch from 0x00404e to 0x00b4fa (0x74ad bytes) 000423 1789576917.167487 read 0x01766e thru 0x01f56c (0x7eff bytes) 000425 1789576917.200440 MIRROR_RESYNC 6 mirrors 000426 1789576920.585306 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) 000427 1789576921.024650 mapwrite 0x03ff34 thru 0x03ffff (0xcc bytes) 000428 1789576921.187448 MIRROR_RESYNC 5 mirrors 000429 1789576927.009151 MIRROR_EXTEND to 6 mirrors 000431 1789576929.016719 mapread 0x01816d thru 0x019d7b (0x1c0f bytes) 000432 1789576929.032664 mapwrite 0x01f545 thru 0x0279b7 (0x8473 bytes) 000434 1789576929.434090 mapread 0x000bd6 thru 0x00a28f (0x96ba bytes) 000439 1789576929.464320 punch from 0x01d50e to 0x022944 (0x5437 bytes) 000440 1789576929.475834 punch from 0x014e88 to 0x0232ba (0xe433 bytes) 000441 1789576929.483931 read 0x036f48 thru 0x03ffff (0x90b8 bytes) 000443 1789576929.507424 write 0x0108c2 thru 0x0194d4 (0x8c13 bytes) 000446 1789576929.541985 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x5e6676fe (stale) Mirror 6: 0x5e6676fe (stale) Mirror 8: 0x5e6676fe (stale) Mirror 10: 0x5e6676fe (stale) Mirror 11: 0x5e6676fe (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc348f061 Mirror 12: 0xc348f061 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000447 1789576932.259926 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x5e6676fe (stale) Mirror 6: 0x5e6676fe (stale) Mirror 8: 0x5e6676fe (stale) Mirror 10: 0x5e6676fe (stale) Mirror 11: 0x5e6676fe (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc348f061 Mirror 12: 0xc348f061 Mirror 13: 0xc348f061 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped truncating to largest ever: 0x3cf34 000448 1789576934.100944 trunc from 0x040000 to 0x03cf33 (0x30cc bytes) 000449 1789576934.212645 trunc from 0x03cf34 to 0x02137b (0x1bbb8 bytes) 000451 1789576934.236660 read 0x006ef0 thru 0x01234f (0xb460 bytes) 000452 1789576934.248407 punch from 0x01a69a to 0x01fb46 (0x54ad bytes) 000454 1789576934.254609 punch from 0x001d3b to 0x007b3c (0x5e02 bytes) 000455 1789576934.263312 write 0x01f422 thru 0x022090 (0x2c6f bytes) 000457 1789576934.283846 MIRROR_RESYNC 8 mirrors 000458 1789576939.758313 mapwrite 0x002998 thru 0x00df7c (0xb5e5 bytes) 000460 1789576939.972706 write 0x012709 thru 0x019031 (0x6929 bytes) 000461 1789576939.999438 MIRROR_RESYNC 8 mirrors 000466 1789576943.212055 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) 000470 1789576944.071981 mapwrite 0x018348 thru 0x01d2c2 (0x4f7b bytes) 000471 1789576944.346195 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x22091): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22091): Mirror 5: 0xfd9245c7 (stale) Mirror 6: 0xfd9245c7 (stale) Mirror 8: 0xfd9245c7 (stale) Mirror 10: 0xfd9245c7 (stale) Mirror 11: 0xfd9245c7 (stale) Mirror 13: 0xfd9245c7 (stale) CRC-32 checksum value for chunk [0, 0x22091): Mirror 1: 0xdb2a1e4f Mirror 14: 0xdb2a1e4f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22091: skipped 000473 1789576946.210406 mapwrite 0x0278f7 thru 0x035c00 (0xe30a bytes) 000474 1789576946.456046 trunc from 0x035c01 to 0x02753a (0xe6c6 bytes) 000476 1789576946.481135 read 0x0047c2 thru 0x012050 (0xd88f bytes) 000479 1789576946.497530 mapread 0x01ba86 thru 0x02753a (0xbab5 bytes) 000480 1789576946.516104 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2753b): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2753b): Mirror 5: 0x92a5e4b1 (stale) Mirror 6: 0x92a5e4b1 (stale) Mirror 8: 0x92a5e4b1 (stale) Mirror 10: 0x92a5e4b1 (stale) Mirror 11: 0x92a5e4b1 (stale) Mirror 13: 0x92a5e4b1 (stale) Mirror 14: 0x3b425708 (stale) CRC-32 checksum value for chunk [0, 0x2753b): Mirror 1: 0x3b425708 Mirror 15: 0x3b425708 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2753b: skipped 000482 1789576948.165408 write 0x03630f thru 0x03ffff (0x9cf1 bytes) 000483 1789576948.272163 MIRROR_RESYNC 9 mirrors 000484 1789576953.292329 punch from 0x02923b to 0x02dc41 (0x4a07 bytes) 000485 1789576953.431509 punch from 0x034cc9 to 0x03ffff (0xb337 bytes) 000487 1789576953.442035 mapwrite 0x01e357 thru 0x01ecd4 (0x97e bytes) 000488 1789576953.499227 punch from 0x022db2 to 0x028c7c (0x5ecb bytes) truncating to largest ever: 0x3fead 000489 1789576953.505028 trunc from 0x040000 to 0x03feac (0x153 bytes) 000490 1789576953.532070 read 0x0380d5 thru 0x03feac (0x7dd8 bytes) 000492 1789576953.547000 punch from 0x038116 to 0x03feac (0x7d97 bytes) 000493 1789576953.566275 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3fead): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fead): Mirror 5: 0xca3dca28 (stale) Mirror 6: 0xca3dca28 (stale) Mirror 8: 0xca3dca28 (stale) Mirror 10: 0xca3dca28 (stale) Mirror 11: 0xca3dca28 (stale) Mirror 13: 0xca3dca28 (stale) Mirror 14: 0xca3dca28 (stale) Mirror 15: 0xca3dca28 (stale) CRC-32 checksum value for chunk [0, 0x3fead): Mirror 1: 0x83c86121 Mirror 16: 0x83c86121 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fead: skipped 000495 1789576955.326682 trunc from 0x03fead to 0x00d554 (0x32958 bytes) 000496 1789576955.481715 mapread 0x005d8f thru 0x00d554 (0x77c6 bytes) 000497 1789576955.516673 MIRROR_RESYNC 10 mirrors 000498 1789576957.378305 mapwrite 0x030a80 thru 0x03f677 (0xebf8 bytes) 000500 1789576957.549090 punch from 0x035853 to 0x03f677 (0x9e25 bytes) 000501 1789576957.555747 write 0x01b460 thru 0x01c4dd (0x107e bytes) 000503 1789576957.567013 mapread 0x004c25 thru 0x009d21 (0x50fd bytes) 000504 1789576957.577081 read 0x02ee29 thru 0x03307e (0x4256 bytes) 000505 1789576957.578024 mapwrite 0x01d64c thru 0x023685 (0x603a bytes) 000506 1789576957.632121 write 0x037c84 thru 0x03ffff (0x837c bytes) 000507 1789576957.640205 punch from 0x00f5bd to 0x01375a (0x419e bytes) 000508 1789576957.653438 read 0x0151ee thru 0x02132f (0xc142 bytes) 000509 1789576957.663466 mapread 0x033ca1 thru 0x03fd05 (0xc065 bytes) 000511 1789576957.665161 mapread 0x023ce7 thru 0x031675 (0xd98f bytes) 000513 1789576957.668115 write 0x03e52e thru 0x03ed5d (0x830 bytes) 000514 1789576957.669837 read 0x029194 thru 0x034eb3 (0xbd20 bytes) 000516 1789576957.671340 trunc from 0x040000 to 0x029ea1 (0x1615e bytes) 000517 1789576957.695436 mapread 0x007e62 thru 0x00a20e (0x23ad bytes) 000518 1789576957.697351 trunc from 0x029ea2 to 0x036dcf (0xcf2e bytes) 000519 1789576957.720379 read 0x017df2 thru 0x02250f (0xa71e bytes) 000520 1789576957.722565 trunc from 0x036dd0 to 0x03e8ef (0x7b20 bytes) 000523 1789576957.747011 write 0x01c7a0 thru 0x02023a (0x3a9b bytes) 000524 1789576957.748884 punch from 0x00f63b to 0x0177b4 (0x817a bytes) 000525 1789576957.761371 trunc from 0x03e8f0 to 0x007e86 (0x36a69 bytes) 000527 1789576957.780858 punch from 0x003fb3 to 0x007e74 (0x3ec2 bytes) 000528 1789576957.787000 punch from 0x00513a to 0x007e86 (0x2d4d bytes) 000529 1789576957.792067 mapwrite 0x031588 thru 0x03ef75 (0xd9ee bytes) 000530 1789576957.882023 MIRROR_RESYNC 10 mirrors 000532 1789576961.988125 MIRROR_EXTEND to 11 mirrors 000533 1789576963.128197 trunc from 0x03ef76 to 0x01799f (0x275d6 bytes) 000534 1789576963.222060 read 0x00e5d5 thru 0x012614 (0x4040 bytes) 000536 1789576963.232131 trunc from 0x0179a0 to 0x03c2e9 (0x2494a bytes) 000537 1789576963.252145 read 0x00fa35 thru 0x01a596 (0xab62 bytes) 000539 1789576963.265912 mapread 0x007ed9 thru 0x00cdb8 (0x4ee0 bytes) 000540 1789576963.267143 write 0x01d6e2 thru 0x0292b5 (0xbbd4 bytes) 000542 1789576963.270378 punch from 0x018fa8 to 0x01e784 (0x57dd bytes) 000543 1789576963.290570 read 0x00505a thru 0x00b9d2 (0x6979 bytes) 000545 1789576963.291863 punch from 0x01022b to 0x01f3f4 (0xf1ca bytes) 000546 1789576963.297384 read 0x0376e3 thru 0x03c2e9 (0x4c07 bytes) 000549 1789576963.299821 trunc from 0x03c2ea to 0x01bc1f (0x206ca bytes) 000550 1789576963.317897 punch from 0x019f17 to 0x01b008 (0x10f2 bytes) 000552 1789576963.323874 mapwrite 0x03c21e thru 0x03ffff (0x3de2 bytes) 000553 1789576963.410771 mapwrite 0x01a62d thru 0x024cd3 (0xa6a7 bytes) 000556 1789576963.465132 mapwrite 0x018ca2 thru 0x0283f0 (0xf74f bytes) 000557 1789576963.515180 mapread 0x030d8a thru 0x03f22f (0xe4a6 bytes) 000559 1789576963.516992 mapwrite 0x0271cc thru 0x028f36 (0x1d6b bytes) 000560 1789576963.556966 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x5daf6bed (stale) Mirror 6: 0x5daf6bed (stale) Mirror 8: 0x5daf6bed (stale) Mirror 10: 0x5daf6bed (stale) Mirror 11: 0x5daf6bed (stale) Mirror 13: 0x5daf6bed (stale) Mirror 14: 0x5daf6bed (stale) Mirror 15: 0x5daf6bed (stale) Mirror 16: 0x5daf6bed (stale) Mirror 17: 0x5daf6bed (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x73a3e2f7 Mirror 18: 0x73a3e2f7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000561 1789576965.307338 punch from 0x01be6e to 0x01edbb (0x2f4e bytes) 000562 1789576965.421303 mapread 0x014543 thru 0x01521e (0xcdc bytes) 000563 1789576965.440806 mapwrite 0x02c65b thru 0x02e7df (0x2185 bytes) 000564 1789576965.505683 MIRROR_RESYNC 12 mirrors 000565 1789576973.832782 mapwrite 0x0132ad thru 0x016a19 (0x376d bytes) 000568 1789576974.087105 trunc from 0x040000 to 0x0340ee (0xbf11 bytes) 000569 1789576974.124634 mapwrite 0x02ac1e thru 0x02f290 (0x4673 bytes) 000571 1789576974.206105 write 0x0112ea thru 0x014a21 (0x3738 bytes) 000572 1789576974.209153 write 0x020b09 thru 0x02d87b (0xcd73 bytes) 000573 1789576974.218040 mapread 0x00e462 thru 0x00fcda (0x1879 bytes) 000574 1789576974.219621 mapread 0x00cbec thru 0x01c172 (0xf587 bytes) 000575 1789576974.232928 punch from 0x0138eb to 0x015209 (0x191f bytes) 000576 1789576974.258493 mapwrite 0x027e29 thru 0x02b5cd (0x37a5 bytes) 000577 1789576974.326346 mapwrite 0x00f9d5 thru 0x01c8ca (0xcef6 bytes) 000578 1789576974.392852 mapwrite 0x0053b2 thru 0x012f0c (0xdb5b bytes) 000579 1789576974.465415 read 0x018aed thru 0x0211b2 (0x86c6 bytes) 000580 1789576974.475453 trunc from 0x0340ef to 0x0190e2 (0x1b00c bytes) 000581 1789576974.496821 mapwrite 0x01b58b thru 0x01cdf1 (0x1867 bytes) 000583 1789576974.557277 read 0x00b0f6 thru 0x011c77 (0x6b82 bytes) 000584 1789576974.558054 trunc from 0x01cdf2 to 0x01918c (0x3c65 bytes) 000585 1789576974.577769 mapwrite 0x03904e thru 0x03b0bc (0x206f bytes) 000586 1789576974.678681 mapread 0x030e69 thru 0x03686b (0x5a03 bytes) 000587 1789576974.679818 trunc from 0x03b0bd to 0x038925 (0x2797 bytes) 000588 1789576974.710008 mapread 0x022259 thru 0x02ede0 (0xcb88 bytes) 000589 1789576974.712980 read 0x00ebf9 thru 0x01007d (0x1485 bytes) 000590 1789576974.728304 MIRROR_SPLIT mirror 4 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38926): Mirror 5: 0xff5fec1a (stale) Mirror 6: 0xff5fec1a (stale) Mirror 8: 0xff5fec1a (stale) Mirror 11: 0xff5fec1a (stale) Mirror 13: 0xff5fec1a (stale) Mirror 14: 0xff5fec1a (stale) Mirror 15: 0xff5fec1a (stale) Mirror 16: 0xff5fec1a (stale) Mirror 17: 0xff5fec1a (stale) Mirror 18: 0xff5fec1a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38926): Mirror 5: 0xff5fec1a (stale) Mirror 6: 0xff5fec1a (stale) Mirror 8: 0xff5fec1a (stale) Mirror 11: 0xff5fec1a (stale) Mirror 13: 0xff5fec1a (stale) Mirror 14: 0xff5fec1a (stale) Mirror 15: 0xff5fec1a (stale) Mirror 16: 0xff5fec1a (stale) Mirror 17: 0xff5fec1a (stale) Mirror 18: 0xff5fec1a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38926: skipped 000591 1789576975.518090 read 0x032353 thru 0x038925 (0x65d3 bytes) 000592 1789576975.529819 mapwrite 0x025bbb thru 0x02b83a (0x5c80 bytes) 000593 1789576975.604676 read 0x01e4b2 thru 0x023c24 (0x5773 bytes) 000594 1789576975.617405 punch from 0x01421a to 0x0142f6 (0xdd bytes) 000597 1789576975.624173 punch from 0x025f41 to 0x02e992 (0x8a52 bytes) 000599 1789576975.629614 mapwrite 0x02b4ea thru 0x02d1c9 (0x1ce0 bytes) 000600 1789576975.696382 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x38926): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38926): Mirror 5: 0xff5fec1a (stale) Mirror 6: 0xff5fec1a (stale) Mirror 8: 0xff5fec1a (stale) Mirror 11: 0xff5fec1a (stale) Mirror 13: 0xff5fec1a (stale) Mirror 14: 0xff5fec1a (stale) Mirror 15: 0xff5fec1a (stale) Mirror 16: 0xff5fec1a (stale) Mirror 17: 0xff5fec1a (stale) Mirror 18: 0xff5fec1a (stale) CRC-32 checksum value for chunk [0, 0x38926): Mirror 1: 0xb2da5130 Mirror 19: 0xb2da5130 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38926: skipped 000602 1789576977.542347 read 0x005818 thru 0x007b80 (0x2369 bytes) 000603 1789576977.574503 punch from 0x02143a to 0x030615 (0xf1dc bytes) 000604 1789576977.692745 mapwrite 0x004bfe thru 0x00914a (0x454d bytes) 000605 1789576977.835526 mapwrite 0x035e8d thru 0x036aba (0xc2e bytes) 000606 1789576977.965071 MIRROR_RESYNC 12 mirrors 000607 1789576981.879089 read 0x018a44 thru 0x01f742 (0x6cff bytes) 000608 1789576981.888832 read 0x005c5f thru 0x00c164 (0x6506 bytes) 000609 1789576981.903949 read 0x00599c thru 0x0062b7 (0x91c bytes) 000610 1789576981.904351 read 0x02c03d thru 0x02cae2 (0xaa6 bytes) 000611 1789576981.905576 read 0x006f4b thru 0x0098ea (0x29a0 bytes) 000612 1789576981.906073 write 0x020b26 thru 0x02f7a3 (0xec7e bytes) 000614 1789576982.001522 mapread 0x01baff thru 0x022320 (0x6822 bytes) 000615 1789576982.003940 mapread 0x003e0e thru 0x01066c (0xc85f bytes) 000616 1789576982.006974 write 0x002c38 thru 0x00aa07 (0x7dd0 bytes) 000617 1789576982.009621 mapread 0x007c24 thru 0x0103f8 (0x87d5 bytes) 000618 1789576982.011010 trunc from 0x038926 to 0x0392d7 (0x9b2 bytes) 000619 1789576982.037928 read 0x020b48 thru 0x02bff6 (0xb4af bytes) 000620 1789576982.039741 write 0x01ac67 thru 0x020268 (0x5602 bytes) 000623 1789576982.044711 mapread 0x038804 thru 0x0392d7 (0xad4 bytes) 000624 1789576982.054497 write 0x0329d4 thru 0x033713 (0xd40 bytes) 000625 1789576982.055969 punch from 0x001928 to 0x0068c1 (0x4f9a bytes) 000626 1789576982.086945 MIRROR_SPLIT mirror 7 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x392d8): Mirror 5: 0xc63c56ea (stale) Mirror 6: 0xc63c56ea (stale) Mirror 8: 0xc63c56ea (stale) Mirror 11: 0xc63c56ea (stale) Mirror 13: 0xc63c56ea (stale) Mirror 14: 0xc63c56ea (stale) Mirror 16: 0xc63c56ea (stale) Mirror 17: 0xc63c56ea (stale) Mirror 18: 0xc63c56ea (stale) Mirror 19: 0xc63c56ea (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x392d8): Mirror 5: 0xc63c56ea (stale) Mirror 6: 0xc63c56ea (stale) Mirror 8: 0xc63c56ea (stale) Mirror 11: 0xc63c56ea (stale) Mirror 13: 0xc63c56ea (stale) Mirror 14: 0xc63c56ea (stale) Mirror 16: 0xc63c56ea (stale) Mirror 17: 0xc63c56ea (stale) Mirror 18: 0xc63c56ea (stale) Mirror 19: 0xc63c56ea (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x392d8: skipped 000627 1789576983.084509 write 0x023a96 thru 0x031e38 (0xe3a3 bytes) 000628 1789576983.111361 punch from 0x009e5f to 0x015499 (0xb63b bytes) 000630 1789576983.161336 trunc from 0x0392d8 to 0x003daf (0x35528 bytes) 000631 1789576983.182413 write 0x012332 thru 0x0125cd (0x29c bytes) 000632 1789576983.183731 mapwrite 0x03c820 thru 0x03ffff (0x37e0 bytes) 000633 1789576983.364670 write 0x004804 thru 0x00f82c (0xb029 bytes) 000636 1789576983.384172 mapread 0x018fe7 thru 0x01a337 (0x1351 bytes) 000638 1789576983.403187 read 0x006aa8 thru 0x00eb8d (0x80e6 bytes) 000639 1789576983.405420 mapwrite 0x003667 thru 0x00d1c4 (0x9b5e bytes) 000640 1789576983.525204 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xc9f60052 (stale) Mirror 6: 0xc9f60052 (stale) Mirror 8: 0xc9f60052 (stale) Mirror 11: 0xc9f60052 (stale) Mirror 13: 0xc9f60052 (stale) Mirror 14: 0xc9f60052 (stale) Mirror 16: 0xc9f60052 (stale) Mirror 17: 0xc9f60052 (stale) Mirror 18: 0xc9f60052 (stale) Mirror 19: 0xc9f60052 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7e69069 Mirror 20: 0x7e69069 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000641 1789576985.425446 punch from 0x001a12 to 0x00b9a8 (0x9f97 bytes) 000642 1789576985.530941 trunc from 0x040000 to 0x0385af (0x7a50 bytes) 000643 1789576985.559039 trunc from 0x0385b0 to 0x00f738 (0x28e77 bytes) 000644 1789576985.589702 trunc from 0x00f739 to 0x02584b (0x16113 bytes) 000645 1789576985.617591 punch from 0x01a8de to 0x021102 (0x6825 bytes) 000646 1789576985.627005 mapread 0x00e27f thru 0x017be5 (0x9967 bytes) 000647 1789576985.658057 mapread 0x0110e8 thru 0x0153cc (0x42e5 bytes) 000648 1789576985.662797 write 0x002c3c thru 0x00bf9a (0x935f bytes) 000649 1789576985.672148 read 0x01ffd7 thru 0x02584b (0x5875 bytes) 000654 1789576985.692373 read 0x01c23c thru 0x02584b (0x9610 bytes) 000656 1789576985.703232 write 0x00cf92 thru 0x012fc5 (0x6034 bytes) 000658 1789576985.705948 read 0x0176cf thru 0x019ded (0x271f bytes) 000660 1789576985.707125 punch from 0x0115c4 to 0x01259e (0xfdb bytes) 000661 1789576985.753033 read 0x01d707 thru 0x01f949 (0x2243 bytes) 000662 1789576985.753744 mapwrite 0x01a4d1 thru 0x01c71b (0x224b bytes) 000663 1789576985.838997 write 0x03f2d3 thru 0x03ffff (0xd2d bytes) 000664 1789576985.846898 trunc from 0x040000 to 0x0349bc (0xb643 bytes) 000665 1789576985.903932 MIRROR_RESYNC 12 mirrors 000666 1789576990.737861 MIRROR_RESYNC 12 mirrors 000667 1789576991.417284 punch from 0x01cc7c to 0x027e87 (0xb20c bytes) 000668 1789576991.531286 punch from 0x000626 to 0x00271e (0x20f9 bytes) 000669 1789576991.553514 mapwrite 0x038a9a thru 0x03a66b (0x1bd2 bytes) 000670 1789576991.811997 punch from 0x023b48 to 0x02d780 (0x9c39 bytes) 000672 1789576991.836363 punch from 0x0149ea to 0x018565 (0x3b7c bytes) 000673 1789576991.846394 read 0x0371ed thru 0x03a66b (0x347f bytes) 000674 1789576991.847230 punch from 0x02f20c to 0x03a66b (0xb460 bytes) 000675 1789576991.861901 read 0x00cae5 thru 0x00d02d (0x549 bytes) 000676 1789576991.897181 trunc from 0x03a66c to 0x03714e (0x351d bytes) 000677 1789576991.923242 punch from 0x034374 to 0x03714e (0x2ddb bytes) 000680 1789576991.931909 read 0x003b55 thru 0x0072e2 (0x378e bytes) 000683 1789576991.934349 punch from 0x019774 to 0x020823 (0x70b0 bytes) 000684 1789576991.950620 write 0x000ffe thru 0x004a1a (0x3a1d bytes) 000685 1789576991.952464 write 0x029576 thru 0x033e67 (0xa8f2 bytes) 000688 1789576991.976994 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3714f): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3714f): Mirror 5: 0x145bd10f (stale) Mirror 6: 0x145bd10f (stale) Mirror 8: 0x145bd10f (stale) Mirror 11: 0x145bd10f (stale) Mirror 13: 0x145bd10f (stale) Mirror 14: 0x145bd10f (stale) Mirror 16: 0x145bd10f (stale) Mirror 17: 0x145bd10f (stale) Mirror 18: 0x145bd10f (stale) Mirror 19: 0x145bd10f (stale) Mirror 20: 0x145bd10f (stale) CRC-32 checksum value for chunk [0, 0x3714f): Mirror 1: 0x700983de Mirror 21: 0x700983de lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3714f: skipped 000689 1789576993.334299 MIRROR_SPLIT mirror 2 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3714f): Mirror 5: 0x145bd10f (stale) Mirror 8: 0x145bd10f (stale) Mirror 11: 0x145bd10f (stale) Mirror 13: 0x145bd10f (stale) Mirror 14: 0x145bd10f (stale) Mirror 16: 0x145bd10f (stale) Mirror 17: 0x145bd10f (stale) Mirror 18: 0x145bd10f (stale) Mirror 19: 0x145bd10f (stale) Mirror 20: 0x145bd10f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3714f): Mirror 5: 0x145bd10f (stale) Mirror 8: 0x145bd10f (stale) Mirror 11: 0x145bd10f (stale) Mirror 13: 0x145bd10f (stale) Mirror 14: 0x145bd10f (stale) Mirror 16: 0x145bd10f (stale) Mirror 17: 0x145bd10f (stale) Mirror 18: 0x145bd10f (stale) Mirror 19: 0x145bd10f (stale) Mirror 20: 0x145bd10f (stale) CRC-32 checksum value for chunk [0, 0x3714f): Mirror 1: 0x700983de Mirror 21: 0x700983de lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3714f: skipped 000690 1789576994.485110 mapwrite 0x01105e thru 0x01c1df (0xb182 bytes) 000691 1789576994.726109 read 0x019c16 thru 0x025355 (0xb740 bytes) 000692 1789576994.731639 mapread 0x031dcf thru 0x036fc9 (0x51fb bytes) 000693 1789576994.745199 mapwrite 0x03dc3d thru 0x03ffff (0x23c3 bytes) 000694 1789576994.821872 mapread 0x00ef80 thru 0x016899 (0x791a bytes) 000696 1789576994.829260 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xef8c8e91 (stale) Mirror 11: 0xef8c8e91 (stale) Mirror 13: 0xef8c8e91 (stale) Mirror 14: 0xef8c8e91 (stale) Mirror 16: 0xef8c8e91 (stale) Mirror 17: 0xef8c8e91 (stale) Mirror 18: 0xef8c8e91 (stale) Mirror 19: 0xef8c8e91 (stale) Mirror 20: 0xef8c8e91 (stale) Mirror 21: 0xdf14989e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xef8c8e91 (stale) Mirror 11: 0xef8c8e91 (stale) Mirror 13: 0xef8c8e91 (stale) Mirror 14: 0xef8c8e91 (stale) Mirror 16: 0xef8c8e91 (stale) Mirror 17: 0xef8c8e91 (stale) Mirror 18: 0xef8c8e91 (stale) Mirror 19: 0xef8c8e91 (stale) Mirror 20: 0xef8c8e91 (stale) Mirror 21: 0xdf14989e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000697 1789576995.554223 mapwrite 0x025daa thru 0x032bfd (0xce54 bytes) 000698 1789576995.635731 punch from 0x0162e1 to 0x017497 (0x11b7 bytes) 000699 1789576995.644799 MIRROR_SPLIT mirror 10 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xef8c8e91 (stale) Mirror 11: 0xef8c8e91 (stale) Mirror 13: 0xef8c8e91 (stale) Mirror 14: 0xef8c8e91 (stale) Mirror 16: 0xef8c8e91 (stale) Mirror 17: 0xef8c8e91 (stale) Mirror 18: 0xef8c8e91 (stale) Mirror 19: 0xef8c8e91 (stale) Mirror 20: 0xef8c8e91 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xef8c8e91 (stale) Mirror 11: 0xef8c8e91 (stale) Mirror 13: 0xef8c8e91 (stale) Mirror 14: 0xef8c8e91 (stale) Mirror 16: 0xef8c8e91 (stale) Mirror 17: 0xef8c8e91 (stale) Mirror 18: 0xef8c8e91 (stale) Mirror 19: 0xef8c8e91 (stale) Mirror 20: 0xef8c8e91 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000701 1789576996.206773 write 0x037067 thru 0x03f333 (0x82cd bytes) 000702 1789576996.220365 write 0x03e840 thru 0x03ffff (0x17c0 bytes) 000703 1789576996.222723 read 0x038848 thru 0x03ae5d (0x2616 bytes) 000704 1789576996.223488 write 0x00a074 thru 0x0193f3 (0xf380 bytes) 000707 1789576996.243421 mapwrite 0x03866b thru 0x03da67 (0x53fd bytes) 000709 1789576996.299644 read 0x02eb4a thru 0x030365 (0x181c bytes) 000710 1789576996.311447 trunc from 0x040000 to 0x027543 (0x18abc bytes) 000711 1789576996.336110 trunc from 0x027544 to 0x032873 (0xb330 bytes) 000712 1789576996.355890 write 0x004192 thru 0x013765 (0xf5d4 bytes) 000713 1789576996.360144 write 0x004669 thru 0x00d657 (0x8fef bytes) 000715 1789576996.368689 MIRROR_RESYNC 10 mirrors 000718 1789576999.636239 MIRROR_EXTEND to 11 mirrors 000719 1789577000.997567 write 0x021784 thru 0x02b5a6 (0x9e23 bytes) 000721 1789577001.111799 punch from 0x02b20c to 0x032873 (0x7668 bytes) 000724 1789577001.132460 mapwrite 0x03cbd4 thru 0x03ffff (0x342c bytes) 000726 1789577001.216973 read 0x03a9d9 thru 0x03ffff (0x5627 bytes) 000727 1789577001.217823 write 0x02ddd0 thru 0x037f98 (0xa1c9 bytes) 000729 1789577001.231372 MIRROR_RESYNC 11 mirrors 000731 1789577006.593069 write 0x030a29 thru 0x03e970 (0xdf48 bytes) 000732 1789577006.685415 trunc from 0x040000 to 0x027598 (0x18a67 bytes) 000733 1789577006.709857 punch from 0x00fe27 to 0x01a5d3 (0xa7ad bytes) 000735 1789577006.716153 punch from 0x004eb3 to 0x007089 (0x21d7 bytes) 000736 1789577006.723022 punch from 0x00f3d3 to 0x010b65 (0x1793 bytes) 000737 1789577006.727904 write 0x015c4d thru 0x01b206 (0x55ba bytes) 000740 1789577006.739601 trunc from 0x027599 to 0x024e10 (0x2788 bytes) 000742 1789577006.760218 punch from 0x018978 to 0x021444 (0x8acd bytes) 000743 1789577006.775892 mapwrite 0x0051b1 thru 0x011341 (0xc191 bytes) 000744 1789577006.918803 trunc from 0x024e11 to 0x02bb19 (0x6d09 bytes) 000745 1789577006.960291 read 0x016cf8 thru 0x01b753 (0x4a5c bytes) 000746 1789577006.972524 write 0x00ecef thru 0x01428d (0x559f bytes) 000747 1789577006.974069 mapwrite 0x02fff4 thru 0x035498 (0x54a5 bytes) 000749 1789577007.144068 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x35499): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35499): Mirror 8: 0xe8167ab8 (stale) Mirror 11: 0xe8167ab8 (stale) Mirror 13: 0xe8167ab8 (stale) Mirror 14: 0xe8167ab8 (stale) Mirror 16: 0xe8167ab8 (stale) Mirror 17: 0xe8167ab8 (stale) Mirror 18: 0xe8167ab8 (stale) Mirror 19: 0xe8167ab8 (stale) Mirror 20: 0xe8167ab8 (stale) Mirror 21: 0xe8167ab8 (stale) CRC-32 checksum value for chunk [0, 0x35499): Mirror 1: 0xf800c5c5 Mirror 22: 0xf800c5c5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35499: skipped 000750 1789577008.983230 MIRROR_RESYNC 12 mirrors 000751 1789577012.569357 write 0x004297 thru 0x00e94f (0xa6b9 bytes) 000752 1789577012.665065 read 0x01ffeb thru 0x021c4d (0x1c63 bytes) 000753 1789577012.672950 trunc from 0x035499 to 0x005959 (0x2fb3f bytes) 000755 1789577012.701354 mapwrite 0x019331 thru 0x025d8c (0xca5c bytes) 000756 1789577012.812797 trunc from 0x025d8d to 0x03713f (0x113b3 bytes) 000758 1789577012.837255 mapwrite 0x00ebca thru 0x0171c2 (0x85f9 bytes) 000759 1789577012.904520 mapread 0x01b343 thru 0x021633 (0x62f1 bytes) 000760 1789577012.911719 MIRROR_SPLIT mirror 2 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37140): Mirror 8: 0xae4198af (stale) Mirror 13: 0xae4198af (stale) Mirror 14: 0xae4198af (stale) Mirror 16: 0xae4198af (stale) Mirror 17: 0xae4198af (stale) Mirror 18: 0xae4198af (stale) Mirror 19: 0xae4198af (stale) Mirror 20: 0xae4198af (stale) Mirror 21: 0xae4198af (stale) Mirror 22: 0xae4198af (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37140): Mirror 8: 0xae4198af (stale) Mirror 13: 0xae4198af (stale) Mirror 14: 0xae4198af (stale) Mirror 16: 0xae4198af (stale) Mirror 17: 0xae4198af (stale) Mirror 18: 0xae4198af (stale) Mirror 19: 0xae4198af (stale) Mirror 20: 0xae4198af (stale) Mirror 21: 0xae4198af (stale) Mirror 22: 0xae4198af (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37140: skipped 000762 1789577013.585127 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37140): Mirror 8: 0xae4198af (stale) Mirror 13: 0xae4198af (stale) Mirror 14: 0xae4198af (stale) Mirror 16: 0xae4198af (stale) Mirror 17: 0xae4198af (stale) Mirror 19: 0xae4198af (stale) Mirror 20: 0xae4198af (stale) Mirror 21: 0xae4198af (stale) Mirror 22: 0xae4198af (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37140): Mirror 8: 0xae4198af (stale) Mirror 13: 0xae4198af (stale) Mirror 14: 0xae4198af (stale) Mirror 16: 0xae4198af (stale) Mirror 17: 0xae4198af (stale) Mirror 19: 0xae4198af (stale) Mirror 20: 0xae4198af (stale) Mirror 21: 0xae4198af (stale) Mirror 22: 0xae4198af (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37140: skipped 000763 1789577014.489962 write 0x03725c thru 0x03d468 (0x620d bytes) 000764 1789577014.505490 MIRROR_RESYNC 10 mirrors 000767 1789577018.694123 read 0x03990b thru 0x03d468 (0x3b5e bytes) 000768 1789577018.703680 punch from 0x0314ae to 0x0385c5 (0x7118 bytes) 000769 1789577018.795740 trunc from 0x03d469 to 0x01b501 (0x21f67 bytes) 000770 1789577018.822298 mapwrite 0x030be7 thru 0x03548a (0x48a4 bytes) 000772 1789577018.934362 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3548b): Mirror 8: 0x8999dce3 (stale) Mirror 13: 0x8999dce3 (stale) Mirror 14: 0x8999dce3 (stale) Mirror 16: 0x8999dce3 (stale) Mirror 17: 0x8999dce3 (stale) Mirror 19: 0x8999dce3 (stale) Mirror 21: 0x8999dce3 (stale) Mirror 22: 0x8999dce3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3548b): Mirror 8: 0x8999dce3 (stale) Mirror 13: 0x8999dce3 (stale) Mirror 14: 0x8999dce3 (stale) Mirror 16: 0x8999dce3 (stale) Mirror 17: 0x8999dce3 (stale) Mirror 19: 0x8999dce3 (stale) Mirror 21: 0x8999dce3 (stale) Mirror 22: 0x8999dce3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3548b: skipped 000773 1789577019.597698 mapread 0x014837 thru 0x021807 (0xcfd1 bytes) 000777 1789577019.638883 mapread 0x0155f8 thru 0x018854 (0x325d bytes) 000779 1789577019.641615 punch from 0x034292 to 0x03548a (0x11f9 bytes) 000780 1789577019.651773 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3548b): Mirror 8: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3548b): Mirror 8: 0x8999dce3 (stale) Mirror 13: 0x8999dce3 (stale) Mirror 14: 0x8999dce3 (stale) Mirror 16: 0x8999dce3 (stale) Mirror 17: 0x8999dce3 (stale) Mirror 19: 0x8999dce3 (stale) Mirror 21: 0x8999dce3 (stale) Mirror 22: 0x8999dce3 (stale) CRC-32 checksum value for chunk [0, 0x3548b): Mirror 1: 0x7294447b Mirror 23: 0x7294447b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3548b: skipped 000781 1789577021.089727 mapwrite 0x024696 thru 0x02ee94 (0xa7ff bytes) 000782 1789577021.299350 write 0x01487f thru 0x019a69 (0x51eb bytes) 000785 1789577021.312145 write 0x0244f9 thru 0x02d8a1 (0x93a9 bytes) 000786 1789577021.313525 mapwrite 0x0373cb thru 0x03b8d2 (0x4508 bytes) 000790 1789577021.401291 read 0x02f716 thru 0x03a234 (0xab1f bytes) 000792 1789577021.404881 read 0x0207d2 thru 0x02b959 (0xb188 bytes) 000793 1789577021.410743 MIRROR_RESYNC 10 mirrors 000795 1789577025.594663 read 0x035ccf thru 0x03b8d2 (0x5c04 bytes) 000796 1789577025.608603 read 0x0238bf thru 0x027e19 (0x455b bytes) 000797 1789577025.631281 punch from 0x01cf91 to 0x020da5 (0x3e15 bytes) 000798 1789577025.722776 trunc from 0x03b8d3 to 0x02e7b2 (0xd120 bytes) 000800 1789577025.749317 mapread 0x016c8b thru 0x024156 (0xd4cc bytes) 000802 1789577025.827937 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e7b3): Mirror 8: 0x4b6c49c1 (stale) Mirror 13: 0x4b6c49c1 (stale) Mirror 14: 0x4b6c49c1 (stale) Mirror 16: 0x4b6c49c1 (stale) Mirror 17: 0x4b6c49c1 (stale) Mirror 19: 0x4b6c49c1 (stale) Mirror 21: 0x4b6c49c1 (stale) Mirror 23: 0x4b6c49c1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e7b3): Mirror 8: 0x4b6c49c1 (stale) Mirror 13: 0x4b6c49c1 (stale) Mirror 14: 0x4b6c49c1 (stale) Mirror 16: 0x4b6c49c1 (stale) Mirror 17: 0x4b6c49c1 (stale) Mirror 19: 0x4b6c49c1 (stale) Mirror 21: 0x4b6c49c1 (stale) Mirror 23: 0x4b6c49c1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e7b3: skipped 000803 1789577026.606765 trunc from 0x02e7b3 to 0x01bc21 (0x12b91 bytes) 000805 1789577026.626920 mapwrite 0x01214c thru 0x01a8ae (0x8763 bytes) 000806 1789577026.711630 write 0x00cb27 thru 0x014da0 (0x827a bytes) 000809 1789577026.722635 read 0x00e8ee thru 0x0162a8 (0x79bb bytes) 000811 1789577026.724591 punch from 0x003c9a to 0x00acfa (0x7061 bytes) 000812 1789577026.755761 trunc from 0x01bc22 to 0x03fe34 (0x24213 bytes) 000813 1789577026.789768 trunc from 0x03fe35 to 0x03d58a (0x28aa bytes) 000815 1789577026.809219 punch from 0x01cae8 to 0x026176 (0x968f bytes) 000816 1789577026.815346 trunc from 0x03d58b to 0x01d574 (0x20016 bytes) 000817 1789577026.836154 mapread 0x00cf4c thru 0x00e025 (0x10da bytes) 000818 1789577026.838302 read 0x004ecf thru 0x00c607 (0x7739 bytes) 000819 1789577026.849347 punch from 0x002716 to 0x003461 (0xd4c bytes) 000820 1789577026.855900 mapread 0x017d87 thru 0x01b5b1 (0x382b bytes) 000821 1789577026.857328 read 0x001aee thru 0x00922a (0x773d bytes) 000822 1789577026.864480 trunc from 0x01d575 to 0x02c6ad (0xf139 bytes) 000823 1789577026.887377 mapwrite 0x010a3d thru 0x012a56 (0x201a bytes) 000825 1789577026.932983 read 0x02ba38 thru 0x02c6ad (0xc76 bytes) 000826 1789577026.943588 read 0x0168c3 thru 0x01f11f (0x885d bytes) 000827 1789577026.945523 punch from 0x0023a4 to 0x00331d (0xf7a bytes) 000829 1789577026.953311 mapwrite 0x00096c thru 0x005559 (0x4bee bytes) 000830 1789577027.009324 trunc from 0x02c6ae to 0x011a18 (0x1ac95 bytes) 000832 1789577027.047198 punch from 0x0110c7 to 0x011a18 (0x952 bytes) 000833 1789577027.059885 write 0x02acd0 thru 0x02d688 (0x29b9 bytes) 000834 1789577027.062745 write 0x03ece8 thru 0x03ffff (0x1318 bytes) 000835 1789577027.064144 mapwrite 0x03e68e thru 0x03ffff (0x1972 bytes) 000836 1789577027.145250 write 0x03c586 thru 0x03cade (0x559 bytes) 000838 1789577027.156522 write 0x00b283 thru 0x01b120 (0xfe9e bytes) 000839 1789577027.165953 trunc from 0x040000 to 0x01754e (0x28ab1 bytes) 000840 1789577027.207918 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x1754f): Mirror 8: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1754f): Mirror 8: 0x9b1fed00 (stale) Mirror 13: 0x9b1fed00 (stale) Mirror 14: 0x9b1fed00 (stale) Mirror 16: 0x9b1fed00 (stale) Mirror 17: 0x9b1fed00 (stale) Mirror 19: 0x9b1fed00 (stale) Mirror 21: 0x9b1fed00 (stale) Mirror 23: 0x9b1fed00 (stale) CRC-32 checksum value for chunk [0, 0x1754f): Mirror 1: 0x4f465c1f Mirror 24: 0x4f465c1f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1754f: skipped 000841 1789577028.974286 mapwrite 0x0123cf thru 0x01d113 (0xad45 bytes) 000842 1789577029.147931 punch from 0x015e19 to 0x01d113 (0x72fb bytes) 000843 1789577029.153853 mapwrite 0x01eeb8 thru 0x020767 (0x18b0 bytes) 000845 1789577029.253691 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x20768): Mirror 8: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20768): Mirror 8: 0xf28f63ee (stale) Mirror 13: 0xf28f63ee (stale) Mirror 14: 0xf28f63ee (stale) Mirror 16: 0xf28f63ee (stale) Mirror 17: 0xf28f63ee (stale) Mirror 19: 0xf28f63ee (stale) Mirror 21: 0xf28f63ee (stale) Mirror 23: 0xf28f63ee (stale) Mirror 24: 0x95895eb2 (stale) CRC-32 checksum value for chunk [0, 0x20768): Mirror 1: 0xe096bc Mirror 25: 0xe096bc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20768: skipped 000846 1789577030.584253 write 0x03482d thru 0x0378cb (0x309f bytes) 000847 1789577030.712210 write 0x00e92f thru 0x015077 (0x6749 bytes) 000848 1789577030.724944 trunc from 0x0378cc to 0x019972 (0x1df59 bytes) 000849 1789577030.790498 write 0x032c5d thru 0x03577e (0x2b22 bytes) 000851 1789577030.801211 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3577f): Mirror 8: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3577f): Mirror 8: 0x3308087b (stale) Mirror 13: 0x3308087b (stale) Mirror 14: 0x3308087b (stale) Mirror 16: 0x3308087b (stale) Mirror 17: 0x3308087b (stale) Mirror 19: 0x3308087b (stale) Mirror 21: 0x3308087b (stale) Mirror 23: 0x3308087b (stale) Mirror 24: 0xcab92a93 (stale) Mirror 25: 0x18866fb0 (stale) CRC-32 checksum value for chunk [0, 0x3577f): Mirror 1: 0x89ab5633 Mirror 26: 0x89ab5633 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3577f: skipped 000852 1789577032.665361 write 0x024e94 thru 0x032160 (0xd2cd bytes) 000853 1789577032.780741 mapread 0x02de42 thru 0x03577e (0x793d bytes) 000854 1789577032.806195 read 0x02192c thru 0x02818a (0x685f bytes) 000857 1789577032.818709 MIRROR_RESYNC 12 mirrors 000858 1789577036.629094 read 0x022d7a thru 0x024cde (0x1f65 bytes) 000859 1789577036.638022 read 0x034eb0 thru 0x03577e (0x8cf bytes) 000861 1789577036.655107 MIRROR_SPLIT mirror 11 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) 000862 1789577037.135501 mapread 0x0144e5 thru 0x0150a0 (0xbbc bytes) 000863 1789577037.142403 mapread 0x01457d thru 0x0178c4 (0x3348 bytes) 000866 1789577037.158926 punch from 0x02c056 to 0x0306fc (0x46a7 bytes) 000870 1789577037.246350 punch from 0x000413 to 0x00d744 (0xd332 bytes) 000871 1789577037.251019 trunc from 0x03577f to 0x026ca6 (0xead8 bytes) 000872 1789577037.275283 mapread 0x02246f thru 0x026ca6 (0x4838 bytes) 000873 1789577037.291020 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x26ca7): Mirror 8: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26ca7): Mirror 8: 0xe6a36bc (stale) Mirror 13: 0xe6a36bc (stale) Mirror 14: 0xe6a36bc (stale) Mirror 16: 0xe6a36bc (stale) Mirror 17: 0xe6a36bc (stale) Mirror 19: 0xe6a36bc (stale) Mirror 21: 0xe6a36bc (stale) Mirror 23: 0xe6a36bc (stale) Mirror 24: 0xe6a36bc (stale) Mirror 25: 0xe6a36bc (stale) CRC-32 checksum value for chunk [0, 0x26ca7): Mirror 1: 0x829c9b52 Mirror 26: 0x829c9b52 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26ca7: skipped 000874 1789577038.622673 read 0x01cc9e thru 0x020e92 (0x41f5 bytes) 000875 1789577038.640011 write 0x019c5b thru 0x01f78c (0x5b32 bytes) 000879 1789577038.773884 write 0x020a5b thru 0x028036 (0x75dc bytes) 000880 1789577038.780736 mapread 0x003d6c thru 0x008f1f (0x51b4 bytes) 000882 1789577038.818326 mapwrite 0x00a0b5 thru 0x00d8f5 (0x3841 bytes) 000883 1789577038.919086 write 0x029509 thru 0x031c54 (0x874c bytes) 000884 1789577038.920701 mapread 0x022ed2 thru 0x02e630 (0xb75f bytes) 000887 1789577038.933148 MIRROR_RESYNC 12 mirrors 000888 1789577042.888507 punch from 0x01fc91 to 0x02618d (0x64fd bytes) 000889 1789577043.011590 trunc from 0x031c55 to 0x01ae97 (0x16dbd bytes) 000890 1789577043.066301 read 0x00d791 thru 0x013800 (0x6070 bytes) 000891 1789577043.077329 mapread 0x014c4c thru 0x01721b (0x25d0 bytes) 000892 1789577043.123161 read 0x00dc51 thru 0x01a933 (0xcce3 bytes) 000894 1789577043.132060 trunc from 0x01ae98 to 0x032991 (0x17afa bytes) 000895 1789577043.169033 mapread 0x01bbf5 thru 0x01e921 (0x2d2d bytes) 000896 1789577043.195528 write 0x03a459 thru 0x03ffff (0x5ba7 bytes) 000897 1789577043.207308 MIRROR_SPLIT mirror 10 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xa8ed40ad (stale) Mirror 13: 0xa8ed40ad (stale) Mirror 14: 0xa8ed40ad (stale) Mirror 16: 0xa8ed40ad (stale) Mirror 17: 0xa8ed40ad (stale) Mirror 19: 0xa8ed40ad (stale) Mirror 21: 0xa8ed40ad (stale) Mirror 23: 0xa8ed40ad (stale) Mirror 24: 0xa8ed40ad (stale) Mirror 26: 0xa8ed40ad (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xa8ed40ad (stale) Mirror 13: 0xa8ed40ad (stale) Mirror 14: 0xa8ed40ad (stale) Mirror 16: 0xa8ed40ad (stale) Mirror 17: 0xa8ed40ad (stale) Mirror 19: 0xa8ed40ad (stale) Mirror 21: 0xa8ed40ad (stale) Mirror 23: 0xa8ed40ad (stale) Mirror 24: 0xa8ed40ad (stale) Mirror 26: 0xa8ed40ad (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000898 1789577044.210243 mapwrite 0x014c8d thru 0x019415 (0x4789 bytes) 000901 1789577044.437993 mapread 0x03cf36 thru 0x03ffff (0x30ca bytes) 000902 1789577044.452116 mapwrite 0x022ac2 thru 0x02e4e1 (0xba20 bytes) 000903 1789577044.577525 punch from 0x02f051 to 0x034ae7 (0x5a97 bytes) 000906 1789577044.587650 mapwrite 0x0078e6 thru 0x008947 (0x1062 bytes) 000908 1789577044.655430 mapread 0x027d5b thru 0x0345b5 (0xc85b bytes) 000909 1789577044.668850 punch from 0x0164c2 to 0x020219 (0x9d58 bytes) 000910 1789577044.677231 mapread 0x01dbeb thru 0x02ac41 (0xd057 bytes) 000911 1789577044.689345 mapwrite 0x00bd8e thru 0x00c36a (0x5dd bytes) 000912 1789577044.746996 mapread 0x00e323 thru 0x015943 (0x7621 bytes) 000915 1789577044.753206 trunc from 0x040000 to 0x01a12e (0x25ed1 bytes) 000918 1789577044.786630 trunc from 0x01a12f to 0x0195f4 (0xb3a bytes) 000921 1789577044.808844 read 0x01745b thru 0x0195f4 (0x219a bytes) 000922 1789577044.809843 trunc from 0x0195f5 to 0x004f45 (0x146af bytes) 000923 1789577044.837476 trunc from 0x004f46 to 0x01309d (0xe158 bytes) 000925 1789577044.862186 write 0x02777e thru 0x027c5a (0x4dd bytes) 000930 1789577044.866198 write 0x027b2c thru 0x0360c0 (0xe595 bytes) 000931 1789577044.873679 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x360c1): Mirror 8: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x360c1): Mirror 8: 0x7e9b4cef (stale) Mirror 13: 0x7e9b4cef (stale) Mirror 14: 0x7e9b4cef (stale) Mirror 16: 0x7e9b4cef (stale) Mirror 17: 0x7e9b4cef (stale) Mirror 19: 0x7e9b4cef (stale) Mirror 21: 0x7e9b4cef (stale) Mirror 23: 0x7e9b4cef (stale) Mirror 24: 0x7e9b4cef (stale) Mirror 26: 0x7e9b4cef (stale) CRC-32 checksum value for chunk [0, 0x360c1): Mirror 1: 0x7f0742f7 Mirror 27: 0x7f0742f7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x360c1: skipped 000932 1789577046.693797 read 0x001dc4 thru 0x00b835 (0x9a72 bytes) 000934 1789577046.727061 punch from 0x0231b4 to 0x029b6f (0x69bc bytes) 000935 1789577046.874105 read 0x000186 thru 0x005d40 (0x5bbb bytes) 000936 1789577046.897598 punch from 0x004c44 to 0x005626 (0x9e3 bytes) 000938 1789577046.917350 mapread 0x00da4a thru 0x016940 (0x8ef7 bytes) 000939 1789577046.931903 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x360c1): Mirror 8: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x360c1): Mirror 8: 0x7e9b4cef (stale) Mirror 13: 0x7e9b4cef (stale) Mirror 14: 0x7e9b4cef (stale) Mirror 16: 0x7e9b4cef (stale) Mirror 17: 0x7e9b4cef (stale) Mirror 19: 0x7e9b4cef (stale) Mirror 21: 0x7e9b4cef (stale) Mirror 23: 0x7e9b4cef (stale) Mirror 24: 0x7e9b4cef (stale) Mirror 26: 0x7e9b4cef (stale) Mirror 27: 0x7f0742f7 (stale) CRC-32 checksum value for chunk [0, 0x360c1): Mirror 1: 0xceb8cf08 Mirror 28: 0xceb8cf08 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x360c1: skipped 000940 1789577048.852166 mapwrite 0x01ee8d thru 0x02903a (0xa1ae bytes) 000941 1789577049.140421 mapwrite 0x008d12 thru 0x00f755 (0x6a44 bytes) 000942 1789577049.240752 mapread 0x02e5be thru 0x0360c0 (0x7b03 bytes) 000943 1789577049.268161 read 0x035c7f thru 0x0360c0 (0x442 bytes) 000945 1789577049.278188 MIRROR_SPLIT mirror 3 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x360c1): Mirror 8: 0x7e9b4cef (stale) Mirror 13: 0x7e9b4cef (stale) Mirror 16: 0x7e9b4cef (stale) Mirror 17: 0x7e9b4cef (stale) Mirror 19: 0x7e9b4cef (stale) Mirror 21: 0x7e9b4cef (stale) Mirror 23: 0x7e9b4cef (stale) Mirror 24: 0x7e9b4cef (stale) Mirror 26: 0x7e9b4cef (stale) Mirror 27: 0x7f0742f7 (stale) Mirror 28: 0xceb8cf08 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x360c1): Mirror 8: 0x7e9b4cef (stale) Mirror 13: 0x7e9b4cef (stale) Mirror 16: 0x7e9b4cef (stale) Mirror 17: 0x7e9b4cef (stale) Mirror 19: 0x7e9b4cef (stale) Mirror 21: 0x7e9b4cef (stale) Mirror 23: 0x7e9b4cef (stale) Mirror 24: 0x7e9b4cef (stale) Mirror 26: 0x7e9b4cef (stale) Mirror 27: 0x7f0742f7 (stale) Mirror 28: 0xceb8cf08 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x360c1: skipped 000946 1789577050.234886 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x360c1): Mirror 8: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x360c1): Mirror 8: 0x7e9b4cef (stale) Mirror 13: 0x7e9b4cef (stale) Mirror 16: 0x7e9b4cef (stale) Mirror 17: 0x7e9b4cef (stale) Mirror 19: 0x7e9b4cef (stale) Mirror 21: 0x7e9b4cef (stale) Mirror 23: 0x7e9b4cef (stale) Mirror 24: 0x7e9b4cef (stale) Mirror 26: 0x7e9b4cef (stale) Mirror 27: 0x7f0742f7 (stale) Mirror 28: 0xceb8cf08 (stale) CRC-32 checksum value for chunk [0, 0x360c1): Mirror 1: 0x1dada0e0 Mirror 29: 0x1dada0e0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x360c1: skipped 000947 1789577052.109363 write 0x00547c thru 0x005df6 (0x97b bytes) 000949 1789577052.241276 write 0x022fda thru 0x02885b (0x5882 bytes) 000950 1789577052.253131 trunc from 0x0360c1 to 0x006d1b (0x2f3a5 bytes) 000951 1789577052.289788 MIRROR_SPLIT mirror 11 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x6d1c): Mirror 8: 0xaceae8ef (stale) Mirror 13: 0xaceae8ef (stale) Mirror 16: 0xaceae8ef (stale) Mirror 17: 0xaceae8ef (stale) Mirror 19: 0xaceae8ef (stale) Mirror 21: 0xaceae8ef (stale) Mirror 23: 0xaceae8ef (stale) Mirror 24: 0xaceae8ef (stale) Mirror 26: 0xaceae8ef (stale) Mirror 27: 0xaceae8ef (stale) Mirror 29: 0xaceae8ef (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6d1c): Mirror 8: 0xaceae8ef (stale) Mirror 13: 0xaceae8ef (stale) Mirror 16: 0xaceae8ef (stale) Mirror 17: 0xaceae8ef (stale) Mirror 19: 0xaceae8ef (stale) Mirror 21: 0xaceae8ef (stale) Mirror 23: 0xaceae8ef (stale) Mirror 24: 0xaceae8ef (stale) Mirror 26: 0xaceae8ef (stale) Mirror 27: 0xaceae8ef (stale) Mirror 29: 0xaceae8ef (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6d1c: skipped 000952 1789577052.852107 punch from 0x000615 to 0x006d1b (0x6707 bytes) 000953 1789577052.857850 read 0x003e71 thru 0x006d1b (0x2eab bytes) 000955 1789577052.864998 punch from 0x000b7a to 0x001276 (0x6fd bytes) 000956 1789577052.875252 MIRROR_RESYNC 12 mirrors 000957 1789577055.255075 read 0x0011a1 thru 0x006d1b (0x5b7b bytes) 000958 1789577055.287077 read 0x001175 thru 0x006d1b (0x5ba7 bytes) 000959 1789577055.320231 MIRROR_EXTEND to 13 mirrors 000960 1789577056.412559 mapwrite 0x00dd57 thru 0x0171f9 (0x94a3 bytes) 000961 1789577056.647387 MIRROR_SPLIT mirror 12 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x171fa): Mirror 8: 0xaa3a4269 (stale) Mirror 13: 0xaa3a4269 (stale) Mirror 16: 0xaa3a4269 (stale) Mirror 17: 0xaa3a4269 (stale) Mirror 19: 0xaa3a4269 (stale) Mirror 21: 0xaa3a4269 (stale) Mirror 23: 0xaa3a4269 (stale) Mirror 24: 0xaa3a4269 (stale) Mirror 26: 0xaa3a4269 (stale) Mirror 27: 0xaa3a4269 (stale) Mirror 29: 0xaa3a4269 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x171fa): Mirror 8: 0xaa3a4269 (stale) Mirror 13: 0xaa3a4269 (stale) Mirror 16: 0xaa3a4269 (stale) Mirror 17: 0xaa3a4269 (stale) Mirror 19: 0xaa3a4269 (stale) Mirror 21: 0xaa3a4269 (stale) Mirror 23: 0xaa3a4269 (stale) Mirror 24: 0xaa3a4269 (stale) Mirror 26: 0xaa3a4269 (stale) Mirror 27: 0xaa3a4269 (stale) Mirror 29: 0xaa3a4269 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x171fa: skipped 000962 1789577057.890197 mapwrite 0x028fa3 thru 0x02e92b (0x5989 bytes) 000963 1789577057.997978 read 0x0011e4 thru 0x002bd7 (0x19f4 bytes) 000964 1789577058.014708 mapread 0x00452d thru 0x004a54 (0x528 bytes) 000965 1789577058.043695 read 0x0131dc thru 0x014bc7 (0x19ec bytes) 000968 1789577058.075324 mapread 0x02aab7 thru 0x02e92b (0x3e75 bytes) 000969 1789577058.079922 read 0x00fcf7 thru 0x01e7ec (0xeaf6 bytes) 000971 1789577058.082006 punch from 0x01905d to 0x01edaa (0x5d4e bytes) 000973 1789577058.088884 write 0x022a4e thru 0x025a89 (0x303c bytes) 000974 1789577058.099787 MIRROR_SPLIT mirror 4 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x175:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e92c): Mirror 8: 0x9d6d6805 (stale) Mirror 13: 0x9d6d6805 (stale) Mirror 16: 0x9d6d6805 (stale) Mirror 19: 0x9d6d6805 (stale) Mirror 21: 0x9d6d6805 (stale) Mirror 23: 0x9d6d6805 (stale) Mirror 24: 0x9d6d6805 (stale) Mirror 26: 0x9d6d6805 (stale) Mirror 27: 0x9d6d6805 (stale) Mirror 29: 0x9d6d6805 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e92c): Mirror 8: 0x9d6d6805 (stale) Mirror 13: 0x9d6d6805 (stale) Mirror 16: 0x9d6d6805 (stale) Mirror 19: 0x9d6d6805 (stale) Mirror 21: 0x9d6d6805 (stale) Mirror 23: 0x9d6d6805 (stale) Mirror 24: 0x9d6d6805 (stale) Mirror 26: 0x9d6d6805 (stale) Mirror 27: 0x9d6d6805 (stale) Mirror 29: 0x9d6d6805 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e92c: skipped 000975 1789577059.007152 punch from 0x01119d to 0x0146bd (0x3521 bytes) 000976 1789577059.013291 mapread 0x01494c thru 0x020322 (0xb9d7 bytes) 000978 1789577059.069949 trunc from 0x02e92c to 0x013d2f (0x1abfc bytes) 000979 1789577059.090628 mapread 0x00108b thru 0x0093a0 (0x8316 bytes) 000980 1789577059.123314 mapwrite 0x01f24e thru 0x021549 (0x22fc bytes) 000982 1789577059.284139 mapwrite 0x028680 thru 0x02bb69 (0x34ea bytes) 000984 1789577059.481295 mapwrite 0x012a56 thru 0x013f66 (0x1511 bytes) 000987 1789577059.553021 trunc from 0x02bb6a to 0x01fb66 (0xc003 bytes) 000988 1789577059.581454 punch from 0x019f0d to 0x01fb66 (0x5c5a bytes) 000990 1789577059.598649 trunc from 0x01fb67 to 0x0048e6 (0x1b280 bytes) 000991 1789577059.626073 write 0x015f3d thru 0x01ab69 (0x4c2d bytes) 000994 1789577059.632342 mapwrite 0x00ef9e thru 0x013695 (0x46f8 bytes) 000996 1789577059.739190 mapwrite 0x0198f9 thru 0x020d7a (0x7482 bytes) 000998 1789577059.861206 punch from 0x0197ce to 0x020d7a (0x75ad bytes) 000999 1789577059.875521 mapread 0x00a901 thru 0x013326 (0x8a26 bytes) 001000 1789577059.883985 read 0x015fba thru 0x01a801 (0x4848 bytes) All operations completed A-OK!