== sanity-flr test 70a: flr mode fsx test ================ 21:01:36 (1788310896) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 898 fallocating to largest ever: 0x40000 000001 1788310898.953086 fallocate 0x03f082 thru 0x03ffff (0xf7e bytes) 000003 1788310898.967847 fallocate 0x03e78b thru 0x03ffff (0x1875 bytes) skipping zero length punch hole skipping zero length punch hole 000006 1788310898.974611 mapwrite 0x016da2 thru 0x01f6fc (0x895b bytes) 000007 1788310899.052183 fallocate 0x006b7a thru 0x007c7d (0x1104 bytes) 000008 1788310899.058236 fallocate 0x02ab25 thru 0x033077 (0x8553 bytes) 000009 1788310899.064129 punch from 0x00e43d to 0x01dfdc (0xfba0 bytes) 000010 1788310899.069490 trunc from 0x01f6fd to 0x0059d5 (0x19d27 bytes) 000011 1788310899.084402 punch from 0x0051f9 to 0x0059d5 (0x7dd bytes) 000012 1788310899.099864 punch from 0x00348b to 0x00529b (0x1e11 bytes) 000013 1788310899.110896 punch from 0x003131 to 0x0059d5 (0x28a5 bytes) 000014 1788310899.117169 trunc from 0x0059d6 to 0x00965b (0x3c86 bytes) 000015 1788310899.137070 trunc from 0x00965c to 0x016688 (0xd02d bytes) 000016 1788310899.149703 mapread 0x010a73 thru 0x0153f2 (0x4980 bytes) 000017 1788310899.168591 MIRROR_EXTEND to 2 mirrors 000018 1788310899.902140 read 0x009ee2 thru 0x011f3b (0x805a bytes) 000020 1788310899.995878 fallocate 0x03e2b8 thru 0x03ffff (0x1d48 bytes) 000021 1788310900.051146 fallocate 0x0375da thru 0x03ffff (0x8a26 bytes) 000022 1788310900.059469 mapread 0x00cce8 thru 0x016688 (0x99a1 bytes) 000023 1788310900.113180 MIRROR_RESYNC 2 mirrors 000024 1788310900.631357 mapwrite 0x01f14d thru 0x026382 (0x7236 bytes) 000025 1788310900.716887 read 0x013cec thru 0x01be87 (0x819c bytes) 000026 1788310900.726532 fallocate 0x02d099 thru 0x02d6c9 (0x631 bytes) 000027 1788310900.732122 read 0x01ebaf thru 0x0258e4 (0x6d36 bytes) 000028 1788310900.733606 trunc from 0x0252f1 to 0x026382 (0x1092 bytes) 000029 1788310900.739542 trunc from 0x026383 to 0x0389dd (0x1265b bytes) 000030 1788310900.758142 trunc from 0x0389de to 0x01b748 (0x1d295 bytes) 000031 1788310900.782571 MIRROR_RESYNC 2 mirrors 000032 1788310901.454329 punch from 0x010c0f to 0x01a0bc (0x94ae bytes) 000033 1788310901.510337 trunc from 0x009d55 to 0x00f2fd (0x55a9 bytes) 000034 1788310901.529765 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) 000035 1788310901.782187 mapwrite 0x034d45 thru 0x0365f3 (0x18af bytes) 000036 1788310901.852631 fallocate 0x0099eb thru 0x012d0a (0x9320 bytes) 000037 1788310901.859806 mapread 0x01de34 thru 0x029d8c (0xbf59 bytes) 000038 1788310901.883764 trunc from 0x0365f4 to 0x029fe6 (0xc60d bytes) 000039 1788310901.901367 read 0x026a91 thru 0x029fe6 (0x3556 bytes) 000040 1788310901.906219 MIRROR_EXTEND to 2 mirrors 000041 1788310902.559450 mapwrite 0x02d65e thru 0x039e05 (0xc7a8 bytes) 000042 1788310902.677435 mapwrite 0x033a4e thru 0x03ffff (0xc5b2 bytes) 000043 1788310902.785097 fallocate 0x00350c thru 0x0036f5 (0x1ea bytes) 000044 1788310902.793517 trunc from 0x006f4b to 0x01454a (0xd600 bytes) 000045 1788310902.805815 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) 000046 1788310903.055307 write 0x003179 thru 0x00dab8 (0xa940 bytes) 000048 1788310903.093403 punch from 0x0056a1 to 0x01533a (0xfc9a bytes) 000049 1788310903.139822 punch from 0x021df6 to 0x02d28d (0xb498 bytes) 000050 1788310903.149067 mapwrite 0x029863 thru 0x031d0c (0x84aa bytes) 000051 1788310903.212399 read 0x031e12 thru 0x03eb82 (0xcd71 bytes) 000052 1788310903.227911 punch from 0x01b981 to 0x02a46c (0xeaec bytes) 000053 1788310903.234403 trunc from 0x040000 to 0x03298c (0xd673 bytes) 000054 1788310903.257637 read 0x02e0b4 thru 0x03298c (0x48d9 bytes) 000055 1788310903.258780 trunc from 0x023527 to 0x0245ff (0x10d9 bytes) 000056 1788310903.269198 mapwrite 0x03b53c thru 0x03ffff (0x4ac4 bytes) 000058 1788310903.325366 mapread 0x014ad3 thru 0x01773d (0x2c6b bytes) 000062 1788310903.332068 trunc from 0x040000 to 0x01c2f0 (0x23d0f bytes) 000063 1788310903.353812 mapread 0x01be44 thru 0x01c2f0 (0x4ad bytes) 000064 1788310903.355263 trunc from 0x01c2f1 to 0x011765 (0xab8b bytes) 000066 1788310903.389609 mapread 0x00dbca thru 0x011765 (0x3b9c bytes) 000067 1788310903.391768 mapwrite 0x01850a thru 0x021d23 (0x981a bytes) 000068 1788310903.476138 punch from 0x008dc9 to 0x00d519 (0x4751 bytes) 000069 1788310903.485727 read 0x009cf9 thru 0x018662 (0xe96a bytes) 000070 1788310903.504509 punch from 0x0110f2 to 0x015d2a (0x4c39 bytes) 000071 1788310903.511056 punch from 0x002f52 to 0x012d5a (0xfe09 bytes) 000073 1788310903.519647 trunc from 0x021d24 to 0x03cbab (0x1ae88 bytes) 000074 1788310903.551416 mapread 0x037afa thru 0x03cbab (0x50b2 bytes) 000075 1788310903.568196 trunc from 0x03cbac to 0x0178a5 (0x25306 bytes) 000076 1788310903.590595 trunc from 0x0178a6 to 0x01974e (0x1ea9 bytes) 000077 1788310903.606361 fallocate 0x020601 thru 0x030222 (0xfc22 bytes) 000078 1788310903.612314 mapwrite 0x036196 thru 0x03ffff (0x9e6a bytes) 000079 1788310903.694105 fallocate 0x0292d7 thru 0x02cf65 (0x3c8f bytes) 000080 1788310903.700786 punch from 0x02c350 to 0x02d633 (0x12e4 bytes) 000081 1788310903.707583 trunc from 0x00559d to 0x006358 (0xdbc bytes) 000082 1788310903.717848 MIRROR_EXTEND to 2 mirrors 000083 1788310904.427648 trunc from 0x040000 to 0x036207 (0x9df8 bytes) 000084 1788310904.478016 write 0x03e30e thru 0x03ffff (0x1cf2 bytes) 000085 1788310904.480122 trunc from 0x032232 to 0x0350d5 (0x2ea4 bytes) 000086 1788310904.492186 trunc from 0x040000 to 0x00d523 (0x32adc bytes) 000087 1788310904.521180 write 0x007218 thru 0x015601 (0xe3ea bytes) 000089 1788310904.548717 MIRROR_RESYNC 2 mirrors 000090 1788310905.323415 write 0x03db7e thru 0x03ed40 (0x11c3 bytes) 000091 1788310905.361129 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) 000092 1788310905.587708 fallocate 0x00cb9e thru 0x01140e (0x4871 bytes) 000093 1788310905.595645 mapread 0x031401 thru 0x03cbb7 (0xb7b7 bytes) 000094 1788310905.624587 punch from 0x00896e to 0x010f47 (0x85da bytes) 000095 1788310905.631115 trunc from 0x03ed41 to 0x02a71c (0x14624 bytes) 000097 1788310905.655140 read 0x00a98b thru 0x014e3b (0xa4b1 bytes) 000098 1788310905.665653 read 0x024d53 thru 0x02a71c (0x59ca bytes) 000099 1788310905.684145 trunc from 0x024180 to 0x02a71c (0x659d bytes) 000100 1788310905.694650 read 0x007ea2 thru 0x009350 (0x14af bytes) 000102 1788310905.695956 read 0x00d537 thru 0x01a43e (0xcf08 bytes) 000103 1788310905.713218 MIRROR_EXTEND to 2 mirrors 000104 1788310906.731044 punch from 0x00059a to 0x009c78 (0x96df bytes) 000105 1788310906.762691 trunc from 0x0174cd to 0x01879f (0x12d3 bytes) 000106 1788310906.771668 trunc from 0x02a71d to 0x00422f (0x264ed bytes) 000107 1788310906.811233 trunc from 0x002589 to 0x00422f (0x1ca7 bytes) 000108 1788310906.817579 trunc from 0x00094f to 0x00422f (0x38e1 bytes) 000109 1788310906.823594 fallocate 0x0217c1 thru 0x028c3a (0x747a bytes) 000110 1788310906.828978 write 0x00c511 thru 0x00d002 (0xaf2 bytes) 000111 1788310906.841742 write 0x03f74f thru 0x03ffff (0x8b1 bytes) 000112 1788310906.843028 mapwrite 0x0080b1 thru 0x009deb (0x1d3b bytes) 000113 1788310906.870536 trunc from 0x036f97 to 0x03bf2c (0x4f96 bytes) 000114 1788310906.875635 trunc from 0x001ebd to 0x002b21 (0xc65 bytes) 000115 1788310906.884153 trunc from 0x040000 to 0x004ae3 (0x3b51c bytes) 000116 1788310906.916141 mapread 0x00326a thru 0x004ae3 (0x187a bytes) 000117 1788310906.928690 write 0x024879 thru 0x028351 (0x3ad9 bytes) 000118 1788310906.930017 mapwrite 0x02327e thru 0x0288f0 (0x5673 bytes) 000119 1788310906.993760 punch from 0x005b82 to 0x012c5b (0xd0da bytes) 000121 1788310907.001058 trunc from 0x0288f1 to 0x02165b (0x7295 bytes) 000122 1788310907.023201 mapwrite 0x018995 thru 0x01ccca (0x4336 bytes) 000123 1788310907.051876 mapwrite 0x026438 thru 0x02d840 (0x7409 bytes) 000124 1788310907.147232 mapwrite 0x0309e3 thru 0x03380a (0x2e28 bytes) 000125 1788310907.198953 punch from 0x0163ea to 0x022b99 (0xc7b0 bytes) 000126 1788310907.205898 mapwrite 0x009a4d thru 0x00b3f3 (0x19a7 bytes) 000128 1788310907.234136 trunc from 0x03380b to 0x009574 (0x2a296 bytes) 000129 1788310907.262183 MIRROR_RESYNC 2 mirrors 000130 1788310907.995812 mapread 0x00938f thru 0x009574 (0x1e6 bytes) 000132 1788310908.007100 read 0x007983 thru 0x008fd4 (0x1652 bytes) 000133 1788310908.018880 MIRROR_EXTEND to 3 mirrors 000134 1788310908.890900 read 0x0009c6 thru 0x009574 (0x8baf bytes) 000135 1788310908.941896 trunc from 0x009575 to 0x033562 (0x29fee bytes) 000136 1788310909.013331 MIRROR_RESYNC 3 mirrors 000137 1788310909.829422 trunc from 0x033563 to 0x000a81 (0x32ae1 bytes) 000138 1788310909.866802 trunc from 0x0002a3 to 0x000a81 (0x7df bytes) 000139 1788310909.873501 write 0x01b2a6 thru 0x021a23 (0x677e bytes) 000140 1788310909.875521 read 0x01097b thru 0x0157ac (0x4e32 bytes) 000141 1788310909.883035 write 0x017179 thru 0x020adf (0x9967 bytes) 000142 1788310909.889029 trunc from 0x021a24 to 0x012871 (0xf1b2 bytes) 000143 1788310909.911845 fallocate 0x01323a thru 0x01b326 (0x80ed bytes) 000145 1788310909.918961 punch from 0x0058a6 to 0x00a508 (0x4c63 bytes) 000146 1788310909.925703 write 0x03bbec thru 0x03f0a7 (0x34bc bytes) 000147 1788310909.927260 fallocate 0x025678 thru 0x02c6ca (0x7053 bytes) 000148 1788310909.938863 MIRROR_RESYNC 3 mirrors 000149 1788310910.703900 write 0x035251 thru 0x038201 (0x2fb1 bytes) 000150 1788310910.744343 fallocate 0x018e4a thru 0x023cb4 (0xae6b bytes) 000151 1788310910.750705 mapread 0x03cf74 thru 0x03f0a7 (0x2134 bytes) 000152 1788310910.770803 mapwrite 0x038040 thru 0x03c4e7 (0x44a8 bytes) 000153 1788310910.793906 trunc from 0x03bb1c to 0x03f0a7 (0x358c bytes) 000154 1788310910.803095 trunc from 0x03f0a8 to 0x016894 (0x28813 bytes) 000155 1788310910.843884 fallocate 0x035b94 thru 0x03ffff (0xa46c bytes) 000156 1788310910.851441 read 0x0003d3 thru 0x00969f (0x92cd bytes) 000158 1788310910.864892 mapwrite 0x01ac9f thru 0x0234e6 (0x8848 bytes) 000159 1788310910.959099 read 0x003c2a thru 0x00caec (0x8ec3 bytes) 000160 1788310910.977756 trunc from 0x0109dd to 0x019b46 (0x916a bytes) 000161 1788310910.985542 mapread 0x018bc3 thru 0x0234e6 (0xa924 bytes) 000162 1788310911.002053 trunc from 0x0234e7 to 0x02d751 (0xa26b bytes) 000164 1788310911.025767 punch from 0x0191e3 to 0x022d23 (0x9b41 bytes) 000165 1788310911.035754 fallocate 0x02203a thru 0x025bf7 (0x3bbe bytes) 000166 1788310911.041077 fallocate 0x009ee6 thru 0x00cd38 (0x2e53 bytes) 000167 1788310911.053431 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2d752): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d752): Mirror 2: 0x88786f3d (stale) Mirror 3: 0x88786f3d (stale) CRC-32 checksum value for chunk [0, 0x2d752): Mirror 1: 0x2aef75a2 Mirror 4: 0x2aef75a2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d752: skipped 000168 1788310911.948427 fallocate 0x00b507 thru 0x00eff4 (0x3aee bytes) 000169 1788310911.990843 read 0x02bf22 thru 0x02d751 (0x1830 bytes) 000170 1788310912.000119 trunc from 0x028745 to 0x02a867 (0x2123 bytes) 000171 1788310912.011446 fallocate 0x03d8a8 thru 0x03ffff (0x2758 bytes) 000172 1788310912.017426 trunc from 0x036da7 to 0x03dc8e (0x6ee8 bytes) 000173 1788310912.031464 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x7e6d0e3f (stale) Mirror 4: 0x66156467 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x7e6d0e3f (stale) Mirror 4: 0x66156467 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000174 1788310912.475487 read 0x0221f4 thru 0x023bc6 (0x19d3 bytes) 000175 1788310912.484285 trunc from 0x040000 to 0x01a3c0 (0x25c3f bytes) 000176 1788310912.524470 read 0x005bb4 thru 0x0157be (0xfc0b bytes) 000178 1788310912.552637 fallocate 0x026118 thru 0x0265b9 (0x4a2 bytes) 000179 1788310912.564119 read 0x00caad thru 0x01a637 (0xdb8b bytes) 000181 1788310912.571007 mapread 0x00086e thru 0x0081b8 (0x794b bytes) 000182 1788310912.575868 read 0x01337b thru 0x019039 (0x5cbf bytes) 000183 1788310912.581264 trunc from 0x0244bf to 0x0265b9 (0x20fb bytes) 000184 1788310912.605417 fallocate 0x01d1d2 thru 0x028102 (0xaf31 bytes) 000185 1788310912.612354 trunc from 0x008dc4 to 0x010a08 (0x7c45 bytes) 000186 1788310912.635274 read 0x026f20 thru 0x028102 (0x11e3 bytes) 000187 1788310912.648653 trunc from 0x000eb2 to 0x0046ae (0x37fd bytes) 000188 1788310912.665015 read 0x01a2fb thru 0x01d95e (0x3664 bytes) 000189 1788310912.667083 trunc from 0x028103 to 0x0175f5 (0x10b0d bytes) 000190 1788310912.718702 fallocate 0x01b9d9 thru 0x025f0a (0xa532 bytes) 000191 1788310912.737562 trunc from 0x025f0b to 0x03214f (0xc245 bytes) 000192 1788310912.763174 read 0x02c443 thru 0x03214f (0x5d0d bytes) 000193 1788310912.787144 mapread 0x00653f thru 0x01639f (0xfe61 bytes) 000194 1788310912.788294 punch from 0x01dcc2 to 0x022a7a (0x4db9 bytes) 000195 1788310912.793875 mapwrite 0x0093e5 thru 0x00c8cf (0x34eb bytes) 000196 1788310912.812318 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x32150): Mirror 2: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32150): Mirror 2: 0xfd63c5c2 (stale) Mirror 4: 0xef326e7f (stale) CRC-32 checksum value for chunk [0, 0x32150): Mirror 1: 0xd090f142 Mirror 5: 0xd090f142 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32150: skipped 000197 1788310913.830118 mapwrite 0x00965b thru 0x00b20a (0x1bb0 bytes) 000198 1788310913.984942 mapwrite 0x028c9e thru 0x02ea39 (0x5d9c bytes) 000199 1788310914.031615 mapwrite 0x0308f5 thru 0x03cfb1 (0xc6bd bytes) 000200 1788310914.125053 mapread 0x014580 thru 0x01fe98 (0xb919 bytes) 000201 1788310914.142870 read 0x024583 thru 0x02b862 (0x72e0 bytes) 000202 1788310914.144045 trunc from 0x019434 to 0x027142 (0xdd0f bytes) 000203 1788310914.151616 trunc from 0x02d6ad to 0x0375d8 (0x9f2c bytes) 000205 1788310914.159092 trunc from 0x03cfb2 to 0x02a0b8 (0x12ef9 bytes) 000206 1788310914.188361 fallocate 0x0223fd thru 0x026712 (0x4316 bytes) 000207 1788310914.193760 read 0x025dba thru 0x026ee9 (0x1130 bytes) 000208 1788310914.205840 punch from 0x00c002 to 0x019327 (0xd326 bytes) 000209 1788310914.212200 trunc from 0x01d0fd to 0x02a0b8 (0xcfbc bytes) 000210 1788310914.217657 trunc from 0x01b27d to 0x0228df (0x7663 bytes) 000211 1788310914.223174 mapwrite 0x00e147 thru 0x01141a (0x32d4 bytes) 000212 1788310914.260124 trunc from 0x02a0b9 to 0x02e492 (0x43da bytes) 000213 1788310914.294546 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2e493): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e493): Mirror 2: 0x2e86d06e (stale) Mirror 4: 0x9c4da8ea (stale) Mirror 5: 0x5fd770a9 (stale) CRC-32 checksum value for chunk [0, 0x2e493): Mirror 1: 0xbd7a4334 Mirror 6: 0xbd7a4334 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e493: skipped 000214 1788310915.367514 mapwrite 0x017860 thru 0x01c7dd (0x4f7e bytes) 000215 1788310915.505722 punch from 0x01ca77 to 0x022afe (0x6088 bytes) 000216 1788310915.517172 mapwrite 0x039441 thru 0x03ffff (0x6bbf bytes) 000217 1788310915.661627 MIRROR_RESYNC 5 mirrors 000218 1788310918.027557 read 0x03b5e9 thru 0x03ffff (0x4a17 bytes) 000219 1788310918.045854 trunc from 0x036486 to 0x03ffff (0x9b7a bytes) 000220 1788310918.124136 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x33838822 (stale) Mirror 4: 0x33838822 (stale) Mirror 5: 0x33838822 (stale) Mirror 6: 0x33838822 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xab95241a Mirror 7: 0xab95241a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000222 1788310919.318723 mapwrite 0x02c2fe thru 0x02e753 (0x2456 bytes) 000223 1788310919.456755 fallocate 0x03d388 thru 0x03ffff (0x2c78 bytes) 000224 1788310919.464601 read 0x032690 thru 0x039cfa (0x766b bytes) 000225 1788310919.472908 read 0x009f80 thru 0x00dd37 (0x3db8 bytes) 000226 1788310919.488147 punch from 0x03af02 to 0x03ffff (0x50fe bytes) 000227 1788310919.498743 mapread 0x03e994 thru 0x03ffff (0x166c bytes) 000228 1788310919.521215 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x33838822 (stale) Mirror 4: 0x33838822 (stale) Mirror 5: 0x33838822 (stale) Mirror 6: 0x33838822 (stale) Mirror 7: 0xab95241a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3bb06479 Mirror 8: 0x3bb06479 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000229 1788310920.870664 mapwrite 0x039ea6 thru 0x03ffff (0x615a bytes) 000230 1788310921.048980 read 0x00ca01 thru 0x018bb5 (0xc1b5 bytes) 000231 1788310921.065759 write 0x037c52 thru 0x037cfc (0xab bytes) 000232 1788310921.074538 read 0x03c02a thru 0x03ef7b (0x2f52 bytes) 000233 1788310921.075336 read 0x004875 thru 0x00e8b0 (0xa03c bytes) 000234 1788310921.101904 mapread 0x034a4a thru 0x03ffff (0xb5b6 bytes) 000236 1788310921.108621 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x33838822 (stale) Mirror 4: 0x33838822 (stale) Mirror 5: 0x33838822 (stale) Mirror 6: 0x33838822 (stale) Mirror 7: 0xab95241a (stale) Mirror 8: 0x3bb06479 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x57cc5c2d Mirror 9: 0x57cc5c2d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000238 1788310922.076246 mapread 0x0015b7 thru 0x006b45 (0x558f bytes) 000239 1788310922.108287 mapwrite 0x02a7be thru 0x033725 (0x8f68 bytes) 000240 1788310922.255636 fallocate 0x00ac95 thru 0x00be54 (0x11c0 bytes) 000241 1788310922.261452 mapread 0x028f99 thru 0x036c35 (0xdc9d bytes) 000242 1788310922.263311 fallocate 0x0228fb thru 0x029b1c (0x7222 bytes) 000243 1788310922.268468 read 0x03b73f thru 0x03ffff (0x48c1 bytes) 000245 1788310922.276736 punch from 0x03056b to 0x039eaa (0x9940 bytes) 000246 1788310922.283908 fallocate 0x038867 thru 0x03f3ae (0x6b48 bytes) 000247 1788310922.290675 trunc from 0x040000 to 0x036812 (0x97ed bytes) 000248 1788310922.350910 punch from 0x019449 to 0x027239 (0xddf1 bytes) 000249 1788310922.357637 mapwrite 0x01f2b6 thru 0x02af62 (0xbcad bytes) 000250 1788310922.390449 write 0x007134 thru 0x010d56 (0x9c23 bytes) 000251 1788310922.403382 trunc from 0x034375 to 0x036812 (0x249e bytes) 000252 1788310922.409286 write 0x02ef2c thru 0x0332cd (0x43a2 bytes) 000253 1788310922.416712 punch from 0x010107 to 0x0143c4 (0x42be bytes) 000254 1788310922.435696 punch from 0x01934d to 0x019c63 (0x917 bytes) 000256 1788310922.447873 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36813): Mirror 2: 0x3a90685b (stale) Mirror 4: 0x3a90685b (stale) Mirror 5: 0x3a90685b (stale) Mirror 6: 0x3a90685b (stale) Mirror 8: 0x3dfbe5a (stale) Mirror 9: 0x3dfbe5a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36813): Mirror 2: 0x3a90685b (stale) Mirror 4: 0x3a90685b (stale) Mirror 5: 0x3a90685b (stale) Mirror 6: 0x3a90685b (stale) Mirror 8: 0x3dfbe5a (stale) Mirror 9: 0x3dfbe5a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36813: skipped 000257 1788310923.124904 write 0x032cfb thru 0x03ad43 (0x8049 bytes) 000258 1788310923.149642 trunc from 0x012623 to 0x0131af (0xb8d bytes) 000259 1788310923.156811 mapread 0x0209c2 thru 0x02f3d8 (0xea17 bytes) 000260 1788310923.181752 punch from 0x0332e7 to 0x035ee3 (0x2bfd bytes) 000261 1788310923.205773 MIRROR_RESYNC 7 mirrors 000262 1788310925.416995 read 0x00edf0 thru 0x01ed47 (0xff58 bytes) 000263 1788310925.433115 mapread 0x00cf13 thru 0x011f4f (0x503d bytes) 000265 1788310925.444149 mapread 0x028f14 thru 0x0345f4 (0xb6e1 bytes) 000266 1788310925.464294 trunc from 0x03ad44 to 0x004c07 (0x3613c bytes) 000267 1788310925.508897 fallocate 0x02238d thru 0x025d6b (0x39df bytes) 000268 1788310925.514729 mapread 0x00cbe2 thru 0x0102ec (0x370b bytes) 000269 1788310925.531864 mapread 0x014428 thru 0x016646 (0x221f bytes) 000270 1788310925.573775 trunc from 0x01fb41 to 0x025d6b (0x622b bytes) 000271 1788310925.585180 fallocate 0x0370b9 thru 0x03cd48 (0x5c90 bytes) 000272 1788310925.602840 fallocate 0x037da9 thru 0x037e40 (0x98 bytes) 000273 1788310925.621648 mapread 0x01d3cf thru 0x024db8 (0x79ea bytes) 000274 1788310925.636115 mapwrite 0x02acb5 thru 0x02b020 (0x36c bytes) 000275 1788310925.669781 trunc from 0x02a8c0 to 0x031a1a (0x715b bytes) 000276 1788310925.684628 MIRROR_RESYNC 7 mirrors 000277 1788310927.641106 MIRROR_EXTEND to 8 mirrors 000278 1788310928.604622 mapread 0x00d904 thru 0x016a44 (0x9141 bytes) 000279 1788310928.647841 punch from 0x0089a4 to 0x010838 (0x7e95 bytes) 000280 1788310928.740354 mapread 0x03198e thru 0x034f82 (0x35f5 bytes) 000281 1788310928.769137 fallocate 0x01a815 thru 0x01ed29 (0x4515 bytes) 000282 1788310928.790568 trunc from 0x02587c to 0x02dd5f (0x84e4 bytes) 000283 1788310928.820150 MIRROR_RESYNC 8 mirrors 000284 1788310930.144408 mapwrite 0x00b2fa thru 0x019421 (0xe128 bytes) 000285 1788310930.343566 trunc from 0x03cd49 to 0x02d715 (0xf633 bytes) 000289 1788310930.406807 MIRROR_RESYNC 8 mirrors 000290 1788310932.412009 trunc from 0x025df5 to 0x02d715 (0x7921 bytes) 000291 1788310932.448541 read 0x017849 thru 0x01efcd (0x7785 bytes) 000292 1788310932.473717 mapwrite 0x0351ac thru 0x0393c5 (0x421a bytes) 000293 1788310932.592496 trunc from 0x0393c6 to 0x00f6f1 (0x29cd4 bytes) 000294 1788310932.628180 trunc from 0x00f6f2 to 0x002ee8 (0xc809 bytes) 000295 1788310932.650473 punch from 0x002daf to 0x002ee8 (0x13a bytes) 000296 1788310932.660367 write 0x023e8d thru 0x02923f (0x53b3 bytes) 000297 1788310932.665540 mapwrite 0x006352 thru 0x010161 (0x9e10 bytes) 000298 1788310932.716207 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x29240): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29240): Mirror 2: 0x40178569 (stale) Mirror 4: 0x40178569 (stale) Mirror 5: 0x40178569 (stale) Mirror 6: 0x40178569 (stale) Mirror 8: 0x40178569 (stale) Mirror 9: 0x40178569 (stale) Mirror 10: 0x40178569 (stale) CRC-32 checksum value for chunk [0, 0x29240): Mirror 1: 0xeb4c1c66 Mirror 11: 0xeb4c1c66 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29240: skipped 000299 1788310933.848069 mapread 0x020a1a thru 0x02923f (0x8826 bytes) 000300 1788310933.891536 MIRROR_RESYNC 9 mirrors 000301 1788310936.038886 mapwrite 0x01f458 thru 0x025467 (0x6010 bytes) 000302 1788310936.184900 read 0x00c4d4 thru 0x00ce17 (0x944 bytes) 000303 1788310936.200395 punch from 0x01eefd to 0x028fa2 (0xa0a6 bytes) 000304 1788310936.215236 trunc from 0x029240 to 0x03b046 (0x11e07 bytes) 000305 1788310936.263330 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3b047): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b047): Mirror 2: 0x26981b80 (stale) Mirror 4: 0x26981b80 (stale) Mirror 5: 0x26981b80 (stale) Mirror 6: 0x26981b80 (stale) Mirror 8: 0x26981b80 (stale) Mirror 9: 0x26981b80 (stale) Mirror 10: 0x26981b80 (stale) Mirror 11: 0x26981b80 (stale) CRC-32 checksum value for chunk [0, 0x3b047): Mirror 1: 0x8d78b81 Mirror 12: 0x8d78b81 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b047: skipped 000306 1788310937.717646 punch from 0x01ab43 to 0x0285f3 (0xdab1 bytes) 000307 1788310937.763362 mapwrite 0x03cee4 thru 0x03f5c4 (0x26e1 bytes) 000308 1788310937.866092 write 0x011ff7 thru 0x01c87f (0xa889 bytes) 000309 1788310937.891489 punch from 0x017ecd to 0x026e57 (0xef8b bytes) 000310 1788310937.914064 mapwrite 0x02780f thru 0x035464 (0xdc56 bytes) 000311 1788310937.974141 fallocate 0x0135b2 thru 0x01dd04 (0xa753 bytes) 000312 1788310937.980542 write 0x0125a8 thru 0x01dbdd (0xb636 bytes) 000313 1788310937.988051 mapwrite 0x032a0f thru 0x03fb9d (0xd18f bytes) 000314 1788310938.053438 mapwrite 0x01e31f thru 0x01eae3 (0x7c5 bytes) 000315 1788310938.085410 fallocate 0x0179e2 thru 0x022bd2 (0xb1f1 bytes) 000316 1788310938.109963 trunc from 0x03fb9e to 0x020229 (0x1f974 bytes) 000317 1788310938.146877 mapwrite 0x01a6d9 thru 0x025f55 (0xb87d bytes) 000318 1788310938.245672 fallocate 0x03a999 thru 0x03ffff (0x5667 bytes) 000319 1788310938.264477 read 0x00375d thru 0x004822 (0x10c6 bytes) 000320 1788310938.271426 punch from 0x007072 to 0x010bc6 (0x9b55 bytes) 000321 1788310938.282114 trunc from 0x01205c to 0x020aec (0xea91 bytes) 000322 1788310938.314732 write 0x0057ba thru 0x00e081 (0x88c8 bytes) 000323 1788310938.357602 mapwrite 0x001a61 thru 0x00b051 (0x95f1 bytes) 000324 1788310938.388095 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25f56): Mirror 4: 0xccc52188 (stale) Mirror 5: 0xccc52188 (stale) Mirror 6: 0xccc52188 (stale) Mirror 8: 0xccc52188 (stale) Mirror 9: 0xccc52188 (stale) Mirror 10: 0xccc52188 (stale) Mirror 11: 0xccc52188 (stale) Mirror 12: 0x6d20ac62 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25f56): Mirror 4: 0xccc52188 (stale) Mirror 5: 0xccc52188 (stale) Mirror 6: 0xccc52188 (stale) Mirror 8: 0xccc52188 (stale) Mirror 9: 0xccc52188 (stale) Mirror 10: 0xccc52188 (stale) Mirror 11: 0xccc52188 (stale) Mirror 12: 0x6d20ac62 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25f56: skipped 000325 1788310939.212747 trunc from 0x015c4c to 0x0243e9 (0xe79e bytes) 000327 1788310939.223319 mapread 0x00cd70 thru 0x01565f (0x88f0 bytes) 000328 1788310939.261071 mapwrite 0x00e683 thru 0x012b01 (0x447f bytes) 000329 1788310939.284206 read 0x00d146 thru 0x017dde (0xac99 bytes) 000330 1788310939.298383 mapwrite 0x038050 thru 0x03d744 (0x56f5 bytes) 000331 1788310939.383997 punch from 0x02711a to 0x031e24 (0xad0b bytes) 000332 1788310939.392730 mapwrite 0x0021a9 thru 0x006749 (0x45a1 bytes) 000333 1788310939.439829 write 0x018249 thru 0x028161 (0xff19 bytes) 000335 1788310939.461572 MIRROR_RESYNC 9 mirrors 000336 1788310941.883717 write 0x00de2c thru 0x018d84 (0xaf59 bytes) 000337 1788310941.952474 mapread 0x02b06b thru 0x02fb5f (0x4af5 bytes) 000338 1788310941.980523 trunc from 0x03d745 to 0x03fc81 (0x253d bytes) 000339 1788310942.007194 trunc from 0x03fc82 to 0x00e5b0 (0x316d1 bytes) 000340 1788310942.025349 trunc from 0x003e17 to 0x00b35c (0x7546 bytes) 000341 1788310942.031295 read 0x001915 thru 0x007d81 (0x646d bytes) 000342 1788310942.045291 read 0x00ccae thru 0x00e2e8 (0x163b bytes) 000343 1788310942.056151 read 0x00cbaf thru 0x00e5b0 (0x1a02 bytes) 000344 1788310942.056986 mapwrite 0x01f4f4 thru 0x0207ec (0x12f9 bytes) 000345 1788310942.101563 write 0x03c5af thru 0x03ffff (0x3a51 bytes) 000346 1788310942.110329 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xb07541c0 (stale) Mirror 5: 0xb07541c0 (stale) Mirror 6: 0xb07541c0 (stale) Mirror 9: 0xb07541c0 (stale) Mirror 10: 0xb07541c0 (stale) Mirror 11: 0xb07541c0 (stale) Mirror 12: 0xb07541c0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xb07541c0 (stale) Mirror 5: 0xb07541c0 (stale) Mirror 6: 0xb07541c0 (stale) Mirror 9: 0xb07541c0 (stale) Mirror 10: 0xb07541c0 (stale) Mirror 11: 0xb07541c0 (stale) Mirror 12: 0xb07541c0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000347 1788310942.667990 punch from 0x03b219 to 0x03ffff (0x4de7 bytes) 000348 1788310942.673520 trunc from 0x022ff1 to 0x030eec (0xdefc bytes) 000349 1788310942.680142 fallocate 0x029c5e thru 0x030501 (0x68a4 bytes) 000350 1788310942.685441 trunc from 0x032d85 to 0x03550f (0x278b bytes) 000351 1788310942.690395 trunc from 0x01939a to 0x02373e (0xa3a5 bytes) 000352 1788310942.695527 fallocate 0x010778 thru 0x01412e (0x39b7 bytes) 000353 1788310942.700851 trunc from 0x040000 to 0x038d74 (0x728b bytes) 000354 1788310942.727832 punch from 0x001011 to 0x00c20a (0xb1fa bytes) 000356 1788310942.736381 mapread 0x00a413 thru 0x00d704 (0x32f2 bytes) 000357 1788310942.758546 trunc from 0x038d75 to 0x02b7ec (0xd588 bytes) 000358 1788310942.776864 punch from 0x027013 to 0x02b7ec (0x47da bytes) 000359 1788310942.783393 mapwrite 0x02454d thru 0x02d1ed (0x8ca1 bytes) 000360 1788310942.850229 fallocate 0x02457a thru 0x0248c9 (0x350 bytes) 000361 1788310942.871864 trunc from 0x02d1ee to 0x01baaf (0x1173e bytes) 000362 1788310942.911910 read 0x018e18 thru 0x01baaf (0x2c98 bytes) 000363 1788310942.925730 read 0x00babd thru 0x015f97 (0xa4db bytes) 000364 1788310942.952150 MIRROR_RESYNC 8 mirrors 000365 1788310945.074316 mapwrite 0x027f2c thru 0x0343f5 (0xc4ca bytes) 000366 1788310945.175304 fallocate 0x0244b2 thru 0x02cdc0 (0x890f bytes) 000367 1788310945.182868 mapread 0x0236a1 thru 0x031863 (0xe1c3 bytes) 000368 1788310945.187683 trunc from 0x0343f6 to 0x036ce8 (0x28f3 bytes) 000369 1788310945.237163 trunc from 0x036ce9 to 0x0206df (0x16609 bytes) 000371 1788310945.256866 read 0x00816e thru 0x00a4ac (0x233f bytes) 000372 1788310945.262899 read 0x00b3e1 thru 0x01a950 (0xf570 bytes) 000373 1788310945.272374 fallocate 0x018dc0 thru 0x026df0 (0xe031 bytes) 000374 1788310945.277733 read 0x00692a thru 0x007877 (0xf4e bytes) 000375 1788310945.279009 write 0x00ae99 thru 0x015a87 (0xabef bytes) 000376 1788310945.282207 fallocate 0x02eaee thru 0x03cbb1 (0xe0c4 bytes) 000377 1788310945.288279 read 0x00585f thru 0x0066e3 (0xe85 bytes) 000378 1788310945.289339 read 0x02ec63 thru 0x03a67e (0xba1c bytes) 000379 1788310945.301677 fallocate 0x007d56 thru 0x00e604 (0x68af bytes) 000380 1788310945.311491 MIRROR_RESYNC 8 mirrors 000381 1788310947.706153 read 0x0239d7 thru 0x02b256 (0x7880 bytes) 000382 1788310947.719258 punch from 0x0183cd to 0x02693b (0xe56f bytes) 000383 1788310947.758623 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cbb2): Mirror 4: 0x54a7333e (stale) Mirror 5: 0x54a7333e (stale) Mirror 6: 0x54a7333e (stale) Mirror 9: 0x54a7333e (stale) Mirror 11: 0x54a7333e (stale) Mirror 12: 0x54a7333e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cbb2): Mirror 4: 0x54a7333e (stale) Mirror 5: 0x54a7333e (stale) Mirror 6: 0x54a7333e (stale) Mirror 9: 0x54a7333e (stale) Mirror 11: 0x54a7333e (stale) Mirror 12: 0x54a7333e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cbb2: skipped 000385 1788310948.371059 read 0x02fb0c thru 0x038f5e (0x9453 bytes) 000386 1788310948.380663 punch from 0x00a14a to 0x00ea60 (0x4917 bytes) 000387 1788310948.387767 mapread 0x028cbb thru 0x036080 (0xd3c6 bytes) 000388 1788310948.423005 read 0x016906 thru 0x0259c6 (0xf0c1 bytes) 000389 1788310948.437208 mapread 0x004945 thru 0x00bb13 (0x71cf bytes) 000390 1788310948.438870 fallocate 0x010766 thru 0x01a1bd (0x9a58 bytes) 000391 1788310948.453198 read 0x01c655 thru 0x01f9df (0x338b bytes) 000392 1788310948.458211 fallocate 0x002ec6 thru 0x011aa6 (0xebe1 bytes) 000393 1788310948.463340 mapwrite 0x01a099 thru 0x01b7f8 (0x1760 bytes) 000394 1788310948.486034 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cbb2): Mirror 4: 0x54a7333e (stale) Mirror 6: 0x54a7333e (stale) Mirror 9: 0x54a7333e (stale) Mirror 11: 0x54a7333e (stale) Mirror 12: 0x54a7333e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cbb2): Mirror 4: 0x54a7333e (stale) Mirror 6: 0x54a7333e (stale) Mirror 9: 0x54a7333e (stale) Mirror 11: 0x54a7333e (stale) Mirror 12: 0x54a7333e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cbb2: skipped 000395 1788310948.923470 trunc from 0x03cbb2 to 0x02f8c6 (0xd2eb bytes) 000396 1788310948.952743 write 0x00be9c thru 0x0142c2 (0x8427 bytes) 000397 1788310948.980456 trunc from 0x01b41c to 0x02ae9e (0xfa83 bytes) 000398 1788310948.994900 trunc from 0x01bf5c to 0x01dde4 (0x1e89 bytes) 000399 1788310949.009392 trunc from 0x02f8c7 to 0x0029cc (0x2cefa bytes) 000400 1788310949.027987 trunc from 0x001a28 to 0x0029cc (0xfa5 bytes) 000402 1788310949.037236 trunc from 0x0029cd to 0x0281c0 (0x257f4 bytes) 000403 1788310949.075695 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x281c1): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x281c1): Mirror 4: 0x9fc5b041 (stale) Mirror 6: 0x9fc5b041 (stale) Mirror 9: 0x9fc5b041 (stale) Mirror 11: 0x9fc5b041 (stale) Mirror 12: 0x9fc5b041 (stale) CRC-32 checksum value for chunk [0, 0x281c1): Mirror 1: 0x12ae35f3 Mirror 13: 0x12ae35f3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x281c1: skipped 000404 1788310950.521268 trunc from 0x0281c1 to 0x033833 (0xb673 bytes) 000405 1788310950.656307 mapwrite 0x0059a5 thru 0x01473e (0xed9a bytes) 000406 1788310950.802482 trunc from 0x033834 to 0x0093e4 (0x2a44f bytes) 000407 1788310950.883701 write 0x003615 thru 0x010a7e (0xd46a bytes) 000408 1788310950.893895 mapread 0x004e65 thru 0x006569 (0x1705 bytes) 000409 1788310950.897164 read 0x0085f1 thru 0x010a7e (0x848e bytes) 000410 1788310950.899701 mapread 0x0008a5 thru 0x00362c (0x2d88 bytes) 000412 1788310950.912626 trunc from 0x00a131 to 0x00ad22 (0xbf2 bytes) 000413 1788310950.972396 trunc from 0x0029db to 0x004739 (0x1d5f bytes) 000415 1788310950.982279 punch from 0x000fbe to 0x003ad6 (0x2b19 bytes) 000416 1788310950.997474 fallocate 0x035f63 thru 0x03a2fb (0x4399 bytes) 000417 1788310951.010612 trunc from 0x00ea27 to 0x010a7e (0x2058 bytes) 000418 1788310951.035813 mapread 0x004eb8 thru 0x008fba (0x4103 bytes) 000419 1788310951.068430 write 0x032d03 thru 0x038fde (0x62dc bytes) 000421 1788310951.070330 read 0x02bbb6 thru 0x02cbcf (0x101a bytes) 000422 1788310951.086630 mapread 0x023352 thru 0x02638f (0x303e bytes) 000423 1788310951.087582 read 0x0002ab thru 0x0015aa (0x1300 bytes) 000424 1788310951.088151 trunc from 0x00ef5e to 0x01d1e2 (0xe285 bytes) 000425 1788310951.099664 mapwrite 0x03974e thru 0x0399b4 (0x267 bytes) 000426 1788310951.181841 fallocate 0x036e6d thru 0x03d463 (0x65f7 bytes) 000427 1788310951.191125 punch from 0x0364c8 to 0x037ae1 (0x161a bytes) 000428 1788310951.224094 trunc from 0x03d464 to 0x002878 (0x3abeb bytes) 000429 1788310951.253522 write 0x031325 thru 0x036a03 (0x56df bytes) 000430 1788310951.296431 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36a04): Mirror 6: 0x18e32b11 (stale) Mirror 9: 0x18e32b11 (stale) Mirror 11: 0x18e32b11 (stale) Mirror 12: 0x18e32b11 (stale) Mirror 13: 0x2ffc5a28 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36a04): Mirror 6: 0x18e32b11 (stale) Mirror 9: 0x18e32b11 (stale) Mirror 11: 0x18e32b11 (stale) Mirror 12: 0x18e32b11 (stale) Mirror 13: 0x2ffc5a28 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36a04: skipped 000431 1788310951.932473 trunc from 0x036a04 to 0x0200e6 (0x1691d bytes) 000432 1788310951.996681 write 0x0148e7 thru 0x022397 (0xdab1 bytes) 000433 1788310952.010357 mapwrite 0x01ad11 thru 0x02a462 (0xf752 bytes) 000434 1788310952.077092 trunc from 0x02a463 to 0x02485f (0x5c03 bytes) 000435 1788310952.099221 write 0x010a64 thru 0x01c0ee (0xb68b bytes) 000436 1788310952.106244 trunc from 0x014a46 to 0x0168b4 (0x1e6f bytes) 000437 1788310952.128753 trunc from 0x010926 to 0x01a16b (0x9846 bytes) 000438 1788310952.135268 write 0x015f71 thru 0x023ee6 (0xdf76 bytes) 000439 1788310952.144850 mapwrite 0x02d6ad thru 0x03b6c9 (0xe01d bytes) 000440 1788310952.267840 trunc from 0x03b6ca to 0x022c64 (0x18a65 bytes) 000441 1788310952.315060 MIRROR_RESYNC 6 mirrors 000442 1788310954.009236 fallocate 0x03fbac thru 0x03ffff (0x454 bytes) 000443 1788310954.047906 write 0x0322b1 thru 0x033f88 (0x1cd8 bytes) 000445 1788310954.056132 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x33f89): Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33f89): Mirror 6: 0x3602f44e (stale) Mirror 9: 0x3602f44e (stale) Mirror 11: 0x3602f44e (stale) Mirror 12: 0x3602f44e (stale) Mirror 13: 0x3602f44e (stale) CRC-32 checksum value for chunk [0, 0x33f89): Mirror 1: 0x123e8c2 Mirror 14: 0x123e8c2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33f89: skipped 000446 1788310955.461824 read 0x026e46 thru 0x02f2c8 (0x8483 bytes) 000447 1788310955.484837 read 0x033a99 thru 0x033f88 (0x4f0 bytes) 000448 1788310955.506226 trunc from 0x033f89 to 0x02324b (0x10d3d bytes) 000449 1788310955.595821 mapread 0x00b2b7 thru 0x00ccf0 (0x1a3a bytes) 000451 1788310955.608088 mapwrite 0x030c97 thru 0x03ba36 (0xada0 bytes) 000452 1788310955.716742 trunc from 0x014ede to 0x017239 (0x235c bytes) 000453 1788310955.723425 punch from 0x02f2ba to 0x036a56 (0x779d bytes) 000454 1788310955.747468 trunc from 0x018ccf to 0x020314 (0x7646 bytes) 000455 1788310955.765241 punch from 0x03131e to 0x0342f7 (0x2fda bytes) 000456 1788310955.772064 punch from 0x037293 to 0x03ba36 (0x47a4 bytes) 000457 1788310955.778355 trunc from 0x03ab6b to 0x03ba36 (0xecc bytes) 000459 1788310955.784299 trunc from 0x03ba37 to 0x02779f (0x14297 bytes) 000460 1788310955.803796 read 0x0009da thru 0x00278c (0x1db3 bytes) 000461 1788310955.815807 mapread 0x003725 thru 0x007391 (0x3c6d bytes) 000463 1788310955.818537 punch from 0x025d87 to 0x02779f (0x1a19 bytes) 000464 1788310955.824214 read 0x02501e thru 0x02779f (0x2782 bytes) 000465 1788310955.830509 mapwrite 0x00b60c thru 0x017077 (0xba6c bytes) 000466 1788310955.869861 fallocate 0x0007ed thru 0x00caa9 (0xc2bd bytes) 000467 1788310955.875396 mapread 0x011cc3 thru 0x014115 (0x2453 bytes) 000468 1788310955.877592 mapread 0x015234 thru 0x015c70 (0xa3d bytes) 000470 1788310955.902175 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x277a0): Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x277a0): Mirror 6: 0xb885bd46 (stale) Mirror 9: 0xb885bd46 (stale) Mirror 11: 0xb885bd46 (stale) Mirror 12: 0xb885bd46 (stale) Mirror 13: 0xb885bd46 (stale) Mirror 14: 0xb885bd46 (stale) CRC-32 checksum value for chunk [0, 0x277a0): Mirror 1: 0x82bad89e Mirror 15: 0x82bad89e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x277a0: skipped 000471 1788310957.215895 trunc from 0x024eb8 to 0x02779f (0x28e8 bytes) 000472 1788310957.264738 write 0x0040f2 thru 0x00c615 (0x8524 bytes) 000473 1788310957.290953 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x277a0): Mirror 6: 0xb885bd46 (stale) Mirror 9: 0xb885bd46 (stale) Mirror 11: 0xb885bd46 (stale) Mirror 13: 0xb885bd46 (stale) Mirror 14: 0xb885bd46 (stale) Mirror 15: 0x82bad89e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x277a0): Mirror 6: 0xb885bd46 (stale) Mirror 9: 0xb885bd46 (stale) Mirror 11: 0xb885bd46 (stale) Mirror 13: 0xb885bd46 (stale) Mirror 14: 0xb885bd46 (stale) Mirror 15: 0x82bad89e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x277a0: skipped 000474 1788310957.738974 punch from 0x012f37 to 0x0210d6 (0xe1a0 bytes) 000475 1788310957.748219 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x277a0): Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x277a0): Mirror 6: 0xb885bd46 (stale) Mirror 9: 0xb885bd46 (stale) Mirror 11: 0xb885bd46 (stale) Mirror 13: 0xb885bd46 (stale) Mirror 14: 0xb885bd46 (stale) Mirror 15: 0x82bad89e (stale) CRC-32 checksum value for chunk [0, 0x277a0): Mirror 1: 0xb15af64a Mirror 16: 0xb15af64a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x277a0: skipped 000476 1788310959.251428 fallocate 0x0009bc thru 0x00890a (0x7f4f bytes) 000477 1788310959.315754 read 0x0256ef thru 0x02779f (0x20b1 bytes) 000478 1788310959.333735 fallocate 0x030aab thru 0x034110 (0x3666 bytes) 000479 1788310959.346516 trunc from 0x01b4d9 to 0x020d5e (0x5886 bytes) 000480 1788310959.359371 mapread 0x00e3b9 thru 0x019482 (0xb0ca bytes) 000481 1788310959.404235 fallocate 0x008cd0 thru 0x012aab (0x9ddc bytes) 000482 1788310959.410067 trunc from 0x0277a0 to 0x03468f (0xcef0 bytes) 000483 1788310959.434670 trunc from 0x034690 to 0x0000aa (0x345e5 bytes) 000484 1788310959.464484 MIRROR_RESYNC 8 mirrors 000485 1788310960.701735 trunc from 0x0000ab to 0x033fa7 (0x33efd bytes) 000487 1788310960.738204 mapread 0x01bf76 thru 0x028add (0xcb68 bytes) 000488 1788310960.769899 mapwrite 0x02dec3 thru 0x02e154 (0x292 bytes) 000489 1788310960.787830 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33fa8): Mirror 9: 0x15523428 (stale) Mirror 11: 0x15523428 (stale) Mirror 13: 0x15523428 (stale) Mirror 14: 0x15523428 (stale) Mirror 15: 0x15523428 (stale) Mirror 16: 0x15523428 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33fa8): Mirror 9: 0x15523428 (stale) Mirror 11: 0x15523428 (stale) Mirror 13: 0x15523428 (stale) Mirror 14: 0x15523428 (stale) Mirror 15: 0x15523428 (stale) Mirror 16: 0x15523428 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33fa8: skipped 000490 1788310961.339692 mapwrite 0x013a8b thru 0x01832b (0x48a1 bytes) 000491 1788310961.409880 write 0x00a18e thru 0x015bc6 (0xba39 bytes) 000492 1788310961.422859 trunc from 0x033fa8 to 0x009c37 (0x2a370 bytes) 000493 1788310961.476047 trunc from 0x009c38 to 0x016fd3 (0xd39c bytes) 000494 1788310961.504110 mapwrite 0x03d26c thru 0x03ffff (0x2d94 bytes) 000495 1788310961.561887 trunc from 0x01852c to 0x01c87b (0x4350 bytes) 000496 1788310961.570454 mapwrite 0x015642 thru 0x02481c (0xf1db bytes) 000497 1788310961.637497 fallocate 0x027df1 thru 0x02f48c (0x769c bytes) 000498 1788310961.648988 mapwrite 0x0335c4 thru 0x03eb74 (0xb5b1 bytes) 000499 1788310961.683239 mapwrite 0x021bdb thru 0x027c7d (0x60a3 bytes) 000500 1788310961.720617 trunc from 0x03efbd to 0x03ffff (0x1043 bytes) 000501 1788310961.729255 read 0x01b92d thru 0x0240c7 (0x879b bytes) 000502 1788310961.730086 write 0x0217ee thru 0x02d5aa (0xbdbd bytes) 000503 1788310961.733427 fallocate 0x00f272 thru 0x01e753 (0xf4e2 bytes) 000504 1788310961.740629 trunc from 0x040000 to 0x03846c (0x7b93 bytes) 000505 1788310961.769513 mapread 0x02621c thru 0x02690e (0x6f3 bytes) 000506 1788310961.772295 fallocate 0x011a66 thru 0x02072d (0xecc8 bytes) 000507 1788310961.785056 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3846d): Mirror 11: 0x37e56497 (stale) Mirror 13: 0x37e56497 (stale) Mirror 14: 0x37e56497 (stale) Mirror 15: 0x37e56497 (stale) Mirror 16: 0x37e56497 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3846d): Mirror 11: 0x37e56497 (stale) Mirror 13: 0x37e56497 (stale) Mirror 14: 0x37e56497 (stale) Mirror 15: 0x37e56497 (stale) Mirror 16: 0x37e56497 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3846d: skipped 000508 1788310962.306785 fallocate 0x007e82 thru 0x012ac9 (0xac48 bytes) 000509 1788310962.315158 trunc from 0x01cff6 to 0x02b3bb (0xe3c6 bytes) 000510 1788310962.331212 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3846d): Mirror 11: 0x37e56497 (stale) Mirror 13: 0x37e56497 (stale) Mirror 14: 0x37e56497 (stale) Mirror 16: 0x37e56497 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3846d): Mirror 11: 0x37e56497 (stale) Mirror 13: 0x37e56497 (stale) Mirror 14: 0x37e56497 (stale) Mirror 16: 0x37e56497 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3846d: skipped 000511 1788310962.769954 punch from 0x037335 to 0x03846c (0x1138 bytes) 000512 1788310962.776776 trunc from 0x03846d to 0x02a1f1 (0xe27b bytes) 000513 1788310962.804146 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a1f2): Mirror 11: 0x72d6dd0d (stale) Mirror 14: 0x72d6dd0d (stale) Mirror 16: 0x72d6dd0d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a1f2): Mirror 11: 0x72d6dd0d (stale) Mirror 14: 0x72d6dd0d (stale) Mirror 16: 0x72d6dd0d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a1f2: skipped 000514 1788310963.305710 mapread 0x0269f4 thru 0x02a1f1 (0x37fe bytes) 000515 1788310963.338095 trunc from 0x02a1f2 to 0x00ff5a (0x1a297 bytes) 000516 1788310963.427773 fallocate 0x03d53c thru 0x03ffff (0x2ac4 bytes) 000517 1788310963.442798 read 0x01f222 thru 0x027885 (0x8664 bytes) 000518 1788310963.464375 mapwrite 0x00253c thru 0x004638 (0x20fd bytes) 000519 1788310963.499087 trunc from 0x040000 to 0x02d11f (0x12ee0 bytes) 000520 1788310963.519993 read 0x01660d thru 0x0203b7 (0x9dab bytes) 000521 1788310963.536661 mapwrite 0x00ebc8 thru 0x00f3fa (0x833 bytes) 000522 1788310963.550471 read 0x00a82a thru 0x0146e8 (0x9ebf bytes) 000523 1788310963.551282 write 0x03efa2 thru 0x03ffff (0x105e bytes) 000525 1788310963.554608 mapread 0x0372ab thru 0x0399fb (0x2751 bytes) 000526 1788310963.572296 trunc from 0x01407f to 0x01d649 (0x95cb bytes) 000527 1788310963.578831 fallocate 0x00f0df thru 0x017fe3 (0x8f05 bytes) 000528 1788310963.587518 punch from 0x038496 to 0x03de1a (0x5985 bytes) 000529 1788310963.596152 trunc from 0x040000 to 0x03365e (0xc9a1 bytes) 000530 1788310963.644371 trunc from 0x03365f to 0x005341 (0x2e31d bytes) 000532 1788310963.685298 trunc from 0x005342 to 0x023fba (0x1ec79 bytes) 000533 1788310963.728710 fallocate 0x0038f4 thru 0x00ac5c (0x7369 bytes) 000534 1788310963.741142 punch from 0x01b1f9 to 0x023fba (0x8dc2 bytes) 000535 1788310963.747869 punch from 0x00ee39 to 0x018632 (0x97fa bytes) 000536 1788310963.758443 fallocate 0x01839b thru 0x01efee (0x6c54 bytes) 000537 1788310963.770979 mapread 0x01ff44 thru 0x023fba (0x4077 bytes) 000538 1788310963.849526 mapwrite 0x03c659 thru 0x03ffff (0x39a7 bytes) 000539 1788310963.943635 read 0x00b240 thru 0x0187cd (0xd58e bytes) 000540 1788310963.983335 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xe20eea22 (stale) Mirror 14: 0xe20eea22 (stale) Mirror 16: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf2cfedeb Mirror 17: 0xf2cfedeb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000541 1788310965.104473 trunc from 0x040000 to 0x01a310 (0x25cef bytes) 000542 1788310965.164755 fallocate 0x00bed5 thru 0x011d09 (0x5e35 bytes) 000543 1788310965.171518 trunc from 0x01a311 to 0x0093b1 (0x10f5f bytes) 000544 1788310965.200866 write 0x034ed5 thru 0x03ffff (0xb12b bytes) 000545 1788310965.204451 punch from 0x01804c to 0x01c0a5 (0x405a bytes) 000546 1788310965.209426 read 0x0330a8 thru 0x03c409 (0x9362 bytes) 000547 1788310965.220220 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xe20eea22 (stale) Mirror 14: 0xe20eea22 (stale) Mirror 16: 0xe20eea22 (stale) Mirror 17: 0xf2cfedeb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9e63ac85 Mirror 18: 0x9e63ac85 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000548 1788310966.552997 write 0x01d20c thru 0x01d698 (0x48d bytes) 000549 1788310966.617909 trunc from 0x00843d to 0x0126de (0xa2a2 bytes) 000551 1788310966.629275 read 0x01c289 thru 0x0248f0 (0x8668 bytes) 000552 1788310966.637567 trunc from 0x040000 to 0x0166d3 (0x2992c bytes) 000553 1788310966.681127 mapread 0x008e1b thru 0x0166d3 (0xd8b9 bytes) 000554 1788310966.711809 mapread 0x00da50 thru 0x010831 (0x2de2 bytes) 000555 1788310966.713251 trunc from 0x006714 to 0x009ef5 (0x37e2 bytes) 000556 1788310966.720360 mapread 0x00187b thru 0x005a63 (0x41e9 bytes) 000557 1788310966.733547 write 0x018e1c thru 0x025b6e (0xcd53 bytes) 000558 1788310966.738092 fallocate 0x035f5a thru 0x03ac1c (0x4cc3 bytes) 000559 1788310966.744890 punch from 0x0240b6 to 0x025b6e (0x1ab9 bytes) 000560 1788310966.765598 trunc from 0x000818 to 0x00ac8e (0xa477 bytes) 000562 1788310966.779017 write 0x02ae89 thru 0x03a405 (0xf57d bytes) 000563 1788310966.794208 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a406): Mirror 11: 0xcc03eef2 (stale) Mirror 14: 0xcc03eef2 (stale) Mirror 17: 0x4e59a02b (stale) Mirror 18: 0xc6e83484 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a406): Mirror 11: 0xcc03eef2 (stale) Mirror 14: 0xcc03eef2 (stale) Mirror 17: 0x4e59a02b (stale) Mirror 18: 0xc6e83484 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a406: skipped 000565 1788310967.391772 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3a406): Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a406): Mirror 11: 0xcc03eef2 (stale) Mirror 14: 0xcc03eef2 (stale) Mirror 17: 0x4e59a02b (stale) Mirror 18: 0xc6e83484 (stale) CRC-32 checksum value for chunk [0, 0x3a406): Mirror 1: 0x89eb7db4 Mirror 19: 0x89eb7db4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a406: skipped 000566 1788310968.825089 trunc from 0x014753 to 0x01ff50 (0xb7fe bytes) 000567 1788310968.895547 mapwrite 0x01ca08 thru 0x02201f (0x5618 bytes) 000568 1788310968.992556 fallocate 0x021fdf thru 0x0284de (0x6500 bytes) 000569 1788310969.003431 trunc from 0x01ead9 to 0x023f71 (0x5499 bytes) 000570 1788310969.016244 punch from 0x010c52 to 0x018288 (0x7637 bytes) 000571 1788310969.026430 fallocate 0x02b2ea thru 0x03412e (0x8e45 bytes) 000573 1788310969.040873 write 0x00cd79 thru 0x00f158 (0x23e0 bytes) 000575 1788310969.067138 punch from 0x026364 to 0x02bbec (0x5889 bytes) 000576 1788310969.093136 mapwrite 0x031d56 thru 0x039937 (0x7be2 bytes) 000577 1788310969.168528 trunc from 0x013e3f to 0x014c00 (0xdc2 bytes) 000578 1788310969.182162 mapwrite 0x015578 thru 0x017fbc (0x2a45 bytes) 000579 1788310969.239893 MIRROR_RESYNC 6 mirrors 000580 1788310972.306719 mapwrite 0x032134 thru 0x032e08 (0xcd5 bytes) 000581 1788310972.399036 punch from 0x003f11 to 0x008662 (0x4752 bytes) 000582 1788310972.410400 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3a406): Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a406): Mirror 11: 0x29b47cc0 (stale) Mirror 14: 0x29b47cc0 (stale) Mirror 17: 0x29b47cc0 (stale) Mirror 18: 0x29b47cc0 (stale) Mirror 19: 0x29b47cc0 (stale) CRC-32 checksum value for chunk [0, 0x3a406): Mirror 1: 0x26127d3c Mirror 20: 0x26127d3c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a406: skipped 000583 1788310973.741562 read 0x02dab1 thru 0x038f90 (0xb4e0 bytes) 000585 1788310973.775769 read 0x01018c thru 0x01233a (0x21af bytes) 000586 1788310973.795700 write 0x025ef9 thru 0x02eae7 (0x8bef bytes) 000587 1788310973.880386 read 0x010cf0 thru 0x017b47 (0x6e58 bytes) 000588 1788310973.918842 read 0x036c7a thru 0x037f06 (0x128d bytes) 000589 1788310973.919740 fallocate 0x03832e thru 0x038603 (0x2d6 bytes) 000590 1788310973.932448 punch from 0x002589 to 0x005c3f (0x36b7 bytes) 000591 1788310973.946663 trunc from 0x03a406 to 0x03a0c0 (0x345 bytes) 000592 1788310973.974644 read 0x01f490 thru 0x02d9a3 (0xe514 bytes) 000593 1788310973.977041 read 0x03746d thru 0x03a0c0 (0x2c54 bytes) 000594 1788310973.986677 mapread 0x027c07 thru 0x034efb (0xd2f5 bytes) 000596 1788310973.990697 read 0x007433 thru 0x00e203 (0x6dd1 bytes) 000597 1788310973.994659 write 0x02e585 thru 0x0374e9 (0x8f65 bytes) 000598 1788310974.002242 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3a0c1): Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a0c1): Mirror 11: 0x2d3d3d9a (stale) Mirror 14: 0x2d3d3d9a (stale) Mirror 17: 0x2d3d3d9a (stale) Mirror 18: 0x2d3d3d9a (stale) Mirror 19: 0x2d3d3d9a (stale) Mirror 20: 0xfe9e5f17 (stale) CRC-32 checksum value for chunk [0, 0x3a0c1): Mirror 1: 0xedb772ab Mirror 21: 0xedb772ab lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a0c1: skipped 000599 1788310975.407938 punch from 0x0304fc to 0x03a0c0 (0x9bc5 bytes) 000600 1788310975.511838 write 0x03d2e6 thru 0x03ffff (0x2d1a bytes) 000601 1788310975.534374 read 0x0309c0 thru 0x03964e (0x8c8f bytes) 000602 1788310975.580388 trunc from 0x038928 to 0x03ffff (0x76d8 bytes) 000603 1788310975.604532 punch from 0x011c32 to 0x017415 (0x57e4 bytes) 000604 1788310975.611239 read 0x00df84 thru 0x01a0b5 (0xc132 bytes) 000605 1788310975.625873 mapread 0x0202ce thru 0x024d32 (0x4a65 bytes) 000606 1788310975.628635 mapread 0x000232 thru 0x0075fa (0x73c9 bytes) 000608 1788310975.631651 trunc from 0x040000 to 0x0029e6 (0x3d619 bytes) 000609 1788310975.670188 trunc from 0x0029e7 to 0x0343d7 (0x319f1 bytes) 000610 1788310975.699510 trunc from 0x012748 to 0x015b0c (0x33c5 bytes) 000612 1788310975.716557 punch from 0x006100 to 0x014f33 (0xee34 bytes) 000613 1788310975.728738 punch from 0x032ae7 to 0x0343d7 (0x18f1 bytes) 000614 1788310975.753433 write 0x01319b thru 0x018762 (0x55c8 bytes) 000615 1788310975.776186 read 0x02554e thru 0x0343d7 (0xee8a bytes) 000616 1788310975.792067 trunc from 0x019642 to 0x026475 (0xce34 bytes) 000617 1788310975.801025 trunc from 0x02d640 to 0x0300c1 (0x2a82 bytes) 000618 1788310975.807245 write 0x03e5bf thru 0x03ffff (0x1a41 bytes) 000619 1788310975.808632 trunc from 0x037660 to 0x038eec (0x188d bytes) 000620 1788310975.813661 trunc from 0x02a5fe to 0x037d38 (0xd73b bytes) 000621 1788310975.818696 punch from 0x0028e5 to 0x006ec8 (0x45e4 bytes) 000623 1788310975.827615 write 0x030680 thru 0x0372d2 (0x6c53 bytes) 000624 1788310975.840614 trunc from 0x0254b6 to 0x0353ae (0xfef9 bytes) 000625 1788310975.860893 mapwrite 0x00b378 thru 0x011afb (0x6784 bytes) 000626 1788310975.899020 write 0x010cbb thru 0x0127ae (0x1af4 bytes) 000627 1788310975.900061 write 0x00f6f8 thru 0x015237 (0x5b40 bytes) 000628 1788310975.901289 trunc from 0x01a981 to 0x02232d (0x79ad bytes) 000629 1788310975.905724 fallocate 0x038deb thru 0x039c40 (0xe56 bytes) 000630 1788310975.926407 mapwrite 0x031523 thru 0x03987c (0x835a bytes) 000631 1788310976.031275 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x5d5766d6 (stale) Mirror 17: 0x5d5766d6 (stale) Mirror 18: 0x5d5766d6 (stale) Mirror 19: 0x5d5766d6 (stale) Mirror 20: 0xd8e2c3ea (stale) Mirror 21: 0xb0d0f6ba (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x5d5766d6 (stale) Mirror 17: 0x5d5766d6 (stale) Mirror 18: 0x5d5766d6 (stale) Mirror 19: 0x5d5766d6 (stale) Mirror 20: 0xd8e2c3ea (stale) Mirror 21: 0xb0d0f6ba (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000632 1788310976.643717 trunc from 0x008ebd to 0x0185d9 (0xf71d bytes) 000633 1788310976.652652 write 0x01bf29 thru 0x02379f (0x7877 bytes) 000634 1788310976.670451 mapread 0x00ede7 thru 0x017091 (0x82ab bytes) 000635 1788310976.695767 mapwrite 0x02660e thru 0x033847 (0xd23a bytes) 000636 1788310976.771633 mapread 0x012ba3 thru 0x01f42d (0xc88b bytes) 000637 1788310976.792851 write 0x02e8df thru 0x03311f (0x4841 bytes) 000638 1788310976.798713 trunc from 0x040000 to 0x00ace9 (0x35316 bytes) 000639 1788310976.833167 MIRROR_RESYNC 7 mirrors 000640 1788310978.006040 fallocate 0x02ac73 thru 0x0340dc (0x946a bytes) 000641 1788310978.052859 trunc from 0x02da43 to 0x031687 (0x3c45 bytes) 000642 1788310978.063446 fallocate 0x009e88 thru 0x0117f9 (0x7972 bytes) 000643 1788310978.079270 trunc from 0x01bf90 to 0x0235b8 (0x7629 bytes) 000644 1788310978.085748 read 0x031f71 thru 0x0340dc (0x216c bytes) 000645 1788310978.094558 write 0x0178c0 thru 0x0267fe (0xef3f bytes) 000646 1788310978.115384 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x340dd): Mirror 14: 0x64461b2e (stale) Mirror 17: 0x64461b2e (stale) Mirror 18: 0x64461b2e (stale) Mirror 19: 0x64461b2e (stale) Mirror 21: 0x64461b2e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x340dd): Mirror 14: 0x64461b2e (stale) Mirror 17: 0x64461b2e (stale) Mirror 18: 0x64461b2e (stale) Mirror 19: 0x64461b2e (stale) Mirror 21: 0x64461b2e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x340dd: skipped 000647 1788310978.555392 trunc from 0x0340dd to 0x022ea2 (0x1123a bytes) 000648 1788310978.583816 mapwrite 0x0124e1 thru 0x017771 (0x5291 bytes) 000649 1788310978.638812 punch from 0x004db9 to 0x014066 (0xf2ae bytes) 000650 1788310978.644684 mapwrite 0x01af5f thru 0x025d63 (0xae05 bytes) 000651 1788310978.701764 read 0x024c63 thru 0x025d63 (0x1101 bytes) 000652 1788310978.702421 mapwrite 0x00c109 thru 0x011c57 (0x5b4f bytes) 000653 1788310978.762406 mapread 0x001f48 thru 0x00e9fc (0xcab5 bytes) 000654 1788310978.770734 trunc from 0x012003 to 0x014e68 (0x2e66 bytes) 000655 1788310978.777838 read 0x01633d thru 0x021e32 (0xbaf6 bytes) 000656 1788310978.779589 trunc from 0x025d64 to 0x005e85 (0x1fede bytes) 000657 1788310978.796088 write 0x039f3e thru 0x03ffff (0x60c2 bytes) 000658 1788310978.797771 read 0x02219e thru 0x02e4af (0xc312 bytes) 000659 1788310978.805221 read 0x03eaf8 thru 0x03ffff (0x1508 bytes) 000660 1788310978.805822 fallocate 0x03b20a thru 0x03ffff (0x4df6 bytes) 000661 1788310978.811170 mapread 0x008c59 thru 0x009f38 (0x12e0 bytes) 000662 1788310978.812257 read 0x017124 thru 0x025d92 (0xec6f bytes) 000664 1788310978.815168 trunc from 0x01f8f5 to 0x02a3c3 (0xaacf bytes) 000665 1788310978.821818 mapread 0x00b0bf thru 0x019f67 (0xeea9 bytes) 000666 1788310978.823172 punch from 0x016ce0 to 0x02271f (0xba40 bytes) 000667 1788310978.830648 punch from 0x01bc1a to 0x02b866 (0xfc4d bytes) 000668 1788310978.844259 read 0x03e2fd thru 0x03ffff (0x1d03 bytes) 000669 1788310978.845874 trunc from 0x040000 to 0x00a1ad (0x35e52 bytes) 000670 1788310978.870615 mapwrite 0x02c67a thru 0x039611 (0xcf98 bytes) 000671 1788310978.941874 trunc from 0x0367a0 to 0x039611 (0x2e72 bytes) 000672 1788310978.950395 fallocate 0x037379 thru 0x039b3b (0x27c3 bytes) 000673 1788310978.957127 write 0x001715 thru 0x006ff2 (0x58de bytes) 000674 1788310978.958290 mapwrite 0x0314a9 thru 0x03948c (0x7fe4 bytes) 000675 1788310979.003039 trunc from 0x02fec1 to 0x035efe (0x603e bytes) 000676 1788310979.022512 MIRROR_RESYNC 6 mirrors 000677 1788310980.555722 write 0x02ec30 thru 0x03e7b8 (0xfb89 bytes) 000678 1788310980.599025 punch from 0x02c300 to 0x031140 (0x4e41 bytes) 000679 1788310980.639345 trunc from 0x03e7b9 to 0x0251ef (0x195c9 bytes) 000680 1788310980.690532 mapwrite 0x031a9d thru 0x03e926 (0xce8a bytes) 000681 1788310980.828222 mapread 0x033dc9 thru 0x036c8f (0x2ec7 bytes) 000682 1788310980.832077 mapwrite 0x0161b7 thru 0x024391 (0xe1db bytes) 000683 1788310980.870504 trunc from 0x03e927 to 0x001584 (0x3d3a2 bytes) 000684 1788310980.885777 mapread 0x00084d thru 0x001584 (0xd38 bytes) 000685 1788310980.892550 read 0x0007c3 thru 0x001584 (0xdc2 bytes) 000686 1788310980.893248 mapwrite 0x007efa thru 0x0170f3 (0xf1fa bytes) 000687 1788310980.993732 write 0x039f8d thru 0x03ffff (0x6073 bytes) 000688 1788310980.995851 mapwrite 0x0253cc thru 0x02ecdb (0x9910 bytes) 000689 1788310981.036370 fallocate 0x0337f3 thru 0x03ffff (0xc80d bytes) 000690 1788310981.059276 punch from 0x03873a to 0x03ffff (0x78c6 bytes) 000691 1788310981.076346 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x3ca8b923 (stale) Mirror 17: 0x3ca8b923 (stale) Mirror 18: 0x3ca8b923 (stale) Mirror 19: 0x3ca8b923 (stale) Mirror 21: 0x3ca8b923 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x982fad9d Mirror 22: 0x982fad9d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000692 1788310982.087666 read 0x03bcf1 thru 0x03e953 (0x2c63 bytes) 000693 1788310982.108188 read 0x00b53b thru 0x011134 (0x5bfa bytes) 000694 1788310982.129644 trunc from 0x040000 to 0x029ac5 (0x1653a bytes) 000695 1788310982.196880 trunc from 0x025f9e to 0x029ac5 (0x3b28 bytes) 000696 1788310982.208581 punch from 0x0090c6 to 0x0148bf (0xb7fa bytes) 000697 1788310982.223545 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29ac6): Mirror 14: 0xb0c75d14 (stale) Mirror 17: 0xb0c75d14 (stale) Mirror 19: 0xb0c75d14 (stale) Mirror 21: 0xb0c75d14 (stale) Mirror 22: 0x95a1b95 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29ac6): Mirror 14: 0xb0c75d14 (stale) Mirror 17: 0xb0c75d14 (stale) Mirror 19: 0xb0c75d14 (stale) Mirror 21: 0xb0c75d14 (stale) Mirror 22: 0x95a1b95 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29ac6: skipped 000698 1788310982.772724 MIRROR_RESYNC 6 mirrors 000699 1788310985.063780 write 0x019d9b thru 0x025f87 (0xc1ed bytes) 000701 1788310985.109721 mapread 0x005874 thru 0x010589 (0xad16 bytes) 000703 1788310985.128445 read 0x02222c thru 0x028c06 (0x69db bytes) 000704 1788310985.133347 trunc from 0x024482 to 0x028381 (0x3f00 bytes) 000705 1788310985.147682 trunc from 0x029ac6 to 0x0343cc (0xa907 bytes) 000706 1788310985.191603 trunc from 0x0343cd to 0x006009 (0x2e3c3 bytes) 000707 1788310985.212194 mapwrite 0x00a00e thru 0x0187ba (0xe7ad bytes) 000708 1788310985.265403 trunc from 0x0106b8 to 0x0187ba (0x8103 bytes) 000709 1788310985.270713 read 0x0157fc thru 0x0165e8 (0xded bytes) 000712 1788310985.285390 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x187bb): Mirror 17: 0x2f8ab741 (stale) Mirror 19: 0x2f8ab741 (stale) Mirror 21: 0x2f8ab741 (stale) Mirror 22: 0x2f8ab741 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x187bb): Mirror 17: 0x2f8ab741 (stale) Mirror 19: 0x2f8ab741 (stale) Mirror 21: 0x2f8ab741 (stale) Mirror 22: 0x2f8ab741 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x187bb: skipped 000713 1788310985.629655 trunc from 0x0125b1 to 0x0187ba (0x620a bytes) 000714 1788310985.635207 punch from 0x015938 to 0x0187ba (0x2e83 bytes) 000715 1788310985.641174 punch from 0x0002f6 to 0x007074 (0x6d7f bytes) 000716 1788310985.649213 MIRROR_RESYNC 5 mirrors 000717 1788310986.804670 fallocate 0x0073e8 thru 0x014732 (0xd34b bytes) 000718 1788310986.832075 read 0x00eab4 thru 0x0132b7 (0x4804 bytes) 000719 1788310986.843888 read 0x006fdc thru 0x011145 (0xa16a bytes) 000720 1788310986.856431 write 0x03e586 thru 0x03ffff (0x1a7a bytes) 000721 1788310986.858002 mapwrite 0x0124c6 thru 0x01f739 (0xd274 bytes) 000722 1788310986.885469 trunc from 0x040000 to 0x01dd6d (0x22292 bytes) 000723 1788310986.912995 punch from 0x00da4b to 0x010dcb (0x3381 bytes) 000724 1788310986.919142 mapwrite 0x036fd2 thru 0x03c585 (0x55b4 bytes) 000725 1788310986.990079 fallocate 0x00b783 thru 0x01a2bf (0xeb3d bytes) 000726 1788310986.995734 fallocate 0x03e57c thru 0x03ffff (0x1a84 bytes) 000727 1788310987.006386 read 0x033f58 thru 0x03c585 (0x862e bytes) 000729 1788310987.024649 write 0x02dcca thru 0x038412 (0xa749 bytes) 000730 1788310987.028228 read 0x01bb22 thru 0x02094f (0x4e2e bytes) 000731 1788310987.028952 write 0x001408 thru 0x003201 (0x1dfa bytes) 000732 1788310987.029884 trunc from 0x03c586 to 0x0174b3 (0x250d2 bytes) 000733 1788310987.054457 punch from 0x013116 to 0x014448 (0x1333 bytes) 000734 1788310987.065233 trunc from 0x012a7f to 0x0174b3 (0x4a35 bytes) 000735 1788310987.074288 mapread 0x00b0bb thru 0x0174b3 (0xc3f9 bytes) 000736 1788310987.101605 mapwrite 0x010b47 thru 0x01c6ff (0xbbb9 bytes) 000737 1788310987.210143 MIRROR_RESYNC 5 mirrors 000738 1788310989.008602 punch from 0x008472 to 0x00aaea (0x2679 bytes) 000739 1788310989.048565 read 0x019ef6 thru 0x01c6ff (0x280a bytes) 000740 1788310989.063510 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1c700): Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c700): Mirror 17: 0xc28c1a11 (stale) Mirror 19: 0xc28c1a11 (stale) Mirror 21: 0xc28c1a11 (stale) Mirror 22: 0xc28c1a11 (stale) CRC-32 checksum value for chunk [0, 0x1c700): Mirror 1: 0x3fe5d310 Mirror 23: 0x3fe5d310 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c700: skipped 000741 1788310990.393951 mapwrite 0x0125f6 thru 0x01aa1f (0x842a bytes) 000742 1788310990.545432 mapread 0x013af1 thru 0x016ebe (0x33ce bytes) 000743 1788310990.549308 write 0x01a505 thru 0x0246ac (0xa1a8 bytes) 000744 1788310990.556880 read 0x00b1de thru 0x01a8bd (0xf6e0 bytes) 000745 1788310990.568093 trunc from 0x0113f7 to 0x01605a (0x4c64 bytes) 000746 1788310990.574329 trunc from 0x012b30 to 0x01cf2c (0xa3fd bytes) 000748 1788310990.593466 mapwrite 0x0321c1 thru 0x03252f (0x36f bytes) 000749 1788310990.674520 mapwrite 0x0007d1 thru 0x004724 (0x3f54 bytes) 000750 1788310990.713279 mapread 0x01a0b8 thru 0x01d76a (0x36b3 bytes) 000751 1788310990.731966 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x32530): Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32530): Mirror 17: 0x9ed7a007 (stale) Mirror 19: 0x9ed7a007 (stale) Mirror 21: 0x9ed7a007 (stale) Mirror 22: 0x9ed7a007 (stale) Mirror 23: 0x3ae7fa3f (stale) CRC-32 checksum value for chunk [0, 0x32530): Mirror 1: 0xc60492d1 Mirror 24: 0xc60492d1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32530: skipped 000752 1788310992.025440 read 0x02ad26 thru 0x03252f (0x780a bytes) 000753 1788310992.045181 trunc from 0x013a58 to 0x01e49e (0xaa47 bytes) 000754 1788310992.098479 read 0x0219d5 thru 0x02f924 (0xdf50 bytes) 000755 1788310992.112495 mapread 0x02fb45 thru 0x03252f (0x29eb bytes) 000756 1788310992.113798 punch from 0x028592 to 0x032135 (0x9ba4 bytes) 000757 1788310992.123843 mapwrite 0x02fc28 thru 0x032edc (0x32b5 bytes) 000758 1788310992.218819 punch from 0x026ea6 to 0x029349 (0x24a4 bytes) 000759 1788310992.227466 trunc from 0x032edd to 0x03619b (0x32bf bytes) 000760 1788310992.271722 MIRROR_RESYNC 7 mirrors 000761 1788310995.011828 trunc from 0x03619c to 0x03e2b9 (0x811e bytes) 000762 1788310995.062782 fallocate 0x0395ad thru 0x03ffff (0x6a53 bytes) 000763 1788310995.072969 mapwrite 0x00e060 thru 0x00f3d9 (0x137a bytes) 000764 1788310995.104504 mapwrite 0x03a612 thru 0x03d624 (0x3013 bytes) 000765 1788310995.147330 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3e2ba): Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e2ba): Mirror 17: 0xc7225b7 (stale) Mirror 19: 0xc7225b7 (stale) Mirror 21: 0xc7225b7 (stale) Mirror 22: 0xc7225b7 (stale) Mirror 23: 0xc7225b7 (stale) Mirror 24: 0xc7225b7 (stale) CRC-32 checksum value for chunk [0, 0x3e2ba): Mirror 1: 0x5f66d6ee Mirror 25: 0x5f66d6ee lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e2ba: skipped 000766 1788310996.437038 trunc from 0x020437 to 0x02b8bf (0xb489 bytes) 000767 1788310996.495348 fallocate 0x009fe4 thru 0x00df41 (0x3f5e bytes) 000768 1788310996.503355 mapwrite 0x0042c3 thru 0x00ac85 (0x69c3 bytes) 000769 1788310996.550743 punch from 0x0359da to 0x03e2b9 (0x88e0 bytes) 000770 1788310996.557298 punch from 0x021865 to 0x029111 (0x78ad bytes) 000771 1788310996.567842 trunc from 0x001f1c to 0x006903 (0x49e8 bytes) 000772 1788310996.583811 punch from 0x01ffd4 to 0x02226e (0x229b bytes) 000773 1788310996.602737 trunc from 0x0195dd to 0x01ad1e (0x1742 bytes) 000774 1788310996.611853 read 0x0245e0 thru 0x02a14c (0x5b6d bytes) 000775 1788310996.634596 write 0x00693f thru 0x0141ee (0xd8b0 bytes) 000776 1788310996.661075 MIRROR_RESYNC 8 mirrors 000777 1788310999.668840 write 0x030a23 thru 0x034e0c (0x43ea bytes) 000778 1788310999.720729 write 0x028c21 thru 0x036e79 (0xe259 bytes) 000779 1788310999.734438 mapread 0x01ec61 thru 0x025a18 (0x6db8 bytes) 000780 1788310999.759337 mapread 0x00690f thru 0x00d8d4 (0x6fc6 bytes) 000781 1788310999.781500 write 0x024e5f thru 0x029d5f (0x4f01 bytes) 000782 1788310999.782867 write 0x00cb23 thru 0x011346 (0x4824 bytes) 000783 1788310999.789696 fallocate 0x010a45 thru 0x012aaf (0x206b bytes) 000784 1788310999.794795 trunc from 0x03e2ba to 0x035e90 (0x8429 bytes) 000785 1788310999.818905 trunc from 0x035e91 to 0x022ae4 (0x133ac bytes) 000786 1788310999.840295 mapread 0x00b395 thru 0x00f60a (0x4276 bytes) 000787 1788310999.841844 mapread 0x0084aa thru 0x00fe46 (0x799d bytes) 000788 1788310999.848520 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x22ae5): Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22ae5): Mirror 17: 0x8064ce53 (stale) Mirror 19: 0x8064ce53 (stale) Mirror 21: 0x8064ce53 (stale) Mirror 22: 0x8064ce53 (stale) Mirror 23: 0x8064ce53 (stale) Mirror 24: 0x8064ce53 (stale) Mirror 25: 0x8064ce53 (stale) CRC-32 checksum value for chunk [0, 0x22ae5): Mirror 1: 0xb7b90394 Mirror 26: 0xb7b90394 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22ae5: skipped 000789 1788311001.340659 MIRROR_RESYNC 9 mirrors 000790 1788311003.745885 trunc from 0x022ae5 to 0x002423 (0x206c1 bytes) 000791 1788311003.795882 read 0x00017f thru 0x0015c4 (0x1446 bytes) 000793 1788311003.805799 punch from 0x000714 to 0x002423 (0x1d10 bytes) 000794 1788311003.811505 mapread 0x0020d3 thru 0x002423 (0x351 bytes) 000795 1788311003.819580 mapwrite 0x016df8 thru 0x024f87 (0xe190 bytes) 000796 1788311003.925140 read 0x0068d2 thru 0x00b46b (0x4b9a bytes) 000797 1788311003.953345 fallocate 0x030132 thru 0x03f609 (0xf4d8 bytes) 000798 1788311003.960625 punch from 0x0134e9 to 0x01d869 (0xa381 bytes) 000799 1788311003.972553 punch from 0x01bc1b to 0x024f87 (0x936d bytes) 000800 1788311003.985495 fallocate 0x02a259 thru 0x031ab2 (0x785a bytes) 000801 1788311003.991145 fallocate 0x020e3c thru 0x021bbd (0xd82 bytes) 000802 1788311004.001183 write 0x03f23f thru 0x03ffff (0xdc1 bytes) 000803 1788311004.007325 MIRROR_RESYNC 9 mirrors 000804 1788311006.218099 fallocate 0x002962 thru 0x009eb7 (0x7556 bytes) 000805 1788311006.277368 write 0x02d3cd thru 0x033c02 (0x6836 bytes) 000806 1788311006.308383 write 0x012932 thru 0x014116 (0x17e5 bytes) 000807 1788311006.332955 read 0x03e8a2 thru 0x03ffff (0x175e bytes) 000808 1788311006.360835 mapwrite 0x029f1b thru 0x02bbd6 (0x1cbc bytes) 000809 1788311006.491289 trunc from 0x03730a to 0x03ffff (0x8cf6 bytes) 000810 1788311006.507647 punch from 0x024d4b to 0x0279bd (0x2c73 bytes) 000811 1788311006.523764 fallocate 0x03dc3b thru 0x03ffff (0x23c5 bytes) 000813 1788311006.545043 punch from 0x034a4d to 0x03947a (0x4a2e bytes) 000814 1788311006.558753 read 0x03e244 thru 0x03ffff (0x1dbc bytes) 000815 1788311006.587767 mapread 0x017806 thru 0x024b3b (0xd336 bytes) 000817 1788311006.598847 fallocate 0x0182de thru 0x028168 (0xfe8b bytes) 000818 1788311006.617292 mapwrite 0x038e5a thru 0x03f986 (0x6b2d bytes) 000819 1788311006.684473 trunc from 0x03f9cd to 0x03ffff (0x633 bytes) 000821 1788311006.694005 write 0x03beaa thru 0x03ffff (0x4156 bytes) 000822 1788311006.695981 trunc from 0x040000 to 0x03ebf4 (0x140b bytes) 000823 1788311006.723911 punch from 0x004e5f to 0x0149cb (0xfb6d bytes) 000824 1788311006.735171 fallocate 0x0374f5 thru 0x037d64 (0x870 bytes) 000825 1788311006.741453 trunc from 0x03d99b to 0x03ebf4 (0x125a bytes) 000826 1788311006.767036 read 0x03b64d thru 0x03ebf4 (0x35a8 bytes) 000827 1788311006.785254 read 0x027d07 thru 0x02f897 (0x7b91 bytes) 000828 1788311006.787561 read 0x005500 thru 0x0068e8 (0x13e9 bytes) 000829 1788311006.789419 punch from 0x023968 to 0x02ae35 (0x74ce bytes) 000830 1788311006.798897 trunc from 0x03ebf5 to 0x038e8c (0x5d68 bytes) 000831 1788311006.846242 write 0x003eb8 thru 0x008f31 (0x507a bytes) 000832 1788311006.857856 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38e8d): Mirror 19: 0x41485916 (stale) Mirror 21: 0x41485916 (stale) Mirror 22: 0x41485916 (stale) Mirror 23: 0x41485916 (stale) Mirror 24: 0x41485916 (stale) Mirror 25: 0x41485916 (stale) Mirror 26: 0x41485916 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38e8d): Mirror 19: 0x41485916 (stale) Mirror 21: 0x41485916 (stale) Mirror 22: 0x41485916 (stale) Mirror 23: 0x41485916 (stale) Mirror 24: 0x41485916 (stale) Mirror 25: 0x41485916 (stale) Mirror 26: 0x41485916 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38e8d: skipped 000833 1788311007.518831 trunc from 0x038e8d to 0x035288 (0x3c04 bytes) 000834 1788311007.543746 mapwrite 0x027699 thru 0x02fb0d (0x8475 bytes) 000835 1788311007.589512 read 0x009b48 thru 0x00f084 (0x553d bytes) 000836 1788311007.601583 fallocate 0x037a97 thru 0x03ffff (0x8569 bytes) 000837 1788311007.607715 trunc from 0x0339c7 to 0x0359fc (0x2036 bytes) 000838 1788311007.613814 trunc from 0x040000 to 0x0157cc (0x2a833 bytes) 000839 1788311007.638390 write 0x03bb9f thru 0x03ffff (0x4461 bytes) 000840 1788311007.640020 trunc from 0x040000 to 0x02ca72 (0x1358d bytes) 000842 1788311007.662799 trunc from 0x003bd3 to 0x0065ea (0x2a18 bytes) 000843 1788311007.669542 trunc from 0x02ca73 to 0x01cce8 (0xfd8a bytes) 000844 1788311007.688757 fallocate 0x03f7e8 thru 0x03ffff (0x818 bytes) 000845 1788311007.698864 MIRROR_RESYNC 8 mirrors 000846 1788311010.508548 mapwrite 0x01a30a thru 0x01ad64 (0xa5b bytes) 000847 1788311010.642182 write 0x009202 thru 0x00dda0 (0x4b9f bytes) 000849 1788311010.660534 trunc from 0x01cce9 to 0x034f95 (0x182ad bytes) 000850 1788311010.692038 punch from 0x011648 to 0x011936 (0x2ef bytes) 000851 1788311010.700463 punch from 0x02e141 to 0x034f95 (0x6e55 bytes) 000852 1788311010.711897 mapwrite 0x01ceb3 thru 0x024d48 (0x7e96 bytes) 000853 1788311010.756552 trunc from 0x034f96 to 0x004453 (0x30b42 bytes) 000854 1788311010.787369 mapwrite 0x02c7dc thru 0x032257 (0x5a7c bytes) 000855 1788311010.848447 punch from 0x01d8dd to 0x0268b4 (0x8fd8 bytes) 000856 1788311010.870307 fallocate 0x00badf thru 0x00ffda (0x44fc bytes) 000857 1788311010.882090 punch from 0x01e65c to 0x02caf9 (0xe49e bytes) 000858 1788311010.895968 mapread 0x002d4c thru 0x00e5fa (0xb8af bytes) 000860 1788311010.913246 mapwrite 0x02ec2d thru 0x0374ce (0x88a2 bytes) 000861 1788311010.968325 mapwrite 0x02084e thru 0x02f10a (0xe8bd bytes) 000862 1788311011.027498 trunc from 0x005dc5 to 0x00759e (0x17da bytes) 000863 1788311011.044628 MIRROR_RESYNC 8 mirrors 000864 1788311013.314769 write 0x03e865 thru 0x03eeeb (0x687 bytes) 000865 1788311013.377408 mapwrite 0x01a024 thru 0x01a66b (0x648 bytes) 000866 1788311013.411117 mapread 0x0037d9 thru 0x0098e7 (0x610f bytes) 000867 1788311013.428011 trunc from 0x009063 to 0x016c63 (0xdc01 bytes) 000868 1788311013.434169 trunc from 0x01141d to 0x020235 (0xee19 bytes) 000869 1788311013.441710 fallocate 0x0065f5 thru 0x00cdd8 (0x67e4 bytes) 000870 1788311013.450673 punch from 0x00d61a to 0x012892 (0x5279 bytes) 000871 1788311013.458178 mapwrite 0x020059 thru 0x02c5c6 (0xc56e bytes) 000872 1788311013.508395 trunc from 0x017b39 to 0x0246f8 (0xcbc0 bytes) 000873 1788311013.514165 read 0x0112dd thru 0x01f72b (0xe44f bytes) 000874 1788311013.527887 read 0x03e7d1 thru 0x03eeeb (0x71b bytes) 000875 1788311013.532747 MIRROR_RESYNC 8 mirrors 000876 1788311016.070777 write 0x0316bc thru 0x03f1a3 (0xdae8 bytes) 000877 1788311016.112611 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3f1a4): Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f1a4): Mirror 19: 0x44583512 (stale) Mirror 21: 0x44583512 (stale) Mirror 22: 0x44583512 (stale) Mirror 23: 0x44583512 (stale) Mirror 24: 0x44583512 (stale) Mirror 25: 0x44583512 (stale) Mirror 26: 0x44583512 (stale) CRC-32 checksum value for chunk [0, 0x3f1a4): Mirror 1: 0xa727b83e Mirror 27: 0xa727b83e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f1a4: skipped 000878 1788311017.585263 trunc from 0x03f1a4 to 0x0110b9 (0x2e0ea bytes) 000879 1788311017.669040 trunc from 0x001b4b to 0x010c2c (0xf0e2 bytes) 000880 1788311017.696863 trunc from 0x0110ba to 0x01b458 (0xa39f bytes) 000881 1788311017.742601 mapwrite 0x02f914 thru 0x032bb3 (0x32a0 bytes) 000882 1788311017.833246 mapread 0x029e41 thru 0x02bac9 (0x1c89 bytes) 000884 1788311017.844766 fallocate 0x00411c thru 0x00d1a7 (0x908c bytes) 000885 1788311017.852835 punch from 0x01f6f1 to 0x02552d (0x5e3d bytes) 000886 1788311017.861182 trunc from 0x001240 to 0x00ab09 (0x98ca bytes) 000887 1788311017.866519 fallocate 0x0365e7 thru 0x03ffff (0x9a19 bytes) 000889 1788311017.880410 fallocate 0x032972 thru 0x03ffff (0xd68e bytes) 000890 1788311017.899557 trunc from 0x040000 to 0x026ada (0x19525 bytes) 000891 1788311017.940028 trunc from 0x026adb to 0x031c2b (0xb151 bytes) 000892 1788311017.964467 punch from 0x028363 to 0x029f35 (0x1bd3 bytes) 000893 1788311017.971416 mapread 0x0162f1 thru 0x022ee5 (0xcbf5 bytes) 000895 1788311018.011177 trunc from 0x031c2c to 0x03a22c (0x8601 bytes) 000896 1788311018.048837 trunc from 0x02998c to 0x02c083 (0x26f8 bytes) 000898 1788311018.064732 read 0x028e12 thru 0x0375c1 (0xe7b0 bytes) 000899 1788311018.078503 mapwrite 0x001b96 thru 0x00de9e (0xc309 bytes) 000900 1788311018.173799 punch from 0x023bc5 to 0x02e004 (0xa440 bytes) 000901 1788311018.199433 punch from 0x0257ac to 0x030954 (0xb1a9 bytes) 000902 1788311018.209096 read 0x0176d4 thru 0x01d6c4 (0x5ff1 bytes) 000904 1788311018.219720 mapwrite 0x0054a9 thru 0x0113c7 (0xbf1f bytes) 000905 1788311018.283167 trunc from 0x03a22d to 0x021f5d (0x182cf bytes) 000906 1788311018.316226 trunc from 0x007633 to 0x00a31e (0x2cec bytes) 000907 1788311018.330493 mapwrite 0x001bb0 thru 0x00551b (0x396c bytes) 000908 1788311018.380525 read 0x006da4 thru 0x01400c (0xd269 bytes) 000909 1788311018.416561 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x21f5e): Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21f5e): Mirror 19: 0x776c2e63 (stale) Mirror 21: 0x776c2e63 (stale) Mirror 22: 0x776c2e63 (stale) Mirror 23: 0x776c2e63 (stale) Mirror 24: 0x776c2e63 (stale) Mirror 25: 0x776c2e63 (stale) Mirror 26: 0x776c2e63 (stale) Mirror 27: 0x776c2e63 (stale) CRC-32 checksum value for chunk [0, 0x21f5e): Mirror 1: 0x91d3258e Mirror 28: 0x91d3258e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21f5e: skipped 000910 1788311019.762162 fallocate 0x033688 thru 0x0357fa (0x2173 bytes) 000911 1788311019.877603 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x21f5e): Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21f5e): Mirror 19: 0x776c2e63 (stale) Mirror 21: 0x776c2e63 (stale) Mirror 22: 0x776c2e63 (stale) Mirror 23: 0x776c2e63 (stale) Mirror 24: 0x776c2e63 (stale) Mirror 25: 0x776c2e63 (stale) Mirror 26: 0x776c2e63 (stale) Mirror 27: 0x776c2e63 (stale) Mirror 28: 0x91d3258e (stale) CRC-32 checksum value for chunk [0, 0x21f5e): Mirror 1: 0x91d3258e Mirror 29: 0x91d3258e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21f5e: skipped 000912 1788311021.459724 punch from 0x00951a to 0x017b5b (0xe642 bytes) 000913 1788311021.514403 punch from 0x00479e to 0x004955 (0x1b8 bytes) 000914 1788311021.518664 mapread 0x01a987 thru 0x01d32b (0x29a5 bytes) 000915 1788311021.547116 read 0x017e96 thru 0x019813 (0x197e bytes) 000916 1788311021.552266 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x21f5e): Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21f5e): Mirror 19: 0x776c2e63 (stale) Mirror 21: 0x776c2e63 (stale) Mirror 22: 0x776c2e63 (stale) Mirror 23: 0x776c2e63 (stale) Mirror 24: 0x776c2e63 (stale) Mirror 25: 0x776c2e63 (stale) Mirror 26: 0x776c2e63 (stale) Mirror 27: 0x776c2e63 (stale) Mirror 28: 0x91d3258e (stale) Mirror 29: 0x91d3258e (stale) CRC-32 checksum value for chunk [0, 0x21f5e): Mirror 1: 0xb927c284 Mirror 30: 0xb927c284 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21f5e: skipped 000917 1788311023.230603 trunc from 0x021f4b to 0x021f5d (0x13 bytes) 000918 1788311023.292280 write 0x00794c thru 0x007c06 (0x2bb bytes) 000919 1788311023.319139 mapwrite 0x019595 thru 0x020b94 (0x7600 bytes) 000920 1788311023.397484 trunc from 0x021f5e to 0x019434 (0x8b29 bytes) 000921 1788311023.438866 punch from 0x005900 to 0x0098d4 (0x3fd5 bytes) 000922 1788311023.448309 mapread 0x00962f thru 0x011274 (0x7c46 bytes) 000923 1788311023.466584 fallocate 0x01b50e thru 0x025cdb (0xa7ce bytes) 000924 1788311023.473453 read 0x01218f thru 0x01607d (0x3eef bytes) 000925 1788311023.485657 trunc from 0x00c025 to 0x010770 (0x474c bytes) 000926 1788311023.512765 MIRROR_SPLIT mirror 2 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19435): Mirror 19: 0x25621967 (stale) Mirror 22: 0x25621967 (stale) Mirror 23: 0x25621967 (stale) Mirror 24: 0x25621967 (stale) Mirror 25: 0x25621967 (stale) Mirror 26: 0x25621967 (stale) Mirror 27: 0x25621967 (stale) Mirror 28: 0x7b06a69f (stale) Mirror 29: 0x7b06a69f (stale) Mirror 30: 0x18c62d30 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19435): Mirror 19: 0x25621967 (stale) Mirror 22: 0x25621967 (stale) Mirror 23: 0x25621967 (stale) Mirror 24: 0x25621967 (stale) Mirror 25: 0x25621967 (stale) Mirror 26: 0x25621967 (stale) Mirror 27: 0x25621967 (stale) Mirror 28: 0x7b06a69f (stale) Mirror 29: 0x7b06a69f (stale) Mirror 30: 0x18c62d30 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19435: skipped 000927 1788311024.518698 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x19435): Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19435): Mirror 19: 0x25621967 (stale) Mirror 22: 0x25621967 (stale) Mirror 23: 0x25621967 (stale) Mirror 24: 0x25621967 (stale) Mirror 25: 0x25621967 (stale) Mirror 26: 0x25621967 (stale) Mirror 27: 0x25621967 (stale) Mirror 28: 0x7b06a69f (stale) Mirror 29: 0x7b06a69f (stale) Mirror 30: 0x18c62d30 (stale) CRC-32 checksum value for chunk [0, 0x19435): Mirror 1: 0x7aa56602 Mirror 31: 0x7aa56602 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19435: skipped 000928 1788311026.131465 write 0x0263a0 thru 0x02dc1d (0x787e bytes) 000930 1788311026.228878 fallocate 0x027ba5 thru 0x02ed96 (0x71f2 bytes) 000931 1788311026.241450 read 0x00e353 thru 0x00fc04 (0x18b2 bytes) 000932 1788311026.252506 trunc from 0x006006 to 0x01121c (0xb217 bytes) 000933 1788311026.264752 trunc from 0x018e9b to 0x024e97 (0xbffd bytes) 000934 1788311026.271300 mapread 0x005225 thru 0x00fde8 (0xabc4 bytes) 000935 1788311026.303708 punch from 0x003f79 to 0x004008 (0x90 bytes) 000936 1788311026.311305 read 0x006303 thru 0x00bd6d (0x5a6b bytes) 000937 1788311026.312303 punch from 0x000d8e to 0x00a428 (0x969b bytes) 000938 1788311026.320467 trunc from 0x008082 to 0x00c7b8 (0x4737 bytes) 000939 1788311026.328087 fallocate 0x03e69b thru 0x03ffff (0x1965 bytes) 000940 1788311026.337287 write 0x02b0a0 thru 0x03940d (0xe36e bytes) 000941 1788311026.342788 write 0x0078dc thru 0x016a67 (0xf18c bytes) 000942 1788311026.377685 fallocate 0x03cc93 thru 0x03ffff (0x336d bytes) 000943 1788311026.383821 trunc from 0x015d21 to 0x01a4ab (0x478b bytes) 000944 1788311026.402859 punch from 0x00cca6 to 0x011d9f (0x50fa bytes) 000945 1788311026.408665 punch from 0x017b18 to 0x01e86d (0x6d56 bytes) 000946 1788311026.415361 mapread 0x02fc01 thru 0x03940d (0x980d bytes) 000947 1788311026.416811 fallocate 0x035cf3 thru 0x03e60a (0x8918 bytes) 000948 1788311026.423656 punch from 0x001c65 to 0x00de19 (0xc1b5 bytes) 000949 1788311026.428860 trunc from 0x03e60b to 0x028862 (0x15da8 bytes) 000951 1788311026.455888 fallocate 0x03e960 thru 0x03ffff (0x16a0 bytes) 000952 1788311026.464181 read 0x01144a thru 0x01df69 (0xcb20 bytes) 000954 1788311026.498397 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28863): Mirror 22: 0xffafb0d8 (stale) Mirror 23: 0xffafb0d8 (stale) Mirror 24: 0xffafb0d8 (stale) Mirror 25: 0xffafb0d8 (stale) Mirror 26: 0xffafb0d8 (stale) Mirror 27: 0xffafb0d8 (stale) Mirror 28: 0xa6b54237 (stale) Mirror 29: 0xa6b54237 (stale) Mirror 30: 0x21785efb (stale) Mirror 31: 0xffac4f79 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28863): Mirror 22: 0xffafb0d8 (stale) Mirror 23: 0xffafb0d8 (stale) Mirror 24: 0xffafb0d8 (stale) Mirror 25: 0xffafb0d8 (stale) Mirror 26: 0xffafb0d8 (stale) Mirror 27: 0xffafb0d8 (stale) Mirror 28: 0xa6b54237 (stale) Mirror 29: 0xa6b54237 (stale) Mirror 30: 0x21785efb (stale) Mirror 31: 0xffac4f79 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28863: skipped 000956 1788311027.272308 fallocate 0x011d5d thru 0x01c794 (0xaa38 bytes) 000957 1788311027.279517 trunc from 0x01c50f to 0x01dbf3 (0x16e5 bytes) 000958 1788311027.285616 read 0x0203aa thru 0x028862 (0x84b9 bytes) 000959 1788311027.301685 trunc from 0x0134bf to 0x016a26 (0x3568 bytes) 000960 1788311027.315507 MIRROR_RESYNC 11 mirrors 000961 1788311030.364711 trunc from 0x016820 to 0x01683e (0x1f bytes) 000962 1788311030.415650 read 0x003051 thru 0x0119bb (0xe96b bytes) 000963 1788311030.434068 fallocate 0x02d1ee thru 0x039097 (0xbeaa bytes) 000964 1788311030.460549 MIRROR_RESYNC 11 mirrors 000965 1788311033.349192 write 0x03bdd9 thru 0x03ccf4 (0xf1c bytes) 000966 1788311033.400187 trunc from 0x000e3a to 0x001e89 (0x1050 bytes) 000967 1788311033.407565 read 0x01b388 thru 0x01bc5b (0x8d4 bytes) 000968 1788311033.413619 fallocate 0x038dde thru 0x03b694 (0x28b7 bytes) 000969 1788311033.419590 trunc from 0x03ccf5 to 0x01d4bd (0x1f837 bytes) 000971 1788311033.445383 mapread 0x00b785 thru 0x00fb54 (0x43d0 bytes) 000972 1788311033.468977 read 0x01a4e5 thru 0x01d4bd (0x2fd9 bytes) 000973 1788311033.480800 trunc from 0x006bbf to 0x010d11 (0xa153 bytes) 000974 1788311033.490234 MIRROR_SPLIT mirror 5 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1d4be): Mirror 22: 0xb3f260c2 (stale) Mirror 23: 0xb3f260c2 (stale) Mirror 24: 0xb3f260c2 (stale) Mirror 25: 0xb3f260c2 (stale) Mirror 27: 0xb3f260c2 (stale) Mirror 28: 0xb3f260c2 (stale) Mirror 29: 0xb3f260c2 (stale) Mirror 30: 0xb3f260c2 (stale) Mirror 31: 0xb3f260c2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d4be): Mirror 22: 0xb3f260c2 (stale) Mirror 23: 0xb3f260c2 (stale) Mirror 24: 0xb3f260c2 (stale) Mirror 25: 0xb3f260c2 (stale) Mirror 27: 0xb3f260c2 (stale) Mirror 28: 0xb3f260c2 (stale) Mirror 29: 0xb3f260c2 (stale) Mirror 30: 0xb3f260c2 (stale) Mirror 31: 0xb3f260c2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d4be: skipped 000976 1788311034.202672 write 0x00dc05 thru 0x01a8fd (0xccf9 bytes) 000977 1788311034.231395 fallocate 0x017b60 thru 0x024040 (0xc4e1 bytes) 000979 1788311034.243513 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x24041): Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24041): Mirror 22: 0xa6906e22 (stale) Mirror 23: 0xa6906e22 (stale) Mirror 24: 0xa6906e22 (stale) Mirror 25: 0xa6906e22 (stale) Mirror 27: 0xa6906e22 (stale) Mirror 28: 0xa6906e22 (stale) Mirror 29: 0xa6906e22 (stale) Mirror 30: 0xa6906e22 (stale) Mirror 31: 0xa6906e22 (stale) CRC-32 checksum value for chunk [0, 0x24041): Mirror 1: 0x5bb4a5a5 Mirror 32: 0x5bb4a5a5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24041: skipped 000980 1788311035.614137 MIRROR_RESYNC 11 mirrors 000983 1788311037.542474 write 0x001b4f thru 0x007be5 (0x6097 bytes) 000984 1788311037.598517 mapwrite 0x02a8d7 thru 0x036f03 (0xc62d bytes) 000985 1788311037.695900 mapread 0x021306 thru 0x029999 (0x8694 bytes) 000986 1788311037.709465 read 0x01ce99 thru 0x0205ea (0x3752 bytes) 000987 1788311037.710820 trunc from 0x036f04 to 0x024cd1 (0x12232 bytes) 000988 1788311037.750697 read 0x00d611 thru 0x0174e1 (0x9ed1 bytes) 000989 1788311037.792617 MIRROR_SPLIT mirror 10 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x29:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24cd2): Mirror 22: 0x794f5c19 (stale) Mirror 23: 0x794f5c19 (stale) Mirror 24: 0x794f5c19 (stale) Mirror 25: 0x794f5c19 (stale) Mirror 27: 0x794f5c19 (stale) Mirror 28: 0x794f5c19 (stale) Mirror 29: 0x794f5c19 (stale) Mirror 30: 0x794f5c19 (stale) Mirror 31: 0x794f5c19 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24cd2): Mirror 22: 0x794f5c19 (stale) Mirror 23: 0x794f5c19 (stale) Mirror 24: 0x794f5c19 (stale) Mirror 25: 0x794f5c19 (stale) Mirror 27: 0x794f5c19 (stale) Mirror 28: 0x794f5c19 (stale) Mirror 29: 0x794f5c19 (stale) Mirror 30: 0x794f5c19 (stale) Mirror 31: 0x794f5c19 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24cd2: skipped 000990 1788311038.455141 MIRROR_RESYNC 10 mirrors 000991 1788311040.497213 MIRROR_EXTEND to 11 mirrors 000992 1788311041.296288 fallocate 0x008c16 thru 0x013c11 (0xaffc bytes) 000993 1788311041.363101 mapread 0x00375b thru 0x00ca96 (0x933c bytes) 000994 1788311041.415578 mapread 0x023c05 thru 0x024cd1 (0x10cd bytes) 000995 1788311041.426075 trunc from 0x022977 to 0x024cd1 (0x235b bytes) 000996 1788311041.432372 trunc from 0x024cd2 to 0x033af1 (0xee20 bytes) 000997 1788311041.466379 write 0x02eb88 thru 0x03ea23 (0xfe9c bytes) 000998 1788311041.473785 mapwrite 0x02b045 thru 0x0399bf (0xe97b bytes) 000999 1788311041.511389 write 0x014ec9 thru 0x020a93 (0xbbcb bytes) 001000 1788311041.519345 write 0x01149d thru 0x01a2f4 (0x8e58 bytes) All operations completed A-OK!