== sanity-flr test 70a: flr mode fsx test ================ 20:30:17 (1790728217) Seed set to 8219 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x20a58 000002 1790728220.043929 trunc from 00000000 to 0x020a57 (0x20a58 bytes) 000003 1790728220.071904 write 0x00652c thru 0x012a72 (0xc547 bytes) 000004 1790728220.088968 punch from 0x0006f4 to 0x00835f (0x7c6c bytes) 000007 1790728220.125918 write 0x0298d5 thru 0x029b5b (0x287 bytes) 000008 1790728220.126938 mapwrite 0x031405 thru 0x03b98e (0xa58a bytes) 000009 1790728220.279854 read 0x02624f thru 0x032b46 (0xc8f8 bytes) truncating to largest ever: 0x2aaa2 000011 1790728220.298765 trunc from 0x03b98f to 0x02aaa1 (0x10eed bytes) 000012 1790728220.321429 punch from 0x0048d8 to 0x006dcb (0x24f4 bytes) 000019 1790728220.334995 mapwrite 0x021994 thru 0x02a9a4 (0x9011 bytes) 000022 1790728220.409349 mapread 0x020429 thru 0x021242 (0xe1a bytes) 000024 1790728220.411294 write 0x02af73 thru 0x0384a2 (0xd530 bytes) 000025 1790728220.413689 mapwrite 0x031bcb thru 0x034101 (0x2537 bytes) 000026 1790728220.463699 mapread 0x00d5f6 thru 0x011247 (0x3c52 bytes) 000028 1790728220.465313 mapwrite 0x01230c thru 0x01d93e (0xb633 bytes) 000029 1790728220.545016 punch from 0x03844c to 0x0384a2 (0x57 bytes) 000030 1790728220.555671 write 0x0084b0 thru 0x00f028 (0x6b79 bytes) 000031 1790728220.565646 punch from 0x026a4f to 0x032c42 (0xc1f4 bytes) 000032 1790728220.587820 write 0x01c057 thru 0x02aabc (0xea66 bytes) 000033 1790728220.598757 write 0x019035 thru 0x01b32a (0x22f6 bytes) 000034 1790728220.600259 read 0x00abc1 thru 0x0189cd (0xde0d bytes) 000036 1790728220.602060 punch from 0x010a87 to 0x0146cd (0x3c47 bytes) 000037 1790728220.619883 write 0x01a606 thru 0x01f229 (0x4c24 bytes) 000038 1790728220.622186 punch from 0x014e1c to 0x0221e0 (0xd3c5 bytes) 000039 1790728220.656411 read 0x01fc78 thru 0x023efa (0x4283 bytes) 000041 1790728220.679428 mapwrite 0x038e43 thru 0x03ebfc (0x5dba bytes) 000043 1790728220.779739 trunc from 0x03ebfd to 0x020b5e (0x1e09e bytes) 000044 1790728220.796010 read 0x004ab0 thru 0x005bf3 (0x1144 bytes) 000045 1790728220.797788 write 0x032baa thru 0x03ee03 (0xc25a bytes) 000046 1790728220.800378 read 0x009e86 thru 0x016304 (0xc47f bytes) 000047 1790728220.801243 write 0x000883 thru 0x00d2db (0xca59 bytes) 000048 1790728220.803771 trunc from 0x03ee04 to 0x028f3a (0x15ec9 bytes) 000049 1790728220.834947 punch from 0x00e38d to 0x012cc3 (0x4937 bytes) 000051 1790728220.859961 mapwrite 0x003c15 thru 0x0089e2 (0x4dce bytes) 000052 1790728220.980777 mapread 0x0024dc thru 0x00aa59 (0x857e bytes) 000055 1790728220.989300 mapwrite 0x02eefe thru 0x03dfa6 (0xf0a9 bytes) 000056 1790728221.153672 trunc from 0x03dfa7 to 0x0066cf (0x378d7 bytes) 000058 1790728221.199887 read 0x00563f thru 0x0066cf (0x1091 bytes) 000061 1790728221.212226 punch from 0x004c83 to 0x0066cf (0x1a4d bytes) 000062 1790728221.217958 punch from 0x005de7 to 0x0066cf (0x8e9 bytes) 000063 1790728221.227063 trunc from 0x0066d0 to 0x0285c2 (0x21ef3 bytes) 000066 1790728221.253887 read 0x011934 thru 0x014215 (0x28e2 bytes) 000067 1790728221.297136 mapwrite 0x0360d4 thru 0x0386e0 (0x260d bytes) 000068 1790728221.488558 punch from 0x010039 to 0x018b62 (0x8b2a bytes) 000070 1790728221.512799 punch from 0x018c09 to 0x026095 (0xd48d bytes) 000071 1790728221.519420 read 0x0179a8 thru 0x01d8f8 (0x5f51 bytes) 000072 1790728221.542384 trunc from 0x0386e1 to 0x01edb4 (0x1992c bytes) 000073 1790728221.572363 MIRROR_EXTEND to 2 mirrors 000074 1790728222.513364 write 0x01d774 thru 0x02295d (0x51ea bytes) 000075 1790728222.591545 write 0x02f03b thru 0x034430 (0x53f6 bytes) 000076 1790728222.592837 read 0x01717b thru 0x024d76 (0xdbfc bytes) 000078 1790728222.607049 mapread 0x003f07 thru 0x0056fc (0x17f6 bytes) 000079 1790728222.642461 mapwrite 0x0393e3 thru 0x03d0cd (0x3ceb bytes) 000080 1790728222.777913 mapwrite 0x03808e thru 0x0396d7 (0x164a bytes) 000081 1790728222.835490 write 0x006209 thru 0x0107f9 (0xa5f1 bytes) 000084 1790728222.840414 mapread 0x01fb31 thru 0x025cfb (0x61cb bytes) 000087 1790728222.871513 punch from 0x02a82c to 0x038fe2 (0xe7b7 bytes) 000088 1790728222.906017 write 0x0249d1 thru 0x02893d (0x3f6d bytes) 000091 1790728222.914527 punch from 0x01605a to 0x01a20d (0x41b4 bytes) 000092 1790728222.930894 mapwrite 0x008c8f thru 0x00cbc4 (0x3f36 bytes) 000093 1790728222.988546 write 0x0301c8 thru 0x03d6a2 (0xd4db bytes) 000094 1790728223.000506 punch from 0x028633 to 0x02d977 (0x5345 bytes) 000095 1790728223.026464 MIRROR_RESYNC 2 mirrors 000096 1790728223.696852 write 0x01fbe0 thru 0x027225 (0x7646 bytes) 000102 1790728223.762704 mapwrite 0x02d7fd thru 0x03361a (0x5e1e bytes) 000103 1790728223.828575 mapread 0x0377c4 thru 0x03d6a2 (0x5edf bytes) 000104 1790728223.836331 trunc from 0x03d6a3 to 0x01d54c (0x20156 bytes) 000105 1790728223.862021 punch from 0x017259 to 0x01d54c (0x62f4 bytes) 000108 1790728223.880115 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1d54d): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d54d): Mirror 2: 0x8827c6ad (stale) CRC-32 checksum value for chunk [0, 0x1d54d): Mirror 1: 0x8827c6ad Mirror 3: 0x8827c6ad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d54d: skipped truncating to largest ever: 0x3aad5 000110 1790728224.948302 trunc from 0x01d54d to 0x03aad4 (0x1d588 bytes) 000111 1790728225.063860 mapwrite 0x02289b thru 0x02e811 (0xbf77 bytes) 000112 1790728225.163986 read 0x02c600 thru 0x02c893 (0x294 bytes) 000113 1790728225.164740 mapread 0x02e087 thru 0x02e72c (0x6a6 bytes) 000114 1790728225.165906 write 0x001aa5 thru 0x010edc (0xf438 bytes) 000116 1790728225.174755 trunc from 0x03aad5 to 0x008ac6 (0x3200e bytes) 000117 1790728225.197569 read 0x0001a6 thru 0x008ac6 (0x8921 bytes) 000118 1790728225.208822 write 0x011a12 thru 0x012eec (0x14db bytes) 000119 1790728225.210145 trunc from 0x012eed to 0x00197e (0x1156e bytes) 000121 1790728225.243883 read 0x00018e thru 0x00197e (0x17f1 bytes) 000122 1790728225.246019 read 0x0005b9 thru 0x00197e (0x13c6 bytes) 000123 1790728225.249974 mapread 0x000083 thru 0x00197e (0x18fc bytes) 000124 1790728225.257686 read 0x000b6f thru 0x00197e (0xe10 bytes) 000125 1790728225.258425 write 0x00e025 thru 0x016117 (0x80f3 bytes) 000126 1790728225.260458 mapread 0x00dfe9 thru 0x016117 (0x812f bytes) 000129 1790728225.278225 write 0x017e42 thru 0x01db27 (0x5ce6 bytes) 000131 1790728225.281504 mapwrite 0x00c179 thru 0x0167f6 (0xa67e bytes) 000132 1790728225.375061 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1db28): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1db28): Mirror 2: 0xcebe74f (stale) Mirror 3: 0xcf86942b (stale) CRC-32 checksum value for chunk [0, 0x1db28): Mirror 1: 0x2b512436 Mirror 4: 0x2b512436 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1db28: skipped 000136 1790728226.366007 write 0x036d9a thru 0x038ab6 (0x1d1d bytes) 000137 1790728226.469266 mapwrite 0x00eb57 thru 0x015a1f (0x6ec9 bytes) 000138 1790728226.595726 write 0x028105 thru 0x02f5d0 (0x74cc bytes) 000139 1790728226.614238 mapread 0x018a62 thru 0x0210ab (0x864a bytes) 000140 1790728226.632259 punch from 0x029307 to 0x02d3a6 (0x40a0 bytes) 000141 1790728226.664813 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38ab7): Mirror 2: 0x7c0a09ed (stale) Mirror 3: 0xea8e8d73 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38ab7): Mirror 2: 0x7c0a09ed (stale) Mirror 3: 0xea8e8d73 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38ab7: skipped 000144 1790728227.168873 mapread 0x001c82 thru 0x00db6e (0xbeed bytes) 000147 1790728227.195070 punch from 0x033721 to 0x038ab6 (0x5396 bytes) 000150 1790728227.205065 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x38ab7): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38ab7): Mirror 2: 0x7c0a09ed (stale) Mirror 3: 0xea8e8d73 (stale) CRC-32 checksum value for chunk [0, 0x38ab7): Mirror 1: 0xc7892c75 Mirror 4: 0xc7892c75 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38ab7: skipped 000152 1790728228.292658 punch from 0x021a1f to 0x029030 (0x7612 bytes) 000153 1790728228.409882 trunc from 0x038ab7 to 0x0289cf (0x100e7 bytes) 000154 1790728228.447162 punch from 0x005f67 to 0x008092 (0x212c bytes) 000156 1790728228.459128 trunc from 0x0289d0 to 0x02449d (0x4532 bytes) 000157 1790728228.495218 punch from 0x013017 to 0x0208e2 (0xd8cc bytes) 000159 1790728228.502409 write 0x017fea thru 0x01aaba (0x2ad1 bytes) 000160 1790728228.510837 mapwrite 0x003baa thru 0x01221e (0xe675 bytes) 000161 1790728228.659267 mapread 0x01661c thru 0x02449d (0xde82 bytes) 000163 1790728228.673218 trunc from 0x02449e to 0x025175 (0xcd8 bytes) 000164 1790728228.708533 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25176): Mirror 2: 0xb9cd091a (stale) Mirror 4: 0x82aea23 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25176): Mirror 2: 0xb9cd091a (stale) Mirror 4: 0x82aea23 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25176: skipped 000168 1790728229.081747 mapwrite 0x02bf40 thru 0x02c782 (0x843 bytes) 000169 1790728229.204488 trunc from 0x02c783 to 0x01d9be (0xedc4 bytes) 000170 1790728229.225455 punch from 0x00322b to 0x010cb6 (0xda8c bytes) 000171 1790728229.230819 read 0x00f271 thru 0x01d9be (0xe74e bytes) 000172 1790728229.249629 read 0x017978 thru 0x01d9be (0x6047 bytes) 000173 1790728229.250644 trunc from 0x01d9bf to 0x01721f (0x679f bytes) 000174 1790728229.283172 MIRROR_RESYNC 3 mirrors 000176 1790728230.171535 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) 000177 1790728230.481880 mapread 0x001062 thru 0x0021e7 (0x1186 bytes) 000178 1790728230.493234 trunc from 0x017220 to 0x036402 (0x1f1e3 bytes) 000180 1790728230.605988 write 0x01835c thru 0x01b3d4 (0x3079 bytes) 000181 1790728230.623563 punch from 0x027c9c to 0x02dffe (0x6363 bytes) 000182 1790728230.636862 read 0x0102f2 thru 0x010b4d (0x85c bytes) 000183 1790728230.643759 punch from 0x013f54 to 0x02118c (0xd239 bytes) 000184 1790728230.655029 mapread 0x028975 thru 0x03319f (0xa82b bytes) 000185 1790728230.676784 punch from 0x01fe81 to 0x028294 (0x8414 bytes) 000186 1790728230.682212 punch from 0x0067aa to 0x00965c (0x2eb3 bytes) 000187 1790728230.687209 trunc from 0x036403 to 0x035e45 (0x5bd bytes) 000188 1790728230.711600 mapread 0x01c01c thru 0x01fe48 (0x3e2d bytes) 000189 1790728230.721781 punch from 0x01d693 to 0x0269f2 (0x9360 bytes) 000190 1790728230.725867 trunc from 0x035e46 to 0x016852 (0x1f5f3 bytes) 000191 1790728230.744348 trunc from 0x016853 to 0x036d1b (0x204c9 bytes) 000192 1790728230.773812 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) 000197 1790728230.924021 mapwrite 0x014b74 thru 0x0152e2 (0x76f bytes) 000198 1790728230.988480 write 0x039b80 thru 0x03ffff (0x6480 bytes) 000199 1790728230.990687 read 0x00cb53 thru 0x01102f (0x44dd bytes) 000202 1790728230.998240 read 0x0354c6 thru 0x0389a0 (0x34db bytes) 000203 1790728231.006666 punch from 0x02a16e to 0x034ec3 (0xad56 bytes) 000205 1790728231.018893 mapread 0x01a678 thru 0x01d218 (0x2ba1 bytes) 000206 1790728231.020343 read 0x00414d thru 0x00e33f (0xa1f3 bytes) 000208 1790728231.023166 read 0x017a7e thru 0x01aef6 (0x3479 bytes) 000209 1790728231.024262 punch from 0x01a7c8 to 0x021620 (0x6e59 bytes) 000210 1790728231.034395 write 0x03ecbc thru 0x03ffff (0x1344 bytes) 000212 1790728231.035889 punch from 0x0247d8 to 0x02db52 (0x937b bytes) 000213 1790728231.047798 trunc from 0x040000 to 0x004b58 (0x3b4a7 bytes) 000215 1790728231.065884 write 0x02f3c8 thru 0x035990 (0x65c9 bytes) 000216 1790728231.073592 MIRROR_EXTEND to 2 mirrors 000217 1790728232.029459 mapwrite 0x010fb3 thru 0x012e6f (0x1ebd bytes) 000218 1790728232.294171 write 0x00f156 thru 0x019a37 (0xa8e2 bytes) 000219 1790728232.295520 mapread 0x015567 thru 0x0210d5 (0xbb6f bytes) 000220 1790728232.308283 mapwrite 0x009e18 thru 0x00edec (0x4fd5 bytes) 000222 1790728232.380981 trunc from 0x035991 to 0x03342f (0x2561 bytes) 000223 1790728232.450960 punch from 0x0054b6 to 0x014eb6 (0xfa01 bytes) 000224 1790728232.455953 trunc from 0x033430 to 0x035031 (0x1c02 bytes) 000225 1790728232.478168 punch from 0x00a32c to 0x018f91 (0xec66 bytes) 000230 1790728232.485437 punch from 0x006699 to 0x0136d1 (0xd039 bytes) 000231 1790728232.489902 mapwrite 0x002ace thru 0x00629f (0x37d2 bytes) 000232 1790728232.539565 read 0x002767 thru 0x0112b1 (0xeb4b bytes) 000233 1790728232.544753 mapwrite 0x0157d4 thru 0x01c7a7 (0x6fd4 bytes) 000234 1790728232.590371 trunc from 0x035032 to 0x022948 (0x126e9 bytes) 000236 1790728232.610736 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x22949): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22949): Mirror 2: 0xf3dd253 (stale) CRC-32 checksum value for chunk [0, 0x22949): Mirror 1: 0xb8293b5f Mirror 3: 0xb8293b5f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22949: skipped 000237 1790728233.378726 read 0x0100a4 thru 0x018289 (0x81e6 bytes) 000239 1790728233.396958 read 0x0093cf thru 0x015ee5 (0xcb17 bytes) 000240 1790728233.430122 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) 000241 1790728233.891505 punch from 0x010958 to 0x01761e (0x6cc7 bytes) 000242 1790728234.060909 punch from 0x00ed71 to 0x00ffca (0x125a bytes) 000244 1790728234.071850 write 0x01e2f3 thru 0x029e16 (0xbb24 bytes) 000245 1790728234.081906 trunc from 0x029e17 to 0x028012 (0x1e04 bytes) 000246 1790728234.174505 mapread 0x00376c thru 0x008d6c (0x5601 bytes) 000247 1790728234.202678 mapread 0x000143 thru 0x0053ef (0x52ad bytes) 000249 1790728234.217768 write 0x03db79 thru 0x03ffff (0x2487 bytes) 000250 1790728234.220807 trunc from 0x040000 to 0x013248 (0x2cdb7 bytes) 000251 1790728234.254668 read 0x00187b thru 0x00961f (0x7da5 bytes) 000252 1790728234.257555 mapread 0x010d48 thru 0x013248 (0x2501 bytes) 000254 1790728234.281329 mapread 0x00a441 thru 0x0129cc (0x858c bytes) 000255 1790728234.283758 mapread 0x00c6d9 thru 0x010f89 (0x48b1 bytes) 000256 1790728234.290864 write 0x00e8c6 thru 0x016423 (0x7b5e bytes) 000258 1790728234.293966 mapwrite 0x0231c5 thru 0x025a1b (0x2857 bytes) 000259 1790728234.422557 punch from 0x006e23 to 0x0104c8 (0x96a6 bytes) 000261 1790728234.434836 write 0x003e6b thru 0x006fa5 (0x313b bytes) 000263 1790728234.456797 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) 000264 1790728234.612362 write 0x02f649 thru 0x03d6c9 (0xe081 bytes) 000266 1790728234.617873 write 0x014bf5 thru 0x022d6a (0xe176 bytes) 000268 1790728234.651931 mapwrite 0x01a23e thru 0x020acb (0x688e bytes) 000269 1790728234.714162 mapwrite 0x01b6b3 thru 0x02b5b5 (0xff03 bytes) 000270 1790728234.806034 MIRROR_EXTEND to 2 mirrors 000271 1790728235.616654 mapread 0x0308ac thru 0x037202 (0x6957 bytes) 000272 1790728235.677057 punch from 0x007fe0 to 0x01785e (0xf87f bytes) 000273 1790728235.754636 write 0x002c6b thru 0x0124fc (0xf892 bytes) 000274 1790728235.781307 mapread 0x011160 thru 0x011579 (0x41a bytes) 000275 1790728235.783153 mapwrite 0x02dea9 thru 0x0363b8 (0x8510 bytes) 000278 1790728235.869825 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d6ca): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d6ca): Mirror 2: 0x2b7dfe7d (stale) CRC-32 checksum value for chunk [0, 0x3d6ca): Mirror 1: 0xcfb25245 Mirror 3: 0xcfb25245 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d6ca: skipped 000281 1790728237.116329 trunc from 0x03d6ca to 0x028a43 (0x14c86 bytes) 000283 1790728237.277698 MIRROR_RESYNC 3 mirrors 000286 1790728238.437914 read 0x01429a thru 0x016424 (0x218b bytes) 000287 1790728238.444677 write 0x00b663 thru 0x01a9bb (0xf359 bytes) 000288 1790728238.514557 trunc from 0x028a44 to 0x0282d2 (0x771 bytes) 000289 1790728238.533008 mapwrite 0x01cf0c thru 0x02c7de (0xf8d3 bytes) 000290 1790728238.675263 write 0x02ac2c thru 0x031fdd (0x73b2 bytes) 000291 1790728238.676783 punch from 0x0268f9 to 0x028882 (0x1f8a bytes) 000294 1790728238.708244 write 0x028fe5 thru 0x02ccfd (0x3d19 bytes) 000295 1790728238.720340 mapwrite 0x002757 thru 0x00e58b (0xbe35 bytes) 000296 1790728238.809543 mapread 0x01e038 thru 0x0202b4 (0x227d bytes) 000297 1790728238.824959 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x31fde): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31fde): Mirror 2: 0x85f4fc24 (stale) Mirror 3: 0x85f4fc24 (stale) CRC-32 checksum value for chunk [0, 0x31fde): Mirror 1: 0x2c6527f Mirror 4: 0x2c6527f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31fde: skipped 000298 1790728240.424120 punch from 0x01ddb0 to 0x02a939 (0xcb8a bytes) 000300 1790728240.499619 mapread 0x013a1c thru 0x01964d (0x5c32 bytes) 000301 1790728240.525517 write 0x00666a thru 0x014889 (0xe220 bytes) 000303 1790728240.532438 mapwrite 0x00f8bd thru 0x018bca (0x930e bytes) 000304 1790728240.578792 punch from 0x018fd9 to 0x01fbba (0x6be2 bytes) 000305 1790728240.583891 mapread 0x011bef thru 0x01dbd6 (0xbfe8 bytes) 000306 1790728240.599879 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x31fde): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31fde): Mirror 2: 0x85f4fc24 (stale) Mirror 3: 0x85f4fc24 (stale) Mirror 4: 0x2c6527f (stale) CRC-32 checksum value for chunk [0, 0x31fde): Mirror 1: 0x70293d41 Mirror 5: 0x70293d41 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31fde: skipped 000307 1790728241.798178 punch from 0x00da09 to 0x00ed1a (0x1312 bytes) 000311 1790728241.899337 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x31fde): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31fde): Mirror 2: 0x85f4fc24 (stale) Mirror 3: 0x85f4fc24 (stale) Mirror 4: 0x2c6527f (stale) Mirror 5: 0x70293d41 (stale) CRC-32 checksum value for chunk [0, 0x31fde): Mirror 1: 0xa73eb684 Mirror 6: 0xa73eb684 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31fde: skipped 000312 1790728243.099034 read 0x010fbe thru 0x011893 (0x8d6 bytes) 000313 1790728243.152683 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31fde): Mirror 3: 0x85f4fc24 (stale) Mirror 4: 0x2c6527f (stale) Mirror 5: 0x70293d41 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31fde): Mirror 3: 0x85f4fc24 (stale) Mirror 4: 0x2c6527f (stale) Mirror 5: 0x70293d41 (stale) CRC-32 checksum value for chunk [0, 0x31fde): Mirror 1: 0xa73eb684 Mirror 6: 0xa73eb684 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31fde: skipped 000314 1790728244.364891 read 0x007542 thru 0x00e5ae (0x706d bytes) 000317 1790728244.446810 punch from 0x011772 to 0x01b5be (0x9e4d bytes) 000319 1790728244.563427 write 0x00da18 thru 0x00f97f (0x1f68 bytes) 000320 1790728244.591693 mapwrite 0x022f3d thru 0x027f69 (0x502d bytes) 000321 1790728244.762258 read 0x00092e thru 0x01004e (0xf721 bytes) 000322 1790728244.779617 punch from 0x010916 to 0x01d97d (0xd068 bytes) 000324 1790728244.806524 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31fde): Mirror 4: 0x2c6527f (stale) Mirror 5: 0x70293d41 (stale) Mirror 6: 0xa73eb684 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31fde): Mirror 4: 0x2c6527f (stale) Mirror 5: 0x70293d41 (stale) Mirror 6: 0xa73eb684 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31fde: skipped 000325 1790728245.224361 trunc from 0x031fde to 0x032f6f (0xf92 bytes) 000326 1790728245.249706 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x32f70): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32f70): Mirror 4: 0x172a2368 (stale) Mirror 5: 0x6e851996 (stale) Mirror 6: 0xbb20da3d (stale) CRC-32 checksum value for chunk [0, 0x32f70): Mirror 1: 0x957bbb13 Mirror 7: 0x957bbb13 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32f70: skipped 000327 1790728246.587977 punch from 0x000f18 to 0x00f587 (0xe670 bytes) 000328 1790728246.743833 trunc from 0x032f70 to 0x02f0c7 (0x3ea8 bytes) 000331 1790728246.794533 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2f0c8): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f0c8): Mirror 4: 0x7dca1973 (stale) Mirror 5: 0xb64650c0 (stale) Mirror 6: 0xa411e1d5 (stale) Mirror 7: 0x6e5fa1d0 (stale) CRC-32 checksum value for chunk [0, 0x2f0c8): Mirror 1: 0xe8617e6e Mirror 8: 0xe8617e6e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f0c8: skipped 000332 1790728248.012819 mapwrite 0x02c98e thru 0x033082 (0x66f5 bytes) 000333 1790728248.254495 read 0x0143d7 thru 0x0147ca (0x3f4 bytes) 000335 1790728248.263044 mapread 0x00bec0 thru 0x00f691 (0x37d2 bytes) 000337 1790728248.307594 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33083): Mirror 4: 0x81662fc1 (stale) Mirror 6: 0xa5af071c (stale) Mirror 7: 0x978c4067 (stale) Mirror 8: 0xde79ecf6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33083): Mirror 4: 0x81662fc1 (stale) Mirror 6: 0xa5af071c (stale) Mirror 7: 0x978c4067 (stale) Mirror 8: 0xde79ecf6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33083: skipped 000341 1790728248.919917 read 0x0281c3 thru 0x02c58e (0x43cc bytes) 000342 1790728248.941460 read 0x0210d9 thru 0x02e0c7 (0xcfef bytes) 000343 1790728248.960700 punch from 0x00d643 to 0x01b337 (0xdcf5 bytes) 000345 1790728248.981549 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33083): Mirror 6: 0xa5af071c (stale) Mirror 7: 0x978c4067 (stale) Mirror 8: 0xde79ecf6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33083): Mirror 6: 0xa5af071c (stale) Mirror 7: 0x978c4067 (stale) Mirror 8: 0xde79ecf6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33083: skipped 000346 1790728249.567332 trunc from 0x033083 to 0x01837a (0x1ad08 bytes) 000347 1790728249.594188 mapread 0x013354 thru 0x01837a (0x5027 bytes) 000348 1790728249.622725 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1837b): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1837b): Mirror 6: 0x21451f3 (stale) Mirror 7: 0xfb54b9df (stale) Mirror 8: 0x9683e072 (stale) CRC-32 checksum value for chunk [0, 0x1837b): Mirror 1: 0xb42320ef Mirror 9: 0xb42320ef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1837b: skipped 000349 1790728250.318402 punch from 0x00ea99 to 0x011d33 (0x329b bytes) 000350 1790728250.427499 mapread 0x0035ac thru 0x00d165 (0x9bba bytes) 000351 1790728250.442573 mapwrite 0x024237 thru 0x02cc9c (0x8a66 bytes) 000353 1790728250.533732 write 0x02337b thru 0x029edb (0x6b61 bytes) 000354 1790728250.535713 write 0x02b5d1 thru 0x0330d1 (0x7b01 bytes) 000355 1790728250.537209 punch from 0x007f35 to 0x010f5d (0x9029 bytes) 000356 1790728250.554886 read 0x023976 thru 0x0300db (0xc766 bytes) 000357 1790728250.557005 write 0x000248 thru 0x00bf34 (0xbced bytes) 000358 1790728250.574118 trunc from 0x0330d2 to 0x01d27f (0x15e52 bytes) 000359 1790728250.602300 mapread 0x019712 thru 0x01d27f (0x3b6e bytes) 000360 1790728250.613950 punch from 0x00b2a4 to 0x011ca8 (0x6a05 bytes) 000361 1790728250.626145 write 0x0334bf thru 0x03d95e (0xa4a0 bytes) 000362 1790728250.627939 mapwrite 0x010224 thru 0x014e9d (0x4c7a bytes) 000363 1790728250.726615 mapread 0x0252c2 thru 0x02c1b6 (0x6ef5 bytes) 000364 1790728250.737249 punch from 0x03021f to 0x032224 (0x2006 bytes) 000365 1790728250.742364 write 0x004f34 thru 0x0064a7 (0x1574 bytes) 000366 1790728250.743824 mapwrite 0x0324a4 thru 0x03e5ee (0xc14b bytes) 000367 1790728250.888228 mapwrite 0x020625 thru 0x02bdc7 (0xb7a3 bytes) 000368 1790728251.009031 mapread 0x01917a thru 0x019504 (0x38b bytes) 000370 1790728251.010875 mapwrite 0x0166ec thru 0x02510a (0xea1f bytes) 000371 1790728251.052315 trunc from 0x03e5ef to 0x01172a (0x2cec4 bytes) 000372 1790728251.100349 write 0x02c063 thru 0x0375ef (0xb58d bytes) 000373 1790728251.101863 write 0x0235bb thru 0x028498 (0x4ede bytes) 000374 1790728251.129656 punch from 0x01fc31 to 0x026ff6 (0x73c6 bytes) 000375 1790728251.147537 mapwrite 0x02e6b7 thru 0x03915b (0xaaa5 bytes) 000376 1790728251.307259 punch from 0x025e47 to 0x0293d1 (0x358b bytes) 000377 1790728251.312827 write 0x00e0b8 thru 0x01a1c7 (0xc110 bytes) 000378 1790728251.323297 trunc from 0x03915c to 0x021b99 (0x175c2 bytes) 000379 1790728251.356619 mapwrite 0x032245 thru 0x03ffff (0xddbb bytes) 000380 1790728251.670244 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xc3a88be4 (stale) Mirror 7: 0x9cb6783 (stale) Mirror 9: 0x2819ab24 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xc3a88be4 (stale) Mirror 7: 0x9cb6783 (stale) Mirror 9: 0x2819ab24 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000381 1790728252.315470 MIRROR_RESYNC 4 mirrors 000382 1790728254.000662 read 0x00b171 thru 0x019f6d (0xedfd bytes) 000383 1790728254.015199 trunc from 0x040000 to 0x00c686 (0x33979 bytes) 000384 1790728254.199644 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xc687): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc687): Mirror 6: 0x68b4b26e (stale) Mirror 7: 0x68b4b26e (stale) Mirror 9: 0x68b4b26e (stale) CRC-32 checksum value for chunk [0, 0xc687): Mirror 1: 0x68b4b26e Mirror 10: 0x68b4b26e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc687: skipped 000386 1790728255.298747 punch from 0x0014a7 to 0x001c4c (0x7a6 bytes) 000387 1790728255.384954 trunc from 0x00c687 to 0x037d9d (0x2b717 bytes) 000390 1790728255.450624 read 0x026d73 thru 0x028b6a (0x1df8 bytes) 000392 1790728255.456556 mapwrite 0x002db3 thru 0x006708 (0x3956 bytes) 000394 1790728255.556211 mapwrite 0x02a582 thru 0x031d7a (0x77f9 bytes) 000397 1790728255.631782 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37d9e): Mirror 7: 0xdb1e5561 (stale) Mirror 9: 0xdb1e5561 (stale) Mirror 10: 0xadad9cd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37d9e): Mirror 7: 0xdb1e5561 (stale) Mirror 9: 0xdb1e5561 (stale) Mirror 10: 0xadad9cd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37d9e: skipped 000398 1790728256.254707 read 0x032c0d thru 0x036bce (0x3fc2 bytes) 000400 1790728256.280361 MIRROR_RESYNC 4 mirrors 000402 1790728258.491788 mapread 0x027831 thru 0x02c897 (0x5067 bytes) 000403 1790728258.548216 mapwrite 0x0207a6 thru 0x022d15 (0x2570 bytes) 000404 1790728258.873496 read 0x01cdac thru 0x0255f8 (0x884d bytes) 000405 1790728258.893279 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x37d9e): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37d9e): Mirror 7: 0x2ad7c861 (stale) Mirror 9: 0x2ad7c861 (stale) Mirror 10: 0x2ad7c861 (stale) CRC-32 checksum value for chunk [0, 0x37d9e): Mirror 1: 0x7b934813 Mirror 11: 0x7b934813 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37d9e: skipped 000406 1790728260.568932 read 0x016c06 thru 0x0202d7 (0x96d2 bytes) 000407 1790728260.603931 mapwrite 0x006e95 thru 0x0124a8 (0xb614 bytes) 000408 1790728261.069597 MIRROR_RESYNC 5 mirrors 000409 1790728262.555226 mapwrite 0x025b93 thru 0x030d04 (0xb172 bytes) 000411 1790728262.850361 trunc from 0x037d9e to 0x00383c (0x34561 bytes) 000414 1790728262.904133 trunc from 0x00383d to 0x01d50c (0x19cd0 bytes) 000415 1790728262.940873 mapwrite 0x039bf4 thru 0x03b45d (0x186a bytes) 000416 1790728263.033982 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b45e): Mirror 9: 0x3ba0db9e (stale) Mirror 10: 0x3ba0db9e (stale) Mirror 11: 0x3ba0db9e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b45e): Mirror 9: 0x3ba0db9e (stale) Mirror 10: 0x3ba0db9e (stale) Mirror 11: 0x3ba0db9e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b45e: skipped 000418 1790728263.469011 trunc from 0x03b45e to 0x01a2bc (0x211a1 bytes) 000420 1790728263.489916 read 0x00d436 thru 0x013654 (0x621f bytes) 000421 1790728263.501430 punch from 0x0026b3 to 0x011a0c (0xf35a bytes) 000422 1790728263.506592 mapread 0x00b556 thru 0x01a2bc (0xed67 bytes) 000423 1790728263.550192 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1a2bd): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a2bd): Mirror 9: 0x71e47fd2 (stale) Mirror 10: 0x71e47fd2 (stale) Mirror 11: 0x71e47fd2 (stale) CRC-32 checksum value for chunk [0, 0x1a2bd): Mirror 1: 0xe639f577 Mirror 12: 0xe639f577 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a2bd: skipped 000424 1790728265.324007 read 0x000517 thru 0x00969f (0x9189 bytes) 000425 1790728265.379467 mapwrite 0x02300e thru 0x0329bc (0xf9af bytes) 000426 1790728265.583867 write 0x03583e thru 0x036e41 (0x1604 bytes) 000428 1790728265.589572 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36e42): Mirror 9: 0x69143f26 (stale) Mirror 10: 0x69143f26 (stale) Mirror 11: 0x69143f26 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36e42): Mirror 9: 0x69143f26 (stale) Mirror 10: 0x69143f26 (stale) Mirror 11: 0x69143f26 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36e42: skipped 000429 1790728266.119876 trunc from 0x036e42 to 0x017fc9 (0x1ee78 bytes) 000430 1790728266.139500 write 0x035016 thru 0x03fd3c (0xad27 bytes) 000433 1790728266.148363 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fd3d): Mirror 10: 0x2922f047 (stale) Mirror 11: 0x2922f047 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fd3d): Mirror 10: 0x2922f047 (stale) Mirror 11: 0x2922f047 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fd3d: skipped 000436 1790728266.499539 write 0x03ed2a thru 0x03ffff (0x12d6 bytes) 000439 1790728266.511736 read 0x026180 thru 0x0312cc (0xb14d bytes) 000441 1790728266.537859 write 0x00b74f thru 0x01b299 (0xfb4b bytes) 000442 1790728266.557233 punch from 0x00d198 to 0x00e5fa (0x1463 bytes) 000446 1790728266.592820 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x8aef99a1 (stale) Mirror 11: 0x8aef99a1 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7d6eb380 Mirror 12: 0x7d6eb380 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000448 1790728267.673753 mapwrite 0x02c9c3 thru 0x039f39 (0xd577 bytes) 000449 1790728267.987062 mapwrite 0x00f868 thru 0x0138cb (0x4064 bytes) 000450 1790728268.061174 MIRROR_RESYNC 4 mirrors 000451 1790728269.238796 trunc from 0x040000 to 0x018304 (0x27cfb bytes) 000452 1790728269.334647 punch from 0x00fb44 to 0x012ffe (0x34bb bytes) 000454 1790728269.340370 write 0x02d4d5 thru 0x02e87c (0x13a8 bytes) 000455 1790728269.344528 mapread 0x00162a thru 0x0076f4 (0x60cb bytes) 000456 1790728269.364524 mapwrite 0x01b426 thru 0x01e82f (0x340a bytes) 000457 1790728269.443835 MIRROR_RESYNC 4 mirrors 000458 1790728270.618508 read 0x021793 thru 0x02af97 (0x9805 bytes) 000459 1790728270.648284 write 0x0274f1 thru 0x0289e4 (0x14f4 bytes) 000460 1790728270.742506 mapwrite 0x035c84 thru 0x0388e6 (0x2c63 bytes) 000461 1790728270.870780 read 0x03412e thru 0x0388e6 (0x47b9 bytes) 000463 1790728270.875453 punch from 0x00dd66 to 0x01d2d1 (0xf56c bytes) 000464 1790728270.887623 write 0x01c699 thru 0x01f09a (0x2a02 bytes) 000465 1790728270.921440 punch from 0x003d19 to 0x005805 (0x1aed bytes) truncating to largest ever: 0x3ef64 000469 1790728270.947854 trunc from 0x0388e7 to 0x03ef63 (0x667d bytes) 000471 1790728270.994670 mapwrite 0x0112c3 thru 0x013cb3 (0x29f1 bytes) 000478 1790728271.073453 punch from 0x03a4fd to 0x03ad96 (0x89a bytes) 000479 1790728271.090210 write 0x02995e thru 0x032d74 (0x9417 bytes) 000480 1790728271.099222 write 0x03d144 thru 0x03ffff (0x2ebc bytes) 000481 1790728271.123297 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x92de4d18 (stale) Mirror 11: 0x92de4d18 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x92de4d18 (stale) Mirror 11: 0x92de4d18 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000484 1790728271.624834 punch from 0x031f8b to 0x0349d0 (0x2a46 bytes) 000485 1790728271.639637 mapwrite 0x0155e7 thru 0x021a3a (0xc454 bytes) 000486 1790728271.766325 trunc from 0x040000 to 0x016254 (0x29dab bytes) 000488 1790728271.791217 mapread 0x00ff5b thru 0x011c4a (0x1cf0 bytes) 000489 1790728271.814296 punch from 0x0035d3 to 0x0072e8 (0x3d16 bytes) 000490 1790728271.830886 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16255): Mirror 10: 0x9ba77c7d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16255): Mirror 10: 0x9ba77c7d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16255: skipped 000491 1790728272.211550 mapwrite 0x00323f thru 0x008049 (0x4e0b bytes) 000494 1790728272.379284 trunc from 0x016255 to 0x03ecc3 (0x28a6f bytes) 000495 1790728272.435168 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3ecc4): Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ecc4): Mirror 10: 0x2b5fb5ae (stale) CRC-32 checksum value for chunk [0, 0x3ecc4): Mirror 1: 0x2005f27f Mirror 11: 0x2005f27f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ecc4: skipped 000496 1790728273.816820 read 0x00e16f thru 0x01090d (0x279f bytes) 000498 1790728273.822952 mapread 0x02ee5a thru 0x032765 (0x390c bytes) 000500 1790728273.847904 MIRROR_RESYNC 3 mirrors 000502 1790728275.015311 trunc from 0x03ecc4 to 0x027739 (0x1758a bytes) 000504 1790728275.152015 trunc from 0x02773a to 0x00a8a6 (0x1ce93 bytes) 000505 1790728275.177272 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xa8a7): Mirror 10: 0x5cb3774a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa8a7): Mirror 10: 0x5cb3774a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa8a7: skipped 000506 1790728275.503866 mapwrite 0x0323a6 thru 0x035b88 (0x37e3 bytes) 000508 1790728275.689158 read 0x018726 thru 0x01c7d2 (0x40ad bytes) 000511 1790728275.726913 mapwrite 0x021d8b thru 0x02e369 (0xc5df bytes) 000512 1790728275.831314 mapread 0x0269b6 thru 0x032969 (0xbfb4 bytes) 000513 1790728275.832506 trunc from 0x035b89 to 0x00fb91 (0x25ff7 bytes) 000514 1790728275.859435 write 0x00a798 thru 0x00d87c (0x30e5 bytes) 000515 1790728275.877530 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xfb92): Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xfb92): Mirror 10: 0x11cb8cc9 (stale) CRC-32 checksum value for chunk [0, 0xfb92): Mirror 1: 0x5d5cedc2 Mirror 11: 0x5d5cedc2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xfb92: skipped 000516 1790728277.018329 punch from 0x00b39a to 0x00fb91 (0x47f8 bytes) 000517 1790728277.186319 MIRROR_RESYNC 3 mirrors 000521 1790728278.215289 trunc from 0x00fb92 to 0x0045ec (0xb5a5 bytes) 000522 1790728278.427818 read 0x0015b7 thru 0x0045ec (0x3036 bytes) 000523 1790728278.450224 mapwrite 0x008c8e thru 0x00bee2 (0x3255 bytes) 000524 1790728278.678349 mapwrite 0x00368e thru 0x00c3a3 (0x8d16 bytes) 000525 1790728278.797610 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xc3a4): Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc3a4): Mirror 10: 0x7f48c030 (stale) Mirror 11: 0x7f48c030 (stale) CRC-32 checksum value for chunk [0, 0xc3a4): Mirror 1: 0x6c9f5621 Mirror 12: 0x6c9f5621 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc3a4: skipped 000526 1790728279.933528 write 0x02023a thru 0x02e522 (0xe2e9 bytes) 000528 1790728280.100779 mapread 0x019874 thru 0x0208a5 (0x7032 bytes) 000529 1790728280.119703 mapwrite 0x02dfe0 thru 0x033b87 (0x5ba8 bytes) 000530 1790728280.230552 trunc from 0x033b88 to 0x036689 (0x2b02 bytes) 000531 1790728280.249799 punch from 0x0048e6 to 0x009d9a (0x54b5 bytes) 000534 1790728280.261517 read 0x02b564 thru 0x036689 (0xb126 bytes) 000536 1790728280.271049 mapread 0x01a487 thru 0x022211 (0x7d8b bytes) 000541 1790728280.280907 trunc from 0x03668a to 0x02333d (0x1334c bytes) 000542 1790728280.320196 mapread 0x017244 thru 0x02333d (0xc0fa bytes) 000543 1790728280.323161 punch from 0x011f61 to 0x0155d7 (0x3677 bytes) 000546 1790728280.341579 read 0x00da99 thru 0x017e69 (0xa3d1 bytes) 000548 1790728280.371658 trunc from 0x02333e to 0x02b49d (0x8160 bytes) 000549 1790728280.465559 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b49e): Mirror 10: 0xd57318a4 (stale) Mirror 11: 0xd57318a4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b49e): Mirror 10: 0xd57318a4 (stale) Mirror 11: 0xd57318a4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b49e: skipped 000550 1790728281.036694 punch from 0x025095 to 0x02b49d (0x6409 bytes) 000551 1790728281.042780 trunc from 0x02b49e to 0x03be5f (0x109c2 bytes) 000552 1790728281.072541 mapwrite 0x005504 thru 0x011ac3 (0xc5c0 bytes) 000553 1790728281.243516 punch from 0x018da4 to 0x01c8e4 (0x3b41 bytes) 000559 1790728281.281530 mapread 0x020c59 thru 0x02939a (0x8742 bytes) 000561 1790728281.339499 punch from 0x00725c to 0x00e7a3 (0x7548 bytes) 000562 1790728281.359162 write 0x00f5c4 thru 0x018266 (0x8ca3 bytes) 000563 1790728281.377656 write 0x03d04a thru 0x03ffff (0x2fb6 bytes) 000564 1790728281.380710 punch from 0x01dbae to 0x01fd93 (0x21e6 bytes) 000568 1790728281.426568 mapread 0x0029bf thru 0x00c621 (0x9c63 bytes) 000569 1790728281.451680 punch from 0x00666c to 0x01485a (0xe1ef bytes) 000571 1790728281.464471 punch from 0x01d789 to 0x0232eb (0x5b63 bytes) 000573 1790728281.480727 write 0x03be8e thru 0x03ffff (0x4172 bytes) 000574 1790728281.509709 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xa8d3f2ce (stale) Mirror 11: 0xa8d3f2ce (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2929054 Mirror 12: 0x2929054 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000575 1790728283.070371 punch from 0x0044e4 to 0x00ec0b (0xa728 bytes) 000576 1790728283.200847 mapwrite 0x006b86 thru 0x00e01b (0x7496 bytes) 000577 1790728283.376984 mapwrite 0x004600 thru 0x00673e (0x213f bytes) 000578 1790728283.482776 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xa8d3f2ce (stale) Mirror 11: 0xa8d3f2ce (stale) Mirror 12: 0x2929054 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x636923ad Mirror 13: 0x636923ad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000580 1790728284.660961 write 0x008613 thru 0x015532 (0xcf20 bytes) 000581 1790728284.838830 write 0x001523 thru 0x00c460 (0xaf3e bytes) 000582 1790728284.851660 read 0x038469 thru 0x03ffff (0x7b97 bytes) 000584 1790728284.864036 mapwrite 0x03058d thru 0x03abef (0xa663 bytes) 000585 1790728285.039264 trunc from 0x040000 to 0x01689d (0x29762 bytes) 000586 1790728285.128975 mapread 0x008056 thru 0x00aa76 (0x2a21 bytes) 000587 1790728285.130178 write 0x012e7b thru 0x0171ed (0x4373 bytes) 000589 1790728285.139796 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x171ee): Mirror 10: 0x634f9fcf (stale) Mirror 11: 0x634f9fcf (stale) Mirror 12: 0x2503d21f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x171ee): Mirror 10: 0x634f9fcf (stale) Mirror 11: 0x634f9fcf (stale) Mirror 12: 0x2503d21f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x171ee: skipped 000590 1790728285.612649 trunc from 0x0171ee to 0x018a60 (0x1873 bytes) 000591 1790728285.633961 punch from 0x00c8d5 to 0x018a60 (0xc18c bytes) 000593 1790728285.641596 punch from 0x016ef4 to 0x018a60 (0x1b6d bytes) 000595 1790728285.648401 punch from 0x003956 to 0x00ffef (0xc69a bytes) 000596 1790728285.653499 write 0x015446 thru 0x017aa6 (0x2661 bytes) 000597 1790728285.664256 mapread 0x016a7e thru 0x018a60 (0x1fe3 bytes) 000598 1790728285.670155 punch from 0x006052 to 0x011d10 (0xbcbf bytes) 000599 1790728285.679045 mapwrite 0x015af2 thru 0x022cd3 (0xd1e2 bytes) 000600 1790728285.837920 write 0x01f369 thru 0x02d686 (0xe31e bytes) 000602 1790728285.856307 MIRROR_RESYNC 4 mirrors 000603 1790728287.360661 trunc from 0x02d687 to 0x00d1cc (0x204ba bytes) 000605 1790728287.462470 mapwrite 0x0038d6 thru 0x011713 (0xde3e bytes) 000606 1790728287.607852 mapwrite 0x033539 thru 0x03ffff (0xcac7 bytes) 000608 1790728287.783039 write 0x02aa10 thru 0x02b7eb (0xddc bytes) 000609 1790728287.804616 trunc from 0x040000 to 0x03645e (0x9ba1 bytes) 000610 1790728287.838755 trunc from 0x03645f to 0x0242b6 (0x121a8 bytes) 000611 1790728287.893858 punch from 0x01ab37 to 0x0242b6 (0x9780 bytes) 000613 1790728287.903483 read 0x0038a1 thru 0x00ab9a (0x72fa bytes) 000615 1790728287.904703 mapread 0x0022fc thru 0x00dd68 (0xba6d bytes) 000616 1790728287.906864 read 0x002324 thru 0x007b9a (0x5877 bytes) 000619 1790728287.912417 write 0x03b119 thru 0x03ceed (0x1dd5 bytes) 000620 1790728287.926695 mapwrite 0x0080a1 thru 0x00fb1a (0x7a7a bytes) 000621 1790728288.087629 read 0x014624 thru 0x01ec58 (0xa635 bytes) 000622 1790728288.141863 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3ceee): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ceee): Mirror 10: 0xed3fa479 (stale) Mirror 11: 0xed3fa479 (stale) Mirror 12: 0xed3fa479 (stale) CRC-32 checksum value for chunk [0, 0x3ceee): Mirror 1: 0xa91b456e Mirror 13: 0xa91b456e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ceee: skipped 000623 1790728289.676609 read 0x033bc1 thru 0x03c64a (0x8a8a bytes) 000624 1790728289.710795 trunc from 0x03ceee to 0x00b9e6 (0x31507 bytes) 000627 1790728289.874027 read 0x0071d8 thru 0x00b9e6 (0x480f bytes) 000628 1790728289.888869 trunc from 0x00b9e7 to 0x004fe8 (0x69fe bytes) 000629 1790728289.943020 read 0x001349 thru 0x004fe8 (0x3ca0 bytes) 000631 1790728289.947434 mapread 0x003ca8 thru 0x004fe8 (0x1341 bytes) 000633 1790728289.950468 mapread 0x0000bd thru 0x0026bd (0x2601 bytes) 000634 1790728289.961421 MIRROR_RESYNC 5 mirrors 000638 1790728291.806762 trunc from 0x004fe9 to 0x02d0f4 (0x2810c bytes) 000642 1790728291.910907 read 0x024b6a thru 0x02b1bf (0x6656 bytes) 000643 1790728291.942390 punch from 0x008ebf to 0x015cf9 (0xce3b bytes) 000644 1790728291.962515 trunc from 0x02d0f5 to 0x01d3c6 (0xfd2e bytes) 000645 1790728292.008918 mapwrite 0x03ef6a thru 0x03ffff (0x1096 bytes) 000646 1790728292.118917 read 0x0104eb thru 0x011c2c (0x1742 bytes) 000647 1790728292.153127 punch from 0x02e21a to 0x02fc64 (0x1a4b bytes) 000648 1790728292.160838 mapwrite 0x02ca1d thru 0x02e087 (0x166b bytes) 000649 1790728292.221475 read 0x010eb1 thru 0x017f83 (0x70d3 bytes) truncating to largest ever: 0x3fcc9 000652 1790728292.223191 trunc from 0x040000 to 0x03fcc8 (0x337 bytes) 000653 1790728292.248552 punch from 0x025528 to 0x030a8a (0xb563 bytes) 000654 1790728292.254050 write 0x00a0d5 thru 0x00cbe2 (0x2b0e bytes) 000655 1790728292.256014 mapread 0x00b278 thru 0x00c9f9 (0x1782 bytes) 000656 1790728292.257053 mapread 0x038b61 thru 0x03fcc8 (0x7168 bytes) 000657 1790728292.258259 write 0x031a31 thru 0x03d0bf (0xb68f bytes) 000658 1790728292.263612 mapwrite 0x03ced4 thru 0x03ffff (0x312c bytes) 000661 1790728292.437965 punch from 0x018646 to 0x01c6a8 (0x4063 bytes) 000662 1790728292.452385 write 0x01f2e5 thru 0x02745b (0x8177 bytes) 000663 1790728292.487791 trunc from 0x040000 to 0x01e151 (0x21eae bytes) 000665 1790728292.543610 mapwrite 0x003d8e thru 0x00f916 (0xbb89 bytes) 000666 1790728292.770678 MIRROR_RESYNC 5 mirrors 000667 1790728295.087189 mapread 0x01a9bf thru 0x01d508 (0x2b4a bytes) 000668 1790728295.167762 MIRROR_RESYNC 5 mirrors 000669 1790728296.137160 write 0x008bb4 thru 0x00ca72 (0x3ebf bytes) 000670 1790728296.352186 mapread 0x0064a6 thru 0x013469 (0xcfc4 bytes) 000671 1790728296.414021 mapwrite 0x003632 thru 0x005a16 (0x23e5 bytes) 000672 1790728296.529726 trunc from 0x01e152 to 0x02f09e (0x10f4d bytes) 000673 1790728296.620911 write 0x02a3be thru 0x02ef89 (0x4bcc bytes) 000674 1790728296.652013 punch from 0x00f80d to 0x01c442 (0xcc36 bytes) 000675 1790728296.683044 mapwrite 0x01ce25 thru 0x01f1b6 (0x2392 bytes) 000676 1790728296.855113 mapread 0x01ebbc thru 0x0256c1 (0x6b06 bytes) 000677 1790728296.881258 mapread 0x0291a3 thru 0x02f09e (0x5efc bytes) 000681 1790728296.899402 read 0x014f4d thru 0x016c18 (0x1ccc bytes) 000683 1790728296.908500 read 0x022b21 thru 0x026a86 (0x3f66 bytes) 000684 1790728296.910649 read 0x003ba4 thru 0x0055ab (0x1a08 bytes) 000686 1790728296.912447 read 0x0222c2 thru 0x028058 (0x5d97 bytes) 000687 1790728296.918525 punch from 0x019168 to 0x01eeba (0x5d53 bytes) 000688 1790728296.933826 MIRROR_RESYNC 5 mirrors 000689 1790728298.448504 punch from 0x00809d to 0x00dbc8 (0x5b2c bytes) 000690 1790728298.537870 mapwrite 0x01b9df thru 0x024d4d (0x936f bytes) 000691 1790728298.652442 mapwrite 0x03d274 thru 0x03ffff (0x2d8c bytes) 000692 1790728298.779668 read 0x02219c thru 0x02980c (0x7671 bytes) 000693 1790728298.791434 MIRROR_RESYNC 5 mirrors 000694 1790728300.143759 MIRROR_RESYNC 5 mirrors 000696 1790728300.927514 mapread 0x03e055 thru 0x03ffff (0x1fab bytes) 000697 1790728300.941795 read 0x026340 thru 0x028dd8 (0x2a99 bytes) 000699 1790728300.949195 read 0x011809 thru 0x013cc6 (0x24be bytes) 000700 1790728300.985234 mapwrite 0x02c84d thru 0x02f8dd (0x3091 bytes) 000701 1790728301.305540 trunc from 0x040000 to 0x027024 (0x18fdb bytes) 000702 1790728301.362984 mapread 0x019a0b thru 0x0225d9 (0x8bcf bytes) 000703 1790728301.518633 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x27025): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27025): Mirror 10: 0x768ca622 (stale) Mirror 11: 0x768ca622 (stale) Mirror 12: 0x768ca622 (stale) Mirror 13: 0x768ca622 (stale) CRC-32 checksum value for chunk [0, 0x27025): Mirror 1: 0x768ca622 Mirror 14: 0x768ca622 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27025: skipped 000704 1790728302.810578 mapread 0x014ab4 thru 0x0225a9 (0xdaf6 bytes) 000705 1790728302.857155 punch from 0x00c5f3 to 0x01005f (0x3a6d bytes) 000706 1790728302.932747 read 0x01c1e4 thru 0x01caf6 (0x913 bytes) 000707 1790728302.938514 trunc from 0x027025 to 0x031aea (0xaac6 bytes) 000708 1790728302.987190 mapwrite 0x0014bf thru 0x00ee19 (0xd95b bytes) 000711 1790728303.131738 mapread 0x024a6e thru 0x02e459 (0x99ec bytes) 000712 1790728303.181960 mapread 0x0065ab thru 0x009e7a (0x38d0 bytes) 000713 1790728303.182962 read 0x028b06 thru 0x02ff21 (0x741c bytes) 000714 1790728303.187200 trunc from 0x031aeb to 0x03f3e8 (0xd8fe bytes) 000715 1790728303.220358 read 0x031890 thru 0x033ef8 (0x2669 bytes) 000716 1790728303.247535 write 0x022aab thru 0x02fa3f (0xcf95 bytes) truncating to largest ever: 0x3fdfe 000717 1790728303.261488 trunc from 0x03f3e9 to 0x03fdfd (0xa15 bytes) 000718 1790728303.305462 punch from 0x009374 to 0x01670d (0xd39a bytes) 000720 1790728303.324267 punch from 0x0393dc to 0x03fdfd (0x6a22 bytes) 000722 1790728303.331147 read 0x015592 thru 0x019d1b (0x478a bytes) 000723 1790728303.344816 mapwrite 0x03f197 thru 0x03ffff (0xe69 bytes) 000724 1790728303.476011 trunc from 0x040000 to 0x014b08 (0x2b4f7 bytes) 000725 1790728303.512504 write 0x03855d thru 0x03ad19 (0x27bd bytes) 000726 1790728303.516805 write 0x00ca70 thru 0x011e65 (0x53f6 bytes) 000727 1790728303.525184 write 0x039240 thru 0x03cbe8 (0x39a9 bytes) 000728 1790728303.531570 punch from 0x03c4ae to 0x03cbe8 (0x73b bytes) 000729 1790728303.565524 mapread 0x01bab1 thru 0x0263c6 (0xa916 bytes) 000730 1790728303.678374 write 0x01fa37 thru 0x022ea8 (0x3472 bytes) 000731 1790728303.685538 MIRROR_RESYNC 6 mirrors 000733 1790728304.970381 trunc from 0x03cbe9 to 0x00d5c2 (0x2f626 bytes) 000734 1790728305.031600 write 0x0216d5 thru 0x02276f (0x109b bytes) 000736 1790728305.035439 mapread 0x00dba5 thru 0x01c2de (0xe73a bytes) 000737 1790728305.060839 write 0x00e63d thru 0x01c2ef (0xdcb3 bytes) 000738 1790728305.063276 write 0x02e698 thru 0x03bc8e (0xd5f7 bytes) 000739 1790728305.065466 mapread 0x01f027 thru 0x02bfd9 (0xcfb3 bytes) 000740 1790728305.074340 trunc from 0x03bc8f to 0x01536e (0x26920 bytes) 000744 1790728305.098357 mapwrite 0x03d51b thru 0x03ffff (0x2ae5 bytes) 000745 1790728305.183654 mapread 0x0099f7 thru 0x018417 (0xea21 bytes) 000746 1790728305.193347 trunc from 0x040000 to 0x02f042 (0x10fbd bytes) 000747 1790728305.221612 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f043): Mirror 10: 0x586ef6df (stale) Mirror 11: 0x586ef6df (stale) Mirror 12: 0x586ef6df (stale) Mirror 13: 0x586ef6df (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f043): Mirror 10: 0x586ef6df (stale) Mirror 11: 0x586ef6df (stale) Mirror 12: 0x586ef6df (stale) Mirror 13: 0x586ef6df (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f043: skipped 000748 1790728305.616605 write 0x032fc0 thru 0x03495a (0x199b bytes) 000749 1790728305.619548 trunc from 0x03495b to 0x0288ae (0xc0ac bytes) 000750 1790728305.636211 punch from 0x018653 to 0x01a38e (0x1d3c bytes) 000751 1790728305.643768 mapwrite 0x00028c thru 0x0005e3 (0x358 bytes) 000752 1790728305.785807 read 0x01967b thru 0x02030f (0x6c95 bytes) 000753 1790728305.817531 mapread 0x02616d thru 0x0288ae (0x2742 bytes) 000754 1790728305.872567 mapread 0x022d25 thru 0x0288ae (0x5b8a bytes) 000755 1790728305.873543 read 0x019725 thru 0x026ff2 (0xd8ce bytes) 000757 1790728305.883319 MIRROR_RESYNC 5 mirrors 000758 1790728307.503964 write 0x022a76 thru 0x0258bb (0x2e46 bytes) 000759 1790728307.673025 MIRROR_RESYNC 5 mirrors 000760 1790728309.078938 trunc from 0x0288af to 0x01abcd (0xdce1 bytes) 000762 1790728309.162249 trunc from 0x01abce to 0x00aaec (0x100e1 bytes) 000763 1790728309.188444 mapwrite 0x02dfab thru 0x03dabf (0xfb15 bytes) 000764 1790728309.297048 punch from 0x008f56 to 0x00ff50 (0x6ffb bytes) 000765 1790728309.303250 write 0x01b919 thru 0x029e51 (0xe539 bytes) 000766 1790728309.310939 write 0x015bcd thru 0x024460 (0xe894 bytes) 000767 1790728309.317960 punch from 0x025fd5 to 0x02d70f (0x773b bytes) 000769 1790728309.333193 punch from 0x028339 to 0x031006 (0x8cce bytes) 000773 1790728309.348938 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dac0): Mirror 10: 0xfe0fd067 (stale) Mirror 11: 0xfe0fd067 (stale) Mirror 12: 0xfe0fd067 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dac0): Mirror 10: 0xfe0fd067 (stale) Mirror 11: 0xfe0fd067 (stale) Mirror 12: 0xfe0fd067 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dac0: skipped 000774 1790728309.912905 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dac0): Mirror 10: 0xfe0fd067 (stale) Mirror 12: 0xfe0fd067 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dac0): Mirror 10: 0xfe0fd067 (stale) Mirror 12: 0xfe0fd067 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dac0: skipped 000775 1790728310.218247 punch from 0x0311ea to 0x03c15c (0xaf73 bytes) 000776 1790728310.223630 trunc from 0x03dac0 to 0x01f8b6 (0x1e209 bytes) 000778 1790728310.249395 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1f8b7): Mirror 10: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f8b7): Mirror 10: 0xa0064bdf (stale) Mirror 12: 0xa0064bdf (stale) CRC-32 checksum value for chunk [0, 0x1f8b7): Mirror 1: 0x98390d3d Mirror 13: 0x98390d3d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f8b7: skipped 000780 1790728311.533112 trunc from 0x01f8b7 to 0x00fc73 (0xfc43 bytes) 000782 1790728311.664938 trunc from 0x00fc74 to 0x0295cc (0x19959 bytes) 000786 1790728311.701581 write 0x03f99e thru 0x03ffff (0x662 bytes) 000787 1790728311.703411 read 0x00b4b8 thru 0x012842 (0x738b bytes) 000788 1790728311.715358 read 0x005eb6 thru 0x00f7ae (0x98f9 bytes) 000789 1790728311.726388 read 0x02800b thru 0x037fa9 (0xff9f bytes) 000790 1790728311.727278 mapwrite 0x012f5e thru 0x01ea6d (0xbb10 bytes) 000791 1790728311.794990 punch from 0x024313 to 0x02fa98 (0xb786 bytes) 000793 1790728311.807319 punch from 0x01d0e6 to 0x021f46 (0x4e61 bytes) 000795 1790728311.829132 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x943814e (stale) Mirror 12: 0x943814e (stale) Mirror 13: 0xadc1e448 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5f0df357 Mirror 14: 0x5f0df357 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000797 1790728313.202405 mapread 0x036923 thru 0x03ffff (0x96dd bytes) 000800 1790728313.303747 MIRROR_RESYNC 5 mirrors 000802 1790728315.276342 write 0x01325c thru 0x0156ee (0x2493 bytes) 000803 1790728315.355536 write 0x005227 thru 0x009585 (0x435f bytes) 000804 1790728315.367890 mapread 0x00034a thru 0x004a94 (0x474b bytes) 000807 1790728315.397148 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x5f0df357 (stale) Mirror 13: 0x5f0df357 (stale) Mirror 14: 0x5f0df357 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x5f0df357 (stale) Mirror 13: 0x5f0df357 (stale) Mirror 14: 0x5f0df357 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000808 1790728315.874476 mapread 0x01fbc0 thru 0x02c0b6 (0xc4f7 bytes) 000809 1790728315.920530 punch from 0x03ef79 to 0x03ffff (0x1087 bytes) 000810 1790728315.926267 mapread 0x0011a5 thru 0x005d61 (0x4bbd bytes) 000813 1790728315.944028 punch from 0x038cd3 to 0x03d3e6 (0x4714 bytes) 000815 1790728315.960038 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x5f0df357 (stale) Mirror 13: 0x5f0df357 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x5f0df357 (stale) Mirror 13: 0x5f0df357 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000817 1790728316.378957 write 0x02353a thru 0x02b5fb (0x80c2 bytes) 000818 1790728316.397382 trunc from 0x040000 to 0x01cd86 (0x23279 bytes) 000820 1790728316.446324 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1cd87): Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1cd87): Mirror 12: 0xc44c1c61 (stale) Mirror 13: 0xc44c1c61 (stale) CRC-32 checksum value for chunk [0, 0x1cd87): Mirror 1: 0x6e5cc660 Mirror 14: 0x6e5cc660 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1cd87: skipped 000821 1790728317.511791 write 0x00a79c thru 0x019a46 (0xf2ab bytes) 000822 1790728317.614544 punch from 0x019048 to 0x01cd86 (0x3d3f bytes) 000823 1790728317.625741 trunc from 0x01cd87 to 0x028174 (0xb3ee bytes) 000824 1790728317.643315 mapread 0x00f0d7 thru 0x011a44 (0x296e bytes) 000825 1790728317.648434 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x28175): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28175): Mirror 12: 0x9a16abec (stale) Mirror 13: 0x9a16abec (stale) Mirror 14: 0x9c021c7d (stale) CRC-32 checksum value for chunk [0, 0x28175): Mirror 1: 0x95d00627 Mirror 15: 0x95d00627 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28175: skipped 000827 1790728319.139640 mapread 0x009ea5 thru 0x00dae0 (0x3c3c bytes) 000828 1790728319.179375 punch from 0x022931 to 0x028174 (0x5844 bytes) 000829 1790728319.293322 read 0x01e6ac thru 0x0212da (0x2c2f bytes) 000831 1790728319.305712 read 0x000524 thru 0x005d64 (0x5841 bytes) 000832 1790728319.316622 read 0x015911 thru 0x025873 (0xff63 bytes) 000835 1790728319.320260 punch from 0x02300b to 0x02472f (0x1725 bytes) 000836 1790728319.326390 punch from 0x01c211 to 0x028174 (0xbf64 bytes) 000837 1790728319.331452 mapwrite 0x00e7a7 thru 0x0186be (0x9f18 bytes) 000840 1790728319.446362 write 0x0028ad thru 0x0051a4 (0x28f8 bytes) 000841 1790728319.448300 write 0x01fdff thru 0x02980f (0x9a11 bytes) 000842 1790728319.468498 trunc from 0x029810 to 0x01998d (0xfe82 bytes) 000844 1790728319.515654 mapread 0x000332 thru 0x00d08a (0xcd59 bytes) 000845 1790728319.516822 mapwrite 0x0120a4 thru 0x017e59 (0x5db6 bytes) 000846 1790728319.609460 read 0x004308 thru 0x00cef9 (0x8bf2 bytes) 000847 1790728319.620126 MIRROR_RESYNC 5 mirrors 000848 1790728321.085582 mapread 0x011600 thru 0x011814 (0x215 bytes) 000849 1790728321.091445 mapwrite 0x0362e5 thru 0x038144 (0x1e60 bytes) 000850 1790728321.291207 read 0x00e457 thru 0x01a88c (0xc436 bytes) 000851 1790728321.305701 mapread 0x0108ae thru 0x0179e6 (0x7139 bytes) 000853 1790728321.309289 trunc from 0x038145 to 0x03b44a (0x3306 bytes) 000854 1790728321.337193 read 0x000993 thru 0x0066f1 (0x5d5f bytes) 000855 1790728321.361520 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b44b): Mirror 12: 0xb8a419e9 (stale) Mirror 13: 0xb8a419e9 (stale) Mirror 14: 0xb8a419e9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b44b): Mirror 12: 0xb8a419e9 (stale) Mirror 13: 0xb8a419e9 (stale) Mirror 14: 0xb8a419e9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b44b: skipped 000857 1790728321.958754 read 0x0217b5 thru 0x02bdaa (0xa5f6 bytes) 000858 1790728321.982525 mapread 0x00a53f thru 0x00f94f (0x5411 bytes) 000859 1790728322.007918 mapwrite 0x02ad23 thru 0x031fe8 (0x72c6 bytes) 000860 1790728322.169562 mapwrite 0x0302d9 thru 0x03d694 (0xd3bc bytes) 000861 1790728322.322895 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3d695): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d695): Mirror 12: 0x57501379 (stale) Mirror 13: 0x57501379 (stale) Mirror 14: 0x57501379 (stale) CRC-32 checksum value for chunk [0, 0x3d695): Mirror 1: 0xebeb31e8 Mirror 15: 0xebeb31e8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d695: skipped 000862 1790728323.636992 trunc from 0x03d695 to 0x03e461 (0xdcd bytes) 000863 1790728323.861818 mapread 0x031c2e thru 0x03611a (0x44ed bytes) 000865 1790728323.892999 read 0x01f31a thru 0x023ca9 (0x4990 bytes) 000866 1790728323.906331 mapread 0x00994e thru 0x011c05 (0x82b8 bytes) 000870 1790728323.947149 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3e462): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e462): Mirror 12: 0x4ab1f415 (stale) Mirror 13: 0x4ab1f415 (stale) Mirror 14: 0x4ab1f415 (stale) Mirror 15: 0xd2d3d758 (stale) CRC-32 checksum value for chunk [0, 0x3e462): Mirror 1: 0xd2d3d758 Mirror 16: 0xd2d3d758 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e462: skipped 000871 1790728325.260342 punch from 0x01c0a3 to 0x02a2ce (0xe22c bytes) 000872 1790728325.410675 mapwrite 0x021b42 thru 0x02c641 (0xab00 bytes) 000875 1790728325.556943 read 0x026869 thru 0x0292c7 (0x2a5f bytes) 000876 1790728325.572827 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e462): Mirror 13: 0x4ab1f415 (stale) Mirror 14: 0x4ab1f415 (stale) Mirror 15: 0xd2d3d758 (stale) Mirror 16: 0xd2d3d758 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e462): Mirror 13: 0x4ab1f415 (stale) Mirror 14: 0x4ab1f415 (stale) Mirror 15: 0xd2d3d758 (stale) Mirror 16: 0xd2d3d758 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e462: skipped 000877 1790728326.000494 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3e462): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e462): Mirror 13: 0x4ab1f415 (stale) Mirror 14: 0x4ab1f415 (stale) Mirror 15: 0xd2d3d758 (stale) Mirror 16: 0xd2d3d758 (stale) CRC-32 checksum value for chunk [0, 0x3e462): Mirror 1: 0xddc8583b Mirror 17: 0xddc8583b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e462: skipped 000878 1790728327.198545 punch from 0x007029 to 0x011cd9 (0xacb1 bytes) 000879 1790728327.306865 read 0x0003b5 thru 0x00279e (0x23ea bytes) 000881 1790728327.313878 trunc from 0x03e462 to 0x005858 (0x38c09 bytes) 000882 1790728327.336965 write 0x009077 thru 0x01562e (0xc5b8 bytes) 000885 1790728327.341442 mapwrite 0x014c55 thru 0x01cb6c (0x7f18 bytes) 000886 1790728327.456996 mapwrite 0x0288a0 thru 0x0322f4 (0x9a55 bytes) 000887 1790728327.574493 trunc from 0x0322f5 to 0x008b96 (0x2975e bytes) 000890 1790728327.598293 write 0x0126b7 thru 0x01fe11 (0xd75b bytes) 000891 1790728327.600885 mapwrite 0x01555a thru 0x017556 (0x1ffd bytes) 000892 1790728327.702504 punch from 0x003a17 to 0x003c68 (0x252 bytes) 000895 1790728327.712242 mapread 0x00d95d thru 0x017cf0 (0xa394 bytes) 000896 1790728327.729251 mapread 0x00cca0 thru 0x01c29c (0xf5fd bytes) 000898 1790728327.731363 trunc from 0x01fe12 to 0x012c07 (0xd20a bytes) 000899 1790728327.753532 punch from 0x008e3a to 0x012c07 (0x9dce bytes) 000900 1790728327.760252 trunc from 0x012c08 to 0x030df9 (0x1e1f2 bytes) 000901 1790728327.781004 punch from 0x02aea5 to 0x030df9 (0x5f55 bytes) 000902 1790728327.787709 trunc from 0x030dfa to 0x03b93e (0xab45 bytes) 000903 1790728327.803389 read 0x02cc51 thru 0x0357cc (0x8b7c bytes) 000904 1790728327.837072 write 0x00c9f9 thru 0x013426 (0x6a2e bytes) 000906 1790728327.839341 punch from 0x00a738 to 0x019acf (0xf398 bytes) 000907 1790728327.853198 write 0x00b69e thru 0x01af03 (0xf866 bytes) 000908 1790728327.859749 write 0x0102b5 thru 0x014e7a (0x4bc6 bytes) 000909 1790728327.861751 punch from 0x01d897 to 0x02334f (0x5ab9 bytes) 000910 1790728327.885466 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3b93f): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b93f): Mirror 13: 0x5ec129e0 (stale) Mirror 14: 0x5ec129e0 (stale) Mirror 15: 0x5322cf54 (stale) Mirror 16: 0x5322cf54 (stale) Mirror 17: 0x3d6f6600 (stale) CRC-32 checksum value for chunk [0, 0x3b93f): Mirror 1: 0x6b393a9f Mirror 18: 0x6b393a9f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b93f: skipped 000912 1790728329.442544 mapread 0x00f8e9 thru 0x018466 (0x8b7e bytes) 000914 1790728329.532636 write 0x036102 thru 0x03ffff (0x9efe bytes) 000916 1790728329.747810 read 0x01cf9b thru 0x0202b6 (0x331c bytes) 000917 1790728329.759140 trunc from 0x040000 to 0x0194b4 (0x26b4b bytes) 000918 1790728329.807422 read 0x00d0a1 thru 0x012332 (0x5292 bytes) 000923 1790728329.839323 punch from 0x002270 to 0x004963 (0x26f4 bytes) 000925 1790728329.846511 trunc from 0x0194b5 to 0x027c36 (0xe782 bytes) 000926 1790728329.860827 mapwrite 0x030e92 thru 0x03542b (0x459a bytes) 000927 1790728329.956405 write 0x002be3 thru 0x00381a (0xc38 bytes) 000930 1790728329.969916 mapwrite 0x00db58 thru 0x011391 (0x383a bytes) 000932 1790728330.062832 trunc from 0x03542c to 0x01f79a (0x15c91 bytes) 000934 1790728330.092690 punch from 0x01ca42 to 0x01f79a (0x2d59 bytes) 000935 1790728330.101120 trunc from 0x01f79b to 0x027caf (0x8515 bytes) 000936 1790728330.141908 mapwrite 0x03951a thru 0x03a775 (0x125c bytes) 000937 1790728330.255240 trunc from 0x03a776 to 0x02a21c (0x10559 bytes) 000938 1790728330.278064 trunc from 0x02a21d to 0x038e87 (0xec6b bytes) 000940 1790728330.299964 mapread 0x0330d4 thru 0x038e87 (0x5db4 bytes) 000941 1790728330.374573 punch from 0x00e69e to 0x01a74e (0xc0b1 bytes) 000942 1790728330.409557 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38e88): Mirror 13: 0xdd3de7eb (stale) Mirror 14: 0xdd3de7eb (stale) Mirror 15: 0x25676218 (stale) Mirror 16: 0x25676218 (stale) Mirror 18: 0x24389be6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38e88): Mirror 13: 0xdd3de7eb (stale) Mirror 14: 0xdd3de7eb (stale) Mirror 15: 0x25676218 (stale) Mirror 16: 0x25676218 (stale) Mirror 18: 0x24389be6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38e88: skipped 000944 1790728331.018004 mapread 0x02a487 thru 0x030df4 (0x696e bytes) 000945 1790728331.059666 MIRROR_RESYNC 6 mirrors 000948 1790728333.098827 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) 000949 1790728333.587182 mapwrite 0x00d19e thru 0x01c038 (0xee9b bytes) 000950 1790728333.835378 read 0x006a24 thru 0x0120f3 (0xb6d0 bytes) 000951 1790728333.851573 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x38e88): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38e88): Mirror 13: 0xb5c4e30a (stale) Mirror 14: 0xb5c4e30a (stale) Mirror 16: 0xb5c4e30a (stale) Mirror 18: 0xb5c4e30a (stale) CRC-32 checksum value for chunk [0, 0x38e88): Mirror 1: 0xd6249ac6 Mirror 19: 0xd6249ac6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38e88: skipped 000952 1790728335.098360 read 0x0360f3 thru 0x037f49 (0x1e57 bytes) 000953 1790728335.113612 trunc from 0x038e88 to 0x01f38f (0x19af8 bytes) 000955 1790728335.260629 read 0x010d8d thru 0x01875d (0x79d1 bytes) 000956 1790728335.284822 punch from 0x00dc3e to 0x0100f7 (0x24ba bytes) 000958 1790728335.293500 read 0x017bbc thru 0x01f38f (0x77d4 bytes) 000959 1790728335.294940 punch from 0x017cbf to 0x018644 (0x986 bytes) 000960 1790728335.307608 punch from 0x00780d to 0x007aed (0x2e1 bytes) 000961 1790728335.316430 read 0x011094 thru 0x018589 (0x74f6 bytes) 000963 1790728335.341909 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1f390): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f390): Mirror 13: 0x439c11cf (stale) Mirror 14: 0x439c11cf (stale) Mirror 16: 0x439c11cf (stale) Mirror 18: 0x439c11cf (stale) Mirror 19: 0xede646fa (stale) CRC-32 checksum value for chunk [0, 0x1f390): Mirror 1: 0xbf1f769a Mirror 20: 0xbf1f769a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f390: skipped 000964 1790728336.729999 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x21e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f390): Mirror 13: 0x439c11cf (stale) Mirror 14: 0x439c11cf (stale) Mirror 18: 0x439c11cf (stale) Mirror 19: 0xede646fa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f390): Mirror 13: 0x439c11cf (stale) Mirror 14: 0x439c11cf (stale) Mirror 18: 0x439c11cf (stale) Mirror 19: 0xede646fa (stale) CRC-32 checksum value for chunk [0, 0x1f390): Mirror 1: 0xbf1f769a Mirror 20: 0xbf1f769a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f390: skipped 000965 1790728337.982953 read 0x01a94e thru 0x01c445 (0x1af8 bytes) 000966 1790728338.008164 mapread 0x00b6c3 thru 0x00bc97 (0x5d5 bytes) 000967 1790728338.045891 write 0x02a266 thru 0x037c38 (0xd9d3 bytes) 000968 1790728338.170896 mapwrite 0x017e30 thru 0x01a168 (0x2339 bytes) 000969 1790728338.249182 write 0x03572d thru 0x03e497 (0x8d6b bytes) 000974 1790728338.252649 punch from 0x005f77 to 0x00d7c3 (0x784d bytes) 000975 1790728338.293297 mapwrite 0x01c15f thru 0x01dadc (0x197e bytes) 000977 1790728338.384806 MIRROR_RESYNC 6 mirrors 000978 1790728340.255061 read 0x038e84 thru 0x0397f9 (0x976 bytes) 000979 1790728340.262589 trunc from 0x03e498 to 0x00ec16 (0x2f881 bytes) 000983 1790728340.422834 trunc from 0x00ec17 to 0x031af5 (0x22edf bytes) 000984 1790728340.491584 punch from 0x004caa to 0x00dbec (0x8f43 bytes) 000985 1790728340.504502 punch from 0x021768 to 0x02c1d2 (0xaa6b bytes) 000986 1790728340.514876 mapread 0x0168c7 thru 0x0264aa (0xfbe4 bytes) 000990 1790728340.549864 write 0x0200d4 thru 0x026781 (0x66ae bytes) 000991 1790728340.552460 trunc from 0x031af6 to 0x0146e0 (0x1d415 bytes) 000992 1790728340.578616 mapread 0x012c7f thru 0x0138b6 (0xc38 bytes) 000993 1790728340.579822 write 0x012150 thru 0x01873c (0x65ed bytes) 000994 1790728340.582974 mapread 0x0068d2 thru 0x011762 (0xae91 bytes) 000995 1790728340.612598 punch from 0x00278d to 0x011446 (0xecba bytes) 000998 1790728340.644033 mapread 0x00e00b thru 0x012008 (0x3ffe bytes) 001000 1790728340.655031 mapwrite 0x003b7d thru 0x0058a3 (0x1d27 bytes) All operations completed A-OK!