== sanity-flr test 70a: flr mode fsx test ================ 02:24:12 (1787379852) Seed set to 9854 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000002 1787379854.952933 MIRROR_EXTEND to 2 mirrors skipping zero size read truncating to largest ever: 0x3dc6c 000007 1787379855.443311 trunc from 00000000 to 0x03dc6b (0x3dc6c bytes) 000009 1787379855.519197 mapwrite 0x03749f thru 0x03ffff (0x8b61 bytes) 000010 1787379855.629153 mapread 0x00fb98 thru 0x01c3f6 (0xc85f bytes) 000012 1787379855.668930 write 0x00eb5a thru 0x01521d (0x66c4 bytes) 000015 1787379855.678045 read 0x01dd07 thru 0x02c329 (0xe623 bytes) 000018 1787379855.696823 write 0x001bdd thru 0x0081c6 (0x65ea bytes) 000019 1787379855.708289 trunc from 0x040000 to 0x03bcc2 (0x433d bytes) 000020 1787379855.739747 mapread 0x027003 thru 0x03060a (0x9608 bytes) 000022 1787379855.754262 mapwrite 0x007c37 thru 0x00bfb5 (0x437f bytes) 000023 1787379855.808316 read 0x024c57 thru 0x026be8 (0x1f92 bytes) 000024 1787379855.809524 write 0x00822a thru 0x01573b (0xd512 bytes) 000027 1787379855.812908 mapread 0x0149c0 thru 0x023751 (0xed92 bytes) 000028 1787379855.815191 write 0x023b0d thru 0x028a54 (0x4f48 bytes) 000029 1787379855.816895 read 0x00b5bf thru 0x00fc17 (0x4659 bytes) 000031 1787379855.818787 mapread 0x02c247 thru 0x036d2e (0xaae8 bytes) 000033 1787379855.821947 write 0x025873 thru 0x029fa4 (0x4732 bytes) 000035 1787379855.824866 write 0x02b641 thru 0x02d766 (0x2126 bytes) 000037 1787379855.827292 read 0x00b28d thru 0x0154d9 (0xa24d bytes) 000040 1787379855.834061 MIRROR_RESYNC 2 mirrors 000041 1787379856.721685 trunc from 0x03bcc3 to 0x00ed17 (0x2cfab bytes) 000045 1787379856.790487 write 0x036e78 thru 0x03998d (0x2b16 bytes) 000046 1787379856.793233 mapwrite 0x02f73c thru 0x0376ae (0x7f73 bytes) 000047 1787379856.856029 mapread 0x031e27 thru 0x033898 (0x1a72 bytes) truncating to largest ever: 0x3ddc3 000051 1787379856.865130 trunc from 0x03998e to 0x03ddc2 (0x4435 bytes) 000052 1787379856.903046 trunc from 0x03ddc3 to 0x0331c7 (0xabfb bytes) 000054 1787379856.940330 mapwrite 0x02d409 thru 0x035a0a (0x8602 bytes) 000056 1787379857.022564 read 0x03404c thru 0x035a0a (0x19bf bytes) 000057 1787379857.023333 trunc from 0x035a0b to 0x008edc (0x2cb2e bytes) 000058 1787379857.039325 read 0x0056ab thru 0x008edc (0x3832 bytes) 000059 1787379857.049604 mapread 0x0031d5 thru 0x008edc (0x5d08 bytes) 000060 1787379857.051918 mapread 0x00687c thru 0x008edc (0x2661 bytes) 000061 1787379857.053675 trunc from 0x008edd to 0x036611 (0x2d735 bytes) 000063 1787379857.069222 read 0x019592 thru 0x01d055 (0x3ac4 bytes) 000064 1787379857.084229 mapwrite 0x00a219 thru 0x0166ed (0xc4d5 bytes) 000065 1787379857.207606 mapwrite 0x00ca88 thru 0x01c4e1 (0xfa5a bytes) 000066 1787379857.324818 write 0x000160 thru 0x000fb0 (0xe51 bytes) 000069 1787379857.333181 trunc from 0x036612 to 0x02818d (0xe484 bytes) 000072 1787379857.371853 write 0x03d7fb thru 0x03ffff (0x2805 bytes) 000074 1787379857.375758 mapread 0x00e23d thru 0x01a163 (0xbf27 bytes) 000075 1787379857.378963 trunc from 0x040000 to 0x024534 (0x1bacb bytes) 000076 1787379857.410233 mapwrite 0x02f854 thru 0x032ef2 (0x369f bytes) 000078 1787379857.502921 mapread 0x002a5f thru 0x00c2b2 (0x9854 bytes) 000080 1787379857.506626 read 0x00a185 thru 0x016712 (0xc58e bytes) 000082 1787379857.512873 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) 000084 1787379857.675862 write 0x013439 thru 0x0182ae (0x4e76 bytes) 000087 1787379857.694072 mapread 0x0156c3 thru 0x0170aa (0x19e8 bytes) 000088 1787379857.713488 MIRROR_EXTEND to 2 mirrors 000089 1787379858.402456 mapread 0x02be82 thru 0x032ef2 (0x7071 bytes) 000090 1787379858.435237 mapread 0x02937d thru 0x02f273 (0x5ef7 bytes) 000091 1787379858.437145 write 0x008312 thru 0x008aa2 (0x791 bytes) 000092 1787379858.524990 write 0x03f8d0 thru 0x03ffff (0x730 bytes) 000093 1787379858.526257 mapwrite 0x010af1 thru 0x018c1e (0x812e bytes) 000094 1787379858.582567 write 0x0156ef thru 0x01ec39 (0x954b bytes) 000097 1787379858.589909 mapwrite 0x002bce thru 0x00e81e (0xbc51 bytes) 000099 1787379858.682560 write 0x015ad9 thru 0x01f9bb (0x9ee3 bytes) 000101 1787379858.697216 mapwrite 0x01c4ff thru 0x027c8f (0xb791 bytes) 000102 1787379858.798490 read 0x00ce09 thru 0x01956d (0xc765 bytes) 000103 1787379858.806433 MIRROR_RESYNC 2 mirrors 000104 1787379859.663333 mapwrite 0x00da55 thru 0x012b5a (0x5106 bytes) 000105 1787379859.842394 mapread 0x00e8d1 thru 0x01bde5 (0xd515 bytes) 000106 1787379859.856121 mapwrite 0x010695 thru 0x016b8e (0x64fa bytes) 000108 1787379859.917897 MIRROR_RESYNC 2 mirrors 000110 1787379860.554059 mapread 0x0351a4 thru 0x03bffc (0x6e59 bytes) 000111 1787379860.585386 read 0x007e31 thru 0x0112af (0x947f bytes) 000113 1787379860.601844 read 0x022503 thru 0x02258c (0x8a bytes) 000116 1787379860.627619 mapread 0x039057 thru 0x03ffff (0x6fa9 bytes) 000119 1787379860.629918 trunc from 0x040000 to 0x036cea (0x9315 bytes) 000120 1787379860.774303 MIRROR_RESYNC 2 mirrors 000121 1787379861.613710 read 0x0135fe thru 0x0160b2 (0x2ab5 bytes) 000123 1787379861.628105 MIRROR_RESYNC 2 mirrors 000124 1787379862.000115 read 0x009bc8 thru 0x00b48c (0x18c5 bytes) 000125 1787379862.005814 write 0x027bcf thru 0x03506b (0xd49d bytes) 000127 1787379862.091501 mapwrite 0x03f99f thru 0x03ffff (0x661 bytes) 000128 1787379862.281433 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x8bdd7e8c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb044cc03 Mirror 3: 0xb044cc03 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000133 1787379863.143690 MIRROR_RESYNC 3 mirrors 000134 1787379864.035047 MIRROR_RESYNC 3 mirrors 000135 1787379864.484307 read 0x0077f2 thru 0x00dd6a (0x6579 bytes) 000136 1787379864.492846 trunc from 0x040000 to 0x023e49 (0x1c1b6 bytes) 000138 1787379864.597823 trunc from 0x023e4a to 0x02c8fd (0x8ab4 bytes) 000139 1787379864.640420 read 0x02b31c thru 0x02c8fd (0x15e2 bytes) 000140 1787379864.655235 mapread 0x01bbf3 thru 0x0213a2 (0x57b0 bytes) 000141 1787379864.664251 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c8fe): Mirror 2: 0xeec36d21 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c8fe): Mirror 2: 0xeec36d21 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c8fe: skipped 000142 1787379865.111929 mapread 0x007637 thru 0x012fc4 (0xb98e bytes) 000144 1787379865.157520 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) 000145 1787379865.407744 read 0x00d587 thru 0x01564e (0x80c8 bytes) 000147 1787379865.420538 trunc from 0x02c8fe to 0x002388 (0x2a575 bytes) 000148 1787379865.465671 read 0x0008cc thru 0x002388 (0x1abd bytes) 000149 1787379865.474688 mapwrite 0x028ab3 thru 0x03111c (0x866a bytes) 000151 1787379865.558370 trunc from 0x03111d to 0x034f74 (0x3e58 bytes) 000155 1787379865.581761 read 0x032f1c thru 0x034f74 (0x2059 bytes) 000157 1787379865.587800 trunc from 0x034f75 to 0x0103c8 (0x24bac bytes) 000159 1787379865.621342 trunc from 0x0103c9 to 0x0017f3 (0xebd5 bytes) 000160 1787379865.640792 write 0x009756 thru 0x012555 (0x8e00 bytes) 000161 1787379865.643756 mapread 0x00cb9f thru 0x00f6dd (0x2b3f bytes) 000163 1787379865.646600 trunc from 0x012556 to 0x011937 (0xc1e bytes) 000164 1787379865.678071 read 0x006610 thru 0x00a0ef (0x3ae0 bytes) 000165 1787379865.696762 write 0x00ab10 thru 0x00e762 (0x3c53 bytes) 000169 1787379865.706940 read 0x00338c thru 0x00bac9 (0x873e bytes) 000170 1787379865.707622 read 0x007945 thru 0x011937 (0x9ff3 bytes) 000173 1787379865.719676 read 0x005568 thru 0x00971d (0x41b6 bytes) 000176 1787379865.726078 read 0x00f533 thru 0x011937 (0x2405 bytes) 000177 1787379865.727259 mapwrite 0x030160 thru 0x03e38b (0xe22c bytes) 000178 1787379865.842632 write 0x03497b thru 0x0377a0 (0x2e26 bytes) 000180 1787379865.846871 write 0x022ff2 thru 0x028717 (0x5726 bytes) 000181 1787379865.851074 read 0x03a998 thru 0x03e38b (0x39f4 bytes) 000185 1787379865.861824 trunc from 0x03e38c to 0x00f738 (0x2ec53 bytes) 000190 1787379865.887781 write 0x02ae77 thru 0x02ca49 (0x1bd3 bytes) 000191 1787379865.890842 write 0x012a38 thru 0x012d6e (0x337 bytes) 000192 1787379865.900760 write 0x003361 thru 0x007976 (0x4616 bytes) 000195 1787379865.913914 MIRROR_EXTEND to 2 mirrors 000198 1787379866.741114 trunc from 0x02ca4a to 0x0391f5 (0xc7ac bytes) 000200 1787379866.899092 mapread 0x008380 thru 0x017fe0 (0xfc61 bytes) 000201 1787379866.939446 mapwrite 0x02fd11 thru 0x0371eb (0x74db bytes) 000202 1787379867.067622 trunc from 0x0391f6 to 0x009712 (0x2fae3 bytes) 000203 1787379867.116068 read 0x0057a4 thru 0x009712 (0x3f6f bytes) 000204 1787379867.118743 write 0x00aa28 thru 0x00df54 (0x352d bytes) 000205 1787379867.147870 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xdf55): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xdf55): Mirror 2: 0x91d9672e (stale) CRC-32 checksum value for chunk [0, 0xdf55): Mirror 1: 0xa693efba Mirror 3: 0xa693efba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xdf55: skipped 000206 1787379868.031170 mapread 0x00276a thru 0x002893 (0x12a bytes) 000210 1787379868.060150 write 0x00b858 thru 0x011f3e (0x66e7 bytes) 000212 1787379868.158844 write 0x0211b7 thru 0x02244c (0x1296 bytes) 000213 1787379868.162056 write 0x02d354 thru 0x033ac8 (0x6775 bytes) 000214 1787379868.164561 trunc from 0x033ac9 to 0x0217f6 (0x122d2 bytes) 000215 1787379868.253782 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x217f7): Mirror 3: 0x628e51b3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x217f7): Mirror 3: 0x628e51b3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x217f7: skipped 000216 1787379868.558725 read 0x002a4e thru 0x00cd34 (0xa2e7 bytes) 000217 1787379868.576698 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) 000219 1787379868.722298 trunc from 0x0217f7 to 0x0155a1 (0xc255 bytes) 000220 1787379868.750464 write 0x02df7d thru 0x03bd9c (0xde20 bytes) 000221 1787379868.754374 mapwrite 0x03a4f7 thru 0x03b857 (0x1361 bytes) 000222 1787379868.808962 mapwrite 0x0127e1 thru 0x01a9ce (0x81ee bytes) 000227 1787379868.871198 read 0x036c54 thru 0x03bd9c (0x5149 bytes) 000229 1787379868.872857 mapwrite 0x005e7b thru 0x009bfa (0x3d80 bytes) 000233 1787379868.930024 write 0x008ba3 thru 0x00c7f6 (0x3c54 bytes) 000234 1787379868.934563 mapread 0x0252cf thru 0x02e2a7 (0x8fd9 bytes) 000235 1787379868.951957 write 0x03e744 thru 0x03ffff (0x18bc bytes) 000239 1787379868.957158 trunc from 0x040000 to 0x01e392 (0x21c6d bytes) 000240 1787379868.972717 mapread 0x017ad5 thru 0x01e392 (0x68be bytes) 000241 1787379868.980554 read 0x019a89 thru 0x01b0af (0x1627 bytes) 000242 1787379868.981520 read 0x0000f5 thru 0x0032e9 (0x31f5 bytes) 000244 1787379868.989583 read 0x00aedf thru 0x00f059 (0x417b bytes) 000251 1787379868.995602 write 0x030ec4 thru 0x0376c0 (0x67fd bytes) 000253 1787379868.998257 write 0x03b32c thru 0x03b528 (0x1fd bytes) 000258 1787379869.003549 mapwrite 0x0338a1 thru 0x0357a9 (0x1f09 bytes) 000259 1787379869.078077 read 0x032e3d thru 0x03b528 (0x86ec bytes) 000264 1787379869.123616 mapwrite 0x01609b thru 0x01cbec (0x6b52 bytes) 000266 1787379869.200744 mapwrite 0x028709 thru 0x0323c5 (0x9cbd bytes) 000267 1787379869.246242 read 0x02a10f thru 0x0381d8 (0xe0ca bytes) 000268 1787379869.247066 write 0x01a3fa thru 0x01cf07 (0x2b0e bytes) 000269 1787379869.253271 MIRROR_EXTEND to 2 mirrors 000270 1787379869.934344 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) 000271 1787379870.128979 read 0x003d07 thru 0x00d58a (0x9884 bytes) 000272 1787379870.153237 mapread 0x00e484 thru 0x01d3de (0xef5b bytes) 000276 1787379870.193729 MIRROR_EXTEND to 2 mirrors 000277 1787379871.093088 read 0x011aef thru 0x01b3c0 (0x98d2 bytes) 000278 1787379871.107047 mapread 0x02ea5c thru 0x03b528 (0xcacd bytes) 000280 1787379871.138787 mapwrite 0x007d8f thru 0x011d1f (0x9f91 bytes) 000282 1787379871.436140 mapread 0x0208d1 thru 0x029b1d (0x924d bytes) 000283 1787379871.459932 read 0x018555 thru 0x02566e (0xd11a bytes) 000286 1787379871.464247 mapwrite 0x033f30 thru 0x03ffff (0xc0d0 bytes) 000288 1787379871.590306 write 0x01062d thru 0x01dac1 (0xd495 bytes) 000289 1787379871.593429 mapwrite 0x030da1 thru 0x03b508 (0xa768 bytes) 000290 1787379871.653845 read 0x00cdf9 thru 0x01b198 (0xe3a0 bytes) 000291 1787379871.669628 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1dc336bf (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x878dca14 Mirror 3: 0x878dca14 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000293 1787379872.582255 read 0x00d6d7 thru 0x00ecfe (0x1628 bytes) 000294 1787379872.612576 write 0x0032a9 thru 0x00e64d (0xb3a5 bytes) 000295 1787379872.734603 read 0x00252b thru 0x00d029 (0xaaff bytes) 000299 1787379872.775857 read 0x002bca thru 0x008211 (0x5648 bytes) 000300 1787379872.785172 MIRROR_RESYNC 3 mirrors 000301 1787379873.574197 read 0x014067 thru 0x0163cf (0x2369 bytes) 000302 1787379873.585209 trunc from 0x040000 to 0x035a2c (0xa5d3 bytes) 000304 1787379873.774978 read 0x02808d thru 0x034454 (0xc3c8 bytes) 000305 1787379873.789854 mapread 0x02dac0 thru 0x031cbf (0x4200 bytes) 000306 1787379873.791036 mapwrite 0x01251b thru 0x01313f (0xc25 bytes) 000308 1787379873.826707 read 0x00e263 thru 0x00fcd1 (0x1a6f bytes) 000311 1787379873.829986 mapwrite 0x0205f3 thru 0x029f27 (0x9935 bytes) 000312 1787379873.916102 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x35a2d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35a2d): Mirror 2: 0x16456a7d (stale) Mirror 3: 0x16456a7d (stale) CRC-32 checksum value for chunk [0, 0x35a2d): Mirror 1: 0x358467ed Mirror 4: 0x358467ed lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35a2d: skipped 000313 1787379874.999851 write 0x00dc22 thru 0x018563 (0xa942 bytes) 000314 1787379875.079482 trunc from 0x035a2d to 0x008a9a (0x2cf92 bytes) 000315 1787379875.102206 mapread 0x00074b thru 0x008a9a (0x8350 bytes) 000316 1787379875.125929 mapread 0x005889 thru 0x005c3c (0x3b4 bytes) 000317 1787379875.127801 mapread 0x007aab thru 0x008a9a (0xff0 bytes) 000320 1787379875.130197 mapread 0x006dd6 thru 0x008a9a (0x1cc5 bytes) 000321 1787379875.131793 read 0x0016ae thru 0x008a9a (0x73ed bytes) 000322 1787379875.132794 read 0x00457d thru 0x005753 (0x11d7 bytes) 000323 1787379875.133689 write 0x001d90 thru 0x0063f3 (0x4664 bytes) 000324 1787379875.135330 mapwrite 0x00f5ad thru 0x017df6 (0x884a bytes) 000325 1787379875.210112 write 0x02126f thru 0x02fcb1 (0xea43 bytes) 000326 1787379875.217610 MIRROR_RESYNC 4 mirrors 000327 1787379876.176810 trunc from 0x02fcb2 to 0x03a436 (0xa785 bytes) 000328 1787379876.362585 mapread 0x02793b thru 0x033213 (0xb8d9 bytes) 000329 1787379876.399283 mapwrite 0x01fade thru 0x02ac8a (0xb1ad bytes) 000330 1787379876.479255 read 0x01c1fc thru 0x022fa6 (0x6dab bytes) truncating to largest ever: 0x3e028 000331 1787379876.480023 trunc from 0x03a437 to 0x03e027 (0x3bf1 bytes) 000332 1787379876.515099 read 0x002064 thru 0x0029dc (0x979 bytes) 000335 1787379876.545603 read 0x0005ea thru 0x00ed90 (0xe7a7 bytes) 000336 1787379876.546676 read 0x02b788 thru 0x02fa59 (0x42d2 bytes) 000337 1787379876.548820 mapwrite 0x01667a thru 0x02505f (0xe9e6 bytes) 000339 1787379876.605252 mapread 0x01455c thru 0x0196b4 (0x5159 bytes) 000340 1787379876.609503 trunc from 0x03e028 to 0x010f2c (0x2d0fb bytes) 000343 1787379876.658249 write 0x03cd57 thru 0x03ffff (0x32a9 bytes) 000344 1787379876.659777 write 0x02c9ab thru 0x033963 (0x6fb9 bytes) 000346 1787379876.695684 write 0x0276cb thru 0x0305dd (0x8f13 bytes) 000349 1787379876.701156 mapwrite 0x01fbc8 thru 0x02b41e (0xb857 bytes) 000352 1787379876.848207 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x2f34c384 (stale) Mirror 3: 0x2f34c384 (stale) Mirror 4: 0x2f34c384 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xba8c35 Mirror 5: 0xba8c35 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000353 1787379878.020537 mapread 0x039ae3 thru 0x03c9be (0x2edc bytes) 000354 1787379878.065486 write 0x00f0dc thru 0x01c008 (0xcf2d bytes) 000356 1787379878.162104 mapread 0x02c77e thru 0x02d616 (0xe99 bytes) 000359 1787379878.191714 mapwrite 0x00b3ab thru 0x0129b0 (0x7606 bytes) 000360 1787379878.257802 mapread 0x0231c4 thru 0x03093f (0xd77c bytes) 000361 1787379878.273250 trunc from 0x040000 to 0x00a5c5 (0x35a3a bytes) 000363 1787379878.309953 trunc from 0x00a5c6 to 0x004481 (0x6144 bytes) 000364 1787379878.346285 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x4482): Mirror 2: 0x7fbb8114 (stale) Mirror 4: 0x7fbb8114 (stale) Mirror 5: 0x7fbb8114 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4482): Mirror 2: 0x7fbb8114 (stale) Mirror 4: 0x7fbb8114 (stale) Mirror 5: 0x7fbb8114 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4482: skipped 000365 1787379878.711758 write 0x0120ec thru 0x019963 (0x7878 bytes) 000367 1787379878.719914 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x19964): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19964): Mirror 2: 0xde6c1b89 (stale) Mirror 4: 0xde6c1b89 (stale) Mirror 5: 0xfb33a418 (stale) CRC-32 checksum value for chunk [0, 0x19964): Mirror 1: 0x188ccb81 Mirror 6: 0x188ccb81 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19964: skipped 000368 1787379879.735338 trunc from 0x019964 to 0x03c40f (0x22aac bytes) 000369 1787379879.856043 write 0x0322a4 thru 0x0352d7 (0x3034 bytes) 000370 1787379879.873503 trunc from 0x03c410 to 0x03c7c1 (0x3b2 bytes) 000371 1787379879.938060 mapread 0x014fba thru 0x0182ee (0x3335 bytes) 000372 1787379879.977597 trunc from 0x03c7c2 to 0x0130aa (0x29717 bytes) 000373 1787379880.006526 mapread 0x004c42 thru 0x011e1b (0xd1da bytes) 000375 1787379880.030486 mapread 0x000434 thru 0x00b72c (0xb2f9 bytes) 000377 1787379880.039420 mapread 0x00d4dc thru 0x0130aa (0x5bcf bytes) 000381 1787379880.044767 trunc from 0x0130ab to 0x03244d (0x1f3a3 bytes) 000382 1787379880.069233 mapread 0x025fe3 thru 0x02f1a0 (0x91be bytes) 000383 1787379880.087859 write 0x02804f thru 0x02e827 (0x67d9 bytes) 000384 1787379880.089234 write 0x023734 thru 0x0284ec (0x4db9 bytes) 000385 1787379880.091725 write 0x0164c0 thru 0x0205ad (0xa0ee bytes) 000386 1787379880.098087 trunc from 0x03244e to 0x00aaf9 (0x27954 bytes) 000387 1787379880.121416 MIRROR_RESYNC 5 mirrors 000388 1787379881.157861 trunc from 0x00aafa to 0x0247c6 (0x19ccd bytes) 000390 1787379881.264906 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x247c7): Mirror 4: 0x4c8ca812 (stale) Mirror 5: 0x4c8ca812 (stale) Mirror 6: 0x4c8ca812 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x247c7): Mirror 4: 0x4c8ca812 (stale) Mirror 5: 0x4c8ca812 (stale) Mirror 6: 0x4c8ca812 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x247c7: skipped 000392 1787379881.787463 mapread 0x0039ac thru 0x00b28b (0x78e0 bytes) 000395 1787379881.831514 mapwrite 0x00cfeb thru 0x012513 (0x5529 bytes) 000396 1787379881.916603 read 0x01f870 thru 0x023a9c (0x422d bytes) 000397 1787379881.943609 mapwrite 0x02839a thru 0x02a50e (0x2175 bytes) 000399 1787379882.110586 read 0x0169cc thru 0x021354 (0xa989 bytes) 000400 1787379882.140971 trunc from 0x02a50f to 0x03cb6d (0x1265f bytes) 000404 1787379882.185836 mapread 0x005cfa thru 0x0135c0 (0xd8c7 bytes) 000405 1787379882.187418 trunc from 0x03cb6e to 0x00ced2 (0x2fc9b bytes) 000406 1787379882.228048 read 0x008e28 thru 0x00ced2 (0x40ab bytes) 000407 1787379882.246381 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xced3): Mirror 5: 0xf71fe44 (stale) Mirror 6: 0xf71fe44 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xced3): Mirror 5: 0xf71fe44 (stale) Mirror 6: 0xf71fe44 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xced3: skipped 000408 1787379882.721448 mapread 0x005afe thru 0x00ced2 (0x73d5 bytes) 000410 1787379882.743872 mapread 0x00b9c9 thru 0x00ced2 (0x150a bytes) 000411 1787379882.746003 trunc from 0x00ced3 to 0x0144fe (0x762c bytes) 000414 1787379882.767473 trunc from 0x0144ff to 0x009815 (0xace9 bytes) 000416 1787379882.789563 mapread 0x0077ec thru 0x009815 (0x202a bytes) 000421 1787379882.794620 trunc from 0x009816 to 0x013ea2 (0xa68d bytes) 000422 1787379882.814087 read 0x0120c5 thru 0x013ea2 (0x1dde bytes) 000424 1787379882.822531 write 0x0048cc thru 0x007c21 (0x3356 bytes) 000426 1787379882.826514 mapread 0x00f7d5 thru 0x013ea2 (0x46ce bytes) 000430 1787379882.839065 mapread 0x00f8fa thru 0x013ea2 (0x45a9 bytes) 000431 1787379882.840448 mapread 0x010b90 thru 0x013ea2 (0x3313 bytes) 000433 1787379882.846986 MIRROR_RESYNC 3 mirrors 000434 1787379883.772228 write 0x015132 thru 0x021668 (0xc537 bytes) 000437 1787379883.888055 mapread 0x01f20b thru 0x021668 (0x245e bytes) 000439 1787379883.890941 read 0x00a46b thru 0x00d7fd (0x3393 bytes) 000440 1787379883.900094 write 0x030b36 thru 0x03a4c7 (0x9992 bytes) 000442 1787379883.905531 write 0x002b9a thru 0x00e390 (0xb7f7 bytes) 000443 1787379883.916797 write 0x02838e thru 0x02dd61 (0x59d4 bytes) 000445 1787379883.927534 write 0x00c835 thru 0x01783d (0xb009 bytes) 000447 1787379883.931012 mapread 0x027170 thru 0x02dea7 (0x6d38 bytes) 000448 1787379883.937527 read 0x02493b thru 0x0285b4 (0x3c7a bytes) 000451 1787379883.955864 mapread 0x0340f1 thru 0x0363e7 (0x22f7 bytes) 000453 1787379883.974764 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a4c8): Mirror 6: 0xd7735f8a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a4c8): Mirror 6: 0xd7735f8a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a4c8: skipped 000454 1787379884.389021 trunc from 0x03a4c8 to 0x0345ba (0x5f0d bytes) 000456 1787379884.435316 write 0x026862 thru 0x028713 (0x1eb2 bytes) 000459 1787379884.473464 mapwrite 0x001b5e thru 0x004d66 (0x3209 bytes) 000460 1787379884.611068 mapwrite 0x01bd13 thru 0x024771 (0x8a5f bytes) 000461 1787379884.739144 mapwrite 0x02d1e0 thru 0x02f4b6 (0x22d7 bytes) 000462 1787379884.850389 trunc from 0x0345bb to 0x027a20 (0xcb9a bytes) 000463 1787379884.881500 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x27a21): Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27a21): Mirror 6: 0x1d817893 (stale) CRC-32 checksum value for chunk [0, 0x27a21): Mirror 1: 0x2215ef38 Mirror 7: 0x2215ef38 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27a21: skipped 000468 1787379885.933858 write 0x03176c thru 0x0333f6 (0x1c8b bytes) 000470 1787379886.085971 MIRROR_RESYNC 3 mirrors 000471 1787379886.936092 mapread 0x00011a thru 0x00d76f (0xd656 bytes) 000475 1787379886.975341 mapread 0x007783 thru 0x008ca0 (0x151e bytes) 000477 1787379886.977034 mapread 0x032daa thru 0x0333f6 (0x64d bytes) 000480 1787379886.988394 read 0x00bf28 thru 0x01684c (0xa925 bytes) 000482 1787379886.998777 write 0x007ac1 thru 0x010bbe (0x90fe bytes) 000484 1787379887.077294 read 0x0160bc thru 0x02082a (0xa76f bytes) 000485 1787379887.089629 write 0x027a38 thru 0x037060 (0xf629 bytes) 000486 1787379887.096897 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x37061): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37061): Mirror 6: 0x6a7d071d (stale) Mirror 7: 0x6a7d071d (stale) CRC-32 checksum value for chunk [0, 0x37061): Mirror 1: 0x3d015433 Mirror 8: 0x3d015433 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37061: skipped 000488 1787379887.968555 mapread 0x005028 thru 0x00670a (0x16e3 bytes) 000490 1787379887.995149 mapread 0x01b75d thru 0x0252d8 (0x9b7c bytes) 000491 1787379888.024297 write 0x02f717 thru 0x036f44 (0x782e bytes) 000492 1787379888.138162 mapread 0x00f28b thru 0x013ed4 (0x4c4a bytes) 000494 1787379888.160755 MIRROR_RESYNC 4 mirrors 000495 1787379889.223765 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) 000496 1787379889.672891 trunc from 0x037061 to 0x036252 (0xe0e bytes) 000497 1787379889.803345 read 0x01657d thru 0x021639 (0xb0bd bytes) 000498 1787379889.818113 write 0x02a16d thru 0x0392cf (0xf163 bytes) 000500 1787379889.823925 read 0x02f6d4 thru 0x0392cf (0x9bfc bytes) 000503 1787379889.830509 MIRROR_RESYNC 3 mirrors 000505 1787379890.625450 trunc from 0x0392d0 to 0x01ba49 (0x1d886 bytes) 000506 1787379890.689059 read 0x019d74 thru 0x01ba49 (0x1cd6 bytes) 000508 1787379890.702417 MIRROR_RESYNC 3 mirrors 000509 1787379891.554710 mapwrite 0x00d297 thru 0x00fb45 (0x28af bytes) 000510 1787379891.767608 MIRROR_RESYNC 3 mirrors 000511 1787379892.561632 MIRROR_RESYNC 3 mirrors 000512 1787379893.002757 MIRROR_EXTEND to 4 mirrors 000513 1787379893.552436 trunc from 0x01ba4a to 0x02a7af (0xed66 bytes) 000514 1787379893.628444 mapwrite 0x03c41d thru 0x03ffff (0x3be3 bytes) 000516 1787379893.717134 write 0x009c9b thru 0x0169aa (0xcd10 bytes) 000517 1787379893.734442 MIRROR_RESYNC 4 mirrors 000521 1787379894.796712 mapwrite 0x001795 thru 0x00c185 (0xa9f1 bytes) 000524 1787379895.043706 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x4dc24698 (stale) Mirror 7: 0x4dc24698 (stale) Mirror 8: 0x4dc24698 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x78598df0 Mirror 9: 0x78598df0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000526 1787379895.991731 read 0x03676e thru 0x03ffff (0x9892 bytes) 000528 1787379895.999997 mapwrite 0x031be6 thru 0x037064 (0x547f bytes) 000530 1787379896.245995 mapread 0x0000a3 thru 0x00d664 (0xd5c2 bytes) 000532 1787379896.281441 MIRROR_RESYNC 5 mirrors 000533 1787379897.578353 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) 000534 1787379897.967292 MIRROR_RESYNC 4 mirrors 000535 1787379898.443359 write 0x02caf8 thru 0x031e51 (0x535a bytes) 000537 1787379898.538020 mapread 0x0035d1 thru 0x009157 (0x5b87 bytes) 000538 1787379898.560412 read 0x02ad86 thru 0x02af7f (0x1fa bytes) 000542 1787379898.588822 trunc from 0x040000 to 0x02e297 (0x11d68 bytes) 000543 1787379898.658455 mapwrite 0x02fdf4 thru 0x03f34a (0xf557 bytes) 000544 1787379898.779709 read 0x037971 thru 0x03f34a (0x79da bytes) 000545 1787379898.780607 mapread 0x026d2d thru 0x02bf6f (0x5243 bytes) 000548 1787379898.801118 mapread 0x038bf3 thru 0x03f34a (0x6758 bytes) 000549 1787379898.802596 write 0x0372b9 thru 0x0373b5 (0xfd bytes) 000550 1787379898.804262 read 0x01b3eb thru 0x01c6e9 (0x12ff bytes) 000551 1787379898.805308 write 0x014944 thru 0x01c784 (0x7e41 bytes) 000554 1787379898.808404 write 0x0043c8 thru 0x005661 (0x129a bytes) 000557 1787379898.811483 read 0x002dec thru 0x006b9b (0x3db0 bytes) 000558 1787379898.816859 MIRROR_RESYNC 4 mirrors 000560 1787379899.958834 trunc from 0x03f34b to 0x011c73 (0x2d6d7 bytes) 000561 1787379900.052763 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x11c74): Mirror 7: 0x450ca3c (stale) Mirror 9: 0x450ca3c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11c74): Mirror 7: 0x450ca3c (stale) Mirror 9: 0x450ca3c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11c74: skipped 000562 1787379900.460438 trunc from 0x011c74 to 0x02289c (0x10c29 bytes) 000563 1787379900.484918 trunc from 0x02289d to 0x034eca (0x1262e bytes) 000564 1787379900.501984 write 0x00a388 thru 0x01332b (0x8fa4 bytes) 000569 1787379900.514994 read 0x00b86f thru 0x01413a (0x88cc bytes) 000573 1787379900.523396 trunc from 0x034ecb to 0x018ca2 (0x1c228 bytes) 000575 1787379900.549554 trunc from 0x018ca3 to 0x025c55 (0xcfb3 bytes) 000577 1787379900.580246 read 0x025c30 thru 0x025c55 (0x26 bytes) 000581 1787379900.605036 write 0x01f9b3 thru 0x023d69 (0x43b7 bytes) 000586 1787379900.614196 trunc from 0x025c56 to 0x00b301 (0x1a954 bytes) 000587 1787379900.659203 mapread 0x00ab02 thru 0x00aded (0x2ec bytes) 000588 1787379900.664275 mapwrite 0x036caf thru 0x037a2b (0xd7d bytes) 000590 1787379900.805904 trunc from 0x037a2c to 0x011adc (0x25f4f bytes) 000591 1787379900.833838 mapread 0x005566 thru 0x007d2f (0x27ca bytes) 000592 1787379900.846880 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x11add): Mirror 7: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11add): Mirror 7: 0x8a8c2aa9 (stale) Mirror 9: 0x8a8c2aa9 (stale) CRC-32 checksum value for chunk [0, 0x11add): Mirror 1: 0xe8e379dd Mirror 10: 0xe8e379dd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11add: skipped 000593 1787379901.890011 mapwrite 0x008aef thru 0x01722b (0xe73d bytes) 000594 1787379902.110619 trunc from 0x01722c to 0x022f17 (0xbcec bytes) 000595 1787379902.143969 mapwrite 0x011725 thru 0x0205d4 (0xeeb0 bytes) 000596 1787379902.222501 mapread 0x00897d thru 0x017d0d (0xf391 bytes) 000598 1787379902.228488 mapwrite 0x0267fc thru 0x0270ee (0x8f3 bytes) 000601 1787379902.310618 read 0x00f34f thru 0x0168b3 (0x7565 bytes) 000605 1787379902.315277 mapwrite 0x022a27 thru 0x02bf91 (0x956b bytes) 000608 1787379902.518696 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2bf92): Mirror 9: 0xf16700bf (stale) Mirror 10: 0x42fc7841 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bf92): Mirror 9: 0xf16700bf (stale) Mirror 10: 0x42fc7841 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bf92: skipped 000611 1787379902.992036 mapread 0x01c77b thru 0x020af7 (0x437d bytes) 000612 1787379903.014532 mapwrite 0x0289d7 thru 0x02ca00 (0x402a bytes) 000613 1787379903.078596 mapwrite 0x010a0e thru 0x0208f3 (0xfee6 bytes) 000614 1787379903.129911 write 0x01b609 thru 0x021ec9 (0x68c1 bytes) 000615 1787379903.131278 trunc from 0x02ca01 to 0x01d0aa (0xf956 bytes) 000618 1787379903.160192 mapread 0x001b8f thru 0x011696 (0xfb08 bytes) 000619 1787379903.179843 mapwrite 0x02896a thru 0x0334c4 (0xab5b bytes) 000620 1787379903.340332 mapwrite 0x011822 thru 0x0147ce (0x2fad bytes) 000621 1787379903.412178 trunc from 0x0334c5 to 0x001b16 (0x319ae bytes) 000622 1787379903.438836 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b17): Mirror 9: 0x316082b5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b17): Mirror 9: 0x316082b5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b17: skipped 000624 1787379903.756081 trunc from 0x001b17 to 0x037a25 (0x35f0f bytes) 000625 1787379903.780017 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x37a26): Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37a26): Mirror 9: 0x41eca942 (stale) CRC-32 checksum value for chunk [0, 0x37a26): Mirror 1: 0xbf7e0e02 Mirror 10: 0xbf7e0e02 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37a26: skipped 000626 1787379904.793057 mapwrite 0x0093ce thru 0x017cb6 (0xe8e9 bytes) 000627 1787379905.026247 mapwrite 0x02d9e6 thru 0x039f3c (0xc557 bytes) 000628 1787379905.166686 write 0x0389ac thru 0x039ded (0x1442 bytes) 000631 1787379905.173390 mapwrite 0x03ed06 thru 0x03ffff (0x12fa bytes) 000633 1787379905.283581 mapwrite 0x01e05b thru 0x0273d0 (0x9376 bytes) 000634 1787379905.382497 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x292b7521 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x292b7521 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000635 1787379905.751248 mapwrite 0x011960 thru 0x01ba0b (0xa0ac bytes) 000637 1787379905.840340 MIRROR_RESYNC 2 mirrors 000638 1787379906.537919 mapread 0x03b209 thru 0x03ffff (0x4df7 bytes) 000640 1787379906.562671 trunc from 0x040000 to 0x025541 (0x1aabe bytes) 000642 1787379906.655663 trunc from 0x025542 to 0x03556f (0x1002e bytes) 000645 1787379906.688301 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x35570): Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35570): Mirror 10: 0x534f7717 (stale) CRC-32 checksum value for chunk [0, 0x35570): Mirror 1: 0x73f6642d Mirror 11: 0x73f6642d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35570: skipped 000646 1787379907.616586 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35570): Mirror 10: 0x534f7717 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35570): Mirror 10: 0x534f7717 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35570: skipped 000647 1787379907.920493 mapread 0x00fee0 thru 0x013122 (0x3243 bytes) 000649 1787379907.944025 read 0x0069a6 thru 0x0097f9 (0x2e54 bytes) 000651 1787379907.955985 trunc from 0x035570 to 0x035173 (0x3fc bytes) 000654 1787379908.008807 write 0x03b495 thru 0x03ffff (0x4b6b bytes) 000655 1787379908.011980 mapread 0x02dab1 thru 0x02e376 (0x8c6 bytes) 000658 1787379908.025042 trunc from 0x040000 to 0x004e1d (0x3b1e2 bytes) 000659 1787379908.059923 MIRROR_RESYNC 2 mirrors 000660 1787379908.837527 MIRROR_RESYNC 2 mirrors 000661 1787379909.162353 mapread 0x000fb3 thru 0x004e1d (0x3e6b bytes) 000662 1787379909.195586 trunc from 0x004e1e to 0x015062 (0x10245 bytes) 000667 1787379909.399734 write 0x00d5e9 thru 0x0143f5 (0x6e0d bytes) 000668 1787379909.439309 mapread 0x0106cf thru 0x012d69 (0x269b bytes) 000670 1787379909.453104 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x15063): Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15063): Mirror 10: 0x23b8a93b (stale) CRC-32 checksum value for chunk [0, 0x15063): Mirror 1: 0x52f091ea Mirror 11: 0x52f091ea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15063: skipped 000671 1787379910.419401 write 0x0289ea thru 0x034671 (0xbc88 bytes) 000673 1787379910.525628 read 0x01dfa2 thru 0x0235e1 (0x5640 bytes) 000678 1787379910.542831 read 0x01b85c thru 0x0288a8 (0xd04d bytes) 000679 1787379910.554013 trunc from 0x034672 to 0x023307 (0x1136a bytes) 000682 1787379910.610845 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23308): Mirror 11: 0x889a4b4f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23308): Mirror 11: 0x889a4b4f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23308: skipped 000685 1787379910.944332 trunc from 0x023308 to 0x014a61 (0xe8a6 bytes) 000686 1787379910.964877 read 0x012c9d thru 0x014a61 (0x1dc5 bytes) 000687 1787379910.977432 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) 000689 1787379911.167446 mapwrite 0x017cd7 thru 0x023e03 (0xc12d bytes) 000694 1787379911.301046 write 0x02c48a thru 0x032457 (0x5fce bytes) 000697 1787379911.305761 mapread 0x00ae24 thru 0x014a3d (0x9c1a bytes) 000698 1787379911.317003 read 0x014639 thru 0x021c91 (0xd659 bytes) 000699 1787379911.318796 mapwrite 0x023d49 thru 0x028c27 (0x4edf bytes) 000702 1787379911.392315 write 0x02e87e thru 0x03e760 (0xfee3 bytes) 000703 1787379911.395298 trunc from 0x03e761 to 0x02c0a0 (0x126c0 bytes) 000704 1787379911.417001 write 0x034f4d thru 0x03da60 (0x8b14 bytes) 000706 1787379911.421204 mapread 0x030c19 thru 0x0326a2 (0x1a8a bytes) 000707 1787379911.430164 write 0x032b23 thru 0x0379cf (0x4ead bytes) 000708 1787379911.439547 trunc from 0x03da61 to 0x007a06 (0x3605a bytes) 000709 1787379911.478293 read 0x003b66 thru 0x007a06 (0x3ea1 bytes) 000710 1787379911.480218 trunc from 0x007a07 to 0x00638e (0x1678 bytes) 000712 1787379911.508844 mapwrite 0x00da80 thru 0x01468f (0x6c10 bytes) 000714 1787379911.592469 read 0x008341 thru 0x009260 (0xf20 bytes) 000716 1787379911.594836 mapwrite 0x03abb9 thru 0x03ffff (0x5447 bytes) 000718 1787379911.667523 write 0x02d0c7 thru 0x02d804 (0x73e bytes) 000719 1787379911.669899 read 0x0346e3 thru 0x03dafe (0x941c bytes) 000720 1787379911.675205 MIRROR_EXTEND to 2 mirrors 000722 1787379912.197443 mapread 0x0262d3 thru 0x03628d (0xffbb bytes) 000723 1787379912.221703 mapread 0x028551 thru 0x035525 (0xcfd5 bytes) 000725 1787379912.223153 read 0x010bd9 thru 0x018a3a (0x7e62 bytes) 000726 1787379912.239453 mapwrite 0x0140c1 thru 0x014f53 (0xe93 bytes) 000727 1787379912.412827 trunc from 0x040000 to 0x014544 (0x2babb bytes) 000729 1787379912.465585 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) 000730 1787379912.593470 mapwrite 0x0054da thru 0x010c12 (0xb739 bytes) 000731 1787379912.668421 trunc from 0x014545 to 0x013494 (0x10b0 bytes) 000732 1787379912.686448 write 0x03884a thru 0x03fac0 (0x7277 bytes) 000733 1787379912.689435 write 0x0075b5 thru 0x00a388 (0x2dd4 bytes) 000734 1787379912.690734 mapwrite 0x01616b thru 0x01db42 (0x79d8 bytes) 000736 1787379912.757607 mapwrite 0x03715f thru 0x03ffff (0x8ea1 bytes) 000738 1787379912.830215 mapread 0x022e26 thru 0x02a205 (0x73e0 bytes) 000739 1787379912.843676 write 0x00281e thru 0x00fd8e (0xd571 bytes) 000741 1787379912.848030 read 0x008a83 thru 0x01699a (0xdf18 bytes) 000742 1787379912.849313 write 0x01fe97 thru 0x0250fa (0x5264 bytes) 000743 1787379912.851002 trunc from 0x040000 to 0x001098 (0x3ef67 bytes) 000745 1787379912.875508 trunc from 0x001099 to 0x0399b4 (0x3891c bytes) 000748 1787379912.903723 trunc from 0x0399b5 to 0x03437a (0x563a bytes) 000750 1787379912.930870 trunc from 0x03437b to 0x025cf4 (0xe686 bytes) 000751 1787379912.948699 mapread 0x01cf87 thru 0x023b64 (0x6bde bytes) 000753 1787379912.964263 mapread 0x00f1c9 thru 0x0112ee (0x2126 bytes) 000754 1787379912.974036 write 0x01cfdc thru 0x01d828 (0x84d bytes) 000755 1787379912.975482 mapread 0x018e7e thru 0x022efc (0xa07f bytes) 000756 1787379912.977499 read 0x009056 thru 0x00ef31 (0x5edc bytes) 000757 1787379912.978586 read 0x004b47 thru 0x00b0c4 (0x657e bytes) 000760 1787379912.994558 mapwrite 0x022849 thru 0x02c43e (0x9bf6 bytes) 000761 1787379913.077738 mapread 0x025a58 thru 0x02c43e (0x69e7 bytes) 000762 1787379913.079979 trunc from 0x02c43f to 0x034458 (0x801a bytes) 000763 1787379913.098474 mapread 0x007586 thru 0x00fc6d (0x86e8 bytes) 000764 1787379913.099999 mapread 0x029f65 thru 0x02e3f2 (0x448e bytes) 000767 1787379913.112433 mapwrite 0x03a834 thru 0x03bee5 (0x16b2 bytes) 000770 1787379913.189903 trunc from 0x03bee6 to 0x019e24 (0x220c1 bytes) 000771 1787379913.215777 mapwrite 0x026933 thru 0x034f6a (0xe638 bytes) 000773 1787379913.410889 read 0x0341fa thru 0x034f6a (0xd71 bytes) 000774 1787379913.411721 mapread 0x02936f thru 0x034f6a (0xbbfc bytes) 000775 1787379913.413893 write 0x015b4c thru 0x018251 (0x2706 bytes) 000779 1787379913.418066 mapread 0x014d05 thru 0x01bf4d (0x7249 bytes) 000780 1787379913.433189 mapwrite 0x006e3a thru 0x013226 (0xc3ed bytes) 000784 1787379913.490572 trunc from 0x034f6b to 0x003229 (0x31d41 bytes) 000788 1787379913.523611 MIRROR_EXTEND to 2 mirrors 000790 1787379914.281981 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) 000791 1787379914.488004 mapwrite 0x01087d thru 0x0158e4 (0x5068 bytes) 000793 1787379914.597622 mapread 0x000579 thru 0x001ac8 (0x1550 bytes) 000795 1787379914.610013 mapread 0x015025 thru 0x0158e4 (0x8c0 bytes) 000798 1787379914.613036 write 0x032d85 thru 0x03822e (0x54aa bytes) 000803 1787379914.619222 trunc from 0x03822f to 0x035b6f (0x26bf bytes) 000804 1787379914.636625 trunc from 0x035b70 to 0x01608e (0x1fae1 bytes) 000806 1787379914.655544 write 0x035107 thru 0x038147 (0x3041 bytes) 000807 1787379914.662838 MIRROR_EXTEND to 2 mirrors 000812 1787379915.339534 read 0x012d06 thru 0x016735 (0x3a30 bytes) 000813 1787379915.348772 mapwrite 0x0186cd thru 0x021ba4 (0x94d8 bytes) 000814 1787379915.584718 write 0x009056 thru 0x017ac0 (0xea6b bytes) 000815 1787379915.593534 mapwrite 0x035eec thru 0x038c05 (0x2d1a bytes) 000817 1787379915.685340 MIRROR_RESYNC 2 mirrors 000818 1787379916.422542 read 0x0276ff thru 0x033b9b (0xc49d bytes) 000819 1787379916.433000 write 0x02f413 thru 0x02f8dd (0x4cb bytes) 000820 1787379916.494550 trunc from 0x038c06 to 0x007bcd (0x31038 bytes) 000821 1787379916.524500 read 0x005b16 thru 0x007bcd (0x20b8 bytes) 000822 1787379916.536200 trunc from 0x007bce to 0x00e582 (0x69b5 bytes) 000823 1787379916.566345 MIRROR_RESYNC 2 mirrors 000824 1787379917.278409 MIRROR_EXTEND to 3 mirrors 000825 1787379918.033464 write 0x0202d6 thru 0x02beaf (0xbbda bytes) 000826 1787379918.100012 write 0x01d795 thru 0x01fa47 (0x22b3 bytes) 000829 1787379918.112690 write 0x01146e thru 0x017f03 (0x6a96 bytes) 000830 1787379918.126242 MIRROR_RESYNC 3 mirrors 000831 1787379918.962940 read 0x0131e2 thru 0x01d38c (0xa1ab bytes) 000833 1787379918.972495 mapread 0x029206 thru 0x02beaf (0x2caa bytes) 000834 1787379919.026295 mapwrite 0x0129e4 thru 0x01e798 (0xbdb5 bytes) 000838 1787379919.263069 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2beb0): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2beb0): Mirror 2: 0xae2f3ba7 (stale) Mirror 3: 0xae2f3ba7 (stale) CRC-32 checksum value for chunk [0, 0x2beb0): Mirror 1: 0x5db73ff6 Mirror 4: 0x5db73ff6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2beb0: skipped 000840 1787379920.206665 write 0x02aaf1 thru 0x02bf35 (0x1445 bytes) 000841 1787379920.332312 read 0x00409e thru 0x0081ab (0x410e bytes) 000842 1787379920.346966 mapwrite 0x004ef4 thru 0x00959b (0x46a8 bytes) 000844 1787379920.422995 mapread 0x006b7b thru 0x0117cb (0xac51 bytes) 000848 1787379920.445541 trunc from 0x02bf36 to 0x003dbe (0x28177 bytes) 000849 1787379920.478132 trunc from 0x003dbf to 0x0284c7 (0x24709 bytes) 000850 1787379920.513923 mapread 0x00ad09 thru 0x00c763 (0x1a5b bytes) 000851 1787379920.543383 MIRROR_RESYNC 4 mirrors 000852 1787379921.377236 read 0x01433e thru 0x01b491 (0x7154 bytes) 000854 1787379921.397696 mapread 0x01a09d thru 0x0284c7 (0xe42b bytes) 000855 1787379921.456332 trunc from 0x0284c8 to 0x00614d (0x2237a bytes) 000856 1787379921.634788 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x614e): Mirror 3: 0xa5dd5aa5 (stale) Mirror 4: 0xa5dd5aa5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x614e): Mirror 3: 0xa5dd5aa5 (stale) Mirror 4: 0xa5dd5aa5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x614e: skipped 000857 1787379921.966908 trunc from 0x00614e to 0x032c64 (0x2cb17 bytes) 000858 1787379921.986083 mapwrite 0x000b56 thru 0x007545 (0x69f0 bytes) 000859 1787379922.065273 trunc from 0x032c65 to 0x032a85 (0x1df bytes) 000860 1787379922.083944 mapread 0x0008c7 thru 0x00f78e (0xeec8 bytes) 000861 1787379922.085365 mapread 0x016598 thru 0x01a15d (0x3bc6 bytes) 000862 1787379922.093855 write 0x00ea4f thru 0x01bbe7 (0xd199 bytes) 000863 1787379922.095466 trunc from 0x032a86 to 0x033dbb (0x1336 bytes) 000867 1787379922.111364 trunc from 0x033dbc to 0x02527a (0xeb41 bytes) 000868 1787379922.137472 mapwrite 0x00d94d thru 0x011380 (0x3a34 bytes) 000869 1787379922.188502 trunc from 0x02527b to 0x028625 (0x33ab bytes) 000870 1787379922.217779 mapread 0x026ba2 thru 0x027c04 (0x1063 bytes) 000871 1787379922.242849 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x28626): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28626): Mirror 3: 0x5cffcf99 (stale) Mirror 4: 0x5cffcf99 (stale) CRC-32 checksum value for chunk [0, 0x28626): Mirror 1: 0x63958884 Mirror 5: 0x63958884 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28626: skipped 000873 1787379923.184278 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28626): Mirror 3: 0x5cffcf99 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28626): Mirror 3: 0x5cffcf99 (stale) CRC-32 checksum value for chunk [0, 0x28626): Mirror 1: 0x63958884 Mirror 5: 0x63958884 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28626: skipped 000874 1787379923.889985 write 0x023074 thru 0x031523 (0xe4b0 bytes) 000875 1787379924.023783 trunc from 0x031524 to 0x01674f (0x1add4 bytes) 000876 1787379924.090358 trunc from 0x016750 to 0x013186 (0x35c9 bytes) 000878 1787379924.140080 mapread 0x012560 thru 0x013186 (0xc27 bytes) 000879 1787379924.177519 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x13187): Mirror 3: 0x6896e00b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13187): Mirror 3: 0x6896e00b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13187: skipped 000880 1787379924.552528 mapread 0x0098c9 thru 0x013186 (0x98be bytes) 000882 1787379924.590956 MIRROR_RESYNC 2 mirrors 000883 1787379925.615882 mapwrite 0x019120 thru 0x022616 (0x94f7 bytes) 000889 1787379925.903541 read 0x021039 thru 0x022616 (0x15de bytes) 000891 1787379925.905410 read 0x010073 thru 0x01d408 (0xd396 bytes) 000892 1787379925.916153 trunc from 0x022617 to 0x022fe5 (0x9cf bytes) 000893 1787379925.962015 read 0x010c5e thru 0x012708 (0x1aab bytes) 000894 1787379925.963587 mapwrite 0x005412 thru 0x00c5e4 (0x71d3 bytes) 000896 1787379926.102741 mapwrite 0x02702e thru 0x031a06 (0xa9d9 bytes) 000897 1787379926.204963 read 0x00eec7 thru 0x019ba1 (0xacdb bytes) 000899 1787379926.206199 mapwrite 0x03c2be thru 0x03ffff (0x3d42 bytes) 000900 1787379926.314574 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x80bbec6f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbc94d54 Mirror 4: 0xbc94d54 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000901 1787379927.053244 mapwrite 0x02b18a thru 0x0372a1 (0xc118 bytes) 000902 1787379927.332948 mapwrite 0x01296e thru 0x017c90 (0x5323 bytes) 000903 1787379927.411366 mapwrite 0x032de6 thru 0x03c197 (0x93b2 bytes) 000904 1787379927.483220 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xbc94d54 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xbc94d54 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000905 1787379927.842150 trunc from 0x040000 to 0x03b000 (0x4fff bytes) 000906 1787379927.906617 mapwrite 0x0151e9 thru 0x018596 (0x33ae bytes) 000907 1787379928.002198 trunc from 0x03b001 to 0x003083 (0x37f7d bytes) 000908 1787379928.021820 read 0x0005b5 thru 0x0021a8 (0x1bf4 bytes) 000910 1787379928.029455 trunc from 0x003084 to 0x01252e (0xf4ab bytes) 000911 1787379928.058478 mapwrite 0x017d1b thru 0x01d9cd (0x5cb3 bytes) 000913 1787379928.157202 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1d9ce): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d9ce): Mirror 4: 0x2baa9df3 (stale) CRC-32 checksum value for chunk [0, 0x1d9ce): Mirror 1: 0x6ed32f5b Mirror 5: 0x6ed32f5b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d9ce: skipped 000914 1787379928.891897 mapwrite 0x03b758 thru 0x03ffff (0x48a8 bytes) 000915 1787379929.097886 mapread 0x017e20 thru 0x022cb3 (0xae94 bytes) 000916 1787379929.117742 write 0x0015dc thru 0x00c553 (0xaf78 bytes) 000917 1787379929.127478 mapread 0x028a0c thru 0x02ed18 (0x630d bytes) 000920 1787379929.137950 write 0x0059ae thru 0x0095ca (0x3c1d bytes) 000922 1787379929.140235 mapwrite 0x0033e5 thru 0x00f0e7 (0xbd03 bytes) 000924 1787379929.194838 mapwrite 0x0010be thru 0x0042d3 (0x3216 bytes) 000925 1787379929.233325 mapread 0x03270f thru 0x0391e5 (0x6ad7 bytes) 000929 1787379929.245085 write 0x009b1e thru 0x00cff4 (0x34d7 bytes) 000930 1787379929.250823 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xbc94d54 (stale) Mirror 5: 0xe07e3092 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf5dc3402 Mirror 6: 0xf5dc3402 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000932 1787379930.071847 mapread 0x008550 thru 0x017c28 (0xf6d9 bytes) 000934 1787379930.116004 trunc from 0x040000 to 0x0366bf (0x9940 bytes) 000936 1787379930.238349 write 0x035591 thru 0x03b57e (0x5fee bytes) 000937 1787379930.246435 write 0x034b6c thru 0x03ffff (0xb494 bytes) 000940 1787379930.255448 write 0x00c535 thru 0x01abdf (0xe6ab bytes) 000942 1787379930.269200 mapread 0x03388d thru 0x035b4f (0x22c3 bytes) 000944 1787379930.278555 mapwrite 0x007b36 thru 0x00974d (0x1c18 bytes) 000945 1787379930.356009 MIRROR_RESYNC 4 mirrors 000948 1787379931.708031 trunc from 0x040000 to 0x00d308 (0x32cf7 bytes) 000949 1787379931.816934 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xd309): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd309): Mirror 4: 0x3a769f57 (stale) Mirror 5: 0x3a769f57 (stale) Mirror 6: 0x3a769f57 (stale) CRC-32 checksum value for chunk [0, 0xd309): Mirror 1: 0x3a769f57 Mirror 7: 0x3a769f57 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd309: skipped 000950 1787379932.665004 mapwrite 0x02391c thru 0x02bee6 (0x85cb bytes) 000953 1787379932.894545 mapread 0x014e9c thru 0x01ffaa (0xb10f bytes) 000955 1787379932.941473 read 0x01619e thru 0x019bfa (0x3a5d bytes) 000956 1787379932.942485 trunc from 0x02bee7 to 0x01507a (0x16e6c bytes) 000958 1787379933.013221 mapwrite 0x0187b3 thru 0x020afd (0x834b bytes) 000959 1787379933.165215 mapread 0x000b04 thru 0x00c0ed (0xb5ea bytes) 000960 1787379933.176227 mapread 0x02021f thru 0x020afd (0x8df bytes) 000962 1787379933.179655 mapread 0x014738 thru 0x017256 (0x2b1f bytes) 000963 1787379933.186881 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20afe): Mirror 4: 0x2fbccf68 (stale) Mirror 5: 0x2fbccf68 (stale) Mirror 6: 0x2fbccf68 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20afe): Mirror 4: 0x2fbccf68 (stale) Mirror 5: 0x2fbccf68 (stale) Mirror 6: 0x2fbccf68 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20afe: skipped 000968 1787379933.683571 write 0x0060cc thru 0x00eb31 (0x8a66 bytes) 000970 1787379933.702498 write 0x002ded thru 0x008b30 (0x5d44 bytes) 000971 1787379933.709019 trunc from 0x020afe to 0x014329 (0xc7d4 bytes) 000973 1787379933.739624 trunc from 0x01432a to 0x000c65 (0x136c4 bytes) 000974 1787379933.768458 read 0x000840 thru 0x000c65 (0x426 bytes) 000976 1787379933.784691 write 0x006e4b thru 0x013e8c (0xd042 bytes) 000977 1787379933.788389 mapread 0x00c806 thru 0x012aa0 (0x629b bytes) 000980 1787379933.798132 read 0x001fb1 thru 0x00c9cc (0xaa1c bytes) 000982 1787379933.816231 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x13e8d): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13e8d): Mirror 4: 0x6b1cc898 (stale) Mirror 5: 0x6b1cc898 (stale) Mirror 6: 0x6b1cc898 (stale) CRC-32 checksum value for chunk [0, 0x13e8d): Mirror 1: 0xd9e3e0cc Mirror 7: 0xd9e3e0cc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13e8d: skipped 000983 1787379934.841953 mapread 0x00c178 thru 0x013e8c (0x7d15 bytes) 000985 1787379934.869327 mapwrite 0x029ee9 thru 0x0300b0 (0x61c8 bytes) 000986 1787379935.176995 mapread 0x003044 thru 0x00fc5b (0xcc18 bytes) 000992 1787379935.214285 trunc from 0x0300b1 to 0x022491 (0xdc1f bytes) 000996 1787379935.246227 read 0x004dc5 thru 0x00fc4f (0xae8b bytes) 000998 1787379935.250365 write 0x03a71c thru 0x03ffff (0x58e4 bytes) 000999 1787379935.252292 mapwrite 0x01c2bc thru 0x024401 (0x8146 bytes) 001000 1787379935.398155 read 0x0042fa thru 0x0092e3 (0x4fea bytes) All operations completed A-OK!