== sanity-flr test 70a: flr mode fsx test ================ 04:15:41 (1788941741) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 1743 fallocating to largest ever: 0xe56f 000002 1788941743.344286 fallocate 0x00a88e thru 0x00e56e (0x3ce1 bytes) skipping zero size read skipping zero length punch hole skipping zero size read truncating to largest ever: 0x2374f 000008 1788941743.357438 trunc from 00000000 to 0x02374e (0x2374f bytes) 000009 1788941743.385429 mapread 0x01ecdd thru 0x02374e (0x4a72 bytes) 000010 1788941743.441489 mapread 0x00ab6e thru 0x00cedc (0x236f bytes) fallocating to largest ever: 0x3e312 000011 1788941743.453216 fallocate 0x03deba thru 0x03e311 (0x458 bytes) 000012 1788941743.457759 write 0x003f85 thru 0x012e28 (0xeea4 bytes) 000013 1788941743.463105 mapwrite 0x0073fc thru 0x00792c (0x531 bytes) 000014 1788941743.477221 trunc from 0x02374f to 0x004458 (0x1f2f6 bytes) 000015 1788941743.492141 trunc from 0x003ec8 to 0x004458 (0x591 bytes) 000016 1788941743.497413 trunc from 0x000a74 to 0x002eca (0x2457 bytes) 000017 1788941743.503049 trunc from 0x004459 to 0x032fd7 (0x2eb7f bytes) 000018 1788941743.518840 fallocate 0x01a8f5 thru 0x01d4b2 (0x2bbe bytes) 000020 1788941743.527838 write 0x01ebe2 thru 0x02089a (0x1cb9 bytes) 000021 1788941743.538242 punch from 0x001814 to 0x002020 (0x80d bytes) 000022 1788941743.543303 fallocate 0x0368ab thru 0x039aa3 (0x31f9 bytes) 000023 1788941743.550122 trunc from 0x035060 to 0x039aa3 (0x4a44 bytes) 000024 1788941743.555297 read 0x022b3f thru 0x027685 (0x4b47 bytes) 000025 1788941743.564525 punch from 0x013d08 to 0x01421c (0x515 bytes) 000026 1788941743.569094 mapread 0x017178 thru 0x025561 (0xe3ea bytes) 000027 1788941743.588259 fallocate 0x01be36 thru 0x02abcd (0xed98 bytes) 000028 1788941743.593398 mapwrite 0x03b4dd thru 0x03ffff (0x4b23 bytes) 000029 1788941743.625182 mapwrite 0x034ae5 thru 0x03c1e2 (0x76fe bytes) 000031 1788941743.644342 trunc from 0x029a29 to 0x02a1ff (0x7d7 bytes) 000032 1788941743.648854 trunc from 0x00af62 to 0x0172d4 (0xc373 bytes) 000033 1788941743.657591 MIRROR_EXTEND to 2 mirrors 000034 1788941744.363573 read 0x022b70 thru 0x02f9f1 (0xce82 bytes) fallocating to largest ever: 0x40000 000035 1788941744.385471 fallocate 0x03a397 thru 0x03ffff (0x5c69 bytes) 000036 1788941744.439200 read 0x020a99 thru 0x0279ee (0x6f56 bytes) 000037 1788941744.449583 write 0x034121 thru 0x039126 (0x5006 bytes) 000038 1788941744.456470 trunc from 0x040000 to 0x023a30 (0x1c5cf bytes) 000039 1788941744.479814 fallocate 0x016da4 thru 0x01b1eb (0x4448 bytes) 000040 1788941744.484350 trunc from 0x023a31 to 0x031397 (0xd967 bytes) 000041 1788941744.496358 write 0x02a102 thru 0x02a509 (0x408 bytes) 000043 1788941744.501727 trunc from 0x0197a6 to 0x01b480 (0x1cdb bytes) 000044 1788941744.509839 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x31398): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31398): Mirror 2: 0x624fbc47 (stale) CRC-32 checksum value for chunk [0, 0x31398): Mirror 1: 0x8e81c128 Mirror 3: 0x8e81c128 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31398: skipped 000045 1788941745.260925 mapwrite 0x0024fa thru 0x01112d (0xec34 bytes) 000046 1788941745.374589 write 0x03d4fd thru 0x03ffff (0x2b03 bytes) 000047 1788941745.380212 mapread 0x00379e thru 0x009093 (0x58f6 bytes) 000048 1788941745.381119 fallocate 0x0064bb thru 0x0132d0 (0xce16 bytes) 000049 1788941745.385284 mapread 0x01b384 thru 0x024015 (0x8c92 bytes) 000050 1788941745.401929 read 0x038c98 thru 0x03de0e (0x5177 bytes) 000051 1788941745.408186 write 0x004aad thru 0x004d78 (0x2cc bytes) 000052 1788941745.409356 trunc from 0x040000 to 0x0384f9 (0x7b06 bytes) 000053 1788941745.447218 trunc from 0x029a45 to 0x0357df (0xbd9b bytes) 000054 1788941745.452365 fallocate 0x01133b thru 0x01fca4 (0xe96a bytes) 000055 1788941745.456491 write 0x00a692 thru 0x01721e (0xcb8d bytes) 000056 1788941745.458549 punch from 0x0168b7 to 0x024d4d (0xe497 bytes) 000057 1788941745.470876 read 0x03709d thru 0x0384f9 (0x145d bytes) 000058 1788941745.483132 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x384fa): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x384fa): Mirror 2: 0x3d983bf5 (stale) Mirror 3: 0xd6014719 (stale) CRC-32 checksum value for chunk [0, 0x384fa): Mirror 1: 0xd10bb188 Mirror 4: 0xd10bb188 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x384fa: skipped 000059 1788941746.237198 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x384fa): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x384fa): Mirror 2: 0x3d983bf5 (stale) Mirror 3: 0xd6014719 (stale) CRC-32 checksum value for chunk [0, 0x384fa): Mirror 1: 0xd10bb188 Mirror 4: 0xd10bb188 Mirror 5: 0xd10bb188 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x384fa: skipped 000060 1788941747.059839 write 0x028991 thru 0x0300db (0x774b bytes) 000061 1788941747.106299 trunc from 0x0384fa to 0x02c7ae (0xbd4b bytes) 000062 1788941747.151081 write 0x01194a thru 0x01390b (0x1fc2 bytes) 000063 1788941747.159329 read 0x004108 thru 0x00ef6a (0xae63 bytes) 000066 1788941747.170283 read 0x00c061 thru 0x01016f (0x410f bytes) 000067 1788941747.179877 fallocate 0x01a50c thru 0x022147 (0x7c3c bytes) 000068 1788941747.189357 MIRROR_RESYNC 5 mirrors 000069 1788941748.386619 mapwrite 0x00e0e1 thru 0x00ee41 (0xd61 bytes) 000070 1788941748.470521 MIRROR_RESYNC 5 mirrors 000071 1788941749.619315 mapwrite 0x03196d thru 0x0367d5 (0x4e69 bytes) 000072 1788941749.690854 punch from 0x0187fd to 0x01b209 (0x2a0d bytes) 000073 1788941749.700402 mapwrite 0x015de5 thru 0x016feb (0x1207 bytes) 000074 1788941749.723150 punch from 0x0357a0 to 0x035a17 (0x278 bytes) 000075 1788941749.727375 punch from 0x035bc6 to 0x0367d5 (0xc10 bytes) 000076 1788941749.732304 trunc from 0x010350 to 0x012787 (0x2438 bytes) 000077 1788941749.744270 read 0x03285c thru 0x0367d5 (0x3f7a bytes) 000078 1788941749.761229 mapread 0x01c450 thru 0x024b3c (0x86ed bytes) 000079 1788941749.781340 punch from 0x00434c to 0x0107fa (0xc4af bytes) 000080 1788941749.794521 punch from 0x01c9dd to 0x0238fe (0x6f22 bytes) 000081 1788941749.799070 mapwrite 0x008bb0 thru 0x010b61 (0x7fb2 bytes) 000082 1788941749.830554 punch from 0x0171f4 to 0x01e64a (0x7457 bytes) 000084 1788941749.843356 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x367d6): Mirror 2: 0x4a5aeb4d (stale) Mirror 3: 0x4a5aeb4d (stale) Mirror 4: 0x4a5aeb4d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x367d6): Mirror 2: 0x4a5aeb4d (stale) Mirror 3: 0x4a5aeb4d (stale) Mirror 4: 0x4a5aeb4d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x367d6: skipped 000085 1788941750.271942 trunc from 0x0367d6 to 0x00bdb6 (0x2aa1f bytes) 000086 1788941750.308160 write 0x020f62 thru 0x0225d0 (0x166f bytes) 000087 1788941750.310000 mapwrite 0x000773 thru 0x00620c (0x5a9a bytes) 000089 1788941750.391167 mapwrite 0x038542 thru 0x03a15c (0x1c1b bytes) 000090 1788941750.464399 fallocate 0x02737a thru 0x031c8f (0xa916 bytes) 000091 1788941750.474156 trunc from 0x03a15d to 0x021987 (0x187d5 bytes) 000092 1788941750.515908 write 0x01b77e thru 0x029869 (0xe0ec bytes) 000093 1788941750.529266 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2986a): Mirror 2: 0xe6a2fb37 (stale) Mirror 3: 0xe6a2fb37 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2986a): Mirror 2: 0xe6a2fb37 (stale) Mirror 3: 0xe6a2fb37 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2986a: skipped 000094 1788941750.797426 read 0x0038ad thru 0x00baba (0x820e bytes) 000095 1788941750.809606 write 0x001c8b thru 0x007092 (0x5408 bytes) 000096 1788941750.833000 write 0x013bb4 thru 0x0225ef (0xea3c bytes) 000097 1788941750.861255 mapread 0x010ff9 thru 0x015330 (0x4338 bytes) 000098 1788941750.892933 write 0x00ee63 thru 0x010ec9 (0x2067 bytes) 000099 1788941750.893941 trunc from 0x02986a to 0x01ed1a (0xab4f bytes) 000100 1788941750.919231 trunc from 0x01ed1b to 0x0008d4 (0x1e446 bytes) 000101 1788941750.970148 write 0x03eb5e thru 0x03ffff (0x14a2 bytes) 000102 1788941750.971219 mapread 0x03da9a thru 0x03ffff (0x2566 bytes) 000103 1788941750.984057 mapread 0x039cba thru 0x03ffff (0x6346 bytes) 000104 1788941750.987759 mapwrite 0x026159 thru 0x031872 (0xb71a bytes) 000105 1788941751.064479 fallocate 0x039136 thru 0x03ffff (0x6eca bytes) 000106 1788941751.069486 punch from 0x00e284 to 0x01208a (0x3e07 bytes) 000107 1788941751.074372 trunc from 0x040000 to 0x01838e (0x27c71 bytes) 000108 1788941751.093663 fallocate 0x035f18 thru 0x03ffff (0xa0e8 bytes) 000111 1788941751.102513 fallocate 0x0150d5 thru 0x019636 (0x4562 bytes) 000112 1788941751.117550 fallocate 0x03e9a0 thru 0x03ffff (0x1660 bytes) 000113 1788941751.125369 mapread 0x03aa1d thru 0x03c958 (0x1f3c bytes) 000115 1788941751.145908 punch from 0x0399de to 0x03aacd (0x10f0 bytes) 000116 1788941751.151329 mapwrite 0x019293 thru 0x01d9fb (0x4769 bytes) 000117 1788941751.174063 fallocate 0x02f4d1 thru 0x03ef23 (0xfa53 bytes) 000118 1788941751.179957 fallocate 0x03f76e thru 0x03ffff (0x892 bytes) 000119 1788941751.187124 read 0x02d8b2 thru 0x0397dd (0xbf2c bytes) 000120 1788941751.208444 write 0x007ede thru 0x01498a (0xcaad bytes) 000121 1788941751.211133 trunc from 0x040000 to 0x0268e3 (0x1971c bytes) 000122 1788941751.236096 trunc from 0x0268e4 to 0x011cbc (0x14c27 bytes) 000123 1788941751.251297 punch from 0x00fe77 to 0x011cbc (0x1e46 bytes) 000124 1788941751.275427 trunc from 0x011cbd to 0x03267a (0x209be bytes) 000125 1788941751.292270 fallocate 0x009901 thru 0x011a57 (0x8157 bytes) 000127 1788941751.299218 mapwrite 0x0366b1 thru 0x03ffff (0x994f bytes) 000128 1788941751.408457 trunc from 0x040000 to 0x01f836 (0x207c9 bytes) 000129 1788941751.431201 mapwrite 0x02b6d0 thru 0x02c12a (0xa5b bytes) 000130 1788941751.510538 fallocate 0x006876 thru 0x00a10f (0x389a bytes) 000131 1788941751.522837 mapread 0x0139db thru 0x02183b (0xde61 bytes) 000132 1788941751.672308 mapread 0x01c619 thru 0x02a678 (0xe060 bytes) 000133 1788941751.733982 punch from 0x0183aa to 0x018671 (0x2c8 bytes) 000134 1788941751.738221 write 0x035a0d thru 0x03f9e0 (0x9fd4 bytes) 000136 1788941751.744334 read 0x003826 thru 0x00c66b (0x8e46 bytes) 000137 1788941751.745360 fallocate 0x039430 thru 0x03af1b (0x1aec bytes) 000138 1788941751.750142 mapread 0x01f151 thru 0x028eba (0x9d6a bytes) 000139 1788941751.750990 read 0x01dfd2 thru 0x025b1d (0x7b4c bytes) 000140 1788941751.751490 mapread 0x02e5ec thru 0x036c2a (0x863f bytes) 000141 1788941751.764525 read 0x002bec thru 0x006df0 (0x4205 bytes) 000142 1788941751.765205 punch from 0x00e174 to 0x00eda6 (0xc33 bytes) 000143 1788941751.777144 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f9e1): Mirror 3: 0x286f3175 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f9e1): Mirror 3: 0x286f3175 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f9e1: skipped 000144 1788941752.123449 mapwrite 0x02f99e thru 0x0370cb (0x772e bytes) 000145 1788941752.181048 trunc from 0x03f9e1 to 0x01b4f0 (0x244f0 bytes) 000146 1788941752.205491 trunc from 0x01b4f1 to 0x004ff0 (0x16500 bytes) 000147 1788941752.225520 fallocate 0x03772a thru 0x0392b1 (0x1b88 bytes) 000148 1788941752.232717 mapread 0x033047 thru 0x0392b1 (0x626b bytes) 000149 1788941752.248221 trunc from 0x0392b2 to 0x0172f2 (0x21fbf bytes) 000150 1788941752.274865 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x172f3): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x172f3): Mirror 3: 0x89233f36 (stale) CRC-32 checksum value for chunk [0, 0x172f3): Mirror 1: 0x403781dd Mirror 4: 0x403781dd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x172f3: skipped 000151 1788941753.018183 fallocate 0x00f17b thru 0x014bf1 (0x5a77 bytes) 000152 1788941753.060030 mapread 0x0079d1 thru 0x0082c4 (0x8f4 bytes) 000153 1788941753.082746 trunc from 0x002b18 to 0x008dab (0x6294 bytes) 000154 1788941753.097372 read 0x00665f thru 0x015167 (0xeb09 bytes) 000155 1788941753.135533 mapwrite 0x030857 thru 0x032414 (0x1bbe bytes) 000156 1788941753.221589 mapread 0x001620 thru 0x0087a4 (0x7185 bytes) 000157 1788941753.234975 read 0x0185a1 thru 0x024b44 (0xc5a4 bytes) 000158 1788941753.265156 write 0x01c781 thru 0x01dce2 (0x1562 bytes) 000159 1788941753.266173 trunc from 0x032415 to 0x000ad0 (0x31944 bytes) 000160 1788941753.305601 punch from 0x000955 to 0x000ad0 (0x17c bytes) 000161 1788941753.321525 trunc from 0x000a3a to 0x000ad0 (0x97 bytes) 000162 1788941753.327151 punch from 0x00024b to 0x000ad0 (0x886 bytes) 000163 1788941753.346286 trunc from 0x000ad1 to 0x0260fb (0x2562b bytes) 000166 1788941753.390868 fallocate 0x01ad65 thru 0x0269f4 (0xbc90 bytes) 000167 1788941753.399812 trunc from 0x005ef7 to 0x007acb (0x1bd5 bytes) 000168 1788941753.425258 mapwrite 0x00acaa thru 0x00c726 (0x1a7d bytes) 000169 1788941753.488354 fallocate 0x0063df thru 0x009fda (0x3bfc bytes) 000170 1788941753.509149 mapread 0x01592b thru 0x01d9de (0x80b4 bytes) 000171 1788941753.594174 read 0x026047 thru 0x0260fb (0xb5 bytes) 000172 1788941753.619101 mapread 0x002dd4 thru 0x0032d8 (0x505 bytes) 000173 1788941753.620012 punch from 0x001851 to 0x007168 (0x5918 bytes) 000175 1788941753.628993 trunc from 0x0260fc to 0x025c15 (0x4e6 bytes) 000176 1788941753.653445 write 0x028e4e thru 0x038920 (0xfad3 bytes) 000177 1788941753.659891 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38921): Mirror 4: 0xad13b017 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38921): Mirror 4: 0xad13b017 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38921: skipped 000178 1788941753.911466 fallocate 0x025943 thru 0x031bbe (0xc27c bytes) 000179 1788941753.915486 punch from 0x029644 to 0x0314ef (0x7eac bytes) 000180 1788941753.923427 MIRROR_RESYNC 2 mirrors 000181 1788941754.771048 trunc from 0x038921 to 0x00ff1b (0x28a05 bytes) 000182 1788941754.812666 mapwrite 0x011a0b thru 0x0157f3 (0x3de9 bytes) 000183 1788941754.854962 trunc from 0x0157f4 to 0x0074d3 (0xe320 bytes) 000184 1788941754.867998 mapread 0x004f78 thru 0x0074d3 (0x255c bytes) 000185 1788941754.880066 trunc from 0x0074d4 to 0x01c097 (0x14bc4 bytes) 000186 1788941754.892503 mapwrite 0x03fa55 thru 0x03ffff (0x5ab bytes) 000187 1788941754.922644 mapwrite 0x03fe2a thru 0x03ffff (0x1d6 bytes) 000188 1788941754.932513 mapwrite 0x0103cd thru 0x01fb69 (0xf79d bytes) 000189 1788941754.964480 MIRROR_RESYNC 2 mirrors 000190 1788941755.586356 write 0x03b543 thru 0x03ffff (0x4abd bytes) 000191 1788941755.618798 fallocate 0x03096c thru 0x036eed (0x6582 bytes) 000192 1788941755.624741 mapread 0x0101cc thru 0x0166b4 (0x64e9 bytes) 000193 1788941755.644568 punch from 0x0023f1 to 0x00944d (0x705d bytes) 000194 1788941755.651009 punch from 0x039e6d to 0x03ffff (0x6193 bytes) 000196 1788941755.665030 read 0x031b34 thru 0x03fe46 (0xe313 bytes) 000197 1788941755.673991 write 0x0094bb thru 0x016b30 (0xd676 bytes) 000198 1788941755.682279 mapread 0x000051 thru 0x00cb92 (0xcb42 bytes) 000199 1788941755.690289 mapread 0x03c515 thru 0x03ffff (0x3aeb bytes) 000200 1788941755.692163 write 0x03dd79 thru 0x03ffff (0x2287 bytes) 000201 1788941755.693928 read 0x016ccc thru 0x022744 (0xba79 bytes) 000202 1788941755.703370 trunc from 0x0168bd to 0x01d349 (0x6a8d bytes) 000203 1788941755.717135 write 0x01f128 thru 0x02e2aa (0xf183 bytes) 000204 1788941755.719216 trunc from 0x040000 to 0x0344bd (0xbb42 bytes) 000205 1788941755.738201 trunc from 0x0344be to 0x01f3cd (0x150f0 bytes) 000206 1788941755.758313 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000207 1788941755.916143 trunc from 0x00a51d to 0x015d7b (0xb85f bytes) 000208 1788941755.929247 write 0x01a7ee thru 0x026d5c (0xc56f bytes) 000210 1788941755.941024 fallocate 0x02e8fe thru 0x030f5b (0x265e bytes) 000211 1788941755.946793 write 0x0298f7 thru 0x02b264 (0x196e bytes) 000212 1788941755.948479 mapwrite 0x031d22 thru 0x03d1ff (0xb4de bytes) 000213 1788941756.040912 trunc from 0x03d200 to 0x00bb19 (0x316e6 bytes) 000214 1788941756.068346 read 0x007b4e thru 0x00bb19 (0x3fcc bytes) 000215 1788941756.078774 write 0x0317c6 thru 0x03a660 (0x8e9b bytes) 000217 1788941756.083790 read 0x02ac0c thru 0x02bf96 (0x138b bytes) 000218 1788941756.096988 fallocate 0x03bd79 thru 0x03ffff (0x4287 bytes) 000219 1788941756.103006 read 0x0344fe thru 0x03ffff (0xbb02 bytes) 000220 1788941756.113300 trunc from 0x03586a to 0x03eccd (0x9464 bytes) 000222 1788941756.129207 read 0x02dfd5 thru 0x037a50 (0x9a7c bytes) 000223 1788941756.137654 read 0x02ef32 thru 0x037150 (0x821f bytes) 000224 1788941756.138936 fallocate 0x018847 thru 0x0201fa (0x79b4 bytes) 000225 1788941756.142289 trunc from 0x02d7e6 to 0x03d796 (0xffb1 bytes) 000226 1788941756.147145 read 0x010ddb thru 0x01e8ea (0xdb10 bytes) 000227 1788941756.148131 punch from 0x01856e to 0x01bca8 (0x373b bytes) 000228 1788941756.153431 read 0x03e2e7 thru 0x03ffff (0x1d19 bytes) 000229 1788941756.154158 trunc from 0x02b7f7 to 0x037c75 (0xc47f bytes) 000230 1788941756.160875 mapwrite 0x021cde thru 0x02a04b (0x836e bytes) 000231 1788941756.191671 mapwrite 0x025046 thru 0x02c312 (0x72cd bytes) 000232 1788941756.239275 fallocate 0x01be66 thru 0x0242fc (0x8497 bytes) 000233 1788941756.246163 trunc from 0x00ed21 to 0x0125fe (0x38de bytes) 000235 1788941756.256271 mapwrite 0x024763 thru 0x02b715 (0x6fb3 bytes) 000236 1788941756.285193 trunc from 0x040000 to 0x012e1c (0x2d1e3 bytes) 000237 1788941756.301496 mapwrite 0x0070d1 thru 0x00eaa8 (0x79d8 bytes) 000239 1788941756.328339 read 0x002275 thru 0x009b5b (0x78e7 bytes) 000240 1788941756.329491 trunc from 0x012e1d to 0x017980 (0x4b64 bytes) 000241 1788941756.355118 trunc from 0x00d1ca to 0x017980 (0xa7b7 bytes) 000242 1788941756.361729 mapwrite 0x01bddb thru 0x02424a (0x8470 bytes) 000243 1788941756.447073 read 0x00b4e5 thru 0x014c15 (0x9731 bytes) 000244 1788941756.447669 mapread 0x022720 thru 0x02424a (0x1b2b bytes) 000245 1788941756.448598 read 0x004fae thru 0x010f17 (0xbf6a bytes) 000246 1788941756.457818 trunc from 0x006b52 to 0x00c16a (0x5619 bytes) 000247 1788941756.476134 MIRROR_EXTEND to 2 mirrors 000248 1788941757.173933 trunc from 0x0020aa to 0x003a12 (0x1969 bytes) 000249 1788941757.256953 MIRROR_RESYNC 2 mirrors 000250 1788941757.832959 punch from 0x00c887 to 0x01497d (0x80f7 bytes) 000251 1788941757.859997 fallocate 0x012df6 thru 0x013c98 (0xea3 bytes) 000252 1788941757.864995 read 0x015e63 thru 0x01888b (0x2a29 bytes) 000253 1788941757.872941 read 0x01530b thru 0x01b5e0 (0x62d6 bytes) 000254 1788941757.884054 read 0x018ef1 thru 0x01dfdf (0x50ef bytes) 000255 1788941757.888508 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2424b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2424b): Mirror 2: 0x62fdb873 (stale) CRC-32 checksum value for chunk [0, 0x2424b): Mirror 1: 0x84d5b605 Mirror 3: 0x84d5b605 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2424b: skipped 000256 1788941758.565900 read 0x002701 thru 0x00d588 (0xae88 bytes) 000257 1788941758.582520 fallocate 0x00fee3 thru 0x01d020 (0xd13e bytes) 000258 1788941758.613229 mapwrite 0x01d53b thru 0x02396c (0x6432 bytes) 000259 1788941758.658148 fallocate 0x01867c thru 0x024e6f (0xc7f4 bytes) 000260 1788941758.666566 punch from 0x01b1c1 to 0x01e59a (0x33da bytes) 000261 1788941758.687556 mapwrite 0x026d35 thru 0x033560 (0xc82c bytes) 000262 1788941758.752444 mapread 0x02172e thru 0x023d5d (0x2630 bytes) 000263 1788941758.753893 trunc from 0x017a96 to 0x021993 (0x9efe bytes) 000264 1788941758.762455 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x33561): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33561): Mirror 2: 0x7438b728 (stale) Mirror 3: 0x95582e3d (stale) CRC-32 checksum value for chunk [0, 0x33561): Mirror 1: 0x63fed924 Mirror 4: 0x63fed924 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33561: skipped 000265 1788941759.760717 write 0x015ecb thru 0x01e80d (0x8943 bytes) 000266 1788941759.855462 read 0x022ed0 thru 0x02b5ea (0x871b bytes) 000267 1788941759.868837 read 0x0187c6 thru 0x026a0b (0xe246 bytes) 000268 1788941759.884801 mapread 0x02e114 thru 0x033560 (0x544d bytes) 000269 1788941759.886271 mapwrite 0x0319b3 thru 0x03db66 (0xc1b4 bytes) 000270 1788941759.960447 read 0x002bf5 thru 0x00e338 (0xb744 bytes) 000271 1788941759.961548 write 0x00f639 thru 0x0198b5 (0xa27d bytes) 000272 1788941759.963944 mapwrite 0x01dce1 thru 0x029c13 (0xbf33 bytes) 000273 1788941760.026226 fallocate 0x01bae7 thru 0x022f26 (0x7440 bytes) 000275 1788941760.041329 MIRROR_RESYNC 4 mirrors 000276 1788941761.095965 punch from 0x01f865 to 0x020c40 (0x13dc bytes) 000277 1788941761.137788 mapwrite 0x0015b6 thru 0x00dcc1 (0xc70c bytes) 000278 1788941761.179516 trunc from 0x020730 to 0x02c52c (0xbdfd bytes) 000279 1788941761.184994 fallocate 0x018ef1 thru 0x01d220 (0x4330 bytes) 000280 1788941761.191452 read 0x007bf2 thru 0x01241b (0xa82a bytes) 000281 1788941761.200544 mapread 0x0027cd thru 0x01142f (0xec63 bytes) 000282 1788941761.201539 trunc from 0x0173b3 to 0x021eb4 (0xab02 bytes) 000283 1788941761.209418 mapread 0x032ddd thru 0x03c0f2 (0x9316 bytes) 000284 1788941761.240083 trunc from 0x025427 to 0x02a9d4 (0x55ae bytes) 000285 1788941761.247923 trunc from 0x013197 to 0x01cde6 (0x9c50 bytes) 000286 1788941761.252804 trunc from 0x019cf7 to 0x01f366 (0x5670 bytes) 000287 1788941761.265107 MIRROR_RESYNC 4 mirrors 000288 1788941762.241360 write 0x004170 thru 0x012817 (0xe6a8 bytes) 000289 1788941762.284451 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3db67): Mirror 3: 0x3f68ef4 (stale) Mirror 4: 0x3f68ef4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3db67): Mirror 3: 0x3f68ef4 (stale) Mirror 4: 0x3f68ef4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3db67: skipped 000290 1788941762.587214 mapread 0x022514 thru 0x027841 (0x532e bytes) 000291 1788941762.608198 read 0x02cadc thru 0x034942 (0x7e67 bytes) 000292 1788941762.618612 MIRROR_RESYNC 3 mirrors 000293 1788941763.211641 write 0x033a14 thru 0x03ffff (0xc5ec bytes) 000294 1788941763.257362 trunc from 0x040000 to 0x003f78 (0x3c087 bytes) 000295 1788941763.303269 mapread 0x000200 thru 0x0019ae (0x17af bytes) 000296 1788941763.319177 mapwrite 0x012f48 thru 0x020795 (0xd84e bytes) 000297 1788941763.415160 write 0x03008c thru 0x0380b7 (0x802c bytes) 000298 1788941763.416616 mapwrite 0x02b0d8 thru 0x02e87e (0x37a7 bytes) 000299 1788941763.446618 read 0x021d05 thru 0x028ec4 (0x71c0 bytes) 000301 1788941763.458410 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x380b8): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x380b8): Mirror 3: 0x81c1acad (stale) Mirror 4: 0x81c1acad (stale) CRC-32 checksum value for chunk [0, 0x380b8): Mirror 1: 0xdc41fd0e Mirror 5: 0xdc41fd0e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x380b8: skipped 000302 1788941764.348860 read 0x007a62 thru 0x008a66 (0x1005 bytes) 000303 1788941764.367767 write 0x01072b thru 0x01af69 (0xa83f bytes) 000304 1788941764.413018 trunc from 0x0380b8 to 0x022e55 (0x15262 bytes) 000305 1788941764.453659 fallocate 0x00607a thru 0x011228 (0xb1af bytes) 000306 1788941764.459725 trunc from 0x01cc1a to 0x022e55 (0x623c bytes) 000307 1788941764.466285 mapread 0x00320b thru 0x006975 (0x376b bytes) 000308 1788941764.494069 trunc from 0x007800 to 0x008830 (0x1031 bytes) 000309 1788941764.499094 punch from 0x01d555 to 0x022e55 (0x5901 bytes) 000310 1788941764.503250 punch from 0x00b077 to 0x00cb35 (0x1abf bytes) 000311 1788941764.507359 mapread 0x012a82 thru 0x01c3bf (0x993e bytes) 000313 1788941764.520659 trunc from 0x022e56 to 0x0228bf (0x596 bytes) 000314 1788941764.540207 trunc from 0x002d85 to 0x00d3d8 (0xa654 bytes) 000315 1788941764.545009 mapwrite 0x01a901 thru 0x029ed9 (0xf5d9 bytes) 000316 1788941764.615620 mapread 0x006493 thru 0x011336 (0xaea4 bytes) 000317 1788941764.623554 mapread 0x009234 thru 0x014726 (0xb4f3 bytes) 000318 1788941764.624496 trunc from 0x029eda to 0x01c9fb (0xd4de bytes) 000319 1788941764.657075 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1c9fc): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c9fc): Mirror 3: 0xdba22db0 (stale) Mirror 4: 0xdba22db0 (stale) Mirror 5: 0xea0a2e5b (stale) CRC-32 checksum value for chunk [0, 0x1c9fc): Mirror 1: 0x1f6bc953 Mirror 6: 0x1f6bc953 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c9fc: skipped 000321 1788941765.553966 fallocate 0x02b4da thru 0x02ffab (0x4ad2 bytes) 000322 1788941765.597493 write 0x0295b9 thru 0x02af57 (0x199f bytes) 000323 1788941765.611945 trunc from 0x024f63 to 0x02af57 (0x5ff5 bytes) 000324 1788941765.635261 MIRROR_RESYNC 5 mirrors 000325 1788941766.799397 trunc from 0x02af58 to 0x006b8a (0x243cd bytes) 000326 1788941766.846576 trunc from 0x006b8b to 0x03fc2c (0x390a2 bytes) 000327 1788941766.874192 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fc2d): Mirror 3: 0xd9400f5a (stale) Mirror 4: 0xd9400f5a (stale) Mirror 5: 0xd9400f5a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fc2d): Mirror 3: 0xd9400f5a (stale) Mirror 4: 0xd9400f5a (stale) Mirror 5: 0xd9400f5a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fc2d: skipped 000328 1788941767.244250 MIRROR_RESYNC 4 mirrors 000329 1788941767.983256 mapread 0x01a561 thru 0x01d5e2 (0x3082 bytes) 000331 1788941768.002845 MIRROR_RESYNC 4 mirrors 000332 1788941768.309393 fallocate 0x031198 thru 0x03b50c (0xa375 bytes) 000333 1788941768.336163 mapread 0x035dbf thru 0x03a3cc (0x460e bytes) 000334 1788941768.370017 trunc from 0x0030c4 to 0x00dfab (0xaee8 bytes) 000335 1788941768.377117 punch from 0x03bde8 to 0x03fc2c (0x3e45 bytes) 000336 1788941768.383120 read 0x00e07f thru 0x0160a3 (0x8025 bytes) 000337 1788941768.389902 read 0x005bb3 thru 0x00d0ee (0x753c bytes) 000338 1788941768.413417 write 0x03aeac thru 0x03dd50 (0x2ea5 bytes) 000339 1788941768.415230 punch from 0x0067be to 0x010be3 (0xa426 bytes) 000340 1788941768.420276 punch from 0x0243d2 to 0x027657 (0x3286 bytes) 000341 1788941768.426291 trunc from 0x03fc2d to 0x009647 (0x365e5 bytes) 000342 1788941768.446374 trunc from 0x009648 to 0x015527 (0xbee0 bytes) 000344 1788941768.462341 mapwrite 0x02585c thru 0x027122 (0x18c7 bytes) 000345 1788941768.531002 write 0x024627 thru 0x02efa9 (0xa983 bytes) 000346 1788941768.544995 trunc from 0x02efaa to 0x028e06 (0x61a3 bytes) 000347 1788941768.576276 trunc from 0x028e07 to 0x01c934 (0xc4d2 bytes) 000348 1788941768.631737 read 0x016142 thru 0x01b432 (0x52f1 bytes) 000349 1788941768.658079 read 0x003d88 thru 0x01172b (0xd9a4 bytes) 000350 1788941768.664842 mapwrite 0x011c59 thru 0x01fa8d (0xde35 bytes) 000351 1788941768.765125 mapwrite 0x03fb10 thru 0x03ffff (0x4f0 bytes) 000352 1788941768.849630 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x87b04e8b (stale) Mirror 4: 0x87b04e8b (stale) Mirror 5: 0x87b04e8b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4aed426f Mirror 6: 0x4aed426f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000353 1788941769.903850 trunc from 0x03546f to 0x03a1ad (0x4d3f bytes) 000354 1788941769.950894 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x87b04e8b (stale) Mirror 4: 0x87b04e8b (stale) Mirror 5: 0x87b04e8b (stale) Mirror 6: 0x4aed426f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4aed426f Mirror 7: 0x4aed426f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000355 1788941770.855922 punch from 0x00ff8c to 0x0183b8 (0x842d bytes) 000356 1788941770.896401 trunc from 0x040000 to 0x00a63b (0x359c4 bytes) 000357 1788941770.920451 fallocate 0x012950 thru 0x01d305 (0xa9b6 bytes) 000358 1788941770.926477 write 0x00e0ca thru 0x01b511 (0xd448 bytes) 000359 1788941770.937958 trunc from 0x005184 to 0x00a02b (0x4ea8 bytes) 000360 1788941770.941991 trunc from 0x0164c8 to 0x01d305 (0x6e3e bytes) 000362 1788941770.957258 mapread 0x00912f thru 0x00cf37 (0x3e09 bytes) 000363 1788941770.976662 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1d306): Mirror 3: 0x73e49b59 (stale) Mirror 4: 0x73e49b59 (stale) Mirror 5: 0x73e49b59 (stale) Mirror 7: 0x4f0549f8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d306): Mirror 3: 0x73e49b59 (stale) Mirror 4: 0x73e49b59 (stale) Mirror 5: 0x73e49b59 (stale) Mirror 7: 0x4f0549f8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d306: skipped 000364 1788941771.289332 punch from 0x01537d to 0x01d305 (0x7f89 bytes) 000365 1788941771.295225 write 0x00ba50 thru 0x00bf46 (0x4f7 bytes) 000366 1788941771.307490 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1d306): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d306): Mirror 3: 0x73e49b59 (stale) Mirror 4: 0x73e49b59 (stale) Mirror 5: 0x73e49b59 (stale) Mirror 7: 0x4f0549f8 (stale) CRC-32 checksum value for chunk [0, 0x1d306): Mirror 1: 0x83f9f8c8 Mirror 8: 0x83f9f8c8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d306: skipped 000367 1788941772.516603 read 0x0114ab thru 0x01d305 (0xbe5b bytes) 000368 1788941772.535906 trunc from 0x01d306 to 0x00aeac (0x12459 bytes) 000369 1788941772.632420 mapwrite 0x0133c4 thru 0x0195ba (0x61f7 bytes) 000370 1788941772.680997 trunc from 0x0195bb to 0x02acb4 (0x116fa bytes) 000371 1788941772.694561 mapwrite 0x025c21 thru 0x02ca99 (0x6e79 bytes) 000372 1788941772.741912 mapwrite 0x02ade1 thru 0x033887 (0x8aa7 bytes) 000373 1788941772.796359 mapwrite 0x0138e5 thru 0x014510 (0xc2c bytes) 000374 1788941772.830248 trunc from 0x0200a1 to 0x021621 (0x1581 bytes) 000375 1788941772.866067 MIRROR_RESYNC 6 mirrors 000376 1788941774.183906 read 0x01d12b thru 0x02953f (0xc415 bytes) 000377 1788941774.193153 trunc from 0x033888 to 0x033d9a (0x513 bytes) 000378 1788941774.250256 read 0x01a1fc thru 0x027d8c (0xdb91 bytes) 000379 1788941774.268636 mapwrite 0x021ce7 thru 0x023a65 (0x1d7f bytes) 000380 1788941774.281881 read 0x00fb96 thru 0x018a38 (0x8ea3 bytes) 000381 1788941774.289217 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33d9b): Mirror 3: 0xba68166b (stale) Mirror 5: 0xba68166b (stale) Mirror 7: 0xba68166b (stale) Mirror 8: 0xba68166b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33d9b): Mirror 3: 0xba68166b (stale) Mirror 5: 0xba68166b (stale) Mirror 7: 0xba68166b (stale) Mirror 8: 0xba68166b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33d9b: skipped 000382 1788941774.656672 mapread 0x00978c thru 0x00e4e9 (0x4d5e bytes) 000383 1788941774.676190 fallocate 0x0053cc thru 0x014d77 (0xf9ac bytes) 000385 1788941774.685649 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33d9b): Mirror 3: 0xba68166b (stale) Mirror 5: 0xba68166b (stale) Mirror 8: 0xba68166b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33d9b): Mirror 3: 0xba68166b (stale) Mirror 5: 0xba68166b (stale) Mirror 8: 0xba68166b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33d9b: skipped 000386 1788941775.195202 mapread 0x01f06b thru 0x01ffc1 (0xf57 bytes) 000389 1788941775.207428 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33d9b): Mirror 5: 0xba68166b (stale) Mirror 8: 0xba68166b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33d9b): Mirror 5: 0xba68166b (stale) Mirror 8: 0xba68166b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33d9b: skipped 000390 1788941775.591536 read 0x01273c thru 0x017dea (0x56af bytes) 000391 1788941775.604963 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x33d9b): Mirror 5: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33d9b): Mirror 5: 0xba68166b (stale) Mirror 8: 0xba68166b (stale) CRC-32 checksum value for chunk [0, 0x33d9b): Mirror 1: 0x9610463a Mirror 9: 0x9610463a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33d9b: skipped 000392 1788941776.573920 read 0x0099e5 thru 0x00b189 (0x17a5 bytes) 000393 1788941776.586482 trunc from 0x029537 to 0x033d9a (0xa864 bytes) 000394 1788941776.630387 write 0x0173b7 thru 0x02303d (0xbc87 bytes) 000395 1788941776.647448 punch from 0x0072bb to 0x010e9d (0x9be3 bytes) 000396 1788941776.657063 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33d9b): Mirror 5: 0xba68166b (stale) Mirror 8: 0xba68166b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33d9b): Mirror 5: 0xba68166b (stale) Mirror 8: 0xba68166b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33d9b: skipped 000397 1788941777.109982 read 0x00905d thru 0x018bf9 (0xfb9d bytes) 000399 1788941777.118796 fallocate 0x012693 thru 0x01d859 (0xb1c7 bytes) 000400 1788941777.122602 mapread 0x010efd thru 0x01346d (0x2571 bytes) 000401 1788941777.123891 trunc from 0x004239 to 0x0060ee (0x1eb6 bytes) 000402 1788941777.127626 trunc from 0x033d9b to 0x02ce53 (0x6f47 bytes) 000403 1788941777.145322 fallocate 0x037920 thru 0x03ffff (0x86e0 bytes) 000404 1788941777.149875 mapwrite 0x00ad54 thru 0x0190d1 (0xe37e bytes) 000405 1788941777.169992 trunc from 0x02ce54 to 0x004ac5 (0x2838e bytes) 000406 1788941777.182278 mapread 0x000b03 thru 0x004ac5 (0x3fc3 bytes) 000408 1788941777.196632 read 0x0008bd thru 0x004ac5 (0x4209 bytes) 000409 1788941777.197227 mapread 0x003dec thru 0x004ac5 (0xcda bytes) 000410 1788941777.198034 punch from 0x00131c to 0x004ac5 (0x37aa bytes) 000411 1788941777.203470 fallocate 0x00b83c thru 0x00ba7a (0x23f bytes) 000412 1788941777.211087 punch from 0x000900 to 0x00ba7a (0xb17b bytes) 000413 1788941777.216522 read 0x00472f thru 0x00ba7a (0x734c bytes) 000414 1788941777.229050 mapread 0x0048f6 thru 0x005f7d (0x1688 bytes) 000415 1788941777.229976 read 0x008342 thru 0x00ba7a (0x3739 bytes) 000416 1788941777.230506 write 0x02e427 thru 0x02fd7e (0x1958 bytes) 000417 1788941777.232020 trunc from 0x027cfa to 0x02fd7e (0x8085 bytes) 000418 1788941777.247311 trunc from 0x010951 to 0x0173e5 (0x6a95 bytes) 000419 1788941777.265841 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fd7f): Mirror 8: 0x9f9303d7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fd7f): Mirror 8: 0x9f9303d7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fd7f: skipped 000420 1788941777.627005 fallocate 0x016ddb thru 0x0218d4 (0xaafa bytes) 000421 1788941777.631227 read 0x008a03 thru 0x009442 (0xa40 bytes) 000423 1788941777.639807 trunc from 0x02fd7f to 0x003178 (0x2cc06 bytes) 000425 1788941777.662731 read 0x002483 thru 0x003178 (0xcf6 bytes) 000426 1788941777.669431 trunc from 0x003179 to 0x01f987 (0x1c80f bytes) 000427 1788941777.684106 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000428 1788941777.792448 mapread 0x017c84 thru 0x01c518 (0x4895 bytes) 000429 1788941777.806135 trunc from 0x01f988 to 0x02ee75 (0xf4ee bytes) 000430 1788941777.825241 mapwrite 0x03eb2c thru 0x03ffff (0x14d4 bytes) 000432 1788941777.858964 read 0x0302cd thru 0x03ffff (0xfd33 bytes) 000433 1788941777.866374 trunc from 0x01a97c to 0x01c2aa (0x192f bytes) 000434 1788941777.870085 fallocate 0x02d9e1 thru 0x03c83c (0xee5c bytes) 000435 1788941777.877004 MIRROR_EXTEND to 2 mirrors 000436 1788941778.598556 punch from 0x022d96 to 0x02f6fc (0xc967 bytes) 000437 1788941778.641253 punch from 0x00dac6 to 0x01947d (0xb9b8 bytes) 000438 1788941778.661964 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x3d276a11 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3d276a11 Mirror 3: 0x3d276a11 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000439 1788941779.531020 fallocate 0x038b74 thru 0x03ebc5 (0x6052 bytes) 000440 1788941779.590062 write 0x02a809 thru 0x0357a5 (0xaf9d bytes) 000441 1788941779.641421 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x3d276a11 (stale) Mirror 3: 0x3d276a11 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3967778b Mirror 4: 0x3967778b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000442 1788941780.681388 mapwrite 0x02a714 thru 0x035ed6 (0xb7c3 bytes) 000443 1788941780.805121 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x3d276a11 (stale) Mirror 3: 0x3d276a11 (stale) Mirror 4: 0x3967778b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb0466d64 Mirror 5: 0xb0466d64 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000444 1788941781.960961 write 0x03a245 thru 0x03ffff (0x5dbb bytes) 000445 1788941782.020599 read 0x00a7a9 thru 0x0106e7 (0x5f3f bytes) 000446 1788941782.031270 fallocate 0x02bcff thru 0x037d86 (0xc088 bytes) 000447 1788941782.041263 read 0x02cac7 thru 0x032d82 (0x62bc bytes) 000448 1788941782.050160 read 0x0333af thru 0x0340ca (0xd1c bytes) 000449 1788941782.056211 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x3d276a11 (stale) Mirror 3: 0x3d276a11 (stale) Mirror 4: 0x3967778b (stale) Mirror 5: 0xb0466d64 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x112a3bfb Mirror 6: 0x112a3bfb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000451 1788941782.948276 write 0x0337f5 thru 0x03ffff (0xc80b bytes) 000452 1788941783.006532 mapread 0x029ffa thru 0x030893 (0x689a bytes) 000453 1788941783.041457 mapread 0x01f453 thru 0x021a28 (0x25d6 bytes) 000454 1788941783.053233 punch from 0x021022 to 0x02cb57 (0xbb36 bytes) 000455 1788941783.062909 write 0x00eadb thru 0x01897c (0x9ea2 bytes) 000456 1788941783.067659 punch from 0x0215a3 to 0x02b24f (0x9cad bytes) 000457 1788941783.081031 punch from 0x0133c9 to 0x0143ba (0xff2 bytes) 000458 1788941783.120649 mapwrite 0x03d934 thru 0x03ffff (0x26cc bytes) 000459 1788941783.143395 fallocate 0x02ac27 thru 0x038433 (0xd80d bytes) 000461 1788941783.154362 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x3d276a11 (stale) Mirror 3: 0x3d276a11 (stale) Mirror 4: 0x3967778b (stale) Mirror 5: 0xb0466d64 (stale) Mirror 6: 0x112a3bfb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8d81d042 Mirror 7: 0x8d81d042 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000462 1788941784.140498 punch from 0x019a65 to 0x022c86 (0x9222 bytes) 000463 1788941784.197387 trunc from 0x040000 to 0x02e59e (0x11a61 bytes) 000464 1788941784.253129 fallocate 0x0198b6 thru 0x025e33 (0xc57e bytes) 000465 1788941784.257801 fallocate 0x02310c thru 0x024120 (0x1015 bytes) 000466 1788941784.262889 punch from 0x01e904 to 0x0290e8 (0xa7e5 bytes) 000467 1788941784.267965 read 0x0265ff thru 0x02ccff (0x6701 bytes) 000468 1788941784.277770 fallocate 0x00fa60 thru 0x010621 (0xbc2 bytes) 000469 1788941784.282676 fallocate 0x00570f thru 0x007930 (0x2222 bytes) 000471 1788941784.288022 trunc from 0x027a28 to 0x02e59e (0x6b77 bytes) 000472 1788941784.293117 fallocate 0x023483 thru 0x02fc08 (0xc786 bytes) 000473 1788941784.298451 trunc from 0x02fc09 to 0x01b8e9 (0x1431f bytes) 000474 1788941784.314617 mapwrite 0x02a16c thru 0x0342ac (0xa141 bytes) 000475 1788941784.383588 punch from 0x02e936 to 0x031d7c (0x3447 bytes) 000476 1788941784.388514 read 0x007e15 thru 0x01365c (0xb848 bytes) 000477 1788941784.399332 fallocate 0x016e99 thru 0x021c17 (0xad7f bytes) 000478 1788941784.404307 read 0x0154e0 thru 0x02522a (0xfd4b bytes) 000479 1788941784.406266 mapwrite 0x0009dc thru 0x0027ef (0x1e14 bytes) 000480 1788941784.420719 mapwrite 0x02bae8 thru 0x03b853 (0xfd6c bytes) 000481 1788941784.486817 write 0x022544 thru 0x030f25 (0xe9e2 bytes) 000482 1788941784.488609 mapwrite 0x0102ea thru 0x0138df (0x35f6 bytes) 000483 1788941784.525369 fallocate 0x03eb99 thru 0x03ffff (0x1467 bytes) 000484 1788941784.530737 trunc from 0x0307ed to 0x03268b (0x1e9f bytes) 000485 1788941784.543564 trunc from 0x040000 to 0x00a7f9 (0x35806 bytes) 000486 1788941784.560217 trunc from 0x008660 to 0x00a7f9 (0x219a bytes) 000487 1788941784.564389 fallocate 0x02b0b8 thru 0x03a4e7 (0xf430 bytes) 000488 1788941784.573025 mapwrite 0x037ea6 thru 0x0392f1 (0x144c bytes) 000489 1788941784.616450 fallocate 0x025769 thru 0x02dfeb (0x8883 bytes) 000490 1788941784.627210 trunc from 0x03a4e8 to 0x02f1f5 (0xb2f2 bytes) 000491 1788941784.649040 mapread 0x02cc71 thru 0x02f1f5 (0x2585 bytes) 000492 1788941784.677424 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f1f6): Mirror 2: 0x3f065db4 (stale) Mirror 3: 0x3f065db4 (stale) Mirror 4: 0x6174cec1 (stale) Mirror 5: 0x9064026a (stale) Mirror 7: 0xdab73347 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f1f6): Mirror 2: 0x3f065db4 (stale) Mirror 3: 0x3f065db4 (stale) Mirror 4: 0x6174cec1 (stale) Mirror 5: 0x9064026a (stale) Mirror 7: 0xdab73347 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f1f6: skipped 000493 1788941785.192677 MIRROR_RESYNC 6 mirrors 000494 1788941786.338640 trunc from 0x008e93 to 0x01725e (0xe3cc bytes) 000495 1788941786.365431 trunc from 0x02f1f6 to 0x02bc74 (0x3581 bytes) 000496 1788941786.387944 read 0x000902 thru 0x003eed (0x35ec bytes) 000497 1788941786.397830 mapread 0x016fe3 thru 0x01d871 (0x688f bytes) 000498 1788941786.434897 read 0x01cc3a thru 0x023135 (0x64fc bytes) 000499 1788941786.448619 write 0x021caf thru 0x0270d2 (0x5424 bytes) 000500 1788941786.450251 fallocate 0x017fe9 thru 0x0240ab (0xc0c3 bytes) 000501 1788941786.455675 write 0x015ab0 thru 0x01d511 (0x7a62 bytes) 000502 1788941786.457546 write 0x02bdc4 thru 0x02f751 (0x398e bytes) 000503 1788941786.458879 mapread 0x00f128 thru 0x019b09 (0xa9e2 bytes) 000505 1788941786.461581 trunc from 0x00e0e9 to 0x01512f (0x7047 bytes) 000506 1788941786.479044 read 0x0231fe thru 0x0272d9 (0x40dc bytes) 000507 1788941786.480984 mapread 0x0278c4 thru 0x02f751 (0x7e8e bytes) 000508 1788941786.483555 trunc from 0x01a6ac to 0x021e97 (0x77ec bytes) 000509 1788941786.493024 mapwrite 0x003a07 thru 0x00b912 (0x7f0c bytes) 000510 1788941786.530899 mapread 0x0235ef thru 0x02afeb (0x79fd bytes) 000511 1788941786.532593 fallocate 0x009f5d thru 0x014ba7 (0xac4b bytes) 000512 1788941786.538530 punch from 0x0275df to 0x02ce26 (0x5848 bytes) 000513 1788941786.554153 mapread 0x00ee67 thru 0x017344 (0x84de bytes) 000515 1788941786.571314 trunc from 0x02f752 to 0x011c95 (0x1dabc bytes) 000516 1788941786.590939 fallocate 0x013f53 thru 0x01ce9f (0x8f4d bytes) 000517 1788941786.595639 trunc from 0x01cea0 to 0x01d4b6 (0x617 bytes) 000518 1788941786.631617 MIRROR_RESYNC 6 mirrors 000519 1788941787.668340 mapwrite 0x030dc1 thru 0x033c47 (0x2e87 bytes) 000520 1788941787.720636 trunc from 0x01ba78 to 0x029d4d (0xe2d6 bytes) 000521 1788941787.725376 trunc from 0x032533 to 0x033c47 (0x1715 bytes) 000522 1788941787.729772 trunc from 0x014190 to 0x0227f2 (0xe663 bytes) 000523 1788941787.733916 trunc from 0x033c48 to 0x028622 (0xb625 bytes) 000524 1788941787.750299 mapwrite 0x025faf thru 0x0297e7 (0x3839 bytes) 000525 1788941787.797829 write 0x02a432 thru 0x039e47 (0xfa16 bytes) 000526 1788941787.806287 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39e48): Mirror 3: 0x298749c0 (stale) Mirror 4: 0x298749c0 (stale) Mirror 5: 0x298749c0 (stale) Mirror 7: 0x298749c0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39e48): Mirror 3: 0x298749c0 (stale) Mirror 4: 0x298749c0 (stale) Mirror 5: 0x298749c0 (stale) Mirror 7: 0x298749c0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39e48: skipped 000527 1788941788.148105 write 0x0254f5 thru 0x02b1dd (0x5ce9 bytes) 000528 1788941788.166942 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39e48): Mirror 4: 0x298749c0 (stale) Mirror 5: 0x298749c0 (stale) Mirror 7: 0x298749c0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39e48): Mirror 4: 0x298749c0 (stale) Mirror 5: 0x298749c0 (stale) Mirror 7: 0x298749c0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39e48: skipped 000529 1788941788.509818 punch from 0x00baba to 0x01acf4 (0xf23b bytes) 000530 1788941788.519271 mapread 0x00c841 thru 0x018ffa (0xc7ba bytes) 000531 1788941788.542967 fallocate 0x033436 thru 0x039de7 (0x69b2 bytes) 000533 1788941788.547521 read 0x021e09 thru 0x0228e0 (0xad8 bytes) 000534 1788941788.551658 trunc from 0x00ecd0 to 0x01939d (0xa6ce bytes) 000535 1788941788.555817 punch from 0x02cf3b to 0x0395a9 (0xc66f bytes) 000536 1788941788.559648 write 0x022390 thru 0x02aa88 (0x86f9 bytes) 000537 1788941788.570170 mapread 0x0159ed thru 0x02364d (0xdc61 bytes) 000538 1788941788.586661 punch from 0x02bb5e to 0x034be9 (0x908c bytes) 000539 1788941788.591588 mapwrite 0x025b00 thru 0x033851 (0xdd52 bytes) 000540 1788941788.642812 write 0x0393e7 thru 0x03b7a4 (0x23be bytes) 000541 1788941788.650502 mapwrite 0x03b6dc thru 0x03ddec (0x2711 bytes) 000542 1788941788.701006 trunc from 0x03dded to 0x035424 (0x89c8 bytes) 000543 1788941788.719270 read 0x01cb3d thru 0x01f69d (0x2b61 bytes) 000544 1788941788.720492 trunc from 0x019320 to 0x01f71a (0x63fb bytes) 000546 1788941788.726570 read 0x02dc59 thru 0x035424 (0x77cc bytes) 000547 1788941788.737576 punch from 0x015285 to 0x01db3c (0x88b8 bytes) 000548 1788941788.742170 fallocate 0x01e431 thru 0x029aba (0xb68a bytes) 000549 1788941788.746380 read 0x010dc4 thru 0x01351d (0x275a bytes) 000550 1788941788.750984 MIRROR_RESYNC 4 mirrors 000551 1788941789.692884 write 0x03c3e3 thru 0x03d061 (0xc7f bytes) 000552 1788941789.722365 trunc from 0x03d062 to 0x0138c0 (0x297a1 bytes) 000553 1788941789.746356 trunc from 0x0138c1 to 0x017ba7 (0x42e7 bytes) 000554 1788941789.786813 read 0x013ac8 thru 0x017ba7 (0x40e0 bytes) 000555 1788941789.802068 fallocate 0x0136d4 thru 0x01ca07 (0x9334 bytes) 000556 1788941789.820189 trunc from 0x018f0b to 0x01ca07 (0x3afd bytes) 000557 1788941789.826180 trunc from 0x01ca08 to 0x02b6e1 (0xecda bytes) 000558 1788941789.852616 read 0x027bd3 thru 0x02b6e1 (0x3b0f bytes) 000559 1788941789.863045 trunc from 0x0210e1 to 0x02b6e1 (0xa601 bytes) 000560 1788941789.868018 mapwrite 0x0318db thru 0x032a0c (0x1132 bytes) 000561 1788941789.905789 punch from 0x018154 to 0x01afc3 (0x2e70 bytes) 000562 1788941789.914415 MIRROR_RESYNC 4 mirrors 000563 1788941790.694662 punch from 0x000f55 to 0x001810 (0x8bc bytes) 000564 1788941790.722858 punch from 0x023b78 to 0x02d452 (0x98db bytes) 000567 1788941790.728453 mapread 0x023ce7 thru 0x02ef02 (0xb21c bytes) 000568 1788941790.751382 read 0x01af56 thru 0x0244d2 (0x957d bytes) 000569 1788941790.757953 trunc from 0x0226b0 to 0x0254be (0x2e0f bytes) 000570 1788941790.763081 read 0x0160f3 thru 0x0239d5 (0xd8e3 bytes) 000571 1788941790.770935 trunc from 0x032a0d to 0x01c4ab (0x16561 bytes) 000572 1788941790.793126 trunc from 0x008b9f to 0x0160ab (0xd50d bytes) 000574 1788941790.799116 mapwrite 0x0348b5 thru 0x035596 (0xce2 bytes) 000575 1788941790.829647 trunc from 0x01c1b7 to 0x02843b (0xc285 bytes) 000576 1788941790.834735 mapwrite 0x01ed7e thru 0x023cad (0x4f30 bytes) 000577 1788941790.880607 read 0x01b95c thru 0x0204ab (0x4b50 bytes) 000578 1788941790.889577 punch from 0x02d251 to 0x02db07 (0x8b7 bytes) 000580 1788941790.904679 read 0x01b659 thru 0x028e7b (0xd823 bytes) 000581 1788941790.907101 trunc from 0x035597 to 0x01d0bf (0x184d7 bytes) 000582 1788941790.925247 trunc from 0x00c0a9 to 0x00cc94 (0xbec bytes) 000583 1788941790.930681 mapread 0x00e9cb thru 0x01be6f (0xd4a5 bytes) 000584 1788941790.933290 fallocate 0x025d31 thru 0x02eef8 (0x91c8 bytes) 000585 1788941790.945523 MIRROR_RESYNC 4 mirrors 000586 1788941791.711634 MIRROR_RESYNC 4 mirrors 000587 1788941792.030241 write 0x02b3c0 thru 0x037675 (0xc2b6 bytes) 000589 1788941792.065148 mapwrite 0x0241a1 thru 0x028b7e (0x49de bytes) 000590 1788941792.106469 fallocate 0x0047dd thru 0x009860 (0x5084 bytes) 000591 1788941792.113906 punch from 0x015b8e to 0x01a3ca (0x483d bytes) 000592 1788941792.121287 trunc from 0x034d6d to 0x037675 (0x2909 bytes) 000593 1788941792.125848 read 0x019510 thru 0x024de8 (0xb8d9 bytes) 000594 1788941792.135086 read 0x02a039 thru 0x030773 (0x673b bytes) 000595 1788941792.136791 trunc from 0x013e91 to 0x01f7b8 (0xb928 bytes) 000596 1788941792.141036 write 0x02eb79 thru 0x03375f (0x4be7 bytes) 000597 1788941792.142212 write 0x01bcbd thru 0x02a266 (0xe5aa bytes) 000598 1788941792.152270 trunc from 0x0186a2 to 0x027e49 (0xf7a8 bytes) 000599 1788941792.167305 trunc from 0x006de7 to 0x00781a (0xa34 bytes) 000600 1788941792.170976 trunc from 0x037676 to 0x01218a (0x254eb bytes) 000601 1788941792.184415 trunc from 0x0118ce to 0x01218a (0x8bd bytes) 000602 1788941792.188899 trunc from 0x0082c8 to 0x00dadd (0x5816 bytes) 000603 1788941792.193644 trunc from 0x005073 to 0x01218a (0xd118 bytes) 000604 1788941792.200489 trunc from 0x009e8c to 0x00edf8 (0x4f6d bytes) 000605 1788941792.207983 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1218b): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1218b): Mirror 4: 0x26019bf6 (stale) Mirror 5: 0x26019bf6 (stale) Mirror 7: 0x26019bf6 (stale) CRC-32 checksum value for chunk [0, 0x1218b): Mirror 1: 0x504257a1 Mirror 8: 0x504257a1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1218b: skipped 000607 1788941792.820106 write 0x01ac36 thru 0x0269b8 (0xbd83 bytes) 000608 1788941792.862395 trunc from 0x01c5b8 to 0x023898 (0x72e1 bytes) 000609 1788941792.886003 trunc from 0x01ee10 to 0x0269b8 (0x7ba9 bytes) 000610 1788941792.890988 mapread 0x0006f8 thru 0x00d107 (0xca10 bytes) 000611 1788941792.917190 trunc from 0x004926 to 0x011ffa (0xd6d5 bytes) 000612 1788941792.922046 fallocate 0x002dde thru 0x00c33f (0x9562 bytes) 000613 1788941792.928288 fallocate 0x00eaae thru 0x0118d5 (0x2e28 bytes) 000614 1788941792.932278 punch from 0x01b9dc to 0x020108 (0x472d bytes) 000615 1788941792.936662 write 0x02cdcb thru 0x037efd (0xb133 bytes) 000616 1788941792.941014 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x37efe): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37efe): Mirror 4: 0x3efeeaf4 (stale) Mirror 5: 0x3efeeaf4 (stale) Mirror 7: 0x3efeeaf4 (stale) Mirror 8: 0x405c3413 (stale) CRC-32 checksum value for chunk [0, 0x37efe): Mirror 1: 0x6947dbdd Mirror 9: 0x6947dbdd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37efe: skipped 000617 1788941793.832751 read 0x035a6c thru 0x037efd (0x2492 bytes) 000618 1788941793.847228 trunc from 0x037efe to 0x03e904 (0x6a07 bytes) 000619 1788941793.894923 mapwrite 0x03881e thru 0x03cc4a (0x442d bytes) 000620 1788941793.928919 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3e905): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e905): Mirror 4: 0xbadefef0 (stale) Mirror 5: 0xbadefef0 (stale) Mirror 7: 0xbadefef0 (stale) Mirror 8: 0x4d64db9e (stale) Mirror 9: 0x8b4cfe70 (stale) CRC-32 checksum value for chunk [0, 0x3e905): Mirror 1: 0xb18edc29 Mirror 10: 0xb18edc29 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e905: skipped 000621 1788941795.063869 punch from 0x02756b to 0x034a7b (0xd511 bytes) 000622 1788941795.097125 punch from 0x000039 to 0x00c3a0 (0xc368 bytes) 000623 1788941795.102672 fallocate 0x025d7d thru 0x02cbfd (0x6e81 bytes) 000624 1788941795.106987 read 0x009465 thru 0x0150f3 (0xbc8f bytes) 000625 1788941795.117680 write 0x01b843 thru 0x0215ae (0x5d6c bytes) 000626 1788941795.134478 punch from 0x02aafa to 0x031f38 (0x743f bytes) 000628 1788941795.139512 punch from 0x02695d to 0x02fec7 (0x956b bytes) 000629 1788941795.144177 trunc from 0x03e905 to 0x0191c7 (0x2573d bytes) 000630 1788941795.160851 trunc from 0x005a29 to 0x007ed1 (0x24a9 bytes) 000631 1788941795.168013 MIRROR_RESYNC 7 mirrors 000633 1788941796.138889 write 0x01f734 thru 0x0243d3 (0x4ca0 bytes) 000634 1788941796.173496 punch from 0x0156fa to 0x023dc1 (0xe6c8 bytes) 000635 1788941796.197279 mapwrite 0x01b2cc thru 0x029d92 (0xeac7 bytes) 000636 1788941796.271908 write 0x000a0f thru 0x0062c7 (0x58b9 bytes) 000637 1788941796.279892 mapread 0x002d30 thru 0x011631 (0xe902 bytes) 000638 1788941796.308103 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29d93): Mirror 5: 0x4aca89ac (stale) Mirror 7: 0x4aca89ac (stale) Mirror 8: 0x4aca89ac (stale) Mirror 9: 0x4aca89ac (stale) Mirror 10: 0x4aca89ac (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29d93): Mirror 5: 0x4aca89ac (stale) Mirror 7: 0x4aca89ac (stale) Mirror 8: 0x4aca89ac (stale) Mirror 9: 0x4aca89ac (stale) Mirror 10: 0x4aca89ac (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29d93: skipped 000639 1788941796.713431 trunc from 0x01b0fc to 0x028beb (0xdaf0 bytes) 000640 1788941796.721926 read 0x02556e thru 0x029d92 (0x4825 bytes) 000641 1788941796.735251 trunc from 0x00c08f to 0x01129a (0x520c bytes) 000642 1788941796.740842 fallocate 0x026d65 thru 0x03669c (0xf938 bytes) 000643 1788941796.744800 read 0x019b8f thru 0x01b438 (0x18aa bytes) 000644 1788941796.763289 read 0x0039c1 thru 0x011ca6 (0xe2e6 bytes) 000645 1788941796.764461 punch from 0x0353ce to 0x03669c (0x12cf bytes) 000646 1788941796.771830 mapwrite 0x000edb thru 0x00def5 (0xd01b bytes) 000647 1788941796.804511 MIRROR_RESYNC 6 mirrors 000648 1788941798.258980 trunc from 0x0015a4 to 0x009994 (0x83f1 bytes) 000649 1788941798.294783 read 0x0188fb thru 0x01e28e (0x5994 bytes) 000650 1788941798.302402 trunc from 0x03669d to 0x003bf4 (0x32aa8 bytes) 000651 1788941798.322164 write 0x02762c thru 0x027fab (0x980 bytes) 000652 1788941798.324257 fallocate 0x026579 thru 0x02c8da (0x6362 bytes) 000653 1788941798.329834 trunc from 0x004025 to 0x007e8f (0x3e6b bytes) 000654 1788941798.333467 trunc from 0x027fac to 0x01dde0 (0xa1cb bytes) 000655 1788941798.345756 trunc from 0x01dde1 to 0x0273b2 (0x95d2 bytes) 000656 1788941798.358817 mapwrite 0x027136 thru 0x036f34 (0xfdff bytes) 000657 1788941798.417631 trunc from 0x036f35 to 0x007f36 (0x2effe bytes) 000658 1788941798.443433 fallocate 0x01dac7 thru 0x02c5f0 (0xeb2a bytes) 000659 1788941798.450298 mapread 0x000488 thru 0x007f36 (0x7aaf bytes) 000660 1788941798.465368 read 0x001728 thru 0x007f36 (0x680f bytes) 000661 1788941798.468973 trunc from 0x007f37 to 0x037e31 (0x2fefb bytes) 000662 1788941798.486165 read 0x02feb9 thru 0x037e31 (0x7f79 bytes) 000664 1788941798.498634 punch from 0x034378 to 0x03667c (0x2305 bytes) 000665 1788941798.502238 mapwrite 0x002fee thru 0x009e98 (0x6eab bytes) 000666 1788941798.530937 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37e32): Mirror 5: 0x2d11997 (stale) Mirror 7: 0x2d11997 (stale) Mirror 8: 0x2d11997 (stale) Mirror 9: 0x2d11997 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37e32): Mirror 5: 0x2d11997 (stale) Mirror 7: 0x2d11997 (stale) Mirror 8: 0x2d11997 (stale) Mirror 9: 0x2d11997 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37e32: skipped 000667 1788941799.033616 mapread 0x025d3c thru 0x02744d (0x1712 bytes) 000669 1788941799.102479 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x37e32): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37e32): Mirror 5: 0x2d11997 (stale) Mirror 7: 0x2d11997 (stale) Mirror 8: 0x2d11997 (stale) Mirror 9: 0x2d11997 (stale) CRC-32 checksum value for chunk [0, 0x37e32): Mirror 1: 0xaefc5199 Mirror 10: 0xaefc5199 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37e32: skipped 000670 1788941800.166753 trunc from 0x037e32 to 0x02a4f7 (0xd93a bytes) 000671 1788941800.215738 trunc from 0x02a4f8 to 0x03f170 (0x14c79 bytes) 000672 1788941800.233457 read 0x00c1c1 thru 0x010ac7 (0x4907 bytes) 000673 1788941800.240024 write 0x035ea3 thru 0x03d2e5 (0x7443 bytes) 000674 1788941800.250766 punch from 0x0202d8 to 0x023c09 (0x3932 bytes) 000675 1788941800.256458 trunc from 0x03f171 to 0x0250fc (0x1a074 bytes) 000676 1788941800.277513 read 0x0109f7 thru 0x01443c (0x3a46 bytes) 000677 1788941800.286650 fallocate 0x03bec2 thru 0x03e11c (0x225b bytes) 000678 1788941800.291526 fallocate 0x01bebc thru 0x025b03 (0x9c48 bytes) 000679 1788941800.295940 write 0x01a15a thru 0x029643 (0xf4ea bytes) 000680 1788941800.303632 punch from 0x02b3e1 to 0x0342f5 (0x8f15 bytes) 000681 1788941800.312573 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e11d): Mirror 5: 0x5e23d38b (stale) Mirror 7: 0x5e23d38b (stale) Mirror 8: 0x5e23d38b (stale) Mirror 9: 0x5e23d38b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e11d): Mirror 5: 0x5e23d38b (stale) Mirror 7: 0x5e23d38b (stale) Mirror 8: 0x5e23d38b (stale) Mirror 9: 0x5e23d38b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e11d: skipped 000682 1788941800.779008 mapwrite 0x01fd40 thru 0x02a3cc (0xa68d bytes) 000683 1788941800.843067 trunc from 0x03e11d to 0x0231fb (0x1af21 bytes) 000684 1788941800.865638 trunc from 0x0162da to 0x01e334 (0x805b bytes) 000685 1788941800.873525 write 0x0030d1 thru 0x00bc8c (0x8bbc bytes) 000686 1788941800.885801 write 0x02a897 thru 0x03297b (0x80e5 bytes) 000687 1788941800.889298 punch from 0x02a996 to 0x03297b (0x7fe6 bytes) 000688 1788941800.904802 read 0x027388 thru 0x030d6c (0x99e5 bytes) 000689 1788941800.914677 trunc from 0x03297c to 0x00cb44 (0x25e37 bytes) 000690 1788941800.928478 fallocate 0x02cb01 thru 0x031d4a (0x524a bytes) 000692 1788941800.933973 mapread 0x008a22 thru 0x00a716 (0x1cf5 bytes) 000693 1788941800.934886 write 0x029ba4 thru 0x036579 (0xc9d6 bytes) 000694 1788941800.937331 read 0x016f66 thru 0x01b6cc (0x4767 bytes) 000695 1788941800.952990 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3657a): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3657a): Mirror 5: 0xc9595abc (stale) Mirror 7: 0xc9595abc (stale) Mirror 8: 0xc9595abc (stale) Mirror 9: 0xc9595abc (stale) CRC-32 checksum value for chunk [0, 0x3657a): Mirror 1: 0xdc6a9a8 Mirror 10: 0xdc6a9a8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3657a: skipped 000696 1788941801.795202 read 0x012f3e thru 0x01938e (0x6451 bytes) 000697 1788941801.811663 punch from 0x0143c8 to 0x01d303 (0x8f3c bytes) 000698 1788941801.894514 trunc from 0x03657a to 0x00e793 (0x27de6 bytes) 000699 1788941801.947608 mapread 0x009e3f thru 0x00de33 (0x3ff5 bytes) 000700 1788941801.982125 write 0x03af99 thru 0x03b8b6 (0x91e bytes) 000701 1788941801.983876 trunc from 0x01098f to 0x011439 (0xaab bytes) 000702 1788941801.995459 MIRROR_RESYNC 6 mirrors 000703 1788941803.394850 MIRROR_RESYNC 6 mirrors 000704 1788941804.052220 mapwrite 0x016d5b thru 0x0246f6 (0xd99c bytes) 000705 1788941804.186064 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b8b7): Mirror 5: 0x5fc1f35b (stale) Mirror 7: 0x5fc1f35b (stale) Mirror 8: 0x5fc1f35b (stale) Mirror 9: 0x5fc1f35b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b8b7): Mirror 5: 0x5fc1f35b (stale) Mirror 7: 0x5fc1f35b (stale) Mirror 8: 0x5fc1f35b (stale) Mirror 9: 0x5fc1f35b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b8b7: skipped 000706 1788941804.578080 read 0x0213c2 thru 0x02eadb (0xd71a bytes) 000707 1788941804.584956 trunc from 0x015dfb to 0x01a0ac (0x42b2 bytes) 000708 1788941804.588918 punch from 0x024731 to 0x02a845 (0x6115 bytes) 000709 1788941804.595549 punch from 0x037fac to 0x03b8b6 (0x390b bytes) 000710 1788941804.599351 write 0x034a23 thru 0x03ffff (0xb5dd bytes) 000711 1788941804.611266 fallocate 0x00d1f2 thru 0x011374 (0x4183 bytes) 000712 1788941804.618084 trunc from 0x015b3d to 0x022bef (0xd0b3 bytes) 000713 1788941804.631443 fallocate 0x039e76 thru 0x03fe3c (0x5fc7 bytes) 000715 1788941804.639419 mapwrite 0x012a58 thru 0x01aaa3 (0x804c bytes) 000716 1788941804.686340 mapwrite 0x007b0c thru 0x00851a (0xa0f bytes) 000717 1788941804.711278 read 0x0150b5 thru 0x01c4de (0x742a bytes) 000719 1788941804.718595 MIRROR_RESYNC 5 mirrors 000720 1788941806.123986 trunc from 0x022b9e to 0x0246de (0x1b41 bytes) 000721 1788941806.155319 mapread 0x018e07 thru 0x019371 (0x56b bytes) 000722 1788941806.166464 mapread 0x01e8db thru 0x02c0e6 (0xd80c bytes) 000723 1788941806.189070 punch from 0x03dd5a to 0x03ffff (0x22a6 bytes) 000724 1788941806.201470 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x2fc9786a (stale) Mirror 7: 0x2fc9786a (stale) Mirror 9: 0x2fc9786a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x2fc9786a (stale) Mirror 7: 0x2fc9786a (stale) Mirror 9: 0x2fc9786a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000725 1788941806.657361 write 0x020ab2 thru 0x0240d5 (0x3624 bytes) 000726 1788941806.686565 MIRROR_RESYNC 4 mirrors 000727 1788941808.134887 mapwrite 0x03a9f9 thru 0x03ffff (0x5607 bytes) 000728 1788941808.234968 fallocate 0x02d5fa thru 0x02e180 (0xb87 bytes) 000730 1788941808.240929 punch from 0x01f8e5 to 0x02435f (0x4a7b bytes) 000731 1788941808.250834 punch from 0x004728 to 0x012e2d (0xe706 bytes) 000732 1788941808.257921 fallocate 0x0166ef thru 0x01d801 (0x7113 bytes) 000733 1788941808.263271 mapwrite 0x036309 thru 0x03ffff (0x9cf7 bytes) 000734 1788941808.296636 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xd6c13fbc (stale) Mirror 7: 0xd6c13fbc (stale) Mirror 9: 0xd6c13fbc (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb8de68ca Mirror 10: 0xb8de68ca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000735 1788941809.433101 trunc from 0x040000 to 0x007e98 (0x38167 bytes) 000736 1788941809.508604 fallocate 0x01c83a thru 0x022973 (0x613a bytes) 000737 1788941809.512880 trunc from 0x01e4a9 to 0x02282c (0x4384 bytes) 000738 1788941809.517417 mapread 0x0122f9 thru 0x01b3d6 (0x90de bytes) 000739 1788941809.533615 mapwrite 0x012358 thru 0x017d41 (0x59ea bytes) 000740 1788941809.549592 mapwrite 0x008c47 thru 0x0104dc (0x7896 bytes) 000741 1788941809.574162 trunc from 0x022974 to 0x03bd73 (0x19400 bytes) 000743 1788941809.590501 mapwrite 0x035c6c thru 0x03ffff (0xa394 bytes) 000744 1788941809.632054 write 0x02f5b5 thru 0x0367ba (0x7206 bytes) 000745 1788941809.633210 write 0x0306eb thru 0x033786 (0x309c bytes) 000746 1788941809.636268 write 0x038006 thru 0x03ffff (0x7ffa bytes) 000747 1788941809.638372 fallocate 0x00de92 thru 0x01a107 (0xc276 bytes) 000748 1788941809.643444 fallocate 0x0181ac thru 0x027238 (0xf08d bytes) 000749 1788941809.648358 read 0x01a672 thru 0x022b62 (0x84f1 bytes) 000750 1788941809.656387 read 0x01fc2b thru 0x024cd6 (0x50ac bytes) 000751 1788941809.664225 mapwrite 0x02e8f9 thru 0x02f246 (0x94e bytes) 000752 1788941809.678131 read 0x00976a thru 0x00badc (0x2373 bytes) 000753 1788941809.678752 trunc from 0x00bd33 to 0x013104 (0x73d2 bytes) 000754 1788941809.687018 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xd6c13fbc (stale) Mirror 9: 0xd6c13fbc (stale) Mirror 10: 0xb8de68ca (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xd6c13fbc (stale) Mirror 9: 0xd6c13fbc (stale) Mirror 10: 0xb8de68ca (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000755 1788941809.970510 mapread 0x01671a thru 0x0173d4 (0xcbb bytes) 000756 1788941809.986251 read 0x01ee65 thru 0x02b655 (0xc7f1 bytes) 000757 1788941809.995165 mapwrite 0x02a3c8 thru 0x02eb1f (0x4758 bytes) 000758 1788941810.015411 punch from 0x022aba to 0x02e117 (0xb65e bytes) 000759 1788941810.024307 mapread 0x02eb23 thru 0x037f85 (0x9463 bytes) 000760 1788941810.046126 write 0x02faef thru 0x03b09b (0xb5ad bytes) 000761 1788941810.054187 mapwrite 0x03b7f8 thru 0x03ffff (0x4808 bytes) 000762 1788941810.068666 fallocate 0x01b7fc thru 0x02700f (0xb814 bytes) 000763 1788941810.072557 fallocate 0x024af0 thru 0x02a8a7 (0x5db8 bytes) 000764 1788941810.076673 write 0x025a6f thru 0x032309 (0xc89b bytes) 000765 1788941810.081531 punch from 0x03a6a7 to 0x03ffff (0x5959 bytes) 000766 1788941810.088648 mapwrite 0x017eb2 thru 0x0229bf (0xab0e bytes) 000768 1788941810.127902 trunc from 0x02007b to 0x0231f4 (0x317a bytes) 000769 1788941810.132425 mapwrite 0x01b65b thru 0x0297d4 (0xe17a bytes) 000770 1788941810.158631 write 0x031ae8 thru 0x037a9b (0x5fb4 bytes) 000771 1788941810.160472 write 0x03d575 thru 0x03ffff (0x2a8b bytes) 000772 1788941810.165543 trunc from 0x040000 to 0x017b7b (0x28484 bytes) 000773 1788941810.182858 MIRROR_RESYNC 4 mirrors 000774 1788941811.289534 punch from 0x0009be to 0x00d2ce (0xc911 bytes) 000776 1788941811.321323 mapwrite 0x00aa65 thru 0x00dcd2 (0x326e bytes) 000777 1788941811.357330 trunc from 0x017b7c to 0x03adca (0x2324f bytes) 000778 1788941811.375545 mapread 0x033b44 thru 0x03adca (0x7287 bytes) 000779 1788941811.385427 trunc from 0x032fa1 to 0x03adca (0x7e2a bytes) 000780 1788941811.395396 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3adcb): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3adcb): Mirror 7: 0x838bd1ea (stale) Mirror 9: 0x838bd1ea (stale) Mirror 10: 0x838bd1ea (stale) CRC-32 checksum value for chunk [0, 0x3adcb): Mirror 1: 0x57326ba3 Mirror 11: 0x57326ba3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3adcb: skipped 000781 1788941812.291395 trunc from 0x01bda1 to 0x01dff7 (0x2257 bytes) 000782 1788941812.330939 trunc from 0x011c33 to 0x0152cd (0x369b bytes) 000785 1788941812.337547 read 0x00dfee thru 0x01757a (0x958d bytes) 000786 1788941812.354521 trunc from 0x003d9a to 0x00773b (0x39a2 bytes) 000787 1788941812.358421 mapread 0x0261bb thru 0x03366d (0xd4b3 bytes) 000788 1788941812.383418 trunc from 0x03adcb to 0x03cf6e (0x21a4 bytes) 000789 1788941812.444845 read 0x002663 thru 0x002c8b (0x629 bytes) 000791 1788941812.459620 MIRROR_RESYNC 5 mirrors 000792 1788941814.080260 fallocate 0x03c41a thru 0x03ffff (0x3be6 bytes) 000793 1788941814.100833 fallocate 0x014b2f thru 0x0221fc (0xd6ce bytes) 000794 1788941814.106908 trunc from 0x03cf6f to 0x0096a7 (0x338c7 bytes) 000795 1788941814.126539 trunc from 0x00367e to 0x004415 (0xd98 bytes) 000797 1788941814.131894 mapread 0x003fae thru 0x007ef1 (0x3f44 bytes) 000798 1788941814.146398 mapwrite 0x03cca6 thru 0x03f3e4 (0x273f bytes) 000799 1788941814.180445 mapread 0x01a84c thru 0x02748d (0xcc42 bytes) 000800 1788941814.203994 trunc from 0x00aa09 to 0x011636 (0x6c2e bytes) 000802 1788941814.209009 read 0x00042a thru 0x00363c (0x3213 bytes) 000803 1788941814.213864 mapread 0x01de86 thru 0x020abc (0x2c37 bytes) 000804 1788941814.214849 write 0x031bbd thru 0x03febc (0xe300 bytes) 000805 1788941814.223830 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3febd): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3febd): Mirror 7: 0x5c3952a5 (stale) Mirror 9: 0x5c3952a5 (stale) Mirror 10: 0x5c3952a5 (stale) Mirror 11: 0x5c3952a5 (stale) CRC-32 checksum value for chunk [0, 0x3febd): Mirror 1: 0x881c7818 Mirror 12: 0x881c7818 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3febd: skipped 000806 1788941815.270058 trunc from 0x03223d to 0x0373a4 (0x5168 bytes) 000807 1788941815.307676 mapread 0x01298b thru 0x013965 (0xfdb bytes) 000808 1788941815.319574 mapread 0x01c0c8 thru 0x02088e (0x47c7 bytes) 000809 1788941815.328444 trunc from 0x03febd to 0x02b03c (0x14e80 bytes) 000810 1788941815.377433 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b03d): Mirror 7: 0x2f93db3 (stale) Mirror 9: 0x2f93db3 (stale) Mirror 10: 0x2f93db3 (stale) Mirror 12: 0x7473693 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b03d): Mirror 7: 0x2f93db3 (stale) Mirror 9: 0x2f93db3 (stale) Mirror 10: 0x2f93db3 (stale) Mirror 12: 0x7473693 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b03d: skipped 000811 1788941815.807680 fallocate 0x02d259 thru 0x038a98 (0xb840 bytes) 000812 1788941815.818820 mapwrite 0x01cd87 thru 0x025cf9 (0x8f73 bytes) 000813 1788941815.863400 write 0x01bc3a thru 0x023dc5 (0x818c bytes) 000814 1788941815.869333 trunc from 0x0045f9 to 0x00877e (0x4186 bytes) 000815 1788941815.874860 punch from 0x0159fa to 0x020eeb (0xb4f2 bytes) 000816 1788941815.888339 mapread 0x019c28 thru 0x01ec57 (0x5030 bytes) 000817 1788941815.896488 read 0x006b3f thru 0x00e163 (0x7625 bytes) 000818 1788941815.907167 mapread 0x01c422 thru 0x0226dc (0x62bb bytes) 000819 1788941815.908490 mapwrite 0x0367c4 thru 0x03f3ec (0x8c29 bytes) 000820 1788941815.953808 trunc from 0x03f3ed to 0x02d089 (0x12363 bytes) 000821 1788941815.967293 read 0x02cbb6 thru 0x02d089 (0x4d4 bytes) 000822 1788941815.977846 read 0x00136e thru 0x0101d2 (0xee65 bytes) 000824 1788941815.979551 read 0x00ce6b thru 0x019c71 (0xce07 bytes) 000825 1788941815.980799 fallocate 0x02eafa thru 0x03839d (0x98a4 bytes) 000826 1788941815.985894 fallocate 0x025f41 thru 0x0272fa (0x13ba bytes) 000827 1788941815.990037 trunc from 0x010f5e to 0x01e153 (0xd1f6 bytes) 000828 1788941815.994237 mapwrite 0x005801 thru 0x010290 (0xaa90 bytes) 000829 1788941816.016671 mapwrite 0x008d26 thru 0x00ed55 (0x6030 bytes) 000830 1788941816.030880 trunc from 0x03839e to 0x01e4aa (0x19ef3 bytes) 000831 1788941816.042568 fallocate 0x0370f0 thru 0x03ffff (0x8f10 bytes) 000832 1788941816.047371 mapwrite 0x00effa thru 0x010b69 (0x1b70 bytes) 000833 1788941816.064145 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xd308e6e4 (stale) Mirror 10: 0xd308e6e4 (stale) Mirror 12: 0x456c0fd9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xd308e6e4 (stale) Mirror 10: 0xd308e6e4 (stale) Mirror 12: 0x456c0fd9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000834 1788941816.352378 mapwrite 0x00228c thru 0x00c98d (0xa702 bytes) 000835 1788941816.385371 mapread 0x018506 thru 0x023fe1 (0xbadc bytes) 000836 1788941816.424538 trunc from 0x00b135 to 0x00c148 (0x1014 bytes) 000837 1788941816.436192 write 0x037c8f thru 0x03ffff (0x8371 bytes) 000838 1788941816.450593 write 0x03c857 thru 0x03e646 (0x1df0 bytes) 000839 1788941816.455154 read 0x038731 thru 0x03ffff (0x78cf bytes) 000840 1788941816.459884 mapread 0x011afb thru 0x013eca (0x23d0 bytes) 000841 1788941816.464224 trunc from 0x040000 to 0x037da6 (0x8259 bytes) 000842 1788941816.486399 write 0x0079b7 thru 0x013a47 (0xc091 bytes) 000843 1788941816.488870 write 0x022b95 thru 0x02e247 (0xb6b3 bytes) 000844 1788941816.495487 mapread 0x036140 thru 0x037da6 (0x1c67 bytes) 000845 1788941816.523381 fallocate 0x0056ce thru 0x00fbc9 (0xa4fc bytes) 000846 1788941816.529551 fallocate 0x003462 thru 0x00b69d (0x823c bytes) 000848 1788941816.545262 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37da7): Mirror 9: 0x629fc715 (stale) Mirror 12: 0xd731581f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37da7): Mirror 9: 0x629fc715 (stale) Mirror 12: 0xd731581f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37da7: skipped 000849 1788941816.978172 fallocate 0x000aaf thru 0x00aa05 (0x9f57 bytes) 000852 1788941816.984823 mapread 0x0289d2 thru 0x02aa2c (0x205b bytes) 000854 1788941817.019441 write 0x00ac36 thru 0x00cdd6 (0x21a1 bytes) 000855 1788941817.041471 punch from 0x02f847 to 0x03102d (0x17e7 bytes) 000856 1788941817.048202 trunc from 0x037da7 to 0x022944 (0x15462 bytes) 000857 1788941817.063214 fallocate 0x0265cd thru 0x030863 (0xa297 bytes) 000858 1788941817.068209 mapread 0x00787a thru 0x011e56 (0xa5dd bytes) 000859 1788941817.083137 write 0x01a839 thru 0x0267ae (0xbf76 bytes) 000860 1788941817.093242 mapwrite 0x03201a thru 0x035ee4 (0x3ecb bytes) 000861 1788941817.138666 mapwrite 0x01b997 thru 0x02b218 (0xf882 bytes) 000862 1788941817.178839 write 0x01fe5d thru 0x02aba1 (0xad45 bytes) 000863 1788941817.181369 trunc from 0x035ee5 to 0x013798 (0x2274c bytes) 000864 1788941817.222123 write 0x017abe thru 0x024c55 (0xd198 bytes) 000865 1788941817.224996 mapread 0x02151b thru 0x024c55 (0x373b bytes) 000866 1788941817.226792 read 0x016d62 thru 0x0216a6 (0xa945 bytes) 000867 1788941817.237109 mapwrite 0x0133f0 thru 0x021914 (0xe525 bytes) 000868 1788941817.294498 trunc from 0x024c56 to 0x020b81 (0x40d4 bytes) 000869 1788941817.322590 trunc from 0x020b82 to 0x01183a (0xf347 bytes) 000870 1788941817.341125 trunc from 0x000ea2 to 0x00454a (0x36a9 bytes) 000871 1788941817.351505 write 0x00e588 thru 0x01358d (0x5006 bytes) 000872 1788941817.353577 punch from 0x00a510 to 0x013520 (0x9011 bytes) 000873 1788941817.376214 mapwrite 0x039623 thru 0x03ffff (0x69dd bytes) 000874 1788941817.415175 trunc from 0x040000 to 0x010cb7 (0x2f348 bytes) 000876 1788941817.430418 mapwrite 0x02530a thru 0x02d964 (0x865b bytes) 000877 1788941817.476003 fallocate 0x006886 thru 0x0103c6 (0x9b41 bytes) 000878 1788941817.481556 read 0x016369 thru 0x018985 (0x261d bytes) 000879 1788941817.500673 read 0x009df9 thru 0x00ec5b (0x4e63 bytes) 000880 1788941817.505017 MIRROR_RESYNC 3 mirrors 000881 1788941818.171822 fallocate 0x027bf8 thru 0x02f24e (0x7657 bytes) 000882 1788941818.205989 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f24f): Mirror 12: 0x3e3f548d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f24f): Mirror 12: 0x3e3f548d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f24f: skipped 000884 1788941818.463458 punch from 0x014e16 to 0x01fd76 (0xaf61 bytes) 000885 1788941818.468415 trunc from 0x00e858 to 0x01cf4c (0xe6f5 bytes) 000886 1788941818.484930 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000887 1788941818.682889 fallocate 0x01cf8c thru 0x01f483 (0x24f8 bytes) 000890 1788941818.690297 write 0x038c3f thru 0x03a571 (0x1933 bytes) 000891 1788941818.713391 trunc from 0x034cd1 to 0x03a571 (0x58a1 bytes) 000892 1788941818.724958 mapread 0x01eae8 thru 0x01f777 (0xc90 bytes) 000893 1788941818.740164 write 0x0304ba thru 0x031090 (0xbd7 bytes) 000894 1788941818.755817 write 0x0284a2 thru 0x035607 (0xd166 bytes) 000895 1788941818.766647 mapwrite 0x029bf8 thru 0x02d481 (0x388a bytes) 000896 1788941818.802124 write 0x0103d8 thru 0x020054 (0xfc7d bytes) 000897 1788941818.825128 punch from 0x022061 to 0x02fa90 (0xda30 bytes) 000898 1788941818.842577 write 0x02cc49 thru 0x0382e2 (0xb69a bytes) 000899 1788941818.873160 mapread 0x001562 thru 0x008b78 (0x7617 bytes) 000900 1788941818.889090 read 0x0184fa thru 0x01c27b (0x3d82 bytes) 000901 1788941818.890183 trunc from 0x027f79 to 0x02a929 (0x29b1 bytes) 000902 1788941818.900550 trunc from 0x03a572 to 0x01917a (0x213f7 bytes) 000903 1788941818.962354 punch from 0x0151f3 to 0x01917a (0x3f88 bytes) 000904 1788941818.976686 write 0x03581d thru 0x03c41e (0x6c02 bytes) 000906 1788941818.979565 write 0x03e238 thru 0x03ffff (0x1dc8 bytes) 000907 1788941818.980990 trunc from 0x040000 to 0x0034b0 (0x3cb4f bytes) 000908 1788941818.998956 trunc from 0x0034b1 to 0x01c558 (0x190a8 bytes) 000910 1788941819.017792 write 0x0069bc thru 0x013e03 (0xd448 bytes) 000912 1788941819.029174 read 0x00271c thru 0x007569 (0x4e4e bytes) 000913 1788941819.040391 read 0x0052ed thru 0x00a267 (0x4f7b bytes) 000914 1788941819.041066 read 0x0118a0 thru 0x01c558 (0xacb9 bytes) 000915 1788941819.042586 trunc from 0x01c559 to 0x02fb15 (0x135bd bytes) 000916 1788941819.052954 mapread 0x020841 thru 0x029dcb (0x958b bytes) 000918 1788941819.069169 fallocate 0x00e409 thru 0x01df68 (0xfb60 bytes) 000919 1788941819.073271 trunc from 0x020c50 to 0x02fb15 (0xeec6 bytes) 000920 1788941819.076827 read 0x00c340 thru 0x018065 (0xbd26 bytes) 000922 1788941819.078194 write 0x030134 thru 0x036d38 (0x6c05 bytes) 000923 1788941819.079761 trunc from 0x036d39 to 0x014848 (0x224f0 bytes) 000924 1788941819.090889 mapread 0x013b53 thru 0x014848 (0xcf6 bytes) 000925 1788941819.091849 mapread 0x001228 thru 0x002286 (0x105f bytes) 000926 1788941819.093450 trunc from 0x014849 to 0x0264fc (0x11cb4 bytes) 000927 1788941819.114928 read 0x01aa43 thru 0x021d5d (0x731b bytes) 000928 1788941819.123905 punch from 0x009f0c to 0x0138dd (0x99d2 bytes) 000930 1788941819.136332 mapread 0x001317 thru 0x00a34c (0x9036 bytes) 000931 1788941819.144808 fallocate 0x028e50 thru 0x035c54 (0xce05 bytes) 000932 1788941819.149203 fallocate 0x0120d4 thru 0x01a5af (0x84dc bytes) 000933 1788941819.158138 punch from 0x003e9b to 0x01131b (0xd481 bytes) 000934 1788941819.164299 punch from 0x00d324 to 0x01b5aa (0xe287 bytes) 000935 1788941819.170778 read 0x01fa84 thru 0x028f44 (0x94c1 bytes) 000936 1788941819.213994 mapread 0x007200 thru 0x013e41 (0xcc42 bytes) 000937 1788941819.214982 mapwrite 0x010119 thru 0x01631b (0x6203 bytes) 000938 1788941819.232459 mapwrite 0x02f5f8 thru 0x03d5bd (0xdfc6 bytes) 000939 1788941819.274380 fallocate 0x02f52d thru 0x033151 (0x3c25 bytes) 000940 1788941819.279477 mapread 0x03412e thru 0x03d5bd (0x9490 bytes) 000941 1788941819.280813 fallocate 0x009436 thru 0x00e789 (0x5354 bytes) 000942 1788941819.286333 write 0x026e59 thru 0x02f7f5 (0x899d bytes) 000943 1788941819.288670 read 0x014252 thru 0x01ab90 (0x693f bytes) 000944 1788941819.289865 trunc from 0x0192e1 to 0x01b74b (0x246b bytes) 000945 1788941819.294483 write 0x024457 thru 0x03166f (0xd219 bytes) 000946 1788941819.296961 read 0x021685 thru 0x02c998 (0xb314 bytes) 000947 1788941819.305012 MIRROR_EXTEND to 2 mirrors 000948 1788941819.866493 trunc from 0x03d5be to 0x007c8a (0x35933 bytes) 000949 1788941819.935214 read 0x003628 thru 0x007c8a (0x4663 bytes) 000950 1788941819.943224 mapread 0x000b72 thru 0x004e50 (0x42df bytes) 000951 1788941819.957864 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x7c8b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7c8b): Mirror 2: 0x7da0ad5f (stale) CRC-32 checksum value for chunk [0, 0x7c8b): Mirror 1: 0x7da0ad5f Mirror 3: 0x7da0ad5f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7c8b: skipped 000953 1788941820.630985 trunc from 0x004f44 to 0x007c8a (0x2d47 bytes) 000954 1788941820.692641 read 0x00784e thru 0x007c8a (0x43d bytes) 000955 1788941820.704073 trunc from 0x0013ab to 0x005177 (0x3dcd bytes) 000956 1788941820.709946 fallocate 0x000c84 thru 0x00c929 (0xbca6 bytes) 000957 1788941820.715387 mapread 0x008827 thru 0x009a9e (0x1278 bytes) 000958 1788941820.732612 write 0x01e6f2 thru 0x026172 (0x7a81 bytes) 000959 1788941820.736927 punch from 0x001775 to 0x00b214 (0x9aa0 bytes) 000960 1788941820.744669 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x26173): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26173): Mirror 2: 0xa0c93d95 (stale) Mirror 3: 0x21494912 (stale) CRC-32 checksum value for chunk [0, 0x26173): Mirror 1: 0xf63423d Mirror 4: 0xf63423d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26173: skipped 000961 1788941821.523906 read 0x009398 thru 0x00a41b (0x1084 bytes) 000962 1788941821.536581 mapread 0x0085b9 thru 0x0122dc (0x9d24 bytes) 000963 1788941821.584149 trunc from 0x026173 to 0x02c1aa (0x6038 bytes) 000965 1788941821.626509 fallocate 0x031898 thru 0x03612e (0x4897 bytes) 000966 1788941821.631587 read 0x0043c1 thru 0x00f757 (0xb397 bytes) 000967 1788941821.641464 trunc from 0x0043f3 to 0x013465 (0xf073 bytes) 000968 1788941821.645602 mapread 0x004f1e thru 0x006770 (0x1853 bytes) 000969 1788941821.656609 punch from 0x02546b to 0x02c254 (0x6dea bytes) 000970 1788941821.661176 read 0x00f282 thru 0x01137b (0x20fa bytes) 000971 1788941821.675640 mapwrite 0x02beea thru 0x02daf2 (0x1c09 bytes) 000972 1788941821.686787 fallocate 0x013530 thru 0x016241 (0x2d12 bytes) 000973 1788941821.690932 fallocate 0x03881b thru 0x03a761 (0x1f47 bytes) 000976 1788941821.699587 MIRROR_RESYNC 4 mirrors 000978 1788941823.108493 trunc from 0x02490f to 0x0318e3 (0xcfd5 bytes) 000979 1788941823.147474 mapread 0x028aa0 thru 0x031ad5 (0x9036 bytes) 000980 1788941823.169733 MIRROR_RESYNC 4 mirrors 000981 1788941824.303020 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000982 1788941824.675334 mapread 0x021fdf thru 0x028c7c (0x6c9e bytes) 000983 1788941824.705021 fallocate 0x018a1b thru 0x0247b4 (0xbd9a bytes) 000984 1788941824.753071 write 0x020fa7 thru 0x02922a (0x8284 bytes) 000985 1788941824.775487 read 0x030eec thru 0x038c65 (0x7d7a bytes) 000986 1788941824.797951 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3a762): Mirror 2: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a762): Mirror 2: 0x1c4224c8 (stale) Mirror 4: 0x1c4224c8 (stale) CRC-32 checksum value for chunk [0, 0x3a762): Mirror 1: 0x693f4c5b Mirror 5: 0x693f4c5b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a762: skipped 000987 1788941825.688057 fallocate 0x0346ce thru 0x03eac2 (0xa3f5 bytes) 000988 1788941825.738273 write 0x02b2c2 thru 0x03a942 (0xf681 bytes) 000989 1788941825.761374 fallocate 0x0226ba thru 0x02f2f8 (0xcc3f bytes) 000990 1788941825.767409 trunc from 0x03a943 to 0x028056 (0x128ec bytes) 000991 1788941825.792166 mapwrite 0x015732 thru 0x01777c (0x204b bytes) 000992 1788941825.829851 read 0x017e80 thru 0x018875 (0x9f6 bytes) 000993 1788941825.831826 read 0x00250e thru 0x00ee5a (0xc94d bytes) 000994 1788941825.845127 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x28057): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28057): Mirror 2: 0xc2ac1fd8 (stale) Mirror 4: 0xc2ac1fd8 (stale) Mirror 5: 0x8b043b6c (stale) CRC-32 checksum value for chunk [0, 0x28057): Mirror 1: 0xa2cd8f4a Mirror 6: 0xa2cd8f4a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28057: skipped 000995 1788941826.807997 trunc from 0x028057 to 0x038db5 (0x10d5f bytes) 000996 1788941826.859951 fallocate 0x005c2a thru 0x00d269 (0x7640 bytes) 000997 1788941826.866359 trunc from 0x0370e4 to 0x038db5 (0x1cd2 bytes) 000998 1788941826.874802 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x38db6): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38db6): Mirror 2: 0x9a7a1f5a (stale) Mirror 4: 0x9a7a1f5a (stale) Mirror 5: 0xc83b9a65 (stale) Mirror 6: 0xca107087 (stale) CRC-32 checksum value for chunk [0, 0x38db6): Mirror 1: 0xca107087 Mirror 7: 0xca107087 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38db6: skipped 000999 1788941827.972143 read 0x003a66 thru 0x012f8f (0xf52a bytes) 001000 1788941827.993901 mapread 0x00d7f6 thru 0x01c60c (0xee17 bytes) All operations completed A-OK!