== sanity-flr test 70a: flr mode fsx test ================ 13:51:24 (1782928284) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 8285 fallocating to largest ever: 0x34f99 000001 1782928285.803825 fallocate 0x0267ae thru 0x034f98 (0xe7eb bytes) 000002 1782928285.809065 trunc from 0x00de92 to 0x01cc84 (0xedf3 bytes) 000003 1782928285.811877 mapread 0x013425 thru 0x013719 (0x2f5 bytes) fallocating to largest ever: 0x40000 000004 1782928285.814612 fallocate 0x03d18e thru 0x03ffff (0x2e72 bytes) 000005 1782928285.817582 trunc from 0x034f99 to 0x016c32 (0x1e366 bytes) 000006 1782928285.829638 trunc from 0x00cc4a to 0x00cf75 (0x32c bytes) 000008 1782928285.833612 punch from 0x00ba94 to 0x016c32 (0xb19f bytes) 000009 1782928285.836402 punch from 0x0167ce to 0x016c32 (0x465 bytes) 000010 1782928285.838930 read 0x007821 thru 0x00a5fd (0x2ddd bytes) 000011 1782928285.843677 mapwrite 0x00233f thru 0x004702 (0x23c4 bytes) 000012 1782928285.858410 mapwrite 0x03c7ee thru 0x03ffff (0x3812 bytes) 000014 1782928285.876160 read 0x016087 thru 0x018659 (0x25d3 bytes) 000015 1782928285.882953 trunc from 0x00dd21 to 0x0121ed (0x44cd bytes) 000016 1782928285.885730 mapread 0x00aaf0 thru 0x01666b (0xbb7c bytes) 000017 1782928285.897399 write 0x02ffde thru 0x03a9ab (0xa9ce bytes) 000018 1782928285.898678 trunc from 0x025ef5 to 0x032ce0 (0xcdec bytes) 000019 1782928285.907415 fallocate 0x0116ff thru 0x01a180 (0x8a82 bytes) 000021 1782928285.911403 read 0x006563 thru 0x00bfd9 (0x5a77 bytes) 000022 1782928285.912290 trunc from 0x03082d to 0x03a02d (0x9801 bytes) 000023 1782928285.915324 trunc from 0x040000 to 0x03fdd8 (0x227 bytes) 000024 1782928285.924780 fallocate 0x0290d4 thru 0x02f991 (0x68be bytes) 000025 1782928285.928602 trunc from 0x03fdd9 to 0x039391 (0x6a47 bytes) 000026 1782928285.935722 mapread 0x01880e thru 0x02069c (0x7e8f bytes) 000027 1782928285.937129 mapwrite 0x0342b5 thru 0x03ffff (0xbd4b bytes) 000028 1782928285.962255 fallocate 0x000093 thru 0x004c68 (0x4bd6 bytes) 000029 1782928285.965073 mapwrite 0x026eb8 thru 0x035ab9 (0xec02 bytes) 000030 1782928285.979794 trunc from 0x040000 to 0x03d498 (0x2b67 bytes) 000031 1782928285.987759 trunc from 0x01f4a8 to 0x02e15d (0xecb6 bytes) 000032 1782928285.990784 read 0x0392ea thru 0x03d498 (0x41af bytes) 000034 1782928285.992008 trunc from 0x021941 to 0x02a2cf (0x898f bytes) 000035 1782928285.995810 punch from 0x00a963 to 0x019599 (0xec37 bytes) 000036 1782928285.998081 mapwrite 0x03ad78 thru 0x03ffff (0x5288 bytes) 000037 1782928286.025430 mapwrite 0x00e7f9 thru 0x017ede (0x96e6 bytes) 000038 1782928286.034438 trunc from 0x001c77 to 0x00e6e5 (0xca6f bytes) 000039 1782928286.038521 trunc from 0x040000 to 0x017c32 (0x283cd bytes) 000040 1782928286.046052 mapread 0x00d87e thru 0x00de80 (0x603 bytes) 000041 1782928286.048734 mapwrite 0x00d049 thru 0x019c12 (0xcbca bytes) 000042 1782928286.067175 punch from 0x0105f4 to 0x01164e (0x105b bytes) 000043 1782928286.069971 trunc from 0x00a0bc to 0x00ea40 (0x4985 bytes) 000044 1782928286.072425 write 0x0051f3 thru 0x009871 (0x467f bytes) 000045 1782928286.079648 MIRROR_EXTEND to 2 mirrors 000046 1782928286.323869 punch from 0x00364e to 0x007a98 (0x444b bytes) 000047 1782928286.339536 mapread 0x00f19e thru 0x0158fc (0x675f bytes) 000048 1782928286.350050 mapwrite 0x023db0 thru 0x030c5a (0xceab bytes) 000049 1782928286.398063 read 0x01a55f thru 0x025eec (0xb98e bytes) 000050 1782928286.401667 fallocate 0x0307b5 thru 0x03bc84 (0xb4d0 bytes) 000051 1782928286.404862 trunc from 0x00744e to 0x016f38 (0xfaeb bytes) 000052 1782928286.407921 write 0x036bee thru 0x03d249 (0x665c bytes) 000053 1782928286.411065 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d24a): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d24a): Mirror 2: 0x5d733576 (stale) CRC-32 checksum value for chunk [0, 0x3d24a): Mirror 1: 0x4139b4e9 Mirror 3: 0x4139b4e9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d24a: skipped 000054 1782928286.773920 mapwrite 0x022586 thru 0x02cc57 (0xa6d2 bytes) 000055 1782928286.831390 mapwrite 0x02785b thru 0x0357c6 (0xdf6c bytes) 000057 1782928286.845779 punch from 0x023006 to 0x029982 (0x697d bytes) 000058 1782928286.848530 trunc from 0x03d24a to 0x03383d (0x9a0c bytes) 000059 1782928286.865919 trunc from 0x03383e to 0x0034c5 (0x30378 bytes) 000060 1782928286.876379 trunc from 0x0034c6 to 0x02c9e2 (0x2951d bytes) 000061 1782928286.884180 mapread 0x02994d thru 0x02c9e2 (0x3096 bytes) 000062 1782928286.890310 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c9e3): Mirror 3: 0xd736cfc1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c9e3): Mirror 3: 0xd736cfc1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c9e3: skipped 000064 1782928287.027198 read 0x01fb74 thru 0x02c9e2 (0xce6f bytes) 000065 1782928287.034117 punch from 0x008930 to 0x013c9a (0xb36b bytes) 000066 1782928287.036061 read 0x00ba61 thru 0x01a065 (0xe605 bytes) 000067 1782928287.040298 read 0x00e83a thru 0x015780 (0x6f47 bytes) 000068 1782928287.041029 punch from 0x004455 to 0x013b63 (0xf70f bytes) 000069 1782928287.045073 MIRROR_RESYNC 2 mirrors 000070 1782928287.251963 trunc from 0x01452f to 0x01f6a2 (0xb174 bytes) 000071 1782928287.263780 write 0x021627 thru 0x030bf6 (0xf5d0 bytes) 000072 1782928287.269797 mapwrite 0x032485 thru 0x032e2c (0x9a8 bytes) 000073 1782928287.290042 fallocate 0x03f40e thru 0x03ffff (0xbf2 bytes) 000074 1782928287.292735 punch from 0x01a63a to 0x01b5cc (0xf93 bytes) 000075 1782928287.294912 write 0x00f401 thru 0x01b94b (0xc54b bytes) 000076 1782928287.302785 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000077 1782928287.367213 mapread 0x000b83 thru 0x010503 (0xf981 bytes) 000078 1782928287.385811 fallocate 0x029947 thru 0x033efb (0xa5b5 bytes) 000079 1782928287.390018 fallocate 0x02ac85 thru 0x03981c (0xeb98 bytes) 000080 1782928287.392338 fallocate 0x03ac64 thru 0x03ff15 (0x52b2 bytes) 000081 1782928287.394438 punch from 0x004999 to 0x008887 (0x3eef bytes) 000082 1782928287.396749 read 0x0366e1 thru 0x03981c (0x313c bytes) 000083 1782928287.400418 mapwrite 0x0207c1 thru 0x028a0a (0x824a bytes) 000084 1782928287.415184 fallocate 0x03df91 thru 0x03ffff (0x206f bytes) 000085 1782928287.418152 read 0x01b39f thru 0x02933e (0xdfa0 bytes) 000087 1782928287.427048 fallocate 0x03129d thru 0x03623d (0x4fa1 bytes) 000088 1782928287.430073 mapread 0x036352 thru 0x03981c (0x34cb bytes) 000089 1782928287.431213 trunc from 0x03981d to 0x03fc06 (0x63ea bytes) 000090 1782928287.438756 trunc from 0x02b7c4 to 0x033896 (0x80d3 bytes) 000091 1782928287.441895 fallocate 0x02929a thru 0x02fbae (0x6915 bytes) 000092 1782928287.444393 mapread 0x02bf3d thru 0x0303f0 (0x44b4 bytes) 000093 1782928287.459298 trunc from 0x03fc07 to 0x03ed1b (0xeeb bytes) 000094 1782928287.464834 trunc from 0x029dfd to 0x02f092 (0x5296 bytes) 000095 1782928287.467890 trunc from 0x018e38 to 0x019399 (0x562 bytes) 000096 1782928287.471173 trunc from 0x03ed1c to 0x03d841 (0x14da bytes) 000097 1782928287.478951 trunc from 0x03d842 to 0x024097 (0x197aa bytes) 000098 1782928287.484868 mapwrite 0x00dade thru 0x0105fa (0x2b1d bytes) 000100 1782928287.495226 trunc from 0x01831e to 0x024097 (0xbd7a bytes) 000101 1782928287.498057 trunc from 0x024098 to 0x02df20 (0x9e89 bytes) 000102 1782928287.506284 mapread 0x02b34d thru 0x02df20 (0x2bd4 bytes) 000103 1782928287.514187 read 0x00416e thru 0x007d63 (0x3bf6 bytes) 000104 1782928287.515309 punch from 0x009970 to 0x00fcea (0x637b bytes) 000105 1782928287.517788 read 0x01a5f3 thru 0x027b18 (0xd526 bytes) 000106 1782928287.524735 write 0x0359ca thru 0x0364f2 (0xb29 bytes) 000107 1782928287.525579 read 0x0270fa thru 0x02b111 (0x4018 bytes) 000109 1782928287.526510 mapread 0x014194 thru 0x01e26d (0xa0da bytes) 000110 1782928287.527846 mapwrite 0x000937 thru 0x0056e5 (0x4daf bytes) 000111 1782928287.537873 read 0x0218c1 thru 0x02ede6 (0xd526 bytes) 000112 1782928287.542833 mapread 0x02dd46 thru 0x02e40d (0x6c8 bytes) 000114 1782928287.545441 fallocate 0x015579 thru 0x02462f (0xf0b7 bytes) 000115 1782928287.548385 fallocate 0x02bc5a thru 0x02f608 (0x39af bytes) 000116 1782928287.553662 MIRROR_EXTEND to 2 mirrors 000117 1782928287.791841 mapwrite 0x023ff8 thru 0x02f669 (0xb672 bytes) 000118 1782928287.840933 mapwrite 0x035b4c thru 0x037de2 (0x2297 bytes) 000119 1782928287.863893 trunc from 0x037de3 to 0x01a691 (0x1d751 bytes) 000120 1782928287.870700 mapread 0x01a54c thru 0x01a691 (0x146 bytes) 000121 1782928287.883075 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000122 1782928287.942805 mapread 0x0170f3 thru 0x01a691 (0x359f bytes) 000123 1782928287.951663 trunc from 0x001e05 to 0x00db7b (0xbd77 bytes) 000124 1782928287.953921 write 0x022272 thru 0x022484 (0x213 bytes) 000125 1782928287.956276 read 0x010e35 thru 0x015b09 (0x4cd5 bytes) 000126 1782928287.960068 trunc from 0x022485 to 0x039259 (0x16dd5 bytes) 000127 1782928287.967690 mapread 0x008e49 thru 0x00aa3d (0x1bf5 bytes) 000129 1782928287.973709 punch from 0x03049e to 0x039259 (0x8dbc bytes) 000130 1782928287.976083 fallocate 0x03db57 thru 0x03ffff (0x24a9 bytes) 000131 1782928287.979158 trunc from 0x040000 to 0x033d3f (0xc2c0 bytes) 000132 1782928287.984712 trunc from 0x033d40 to 0x00fca3 (0x2409c bytes) 000133 1782928287.990089 fallocate 0x00a2e8 thru 0x0171d2 (0xceeb bytes) 000134 1782928287.992238 mapwrite 0x013452 thru 0x01391f (0x4ce bytes) 000135 1782928288.005097 mapwrite 0x01905e thru 0x024189 (0xb12c bytes) 000136 1782928288.026812 punch from 0x00d401 to 0x01ac30 (0xd830 bytes) 000137 1782928288.029815 trunc from 0x01ba4a to 0x01c25b (0x812 bytes) 000139 1782928288.033207 mapwrite 0x0031ff thru 0x007d01 (0x4b03 bytes) 000140 1782928288.041165 mapwrite 0x010cc7 thru 0x0167ea (0x5b24 bytes) 000141 1782928288.055570 read 0x002c4b thru 0x0111f2 (0xe5a8 bytes) 000142 1782928288.056482 read 0x01f934 thru 0x024189 (0x4856 bytes) 000143 1782928288.057005 read 0x015be8 thru 0x01cd0a (0x7123 bytes) 000144 1782928288.064854 punch from 0x006b36 to 0x012751 (0xbc1c bytes) 000145 1782928288.068039 punch from 0x01604a to 0x019555 (0x350c bytes) 000146 1782928288.072606 MIRROR_EXTEND to 2 mirrors 000147 1782928288.311532 mapwrite 0x028095 thru 0x035dc9 (0xdd35 bytes) 000148 1782928288.364691 read 0x018a17 thru 0x01e8e8 (0x5ed2 bytes) 000149 1782928288.369141 mapwrite 0x01d673 thru 0x024591 (0x6f1f bytes) 000150 1782928288.380831 trunc from 0x035dca to 0x023993 (0x12436 bytes) 000151 1782928288.390374 write 0x0012cb thru 0x00b059 (0x9d8f bytes) 000152 1782928288.395154 punch from 0x00d310 to 0x019631 (0xc322 bytes) 000153 1782928288.397415 mapread 0x015f66 thru 0x023993 (0xda2e bytes) 000154 1782928288.402505 punch from 0x0020ae to 0x007b49 (0x5a9c bytes) 000155 1782928288.408540 trunc from 0x023994 to 0x03930a (0x15977 bytes) 000156 1782928288.413591 mapread 0x01c39b thru 0x029c7b (0xd8e1 bytes) 000157 1782928288.418607 trunc from 0x0202b3 to 0x0245c7 (0x4315 bytes) 000158 1782928288.422537 write 0x0178c7 thru 0x0278c6 (0x10000 bytes) 000159 1782928288.424422 read 0x036921 thru 0x03930a (0x29ea bytes) 000160 1782928288.429523 trunc from 0x033168 to 0x035e41 (0x2cda bytes) 000161 1782928288.432082 mapwrite 0x01a36b thru 0x021d31 (0x79c7 bytes) 000162 1782928288.441049 write 0x002471 thru 0x00ebd9 (0xc769 bytes) 000163 1782928288.442581 punch from 0x00dae2 to 0x0124f5 (0x4a14 bytes) 000164 1782928288.447832 mapwrite 0x00653d thru 0x014423 (0xdee7 bytes) 000165 1782928288.471132 trunc from 0x03930b to 0x03f7b0 (0x64a6 bytes) 000167 1782928288.481654 write 0x01b55e thru 0x02158d (0x6030 bytes) 000168 1782928288.482663 write 0x020f58 thru 0x02dbab (0xcc54 bytes) 000169 1782928288.483958 fallocate 0x017986 thru 0x022bb7 (0xb232 bytes) 000170 1782928288.486736 trunc from 0x03f7b1 to 0x0019d8 (0x3ddd8 bytes) 000171 1782928288.498817 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000173 1782928288.565062 read 0x0012a2 thru 0x0019d8 (0x737 bytes) 000174 1782928288.572539 fallocate 0x026353 thru 0x02b5c1 (0x526f bytes) 000175 1782928288.575605 fallocate 0x004108 thru 0x0124e9 (0xe3e2 bytes) 000178 1782928288.584406 mapwrite 0x011059 thru 0x01d8f5 (0xc89d bytes) 000179 1782928288.624355 fallocate 0x011f8b thru 0x01dc7b (0xbcf1 bytes) 000180 1782928288.627904 punch from 0x01b234 to 0x01d445 (0x2212 bytes) 000181 1782928288.631619 fallocate 0x01b9c0 thru 0x01c6f8 (0xd39 bytes) 000182 1782928288.634331 mapread 0x01849e thru 0x01dc7b (0x57de bytes) 000183 1782928288.638490 punch from 0x003bce to 0x012645 (0xea78 bytes) 000184 1782928288.641355 trunc from 0x01dc7c to 0x0176a8 (0x65d3 bytes) 000185 1782928288.649274 trunc from 0x0176a9 to 0x02f148 (0x17aa0 bytes) 000186 1782928288.655446 mapread 0x02baf1 thru 0x02f148 (0x3658 bytes) 000187 1782928288.663234 punch from 0x02ce45 to 0x02f148 (0x2304 bytes) 000188 1782928288.667433 mapwrite 0x01a886 thru 0x01b248 (0x9c3 bytes) 000189 1782928288.677186 punch from 0x001cfb to 0x00b5dd (0x98e3 bytes) 000190 1782928288.679730 trunc from 0x02f149 to 0x0237f8 (0xb950 bytes) 000191 1782928288.686727 read 0x01a8be thru 0x0237f8 (0x8f3b bytes) 000192 1782928288.691187 fallocate 0x00c130 thru 0x00c19c (0x6d bytes) 000193 1782928288.694087 mapwrite 0x03951e thru 0x03ffff (0x6ae2 bytes) 000194 1782928288.716708 fallocate 0x01437e thru 0x01c5ee (0x8271 bytes) 000195 1782928288.722634 trunc from 0x040000 to 0x01fa31 (0x205ce bytes) 000196 1782928288.728852 mapread 0x010213 thru 0x0114a0 (0x128e bytes) 000197 1782928288.729578 mapread 0x017598 thru 0x018840 (0x12a9 bytes) 000198 1782928288.730583 punch from 0x00ff4e to 0x01afa2 (0xb055 bytes) 000199 1782928288.733107 read 0x00552f thru 0x014e14 (0xf8e6 bytes) 000200 1782928288.737732 write 0x0334d4 thru 0x03cca7 (0x97d4 bytes) 000201 1782928288.739434 write 0x0013ff thru 0x009cbf (0x88c1 bytes) 000203 1782928288.741437 fallocate 0x011afb thru 0x01a85c (0x8d62 bytes) 000204 1782928288.743475 mapwrite 0x0036fc thru 0x004f75 (0x187a bytes) 000206 1782928288.753405 punch from 0x033635 to 0x035a94 (0x2460 bytes) 000207 1782928288.756017 write 0x0160aa thru 0x01f17c (0x90d3 bytes) 000208 1782928288.757340 mapwrite 0x0101af thru 0x018269 (0x80bb bytes) 000209 1782928288.767635 write 0x019576 thru 0x01ea66 (0x54f1 bytes) 000210 1782928288.768853 punch from 0x019c47 to 0x028684 (0xea3e bytes) 000211 1782928288.775243 read 0x00191c thru 0x009f41 (0x8626 bytes) 000212 1782928288.775844 punch from 0x0332aa to 0x035ddb (0x2b32 bytes) 000214 1782928288.779087 trunc from 0x03cca8 to 0x03ee89 (0x21e2 bytes) 000215 1782928288.795383 trunc from 0x03ee8a to 0x035026 (0x9e63 bytes) 000216 1782928288.805421 trunc from 0x035027 to 0x01b966 (0x196c0 bytes) 000217 1782928288.819958 trunc from 0x01b967 to 0x007538 (0x1442e bytes) 000219 1782928288.830901 punch from 0x004843 to 0x007538 (0x2cf6 bytes) 000220 1782928288.836086 mapwrite 0x0349c6 thru 0x03ffff (0xb63a bytes) 000221 1782928288.869629 mapread 0x008911 thru 0x00b87f (0x2f6f bytes) 000222 1782928288.870748 write 0x0013ac thru 0x00f4d5 (0xe12a bytes) 000223 1782928288.872433 trunc from 0x027db8 to 0x02b831 (0x3a7a bytes) 000224 1782928288.875754 punch from 0x00da61 to 0x00ff1e (0x24be bytes) 000225 1782928288.882664 fallocate 0x02b0fe thru 0x039032 (0xdf35 bytes) 000227 1782928288.887376 write 0x0128bc thru 0x01df9f (0xb6e4 bytes) 000228 1782928288.889238 mapread 0x028f62 thru 0x030440 (0x74df bytes) 000229 1782928288.903261 mapread 0x008172 thru 0x00fd08 (0x7b97 bytes) 000230 1782928288.912328 trunc from 0x040000 to 0x03dfa9 (0x2056 bytes) 000231 1782928288.919016 trunc from 0x031769 to 0x03b203 (0x9a9b bytes) 000232 1782928288.923163 mapwrite 0x02426e thru 0x024a37 (0x7ca bytes) 000233 1782928288.934833 fallocate 0x03d5c9 thru 0x03ffff (0x2a37 bytes) 000234 1782928288.937690 read 0x007067 thru 0x015bf2 (0xeb8c bytes) 000235 1782928288.938213 write 0x016e31 thru 0x01d7c2 (0x6992 bytes) 000238 1782928288.940463 trunc from 0x01a91c to 0x0257e0 (0xaec5 bytes) 000239 1782928288.946178 mapwrite 0x0387f9 thru 0x03a7b0 (0x1fb8 bytes) 000240 1782928288.959652 trunc from 0x009b13 to 0x019658 (0xfb46 bytes) 000241 1782928288.962183 write 0x0178b3 thru 0x01ff4e (0x869c bytes) 000242 1782928288.966610 trunc from 0x03dfaa to 0x01a79f (0x2380a bytes) 000243 1782928288.977235 trunc from 0x008e38 to 0x013d6c (0xaf35 bytes) 000244 1782928288.979597 read 0x016cdb thru 0x01a79f (0x3ac5 bytes) 000245 1782928288.984421 mapwrite 0x01a8b6 thru 0x01fdec (0x5537 bytes) 000246 1782928289.002327 fallocate 0x0071fe thru 0x010460 (0x9263 bytes) 000247 1782928289.005234 punch from 0x0150c8 to 0x01fc81 (0xabba bytes) 000248 1782928289.008612 mapwrite 0x0311ff thru 0x0314b0 (0x2b2 bytes) 000249 1782928289.024471 mapwrite 0x02750f thru 0x030d76 (0x9868 bytes) 000250 1782928289.036137 mapread 0x024aa0 thru 0x0314b0 (0xca11 bytes) 000251 1782928289.037568 mapread 0x0265e8 thru 0x030b0e (0xa527 bytes) 000252 1782928289.038663 trunc from 0x01d2b7 to 0x02adf7 (0xdb41 bytes) 000253 1782928289.041850 write 0x01b08c thru 0x028be1 (0xdb56 bytes) 000254 1782928289.047700 punch from 0x01dd8f to 0x02956b (0xb7dd bytes) 000255 1782928289.054053 mapread 0x006363 thru 0x00f62b (0x92c9 bytes) 000256 1782928289.055264 trunc from 0x0314b1 to 0x003c57 (0x2d859 bytes) 000257 1782928289.064756 write 0x02060f thru 0x0211e8 (0xbda bytes) 000258 1782928289.065545 read 0x01fd46 thru 0x0211e8 (0x14a3 bytes) 000259 1782928289.068935 write 0x02abcc thru 0x037c02 (0xd037 bytes) 000260 1782928289.070058 mapwrite 0x0359af thru 0x03ffff (0xa651 bytes) 000261 1782928289.092538 trunc from 0x0373ed to 0x03ffff (0x8c13 bytes) 000262 1782928289.095535 trunc from 0x040000 to 0x00bd6f (0x34290 bytes) 000263 1782928289.102639 trunc from 0x00498b to 0x00bd6f (0x73e5 bytes) 000264 1782928289.104774 mapread 0x0014ae thru 0x00723e (0x5d91 bytes) 000265 1782928289.113132 trunc from 0x0007a7 to 0x004dd1 (0x462b bytes) 000266 1782928289.116237 punch from 0x00aa4e to 0x00bd6f (0x1322 bytes) 000267 1782928289.118023 fallocate 0x012616 thru 0x020eba (0xe8a5 bytes) 000269 1782928289.121615 fallocate 0x004d2d thru 0x012a76 (0xdd4a bytes) 000270 1782928289.124330 trunc from 0x012a77 to 0x02fa68 (0x1cff2 bytes) 000271 1782928289.133465 fallocate 0x036dd9 thru 0x036e80 (0xa8 bytes) 000272 1782928289.138716 MIRROR_EXTEND to 2 mirrors 000273 1782928289.381110 fallocate 0x03b3e0 thru 0x03ffff (0x4c20 bytes) 000274 1782928289.397021 MIRROR_RESYNC 2 mirrors 000275 1782928289.663527 trunc from 0x0316e0 to 0x032212 (0xb33 bytes) 000276 1782928289.678433 punch from 0x022a88 to 0x026661 (0x3bda bytes) 000277 1782928289.683978 MIRROR_RESYNC 2 mirrors 000278 1782928289.926150 punch from 0x0131e2 to 0x015ef7 (0x2d16 bytes) 000279 1782928289.944682 MIRROR_RESYNC 2 mirrors 000280 1782928290.165532 punch from 0x00df24 to 0x01b808 (0xd8e5 bytes) 000281 1782928290.179819 read 0x011f7a thru 0x01f243 (0xd2ca bytes) 000282 1782928290.184377 mapwrite 0x03b794 thru 0x03ffff (0x486c bytes) 000283 1782928290.212205 mapwrite 0x029b37 thru 0x02db16 (0x3fe0 bytes) 000284 1782928290.225700 trunc from 0x01d730 to 0x02cf7b (0xf84c bytes) 000286 1782928290.231611 fallocate 0x00244d thru 0x00bccf (0x9883 bytes) 000287 1782928290.234612 trunc from 0x040000 to 0x02cddc (0x13223 bytes) 000288 1782928290.241304 mapread 0x0242d8 thru 0x02814d (0x3e76 bytes) 000289 1782928290.245658 trunc from 0x02cddd to 0x00edd8 (0x1e004 bytes) 000290 1782928290.253287 read 0x005ce7 thru 0x00edd8 (0x90f2 bytes) 000291 1782928290.257648 fallocate 0x0291b3 thru 0x02ba3f (0x288d bytes) 000292 1782928290.260673 mapread 0x0266da thru 0x02ba3f (0x5366 bytes) 000293 1782928290.266509 mapwrite 0x03a535 thru 0x03deb6 (0x3982 bytes) 000294 1782928290.290509 trunc from 0x03deb7 to 0x018d9d (0x25119 bytes) 000295 1782928290.298894 read 0x001542 thru 0x00de0d (0xc8cc bytes) 000296 1782928290.299693 mapread 0x004e7d thru 0x0092cf (0x4453 bytes) 000297 1782928290.300436 mapwrite 0x0297d1 thru 0x0303ec (0x6c1c bytes) 000298 1782928290.321405 punch from 0x009731 to 0x01183e (0x810e bytes) 000299 1782928290.324584 trunc from 0x0303ed to 0x023754 (0xcc98 bytes) 000301 1782928290.341049 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x23755): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23755): Mirror 2: 0xee096c (stale) CRC-32 checksum value for chunk [0, 0x23755): Mirror 1: 0xee096c Mirror 3: 0xee096c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23755: skipped 000302 1782928290.690467 trunc from 0x023755 to 0x025ae6 (0x2392 bytes) 000303 1782928290.713506 trunc from 0x025ae7 to 0x00d2f5 (0x187f1 bytes) 000304 1782928290.722685 MIRROR_RESYNC 3 mirrors 000305 1782928290.985907 punch from 0x00d2aa to 0x00d2f5 (0x4c bytes) 000306 1782928291.011040 mapread 0x00682e thru 0x00d2f5 (0x6ac8 bytes) 000307 1782928291.022748 mapread 0x006e0a thru 0x00d2f5 (0x64ec bytes) 000309 1782928291.024870 punch from 0x00657e to 0x00d2f5 (0x6d78 bytes) 000310 1782928291.028365 fallocate 0x01b5b3 thru 0x021b3d (0x658b bytes) 000312 1782928291.033048 fallocate 0x038661 thru 0x03ffff (0x799f bytes) 000313 1782928291.037513 trunc from 0x011817 to 0x01f133 (0xd91d bytes) 000314 1782928291.040376 trunc from 0x019629 to 0x01ebb1 (0x5589 bytes) 000316 1782928291.045685 mapread 0x00c6eb thru 0x0156be (0x8fd4 bytes) 000317 1782928291.060117 write 0x0266fa thru 0x032aa7 (0xc3ae bytes) 000318 1782928291.072128 write 0x00fc09 thru 0x01825a (0x8652 bytes) 000319 1782928291.075609 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) Mirror 3: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3fef6350 Mirror 4: 0x3fef6350 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000320 1782928291.443743 trunc from 0x040000 to 0x013cf3 (0x2c30c bytes) 000321 1782928291.480630 trunc from 0x013cf4 to 0x03153e (0x1d84b bytes) 000322 1782928291.500028 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3153f): Mirror 3: 0x42981538 (stale) Mirror 4: 0xcd02cafb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3153f): Mirror 3: 0x42981538 (stale) Mirror 4: 0xcd02cafb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3153f: skipped 000323 1782928291.615658 write 0x0224e2 thru 0x02fd4b (0xd86a bytes) 000324 1782928291.622833 trunc from 0x0080e5 to 0x008a58 (0x974 bytes) 000325 1782928291.628678 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3153f): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3153f): Mirror 3: 0x42981538 (stale) Mirror 4: 0xcd02cafb (stale) CRC-32 checksum value for chunk [0, 0x3153f): Mirror 1: 0x7f3d05d1 Mirror 5: 0x7f3d05d1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3153f: skipped 000326 1782928292.009257 trunc from 0x02d606 to 0x03153e (0x3f39 bytes) 000328 1782928292.025904 punch from 0x029a85 to 0x02b05f (0x15db bytes) 000329 1782928292.029757 mapread 0x00e926 thru 0x0187dd (0x9eb8 bytes) 000330 1782928292.037015 read 0x0115d4 thru 0x016096 (0x4ac3 bytes) 000331 1782928292.037912 trunc from 0x03153f to 0x035069 (0x3b2b bytes) 000332 1782928292.052784 mapread 0x019182 thru 0x01fbcd (0x6a4c bytes) 000333 1782928292.056365 trunc from 0x03506a to 0x03e7a4 (0x973b bytes) 000334 1782928292.063588 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e7a5): Mirror 3: 0x564dfa83 (stale) Mirror 5: 0x671dce37 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e7a5): Mirror 3: 0x564dfa83 (stale) Mirror 5: 0x671dce37 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e7a5: skipped 000335 1782928292.205583 fallocate 0x0321ec thru 0x039297 (0x70ac bytes) 000336 1782928292.209746 mapread 0x01cddb thru 0x0267e2 (0x9a08 bytes) 000337 1782928292.228158 write 0x03b55d thru 0x03ffff (0x4aa3 bytes) 000338 1782928292.235426 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) Mirror 5: 0x4ae79eb4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x19e595a Mirror 6: 0x19e595a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000339 1782928292.650388 read 0x030b13 thru 0x039255 (0x8743 bytes) 000340 1782928292.656412 mapwrite 0x007870 thru 0x013505 (0xbc96 bytes) 000341 1782928292.724637 fallocate 0x01f60f thru 0x02a3a1 (0xad93 bytes) 000342 1782928292.728786 trunc from 0x040000 to 0x035080 (0xaf7f bytes) 000343 1782928292.746875 mapwrite 0x004c51 thru 0x00e038 (0x93e8 bytes) 000344 1782928292.760013 mapread 0x02b824 thru 0x035080 (0x985d bytes) 000345 1782928292.767810 trunc from 0x007801 to 0x010ce3 (0x94e3 bytes) 000346 1782928292.773260 read 0x00e6c2 thru 0x00eed1 (0x810 bytes) 000347 1782928292.780413 write 0x025d5d thru 0x031df3 (0xc097 bytes) 000349 1782928292.782419 trunc from 0x00fe0e to 0x01eea0 (0xf093 bytes) 000350 1782928292.787576 write 0x00e859 thru 0x00fe2c (0x15d4 bytes) 000352 1782928292.791199 write 0x017380 thru 0x021c0e (0xa88f bytes) 000353 1782928292.794762 trunc from 0x035081 to 0x00cb21 (0x2855f bytes) 000354 1782928292.804081 trunc from 0x00cb22 to 0x02f8e0 (0x22dbf bytes) 000355 1782928292.814998 punch from 0x02a855 to 0x02f8e0 (0x508c bytes) 000356 1782928292.817703 fallocate 0x031544 thru 0x03d89b (0xc358 bytes) 000357 1782928292.820512 read 0x01b17b thru 0x027038 (0xbebe bytes) 000358 1782928292.828914 read 0x006204 thru 0x00ac41 (0x4a3e bytes) 000359 1782928292.829467 write 0x00bc7f thru 0x00d8df (0x1c61 bytes) 000360 1782928292.830569 mapread 0x02efea thru 0x02f8e0 (0x8f7 bytes) 000361 1782928292.833952 MIRROR_RESYNC 4 mirrors 000362 1782928293.271026 mapread 0x00df95 thru 0x010c56 (0x2cc2 bytes) 000363 1782928293.282199 mapwrite 0x01e149 thru 0x02d505 (0xf3bd bytes) 000364 1782928293.347886 trunc from 0x02ebc8 to 0x02f8e0 (0xd19 bytes) 000365 1782928293.352772 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2f8e1): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f8e1): Mirror 3: 0x25badc6 (stale) Mirror 5: 0x25badc6 (stale) Mirror 6: 0x25badc6 (stale) CRC-32 checksum value for chunk [0, 0x2f8e1): Mirror 1: 0x141c3e28 Mirror 7: 0x141c3e28 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f8e1: skipped 000366 1782928293.820815 write 0x00f015 thru 0x015381 (0x636d bytes) 000367 1782928293.848365 mapread 0x00c2ee thru 0x012f0c (0x6c1f bytes) 000368 1782928293.859429 trunc from 0x015174 to 0x021d79 (0xcc06 bytes) 000369 1782928293.869275 mapwrite 0x000dbe thru 0x00aa33 (0x9c76 bytes) 000370 1782928293.887492 trunc from 0x02f8e1 to 0x00ad9c (0x24b44 bytes) 000371 1782928293.904623 write 0x01a40e thru 0x01e6ee (0x42e1 bytes) 000372 1782928293.906722 read 0x013e16 thru 0x01e6ee (0xa8d9 bytes) 000374 1782928293.913290 fallocate 0x0100c7 thru 0x018155 (0x808f bytes) 000375 1782928293.918922 mapread 0x004420 thru 0x00b5d2 (0x71b3 bytes) 000376 1782928293.926063 fallocate 0x015195 thru 0x02389a (0xe706 bytes) 000377 1782928293.929290 trunc from 0x01d73d to 0x01e6ee (0xfb2 bytes) 000379 1782928293.936098 write 0x020ad0 thru 0x02a13c (0x966d bytes) 000380 1782928293.937742 mapread 0x00a807 thru 0x00e0ae (0x38a8 bytes) 000381 1782928293.939053 trunc from 0x02a13d to 0x007e5e (0x222de bytes) 000382 1782928293.947016 trunc from 0x0025b9 to 0x00747f (0x4ec7 bytes) 000383 1782928293.950364 mapread 0x000a3b thru 0x007e5e (0x7424 bytes) 000384 1782928293.954636 trunc from 0x005730 to 0x007e5e (0x272f bytes) 000385 1782928293.957214 write 0x020213 thru 0x02f95c (0xf74a bytes) 000386 1782928293.959539 punch from 0x016f4b to 0x01b9c8 (0x4a7e bytes) 000387 1782928293.963494 write 0x026d1b thru 0x02fd62 (0x9048 bytes) 000389 1782928293.966747 fallocate 0x0300da thru 0x03ad05 (0xac2c bytes) 000390 1782928293.970368 fallocate 0x004dc0 thru 0x006170 (0x13b1 bytes) 000391 1782928293.974139 mapread 0x01c835 thru 0x01f9ae (0x317a bytes) 000392 1782928293.980581 trunc from 0x0024b3 to 0x01228f (0xfddd bytes) 000393 1782928293.984124 mapread 0x009fa0 thru 0x01537f (0xb3e0 bytes) 000394 1782928293.993117 punch from 0x01425c to 0x022873 (0xe618 bytes) 000395 1782928294.007019 read 0x01817a thru 0x01a4dc (0x2363 bytes) 000396 1782928294.011683 fallocate 0x01bcaf thru 0x01cbbd (0xf0f bytes) 000397 1782928294.016649 punch from 0x01a1bf to 0x0280a5 (0xdee7 bytes) 000398 1782928294.022464 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fd63): Mirror 5: 0x2e65f944 (stale) Mirror 6: 0x2e65f944 (stale) Mirror 7: 0xddbeadce (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fd63): Mirror 5: 0x2e65f944 (stale) Mirror 6: 0x2e65f944 (stale) Mirror 7: 0xddbeadce (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fd63: skipped 000399 1782928294.178005 punch from 0x00ebdc to 0x01dbce (0xeff3 bytes) 000400 1782928294.182513 trunc from 0x02f46c to 0x02fd62 (0x8f7 bytes) 000402 1782928294.188311 trunc from 0x015d80 to 0x01dcf9 (0x7f7a bytes) 000403 1782928294.193700 mapread 0x01ebaf thru 0x02cd2c (0xe17e bytes) 000404 1782928294.212960 mapwrite 0x00cf1f thru 0x0169f7 (0x9ad9 bytes) 000406 1782928294.239447 trunc from 0x02fd63 to 0x00cd1e (0x23044 bytes) 000407 1782928294.254942 write 0x0394b7 thru 0x03ffff (0x6b49 bytes) 000408 1782928294.256340 trunc from 0x040000 to 0x0302e8 (0xfd17 bytes) 000409 1782928294.265996 fallocate 0x03816b thru 0x03ffff (0x7e95 bytes) 000410 1782928294.270139 trunc from 0x002ba5 to 0x00fea2 (0xd2fe bytes) 000411 1782928294.280043 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x3cee80c3 (stale) Mirror 6: 0x3cee80c3 (stale) Mirror 7: 0xe50b8835 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcf6e2ac9 Mirror 8: 0xcf6e2ac9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000412 1782928294.656087 read 0x00e402 thru 0x01d2a8 (0xeea7 bytes) 000413 1782928294.666116 mapread 0x007af1 thru 0x009dfc (0x230c bytes) 000414 1782928294.691987 punch from 0x026d7f to 0x02da17 (0x6c99 bytes) 000415 1782928294.717152 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x3cee80c3 (stale) Mirror 7: 0xe50b8835 (stale) Mirror 8: 0xcf6e2ac9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x3cee80c3 (stale) Mirror 7: 0xe50b8835 (stale) Mirror 8: 0xcf6e2ac9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000416 1782928294.946293 mapread 0x01cd50 thru 0x01f6fe (0x29af bytes) 000417 1782928294.959196 trunc from 0x008a2d to 0x00ef47 (0x651b bytes) 000419 1782928294.962776 punch from 0x0021cf to 0x00eaa1 (0xc8d3 bytes) 000420 1782928294.969990 trunc from 0x040000 to 0x031090 (0xef6f bytes) 000421 1782928294.996047 mapwrite 0x009e24 thru 0x00d158 (0x3335 bytes) 000422 1782928295.009218 write 0x02516d thru 0x033470 (0xe304 bytes) 000423 1782928295.010668 read 0x011673 thru 0x01941c (0x7daa bytes) 000424 1782928295.015698 trunc from 0x033471 to 0x038190 (0x4d20 bytes) 000426 1782928295.023940 read 0x0272cf thru 0x034cde (0xda10 bytes) 000427 1782928295.028613 trunc from 0x00b776 to 0x015788 (0xa013 bytes) 000428 1782928295.031788 punch from 0x014d16 to 0x021edd (0xd1c8 bytes) 000429 1782928295.035428 read 0x02e51a thru 0x033e5c (0x5943 bytes) 000430 1782928295.036325 fallocate 0x00daf5 thru 0x012e1b (0x5327 bytes) 000432 1782928295.039514 trunc from 0x0250a3 to 0x033608 (0xe566 bytes) 000433 1782928295.046307 fallocate 0x03daf2 thru 0x03f134 (0x1643 bytes) 000434 1782928295.050192 trunc from 0x02d369 to 0x02e37e (0x1016 bytes) 000435 1782928295.052944 trunc from 0x0174f1 to 0x0248c0 (0xd3d0 bytes) 000436 1782928295.055579 punch from 0x024715 to 0x029487 (0x4d73 bytes) 000437 1782928295.060465 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38191): Mirror 6: 0xf7f177f2 (stale) Mirror 8: 0xd9b98558 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38191): Mirror 6: 0xf7f177f2 (stale) Mirror 8: 0xd9b98558 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38191: skipped 000438 1782928295.259185 mapread 0x00338b thru 0x006499 (0x310f bytes) 000439 1782928295.275626 mapwrite 0x01f453 thru 0x0218cc (0x247a bytes) 000440 1782928295.298724 fallocate 0x035810 thru 0x03b3b3 (0x5ba4 bytes) 000441 1782928295.303604 trunc from 0x026b65 to 0x0298a3 (0x2d3f bytes) 000442 1782928295.308495 fallocate 0x00ff12 thru 0x01941d (0x950c bytes) 000443 1782928295.313411 read 0x00e6d0 thru 0x0170c0 (0x89f1 bytes) 000444 1782928295.321434 trunc from 0x03b3b4 to 0x03fd4f (0x499c bytes) 000445 1782928295.338650 punch from 0x01bb86 to 0x02749f (0xb91a bytes) 000446 1782928295.343050 fallocate 0x01c5b6 thru 0x01eb85 (0x25d0 bytes) 000447 1782928295.346445 mapwrite 0x021618 thru 0x02bb49 (0xa532 bytes) 000448 1782928295.374518 write 0x00bda1 thru 0x014056 (0x82b6 bytes) 000451 1782928295.377346 mapwrite 0x0389e3 thru 0x03ffff (0x761d bytes) 000452 1782928295.400887 trunc from 0x011c6a to 0x018b48 (0x6edf bytes) 000453 1782928295.406488 fallocate 0x021463 thru 0x0228be (0x145c bytes) 000454 1782928295.410324 mapwrite 0x0113b3 thru 0x01a1f3 (0x8e41 bytes) 000455 1782928295.432143 mapread 0x00710a thru 0x00e0aa (0x6fa1 bytes) 000456 1782928295.433568 fallocate 0x02e8b9 thru 0x032280 (0x39c8 bytes) 000457 1782928295.436663 punch from 0x0329f3 to 0x03ffff (0xd60d bytes) 000459 1782928295.445843 MIRROR_RESYNC 3 mirrors 000461 1782928295.993077 mapread 0x033c40 thru 0x03ffff (0xc3c0 bytes) 000462 1782928296.006176 mapread 0x01b498 thru 0x01ba5e (0x5c7 bytes) 000463 1782928296.017718 MIRROR_EXTEND to 4 mirrors 000465 1782928296.430488 read 0x002960 thru 0x0041cf (0x1870 bytes) 000466 1782928296.437092 trunc from 0x040000 to 0x03715f (0x8ea0 bytes) 000467 1782928296.471822 write 0x03885f thru 0x03ffff (0x77a1 bytes) 000468 1782928296.477600 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x511f1919 (stale) Mirror 8: 0x511f1919 (stale) Mirror 9: 0x511f1919 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9388cb46 Mirror 10: 0x9388cb46 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000469 1782928296.988685 punch from 0x0071fb to 0x008b62 (0x1968 bytes) 000470 1782928297.010957 fallocate 0x017ecd thru 0x01815c (0x290 bytes) 000471 1782928297.013643 trunc from 0x02760a to 0x033bb5 (0xc5ac bytes) 000474 1782928297.017514 punch from 0x029eb3 to 0x038a0d (0xeb5b bytes) 000475 1782928297.021120 fallocate 0x00a76d thru 0x01250d (0x7da1 bytes) 000476 1782928297.024294 mapwrite 0x00ef5a thru 0x013f62 (0x5009 bytes) 000477 1782928297.051169 mapwrite 0x003c84 thru 0x009c45 (0x5fc2 bytes) 000480 1782928297.070807 mapwrite 0x015367 thru 0x0166be (0x1358 bytes) 000481 1782928297.084398 trunc from 0x02a9c6 to 0x03749c (0xcad7 bytes) 000482 1782928297.087859 read 0x01b794 thru 0x01d3e0 (0x1c4d bytes) 000483 1782928297.091488 trunc from 0x040000 to 0x034c3b (0xb3c4 bytes) 000484 1782928297.106701 mapread 0x01dddf thru 0x02d966 (0xfb88 bytes) 000485 1782928297.118671 mapwrite 0x033c7f thru 0x03bd67 (0x80e9 bytes) 000486 1782928297.148909 mapread 0x039323 thru 0x039bc5 (0x8a3 bytes) 000487 1782928297.149944 punch from 0x0237a7 to 0x0266dc (0x2f36 bytes) 000488 1782928297.153103 mapread 0x006239 thru 0x012436 (0xc1fe bytes) 000489 1782928297.153989 punch from 0x007d1b to 0x015c5a (0xdf40 bytes) 000491 1782928297.159949 trunc from 0x03bd68 to 0x02a388 (0x119df bytes) 000492 1782928297.170532 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a389): Mirror 8: 0xa77cc8f (stale) Mirror 9: 0xa77cc8f (stale) Mirror 10: 0xa77cc8f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a389): Mirror 8: 0xa77cc8f (stale) Mirror 9: 0xa77cc8f (stale) Mirror 10: 0xa77cc8f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a389: skipped 000493 1782928297.318254 mapwrite 0x0284d0 thru 0x031804 (0x9335 bytes) 000495 1782928297.353874 mapwrite 0x01b49a thru 0x021e8f (0x69f6 bytes) 000496 1782928297.373773 punch from 0x003b76 to 0x00d0f9 (0x9584 bytes) 000497 1782928297.377042 mapread 0x013cc4 thru 0x02054b (0xc888 bytes) 000498 1782928297.381655 fallocate 0x036700 thru 0x03ffff (0x9900 bytes) 000499 1782928297.385339 write 0x0187ad thru 0x02435c (0xbbb0 bytes) 000500 1782928297.386736 punch from 0x0274ee to 0x0289bb (0x14ce bytes) 000501 1782928297.389392 read 0x033ad6 thru 0x03d33b (0x9866 bytes) 000502 1782928297.393102 punch from 0x033239 to 0x03ffff (0xcdc7 bytes) 000503 1782928297.395119 trunc from 0x040000 to 0x019847 (0x267b8 bytes) 000504 1782928297.401408 fallocate 0x005e92 thru 0x00ef3f (0x90ae bytes) 000505 1782928297.404221 fallocate 0x00c288 thru 0x017fab (0xbd24 bytes) 000507 1782928297.407529 mapwrite 0x0261b9 thru 0x031ba8 (0xb9f0 bytes) 000508 1782928297.433732 read 0x01feb6 thru 0x025d39 (0x5e84 bytes) 000509 1782928297.434613 trunc from 0x009c76 to 0x0148a8 (0xac33 bytes) 000510 1782928297.437293 trunc from 0x02f407 to 0x031ba8 (0x27a2 bytes) 000512 1782928297.440890 read 0x01e30b thru 0x01f60d (0x1303 bytes) 000513 1782928297.446598 read 0x029748 thru 0x031ba8 (0x8461 bytes) 000514 1782928297.449204 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x31ba9): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31ba9): Mirror 8: 0xa42a5e2a (stale) Mirror 9: 0xa42a5e2a (stale) Mirror 10: 0xa42a5e2a (stale) CRC-32 checksum value for chunk [0, 0x31ba9): Mirror 1: 0xed2f19d2 Mirror 11: 0xed2f19d2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31ba9: skipped 000516 1782928297.861470 mapwrite 0x022bda thru 0x024606 (0x1a2d bytes) 000517 1782928297.912950 write 0x000c07 thru 0x00cf37 (0xc331 bytes) 000518 1782928297.925480 MIRROR_RESYNC 5 mirrors 000519 1782928298.620987 mapwrite 0x01879f thru 0x01deab (0x570d bytes) 000521 1782928298.684025 trunc from 0x031ba9 to 0x027ca8 (0x9f00 bytes) 000522 1782928298.698343 punch from 0x0118ee to 0x0140c6 (0x27d9 bytes) 000523 1782928298.709743 trunc from 0x027ca9 to 0x0290aa (0x1402 bytes) 000524 1782928298.724875 trunc from 0x001299 to 0x0095ab (0x8313 bytes) 000525 1782928298.734495 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x290ab): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x290ab): Mirror 8: 0x12a6d28d (stale) Mirror 9: 0x12a6d28d (stale) Mirror 10: 0x12a6d28d (stale) Mirror 11: 0x12a6d28d (stale) CRC-32 checksum value for chunk [0, 0x290ab): Mirror 1: 0x1bdaf07c Mirror 12: 0x1bdaf07c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x290ab: skipped 000526 1782928299.303764 trunc from 0x0290ab to 0x03a4d8 (0x1142e bytes) 000527 1782928299.335307 mapread 0x01a874 thru 0x025b65 (0xb2f2 bytes) 000528 1782928299.356576 punch from 0x023990 to 0x028b3a (0x51ab bytes) 000529 1782928299.365770 MIRROR_RESYNC 6 mirrors 000530 1782928300.266184 read 0x032135 thru 0x032944 (0x810 bytes) 000531 1782928300.269278 punch from 0x02efa5 to 0x038b04 (0x9b60 bytes) 000532 1782928300.290688 mapread 0x015220 thru 0x0200e2 (0xaec3 bytes) 000533 1782928300.312776 read 0x02cc13 thru 0x03a4d8 (0xd8c6 bytes) 000534 1782928300.320490 fallocate 0x019866 thru 0x024833 (0xafce bytes) 000535 1782928300.326430 read 0x021c3a thru 0x030c35 (0xeffc bytes) 000536 1782928300.328011 write 0x00c649 thru 0x012da5 (0x675d bytes) 000539 1782928300.332176 punch from 0x0203f4 to 0x028288 (0x7e95 bytes) 000540 1782928300.337444 trunc from 0x0210e4 to 0x0268de (0x57fb bytes) 000541 1782928300.346071 mapread 0x010b5e thru 0x01f6e0 (0xeb83 bytes) 000542 1782928300.347371 trunc from 0x02270d to 0x0301fc (0xdaf0 bytes) 000543 1782928300.355475 mapread 0x02359b thru 0x02847e (0x4ee4 bytes) 000544 1782928300.365412 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3a4d9): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a4d9): Mirror 8: 0x50f5a656 (stale) Mirror 9: 0x50f5a656 (stale) Mirror 10: 0x50f5a656 (stale) Mirror 11: 0x50f5a656 (stale) Mirror 12: 0x50f5a656 (stale) CRC-32 checksum value for chunk [0, 0x3a4d9): Mirror 1: 0xa4773548 Mirror 13: 0xa4773548 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a4d9: skipped 000545 1782928300.881319 mapwrite 0x01c79f thru 0x02798a (0xb1ec bytes) 000546 1782928300.946213 write 0x033ca9 thru 0x03f70a (0xba62 bytes) 000547 1782928300.951447 write 0x0157e7 thru 0x01a92c (0x5146 bytes) 000548 1782928300.954341 read 0x02bc31 thru 0x03183e (0x5c0e bytes) 000549 1782928300.959284 MIRROR_RESYNC 7 mirrors 000550 1782928301.928193 write 0x03a625 thru 0x03ffff (0x59db bytes) 000551 1782928301.951894 trunc from 0x040000 to 0x00ea4a (0x315b5 bytes) 000552 1782928301.962764 fallocate 0x01754a thru 0x021339 (0x9df0 bytes) 000553 1782928301.967488 trunc from 0x00e10b to 0x00ea4a (0x940 bytes) 000554 1782928301.970673 punch from 0x00becc to 0x00ea4a (0x2b7f bytes) 000555 1782928301.974881 trunc from 0x00ea4b to 0x007338 (0x7712 bytes) 000556 1782928301.982835 trunc from 0x007339 to 0x03a49e (0x33166 bytes) 000557 1782928301.994205 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3a49f): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a49f): Mirror 8: 0x53f53ef9 (stale) Mirror 9: 0x53f53ef9 (stale) Mirror 10: 0x53f53ef9 (stale) Mirror 11: 0x53f53ef9 (stale) Mirror 12: 0x53f53ef9 (stale) Mirror 13: 0x53f53ef9 (stale) CRC-32 checksum value for chunk [0, 0x3a49f): Mirror 1: 0xb5c42cba Mirror 14: 0xb5c42cba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a49f: skipped 000558 1782928302.419538 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3a49f): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a49f): Mirror 8: 0x53f53ef9 (stale) Mirror 9: 0x53f53ef9 (stale) Mirror 10: 0x53f53ef9 (stale) Mirror 11: 0x53f53ef9 (stale) Mirror 12: 0x53f53ef9 (stale) Mirror 13: 0x53f53ef9 (stale) CRC-32 checksum value for chunk [0, 0x3a49f): Mirror 1: 0xb5c42cba Mirror 14: 0xb5c42cba Mirror 15: 0xb5c42cba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a49f: skipped 000559 1782928302.814514 read 0x0344bc thru 0x03a49e (0x5fe3 bytes) 000560 1782928302.819574 read 0x00cc35 thru 0x0133d7 (0x67a3 bytes) 000561 1782928302.824657 write 0x00274f thru 0x00bddd (0x968f bytes) 000562 1782928302.854443 fallocate 0x0307e8 thru 0x03630c (0x5b25 bytes) 000563 1782928302.857694 read 0x028866 thru 0x02d5c3 (0x4d5e bytes) 000564 1782928302.866443 write 0x027b36 thru 0x031887 (0x9d52 bytes) 000565 1782928302.868077 fallocate 0x0302ed thru 0x03681c (0x6530 bytes) 000566 1782928302.873438 punch from 0x01ea35 to 0x0249ff (0x5fcb bytes) 000567 1782928302.875745 write 0x027f5a thru 0x02c753 (0x47fa bytes) 000568 1782928302.877026 fallocate 0x030e34 thru 0x03a885 (0x9a52 bytes) 000569 1782928302.880276 trunc from 0x03a886 to 0x01e1ce (0x1c6b7 bytes) 000570 1782928302.889170 read 0x01278b thru 0x01e1ce (0xba44 bytes) 000571 1782928302.892937 trunc from 0x0092b2 to 0x00b779 (0x24c8 bytes) 000572 1782928302.900177 trunc from 0x008fb8 to 0x009f94 (0xfdd bytes) 000573 1782928302.904910 MIRROR_RESYNC 9 mirrors 000574 1782928303.643572 mapread 0x016e96 thru 0x01ace6 (0x3e51 bytes) 000575 1782928303.654225 trunc from 0x01e1cf to 0x003cb0 (0x1a51e bytes) 000576 1782928303.672489 punch from 0x002505 to 0x003cb0 (0x17ac bytes) 000577 1782928303.675070 write 0x0281c2 thru 0x02c410 (0x424f bytes) 000578 1782928303.676424 write 0x015ad7 thru 0x01a78c (0x4cb6 bytes) 000580 1782928303.681820 trunc from 0x000622 to 0x003f58 (0x3937 bytes) 000581 1782928303.684288 write 0x030b6a thru 0x03a5ab (0x9a42 bytes) 000582 1782928303.685760 punch from 0x02609f to 0x035a7b (0xf9dd bytes) 000583 1782928303.693036 trunc from 0x02bc71 to 0x02f22c (0x35bc bytes) 000584 1782928303.695321 fallocate 0x03bfa1 thru 0x03d67d (0x16dd bytes) 000585 1782928303.701460 write 0x00ac2d thru 0x00da03 (0x2dd7 bytes) 000586 1782928303.707011 trunc from 0x0336f4 to 0x03d67d (0x9f8a bytes) 000588 1782928303.711224 punch from 0x033dcc to 0x035826 (0x1a5b bytes) 000589 1782928303.714475 trunc from 0x026a40 to 0x03069c (0x9c5d bytes) 000591 1782928303.720709 fallocate 0x03e890 thru 0x03ffff (0x1770 bytes) 000592 1782928303.725524 trunc from 0x02b927 to 0x030cde (0x53b8 bytes) 000593 1782928303.729634 trunc from 0x012629 to 0x014883 (0x225b bytes) 000594 1782928303.735280 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xc016c849 (stale) Mirror 9: 0xc016c849 (stale) Mirror 10: 0xc016c849 (stale) Mirror 11: 0xc016c849 (stale) Mirror 12: 0xc016c849 (stale) Mirror 13: 0xc016c849 (stale) Mirror 15: 0xc016c849 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xc016c849 (stale) Mirror 9: 0xc016c849 (stale) Mirror 10: 0xc016c849 (stale) Mirror 11: 0xc016c849 (stale) Mirror 12: 0xc016c849 (stale) Mirror 13: 0xc016c849 (stale) Mirror 15: 0xc016c849 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000595 1782928303.965985 MIRROR_RESYNC 8 mirrors 000596 1782928304.819509 trunc from 0x040000 to 0x0064c9 (0x39b36 bytes) 000597 1782928304.837679 fallocate 0x03c06a thru 0x03ffff (0x3f96 bytes) 000598 1782928304.841354 mapwrite 0x011163 thru 0x01b502 (0xa3a0 bytes) 000599 1782928304.875222 write 0x000dd2 thru 0x0029d7 (0x1c06 bytes) 000600 1782928304.879839 write 0x029958 thru 0x02a418 (0xac1 bytes) 000601 1782928304.880463 mapwrite 0x01dfa6 thru 0x02174c (0x37a7 bytes) 000602 1782928304.896121 write 0x01420f thru 0x0232c6 (0xf0b8 bytes) 000603 1782928304.898025 read 0x012133 thru 0x013127 (0xff5 bytes) 000604 1782928304.900192 mapwrite 0x03e2fb thru 0x03ffff (0x1d05 bytes) 000605 1782928304.935597 mapread 0x03e4e3 thru 0x03ffff (0x1b1d bytes) 000606 1782928304.936882 write 0x017ee7 thru 0x025253 (0xd36d bytes) 000607 1782928304.938458 trunc from 0x029e13 to 0x02aaef (0xcdd bytes) 000608 1782928304.941013 trunc from 0x040000 to 0x0236cb (0x1c934 bytes) 000609 1782928304.952029 trunc from 0x0236cc to 0x005912 (0x1ddb9 bytes) 000610 1782928304.968988 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x5913): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5913): Mirror 8: 0xc4d406a4 (stale) Mirror 9: 0xc4d406a4 (stale) Mirror 10: 0xc4d406a4 (stale) Mirror 11: 0xc4d406a4 (stale) Mirror 12: 0xc4d406a4 (stale) Mirror 13: 0xc4d406a4 (stale) Mirror 15: 0xc4d406a4 (stale) CRC-32 checksum value for chunk [0, 0x5913): Mirror 1: 0x708826d6 Mirror 16: 0x708826d6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5913: skipped 000611 1782928305.411576 fallocate 0x002a14 thru 0x005659 (0x2c46 bytes) 000612 1782928305.434213 fallocate 0x02a635 thru 0x032c4d (0x8619 bytes) 000613 1782928305.437600 read 0x0007e3 thru 0x00c752 (0xbf70 bytes) 000614 1782928305.447882 fallocate 0x036d56 thru 0x03745b (0x706 bytes) 000615 1782928305.452307 mapread 0x00eaed thru 0x011478 (0x298c bytes) 000616 1782928305.464169 fallocate 0x033d41 thru 0x036a91 (0x2d51 bytes) 000618 1782928305.469519 trunc from 0x03745c to 0x01a586 (0x1ced5 bytes) 000619 1782928305.482746 mapwrite 0x02ad25 thru 0x0389e6 (0xdcc2 bytes) 000620 1782928305.535282 punch from 0x031e46 to 0x0389e6 (0x6ba1 bytes) 000621 1782928305.542265 read 0x006bb2 thru 0x0137ca (0xcc19 bytes) 000622 1782928305.542936 mapwrite 0x00ef96 thru 0x01184c (0x28b7 bytes) 000623 1782928305.556287 write 0x00a620 thru 0x01069e (0x607f bytes) 000624 1782928305.560392 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x389e7): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x389e7): Mirror 8: 0xe7637a36 (stale) Mirror 9: 0xe7637a36 (stale) Mirror 10: 0xe7637a36 (stale) Mirror 11: 0xe7637a36 (stale) Mirror 12: 0xe7637a36 (stale) Mirror 13: 0xe7637a36 (stale) Mirror 15: 0xe7637a36 (stale) Mirror 16: 0xfda699b1 (stale) CRC-32 checksum value for chunk [0, 0x389e7): Mirror 1: 0x7c9b8d43 Mirror 17: 0x7c9b8d43 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x389e7: skipped 000625 1782928306.023420 mapread 0x002c88 thru 0x0071a0 (0x4519 bytes) 000626 1782928306.052447 trunc from 0x01968f to 0x01df5a (0x48cc bytes) 000627 1782928306.076737 trunc from 0x0389e7 to 0x01b84f (0x1d197 bytes) 000628 1782928306.103238 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b850): Mirror 8: 0x32caa553 (stale) Mirror 9: 0x32caa553 (stale) Mirror 10: 0x32caa553 (stale) Mirror 11: 0x32caa553 (stale) Mirror 12: 0x32caa553 (stale) Mirror 15: 0x32caa553 (stale) Mirror 16: 0x1be314ae (stale) Mirror 17: 0xd35a814b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b850): Mirror 8: 0x32caa553 (stale) Mirror 9: 0x32caa553 (stale) Mirror 10: 0x32caa553 (stale) Mirror 11: 0x32caa553 (stale) Mirror 12: 0x32caa553 (stale) Mirror 15: 0x32caa553 (stale) Mirror 16: 0x1be314ae (stale) Mirror 17: 0xd35a814b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b850: skipped 000630 1782928306.325448 fallocate 0x014b0c thru 0x01f71f (0xac14 bytes) 000631 1782928306.330328 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b850): Mirror 8: 0x32caa553 (stale) Mirror 10: 0x32caa553 (stale) Mirror 11: 0x32caa553 (stale) Mirror 12: 0x32caa553 (stale) Mirror 15: 0x32caa553 (stale) Mirror 16: 0x1be314ae (stale) Mirror 17: 0xd35a814b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b850): Mirror 8: 0x32caa553 (stale) Mirror 10: 0x32caa553 (stale) Mirror 11: 0x32caa553 (stale) Mirror 12: 0x32caa553 (stale) Mirror 15: 0x32caa553 (stale) Mirror 16: 0x1be314ae (stale) Mirror 17: 0xd35a814b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b850: skipped 000632 1782928306.585243 fallocate 0x03d6f1 thru 0x03ffff (0x290f bytes) 000633 1782928306.588520 write 0x02d0aa thru 0x039be3 (0xcb3a bytes) 000634 1782928306.592887 write 0x01a5c2 thru 0x022f48 (0x8987 bytes) 000635 1782928306.605211 fallocate 0x00f5d4 thru 0x019057 (0x9a84 bytes) 000636 1782928306.608494 punch from 0x008449 to 0x0134c8 (0xb080 bytes) 000637 1782928306.618102 punch from 0x0028ab to 0x01064b (0xdda1 bytes) 000638 1782928306.622594 fallocate 0x00a383 thru 0x010a6e (0x66ec bytes) 000639 1782928306.625323 write 0x005c2a thru 0x0095e4 (0x39bb bytes) 000641 1782928306.631958 fallocate 0x0163fa thru 0x01f408 (0x900f bytes) 000642 1782928306.635008 fallocate 0x012e5c thru 0x013eee (0x1093 bytes) 000643 1782928306.639229 write 0x023f46 thru 0x02fb59 (0xbc14 bytes) 000644 1782928306.643954 trunc from 0x024961 to 0x02f49b (0xab3b bytes) 000645 1782928306.654516 mapwrite 0x0105f2 thru 0x011268 (0xc77 bytes) 000646 1782928306.674002 write 0x02c5e2 thru 0x02e5bd (0x1fdc bytes) 000647 1782928306.679345 punch from 0x033dac to 0x039be3 (0x5e38 bytes) 000648 1782928306.682868 fallocate 0x038a17 thru 0x03cb29 (0x4113 bytes) 000649 1782928306.685652 fallocate 0x015f2c thru 0x02308a (0xd15f bytes) 000650 1782928306.687613 punch from 0x020441 to 0x022854 (0x2414 bytes) 000651 1782928306.689771 punch from 0x02fcef to 0x030310 (0x622 bytes) 000652 1782928306.694918 MIRROR_RESYNC 8 mirrors 000653 1782928308.216391 mapwrite 0x0125fc thru 0x0136f2 (0x10f7 bytes) 000654 1782928308.265965 mapread 0x0202f0 thru 0x02bd44 (0xba55 bytes) 000657 1782928308.283141 write 0x019af2 thru 0x0246b6 (0xabc5 bytes) 000658 1782928308.284887 trunc from 0x012461 to 0x01de49 (0xb9e9 bytes) 000659 1782928308.302494 write 0x00835a thru 0x012110 (0x9db7 bytes) 000660 1782928308.307725 fallocate 0x022e30 thru 0x02cf7f (0xa150 bytes) 000661 1782928308.310450 trunc from 0x039be4 to 0x0385df (0x1604 bytes) 000662 1782928308.322264 punch from 0x0160b7 to 0x025a84 (0xf9ce bytes) 000663 1782928308.329639 trunc from 0x0152d8 to 0x022ba2 (0xd8cb bytes) 000667 1782928308.335184 punch from 0x011440 to 0x01ef91 (0xdb52 bytes) 000668 1782928308.348614 mapread 0x001660 thru 0x002843 (0x11e4 bytes) 000669 1782928308.353354 fallocate 0x012b09 thru 0x01ba4a (0x8f42 bytes) 000670 1782928308.356266 punch from 0x02e5f7 to 0x02efc3 (0x9cd bytes) 000671 1782928308.361824 fallocate 0x02fab9 thru 0x031f50 (0x2498 bytes) 000672 1782928308.367509 trunc from 0x011717 to 0x013388 (0x1c72 bytes) 000673 1782928308.371179 mapwrite 0x01a933 thru 0x01d6d2 (0x2da0 bytes) 000674 1782928308.387635 punch from 0x00e58a to 0x012d90 (0x4807 bytes) 000675 1782928308.392770 read 0x02960c thru 0x0296fa (0xef bytes) 000676 1782928308.393870 trunc from 0x013b29 to 0x020b7c (0xd054 bytes) 000678 1782928308.397371 fallocate 0x03444f thru 0x039149 (0x4cfb bytes) 000679 1782928308.400600 fallocate 0x03d593 thru 0x03ffff (0x2a6d bytes) 000680 1782928308.405592 write 0x02638d thru 0x0271e7 (0xe5b bytes) 000681 1782928308.409808 MIRROR_RESYNC 8 mirrors 000682 1782928309.256710 trunc from 0x01194f to 0x0172f8 (0x59aa bytes) 000683 1782928309.276330 mapwrite 0x0114b8 thru 0x01f4d5 (0xe01e bytes) 000684 1782928309.308852 read 0x0049f4 thru 0x00a1b8 (0x57c5 bytes) 000685 1782928309.312898 write 0x01bda5 thru 0x01d04b (0x12a7 bytes) 000686 1782928309.313986 trunc from 0x02876f to 0x034ebe (0xc750 bytes) 000687 1782928309.316530 mapread 0x002273 thru 0x00c6ed (0xa47b bytes) 000688 1782928309.322633 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3914a): Mirror 10: 0x6721a608 (stale) Mirror 11: 0x6721a608 (stale) Mirror 12: 0x6721a608 (stale) Mirror 15: 0x6721a608 (stale) Mirror 16: 0x6721a608 (stale) Mirror 17: 0x6721a608 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3914a): Mirror 10: 0x6721a608 (stale) Mirror 11: 0x6721a608 (stale) Mirror 12: 0x6721a608 (stale) Mirror 15: 0x6721a608 (stale) Mirror 16: 0x6721a608 (stale) Mirror 17: 0x6721a608 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3914a: skipped 000689 1782928309.494768 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3914a): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3914a): Mirror 10: 0x6721a608 (stale) Mirror 11: 0x6721a608 (stale) Mirror 12: 0x6721a608 (stale) Mirror 15: 0x6721a608 (stale) Mirror 16: 0x6721a608 (stale) Mirror 17: 0x6721a608 (stale) CRC-32 checksum value for chunk [0, 0x3914a): Mirror 1: 0xfecc8c27 Mirror 18: 0xfecc8c27 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3914a: skipped 000690 1782928309.929647 mapwrite 0x0260f6 thru 0x02c6d1 (0x65dc bytes) 000691 1782928309.994684 mapwrite 0x03f10f thru 0x03ffff (0xef1 bytes) 000692 1782928310.028107 read 0x013391 thru 0x0180cb (0x4d3b bytes) 000696 1782928310.045765 write 0x0315e7 thru 0x03607a (0x4a94 bytes) 000698 1782928310.055291 write 0x00b4b4 thru 0x012db5 (0x7902 bytes) 000699 1782928310.065865 mapread 0x02eb5a thru 0x03cf9c (0xe443 bytes) 000700 1782928310.072669 trunc from 0x040000 to 0x0076cd (0x38932 bytes) 000701 1782928310.082812 mapread 0x003637 thru 0x0076cd (0x4097 bytes) 000702 1782928310.089187 mapwrite 0x009f4d thru 0x012e00 (0x8eb4 bytes) 000703 1782928310.117069 punch from 0x00befb to 0x012e00 (0x6f06 bytes) 000704 1782928310.120973 mapwrite 0x022041 thru 0x0291a7 (0x7167 bytes) 000705 1782928310.149464 read 0x0173fd thru 0x026ccc (0xf8d0 bytes) 000706 1782928310.153796 read 0x0009cc thru 0x004699 (0x3cce bytes) 000708 1782928310.155169 trunc from 0x0173d6 to 0x01b8c9 (0x44f4 bytes) 000709 1782928310.158049 mapread 0x023f1b thru 0x0291a7 (0x528d bytes) 000710 1782928310.159003 trunc from 0x0291a8 to 0x03a655 (0x114ae bytes) 000711 1782928310.165690 punch from 0x0014bb to 0x00e5f5 (0xd13b bytes) 000712 1782928310.169598 trunc from 0x03a656 to 0x020bb1 (0x19aa4 bytes) 000713 1782928310.183630 mapread 0x01a785 thru 0x020bb1 (0x642d bytes) 000715 1782928310.188944 trunc from 0x0095f1 to 0x017e93 (0xe8a3 bytes) 000716 1782928310.191449 punch from 0x00a956 to 0x011dc0 (0x746b bytes) 000717 1782928310.195153 trunc from 0x01a9e0 to 0x020bb1 (0x61d2 bytes) 000720 1782928310.200534 trunc from 0x00a17d to 0x012295 (0x8119 bytes) 000721 1782928310.203942 read 0x00d32b thru 0x014627 (0x72fd bytes) 000722 1782928310.210389 read 0x00caa2 thru 0x01b579 (0xead8 bytes) 000723 1782928310.211284 write 0x037ffa thru 0x03b35a (0x3361 bytes) 000724 1782928310.212909 punch from 0x002aec to 0x004d30 (0x2245 bytes) 000725 1782928310.217111 punch from 0x01b051 to 0x0268d3 (0xb883 bytes) 000726 1782928310.220430 write 0x007849 thru 0x0147a1 (0xcf59 bytes) 000727 1782928310.222205 write 0x0346bb thru 0x03e0d2 (0x9a18 bytes) 000728 1782928310.227176 fallocate 0x0356ae thru 0x03e922 (0x9275 bytes) 000729 1782928310.233816 mapread 0x00f8f5 thru 0x01b5a9 (0xbcb5 bytes) 000730 1782928310.235113 mapwrite 0x037faf thru 0x03cb0d (0x4b5f bytes) 000731 1782928310.243839 write 0x0144fd thru 0x021168 (0xcc6c bytes) 000732 1782928310.245021 trunc from 0x010b27 to 0x015b51 (0x502b bytes) 000733 1782928310.251779 write 0x0256c9 thru 0x02bdf0 (0x6728 bytes) 000734 1782928310.252769 mapread 0x013fbf thru 0x01756d (0x35af bytes) 000737 1782928310.260034 trunc from 0x03e923 to 0x027b09 (0x16e19 bytes) 000738 1782928310.274240 punch from 0x02035b to 0x027b09 (0x77af bytes) 000739 1782928310.284016 MIRROR_RESYNC 8 mirrors 000741 1782928310.977963 fallocate 0x003d61 thru 0x00a4b6 (0x6756 bytes) 000742 1782928310.999255 fallocate 0x0009c0 thru 0x004b5a (0x419b bytes) 000743 1782928311.001923 write 0x006411 thru 0x00dc36 (0x7826 bytes) 000744 1782928311.007105 mapwrite 0x0228fa thru 0x0237b7 (0xebe bytes) 000745 1782928311.018537 punch from 0x01eb2b to 0x0254d1 (0x69a7 bytes) 000746 1782928311.021403 trunc from 0x007146 to 0x0089a6 (0x1861 bytes) 000747 1782928311.024119 read 0x004e40 thru 0x006974 (0x1b35 bytes) 000748 1782928311.029105 trunc from 0x027b0a to 0x01bb95 (0xbf74 bytes) 000749 1782928311.053243 fallocate 0x029a35 thru 0x036721 (0xcced bytes) 000750 1782928311.056369 write 0x0326f8 thru 0x037c12 (0x551b bytes) 000751 1782928311.060185 fallocate 0x013d59 thru 0x01637d (0x2625 bytes) 000752 1782928311.063239 punch from 0x01f3c8 to 0x029bfa (0xa833 bytes) 000753 1782928311.072274 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x37c13): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37c13): Mirror 10: 0x88fe49a5 (stale) Mirror 11: 0x88fe49a5 (stale) Mirror 12: 0x88fe49a5 (stale) Mirror 15: 0x88fe49a5 (stale) Mirror 16: 0x88fe49a5 (stale) Mirror 17: 0x88fe49a5 (stale) Mirror 18: 0x88fe49a5 (stale) CRC-32 checksum value for chunk [0, 0x37c13): Mirror 1: 0xc35df0a1 Mirror 19: 0xc35df0a1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37c13: skipped 000754 1782928311.449887 write 0x00de6f thru 0x016211 (0x83a3 bytes) 000755 1782928311.465669 mapwrite 0x035223 thru 0x03ffff (0xaddd bytes) 000756 1782928311.490639 write 0x01ae9b thru 0x027156 (0xc2bc bytes) 000757 1782928311.498346 mapread 0x01df28 thru 0x026168 (0x8241 bytes) 000758 1782928311.499513 punch from 0x0160f4 to 0x01f7ad (0x96ba bytes) 000759 1782928311.506574 trunc from 0x040000 to 0x022761 (0x1d89e bytes) 000760 1782928311.517797 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x22762): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22762): Mirror 10: 0xcdc05d0d (stale) Mirror 11: 0xcdc05d0d (stale) Mirror 12: 0xcdc05d0d (stale) Mirror 15: 0xcdc05d0d (stale) Mirror 16: 0xcdc05d0d (stale) Mirror 17: 0xcdc05d0d (stale) Mirror 18: 0xcdc05d0d (stale) Mirror 19: 0x3155a6bc (stale) CRC-32 checksum value for chunk [0, 0x22762): Mirror 1: 0xf5486854 Mirror 20: 0xf5486854 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22762: skipped 000761 1782928311.847858 trunc from 0x022762 to 0x0279b4 (0x5253 bytes) 000762 1782928311.868927 punch from 0x01b37d to 0x01b5b4 (0x238 bytes) 000763 1782928311.871931 write 0x036403 thru 0x03ffff (0x9bfd bytes) 000764 1782928311.873840 mapwrite 0x00bfb2 thru 0x019551 (0xd5a0 bytes) 000765 1782928311.897791 trunc from 0x040000 to 0x016928 (0x296d7 bytes) 000766 1782928311.907242 write 0x0251a5 thru 0x02b174 (0x5fd0 bytes) 000767 1782928311.908767 punch from 0x0284b9 to 0x02b174 (0x2cbc bytes) 000768 1782928311.914781 mapwrite 0x038a2c thru 0x03ffff (0x75d4 bytes) 000769 1782928311.937638 punch from 0x00d14a to 0x0116a9 (0x4560 bytes) 000770 1782928311.940335 fallocate 0x00f506 thru 0x010f97 (0x1a92 bytes) 000771 1782928311.942432 read 0x000045 thru 0x00a61c (0xa5d8 bytes) 000772 1782928311.946489 mapread 0x031163 thru 0x036dc1 (0x5c5f bytes) 000773 1782928311.947694 write 0x0396c8 thru 0x03f617 (0x5f50 bytes) 000774 1782928311.949088 mapwrite 0x02a92a thru 0x0338f1 (0x8fc8 bytes) 000775 1782928311.961698 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xf7b4ddd (stale) Mirror 11: 0xf7b4ddd (stale) Mirror 12: 0xf7b4ddd (stale) Mirror 15: 0xf7b4ddd (stale) Mirror 16: 0xf7b4ddd (stale) Mirror 17: 0xf7b4ddd (stale) Mirror 18: 0xf7b4ddd (stale) Mirror 19: 0xf8654dc9 (stale) Mirror 20: 0x75af6395 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x72145922 Mirror 21: 0x72145922 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000776 1782928312.340701 MIRROR_SPLIT mirror 2 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xf7b4ddd (stale) Mirror 12: 0xf7b4ddd (stale) Mirror 15: 0xf7b4ddd (stale) Mirror 16: 0xf7b4ddd (stale) Mirror 17: 0xf7b4ddd (stale) Mirror 18: 0xf7b4ddd (stale) Mirror 19: 0xf8654dc9 (stale) Mirror 20: 0x75af6395 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xf7b4ddd (stale) Mirror 12: 0xf7b4ddd (stale) Mirror 15: 0xf7b4ddd (stale) Mirror 16: 0xf7b4ddd (stale) Mirror 17: 0xf7b4ddd (stale) Mirror 18: 0xf7b4ddd (stale) Mirror 19: 0xf8654dc9 (stale) Mirror 20: 0x75af6395 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x72145922 Mirror 21: 0x72145922 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000777 1782928312.690457 punch from 0x02ea8d to 0x033268 (0x47dc bytes) 000778 1782928312.705318 trunc from 0x040000 to 0x031bd8 (0xe427 bytes) 000779 1782928312.714050 punch from 0x00049e to 0x00d910 (0xd473 bytes) 000780 1782928312.717470 write 0x0018eb thru 0x00a11d (0x8833 bytes) 000781 1782928312.722213 fallocate 0x00ea37 thru 0x00f210 (0x7da bytes) 000782 1782928312.725012 trunc from 0x0173e3 to 0x01a9a9 (0x35c7 bytes) 000783 1782928312.727163 punch from 0x0083ce to 0x0121a9 (0x9ddc bytes) 000784 1782928312.732654 punch from 0x0264af to 0x02c85d (0x63af bytes) 000785 1782928312.734868 mapwrite 0x025990 thru 0x031963 (0xbfd4 bytes) 000786 1782928312.754528 read 0x029d6c thru 0x031bd8 (0x7e6d bytes) 000787 1782928312.755282 punch from 0x011681 to 0x019b93 (0x8513 bytes) 000788 1782928312.757914 fallocate 0x012965 thru 0x01cec2 (0xa55e bytes) 000789 1782928312.761042 mapread 0x00a88e thru 0x00f30e (0x4a81 bytes) 000791 1782928312.765313 trunc from 0x031bd9 to 0x007ab3 (0x2a125 bytes) 000793 1782928312.774255 punch from 0x000379 to 0x007ab3 (0x773b bytes) 000794 1782928312.777333 trunc from 0x007ab4 to 0x0313a9 (0x298f6 bytes) 000795 1782928312.784342 mapread 0x00ea48 thru 0x01d808 (0xedc1 bytes) 000796 1782928312.794463 fallocate 0x03adea thru 0x03cb47 (0x1d5e bytes) 000797 1782928312.798917 trunc from 0x010611 to 0x013fe5 (0x39d5 bytes) 000798 1782928312.802900 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x313aa): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x313aa): Mirror 10: 0x72289242 (stale) Mirror 12: 0x72289242 (stale) Mirror 15: 0x72289242 (stale) Mirror 16: 0x72289242 (stale) Mirror 17: 0x72289242 (stale) Mirror 18: 0x72289242 (stale) Mirror 19: 0x5d841576 (stale) Mirror 20: 0x5842fdbf (stale) Mirror 21: 0x733e9715 (stale) CRC-32 checksum value for chunk [0, 0x313aa): Mirror 1: 0xf4100f19 Mirror 22: 0xf4100f19 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x313aa: skipped 000799 1782928313.188383 fallocate 0x007c64 thru 0x0090e6 (0x1483 bytes) 000800 1782928313.206165 trunc from 0x0313aa to 0x00e7d5 (0x22bd4 bytes) 000801 1782928313.224003 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0xe7d6): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe7d6): Mirror 10: 0x931f28ef (stale) Mirror 12: 0x931f28ef (stale) Mirror 15: 0x931f28ef (stale) Mirror 16: 0x931f28ef (stale) Mirror 17: 0x931f28ef (stale) Mirror 18: 0x931f28ef (stale) Mirror 19: 0x2c1d236e (stale) Mirror 20: 0xfb560539 (stale) Mirror 21: 0xf906c2e5 (stale) Mirror 22: 0xdb43e19b (stale) CRC-32 checksum value for chunk [0, 0xe7d6): Mirror 1: 0xdb43e19b Mirror 23: 0xdb43e19b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe7d6: skipped 000802 1782928313.674437 trunc from 0x005054 to 0x00e7d5 (0x9782 bytes) 000804 1782928313.698764 trunc from 0x00b5c5 to 0x00e7d5 (0x3211 bytes) 000805 1782928313.706120 punch from 0x008db0 to 0x009bff (0xe50 bytes) 000806 1782928313.710265 write 0x03ec17 thru 0x03ede9 (0x1d3 bytes) 000807 1782928313.714960 mapread 0x000c18 thru 0x00c2c8 (0xb6b1 bytes) 000808 1782928313.727064 trunc from 0x03edea to 0x0048e3 (0x3a506 bytes) 000810 1782928313.738480 mapwrite 0x01a9d4 thru 0x01e799 (0x3dc6 bytes) 000812 1782928313.760895 fallocate 0x035bc7 thru 0x038915 (0x2d4f bytes) 000813 1782928313.763479 trunc from 0x01e79a to 0x011d92 (0xca07 bytes) 000814 1782928313.768450 mapwrite 0x01c472 thru 0x0284dd (0xc06c bytes) 000815 1782928313.793987 write 0x012386 thru 0x013239 (0xeb4 bytes) 000816 1782928313.808444 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x284de): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x284de): Mirror 10: 0xb26a96f1 (stale) Mirror 12: 0xb26a96f1 (stale) Mirror 15: 0xb26a96f1 (stale) Mirror 16: 0xb26a96f1 (stale) Mirror 17: 0xb26a96f1 (stale) Mirror 18: 0xb26a96f1 (stale) Mirror 19: 0x275b1069 (stale) Mirror 20: 0x5ea46388 (stale) Mirror 21: 0x11c16c24 (stale) Mirror 22: 0x86c3c03f (stale) Mirror 23: 0x86c3c03f (stale) CRC-32 checksum value for chunk [0, 0x284de): Mirror 1: 0xcd274c3 Mirror 24: 0xcd274c3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x284de: skipped 000817 1782928314.288191 read 0x01cbb5 thru 0x0284dd (0xb929 bytes) 000818 1782928314.298667 mapread 0x00e7d0 thru 0x0114f8 (0x2d29 bytes) 000819 1782928314.320340 write 0x02f403 thru 0x039940 (0xa53e bytes) 000820 1782928314.347133 trunc from 0x039941 to 0x017a53 (0x21eed bytes) 000821 1782928314.369030 trunc from 0x017a54 to 0x03ac5a (0x23207 bytes) 000822 1782928314.381192 fallocate 0x038365 thru 0x03d3bf (0x505b bytes) 000823 1782928314.389650 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3ac5b): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ac5b): Mirror 10: 0xafcac627 (stale) Mirror 12: 0xafcac627 (stale) Mirror 15: 0xafcac627 (stale) Mirror 16: 0xafcac627 (stale) Mirror 17: 0xafcac627 (stale) Mirror 18: 0xafcac627 (stale) Mirror 19: 0xa1af4ef1 (stale) Mirror 20: 0x9bfa2c9 (stale) Mirror 21: 0xbf10daa5 (stale) Mirror 22: 0x85889db (stale) Mirror 23: 0x85889db (stale) Mirror 24: 0x88af0b8b (stale) CRC-32 checksum value for chunk [0, 0x3ac5b): Mirror 1: 0xf99b52c5 Mirror 25: 0xf99b52c5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ac5b: skipped 000824 1782928314.964875 mapwrite 0x00d8f6 thru 0x011f1e (0x4629 bytes) 000825 1782928315.031674 trunc from 0x0084c0 to 0x00df50 (0x5a91 bytes) 000826 1782928315.037575 mapread 0x00a1a4 thru 0x0175f2 (0xd44f bytes) 000827 1782928315.056780 mapread 0x02367a thru 0x02675d (0x30e4 bytes) 000828 1782928315.071045 trunc from 0x03ac5b to 0x03df52 (0x32f8 bytes) 000829 1782928315.093606 write 0x032597 thru 0x03b3de (0x8e48 bytes) 000830 1782928315.102321 read 0x02ce0f thru 0x031e66 (0x5058 bytes) 000831 1782928315.110098 write 0x02035b thru 0x029ac6 (0x976c bytes) 000832 1782928315.111050 punch from 0x01ec0e to 0x023572 (0x4965 bytes) 000833 1782928315.120790 fallocate 0x011149 thru 0x016412 (0x52ca bytes) 000834 1782928315.126430 write 0x038c03 thru 0x03ffff (0x73fd bytes) 000835 1782928315.130612 write 0x016945 thru 0x01e2c3 (0x797f bytes) 000836 1782928315.140919 trunc from 0x040000 to 0x0192ff (0x26d00 bytes) 000837 1782928315.152848 read 0x010f91 thru 0x0192ff (0x836f bytes) 000838 1782928315.158694 MIRROR_SPLIT mirror 13 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19300): Mirror 10: 0xff12ce7a (stale) Mirror 12: 0xff12ce7a (stale) Mirror 15: 0xff12ce7a (stale) Mirror 16: 0xff12ce7a (stale) Mirror 17: 0xff12ce7a (stale) Mirror 18: 0xff12ce7a (stale) Mirror 19: 0xd2fb06dd (stale) Mirror 20: 0xc9d7193d (stale) Mirror 21: 0xddec0cc6 (stale) Mirror 22: 0xd00ed5cf (stale) Mirror 23: 0xd00ed5cf (stale) Mirror 24: 0x7b0a7887 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19300): Mirror 10: 0xff12ce7a (stale) Mirror 12: 0xff12ce7a (stale) Mirror 15: 0xff12ce7a (stale) Mirror 16: 0xff12ce7a (stale) Mirror 17: 0xff12ce7a (stale) Mirror 18: 0xff12ce7a (stale) Mirror 19: 0xd2fb06dd (stale) Mirror 20: 0xc9d7193d (stale) Mirror 21: 0xddec0cc6 (stale) Mirror 22: 0xd00ed5cf (stale) Mirror 23: 0xd00ed5cf (stale) Mirror 24: 0x7b0a7887 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19300: skipped 000839 1782928315.436611 fallocate 0x02f286 thru 0x0314b2 (0x222d bytes) 000840 1782928315.441404 mapwrite 0x008f3f thru 0x0129cc (0x9a8e bytes) 000841 1782928315.463393 trunc from 0x006f44 to 0x00a116 (0x31d3 bytes) 000842 1782928315.470572 mapwrite 0x033614 thru 0x033f6e (0x95b bytes) 000844 1782928315.498267 read 0x028b96 thru 0x0330dd (0xa548 bytes) 000845 1782928315.510523 trunc from 0x033f6f to 0x0342c0 (0x352 bytes) 000846 1782928315.518726 fallocate 0x027865 thru 0x03541b (0xdbb7 bytes) 000847 1782928315.522902 fallocate 0x00dff0 thru 0x01b838 (0xd849 bytes) 000848 1782928315.526778 punch from 0x00da86 to 0x01b5e8 (0xdb63 bytes) 000849 1782928315.531288 mapread 0x01c7a5 thru 0x01eca1 (0x24fd bytes) 000850 1782928315.546274 mapread 0x0219be thru 0x02760d (0x5c50 bytes) 000851 1782928315.550531 punch from 0x002d35 to 0x002f5b (0x227 bytes) 000852 1782928315.553030 punch from 0x0189c9 to 0x01b748 (0x2d80 bytes) 000855 1782928315.557934 punch from 0x007c63 to 0x00ea51 (0x6def bytes) 000856 1782928315.562332 fallocate 0x039a6b thru 0x03a27e (0x814 bytes) 000857 1782928315.565825 punch from 0x01a61e to 0x028ed6 (0xe8b9 bytes) 000859 1782928315.570516 read 0x034e3f thru 0x03a27e (0x5440 bytes) 000860 1782928315.576991 mapread 0x015c3e thru 0x0201f1 (0xa5b4 bytes) 000861 1782928315.578197 fallocate 0x003caa thru 0x0074c4 (0x381b bytes) 000862 1782928315.581871 mapread 0x0141d3 thru 0x017af4 (0x3922 bytes) 000863 1782928315.583154 mapwrite 0x013024 thru 0x013a3a (0xa17 bytes) 000864 1782928315.591603 trunc from 0x01fee4 to 0x02e5c1 (0xe6de bytes) 000865 1782928315.594621 write 0x02b7c1 thru 0x02dd59 (0x2599 bytes) 000866 1782928315.599356 write 0x02e28a thru 0x03d899 (0xf610 bytes) 000868 1782928315.604360 write 0x01ded3 thru 0x02a7eb (0xc919 bytes) 000869 1782928315.608982 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d89a): Mirror 12: 0xda115c3c (stale) Mirror 15: 0xda115c3c (stale) Mirror 16: 0xda115c3c (stale) Mirror 17: 0xda115c3c (stale) Mirror 18: 0xda115c3c (stale) Mirror 19: 0xc47c6b6e (stale) Mirror 20: 0x56f99e99 (stale) Mirror 21: 0xa1eacb55 (stale) Mirror 22: 0x1849246f (stale) Mirror 23: 0x1849246f (stale) Mirror 24: 0xf3b1d20e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d89a): Mirror 12: 0xda115c3c (stale) Mirror 15: 0xda115c3c (stale) Mirror 16: 0xda115c3c (stale) Mirror 17: 0xda115c3c (stale) Mirror 18: 0xda115c3c (stale) Mirror 19: 0xc47c6b6e (stale) Mirror 20: 0x56f99e99 (stale) Mirror 21: 0xa1eacb55 (stale) Mirror 22: 0x1849246f (stale) Mirror 23: 0x1849246f (stale) Mirror 24: 0xf3b1d20e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d89a: skipped 000872 1782928315.910608 mapread 0x01980d thru 0x01c060 (0x2854 bytes) 000873 1782928315.928896 trunc from 0x03d89a to 0x01962b (0x2426e bytes) 000874 1782928315.943441 mapread 0x016405 thru 0x01962b (0x3227 bytes) 000875 1782928315.944807 read 0x00d8ad thru 0x0108d3 (0x3027 bytes) 000876 1782928315.950990 mapread 0x00d988 thru 0x01878c (0xae05 bytes) 000877 1782928315.955825 read 0x00d354 thru 0x013275 (0x5f22 bytes) 000878 1782928315.956413 mapwrite 0x03ea03 thru 0x03ffff (0x15fd bytes) 000879 1782928315.977253 read 0x039c05 thru 0x03c873 (0x2c6f bytes) 000880 1782928315.978253 punch from 0x008d4d to 0x01236b (0x961f bytes) 000881 1782928315.982254 mapread 0x015f9a thru 0x0248b5 (0xe91c bytes) 000882 1782928315.984011 mapwrite 0x00a058 thru 0x00a0de (0x87 bytes) 000883 1782928315.999203 write 0x009aca thru 0x00ef86 (0x54bd bytes) 000885 1782928316.000567 read 0x02042f thru 0x02e879 (0xe44b bytes) 000886 1782928316.001155 punch from 0x017203 to 0x022a8b (0xb889 bytes) 000887 1782928316.005303 read 0x02133c thru 0x02965d (0x8322 bytes) 000888 1782928316.010441 write 0x0293ed thru 0x033087 (0x9c9b bytes) 000889 1782928316.015228 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xf7b4ddd (stale) Mirror 15: 0xf7b4ddd (stale) Mirror 16: 0xf7b4ddd (stale) Mirror 17: 0xf7b4ddd (stale) Mirror 18: 0xf7b4ddd (stale) Mirror 19: 0xf8654dc9 (stale) Mirror 20: 0x75af6395 (stale) Mirror 21: 0x72145922 (stale) Mirror 22: 0xe20eea22 (stale) Mirror 23: 0xe20eea22 (stale) Mirror 24: 0x13c6579d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x88c27e78 Mirror 25: 0x88c27e78 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000890 1782928316.595292 trunc from 0x01caec to 0x023a45 (0x6f5a bytes) 000891 1782928316.612168 fallocate 0x03a999 thru 0x03ffff (0x5667 bytes) 000892 1782928316.617431 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xf7b4ddd (stale) Mirror 15: 0xf7b4ddd (stale) Mirror 16: 0xf7b4ddd (stale) Mirror 17: 0xf7b4ddd (stale) Mirror 18: 0xf7b4ddd (stale) Mirror 19: 0xf8654dc9 (stale) Mirror 20: 0x75af6395 (stale) Mirror 21: 0x72145922 (stale) Mirror 22: 0xe20eea22 (stale) Mirror 23: 0xe20eea22 (stale) Mirror 24: 0x13c6579d (stale) Mirror 25: 0x88c27e78 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x88c27e78 Mirror 26: 0x88c27e78 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000893 1782928317.163131 trunc from 0x040000 to 0x001477 (0x3eb88 bytes) 000894 1782928317.232826 MIRROR_RESYNC 14 mirrors 000895 1782928318.122666 read 0x001401 thru 0x001477 (0x77 bytes) 000896 1782928318.126748 write 0x013980 thru 0x01fcc8 (0xc349 bytes) 000897 1782928318.155419 punch from 0x000645 to 0x00b7b8 (0xb174 bytes) 000898 1782928318.162034 MIRROR_RESYNC 14 mirrors 000899 1782928318.745096 mapread 0x0031dc thru 0x005fcc (0x2df1 bytes) 000900 1782928318.753068 read 0x01d804 thru 0x01fcc8 (0x24c5 bytes) 000902 1782928318.756546 fallocate 0x001990 thru 0x0021ce (0x83f bytes) 000903 1782928318.775846 mapwrite 0x02cb57 thru 0x039120 (0xc5ca bytes) 000904 1782928318.807390 mapread 0x000b8e thru 0x00ddb5 (0xd228 bytes) 000905 1782928318.812979 trunc from 0x039121 to 0x018e78 (0x202a8 bytes) 000906 1782928318.819690 read 0x0095e8 thru 0x00f674 (0x608d bytes) 000907 1782928318.822337 MIRROR_RESYNC 14 mirrors 000908 1782928319.543063 fallocate 0x02cc67 thru 0x0370ed (0xa487 bytes) 000909 1782928319.565108 MIRROR_RESYNC 14 mirrors 000910 1782928320.398913 write 0x033743 thru 0x038122 (0x49e0 bytes) 000911 1782928320.419868 punch from 0x00192f to 0x002adc (0x11ae bytes) 000912 1782928320.421418 trunc from 0x038123 to 0x03b71b (0x35f9 bytes) 000913 1782928320.428735 mapwrite 0x01eb7f thru 0x02542b (0x68ad bytes) 000914 1782928320.450910 fallocate 0x03371e thru 0x03ffff (0xc8e2 bytes) 000916 1782928320.453477 trunc from 0x02232e to 0x02c1ed (0x9ec0 bytes) 000917 1782928320.455795 fallocate 0x037639 thru 0x03ac06 (0x35ce bytes) 000918 1782928320.458067 read 0x0237ed thru 0x02c768 (0x8f7c bytes) 000920 1782928320.462250 trunc from 0x0046b6 to 0x014112 (0xfa5d bytes) 000921 1782928320.466661 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x3b71c): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b71c): Mirror 12: 0xc224838b (stale) Mirror 15: 0xc224838b (stale) Mirror 16: 0xc224838b (stale) Mirror 17: 0xc224838b (stale) Mirror 18: 0xc224838b (stale) Mirror 19: 0xc224838b (stale) Mirror 20: 0xc224838b (stale) Mirror 21: 0xc224838b (stale) Mirror 22: 0xc224838b (stale) Mirror 23: 0xc224838b (stale) Mirror 24: 0xc224838b (stale) Mirror 25: 0xc224838b (stale) Mirror 26: 0xc224838b (stale) CRC-32 checksum value for chunk [0, 0x3b71c): Mirror 1: 0xf43980b5 Mirror 27: 0xf43980b5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b71c: skipped 000922 1782928320.911754 trunc from 0x02ae0b to 0x03891d (0xdb13 bytes) 000923 1782928320.933004 mapread 0x02cad5 thru 0x03a789 (0xdcb5 bytes) 000924 1782928320.944073 fallocate 0x03cc9f thru 0x03d859 (0xbbb bytes) 000925 1782928320.946809 punch from 0x0141ea to 0x018f01 (0x4d18 bytes) 000926 1782928320.949068 mapwrite 0x01e1c5 thru 0x02d589 (0xf3c5 bytes) 000927 1782928320.963771 write 0x015ae0 thru 0x01943d (0x395e bytes) 000928 1782928320.967622 fallocate 0x0143c4 thru 0x01704f (0x2c8c bytes) 000929 1782928320.970096 mapwrite 0x0140cf thru 0x01a11e (0x6050 bytes) 000930 1782928320.983189 trunc from 0x03b71c to 0x02c50d (0xf20e bytes) 000931 1782928320.998574 fallocate 0x03e0d5 thru 0x03ffff (0x1f2b bytes) 000932 1782928321.000993 trunc from 0x040000 to 0x0084a4 (0x37b5b bytes) 000933 1782928321.006934 punch from 0x0019e3 to 0x0084a4 (0x6ac2 bytes) 000934 1782928321.013147 MIRROR_SPLIT mirror 1 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x84a5): Mirror 15: 0x35a60dcd (stale) Mirror 16: 0x35a60dcd (stale) Mirror 17: 0x35a60dcd (stale) Mirror 18: 0x35a60dcd (stale) Mirror 19: 0x35a60dcd (stale) Mirror 20: 0x35a60dcd (stale) Mirror 21: 0x35a60dcd (stale) Mirror 22: 0x35a60dcd (stale) Mirror 23: 0x35a60dcd (stale) Mirror 24: 0x35a60dcd (stale) Mirror 25: 0x35a60dcd (stale) Mirror 26: 0x35a60dcd (stale) Mirror 27: 0x35a60dcd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x84a5): Mirror 15: 0x35a60dcd (stale) Mirror 16: 0x35a60dcd (stale) Mirror 17: 0x35a60dcd (stale) Mirror 18: 0x35a60dcd (stale) Mirror 19: 0x35a60dcd (stale) Mirror 20: 0x35a60dcd (stale) Mirror 21: 0x35a60dcd (stale) Mirror 22: 0x35a60dcd (stale) Mirror 23: 0x35a60dcd (stale) Mirror 24: 0x35a60dcd (stale) Mirror 25: 0x35a60dcd (stale) Mirror 26: 0x35a60dcd (stale) Mirror 27: 0x35a60dcd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x84a5: skipped 000936 1782928321.243742 mapread 0x004e6f thru 0x0084a4 (0x3636 bytes) 000937 1782928321.257705 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x84a5): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x84a5): Mirror 15: 0x35a60dcd (stale) Mirror 16: 0x35a60dcd (stale) Mirror 17: 0x35a60dcd (stale) Mirror 18: 0x35a60dcd (stale) Mirror 19: 0x35a60dcd (stale) Mirror 20: 0x35a60dcd (stale) Mirror 21: 0x35a60dcd (stale) Mirror 22: 0x35a60dcd (stale) Mirror 23: 0x35a60dcd (stale) Mirror 24: 0x35a60dcd (stale) Mirror 25: 0x35a60dcd (stale) Mirror 26: 0x35a60dcd (stale) Mirror 27: 0x35a60dcd (stale) CRC-32 checksum value for chunk [0, 0x84a5): Mirror 1: 0x35a60dcd Mirror 28: 0x35a60dcd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x84a5: skipped 000938 1782928321.636181 MIRROR_RESYNC 15 mirrors 000939 1782928322.352527 fallocate 0x03f47c thru 0x03ffff (0xb84 bytes) 000940 1782928322.369741 read 0x003611 thru 0x0084a4 (0x4e94 bytes) 000941 1782928322.378070 MIRROR_RESYNC 15 mirrors 000942 1782928323.079463 mapread 0x007e5e thru 0x0084a4 (0x647 bytes) 000943 1782928323.089700 MIRROR_RESYNC 15 mirrors 000944 1782928323.381829 trunc from 0x0084a5 to 0x0361a3 (0x2dcff bytes) 000945 1782928323.415839 mapwrite 0x02fb41 thru 0x035a4e (0x5f0e bytes) 000946 1782928323.435731 mapwrite 0x01ee86 thru 0x02b73d (0xc8b8 bytes) 000947 1782928323.451138 mapwrite 0x0361ad thru 0x03995d (0x37b1 bytes) 000949 1782928323.472143 fallocate 0x027f6c thru 0x037463 (0xf4f8 bytes) 000950 1782928323.478655 MIRROR_RESYNC 15 mirrors 000951 1782928324.440144 mapread 0x02f7f1 thru 0x03995d (0xa16d bytes) 000952 1782928324.449689 MIRROR_SPLIT mirror 6 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) 000953 1782928324.653111 fallocate 0x026ff0 thru 0x031c5f (0xac70 bytes) 000954 1782928324.667439 read 0x027c23 thru 0x033722 (0xbb00 bytes) 000956 1782928324.672774 mapwrite 0x03f3df thru 0x03f76e (0x390 bytes) 000957 1782928324.690399 mapwrite 0x03681c thru 0x03e6bb (0x7ea0 bytes) 000958 1782928324.706783 trunc from 0x0173dc to 0x0259f1 (0xe616 bytes) 000959 1782928324.712575 read 0x03bfc7 thru 0x03f76e (0x37a8 bytes) 000960 1782928324.714068 punch from 0x02c515 to 0x0392eb (0xcdd7 bytes) 000961 1782928324.718306 fallocate 0x00375f thru 0x00ecb1 (0xb553 bytes) 000962 1782928324.722218 write 0x02e08b thru 0x0348e7 (0x685d bytes) 000964 1782928324.729187 fallocate 0x030772 thru 0x0359e6 (0x5275 bytes) 000965 1782928324.733042 punch from 0x03e94d to 0x03f76e (0xe22 bytes) 000966 1782928324.736398 mapwrite 0x038131 thru 0x03e125 (0x5ff5 bytes) 000967 1782928324.749971 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x3f76f): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f76f): Mirror 15: 0x697c3b1d (stale) Mirror 16: 0x697c3b1d (stale) Mirror 17: 0x697c3b1d (stale) Mirror 18: 0x697c3b1d (stale) Mirror 19: 0x697c3b1d (stale) Mirror 21: 0x697c3b1d (stale) Mirror 22: 0x697c3b1d (stale) Mirror 23: 0x697c3b1d (stale) Mirror 24: 0x697c3b1d (stale) Mirror 25: 0x697c3b1d (stale) Mirror 26: 0x697c3b1d (stale) Mirror 27: 0x697c3b1d (stale) Mirror 28: 0x697c3b1d (stale) CRC-32 checksum value for chunk [0, 0x3f76f): Mirror 1: 0xc99a6785 Mirror 29: 0xc99a6785 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f76f: skipped 000968 1782928325.212330 mapread 0x03afa6 thru 0x03f76e (0x47c9 bytes) 000969 1782928325.229872 punch from 0x00e725 to 0x0128ed (0x41c9 bytes) 000970 1782928325.253625 write 0x03436c thru 0x03c7fd (0x8492 bytes) 000971 1782928325.261517 punch from 0x03ee9c to 0x03f76e (0x8d3 bytes) 000972 1782928325.263998 punch from 0x02d292 to 0x03a591 (0xd300 bytes) 000973 1782928325.274950 MIRROR_RESYNC 15 mirrors 000974 1782928326.475154 fallocate 0x034855 thru 0x03ffff (0xb7ab bytes) 000975 1782928326.488308 punch from 0x022239 to 0x02724b (0x5013 bytes) 000976 1782928326.491979 MIRROR_SPLIT mirror 12 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x2fd181e0 (stale) Mirror 16: 0x2fd181e0 (stale) Mirror 17: 0x2fd181e0 (stale) Mirror 18: 0x2fd181e0 (stale) Mirror 19: 0x2fd181e0 (stale) Mirror 21: 0x2fd181e0 (stale) Mirror 22: 0x2fd181e0 (stale) Mirror 23: 0x2fd181e0 (stale) Mirror 24: 0x2fd181e0 (stale) Mirror 25: 0x2fd181e0 (stale) Mirror 26: 0x2fd181e0 (stale) Mirror 28: 0x2fd181e0 (stale) Mirror 29: 0x2fd181e0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0x2fd181e0 (stale) Mirror 16: 0x2fd181e0 (stale) Mirror 17: 0x2fd181e0 (stale) Mirror 18: 0x2fd181e0 (stale) Mirror 19: 0x2fd181e0 (stale) Mirror 21: 0x2fd181e0 (stale) Mirror 22: 0x2fd181e0 (stale) Mirror 23: 0x2fd181e0 (stale) Mirror 24: 0x2fd181e0 (stale) Mirror 25: 0x2fd181e0 (stale) Mirror 26: 0x2fd181e0 (stale) Mirror 28: 0x2fd181e0 (stale) Mirror 29: 0x2fd181e0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000977 1782928326.774057 write 0x015864 thru 0x02262b (0xcdc8 bytes) 000978 1782928326.780714 fallocate 0x035de6 thru 0x03ffff (0xa21a bytes) 000979 1782928326.784008 trunc from 0x017042 to 0x01e07d (0x703c bytes) 000980 1782928326.791975 mapwrite 0x034b80 thru 0x03ffff (0xb480 bytes) 000981 1782928326.814869 trunc from 0x022a0b to 0x02fcdc (0xd2d2 bytes) 000982 1782928326.817845 mapread 0x0036f9 thru 0x006292 (0x2b9a bytes) 000984 1782928326.823722 fallocate 0x010584 thru 0x012488 (0x1f05 bytes) 000985 1782928326.829709 trunc from 0x040000 to 0x033f26 (0xc0d9 bytes) 000986 1782928326.838111 mapread 0x02a72d thru 0x0332a5 (0x8b79 bytes) 000987 1782928326.842713 trunc from 0x032939 to 0x033305 (0x9cd bytes) 000988 1782928326.846877 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x33f27): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33f27): Mirror 15: 0xfcae4c86 (stale) Mirror 16: 0xfcae4c86 (stale) Mirror 17: 0xfcae4c86 (stale) Mirror 18: 0xfcae4c86 (stale) Mirror 19: 0xfcae4c86 (stale) Mirror 21: 0xfcae4c86 (stale) Mirror 22: 0xfcae4c86 (stale) Mirror 23: 0xfcae4c86 (stale) Mirror 24: 0xfcae4c86 (stale) Mirror 25: 0xfcae4c86 (stale) Mirror 26: 0xfcae4c86 (stale) Mirror 28: 0xfcae4c86 (stale) Mirror 29: 0xfcae4c86 (stale) CRC-32 checksum value for chunk [0, 0x33f27): Mirror 1: 0x80aa877a Mirror 30: 0x80aa877a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33f27: skipped 000989 1782928327.242710 punch from 0x02a82c to 0x033f26 (0x96fb bytes) 000991 1782928327.268499 mapread 0x01ded9 thru 0x027c45 (0x9d6d bytes) 000992 1782928327.279386 read 0x03347a thru 0x033f26 (0xaad bytes) 000993 1782928327.282416 write 0x017904 thru 0x020b56 (0x9253 bytes) 000994 1782928327.290034 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x33f27): Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33f27): Mirror 15: 0xfcae4c86 (stale) Mirror 16: 0xfcae4c86 (stale) Mirror 17: 0xfcae4c86 (stale) Mirror 18: 0xfcae4c86 (stale) Mirror 19: 0xfcae4c86 (stale) Mirror 21: 0xfcae4c86 (stale) Mirror 22: 0xfcae4c86 (stale) Mirror 23: 0xfcae4c86 (stale) Mirror 24: 0xfcae4c86 (stale) Mirror 25: 0xfcae4c86 (stale) Mirror 26: 0xfcae4c86 (stale) Mirror 28: 0xfcae4c86 (stale) Mirror 29: 0xfcae4c86 (stale) Mirror 30: 0x80aa877a (stale) CRC-32 checksum value for chunk [0, 0x33f27): Mirror 1: 0xe2f5abca Mirror 31: 0xe2f5abca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33f27: skipped 000996 1782928327.695991 mapwrite 0x01329d thru 0x01b937 (0x869b bytes) 000997 1782928327.751095 trunc from 0x0133bd to 0x02283b (0xf47f bytes) 000999 1782928327.754929 fallocate 0x016800 thru 0x01b9df (0x51e0 bytes) 001000 1782928327.758447 write 0x036865 thru 0x03ffff (0x979b bytes) All operations completed A-OK!