== sanity-flr test 70a: flr mode fsx test ================ 23:55:01 (1788926101) Seed set to 6103 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read skipping zero length punch hole skipping zero length punch hole 000006 1788926104.178321 write 0x02b892 thru 0x0371a8 (0xb917 bytes) 000010 1788926104.196579 read 0x02fef9 thru 0x036e24 (0x6f2c bytes) 000012 1788926104.198559 write 0x02afbd thru 0x030862 (0x58a6 bytes) 000014 1788926104.230710 mapwrite 0x0265a1 thru 0x02c558 (0x5fb8 bytes) 000017 1788926104.365834 write 0x01dd26 thru 0x02352e (0x5809 bytes) 000020 1788926104.382202 punch from 0x0113cb to 0x01351f (0x2155 bytes) 000021 1788926104.433027 read 0x02d773 thru 0x0313b5 (0x3c43 bytes) 000022 1788926104.433680 read 0x01a501 thru 0x01e544 (0x4044 bytes) 000023 1788926104.457401 write 0x014fac thru 0x01cf66 (0x7fbb bytes) truncating to largest ever: 0x12f7b 000024 1788926104.458644 trunc from 0x0371a9 to 0x012f7a (0x2422e bytes) 000025 1788926104.491257 mapwrite 0x039f0f thru 0x03ffff (0x60f1 bytes) 000026 1788926104.561909 read 0x039378 thru 0x03e1d0 (0x4e59 bytes) 000027 1788926104.563087 mapwrite 0x0317c6 thru 0x03aba2 (0x93dd bytes) 000028 1788926104.657065 read 0x01b4ea thru 0x0242ef (0x8e06 bytes) 000032 1788926104.670903 mapread 0x01ccaf thru 0x02ad0a (0xe05c bytes) 000033 1788926104.672803 read 0x00ff44 thru 0x0159b4 (0x5a71 bytes) 000034 1788926104.674159 read 0x00074d thru 0x00dc24 (0xd4d8 bytes) 000035 1788926104.675254 write 0x021e63 thru 0x03137b (0xf519 bytes) truncating to largest ever: 0x15cb9 000037 1788926104.679039 trunc from 0x040000 to 0x015cb8 (0x2a347 bytes) 000038 1788926104.704396 mapread 0x0121fd thru 0x015cb8 (0x3abc bytes) 000039 1788926104.705382 read 0x010969 thru 0x015cb8 (0x5350 bytes) 000040 1788926104.705930 mapread 0x011a1d thru 0x015cb8 (0x429c bytes) 000041 1788926104.706832 mapread 0x001a99 thru 0x00d010 (0xb578 bytes) 000042 1788926104.707764 write 0x005484 thru 0x0079f8 (0x2575 bytes) 000044 1788926104.709195 read 0x003232 thru 0x010811 (0xd5e0 bytes) 000046 1788926104.710176 punch from 0x00410e to 0x008853 (0x4746 bytes) 000047 1788926104.724836 punch from 0x007182 to 0x00ff65 (0x8de4 bytes) 000051 1788926104.736143 mapread 0x002869 thru 0x006720 (0x3eb8 bytes) 000052 1788926104.748682 mapread 0x00bc40 thru 0x00c9a9 (0xd6a bytes) 000055 1788926104.753039 mapread 0x006104 thru 0x011cd2 (0xbbcf bytes) truncating to largest ever: 0x2c87d 000056 1788926104.755108 trunc from 0x015cb9 to 0x02c87c (0x16bc4 bytes) 000057 1788926104.769068 read 0x013b94 thru 0x018416 (0x4883 bytes) 000058 1788926104.794650 mapwrite 0x01e4e7 thru 0x02c757 (0xe271 bytes) 000059 1788926104.922098 punch from 0x021933 to 0x02ad73 (0x9441 bytes) 000060 1788926104.927625 mapread 0x021f12 thru 0x026a83 (0x4b72 bytes) 000061 1788926104.987817 punch from 0x02235c to 0x023cf5 (0x199a bytes) 000062 1788926104.993423 write 0x00c2ff thru 0x013c91 (0x7993 bytes) 000064 1788926105.005942 write 0x03bf2f thru 0x03e6ef (0x27c1 bytes) truncating to largest ever: 0x34a90 000065 1788926105.009726 trunc from 0x03e6f0 to 0x034a8f (0x9c60 bytes) 000066 1788926105.054167 punch from 0x009150 to 0x017907 (0xe7b8 bytes) 000067 1788926105.105034 punch from 0x0270fb to 0x02d2b5 (0x61bb bytes) 000068 1788926105.123295 write 0x03555b thru 0x03ffff (0xaaa5 bytes) 000069 1788926105.125718 write 0x025b5f thru 0x031828 (0xbcca bytes) 000070 1788926105.134394 mapwrite 0x027ff7 thru 0x02c6d7 (0x46e1 bytes) 000071 1788926105.283731 mapread 0x02107d thru 0x027020 (0x5fa4 bytes) 000073 1788926105.331017 read 0x0252af thru 0x0313f8 (0xc14a bytes) 000075 1788926105.339227 mapwrite 0x02c37b thru 0x03b83d (0xf4c3 bytes) 000077 1788926105.441151 mapread 0x005037 thru 0x007178 (0x2142 bytes) 000078 1788926105.442443 mapread 0x03a9ae thru 0x03ffff (0x5652 bytes) 000080 1788926105.448789 mapread 0x01b19e thru 0x0259d6 (0xa839 bytes) 000081 1788926105.450396 trunc from 0x040000 to 0x028532 (0x17acd bytes) 000082 1788926105.496912 trunc from 0x028533 to 0x01fc28 (0x890a bytes) 000084 1788926105.537805 read 0x013f34 thru 0x01d552 (0x961f bytes) 000086 1788926105.561355 trunc from 0x01fc29 to 0x02eba0 (0xef78 bytes) 000087 1788926105.597510 read 0x0256ca thru 0x028dd1 (0x3708 bytes) 000089 1788926105.613335 mapread 0x02cd54 thru 0x02eba0 (0x1e4d bytes) 000090 1788926105.614607 trunc from 0x02eba1 to 0x01f30e (0xf892 bytes) 000091 1788926105.632811 mapread 0x01c1ca thru 0x01f30e (0x3145 bytes) 000092 1788926105.633932 mapwrite 0x026765 thru 0x03291d (0xc1b9 bytes) 000093 1788926105.744870 mapread 0x015451 thru 0x016280 (0xe30 bytes) 000094 1788926105.746375 punch from 0x012e8f to 0x01fc58 (0xcdca bytes) 000096 1788926105.756456 mapwrite 0x00ed25 thru 0x011f66 (0x3242 bytes) 000098 1788926105.868434 read 0x020e42 thru 0x02786d (0x6a2c bytes) 000099 1788926105.893080 write 0x01473c thru 0x020bab (0xc470 bytes) 000101 1788926105.896773 read 0x02d161 thru 0x030d05 (0x3ba5 bytes) 000103 1788926105.897943 write 0x00b08d thru 0x01a2c0 (0xf234 bytes) 000104 1788926105.906970 mapread 0x01e877 thru 0x02532c (0x6ab6 bytes) 000105 1788926105.907978 mapwrite 0x008579 thru 0x00d849 (0x52d1 bytes) 000106 1788926106.018261 MIRROR_EXTEND to 2 mirrors 000107 1788926106.859891 read 0x00d98b thru 0x01a35a (0xc9d0 bytes) 000109 1788926106.874814 mapwrite 0x02bc1d thru 0x03570e (0x9af2 bytes) 000110 1788926107.201903 read 0x014419 thru 0x01cd55 (0x893d bytes) 000113 1788926107.232236 trunc from 0x03570f to 0x00fb1c (0x25bf2 bytes) 000114 1788926107.276579 MIRROR_RESYNC 2 mirrors 000115 1788926107.981846 punch from 0x003a77 to 0x003fe1 (0x56b bytes) 000116 1788926108.076648 read 0x00a29e thru 0x00eee3 (0x4c46 bytes) 000118 1788926108.096773 trunc from 0x00fb1d to 0x029ba7 (0x1a08b bytes) 000119 1788926108.188772 mapread 0x01cf4b thru 0x01eef6 (0x1fac bytes) 000121 1788926108.228257 read 0x0052e4 thru 0x0135b7 (0xe2d4 bytes) 000123 1788926108.286726 write 0x001889 thru 0x0103ec (0xeb64 bytes) 000124 1788926108.293000 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) 000125 1788926108.501676 punch from 0x0030cc to 0x010211 (0xd146 bytes) 000128 1788926108.512599 punch from 0x020c37 to 0x0233b8 (0x2782 bytes) 000131 1788926108.519124 mapwrite 0x012130 thru 0x013286 (0x1157 bytes) 000132 1788926108.635506 write 0x012f12 thru 0x01fae7 (0xcbd6 bytes) 000133 1788926108.644214 mapwrite 0x03790c thru 0x03f6fd (0x7df2 bytes) 000134 1788926108.780634 write 0x03eece thru 0x03ffff (0x1132 bytes) 000135 1788926108.787003 read 0x00af3a thru 0x00d81f (0x28e6 bytes) 000136 1788926108.794651 mapwrite 0x036851 thru 0x03ffff (0x97af bytes) 000137 1788926108.907148 write 0x027585 thru 0x029105 (0x1b81 bytes) 000138 1788926108.929942 trunc from 0x040000 to 0x011523 (0x2eadc bytes) 000139 1788926108.979077 MIRROR_EXTEND to 2 mirrors 000140 1788926109.687107 trunc from 0x011524 to 0x01dab1 (0xc58e bytes) 000142 1788926109.823646 punch from 0x01bf51 to 0x01dab1 (0x1b61 bytes) 000143 1788926109.835792 trunc from 0x01dab2 to 0x02b983 (0xded2 bytes) 000144 1788926109.874853 read 0x028df3 thru 0x02b983 (0x2b91 bytes) 000145 1788926109.887811 write 0x031e94 thru 0x03bad7 (0x9c44 bytes) 000148 1788926109.893706 trunc from 0x03bad8 to 0x013a72 (0x28065 bytes) 000150 1788926109.914801 mapread 0x003492 thru 0x00fe82 (0xc9f1 bytes) 000151 1788926109.952694 trunc from 0x013a73 to 0x002b44 (0x10f2e bytes) 000153 1788926109.993392 punch from 0x000c35 to 0x002b44 (0x1f10 bytes) 000154 1788926109.999448 punch from 0x0023e6 to 0x002b44 (0x75f bytes) 000155 1788926110.007613 trunc from 0x002b45 to 0x021799 (0x1ec55 bytes) 000156 1788926110.053622 trunc from 0x02179a to 0x019bc5 (0x7bd4 bytes) 000157 1788926110.079767 trunc from 0x019bc6 to 0x00005f (0x19b66 bytes) 000159 1788926110.098572 mapwrite 0x03da67 thru 0x03ffff (0x2599 bytes) 000160 1788926110.261015 MIRROR_RESYNC 2 mirrors 000161 1788926111.323370 MIRROR_RESYNC 2 mirrors 000164 1788926111.901991 read 0x00b724 thru 0x017021 (0xb8fe bytes) 000165 1788926111.930386 read 0x016f17 thru 0x0199e5 (0x2acf bytes) 000166 1788926111.948164 mapwrite 0x00a422 thru 0x00e8d0 (0x44af bytes) 000167 1788926112.108907 write 0x029ec1 thru 0x03649e (0xc5de bytes) 000168 1788926112.129151 punch from 0x00998a to 0x00cfce (0x3645 bytes) 000169 1788926112.163602 mapwrite 0x00cd05 thru 0x01932d (0xc629 bytes) 000171 1788926112.424216 write 0x014490 thru 0x021b09 (0xd67a bytes) 000173 1788926112.438918 trunc from 0x040000 to 0x00c389 (0x33c76 bytes) 000174 1788926112.557844 punch from 0x000c2f to 0x00c389 (0xb75b bytes) 000176 1788926112.574179 mapwrite 0x03df25 thru 0x03ffff (0x20db bytes) 000177 1788926112.654394 trunc from 0x040000 to 0x01a29f (0x25d60 bytes) 000178 1788926112.673519 mapwrite 0x006ae4 thru 0x007b0d (0x102a bytes) 000181 1788926112.753918 read 0x012999 thru 0x0190e0 (0x6748 bytes) 000182 1788926112.763824 mapwrite 0x015816 thru 0x017172 (0x195d bytes) 000183 1788926112.850405 mapwrite 0x0023e4 thru 0x00eb8a (0xc7a7 bytes) 000186 1788926112.975932 write 0x02d63a thru 0x02df16 (0x8dd bytes) 000187 1788926112.976858 mapread 0x0187cc thru 0x025554 (0xcd89 bytes) 000188 1788926112.992669 punch from 0x019b00 to 0x024bde (0xb0df bytes) 000189 1788926113.009611 mapread 0x01912e thru 0x022e35 (0x9d08 bytes) 000190 1788926113.066701 read 0x004236 thru 0x00d1c8 (0x8f93 bytes) truncating to largest ever: 0x3e77a 000191 1788926113.068238 trunc from 0x02df17 to 0x03e779 (0x10863 bytes) 000192 1788926113.087402 punch from 0x010132 to 0x01f622 (0xf4f1 bytes) 000196 1788926113.095982 mapread 0x019dc3 thru 0x01f6c5 (0x5903 bytes) 000197 1788926113.116480 MIRROR_RESYNC 2 mirrors 000198 1788926114.161278 MIRROR_RESYNC 2 mirrors 000200 1788926114.667341 mapread 0x00a535 thru 0x01a3b6 (0xfe82 bytes) 000201 1788926114.704126 trunc from 0x03e77a to 0x02c6dd (0x1209c bytes) 000202 1788926114.863253 punch from 0x00d95e to 0x01220c (0x48af bytes) 000203 1788926114.875431 trunc from 0x02c6de to 0x017fe5 (0x146f8 bytes) 000205 1788926114.929173 read 0x000ae7 thru 0x0034f7 (0x2a11 bytes) 000206 1788926114.938814 trunc from 0x017fe6 to 0x02c869 (0x14884 bytes) 000208 1788926114.963865 trunc from 0x02c86a to 0x035ad6 (0x926d bytes) 000209 1788926115.001880 mapread 0x00e9e4 thru 0x011808 (0x2e25 bytes) 000211 1788926115.044698 mapwrite 0x01609f thru 0x01d915 (0x7877 bytes) 000212 1788926115.188228 MIRROR_RESYNC 2 mirrors 000213 1788926116.299853 read 0x0140a9 thru 0x01a6a1 (0x65f9 bytes) 000214 1788926116.316601 read 0x029ea7 thru 0x030ff9 (0x7153 bytes) 000215 1788926116.338478 trunc from 0x035ad7 to 0x03aa9c (0x4fc6 bytes) 000216 1788926116.490014 read 0x03a175 thru 0x03aa9c (0x928 bytes) 000217 1788926116.509616 read 0x037050 thru 0x03aa9c (0x3a4d bytes) 000218 1788926116.510522 trunc from 0x03aa9d to 0x01ddd3 (0x1ccc9 bytes) 000219 1788926116.539819 read 0x0003ec thru 0x007caf (0x78c4 bytes) 000221 1788926116.546861 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1ddd4): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ddd4): Mirror 2: 0xd493e931 (stale) CRC-32 checksum value for chunk [0, 0x1ddd4): Mirror 1: 0xd493e931 Mirror 3: 0xd493e931 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ddd4: skipped 000222 1788926117.938906 read 0x008b1b thru 0x016f44 (0xe42a bytes) 000223 1788926118.002727 mapread 0x018c66 thru 0x01ddd3 (0x516e bytes) 000224 1788926118.085867 trunc from 0x01ddd4 to 0x01ab13 (0x32c0 bytes) 000225 1788926118.210352 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1ab14): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ab14): Mirror 2: 0x8a0f35b9 (stale) Mirror 3: 0x8a0f35b9 (stale) CRC-32 checksum value for chunk [0, 0x1ab14): Mirror 1: 0x8a0f35b9 Mirror 4: 0x8a0f35b9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ab14: skipped 000227 1788926119.461704 punch from 0x00833d to 0x01039e (0x8062 bytes) 000232 1788926119.538254 write 0x00e6f7 thru 0x00eb6c (0x476 bytes) 000233 1788926119.544692 read 0x016a88 thru 0x01ab13 (0x408c bytes) 000234 1788926119.555869 mapread 0x00a896 thru 0x00d544 (0x2caf bytes) 000235 1788926119.572913 mapread 0x0009fb thru 0x0097a2 (0x8da8 bytes) 000236 1788926119.581830 mapwrite 0x038f59 thru 0x03ffff (0x70a7 bytes) 000237 1788926119.688602 punch from 0x02d356 to 0x0347be (0x7469 bytes) 000240 1788926119.696340 mapread 0x03ff60 thru 0x03ffff (0xa0 bytes) 000241 1788926119.698120 write 0x001072 thru 0x00a613 (0x95a2 bytes) 000242 1788926119.701207 trunc from 0x040000 to 0x01126d (0x2ed92 bytes) 000245 1788926119.744290 trunc from 0x01126e to 0x01f495 (0xe228 bytes) 000246 1788926119.784216 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f496): Mirror 2: 0xb006353b (stale) Mirror 4: 0x27c0ef69 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f496): Mirror 2: 0xb006353b (stale) Mirror 4: 0x27c0ef69 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f496: skipped 000247 1788926120.334140 MIRROR_RESYNC 3 mirrors 000248 1788926121.701864 MIRROR_RESYNC 3 mirrors 000249 1788926122.109907 punch from 0x009161 to 0x01104c (0x7eec bytes) 000250 1788926122.232344 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f496): Mirror 4: 0x6d7d3159 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f496): Mirror 4: 0x6d7d3159 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f496: skipped 000251 1788926122.652497 mapread 0x017aa4 thru 0x01f495 (0x79f2 bytes) 000252 1788926122.690784 read 0x000607 thru 0x00ca58 (0xc452 bytes) 000254 1788926122.701431 mapread 0x002555 thru 0x002697 (0x143 bytes) 000257 1788926122.704068 punch from 0x0075a2 to 0x00a970 (0x33cf bytes) 000258 1788926122.716917 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) 000259 1788926122.959758 read 0x011f9a thru 0x015578 (0x35df bytes) 000263 1788926122.982927 write 0x00abdb thru 0x00dc94 (0x30ba bytes) 000264 1788926123.001332 mapwrite 0x020a1d thru 0x02aeeb (0xa4cf bytes) 000268 1788926123.096925 mapread 0x0078a9 thru 0x00bfff (0x4757 bytes) 000269 1788926123.114363 MIRROR_EXTEND to 2 mirrors 000271 1788926123.609140 punch from 0x029f7f to 0x02aeeb (0xf6d bytes) 000273 1788926123.691570 punch from 0x0142e6 to 0x023adb (0xf7f6 bytes) 000276 1788926123.699984 mapread 0x01d868 thru 0x02aeeb (0xd684 bytes) 000277 1788926123.727285 read 0x01abc7 thru 0x0271d4 (0xc60e bytes) 000279 1788926123.732682 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2aeec): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2aeec): Mirror 2: 0xfaec89c3 (stale) CRC-32 checksum value for chunk [0, 0x2aeec): Mirror 1: 0xadabd39c Mirror 3: 0xadabd39c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2aeec: skipped 000280 1788926124.632228 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2aeec): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2aeec): Mirror 2: 0xfaec89c3 (stale) CRC-32 checksum value for chunk [0, 0x2aeec): Mirror 1: 0xadabd39c Mirror 3: 0xadabd39c Mirror 4: 0xadabd39c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2aeec: skipped 000281 1788926125.547646 write 0x00cf13 thru 0x00e77e (0x186c bytes) 000282 1788926125.675122 mapread 0x0238f3 thru 0x024df3 (0x1501 bytes) 000283 1788926125.692813 write 0x02a3ba thru 0x02e630 (0x4277 bytes) 000284 1788926125.702846 trunc from 0x02e631 to 0x034621 (0x5ff1 bytes) 000286 1788926125.738464 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34622): Mirror 2: 0x997b0c11 (stale) Mirror 4: 0x2fd351e7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34622): Mirror 2: 0x997b0c11 (stale) Mirror 4: 0x2fd351e7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34622: skipped 000287 1788926126.208057 punch from 0x0069d3 to 0x00d593 (0x6bc1 bytes) 000288 1788926126.213265 write 0x0347a4 thru 0x034c83 (0x4e0 bytes) 000289 1788926126.219525 read 0x01f234 thru 0x02a28c (0xb059 bytes) 000291 1788926126.231211 read 0x01ee7c thru 0x023547 (0x46cc bytes) 000293 1788926126.243119 write 0x01dac3 thru 0x023d80 (0x62be bytes) 000297 1788926126.246846 write 0x01e420 thru 0x02bd97 (0xd978 bytes) 000298 1788926126.249261 read 0x006ba1 thru 0x00a351 (0x37b1 bytes) 000299 1788926126.250157 mapwrite 0x017eef thru 0x01acdd (0x2def bytes) 000300 1788926126.352873 read 0x0348b0 thru 0x034c83 (0x3d4 bytes) 000301 1788926126.353461 mapread 0x00519d thru 0x014366 (0xf1ca bytes) 000302 1788926126.354398 write 0x000a68 thru 0x0056d9 (0x4c72 bytes) 000303 1788926126.361604 trunc from 0x034c84 to 0x01d87c (0x17407 bytes) 000305 1788926126.405480 write 0x022a46 thru 0x0251a1 (0x275c bytes) 000306 1788926126.406549 mapwrite 0x037d36 thru 0x03ffff (0x82ca bytes) 000307 1788926126.577716 mapread 0x0150ec thru 0x020481 (0xb396 bytes) 000309 1788926126.580543 trunc from 0x040000 to 0x011a6b (0x2e594 bytes) 000310 1788926126.636671 trunc from 0x011a6c to 0x02639d (0x14932 bytes) 000312 1788926126.665602 punch from 0x01c317 to 0x02639d (0xa087 bytes) 000314 1788926126.669807 trunc from 0x02639e to 0x03d8a7 (0x1750a bytes) 000315 1788926126.693911 trunc from 0x03d8a8 to 0x0307ef (0xd0b8 bytes) 000317 1788926126.721678 mapwrite 0x0323c1 thru 0x03c057 (0x9c97 bytes) 000319 1788926126.918507 punch from 0x016f9c to 0x02286d (0xb8d2 bytes) 000321 1788926126.930327 punch from 0x014fef to 0x016cae (0x1cc0 bytes) 000322 1788926126.945831 punch from 0x02e616 to 0x03c057 (0xda42 bytes) 000323 1788926126.955119 MIRROR_RESYNC 3 mirrors 000325 1788926127.824327 trunc from 0x03c058 to 0x025c82 (0x163d5 bytes) 000327 1788926127.901764 trunc from 0x025c83 to 0x0379db (0x11d59 bytes) 000328 1788926127.937513 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x379dc): Mirror 4: 0x64421c98 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x379dc): Mirror 4: 0x64421c98 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x379dc: skipped 000330 1788926128.239096 punch from 0x00de75 to 0x01d3e8 (0xf574 bytes) 000332 1788926128.244711 read 0x01b6b8 thru 0x01e8c3 (0x320c bytes) 000337 1788926128.252521 punch from 0x00238c to 0x006092 (0x3d07 bytes) 000338 1788926128.258623 mapwrite 0x03fcb7 thru 0x03ffff (0x349 bytes) 000340 1788926128.325792 mapread 0x007d9e thru 0x00b593 (0x37f6 bytes) 000341 1788926128.351751 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x8dcb8910 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6b9b927e Mirror 5: 0x6b9b927e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000342 1788926129.419991 trunc from 0x040000 to 0x023357 (0x1cca8 bytes) 000345 1788926129.547882 trunc from 0x023358 to 0x01b674 (0x7ce3 bytes) 000347 1788926129.595686 read 0x017bf0 thru 0x01b674 (0x3a85 bytes) 000351 1788926129.613640 punch from 0x00eb19 to 0x01b674 (0xcb5c bytes) 000352 1788926129.624763 trunc from 0x01b675 to 0x009710 (0x11f64 bytes) 000354 1788926129.653243 MIRROR_RESYNC 3 mirrors 000356 1788926130.766492 mapwrite 0x02b324 thru 0x039813 (0xe4f0 bytes) 000357 1788926131.041375 MIRROR_RESYNC 3 mirrors 000358 1788926132.420669 write 0x00861a thru 0x01337e (0xad65 bytes) 000359 1788926132.531322 mapread 0x00a7e6 thru 0x010b66 (0x6381 bytes) 000360 1788926132.539079 MIRROR_RESYNC 3 mirrors 000362 1788926133.762303 mapwrite 0x010720 thru 0x0169ec (0x62cd bytes) 000363 1788926134.022733 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x39814): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39814): Mirror 4: 0xbfc2e648 (stale) Mirror 5: 0xbfc2e648 (stale) CRC-32 checksum value for chunk [0, 0x39814): Mirror 1: 0x4f177a37 Mirror 6: 0x4f177a37 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39814: skipped 000365 1788926135.317891 punch from 0x0345fc to 0x039813 (0x5218 bytes) 000367 1788926135.420013 trunc from 0x039814 to 0x01224b (0x275c8 bytes) 000368 1788926135.460642 punch from 0x00e4b8 to 0x01224b (0x3d94 bytes) 000369 1788926135.469230 punch from 0x00d696 to 0x01224b (0x4bb6 bytes) 000370 1788926135.476750 write 0x020ded thru 0x029ee2 (0x90f6 bytes) 000371 1788926135.480808 write 0x018bb5 thru 0x01997e (0xdca bytes) 000372 1788926135.491445 read 0x01f1c8 thru 0x029ee2 (0xad1b bytes) 000373 1788926135.499658 mapread 0x015605 thru 0x02131a (0xbd16 bytes) 000375 1788926135.516491 trunc from 0x029ee3 to 0x008d2c (0x211b6 bytes) 000379 1788926135.540604 mapwrite 0x01efc1 thru 0x02df9f (0xefdf bytes) 000380 1788926135.713780 write 0x029435 thru 0x030864 (0x7430 bytes) 000384 1788926135.722198 mapread 0x00d61e thru 0x00ea51 (0x1434 bytes) 000385 1788926135.746050 punch from 0x021bd8 to 0x027723 (0x5b4c bytes) 000386 1788926135.773088 mapwrite 0x035655 thru 0x03cc84 (0x7630 bytes) 000387 1788926135.891512 trunc from 0x03cc85 to 0x02f5e6 (0xd69e bytes) 000389 1788926135.909989 mapread 0x01d363 thru 0x01f303 (0x1fa1 bytes) 000390 1788926135.911820 trunc from 0x02f5e7 to 0x009b00 (0x25ae6 bytes) 000392 1788926135.930475 read 0x0078d2 thru 0x009b00 (0x222f bytes) 000393 1788926135.931132 punch from 0x001e05 to 0x009b00 (0x7cfc bytes) 000394 1788926135.940798 write 0x00ba12 thru 0x01185d (0x5e4c bytes) 000395 1788926135.942778 read 0x0077ee thru 0x01185d (0xa070 bytes) 000396 1788926135.958876 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1185e): Mirror 4: 0xfc7cfbae (stale) Mirror 5: 0xfc7cfbae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1185e): Mirror 4: 0xfc7cfbae (stale) Mirror 5: 0xfc7cfbae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1185e: skipped 000401 1788926136.339415 trunc from 0x01185e to 0x01efd2 (0xd775 bytes) 000404 1788926136.363314 write 0x038748 thru 0x03ffff (0x78b8 bytes) 000405 1788926136.368913 mapread 0x02d88f thru 0x038939 (0xb0ab bytes) 000406 1788926136.387228 mapwrite 0x03ade9 thru 0x03ffff (0x5217 bytes) 000407 1788926136.460532 trunc from 0x040000 to 0x02f3a4 (0x10c5b bytes) 000408 1788926136.478252 mapread 0x010270 thru 0x01b9ef (0xb780 bytes) 000409 1788926136.506590 punch from 0x015dec to 0x01b5ec (0x5801 bytes) 000411 1788926136.512629 write 0x0119d8 thru 0x01ab17 (0x9140 bytes) 000412 1788926136.517427 read 0x001005 thru 0x00bb95 (0xab91 bytes) 000413 1788926136.536865 mapwrite 0x02efe8 thru 0x03899e (0x99b7 bytes) 000414 1788926136.623582 mapwrite 0x01f2f1 thru 0x02ccde (0xd9ee bytes) 000415 1788926136.720640 MIRROR_RESYNC 3 mirrors 000416 1788926137.755862 write 0x0119cd thru 0x017401 (0x5a35 bytes) 000417 1788926137.866894 read 0x00be19 thru 0x01a384 (0xe56c bytes) 000418 1788926137.876873 write 0x00a966 thru 0x015e4e (0xb4e9 bytes) 000419 1788926137.883730 trunc from 0x03899f to 0x00171c (0x37282 bytes) 000423 1788926137.920885 read 0x0015fb thru 0x00171c (0x122 bytes) 000424 1788926137.931864 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x171d): Mirror 5: 0x6ea3bf1a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x171d): Mirror 5: 0x6ea3bf1a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x171d: skipped 000425 1788926138.201007 write 0x007f02 thru 0x017de5 (0xfee4 bytes) 000426 1788926138.202585 mapread 0x008130 thru 0x00f0af (0x6f80 bytes) 000429 1788926138.208688 mapwrite 0x03eeb0 thru 0x03ffff (0x1150 bytes) 000431 1788926138.291443 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) 000432 1788926138.443359 read 0x00d52a thru 0x012ef9 (0x59d0 bytes) 000433 1788926138.472333 write 0x010044 thru 0x01d33d (0xd2fa bytes) 000435 1788926138.483455 write 0x02deda thru 0x0372d9 (0x9400 bytes) 000436 1788926138.511496 write 0x007198 thru 0x009204 (0x206d bytes) 000437 1788926138.531195 write 0x026410 thru 0x030777 (0xa368 bytes) 000439 1788926138.541612 read 0x03d830 thru 0x03ffff (0x27d0 bytes) 000440 1788926138.555118 write 0x03691f thru 0x03bd0f (0x53f1 bytes) 000441 1788926138.556474 punch from 0x039284 to 0x03ffff (0x6d7c bytes) 000442 1788926138.572348 write 0x02ac27 thru 0x035ca5 (0xb07f bytes) 000444 1788926138.574581 trunc from 0x040000 to 0x002948 (0x3d6b7 bytes) 000445 1788926138.595361 trunc from 0x002949 to 0x01618d (0x13845 bytes) 000446 1788926138.615537 punch from 0x012125 to 0x01618d (0x4069 bytes) 000449 1788926138.622709 read 0x00be02 thru 0x01618d (0xa38c bytes) 000450 1788926138.635447 punch from 0x00fb6a to 0x011e08 (0x229f bytes) 000453 1788926138.649773 trunc from 0x01618e to 0x01493b (0x1852 bytes) 000456 1788926138.679461 mapwrite 0x00a2ad thru 0x00ed39 (0x4a8d bytes) 000457 1788926138.727479 punch from 0x00cb88 to 0x00e06b (0x14e4 bytes) 000458 1788926138.732233 mapwrite 0x037183 thru 0x03ffff (0x8e7d bytes) 000459 1788926138.806205 mapread 0x025267 thru 0x02a3f8 (0x5192 bytes) 000460 1788926138.807213 mapwrite 0x035595 thru 0x03ffff (0xaa6b bytes) 000461 1788926138.901902 punch from 0x03af49 to 0x03ffff (0x50b7 bytes) 000462 1788926138.908327 mapread 0x004a4d thru 0x00e41b (0x99cf bytes) 000465 1788926138.933900 mapread 0x03c202 thru 0x03db46 (0x1945 bytes) 000466 1788926138.952242 punch from 0x03dda1 to 0x03ffff (0x225f bytes) 000468 1788926138.963080 trunc from 0x040000 to 0x039895 (0x676a bytes) 000469 1788926138.984551 trunc from 0x039896 to 0x034f6f (0x4926 bytes) 000470 1788926139.005036 mapread 0x02ba63 thru 0x034f6f (0x950d bytes) 000472 1788926139.008674 read 0x01b1f5 thru 0x01d0d8 (0x1ee4 bytes) 000473 1788926139.009517 mapread 0x0265e8 thru 0x026d0c (0x725 bytes) 000474 1788926139.011476 punch from 0x030a8e to 0x03353d (0x2ab0 bytes) 000475 1788926139.015213 read 0x00f9bb thru 0x0134e2 (0x3b28 bytes) 000476 1788926139.025466 write 0x0279b6 thru 0x036866 (0xeeb1 bytes) 000477 1788926139.027269 trunc from 0x036867 to 0x02fe33 (0x6a33 bytes) 000478 1788926139.045542 read 0x002bba thru 0x00cfe9 (0xa430 bytes) 000481 1788926139.049757 read 0x01eaa3 thru 0x025ea0 (0x73fe bytes) 000482 1788926139.050669 write 0x01987f thru 0x02863a (0xedbc bytes) 000487 1788926139.055911 mapread 0x02d184 thru 0x02ec17 (0x1a94 bytes) 000488 1788926139.057638 read 0x00b924 thru 0x00d2cc (0x19a9 bytes) 000490 1788926139.062513 MIRROR_EXTEND to 2 mirrors 000491 1788926139.941650 read 0x01b5d1 thru 0x01e777 (0x31a7 bytes) 000493 1788926139.958699 MIRROR_EXTEND to 3 mirrors 000494 1788926140.860732 mapread 0x02eec6 thru 0x02fe33 (0xf6e bytes) 000496 1788926140.904771 trunc from 0x02fe34 to 0x018100 (0x17d33 bytes) 000498 1788926141.028806 write 0x010f97 thru 0x01f58d (0xe5f7 bytes) 000499 1788926141.038937 write 0x00781f thru 0x015496 (0xdc78 bytes) 000501 1788926141.045558 trunc from 0x01f58e to 0x00afe1 (0x145ac bytes) 000502 1788926141.074210 mapwrite 0x020088 thru 0x029f38 (0x9eb1 bytes) 000503 1788926141.163775 mapwrite 0x015af5 thru 0x01ba66 (0x5f72 bytes) 000504 1788926141.221876 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x29f39): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29f39): Mirror 2: 0x8c662c5d (stale) Mirror 3: 0x8c662c5d (stale) CRC-32 checksum value for chunk [0, 0x29f39): Mirror 1: 0xa21f6b15 Mirror 4: 0xa21f6b15 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29f39: skipped 000505 1788926142.226657 trunc from 0x029f39 to 0x0032eb (0x26c4d bytes) 000506 1788926142.364821 trunc from 0x0032ec to 0x0064ba (0x31cf bytes) 000507 1788926142.413182 read 0x003de0 thru 0x0064ba (0x26db bytes) 000508 1788926142.419833 read 0x00394a thru 0x005144 (0x17fb bytes) 000509 1788926142.423818 punch from 0x001eb9 to 0x0064ba (0x4602 bytes) 000510 1788926142.435861 trunc from 0x0064bb to 0x025b63 (0x1f6a9 bytes) 000512 1788926142.465427 mapwrite 0x02e165 thru 0x03bff7 (0xde93 bytes) 000513 1788926142.726665 trunc from 0x03bff8 to 0x02f5d7 (0xca20 bytes) 000514 1788926142.749605 read 0x021419 thru 0x029f11 (0x8af9 bytes) 000518 1788926142.758806 read 0x022b65 thru 0x02929f (0x673b bytes) 000519 1788926142.765786 mapwrite 0x0134c1 thru 0x01f88c (0xc3cc bytes) 000520 1788926142.870753 mapwrite 0x0013bf thru 0x003b41 (0x2783 bytes) 000521 1788926142.951770 read 0x013429 thru 0x015dd0 (0x29a8 bytes) 000523 1788926142.956687 punch from 0x00d23f to 0x018fa1 (0xbd63 bytes) 000524 1788926142.962465 trunc from 0x02f5d8 to 0x029824 (0x5db3 bytes) 000525 1788926142.986845 trunc from 0x029825 to 0x03c047 (0x12823 bytes) 000526 1788926143.008509 trunc from 0x03c048 to 0x0184e9 (0x23b5e bytes) 000530 1788926143.035741 mapread 0x003ab5 thru 0x005c9e (0x21ea bytes) 000531 1788926143.036944 trunc from 0x0184ea to 0x03bba0 (0x236b7 bytes) 000533 1788926143.054771 write 0x023937 thru 0x024cb3 (0x137d bytes) 000534 1788926143.076672 trunc from 0x03bba1 to 0x020588 (0x1b618 bytes) 000535 1788926143.120769 mapwrite 0x03c5f6 thru 0x03f850 (0x325b bytes) 000536 1788926143.228760 write 0x01366b thru 0x016a0f (0x33a5 bytes) 000538 1788926143.230901 mapread 0x01e441 thru 0x02c0eb (0xdcab bytes) 000540 1788926143.314599 write 0x00b52b thru 0x00cc93 (0x1769 bytes) 000541 1788926143.316200 mapread 0x02488d thru 0x02afa1 (0x6715 bytes) 000542 1788926143.318134 mapwrite 0x02c42f thru 0x0398df (0xd4b1 bytes) 000544 1788926143.495360 read 0x02226c thru 0x02c947 (0xa6dc bytes) 000546 1788926143.503448 mapread 0x021df9 thru 0x022d77 (0xf7f bytes) 000547 1788926143.504272 mapwrite 0x028b37 thru 0x02edd9 (0x62a3 bytes) 000548 1788926143.614696 mapwrite 0x03299a thru 0x036db6 (0x441d bytes) 000549 1788926143.732078 MIRROR_RESYNC 4 mirrors 000550 1788926144.915729 trunc from 0x03f851 to 0x03ce46 (0x2a0a bytes) 000552 1788926144.992643 punch from 0x030226 to 0x030539 (0x314 bytes) 000553 1788926144.998514 mapread 0x03245f thru 0x03778b (0x532d bytes) 000554 1788926145.019526 read 0x030ab3 thru 0x03ab8c (0xa0da bytes) 000555 1788926145.020774 mapwrite 0x015c05 thru 0x023733 (0xdb2f bytes) 000556 1788926145.110158 punch from 0x01b74b to 0x02a2e0 (0xeb96 bytes) 000557 1788926145.121060 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ce47): Mirror 3: 0xf0fad179 (stale) Mirror 4: 0xf0fad179 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ce47): Mirror 3: 0xf0fad179 (stale) Mirror 4: 0xf0fad179 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ce47: skipped 000558 1788926145.474120 trunc from 0x03ce47 to 0x0167b8 (0x2668e bytes) 000559 1788926145.512405 trunc from 0x0167b9 to 0x00d5e5 (0x91d3 bytes) 000560 1788926145.536902 read 0x00025c thru 0x001536 (0x12db bytes) 000564 1788926145.564726 mapwrite 0x03d419 thru 0x03ffff (0x2be7 bytes) 000566 1788926145.651568 mapwrite 0x03e06a thru 0x03ffff (0x1f96 bytes) 000567 1788926145.714153 trunc from 0x040000 to 0x018d69 (0x27296 bytes) 000569 1788926145.749767 punch from 0x012754 to 0x018d69 (0x6616 bytes) 000570 1788926145.759136 mapread 0x017c92 thru 0x018d69 (0x10d8 bytes) 000572 1788926145.774251 mapwrite 0x01493f thru 0x017570 (0x2c32 bytes) 000573 1788926145.831295 trunc from 0x018d6a to 0x019ee7 (0x117e bytes) 000574 1788926145.869322 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x19ee8): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19ee8): Mirror 3: 0x5989bb96 (stale) Mirror 4: 0x5989bb96 (stale) CRC-32 checksum value for chunk [0, 0x19ee8): Mirror 1: 0xf3fad524 Mirror 5: 0xf3fad524 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19ee8: skipped 000577 1788926146.993685 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19ee8): Mirror 4: 0x5989bb96 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19ee8): Mirror 4: 0x5989bb96 (stale) CRC-32 checksum value for chunk [0, 0x19ee8): Mirror 1: 0xf3fad524 Mirror 5: 0xf3fad524 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19ee8: skipped 000578 1788926147.713581 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) 000579 1788926148.030849 MIRROR_RESYNC 2 mirrors 000580 1788926148.390773 punch from 0x006149 to 0x006b99 (0xa51 bytes) 000581 1788926148.500329 read 0x0132ed thru 0x019ee7 (0x6bfb bytes) 000584 1788926148.511159 trunc from 0x019ee8 to 0x0126fb (0x77ec bytes) 000585 1788926148.542463 trunc from 0x0126fc to 0x00b02b (0x76d0 bytes) 000588 1788926148.579223 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xb02c): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb02c): Mirror 5: 0x441da4c6 (stale) CRC-32 checksum value for chunk [0, 0xb02c): Mirror 1: 0x441da4c6 Mirror 6: 0x441da4c6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb02c: skipped 000590 1788926150.038632 mapwrite 0x0001c3 thru 0x0085e5 (0x8423 bytes) 000592 1788926150.327531 mapread 0x008b3a thru 0x00b02b (0x24f2 bytes) 000593 1788926150.329479 read 0x001bba thru 0x006af3 (0x4f3a bytes) 000594 1788926150.331614 punch from 0x002b57 to 0x00b02b (0x84d5 bytes) 000596 1788926150.350368 read 0x004946 thru 0x00a486 (0x5b41 bytes) 000597 1788926150.385741 mapread 0x00a4ff thru 0x00b02b (0xb2d bytes) 000599 1788926150.401396 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xb02c): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb02c): Mirror 5: 0x441da4c6 (stale) Mirror 6: 0x441da4c6 (stale) CRC-32 checksum value for chunk [0, 0xb02c): Mirror 1: 0xb4622439 Mirror 7: 0xb4622439 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb02c: skipped 000600 1788926151.422032 mapread 0x003bc9 thru 0x00b02b (0x7463 bytes) 000603 1788926151.465813 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xb02c): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb02c): Mirror 5: 0x441da4c6 (stale) Mirror 6: 0x441da4c6 (stale) CRC-32 checksum value for chunk [0, 0xb02c): Mirror 1: 0xb4622439 Mirror 7: 0xb4622439 Mirror 8: 0xb4622439 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb02c: skipped 000604 1788926152.417045 read 0x003208 thru 0x008862 (0x565b bytes) 000605 1788926152.428630 trunc from 0x00b02c to 0x002e2a (0x8201 bytes) 000606 1788926152.651861 trunc from 0x002e2b to 0x019571 (0x16747 bytes) 000607 1788926152.678388 punch from 0x01353b to 0x019571 (0x6037 bytes) 000608 1788926152.699123 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19572): Mirror 5: 0xb889fcf0 (stale) Mirror 6: 0x4dd1a105 (stale) Mirror 7: 0x523d4bc8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19572): Mirror 5: 0xb889fcf0 (stale) Mirror 6: 0x4dd1a105 (stale) Mirror 7: 0x523d4bc8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19572: skipped 000609 1788926153.131453 trunc from 0x019572 to 0x013ac6 (0x5aab bytes) 000611 1788926153.172411 punch from 0x011a9f to 0x013ac6 (0x2028 bytes) 000612 1788926153.200640 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x13ac7): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13ac7): Mirror 5: 0xe8c8b221 (stale) Mirror 6: 0xfb9e9b5d (stale) Mirror 7: 0x9575d87c (stale) CRC-32 checksum value for chunk [0, 0x13ac7): Mirror 1: 0x9575d87c Mirror 8: 0x9575d87c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13ac7: skipped 000614 1788926154.782061 trunc from 0x013ac7 to 0x017f52 (0x448c bytes) 000615 1788926154.943170 mapread 0x017433 thru 0x017f52 (0xb20 bytes) 000622 1788926154.973562 punch from 0x006cf8 to 0x00cf4f (0x6258 bytes) 000623 1788926155.006317 MIRROR_RESYNC 5 mirrors 000624 1788926156.583189 punch from 0x00a049 to 0x01229d (0x8255 bytes) 000625 1788926156.663693 mapread 0x00c6fd thru 0x017f52 (0xb856 bytes) 000626 1788926156.703748 mapwrite 0x0279de thru 0x03723d (0xf860 bytes) 000627 1788926156.843814 read 0x028093 thru 0x03679e (0xe70c bytes) 000629 1788926156.854168 MIRROR_RESYNC 5 mirrors 000631 1788926158.349547 MIRROR_EXTEND to 6 mirrors 000632 1788926159.317789 trunc from 0x03723e to 0x00e80b (0x28a32 bytes) 000633 1788926159.420063 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe80c): Mirror 5: 0xccd0499f (stale) Mirror 6: 0xccd0499f (stale) Mirror 7: 0xccd0499f (stale) Mirror 9: 0xccd0499f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe80c): Mirror 5: 0xccd0499f (stale) Mirror 6: 0xccd0499f (stale) Mirror 7: 0xccd0499f (stale) Mirror 9: 0xccd0499f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe80c: skipped 000636 1788926159.891982 trunc from 0x00e80c to 0x0096d0 (0x513b bytes) 000637 1788926159.925871 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x96d1): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x96d1): Mirror 5: 0xbd7920de (stale) Mirror 6: 0xbd7920de (stale) Mirror 7: 0xbd7920de (stale) Mirror 9: 0xbd7920de (stale) CRC-32 checksum value for chunk [0, 0x96d1): Mirror 1: 0xbd7920de Mirror 10: 0xbd7920de lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x96d1: skipped 000639 1788926161.237098 mapwrite 0x007f96 thru 0x01775e (0xf7c9 bytes) 000640 1788926161.426359 read 0x00c768 thru 0x01775e (0xaff7 bytes) 000641 1788926161.431380 MIRROR_RESYNC 6 mirrors 000642 1788926162.577699 read 0x004a25 thru 0x00d1a0 (0x877c bytes) 000643 1788926162.585669 read 0x0103f8 thru 0x01775e (0x7367 bytes) 000645 1788926162.593864 punch from 0x00ac65 to 0x00b6eb (0xa87 bytes) 000646 1788926162.664475 punch from 0x014b0a to 0x01775e (0x2c55 bytes) 000648 1788926162.672250 write 0x026e9c thru 0x033126 (0xc28b bytes) 000649 1788926162.674691 write 0x0057e5 thru 0x00ac54 (0x5470 bytes) 000651 1788926162.690147 write 0x00544a thru 0x012fb0 (0xdb67 bytes) 000653 1788926162.705164 trunc from 0x033127 to 0x0356d0 (0x25aa bytes) 000654 1788926162.750925 read 0x0052cb thru 0x00e391 (0x90c7 bytes) 000656 1788926162.752174 trunc from 0x0356d1 to 0x00c13d (0x29593 bytes) 000659 1788926162.782503 read 0x00381b thru 0x008827 (0x500d bytes) 000660 1788926162.828532 mapread 0x006040 thru 0x00c13d (0x60fe bytes) 000661 1788926162.841133 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0xc13e): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc13e): Mirror 5: 0x1d96e24a (stale) Mirror 6: 0x1d96e24a (stale) Mirror 7: 0x1d96e24a (stale) Mirror 9: 0x1d96e24a (stale) Mirror 10: 0x1d96e24a (stale) CRC-32 checksum value for chunk [0, 0xc13e): Mirror 1: 0x6425f618 Mirror 11: 0x6425f618 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc13e: skipped 000662 1788926164.045553 mapwrite 0x03ca61 thru 0x03ffff (0x359f bytes) 000663 1788926164.195522 mapread 0x0307a0 thru 0x03afb8 (0xa819 bytes) 000664 1788926164.206498 mapread 0x011cac thru 0x018fbc (0x7311 bytes) 000665 1788926164.217486 trunc from 0x040000 to 0x020448 (0x1fbb7 bytes) 000667 1788926164.255742 mapwrite 0x03bb92 thru 0x03ffff (0x446e bytes) 000668 1788926164.358356 mapread 0x03936c thru 0x03ffff (0x6c94 bytes) 000670 1788926164.361456 mapwrite 0x01d054 thru 0x01ff6c (0x2f19 bytes) 000671 1788926164.413161 mapread 0x032a1f thru 0x03ffff (0xd5e1 bytes) 000672 1788926164.422414 trunc from 0x040000 to 0x01484b (0x2b7b4 bytes) 000674 1788926164.447456 mapwrite 0x0362c5 thru 0x036fad (0xce9 bytes) 000676 1788926164.514640 punch from 0x01e51d to 0x029a41 (0xb525 bytes) 000682 1788926164.523904 read 0x026b59 thru 0x0311e1 (0xa689 bytes) 000684 1788926164.534340 mapwrite 0x00f1ad thru 0x01ea80 (0xf8d4 bytes) 000685 1788926164.608216 mapread 0x02f93e thru 0x036fad (0x7670 bytes) 000686 1788926164.610069 trunc from 0x036fae to 0x03643d (0xb70 bytes) 000688 1788926164.626920 mapwrite 0x00a45f thru 0x017c9a (0xd83c bytes) 000689 1788926164.677841 mapread 0x0201d5 thru 0x0221e2 (0x200e bytes) 000690 1788926164.690342 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3643e): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3643e): Mirror 5: 0x15088117 (stale) Mirror 6: 0x15088117 (stale) Mirror 7: 0x15088117 (stale) Mirror 9: 0x15088117 (stale) Mirror 10: 0x15088117 (stale) Mirror 11: 0x74f71936 (stale) CRC-32 checksum value for chunk [0, 0x3643e): Mirror 1: 0x6a668278 Mirror 12: 0x6a668278 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3643e: skipped 000694 1788926165.880700 write 0x039d20 thru 0x03ffff (0x62e0 bytes) 000696 1788926165.980578 trunc from 0x040000 to 0x017cd1 (0x2832e bytes) 000699 1788926166.025433 mapread 0x00f6f0 thru 0x01498a (0x529b bytes) 000701 1788926166.067559 trunc from 0x017cd2 to 0x033c80 (0x1bfaf bytes) 000702 1788926166.090715 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x33c81): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33c81): Mirror 5: 0x3f85d6e4 (stale) Mirror 6: 0x3f85d6e4 (stale) Mirror 7: 0x3f85d6e4 (stale) Mirror 9: 0x3f85d6e4 (stale) Mirror 10: 0x3f85d6e4 (stale) Mirror 11: 0x2308b171 (stale) Mirror 12: 0x498fb693 (stale) CRC-32 checksum value for chunk [0, 0x33c81): Mirror 1: 0x4960678d Mirror 13: 0x4960678d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33c81: skipped 000703 1788926167.317394 punch from 0x013238 to 0x019d9f (0x6b68 bytes) 000704 1788926167.392281 mapread 0x029164 thru 0x02e369 (0x5206 bytes) 000705 1788926167.413858 read 0x008ca2 thru 0x00bfc1 (0x3320 bytes) 000706 1788926167.424277 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x33c81): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33c81): Mirror 5: 0x3f85d6e4 (stale) Mirror 6: 0x3f85d6e4 (stale) Mirror 7: 0x3f85d6e4 (stale) Mirror 9: 0x3f85d6e4 (stale) Mirror 10: 0x3f85d6e4 (stale) Mirror 11: 0x2308b171 (stale) Mirror 12: 0x498fb693 (stale) Mirror 13: 0x4960678d (stale) CRC-32 checksum value for chunk [0, 0x33c81): Mirror 1: 0x75b67b20 Mirror 14: 0x75b67b20 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33c81: skipped 000707 1788926168.670325 mapwrite 0x012ff8 thru 0x01e2e9 (0xb2f2 bytes) 000708 1788926169.021795 mapread 0x0081a1 thru 0x00c760 (0x45c0 bytes) 000709 1788926169.041938 write 0x00cf1c thru 0x0157e5 (0x88ca bytes) 000710 1788926169.043775 write 0x02aa0e thru 0x034525 (0x9b18 bytes) 000711 1788926169.050317 mapwrite 0x029eab thru 0x0379db (0xdb31 bytes) 000713 1788926169.148250 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x379dc): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x379dc): Mirror 5: 0x69573e57 (stale) Mirror 6: 0x69573e57 (stale) Mirror 7: 0x69573e57 (stale) Mirror 9: 0x69573e57 (stale) Mirror 10: 0x69573e57 (stale) Mirror 11: 0x8275d678 (stale) Mirror 12: 0x2c6919ad (stale) Mirror 13: 0x2bc15a8c (stale) Mirror 14: 0x438fa67b (stale) CRC-32 checksum value for chunk [0, 0x379dc): Mirror 1: 0x99d883a0 Mirror 15: 0x99d883a0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x379dc: skipped 000716 1788926170.224374 trunc from 0x0379dc to 0x02681c (0x111bf bytes) 000717 1788926170.339127 trunc from 0x02681d to 0x01685e (0xffbe bytes) 000718 1788926170.358233 trunc from 0x01685f to 0x0205bd (0x9d5f bytes) 000720 1788926170.379288 punch from 0x0057c8 to 0x009fde (0x4817 bytes) 000721 1788926170.384415 trunc from 0x0205be to 0x0048ac (0x1bd11 bytes) 000722 1788926170.434451 write 0x01d7ed thru 0x023faf (0x67c3 bytes) 000723 1788926170.436122 punch from 0x01750b to 0x01e32c (0x6e22 bytes) 000724 1788926170.482335 mapread 0x02397d thru 0x023faf (0x633 bytes) 000725 1788926170.486323 mapwrite 0x0066da thru 0x00a2cf (0x3bf6 bytes) 000726 1788926170.674375 mapread 0x00686d thru 0x013a60 (0xd1f4 bytes) 000727 1788926170.689610 punch from 0x0216ae to 0x023faf (0x2902 bytes) 000728 1788926170.701703 mapwrite 0x027a1e thru 0x0291b4 (0x1797 bytes) 000729 1788926170.913477 punch from 0x009318 to 0x015a83 (0xc76c bytes) 000730 1788926170.921541 mapwrite 0x02d2b8 thru 0x032e85 (0x5bce bytes) 000731 1788926171.123707 trunc from 0x032e86 to 0x02d6d0 (0x57b5 bytes) 000732 1788926171.181130 mapread 0x023c49 thru 0x02d6d0 (0x9a88 bytes) 000733 1788926171.187820 write 0x02921e thru 0x02af79 (0x1d5c bytes) 000734 1788926171.193622 mapwrite 0x037ea6 thru 0x039650 (0x17ab bytes) 000735 1788926171.449536 MIRROR_SPLIT mirror 4 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39651): Mirror 5: 0x87cec515 (stale) Mirror 6: 0x87cec515 (stale) Mirror 7: 0x87cec515 (stale) Mirror 10: 0x87cec515 (stale) Mirror 11: 0x577a0829 (stale) Mirror 12: 0xfa5d25b8 (stale) Mirror 13: 0x85797837 (stale) Mirror 14: 0xb3945c5d (stale) Mirror 15: 0xb6279d6c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39651): Mirror 5: 0x87cec515 (stale) Mirror 6: 0x87cec515 (stale) Mirror 7: 0x87cec515 (stale) Mirror 10: 0x87cec515 (stale) Mirror 11: 0x577a0829 (stale) Mirror 12: 0xfa5d25b8 (stale) Mirror 13: 0x85797837 (stale) Mirror 14: 0xb3945c5d (stale) Mirror 15: 0xb6279d6c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39651: skipped 000736 1788926172.272316 write 0x01cb9f thru 0x01e52c (0x198e bytes) 000737 1788926172.292564 trunc from 0x039651 to 0x00f54e (0x2a102 bytes) 000738 1788926172.324260 mapread 0x008f64 thru 0x00c7df (0x387c bytes) 000740 1788926172.374609 mapread 0x002f42 thru 0x006469 (0x3528 bytes) 000741 1788926172.399295 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0xf54f): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf54f): Mirror 5: 0x5825ad3a (stale) Mirror 6: 0x5825ad3a (stale) Mirror 7: 0x5825ad3a (stale) Mirror 10: 0x5825ad3a (stale) Mirror 11: 0x41375989 (stale) Mirror 12: 0xbc76f835 (stale) Mirror 13: 0xbc76f835 (stale) Mirror 14: 0xbc76f835 (stale) Mirror 15: 0x31d25a27 (stale) CRC-32 checksum value for chunk [0, 0xf54f): Mirror 1: 0xb8a8bffe Mirror 16: 0xb8a8bffe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf54f: skipped 000743 1788926173.517819 trunc from 0x00f54f to 0x012a4f (0x3501 bytes) 000744 1788926173.688056 punch from 0x00f316 to 0x012a4f (0x373a bytes) 000745 1788926173.695401 read 0x00df37 thru 0x00f29c (0x1366 bytes) 000746 1788926173.703777 write 0x011788 thru 0x0193a2 (0x7c1b bytes) 000747 1788926173.717604 read 0x011b61 thru 0x0193a2 (0x7842 bytes) 000748 1788926173.718938 mapread 0x01544e thru 0x0193a2 (0x3f55 bytes) 000749 1788926173.728166 punch from 0x004aad to 0x0058ee (0xe42 bytes) 000750 1788926173.755159 write 0x0100e9 thru 0x01bc48 (0xbb60 bytes) 000752 1788926173.781230 read 0x010e18 thru 0x0125aa (0x1793 bytes) 000754 1788926173.785539 mapwrite 0x037cd3 thru 0x03ffff (0x832d bytes) 000755 1788926173.958293 punch from 0x02821e to 0x033e04 (0xbbe7 bytes) 000756 1788926173.965710 trunc from 0x040000 to 0x03d4ef (0x2b10 bytes) 000757 1788926174.012338 trunc from 0x03d4f0 to 0x02afea (0x12505 bytes) 000758 1788926174.040497 trunc from 0x02afeb to 0x02dd6e (0x2d84 bytes) 000759 1788926174.059789 mapread 0x027a96 thru 0x02dd6e (0x62d9 bytes) 000762 1788926174.091465 trunc from 0x02dd6f to 0x036deb (0x907d bytes) 000764 1788926174.111798 write 0x02cc53 thru 0x039945 (0xccf3 bytes) 000765 1788926174.117683 read 0x036233 thru 0x039945 (0x3713 bytes) 000767 1788926174.120839 trunc from 0x039946 to 0x0217d1 (0x18174 bytes) 000768 1788926174.150062 write 0x015664 thru 0x024507 (0xeea4 bytes) 000769 1788926174.151902 mapwrite 0x035a38 thru 0x039bd8 (0x41a1 bytes) 000770 1788926174.293040 MIRROR_RESYNC 11 mirrors 000771 1788926176.554467 mapwrite 0x028ff9 thru 0x03074f (0x7757 bytes) 000772 1788926176.885150 write 0x03848d thru 0x03b480 (0x2ff4 bytes) 000773 1788926176.897213 trunc from 0x03b481 to 0x0285bb (0x12ec5 bytes) 000774 1788926176.937853 read 0x0267d1 thru 0x0285bb (0x1deb bytes) 000776 1788926176.944120 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x285bc): Mirror 6: 0xd5141a73 (stale) Mirror 7: 0xd5141a73 (stale) Mirror 10: 0xd5141a73 (stale) Mirror 11: 0xd5141a73 (stale) Mirror 12: 0xd5141a73 (stale) Mirror 13: 0xd5141a73 (stale) Mirror 14: 0xd5141a73 (stale) Mirror 15: 0xd5141a73 (stale) Mirror 16: 0xd5141a73 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x285bc): Mirror 6: 0xd5141a73 (stale) Mirror 7: 0xd5141a73 (stale) Mirror 10: 0xd5141a73 (stale) Mirror 11: 0xd5141a73 (stale) Mirror 12: 0xd5141a73 (stale) Mirror 13: 0xd5141a73 (stale) Mirror 14: 0xd5141a73 (stale) Mirror 15: 0xd5141a73 (stale) Mirror 16: 0xd5141a73 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x285bc: skipped 000777 1788926177.526678 write 0x01aa2e thru 0x022ce7 (0x82ba bytes) 000778 1788926177.538544 mapread 0x01f088 thru 0x021e60 (0x2dd9 bytes) 000779 1788926177.540373 mapread 0x00cd32 thru 0x013d60 (0x702f bytes) 000780 1788926177.566568 read 0x0038fe thru 0x007624 (0x3d27 bytes) 000781 1788926177.573171 trunc from 0x0285bc to 0x00a52e (0x1e08d bytes) 000783 1788926177.607425 write 0x018d2c thru 0x01e008 (0x52dd bytes) 000784 1788926177.610627 mapwrite 0x004bef thru 0x01090e (0xbd20 bytes) 000785 1788926177.678212 mapwrite 0x02e353 thru 0x03d58e (0xf23c bytes) 000786 1788926177.816624 write 0x000a95 thru 0x00bdba (0xb326 bytes) 000789 1788926177.827340 mapwrite 0x015c84 thru 0x0170d0 (0x144d bytes) 000790 1788926177.941700 read 0x0234fe thru 0x0268b6 (0x33b9 bytes) 000792 1788926177.956289 read 0x01356b thru 0x019408 (0x5e9e bytes) 000793 1788926177.963497 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3d58f): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d58f): Mirror 6: 0x3bebf458 (stale) Mirror 7: 0x3bebf458 (stale) Mirror 10: 0x3bebf458 (stale) Mirror 11: 0x3bebf458 (stale) Mirror 12: 0x3bebf458 (stale) Mirror 13: 0x3bebf458 (stale) Mirror 14: 0x3bebf458 (stale) Mirror 15: 0x3bebf458 (stale) Mirror 16: 0x3bebf458 (stale) CRC-32 checksum value for chunk [0, 0x3d58f): Mirror 1: 0xdafc7964 Mirror 17: 0xdafc7964 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d58f: skipped 000795 1788926179.390815 trunc from 0x03d58f to 0x026d08 (0x16886 bytes) 000796 1788926179.529056 MIRROR_RESYNC 11 mirrors 000797 1788926181.822558 trunc from 0x026d09 to 0x031df1 (0xb0e9 bytes) 000798 1788926181.914205 mapread 0x0305a2 thru 0x031df1 (0x1850 bytes) 000799 1788926181.932502 trunc from 0x031df2 to 0x01cc0e (0x151e3 bytes) 000800 1788926181.964228 write 0x03b3fc thru 0x03ffff (0x4c04 bytes) 000801 1788926181.972193 MIRROR_RESYNC 11 mirrors 000802 1788926185.169296 punch from 0x00581c to 0x011a80 (0xc265 bytes) 000804 1788926185.291373 read 0x0274eb thru 0x02e89a (0x73b0 bytes) 000805 1788926185.313476 MIRROR_SPLIT mirror 5 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xb04b825f (stale) Mirror 7: 0xb04b825f (stale) Mirror 10: 0xb04b825f (stale) Mirror 11: 0xb04b825f (stale) Mirror 13: 0xb04b825f (stale) Mirror 14: 0xb04b825f (stale) Mirror 15: 0xb04b825f (stale) Mirror 16: 0xb04b825f (stale) Mirror 17: 0xb04b825f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xb04b825f (stale) Mirror 7: 0xb04b825f (stale) Mirror 10: 0xb04b825f (stale) Mirror 11: 0xb04b825f (stale) Mirror 13: 0xb04b825f (stale) Mirror 14: 0xb04b825f (stale) Mirror 15: 0xb04b825f (stale) Mirror 16: 0xb04b825f (stale) Mirror 17: 0xb04b825f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000807 1788926186.021549 write 0x020ef8 thru 0x0247cd (0x38d6 bytes) 000808 1788926186.044000 read 0x006b55 thru 0x01368e (0xcb3a bytes) 000810 1788926186.061879 punch from 0x024bf2 to 0x02e0d7 (0x94e6 bytes) 000811 1788926186.113323 mapread 0x010afd thru 0x0151fd (0x4701 bytes) 000812 1788926186.148400 punch from 0x003de4 to 0x00b618 (0x7835 bytes) 000813 1788926186.172471 read 0x002b59 thru 0x00970b (0x6bb3 bytes) 000815 1788926186.194461 mapwrite 0x012726 thru 0x01f9b4 (0xd28f bytes) 000816 1788926186.290644 read 0x039ba2 thru 0x03ffff (0x645e bytes) 000818 1788926186.301302 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xb04b825f (stale) Mirror 10: 0xb04b825f (stale) Mirror 11: 0xb04b825f (stale) Mirror 13: 0xb04b825f (stale) Mirror 14: 0xb04b825f (stale) Mirror 15: 0xb04b825f (stale) Mirror 16: 0xb04b825f (stale) Mirror 17: 0xb04b825f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xb04b825f (stale) Mirror 10: 0xb04b825f (stale) Mirror 11: 0xb04b825f (stale) Mirror 13: 0xb04b825f (stale) Mirror 14: 0xb04b825f (stale) Mirror 15: 0xb04b825f (stale) Mirror 16: 0xb04b825f (stale) Mirror 17: 0xb04b825f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000821 1788926187.011944 write 0x027716 thru 0x0369e7 (0xf2d2 bytes) 000822 1788926187.026936 trunc from 0x040000 to 0x02770a (0x188f5 bytes) 000823 1788926187.049028 mapwrite 0x03062f thru 0x035de0 (0x57b2 bytes) 000824 1788926187.188637 mapwrite 0x035d03 thru 0x03b70e (0x5a0c bytes) 000825 1788926187.345303 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b70f): Mirror 10: 0x2ad8a9c9 (stale) Mirror 11: 0x2ad8a9c9 (stale) Mirror 13: 0x2ad8a9c9 (stale) Mirror 14: 0x2ad8a9c9 (stale) Mirror 15: 0x2ad8a9c9 (stale) Mirror 16: 0x2ad8a9c9 (stale) Mirror 17: 0x2ad8a9c9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b70f): Mirror 10: 0x2ad8a9c9 (stale) Mirror 11: 0x2ad8a9c9 (stale) Mirror 13: 0x2ad8a9c9 (stale) Mirror 14: 0x2ad8a9c9 (stale) Mirror 15: 0x2ad8a9c9 (stale) Mirror 16: 0x2ad8a9c9 (stale) Mirror 17: 0x2ad8a9c9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b70f: skipped 000826 1788926188.001769 mapwrite 0x01bb57 thru 0x02531e (0x97c8 bytes) 000827 1788926188.065076 read 0x0012be thru 0x00dee7 (0xcc2a bytes) 000828 1788926188.070273 punch from 0x02e553 to 0x038e15 (0xa8c3 bytes) 000829 1788926188.074550 read 0x00471d thru 0x013e1a (0xf6fe bytes) 000833 1788926188.087596 trunc from 0x03b70f to 0x02ef1b (0xc7f3 bytes) 000834 1788926188.117131 MIRROR_RESYNC 8 mirrors 000835 1788926190.004453 trunc from 0x02ef1c to 0x02fbed (0xcd2 bytes) 000837 1788926190.107810 read 0x028ee6 thru 0x02fbed (0x6d08 bytes) 000841 1788926190.127511 trunc from 0x02fbee to 0x02a464 (0x5789 bytes) 000842 1788926190.150904 mapread 0x016fe9 thru 0x0200f9 (0x9111 bytes) 000843 1788926190.169805 punch from 0x00bfa2 to 0x013072 (0x70d1 bytes) 000844 1788926190.177176 mapwrite 0x026903 thru 0x0309f0 (0xa0ee bytes) 000845 1788926190.284632 trunc from 0x0309f1 to 0x006695 (0x2a35b bytes) 000847 1788926190.305875 write 0x01b4f0 thru 0x02973b (0xe24c bytes) 000849 1788926190.308990 mapread 0x01085f thru 0x017609 (0x6dab bytes) 000850 1788926190.322121 mapread 0x0223f0 thru 0x0242c6 (0x1ed7 bytes) 000851 1788926190.323126 read 0x0282f2 thru 0x02973b (0x144a bytes) 000852 1788926190.323666 punch from 0x0094f4 to 0x017aee (0xe5fb bytes) 000853 1788926190.341458 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2973c): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2973c): Mirror 10: 0x7fbc9d2 (stale) Mirror 11: 0x7fbc9d2 (stale) Mirror 13: 0x7fbc9d2 (stale) Mirror 14: 0x7fbc9d2 (stale) Mirror 15: 0x7fbc9d2 (stale) Mirror 16: 0x7fbc9d2 (stale) Mirror 17: 0x7fbc9d2 (stale) CRC-32 checksum value for chunk [0, 0x2973c): Mirror 1: 0x86080b0f Mirror 18: 0x86080b0f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2973c: skipped 000855 1788926191.391812 MIRROR_RESYNC 9 mirrors 000856 1788926192.960324 write 0x033b21 thru 0x03ffff (0xc4df bytes) 000857 1788926193.053784 punch from 0x028a3d to 0x02ca10 (0x3fd4 bytes) 000858 1788926193.070630 punch from 0x036b29 to 0x03b151 (0x4629 bytes) 000862 1788926193.078701 write 0x012def thru 0x01e0cd (0xb2df bytes) 000863 1788926193.095735 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xf2145cf3 (stale) Mirror 13: 0xf2145cf3 (stale) Mirror 14: 0xf2145cf3 (stale) Mirror 15: 0xf2145cf3 (stale) Mirror 16: 0xf2145cf3 (stale) Mirror 17: 0xf2145cf3 (stale) Mirror 18: 0xf2145cf3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xf2145cf3 (stale) Mirror 13: 0xf2145cf3 (stale) Mirror 14: 0xf2145cf3 (stale) Mirror 15: 0xf2145cf3 (stale) Mirror 16: 0xf2145cf3 (stale) Mirror 17: 0xf2145cf3 (stale) Mirror 18: 0xf2145cf3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000864 1788926193.591812 trunc from 0x040000 to 0x00e205 (0x31dfa bytes) 000865 1788926193.637601 read 0x005ace thru 0x00e205 (0x8738 bytes) 000866 1788926193.648784 punch from 0x007f94 to 0x0094c5 (0x1532 bytes) 000867 1788926193.657617 trunc from 0x00e206 to 0x005112 (0x90f3 bytes) 000869 1788926193.687067 mapwrite 0x0267a1 thru 0x031dce (0xb62e bytes) 000873 1788926193.818295 trunc from 0x031dcf to 0x003a16 (0x2e3b8 bytes) 000875 1788926193.854152 MIRROR_RESYNC 8 mirrors 000876 1788926194.943829 read 0x001a99 thru 0x003a16 (0x1f7e bytes) 000877 1788926194.949721 write 0x0221bc thru 0x02dbca (0xba0f bytes) 000878 1788926195.032433 punch from 0x00def7 to 0x018bc7 (0xacd1 bytes) 000879 1788926195.046897 write 0x023c1e thru 0x02a026 (0x6409 bytes) 000882 1788926195.050763 read 0x019dfe thru 0x0259a0 (0xbba3 bytes) 000883 1788926195.061976 mapread 0x020139 thru 0x027ca9 (0x7b71 bytes) 000884 1788926195.063409 read 0x015fda thru 0x01abb4 (0x4bdb bytes) 000885 1788926195.064518 mapwrite 0x031a86 thru 0x03dbb1 (0xc12c bytes) 000886 1788926195.195484 mapwrite 0x03c925 thru 0x03ffff (0x36db bytes) 000888 1788926195.326890 write 0x0370d3 thru 0x03e2bb (0x71e9 bytes) 000892 1788926195.332992 mapread 0x006b93 thru 0x00b7aa (0x4c18 bytes) 000893 1788926195.334557 read 0x02e92e thru 0x037f46 (0x9619 bytes) 000894 1788926195.335422 write 0x02b8fe thru 0x038ee3 (0xd5e6 bytes) 000895 1788926195.337727 read 0x007d1c thru 0x00eaf6 (0x6ddb bytes) 000898 1788926195.345174 read 0x01796c thru 0x026fa6 (0xf63b bytes) 000900 1788926195.364936 MIRROR_RESYNC 8 mirrors 000901 1788926198.186074 read 0x03f568 thru 0x03ffff (0xa98 bytes) 000903 1788926198.193488 punch from 0x02a5e3 to 0x03511d (0xab3b bytes) 000906 1788926198.286796 mapwrite 0x03e93e thru 0x03ffff (0x16c2 bytes) 000907 1788926198.384014 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x3fb9352 (stale) Mirror 13: 0x3fb9352 (stale) Mirror 14: 0x3fb9352 (stale) Mirror 15: 0x3fb9352 (stale) Mirror 16: 0x3fb9352 (stale) Mirror 17: 0x3fb9352 (stale) Mirror 18: 0x3fb9352 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x535cd4b0 Mirror 19: 0x535cd4b0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000908 1788926200.078395 write 0x014d01 thru 0x01f188 (0xa488 bytes) 000909 1788926200.260897 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x3fb9352 (stale) Mirror 13: 0x3fb9352 (stale) Mirror 14: 0x3fb9352 (stale) Mirror 15: 0x3fb9352 (stale) Mirror 16: 0x3fb9352 (stale) Mirror 17: 0x3fb9352 (stale) Mirror 18: 0x3fb9352 (stale) Mirror 19: 0x535cd4b0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x83a740ed Mirror 20: 0x83a740ed lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000911 1788926201.641222 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x3fb9352 (stale) Mirror 14: 0x3fb9352 (stale) Mirror 15: 0x3fb9352 (stale) Mirror 16: 0x3fb9352 (stale) Mirror 17: 0x3fb9352 (stale) Mirror 18: 0x3fb9352 (stale) Mirror 19: 0x535cd4b0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x3fb9352 (stale) Mirror 14: 0x3fb9352 (stale) Mirror 15: 0x3fb9352 (stale) Mirror 16: 0x3fb9352 (stale) Mirror 17: 0x3fb9352 (stale) Mirror 18: 0x3fb9352 (stale) Mirror 19: 0x535cd4b0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x83a740ed Mirror 20: 0x83a740ed lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000912 1788926202.823202 read 0x0367b3 thru 0x03a42d (0x3c7b bytes) 000913 1788926202.844359 punch from 0x0096a1 to 0x0174e5 (0xde45 bytes) 000915 1788926203.060105 read 0x008698 thru 0x010517 (0x7e80 bytes) 000917 1788926203.086434 read 0x019c4f thru 0x01a926 (0xcd8 bytes) 000918 1788926203.087060 mapwrite 0x01611c thru 0x0212e6 (0xb1cb bytes) 000919 1788926203.207374 MIRROR_RESYNC 9 mirrors 000920 1788926205.377678 trunc from 0x040000 to 0x028470 (0x17b8f bytes) 000921 1788926205.588272 punch from 0x027a0d to 0x028470 (0xa64 bytes) 000922 1788926205.596289 mapread 0x01402e thru 0x01b3f1 (0x73c4 bytes) 000923 1788926205.678299 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x28471): Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28471): Mirror 11: 0x6fd9ca36 (stale) Mirror 14: 0x6fd9ca36 (stale) Mirror 15: 0x6fd9ca36 (stale) Mirror 16: 0x6fd9ca36 (stale) Mirror 17: 0x6fd9ca36 (stale) Mirror 18: 0x6fd9ca36 (stale) Mirror 19: 0x6fd9ca36 (stale) Mirror 20: 0x6fd9ca36 (stale) CRC-32 checksum value for chunk [0, 0x28471): Mirror 1: 0xdc527aa6 Mirror 21: 0xdc527aa6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28471: skipped 000924 1788926206.951802 write 0x0147ae thru 0x023442 (0xec95 bytes) 000926 1788926207.046673 punch from 0x017629 to 0x02191f (0xa2f7 bytes) 000927 1788926207.060120 mapwrite 0x031b3c thru 0x03a66c (0x8b31 bytes) 000928 1788926207.165934 read 0x030a98 thru 0x0339b0 (0x2f19 bytes) 000929 1788926207.166714 mapread 0x01fd5c thru 0x02411c (0x43c1 bytes) 000931 1788926207.176980 trunc from 0x03a66d to 0x000702 (0x39f6a bytes) 000932 1788926207.201634 punch from 0x000562 to 0x000702 (0x1a1 bytes) 000933 1788926207.209215 read 0x0003e8 thru 0x000702 (0x31b bytes) 000934 1788926207.215427 punch from 0x00026e to 0x000702 (0x495 bytes) 000935 1788926207.222378 mapread 0x000554 thru 0x000702 (0x1af bytes) 000936 1788926207.228497 write 0x027a0e thru 0x031a36 (0xa029 bytes) 000937 1788926207.230755 punch from 0x01716b to 0x01f22b (0x80c1 bytes) 000938 1788926207.249012 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31a37): Mirror 14: 0xbf0e2c09 (stale) Mirror 15: 0xbf0e2c09 (stale) Mirror 16: 0xbf0e2c09 (stale) Mirror 17: 0xbf0e2c09 (stale) Mirror 18: 0xbf0e2c09 (stale) Mirror 19: 0xbf0e2c09 (stale) Mirror 20: 0xbf0e2c09 (stale) Mirror 21: 0x6ad6250a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31a37): Mirror 14: 0xbf0e2c09 (stale) Mirror 15: 0xbf0e2c09 (stale) Mirror 16: 0xbf0e2c09 (stale) Mirror 17: 0xbf0e2c09 (stale) Mirror 18: 0xbf0e2c09 (stale) Mirror 19: 0xbf0e2c09 (stale) Mirror 20: 0xbf0e2c09 (stale) Mirror 21: 0x6ad6250a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31a37: skipped 000939 1788926207.792520 mapwrite 0x03ccdd thru 0x03ffff (0x3323 bytes) 000940 1788926207.901220 read 0x036505 thru 0x03ffff (0x9afb bytes) 000942 1788926207.908166 punch from 0x004ed2 to 0x011244 (0xc373 bytes) 000943 1788926207.917890 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x187:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x7a83144c (stale) Mirror 15: 0x7a83144c (stale) Mirror 16: 0x7a83144c (stale) Mirror 18: 0x7a83144c (stale) Mirror 19: 0x7a83144c (stale) Mirror 20: 0x7a83144c (stale) Mirror 21: 0xa1735864 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x7a83144c (stale) Mirror 15: 0x7a83144c (stale) Mirror 16: 0x7a83144c (stale) Mirror 18: 0x7a83144c (stale) Mirror 19: 0x7a83144c (stale) Mirror 20: 0x7a83144c (stale) Mirror 21: 0xa1735864 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000944 1788926208.407813 read 0x03e601 thru 0x03ffff (0x19ff bytes) 000945 1788926208.416247 mapread 0x00f0d5 thru 0x013ce4 (0x4c10 bytes) 000946 1788926208.439408 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x7a83144c (stale) Mirror 15: 0x7a83144c (stale) Mirror 16: 0x7a83144c (stale) Mirror 18: 0x7a83144c (stale) Mirror 19: 0x7a83144c (stale) Mirror 20: 0x7a83144c (stale) Mirror 21: 0xa1735864 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8224a551 Mirror 22: 0x8224a551 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000947 1788926209.961178 mapread 0x01bf2d thru 0x02bc75 (0xfd49 bytes) 000948 1788926210.034470 read 0x03e9de thru 0x03ffff (0x1622 bytes) 000954 1788926210.120654 read 0x02eac9 thru 0x03bd12 (0xd24a bytes) 000955 1788926210.152744 trunc from 0x040000 to 0x0253a0 (0x1ac5f bytes) 000956 1788926210.268505 mapwrite 0x021f54 thru 0x02a6fa (0x87a7 bytes) 000957 1788926210.390513 read 0x028417 thru 0x02a6fa (0x22e4 bytes) 000958 1788926210.391871 trunc from 0x02a6fb to 0x00da3f (0x1ccbb bytes) 000959 1788926210.414185 MIRROR_RESYNC 9 mirrors 000960 1788926211.914730 mapwrite 0x006bba thru 0x0073c4 (0x80b bytes) 000961 1788926212.063929 write 0x00599f thru 0x00af7b (0x55dd bytes) 000962 1788926212.065352 mapwrite 0x00483a thru 0x011390 (0xcb57 bytes) 000963 1788926212.133691 mapread 0x00e0f0 thru 0x011390 (0x32a1 bytes) 000964 1788926212.134725 punch from 0x000b4c to 0x004c79 (0x412e bytes) 000965 1788926212.140252 read 0x0084f3 thru 0x00a9de (0x24ec bytes) 000966 1788926212.140906 punch from 0x0021d2 to 0x00d979 (0xb7a8 bytes) 000967 1788926212.148736 trunc from 0x011391 to 0x002da6 (0xe5ea bytes) 000969 1788926212.165285 trunc from 0x002da7 to 0x01f141 (0x1c39b bytes) 000971 1788926212.179051 mapwrite 0x02d175 thru 0x030ba2 (0x3a2e bytes) 000972 1788926212.299556 trunc from 0x030ba3 to 0x037786 (0x6be4 bytes) 000973 1788926212.335504 read 0x0328e0 thru 0x037786 (0x4ea7 bytes) 000974 1788926212.360391 read 0x00f81e thru 0x0153e2 (0x5bc5 bytes) 000975 1788926212.362387 mapread 0x019b25 thru 0x021f6b (0x8447 bytes) 000976 1788926212.367697 write 0x024290 thru 0x02ff60 (0xbcd1 bytes) 000977 1788926212.374187 trunc from 0x037787 to 0x0100c6 (0x276c0 bytes) 000978 1788926212.405823 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x100c7): Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x100c7): Mirror 14: 0xc9874034 (stale) Mirror 15: 0xc9874034 (stale) Mirror 16: 0xc9874034 (stale) Mirror 18: 0xc9874034 (stale) Mirror 19: 0xc9874034 (stale) Mirror 20: 0xc9874034 (stale) Mirror 21: 0xc9874034 (stale) Mirror 22: 0xc9874034 (stale) CRC-32 checksum value for chunk [0, 0x100c7): Mirror 1: 0xc9874034 Mirror 23: 0xc9874034 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x100c7: skipped 000979 1788926213.410266 read 0x009c53 thru 0x00aa23 (0xdd1 bytes) 000982 1788926213.454790 mapwrite 0x021cfc thru 0x02d179 (0xb47e bytes) 000983 1788926213.744322 punch from 0x023280 to 0x02d179 (0x9efa bytes) 000984 1788926213.751239 mapwrite 0x00738f thru 0x01063b (0x92ad bytes) 000986 1788926213.868480 mapwrite 0x03c8e5 thru 0x03ffff (0x371b bytes) 000987 1788926214.013423 mapread 0x03dcaf thru 0x03ffff (0x2351 bytes) 000988 1788926214.016514 mapread 0x0277b9 thru 0x03446e (0xccb6 bytes) 000989 1788926214.048125 write 0x03c71a thru 0x03ffff (0x38e6 bytes) 000991 1788926214.057940 mapread 0x02c7af thru 0x03ab99 (0xe3eb bytes) 000992 1788926214.061916 mapread 0x027ee0 thru 0x02fe89 (0x7faa bytes) 000995 1788926214.070740 mapwrite 0x02bcd9 thru 0x032667 (0x698f bytes) 000997 1788926214.175138 write 0x03596d thru 0x03777c (0x1e10 bytes) 000998 1788926214.176171 mapwrite 0x006b02 thru 0x008189 (0x1688 bytes) 000999 1788926214.289777 mapread 0x027f7c thru 0x037ea3 (0xff28 bytes) All operations completed A-OK!