== sanity-flr test 70a: flr mode fsx test ================ 20:01:46 (1770685306) striped dir -i0 -c2 -H crush /mnt/lustre/d70a.sanity-flr Seed set to 5309 skipping zero size read skipping zero length punch hole 000003 1770685309.337531 write 0x02dfac thru 0x034d5c (0x6db1 bytes) truncating to largest ever: 0x31788 000005 1770685309.343493 trunc from 0x034d5d to 0x031787 (0x35d5 bytes) 000006 1770685309.365032 punch from 0x01a6b1 to 0x02a132 (0xfa82 bytes) 000007 1770685309.369421 trunc from 0x031788 to 0x01c039 (0x1574e bytes) 000009 1770685309.393132 read 0x001138 thru 0x00fa4b (0xe914 bytes) 000010 1770685309.408822 punch from 0x01385b to 0x01c039 (0x87df bytes) 000011 1770685309.413558 mapwrite 0x022276 thru 0x024ede (0x2c69 bytes) 000012 1770685309.499022 mapread 0x00d22a thru 0x01a8e5 (0xd6bc bytes) 000013 1770685309.538648 MIRROR_EXTEND to 2 mirrors 000015 1770685310.595513 mapwrite 0x02b46c thru 0x036c78 (0xb80d bytes) 000016 1770685310.734835 trunc from 0x034d7e to 0x036c78 (0x1efb bytes) 000017 1770685310.740749 write 0x03efaf thru 0x03ffff (0x1051 bytes) 000018 1770685310.742120 trunc from 0x040000 to 0x015d0a (0x2a2f5 bytes) fallocating to largest ever: 0x37fee 000019 1770685310.777235 fallocate 0x036cbd thru 0x037fed (0x1331 bytes) 000020 1770685310.783647 mapread 0x001212 thru 0x0057da (0x45c9 bytes) 000021 1770685310.807689 write 0x005fb5 thru 0x00c3eb (0x6437 bytes) 000022 1770685310.811811 punch from 0x011ee2 to 0x015d0a (0x3e29 bytes) 000023 1770685310.820242 trunc from 0x00557d to 0x01109d (0xbb21 bytes) 000024 1770685310.853549 mapwrite 0x027e49 thru 0x02f411 (0x75c9 bytes) 000025 1770685310.943640 punch from 0x00a02f to 0x00ce6e (0x2e40 bytes) 000026 1770685310.951346 punch from 0x018ca1 to 0x024165 (0xb4c5 bytes) 000028 1770685310.957780 mapwrite 0x02e377 thru 0x033cec (0x5976 bytes) 000029 1770685311.004749 trunc from 0x022a6b to 0x030396 (0xd92c bytes) 000030 1770685311.010392 read 0x01926d thru 0x01f459 (0x61ed bytes) 000031 1770685311.019224 fallocate 0x01835e thru 0x0210e1 (0x8d84 bytes) 000032 1770685311.025021 mapread 0x01e65b thru 0x02d268 (0xec0e bytes) 000034 1770685311.042663 write 0x015577 thru 0x017a98 (0x2522 bytes) 000035 1770685311.053597 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x33ced): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33ced): Mirror 2: 0x3faf1d71 (stale) CRC-32 checksum value for chunk [0, 0x33ced): Mirror 1: 0xb9c26341 Mirror 3: 0xb9c26341 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33ced: skipped 000036 1770685311.714360 mapread 0x001a96 thru 0x00fe75 (0xe3e0 bytes) 000037 1770685311.750940 mapwrite 0x039421 thru 0x03ae5a (0x1a3a bytes) 000038 1770685311.841178 write 0x031030 thru 0x032e46 (0x1e17 bytes) 000039 1770685311.850327 mapwrite 0x026d9c thru 0x02d475 (0x66da bytes) 000040 1770685311.909515 read 0x0314a6 thru 0x03ae5a (0x99b5 bytes) 000041 1770685311.911636 mapread 0x010100 thru 0x01321a (0x311b bytes) 000042 1770685311.930362 fallocate 0x004e82 thru 0x01012e (0xb2ad bytes) 000043 1770685311.938451 trunc from 0x03ae5b to 0x034ad0 (0x638a bytes) 000044 1770685311.984835 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x34ad1): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34ad1): Mirror 2: 0x69f10f2 (stale) Mirror 3: 0xb9285002 (stale) CRC-32 checksum value for chunk [0, 0x34ad1): Mirror 1: 0xf0013fb2 Mirror 4: 0xf0013fb2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34ad1: skipped 000045 1770685312.826380 fallocate 0x021708 thru 0x02c7b6 (0xb0af bytes) 000047 1770685312.869772 trunc from 0x02edd8 to 0x02f515 (0x73e bytes) 000048 1770685312.876246 trunc from 0x0070a0 to 0x00d216 (0x6177 bytes) 000049 1770685312.881155 punch from 0x029ecf to 0x02e268 (0x439a bytes) 000050 1770685312.886362 write 0x01b66d thru 0x026cc8 (0xb65c bytes) 000051 1770685312.902104 write 0x03fd3d thru 0x03ffff (0x2c3 bytes) 000052 1770685312.909275 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xedd67dc9 (stale) Mirror 3: 0xa129daa8 (stale) Mirror 4: 0xdc69ab1d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x387a7800 Mirror 5: 0x387a7800 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000054 1770685313.888514 punch from 0x03d689 to 0x03e5d9 (0xf51 bytes) 000055 1770685313.941155 trunc from 0x007304 to 0x01686e (0xf56b bytes) 000056 1770685313.950659 punch from 0x02072f to 0x02b7a2 (0xb074 bytes) 000057 1770685313.963126 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xedd67dc9 (stale) Mirror 3: 0xa129daa8 (stale) Mirror 4: 0xdc69ab1d (stale) Mirror 5: 0x387a7800 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x16ae8d03 Mirror 6: 0x16ae8d03 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000058 1770685315.007006 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xedd67dc9 (stale) Mirror 3: 0xa129daa8 (stale) Mirror 4: 0xdc69ab1d (stale) Mirror 5: 0x387a7800 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x16ae8d03 Mirror 6: 0x16ae8d03 Mirror 7: 0x16ae8d03 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped fallocating to largest ever: 0x40000 000059 1770685315.898207 fallocate 0x037d08 thru 0x03ffff (0x82f8 bytes) 000060 1770685315.944337 mapwrite 0x030a6f thru 0x036cc3 (0x6255 bytes) 000061 1770685316.002155 fallocate 0x006b85 thru 0x00ac03 (0x407f bytes) 000064 1770685316.008530 punch from 0x016286 to 0x02614c (0xfec7 bytes) 000065 1770685316.014275 trunc from 0x0289fa to 0x02b765 (0x2d6c bytes) 000066 1770685316.019282 trunc from 0x040000 to 0x01f179 (0x20e86 bytes) 000067 1770685316.044152 trunc from 0x01f17a to 0x016a1a (0x875f bytes) 000068 1770685316.057775 fallocate 0x0345fe thru 0x03845f (0x3e62 bytes) 000069 1770685316.062793 mapwrite 0x00e1bf thru 0x017911 (0x9753 bytes) 000070 1770685316.097088 trunc from 0x038460 to 0x01fb60 (0x188ff bytes) 000072 1770685316.112445 read 0x01985b thru 0x01d124 (0x38ca bytes) 000073 1770685316.114042 fallocate 0x025319 thru 0x0282ca (0x2fb2 bytes) 000074 1770685316.120043 read 0x008ee1 thru 0x00a582 (0x16a2 bytes) 000075 1770685316.121083 punch from 0x01c36a to 0x01fb60 (0x37f7 bytes) 000076 1770685316.125972 trunc from 0x01fb61 to 0x035ad7 (0x15f77 bytes) 000077 1770685316.146028 mapwrite 0x020b99 thru 0x02c0d4 (0xb53c bytes) 000079 1770685316.182167 trunc from 0x035ad8 to 0x03e3da (0x8903 bytes) 000081 1770685316.201985 mapwrite 0x02086f thru 0x0240f9 (0x388b bytes) 000082 1770685316.224617 trunc from 0x02d681 to 0x03cdd1 (0xf751 bytes) 000083 1770685316.237073 mapwrite 0x012f7f thru 0x013931 (0x9b3 bytes) 000085 1770685316.252484 write 0x030a13 thru 0x032e09 (0x23f7 bytes) 000086 1770685316.271200 write 0x00dea1 thru 0x00e4df (0x63f bytes) 000087 1770685316.272155 read 0x024924 thru 0x02b902 (0x6fdf bytes) 000088 1770685316.273644 read 0x02faa1 thru 0x0391db (0x973b bytes) 000090 1770685316.282591 write 0x03831e thru 0x03ffff (0x7ce2 bytes) 000091 1770685316.284438 read 0x0398a1 thru 0x03fd0d (0x646d bytes) 000092 1770685316.286398 punch from 0x01965f to 0x020906 (0x72a8 bytes) 000094 1770685316.297197 punch from 0x01c9fb to 0x025c52 (0x9258 bytes) 000095 1770685316.303144 trunc from 0x0218b9 to 0x02fdca (0xe512 bytes) 000096 1770685316.307627 trunc from 0x02aa1d to 0x039184 (0xe768 bytes) 000097 1770685316.328748 mapwrite 0x03988b thru 0x03f5a1 (0x5d17 bytes) 000098 1770685316.359347 punch from 0x0006b9 to 0x00fae4 (0xf42c bytes) 000099 1770685316.365027 trunc from 0x001940 to 0x00a437 (0x8af8 bytes) 000100 1770685316.369002 fallocate 0x0006da thru 0x002529 (0x1e50 bytes) 000101 1770685316.373320 trunc from 0x040000 to 0x02d4dc (0x12b23 bytes) 000102 1770685316.389358 fallocate 0x01c9e9 thru 0x02568e (0x8ca6 bytes) 000103 1770685316.398562 fallocate 0x0027b0 thru 0x00908a (0x68db bytes) 000104 1770685316.404047 trunc from 0x01a938 to 0x02a041 (0xf70a bytes) 000105 1770685316.409130 mapread 0x021bf3 thru 0x022852 (0xc60 bytes) 000106 1770685316.418490 trunc from 0x015332 to 0x015882 (0x551 bytes) 000108 1770685316.424260 trunc from 0x01705e to 0x01aaff (0x3aa2 bytes) 000109 1770685316.428405 read 0x0026cf thru 0x0034d5 (0xe07 bytes) 000110 1770685316.441322 MIRROR_RESYNC 7 mirrors 000111 1770685317.733452 write 0x003eae thru 0x00cf2d (0x9080 bytes) 000112 1770685317.771878 mapread 0x01cf17 thru 0x021222 (0x430c bytes) 000114 1770685317.781372 trunc from 0x01c491 to 0x02110e (0x4c7e bytes) 000115 1770685317.788557 read 0x003411 thru 0x003d1b (0x90b bytes) 000116 1770685317.789192 write 0x015321 thru 0x022f70 (0xdc50 bytes) 000117 1770685317.790695 write 0x015538 thru 0x01da5a (0x8523 bytes) 000118 1770685317.796472 MIRROR_RESYNC 7 mirrors 000119 1770685319.242206 punch from 0x0029ae to 0x00a7f6 (0x7e49 bytes) 000120 1770685319.268298 mapwrite 0x01af64 thru 0x01e195 (0x3232 bytes) 000121 1770685319.291428 trunc from 0x02d4dd to 0x016230 (0x172ac bytes) 000123 1770685319.311216 trunc from 0x004314 to 0x0058e6 (0x15d3 bytes) 000124 1770685319.316399 read 0x00d347 thru 0x016230 (0x8eea bytes) 000125 1770685319.328669 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16231): Mirror 2: 0x93fe7868 (stale) Mirror 4: 0x93fe7868 (stale) Mirror 5: 0x93fe7868 (stale) Mirror 6: 0x93fe7868 (stale) Mirror 7: 0x93fe7868 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16231): Mirror 2: 0x93fe7868 (stale) Mirror 4: 0x93fe7868 (stale) Mirror 5: 0x93fe7868 (stale) Mirror 6: 0x93fe7868 (stale) Mirror 7: 0x93fe7868 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16231: skipped 000126 1770685319.692033 trunc from 0x016231 to 0x006406 (0xfe2a bytes) 000127 1770685319.713755 read 0x00447c thru 0x006406 (0x1f8b bytes) 000128 1770685319.718972 punch from 0x004e1d to 0x006406 (0x15ea bytes) 000129 1770685319.724290 mapread 0x00237f thru 0x006406 (0x4088 bytes) 000130 1770685319.737515 write 0x03325e thru 0x035aa2 (0x2845 bytes) 000131 1770685319.738533 trunc from 0x026c71 to 0x034b7f (0xdf0f bytes) 000132 1770685319.749649 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35aa3): Mirror 2: 0x80c9e3df (stale) Mirror 4: 0x80c9e3df (stale) Mirror 6: 0x80c9e3df (stale) Mirror 7: 0x80c9e3df (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35aa3): Mirror 2: 0x80c9e3df (stale) Mirror 4: 0x80c9e3df (stale) Mirror 6: 0x80c9e3df (stale) Mirror 7: 0x80c9e3df (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35aa3: skipped 000133 1770685320.035376 trunc from 0x035aa3 to 0x00fbff (0x25ea3 bytes) 000134 1770685320.063106 fallocate 0x038dfe thru 0x03ffff (0x7202 bytes) 000135 1770685320.069510 write 0x01541d thru 0x01cdd2 (0x79b6 bytes) 000136 1770685320.072514 fallocate 0x03c4df thru 0x03e172 (0x1c94 bytes) 000137 1770685320.077617 read 0x004e29 thru 0x005eb8 (0x1090 bytes) 000138 1770685320.087433 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e173): Mirror 2: 0xbe8cdc0 (stale) Mirror 6: 0xbe8cdc0 (stale) Mirror 7: 0xbe8cdc0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e173): Mirror 2: 0xbe8cdc0 (stale) Mirror 6: 0xbe8cdc0 (stale) Mirror 7: 0xbe8cdc0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e173: skipped 000139 1770685320.465953 trunc from 0x00609a to 0x00d480 (0x73e7 bytes) 000140 1770685320.471194 read 0x00280e thru 0x005746 (0x2f39 bytes) 000141 1770685320.477461 trunc from 0x03e173 to 0x02ac93 (0x134df bytes) 000142 1770685320.499668 mapread 0x00278e thru 0x00bd6e (0x95e1 bytes) 000143 1770685320.517085 trunc from 0x02ac94 to 0x024c85 (0x600e bytes) 000144 1770685320.533280 fallocate 0x00e27f thru 0x00f863 (0x15e5 bytes) 000145 1770685320.538631 write 0x03ee18 thru 0x03ffff (0x11e8 bytes) 000146 1770685320.540273 read 0x014a63 thru 0x02236f (0xd90d bytes) 000147 1770685320.548300 mapwrite 0x02917d thru 0x030d2c (0x7bb0 bytes) 000148 1770685320.566453 write 0x023b4d thru 0x02c0e1 (0x8595 bytes) 000149 1770685320.567874 fallocate 0x007694 thru 0x01581c (0xe189 bytes) 000150 1770685320.573407 punch from 0x00ee3b to 0x01791d (0x8ae3 bytes) 000151 1770685320.582454 punch from 0x016353 to 0x017f3f (0x1bed bytes) 000152 1770685320.587246 mapwrite 0x003c73 thru 0x011228 (0xd5b6 bytes) 000153 1770685320.625487 mapwrite 0x03665d thru 0x03ffff (0x99a3 bytes) 000155 1770685320.651444 write 0x015f1a thru 0x01b690 (0x5777 bytes) 000157 1770685320.667238 write 0x0209dd thru 0x021c70 (0x1294 bytes) 000158 1770685320.668325 fallocate 0x020fe7 thru 0x02cb70 (0xbb8a bytes) 000159 1770685320.679679 mapwrite 0x038d97 thru 0x03dea7 (0x5111 bytes) 000160 1770685320.704059 fallocate 0x0184a5 thru 0x025625 (0xd181 bytes) 000161 1770685320.711368 trunc from 0x015010 to 0x017b36 (0x2b27 bytes) 000162 1770685320.716558 fallocate 0x019102 thru 0x028ec9 (0xfdc8 bytes) 000163 1770685320.721073 read 0x02e2cc thru 0x0331bd (0x4ef2 bytes) 000164 1770685320.721851 punch from 0x01cd45 to 0x023900 (0x6bbc bytes) 000165 1770685320.726659 fallocate 0x0038bb thru 0x005770 (0x1eb6 bytes) 000166 1770685320.730984 mapwrite 0x01a926 thru 0x01bdfe (0x14d9 bytes) 000167 1770685320.748364 fallocate 0x01527e thru 0x020307 (0xb08a bytes) 000168 1770685320.756602 write 0x035b12 thru 0x038f3b (0x342a bytes) 000169 1770685320.759311 fallocate 0x0071d9 thru 0x008c23 (0x1a4b bytes) 000170 1770685320.768245 write 0x00a601 thru 0x00eff5 (0x49f5 bytes) 000171 1770685320.770231 fallocate 0x02b377 thru 0x03993d (0xe5c7 bytes) 000172 1770685320.775743 write 0x019342 thru 0x01c0fd (0x2dbc bytes) 000173 1770685320.787527 mapwrite 0x01e93b thru 0x020cb4 (0x237a bytes) 000174 1770685320.821642 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x7ca0e305 (stale) Mirror 6: 0x7ca0e305 (stale) Mirror 7: 0x7ca0e305 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2c31514a Mirror 8: 0x2c31514a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000175 1770685321.718667 trunc from 0x040000 to 0x01dde8 (0x22217 bytes) 000176 1770685321.771021 read 0x005e8d thru 0x00b155 (0x52c9 bytes) 000177 1770685321.777218 write 0x00532a thru 0x00f70d (0xa3e4 bytes) 000178 1770685321.782059 fallocate 0x00763d thru 0x00bd8d (0x4751 bytes) 000179 1770685321.786657 mapwrite 0x01d273 thru 0x02158e (0x431c bytes) 000180 1770685321.860416 punch from 0x01797c to 0x018cb7 (0x133c bytes) 000181 1770685321.872165 mapread 0x000209 thru 0x006a7a (0x6872 bytes) 000182 1770685321.888667 punch from 0x007eb1 to 0x00d45d (0x55ad bytes) 000183 1770685321.894460 trunc from 0x02158f to 0x01243e (0xf150 bytes) 000184 1770685321.915427 mapread 0x002a88 thru 0x0123cb (0xf944 bytes) 000185 1770685321.939492 MIRROR_RESYNC 5 mirrors 000186 1770685323.046220 write 0x0071b4 thru 0x00e9de (0x782b bytes) 000187 1770685323.081157 MIRROR_RESYNC 5 mirrors 000188 1770685324.093851 mapwrite 0x03a3ea thru 0x03ffff (0x5c16 bytes) 000189 1770685324.205359 read 0x03e50e thru 0x03ffff (0x1af2 bytes) 000190 1770685324.205950 read 0x023ac7 thru 0x027a23 (0x3f5d bytes) 000191 1770685324.220783 mapread 0x0377ee thru 0x03ffff (0x8812 bytes) 000192 1770685324.222632 trunc from 0x02cbe0 to 0x037b27 (0xaf48 bytes) 000193 1770685324.244967 mapread 0x01d2d6 thru 0x02c787 (0xf4b2 bytes) 000194 1770685324.250791 write 0x00c31a thru 0x00d3cc (0x10b3 bytes) 000195 1770685324.252216 read 0x0044c6 thru 0x005e98 (0x19d3 bytes) 000196 1770685324.253192 fallocate 0x03bbbe thru 0x03ffff (0x4442 bytes) 000197 1770685324.258519 mapread 0x024a4b thru 0x02f8a4 (0xae5a bytes) 000198 1770685324.266491 trunc from 0x00d1e0 to 0x015b90 (0x89b1 bytes) 000199 1770685324.275407 trunc from 0x040000 to 0x023f26 (0x1c0d9 bytes) 000200 1770685324.291145 mapread 0x01832f thru 0x01d2c9 (0x4f9b bytes) 000202 1770685324.292471 read 0x0172d9 thru 0x01c7d9 (0x5501 bytes) 000203 1770685324.293042 punch from 0x012217 to 0x01dfa3 (0xbd8d bytes) 000204 1770685324.298584 trunc from 0x018c7d to 0x01af6b (0x22ef bytes) 000205 1770685324.303478 trunc from 0x023f27 to 0x002825 (0x21701 bytes) 000206 1770685324.320696 trunc from 0x002826 to 0x00cb2c (0xa307 bytes) 000207 1770685324.334692 mapwrite 0x0259ae thru 0x032efc (0xd54f bytes) 000208 1770685324.387110 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x32efd): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32efd): Mirror 2: 0x5ffccfed (stale) Mirror 6: 0x5ffccfed (stale) Mirror 7: 0x5ffccfed (stale) Mirror 8: 0x5ffccfed (stale) CRC-32 checksum value for chunk [0, 0x32efd): Mirror 1: 0x3ef17810 Mirror 9: 0x3ef17810 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32efd: skipped 000209 1770685325.118077 write 0x0240ab thru 0x02e12a (0xa080 bytes) 000210 1770685325.161684 fallocate 0x007b8a thru 0x00c085 (0x44fc bytes) 000211 1770685325.167312 trunc from 0x016baf to 0x0178ca (0xd1c bytes) 000212 1770685325.171534 mapread 0x0274d8 thru 0x032efc (0xba25 bytes) 000213 1770685325.177377 mapread 0x00f4a6 thru 0x018706 (0x9261 bytes) 000214 1770685325.195167 trunc from 0x019c3f to 0x021ab9 (0x7e7b bytes) 000215 1770685325.200391 mapread 0x016977 thru 0x023b98 (0xd222 bytes) 000216 1770685325.213648 mapwrite 0x006139 thru 0x01208e (0xbf56 bytes) 000218 1770685325.245223 trunc from 0x032efd to 0x00b499 (0x27a63 bytes) 000219 1770685325.279346 trunc from 0x00b49a to 0x00eec9 (0x3a30 bytes) 000222 1770685325.291608 read 0x0048db thru 0x00594d (0x1073 bytes) 000223 1770685325.292335 trunc from 0x00eeca to 0x0028de (0xc5eb bytes) 000224 1770685325.311961 mapwrite 0x03f1a1 thru 0x03ffff (0xe5f bytes) 000225 1770685325.339079 write 0x01641c thru 0x020851 (0xa436 bytes) 000226 1770685325.349121 trunc from 0x040000 to 0x002bca (0x3d435 bytes) 000227 1770685325.361587 mapwrite 0x034409 thru 0x037d29 (0x3921 bytes) 000228 1770685325.384202 write 0x03994c thru 0x03ffff (0x66b4 bytes) 000229 1770685325.385362 punch from 0x02f527 to 0x032fed (0x3ac7 bytes) 000230 1770685325.402518 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xa52b968b (stale) Mirror 7: 0xa52b968b (stale) Mirror 8: 0xa52b968b (stale) Mirror 9: 0x6f0ddf40 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xa52b968b (stale) Mirror 7: 0xa52b968b (stale) Mirror 8: 0xa52b968b (stale) Mirror 9: 0x6f0ddf40 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000231 1770685325.715469 trunc from 0x040000 to 0x03938f (0x6c70 bytes) 000233 1770685325.736047 mapwrite 0x00a121 thru 0x013458 (0x9338 bytes) 000234 1770685325.789627 punch from 0x00124d to 0x00df57 (0xcd0b bytes) 000235 1770685325.796356 trunc from 0x039390 to 0x03326d (0x6122 bytes) 000236 1770685325.817356 fallocate 0x01ce1b thru 0x02213d (0x5323 bytes) 000237 1770685325.822494 read 0x017a28 thru 0x022bc5 (0xb19e bytes) 000238 1770685325.852971 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3326e): Mirror 7: 0xdcd9a2be (stale) Mirror 8: 0xdcd9a2be (stale) Mirror 9: 0x300afd69 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3326e): Mirror 7: 0xdcd9a2be (stale) Mirror 8: 0xdcd9a2be (stale) Mirror 9: 0x300afd69 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3326e: skipped 000239 1770685326.220428 trunc from 0x02d1df to 0x0326f4 (0x5516 bytes) 000240 1770685326.225580 mapread 0x021395 thru 0x0266f2 (0x535e bytes) 000241 1770685326.253326 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3326e): Mirror 7: 0xdcd9a2be (stale) Mirror 8: 0xdcd9a2be (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3326e): Mirror 7: 0xdcd9a2be (stale) Mirror 8: 0xdcd9a2be (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3326e: skipped 000242 1770685326.626311 trunc from 0x00d4be to 0x01335c (0x5e9f bytes) 000243 1770685326.631610 trunc from 0x03326e to 0x03c5f4 (0x9387 bytes) 000244 1770685326.667639 punch from 0x002618 to 0x003ff8 (0x19e1 bytes) 000245 1770685326.677912 trunc from 0x03c5f5 to 0x019e7b (0x22779 bytes) 000246 1770685326.696598 mapwrite 0x00e46a thru 0x010cb5 (0x284c bytes) 000248 1770685326.743452 write 0x01653f thru 0x01ead2 (0x8594 bytes) 000249 1770685326.747852 trunc from 0x01ead3 to 0x03134e (0x1287c bytes) 000250 1770685326.762495 trunc from 0x02eeb1 to 0x03134e (0x249e bytes) 000251 1770685326.768324 punch from 0x00bb2f to 0x019157 (0xd629 bytes) 000252 1770685326.779611 trunc from 0x03134f to 0x000728 (0x30c26 bytes) 000253 1770685326.801189 fallocate 0x01ee66 thru 0x022ff5 (0x4190 bytes) 000254 1770685326.805844 trunc from 0x000674 to 0x000728 (0xb5 bytes) 000255 1770685326.810074 read 0x000647 thru 0x000728 (0xe2 bytes) 000256 1770685326.817436 mapread 0x0000d5 thru 0x000728 (0x654 bytes) 000257 1770685326.823154 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x729): Mirror 8: 0xb7a418b5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x729): Mirror 8: 0xb7a418b5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x729: skipped 000258 1770685327.116398 mapwrite 0x007b12 thru 0x017357 (0xf846 bytes) 000259 1770685327.177754 read 0x00b21f thru 0x017357 (0xc139 bytes) 000260 1770685327.179620 mapwrite 0x02ee16 thru 0x0327ac (0x3997 bytes) 000261 1770685327.252311 trunc from 0x005a41 to 0x007da9 (0x2369 bytes) 000262 1770685327.257101 read 0x00b134 thru 0x00ba4a (0x917 bytes) 000263 1770685327.260945 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) 000265 1770685327.384009 trunc from 0x0327ad to 0x005bb5 (0x2cbf7 bytes) 000266 1770685327.404175 trunc from 0x005bb6 to 0x03e872 (0x38cbd bytes) 000267 1770685327.422166 read 0x038c52 thru 0x03e872 (0x5c21 bytes) 000268 1770685327.432012 read 0x02cd79 thru 0x035573 (0x87fb bytes) 000269 1770685327.442003 read 0x03b3b8 thru 0x03e872 (0x34bb bytes) 000270 1770685327.442633 trunc from 0x03e873 to 0x015dc6 (0x28aac bytes) 000272 1770685327.459694 trunc from 0x001732 to 0x007adc (0x63ab bytes) 000273 1770685327.466049 trunc from 0x006550 to 0x0075b2 (0x1063 bytes) 000275 1770685327.470571 trunc from 0x00194a to 0x010d2e (0xf3e5 bytes) 000276 1770685327.475146 mapread 0x0033f8 thru 0x00541c (0x2025 bytes) 000277 1770685327.485152 mapwrite 0x01df3d thru 0x01e718 (0x7dc bytes) 000278 1770685327.531471 punch from 0x0124d0 to 0x014e5f (0x2990 bytes) 000279 1770685327.540124 read 0x00966c thru 0x00987e (0x213 bytes) 000281 1770685327.544744 write 0x033861 thru 0x03d1c8 (0x9968 bytes) 000282 1770685327.547205 fallocate 0x00a3f6 thru 0x00b114 (0xd1f bytes) 000284 1770685327.557749 punch from 0x0232f4 to 0x03094b (0xd658 bytes) 000286 1770685327.565128 write 0x02e58a thru 0x03d769 (0xf1e0 bytes) 000288 1770685327.573321 mapwrite 0x02d663 thru 0x03b4e9 (0xde87 bytes) 000290 1770685327.591451 read 0x035a7f thru 0x039c4d (0x41cf bytes) 000291 1770685327.592130 trunc from 0x0076b1 to 0x013d51 (0xc6a1 bytes) 000292 1770685327.596424 trunc from 0x03d76a to 0x001f34 (0x3b835 bytes) 000293 1770685327.618004 fallocate 0x02915d thru 0x03690b (0xd7af bytes) 000296 1770685327.624322 mapwrite 0x02b8f9 thru 0x037be7 (0xc2ef bytes) 000298 1770685327.685436 trunc from 0x011002 to 0x01129d (0x29c bytes) 000299 1770685327.692425 trunc from 0x01407a to 0x01ecb8 (0xac3f bytes) 000300 1770685327.703895 read 0x008667 thru 0x012f38 (0xa8d2 bytes) 000301 1770685327.714055 mapread 0x013d24 thru 0x0238b9 (0xfb96 bytes) 000302 1770685327.716373 mapread 0x00fd7e thru 0x015241 (0x54c4 bytes) 000303 1770685327.717517 punch from 0x032e56 to 0x037be7 (0x4d92 bytes) 000304 1770685327.723345 mapwrite 0x039809 thru 0x03ffff (0x67f7 bytes) 000305 1770685327.760671 read 0x039ed7 thru 0x03f581 (0x56ab bytes) 000306 1770685327.761952 punch from 0x03cc53 to 0x03faea (0x2e98 bytes) 000307 1770685327.771201 mapwrite 0x01ed38 thru 0x02dcbc (0xef85 bytes) 000308 1770685327.788868 write 0x03a8e0 thru 0x03ffff (0x5720 bytes) 000309 1770685327.790003 trunc from 0x040000 to 0x030c1c (0xf3e3 bytes) 000310 1770685327.803986 read 0x00c884 thru 0x01beb7 (0xf634 bytes) 000312 1770685327.805016 write 0x02d414 thru 0x03b942 (0xe52f bytes) 000313 1770685327.806506 write 0x027ecd thru 0x03382b (0xb95f bytes) 000314 1770685327.809448 punch from 0x015c5e to 0x01b950 (0x5cf3 bytes) 000315 1770685327.814433 write 0x023322 thru 0x0302d2 (0xcfb1 bytes) 000316 1770685327.821363 read 0x031641 thru 0x036f4c (0x590c bytes) 000317 1770685327.823103 mapread 0x031449 thru 0x03b942 (0xa4fa bytes) 000318 1770685327.824504 read 0x012676 thru 0x01e189 (0xbb14 bytes) 000319 1770685327.834024 trunc from 0x01db7e to 0x02d84b (0xfcce bytes) 000320 1770685327.846571 fallocate 0x02b704 thru 0x02ba42 (0x33f bytes) 000321 1770685327.850427 write 0x00f179 thru 0x01afe2 (0xbe6a bytes) 000322 1770685327.852032 mapwrite 0x00bc37 thru 0x01b196 (0xf560 bytes) 000323 1770685327.871741 trunc from 0x014cdb to 0x018559 (0x387f bytes) 000324 1770685327.878152 write 0x0106fb thru 0x01aa10 (0xa316 bytes) 000327 1770685327.880362 fallocate 0x014c7c thru 0x01d713 (0x8a98 bytes) 000328 1770685327.887312 read 0x02802e thru 0x02f31c (0x72ef bytes) 000329 1770685327.900019 trunc from 0x03b943 to 0x00e097 (0x2d8ab bytes) 000330 1770685327.916194 read 0x00485b thru 0x005358 (0xafe bytes) 000331 1770685327.916791 trunc from 0x00e098 to 0x03c0ed (0x2e056 bytes) 000332 1770685327.932389 mapread 0x00cd3e thru 0x014047 (0x730a bytes) 000334 1770685327.945781 read 0x026af2 thru 0x028df9 (0x2308 bytes) 000335 1770685327.946193 mapwrite 0x00dc8a thru 0x014954 (0x6ccb bytes) 000337 1770685327.961159 fallocate 0x03bdf9 thru 0x03ffff (0x4207 bytes) 000338 1770685327.965686 read 0x02098a thru 0x023464 (0x2adb bytes) 000339 1770685327.966278 fallocate 0x013198 thru 0x01b95f (0x87c8 bytes) 000341 1770685327.971827 trunc from 0x040000 to 0x01328b (0x2cd74 bytes) 000342 1770685327.994560 fallocate 0x009e91 thru 0x00c816 (0x2986 bytes) 000343 1770685327.998318 write 0x017294 thru 0x019fe6 (0x2d53 bytes) 000344 1770685327.999480 mapread 0x012cd4 thru 0x0168a3 (0x3bd0 bytes) 000345 1770685328.003601 trunc from 0x019fe7 to 0x03db3b (0x23b55 bytes) 000346 1770685328.017516 trunc from 0x03db3c to 0x014b0a (0x29031 bytes) 000347 1770685328.026396 mapwrite 0x036e41 thru 0x03ffff (0x91bf bytes) 000348 1770685328.059114 mapread 0x02e6aa thru 0x0333df (0x4d36 bytes) 000349 1770685328.060114 mapwrite 0x01705c thru 0x01def9 (0x6e9e bytes) 000350 1770685328.084988 trunc from 0x040000 to 0x01cb14 (0x234eb bytes) 000351 1770685328.101431 read 0x013219 thru 0x01cb14 (0x98fc bytes) 000352 1770685328.105086 trunc from 0x01cb15 to 0x0233ed (0x68d9 bytes) 000353 1770685328.116115 trunc from 0x009af6 to 0x009f98 (0x4a3 bytes) 000354 1770685328.120318 trunc from 0x01a49b to 0x0233ed (0x8f53 bytes) 000355 1770685328.124202 punch from 0x001dec to 0x00cdde (0xaff3 bytes) 000357 1770685328.128264 fallocate 0x01687f thru 0x01c928 (0x60aa bytes) 000359 1770685328.132150 punch from 0x000dd0 to 0x0044a4 (0x36d5 bytes) 000360 1770685328.136328 trunc from 0x01ea5d to 0x0233ed (0x4991 bytes) 000361 1770685328.147116 trunc from 0x017673 to 0x01ba41 (0x43cf bytes) 000362 1770685328.157296 mapread 0x008aca thru 0x00d99d (0x4ed4 bytes) 000363 1770685328.179120 trunc from 0x0233ee to 0x03127b (0xde8e bytes) 000364 1770685328.195315 write 0x0024d5 thru 0x006207 (0x3d33 bytes) 000365 1770685328.207144 mapread 0x01717d thru 0x02162a (0xa4ae bytes) 000366 1770685328.235101 trunc from 0x0076e9 to 0x00d1c3 (0x5adb bytes) 000368 1770685328.239575 read 0x007b11 thru 0x017804 (0xfcf4 bytes) 000369 1770685328.248152 mapwrite 0x003ed4 thru 0x00d483 (0x95b0 bytes) 000370 1770685328.262682 write 0x037591 thru 0x03b7d9 (0x4249 bytes) 000372 1770685328.269444 trunc from 0x03b7da to 0x01aa88 (0x20d51 bytes) 000375 1770685328.284053 trunc from 0x011904 to 0x01aa88 (0x9185 bytes) 000376 1770685328.288423 read 0x00676c thru 0x012a12 (0xc2a7 bytes) 000377 1770685328.297453 fallocate 0x00d757 thru 0x011f54 (0x47fe bytes) 000379 1770685328.302274 fallocate 0x02f747 thru 0x03f545 (0xfdff bytes) 000381 1770685328.309976 trunc from 0x03f546 to 0x014c2e (0x2a917 bytes) 000382 1770685328.324941 trunc from 0x0074f6 to 0x009f1d (0x2a28 bytes) 000384 1770685328.329531 write 0x004310 thru 0x00989e (0x558f bytes) 000385 1770685328.335344 trunc from 0x014c2f to 0x01f60d (0xa9df bytes) 000386 1770685328.348291 mapread 0x007f2b thru 0x013069 (0xb13f bytes) 000387 1770685328.349150 trunc from 0x0115db to 0x01317e (0x1ba4 bytes) 000388 1770685328.353133 mapread 0x01d035 thru 0x01f60d (0x25d9 bytes) 000389 1770685328.358325 fallocate 0x01424c thru 0x01a9e1 (0x6796 bytes) 000390 1770685328.361546 mapread 0x01c41b thru 0x01e004 (0x1bea bytes) 000391 1770685328.362969 read 0x00b9f8 thru 0x01340d (0x7a16 bytes) 000392 1770685328.372188 punch from 0x00c9d4 to 0x014eee (0x851b bytes) 000393 1770685328.377403 mapwrite 0x03073c thru 0x030cb7 (0x57c bytes) 000394 1770685328.419654 trunc from 0x0174f5 to 0x019338 (0x1e44 bytes) 000395 1770685328.425810 trunc from 0x002673 to 0x003817 (0x11a5 bytes) 000396 1770685328.431838 write 0x000999 thru 0x007d1c (0x7384 bytes) 000397 1770685328.435634 trunc from 0x019ae0 to 0x01f820 (0x5d41 bytes) 000398 1770685328.442124 read 0x019531 thru 0x02054e (0x701e bytes) 000399 1770685328.461583 read 0x015ef9 thru 0x0255b5 (0xf6bd bytes) 000400 1770685328.462377 mapwrite 0x0066d6 thru 0x00dea6 (0x77d1 bytes) 000401 1770685328.480840 read 0x0022ac thru 0x00fc39 (0xd98e bytes) 000402 1770685328.481511 write 0x02d9df thru 0x032bc4 (0x51e6 bytes) 000403 1770685328.483267 fallocate 0x00331e thru 0x00c256 (0x8f39 bytes) 000405 1770685328.488543 fallocate 0x02a88b thru 0x033a25 (0x919b bytes) 000406 1770685328.493671 read 0x00d100 thru 0x010ea8 (0x3da9 bytes) 000408 1770685328.495494 trunc from 0x0183dd to 0x01aa36 (0x265a bytes) 000409 1770685328.501339 write 0x0011f7 thru 0x00a06b (0x8e75 bytes) 000410 1770685328.503345 trunc from 0x028272 to 0x032bc4 (0xa953 bytes) 000411 1770685328.520274 write 0x018c98 thru 0x020d9f (0x8108 bytes) 000412 1770685328.530103 trunc from 0x032bc5 to 0x039767 (0x6ba3 bytes) 000413 1770685328.544679 trunc from 0x0174c8 to 0x0221ae (0xace7 bytes) 000414 1770685328.556359 punch from 0x015317 to 0x018b31 (0x381b bytes) 000416 1770685328.560494 trunc from 0x039768 to 0x02e172 (0xb5f5 bytes) 000418 1770685328.572572 fallocate 0x00bccc thru 0x01b779 (0xfaae bytes) 000419 1770685328.578358 trunc from 0x02e173 to 0x0051bc (0x28fb6 bytes) 000423 1770685328.595480 trunc from 0x0051bd to 0x021d4b (0x1cb8f bytes) 000424 1770685328.616862 read 0x00a26b thru 0x01048b (0x6221 bytes) 000425 1770685328.632980 write 0x00e5d3 thru 0x013264 (0x4c92 bytes) 000426 1770685328.634104 read 0x0210c5 thru 0x021d4b (0xc87 bytes) 000427 1770685328.634615 write 0x02da6d thru 0x037e84 (0xa418 bytes) 000428 1770685328.645869 MIRROR_EXTEND to 2 mirrors 000429 1770685329.252134 fallocate 0x01f382 thru 0x02e9cd (0xf64c bytes) 000431 1770685329.281113 write 0x01eeed thru 0x02b0f7 (0xc20b bytes) 000432 1770685329.295448 trunc from 0x02cb15 to 0x02dbd0 (0x10bc bytes) 000433 1770685329.300160 read 0x033c67 thru 0x0374e6 (0x3880 bytes) 000434 1770685329.308203 fallocate 0x00d426 thru 0x012638 (0x5213 bytes) 000435 1770685329.312498 trunc from 0x0102fb to 0x01a16c (0x9e72 bytes) 000436 1770685329.317282 fallocate 0x01489c thru 0x01e117 (0x987c bytes) 000437 1770685329.324248 MIRROR_RESYNC 2 mirrors 000438 1770685329.728236 trunc from 0x0050ed to 0x00a75b (0x566f bytes) 000439 1770685329.761688 read 0x01a93b thru 0x02240a (0x7ad0 bytes) 000440 1770685329.766593 read 0x01a3cd thru 0x026c4e (0xc882 bytes) 000441 1770685329.778230 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) 000442 1770685329.864306 read 0x028bab thru 0x037e7e (0xf2d4 bytes) 000443 1770685329.872459 mapread 0x013543 thru 0x016825 (0x32e3 bytes) 000444 1770685329.885677 trunc from 0x012372 to 0x01fc29 (0xd8b8 bytes) 000445 1770685329.890159 punch from 0x014928 to 0x01d50d (0x8be6 bytes) 000446 1770685329.895780 punch from 0x006a33 to 0x014196 (0xd764 bytes) 000448 1770685329.901434 trunc from 0x037e85 to 0x019cb7 (0x1e1cd bytes) 000449 1770685329.968775 mapwrite 0x02949e thru 0x02f665 (0x61c8 bytes) 000450 1770685330.035861 write 0x01b4d6 thru 0x0233d8 (0x7f03 bytes) 000451 1770685330.052776 mapwrite 0x0281f7 thru 0x035375 (0xd17f bytes) 000452 1770685330.105236 mapread 0x005519 thru 0x010e8b (0xb973 bytes) 000453 1770685330.111258 mapwrite 0x03ddf2 thru 0x03ffff (0x220e bytes) 000454 1770685330.167210 fallocate 0x0188b4 thru 0x0256bd (0xce0a bytes) 000455 1770685330.173342 write 0x0111f4 thru 0x01d177 (0xbf84 bytes) 000457 1770685330.206295 read 0x034d3d thru 0x03e579 (0x983d bytes) 000458 1770685330.206785 punch from 0x011a07 to 0x011a4b (0x45 bytes) 000459 1770685330.231484 trunc from 0x01e562 to 0x026b3a (0x85d9 bytes) 000460 1770685330.244591 write 0x01d683 thru 0x022ffc (0x597a bytes) 000461 1770685330.263870 fallocate 0x00ab0f thru 0x015ff4 (0xb4e6 bytes) 000462 1770685330.275685 mapread 0x00726e thru 0x013865 (0xc5f8 bytes) 000463 1770685330.276529 trunc from 0x0219a4 to 0x029eff (0x855c bytes) 000464 1770685330.306928 MIRROR_EXTEND to 2 mirrors 000465 1770685330.843176 mapwrite 0x001c7c thru 0x00d742 (0xbac7 bytes) 000466 1770685330.952567 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1b330a5e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xfa6eb10c Mirror 3: 0xfa6eb10c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000467 1770685331.649536 read 0x03ad28 thru 0x03ffff (0x52d8 bytes) 000468 1770685331.665044 fallocate 0x006346 thru 0x00a4db (0x4196 bytes) 000469 1770685331.696942 write 0x01fe17 thru 0x023934 (0x3b1e bytes) 000470 1770685331.710864 mapread 0x016f40 thru 0x01f2d5 (0x8396 bytes) 000471 1770685331.719873 write 0x035533 thru 0x0370c0 (0x1b8e bytes) 000472 1770685331.730939 fallocate 0x00e2f2 thru 0x00f32d (0x103c bytes) 000474 1770685331.735997 fallocate 0x01447d thru 0x018ddb (0x495f bytes) 000475 1770685331.740690 read 0x01f08c thru 0x02dab5 (0xea2a bytes) 000476 1770685331.749641 fallocate 0x00e0a8 thru 0x01c9a1 (0xe8fa bytes) 000477 1770685331.754315 mapread 0x0391d2 thru 0x03eb88 (0x59b7 bytes) 000478 1770685331.757297 fallocate 0x0232e6 thru 0x02f9ff (0xc71a bytes) 000479 1770685331.764386 trunc from 0x040000 to 0x01c32e (0x23cd1 bytes) 000480 1770685331.794521 mapread 0x009444 thru 0x018321 (0xeede bytes) 000481 1770685331.795530 mapread 0x00d2fb thru 0x0138a7 (0x65ad bytes) 000482 1770685331.796263 mapread 0x003a2b thru 0x00cab1 (0x9087 bytes) 000483 1770685331.798084 fallocate 0x02bc61 thru 0x036f7c (0xb31c bytes) 000484 1770685331.803088 punch from 0x01fbb2 to 0x02e5a7 (0xe9f6 bytes) 000485 1770685331.807415 write 0x00a00e thru 0x00f33d (0x5330 bytes) 000486 1770685331.808468 write 0x039a4a thru 0x03abda (0x1191 bytes) 000488 1770685331.814064 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3abdb): Mirror 3: 0xf5ad1197 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3abdb): Mirror 3: 0xf5ad1197 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3abdb: skipped 000489 1770685332.112312 mapread 0x02fbc6 thru 0x03ab06 (0xaf41 bytes) 000491 1770685332.134240 trunc from 0x0039f2 to 0x00932a (0x5939 bytes) 000492 1770685332.142301 mapread 0x016a6c thru 0x0266ef (0xfc84 bytes) 000493 1770685332.160330 fallocate 0x03ee81 thru 0x03ffff (0x117f bytes) 000494 1770685332.166080 trunc from 0x040000 to 0x00e7d5 (0x3182a bytes) 000495 1770685332.189145 write 0x02a035 thru 0x036a02 (0xc9ce bytes) 000496 1770685332.192435 read 0x0006cb thru 0x0106ad (0xffe3 bytes) 000497 1770685332.200189 write 0x018dd0 thru 0x01b2a8 (0x24d9 bytes) 000498 1770685332.207891 mapwrite 0x03a1cf thru 0x03ff04 (0x5d36 bytes) 000499 1770685332.240969 fallocate 0x01c7f1 thru 0x027a49 (0xb259 bytes) 000501 1770685332.246465 write 0x0118fc thru 0x01acbf (0x93c4 bytes) 000502 1770685332.247638 mapread 0x0058b6 thru 0x0086f9 (0x2e44 bytes) 000503 1770685332.248416 mapread 0x021447 thru 0x02980b (0x83c5 bytes) 000504 1770685332.260076 MIRROR_RESYNC 2 mirrors 000505 1770685332.993602 punch from 0x0283a6 to 0x02de25 (0x5a80 bytes) 000506 1770685333.038273 fallocate 0x0061dd thru 0x00e57b (0x839f bytes) 000507 1770685333.044902 write 0x013768 thru 0x01e302 (0xab9b bytes) 000508 1770685333.059546 mapwrite 0x007a47 thru 0x00c611 (0x4bcb bytes) 000509 1770685333.086446 mapwrite 0x00e3d2 thru 0x01a871 (0xc4a0 bytes) 000510 1770685333.106341 fallocate 0x033f05 thru 0x03ffff (0xc0fb bytes) 000511 1770685333.110472 fallocate 0x033c25 thru 0x03e105 (0xa4e1 bytes) 000512 1770685333.115373 punch from 0x026086 to 0x0316a9 (0xb624 bytes) 000513 1770685333.122405 mapread 0x02ad8b thru 0x02ecf4 (0x3f6a bytes) 000514 1770685333.134351 fallocate 0x03764e thru 0x03ffff (0x89b2 bytes) 000515 1770685333.141369 fallocate 0x01d71a thru 0x027b24 (0xa40b bytes) 000516 1770685333.149341 trunc from 0x040000 to 0x02e099 (0x11f66 bytes) 000517 1770685333.206660 fallocate 0x03a2da thru 0x03d23b (0x2f62 bytes) 000518 1770685333.221011 fallocate 0x011e07 thru 0x01aeca (0x90c4 bytes) 000519 1770685333.229080 read 0x004670 thru 0x011864 (0xd1f5 bytes) 000520 1770685333.229660 fallocate 0x00ae4f thru 0x016b25 (0xbcd7 bytes) 000521 1770685333.233953 punch from 0x011f0a to 0x01fb17 (0xdc0e bytes) 000522 1770685333.244457 mapread 0x004ee8 thru 0x0096ac (0x47c5 bytes) 000523 1770685333.246648 punch from 0x00f7de to 0x00fc4b (0x46e bytes) 000524 1770685333.255628 write 0x02a3fc thru 0x02b37f (0xf84 bytes) 000525 1770685333.257119 mapwrite 0x023847 thru 0x032e27 (0xf5e1 bytes) 000526 1770685333.300028 read 0x008c9f thru 0x00d032 (0x4394 bytes) 000527 1770685333.307258 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x32e28): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32e28): Mirror 3: 0x22b1320f (stale) CRC-32 checksum value for chunk [0, 0x32e28): Mirror 1: 0x650d219b Mirror 4: 0x650d219b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32e28: skipped 000528 1770685333.957544 trunc from 0x032e28 to 0x019307 (0x19b20 bytes) 000529 1770685334.030086 write 0x00d65c thru 0x00f503 (0x1ea8 bytes) 000530 1770685334.039261 trunc from 0x0088ac to 0x00eb17 (0x626c bytes) 000531 1770685334.048961 punch from 0x00fdf5 to 0x0150cc (0x52d8 bytes) 000532 1770685334.053142 trunc from 0x019308 to 0x00c076 (0xd291 bytes) 000533 1770685334.065777 read 0x008904 thru 0x00c076 (0x3773 bytes) 000534 1770685334.071053 fallocate 0x01d5dd thru 0x024652 (0x7076 bytes) 000535 1770685334.073775 trunc from 0x00b5b7 to 0x00c076 (0xac0 bytes) 000536 1770685334.077618 read 0x007715 thru 0x00c076 (0x4962 bytes) 000537 1770685334.085641 mapwrite 0x031458 thru 0x03848a (0x7033 bytes) 000538 1770685334.122023 punch from 0x02e29e to 0x0339aa (0x570d bytes) 000539 1770685334.127944 write 0x031d84 thru 0x035c3f (0x3ebc bytes) 000542 1770685334.138626 trunc from 0x02a9c0 to 0x0364b6 (0xbaf7 bytes) 000543 1770685334.157232 punch from 0x01f3e2 to 0x024e20 (0x5a3f bytes) 000544 1770685334.164769 write 0x0171a4 thru 0x0203e0 (0x923d bytes) 000545 1770685334.173652 trunc from 0x008198 to 0x008dcd (0xc36 bytes) 000546 1770685334.181492 write 0x01a008 thru 0x022437 (0x8430 bytes) 000547 1770685334.190194 write 0x020510 thru 0x02940c (0x8efd bytes) 000548 1770685334.193553 mapwrite 0x0208ab thru 0x02817f (0x78d5 bytes) 000549 1770685334.221211 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3848b): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3848b): Mirror 3: 0xcfb4fb83 (stale) Mirror 4: 0x94cd7148 (stale) CRC-32 checksum value for chunk [0, 0x3848b): Mirror 1: 0x9a417aeb Mirror 5: 0x9a417aeb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3848b: skipped 000550 1770685334.868072 mapwrite 0x02497a thru 0x029b42 (0x51c9 bytes) 000551 1770685334.952195 trunc from 0x027e8b to 0x029c6b (0x1de1 bytes) 000552 1770685334.956257 punch from 0x0020d0 to 0x00c747 (0xa678 bytes) 000553 1770685334.961630 write 0x014ab6 thru 0x02011c (0xb667 bytes) 000554 1770685334.975430 write 0x03370a thru 0x034b41 (0x1438 bytes) 000555 1770685334.985029 write 0x03a4a7 thru 0x03b19b (0xcf5 bytes) 000556 1770685334.986109 mapwrite 0x0002c5 thru 0x00f45b (0xf197 bytes) 000557 1770685335.010154 mapwrite 0x03be16 thru 0x03ffff (0x41ea bytes) 000558 1770685335.069965 trunc from 0x040000 to 0x036555 (0x9aaa bytes) 000559 1770685335.089594 mapread 0x02ed76 thru 0x036555 (0x77e0 bytes) 000560 1770685335.090547 mapwrite 0x02cce1 thru 0x038ebf (0xc1df bytes) 000561 1770685335.130268 fallocate 0x0157a6 thru 0x02392f (0xe18a bytes) 000562 1770685335.136810 trunc from 0x038ec0 to 0x0309da (0x84e5 bytes) 000563 1770685335.157321 punch from 0x01b7f9 to 0x020836 (0x503e bytes) 000564 1770685335.166448 write 0x027950 thru 0x030bdf (0x9290 bytes) 000565 1770685335.188774 mapread 0x0014ce thru 0x00d080 (0xbbb3 bytes) 000566 1770685335.189679 trunc from 0x016532 to 0x01cfb3 (0x6a82 bytes) 000567 1770685335.197262 mapwrite 0x004b76 thru 0x00f85d (0xace8 bytes) 000568 1770685335.223615 MIRROR_RESYNC 4 mirrors 000569 1770685336.217417 write 0x021ce7 thru 0x02bef8 (0xa212 bytes) 000570 1770685336.267436 mapwrite 0x026aa5 thru 0x03097c (0x9ed8 bytes) 000571 1770685336.291989 mapwrite 0x0215e1 thru 0x0253da (0x3dfa bytes) 000572 1770685336.307289 punch from 0x019085 to 0x0207d0 (0x774c bytes) 000573 1770685336.317924 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x30be0): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30be0): Mirror 3: 0x2a76cade (stale) Mirror 4: 0x2a76cade (stale) Mirror 5: 0x2a76cade (stale) CRC-32 checksum value for chunk [0, 0x30be0): Mirror 1: 0xf09ab45c Mirror 6: 0xf09ab45c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30be0: skipped 000574 1770685337.024768 MIRROR_RESYNC 5 mirrors 000576 1770685337.898817 write 0x02091d thru 0x02a181 (0x9865 bytes) 000577 1770685337.934280 trunc from 0x030be0 to 0x01a14b (0x16a94 bytes) 000578 1770685337.970164 read 0x009245 thru 0x010ba0 (0x795c bytes) 000579 1770685337.977027 fallocate 0x018216 thru 0x0208d1 (0x86bc bytes) 000580 1770685337.982626 fallocate 0x028c3c thru 0x02949a (0x85f bytes) 000581 1770685337.987749 mapread 0x005a1b thru 0x009acc (0x40b2 bytes) 000582 1770685337.995513 mapwrite 0x00609d thru 0x01390f (0xd873 bytes) 000583 1770685338.018636 punch from 0x0156c6 to 0x018cde (0x3619 bytes) 000584 1770685338.026277 write 0x014e7f thru 0x023bbf (0xed41 bytes) 000585 1770685338.027815 write 0x004120 thru 0x0069b6 (0x2897 bytes) 000586 1770685338.028349 mapwrite 0x03dfdd thru 0x03ffff (0x2023 bytes) 000588 1770685338.069865 fallocate 0x00ea12 thru 0x019e29 (0xb418 bytes) 000589 1770685338.075771 mapread 0x00aca9 thru 0x00bb1c (0xe74 bytes) 000590 1770685338.078903 read 0x01bbb8 thru 0x01da5b (0x1ea4 bytes) 000591 1770685338.080411 write 0x036e9a thru 0x03ffff (0x9166 bytes) 000592 1770685338.083647 mapread 0x023198 thru 0x032e1b (0xfc84 bytes) 000593 1770685338.100967 fallocate 0x017dcd thru 0x02315b (0xb38f bytes) 000594 1770685338.105150 punch from 0x02f0a9 to 0x033252 (0x41aa bytes) 000595 1770685338.109215 write 0x0336ea thru 0x03ffff (0xc916 bytes) 000596 1770685338.115033 trunc from 0x02ea19 to 0x03e840 (0xfe28 bytes) 000597 1770685338.125019 trunc from 0x040000 to 0x005df9 (0x3a206 bytes) 000598 1770685338.142947 write 0x039723 thru 0x03b1da (0x1ab8 bytes) 000599 1770685338.144490 trunc from 0x030d9c to 0x039d1c (0x8f81 bytes) 000600 1770685338.156631 trunc from 0x03b1db to 0x00da93 (0x2d747 bytes) 000601 1770685338.172139 trunc from 0x006b88 to 0x00da93 (0x6f0c bytes) 000602 1770685338.177158 write 0x034570 thru 0x037984 (0x3415 bytes) 000603 1770685338.184620 MIRROR_RESYNC 5 mirrors 000604 1770685339.108014 read 0x01a205 thru 0x024606 (0xa402 bytes) 000605 1770685339.122191 mapread 0x0099e5 thru 0x0168ce (0xceea bytes) 000606 1770685339.163006 trunc from 0x037985 to 0x03d1fd (0x5879 bytes) 000607 1770685339.252601 trunc from 0x025e8d to 0x02b8d6 (0x5a4a bytes) 000609 1770685339.264067 fallocate 0x039586 thru 0x03ee8a (0x5905 bytes) 000610 1770685339.273021 write 0x0155b0 thru 0x0211e3 (0xbc34 bytes) 000611 1770685339.310141 mapwrite 0x0173be thru 0x025792 (0xe3d5 bytes) 000613 1770685339.373612 trunc from 0x03a392 to 0x03d001 (0x2c70 bytes) 000614 1770685339.380362 trunc from 0x033825 to 0x03ee8a (0xb666 bytes) 000616 1770685339.404370 mapwrite 0x01ed8d thru 0x02b2c0 (0xc534 bytes) 000617 1770685339.481305 fallocate 0x02efbd thru 0x0370a0 (0x80e4 bytes) 000618 1770685339.492118 fallocate 0x02b5d9 thru 0x02c6c4 (0x10ec bytes) 000619 1770685339.504694 mapwrite 0x00fa49 thru 0x01d5ee (0xdba6 bytes) 000620 1770685339.550653 mapread 0x0221bd thru 0x026711 (0x4555 bytes) 000621 1770685339.551460 read 0x00fff4 thru 0x01a984 (0xa991 bytes) 000622 1770685339.552008 trunc from 0x03ee8b to 0x015a10 (0x2947a bytes) 000623 1770685339.586430 mapread 0x00a256 thru 0x00bf85 (0x1d30 bytes) 000624 1770685339.604340 mapwrite 0x0107b4 thru 0x017d4d (0x759a bytes) 000626 1770685339.701504 trunc from 0x012613 to 0x017d4d (0x573b bytes) 000627 1770685339.710678 punch from 0x0085d3 to 0x01790a (0xf338 bytes) 000628 1770685339.723263 trunc from 0x017d4e to 0x003493 (0x148ba bytes) 000629 1770685339.745922 write 0x007093 thru 0x00e5f4 (0x7562 bytes) 000630 1770685339.748250 read 0x00ae4d thru 0x00e5f4 (0x37a8 bytes) 000631 1770685339.750204 punch from 0x000dbc to 0x004b54 (0x3d99 bytes) 000632 1770685339.757044 punch from 0x005655 to 0x00b1a0 (0x5b4c bytes) 000633 1770685339.791083 punch from 0x00b71a to 0x00e5f4 (0x2edb bytes) 000635 1770685339.805734 read 0x0065d5 thru 0x00e5f4 (0x8020 bytes) 000636 1770685339.841249 write 0x02f6e2 thru 0x039997 (0xa2b6 bytes) 000637 1770685339.842807 trunc from 0x00f16e to 0x018764 (0x95f7 bytes) 000638 1770685339.854295 mapread 0x011d0a thru 0x01623a (0x4531 bytes) 000639 1770685339.870976 read 0x00dafa thru 0x0111e6 (0x36ed bytes) 000640 1770685339.871611 read 0x00b929 thru 0x01b1c1 (0xf899 bytes) 000641 1770685339.872261 trunc from 0x039998 to 0x015a13 (0x23f84 bytes) 000642 1770685339.927023 mapread 0x00872e thru 0x015a13 (0xd2e6 bytes) 000643 1770685339.930118 read 0x00e184 thru 0x015a13 (0x7890 bytes) 000644 1770685339.934186 mapread 0x007502 thru 0x013ca5 (0xc7a4 bytes) 000645 1770685339.942377 write 0x03f789 thru 0x03ffff (0x877 bytes) 000646 1770685339.943404 fallocate 0x008fa2 thru 0x009469 (0x4c8 bytes) 000647 1770685339.957226 punch from 0x01a1c6 to 0x01b938 (0x1773 bytes) 000648 1770685339.969616 punch from 0x02000f to 0x02e509 (0xe4fb bytes) 000649 1770685339.977287 mapwrite 0x002f7c thru 0x010741 (0xd7c6 bytes) 000650 1770685340.001895 punch from 0x01bb3b to 0x0269a2 (0xae68 bytes) 000651 1770685340.006251 punch from 0x03e37d to 0x03ffff (0x1c83 bytes) 000652 1770685340.011557 write 0x0365fb thru 0x03ffff (0x9a05 bytes) 000653 1770685340.029323 write 0x0109c0 thru 0x01db7d (0xd1be bytes) 000654 1770685340.030634 mapread 0x035436 thru 0x03ffff (0xabca bytes) 000655 1770685340.033157 write 0x018c5b thru 0x01e8e5 (0x5c8b bytes) 000656 1770685340.035185 fallocate 0x025303 thru 0x032342 (0xd040 bytes) 000657 1770685340.051584 fallocate 0x0331dc thru 0x03c986 (0x97ab bytes) 000658 1770685340.061417 punch from 0x01ad31 to 0x025a92 (0xad62 bytes) 000659 1770685340.068300 mapread 0x03d650 thru 0x03ffff (0x29b0 bytes) 000660 1770685340.069505 trunc from 0x040000 to 0x0226bb (0x1d944 bytes) 000661 1770685340.090034 trunc from 0x01fd35 to 0x0226bb (0x2987 bytes) 000662 1770685340.096533 trunc from 0x0226bc to 0x002b05 (0x1fbb6 bytes) 000664 1770685340.119295 read 0x001cc8 thru 0x002b05 (0xe3e bytes) 000665 1770685340.122789 trunc from 0x002b06 to 0x004088 (0x1583 bytes) 000666 1770685340.155561 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x4089): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4089): Mirror 3: 0xb994169d (stale) Mirror 4: 0xb994169d (stale) Mirror 5: 0xb994169d (stale) Mirror 6: 0xb994169d (stale) CRC-32 checksum value for chunk [0, 0x4089): Mirror 1: 0x762a61ce Mirror 7: 0x762a61ce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4089: skipped 000667 1770685341.029473 read 0x001c52 thru 0x004088 (0x2437 bytes) 000668 1770685341.046998 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x4089): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4089): Mirror 3: 0xb994169d (stale) Mirror 4: 0xb994169d (stale) Mirror 5: 0xb994169d (stale) Mirror 6: 0xb994169d (stale) CRC-32 checksum value for chunk [0, 0x4089): Mirror 1: 0x762a61ce Mirror 7: 0x762a61ce Mirror 8: 0x762a61ce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4089: skipped 000669 1770685341.835085 write 0x03478d thru 0x03ffff (0xb873 bytes) 000670 1770685341.892393 trunc from 0x02b3da to 0x02bbe4 (0x80b bytes) 000671 1770685341.898460 fallocate 0x02a1a1 thru 0x0301cc (0x602c bytes) 000672 1770685341.904501 trunc from 0x02778e to 0x02ad41 (0x35b4 bytes) 000673 1770685341.911071 mapwrite 0x00664f thru 0x00a45e (0x3e10 bytes) 000674 1770685341.953978 mapwrite 0x00082a thru 0x003a82 (0x3259 bytes) 000675 1770685341.979420 fallocate 0x005398 thru 0x00dddb (0x8a44 bytes) 000676 1770685341.986483 fallocate 0x02ee29 thru 0x035fb6 (0x718e bytes) 000677 1770685341.992036 trunc from 0x012d2d to 0x01d5bc (0xa890 bytes) 000678 1770685342.003964 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x64c24943 (stale) Mirror 4: 0x64c24943 (stale) Mirror 5: 0x64c24943 (stale) Mirror 6: 0x64c24943 (stale) Mirror 7: 0xd53c4034 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x64c24943 (stale) Mirror 4: 0x64c24943 (stale) Mirror 5: 0x64c24943 (stale) Mirror 6: 0x64c24943 (stale) Mirror 7: 0xd53c4034 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000679 1770685342.486460 punch from 0x035b42 to 0x03d9c8 (0x7e87 bytes) 000680 1770685342.491352 write 0x00e409 thru 0x01df28 (0xfb20 bytes) 000681 1770685342.513309 mapwrite 0x016185 thru 0x01e342 (0x81be bytes) 000682 1770685342.542982 trunc from 0x040000 to 0x032ff3 (0xd00c bytes) 000684 1770685342.560220 read 0x00fb15 thru 0x01cc91 (0xd17d bytes) 000685 1770685342.561359 punch from 0x010ad6 to 0x01b894 (0xadbf bytes) 000686 1770685342.567039 write 0x03d1df thru 0x03ffff (0x2e21 bytes) 000687 1770685342.568542 write 0x01af80 thru 0x024632 (0x96b3 bytes) 000688 1770685342.577265 trunc from 0x040000 to 0x01795d (0x286a2 bytes) 000689 1770685342.592196 write 0x01b2e0 thru 0x01dade (0x27ff bytes) 000690 1770685342.596342 trunc from 0x01bb65 to 0x01dade (0x1f7a bytes) 000691 1770685342.610086 fallocate 0x01f9e6 thru 0x02e3f9 (0xea14 bytes) 000692 1770685342.620406 fallocate 0x0014a7 thru 0x00ff97 (0xeaf1 bytes) 000693 1770685342.650231 read 0x00b518 thru 0x00c0be (0xba7 bytes) 000694 1770685342.675543 mapread 0x02326b thru 0x0289f4 (0x578a bytes) 000695 1770685342.679843 mapwrite 0x03ac94 thru 0x03ffff (0x536c bytes) 000696 1770685342.734875 mapwrite 0x00b3c8 thru 0x015c49 (0xa882 bytes) 000697 1770685342.753558 mapwrite 0x01cc43 thru 0x01f1f0 (0x25ae bytes) 000698 1770685342.766169 write 0x03c9cb thru 0x03ffff (0x3635 bytes) 000699 1770685342.768452 punch from 0x031c15 to 0x03ad63 (0x914f bytes) 000700 1770685342.774090 trunc from 0x040000 to 0x0363e5 (0x9c1a bytes) 000701 1770685342.786096 trunc from 0x0363e6 to 0x018ebe (0x1d527 bytes) 000702 1770685342.808090 trunc from 0x013688 to 0x018ebe (0x5837 bytes) 000703 1770685342.812274 punch from 0x0020eb to 0x00f652 (0xd568 bytes) 000704 1770685342.817852 trunc from 0x018ebf to 0x03838d (0x1f4cf bytes) 000705 1770685342.828850 punch from 0x0285c9 to 0x0377d7 (0xf20f bytes) 000706 1770685342.833322 punch from 0x03431f to 0x0353b1 (0x1093 bytes) 000707 1770685342.844765 mapread 0x00ae29 thru 0x017b6b (0xcd43 bytes) 000708 1770685342.886247 trunc from 0x02bb02 to 0x03412e (0x862d bytes) 000709 1770685342.890540 trunc from 0x03838e to 0x030adb (0x78b2 bytes) 000710 1770685342.911838 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30adc): Mirror 3: 0xe04d3dec (stale) Mirror 4: 0xe04d3dec (stale) Mirror 6: 0xe04d3dec (stale) Mirror 7: 0x9646622d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30adc): Mirror 3: 0xe04d3dec (stale) Mirror 4: 0xe04d3dec (stale) Mirror 6: 0xe04d3dec (stale) Mirror 7: 0x9646622d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30adc: skipped 000711 1770685343.210160 trunc from 0x02664f to 0x030adb (0xa48d bytes) 000713 1770685343.218988 punch from 0x00d4a0 to 0x014427 (0x6f88 bytes) 000714 1770685343.223346 trunc from 0x030adc to 0x0198e3 (0x171f8 bytes) 000715 1770685343.242071 read 0x0186f1 thru 0x0198e3 (0x11f3 bytes) 000716 1770685343.247347 read 0x0109fa thru 0x014557 (0x3b5e bytes) 000717 1770685343.259232 trunc from 0x01105b to 0x018ce6 (0x7c8c bytes) 000718 1770685343.266357 trunc from 0x0198e4 to 0x02af71 (0x1168e bytes) 000719 1770685343.281997 trunc from 0x02af72 to 0x00b162 (0x1fe0f bytes) 000720 1770685343.298430 mapwrite 0x02ae85 thru 0x032c78 (0x7df4 bytes) 000721 1770685343.352348 mapwrite 0x028d4a thru 0x02b5ee (0x28a5 bytes) 000722 1770685343.365116 read 0x0228b2 thru 0x027278 (0x49c7 bytes) 000723 1770685343.366045 write 0x02eafc thru 0x0385b8 (0x9abd bytes) 000724 1770685343.368588 read 0x00f1e4 thru 0x00f405 (0x222 bytes) 000726 1770685343.378900 mapread 0x018788 thru 0x019e3c (0x16b5 bytes) 000729 1770685343.381210 fallocate 0x028bd6 thru 0x02b0fd (0x2528 bytes) 000730 1770685343.386033 mapwrite 0x01f830 thru 0x02d6cc (0xde9d bytes) 000731 1770685343.404229 trunc from 0x006e81 to 0x0158a6 (0xea26 bytes) 000732 1770685343.411413 mapread 0x035a70 thru 0x0385b8 (0x2b49 bytes) 000733 1770685343.412859 fallocate 0x03acfb thru 0x03f291 (0x4597 bytes) 000734 1770685343.417453 trunc from 0x03761c to 0x0385b8 (0xf9d bytes) 000735 1770685343.422538 trunc from 0x0385b9 to 0x03fc01 (0x7649 bytes) 000736 1770685343.437596 read 0x0210ee thru 0x030816 (0xf729 bytes) 000737 1770685343.439076 fallocate 0x0294b1 thru 0x039307 (0xfe57 bytes) 000738 1770685343.444569 trunc from 0x015f1b to 0x023900 (0xd9e6 bytes) 000739 1770685343.450062 mapwrite 0x03ece0 thru 0x03ffff (0x1320 bytes) 000740 1770685343.492096 punch from 0x0304f0 to 0x03c64b (0xc15c bytes) 000741 1770685343.500291 trunc from 0x040000 to 0x01d0fb (0x22f04 bytes) 000742 1770685343.512423 punch from 0x00186a to 0x005c68 (0x43ff bytes) 000743 1770685343.519495 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1d0fc): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d0fc): Mirror 3: 0x7eb49396 (stale) Mirror 4: 0x7eb49396 (stale) Mirror 6: 0x7eb49396 (stale) Mirror 7: 0x4aae780d (stale) CRC-32 checksum value for chunk [0, 0x1d0fc): Mirror 1: 0xc6cc41dd Mirror 8: 0xc6cc41dd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d0fc: skipped 000744 1770685344.285329 read 0x008b1b thru 0x00d8a8 (0x4d8e bytes) 000745 1770685344.299437 write 0x02f3df thru 0x037826 (0x8448 bytes) 000746 1770685344.362479 trunc from 0x01a7cf to 0x01c746 (0x1f78 bytes) 000747 1770685344.376484 trunc from 0x026597 to 0x033e16 (0xd880 bytes) 000749 1770685344.409568 mapwrite 0x013d9c thru 0x02312c (0xf391 bytes) 000750 1770685344.481998 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x37827): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37827): Mirror 3: 0xf3d0121e (stale) Mirror 4: 0xf3d0121e (stale) Mirror 6: 0xf3d0121e (stale) Mirror 7: 0xd74e7511 (stale) Mirror 8: 0x15c17468 (stale) CRC-32 checksum value for chunk [0, 0x37827): Mirror 1: 0xe8c22076 Mirror 9: 0xe8c22076 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37827: skipped 000751 1770685345.497567 punch from 0x0334af to 0x037826 (0x4378 bytes) 000752 1770685345.565472 trunc from 0x0346ad to 0x037826 (0x317a bytes) 000753 1770685345.579350 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x37827): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37827): Mirror 3: 0xf3d0121e (stale) Mirror 4: 0xf3d0121e (stale) Mirror 6: 0xf3d0121e (stale) Mirror 7: 0xd74e7511 (stale) Mirror 8: 0x15c17468 (stale) Mirror 9: 0xe8c22076 (stale) CRC-32 checksum value for chunk [0, 0x37827): Mirror 1: 0x6d9523d6 Mirror 10: 0x6d9523d6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37827: skipped 000754 1770685346.466152 fallocate 0x03f4d5 thru 0x03f8b1 (0x3dd bytes) 000755 1770685346.497636 read 0x005243 thru 0x008172 (0x2f30 bytes) 000756 1770685346.509863 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x37827): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37827): Mirror 3: 0xf3d0121e (stale) Mirror 4: 0xf3d0121e (stale) Mirror 6: 0xf3d0121e (stale) Mirror 7: 0xd74e7511 (stale) Mirror 8: 0x15c17468 (stale) Mirror 9: 0xe8c22076 (stale) Mirror 10: 0x6d9523d6 (stale) CRC-32 checksum value for chunk [0, 0x37827): Mirror 1: 0x6d9523d6 Mirror 11: 0x6d9523d6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37827: skipped 000758 1770685347.341551 punch from 0x010b5a to 0x016981 (0x5e28 bytes) 000759 1770685347.383321 read 0x02d80c thru 0x03745a (0x9c4f bytes) 000760 1770685347.389521 trunc from 0x037827 to 0x030235 (0x75f1 bytes) 000761 1770685347.423461 punch from 0x011495 to 0x020877 (0xf3e3 bytes) 000762 1770685347.429124 punch from 0x02e59c to 0x030235 (0x1c9a bytes) 000763 1770685347.435370 trunc from 0x030236 to 0x02fd48 (0x4ed bytes) 000764 1770685347.456036 read 0x007c4b thru 0x016ec4 (0xf27a bytes) 000766 1770685347.470993 MIRROR_RESYNC 9 mirrors 000767 1770685349.031858 punch from 0x029799 to 0x02fd48 (0x65b0 bytes) 000768 1770685349.070760 fallocate 0x0039e2 thru 0x00fd16 (0xc335 bytes) 000769 1770685349.079434 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fd49): Mirror 3: 0x59d74124 (stale) Mirror 4: 0x59d74124 (stale) Mirror 6: 0x59d74124 (stale) Mirror 7: 0x59d74124 (stale) Mirror 9: 0x59d74124 (stale) Mirror 10: 0x59d74124 (stale) Mirror 11: 0x59d74124 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fd49): Mirror 3: 0x59d74124 (stale) Mirror 4: 0x59d74124 (stale) Mirror 6: 0x59d74124 (stale) Mirror 7: 0x59d74124 (stale) Mirror 9: 0x59d74124 (stale) Mirror 10: 0x59d74124 (stale) Mirror 11: 0x59d74124 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fd49: skipped 000770 1770685349.581151 write 0x02a172 thru 0x035d63 (0xbbf2 bytes) 000771 1770685349.591156 punch from 0x002e95 to 0x006cc7 (0x3e33 bytes) 000772 1770685349.605098 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35d64): Mirror 3: 0xc33daa3b (stale) Mirror 4: 0xc33daa3b (stale) Mirror 6: 0xc33daa3b (stale) Mirror 9: 0xc33daa3b (stale) Mirror 10: 0xc33daa3b (stale) Mirror 11: 0xc33daa3b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35d64): Mirror 3: 0xc33daa3b (stale) Mirror 4: 0xc33daa3b (stale) Mirror 6: 0xc33daa3b (stale) Mirror 9: 0xc33daa3b (stale) Mirror 10: 0xc33daa3b (stale) Mirror 11: 0xc33daa3b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35d64: skipped 000773 1770685350.129466 punch from 0x022b0b to 0x02bb56 (0x904c bytes) 000774 1770685350.141798 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x35d64): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35d64): Mirror 3: 0xc33daa3b (stale) Mirror 4: 0xc33daa3b (stale) Mirror 6: 0xc33daa3b (stale) Mirror 9: 0xc33daa3b (stale) Mirror 10: 0xc33daa3b (stale) Mirror 11: 0xc33daa3b (stale) CRC-32 checksum value for chunk [0, 0x35d64): Mirror 1: 0x7755157d Mirror 12: 0x7755157d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35d64: skipped 000775 1770685350.986595 punch from 0x022c59 to 0x030ace (0xde76 bytes) 000777 1770685351.031263 write 0x028494 thru 0x0375c0 (0xf12d bytes) 000778 1770685351.052518 mapread 0x035458 thru 0x0375c0 (0x2169 bytes) 000779 1770685351.053763 mapwrite 0x03abb3 thru 0x03f00a (0x4458 bytes) 000780 1770685351.113538 punch from 0x0175ab to 0x0261b2 (0xec08 bytes) 000781 1770685351.121038 mapread 0x012bd6 thru 0x017d3e (0x5169 bytes) 000782 1770685351.132829 trunc from 0x028b76 to 0x030625 (0x7ab0 bytes) 000783 1770685351.137213 mapwrite 0x023579 thru 0x027a74 (0x44fc bytes) 000784 1770685351.175013 punch from 0x02cbb3 to 0x030f0d (0x435b bytes) 000785 1770685351.179069 read 0x02af76 thru 0x037b03 (0xcb8e bytes) 000786 1770685351.185526 trunc from 0x019b05 to 0x01ac48 (0x1144 bytes) 000787 1770685351.196457 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3f00b): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f00b): Mirror 3: 0x4c0e2e72 (stale) Mirror 4: 0x4c0e2e72 (stale) Mirror 6: 0x4c0e2e72 (stale) Mirror 9: 0x4c0e2e72 (stale) Mirror 10: 0x4c0e2e72 (stale) Mirror 11: 0x4c0e2e72 (stale) Mirror 12: 0xb58038ef (stale) CRC-32 checksum value for chunk [0, 0x3f00b): Mirror 1: 0xa15ece76 Mirror 13: 0xa15ece76 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f00b: skipped 000788 1770685352.098080 mapread 0x03148f thru 0x03f00a (0xdb7c bytes) 000789 1770685352.160425 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f00b): Mirror 4: 0x4c0e2e72 (stale) Mirror 6: 0x4c0e2e72 (stale) Mirror 9: 0x4c0e2e72 (stale) Mirror 10: 0x4c0e2e72 (stale) Mirror 11: 0x4c0e2e72 (stale) Mirror 12: 0xb58038ef (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f00b): Mirror 4: 0x4c0e2e72 (stale) Mirror 6: 0x4c0e2e72 (stale) Mirror 9: 0x4c0e2e72 (stale) Mirror 10: 0x4c0e2e72 (stale) Mirror 11: 0x4c0e2e72 (stale) Mirror 12: 0xb58038ef (stale) CRC-32 checksum value for chunk [0, 0x3f00b): Mirror 1: 0xa15ece76 Mirror 13: 0xa15ece76 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f00b: skipped 000790 1770685353.010546 mapread 0x009ae6 thru 0x00cb98 (0x30b3 bytes) 000791 1770685353.054880 write 0x02a774 thru 0x0392a5 (0xeb32 bytes) 000792 1770685353.148241 punch from 0x028461 to 0x03082a (0x83ca bytes) 000793 1770685353.178396 trunc from 0x03f00b to 0x025681 (0x19989 bytes) 000794 1770685353.230073 mapread 0x012bff thru 0x01555e (0x2960 bytes) 000795 1770685353.270213 MIRROR_RESYNC 8 mirrors 000796 1770685354.796251 mapread 0x02457e thru 0x025681 (0x1104 bytes) 000797 1770685354.806226 read 0x022c85 thru 0x025681 (0x29fd bytes) 000798 1770685354.811248 fallocate 0x0203ed thru 0x02a336 (0x9f4a bytes) 000799 1770685354.848241 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a337): Mirror 4: 0x3ee3702b (stale) Mirror 6: 0x3ee3702b (stale) Mirror 9: 0x3ee3702b (stale) Mirror 10: 0x3ee3702b (stale) Mirror 12: 0x3ee3702b (stale) Mirror 13: 0x3ee3702b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a337): Mirror 4: 0x3ee3702b (stale) Mirror 6: 0x3ee3702b (stale) Mirror 9: 0x3ee3702b (stale) Mirror 10: 0x3ee3702b (stale) Mirror 12: 0x3ee3702b (stale) Mirror 13: 0x3ee3702b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a337: skipped 000800 1770685355.279076 read 0x0020ba thru 0x00b242 (0x9189 bytes) 000802 1770685355.285536 write 0x03a9d4 thru 0x03ae56 (0x483 bytes) 000803 1770685355.291078 mapwrite 0x02caf4 thru 0x039877 (0xcd84 bytes) 000804 1770685355.373521 trunc from 0x0077e8 to 0x00a144 (0x295d bytes) 000805 1770685355.386587 write 0x01af4a thru 0x01c12d (0x11e4 bytes) 000806 1770685355.398268 trunc from 0x03ae57 to 0x02a667 (0x107ef bytes) 000807 1770685355.421441 fallocate 0x0392b8 thru 0x03ffff (0x6d48 bytes) 000808 1770685355.444543 write 0x034e9f thru 0x035e13 (0xf75 bytes) 000809 1770685355.496450 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xc7d2041e (stale) Mirror 6: 0xc7d2041e (stale) Mirror 9: 0xc7d2041e (stale) Mirror 10: 0xc7d2041e (stale) Mirror 12: 0xc7d2041e (stale) Mirror 13: 0xc7d2041e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb709c085 Mirror 14: 0xb709c085 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000810 1770685356.198994 trunc from 0x040000 to 0x00ac43 (0x353bc bytes) 000811 1770685356.266283 trunc from 0x00ac44 to 0x030f31 (0x262ee bytes) 000812 1770685356.293234 mapread 0x00cdcf thru 0x0116ac (0x48de bytes) 000813 1770685356.314936 punch from 0x003323 to 0x011d0b (0xe9e9 bytes) 000814 1770685356.320118 trunc from 0x030f32 to 0x025bda (0xb357 bytes) 000815 1770685356.333063 read 0x01c8da thru 0x01f73b (0x2e62 bytes) 000816 1770685356.339241 trunc from 0x005cdb to 0x012fd7 (0xd2fd bytes) 000817 1770685356.348344 trunc from 0x00b378 to 0x01338c (0x8015 bytes) 000818 1770685356.353474 read 0x00fc78 thru 0x01eb2d (0xeeb6 bytes) 000819 1770685356.364307 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25bdb): Mirror 4: 0x72d9509a (stale) Mirror 6: 0x72d9509a (stale) Mirror 9: 0x72d9509a (stale) Mirror 10: 0x72d9509a (stale) Mirror 12: 0x72d9509a (stale) Mirror 14: 0x239902c4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25bdb): Mirror 4: 0x72d9509a (stale) Mirror 6: 0x72d9509a (stale) Mirror 9: 0x72d9509a (stale) Mirror 10: 0x72d9509a (stale) Mirror 12: 0x72d9509a (stale) Mirror 14: 0x239902c4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25bdb: skipped 000821 1770685356.769356 punch from 0x00efac to 0x01b97a (0xc9cf bytes) 000822 1770685356.773785 mapwrite 0x0040b1 thru 0x00abd7 (0x6b27 bytes) 000823 1770685356.812345 mapwrite 0x028ec6 thru 0x02ff27 (0x7062 bytes) 000824 1770685356.876321 read 0x01d6a4 thru 0x021793 (0x40f0 bytes) 000825 1770685356.884510 mapread 0x0264bd thru 0x02ff27 (0x9a6b bytes) 000826 1770685356.886097 trunc from 0x02ff28 to 0x005a5f (0x2a4c8 bytes) 000827 1770685356.910970 write 0x03eea7 thru 0x03ffff (0x1159 bytes) 000829 1770685356.915223 trunc from 0x040000 to 0x0207ae (0x1f851 bytes) 000830 1770685356.941496 mapwrite 0x0384b7 thru 0x03e6f0 (0x623a bytes) 000831 1770685357.000063 punch from 0x020e73 to 0x02eea2 (0xe030 bytes) 000832 1770685357.010625 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3e6f1): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e6f1): Mirror 4: 0x84afcd30 (stale) Mirror 6: 0x84afcd30 (stale) Mirror 9: 0x84afcd30 (stale) Mirror 10: 0x84afcd30 (stale) Mirror 12: 0x84afcd30 (stale) Mirror 14: 0xa5432e5b (stale) CRC-32 checksum value for chunk [0, 0x3e6f1): Mirror 1: 0xcaede094 Mirror 15: 0xcaede094 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e6f1: skipped 000833 1770685357.928081 mapread 0x02f912 thru 0x03c0b9 (0xc7a8 bytes) 000834 1770685357.976424 write 0x022166 thru 0x02388b (0x1726 bytes) 000835 1770685358.047370 trunc from 0x03e6f1 to 0x000547 (0x3e1a9 bytes) 000836 1770685358.068963 punch from 0x0004cd to 0x000547 (0x7b bytes) 000838 1770685358.073459 punch from 0x0002e9 to 0x000547 (0x25f bytes) 000839 1770685358.085293 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x548): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x548): Mirror 4: 0xd18842 (stale) Mirror 6: 0xd18842 (stale) Mirror 9: 0xd18842 (stale) Mirror 10: 0xd18842 (stale) Mirror 12: 0xd18842 (stale) Mirror 14: 0xd18842 (stale) Mirror 15: 0xd18842 (stale) CRC-32 checksum value for chunk [0, 0x548): Mirror 1: 0x1d96b30c Mirror 16: 0x1d96b30c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x548: skipped 000840 1770685358.817402 fallocate 0x009fdf thru 0x011566 (0x7588 bytes) 000841 1770685358.860471 trunc from 0x000548 to 0x03aac9 (0x3a582 bytes) 000842 1770685358.906267 trunc from 0x03aaca to 0x03a74b (0x37e bytes) 000843 1770685358.927569 mapwrite 0x000b6e thru 0x00ab0e (0x9fa1 bytes) 000845 1770685358.971719 write 0x01f74b thru 0x02c027 (0xc8dd bytes) 000846 1770685358.983314 trunc from 0x022866 to 0x02b359 (0x8af4 bytes) 000847 1770685358.996728 mapwrite 0x0073a3 thru 0x01051c (0x917a bytes) 000848 1770685359.015899 trunc from 0x012b3a to 0x021aee (0xefb5 bytes) 000849 1770685359.021997 trunc from 0x03a74c to 0x014c7c (0x25acf bytes) 000850 1770685359.042165 MIRROR_RESYNC 9 mirrors 000851 1770685360.155036 write 0x01259f thru 0x01f41c (0xce7e bytes) 000852 1770685360.186060 punch from 0x015595 to 0x01903e (0x3aaa bytes) 000853 1770685360.196028 write 0x00f0f1 thru 0x01127a (0x218a bytes) 000854 1770685360.203408 mapread 0x00ef8d thru 0x011224 (0x2298 bytes) 000855 1770685360.204086 trunc from 0x012976 to 0x0160b9 (0x3744 bytes) 000857 1770685360.207692 write 0x02d992 thru 0x032df7 (0x5466 bytes) 000858 1770685360.208578 fallocate 0x03bf9c thru 0x03f7de (0x3843 bytes) 000859 1770685360.211901 read 0x01a7c2 thru 0x0261c1 (0xba00 bytes) 000860 1770685360.218423 mapread 0x026518 thru 0x0324a7 (0xbf90 bytes) 000861 1770685360.226166 trunc from 0x032df8 to 0x037e55 (0x505e bytes) 000862 1770685360.261123 read 0x017989 thru 0x01e85d (0x6ed5 bytes) 000863 1770685360.261877 mapread 0x01bb2c thru 0x01f584 (0x3a59 bytes) 000865 1770685360.266016 write 0x01b4ff thru 0x0294a7 (0xdfa9 bytes) 000866 1770685360.268489 trunc from 0x028240 to 0x037695 (0xf456 bytes) 000867 1770685360.286007 write 0x03c92e thru 0x03e104 (0x17d7 bytes) 000868 1770685360.288410 write 0x03326b thru 0x03525f (0x1ff5 bytes) 000869 1770685360.302421 trunc from 0x03e105 to 0x035c6f (0x8495 bytes) 000871 1770685360.323872 trunc from 0x035c70 to 0x00bb1f (0x2a150 bytes) 000872 1770685360.357241 MIRROR_RESYNC 9 mirrors 000874 1770685361.106123 fallocate 0x00e6e9 thru 0x015109 (0x6a21 bytes) 000875 1770685361.146770 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x1510a): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1510a): Mirror 4: 0xe5e89f5c (stale) Mirror 6: 0xe5e89f5c (stale) Mirror 9: 0xe5e89f5c (stale) Mirror 10: 0xe5e89f5c (stale) Mirror 12: 0xe5e89f5c (stale) Mirror 14: 0xe5e89f5c (stale) Mirror 15: 0xe5e89f5c (stale) Mirror 16: 0xe5e89f5c (stale) CRC-32 checksum value for chunk [0, 0x1510a): Mirror 1: 0xe5e89f5c Mirror 17: 0xe5e89f5c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1510a: skipped 000876 1770685362.173063 trunc from 0x00f82c to 0x015109 (0x58de bytes) 000878 1770685362.229435 write 0x009c77 thru 0x00dbaa (0x3f34 bytes) 000879 1770685362.243107 trunc from 0x002093 to 0x0110b9 (0xf027 bytes) 000880 1770685362.254774 punch from 0x0041be to 0x011296 (0xd0d9 bytes) 000881 1770685362.258285 trunc from 0x01510a to 0x02ad1a (0x15c11 bytes) 000882 1770685362.280162 mapwrite 0x03dbab thru 0x03ffff (0x2455 bytes) 000883 1770685362.348923 read 0x0347fc thru 0x0354c0 (0xcc5 bytes) 000884 1770685362.358174 read 0x02bd6d thru 0x038b98 (0xce2c bytes) 000885 1770685362.382866 MIRROR_RESYNC 10 mirrors 000886 1770685363.689590 fallocate 0x02e1ce thru 0x02ffb6 (0x1de9 bytes) 000887 1770685363.726509 trunc from 0x040000 to 0x004512 (0x3baed bytes) 000888 1770685363.751424 mapwrite 0x00c3d5 thru 0x013a1a (0x7646 bytes) 000892 1770685363.839619 mapwrite 0x020068 thru 0x027efe (0x7e97 bytes) 000893 1770685363.906932 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27eff): Mirror 4: 0x9f762b97 (stale) Mirror 9: 0x9f762b97 (stale) Mirror 10: 0x9f762b97 (stale) Mirror 12: 0x9f762b97 (stale) Mirror 14: 0x9f762b97 (stale) Mirror 15: 0x9f762b97 (stale) Mirror 16: 0x9f762b97 (stale) Mirror 17: 0x9f762b97 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27eff): Mirror 4: 0x9f762b97 (stale) Mirror 9: 0x9f762b97 (stale) Mirror 10: 0x9f762b97 (stale) Mirror 12: 0x9f762b97 (stale) Mirror 14: 0x9f762b97 (stale) Mirror 15: 0x9f762b97 (stale) Mirror 16: 0x9f762b97 (stale) Mirror 17: 0x9f762b97 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27eff: skipped 000894 1770685364.362541 fallocate 0x020910 thru 0x02a0f0 (0x97e1 bytes) 000895 1770685364.367220 write 0x00f1cb thru 0x012e5e (0x3c94 bytes) 000896 1770685364.383849 fallocate 0x028b8f thru 0x029a71 (0xee3 bytes) 000897 1770685364.388935 fallocate 0x01059d thru 0x01cacb (0xc52f bytes) 000898 1770685364.394349 punch from 0x0076fe to 0x00e20e (0x6b11 bytes) 000900 1770685364.406640 mapread 0x01e6f9 thru 0x028633 (0x9f3b bytes) 000901 1770685364.428457 trunc from 0x02a0f1 to 0x02d909 (0x3819 bytes) 000902 1770685364.448853 fallocate 0x01efba thru 0x0263c1 (0x7408 bytes) 000903 1770685364.455886 mapwrite 0x001236 thru 0x00a357 (0x9122 bytes) 000904 1770685364.488423 write 0x034513 thru 0x03d3d3 (0x8ec1 bytes) 000905 1770685364.494965 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d3d4): Mirror 4: 0x7fdfb492 (stale) Mirror 9: 0x7fdfb492 (stale) Mirror 10: 0x7fdfb492 (stale) Mirror 12: 0x7fdfb492 (stale) Mirror 14: 0x7fdfb492 (stale) Mirror 16: 0x7fdfb492 (stale) Mirror 17: 0x7fdfb492 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d3d4): Mirror 4: 0x7fdfb492 (stale) Mirror 9: 0x7fdfb492 (stale) Mirror 10: 0x7fdfb492 (stale) Mirror 12: 0x7fdfb492 (stale) Mirror 14: 0x7fdfb492 (stale) Mirror 16: 0x7fdfb492 (stale) Mirror 17: 0x7fdfb492 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d3d4: skipped 000907 1770685364.950804 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3d3d4): Mirror 4: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d3d4): Mirror 4: 0x7fdfb492 (stale) Mirror 9: 0x7fdfb492 (stale) Mirror 10: 0x7fdfb492 (stale) Mirror 12: 0x7fdfb492 (stale) Mirror 14: 0x7fdfb492 (stale) Mirror 16: 0x7fdfb492 (stale) Mirror 17: 0x7fdfb492 (stale) CRC-32 checksum value for chunk [0, 0x3d3d4): Mirror 1: 0x5a914f09 Mirror 18: 0x5a914f09 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d3d4: skipped 000908 1770685365.918168 fallocate 0x005c01 thru 0x00be2b (0x622b bytes) 000909 1770685366.005029 read 0x037349 thru 0x03d3d3 (0x608b bytes) 000910 1770685366.017527 mapwrite 0x002400 thru 0x010a2d (0xe62e bytes) 000911 1770685366.065404 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3d3d4): Mirror 4: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d3d4): Mirror 4: 0x7fdfb492 (stale) Mirror 9: 0x7fdfb492 (stale) Mirror 10: 0x7fdfb492 (stale) Mirror 12: 0x7fdfb492 (stale) Mirror 14: 0x7fdfb492 (stale) Mirror 16: 0x7fdfb492 (stale) Mirror 17: 0x7fdfb492 (stale) Mirror 18: 0x5a914f09 (stale) CRC-32 checksum value for chunk [0, 0x3d3d4): Mirror 1: 0xe96b8bad Mirror 19: 0xe96b8bad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d3d4: skipped 000912 1770685366.834686 mapread 0x00d948 thru 0x0107fe (0x2eb7 bytes) 000913 1770685366.864208 trunc from 0x03d3d4 to 0x019712 (0x23cc1 bytes) 000914 1770685366.934931 punch from 0x0029f9 to 0x00ea89 (0xc091 bytes) 000915 1770685366.941017 punch from 0x00cdd8 to 0x017579 (0xa7a2 bytes) 000916 1770685366.946785 mapread 0x013613 thru 0x019712 (0x6100 bytes) 000917 1770685366.957356 read 0x008741 thru 0x00c016 (0x38d6 bytes) 000918 1770685366.965808 punch from 0x009c82 to 0x01856a (0xe8e9 bytes) 000919 1770685366.972315 trunc from 0x019713 to 0x026cc3 (0xd5b1 bytes) 000920 1770685366.994484 write 0x00781c thru 0x009113 (0x18f8 bytes) 000921 1770685367.005078 mapwrite 0x03d36a thru 0x03ffff (0x2c96 bytes) 000922 1770685367.043343 write 0x028945 thru 0x032ab4 (0xa170 bytes) 000923 1770685367.058132 mapwrite 0x01ccb6 thru 0x021e50 (0x519b bytes) 000924 1770685367.084735 fallocate 0x009e97 thru 0x00ab14 (0xc7e bytes) 000926 1770685367.093840 MIRROR_RESYNC 10 mirrors 000927 1770685370.025209 trunc from 0x01eb03 to 0x0278ae (0x8dac bytes) 000928 1770685370.055105 punch from 0x00e8a7 to 0x014b1f (0x6279 bytes) 000929 1770685370.060050 mapread 0x0370d4 thru 0x03ffff (0x8f2c bytes) 000931 1770685370.075361 mapwrite 0x032dc1 thru 0x03403e (0x127e bytes) 000932 1770685370.086414 fallocate 0x032a29 thru 0x0398e3 (0x6ebb bytes) 000933 1770685370.091221 trunc from 0x040000 to 0x03d80c (0x27f3 bytes) 000934 1770685370.108954 mapwrite 0x021c42 thru 0x02f893 (0xdc52 bytes) 000935 1770685370.140838 mapwrite 0x01b73e thru 0x01fec9 (0x478c bytes) 000936 1770685370.153526 write 0x025718 thru 0x0306e7 (0xafd0 bytes) 000937 1770685370.158452 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3d80d): Mirror 4: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d80d): Mirror 4: 0x221721a9 (stale) Mirror 9: 0x221721a9 (stale) Mirror 10: 0x221721a9 (stale) Mirror 12: 0x221721a9 (stale) Mirror 14: 0x221721a9 (stale) Mirror 16: 0x221721a9 (stale) Mirror 17: 0x221721a9 (stale) Mirror 18: 0x221721a9 (stale) Mirror 19: 0x221721a9 (stale) CRC-32 checksum value for chunk [0, 0x3d80d): Mirror 1: 0xaee60dfa Mirror 20: 0xaee60dfa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d80d: skipped 000938 1770685371.050963 trunc from 0x03d80d to 0x03d284 (0x588 bytes) 000939 1770685371.161171 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3d285): Mirror 4: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d285): Mirror 4: 0x15dfce33 (stale) Mirror 9: 0x15dfce33 (stale) Mirror 10: 0x15dfce33 (stale) Mirror 12: 0x15dfce33 (stale) Mirror 14: 0x15dfce33 (stale) Mirror 16: 0x15dfce33 (stale) Mirror 17: 0x15dfce33 (stale) Mirror 18: 0x15dfce33 (stale) Mirror 19: 0x15dfce33 (stale) Mirror 20: 0xd62d91e2 (stale) CRC-32 checksum value for chunk [0, 0x3d285): Mirror 1: 0xd62d91e2 Mirror 21: 0xd62d91e2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d285: skipped 000940 1770685372.006485 mapread 0x026e90 thru 0x031e05 (0xaf76 bytes) 000941 1770685372.094252 trunc from 0x03d285 to 0x004e06 (0x3847e bytes) 000943 1770685372.157506 mapread 0x00019c thru 0x002f9d (0x2e02 bytes) 000944 1770685372.165411 trunc from 0x004e07 to 0x02bc71 (0x26e6b bytes) 000945 1770685372.183867 mapread 0x018e16 thru 0x01c4f8 (0x36e3 bytes) 000946 1770685372.194193 read 0x005f1d thru 0x011c82 (0xbd66 bytes) 000947 1770685372.202259 fallocate 0x01c5d2 thru 0x02a937 (0xe366 bytes) 000948 1770685372.207160 write 0x01f4e7 thru 0x02f2f5 (0xfe0f bytes) 000949 1770685372.210327 trunc from 0x016e75 to 0x018ef3 (0x207f bytes) 000950 1770685372.215328 trunc from 0x0263b7 to 0x02f2f5 (0x8f3f bytes) 000951 1770685372.228269 mapwrite 0x028275 thru 0x02c3a4 (0x4130 bytes) 000952 1770685372.260090 MIRROR_RESYNC 12 mirrors 000953 1770685374.409558 MIRROR_EXTEND to 13 mirrors 000954 1770685374.974551 write 0x01c18a thru 0x0203da (0x4251 bytes) 000955 1770685375.038873 fallocate 0x02a89b thru 0x036de4 (0xc54a bytes) 000956 1770685375.045299 write 0x00c81a thru 0x010070 (0x3857 bytes) 000957 1770685375.056119 mapwrite 0x0397b8 thru 0x03b8ec (0x2135 bytes) 000958 1770685375.098944 punch from 0x0146de to 0x021e65 (0xd788 bytes) 000959 1770685375.105646 trunc from 0x0010e2 to 0x00cbee (0xbb0d bytes) 000960 1770685375.112275 write 0x0010ef thru 0x007846 (0x6758 bytes) 000961 1770685375.121823 fallocate 0x028a5c thru 0x030d2c (0x82d1 bytes) 000962 1770685375.126980 write 0x026b03 thru 0x031f36 (0xb434 bytes) 000963 1770685375.139336 trunc from 0x03b578 to 0x03b8ec (0x375 bytes) 000964 1770685375.144491 mapread 0x017de4 thru 0x01a9cd (0x2bea bytes) 000966 1770685375.153947 mapread 0x0353ba thru 0x03b8ec (0x6533 bytes) 000967 1770685375.160692 mapread 0x038af1 thru 0x03b8ec (0x2dfc bytes) 000968 1770685375.162430 fallocate 0x029dcc thru 0x034892 (0xaac7 bytes) 000969 1770685375.167875 fallocate 0x000866 thru 0x0065bc (0x5d57 bytes) 000970 1770685375.173790 fallocate 0x034070 thru 0x03fa22 (0xb9b3 bytes) 000971 1770685375.179375 read 0x00a774 thru 0x018080 (0xd90d bytes) 000972 1770685375.180243 read 0x018a3b thru 0x01ead5 (0x609b bytes) 000973 1770685375.185068 MIRROR_SPLIT mirror 6 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fa23): Mirror 4: 0x13d76a44 (stale) Mirror 9: 0x13d76a44 (stale) Mirror 10: 0x13d76a44 (stale) Mirror 12: 0x13d76a44 (stale) Mirror 14: 0x13d76a44 (stale) Mirror 17: 0x13d76a44 (stale) Mirror 18: 0x13d76a44 (stale) Mirror 19: 0x13d76a44 (stale) Mirror 20: 0x13d76a44 (stale) Mirror 21: 0x13d76a44 (stale) Mirror 22: 0x13d76a44 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fa23): Mirror 4: 0x13d76a44 (stale) Mirror 9: 0x13d76a44 (stale) Mirror 10: 0x13d76a44 (stale) Mirror 12: 0x13d76a44 (stale) Mirror 14: 0x13d76a44 (stale) Mirror 17: 0x13d76a44 (stale) Mirror 18: 0x13d76a44 (stale) Mirror 19: 0x13d76a44 (stale) Mirror 20: 0x13d76a44 (stale) Mirror 21: 0x13d76a44 (stale) Mirror 22: 0x13d76a44 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fa23: skipped 000974 1770685375.795299 write 0x00c629 thru 0x0118f2 (0x52ca bytes) 000975 1770685375.808024 trunc from 0x03fa23 to 0x012cf6 (0x2cd2c bytes) 000976 1770685375.821359 read 0x0057b8 thru 0x0058e1 (0x12a bytes) 000977 1770685375.826219 write 0x0262f1 thru 0x027e03 (0x1b13 bytes) 000978 1770685375.827188 trunc from 0x027e04 to 0x00cb83 (0x1b280 bytes) 000980 1770685375.842662 write 0x003f10 thru 0x00e464 (0xa555 bytes) 000982 1770685375.851174 mapread 0x009834 thru 0x00e464 (0x4c31 bytes) 000983 1770685375.856353 MIRROR_SPLIT mirror 2 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe465): Mirror 4: 0x7d520b32 (stale) Mirror 10: 0x7d520b32 (stale) Mirror 12: 0x7d520b32 (stale) Mirror 14: 0x7d520b32 (stale) Mirror 17: 0x7d520b32 (stale) Mirror 18: 0x7d520b32 (stale) Mirror 19: 0x7d520b32 (stale) Mirror 20: 0x7d520b32 (stale) Mirror 21: 0x7d520b32 (stale) Mirror 22: 0x7d520b32 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe465): Mirror 4: 0x7d520b32 (stale) Mirror 10: 0x7d520b32 (stale) Mirror 12: 0x7d520b32 (stale) Mirror 14: 0x7d520b32 (stale) Mirror 17: 0x7d520b32 (stale) Mirror 18: 0x7d520b32 (stale) Mirror 19: 0x7d520b32 (stale) Mirror 20: 0x7d520b32 (stale) Mirror 21: 0x7d520b32 (stale) Mirror 22: 0x7d520b32 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe465: skipped 000984 1770685376.267522 mapread 0x006772 thru 0x00e464 (0x7cf3 bytes) 000985 1770685376.288087 write 0x010cdb thru 0x01465e (0x3984 bytes) 000986 1770685376.294185 punch from 0x0136f5 to 0x01465e (0xf6a bytes) 000987 1770685376.306821 read 0x0058d5 thru 0x011755 (0xbe81 bytes) 000988 1770685376.310892 trunc from 0x001894 to 0x00aa24 (0x9191 bytes) 000989 1770685376.319152 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1465f): Mirror 10: 0x20cae5f0 (stale) Mirror 12: 0x20cae5f0 (stale) Mirror 14: 0x20cae5f0 (stale) Mirror 17: 0x20cae5f0 (stale) Mirror 18: 0x20cae5f0 (stale) Mirror 19: 0x20cae5f0 (stale) Mirror 20: 0x20cae5f0 (stale) Mirror 21: 0x20cae5f0 (stale) Mirror 22: 0x20cae5f0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1465f): Mirror 10: 0x20cae5f0 (stale) Mirror 12: 0x20cae5f0 (stale) Mirror 14: 0x20cae5f0 (stale) Mirror 17: 0x20cae5f0 (stale) Mirror 18: 0x20cae5f0 (stale) Mirror 19: 0x20cae5f0 (stale) Mirror 20: 0x20cae5f0 (stale) Mirror 21: 0x20cae5f0 (stale) Mirror 22: 0x20cae5f0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1465f: skipped 000990 1770685376.710265 write 0x00eff6 thru 0x0151ed (0x61f8 bytes) 000991 1770685376.724362 trunc from 0x0143cc to 0x0151ed (0xe22 bytes) 000992 1770685376.739810 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x151ee): Mirror 10: 0x57a9dd23 (stale) Mirror 12: 0x57a9dd23 (stale) Mirror 17: 0x57a9dd23 (stale) Mirror 18: 0x57a9dd23 (stale) Mirror 19: 0x57a9dd23 (stale) Mirror 20: 0x57a9dd23 (stale) Mirror 21: 0x57a9dd23 (stale) Mirror 22: 0x57a9dd23 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x151ee): Mirror 10: 0x57a9dd23 (stale) Mirror 12: 0x57a9dd23 (stale) Mirror 17: 0x57a9dd23 (stale) Mirror 18: 0x57a9dd23 (stale) Mirror 19: 0x57a9dd23 (stale) Mirror 20: 0x57a9dd23 (stale) Mirror 21: 0x57a9dd23 (stale) Mirror 22: 0x57a9dd23 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x151ee: skipped 000993 1770685377.106215 mapread 0x00c238 thru 0x0151ed (0x8fb6 bytes) 000994 1770685377.124351 trunc from 0x0151ee to 0x00bcbf (0x952e bytes) 000995 1770685377.143212 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0xbcc0): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xbcc0): Mirror 10: 0x8fc64416 (stale) Mirror 12: 0x8fc64416 (stale) Mirror 17: 0x8fc64416 (stale) Mirror 18: 0x8fc64416 (stale) Mirror 19: 0x8fc64416 (stale) Mirror 20: 0x8fc64416 (stale) Mirror 21: 0x8fc64416 (stale) Mirror 22: 0x8fc64416 (stale) CRC-32 checksum value for chunk [0, 0xbcc0): Mirror 1: 0x4522c5ea Mirror 23: 0x4522c5ea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xbcc0: skipped 000996 1770685378.050342 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ab:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xbcc0): Mirror 10: 0x8fc64416 (stale) Mirror 12: 0x8fc64416 (stale) Mirror 17: 0x8fc64416 (stale) Mirror 18: 0x8fc64416 (stale) Mirror 19: 0x8fc64416 (stale) Mirror 21: 0x8fc64416 (stale) Mirror 22: 0x8fc64416 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xbcc0): Mirror 10: 0x8fc64416 (stale) Mirror 12: 0x8fc64416 (stale) Mirror 17: 0x8fc64416 (stale) Mirror 18: 0x8fc64416 (stale) Mirror 19: 0x8fc64416 (stale) Mirror 21: 0x8fc64416 (stale) Mirror 22: 0x8fc64416 (stale) CRC-32 checksum value for chunk [0, 0xbcc0): Mirror 1: 0x4522c5ea Mirror 23: 0x4522c5ea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xbcc0: skipped 000997 1770685378.629137 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0xbcc0): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xbcc0): Mirror 10: 0x8fc64416 (stale) Mirror 12: 0x8fc64416 (stale) Mirror 17: 0x8fc64416 (stale) Mirror 18: 0x8fc64416 (stale) Mirror 19: 0x8fc64416 (stale) Mirror 21: 0x8fc64416 (stale) Mirror 22: 0x8fc64416 (stale) CRC-32 checksum value for chunk [0, 0xbcc0): Mirror 1: 0x4522c5ea Mirror 23: 0x4522c5ea Mirror 24: 0x4522c5ea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xbcc0: skipped 000998 1770685379.395826 mapwrite 0x01d3f9 thru 0x0288f3 (0xb4fb bytes) 001000 1770685379.486145 mapread 0x014b75 thru 0x0220e6 (0xd572 bytes) All operations completed A-OK!