== sanity-flr test 70a: flr mode fsx test ================ 11:48:29 (1788623309) striped dir -i0 -c2 -H crush /mnt/lustre/d70a.sanity-flr Seed set to 3311 skipping zero size read fallocating to largest ever: 0xb5e1 000003 1788623311.325848 fallocate 0x00809f thru 0x00b5e0 (0x3542 bytes) skipping zero length punch hole skipping zero length zero range 000006 1788623311.335602 MIRROR_EXTEND to 2 mirrors skipping zero length punch hole truncating to largest ever: 0x357c4 000008 1788623311.678785 trunc from 00000000 to 0x0357c3 (0x357c4 bytes) 000009 1788623311.701306 fallocate 0x021603 thru 0x0282c0 (0x6cbe bytes) 000010 1788623311.704926 mapread 0x01acb9 thru 0x02a8e3 (0xfc2b bytes) 000011 1788623311.724912 read 0x031116 thru 0x0357c3 (0x46ae bytes) 000012 1788623311.730585 mapread 0x0337e7 thru 0x0357c3 (0x1fdd bytes) truncating to largest ever: 0x3a576 000013 1788623311.731465 trunc from 0x0357c4 to 0x03a575 (0x4db2 bytes) 000014 1788623311.744377 mapread 0x035633 thru 0x039849 (0x4217 bytes) 000015 1788623311.752945 mapwrite 0x02d612 thru 0x02faaa (0x2499 bytes) 000016 1788623311.766554 mapread 0x007833 thru 0x00d2e7 (0x5ab5 bytes) 000018 1788623311.780258 trunc from 0x03a576 to 0x013121 (0x27454 bytes) 000019 1788623311.801641 trunc from 0x00d728 to 0x010d54 (0x362d bytes) 000020 1788623311.810556 mapread 0x00e998 thru 0x01002e (0x1697 bytes) 000021 1788623311.822182 trunc from 0x013122 to 0x025ce5 (0x12bc4 bytes) 000022 1788623311.845872 read 0x0093f4 thru 0x0162db (0xcee8 bytes) 000023 1788623311.860836 punch from 0x00a691 to 0x00f8e0 (0x5250 bytes) 000024 1788623311.864961 write 0x002bb4 thru 0x002f05 (0x352 bytes) 000025 1788623311.870098 MIRROR_RESYNC 2 mirrors 000026 1788623312.617651 write 0x03f242 thru 0x03ffff (0xdbe bytes) 000027 1788623312.675254 fallocate 0x0196ad thru 0x027161 (0xdab5 bytes) 000028 1788623312.682227 fallocate 0x02f87a thru 0x0379ab (0x8132 bytes) 000029 1788623312.694402 read 0x02cbf9 thru 0x02f665 (0x2a6d bytes) 000030 1788623312.713037 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) 000031 1788623312.940982 mapwrite 0x021671 thru 0x0249f9 (0x3389 bytes) 000032 1788623313.005485 write 0x007cf2 thru 0x00f553 (0x7862 bytes) 000033 1788623313.030831 trunc from 0x040000 to 0x02eb9a (0x11465 bytes) 000034 1788623313.064203 read 0x01828e thru 0x01a156 (0x1ec9 bytes) 000035 1788623313.074914 read 0x0039a4 thru 0x009ceb (0x6348 bytes) 000036 1788623313.090862 mapwrite 0x017eb3 thru 0x01cea2 (0x4ff0 bytes) 000037 1788623313.114285 trunc from 0x021703 to 0x02dac1 (0xc3bf bytes) 000039 1788623313.124301 mapwrite 0x012a65 thru 0x0131a9 (0x745 bytes) 000040 1788623313.139279 fallocate 0x01bd14 thru 0x02429f (0x858c bytes) 000041 1788623313.147178 read 0x021246 thru 0x029426 (0x81e1 bytes) 000042 1788623313.177034 fallocate 0x02b3a8 thru 0x03149e (0x60f7 bytes) 000043 1788623313.189163 mapread 0x00f248 thru 0x012af3 (0x38ac bytes) 000044 1788623313.199206 trunc from 0x02cf92 to 0x02eb9a (0x1c09 bytes) 000045 1788623313.221201 mapread 0x01782d thru 0x01fa81 (0x8255 bytes) 000046 1788623313.226205 fallocate 0x0031c2 thru 0x00468e (0x14cd bytes) 000047 1788623313.244282 mapwrite 0x026f85 thru 0x033d06 (0xcd82 bytes) 000048 1788623313.316254 mapwrite 0x01bbf2 thru 0x02a2e6 (0xe6f5 bytes) 000049 1788623313.361947 fallocate 0x01bb23 thru 0x01fe15 (0x42f3 bytes) 000050 1788623313.368965 punch from 0x01b8e2 to 0x026112 (0xa831 bytes) 000051 1788623313.379358 fallocate 0x03202e thru 0x0358fc (0x38cf bytes) 000053 1788623313.392668 mapwrite 0x03ce57 thru 0x03fe4b (0x2ff5 bytes) 000054 1788623313.472441 mapwrite 0x015024 thru 0x01de54 (0x8e31 bytes) 000055 1788623313.522625 trunc from 0x012772 to 0x01fa5b (0xd2ea bytes) 000056 1788623313.532273 punch from 0x00eb89 to 0x00ed2e (0x1a6 bytes) 000057 1788623313.544334 trunc from 0x0155ee to 0x01ae8d (0x58a0 bytes) 000058 1788623313.566133 mapwrite 0x023f8f thru 0x02c563 (0x85d5 bytes) 000060 1788623313.625232 write 0x014c4a thru 0x021e10 (0xd1c7 bytes) 000061 1788623313.643550 trunc from 0x00b7d8 to 0x01882b (0xd054 bytes) 000062 1788623313.657966 write 0x004f70 thru 0x00c132 (0x71c3 bytes) 000063 1788623313.665213 write 0x003cee thru 0x0066c0 (0x29d3 bytes) 000064 1788623313.666673 fallocate 0x024722 thru 0x02760e (0x2eed bytes) 000065 1788623313.671910 trunc from 0x03fe4c to 0x00ef63 (0x30ee8 bytes) 000067 1788623313.700161 fallocate 0x02a62e thru 0x0397db (0xf1ae bytes) 000068 1788623313.709570 mapread 0x00be22 thru 0x00ef63 (0x3142 bytes) 000069 1788623313.729670 trunc from 0x001b94 to 0x0079a6 (0x5e13 bytes) 000070 1788623313.760577 write 0x01712b thru 0x01e03f (0x6f15 bytes) 000072 1788623313.776203 read 0x0071b3 thru 0x008706 (0x1554 bytes) 000073 1788623313.796606 mapread 0x0090a0 thru 0x0097b5 (0x716 bytes) 000074 1788623313.799184 mapwrite 0x024cc5 thru 0x02cdfe (0x813a bytes) 000077 1788623313.871433 mapread 0x0080bc thru 0x012f34 (0xae79 bytes) 000080 1788623313.880509 trunc from 0x02cdff to 0x024e83 (0x7f7b bytes) 000081 1788623313.926620 mapwrite 0x037c80 thru 0x03e67a (0x69fb bytes) 000084 1788623313.993094 read 0x031636 thru 0x03d858 (0xc223 bytes) 000085 1788623313.996907 mapwrite 0x010a43 thru 0x01c9a7 (0xbf65 bytes) 000086 1788623314.045562 read 0x025080 thru 0x03428b (0xf20c bytes) 000087 1788623314.062857 fallocate 0x023702 thru 0x02a8bf (0x71be bytes) 000088 1788623314.070242 fallocate 0x031ce0 thru 0x03656c (0x488d bytes) 000089 1788623314.079686 mapread 0x017379 thru 0x017665 (0x2ed bytes) 000090 1788623314.085948 MIRROR_EXTEND to 2 mirrors 000091 1788623314.954657 MIRROR_EXTEND to 3 mirrors 000092 1788623315.705018 MIRROR_EXTEND to 4 mirrors 000093 1788623316.827391 mapread 0x03b6ec thru 0x03e67a (0x2f8f bytes) 000094 1788623316.842318 fallocate 0x01ab58 thru 0x02859b (0xda44 bytes) 000095 1788623316.866364 trunc from 0x03e67b to 0x0291c0 (0x154ba bytes) 000096 1788623316.899828 read 0x010fcf thru 0x019954 (0x8986 bytes) 000097 1788623316.913063 MIRROR_RESYNC 4 mirrors 000099 1788623318.474301 punch from 0x0131bd to 0x017d15 (0x4b59 bytes) 000100 1788623318.515418 mapread 0x0000f5 thru 0x0081ed (0x80f9 bytes) 000101 1788623318.543016 write 0x0173ff thru 0x027000 (0xfc02 bytes) 000102 1788623318.556016 trunc from 0x0291c1 to 0x022da7 (0x6419 bytes) 000103 1788623318.578285 trunc from 0x01988d to 0x022da7 (0x951b bytes) 000104 1788623318.598208 punch from 0x006d65 to 0x0106f1 (0x998d bytes) 000105 1788623318.604976 fallocate 0x01c980 thru 0x01ca97 (0x118 bytes) 000106 1788623318.613196 write 0x020f84 thru 0x0277a4 (0x6821 bytes) 000107 1788623318.626531 trunc from 0x02715d to 0x0277a4 (0x648 bytes) 000108 1788623318.643109 fallocate 0x010db2 thru 0x019449 (0x8698 bytes) 000109 1788623318.648640 mapwrite 0x037e1c thru 0x03c4e8 (0x46cd bytes) 000110 1788623318.715449 fallocate 0x00b206 thru 0x0111d6 (0x5fd1 bytes) 000112 1788623318.722521 punch from 0x00ab15 to 0x00cf66 (0x2452 bytes) 000113 1788623318.728354 mapwrite 0x01b8a3 thru 0x01d7e4 (0x1f42 bytes) 000115 1788623318.762115 read 0x03520e thru 0x03c4e8 (0x72db bytes) 000116 1788623318.763377 write 0x00b833 thru 0x00ce5a (0x1628 bytes) 000117 1788623318.775238 write 0x0221d5 thru 0x02ee60 (0xcc8c bytes) 000118 1788623318.783172 write 0x034460 thru 0x03dbd1 (0x9772 bytes) 000119 1788623318.791820 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dbd2): Mirror 2: 0x1ad98d07 (stale) Mirror 3: 0x1ad98d07 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dbd2): Mirror 2: 0x1ad98d07 (stale) Mirror 3: 0x1ad98d07 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dbd2: skipped 000120 1788623319.464792 mapwrite 0x03f311 thru 0x03ffff (0xcef bytes) 000122 1788623319.570157 write 0x0355ff thru 0x03ffff (0xaa01 bytes) 000123 1788623319.577806 trunc from 0x040000 to 0x00c7e0 (0x3381f bytes) 000124 1788623319.607008 mapwrite 0x01ec6c thru 0x02d05a (0xe3ef bytes) 000125 1788623319.745565 fallocate 0x019c6f thru 0x01a2f4 (0x686 bytes) 000126 1788623319.759131 trunc from 0x003188 to 0x004d42 (0x1bbb bytes) 000127 1788623319.766981 mapwrite 0x01a983 thru 0x01ba16 (0x1094 bytes) fallocating to largest ever: 0x40000 000128 1788623319.785518 fallocate 0x03e525 thru 0x03ffff (0x1adb bytes) 000129 1788623319.793902 trunc from 0x040000 to 0x0284ca (0x17b35 bytes) 000131 1788623319.822439 MIRROR_RESYNC 3 mirrors 000132 1788623321.109749 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) 000133 1788623321.592783 mapread 0x01fb60 thru 0x0284ca (0x896b bytes) 000134 1788623321.631763 trunc from 0x01208b to 0x01b095 (0x900b bytes) 000135 1788623321.690748 punch from 0x008f8c to 0x00b4c9 (0x253e bytes) 000136 1788623321.696013 punch from 0x00bbde to 0x00d852 (0x1c75 bytes) 000137 1788623321.701905 write 0x01c89f thru 0x022869 (0x5fcb bytes) 000138 1788623321.718426 fallocate 0x024a24 thru 0x033faa (0xf587 bytes) 000139 1788623321.725009 trunc from 0x0284cb to 0x01144f (0x1707b bytes) 000140 1788623321.763148 trunc from 0x011450 to 0x03ffc6 (0x2eb77 bytes) 000142 1788623321.805084 write 0x02009c thru 0x025ddf (0x5d44 bytes) 000143 1788623321.862129 MIRROR_RESYNC 2 mirrors 000144 1788623322.897028 write 0x011e2e thru 0x0141f8 (0x23cb bytes) 000145 1788623322.968388 trunc from 0x030b46 to 0x036bc6 (0x6081 bytes) 000146 1788623322.978362 read 0x02a640 thru 0x02ad09 (0x6ca bytes) 000147 1788623322.982648 mapread 0x01833a thru 0x025ef4 (0xdbbb bytes) 000148 1788623323.002195 trunc from 0x03ffc7 to 0x0381eb (0x7ddb bytes) 000149 1788623323.041400 read 0x000b31 thru 0x00e40a (0xd8da bytes) 000150 1788623323.108884 fallocate 0x0356e1 thru 0x036627 (0xf47 bytes) 000151 1788623323.134656 punch from 0x000f2c to 0x009e91 (0x8f66 bytes) 000152 1788623323.145648 trunc from 0x0381ec to 0x031ed7 (0x6314 bytes) 000153 1788623323.220655 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x31ed8): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31ed8): Mirror 3: 0xd61e950c (stale) CRC-32 checksum value for chunk [0, 0x31ed8): Mirror 1: 0xc35b8973 Mirror 4: 0xc35b8973 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31ed8: skipped 000154 1788623324.904981 fallocate 0x01d9c3 thru 0x01fbfc (0x223a bytes) 000155 1788623324.956118 write 0x03f113 thru 0x03ffff (0xeed bytes) 000156 1788623324.962961 trunc from 0x039d10 to 0x03ffff (0x62f0 bytes) 000157 1788623324.978014 write 0x00077d thru 0x0021dc (0x1a60 bytes) 000158 1788623324.988446 write 0x031255 thru 0x0339ab (0x2757 bytes) 000159 1788623324.997077 trunc from 0x040000 to 0x019a81 (0x2657e bytes) 000160 1788623325.019895 read 0x00ee14 thru 0x013be6 (0x4dd3 bytes) 000161 1788623325.031153 fallocate 0x022198 thru 0x02c727 (0xa590 bytes) 000162 1788623325.036635 write 0x016521 thru 0x01e2e7 (0x7dc7 bytes) 000163 1788623325.046938 punch from 0x024e4b to 0x02b3b5 (0x656b bytes) 000164 1788623325.052183 write 0x023017 thru 0x025e3c (0x2e26 bytes) 000165 1788623325.064973 trunc from 0x027dad to 0x02ae05 (0x3059 bytes) 000166 1788623325.074112 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c728): Mirror 3: 0x66c2d6f1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c728): Mirror 3: 0x66c2d6f1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c728: skipped 000168 1788623325.485382 trunc from 0x00f746 to 0x01c4ea (0xcda5 bytes) 000170 1788623325.507683 write 0x00c4f5 thru 0x01a492 (0xdf9e bytes) 000171 1788623325.549134 mapread 0x01ace0 thru 0x022947 (0x7c68 bytes) 000172 1788623325.604387 trunc from 0x017f92 to 0x023db3 (0xbe22 bytes) 000173 1788623325.644419 punch from 0x00fe49 to 0x01d981 (0xdb39 bytes) 000174 1788623325.656679 trunc from 0x01f7e6 to 0x027220 (0x7a3b bytes) 000175 1788623325.664286 read 0x00c535 thru 0x00dd7a (0x1846 bytes) 000177 1788623325.666390 mapread 0x01f498 thru 0x01f61f (0x188 bytes) 000178 1788623325.685352 punch from 0x0132ea to 0x02077f (0xd496 bytes) 000179 1788623325.693395 fallocate 0x00bc3b thru 0x0180ce (0xc494 bytes) 000180 1788623325.701871 mapread 0x003632 thru 0x00716f (0x3b3e bytes) 000181 1788623325.724644 mapread 0x01e3a0 thru 0x01efae (0xc0f bytes) 000182 1788623325.749084 trunc from 0x02c728 to 0x00ef3b (0x1d7ec bytes) 000183 1788623325.811562 punch from 0x0036d5 to 0x0090bc (0x59e8 bytes) 000184 1788623325.816379 mapread 0x007e6a thru 0x00ef3b (0x70d2 bytes) 000185 1788623325.827271 trunc from 0x00ef3c to 0x00fd5c (0xe21 bytes) 000186 1788623325.859180 trunc from 0x005dc9 to 0x009e5d (0x4095 bytes) 000187 1788623325.885328 punch from 0x00e5ea to 0x00fd5c (0x1773 bytes) 000188 1788623325.895474 read 0x003046 thru 0x00c073 (0x902e bytes) 000190 1788623325.907550 write 0x0205d9 thru 0x029b4b (0x9573 bytes) 000192 1788623325.915241 mapread 0x015b14 thru 0x020da4 (0xb291 bytes) 000193 1788623325.930187 trunc from 0x002d1e to 0x012b21 (0xfe04 bytes) 000194 1788623325.953178 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x29b4c): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29b4c): Mirror 3: 0x5e842618 (stale) CRC-32 checksum value for chunk [0, 0x29b4c): Mirror 1: 0x788c7bf1 Mirror 4: 0x788c7bf1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29b4c: skipped 000195 1788623327.430224 mapwrite 0x037a04 thru 0x03ffff (0x85fc bytes) 000196 1788623327.544033 mapwrite 0x00f416 thru 0x0179eb (0x85d6 bytes) 000197 1788623327.589298 mapwrite 0x004414 thru 0x011495 (0xd082 bytes) 000198 1788623327.648064 mapwrite 0x01123c thru 0x01ff6a (0xed2f bytes) 000199 1788623327.726623 trunc from 0x025f3b to 0x02b262 (0x5328 bytes) 000200 1788623327.754881 trunc from 0x040000 to 0x00aea4 (0x3515b bytes) 000202 1788623327.827530 write 0x03428a thru 0x03f900 (0xb677 bytes) 000203 1788623327.835538 punch from 0x034992 to 0x03d2eb (0x895a bytes) 000204 1788623327.876660 punch from 0x034ea5 to 0x0398c0 (0x4a1c bytes) 000205 1788623327.897503 trunc from 0x03f901 to 0x025c71 (0x19c8f bytes) 000206 1788623327.945511 fallocate 0x003f61 thru 0x00ccd5 (0x8d75 bytes) 000207 1788623327.962528 mapwrite 0x0131f7 thru 0x018d16 (0x5b20 bytes) 000208 1788623328.025141 fallocate 0x01850c thru 0x0191bb (0xcb0 bytes) 000209 1788623328.030252 mapwrite 0x00462b thru 0x0109de (0xc3b4 bytes) 000211 1788623328.063514 trunc from 0x025c72 to 0x010951 (0x15320 bytes) 000212 1788623328.088067 mapwrite 0x00d00a thru 0x01582a (0x8821 bytes) 000213 1788623328.175265 mapwrite 0x039b06 thru 0x03aeb7 (0x13b2 bytes) 000214 1788623328.251551 trunc from 0x03aeb8 to 0x0382fc (0x2bbb bytes) 000215 1788623328.314746 MIRROR_RESYNC 3 mirrors 000216 1788623329.342596 mapwrite 0x019f66 thru 0x01fdd6 (0x5e71 bytes) 000217 1788623329.546754 trunc from 0x01a2d8 to 0x0200c6 (0x5def bytes) 000218 1788623329.566984 punch from 0x01a8e5 to 0x02429d (0x99b9 bytes) 000219 1788623329.588735 punch from 0x02ca84 to 0x0344a0 (0x7a1d bytes) 000220 1788623329.616873 MIRROR_RESYNC 3 mirrors 000221 1788623331.363473 MIRROR_EXTEND to 4 mirrors 000222 1788623332.494398 MIRROR_EXTEND to 5 mirrors 000223 1788623333.187197 mapread 0x00e94c thru 0x0113ca (0x2a7f bytes) 000224 1788623333.252813 trunc from 0x0228e8 to 0x024736 (0x1e4f bytes) 000225 1788623333.307017 read 0x02938e thru 0x031f43 (0x8bb6 bytes) 000226 1788623333.328517 mapwrite 0x0202bd thru 0x02d150 (0xce94 bytes) 000227 1788623333.369341 trunc from 0x0382fd to 0x00cd29 (0x2b5d3 bytes) 000228 1788623333.405181 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xcd2a): Mirror 3: 0x7884fb16 (stale) Mirror 4: 0x7884fb16 (stale) Mirror 5: 0x7884fb16 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xcd2a): Mirror 3: 0x7884fb16 (stale) Mirror 4: 0x7884fb16 (stale) Mirror 5: 0x7884fb16 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xcd2a: skipped 000229 1788623333.771891 trunc from 0x00b9e1 to 0x00cd29 (0x1349 bytes) 000231 1788623333.780586 MIRROR_RESYNC 4 mirrors 000232 1788623334.867128 write 0x016f5e thru 0x022223 (0xb2c6 bytes) 000233 1788623334.945511 trunc from 0x022224 to 0x008a8f (0x19794 bytes) 000234 1788623334.976011 fallocate 0x00161e thru 0x002b56 (0x1539 bytes) 000235 1788623335.010364 write 0x0071dd thru 0x0138af (0xc6d3 bytes) 000236 1788623335.023503 mapread 0x009adc thru 0x0107dd (0x6d02 bytes) 000237 1788623335.025288 read 0x0077a3 thru 0x007b7d (0x3db bytes) 000238 1788623335.026142 trunc from 0x0138b0 to 0x023c0c (0x1035d bytes) 000239 1788623335.049040 punch from 0x01de1b to 0x023c0c (0x5df2 bytes) 000240 1788623335.069945 read 0x0231d8 thru 0x023c0c (0xa35 bytes) 000241 1788623335.106987 write 0x009a91 thru 0x016e95 (0xd405 bytes) 000242 1788623335.123439 MIRROR_RESYNC 4 mirrors 000243 1788623336.284202 fallocate 0x006903 thru 0x010c8b (0xa389 bytes) 000244 1788623336.337432 mapwrite 0x00c058 thru 0x00d21a (0x11c3 bytes) 000245 1788623336.363597 mapread 0x01afba thru 0x01b6cc (0x713 bytes) 000246 1788623336.408202 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x23c0d): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23c0d): Mirror 3: 0xe9c692d6 (stale) Mirror 4: 0xe9c692d6 (stale) Mirror 5: 0xe9c692d6 (stale) CRC-32 checksum value for chunk [0, 0x23c0d): Mirror 1: 0xf4598dbd Mirror 6: 0xf4598dbd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23c0d: skipped 000247 1788623337.644805 trunc from 0x023c0d to 0x00e6ab (0x15561 bytes) 000248 1788623337.703801 fallocate 0x03b17b thru 0x03b439 (0x2bf bytes) 000249 1788623337.709210 punch from 0x003e17 to 0x00e6ab (0xa895 bytes) 000250 1788623337.714440 mapread 0x00bb7d thru 0x00e6ab (0x2b2f bytes) 000251 1788623337.731253 fallocate 0x039995 thru 0x03cf39 (0x35a5 bytes) 000252 1788623337.735880 mapwrite 0x03ed46 thru 0x03ffff (0x12ba bytes) 000253 1788623337.774815 trunc from 0x040000 to 0x02cc1e (0x133e1 bytes) 000254 1788623337.792688 trunc from 0x01cf81 to 0x027d65 (0xade5 bytes) 000255 1788623337.798317 trunc from 0x02cc1f to 0x02053b (0xc6e3 bytes) 000256 1788623337.815026 write 0x0215a9 thru 0x02e8cf (0xd327 bytes) 000257 1788623337.817913 punch from 0x01a66a to 0x024bd0 (0xa567 bytes) 000258 1788623337.834555 mapread 0x02890b thru 0x02a2f4 (0x19ea bytes) 000259 1788623337.835896 read 0x008089 thru 0x017e72 (0xfdea bytes) 000260 1788623337.847856 fallocate 0x018f37 thru 0x01d593 (0x465d bytes) 000261 1788623337.853807 trunc from 0x00d414 to 0x013ea0 (0x6a8d bytes) 000262 1788623337.866328 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2e8d0): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e8d0): Mirror 3: 0xd1a6dd4d (stale) Mirror 4: 0xd1a6dd4d (stale) Mirror 5: 0xd1a6dd4d (stale) Mirror 6: 0x705566bd (stale) CRC-32 checksum value for chunk [0, 0x2e8d0): Mirror 1: 0x5c6e952d Mirror 7: 0x5c6e952d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e8d0: skipped 000263 1788623339.341612 mapwrite 0x010203 thru 0x020145 (0xff43 bytes) 000264 1788623339.531495 trunc from 0x02e8d0 to 0x014c1a (0x19cb5 bytes) 000265 1788623339.586517 write 0x02f427 thru 0x03832b (0x8f05 bytes) 000266 1788623339.590524 trunc from 0x0329ba to 0x033ef2 (0x1539 bytes) 000267 1788623339.620586 mapread 0x03595f thru 0x03832b (0x29cd bytes) 000268 1788623339.622825 mapwrite 0x020f98 thru 0x02da76 (0xcadf bytes) 000269 1788623339.708798 read 0x000929 thru 0x00c1ff (0xb8d7 bytes) 000270 1788623339.728211 mapwrite 0x01d4f2 thru 0x02750d (0xa01c bytes) 000271 1788623339.750497 mapread 0x01e75a thru 0x02d0c5 (0xe96c bytes) 000272 1788623339.751476 trunc from 0x03832c to 0x006e93 (0x31498 bytes) 000273 1788623339.769674 read 0x000e76 thru 0x006e93 (0x601e bytes) 000274 1788623339.770284 trunc from 0x002251 to 0x006e93 (0x4c43 bytes) 000275 1788623339.783294 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x6e94): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6e94): Mirror 3: 0xbb963b9d (stale) Mirror 4: 0xbb963b9d (stale) Mirror 5: 0xbb963b9d (stale) Mirror 6: 0xbb963b9d (stale) Mirror 7: 0x4b09718f (stale) CRC-32 checksum value for chunk [0, 0x6e94): Mirror 1: 0x4b09718f Mirror 8: 0x4b09718f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6e94: skipped 000276 1788623340.694605 punch from 0x002084 to 0x006e93 (0x4e10 bytes) 000278 1788623340.762277 fallocate 0x035d7a thru 0x03ffff (0xa286 bytes) 000279 1788623340.769249 trunc from 0x040000 to 0x0338c9 (0xc736 bytes) 000280 1788623340.814395 MIRROR_RESYNC 7 mirrors 000281 1788623342.251205 MIRROR_EXTEND to 8 mirrors 000283 1788623343.155989 mapwrite 0x00f86c thru 0x01875b (0x8ef0 bytes) 000284 1788623343.363608 mapwrite 0x011e32 thru 0x01d625 (0xb7f4 bytes) 000285 1788623343.417950 mapwrite 0x019536 thru 0x01c978 (0x3443 bytes) 000286 1788623343.463056 punch from 0x0228f2 to 0x02d2d5 (0xa9e4 bytes) 000288 1788623343.483095 mapread 0x02e6c7 thru 0x0338c9 (0x5203 bytes) 000289 1788623343.510997 trunc from 0x00beda to 0x0153a4 (0x94cb bytes) 000291 1788623343.540209 mapread 0x032caa thru 0x0338c9 (0xc20 bytes) 000294 1788623343.560652 read 0x018e51 thru 0x01be48 (0x2ff8 bytes) 000295 1788623343.561483 punch from 0x0303f6 to 0x0338c9 (0x34d4 bytes) 000296 1788623343.594437 trunc from 0x0338ca to 0x034e34 (0x156b bytes) 000297 1788623343.637648 mapread 0x008760 thru 0x00af25 (0x27c6 bytes) 000298 1788623343.658493 mapread 0x029116 thru 0x031efc (0x8de7 bytes) 000299 1788623343.703487 mapwrite 0x00dda3 thru 0x00fbb9 (0x1e17 bytes) 000300 1788623343.744070 write 0x033bb9 thru 0x03d678 (0x9ac0 bytes) 000301 1788623343.754576 mapwrite 0x01d377 thru 0x020471 (0x30fb bytes) 000302 1788623343.802785 trunc from 0x03d679 to 0x038efd (0x477b bytes) 000303 1788623343.833392 mapwrite 0x03ad1b thru 0x03ffff (0x52e5 bytes) 000304 1788623343.933474 trunc from 0x040000 to 0x0031aa (0x3ce55 bytes) 000305 1788623343.977524 fallocate 0x016644 thru 0x019d97 (0x3754 bytes) 000306 1788623343.996301 mapread 0x0046fc thru 0x010390 (0xbc95 bytes) 000307 1788623344.014431 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19d98): Mirror 4: 0x981006b (stale) Mirror 5: 0x981006b (stale) Mirror 6: 0x981006b (stale) Mirror 7: 0x981006b (stale) Mirror 8: 0x981006b (stale) Mirror 9: 0x981006b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19d98): Mirror 4: 0x981006b (stale) Mirror 5: 0x981006b (stale) Mirror 6: 0x981006b (stale) Mirror 7: 0x981006b (stale) Mirror 8: 0x981006b (stale) Mirror 9: 0x981006b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19d98: skipped 000308 1788623344.545231 read 0x001a92 thru 0x00d486 (0xb9f5 bytes) 000310 1788623344.559588 read 0x001a60 thru 0x00a074 (0x8615 bytes) 000311 1788623344.564136 trunc from 0x019d98 to 0x030b24 (0x16d8d bytes) 000312 1788623344.582523 read 0x023c1d thru 0x02764a (0x3a2e bytes) 000313 1788623344.592023 trunc from 0x030b25 to 0x032851 (0x1d2d bytes) 000314 1788623344.604612 read 0x00d396 thru 0x00ef4c (0x1bb7 bytes) 000315 1788623344.605316 trunc from 0x032852 to 0x02e0b6 (0x479b bytes) 000316 1788623344.622236 write 0x02efab thru 0x0348bc (0x5912 bytes) 000317 1788623344.623638 mapwrite 0x0376e3 thru 0x03c5bc (0x4eda bytes) 000318 1788623344.665152 write 0x001655 thru 0x001687 (0x33 bytes) 000319 1788623344.666447 mapread 0x01eb13 thru 0x024d7c (0x626a bytes) 000320 1788623344.669269 punch from 0x035a14 to 0x03c5bc (0x6ba9 bytes) 000321 1788623344.674360 write 0x0313b4 thru 0x037a45 (0x6692 bytes) 000322 1788623344.684081 trunc from 0x039613 to 0x039caa (0x698 bytes) 000323 1788623344.689566 mapwrite 0x03c6fa thru 0x03ffff (0x3906 bytes) 000324 1788623344.726395 trunc from 0x040000 to 0x01d05f (0x22fa0 bytes) 000326 1788623344.748466 MIRROR_RESYNC 7 mirrors 000327 1788623345.659898 read 0x015b48 thru 0x01d05f (0x7518 bytes) 000328 1788623345.671097 mapwrite 0x0108b6 thru 0x020824 (0xff6f bytes) 000329 1788623345.812740 fallocate 0x007e09 thru 0x008aba (0xcb2 bytes) 000330 1788623345.817432 fallocate 0x02b6f8 thru 0x030dc4 (0x56cd bytes) 000332 1788623345.832881 fallocate 0x006a06 thru 0x00e66e (0x7c69 bytes) 000333 1788623345.838977 mapwrite 0x02c488 thru 0x036d8f (0xa908 bytes) 000334 1788623345.902034 read 0x01d6b1 thru 0x02bc44 (0xe594 bytes) 000335 1788623345.911722 trunc from 0x005334 to 0x00fbbb (0xa888 bytes) 000336 1788623345.917480 trunc from 0x0299e0 to 0x02a534 (0xb55 bytes) 000337 1788623345.921729 mapread 0x00381c thru 0x0094d2 (0x5cb7 bytes) 000338 1788623345.945577 read 0x004562 thru 0x00bb98 (0x7637 bytes) 000339 1788623345.952463 punch from 0x00db56 to 0x0170f2 (0x959d bytes) 000340 1788623345.963408 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x36d90): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36d90): Mirror 4: 0xdb40f8b5 (stale) Mirror 5: 0xdb40f8b5 (stale) Mirror 6: 0xdb40f8b5 (stale) Mirror 7: 0xdb40f8b5 (stale) Mirror 8: 0xdb40f8b5 (stale) Mirror 9: 0xdb40f8b5 (stale) CRC-32 checksum value for chunk [0, 0x36d90): Mirror 1: 0x9650ddd3 Mirror 10: 0x9650ddd3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36d90: skipped 000341 1788623346.774164 mapread 0x030e4c thru 0x036d8f (0x5f44 bytes) 000342 1788623346.823154 trunc from 0x036d90 to 0x036b26 (0x269 bytes) 000343 1788623346.874575 write 0x02767c thru 0x02aff5 (0x397a bytes) 000344 1788623346.885273 mapwrite 0x02619c thru 0x0311a3 (0xb008 bytes) 000345 1788623346.916018 read 0x0259d6 thru 0x029a1b (0x4046 bytes) 000346 1788623346.916553 trunc from 0x02a3a2 to 0x033e5c (0x9abb bytes) 000347 1788623346.929919 MIRROR_RESYNC 8 mirrors 000348 1788623348.339939 mapread 0x00c6bc thru 0x01c5e0 (0xff25 bytes) 000350 1788623348.360595 punch from 0x01ea36 to 0x02c8a2 (0xde6d bytes) 000351 1788623348.386536 trunc from 0x00da73 to 0x019ffa (0xc588 bytes) 000353 1788623348.391397 trunc from 0x036b27 to 0x0293bb (0xd76b bytes) 000354 1788623348.401648 fallocate 0x003f5f thru 0x0054b8 (0x155a bytes) 000355 1788623348.404915 trunc from 0x0293bc to 0x02c837 (0x347c bytes) 000356 1788623348.415909 trunc from 0x025c1d to 0x02b527 (0x590b bytes) 000357 1788623348.419862 trunc from 0x02c838 to 0x01b1e8 (0x1164f bytes) 000358 1788623348.435190 punch from 0x011e37 to 0x019a4e (0x7c18 bytes) 000359 1788623348.440773 punch from 0x00a068 to 0x011520 (0x74b9 bytes) 000360 1788623348.445913 trunc from 0x017922 to 0x017aaf (0x18e bytes) 000361 1788623348.451114 punch from 0x019ea3 to 0x01b1e8 (0x1346 bytes) 000362 1788623348.455513 read 0x019a4f thru 0x01b1e8 (0x179a bytes) 000363 1788623348.459288 read 0x00ce19 thru 0x019348 (0xc530 bytes) 000364 1788623348.466955 mapwrite 0x0333e3 thru 0x03d4e1 (0xa0ff bytes) 000365 1788623348.521904 write 0x021c30 thru 0x02fa8d (0xde5e bytes) 000366 1788623348.538573 trunc from 0x036cd9 to 0x037924 (0xc4c bytes) 000367 1788623348.547368 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d4e2): Mirror 4: 0x8dc79cd8 (stale) Mirror 5: 0x8dc79cd8 (stale) Mirror 6: 0x8dc79cd8 (stale) Mirror 7: 0x8dc79cd8 (stale) Mirror 8: 0x8dc79cd8 (stale) Mirror 10: 0x8dc79cd8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d4e2): Mirror 4: 0x8dc79cd8 (stale) Mirror 5: 0x8dc79cd8 (stale) Mirror 6: 0x8dc79cd8 (stale) Mirror 7: 0x8dc79cd8 (stale) Mirror 8: 0x8dc79cd8 (stale) Mirror 10: 0x8dc79cd8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d4e2: skipped 000369 1788623348.917281 read 0x022d2b thru 0x0243f9 (0x16cf bytes) 000370 1788623348.922681 trunc from 0x03d4e2 to 0x0162e8 (0x271f9 bytes) 000371 1788623348.935234 mapread 0x0043d1 thru 0x0083c1 (0x3ff1 bytes) 000372 1788623348.947465 read 0x006223 thru 0x01338d (0xd16b bytes) 000373 1788623348.953392 trunc from 0x0162e9 to 0x035a92 (0x1f7aa bytes) 000374 1788623348.964761 mapwrite 0x017dce thru 0x02093c (0x8b6f bytes) 000375 1788623348.983122 trunc from 0x00491d to 0x00567e (0xd62 bytes) 000376 1788623348.986257 trunc from 0x025f8b to 0x0344df (0xe555 bytes) 000377 1788623348.989503 mapread 0x030624 thru 0x035a92 (0x546f bytes) 000378 1788623349.009537 trunc from 0x00f1da to 0x012c95 (0x3abc bytes) 000379 1788623349.015399 mapread 0x02be52 thru 0x035a92 (0x9c41 bytes) 000380 1788623349.039826 fallocate 0x0289d9 thru 0x02f90a (0x6f32 bytes) 000381 1788623349.045080 trunc from 0x035a93 to 0x030ca6 (0x4dec bytes) 000382 1788623349.059426 trunc from 0x030ca7 to 0x005bb0 (0x2b0f6 bytes) 000383 1788623349.078135 trunc from 0x005bb1 to 0x0076c7 (0x1b17 bytes) 000384 1788623349.093234 mapwrite 0x02812e thru 0x02ffbb (0x7e8e bytes) 000385 1788623349.161572 mapread 0x00ccfe thru 0x019ac1 (0xcdc4 bytes) 000387 1788623349.218531 read 0x016adc thru 0x021936 (0xae5b bytes) 000388 1788623349.225020 trunc from 0x02ffbc to 0x012be1 (0x1d3da bytes) 000389 1788623349.235434 punch from 0x0012c0 to 0x00a348 (0x9089 bytes) 000390 1788623349.240919 punch from 0x002840 to 0x003c84 (0x1445 bytes) 000391 1788623349.245923 write 0x032843 thru 0x03b950 (0x910e bytes) 000393 1788623349.248895 fallocate 0x00e157 thru 0x01ab4c (0xc9f6 bytes) 000394 1788623349.254092 trunc from 0x03b951 to 0x00fdd1 (0x2bb7f bytes) 000395 1788623349.272970 fallocate 0x031143 thru 0x03fd24 (0xebe2 bytes) 000396 1788623349.279172 write 0x008e3b thru 0x00a2b5 (0x147b bytes) 000398 1788623349.294290 write 0x03cbb2 thru 0x03e983 (0x1dd2 bytes) 000399 1788623349.295619 read 0x02db49 thru 0x030f70 (0x3428 bytes) 000400 1788623349.325424 punch from 0x02851d to 0x032da1 (0xa885 bytes) 000401 1788623349.331152 write 0x03410d thru 0x03b449 (0x733d bytes) 000404 1788623349.340427 fallocate 0x02ccbe thru 0x034b4a (0x7e8d bytes) 000405 1788623349.350221 read 0x0113fd thru 0x01e73f (0xd343 bytes) 000407 1788623349.351798 trunc from 0x03fd25 to 0x00c659 (0x336cb bytes) 000408 1788623349.378458 read 0x00aa85 thru 0x00c659 (0x1bd5 bytes) 000409 1788623349.379233 mapread 0x00c166 thru 0x00c659 (0x4f4 bytes) 000410 1788623349.393482 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xc65a): Mirror 4: 0x267f49e8 (stale) Mirror 6: 0x267f49e8 (stale) Mirror 7: 0x267f49e8 (stale) Mirror 8: 0x267f49e8 (stale) Mirror 10: 0x267f49e8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc65a): Mirror 4: 0x267f49e8 (stale) Mirror 6: 0x267f49e8 (stale) Mirror 7: 0x267f49e8 (stale) Mirror 8: 0x267f49e8 (stale) Mirror 10: 0x267f49e8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc65a: skipped 000411 1788623349.876118 mapread 0x00008d thru 0x00ad88 (0xacfc bytes) 000412 1788623349.898350 read 0x00185a thru 0x00c659 (0xae00 bytes) 000413 1788623349.899730 fallocate 0x0021d6 thru 0x00dc74 (0xba9f bytes) 000415 1788623349.905811 mapread 0x00aae4 thru 0x00bed7 (0x13f4 bytes) 000416 1788623349.907404 punch from 0x00c3a3 to 0x00c659 (0x2b7 bytes) 000417 1788623349.912689 mapread 0x004de3 thru 0x005c0d (0xe2b bytes) 000418 1788623349.913829 read 0x00a132 thru 0x00c659 (0x2528 bytes) 000420 1788623349.919868 mapread 0x006a24 thru 0x00ae80 (0x445d bytes) 000421 1788623349.921149 trunc from 0x00c65a to 0x000c21 (0xba38 bytes) 000422 1788623349.946059 fallocate 0x024c3f thru 0x02e703 (0x9ac5 bytes) 000423 1788623349.965179 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e704): Mirror 4: 0x3b438831 (stale) Mirror 6: 0x3b438831 (stale) Mirror 7: 0x3b438831 (stale) Mirror 10: 0x3b438831 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e704): Mirror 4: 0x3b438831 (stale) Mirror 6: 0x3b438831 (stale) Mirror 7: 0x3b438831 (stale) Mirror 10: 0x3b438831 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e704: skipped 000424 1788623350.411293 mapread 0x0132d6 thru 0x021fbc (0xece7 bytes) 000425 1788623350.441614 trunc from 0x0144d9 to 0x0158e6 (0x140e bytes) 000426 1788623350.446654 mapwrite 0x021e98 thru 0x02aec9 (0x9032 bytes) 000427 1788623350.486065 read 0x01a52e thru 0x01e844 (0x4317 bytes) 000428 1788623350.486525 write 0x01921f thru 0x01b0be (0x1ea0 bytes) 000429 1788623350.499042 write 0x010fe0 thru 0x017020 (0x6041 bytes) 000430 1788623350.501485 fallocate 0x00605f thru 0x013dbd (0xdd5f bytes) 000431 1788623350.511421 punch from 0x01184d to 0x020516 (0xecca bytes) 000432 1788623350.565872 read 0x00a905 thru 0x00aafd (0x1f9 bytes) 000433 1788623350.580248 mapwrite 0x01c50f thru 0x01fd79 (0x386b bytes) 000434 1788623350.599647 mapread 0x024aa4 thru 0x02739f (0x28fc bytes) 000435 1788623350.601388 punch from 0x018a1f to 0x025177 (0xc759 bytes) 000436 1788623350.609915 trunc from 0x00539e to 0x006d67 (0x19ca bytes) 000437 1788623350.615253 mapread 0x0019e4 thru 0x008bd6 (0x71f3 bytes) 000438 1788623350.629274 fallocate 0x00cf56 thru 0x01b5d9 (0xe684 bytes) 000439 1788623350.635432 mapread 0x0027d8 thru 0x00a662 (0x7e8b bytes) 000441 1788623350.638430 mapwrite 0x004cc6 thru 0x00d956 (0x8c91 bytes) 000442 1788623350.676442 mapread 0x003a18 thru 0x003ec8 (0x4b1 bytes) 000443 1788623350.678559 write 0x01652b thru 0x01dafc (0x75d2 bytes) 000444 1788623350.685949 trunc from 0x015bdf to 0x022fee (0xd410 bytes) 000445 1788623350.719389 read 0x016c5a thru 0x02325c (0xc603 bytes) 000446 1788623350.739893 fallocate 0x02f3a4 thru 0x033ad1 (0x472e bytes) 000447 1788623350.746660 mapread 0x019f27 thru 0x01b030 (0x110a bytes) 000448 1788623350.750020 punch from 0x008bbf to 0x00c557 (0x3999 bytes) 000449 1788623350.757434 fallocate 0x010887 thru 0x0207ec (0xff66 bytes) 000450 1788623350.762565 mapread 0x02dc90 thru 0x02e703 (0xa74 bytes) 000451 1788623350.767364 MIRROR_RESYNC 5 mirrors 000452 1788623351.786578 trunc from 0x002ae2 to 0x00dbeb (0xb10a bytes) 000453 1788623351.810272 read 0x008355 thru 0x009e9f (0x1b4b bytes) 000454 1788623351.815957 mapread 0x02cfa3 thru 0x02e703 (0x1761 bytes) 000455 1788623351.834538 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e704): Mirror 6: 0xbec1767c (stale) Mirror 7: 0xbec1767c (stale) Mirror 10: 0xbec1767c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e704): Mirror 6: 0xbec1767c (stale) Mirror 7: 0xbec1767c (stale) Mirror 10: 0xbec1767c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e704: skipped 000456 1788623352.145225 write 0x008fd8 thru 0x00af20 (0x1f49 bytes) 000457 1788623352.157502 fallocate 0x024bcd thru 0x029763 (0x4b97 bytes) 000458 1788623352.166474 write 0x0087ea thru 0x00fab8 (0x72cf bytes) 000459 1788623352.175468 fallocate 0x02bb60 thru 0x038ce4 (0xd185 bytes) 000460 1788623352.185107 trunc from 0x038ce5 to 0x00c63b (0x2c6a9 bytes) 000461 1788623352.204396 mapwrite 0x03db12 thru 0x03f2fd (0x17ec bytes) 000462 1788623352.298238 MIRROR_RESYNC 4 mirrors 000463 1788623353.130195 trunc from 0x03f2fe to 0x03f536 (0x239 bytes) 000464 1788623353.196227 mapread 0x000e38 thru 0x00d5c9 (0xc792 bytes) 000465 1788623353.218878 trunc from 0x03f537 to 0x02e13d (0x113f9 bytes) 000467 1788623353.244943 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e13e): Mirror 7: 0x964dce64 (stale) Mirror 10: 0x964dce64 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e13e): Mirror 7: 0x964dce64 (stale) Mirror 10: 0x964dce64 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e13e: skipped 000468 1788623353.444056 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e13e): Mirror 10: 0x964dce64 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e13e): Mirror 10: 0x964dce64 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e13e: skipped 000469 1788623353.671800 write 0x03a077 thru 0x03ac72 (0xbfc bytes) 000470 1788623353.680739 trunc from 0x018c30 to 0x021e3b (0x920c bytes) 000471 1788623353.687073 read 0x0345d9 thru 0x039de3 (0x580b bytes) 000472 1788623353.697386 trunc from 0x027db9 to 0x034b24 (0xcd6c bytes) 000473 1788623353.704399 trunc from 0x03ac73 to 0x001449 (0x39829 bytes) 000475 1788623353.744220 mapread 0x000992 thru 0x001449 (0xab8 bytes) 000476 1788623353.763944 trunc from 0x00144a to 0x00461d (0x31d4 bytes) 000477 1788623353.782727 mapread 0x000690 thru 0x003646 (0x2fb7 bytes) 000478 1788623353.794614 read 0x002ea7 thru 0x00461d (0x1777 bytes) 000479 1788623353.795455 write 0x036aba thru 0x037860 (0xda7 bytes) 000480 1788623353.797213 write 0x028853 thru 0x02c2c2 (0x3a70 bytes) 000481 1788623353.806063 write 0x0083d4 thru 0x00d0d6 (0x4d03 bytes) 000482 1788623353.807408 write 0x022d2e thru 0x02fceb (0xcfbe bytes) 000483 1788623353.809788 punch from 0x034aa2 to 0x037860 (0x2dbf bytes) 000485 1788623353.829971 punch from 0x022f1c to 0x02e393 (0xb478 bytes) 000486 1788623353.836059 write 0x014fe2 thru 0x0244dd (0xf4fc bytes) 000487 1788623353.842612 mapwrite 0x008c4b thru 0x012aba (0x9e70 bytes) 000488 1788623353.859907 fallocate 0x01ecae thru 0x022c05 (0x3f58 bytes) 000489 1788623353.863690 fallocate 0x010344 thru 0x017257 (0x6f14 bytes) 000490 1788623353.867683 write 0x036ac7 thru 0x0381de (0x1718 bytes) 000491 1788623353.873059 mapread 0x012d56 thru 0x017d61 (0x500c bytes) 000492 1788623353.874060 write 0x0142b0 thru 0x02407c (0xfdcd bytes) 000493 1788623353.876047 punch from 0x018069 to 0x01b625 (0x35bd bytes) 000494 1788623353.891191 punch from 0x00524b to 0x005dd6 (0xb8c bytes) 000495 1788623353.896189 mapwrite 0x039db9 thru 0x03ffff (0x6247 bytes) 000496 1788623353.933619 write 0x0373b2 thru 0x03ffff (0x8c4e bytes) 000497 1788623353.935102 punch from 0x0000da to 0x006293 (0x61ba bytes) 000499 1788623353.941307 trunc from 0x028639 to 0x03682e (0xe1f6 bytes) 000500 1788623353.947440 write 0x021c54 thru 0x029c76 (0x8023 bytes) 000501 1788623353.956754 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x27ee339b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xfb482a1d Mirror 11: 0xfb482a1d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000502 1788623354.911819 read 0x0192e6 thru 0x019be1 (0x8fc bytes) 000503 1788623354.924165 trunc from 0x032de3 to 0x0399f3 (0x6c11 bytes) 000504 1788623354.982121 mapwrite 0x0093a1 thru 0x00c52d (0x318d bytes) 000505 1788623355.017972 punch from 0x012109 to 0x014819 (0x2711 bytes) 000506 1788623355.024240 trunc from 0x006d04 to 0x0104aa (0x97a7 bytes) 000507 1788623355.030913 trunc from 0x040000 to 0x038f6f (0x7090 bytes) 000508 1788623355.070312 write 0x025eae thru 0x02d075 (0x71c8 bytes) 000509 1788623355.083120 fallocate 0x03df82 thru 0x03e9c4 (0xa43 bytes) 000510 1788623355.089978 write 0x018069 thru 0x022124 (0xa0bc bytes) 000511 1788623355.101031 read 0x02423d thru 0x0304f6 (0xc2ba bytes) 000512 1788623355.112563 trunc from 0x031a6c to 0x032154 (0x6e9 bytes) 000513 1788623355.118127 mapread 0x01f975 thru 0x029c57 (0xa2e3 bytes) 000514 1788623355.119320 mapwrite 0x02749c thru 0x0287b7 (0x131c bytes) 000515 1788623355.139963 read 0x035661 thru 0x035d61 (0x701 bytes) 000516 1788623355.140813 punch from 0x01e1d4 to 0x02a54e (0xc37b bytes) 000517 1788623355.147747 punch from 0x0247f7 to 0x0315c5 (0xcdcf bytes) 000518 1788623355.156171 mapread 0x000016 thru 0x0063b4 (0x639f bytes) 000519 1788623355.158657 read 0x02f47b thru 0x03c0dc (0xcc62 bytes) 000521 1788623355.172992 write 0x01bd26 thru 0x01d9ea (0x1cc5 bytes) 000522 1788623355.174252 mapread 0x0311fc thru 0x0368ce (0x56d3 bytes) 000523 1788623355.176350 trunc from 0x035d6c to 0x03a9c2 (0x4c57 bytes) 000524 1788623355.182605 mapwrite 0x01196a thru 0x01e03f (0xc6d6 bytes) 000525 1788623355.218197 trunc from 0x01469a to 0x01586c (0x11d3 bytes) 000526 1788623355.234303 write 0x00ff9e thru 0x016f29 (0x6f8c bytes) 000527 1788623355.235737 mapread 0x000b84 thru 0x0043d2 (0x384f bytes) 000529 1788623355.244039 mapwrite 0x036e35 thru 0x03ffff (0x91cb bytes) 000530 1788623355.336223 MIRROR_RESYNC 3 mirrors 000531 1788623356.213201 mapwrite 0x0371fe thru 0x03ffff (0x8e02 bytes) 000532 1788623356.367142 mapwrite 0x01c8d4 thru 0x022b19 (0x6246 bytes) 000533 1788623356.432592 trunc from 0x035234 to 0x03ffff (0xadcc bytes) 000534 1788623356.441234 punch from 0x0365a8 to 0x03ffff (0x9a58 bytes) 000535 1788623356.448626 trunc from 0x040000 to 0x024d6f (0x1b290 bytes) 000536 1788623356.530841 mapread 0x01d4ed thru 0x024d6f (0x7883 bytes) 000537 1788623356.531936 mapread 0x00b8df thru 0x01943f (0xdb61 bytes) 000538 1788623356.549652 mapread 0x024b77 thru 0x024d6f (0x1f9 bytes) 000539 1788623356.556347 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x24d70): Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24d70): Mirror 10: 0x4ae45aa9 (stale) Mirror 11: 0x4ae45aa9 (stale) CRC-32 checksum value for chunk [0, 0x24d70): Mirror 1: 0x8b6a766e Mirror 12: 0x8b6a766e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24d70: skipped 000540 1788623357.384161 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x24d70): Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24d70): Mirror 10: 0x4ae45aa9 (stale) Mirror 11: 0x4ae45aa9 (stale) CRC-32 checksum value for chunk [0, 0x24d70): Mirror 1: 0x8b6a766e Mirror 12: 0x8b6a766e Mirror 13: 0x8b6a766e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24d70: skipped 000541 1788623358.221550 read 0x01c33e thru 0x024d6f (0x8a32 bytes) 000542 1788623358.243439 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x24d70): Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24d70): Mirror 10: 0x4ae45aa9 (stale) Mirror 11: 0x4ae45aa9 (stale) CRC-32 checksum value for chunk [0, 0x24d70): Mirror 1: 0x8b6a766e Mirror 12: 0x8b6a766e Mirror 13: 0x8b6a766e Mirror 14: 0x8b6a766e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24d70: skipped 000543 1788623359.196419 fallocate 0x0294ed thru 0x035806 (0xc31a bytes) 000544 1788623359.242922 mapwrite 0x0365de thru 0x03cdc3 (0x67e6 bytes) 000545 1788623359.304873 fallocate 0x005166 thru 0x014745 (0xf5e0 bytes) 000546 1788623359.308856 fallocate 0x02c059 thru 0x030440 (0x43e8 bytes) 000547 1788623359.315295 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cdc4): Mirror 11: 0xb49430ee (stale) Mirror 12: 0x5e4cae64 (stale) Mirror 13: 0x5e4cae64 (stale) Mirror 14: 0x5e4cae64 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cdc4): Mirror 11: 0xb49430ee (stale) Mirror 12: 0x5e4cae64 (stale) Mirror 13: 0x5e4cae64 (stale) Mirror 14: 0x5e4cae64 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cdc4: skipped 000548 1788623359.658343 trunc from 0x03cdc4 to 0x02d54f (0xf874 bytes) 000549 1788623359.687988 punch from 0x008795 to 0x016bc3 (0xe42f bytes) 000552 1788623359.705672 MIRROR_RESYNC 5 mirrors 000553 1788623360.936421 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) 000554 1788623361.328970 punch from 0x0117e3 to 0x01d498 (0xbcb6 bytes) 000555 1788623361.368725 trunc from 0x01f394 to 0x02469c (0x5309 bytes) 000557 1788623361.376844 read 0x01db03 thru 0x022d33 (0x5231 bytes) 000558 1788623361.391433 write 0x019b77 thru 0x026691 (0xcb1b bytes) 000559 1788623361.418576 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d550): Mirror 11: 0x106844f1 (stale) Mirror 13: 0x106844f1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d550): Mirror 11: 0x106844f1 (stale) Mirror 13: 0x106844f1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d550: skipped 000560 1788623361.797322 read 0x02ccad thru 0x02d54f (0x8a3 bytes) 000561 1788623361.801855 mapread 0x016d0f thru 0x01957c (0x286e bytes) 000562 1788623361.824876 mapwrite 0x001f0e thru 0x004d92 (0x2e85 bytes) 000563 1788623361.852001 write 0x00a30a thru 0x00c757 (0x244e bytes) 000564 1788623361.858898 punch from 0x0147ed to 0x01aad9 (0x62ed bytes) 000565 1788623361.864082 mapwrite 0x0308b6 thru 0x039c93 (0x93de bytes) 000566 1788623361.910364 trunc from 0x039c94 to 0x0203d5 (0x198be bytes) 000567 1788623361.925826 trunc from 0x01e075 to 0x0203d5 (0x2361 bytes) 000568 1788623361.939317 trunc from 0x01c29b to 0x0203d5 (0x413b bytes) 000569 1788623361.943512 write 0x02b43c thru 0x038495 (0xd05a bytes) 000570 1788623361.945368 punch from 0x02f791 to 0x0307ae (0x101e bytes) 000571 1788623361.955640 trunc from 0x023707 to 0x026f9a (0x3894 bytes) 000572 1788623361.959351 trunc from 0x0202ed to 0x02184f (0x1563 bytes) 000573 1788623361.962563 punch from 0x01a467 to 0x0294c8 (0xf062 bytes) 000574 1788623361.966497 trunc from 0x027cb6 to 0x02e54f (0x689a bytes) 000575 1788623361.970217 write 0x025a6c thru 0x0338d3 (0xde68 bytes) 000576 1788623361.976004 read 0x00598b thru 0x010b5d (0xb1d3 bytes) 000577 1788623361.982087 trunc from 0x038496 to 0x03e616 (0x6181 bytes) 000578 1788623361.994466 trunc from 0x017362 to 0x01b9c9 (0x4668 bytes) 000579 1788623362.000907 write 0x0129ab thru 0x01f6a9 (0xccff bytes) 000580 1788623362.002508 punch from 0x03b467 to 0x03e616 (0x31b0 bytes) 000581 1788623362.006686 write 0x03da5e thru 0x03ffff (0x25a2 bytes) 000582 1788623362.015136 read 0x021be9 thru 0x02c378 (0xa790 bytes) 000583 1788623362.016021 trunc from 0x040000 to 0x02b96f (0x14690 bytes) 000584 1788623362.030200 punch from 0x019ec0 to 0x01be62 (0x1fa3 bytes) 000585 1788623362.059676 fallocate 0x01d503 thru 0x0298af (0xc3ad bytes) 000586 1788623362.080539 trunc from 0x02b970 to 0x03e78b (0x12e1c bytes) 000587 1788623362.097425 fallocate 0x014ffd thru 0x01fd7a (0xad7e bytes) 000589 1788623362.110337 punch from 0x0189e1 to 0x01eafd (0x611d bytes) 000590 1788623362.120433 read 0x03ae4c thru 0x03e78b (0x3940 bytes) 000591 1788623362.137897 write 0x02c931 thru 0x02d5a0 (0xc70 bytes) 000592 1788623362.138997 punch from 0x020e13 to 0x027d6f (0x6f5d bytes) 000593 1788623362.150360 read 0x007e54 thru 0x00aaba (0x2c67 bytes) 000594 1788623362.160001 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3e78c): Mirror 11: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e78c): Mirror 11: 0xb4419307 (stale) Mirror 13: 0xb4419307 (stale) CRC-32 checksum value for chunk [0, 0x3e78c): Mirror 1: 0xbc3d1b3d Mirror 14: 0xbc3d1b3d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e78c: skipped 000596 1788623363.073071 trunc from 0x0380a1 to 0x03e78b (0x66eb bytes) 000598 1788623363.129377 punch from 0x001a51 to 0x00a3b7 (0x8967 bytes) 000599 1788623363.134791 write 0x0224a0 thru 0x02d698 (0xb1f9 bytes) 000600 1788623363.152309 fallocate 0x026a00 thru 0x0340b2 (0xd6b3 bytes) 000601 1788623363.157320 mapread 0x01ff1c thru 0x021ce2 (0x1dc7 bytes) 000602 1788623363.185679 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3e78c): Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e78c): Mirror 11: 0xb4419307 (stale) Mirror 13: 0xb4419307 (stale) Mirror 14: 0xbc3d1b3d (stale) CRC-32 checksum value for chunk [0, 0x3e78c): Mirror 1: 0xb2367420 Mirror 15: 0xb2367420 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e78c: skipped 000603 1788623364.205964 punch from 0x038687 to 0x03e78b (0x6105 bytes) 000604 1788623364.241557 mapread 0x00db24 thru 0x014247 (0x6724 bytes) 000605 1788623364.269606 write 0x003745 thru 0x006221 (0x2add bytes) 000606 1788623364.281807 trunc from 0x00eb02 to 0x01806f (0x956e bytes) 000607 1788623364.287754 mapread 0x00dfbf thru 0x015db1 (0x7df3 bytes) 000608 1788623364.297084 write 0x006782 thru 0x008f03 (0x2782 bytes) 000609 1788623364.303232 MIRROR_RESYNC 5 mirrors 000610 1788623366.058647 fallocate 0x03e6b2 thru 0x03f02b (0x97a bytes) 000611 1788623366.091396 mapread 0x007e30 thru 0x00c282 (0x4453 bytes) 000612 1788623366.108983 mapread 0x028ad6 thru 0x033821 (0xad4c bytes) 000613 1788623366.127046 trunc from 0x03c8bc to 0x03e78b (0x1ed0 bytes) 000614 1788623366.131489 fallocate 0x0052e9 thru 0x00a6af (0x53c7 bytes) 000615 1788623366.136283 mapwrite 0x03b039 thru 0x03ffff (0x4fc7 bytes) 000616 1788623366.177889 write 0x034d30 thru 0x03890f (0x3be0 bytes) 000617 1788623366.179607 trunc from 0x00ce50 to 0x00ced1 (0x82 bytes) 000618 1788623366.185164 mapread 0x01eae1 thru 0x023e01 (0x5321 bytes) 000619 1788623366.196450 punch from 0x001030 to 0x00e93f (0xd910 bytes) 000620 1788623366.202080 mapwrite 0x0320f4 thru 0x03a588 (0x8495 bytes) 000622 1788623366.221880 fallocate 0x008c7b thru 0x01859e (0xf924 bytes) 000623 1788623366.228947 trunc from 0x040000 to 0x000d70 (0x3f28f bytes) 000624 1788623366.249525 write 0x033256 thru 0x039d07 (0x6ab2 bytes) 000625 1788623366.251914 read 0x02d3c9 thru 0x035793 (0x83cb bytes) 000626 1788623366.259363 read 0x02a4f1 thru 0x0332b2 (0x8dc2 bytes) 000627 1788623366.266929 trunc from 0x039d08 to 0x0347a2 (0x5565 bytes) 000628 1788623366.277852 write 0x013965 thru 0x021435 (0xdad1 bytes) 000629 1788623366.279344 trunc from 0x0347a3 to 0x02851b (0xc287 bytes) 000630 1788623366.296782 punch from 0x0265ba to 0x02851b (0x1f62 bytes) 000631 1788623366.300871 trunc from 0x02851c to 0x015a2b (0x12af0 bytes) 000632 1788623366.324474 fallocate 0x02b385 thru 0x0379e4 (0xc660 bytes) 000633 1788623366.329899 trunc from 0x00ced7 to 0x00fe63 (0x2f8d bytes) 000635 1788623366.334606 punch from 0x0088a9 to 0x00f55b (0x6cb3 bytes) 000636 1788623366.338485 mapread 0x00c410 thru 0x00ed65 (0x2956 bytes) 000637 1788623366.359076 write 0x00b8cf thru 0x01a408 (0xeb3a bytes) 000638 1788623366.364347 fallocate 0x030548 thru 0x03a33f (0x9df8 bytes) 000639 1788623366.369217 read 0x014e98 thru 0x0157e4 (0x94d bytes) 000640 1788623366.369997 trunc from 0x006e61 to 0x00d98d (0x6b2d bytes) 000641 1788623366.389403 fallocate 0x0127e6 thru 0x01b25c (0x8a77 bytes) 000642 1788623366.395179 trunc from 0x01a409 to 0x0311bc (0x16db4 bytes) 000643 1788623366.412875 mapwrite 0x032116 thru 0x03a4f4 (0x83df bytes) 000644 1788623366.495158 trunc from 0x03a4f5 to 0x03623b (0x42b9 bytes) 000645 1788623366.518496 mapread 0x024154 thru 0x030036 (0xbee3 bytes) 000646 1788623366.527113 MIRROR_RESYNC 5 mirrors 000647 1788623367.534552 fallocate 0x008db9 thru 0x014a27 (0xbc6f bytes) 000648 1788623367.565684 fallocate 0x00db2b thru 0x01a282 (0xc758 bytes) 000649 1788623367.573415 trunc from 0x0107a5 to 0x016bb3 (0x640f bytes) 000650 1788623367.577996 trunc from 0x03623c to 0x01f2ff (0x16f3c bytes) 000651 1788623367.599003 mapread 0x00586a thru 0x010560 (0xacf7 bytes) 000652 1788623367.625050 trunc from 0x01f300 to 0x0230e9 (0x3dea bytes) 000653 1788623367.662285 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x230ea): Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x230ea): Mirror 11: 0x31a2e17f (stale) Mirror 13: 0x31a2e17f (stale) Mirror 14: 0x31a2e17f (stale) Mirror 15: 0x31a2e17f (stale) CRC-32 checksum value for chunk [0, 0x230ea): Mirror 1: 0x5e65c9e9 Mirror 16: 0x5e65c9e9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x230ea: skipped 000654 1788623368.933583 fallocate 0x0198aa thru 0x01f524 (0x5c7b bytes) 000655 1788623368.998530 trunc from 0x000bfa to 0x0038ad (0x2cb4 bytes) 000656 1788623369.010148 trunc from 0x01eef5 to 0x0230e9 (0x41f5 bytes) 000658 1788623369.023982 mapwrite 0x007c58 thru 0x0092dd (0x1686 bytes) 000659 1788623369.101350 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x230ea): Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x230ea): Mirror 11: 0x31a2e17f (stale) Mirror 13: 0x31a2e17f (stale) Mirror 14: 0x31a2e17f (stale) Mirror 15: 0x31a2e17f (stale) Mirror 16: 0x5e65c9e9 (stale) CRC-32 checksum value for chunk [0, 0x230ea): Mirror 1: 0x7bc73793 Mirror 17: 0x7bc73793 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x230ea: skipped 000660 1788623370.221961 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x230ea): Mirror 11: 0x31a2e17f (stale) Mirror 13: 0x31a2e17f (stale) Mirror 14: 0x31a2e17f (stale) Mirror 15: 0x31a2e17f (stale) Mirror 16: 0x5e65c9e9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x230ea): Mirror 11: 0x31a2e17f (stale) Mirror 13: 0x31a2e17f (stale) Mirror 14: 0x31a2e17f (stale) Mirror 15: 0x31a2e17f (stale) Mirror 16: 0x5e65c9e9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x230ea: skipped 000661 1788623370.740803 write 0x031634 thru 0x03ffff (0xe9cc bytes) 000663 1788623370.767276 fallocate 0x010e85 thru 0x018a7e (0x7bfa bytes) 000664 1788623370.773891 fallocate 0x00e4ea thru 0x00f538 (0x104f bytes) 000665 1788623370.784062 MIRROR_RESYNC 6 mirrors 000666 1788623372.413627 MIRROR_RESYNC 6 mirrors 000667 1788623373.069960 fallocate 0x0059ad thru 0x013c70 (0xe2c4 bytes) 000668 1788623373.145922 read 0x03d6e6 thru 0x03ffff (0x291a bytes) 000669 1788623373.155310 fallocate 0x0266a4 thru 0x02f971 (0x92ce bytes) 000670 1788623373.181564 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x101ffd81 (stale) Mirror 13: 0x101ffd81 (stale) Mirror 15: 0x101ffd81 (stale) Mirror 16: 0x101ffd81 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x101ffd81 (stale) Mirror 13: 0x101ffd81 (stale) Mirror 15: 0x101ffd81 (stale) Mirror 16: 0x101ffd81 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000671 1788623373.791252 trunc from 0x00956f to 0x017a0e (0xe4a0 bytes) 000672 1788623373.797298 mapread 0x03eac0 thru 0x03ffff (0x1540 bytes) 000673 1788623373.816081 punch from 0x03de5e to 0x03ffff (0x21a2 bytes) 000674 1788623373.825474 trunc from 0x012a08 to 0x01a66f (0x7c68 bytes) 000675 1788623373.834395 punch from 0x01040b to 0x019d02 (0x98f8 bytes) 000676 1788623373.851111 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x101ffd81 (stale) Mirror 13: 0x101ffd81 (stale) Mirror 16: 0x101ffd81 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x101ffd81 (stale) Mirror 13: 0x101ffd81 (stale) Mirror 16: 0x101ffd81 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000677 1788623374.170995 fallocate 0x025a81 thru 0x033125 (0xd6a5 bytes) 000678 1788623374.179503 mapread 0x03f018 thru 0x03ffff (0xfe8 bytes) 000679 1788623374.186741 fallocate 0x027cb8 thru 0x037662 (0xf9ab bytes) 000680 1788623374.191905 mapwrite 0x012a3b thru 0x0218e0 (0xeea6 bytes) 000681 1788623374.240603 mapread 0x000151 thru 0x00dced (0xdb9d bytes) 000682 1788623374.254657 punch from 0x012f5e to 0x01d159 (0xa1fc bytes) 000683 1788623374.261651 trunc from 0x040000 to 0x0301e4 (0xfe1b bytes) 000684 1788623374.286080 fallocate 0x00223e thru 0x003c04 (0x19c7 bytes) 000685 1788623374.295220 write 0x02058f thru 0x02bcee (0xb760 bytes) 000686 1788623374.301675 trunc from 0x0301e5 to 0x03f9c7 (0xf7e3 bytes) 000687 1788623374.316848 write 0x020f41 thru 0x02441a (0x34da bytes) 000688 1788623374.317981 read 0x006115 thru 0x00c8fa (0x67e6 bytes) 000690 1788623374.322299 mapread 0x016161 thru 0x01634d (0x1ed bytes) 000692 1788623374.332961 punch from 0x024b03 to 0x02e3fc (0x98fa bytes) 000693 1788623374.345544 fallocate 0x01d008 thru 0x02506a (0x8063 bytes) 000694 1788623374.351548 read 0x037791 thru 0x03f9c7 (0x8237 bytes) 000695 1788623374.364269 trunc from 0x03f9c8 to 0x024fb5 (0x1aa12 bytes) 000696 1788623374.382551 fallocate 0x009fc0 thru 0x00d537 (0x3578 bytes) 000697 1788623374.388326 punch from 0x01c031 to 0x01dae5 (0x1ab5 bytes) 000698 1788623374.393370 punch from 0x0128e1 to 0x017616 (0x4d36 bytes) 000700 1788623374.399311 fallocate 0x03b706 thru 0x03ffff (0x48fa bytes) 000701 1788623374.408258 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x24fb6): Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24fb6): Mirror 11: 0xfcfe6a5c (stale) Mirror 13: 0xfcfe6a5c (stale) Mirror 16: 0xfcfe6a5c (stale) CRC-32 checksum value for chunk [0, 0x24fb6): Mirror 1: 0x5c784180 Mirror 17: 0x5c784180 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24fb6: skipped 000702 1788623375.527372 punch from 0x010315 to 0x016fb0 (0x6c9c bytes) 000703 1788623375.622232 punch from 0x014631 to 0x01d5c7 (0x8f97 bytes) 000704 1788623375.634303 write 0x004bcc thru 0x006eb7 (0x22ec bytes) 000705 1788623375.657671 punch from 0x00ddf4 to 0x011f3e (0x414b bytes) 000706 1788623375.666390 read 0x00664a thru 0x00fa30 (0x93e7 bytes) 000707 1788623375.689423 fallocate 0x010073 thru 0x0144d6 (0x4464 bytes) 000708 1788623375.709538 write 0x019652 thru 0x01b5b7 (0x1f66 bytes) 000710 1788623375.722655 punch from 0x024995 to 0x024fb5 (0x621 bytes) 000711 1788623375.734089 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24fb6): Mirror 13: 0xfcfe6a5c (stale) Mirror 16: 0xfcfe6a5c (stale) Mirror 17: 0x5c784180 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24fb6): Mirror 13: 0xfcfe6a5c (stale) Mirror 16: 0xfcfe6a5c (stale) Mirror 17: 0x5c784180 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24fb6: skipped 000712 1788623376.191348 fallocate 0x02281d thru 0x027a34 (0x5218 bytes) 000713 1788623376.195127 mapread 0x02220a thru 0x024fb5 (0x2dac bytes) 000714 1788623376.214496 trunc from 0x024ab6 to 0x024fb5 (0x500 bytes) 000715 1788623376.224382 write 0x025d6f thru 0x0284e9 (0x277b bytes) 000716 1788623376.234173 mapwrite 0x00eda8 thru 0x0193a5 (0xa5fe bytes) 000717 1788623376.281803 read 0x00510d thru 0x00daa5 (0x8999 bytes) 000718 1788623376.287276 trunc from 0x009257 to 0x009522 (0x2cc bytes) 000719 1788623376.294418 read 0x0104d8 thru 0x01fed2 (0xf9fb bytes) 000720 1788623376.295467 write 0x00ff63 thru 0x011c7e (0x1d1c bytes) 000721 1788623376.297289 mapread 0x0081e5 thru 0x00e714 (0x6530 bytes) 000722 1788623376.306583 trunc from 0x00d47b to 0x00d592 (0x118 bytes) 000723 1788623376.312175 mapwrite 0x002157 thru 0x00f6aa (0xd554 bytes) 000724 1788623376.347171 read 0x0261b7 thru 0x0284e9 (0x2333 bytes) 000725 1788623376.347843 trunc from 0x018372 to 0x01f4ed (0x717c bytes) 000726 1788623376.353274 read 0x01e37d thru 0x01ebbe (0x842 bytes) 000727 1788623376.364390 punch from 0x012ac3 to 0x017a72 (0x4fb0 bytes) 000728 1788623376.370607 punch from 0x01cd5e to 0x02575a (0x89fd bytes) 000729 1788623376.377143 punch from 0x01d75b to 0x0284e9 (0xad8f bytes) 000730 1788623376.384233 punch from 0x001373 to 0x004131 (0x2dbf bytes) 000732 1788623376.391943 fallocate 0x03553c thru 0x03ffff (0xaac4 bytes) 000734 1788623376.402151 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x101ffd81 (stale) Mirror 16: 0x101ffd81 (stale) Mirror 17: 0x717976c2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9b2478d4 Mirror 18: 0x9b2478d4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000735 1788623377.271804 punch from 0x016355 to 0x019ddf (0x3a8b bytes) 000736 1788623377.309069 mapread 0x01952c thru 0x01f8c5 (0x639a bytes) 000737 1788623377.326591 fallocate 0x00167d thru 0x0056a0 (0x4024 bytes) 000738 1788623377.331387 write 0x03422c thru 0x03d726 (0x94fb bytes) 000739 1788623377.342720 fallocate 0x007f13 thru 0x00ecdf (0x6dcd bytes) 000740 1788623377.346935 fallocate 0x01caeb thru 0x01e007 (0x151d bytes) 000741 1788623377.351099 trunc from 0x007098 to 0x014bf3 (0xdb5c bytes) 000744 1788623377.357370 fallocate 0x0254fb thru 0x0337b6 (0xe2bc bytes) 000746 1788623377.362226 mapwrite 0x034713 thru 0x03f1e6 (0xaad4 bytes) 000748 1788623377.385159 trunc from 0x03142a to 0x03fa20 (0xe5f7 bytes) 000750 1788623377.390504 mapwrite 0x034ba1 thru 0x03aeb7 (0x6317 bytes) 000751 1788623377.417317 punch from 0x0214fa to 0x026d72 (0x5879 bytes) 000752 1788623377.421899 write 0x039cef thru 0x03f82f (0x5b41 bytes) 000753 1788623377.434354 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x101ffd81 (stale) Mirror 17: 0x717976c2 (stale) Mirror 18: 0x9b2478d4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x101ffd81 (stale) Mirror 17: 0x717976c2 (stale) Mirror 18: 0x9b2478d4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000754 1788623377.752057 trunc from 0x026349 to 0x033e76 (0xdb2e bytes) 000755 1788623377.758071 read 0x01347f thru 0x0187c4 (0x5346 bytes) 000756 1788623377.766733 write 0x030a33 thru 0x031e03 (0x13d1 bytes) 000757 1788623377.777907 mapwrite 0x033942 thru 0x03b3db (0x7a9a bytes) 000758 1788623377.798491 mapread 0x02eb6b thru 0x039613 (0xaaa9 bytes) 000759 1788623377.799286 write 0x00dcc8 thru 0x01400d (0x6346 bytes) 000760 1788623377.802503 fallocate 0x03f0cd thru 0x03faad (0x9e1 bytes) 000761 1788623377.805296 mapread 0x03a44f thru 0x03ffff (0x5bb1 bytes) 000762 1788623377.808475 read 0x02613f thru 0x02a112 (0x3fd4 bytes) 000763 1788623377.814154 mapread 0x02b371 thru 0x033516 (0x81a6 bytes) 000764 1788623377.816029 mapwrite 0x027431 thru 0x027909 (0x4d9 bytes) 000765 1788623377.828818 write 0x002ea5 thru 0x0065dd (0x3739 bytes) 000766 1788623377.830134 mapwrite 0x025923 thru 0x0278cc (0x1faa bytes) 000767 1788623377.852136 mapread 0x0341c1 thru 0x03ffff (0xbe3f bytes) 000768 1788623377.854384 trunc from 0x010678 to 0x01f6be (0xf047 bytes) 000769 1788623377.859790 read 0x0169e2 thru 0x0209b8 (0x9fd7 bytes) 000770 1788623377.872348 read 0x0037f4 thru 0x00442c (0xc39 bytes) 000771 1788623377.873863 trunc from 0x040000 to 0x01f00d (0x20ff2 bytes) 000772 1788623377.911236 read 0x00fcb0 thru 0x012149 (0x249a bytes) 000773 1788623377.911933 read 0x01735b thru 0x01f00d (0x7cb3 bytes) 000774 1788623377.912404 fallocate 0x00566c thru 0x00ed4f (0x96e4 bytes) 000775 1788623377.917030 trunc from 0x01f00e to 0x018e10 (0x61fd bytes) 000776 1788623377.931125 trunc from 0x018e11 to 0x02d3ea (0x145da bytes) 000777 1788623377.946733 write 0x02f622 thru 0x038bce (0x95ad bytes) 000779 1788623377.950348 trunc from 0x034489 to 0x038bce (0x4746 bytes) 000780 1788623377.962113 mapread 0x01bd59 thru 0x025311 (0x95b9 bytes) 000781 1788623377.972217 mapwrite 0x03cead thru 0x03ffff (0x3153 bytes) 000782 1788623378.006234 trunc from 0x039ff5 to 0x03f6f7 (0x5703 bytes) 000783 1788623378.011399 trunc from 0x040000 to 0x011ecf (0x2e130 bytes) 000784 1788623378.025689 read 0x0074f8 thru 0x011ecf (0xa9d8 bytes) 000785 1788623378.026967 punch from 0x00e726 to 0x011ecf (0x37aa bytes) 000786 1788623378.032128 mapread 0x003e13 thru 0x010cfe (0xceec bytes) 000787 1788623378.038817 trunc from 0x00829e to 0x011ecf (0x9c32 bytes) 000788 1788623378.043899 punch from 0x00c838 to 0x011ecf (0x5698 bytes) 000789 1788623378.047591 punch from 0x00d332 to 0x011ecf (0x4b9e bytes) 000790 1788623378.052104 trunc from 0x00416d to 0x0042cd (0x161 bytes) 000791 1788623378.056657 fallocate 0x0254ed thru 0x0261f6 (0xd0a bytes) 000792 1788623378.061289 trunc from 0x004cb1 to 0x00e2e1 (0x9631 bytes) 000793 1788623378.066202 fallocate 0x015876 thru 0x01f03b (0x97c6 bytes) 000794 1788623378.070421 write 0x01272a thru 0x020516 (0xdded bytes) 000795 1788623378.081288 read 0x00c5ea thru 0x0195da (0xcff1 bytes) 000796 1788623378.091305 fallocate 0x00f963 thru 0x01af37 (0xb5d5 bytes) 000797 1788623378.096069 trunc from 0x020517 to 0x03bea2 (0x1b98c bytes) 000798 1788623378.109727 mapwrite 0x027617 thru 0x02d293 (0x5c7d bytes) 000799 1788623378.133841 mapread 0x02e42b thru 0x03bea2 (0xda78 bytes) 000800 1788623378.135220 trunc from 0x03bea3 to 0x01816c (0x23d36 bytes) 000803 1788623378.152392 read 0x010c3c thru 0x014554 (0x3919 bytes) 000804 1788623378.153062 trunc from 0x005a4d to 0x00d5b0 (0x7b64 bytes) 000806 1788623378.162100 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1816d): Mirror 13: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1816d): Mirror 13: 0x7ed0c5 (stale) Mirror 17: 0xecc202c0 (stale) Mirror 18: 0xc01a54ad (stale) CRC-32 checksum value for chunk [0, 0x1816d): Mirror 1: 0x87786fdc Mirror 19: 0x87786fdc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1816d: skipped 000807 1788623378.804783 punch from 0x000f28 to 0x00cb95 (0xbc6e bytes) 000809 1788623378.844441 MIRROR_RESYNC 5 mirrors 000810 1788623379.931420 read 0x01192f thru 0x016f2f (0x5601 bytes) 000811 1788623379.987106 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) 000812 1788623380.443428 punch from 0x004910 to 0x011b06 (0xd1f7 bytes) 000813 1788623380.492433 mapread 0x00048e thru 0x000695 (0x208 bytes) 000814 1788623380.500376 punch from 0x006081 to 0x006df2 (0xd72 bytes) 000816 1788623380.506401 read 0x00d1dd thru 0x00e0f6 (0xf1a bytes) 000817 1788623380.512449 mapwrite 0x03f216 thru 0x03ffff (0xdea bytes) 000818 1788623380.554057 write 0x012a88 thru 0x01392d (0xea6 bytes) 000819 1788623380.563285 trunc from 0x040000 to 0x024ca6 (0x1b359 bytes) 000820 1788623380.580191 write 0x030613 thru 0x035104 (0x4af2 bytes) 000821 1788623380.582454 mapwrite 0x011edb thru 0x0218fa (0xfa20 bytes) 000822 1788623380.627101 trunc from 0x035105 to 0x02a1fa (0xaf0a bytes) 000823 1788623380.646119 punch from 0x00155e to 0x010433 (0xeed6 bytes) 000824 1788623380.651186 trunc from 0x0021c6 to 0x00717c (0x4fb7 bytes) 000826 1788623380.657380 mapwrite 0x013a67 thru 0x013a6a (0x4 bytes) 000827 1788623380.668155 mapwrite 0x039b8d thru 0x03b247 (0x16bb bytes) 000828 1788623380.700622 trunc from 0x03b248 to 0x002416 (0x38e31 bytes) 000829 1788623380.725763 trunc from 0x002417 to 0x0368b3 (0x3449d bytes) 000830 1788623380.741186 mapwrite 0x01b2fb thru 0x02127d (0x5f83 bytes) 000833 1788623380.767934 mapwrite 0x01babd thru 0x024e54 (0x9398 bytes) 000834 1788623380.792877 write 0x033f6f thru 0x03e014 (0xa0a6 bytes) 000835 1788623380.799355 fallocate 0x0335f7 thru 0x0399b9 (0x63c3 bytes) 000836 1788623380.804051 trunc from 0x03e015 to 0x012d81 (0x2b293 bytes) 000837 1788623380.820341 read 0x00cb3f thru 0x010638 (0x3afa bytes) 000838 1788623380.831875 fallocate 0x00e31f thru 0x01b246 (0xcf28 bytes) 000839 1788623380.839394 MIRROR_RESYNC 4 mirrors 000840 1788623381.631398 fallocate 0x0380cf thru 0x03ffff (0x7f31 bytes) 000841 1788623381.690551 punch from 0x00bf21 to 0x01a5e4 (0xe6c4 bytes) 000842 1788623381.699011 mapwrite 0x03caa0 thru 0x03ffff (0x3560 bytes) 000843 1788623381.836019 fallocate 0x00da6d thru 0x012940 (0x4ed4 bytes) 000844 1788623381.851151 read 0x0201ef thru 0x023da5 (0x3bb7 bytes) 000845 1788623381.866300 fallocate 0x01f0bf thru 0x02536d (0x62af bytes) 000846 1788623381.877217 write 0x0177b4 thru 0x019aca (0x2317 bytes) 000847 1788623381.890002 read 0x010e78 thru 0x011a4d (0xbd6 bytes) 000848 1788623381.918116 trunc from 0x040000 to 0x002901 (0x3d6fe bytes) 000849 1788623381.934948 write 0x01d157 thru 0x01d913 (0x7bd bytes) 000850 1788623381.936071 mapwrite 0x00b581 thru 0x00cc3e (0x16be bytes) 000851 1788623381.962475 read 0x001e87 thru 0x00a359 (0x84d3 bytes) 000852 1788623381.979914 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1d914): Mirror 17: 0xe2c7ab90 (stale) Mirror 19: 0xe2c7ab90 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d914): Mirror 17: 0xe2c7ab90 (stale) Mirror 19: 0xe2c7ab90 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d914: skipped 000853 1788623382.247385 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1d914): Mirror 17: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d914): Mirror 17: 0xe2c7ab90 (stale) Mirror 19: 0xe2c7ab90 (stale) CRC-32 checksum value for chunk [0, 0x1d914): Mirror 1: 0x8c27e48 Mirror 20: 0x8c27e48 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d914: skipped 000854 1788623382.980020 write 0x0053a8 thru 0x00922d (0x3e86 bytes) 000855 1788623383.039114 fallocate 0x00aae8 thru 0x00ac75 (0x18e bytes) 000856 1788623383.044645 punch from 0x005266 to 0x00540e (0x1a9 bytes) 000857 1788623383.057535 trunc from 0x01d914 to 0x0187b8 (0x515b bytes) 000858 1788623383.074333 trunc from 0x0187b9 to 0x02eeca (0x16712 bytes) 000859 1788623383.091279 trunc from 0x00df15 to 0x01c9e6 (0xead2 bytes) 000860 1788623383.097023 mapread 0x0257d7 thru 0x02eeca (0x96f4 bytes) 000861 1788623383.117377 punch from 0x008c77 to 0x0150bd (0xc447 bytes) 000862 1788623383.122990 mapwrite 0x025200 thru 0x02a16c (0x4f6d bytes) 000863 1788623383.145197 punch from 0x00c65d to 0x0102c8 (0x3c6c bytes) 000864 1788623383.151571 write 0x01b1fe thru 0x0282e9 (0xd0ec bytes) 000865 1788623383.159262 fallocate 0x0251f7 thru 0x026eb2 (0x1cbc bytes) 000867 1788623383.167148 trunc from 0x02eecb to 0x01d022 (0x11ea8 bytes) 000868 1788623383.183360 trunc from 0x01d023 to 0x0397ab (0x1c789 bytes) 000869 1788623383.204907 MIRROR_RESYNC 4 mirrors 000871 1788623384.493003 punch from 0x026e72 to 0x0276b1 (0x840 bytes) 000872 1788623384.528019 mapwrite 0x0125d6 thru 0x01910f (0x6b3a bytes) 000873 1788623384.565142 trunc from 0x0397ac to 0x01b0af (0x1e6fc bytes) 000874 1788623384.583175 mapwrite 0x032769 thru 0x0373aa (0x4c42 bytes) 000875 1788623384.624860 punch from 0x01f287 to 0x0229d3 (0x374d bytes) 000876 1788623384.630217 punch from 0x02953b to 0x029ae0 (0x5a6 bytes) 000877 1788623384.635293 punch from 0x017b96 to 0x027269 (0xf6d4 bytes) 000878 1788623384.640828 trunc from 0x0373ab to 0x013adf (0x238cb bytes) 000879 1788623384.661655 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x13ae0): Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13ae0): Mirror 17: 0x69581799 (stale) Mirror 19: 0x69581799 (stale) Mirror 20: 0x69581799 (stale) CRC-32 checksum value for chunk [0, 0x13ae0): Mirror 1: 0x8bcc9554 Mirror 21: 0x8bcc9554 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13ae0: skipped 000880 1788623385.552146 fallocate 0x00feda thru 0x01fad4 (0xfbfb bytes) 000881 1788623385.593669 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x13ae0): Mirror 17: 0x69581799 (stale) Mirror 20: 0x69581799 (stale) Mirror 21: 0x8bcc9554 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13ae0): Mirror 17: 0x69581799 (stale) Mirror 20: 0x69581799 (stale) Mirror 21: 0x8bcc9554 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13ae0: skipped 000882 1788623385.910327 write 0x01099c thru 0x01be65 (0xb4ca bytes) 000883 1788623385.923507 trunc from 0x01be66 to 0x00d35f (0xeb06 bytes) 000885 1788623385.937481 write 0x009983 thru 0x00dcca (0x4348 bytes) 000886 1788623385.949102 trunc from 0x00dccb to 0x024d6f (0x170a5 bytes) 000887 1788623385.966270 fallocate 0x01e108 thru 0x022dc1 (0x4cba bytes) 000888 1788623385.972642 write 0x009c62 thru 0x011590 (0x792f bytes) 000889 1788623385.979149 trunc from 0x013c5c to 0x01b933 (0x7cd8 bytes) 000890 1788623385.985854 write 0x03fa0c thru 0x03ffff (0x5f4 bytes) 000891 1788623385.991942 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0x225a2856 (stale) Mirror 20: 0x225a2856 (stale) Mirror 21: 0x500d6d45 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf3bd9f7a Mirror 22: 0xf3bd9f7a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000892 1788623386.843235 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0x225a2856 (stale) Mirror 20: 0x225a2856 (stale) Mirror 21: 0x500d6d45 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf3bd9f7a Mirror 22: 0xf3bd9f7a Mirror 23: 0xf3bd9f7a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000893 1788623387.914579 mapwrite 0x00cba0 thru 0x016f9f (0xa400 bytes) 000894 1788623388.071407 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0x225a2856 (stale) Mirror 20: 0x225a2856 (stale) Mirror 21: 0x500d6d45 (stale) Mirror 23: 0xf3bd9f7a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0x225a2856 (stale) Mirror 20: 0x225a2856 (stale) Mirror 21: 0x500d6d45 (stale) Mirror 23: 0xf3bd9f7a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000895 1788623388.548004 trunc from 0x03d476 to 0x03ffff (0x2b8a bytes) 000896 1788623388.558366 trunc from 0x040000 to 0x001761 (0x3e89e bytes) 000897 1788623388.581387 read 0x001471 thru 0x001761 (0x2f1 bytes) 000898 1788623388.586942 fallocate 0x00769d thru 0x00ce1a (0x577e bytes) 000899 1788623388.591261 mapread 0x000282 thru 0x001761 (0x14e0 bytes) 000900 1788623388.597692 mapwrite 0x036203 thru 0x03ac24 (0x4a22 bytes) 000901 1788623388.646958 MIRROR_RESYNC 5 mirrors 000902 1788623389.725987 read 0x018eec thru 0x0234ec (0xa601 bytes) 000903 1788623389.739612 trunc from 0x02c197 to 0x03a382 (0xe1ec bytes) 000904 1788623389.783270 write 0x002bf3 thru 0x00c14c (0x955a bytes) 000905 1788623389.798222 write 0x0241d9 thru 0x02c3dc (0x8204 bytes) 000906 1788623389.809831 read 0x017c13 thru 0x026afe (0xeeec bytes) 000907 1788623389.823560 trunc from 0x02e4d5 to 0x03408b (0x5bb7 bytes) 000908 1788623389.830027 trunc from 0x00e3ec to 0x01bc60 (0xd875 bytes) 000909 1788623389.835980 read 0x02ac3c thru 0x038a1c (0xdde1 bytes) 000910 1788623389.851793 fallocate 0x022d94 thru 0x02e043 (0xb2b0 bytes) 000911 1788623389.858363 punch from 0x000b1e to 0x008c58 (0x813b bytes) 000912 1788623389.876800 trunc from 0x03ac25 to 0x02a7e1 (0x10443 bytes) 000913 1788623389.902044 fallocate 0x028dc7 thru 0x02c84d (0x3a87 bytes) 000914 1788623389.912437 MIRROR_RESYNC 5 mirrors 000915 1788623391.117140 read 0x015a1b thru 0x020644 (0xac2a bytes) 000916 1788623391.135458 mapread 0x005415 thru 0x009470 (0x405c bytes) 000917 1788623391.175048 punch from 0x013863 to 0x015ce0 (0x247e bytes) 000918 1788623391.229880 fallocate 0x026936 thru 0x03109d (0xa768 bytes) 000920 1788623391.237942 read 0x00b77a thru 0x011ced (0x6574 bytes) 000921 1788623391.260933 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a7e2): Mirror 17: 0xcb5ce04 (stale) Mirror 20: 0xcb5ce04 (stale) Mirror 21: 0xcb5ce04 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a7e2): Mirror 17: 0xcb5ce04 (stale) Mirror 20: 0xcb5ce04 (stale) Mirror 21: 0xcb5ce04 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a7e2: skipped 000922 1788623391.638829 mapread 0x0074d5 thru 0x015096 (0xdbc2 bytes) 000923 1788623391.666292 write 0x01fc99 thru 0x02b8cf (0xbc37 bytes) 000924 1788623391.682034 punch from 0x0119b1 to 0x0120d1 (0x721 bytes) 000925 1788623391.691832 MIRROR_RESYNC 4 mirrors 000926 1788623392.804112 mapwrite 0x020320 thru 0x0204bd (0x19e bytes) 000927 1788623392.867868 punch from 0x024624 to 0x02b8cf (0x72ac bytes) 000928 1788623392.873249 read 0x011ff5 thru 0x016e94 (0x4ea0 bytes) 000929 1788623392.884520 mapread 0x01a0f1 thru 0x025bce (0xbade bytes) 000930 1788623392.911266 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2b8d0): Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b8d0): Mirror 17: 0x11066fad (stale) Mirror 20: 0x11066fad (stale) Mirror 21: 0x11066fad (stale) CRC-32 checksum value for chunk [0, 0x2b8d0): Mirror 1: 0xfda7526 Mirror 22: 0xfda7526 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b8d0: skipped 000931 1788623393.884476 write 0x02cc3d thru 0x02d6ae (0xa72 bytes) 000932 1788623393.924066 mapread 0x007383 thru 0x0123c8 (0xb046 bytes) 000933 1788623393.945332 fallocate 0x0380d0 thru 0x03ffff (0x7f30 bytes) 000934 1788623393.949031 read 0x026b25 thru 0x02a224 (0x3700 bytes) 000935 1788623393.954116 trunc from 0x03a4da to 0x03ffff (0x5b26 bytes) 000936 1788623393.959956 MIRROR_RESYNC 5 mirrors 000937 1788623395.475482 mapread 0x0349d7 thru 0x0393ab (0x49d5 bytes) 000938 1788623395.494124 MIRROR_EXTEND to 6 mirrors 000939 1788623396.374331 read 0x005304 thru 0x0108a3 (0xb5a0 bytes) 000940 1788623396.383330 read 0x034fd2 thru 0x03cd44 (0x7d73 bytes) 000941 1788623396.401759 fallocate 0x02f667 thru 0x02ffab (0x945 bytes) 000942 1788623396.446898 read 0x00d88b thru 0x0103ac (0x2b22 bytes) 000943 1788623396.460056 mapwrite 0x036791 thru 0x039cae (0x351e bytes) 000944 1788623396.476843 read 0x019fd4 thru 0x0249b4 (0xa9e1 bytes) 000945 1788623396.478374 fallocate 0x00d4e1 thru 0x0174d8 (0x9ff8 bytes) 000946 1788623396.483172 mapwrite 0x02dc41 thru 0x03b9d3 (0xdd93 bytes) 000947 1788623396.501988 mapwrite 0x00ba45 thru 0x019fb4 (0xe570 bytes) 000950 1788623396.528514 punch from 0x0050eb to 0x00bfaf (0x6ec5 bytes) 000951 1788623396.534359 fallocate 0x019a45 thru 0x020e19 (0x73d5 bytes) 000952 1788623396.540200 fallocate 0x033ae2 thru 0x039866 (0x5d85 bytes) 000953 1788623396.545272 punch from 0x0123df to 0x01f866 (0xd488 bytes) 000954 1788623396.552051 mapread 0x03cd1c thru 0x03ffff (0x32e4 bytes) 000955 1788623396.557022 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0x20f054fb (stale) Mirror 20: 0x20f054fb (stale) Mirror 21: 0x20f054fb (stale) Mirror 22: 0x20f054fb (stale) Mirror 23: 0x20f054fb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3fa1ee3a Mirror 24: 0x3fa1ee3a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000956 1788623397.488982 fallocate 0x03eaf0 thru 0x03ffff (0x1510 bytes) 000957 1788623397.533169 trunc from 0x040000 to 0x0171bf (0x28e40 bytes) 000958 1788623397.582010 trunc from 0x0171c0 to 0x00a418 (0xcda7 bytes) 000959 1788623397.596985 trunc from 0x00a419 to 0x007533 (0x2ee5 bytes) 000960 1788623397.610027 mapwrite 0x022f7f thru 0x030cc6 (0xdd48 bytes) 000961 1788623397.657043 mapread 0x008776 thru 0x009db1 (0x163c bytes) 000962 1788623397.664807 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1ed:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30cc7): Mirror 17: 0x9e2eebf8 (stale) Mirror 20: 0x9e2eebf8 (stale) Mirror 21: 0x9e2eebf8 (stale) Mirror 22: 0x9e2eebf8 (stale) Mirror 23: 0x9e2eebf8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30cc7): Mirror 17: 0x9e2eebf8 (stale) Mirror 20: 0x9e2eebf8 (stale) Mirror 21: 0x9e2eebf8 (stale) Mirror 22: 0x9e2eebf8 (stale) Mirror 23: 0x9e2eebf8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30cc7: skipped 000963 1788623398.032294 write 0x0023c6 thru 0x011396 (0xefd1 bytes) 000965 1788623398.051222 fallocate 0x0064f8 thru 0x007c9a (0x17a3 bytes) 000967 1788623398.056619 mapread 0x006480 thru 0x00b4ee (0x506f bytes) 000968 1788623398.059050 trunc from 0x030cc7 to 0x0226ea (0xe5dc bytes) 000969 1788623398.075101 mapwrite 0x025012 thru 0x0262c3 (0x12b2 bytes) 000970 1788623398.122461 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x262c4): Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x262c4): Mirror 17: 0x421a8e19 (stale) Mirror 20: 0x421a8e19 (stale) Mirror 21: 0x421a8e19 (stale) Mirror 22: 0x421a8e19 (stale) Mirror 23: 0x421a8e19 (stale) CRC-32 checksum value for chunk [0, 0x262c4): Mirror 1: 0xa51cc4ed Mirror 24: 0xa51cc4ed lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x262c4: skipped 000972 1788623398.947475 fallocate 0x030481 thru 0x03dd31 (0xd8b1 bytes) 000973 1788623398.989570 fallocate 0x01864c thru 0x025d7f (0xd734 bytes) 000975 1788623398.996540 trunc from 0x0262c4 to 0x03c990 (0x166cd bytes) 000977 1788623399.052060 read 0x032423 thru 0x03868b (0x6269 bytes) 000978 1788623399.061045 trunc from 0x03c991 to 0x0372df (0x56b1 bytes) 000980 1788623399.077555 trunc from 0x015153 to 0x019a1b (0x48c9 bytes) 000981 1788623399.083259 mapread 0x0307d5 thru 0x0372df (0x6b0b bytes) 000983 1788623399.093896 fallocate 0x031a98 thru 0x0375d8 (0x5b41 bytes) 000984 1788623399.098350 trunc from 0x02634b to 0x02ec75 (0x892b bytes) 000985 1788623399.103231 fallocate 0x03f366 thru 0x03ffff (0xc9a bytes) 000986 1788623399.107655 trunc from 0x0372e0 to 0x012d0a (0x245d5 bytes) 000987 1788623399.125009 fallocate 0x01029c thru 0x0159a8 (0x570d bytes) 000988 1788623399.131191 write 0x0094a8 thru 0x009b57 (0x6b0 bytes) 000989 1788623399.140628 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x159a9): Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x159a9): Mirror 17: 0x5cb6da3e (stale) Mirror 20: 0x5cb6da3e (stale) Mirror 21: 0x5cb6da3e (stale) Mirror 22: 0x5cb6da3e (stale) Mirror 23: 0x5cb6da3e (stale) Mirror 24: 0x90cac4f (stale) CRC-32 checksum value for chunk [0, 0x159a9): Mirror 1: 0xf92810fd Mirror 25: 0xf92810fd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x159a9: skipped 000990 1788623399.945054 read 0x0095b4 thru 0x0159a8 (0xc3f5 bytes) 000991 1788623399.960165 read 0x004332 thru 0x00fcfa (0xb9c9 bytes) 000992 1788623399.977997 write 0x03acae thru 0x03ffff (0x5352 bytes) 000993 1788623400.021276 punch from 0x02f92e to 0x038980 (0x9053 bytes) 000994 1788623400.026825 trunc from 0x011071 to 0x0145de (0x356e bytes) 000996 1788623400.032740 write 0x036ada thru 0x03cf02 (0x6429 bytes) 000997 1788623400.044754 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0x20f054fb (stale) Mirror 20: 0x20f054fb (stale) Mirror 21: 0x20f054fb (stale) Mirror 22: 0x20f054fb (stale) Mirror 23: 0x20f054fb (stale) Mirror 24: 0x57b33067 (stale) Mirror 25: 0xa68d53d1 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x21726e33 Mirror 26: 0x21726e33 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000998 1788623401.013944 read 0x003eb2 thru 0x00e968 (0xaab7 bytes) 000999 1788623401.030870 mapread 0x000014 thru 0x00abdd (0xabca bytes) 001000 1788623401.066642 mapread 0x01a2b0 thru 0x01f0c3 (0x4e14 bytes) All operations completed A-OK!