== sanity-flr test 70a: flr mode fsx test ================ 14:13:36 (1784225616) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 5618 skipping zero length punch hole skipping zero size read fallocating to largest ever: 0x35e3c 000003 1784225618.256912 fallocate 0x034992 thru 0x035e3b (0x14aa bytes) 000004 1784225618.264242 trunc from 0x0041d8 to 0x00e82a (0xa653 bytes) 000005 1784225618.268090 trunc from 0x035e3c to 0x00a402 (0x2ba39 bytes) 000006 1784225618.281832 mapwrite 0x00e966 thru 0x01de6c (0xf507 bytes) 000007 1784225618.363289 read 0x007f7a thru 0x00f1f8 (0x727f bytes) 000008 1784225618.369537 fallocate 0x01e02e thru 0x02126c (0x323f bytes) 000009 1784225618.376211 punch from 0x015f4a to 0x0182f8 (0x23af bytes) 000010 1784225618.380801 mapread 0x02102b thru 0x02126c (0x242 bytes) 000011 1784225618.389426 punch from 0x0061db to 0x01287f (0xc6a5 bytes) 000012 1784225618.403141 MIRROR_EXTEND to 2 mirrors 000013 1784225618.887358 write 0x01f534 thru 0x020791 (0x125e bytes) 000014 1784225618.920622 trunc from 0x02126d to 0x014ad1 (0xc79b bytes) 000015 1784225618.959253 write 0x007c0d thru 0x013dad (0xc1a1 bytes) 000016 1784225618.968269 mapread 0x0085ea thru 0x012a50 (0xa467 bytes) 000017 1784225618.969890 trunc from 0x00d538 to 0x00e19d (0xc66 bytes) 000018 1784225618.987657 read 0x00e5e2 thru 0x014ad1 (0x64f0 bytes) 000019 1784225618.995905 trunc from 0x014ad2 to 0x0233b7 (0xe8e6 bytes) 000020 1784225619.015235 fallocate 0x008d7c thru 0x0119e3 (0x8c68 bytes) 000021 1784225619.024604 write 0x005c19 thru 0x00b7af (0x5b97 bytes) 000022 1784225619.034900 mapwrite 0x015e58 thru 0x01798c (0x1b35 bytes) 000023 1784225619.075461 mapread 0x015131 thru 0x01f03b (0x9f0b bytes) 000024 1784225619.084745 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x233b8): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x233b8): Mirror 2: 0xbeb606b (stale) CRC-32 checksum value for chunk [0, 0x233b8): Mirror 1: 0x1aae8575 Mirror 3: 0x1aae8575 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x233b8: skipped 000025 1784225619.651933 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x233b8): Mirror 2: 0xbeb606b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x233b8): Mirror 2: 0xbeb606b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x233b8: skipped 000026 1784225619.893991 mapread 0x00a766 thru 0x014b0a (0xa3a5 bytes) 000027 1784225619.920339 read 0x00165e thru 0x00f3ea (0xdd8d bytes) 000028 1784225619.928590 mapread 0x006e02 thru 0x012bc4 (0xbdc3 bytes) 000029 1784225619.930328 mapread 0x007e3c thru 0x008773 (0x938 bytes) 000030 1784225619.931765 trunc from 0x0233b8 to 0x00cf0a (0x164ad bytes) 000032 1784225619.987392 mapwrite 0x0071c5 thru 0x011eea (0xad26 bytes) 000033 1784225620.038318 punch from 0x000aa0 to 0x00b867 (0xadc8 bytes) 000034 1784225620.047482 MIRROR_RESYNC 2 mirrors 000035 1784225620.430229 trunc from 0x011b80 to 0x011eea (0x36b bytes) 000036 1784225620.459489 mapwrite 0x038f69 thru 0x03fba0 (0x6c38 bytes) 000037 1784225620.514002 mapread 0x02e04d thru 0x03c3ae (0xe362 bytes) 000039 1784225620.524163 mapwrite 0x00b82d thru 0x010772 (0x4f46 bytes) 000040 1784225620.549223 write 0x0301ac thru 0x034504 (0x4359 bytes) 000042 1784225620.553038 read 0x022e26 thru 0x02d531 (0xa70c bytes) 000043 1784225620.563300 trunc from 0x03fba1 to 0x02e9fb (0x111a5 bytes) 000044 1784225620.577924 write 0x038e06 thru 0x03d33e (0x4539 bytes) 000045 1784225620.581952 read 0x00b7d1 thru 0x013fa4 (0x87d4 bytes) 000046 1784225620.583371 read 0x014e07 thru 0x022649 (0xd843 bytes) 000047 1784225620.594825 mapread 0x0254b2 thru 0x02f30d (0x9e5c bytes) 000048 1784225620.595998 mapwrite 0x013fd5 thru 0x014e2a (0xe56 bytes) 000049 1784225620.611495 punch from 0x00d911 to 0x01ac6e (0xd35e bytes) 000050 1784225620.619131 read 0x037b12 thru 0x03d33e (0x582d bytes) 000051 1784225620.620001 read 0x028c03 thru 0x035d65 (0xd163 bytes) 000052 1784225620.621711 write 0x01e034 thru 0x024cb3 (0x6c80 bytes) 000053 1784225620.624324 fallocate 0x01def2 thru 0x02a0d5 (0xc1e4 bytes) 000054 1784225620.634898 read 0x02a0c9 thru 0x02cb1a (0x2a52 bytes) 000055 1784225620.635621 write 0x03488a thru 0x038a1f (0x4196 bytes) 000056 1784225620.642985 MIRROR_RESYNC 2 mirrors 000057 1784225621.082928 MIRROR_EXTEND to 3 mirrors 000058 1784225621.532452 write 0x017fac thru 0x01a3af (0x2404 bytes) 000059 1784225621.561798 mapwrite 0x02b420 thru 0x02dbcd (0x27ae bytes) 000060 1784225621.591423 mapread 0x01b226 thru 0x021708 (0x64e3 bytes) 000061 1784225621.600418 fallocate 0x013aa7 thru 0x020f6e (0xd4c8 bytes) 000062 1784225621.604887 mapread 0x02a1bc thru 0x02ac87 (0xacc bytes) 000063 1784225621.605919 trunc from 0x03d33f to 0x008f03 (0x3443b bytes) 000064 1784225621.643968 punch from 0x0043f2 to 0x008f03 (0x4b12 bytes) fallocating to largest ever: 0x3e180 000066 1784225621.650708 fallocate 0x0304e5 thru 0x03e17f (0xdc9b bytes) 000067 1784225621.657247 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3e180): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e180): Mirror 2: 0x24e05ce8 (stale) Mirror 3: 0x24e05ce8 (stale) CRC-32 checksum value for chunk [0, 0x3e180): Mirror 1: 0xa384f23b Mirror 4: 0xa384f23b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e180: skipped 000070 1784225622.187785 mapwrite 0x00096f thru 0x007f9b (0x762d bytes) 000071 1784225622.292213 trunc from 0x03e180 to 0x036efb (0x7284 bytes) 000072 1784225622.312963 punch from 0x01a942 to 0x025b2d (0xb1ec bytes) 000073 1784225622.318279 punch from 0x021908 to 0x02ee4d (0xd546 bytes) 000074 1784225622.321524 mapwrite 0x00eab6 thru 0x011120 (0x266b bytes) 000075 1784225622.343163 mapwrite 0x0288fb thru 0x0335a5 (0xacab bytes) 000076 1784225622.375879 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x36efc): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36efc): Mirror 2: 0x4ae75f3b (stale) Mirror 3: 0x4ae75f3b (stale) Mirror 4: 0x4b856a75 (stale) CRC-32 checksum value for chunk [0, 0x36efc): Mirror 1: 0xce00e7db Mirror 5: 0xce00e7db lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36efc: skipped 000077 1784225622.994372 fallocate 0x0340a7 thru 0x03aed2 (0x6e2c bytes) 000078 1784225623.020798 mapwrite 0x00d878 thru 0x01bc2f (0xe3b8 bytes) 000079 1784225623.056365 trunc from 0x037807 to 0x03aed2 (0x36cc bytes) 000080 1784225623.060412 punch from 0x02e7a4 to 0x039555 (0xadb2 bytes) 000081 1784225623.068266 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3aed3): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aed3): Mirror 2: 0x8f9de6b7 (stale) Mirror 3: 0x8f9de6b7 (stale) Mirror 4: 0xac9c5c2a (stale) Mirror 5: 0xba4a814e (stale) CRC-32 checksum value for chunk [0, 0x3aed3): Mirror 1: 0x73d4e1a8 Mirror 6: 0x73d4e1a8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aed3: skipped 000082 1784225623.800021 trunc from 0x00aab9 to 0x011818 (0x6d60 bytes) 000083 1784225623.832668 punch from 0x03714b to 0x03aed2 (0x3d88 bytes) 000084 1784225623.838220 punch from 0x030256 to 0x038e9f (0x8c4a bytes) 000085 1784225623.844824 trunc from 0x03aed3 to 0x01f266 (0x1bc6c bytes) 000086 1784225623.890360 trunc from 0x00158f to 0x001cc3 (0x735 bytes) 000087 1784225623.894390 mapread 0x001a9f thru 0x00ec62 (0xd1c4 bytes) 000088 1784225623.915532 mapread 0x00bc8c thru 0x019eb4 (0xe229 bytes) 000089 1784225623.925311 mapread 0x001061 thru 0x00c043 (0xafe3 bytes) 000090 1784225623.927360 mapwrite 0x03f9af thru 0x03ffff (0x651 bytes) 000091 1784225623.978198 punch from 0x016de3 to 0x0198c8 (0x2ae6 bytes) 000092 1784225623.982874 fallocate 0x0032bd thru 0x008729 (0x546d bytes) truncating to largest ever: 0x3f443 000093 1784225623.987372 trunc from 0x040000 to 0x03f442 (0xbbd bytes) 000094 1784225623.997644 mapread 0x01b360 thru 0x01bb3f (0x7e0 bytes) 000095 1784225624.009125 mapwrite 0x016c2e thru 0x01af02 (0x42d5 bytes) 000096 1784225624.028425 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f443): Mirror 2: 0xc41a4c1b (stale) Mirror 3: 0xc41a4c1b (stale) Mirror 5: 0xdbb57a19 (stale) Mirror 6: 0x7444d54d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f443): Mirror 2: 0xc41a4c1b (stale) Mirror 3: 0xc41a4c1b (stale) Mirror 5: 0xdbb57a19 (stale) Mirror 6: 0x7444d54d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f443: skipped 000097 1784225624.348503 mapwrite 0x01a62b thru 0x01b0f9 (0xacf bytes) 000098 1784225624.369182 read 0x00c61d thru 0x01402f (0x7a13 bytes) 000099 1784225624.389533 write 0x03363e thru 0x03ffff (0xc9c2 bytes) fallocating to largest ever: 0x40000 000100 1784225624.415897 fallocate 0x036c2d thru 0x03ffff (0x93d3 bytes) 000101 1784225624.420219 mapread 0x0257a6 thru 0x031424 (0xbc7f bytes) 000102 1784225624.436421 trunc from 0x0310a0 to 0x0359cf (0x4930 bytes) 000103 1784225624.451952 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe1fc45d9 (stale) Mirror 3: 0xe1fc45d9 (stale) Mirror 5: 0x199cb664 (stale) Mirror 6: 0xb0efefe7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd7d8283d Mirror 7: 0xd7d8283d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000104 1784225625.095045 fallocate 0x00aab7 thru 0x00f678 (0x4bc2 bytes) 000105 1784225625.128165 mapread 0x025658 thru 0x02ca7c (0x7425 bytes) 000106 1784225625.144957 read 0x034152 thru 0x0371bd (0x306c bytes) 000107 1784225625.149205 write 0x014be5 thru 0x0244a8 (0xf8c4 bytes) 000108 1784225625.160868 fallocate 0x01d53e thru 0x026352 (0x8e15 bytes) 000109 1784225625.165330 punch from 0x030b24 to 0x036d7a (0x6257 bytes) 000110 1784225625.168924 fallocate 0x00ec20 thru 0x0128a7 (0x3c88 bytes) 000111 1784225625.174842 read 0x02cd4c thru 0x032f22 (0x61d7 bytes) 000112 1784225625.185507 trunc from 0x040000 to 0x003e60 (0x3c19f bytes) 000113 1784225625.222185 mapread 0x0019c5 thru 0x003e60 (0x249c bytes) 000114 1784225625.223354 trunc from 0x003e61 to 0x01921a (0x153ba bytes) 000115 1784225625.246218 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1921b): Mirror 2: 0x9882fc66 (stale) Mirror 3: 0x9882fc66 (stale) Mirror 5: 0xcb0865d3 (stale) Mirror 6: 0xd559896d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1921b): Mirror 2: 0x9882fc66 (stale) Mirror 3: 0x9882fc66 (stale) Mirror 5: 0xcb0865d3 (stale) Mirror 6: 0xd559896d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1921b: skipped 000116 1784225625.555991 mapread 0x00ff8b thru 0x01921a (0x9290 bytes) 000117 1784225625.577452 trunc from 0x00b8e9 to 0x01676a (0xae82 bytes) 000118 1784225625.588997 MIRROR_RESYNC 5 mirrors 000119 1784225626.308324 read 0x001199 thru 0x00316c (0x1fd4 bytes) 000120 1784225626.312254 write 0x015e14 thru 0x017f5f (0x214c bytes) 000121 1784225626.334173 mapread 0x017469 thru 0x018c3e (0x17d6 bytes) 000122 1784225626.340607 punch from 0x013683 to 0x01921a (0x5b98 bytes) 000123 1784225626.352329 read 0x0027f8 thru 0x00a36c (0x7b75 bytes) 000124 1784225626.365862 trunc from 0x00e843 to 0x01921a (0xa9d8 bytes) 000125 1784225626.371745 trunc from 0x00da55 to 0x013dd1 (0x637d bytes) 000126 1784225626.380687 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1921b): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1921b): Mirror 2: 0x555225b4 (stale) Mirror 3: 0x555225b4 (stale) Mirror 5: 0x555225b4 (stale) Mirror 6: 0x555225b4 (stale) CRC-32 checksum value for chunk [0, 0x1921b): Mirror 1: 0x555225b4 Mirror 7: 0x555225b4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1921b: skipped 000127 1784225627.015203 trunc from 0x01921b to 0x03c44d (0x23233 bytes) 000128 1784225627.077489 trunc from 0x01db3e to 0x0256ef (0x7bb2 bytes) 000129 1784225627.084447 fallocate 0x008897 thru 0x009778 (0xee2 bytes) 000130 1784225627.094220 read 0x02ede8 thru 0x03c058 (0xd271 bytes) 000131 1784225627.110961 read 0x00df8e thru 0x01ac64 (0xccd7 bytes) 000132 1784225627.125526 write 0x039d00 thru 0x03ffff (0x6300 bytes) 000133 1784225627.126873 trunc from 0x03a163 to 0x03d27a (0x3118 bytes) 000134 1784225627.139097 trunc from 0x03bd92 to 0x03ff09 (0x4178 bytes) 000135 1784225627.144378 fallocate 0x008184 thru 0x015127 (0xcfa4 bytes) 000136 1784225627.150308 trunc from 0x02c4ae to 0x030a7e (0x45d1 bytes) 000137 1784225627.156207 read 0x019ad4 thru 0x01d99a (0x3ec7 bytes) 000138 1784225627.157232 mapread 0x004331 thru 0x004ebe (0xb8e bytes) 000139 1784225627.158664 mapread 0x013435 thru 0x01aa44 (0x7610 bytes) 000140 1784225627.159794 fallocate 0x00bb43 thru 0x00f478 (0x3936 bytes) 000141 1784225627.170115 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xab7eedd3 (stale) Mirror 3: 0xab7eedd3 (stale) Mirror 5: 0xab7eedd3 (stale) Mirror 6: 0xab7eedd3 (stale) Mirror 7: 0xab7eedd3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x68ca5f21 Mirror 8: 0x68ca5f21 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000142 1784225627.852214 read 0x033b7e thru 0x03b581 (0x7a04 bytes) 000144 1784225627.881456 read 0x0225e0 thru 0x02914b (0x6b6c bytes) 000145 1784225627.902266 punch from 0x00658b to 0x013bee (0xd664 bytes) 000146 1784225627.938155 read 0x012fe1 thru 0x013392 (0x3b2 bytes) 000147 1784225627.957834 punch from 0x03faff to 0x03ffff (0x501 bytes) 000148 1784225627.963174 punch from 0x03e17d to 0x03ffff (0x1e83 bytes) 000149 1784225627.972906 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xab7eedd3 (stale) Mirror 5: 0xab7eedd3 (stale) Mirror 6: 0xab7eedd3 (stale) Mirror 7: 0xab7eedd3 (stale) Mirror 8: 0x68ca5f21 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xab7eedd3 (stale) Mirror 5: 0xab7eedd3 (stale) Mirror 6: 0xab7eedd3 (stale) Mirror 7: 0xab7eedd3 (stale) Mirror 8: 0x68ca5f21 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000150 1784225628.343757 fallocate 0x02cd96 thru 0x032d9a (0x6005 bytes) 000151 1784225628.351275 trunc from 0x040000 to 0x032385 (0xdc7a bytes) 000153 1784225628.396164 punch from 0x029d5d to 0x02ef3e (0x51e2 bytes) 000154 1784225628.401362 write 0x01d7f9 thru 0x0283aa (0xabb2 bytes) 000156 1784225628.419105 mapwrite 0x010830 thru 0x018c49 (0x841a bytes) 000158 1784225628.461634 punch from 0x01e537 to 0x026dbd (0x8887 bytes) 000159 1784225628.470701 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32386): Mirror 5: 0x7c32496d (stale) Mirror 6: 0x7c32496d (stale) Mirror 7: 0x7c32496d (stale) Mirror 8: 0x7c32496d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32386): Mirror 5: 0x7c32496d (stale) Mirror 6: 0x7c32496d (stale) Mirror 7: 0x7c32496d (stale) Mirror 8: 0x7c32496d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32386: skipped 000160 1784225628.824227 fallocate 0x0161e9 thru 0x01f0ec (0x8f04 bytes) 000161 1784225628.830018 trunc from 0x032386 to 0x02f407 (0x2f7e bytes) 000162 1784225628.852537 trunc from 0x0291d4 to 0x02f407 (0x6234 bytes) 000163 1784225628.857400 trunc from 0x02f408 to 0x006e2f (0x285d8 bytes) 000164 1784225628.878307 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x6e30): Mirror 5: 0x4f74e079 (stale) Mirror 7: 0x4f74e079 (stale) Mirror 8: 0x4f74e079 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6e30): Mirror 5: 0x4f74e079 (stale) Mirror 7: 0x4f74e079 (stale) Mirror 8: 0x4f74e079 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6e30: skipped 000165 1784225629.161394 fallocate 0x02b7dd thru 0x0376b4 (0xbed8 bytes) 000166 1784225629.164774 write 0x02f012 thru 0x031086 (0x2075 bytes) 000167 1784225629.168885 fallocate 0x02defb thru 0x0343ae (0x64b4 bytes) 000168 1784225629.174047 write 0x038e07 thru 0x03b5b0 (0x27aa bytes) 000169 1784225629.180313 MIRROR_RESYNC 4 mirrors 000170 1784225630.035513 trunc from 0x005429 to 0x00bbec (0x67c4 bytes) 000171 1784225630.056999 mapread 0x0124bf thru 0x01fe14 (0xd956 bytes) 000172 1784225630.083538 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b5b1): Mirror 7: 0x42d32eb1 (stale) Mirror 8: 0x42d32eb1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b5b1): Mirror 7: 0x42d32eb1 (stale) Mirror 8: 0x42d32eb1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b5b1: skipped 000173 1784225630.320064 write 0x01ab3b thru 0x0262b7 (0xb77d bytes) 000174 1784225630.333109 mapread 0x02eafd thru 0x03b508 (0xca0c bytes) 000175 1784225630.362182 trunc from 0x03b5b1 to 0x015436 (0x2617a bytes) 000176 1784225630.388653 read 0x003c33 thru 0x008c3e (0x500c bytes) 000177 1784225630.396870 read 0x00b21a thru 0x011c6e (0x6a55 bytes) 000178 1784225630.411107 trunc from 0x015437 to 0x03429f (0x1ee69 bytes) 000179 1784225630.437275 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x342a0): Mirror 8: 0xeb57f73d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x342a0): Mirror 8: 0xeb57f73d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x342a0: skipped 000180 1784225630.668504 trunc from 0x001162 to 0x001ee0 (0xd7f bytes) 000181 1784225630.674827 fallocate 0x016e1f thru 0x01d965 (0x6b47 bytes) 000182 1784225630.688244 fallocate 0x01d5c4 thru 0x026a05 (0x9442 bytes) 000183 1784225630.705175 MIRROR_RESYNC 2 mirrors 000184 1784225631.102772 read 0x01c0b0 thru 0x01f7d2 (0x3723 bytes) 000185 1784225631.112734 trunc from 0x025efa to 0x02f6b2 (0x97b9 bytes) 000186 1784225631.155285 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) 000187 1784225631.319322 MIRROR_EXTEND to 2 mirrors 000188 1784225631.909985 punch from 0x02a01d to 0x02ee25 (0x4e09 bytes) 000189 1784225631.947176 read 0x00c1e9 thru 0x01875b (0xc573 bytes) 000190 1784225631.958360 read 0x01e8a2 thru 0x02d0ba (0xe819 bytes) 000191 1784225631.978656 trunc from 0x0251eb to 0x029fa4 (0x4dba bytes) 000192 1784225631.986396 trunc from 0x0342a0 to 0x02ca7b (0x7824 bytes) 000193 1784225632.013009 read 0x01b345 thru 0x01eae4 (0x37a0 bytes) 000194 1784225632.013951 write 0x003403 thru 0x0039e9 (0x5e7 bytes) 000195 1784225632.015176 mapread 0x01b3a9 thru 0x0272cb (0xbf23 bytes) 000196 1784225632.028069 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2ca7c): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ca7c): Mirror 2: 0x9e226e0b (stale) CRC-32 checksum value for chunk [0, 0x2ca7c): Mirror 1: 0x84562040 Mirror 3: 0x84562040 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ca7c: skipped 000197 1784225632.707697 mapwrite 0x03eeee thru 0x03ffff (0x1112 bytes) 000198 1784225632.797403 mapwrite 0x03b287 thru 0x03ffff (0x4d79 bytes) 000199 1784225632.828030 mapread 0x03f7e4 thru 0x03ffff (0x81c bytes) 000200 1784225632.829182 read 0x013318 thru 0x014a58 (0x1741 bytes) 000201 1784225632.836089 fallocate 0x00322c thru 0x00a6da (0x74af bytes) 000202 1784225632.847421 MIRROR_RESYNC 3 mirrors 000203 1784225633.438644 read 0x0398b0 thru 0x03a881 (0xfd2 bytes) 000204 1784225633.442719 punch from 0x02f1bf to 0x03b7e5 (0xc627 bytes) 000205 1784225633.485598 punch from 0x034dc9 to 0x035595 (0x7cd bytes) 000206 1784225633.496964 fallocate 0x020231 thru 0x0218d4 (0x16a4 bytes) 000208 1784225633.509253 mapwrite 0x00773b thru 0x00f517 (0x7ddd bytes) 000209 1784225633.563323 mapread 0x010346 thru 0x0133eb (0x30a6 bytes) 000211 1784225633.585675 mapwrite 0x02ace8 thru 0x034129 (0x9442 bytes) 000212 1784225633.641623 read 0x036a40 thru 0x03fc36 (0x91f7 bytes) 000213 1784225633.655620 write 0x016e15 thru 0x01b5ef (0x47db bytes) 000214 1784225633.658383 trunc from 0x040000 to 0x00ead6 (0x31529 bytes) 000215 1784225633.714131 mapread 0x0060bb thru 0x00ead6 (0x8a1c bytes) 000218 1784225633.717073 mapwrite 0x01fc99 thru 0x01fea9 (0x211 bytes) 000219 1784225633.747374 punch from 0x008d18 to 0x00b646 (0x292f bytes) 000220 1784225633.752777 write 0x011710 thru 0x019a68 (0x8359 bytes) 000221 1784225633.766507 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1feaa): Mirror 3: 0xdcc3da43 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1feaa): Mirror 3: 0xdcc3da43 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1feaa: skipped 000222 1784225634.028245 MIRROR_RESYNC 2 mirrors 000223 1784225634.707045 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) 000224 1784225634.820568 punch from 0x01d2ff to 0x01fea9 (0x2bab bytes) 000225 1784225634.833400 trunc from 0x01feaa to 0x025f2a (0x6081 bytes) 000226 1784225634.858781 fallocate 0x01493c thru 0x01d2fe (0x89c3 bytes) 000227 1784225634.863185 trunc from 0x010640 to 0x0126c8 (0x2089 bytes) 000228 1784225634.868020 write 0x038bf6 thru 0x03ffff (0x740a bytes) 000229 1784225634.870302 trunc from 0x040000 to 0x00188a (0x3e775 bytes) 000231 1784225634.884883 trunc from 0x00119c to 0x00188a (0x6ef bytes) 000232 1784225634.890191 trunc from 0x00188b to 0x01ffda (0x1e750 bytes) 000233 1784225634.904746 fallocate 0x03234d thru 0x03ffff (0xdcb3 bytes) 000234 1784225634.910090 mapread 0x012e24 thru 0x01aac1 (0x7c9e bytes) 000235 1784225634.930391 trunc from 0x01ffdb to 0x015b9c (0xa43e bytes) 000236 1784225634.944461 trunc from 0x015b47 to 0x015b9c (0x56 bytes) 000237 1784225634.948411 punch from 0x0106e0 to 0x015b9c (0x54bd bytes) 000238 1784225634.953045 trunc from 0x015b9d to 0x024e2e (0xf292 bytes) 000239 1784225634.966215 mapwrite 0x01f908 thru 0x026e4a (0x7543 bytes) 000242 1784225635.008951 trunc from 0x026e4b to 0x002f28 (0x23f22 bytes) 000244 1784225635.033207 write 0x0058da thru 0x00ac63 (0x538a bytes) 000245 1784225635.035321 trunc from 0x00ac64 to 0x011d41 (0x70de bytes) 000246 1784225635.051183 fallocate 0x020102 thru 0x02126b (0x116a bytes) 000247 1784225635.057111 trunc from 0x0055bd to 0x011d41 (0xc785 bytes) 000248 1784225635.075065 punch from 0x00aa1a to 0x011d41 (0x7328 bytes) 000250 1784225635.082819 punch from 0x00ff5e to 0x011d41 (0x1de4 bytes) 000251 1784225635.090462 fallocate 0x03f24e thru 0x03ffff (0xdb2 bytes) 000252 1784225635.099016 trunc from 0x011d42 to 0x0111d4 (0xb6d bytes) 000253 1784225635.114457 trunc from 0x0111d5 to 0x02aa61 (0x1988d bytes) 000254 1784225635.129050 mapwrite 0x03fc38 thru 0x03ffff (0x3c8 bytes) 000255 1784225635.164320 read 0x016b63 thru 0x0257ee (0xec8c bytes) 000257 1784225635.174496 punch from 0x030de9 to 0x038183 (0x739b bytes) 000258 1784225635.180244 fallocate 0x016afb thru 0x024e05 (0xe30b bytes) 000259 1784225635.185368 read 0x026b88 thru 0x03085c (0x9cd5 bytes) 000260 1784225635.197455 mapread 0x02fa38 thru 0x03d7ea (0xddb3 bytes) 000261 1784225635.199097 trunc from 0x040000 to 0x00bc3c (0x343c3 bytes) 000262 1784225635.210220 mapwrite 0x03bd4b thru 0x03f4c7 (0x377d bytes) 000263 1784225635.248772 fallocate 0x0016a0 thru 0x009a9e (0x83ff bytes) 000264 1784225635.253024 mapread 0x0214de thru 0x0312dc (0xfdff bytes) 000265 1784225635.324342 trunc from 0x03f4c8 to 0x0207df (0x1ece8 bytes) 000266 1784225635.342026 fallocate 0x00046a thru 0x002c05 (0x279c bytes) 000267 1784225635.353790 mapread 0x00892f thru 0x00b568 (0x2c3a bytes) 000269 1784225635.356975 mapread 0x017752 thru 0x01adef (0x369e bytes) 000270 1784225635.388019 mapwrite 0x03706c thru 0x03ffff (0x8f94 bytes) 000271 1784225635.481231 fallocate 0x00d380 thru 0x01c9ed (0xf66e bytes) 000272 1784225635.488659 MIRROR_EXTEND to 2 mirrors 000273 1784225636.053752 punch from 0x016f64 to 0x023e10 (0xcead bytes) 000274 1784225636.100312 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb989c69e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb989c69e Mirror 3: 0xb989c69e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000275 1784225636.912299 mapread 0x006c21 thru 0x00ab5f (0x3f3f bytes) 000276 1784225636.942032 punch from 0x023280 to 0x02cf57 (0x9cd8 bytes) 000277 1784225636.985226 read 0x00cc54 thru 0x01625c (0x9609 bytes) 000278 1784225636.993193 mapwrite 0x00c817 thru 0x00f045 (0x282f bytes) 000279 1784225637.006487 mapwrite 0x02b668 thru 0x02d84e (0x21e7 bytes) 000280 1784225637.034703 mapwrite 0x01f168 thru 0x0237ab (0x4644 bytes) 000281 1784225637.073297 fallocate 0x01cf62 thru 0x02997c (0xca1b bytes) 000282 1784225637.082512 trunc from 0x040000 to 0x0168c5 (0x2973a bytes) 000284 1784225637.121252 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x168c6): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x168c6): Mirror 2: 0x14c123e6 (stale) Mirror 3: 0x14c123e6 (stale) CRC-32 checksum value for chunk [0, 0x168c6): Mirror 1: 0xa05cb018 Mirror 4: 0xa05cb018 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x168c6: skipped 000285 1784225637.947007 trunc from 0x00c81f to 0x00f082 (0x2864 bytes) 000286 1784225637.978324 punch from 0x015c03 to 0x0168c5 (0xcc3 bytes) 000287 1784225637.992802 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x168c6): Mirror 3: 0x14c123e6 (stale) Mirror 4: 0xa05cb018 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x168c6): Mirror 3: 0x14c123e6 (stale) Mirror 4: 0xa05cb018 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x168c6: skipped 000288 1784225638.258406 mapwrite 0x020345 thru 0x02aeec (0xaba8 bytes) 000289 1784225638.313773 read 0x019f1b thru 0x01ec75 (0x4d5b bytes) 000290 1784225638.328735 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2aeed): Mirror 3: 0x639433e3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2aeed): Mirror 3: 0x639433e3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2aeed: skipped 000291 1784225638.541074 read 0x008623 thru 0x01842b (0xfe09 bytes) 000292 1784225638.550696 mapwrite 0x03952f thru 0x03a9aa (0x147c bytes) 000293 1784225638.613712 write 0x03f26a thru 0x03f7c4 (0x55b bytes) 000294 1784225638.616741 fallocate 0x02c7a1 thru 0x038ab5 (0xc315 bytes) 000295 1784225638.632038 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) 000296 1784225638.774204 fallocate 0x01a632 thru 0x02a191 (0xfb60 bytes) 000298 1784225638.787979 MIRROR_EXTEND to 2 mirrors 000299 1784225639.408409 trunc from 0x025497 to 0x028ced (0x3857 bytes) 000300 1784225639.440834 fallocate 0x02077b thru 0x028e84 (0x870a bytes) 000301 1784225639.445055 trunc from 0x03f7c5 to 0x039e0e (0x59b6 bytes) 000302 1784225639.461275 mapread 0x02b1df thru 0x02bf22 (0xd44 bytes) 000303 1784225639.466170 trunc from 0x039e0f to 0x036f45 (0x2ec9 bytes) 000304 1784225639.478729 read 0x025172 thru 0x02d47a (0x8309 bytes) 000305 1784225639.488129 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) 000306 1784225639.603429 mapread 0x00b8f1 thru 0x00d781 (0x1e91 bytes) 000307 1784225639.618533 trunc from 0x036f46 to 0x0224ed (0x14a58 bytes) 000308 1784225639.632670 trunc from 0x017908 to 0x0224ed (0xabe6 bytes) 000309 1784225639.639508 punch from 0x0102e3 to 0x0130f9 (0x2e17 bytes) 000310 1784225639.648396 read 0x013039 thru 0x021fb7 (0xef7f bytes) 000311 1784225639.662607 punch from 0x01e1c9 to 0x0224ed (0x4325 bytes) 000312 1784225639.669989 trunc from 0x0224ee to 0x002ff9 (0x1f4f4 bytes) 000313 1784225639.686709 read 0x001646 thru 0x002450 (0xe0b bytes) 000314 1784225639.693062 fallocate 0x01a01d thru 0x026b0e (0xcaf2 bytes) 000315 1784225639.707081 trunc from 0x002ffa to 0x03a0d3 (0x370da bytes) 000316 1784225639.726433 write 0x035f6c thru 0x039856 (0x38eb bytes) 000317 1784225639.741342 mapread 0x0060aa thru 0x01210e (0xc065 bytes) 000318 1784225639.743255 punch from 0x012446 to 0x01ce9d (0xaa58 bytes) 000319 1784225639.749270 fallocate 0x03308b thru 0x03ffff (0xcf75 bytes) 000320 1784225639.758689 trunc from 0x040000 to 0x00cc63 (0x3339c bytes) 000322 1784225639.782568 trunc from 0x00cc64 to 0x0322f5 (0x25692 bytes) 000323 1784225639.800736 fallocate 0x022289 thru 0x023433 (0x11ab bytes) 000324 1784225639.809625 mapwrite 0x00f150 thru 0x00fe9b (0xd4c bytes) 000325 1784225639.830131 mapwrite 0x029297 thru 0x033703 (0xa46d bytes) 000326 1784225639.922049 trunc from 0x033704 to 0x021384 (0x1237f bytes) 000327 1784225639.946815 trunc from 0x021385 to 0x03e990 (0x1d60c bytes) 000328 1784225639.968687 MIRROR_EXTEND to 2 mirrors 000329 1784225640.603773 read 0x0339e4 thru 0x03c6c9 (0x8ce6 bytes) 000330 1784225640.632956 write 0x036bdf thru 0x03d05c (0x647e bytes) 000331 1784225640.676263 mapwrite 0x01d458 thru 0x027825 (0xa3ce bytes) 000332 1784225640.735974 fallocate 0x00d716 thru 0x019f94 (0xc87f bytes) 000333 1784225640.743523 read 0x00e873 thru 0x01524a (0x69d8 bytes) 000335 1784225640.758332 trunc from 0x019e81 to 0x0264f7 (0xc677 bytes) 000336 1784225640.769285 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) 000337 1784225640.895267 read 0x00e95b thru 0x010f6e (0x2614 bytes) 000338 1784225640.901623 write 0x0226df thru 0x02de14 (0xb736 bytes) 000340 1784225640.922776 write 0x002da4 thru 0x00e653 (0xb8b0 bytes) 000341 1784225640.931573 read 0x030e0d thru 0x03af8f (0xa183 bytes) 000342 1784225640.943744 trunc from 0x01130c to 0x01cf54 (0xbc49 bytes) 000343 1784225640.957535 fallocate 0x031fd6 thru 0x0380ea (0x6115 bytes) 000344 1784225640.962174 write 0x003593 thru 0x01067f (0xd0ed bytes) 000345 1784225640.964099 mapwrite 0x020551 thru 0x022a38 (0x24e8 bytes) 000346 1784225640.984248 write 0x02d4de thru 0x02e9d3 (0x14f6 bytes) 000348 1784225640.988594 mapwrite 0x039577 thru 0x03af90 (0x1a1a bytes) 000350 1784225641.016056 fallocate 0x000ffc thru 0x010952 (0xf957 bytes) 000351 1784225641.024922 trunc from 0x03e991 to 0x02349f (0x1b4f1 bytes) 000352 1784225641.049495 mapread 0x00eef5 thru 0x011996 (0x2aa2 bytes) 000353 1784225641.057073 trunc from 0x0234a0 to 0x028489 (0x4fea bytes) 000354 1784225641.083087 MIRROR_EXTEND to 2 mirrors 000355 1784225641.748247 punch from 0x0205e3 to 0x028489 (0x7ea7 bytes) 000356 1784225641.778410 punch from 0x007c53 to 0x0094e3 (0x1891 bytes) 000357 1784225641.783804 read 0x01ed20 thru 0x01efb3 (0x294 bytes) 000358 1784225641.788062 fallocate 0x00a676 thru 0x0176ef (0xd07a bytes) 000359 1784225641.793426 mapread 0x0162e4 thru 0x02096b (0xa688 bytes) 000360 1784225641.817435 trunc from 0x02848a to 0x007ec5 (0x205c4 bytes) 000361 1784225641.839643 write 0x016a2a thru 0x01beba (0x5491 bytes) 000362 1784225641.854800 MIRROR_RESYNC 2 mirrors 000363 1784225642.336090 write 0x030065 thru 0x03b42a (0xb3c6 bytes) 000364 1784225642.357867 trunc from 0x03b42b to 0x0179a1 (0x23a89 bytes) 000365 1784225642.381089 trunc from 0x004245 to 0x01227f (0xe03b bytes) 000366 1784225642.386653 fallocate 0x014127 thru 0x0158aa (0x1784 bytes) 000367 1784225642.390724 trunc from 0x016332 to 0x016871 (0x540 bytes) 000368 1784225642.395224 write 0x02c0a9 thru 0x031fbc (0x5f14 bytes) 000370 1784225642.399099 trunc from 0x030530 to 0x031fbc (0x1a8d bytes) 000371 1784225642.411014 fallocate 0x003dfd thru 0x00bc1d (0x7e21 bytes) 000373 1784225642.415538 fallocate 0x02ab7f thru 0x03532c (0xa7ae bytes) 000375 1784225642.420172 write 0x00cc41 thru 0x00dc36 (0xff6 bytes) 000376 1784225642.427013 mapread 0x009183 thru 0x00ee3c (0x5cba bytes) 000377 1784225642.442276 fallocate 0x01b744 thru 0x02ae22 (0xf6df bytes) 000378 1784225642.450990 mapread 0x00a83b thru 0x00d9b4 (0x317a bytes) 000379 1784225642.452217 read 0x01b20a thru 0x01fa0e (0x4805 bytes) 000380 1784225642.461951 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) 000381 1784225642.573231 fallocate 0x013cbf thru 0x015276 (0x15b8 bytes) 000382 1784225642.579378 mapwrite 0x0257c2 thru 0x028182 (0x29c1 bytes) 000383 1784225642.621737 punch from 0x0319c5 to 0x031fbc (0x5f8 bytes) 000384 1784225642.627925 mapwrite 0x00ba2e thru 0x00c346 (0x919 bytes) 000385 1784225642.652403 trunc from 0x031fbd to 0x021c85 (0x10337 bytes) 000386 1784225642.676657 punch from 0x0186a9 to 0x021c85 (0x95dd bytes) 000387 1784225642.681724 trunc from 0x021c86 to 0x021604 (0x681 bytes) 000389 1784225642.712051 trunc from 0x01062a to 0x01483a (0x4211 bytes) 000390 1784225642.719904 punch from 0x01c42e to 0x021604 (0x51d7 bytes) 000391 1784225642.728189 trunc from 0x01e706 to 0x021604 (0x2eff bytes) 000392 1784225642.737239 mapread 0x0205eb thru 0x021604 (0x101a bytes) 000393 1784225642.746983 trunc from 0x006a0d to 0x00d202 (0x67f6 bytes) 000394 1784225642.751513 punch from 0x0124c5 to 0x020cd3 (0xe80f bytes) 000395 1784225642.755934 trunc from 0x001484 to 0x0083f8 (0x6f75 bytes) 000396 1784225642.769243 trunc from 0x021605 to 0x00bef0 (0x15714 bytes) 000397 1784225642.786386 trunc from 0x00bef1 to 0x0222f1 (0x16401 bytes) 000398 1784225642.805982 trunc from 0x0222f2 to 0x035120 (0x12e2f bytes) 000399 1784225642.823862 fallocate 0x001c98 thru 0x00bb48 (0x9eb1 bytes) 000400 1784225642.828237 trunc from 0x035121 to 0x02ec7a (0x64a6 bytes) 000401 1784225642.858294 fallocate 0x0309c3 thru 0x036afc (0x613a bytes) 000402 1784225642.870208 trunc from 0x036afd to 0x038466 (0x196a bytes) 000403 1784225642.908993 MIRROR_EXTEND to 2 mirrors 000404 1784225643.381410 fallocate 0x033387 thru 0x03ffff (0xcc79 bytes) 000405 1784225643.416817 read 0x02b249 thru 0x038378 (0xd130 bytes) 000406 1784225643.434286 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x861068db (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x861068db Mirror 3: 0x861068db lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000407 1784225644.228908 trunc from 0x040000 to 0x031ca1 (0xe35e bytes) 000408 1784225644.297612 read 0x00348b thru 0x00ac18 (0x778e bytes) 000409 1784225644.314740 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31ca2): Mirror 3: 0x5e828247 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31ca2): Mirror 3: 0x5e828247 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31ca2: skipped 000410 1784225644.563662 fallocate 0x017de0 thru 0x024302 (0xc523 bytes) 000411 1784225644.568899 trunc from 0x031ca2 to 0x02d7f0 (0x44b1 bytes) 000412 1784225644.605799 trunc from 0x0100d4 to 0x0106ea (0x617 bytes) 000414 1784225644.618438 trunc from 0x02d7f1 to 0x02683e (0x6fb2 bytes) 000415 1784225644.647317 read 0x00a0c4 thru 0x00ab73 (0xab0 bytes) 000416 1784225644.654401 trunc from 0x009ed1 to 0x0178ea (0xda1a bytes) 000417 1784225644.659472 fallocate 0x001140 thru 0x005158 (0x4019 bytes) 000418 1784225644.667276 mapread 0x0260ee thru 0x02683e (0x751 bytes) 000419 1784225644.676695 fallocate 0x007ea6 thru 0x011afb (0x9c56 bytes) 000420 1784225644.686865 MIRROR_RESYNC 2 mirrors 000421 1784225645.146741 trunc from 0x00ae40 to 0x00c21a (0x13db bytes) 000422 1784225645.197087 read 0x025293 thru 0x02683e (0x15ac bytes) 000423 1784225645.202374 read 0x012a09 thru 0x0208d4 (0xdecc bytes) 000425 1784225645.220642 trunc from 0x02683f to 0x003489 (0x233b5 bytes) 000426 1784225645.255956 trunc from 0x0005c4 to 0x003489 (0x2ec6 bytes) 000428 1784225645.269613 trunc from 0x00348a to 0x03bef3 (0x38a6a bytes) 000429 1784225645.294117 trunc from 0x024df8 to 0x02d0f1 (0x82fa bytes) 000431 1784225645.302786 fallocate 0x00e851 thru 0x015f93 (0x7743 bytes) 000432 1784225645.308165 mapwrite 0x01e0e0 thru 0x0262d5 (0x81f6 bytes) 000434 1784225645.389590 fallocate 0x01d689 thru 0x02395f (0x62d7 bytes) 000435 1784225645.399508 punch from 0x010d76 to 0x01d7be (0xca49 bytes) 000436 1784225645.414171 read 0x01960e thru 0x027be4 (0xe5d7 bytes) 000437 1784225645.441806 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3bef4): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bef4): Mirror 3: 0xd3e1c8f9 (stale) CRC-32 checksum value for chunk [0, 0x3bef4): Mirror 1: 0x4eea9536 Mirror 4: 0x4eea9536 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bef4: skipped 000438 1784225646.093435 read 0x03be6c thru 0x03bef3 (0x88 bytes) 000439 1784225646.101591 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) 000440 1784225646.384819 mapread 0x00b7bf thru 0x00c275 (0xab7 bytes) 000441 1784225646.409771 punch from 0x0336f9 to 0x03929c (0x5ba4 bytes) 000442 1784225646.445418 punch from 0x01abe7 to 0x0250f3 (0xa50d bytes) 000443 1784225646.450753 mapwrite 0x033d44 thru 0x03af8e (0x724b bytes) 000444 1784225646.480631 trunc from 0x001505 to 0x00e8eb (0xd3e7 bytes) 000445 1784225646.485176 punch from 0x024724 to 0x027f01 (0x37de bytes) 000446 1784225646.489507 mapwrite 0x0269ef thru 0x0327be (0xbdd0 bytes) 000447 1784225646.513352 mapread 0x00f748 thru 0x01b470 (0xbd29 bytes) 000448 1784225646.531924 write 0x027b25 thru 0x02815e (0x63a bytes) 000449 1784225646.541779 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) 000450 1784225646.685968 trunc from 0x03bef4 to 0x037528 (0x49cb bytes) 000452 1784225646.732445 fallocate 0x016d04 thru 0x019fd1 (0x32ce bytes) 000453 1784225646.738071 write 0x01f9a6 thru 0x023b85 (0x41e0 bytes) 000454 1784225646.747733 punch from 0x0019c6 to 0x0057b4 (0x3def bytes) 000455 1784225646.755392 trunc from 0x037529 to 0x02bfd6 (0xb552 bytes) 000456 1784225646.772833 mapwrite 0x00902d thru 0x00d2fa (0x42ce bytes) 000457 1784225646.806316 trunc from 0x0028be to 0x00a261 (0x79a4 bytes) 000458 1784225646.812565 trunc from 0x02bfd7 to 0x0134d3 (0x18b03 bytes) 000459 1784225646.837175 mapwrite 0x020599 thru 0x0296f8 (0x9160 bytes) 000461 1784225646.885344 write 0x002e71 thru 0x00c028 (0x91b8 bytes) 000462 1784225646.901778 trunc from 0x0296f9 to 0x0161a7 (0x13551 bytes) 000463 1784225646.924261 trunc from 0x003c7d to 0x005ca6 (0x202a bytes) 000464 1784225646.943132 mapread 0x0095e2 thru 0x00ec46 (0x5665 bytes) 000465 1784225646.944287 trunc from 0x0157e7 to 0x0161a7 (0x9c1 bytes) 000466 1784225646.953123 write 0x0028a2 thru 0x002a73 (0x1d2 bytes) 000467 1784225646.955307 trunc from 0x005b92 to 0x013d3a (0xe1a9 bytes) 000468 1784225646.970078 MIRROR_EXTEND to 2 mirrors 000469 1784225647.661152 trunc from 0x0055c5 to 0x00e0b7 (0x8af3 bytes) 000470 1784225647.686267 write 0x016e34 thru 0x01ba87 (0x4c54 bytes) 000471 1784225647.694066 mapread 0x0083c2 thru 0x014572 (0xc1b1 bytes) 000472 1784225647.719620 punch from 0x010523 to 0x018fef (0x8acd bytes) 000473 1784225647.746001 punch from 0x01a24e to 0x01ba87 (0x183a bytes) 000474 1784225647.761690 MIRROR_RESYNC 2 mirrors 000475 1784225648.376746 write 0x03475d thru 0x0365a5 (0x1e49 bytes) 000476 1784225648.396502 read 0x01f4a7 thru 0x02d186 (0xdce0 bytes) 000477 1784225648.405354 trunc from 0x02f4ba to 0x036016 (0x6b5d bytes) 000478 1784225648.422335 punch from 0x00e0a7 to 0x00f8d8 (0x1832 bytes) 000479 1784225648.428456 fallocate 0x018276 thru 0x01ed40 (0x6acb bytes) 000480 1784225648.435855 mapread 0x01e61d thru 0x02070d (0x20f1 bytes) 000481 1784225648.442903 read 0x022a5d thru 0x02d2f1 (0xa895 bytes) 000482 1784225648.444809 read 0x020cab thru 0x024072 (0x33c8 bytes) 000483 1784225648.446743 read 0x032267 thru 0x035ea8 (0x3c42 bytes) 000484 1784225648.464280 mapread 0x0246b2 thru 0x02f316 (0xac65 bytes) 000485 1784225648.465773 mapwrite 0x03f6c3 thru 0x03ffff (0x93d bytes) 000486 1784225648.517021 trunc from 0x038f2d to 0x03f273 (0x6347 bytes) 000487 1784225648.531409 mapread 0x02f3a1 thru 0x03d925 (0xe585 bytes) 000488 1784225648.566135 fallocate 0x001a37 thru 0x0025ef (0xbb9 bytes) 000489 1784225648.574264 trunc from 0x040000 to 0x03b542 (0x4abd bytes) 000490 1784225648.593410 mapwrite 0x016a1c thru 0x01d83a (0x6e1f bytes) 000491 1784225648.614438 fallocate 0x02c9a0 thru 0x0352a9 (0x890a bytes) 000492 1784225648.621254 trunc from 0x00d3b9 to 0x00e3db (0x1023 bytes) 000493 1784225648.628087 mapwrite 0x012f59 thru 0x01bc2b (0x8cd3 bytes) 000494 1784225648.655640 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3b543): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b543): Mirror 2: 0x550fdc3a (stale) CRC-32 checksum value for chunk [0, 0x3b543): Mirror 1: 0x7b6a84da Mirror 3: 0x7b6a84da lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b543: skipped 000495 1784225649.471035 trunc from 0x03b543 to 0x0238c9 (0x17c79 bytes) 000496 1784225649.535172 trunc from 0x008bdb to 0x014735 (0xbb5b bytes) 000497 1784225649.544192 trunc from 0x0238ca to 0x033e20 (0x10557 bytes) 000499 1784225649.577984 read 0x02ae93 thru 0x033e20 (0x8f8e bytes) 000500 1784225649.594305 fallocate 0x010a48 thru 0x013f62 (0x351b bytes) 000501 1784225649.599070 punch from 0x0303fc to 0x033e20 (0x3a25 bytes) 000502 1784225649.604684 punch from 0x017d94 to 0x02451c (0xc789 bytes) 000503 1784225649.612050 punch from 0x01c343 to 0x029d5a (0xda18 bytes) 000504 1784225649.619995 mapwrite 0x02ff36 thru 0x030ff2 (0x10bd bytes) 000505 1784225649.653175 trunc from 0x033e21 to 0x00c48a (0x27996 bytes) 000506 1784225649.676849 read 0x00c195 thru 0x00c48a (0x2f6 bytes) 000507 1784225649.688261 trunc from 0x00c48b to 0x009d8d (0x26fd bytes) 000508 1784225649.707533 punch from 0x003882 to 0x009d8d (0x650c bytes) 000509 1784225649.712975 write 0x0364e1 thru 0x03ffff (0x9b1f bytes) 000510 1784225649.727094 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x9c38dc14 (stale) Mirror 3: 0xea4afdae (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x96e65b62 Mirror 4: 0x96e65b62 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000511 1784225650.437934 punch from 0x0317cb to 0x03ffff (0xe835 bytes) 000512 1784225650.466872 MIRROR_RESYNC 4 mirrors 000513 1784225651.219998 mapread 0x02f778 thru 0x03cf8c (0xd815 bytes) 000514 1784225651.253945 MIRROR_RESYNC 4 mirrors 000515 1784225651.503365 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) 000517 1784225651.755411 mapwrite 0x0226b5 thru 0x0227e8 (0x134 bytes) 000518 1784225651.819445 fallocate 0x02dbde thru 0x0377c5 (0x9be8 bytes) 000519 1784225651.823096 read 0x011c07 thru 0x01dee5 (0xc2df bytes) 000520 1784225651.830242 punch from 0x03626a to 0x038ddb (0x2b72 bytes) 000521 1784225651.835581 fallocate 0x03fe8d thru 0x03ffff (0x173 bytes) 000522 1784225651.839866 trunc from 0x018c48 to 0x021e7b (0x9234 bytes) 000523 1784225651.847190 read 0x031b40 thru 0x03e518 (0xc9d9 bytes) 000524 1784225651.858646 punch from 0x00f5c5 to 0x015bc5 (0x6601 bytes) 000525 1784225651.866230 punch from 0x02e4f1 to 0x03af09 (0xca19 bytes) 000526 1784225651.874325 MIRROR_RESYNC 3 mirrors 000527 1784225652.583390 mapwrite 0x0202ee thru 0x02cf9e (0xccb1 bytes) 000528 1784225652.664169 trunc from 0x040000 to 0x01698a (0x29675 bytes) 000529 1784225652.679652 trunc from 0x001516 to 0x010e33 (0xf91e bytes) 000530 1784225652.689092 mapread 0x009b3c thru 0x00fe4a (0x630f bytes) 000531 1784225652.703520 MIRROR_RESYNC 3 mirrors 000532 1784225653.147239 read 0x007177 thru 0x008ffc (0x1e86 bytes) 000533 1784225653.150608 write 0x006a42 thru 0x009d76 (0x3335 bytes) 000534 1784225653.184584 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1698b): Mirror 3: 0x145fc170 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1698b): Mirror 3: 0x145fc170 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1698b: skipped 000535 1784225653.408694 mapread 0x009b94 thru 0x00ab14 (0xf81 bytes) 000536 1784225653.416846 punch from 0x008e75 to 0x00fdf5 (0x6f81 bytes) 000537 1784225653.420804 mapwrite 0x00df46 thru 0x018be9 (0xaca4 bytes) 000538 1784225653.471212 trunc from 0x010ecb to 0x017c52 (0x6d88 bytes) 000539 1784225653.476769 punch from 0x009782 to 0x011841 (0x80c0 bytes) 000540 1784225653.482302 punch from 0x005b93 to 0x010709 (0xab77 bytes) 000541 1784225653.486338 trunc from 0x007490 to 0x00fb5d (0x86ce bytes) 000542 1784225653.490025 trunc from 0x00a5a8 to 0x00fe70 (0x58c9 bytes) 000543 1784225653.494030 punch from 0x002af0 to 0x007585 (0x4a96 bytes) 000544 1784225653.501043 mapwrite 0x027f72 thru 0x02dfc8 (0x6057 bytes) 000545 1784225653.558128 trunc from 0x022e20 to 0x02c7e3 (0x99c4 bytes) 000546 1784225653.563255 trunc from 0x02dfc9 to 0x015b4b (0x1847d bytes) 000547 1784225653.581627 mapwrite 0x02346e thru 0x0235be (0x151 bytes) 000548 1784225653.622768 punch from 0x019b5f to 0x0234e8 (0x998a bytes) 000549 1784225653.628803 read 0x002c34 thru 0x010bdc (0xdfa9 bytes) 000550 1784225653.641650 read 0x00a0f9 thru 0x00faa5 (0x59ad bytes) 000551 1784225653.642588 write 0x034b93 thru 0x03ffff (0xb46d bytes) 000552 1784225653.646904 MIRROR_RESYNC 2 mirrors 000553 1784225654.108835 write 0x02bc8e thru 0x02e1f0 (0x2563 bytes) 000554 1784225654.152056 mapread 0x009406 thru 0x01640c (0xd007 bytes) 000555 1784225654.187448 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xdb3f364b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb0197a56 Mirror 4: 0xb0197a56 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000556 1784225654.716977 mapread 0x021f49 thru 0x0223cc (0x484 bytes) 000557 1784225654.727178 mapread 0x0298e3 thru 0x031269 (0x7987 bytes) 000558 1784225654.736826 write 0x01afbf thru 0x02aa08 (0xfa4a bytes) 000559 1784225654.774496 write 0x0000ab thru 0x0037f0 (0x3746 bytes) 000560 1784225654.785273 trunc from 0x02ade4 to 0x02bbaa (0xdc7 bytes) 000561 1784225654.800914 mapread 0x037678 thru 0x03ffff (0x8988 bytes) 000562 1784225654.815200 fallocate 0x00ca76 thru 0x0105d0 (0x3b5b bytes) 000563 1784225654.819774 trunc from 0x040000 to 0x029b12 (0x164ed bytes) 000564 1784225654.876597 fallocate 0x02b285 thru 0x039003 (0xdd7f bytes) 000566 1784225654.884011 trunc from 0x029b13 to 0x00a6f7 (0x1f41b bytes) 000567 1784225654.893867 read 0x004b31 thru 0x00a6f7 (0x5bc7 bytes) 000568 1784225654.900736 trunc from 0x00a6f8 to 0x024e78 (0x1a781 bytes) 000569 1784225654.916883 write 0x02ca30 thru 0x036d0e (0xa2df bytes) 000570 1784225654.919584 fallocate 0x00e788 thru 0x01d16d (0xe9e6 bytes) 000572 1784225654.931846 MIRROR_RESYNC 3 mirrors 000574 1784225655.448512 MIRROR_EXTEND to 4 mirrors 000575 1784225655.940766 mapread 0x0145a8 thru 0x023f96 (0xf9ef bytes) 000576 1784225655.965018 read 0x02af5d thru 0x036d0e (0xbdb2 bytes) 000577 1784225655.976866 fallocate 0x0031b4 thru 0x00c9d1 (0x981e bytes) 000578 1784225656.006808 mapread 0x0333ca thru 0x0364d8 (0x310f bytes) 000579 1784225656.025913 MIRROR_RESYNC 4 mirrors 000580 1784225656.568427 mapread 0x017cbe thru 0x01b22c (0x356f bytes) 000581 1784225656.581400 punch from 0x01d190 to 0x021c0c (0x4a7d bytes) 000582 1784225656.611072 punch from 0x00f509 to 0x01430b (0x4e03 bytes) 000583 1784225656.616948 trunc from 0x02b8b2 to 0x033153 (0x78a2 bytes) 000584 1784225656.621983 fallocate 0x03d0f9 thru 0x03ffff (0x2f07 bytes) 000585 1784225656.625641 fallocate 0x005935 thru 0x00b939 (0x6005 bytes) 000586 1784225656.629154 write 0x00cfc4 thru 0x0161ee (0x922b bytes) 000587 1784225656.638561 read 0x0041aa thru 0x00bad4 (0x792b bytes) 000588 1784225656.646065 mapread 0x01adc2 thru 0x020253 (0x5492 bytes) 000589 1784225656.657271 write 0x02fdda thru 0x03a03c (0xa263 bytes) 000590 1784225656.665532 trunc from 0x036cf5 to 0x03a03c (0x3348 bytes) 000591 1784225656.681320 trunc from 0x03a03d to 0x03e5d4 (0x4598 bytes) 000592 1784225656.705033 mapread 0x018eee thru 0x0211f8 (0x830b bytes) 000593 1784225656.706284 punch from 0x02dd3a to 0x03d546 (0xf80d bytes) 000594 1784225656.713841 fallocate 0x02d35c thru 0x03c524 (0xf1c9 bytes) 000595 1784225656.722501 punch from 0x00abed to 0x00bfc0 (0x13d4 bytes) 000596 1784225656.727181 mapwrite 0x003e3f thru 0x010b45 (0xcd07 bytes) 000597 1784225656.755340 punch from 0x014914 to 0x01f499 (0xab86 bytes) 000598 1784225656.764667 write 0x03cfc1 thru 0x03ffff (0x303f bytes) 000599 1784225656.775912 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xadb8e1e2 (stale) Mirror 4: 0xadb8e1e2 (stale) Mirror 5: 0xadb8e1e2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x991b861f Mirror 6: 0x991b861f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000600 1784225657.303740 fallocate 0x02f0c6 thru 0x03d6e6 (0xe621 bytes) 000601 1784225657.347523 read 0x0163d5 thru 0x023036 (0xcc62 bytes) 000602 1784225657.358814 write 0x03db76 thru 0x03ffff (0x248a bytes) 000603 1784225657.367452 mapwrite 0x0182d0 thru 0x025e62 (0xdb93 bytes) 000604 1784225657.398426 mapread 0x0161bc thru 0x01e7db (0x8620 bytes) 000605 1784225657.399642 trunc from 0x011430 to 0x01e32e (0xceff bytes) 000606 1784225657.407064 read 0x0008f8 thru 0x0038e2 (0x2feb bytes) 000607 1784225657.424402 trunc from 0x040000 to 0x005944 (0x3a6bb bytes) 000608 1784225657.453096 fallocate 0x011187 thru 0x017397 (0x6211 bytes) 000609 1784225657.458499 fallocate 0x03c793 thru 0x03ffff (0x386d bytes) 000610 1784225657.464247 mapread 0x00c895 thru 0x015c32 (0x939e bytes) 000612 1784225657.514074 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xadb8e1e2 (stale) Mirror 4: 0xadb8e1e2 (stale) Mirror 5: 0xadb8e1e2 (stale) Mirror 6: 0x991b861f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7a2e6bda Mirror 7: 0x7a2e6bda lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000613 1784225658.087094 trunc from 0x02af38 to 0x02d67c (0x2745 bytes) 000614 1784225658.114217 mapread 0x015f1b thru 0x01b220 (0x5306 bytes) 000615 1784225658.138352 read 0x034f0b thru 0x037dcd (0x2ec3 bytes) 000616 1784225658.146129 trunc from 0x040000 to 0x008383 (0x37c7c bytes) 000617 1784225658.211636 trunc from 0x008384 to 0x01006b (0x7ce8 bytes) 000618 1784225658.226613 write 0x002f02 thru 0x0072ab (0x43aa bytes) 000619 1784225658.237581 punch from 0x00e3de to 0x01006b (0x1c8e bytes) 000620 1784225658.241193 trunc from 0x0069fc to 0x00a626 (0x3c2b bytes) 000621 1784225658.250914 fallocate 0x01409f thru 0x0226ac (0xe60e bytes) 000622 1784225658.254636 write 0x008524 thru 0x00ca42 (0x451f bytes) 000623 1784225658.264151 mapread 0x00fb93 thru 0x01006b (0x4d9 bytes) 000624 1784225658.274316 write 0x00816d thru 0x0178b4 (0xf748 bytes) 000625 1784225658.276584 mapwrite 0x030266 thru 0x039113 (0x8eae bytes) 000626 1784225658.340917 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x39114): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39114): Mirror 3: 0xd6a58402 (stale) Mirror 4: 0xd6a58402 (stale) Mirror 5: 0xd6a58402 (stale) Mirror 6: 0x87821f4a (stale) Mirror 7: 0x1a42842c (stale) CRC-32 checksum value for chunk [0, 0x39114): Mirror 1: 0xac8669ce Mirror 8: 0xac8669ce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39114: skipped 000627 1784225658.947316 trunc from 0x039114 to 0x03598b (0x3788 bytes) 000628 1784225659.011654 read 0x01de86 thru 0x0288f5 (0xaa70 bytes) 000629 1784225659.027147 mapwrite 0x022498 thru 0x02ec61 (0xc7ca bytes) 000630 1784225659.076658 write 0x004820 thru 0x00cd93 (0x8574 bytes) 000631 1784225659.087258 trunc from 0x0023cc to 0x006f15 (0x4b4a bytes) 000632 1784225659.114070 write 0x03e42c thru 0x03e860 (0x435 bytes) 000633 1784225659.116314 read 0x0035f4 thru 0x00c740 (0x914d bytes) 000634 1784225659.128236 punch from 0x010341 to 0x01ac78 (0xa938 bytes) 000635 1784225659.137397 mapwrite 0x02f0ee thru 0x034fa1 (0x5eb4 bytes) 000636 1784225659.162338 trunc from 0x0070d6 to 0x00ebd0 (0x7afb bytes) 000637 1784225659.168477 trunc from 0x032a39 to 0x0386a8 (0x5c70 bytes) 000638 1784225659.175089 read 0x038153 thru 0x03bbb6 (0x3a64 bytes) 000639 1784225659.185809 trunc from 0x02189b to 0x02dffd (0xc763 bytes) 000640 1784225659.191295 punch from 0x022ba0 to 0x02697e (0x3ddf bytes) 000642 1784225659.198123 write 0x00a428 thru 0x014ab9 (0xa692 bytes) 000643 1784225659.200661 trunc from 0x0381cf to 0x03e860 (0x6692 bytes) 000645 1784225659.208461 punch from 0x021e33 to 0x0281d7 (0x63a5 bytes) 000646 1784225659.213851 punch from 0x0310d1 to 0x0381d4 (0x7104 bytes) 000647 1784225659.224485 write 0x006603 thru 0x00c560 (0x5f5e bytes) 000648 1784225659.225623 trunc from 0x03e861 to 0x024071 (0x1a7ef bytes) 000649 1784225659.247343 write 0x038897 thru 0x03dc11 (0x537b bytes) 000650 1784225659.249189 mapread 0x000d0c thru 0x001863 (0xb58 bytes) 000651 1784225659.250470 write 0x0316f2 thru 0x03ffff (0xe90e bytes) 000652 1784225659.259440 mapwrite 0x02e3ef thru 0x02e993 (0x5a5 bytes) 000653 1784225659.280705 mapread 0x00898e thru 0x008f9a (0x60d bytes) 000654 1784225659.281956 trunc from 0x040000 to 0x03d42a (0x2bd5 bytes) 000656 1784225659.294388 punch from 0x024173 to 0x02be1c (0x7caa bytes) 000657 1784225659.299313 write 0x007ed3 thru 0x009e2c (0x1f5a bytes) 000658 1784225659.300434 trunc from 0x0054a9 to 0x00682f (0x1387 bytes) 000659 1784225659.304665 mapwrite 0x0079ce thru 0x00e1ff (0x6832 bytes) 000660 1784225659.321094 trunc from 0x03d42b to 0x0390f2 (0x4338 bytes) 000661 1784225659.335743 punch from 0x011453 to 0x01345f (0x200d bytes) 000662 1784225659.342312 fallocate 0x036920 thru 0x03ffff (0x96e0 bytes) 000663 1784225659.346873 trunc from 0x0390f3 to 0x03b582 (0x2490 bytes) 000664 1784225659.366284 MIRROR_RESYNC 7 mirrors 000665 1784225661.091834 mapread 0x0115ba thru 0x013c5f (0x26a6 bytes) 000666 1784225661.114266 mapwrite 0x008d03 thru 0x00a091 (0x138f bytes) 000667 1784225661.202321 trunc from 0x03b583 to 0x03bebc (0x93a bytes) 000668 1784225661.248611 punch from 0x007541 to 0x016a5d (0xf51d bytes) 000669 1784225661.260162 trunc from 0x0065a9 to 0x00c61e (0x6076 bytes) 000670 1784225661.276168 MIRROR_RESYNC 7 mirrors 000671 1784225662.848777 mapread 0x01c6d5 thru 0x01d961 (0x128d bytes) 000672 1784225662.858775 trunc from 0x004f1d to 0x00861c (0x3700 bytes) 000673 1784225662.889272 fallocate 0x02cf00 thru 0x03be5d (0xef5e bytes) 000674 1784225662.898916 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3bebd): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bebd): Mirror 3: 0xe2ae1c82 (stale) Mirror 4: 0xe2ae1c82 (stale) Mirror 5: 0xe2ae1c82 (stale) Mirror 6: 0xe2ae1c82 (stale) Mirror 7: 0xe2ae1c82 (stale) Mirror 8: 0xe2ae1c82 (stale) CRC-32 checksum value for chunk [0, 0x3bebd): Mirror 1: 0xe2ae1c82 Mirror 9: 0xe2ae1c82 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bebd: skipped 000675 1784225663.730468 mapwrite 0x031e26 thru 0x0395a3 (0x777e bytes) 000676 1784225663.861769 MIRROR_RESYNC 8 mirrors 000679 1784225665.390919 trunc from 0x03bebd to 0x01390b (0x285b1 bytes) 000680 1784225665.436605 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1390c): Mirror 3: 0xcc570a08 (stale) Mirror 4: 0xcc570a08 (stale) Mirror 5: 0xcc570a08 (stale) Mirror 6: 0xcc570a08 (stale) Mirror 7: 0xcc570a08 (stale) Mirror 9: 0xcc570a08 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1390c): Mirror 3: 0xcc570a08 (stale) Mirror 4: 0xcc570a08 (stale) Mirror 5: 0xcc570a08 (stale) Mirror 6: 0xcc570a08 (stale) Mirror 7: 0xcc570a08 (stale) Mirror 9: 0xcc570a08 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1390c: skipped 000681 1784225665.804445 trunc from 0x00bb4d to 0x01390b (0x7dbf bytes) 000682 1784225665.814826 write 0x0301ba thru 0x03486a (0x46b1 bytes) 000683 1784225665.822075 mapwrite 0x00ac90 thru 0x00ce0d (0x217e bytes) 000684 1784225665.857432 trunc from 0x03486b to 0x01abc0 (0x19caa bytes) 000685 1784225665.871918 punch from 0x00e93d to 0x010445 (0x1b09 bytes) 000686 1784225665.876397 trunc from 0x01abc1 to 0x028404 (0xd844 bytes) 000687 1784225665.888708 trunc from 0x019e56 to 0x028404 (0xe5af bytes) 000688 1784225665.892896 write 0x0268f3 thru 0x033744 (0xce52 bytes) 000689 1784225665.900866 write 0x03d81e thru 0x03ffff (0x27e2 bytes) 000690 1784225665.902232 write 0x023645 thru 0x0289ee (0x53aa bytes) 000691 1784225665.908898 read 0x007345 thru 0x00df28 (0x6be4 bytes) 000692 1784225665.909666 mapwrite 0x01f06d thru 0x02227e (0x3212 bytes) 000693 1784225665.936632 mapwrite 0x00a188 thru 0x00f51e (0x5397 bytes) 000694 1784225665.962383 mapread 0x03419b thru 0x03ffff (0xbe65 bytes) 000695 1784225665.976868 trunc from 0x027fd8 to 0x035509 (0xd532 bytes) 000696 1784225665.981913 punch from 0x022294 to 0x028e0b (0x6b78 bytes) 000698 1784225665.992920 MIRROR_RESYNC 7 mirrors 000699 1784225667.577202 mapwrite 0x0072c2 thru 0x0075a6 (0x2e5 bytes) 000700 1784225667.650016 mapread 0x03d65b thru 0x03ffff (0x29a5 bytes) 000701 1784225667.658833 mapread 0x02ff7d thru 0x03b84a (0xb8ce bytes) 000702 1784225667.670983 mapwrite 0x005b69 thru 0x005ff8 (0x490 bytes) 000703 1784225667.696516 MIRROR_RESYNC 7 mirrors 000704 1784225669.649476 mapread 0x011f7a thru 0x01cf38 (0xafbf bytes) 000705 1784225669.671189 write 0x03cdb7 thru 0x03edf0 (0x203a bytes) 000706 1784225669.696868 read 0x01af27 thru 0x025e08 (0xaee2 bytes) 000707 1784225669.712738 punch from 0x0343c8 to 0x0366a7 (0x22e0 bytes) 000709 1784225669.719393 trunc from 0x004c76 to 0x00fcf7 (0xb082 bytes) 000710 1784225669.728027 MIRROR_RESYNC 7 mirrors 000711 1784225671.015666 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) 000712 1784225671.337014 mapread 0x0327d8 thru 0x036f80 (0x47a9 bytes) 000713 1784225671.364700 read 0x01b47a thru 0x01dea5 (0x2a2c bytes) 000714 1784225671.377230 mapwrite 0x00a657 thru 0x014500 (0x9eaa bytes) 000716 1784225671.485509 write 0x024ed2 thru 0x028ba2 (0x3cd1 bytes) 000717 1784225671.497613 write 0x037507 thru 0x03ffff (0x8af9 bytes) 000718 1784225671.502661 punch from 0x02913d to 0x0384c2 (0xf386 bytes) 000719 1784225671.514944 write 0x02f193 thru 0x039e07 (0xac75 bytes) 000720 1784225671.519933 fallocate 0x00a8a9 thru 0x00eaef (0x4247 bytes) 000721 1784225671.524407 trunc from 0x017ff0 to 0x01ebe7 (0x6bf8 bytes) 000722 1784225671.528205 mapread 0x039151 thru 0x03caab (0x395b bytes) 000723 1784225671.530081 fallocate 0x026f03 thru 0x029a02 (0x2b00 bytes) 000724 1784225671.538186 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x5f8f1812 (stale) Mirror 6: 0x5f8f1812 (stale) Mirror 7: 0x5f8f1812 (stale) Mirror 9: 0x5f8f1812 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x5f8f1812 (stale) Mirror 6: 0x5f8f1812 (stale) Mirror 7: 0x5f8f1812 (stale) Mirror 9: 0x5f8f1812 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000725 1784225671.915725 punch from 0x03dd79 to 0x03ffff (0x2287 bytes) 000726 1784225671.924777 mapread 0x029889 thru 0x030200 (0x6978 bytes) 000727 1784225671.942966 mapwrite 0x0074f5 thru 0x00b23a (0x3d46 bytes) 000728 1784225671.992361 mapread 0x010bea thru 0x01c8ac (0xbcc3 bytes) 000729 1784225672.011529 punch from 0x0047ac to 0x0092bb (0x4b10 bytes) 000731 1784225672.020114 mapread 0x012ff0 thru 0x014c68 (0x1c79 bytes) 000732 1784225672.021024 write 0x027b81 thru 0x035a35 (0xdeb5 bytes) 000733 1784225672.036093 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x5f8f1812 (stale) Mirror 6: 0x5f8f1812 (stale) Mirror 7: 0x5f8f1812 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x5f8f1812 (stale) Mirror 6: 0x5f8f1812 (stale) Mirror 7: 0x5f8f1812 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000734 1784225672.319218 trunc from 0x040000 to 0x039ea0 (0x615f bytes) 000735 1784225672.339053 trunc from 0x0016ac to 0x00e3ef (0xcd44 bytes) 000736 1784225672.346187 mapread 0x038e2d thru 0x039ea0 (0x1074 bytes) 000737 1784225672.360028 trunc from 0x039ea1 to 0x00d925 (0x2c57b bytes) 000738 1784225672.380818 MIRROR_RESYNC 4 mirrors 000739 1784225673.019478 write 0x03ffb5 thru 0x03ffff (0x4b bytes) 000740 1784225673.046173 write 0x03100e thru 0x036cc3 (0x5cb6 bytes) 000741 1784225673.071364 MIRROR_RESYNC 4 mirrors 000742 1784225673.986298 MIRROR_RESYNC 4 mirrors 000743 1784225674.350388 mapwrite 0x025806 thru 0x027c2a (0x2425 bytes) 000744 1784225674.437243 MIRROR_RESYNC 4 mirrors 000745 1784225675.378700 MIRROR_EXTEND to 5 mirrors 000746 1784225676.079167 punch from 0x011c12 to 0x01d716 (0xbb05 bytes) 000747 1784225676.121123 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xf8028a0c (stale) Mirror 6: 0xf8028a0c (stale) Mirror 7: 0xf8028a0c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xf8028a0c (stale) Mirror 6: 0xf8028a0c (stale) Mirror 7: 0xf8028a0c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000749 1784225676.405469 fallocate 0x00baa8 thru 0x018797 (0xccf0 bytes) 000750 1784225676.413048 MIRROR_RESYNC 4 mirrors 000751 1784225677.250109 write 0x010b39 thru 0x0116af (0xb77 bytes) 000752 1784225677.281308 read 0x0000e3 thru 0x00f882 (0xf7a0 bytes) 000753 1784225677.290861 read 0x01eea2 thru 0x0213f9 (0x2558 bytes) 000754 1784225677.302888 mapwrite 0x01a7d7 thru 0x0268b5 (0xc0df bytes) 000755 1784225677.333453 write 0x005c32 thru 0x0149b5 (0xed84 bytes) 000756 1784225677.338851 write 0x03e11d thru 0x03ffff (0x1ee3 bytes) 000757 1784225677.340799 write 0x002417 thru 0x00f50b (0xd0f5 bytes) 000758 1784225677.343256 write 0x006bb6 thru 0x008836 (0x1c81 bytes) 000759 1784225677.344986 mapread 0x022082 thru 0x0257fc (0x377b bytes) 000760 1784225677.348633 punch from 0x004fee to 0x009af0 (0x4b03 bytes) 000761 1784225677.370957 trunc from 0x0373f3 to 0x03ffff (0x8c0d bytes) 000763 1784225677.382689 MIRROR_RESYNC 4 mirrors 000764 1784225678.524475 trunc from 0x040000 to 0x005272 (0x3ad8d bytes) 000765 1784225678.570987 mapread 0x004795 thru 0x005272 (0xade bytes) 000766 1784225678.589233 mapread 0x0012a1 thru 0x005272 (0x3fd2 bytes) 000767 1784225678.595315 write 0x033301 thru 0x03ffff (0xccff bytes) 000768 1784225678.597710 trunc from 0x0206fe to 0x024d22 (0x4625 bytes) 000769 1784225678.604604 write 0x0172fe thru 0x0214b9 (0xa1bc bytes) 000771 1784225678.618426 fallocate 0x00fcd8 thru 0x01b614 (0xb93d bytes) 000772 1784225678.626478 read 0x017aba thru 0x01813e (0x685 bytes) 000773 1784225678.627624 mapread 0x016a98 thru 0x0212bc (0xa825 bytes) 000775 1784225678.642916 write 0x03a5a8 thru 0x03ffff (0x5a58 bytes) 000776 1784225678.644116 punch from 0x00e781 to 0x01ba28 (0xd2a8 bytes) 000777 1784225678.660947 fallocate 0x021c5e thru 0x02679b (0x4b3e bytes) 000778 1784225678.665588 read 0x004ab8 thru 0x00fdde (0xb327 bytes) 000779 1784225678.675392 write 0x025770 thru 0x03119c (0xba2d bytes) 000780 1784225678.677737 fallocate 0x01249c thru 0x01a2f5 (0x7e5a bytes) 000781 1784225678.683321 mapwrite 0x001f42 thru 0x00a10b (0x81ca bytes) 000782 1784225678.700512 trunc from 0x005262 to 0x00e15c (0x8efb bytes) 000783 1784225678.704980 mapwrite 0x023cc9 thru 0x0281cf (0x4507 bytes) 000785 1784225678.721351 trunc from 0x016dfd to 0x02552b (0xe72f bytes) 000786 1784225678.727080 trunc from 0x00faf5 to 0x013f9d (0x44a9 bytes) 000787 1784225678.737904 MIRROR_RESYNC 4 mirrors 000788 1784225679.538482 fallocate 0x02a93b thru 0x036417 (0xbadd bytes) 000789 1784225679.563615 punch from 0x0234c8 to 0x02fa39 (0xc572 bytes) 000790 1784225679.571300 MIRROR_RESYNC 4 mirrors 000791 1784225680.362889 write 0x0333a9 thru 0x0365e9 (0x3241 bytes) 000793 1784225680.404768 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xa2b40d47 (stale) Mirror 7: 0xa2b40d47 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xa2b40d47 (stale) Mirror 7: 0xa2b40d47 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000795 1784225680.669475 write 0x00f697 thru 0x01bd2f (0xc699 bytes) 000796 1784225680.686297 mapread 0x016f5e thru 0x0245be (0xd661 bytes) 000797 1784225680.705267 trunc from 0x00a2b1 to 0x00d4c9 (0x3219 bytes) 000798 1784225680.709923 fallocate 0x015856 thru 0x019565 (0x3d10 bytes) 000799 1784225680.715870 punch from 0x017048 to 0x01dfb0 (0x6f69 bytes) 000800 1784225680.728276 mapwrite 0x02d06f thru 0x0390b0 (0xc042 bytes) 000801 1784225680.766380 trunc from 0x00ae7a to 0x016387 (0xb50e bytes) 000802 1784225680.778883 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xa2b40d47 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xa2b40d47 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000803 1784225681.060082 MIRROR_RESYNC 2 mirrors 000804 1784225681.620112 trunc from 0x038da6 to 0x03d019 (0x4274 bytes) 000805 1784225681.658974 punch from 0x037816 to 0x03ffff (0x87ea bytes) 000806 1784225681.680777 mapwrite 0x01168d thru 0x01879e (0x7112 bytes) 000807 1784225681.747233 trunc from 0x040000 to 0x01579b (0x2a864 bytes) 000809 1784225681.771334 mapwrite 0x02dc5a thru 0x02f062 (0x1409 bytes) 000810 1784225681.818233 trunc from 0x02f063 to 0x00124a (0x2de18 bytes) 000811 1784225681.837160 punch from 0x000176 to 0x00124a (0x10d5 bytes) 000812 1784225681.840958 mapwrite 0x00ddf5 thru 0x00e89a (0xaa6 bytes) 000813 1784225681.895060 mapread 0x00e74a thru 0x00e89a (0x151 bytes) 000814 1784225681.896827 write 0x0223aa thru 0x028885 (0x64dc bytes) 000815 1784225681.898938 fallocate 0x01555d thru 0x01ed01 (0x97a5 bytes) 000816 1784225681.903903 punch from 0x00cbb6 to 0x018b5a (0xbfa5 bytes) 000817 1784225681.908160 trunc from 0x00eb79 to 0x017180 (0x8608 bytes) 000818 1784225681.911988 trunc from 0x0172fd to 0x022855 (0xb559 bytes) 000819 1784225681.927595 punch from 0x007899 to 0x0137b5 (0xbf1d bytes) 000820 1784225681.934343 fallocate 0x004fb1 thru 0x0055bf (0x60f bytes) 000821 1784225681.941931 read 0x010607 thru 0x01c34b (0xbd45 bytes) 000822 1784225681.960629 trunc from 0x002fa9 to 0x008bfc (0x5c54 bytes) 000823 1784225681.975082 trunc from 0x028886 to 0x009ec5 (0x1e9c0 bytes) 000824 1784225681.999686 punch from 0x001fa5 to 0x009ec5 (0x7f21 bytes) 000825 1784225682.006193 mapread 0x009000 thru 0x009ec5 (0xec6 bytes) 000826 1784225682.019895 MIRROR_RESYNC 2 mirrors 000827 1784225682.464852 write 0x02debe thru 0x03320c (0x534f bytes) 000828 1784225682.487682 trunc from 0x01494c to 0x0229c0 (0xe075 bytes) 000830 1784225682.499657 mapwrite 0x03b98a thru 0x03ffff (0x4676 bytes) 000831 1784225682.566193 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xd08a6c9c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6d2fb1d9 Mirror 6: 0x6d2fb1d9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000832 1784225683.251952 read 0x00630a thru 0x01151b (0xb212 bytes) 000833 1784225683.270288 punch from 0x00d27d to 0x016f5d (0x9ce1 bytes) 000834 1784225683.314093 mapread 0x02f8bc thru 0x03cf6e (0xd6b3 bytes) 000835 1784225683.348310 fallocate 0x0090da thru 0x009ddf (0xd06 bytes) 000836 1784225683.352711 trunc from 0x040000 to 0x03ef45 (0x10ba bytes) 000837 1784225683.396460 mapread 0x02fd7e thru 0x038ed4 (0x9157 bytes) 000838 1784225683.397763 mapread 0x0321fc thru 0x03ef45 (0xcd4a bytes) 000839 1784225683.399304 punch from 0x000581 to 0x0086ba (0x813a bytes) 000842 1784225683.407039 fallocate 0x03fd77 thru 0x03ffff (0x289 bytes) 000843 1784225683.411200 read 0x025d49 thru 0x029555 (0x380d bytes) 000844 1784225683.423531 punch from 0x036115 to 0x03ffff (0x9eeb bytes) 000845 1784225683.432397 fallocate 0x02c28e thru 0x02fc66 (0x39d9 bytes) 000846 1784225683.442732 trunc from 0x01b959 to 0x01f45f (0x3b07 bytes) 000847 1784225683.448234 trunc from 0x025e7f to 0x029a8c (0x3c0e bytes) 000848 1784225683.454957 mapread 0x015837 thru 0x017afb (0x22c5 bytes) 000849 1784225683.456344 mapwrite 0x03a797 thru 0x03c913 (0x217d bytes) 000850 1784225683.491046 trunc from 0x00d0db to 0x00e834 (0x175a bytes) 000851 1784225683.495574 trunc from 0x03c8cf to 0x03ffff (0x3731 bytes) 000852 1784225683.501649 read 0x020ddc thru 0x02e418 (0xd63d bytes) 000853 1784225683.515359 trunc from 0x0022a5 to 0x009f4b (0x7ca7 bytes) 000854 1784225683.520287 fallocate 0x022c6a thru 0x0307e5 (0xdb7c bytes) 000855 1784225683.529882 write 0x012495 thru 0x01d911 (0xb47d bytes) 000856 1784225683.534387 write 0x0272cc thru 0x02c6c3 (0x53f8 bytes) 000857 1784225683.535822 mapwrite 0x005451 thru 0x0099fd (0x45ad bytes) 000858 1784225683.589008 fallocate 0x03caf3 thru 0x03ffff (0x350d bytes) 000859 1784225683.598666 MIRROR_RESYNC 3 mirrors 000860 1784225684.606522 trunc from 0x040000 to 0x03a8c8 (0x5737 bytes) 000861 1784225684.644778 read 0x028e8d thru 0x038416 (0xf58a bytes) 000862 1784225684.660138 read 0x001c63 thru 0x01151e (0xf8bc bytes) 000863 1784225684.667579 mapwrite 0x0397f6 thru 0x03ffff (0x680a bytes) 000864 1784225684.719660 mapread 0x0265e1 thru 0x02c222 (0x5c42 bytes) 000865 1784225684.721276 fallocate 0x03ec10 thru 0x03ffff (0x13f0 bytes) 000867 1784225684.728260 trunc from 0x040000 to 0x03e84d (0x17b2 bytes) 000868 1784225684.745323 punch from 0x01450b to 0x021052 (0xcb48 bytes) 000869 1784225684.752996 mapwrite 0x038430 thru 0x039e30 (0x1a01 bytes) 000870 1784225684.777190 MIRROR_RESYNC 3 mirrors 000871 1784225685.652490 MIRROR_EXTEND to 4 mirrors 000872 1784225686.290164 read 0x010aa6 thru 0x013bf8 (0x3153 bytes) 000873 1784225686.296051 punch from 0x00cc65 to 0x01478f (0x7b2b bytes) 000874 1784225686.325728 mapwrite 0x039c32 thru 0x03e313 (0x46e2 bytes) 000875 1784225686.373985 trunc from 0x03e84e to 0x025cbc (0x18b91 bytes) 000876 1784225686.400329 fallocate 0x033f4d thru 0x03f30a (0xb3be bytes) 000877 1784225686.405600 mapwrite 0x039b1e thru 0x03ffff (0x64e2 bytes) 000878 1784225686.439799 mapwrite 0x021b38 thru 0x025031 (0x34fa bytes) 000879 1784225686.465667 trunc from 0x040000 to 0x009155 (0x36eaa bytes) 000880 1784225686.490013 read 0x004845 thru 0x009155 (0x4911 bytes) 000881 1784225686.500063 mapwrite 0x0378d2 thru 0x03ffff (0x872e bytes) 000882 1784225686.551367 write 0x03d6ea thru 0x03ffff (0x2916 bytes) 000883 1784225686.552652 trunc from 0x00c3a7 to 0x010e58 (0x4ab2 bytes) 000884 1784225686.558886 mapwrite 0x018ddf thru 0x01f8f5 (0x6b17 bytes) 000885 1784225686.586724 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x51b941c4 (stale) Mirror 6: 0x51b941c4 (stale) Mirror 7: 0x51b941c4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf6c28685 Mirror 8: 0xf6c28685 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000886 1784225687.263672 fallocate 0x021488 thru 0x02be41 (0xa9ba bytes) 000887 1784225687.294782 punch from 0x00d131 to 0x00e01e (0xeee bytes) 000888 1784225687.301139 punch from 0x023551 to 0x02f6a1 (0xc151 bytes) 000889 1784225687.305124 fallocate 0x0215aa thru 0x0292ee (0x7d45 bytes) 000890 1784225687.311781 trunc from 0x040000 to 0x02c1eb (0x13e14 bytes) 000891 1784225687.347060 trunc from 0x02c1ec to 0x01dc60 (0xe58b bytes) 000892 1784225687.358576 punch from 0x016b85 to 0x01ba3b (0x4eb7 bytes) 000893 1784225687.362399 write 0x02bcab thru 0x031194 (0x54ea bytes) 000894 1784225687.364130 write 0x0313d7 thru 0x0361e8 (0x4e12 bytes) 000896 1784225687.365813 trunc from 0x02c7c1 to 0x030112 (0x3952 bytes) 000897 1784225687.376333 write 0x03baf5 thru 0x03ffff (0x450b bytes) 000898 1784225687.377675 trunc from 0x01ba09 to 0x0249bb (0x8fb3 bytes) 000899 1784225687.385606 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1e3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x51b941c4 (stale) Mirror 6: 0x51b941c4 (stale) Mirror 8: 0xf6c28685 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x51b941c4 (stale) Mirror 6: 0x51b941c4 (stale) Mirror 8: 0xf6c28685 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000900 1784225687.598444 punch from 0x010ddc to 0x01ebbf (0xdde4 bytes) 000901 1784225687.602426 read 0x031566 thru 0x033482 (0x1f1d bytes) 000902 1784225687.606427 mapread 0x037b15 thru 0x03ffff (0x84eb bytes) 000903 1784225687.620324 punch from 0x02f321 to 0x03795a (0x863a bytes) 000904 1784225687.623800 read 0x01b40f thru 0x02550e (0xa100 bytes) 000905 1784225687.631456 mapwrite 0x00fbb0 thru 0x01ccfd (0xd14e bytes) 000907 1784225687.655582 MIRROR_RESYNC 4 mirrors 000908 1784225688.619465 mapread 0x02fe0c thru 0x035d6d (0x5f62 bytes) 000909 1784225688.653186 mapwrite 0x004c2b thru 0x00ebc8 (0x9f9e bytes) 000910 1784225688.719820 mapread 0x01759d thru 0x021e41 (0xa8a5 bytes) 000911 1784225688.734834 read 0x002f56 thru 0x0120c9 (0xf174 bytes) 000913 1784225688.736069 trunc from 0x0118fa to 0x01cd4f (0xb456 bytes) 000914 1784225688.740205 read 0x0369d0 thru 0x037ceb (0x131c bytes) 000915 1784225688.751446 punch from 0x0103e2 to 0x011371 (0xf90 bytes) 000916 1784225688.755444 trunc from 0x022f9b to 0x030639 (0xd69f bytes) 000918 1784225688.761567 write 0x004d72 thru 0x00ee83 (0xa112 bytes) 000919 1784225688.762855 trunc from 0x000618 to 0x00794b (0x7334 bytes) 000920 1784225688.776975 read 0x02490d thru 0x02d1aa (0x889e bytes) 000922 1784225688.787753 punch from 0x01fb4e to 0x025a38 (0x5eeb bytes) 000923 1784225688.792444 trunc from 0x040000 to 0x03d205 (0x2dfa bytes) 000924 1784225688.811802 mapread 0x0269f5 thru 0x034448 (0xda54 bytes) 000925 1784225688.813809 punch from 0x01d770 to 0x02c929 (0xf1ba bytes) 000926 1784225688.821933 trunc from 0x03d206 to 0x0013a6 (0x3be5f bytes) 000927 1784225688.839259 punch from 0x0007fe to 0x000a60 (0x263 bytes) 000928 1784225688.845493 write 0x0165d2 thru 0x01cb1a (0x6549 bytes) 000929 1784225688.846928 punch from 0x00b122 to 0x00ddd7 (0x2cb6 bytes) 000930 1784225688.850693 punch from 0x01c0e6 to 0x01cb1a (0xa35 bytes) 000932 1784225688.863353 trunc from 0x01cb1b to 0x032372 (0x15858 bytes) 000933 1784225688.881705 fallocate 0x0180c3 thru 0x021bc5 (0x9b03 bytes) 000934 1784225688.886711 punch from 0x0160ef to 0x017f32 (0x1e44 bytes) 000935 1784225688.891973 punch from 0x0157ba to 0x01be84 (0x66cb bytes) 000937 1784225688.896405 write 0x012732 thru 0x015b38 (0x3407 bytes) 000938 1784225688.904053 mapwrite 0x03e254 thru 0x03ffff (0x1dac bytes) 000940 1784225688.935004 mapread 0x0184d6 thru 0x01b5de (0x3109 bytes) 000941 1784225688.955828 MIRROR_RESYNC 4 mirrors 000942 1784225689.720388 MIRROR_RESYNC 4 mirrors 000943 1784225690.030863 mapread 0x01ff4e thru 0x020c04 (0xcb7 bytes) 000944 1784225690.040791 write 0x03de22 thru 0x03ffff (0x21de bytes) 000945 1784225690.073724 write 0x027abb thru 0x02dc18 (0x615e bytes) 000946 1784225690.085105 trunc from 0x040000 to 0x024feb (0x1b014 bytes) 000947 1784225690.107103 read 0x01b618 thru 0x0245be (0x8fa7 bytes) 000949 1784225690.117046 trunc from 0x024fec to 0x01dbca (0x7421 bytes) 000950 1784225690.133511 mapwrite 0x035813 thru 0x03ffff (0xa7ed bytes) 000952 1784225690.182878 write 0x038e2a thru 0x03ffff (0x71d6 bytes) 000953 1784225690.184104 trunc from 0x040000 to 0x031bd4 (0xe42b bytes) 000954 1784225690.196434 read 0x007913 thru 0x01471b (0xce09 bytes) 000955 1784225690.204392 trunc from 0x031bd5 to 0x00ee44 (0x22d90 bytes) 000956 1784225690.220350 trunc from 0x000a5a to 0x0094ea (0x8a91 bytes) 000957 1784225690.224611 trunc from 0x005e82 to 0x00ee44 (0x8fc3 bytes) 000958 1784225690.230454 trunc from 0x006f76 to 0x00ee44 (0x7ecf bytes) 000959 1784225690.237404 write 0x02281c thru 0x029e4d (0x7632 bytes) 000960 1784225690.238826 punch from 0x00f91f to 0x01bd46 (0xc428 bytes) 000961 1784225690.244343 write 0x02cdab thru 0x038111 (0xb367 bytes) 000962 1784225690.245978 fallocate 0x01666e thru 0x01e859 (0x81ec bytes) 000963 1784225690.250032 mapread 0x02ea1b thru 0x038111 (0x96f7 bytes) 000964 1784225690.251743 trunc from 0x038112 to 0x03901c (0xf0b bytes) 000965 1784225690.274453 fallocate 0x015f29 thru 0x01ee4e (0x8f26 bytes) 000967 1784225690.287240 read 0x025dec thru 0x034844 (0xea59 bytes) 000969 1784225690.298890 read 0x027d37 thru 0x02a175 (0x243f bytes) 000970 1784225690.303526 MIRROR_RESYNC 4 mirrors 000971 1784225691.092664 fallocate 0x00f369 thru 0x012a53 (0x36eb bytes) 000972 1784225691.123879 trunc from 0x03901d to 0x023ac1 (0x1555b bytes) 000973 1784225691.167993 mapwrite 0x038f2e thru 0x03b7b9 (0x288c bytes) 000974 1784225691.218817 write 0x0037ac thru 0x01220c (0xea61 bytes) 000975 1784225691.228339 write 0x02df8d thru 0x02e8e0 (0x954 bytes) 000976 1784225691.242260 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3b7ba): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b7ba): Mirror 5: 0x18ffa77c (stale) Mirror 6: 0x18ffa77c (stale) Mirror 8: 0x18ffa77c (stale) CRC-32 checksum value for chunk [0, 0x3b7ba): Mirror 1: 0x4fd6a7e6 Mirror 9: 0x4fd6a7e6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b7ba: skipped 000977 1784225691.920375 write 0x00cff3 thru 0x0136ea (0x66f8 bytes) 000978 1784225691.962562 trunc from 0x03b7ba to 0x00d834 (0x2df85 bytes) 000979 1784225691.993810 read 0x005063 thru 0x00b65f (0x65fd bytes) 000980 1784225692.001736 fallocate 0x000b34 thru 0x004da1 (0x426e bytes) 000981 1784225692.013019 MIRROR_RESYNC 5 mirrors 000982 1784225692.700013 mapread 0x005041 thru 0x00d834 (0x87f4 bytes) 000983 1784225692.716928 mapwrite 0x024dfa thru 0x028fb6 (0x41bd bytes) 000984 1784225692.768363 mapwrite 0x026809 thru 0x02eb74 (0x836c bytes) 000985 1784225692.806463 write 0x03c61b thru 0x03d5ba (0xfa0 bytes) 000986 1784225692.807622 read 0x00eab2 thru 0x015b2c (0x707b bytes) 000987 1784225692.819674 read 0x03084f thru 0x03465d (0x3e0f bytes) 000988 1784225692.828045 punch from 0x017409 to 0x026fb3 (0xfbab bytes) 000989 1784225692.837974 read 0x02f6c1 thru 0x03d5ba (0xdefa bytes) 000990 1784225692.840087 trunc from 0x03a1d0 to 0x03d425 (0x3256 bytes) 000991 1784225692.851606 trunc from 0x03d5bb to 0x02a24c (0x1336e bytes) 000992 1784225692.872530 punch from 0x00156a to 0x00b573 (0xa00a bytes) 000993 1784225692.883076 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2a24d): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a24d): Mirror 5: 0xcaf07fcc (stale) Mirror 6: 0xcaf07fcc (stale) Mirror 8: 0xcaf07fcc (stale) Mirror 9: 0xcaf07fcc (stale) CRC-32 checksum value for chunk [0, 0x2a24d): Mirror 1: 0x39744890 Mirror 10: 0x39744890 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a24d: skipped 000994 1784225693.547984 fallocate 0x01438a thru 0x01561b (0x1292 bytes) 000995 1784225693.575478 mapread 0x00cfd3 thru 0x01bfee (0xf01c bytes) 000996 1784225693.598740 mapwrite 0x025de8 thru 0x0357a7 (0xf9c0 bytes) 000997 1784225693.654452 punch from 0x034ddd to 0x0357a7 (0x9cb bytes) 000998 1784225693.661480 mapread 0x0124bc thru 0x01d508 (0xb04d bytes) 000999 1784225693.665307 read 0x027224 thru 0x02a5cc (0x33a9 bytes) All operations completed A-OK!