== sanity-flr test 70a: flr mode fsx test ================ 23:32:54 (1783135974) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 5976 000001 1783135976.905931 mapwrite 0x02f807 thru 0x03a169 (0xa963 bytes) 000002 1783135977.042716 mapwrite 0x02f933 thru 0x03a229 (0xa8f7 bytes) 000003 1783135977.115108 punch from 0x030072 to 0x033da6 (0x3d35 bytes) 000004 1783135977.150509 MIRROR_EXTEND to 2 mirrors 000005 1783135978.129339 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) truncating to largest ever: 0x1c3ef 000007 1783135978.442528 trunc from 0x03a22a to 0x01c3ee (0x1de3b bytes) 000008 1783135978.565056 trunc from 0x003aeb to 0x004734 (0xc4a bytes) 000009 1783135978.577267 trunc from 0x016d10 to 0x01c3ee (0x56df bytes) 000010 1783135978.596418 trunc from 0x01c3ef to 0x01ae08 (0x15e6 bytes) 000011 1783135978.634677 punch from 0x00dcdd to 0x01ae08 (0xd12c bytes) 000013 1783135978.643514 fallocate 0x007f17 thru 0x00d4e2 (0x55cc bytes) 000015 1783135978.651358 mapread 0x00d300 thru 0x010795 (0x3496 bytes) 000016 1783135978.684826 trunc from 0x01ae09 to 0x0147ee (0x661a bytes) 000017 1783135978.724720 mapwrite 0x007d9d thru 0x0097de (0x1a42 bytes) truncating to largest ever: 0x37e91 000018 1783135978.772899 trunc from 0x0147ef to 0x037e90 (0x236a2 bytes) 000019 1783135978.794052 trunc from 0x037e91 to 0x01c0b2 (0x1bdde bytes) 000020 1783135978.818249 fallocate 0x00ab92 thru 0x011d52 (0x71c1 bytes) 000021 1783135978.826993 mapwrite 0x0063ab thru 0x006889 (0x4df bytes) 000022 1783135978.855810 read 0x0112db thru 0x014af1 (0x3817 bytes) 000023 1783135978.863561 MIRROR_EXTEND to 2 mirrors 000024 1783135980.035557 trunc from 0x01c0b3 to 0x0208cb (0x4819 bytes) 000026 1783135980.108626 mapread 0x003c52 thru 0x009263 (0x5612 bytes) 000027 1783135980.137273 mapread 0x00e908 thru 0x01aebb (0xc5b4 bytes) 000028 1783135980.179950 mapwrite 0x002764 thru 0x011061 (0xe8fe bytes) 000029 1783135980.230544 trunc from 0x0208cc to 0x02c04e (0xb783 bytes) 000030 1783135980.257822 write 0x023062 thru 0x023d28 (0xcc7 bytes) 000031 1783135980.269905 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2c04f): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c04f): Mirror 2: 0xc2e2d418 (stale) CRC-32 checksum value for chunk [0, 0x2c04f): Mirror 1: 0xfcc09880 Mirror 3: 0xfcc09880 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c04f: skipped 000032 1783135981.291997 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c04f): Mirror 2: 0xc2e2d418 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c04f): Mirror 2: 0xc2e2d418 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c04f: skipped 000033 1783135981.636840 MIRROR_RESYNC 2 mirrors 000034 1783135982.742275 mapread 0x0082d6 thru 0x0101b7 (0x7ee2 bytes) 000035 1783135982.787578 punch from 0x00d0b7 to 0x016d27 (0x9c71 bytes) 000036 1783135982.839366 write 0x006f1f thru 0x00faaf (0x8b91 bytes) 000037 1783135982.876631 MIRROR_RESYNC 2 mirrors 000038 1783135983.801841 fallocate 0x022b6b thru 0x02beb8 (0x934e bytes) 000040 1783135983.832416 read 0x025dd7 thru 0x02c04e (0x6278 bytes) 000041 1783135983.843156 read 0x025bfd thru 0x028220 (0x2624 bytes) 000042 1783135983.843983 read 0x01ff9e thru 0x0217b7 (0x181a bytes) 000044 1783135983.859633 read 0x02a32c thru 0x02c04e (0x1d23 bytes) 000045 1783135983.860436 mapwrite 0x00154a thru 0x002200 (0xcb7 bytes) truncating to largest ever: 0x3d623 000046 1783135983.876442 trunc from 0x02c04f to 0x03d622 (0x115d4 bytes) 000047 1783135983.902788 MIRROR_RESYNC 2 mirrors 000048 1783135984.795897 mapwrite 0x00b974 thru 0x012440 (0x6acd bytes) 000049 1783135984.917053 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) 000051 1783135985.062165 trunc from 0x03d623 to 0x00d244 (0x303de bytes) 000053 1783135985.087210 trunc from 0x00d245 to 0x01c8d9 (0xf695 bytes) 000054 1783135985.106720 mapread 0x003c4f thru 0x00e37b (0xa72d bytes) 000055 1783135985.128065 write 0x03bf58 thru 0x03ffff (0x40a8 bytes) 000057 1783135985.131536 mapwrite 0x001008 thru 0x005637 (0x4630 bytes) 000058 1783135985.147770 trunc from 0x040000 to 0x03803a (0x7fc5 bytes) 000059 1783135985.168155 fallocate 0x01ab29 thru 0x01fc2f (0x5107 bytes) 000060 1783135985.174166 trunc from 0x03803b to 0x01a291 (0x1dda9 bytes) 000061 1783135985.191550 fallocate 0x039554 thru 0x03a5cf (0x107c bytes) truncating to largest ever: 0x3dd3b 000063 1783135985.199252 trunc from 0x01a292 to 0x03dd3a (0x23aa9 bytes) 000064 1783135985.213996 fallocate 0x028f88 thru 0x033ee0 (0xaf59 bytes) fallocating to largest ever: 0x40000 000065 1783135985.220764 fallocate 0x03bc05 thru 0x03ffff (0x43fb bytes) 000066 1783135985.225983 read 0x039443 thru 0x03dd3a (0x48f8 bytes) 000067 1783135985.235508 fallocate 0x00d0d7 thru 0x01c993 (0xf8bd bytes) 000069 1783135985.241482 trunc from 0x01657c to 0x025b75 (0xf5fa bytes) 000070 1783135985.249696 write 0x013d22 thru 0x016fef (0x32ce bytes) 000071 1783135985.262991 trunc from 0x00238f to 0x010804 (0xe476 bytes) 000072 1783135985.270121 punch from 0x016d3b to 0x017103 (0x3c9 bytes) 000073 1783135985.289565 read 0x022ae8 thru 0x02be15 (0x932e bytes) 000074 1783135985.308232 write 0x01dd28 thru 0x028bae (0xae87 bytes) 000075 1783135985.310620 trunc from 0x034aa8 to 0x039593 (0x4aec bytes) 000076 1783135985.316241 mapread 0x03719c thru 0x03983a (0x269f bytes) 000077 1783135985.339475 fallocate 0x0375eb thru 0x039685 (0x209b bytes) 000079 1783135985.348835 mapwrite 0x019031 thru 0x01d233 (0x4203 bytes) 000080 1783135985.387161 trunc from 0x03dd3b to 0x019b3c (0x241fe bytes) 000081 1783135985.417241 write 0x024950 thru 0x031e9f (0xd550 bytes) 000082 1783135985.424814 punch from 0x01d917 to 0x025437 (0x7b21 bytes) 000083 1783135985.444009 mapread 0x001804 thru 0x00a315 (0x8b12 bytes) 000084 1783135985.445431 read 0x004317 thru 0x012134 (0xde1e bytes) 000085 1783135985.447214 read 0x0207db thru 0x020cd0 (0x4f6 bytes) 000086 1783135985.462921 read 0x026ca7 thru 0x031e9f (0xb1f9 bytes) 000087 1783135985.464080 write 0x02867c thru 0x02d9f4 (0x5379 bytes) 000089 1783135985.471447 punch from 0x012fef to 0x01d6ab (0xa6bd bytes) 000093 1783135985.480343 punch from 0x01939c to 0x02680d (0xd472 bytes) 000094 1783135985.493493 fallocate 0x00ea27 thru 0x0196ac (0xac86 bytes) 000095 1783135985.499547 write 0x006ba6 thru 0x015723 (0xeb7e bytes) 000096 1783135985.513401 trunc from 0x02f861 to 0x02fb82 (0x322 bytes) 000097 1783135985.518554 mapread 0x015b2f thru 0x025a30 (0xff02 bytes) 000099 1783135985.550555 trunc from 0x031ea0 to 0x01bfdc (0x15ec3 bytes) 000100 1783135985.579214 write 0x009f12 thru 0x00f704 (0x57f3 bytes) 000101 1783135985.583479 write 0x0329c2 thru 0x036953 (0x3f92 bytes) 000102 1783135985.586243 trunc from 0x036954 to 0x03e983 (0x8030 bytes) 000103 1783135985.608361 mapwrite 0x02c6b4 thru 0x0365c2 (0x9f0f bytes) 000104 1783135985.671656 trunc from 0x031852 to 0x03be1d (0xa5cc bytes) 000105 1783135985.680369 mapread 0x01e9eb thru 0x0202a2 (0x18b8 bytes) 000106 1783135985.697478 read 0x0092f4 thru 0x00c160 (0x2e6d bytes) 000107 1783135985.700571 mapwrite 0x00772f thru 0x016ab4 (0xf386 bytes) 000108 1783135985.743995 trunc from 0x002600 to 0x0051c4 (0x2bc5 bytes) 000110 1783135985.760447 fallocate 0x00143d thru 0x00e6d5 (0xd299 bytes) 000111 1783135985.770246 punch from 0x01b82a to 0x0295ba (0xdd91 bytes) 000112 1783135985.777859 trunc from 0x03e984 to 0x02892c (0x16057 bytes) 000113 1783135985.801157 MIRROR_EXTEND to 2 mirrors 000114 1783135986.867389 punch from 0x014791 to 0x01b342 (0x6bb2 bytes) 000115 1783135986.934800 trunc from 0x023e2b to 0x02892c (0x4b02 bytes) 000116 1783135986.944519 read 0x00519d thru 0x00c794 (0x75f8 bytes) 000117 1783135986.971152 write 0x01d9f0 thru 0x023ccd (0x62de bytes) 000118 1783135986.997640 write 0x023786 thru 0x02b75f (0x7fda bytes) 000119 1783135987.002953 fallocate 0x023ffa thru 0x02a985 (0x698c bytes) 000121 1783135987.022941 trunc from 0x02b760 to 0x01397d (0x17de2 bytes) 000122 1783135987.054245 mapread 0x004c30 thru 0x00b133 (0x6504 bytes) 000123 1783135987.062833 write 0x019223 thru 0x02515f (0xbf3d bytes) 000124 1783135987.067659 mapread 0x000752 thru 0x00f736 (0xefe5 bytes) 000125 1783135987.090715 mapwrite 0x02dc50 thru 0x02dfab (0x35c bytes) 000127 1783135987.141117 mapread 0x0297d4 thru 0x02cb7d (0x33aa bytes) 000128 1783135987.142960 mapwrite 0x035671 thru 0x03d71c (0x80ac bytes) 000129 1783135987.232278 read 0x02443f thru 0x029541 (0x5103 bytes) 000130 1783135987.250890 mapwrite 0x036d16 thru 0x03cfc2 (0x62ad bytes) 000131 1783135987.292415 mapwrite 0x010fda thru 0x014db5 (0x3ddc bytes) 000132 1783135987.328864 trunc from 0x03d71d to 0x02300a (0x1a712 bytes) 000133 1783135987.354084 trunc from 0x013cc9 to 0x01d32d (0x9665 bytes) 000134 1783135987.364221 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2300b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2300b): Mirror 2: 0xa8412a91 (stale) CRC-32 checksum value for chunk [0, 0x2300b): Mirror 1: 0x97b5b0c8 Mirror 3: 0x97b5b0c8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2300b: skipped 000135 1783135988.264493 punch from 0x00e007 to 0x0119ba (0x39b4 bytes) 000137 1783135988.332733 mapread 0x01074c thru 0x011e31 (0x16e6 bytes) 000138 1783135988.355705 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2300b): Mirror 2: 0xa8412a91 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2300b): Mirror 2: 0xa8412a91 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2300b: skipped 000139 1783135988.843274 read 0x018f84 thru 0x01d01d (0x409a bytes) 000140 1783135988.864846 mapread 0x016d1e thru 0x01f3cc (0x86af bytes) 000141 1783135988.914107 punch from 0x00d179 to 0x016de6 (0x9c6e bytes) 000142 1783135988.925910 fallocate 0x02b109 thru 0x02bc54 (0xb4c bytes) 000143 1783135988.941781 fallocate 0x011434 thru 0x013b82 (0x274f bytes) 000144 1783135988.963945 write 0x02b83c thru 0x03984f (0xe014 bytes) 000145 1783135988.980726 mapwrite 0x00448d thru 0x00acb0 (0x6824 bytes) 000146 1783135989.014014 write 0x01bc30 thru 0x0204b5 (0x4886 bytes) 000147 1783135989.015324 write 0x003f20 thru 0x009e1c (0x5efd bytes) 000148 1783135989.017706 mapread 0x006e9e thru 0x012ebc (0xc01f bytes) 000149 1783135989.028486 mapwrite 0x01c4bc thru 0x020152 (0x3c97 bytes) 000150 1783135989.054422 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x39850): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39850): Mirror 2: 0x7b10cae (stale) CRC-32 checksum value for chunk [0, 0x39850): Mirror 1: 0x77249c5a Mirror 3: 0x77249c5a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39850: skipped 000151 1783135989.898935 fallocate 0x0080a7 thru 0x010ff5 (0x8f4f bytes) 000152 1783135989.944832 mapwrite 0x039499 thru 0x03ffff (0x6b67 bytes) 000153 1783135990.051868 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa5af6dcb (stale) Mirror 3: 0xa352c279 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6d015cab Mirror 4: 0x6d015cab lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000154 1783135991.028294 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa5af6dcb (stale) Mirror 3: 0xa352c279 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xa5af6dcb (stale) Mirror 3: 0xa352c279 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000155 1783135991.364094 mapwrite 0x016718 thru 0x019b24 (0x340d bytes) 000156 1783135991.420100 trunc from 0x040000 to 0x00dddf (0x32220 bytes) 000157 1783135991.442529 fallocate 0x01aad9 thru 0x01ff17 (0x543f bytes) 000158 1783135991.450882 trunc from 0x0007e5 to 0x002d32 (0x254e bytes) 000159 1783135991.458766 mapwrite 0x010a29 thru 0x015de5 (0x53bd bytes) 000160 1783135991.529760 MIRROR_RESYNC 3 mirrors 000161 1783135992.408198 fallocate 0x028cc0 thru 0x028e5c (0x19d bytes) 000162 1783135992.446102 trunc from 0x015de6 to 0x00397a (0x1246b bytes) 000164 1783135992.467940 mapread 0x0011cb thru 0x00397a (0x27b0 bytes) 000165 1783135992.485894 write 0x005a26 thru 0x009d3a (0x4315 bytes) 000166 1783135992.491706 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x9d3b): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9d3b): Mirror 2: 0xf1eecc0e (stale) Mirror 3: 0xf1eecc0e (stale) CRC-32 checksum value for chunk [0, 0x9d3b): Mirror 1: 0xd40a64c2 Mirror 4: 0xd40a64c2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9d3b: skipped 000167 1783135993.690826 punch from 0x0081f5 to 0x009d3a (0x1b46 bytes) 000169 1783135993.782388 fallocate 0x021d94 thru 0x0239ff (0x1c6c bytes) 000170 1783135993.796459 MIRROR_RESYNC 4 mirrors 000171 1783135995.049742 mapread 0x00a643 thru 0x014f90 (0xa94e bytes) 000172 1783135995.124475 MIRROR_EXTEND to 5 mirrors 000173 1783135995.863530 punch from 0x01f249 to 0x0239ff (0x47b7 bytes) 000174 1783135995.903003 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23a00): Mirror 3: 0x7cdbc6ae (stale) Mirror 4: 0x7cdbc6ae (stale) Mirror 5: 0x7cdbc6ae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23a00): Mirror 3: 0x7cdbc6ae (stale) Mirror 4: 0x7cdbc6ae (stale) Mirror 5: 0x7cdbc6ae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23a00: skipped 000175 1783135996.215313 trunc from 0x01aa54 to 0x0239ff (0x8fac bytes) 000177 1783135996.222506 write 0x02ecc5 thru 0x03199a (0x2cd6 bytes) 000178 1783135996.237132 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3199b): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3199b): Mirror 3: 0x6be1d62c (stale) Mirror 4: 0x6be1d62c (stale) Mirror 5: 0x6be1d62c (stale) CRC-32 checksum value for chunk [0, 0x3199b): Mirror 1: 0x74469bdb Mirror 6: 0x74469bdb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3199b: skipped 000179 1783135997.245087 trunc from 0x03199b to 0x005e85 (0x2bb15 bytes) 000180 1783135997.296353 write 0x00bb19 thru 0x017500 (0xb9e8 bytes) 000181 1783135997.298286 mapread 0x002713 thru 0x004d9b (0x2689 bytes) 000182 1783135997.324444 write 0x016124 thru 0x01b693 (0x5570 bytes) 000183 1783135997.326481 trunc from 0x01b694 to 0x033b0d (0x1847a bytes) 000184 1783135997.354357 mapwrite 0x0212e4 thru 0x028673 (0x7390 bytes) 000185 1783135997.386109 read 0x00de4e thru 0x01a0ed (0xc2a0 bytes) 000186 1783135997.386832 write 0x038b0c thru 0x03ffff (0x74f4 bytes) 000187 1783135997.388533 punch from 0x0027f2 to 0x010735 (0xdf44 bytes) 000188 1783135997.393495 read 0x009fdd thru 0x017762 (0xd786 bytes) 000191 1783135997.402140 read 0x03ef51 thru 0x03ffff (0x10af bytes) 000192 1783135997.403200 trunc from 0x0344f6 to 0x0362c5 (0x1dd0 bytes) 000193 1783135997.407515 mapread 0x03b5cd thru 0x03ffff (0x4a33 bytes) 000194 1783135997.408466 trunc from 0x02ca34 to 0x02f0b2 (0x267f bytes) 000196 1783135997.424143 mapwrite 0x0202c8 thru 0x02c3dd (0xc116 bytes) 000197 1783135997.479694 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa5a51ec1 (stale) Mirror 4: 0xa5a51ec1 (stale) Mirror 5: 0xa5a51ec1 (stale) Mirror 6: 0xb01a33f9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa6d5b658 Mirror 7: 0xa6d5b658 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000198 1783135998.779564 trunc from 0x040000 to 0x00a669 (0x35996 bytes) 000199 1783135998.931011 MIRROR_RESYNC 6 mirrors 000200 1783136000.109380 trunc from 0x002498 to 0x00a669 (0x81d2 bytes) 000201 1783136000.145975 mapread 0x0056c5 thru 0x0095a7 (0x3ee3 bytes) 000202 1783136000.165475 read 0x00719c thru 0x00a669 (0x34ce bytes) 000203 1783136000.166677 write 0x03f4d1 thru 0x03ffff (0xb2f bytes) 000204 1783136000.169528 trunc from 0x040000 to 0x01e585 (0x21a7a bytes) 000205 1783136000.195123 trunc from 0x012dbe to 0x013f06 (0x1149 bytes) 000207 1783136000.201553 mapread 0x002d10 thru 0x008fd9 (0x62ca bytes) 000210 1783136000.209273 MIRROR_RESYNC 6 mirrors 000211 1783136001.207334 write 0x0094b3 thru 0x0179e8 (0xe536 bytes) 000212 1783136001.249883 write 0x038860 thru 0x03ffff (0x77a0 bytes) 000213 1783136001.251656 mapread 0x03bda8 thru 0x03ffff (0x4258 bytes) 000214 1783136001.253364 fallocate 0x020f24 thru 0x025f5f (0x503c bytes) 000216 1783136001.260394 trunc from 0x040000 to 0x012d34 (0x2d2cb bytes) 000217 1783136001.302506 fallocate 0x034daa thru 0x037fa4 (0x31fb bytes) 000218 1783136001.307905 trunc from 0x012d35 to 0x00efb5 (0x3d7f bytes) 000219 1783136001.327274 MIRROR_RESYNC 6 mirrors 000220 1783136002.377372 read 0x00de76 thru 0x00efb5 (0x1140 bytes) 000221 1783136002.383328 trunc from 0x00368c to 0x008d7a (0x56ef bytes) 000222 1783136002.413441 read 0x00069b thru 0x0060b0 (0x5a16 bytes) 000223 1783136002.424155 trunc from 0x0068cc to 0x0083f0 (0x1b25 bytes) 000224 1783136002.429307 punch from 0x000d4b to 0x00c5e7 (0xb89d bytes) 000226 1783136002.436386 write 0x0350b1 thru 0x037ae5 (0x2a35 bytes) 000227 1783136002.438643 write 0x03aecf thru 0x03ffe8 (0x511a bytes) 000228 1783136002.441132 read 0x0121da thru 0x0173d7 (0x51fe bytes) 000229 1783136002.451088 punch from 0x02c3a7 to 0x02d9e9 (0x1643 bytes) 000230 1783136002.455272 read 0x012de5 thru 0x015def (0x300b bytes) 000231 1783136002.456475 write 0x01890b thru 0x02345a (0xab50 bytes) 000234 1783136002.460466 mapwrite 0x00f28e thru 0x016ead (0x7c20 bytes) 000235 1783136002.479986 trunc from 0x03ffe9 to 0x02a37b (0x15c6d bytes) 000236 1783136002.501000 mapwrite 0x009865 thru 0x011e24 (0x85c0 bytes) 000237 1783136002.520862 mapwrite 0x03aca3 thru 0x03ffff (0x535d bytes) 000238 1783136002.578771 write 0x02f165 thru 0x03c9a3 (0xd83f bytes) 000239 1783136002.580523 trunc from 0x040000 to 0x0149bd (0x2b642 bytes) 000240 1783136002.601365 punch from 0x00decb to 0x0149bd (0x6af3 bytes) 000241 1783136002.606913 trunc from 0x0149be to 0x0183f0 (0x3a33 bytes) 000243 1783136002.623507 mapwrite 0x01646b thru 0x023806 (0xd39c bytes) 000245 1783136002.733023 write 0x02ed5a thru 0x031e00 (0x30a7 bytes) 000246 1783136002.735205 mapwrite 0x00b2da thru 0x018674 (0xd39b bytes) 000247 1783136002.794197 read 0x02f2ec thru 0x031e00 (0x2b15 bytes) 000248 1783136002.795581 fallocate 0x01beb5 thru 0x029c62 (0xddae bytes) 000249 1783136002.802211 punch from 0x01b0bf to 0x0292f3 (0xe235 bytes) 000250 1783136002.808001 read 0x01dbb9 thru 0x0235b9 (0x5a01 bytes) 000251 1783136002.818857 write 0x0314dd thru 0x03e6ae (0xd1d2 bytes) 000252 1783136002.821851 fallocate 0x02070f thru 0x02eed0 (0xe7c2 bytes) 000253 1783136002.827325 trunc from 0x018329 to 0x0185f3 (0x2cb bytes) 000254 1783136002.832384 write 0x01b0d5 thru 0x01b3a4 (0x2d0 bytes) 000255 1783136002.833673 mapwrite 0x031553 thru 0x03b38f (0x9e3d bytes) 000256 1783136002.858428 write 0x03a170 thru 0x03ffff (0x5e90 bytes) 000258 1783136002.860541 read 0x00b514 thru 0x00c5e8 (0x10d5 bytes) 000259 1783136002.862472 mapwrite 0x00e76b thru 0x01b36e (0xcc04 bytes) 000260 1783136002.895143 mapwrite 0x03c217 thru 0x03ffff (0x3de9 bytes) 000261 1783136002.911833 mapread 0x03dd3a thru 0x03ffff (0x22c6 bytes) 000262 1783136002.912969 trunc from 0x028ee6 to 0x02b7e2 (0x28fd bytes) 000263 1783136002.919274 read 0x01d32a thru 0x01d721 (0x3f8 bytes) 000264 1783136002.921881 trunc from 0x03d11a to 0x03ffff (0x2ee6 bytes) 000266 1783136002.928476 punch from 0x013e1a to 0x020d22 (0xcf09 bytes) 000267 1783136002.937773 mapwrite 0x020102 thru 0x029b49 (0x9a48 bytes) 000268 1783136003.010323 fallocate 0x03f26c thru 0x03ffff (0xd94 bytes) 000269 1783136003.016442 mapwrite 0x01af39 thru 0x021ff9 (0x70c1 bytes) 000270 1783136003.035381 write 0x0138ca thru 0x020b89 (0xd2c0 bytes) 000271 1783136003.037818 trunc from 0x040000 to 0x0068a4 (0x3975b bytes) 000272 1783136003.059146 read 0x002845 thru 0x0068a4 (0x4060 bytes) 000273 1783136003.065416 MIRROR_RESYNC 6 mirrors 000274 1783136003.981113 punch from 0x00323a to 0x0068a4 (0x366b bytes) 000275 1783136004.026164 MIRROR_RESYNC 6 mirrors 000276 1783136005.081069 trunc from 0x004485 to 0x0068a4 (0x2420 bytes) 000277 1783136005.101908 punch from 0x0050bf to 0x00653e (0x1480 bytes) 000278 1783136005.115405 trunc from 0x002eb9 to 0x00527b (0x23c3 bytes) 000279 1783136005.121460 mapread 0x001923 thru 0x0068a4 (0x4f82 bytes) 000280 1783136005.139427 read 0x0036d4 thru 0x0057a9 (0x20d6 bytes) 000281 1783136005.141223 write 0x02dfdc thru 0x033aea (0x5b0f bytes) 000282 1783136005.145260 trunc from 0x02d021 to 0x033aea (0x6aca bytes) 000283 1783136005.160018 trunc from 0x02a0ba to 0x0333bc (0x9303 bytes) 000284 1783136005.165838 read 0x029007 thru 0x033aea (0xaae4 bytes) 000285 1783136005.184226 fallocate 0x02e154 thru 0x0349ce (0x687b bytes) 000286 1783136005.191108 mapwrite 0x029faa thru 0x02eab8 (0x4b0f bytes) 000287 1783136005.213400 write 0x037d68 thru 0x0389df (0xc78 bytes) 000288 1783136005.218219 mapread 0x022601 thru 0x02a713 (0x8113 bytes) 000289 1783136005.221068 trunc from 0x0389e0 to 0x00038f (0x38650 bytes) 000290 1783136005.255859 punch from 0x000030 to 0x00038f (0x360 bytes) 000291 1783136005.262186 mapwrite 0x0300b0 thru 0x03e237 (0xe188 bytes) 000292 1783136005.346885 punch from 0x018119 to 0x0242d0 (0xc1b8 bytes) 000293 1783136005.350849 mapread 0x0329a9 thru 0x036842 (0x3e9a bytes) 000294 1783136005.351980 punch from 0x00d71a to 0x01c5cf (0xeeb6 bytes) 000295 1783136005.357193 read 0x0106c6 thru 0x01b022 (0xa95d bytes) 000296 1783136005.369773 MIRROR_RESYNC 6 mirrors 000298 1783136006.161540 punch from 0x02de1b to 0x033c77 (0x5e5d bytes) 000299 1783136006.208155 punch from 0x008fdb to 0x010534 (0x755a bytes) 000300 1783136006.214355 mapwrite 0x02b81c thru 0x0316f7 (0x5edc bytes) 000301 1783136006.252671 punch from 0x027425 to 0x0347c4 (0xd3a0 bytes) 000302 1783136006.258174 read 0x0273b0 thru 0x030823 (0x9474 bytes) 000303 1783136006.269248 mapwrite 0x023a56 thru 0x029091 (0x563c bytes) 000304 1783136006.301130 MIRROR_RESYNC 6 mirrors 000305 1783136007.405288 write 0x02104c thru 0x02952b (0x84e0 bytes) 000306 1783136007.450274 trunc from 0x03e238 to 0x03ad87 (0x34b0 bytes) 000308 1783136007.478154 write 0x0047aa thru 0x01445a (0xfcb1 bytes) 000309 1783136007.489827 mapwrite 0x01d157 thru 0x02a0c1 (0xcf6b bytes) 000310 1783136007.541335 read 0x018596 thru 0x025363 (0xcdce bytes) 000311 1783136007.542210 mapread 0x00e1c4 thru 0x019dbb (0xbbf8 bytes) 000312 1783136007.548619 trunc from 0x03ad88 to 0x00dfe7 (0x2cda0 bytes) 000313 1783136007.571829 MIRROR_RESYNC 6 mirrors 000314 1783136008.355257 write 0x0378df thru 0x0383b3 (0xad5 bytes) 000315 1783136008.394375 mapwrite 0x03eccf thru 0x03ffff (0x1331 bytes) 000316 1783136008.440347 punch from 0x03cd36 to 0x03dd60 (0x102b bytes) 000317 1783136008.450224 read 0x02920d thru 0x02a29e (0x1092 bytes) 000318 1783136008.456536 write 0x02b9d0 thru 0x030ab2 (0x50e3 bytes) 000319 1783136008.467951 trunc from 0x040000 to 0x02a6d9 (0x15926 bytes) 000320 1783136008.485481 trunc from 0x027a65 to 0x02a6d9 (0x2c75 bytes) 000321 1783136008.493041 punch from 0x022dd8 to 0x02a6d9 (0x7902 bytes) 000322 1783136008.498310 trunc from 0x001063 to 0x00f9f2 (0xe990 bytes) 000323 1783136008.503402 mapread 0x016003 thru 0x0192ef (0x32ed bytes) 000324 1783136008.526315 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2a6da): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a6da): Mirror 3: 0x2fd9783e (stale) Mirror 4: 0x2fd9783e (stale) Mirror 5: 0x2fd9783e (stale) Mirror 6: 0x2fd9783e (stale) Mirror 7: 0x2fd9783e (stale) CRC-32 checksum value for chunk [0, 0x2a6da): Mirror 1: 0xfa4a9e5 Mirror 8: 0xfa4a9e5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a6da: skipped 000325 1783136009.233154 trunc from 0x0111ae to 0x01ebd9 (0xda2c bytes) 000326 1783136009.270545 mapwrite 0x02c3e9 thru 0x02de6a (0x1a82 bytes) 000327 1783136009.343173 mapread 0x02dc70 thru 0x02de6a (0x1fb bytes) 000328 1783136009.345236 punch from 0x02771a to 0x02de6a (0x6751 bytes) 000329 1783136009.357352 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2de6b): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2de6b): Mirror 3: 0xa2ee732d (stale) Mirror 4: 0xa2ee732d (stale) Mirror 5: 0xa2ee732d (stale) Mirror 6: 0xa2ee732d (stale) Mirror 7: 0xa2ee732d (stale) Mirror 8: 0x7ce58f4b (stale) CRC-32 checksum value for chunk [0, 0x2de6b): Mirror 1: 0x7ce58f4b Mirror 9: 0x7ce58f4b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2de6b: skipped 000330 1783136010.087217 trunc from 0x02de6b to 0x006c46 (0x27224 bytes) 000331 1783136010.156523 write 0x01b4e9 thru 0x0208f2 (0x540a bytes) 000333 1783136010.162432 trunc from 0x0208f3 to 0x029ddf (0x94ed bytes) 000334 1783136010.189260 punch from 0x00f58f to 0x010680 (0x10f2 bytes) 000335 1783136010.199028 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29de0): Mirror 3: 0x2239742b (stale) Mirror 4: 0x2239742b (stale) Mirror 5: 0x2239742b (stale) Mirror 6: 0x2239742b (stale) Mirror 7: 0x2239742b (stale) Mirror 9: 0x2882cce9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29de0): Mirror 3: 0x2239742b (stale) Mirror 4: 0x2239742b (stale) Mirror 5: 0x2239742b (stale) Mirror 6: 0x2239742b (stale) Mirror 7: 0x2239742b (stale) Mirror 9: 0x2882cce9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29de0: skipped 000336 1783136010.707819 punch from 0x010b69 to 0x01ca7f (0xbf17 bytes) 000337 1783136010.716292 mapread 0x0238c2 thru 0x029ddf (0x651e bytes) 000338 1783136010.738269 punch from 0x00c236 to 0x010b17 (0x48e2 bytes) 000339 1783136010.747412 MIRROR_RESYNC 7 mirrors 000340 1783136011.989423 mapwrite 0x03b0f0 thru 0x03ffff (0x4f10 bytes) 000341 1783136012.071032 mapread 0x030dab thru 0x035038 (0x428e bytes) 000342 1783136012.086227 trunc from 0x040000 to 0x00afab (0x35054 bytes) 000343 1783136012.122257 write 0x025675 thru 0x02d2c6 (0x7c52 bytes) 000344 1783136012.124012 trunc from 0x02d2c7 to 0x038d70 (0xbaaa bytes) 000345 1783136012.141071 write 0x00d06b thru 0x017ac1 (0xaa57 bytes) 000346 1783136012.151691 punch from 0x025c7a to 0x030f20 (0xb2a7 bytes) 000347 1783136012.166435 fallocate 0x008d6a thru 0x00f21b (0x64b2 bytes) 000348 1783136012.171555 trunc from 0x02a3d4 to 0x0333f7 (0x9024 bytes) 000349 1783136012.176401 trunc from 0x028227 to 0x034ab7 (0xc891 bytes) 000350 1783136012.181064 read 0x00bea2 thru 0x012253 (0x63b2 bytes) 000351 1783136012.186123 mapwrite 0x00400a thru 0x01117a (0xd171 bytes) 000352 1783136012.217415 write 0x027a84 thru 0x0339cd (0xbf4a bytes) 000353 1783136012.226981 punch from 0x00fafe to 0x01ea89 (0xef8c bytes) 000354 1783136012.231324 trunc from 0x038d71 to 0x01241e (0x26952 bytes) 000355 1783136012.254002 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1241f): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1241f): Mirror 3: 0x5dc4497c (stale) Mirror 4: 0x5dc4497c (stale) Mirror 5: 0x5dc4497c (stale) Mirror 6: 0x5dc4497c (stale) Mirror 7: 0x5dc4497c (stale) Mirror 9: 0x5dc4497c (stale) CRC-32 checksum value for chunk [0, 0x1241f): Mirror 1: 0xdea3daf6 Mirror 10: 0xdea3daf6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1241f: skipped 000356 1783136012.989496 trunc from 0x01241f to 0x039a1a (0x275fc bytes) 000358 1783136013.053278 punch from 0x0382aa to 0x039a1a (0x1771 bytes) 000360 1783136013.058745 punch from 0x010ee7 to 0x01ce7b (0xbf95 bytes) 000361 1783136013.066166 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x39a1b): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39a1b): Mirror 3: 0xc0c239c (stale) Mirror 4: 0xc0c239c (stale) Mirror 5: 0xc0c239c (stale) Mirror 6: 0xc0c239c (stale) Mirror 7: 0xc0c239c (stale) Mirror 9: 0xc0c239c (stale) Mirror 10: 0x31e9d7de (stale) CRC-32 checksum value for chunk [0, 0x39a1b): Mirror 1: 0x31e9d7de Mirror 11: 0x31e9d7de lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39a1b: skipped 000362 1783136013.995888 trunc from 0x024b09 to 0x03370e (0xec06 bytes) 000363 1783136014.038412 read 0x00f9ca thru 0x011d11 (0x2348 bytes) 000364 1783136014.044494 read 0x0372e8 thru 0x039a1a (0x2733 bytes) 000365 1783136014.063480 fallocate 0x0181a1 thru 0x022b46 (0xa9a6 bytes) 000366 1783136014.069382 punch from 0x025e21 to 0x028339 (0x2519 bytes) 000367 1783136014.075141 write 0x008249 thru 0x0086b0 (0x468 bytes) 000368 1783136014.080496 fallocate 0x023d3c thru 0x02cda0 (0x9065 bytes) 000369 1783136014.086066 read 0x011deb thru 0x01d75f (0xb975 bytes) 000370 1783136014.087412 write 0x0113b0 thru 0x013999 (0x25ea bytes) 000371 1783136014.088891 mapread 0x010056 thru 0x0179b1 (0x795c bytes) 000373 1783136014.091993 punch from 0x01b311 to 0x02699e (0xb68e bytes) 000374 1783136014.097387 mapread 0x025cdd thru 0x031282 (0xb5a6 bytes) 000375 1783136014.108444 fallocate 0x01cc85 thru 0x0246c6 (0x7a42 bytes) 000376 1783136014.114294 trunc from 0x01e6a8 to 0x02d442 (0xed9b bytes) 000377 1783136014.119476 trunc from 0x02ea67 to 0x039a1a (0xafb4 bytes) 000378 1783136014.125015 fallocate 0x00b429 thru 0x0145bc (0x9194 bytes) 000379 1783136014.133848 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39a1b): Mirror 3: 0xc0c239c (stale) Mirror 5: 0xc0c239c (stale) Mirror 6: 0xc0c239c (stale) Mirror 7: 0xc0c239c (stale) Mirror 9: 0xc0c239c (stale) Mirror 10: 0x31e9d7de (stale) Mirror 11: 0x31e9d7de (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39a1b): Mirror 3: 0xc0c239c (stale) Mirror 5: 0xc0c239c (stale) Mirror 6: 0xc0c239c (stale) Mirror 7: 0xc0c239c (stale) Mirror 9: 0xc0c239c (stale) Mirror 10: 0x31e9d7de (stale) Mirror 11: 0x31e9d7de (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39a1b: skipped 000380 1783136014.554988 trunc from 0x039a1b to 0x02ebc3 (0xae57 bytes) 000381 1783136014.583791 trunc from 0x01c776 to 0x026d89 (0xa614 bytes) 000382 1783136014.593350 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2ebc4): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ebc4): Mirror 3: 0x19e78cc1 (stale) Mirror 5: 0x19e78cc1 (stale) Mirror 6: 0x19e78cc1 (stale) Mirror 7: 0x19e78cc1 (stale) Mirror 9: 0x19e78cc1 (stale) Mirror 10: 0x62a57ae2 (stale) Mirror 11: 0x62a57ae2 (stale) CRC-32 checksum value for chunk [0, 0x2ebc4): Mirror 1: 0x484195b2 Mirror 12: 0x484195b2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ebc4: skipped 000383 1783136015.446827 mapread 0x01a2e8 thru 0x028246 (0xdf5f bytes) 000384 1783136015.500371 mapread 0x006c10 thru 0x0166a1 (0xfa92 bytes) 000385 1783136015.542072 write 0x01d444 thru 0x020a1b (0x35d8 bytes) 000386 1783136015.594068 mapwrite 0x034e32 thru 0x03f4bd (0xa68c bytes) 000387 1783136015.667311 write 0x0380dc thru 0x03ffff (0x7f24 bytes) 000388 1783136015.669932 mapread 0x0099ac thru 0x00cb68 (0x31bd bytes) 000389 1783136015.679990 read 0x0340ab thru 0x03feba (0xbe10 bytes) 000390 1783136015.685214 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xfdd31482 (stale) Mirror 5: 0xfdd31482 (stale) Mirror 6: 0xfdd31482 (stale) Mirror 7: 0xfdd31482 (stale) Mirror 10: 0x2bf2e397 (stale) Mirror 11: 0x2bf2e397 (stale) Mirror 12: 0x7e94ba43 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xfdd31482 (stale) Mirror 5: 0xfdd31482 (stale) Mirror 6: 0xfdd31482 (stale) Mirror 7: 0xfdd31482 (stale) Mirror 10: 0x2bf2e397 (stale) Mirror 11: 0x2bf2e397 (stale) Mirror 12: 0x7e94ba43 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000391 1783136016.117482 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xfdd31482 (stale) Mirror 5: 0xfdd31482 (stale) Mirror 6: 0xfdd31482 (stale) Mirror 7: 0xfdd31482 (stale) Mirror 10: 0x2bf2e397 (stale) Mirror 11: 0x2bf2e397 (stale) Mirror 12: 0x7e94ba43 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb2eb0f85 Mirror 13: 0xb2eb0f85 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000392 1783136017.204389 mapread 0x00d5f1 thru 0x015e2b (0x883b bytes) 000393 1783136017.242396 trunc from 0x013372 to 0x017111 (0x3da0 bytes) 000394 1783136017.298059 trunc from 0x01ef76 to 0x023da6 (0x4e31 bytes) 000395 1783136017.304895 write 0x01c83f thru 0x0200d8 (0x389a bytes) 000396 1783136017.325006 mapread 0x03a0d5 thru 0x03c8cf (0x27fb bytes) 000397 1783136017.341870 fallocate 0x00d2d9 thru 0x012cf9 (0x5a21 bytes) 000398 1783136017.353184 MIRROR_RESYNC 9 mirrors 000399 1783136019.730212 write 0x007bb7 thru 0x00aae5 (0x2f2f bytes) 000400 1783136019.776208 trunc from 0x040000 to 0x00edc4 (0x3123b bytes) 000401 1783136019.796570 trunc from 0x00edc5 to 0x025a8d (0x16cc9 bytes) 000403 1783136019.823750 read 0x0188b6 thru 0x01a1fe (0x1949 bytes) 000404 1783136019.832160 write 0x031e91 thru 0x03c20e (0xa37e bytes) 000405 1783136019.834207 punch from 0x033bde to 0x03c20e (0x8631 bytes) 000406 1783136019.853091 punch from 0x01dbaa to 0x0254e1 (0x7938 bytes) 000407 1783136019.862512 MIRROR_RESYNC 9 mirrors 000408 1783136021.726117 trunc from 0x02fe4f to 0x03a0e6 (0xa298 bytes) 000409 1783136021.761098 read 0x01f163 thru 0x02874b (0x95e9 bytes) 000411 1783136021.770297 mapwrite 0x02cfb9 thru 0x03adfc (0xde44 bytes) 000412 1783136021.866433 mapwrite 0x029693 thru 0x02e3cf (0x4d3d bytes) 000413 1783136021.894077 punch from 0x032ed1 to 0x03816e (0x529e bytes) 000416 1783136021.904617 trunc from 0x03c20f to 0x03b143 (0x10cb bytes) 000417 1783136021.937153 MIRROR_RESYNC 9 mirrors 000419 1783136024.065120 write 0x033c59 thru 0x03ffff (0xc3a7 bytes) 000420 1783136024.098276 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc34dc031 (stale) Mirror 5: 0xc34dc031 (stale) Mirror 6: 0xc34dc031 (stale) Mirror 7: 0xc34dc031 (stale) Mirror 10: 0xc34dc031 (stale) Mirror 11: 0xc34dc031 (stale) Mirror 12: 0xc34dc031 (stale) Mirror 13: 0xc34dc031 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x38d7e852 Mirror 14: 0x38d7e852 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000421 1783136025.037232 trunc from 0x02e278 to 0x0345d5 (0x635e bytes) 000422 1783136025.109318 read 0x03a2c3 thru 0x03ffff (0x5d3d bytes) 000423 1783136025.122132 trunc from 0x00e3a6 to 0x015289 (0x6ee4 bytes) 000424 1783136025.131088 mapwrite 0x013f1d thru 0x0236e3 (0xf7c7 bytes) 000425 1783136025.203684 trunc from 0x040000 to 0x000a3e (0x3f5c1 bytes) 000426 1783136025.224976 write 0x02d623 thru 0x03981a (0xc1f8 bytes) 000427 1783136025.227395 trunc from 0x02db90 to 0x02e0d3 (0x544 bytes) 000428 1783136025.241848 punch from 0x023224 to 0x02cc02 (0x99df bytes) 000429 1783136025.246296 trunc from 0x00d97b to 0x018c7d (0xb303 bytes) 000430 1783136025.255097 mapwrite 0x039f3a thru 0x03c968 (0x2a2f bytes) 000431 1783136025.295193 fallocate 0x034e48 thru 0x03626d (0x1426 bytes) 000432 1783136025.300581 mapread 0x01cfdd thru 0x028671 (0xb695 bytes) 000433 1783136025.325479 mapread 0x030889 thru 0x03684d (0x5fc5 bytes) 000434 1783136025.326937 mapread 0x0185fb thru 0x021c52 (0x9658 bytes) 000435 1783136025.329952 trunc from 0x03c969 to 0x011544 (0x2b424 bytes) 000436 1783136025.347558 trunc from 0x011545 to 0x01989b (0x8357 bytes) 000437 1783136025.364060 trunc from 0x0035e3 to 0x0085c0 (0x4fde bytes) 000438 1783136025.371329 trunc from 0x01989c to 0x02730f (0xda74 bytes) 000439 1783136025.385999 punch from 0x00e967 to 0x01b65a (0xccf4 bytes) 000440 1783136025.391434 mapwrite 0x027b86 thru 0x02d50e (0x5989 bytes) 000441 1783136025.455027 trunc from 0x02d50f to 0x002486 (0x2b088 bytes) 000442 1783136025.485117 write 0x02699c thru 0x0299c4 (0x3029 bytes) 000443 1783136025.488228 punch from 0x000ea4 to 0x0083c8 (0x7525 bytes) 000444 1783136025.507800 trunc from 0x010776 to 0x016055 (0x58e0 bytes) 000445 1783136025.514230 write 0x019b3e thru 0x029a03 (0xfec6 bytes) 000446 1783136025.529153 read 0x024910 thru 0x029a03 (0x50f4 bytes) 000447 1783136025.530830 write 0x01a959 thru 0x020136 (0x57de bytes) 000448 1783136025.533100 punch from 0x02581e to 0x02931a (0x3afd bytes) 000449 1783136025.552264 write 0x028851 thru 0x02c7fa (0x3faa bytes) 000450 1783136025.565215 read 0x019dac thru 0x0236f1 (0x9946 bytes) 000451 1783136025.566059 trunc from 0x02c7fb to 0x00c4c3 (0x20337 bytes) 000452 1783136025.591517 mapread 0x0008f2 thru 0x001adc (0x11eb bytes) 000453 1783136025.593216 mapread 0x0033fc thru 0x00b50d (0x8112 bytes) 000454 1783136025.594938 fallocate 0x038927 thru 0x03b4f6 (0x2bd0 bytes) 000455 1783136025.611203 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b4f7): Mirror 5: 0x4d23cf1 (stale) Mirror 6: 0x4d23cf1 (stale) Mirror 7: 0x4d23cf1 (stale) Mirror 10: 0x4d23cf1 (stale) Mirror 11: 0x4d23cf1 (stale) Mirror 12: 0x4d23cf1 (stale) Mirror 13: 0x4d23cf1 (stale) Mirror 14: 0xf8895a9a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b4f7): Mirror 5: 0x4d23cf1 (stale) Mirror 6: 0x4d23cf1 (stale) Mirror 7: 0x4d23cf1 (stale) Mirror 10: 0x4d23cf1 (stale) Mirror 11: 0x4d23cf1 (stale) Mirror 12: 0x4d23cf1 (stale) Mirror 13: 0x4d23cf1 (stale) Mirror 14: 0xf8895a9a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b4f7: skipped 000456 1783136026.121510 write 0x015703 thru 0x01830b (0x2c09 bytes) 000457 1783136026.143416 MIRROR_RESYNC 9 mirrors 000458 1783136028.031130 mapread 0x01b47e thru 0x01d559 (0x20dc bytes) 000459 1783136028.061118 write 0x026fda thru 0x02e03a (0x7061 bytes) 000460 1783136028.114160 mapread 0x0079b5 thru 0x00ebb3 (0x71ff bytes) 000461 1783136028.130614 trunc from 0x02ee47 to 0x034512 (0x56cc bytes) 000462 1783136028.146671 trunc from 0x005d86 to 0x015ca9 (0xff24 bytes) 000463 1783136028.151733 write 0x03b58d thru 0x03ffff (0x4a73 bytes) 000464 1783136028.157235 mapwrite 0x009884 thru 0x00b804 (0x1f81 bytes) 000466 1783136028.204645 write 0x0237a7 thru 0x030dc7 (0xd621 bytes) 000467 1783136028.230839 fallocate 0x0373c4 thru 0x03ffff (0x8c3c bytes) 000468 1783136028.249504 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x4c2babf (stale) Mirror 6: 0x4c2babf (stale) Mirror 7: 0x4c2babf (stale) Mirror 10: 0x4c2babf (stale) Mirror 11: 0x4c2babf (stale) Mirror 12: 0x4c2babf (stale) Mirror 13: 0x4c2babf (stale) Mirror 14: 0x4c2babf (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc15d71ab Mirror 15: 0xc15d71ab lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000471 1783136029.684442 trunc from 0x040000 to 0x03bd59 (0x42a6 bytes) 000472 1783136029.763269 trunc from 0x03bd5a to 0x03d286 (0x152d bytes) 000473 1783136029.784704 trunc from 0x0216cb to 0x02a636 (0x8f6c bytes) 000474 1783136029.791663 write 0x0038d0 thru 0x00b245 (0x7976 bytes) 000475 1783136029.806865 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d287): Mirror 5: 0x2b337b66 (stale) Mirror 7: 0x2b337b66 (stale) Mirror 10: 0x2b337b66 (stale) Mirror 11: 0x2b337b66 (stale) Mirror 12: 0x2b337b66 (stale) Mirror 13: 0x2b337b66 (stale) Mirror 14: 0x2b337b66 (stale) Mirror 15: 0x42f3e00 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d287): Mirror 5: 0x2b337b66 (stale) Mirror 7: 0x2b337b66 (stale) Mirror 10: 0x2b337b66 (stale) Mirror 11: 0x2b337b66 (stale) Mirror 12: 0x2b337b66 (stale) Mirror 13: 0x2b337b66 (stale) Mirror 14: 0x2b337b66 (stale) Mirror 15: 0x42f3e00 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d287: skipped 000476 1783136030.402546 fallocate 0x03a652 thru 0x03ffff (0x59ae bytes) 000477 1783136030.414310 trunc from 0x0182e4 to 0x027b90 (0xf8ad bytes) 000479 1783136030.445879 mapwrite 0x02580b thru 0x02a8b5 (0x50ab bytes) 000480 1783136030.507182 mapwrite 0x03ab4c thru 0x03ffff (0x54b4 bytes) 000481 1783136030.629349 MIRROR_RESYNC 9 mirrors 000482 1783136033.501432 mapwrite 0x00b2e7 thru 0x00caa1 (0x17bb bytes) 000483 1783136033.599085 mapread 0x03427a thru 0x03cf18 (0x8c9f bytes) 000484 1783136033.611323 mapread 0x020c2e thru 0x02841a (0x77ed bytes) 000487 1783136033.624038 trunc from 0x040000 to 0x03af11 (0x50ee bytes) 000488 1783136033.645079 mapread 0x0284db thru 0x02d844 (0x536a bytes) 000489 1783136033.657332 read 0x025006 thru 0x031a3c (0xca37 bytes) 000490 1783136033.658233 fallocate 0x029a45 thru 0x030b85 (0x7141 bytes) 000491 1783136033.662944 trunc from 0x0215a4 to 0x02e7eb (0xd248 bytes) 000492 1783136033.673110 MIRROR_RESYNC 9 mirrors 000493 1783136036.498799 trunc from 0x01d305 to 0x029873 (0xc56f bytes) 000495 1783136036.541771 mapwrite 0x03eddc thru 0x03ffff (0x1224 bytes) 000496 1783136036.585536 trunc from 0x040000 to 0x00fa4f (0x305b0 bytes) 000497 1783136036.607720 read 0x00c4bb thru 0x00fa4f (0x3595 bytes) 000500 1783136036.620283 fallocate 0x036266 thru 0x03ffff (0x9d9a bytes) 000502 1783136036.627308 mapwrite 0x032f45 thru 0x0360e5 (0x31a1 bytes) 000503 1783136036.678645 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x360e6): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x360e6): Mirror 5: 0x5c7b011 (stale) Mirror 7: 0x5c7b011 (stale) Mirror 10: 0x5c7b011 (stale) Mirror 11: 0x5c7b011 (stale) Mirror 12: 0x5c7b011 (stale) Mirror 13: 0x5c7b011 (stale) Mirror 14: 0x5c7b011 (stale) Mirror 15: 0x5c7b011 (stale) CRC-32 checksum value for chunk [0, 0x360e6): Mirror 1: 0x7ced3f31 Mirror 16: 0x7ced3f31 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x360e6: skipped 000505 1783136037.699088 write 0x02dfde thru 0x030172 (0x2195 bytes) 000506 1783136037.753243 mapread 0x01faca thru 0x024a4c (0x4f83 bytes) 000507 1783136037.782804 mapwrite 0x023e07 thru 0x0319b0 (0xdbaa bytes) 000508 1783136037.819143 mapread 0x02b96d thru 0x02f4c9 (0x3b5d bytes) 000509 1783136037.820331 read 0x01776e thru 0x02325c (0xbaef bytes) 000510 1783136037.833812 MIRROR_RESYNC 10 mirrors 000511 1783136039.902276 write 0x015e40 thru 0x01f162 (0x9323 bytes) 000512 1783136039.963886 trunc from 0x027cff to 0x02c382 (0x4684 bytes) 000513 1783136039.977881 fallocate 0x030950 thru 0x03952a (0x8bdb bytes) 000514 1783136039.989829 MIRROR_RESYNC 10 mirrors 000515 1783136042.399231 trunc from 0x004a97 to 0x00d19a (0x8704 bytes) 000516 1783136042.439124 MIRROR_RESYNC 10 mirrors 000517 1783136045.842960 mapread 0x033834 thru 0x0360e5 (0x28b2 bytes) 000518 1783136045.865908 read 0x001078 thru 0x00882a (0x77b3 bytes) 000519 1783136045.876313 trunc from 0x00f8a4 to 0x01400d (0x476a bytes) 000520 1783136045.916329 punch from 0x02cfba to 0x0360e5 (0x912c bytes) 000521 1783136045.922164 read 0x012fba thru 0x0166c5 (0x370c bytes) 000522 1783136045.941031 punch from 0x0066a9 to 0x00e580 (0x7ed8 bytes) 000523 1783136045.948630 mapwrite 0x004ef0 thru 0x00e63b (0x974c bytes) 000524 1783136046.004997 trunc from 0x0360e6 to 0x000563 (0x35b82 bytes) 000525 1783136046.027761 write 0x02e7ce thru 0x02f002 (0x835 bytes) 000526 1783136046.041431 trunc from 0x0000bd to 0x006b4d (0x6a91 bytes) 000527 1783136046.062700 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f003): Mirror 5: 0x94950be5 (stale) Mirror 7: 0x94950be5 (stale) Mirror 10: 0x94950be5 (stale) Mirror 11: 0x94950be5 (stale) Mirror 12: 0x94950be5 (stale) Mirror 13: 0x94950be5 (stale) Mirror 15: 0x94950be5 (stale) Mirror 16: 0x94950be5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f003): Mirror 5: 0x94950be5 (stale) Mirror 7: 0x94950be5 (stale) Mirror 10: 0x94950be5 (stale) Mirror 11: 0x94950be5 (stale) Mirror 12: 0x94950be5 (stale) Mirror 13: 0x94950be5 (stale) Mirror 15: 0x94950be5 (stale) Mirror 16: 0x94950be5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f003: skipped 000528 1783136046.858566 read 0x02a087 thru 0x02b272 (0x11ec bytes) 000529 1783136046.867198 trunc from 0x027c89 to 0x02c152 (0x44ca bytes) 000530 1783136046.873699 trunc from 0x015739 to 0x01ef50 (0x9818 bytes) 000531 1783136046.879166 read 0x0297fe thru 0x02f002 (0x5805 bytes) 000532 1783136046.891483 mapread 0x01eac4 thru 0x024b6b (0x60a8 bytes) 000533 1783136046.893407 punch from 0x02096b to 0x026be0 (0x6276 bytes) 000534 1783136046.901512 read 0x0275af thru 0x029bde (0x2630 bytes) 000535 1783136046.902548 trunc from 0x019246 to 0x022933 (0x96ee bytes) 000536 1783136046.916938 mapread 0x027d99 thru 0x028e93 (0x10fb bytes) 000537 1783136046.924025 fallocate 0x038ac8 thru 0x03ffff (0x7538 bytes) 000538 1783136046.932642 write 0x03e90e thru 0x03ffff (0x16f2 bytes) 000539 1783136046.992833 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x11c5d6b7 (stale) Mirror 7: 0x11c5d6b7 (stale) Mirror 10: 0x11c5d6b7 (stale) Mirror 11: 0x11c5d6b7 (stale) Mirror 12: 0x11c5d6b7 (stale) Mirror 13: 0x11c5d6b7 (stale) Mirror 15: 0x11c5d6b7 (stale) Mirror 16: 0x11c5d6b7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1b3de524 Mirror 17: 0x1b3de524 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000542 1783136048.431297 mapread 0x012321 thru 0x019117 (0x6df7 bytes) 000543 1783136048.476939 trunc from 0x040000 to 0x004afa (0x3b505 bytes) 000544 1783136048.538333 trunc from 0x001af2 to 0x004afa (0x3009 bytes) 000545 1783136048.546974 MIRROR_RESYNC 10 mirrors 000547 1783136049.915152 mapwrite 0x0014bb thru 0x001902 (0x448 bytes) 000548 1783136050.064894 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x4afb): Mirror 5: 0x9bea642b (stale) Mirror 7: 0x9bea642b (stale) Mirror 10: 0x9bea642b (stale) Mirror 11: 0x9bea642b (stale) Mirror 12: 0x9bea642b (stale) Mirror 13: 0x9bea642b (stale) Mirror 16: 0x9bea642b (stale) Mirror 17: 0x9bea642b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4afb): Mirror 5: 0x9bea642b (stale) Mirror 7: 0x9bea642b (stale) Mirror 10: 0x9bea642b (stale) Mirror 11: 0x9bea642b (stale) Mirror 12: 0x9bea642b (stale) Mirror 13: 0x9bea642b (stale) Mirror 16: 0x9bea642b (stale) Mirror 17: 0x9bea642b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4afb: skipped 000549 1783136050.726914 punch from 0x001b4f to 0x004afa (0x2fac bytes) 000550 1783136050.735444 mapread 0x0003a1 thru 0x004afa (0x475a bytes) 000551 1783136050.761557 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x4afb): Mirror 7: 0x9bea642b (stale) Mirror 10: 0x9bea642b (stale) Mirror 11: 0x9bea642b (stale) Mirror 12: 0x9bea642b (stale) Mirror 13: 0x9bea642b (stale) Mirror 16: 0x9bea642b (stale) Mirror 17: 0x9bea642b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4afb): Mirror 7: 0x9bea642b (stale) Mirror 10: 0x9bea642b (stale) Mirror 11: 0x9bea642b (stale) Mirror 12: 0x9bea642b (stale) Mirror 13: 0x9bea642b (stale) Mirror 16: 0x9bea642b (stale) Mirror 17: 0x9bea642b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4afb: skipped 000552 1783136051.189292 write 0x03c189 thru 0x03ffff (0x3e77 bytes) 000553 1783136051.196319 trunc from 0x02baaa to 0x03a525 (0xea7c bytes) 000554 1783136051.201278 write 0x01318c thru 0x01f258 (0xc0cd bytes) 000555 1783136051.210516 fallocate 0x01579e thru 0x01c940 (0x71a3 bytes) 000556 1783136051.216793 mapread 0x01c1ee thru 0x01f230 (0x3043 bytes) 000557 1783136051.218127 trunc from 0x040000 to 0x03b6c4 (0x493b bytes) 000559 1783136051.243450 mapwrite 0x027466 thru 0x02dc49 (0x67e4 bytes) 000560 1783136051.295732 trunc from 0x02ae7c to 0x02b189 (0x30e bytes) 000561 1783136051.305085 write 0x030a19 thru 0x035c04 (0x51ec bytes) 000563 1783136051.324607 punch from 0x035a68 to 0x03b6c4 (0x5c5d bytes) 000564 1783136051.372193 fallocate 0x011c7f thru 0x0120e7 (0x469 bytes) 000565 1783136051.384233 write 0x024f8a thru 0x02b74d (0x67c4 bytes) 000566 1783136051.406054 trunc from 0x015f73 to 0x01bbc2 (0x5c50 bytes) 000567 1783136051.418884 trunc from 0x03b6c5 to 0x01d584 (0x1e140 bytes) 000568 1783136051.443736 trunc from 0x0033d4 to 0x00c807 (0x9434 bytes) 000569 1783136051.454082 trunc from 0x00560d to 0x009712 (0x4106 bytes) 000570 1783136051.466239 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x1d585): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d585): Mirror 7: 0x335639a0 (stale) Mirror 10: 0x335639a0 (stale) Mirror 11: 0x335639a0 (stale) Mirror 12: 0x335639a0 (stale) Mirror 13: 0x335639a0 (stale) Mirror 16: 0x335639a0 (stale) Mirror 17: 0x335639a0 (stale) CRC-32 checksum value for chunk [0, 0x1d585): Mirror 1: 0xcc46f891 Mirror 18: 0xcc46f891 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d585: skipped 000571 1783136053.116332 MIRROR_RESYNC 9 mirrors 000572 1783136055.258082 trunc from 0x001d28 to 0x002d50 (0x1029 bytes) 000573 1783136055.296844 MIRROR_RESYNC 9 mirrors 000574 1783136057.409342 read 0x004efd thru 0x00c617 (0x771b bytes) 000575 1783136057.418388 mapwrite 0x01c548 thru 0x023feb (0x7aa4 bytes) 000576 1783136057.509233 MIRROR_RESYNC 9 mirrors 000577 1783136059.536762 punch from 0x01713e to 0x019140 (0x2003 bytes) 000578 1783136059.574047 read 0x011f6c thru 0x01947b (0x7510 bytes) 000579 1783136059.591644 mapread 0x022506 thru 0x023feb (0x1ae6 bytes) 000580 1783136059.602621 read 0x01058e thru 0x0188f6 (0x8369 bytes) 000581 1783136059.613477 write 0x02d574 thru 0x02f2ac (0x1d39 bytes) 000582 1783136059.615005 write 0x01148d thru 0x018fb9 (0x7b2d bytes) 000583 1783136059.617357 fallocate 0x025ef7 thru 0x0311d0 (0xb2da bytes) 000584 1783136059.621945 trunc from 0x01958c to 0x0226e6 (0x915b bytes) 000585 1783136059.626723 write 0x01f02b thru 0x025dcc (0x6da2 bytes) 000586 1783136059.637146 trunc from 0x0311d1 to 0x02252a (0xeca6 bytes) 000587 1783136059.666067 mapread 0x00dc15 thru 0x00fdbc (0x21a8 bytes) 000588 1783136059.667528 punch from 0x017e0e to 0x01b926 (0x3b19 bytes) 000589 1783136059.684489 write 0x01070e thru 0x011ce3 (0x15d6 bytes) 000590 1783136059.685670 mapwrite 0x01a918 thru 0x02a7cf (0xfeb8 bytes) 000591 1783136059.781191 mapwrite 0x00ed63 thru 0x012d65 (0x4003 bytes) 000592 1783136059.804324 read 0x004d3f thru 0x00b920 (0x6be2 bytes) 000593 1783136059.805498 trunc from 0x019708 to 0x022575 (0x8e6e bytes) 000594 1783136059.811362 write 0x03fe8a thru 0x03ffff (0x176 bytes) 000596 1783136059.814075 punch from 0x0152a2 to 0x016cbf (0x1a1e bytes) 000597 1783136059.818841 write 0x031a98 thru 0x0371ad (0x5716 bytes) 000598 1783136059.829856 trunc from 0x040000 to 0x01cbfd (0x23402 bytes) 000599 1783136059.845070 mapwrite 0x035c64 thru 0x036b27 (0xec4 bytes) 000601 1783136059.889231 trunc from 0x036b28 to 0x007e20 (0x2ed07 bytes) 000602 1783136059.905560 mapwrite 0x02ec86 thru 0x039002 (0xa37d bytes) 000603 1783136060.006032 mapwrite 0x035fbf thru 0x038af2 (0x2b34 bytes) 000604 1783136060.034461 fallocate 0x021c77 thru 0x02fd25 (0xe0af bytes) 000605 1783136060.053543 write 0x028387 thru 0x0367c7 (0xe441 bytes) 000607 1783136060.069129 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x39003): Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39003): Mirror 7: 0xefa28d67 (stale) Mirror 10: 0xefa28d67 (stale) Mirror 11: 0xefa28d67 (stale) Mirror 12: 0xefa28d67 (stale) Mirror 13: 0xefa28d67 (stale) Mirror 16: 0xefa28d67 (stale) Mirror 17: 0xefa28d67 (stale) Mirror 18: 0xefa28d67 (stale) CRC-32 checksum value for chunk [0, 0x39003): Mirror 1: 0x23f74492 Mirror 19: 0x23f74492 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39003: skipped 000608 1783136060.908849 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39003): Mirror 10: 0xefa28d67 (stale) Mirror 11: 0xefa28d67 (stale) Mirror 12: 0xefa28d67 (stale) Mirror 13: 0xefa28d67 (stale) Mirror 16: 0xefa28d67 (stale) Mirror 17: 0xefa28d67 (stale) Mirror 18: 0xefa28d67 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39003): Mirror 10: 0xefa28d67 (stale) Mirror 11: 0xefa28d67 (stale) Mirror 12: 0xefa28d67 (stale) Mirror 13: 0xefa28d67 (stale) Mirror 16: 0xefa28d67 (stale) Mirror 17: 0xefa28d67 (stale) Mirror 18: 0xefa28d67 (stale) CRC-32 checksum value for chunk [0, 0x39003): Mirror 1: 0x23f74492 Mirror 19: 0x23f74492 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39003: skipped 000609 1783136061.761649 trunc from 0x0129eb to 0x01c87a (0x9e90 bytes) 000610 1783136061.838098 trunc from 0x039003 to 0x022aae (0x16554 bytes) 000612 1783136061.907416 trunc from 0x01ed6b to 0x0224c2 (0x3758 bytes) 000613 1783136061.917510 read 0x003fcb thru 0x00e122 (0xa158 bytes) 000614 1783136061.934880 trunc from 0x003691 to 0x0048ef (0x125f bytes) 000616 1783136061.944654 mapwrite 0x00be77 thru 0x00d512 (0x169c bytes) 000617 1783136061.965782 MIRROR_RESYNC 9 mirrors 000618 1783136063.804957 read 0x00de82 thru 0x016128 (0x82a7 bytes) 000619 1783136063.812223 fallocate 0x03073e thru 0x0341b1 (0x3a74 bytes) 000620 1783136063.854797 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x341b2): Mirror 10: 0xd09e61da (stale) Mirror 11: 0xd09e61da (stale) Mirror 12: 0xd09e61da (stale) Mirror 13: 0xd09e61da (stale) Mirror 16: 0xd09e61da (stale) Mirror 17: 0xd09e61da (stale) Mirror 18: 0xd09e61da (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x341b2): Mirror 10: 0xd09e61da (stale) Mirror 11: 0xd09e61da (stale) Mirror 12: 0xd09e61da (stale) Mirror 13: 0xd09e61da (stale) Mirror 16: 0xd09e61da (stale) Mirror 17: 0xd09e61da (stale) Mirror 18: 0xd09e61da (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x341b2: skipped 000621 1783136064.291390 punch from 0x01499d to 0x01646f (0x1ad3 bytes) 000622 1783136064.296172 punch from 0x007101 to 0x013491 (0xc391 bytes) 000623 1783136064.301185 trunc from 0x0341b2 to 0x00da85 (0x2672c bytes) 000624 1783136064.333311 MIRROR_RESYNC 8 mirrors 000625 1783136065.472806 trunc from 0x00da86 to 0x00b470 (0x2615 bytes) 000626 1783136065.520155 trunc from 0x00b471 to 0x020096 (0x14c26 bytes) 000629 1783136065.537430 fallocate 0x01432f thru 0x01f80d (0xb4df bytes) 000631 1783136065.548048 MIRROR_RESYNC 8 mirrors 000632 1783136066.822750 write 0x0287e1 thru 0x033c0d (0xb42d bytes) 000633 1783136066.863555 write 0x023d43 thru 0x0244ca (0x788 bytes) 000634 1783136066.873889 read 0x02f5fe thru 0x033c0d (0x4610 bytes) 000635 1783136066.874683 write 0x02c98c thru 0x03167d (0x4cf2 bytes) 000636 1783136066.876544 mapread 0x01862b thru 0x026904 (0xe2da bytes) 000637 1783136066.899317 trunc from 0x022409 to 0x02f78b (0xd383 bytes) 000638 1783136066.912359 read 0x011af2 thru 0x020e8d (0xf39c bytes) 000639 1783136066.922245 trunc from 0x00e51c to 0x015eae (0x7993 bytes) 000640 1783136066.926560 punch from 0x02cd4c to 0x033c0d (0x6ec2 bytes) 000641 1783136066.932448 mapread 0x02263a thru 0x02d177 (0xab3e bytes) 000642 1783136066.943427 mapread 0x01b450 thru 0x01fdd2 (0x4983 bytes) 000643 1783136066.949103 MIRROR_RESYNC 8 mirrors 000646 1783136068.183542 mapread 0x009a70 thru 0x00ef4f (0x54e0 bytes) 000647 1783136068.206436 trunc from 0x015444 to 0x01eae6 (0x96a3 bytes) 000648 1783136068.237791 mapwrite 0x015411 thru 0x0181be (0x2dae bytes) 000649 1783136068.267547 read 0x0225ca thru 0x02f687 (0xd0be bytes) 000650 1783136068.280998 read 0x030c4d thru 0x033c0d (0x2fc1 bytes) 000651 1783136068.290185 mapread 0x010ace thru 0x01c394 (0xb8c7 bytes) 000653 1783136068.300444 MIRROR_RESYNC 8 mirrors 000654 1783136069.983419 trunc from 0x0081b2 to 0x017e39 (0xfc88 bytes) 000655 1783136070.023548 write 0x02aa28 thru 0x0343fa (0x99d3 bytes) 000656 1783136070.039048 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x343fb): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x343fb): Mirror 10: 0xee2ea1e4 (stale) Mirror 11: 0xee2ea1e4 (stale) Mirror 12: 0xee2ea1e4 (stale) Mirror 13: 0xee2ea1e4 (stale) Mirror 16: 0xee2ea1e4 (stale) Mirror 17: 0xee2ea1e4 (stale) Mirror 18: 0xee2ea1e4 (stale) CRC-32 checksum value for chunk [0, 0x343fb): Mirror 1: 0xf189e012 Mirror 19: 0xf189e012 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x343fb: skipped 000657 1783136071.047506 punch from 0x0120b8 to 0x01e744 (0xc68d bytes) 000659 1783136071.090237 read 0x02cc7c thru 0x0343fa (0x777f bytes) 000660 1783136071.104902 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x343fb): Mirror 10: 0xee2ea1e4 (stale) Mirror 11: 0xee2ea1e4 (stale) Mirror 12: 0xee2ea1e4 (stale) Mirror 13: 0xee2ea1e4 (stale) Mirror 16: 0xee2ea1e4 (stale) Mirror 17: 0xee2ea1e4 (stale) Mirror 19: 0xf189e012 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x343fb): Mirror 10: 0xee2ea1e4 (stale) Mirror 11: 0xee2ea1e4 (stale) Mirror 12: 0xee2ea1e4 (stale) Mirror 13: 0xee2ea1e4 (stale) Mirror 16: 0xee2ea1e4 (stale) Mirror 17: 0xee2ea1e4 (stale) Mirror 19: 0xf189e012 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x343fb: skipped 000661 1783136071.588634 punch from 0x018b04 to 0x0268fd (0xddfa bytes) 000662 1783136071.594022 trunc from 0x0102bc to 0x01b8d7 (0xb61c bytes) 000663 1783136071.600304 trunc from 0x0343fb to 0x035f5b (0x1b61 bytes) 000664 1783136071.621798 trunc from 0x0244f1 to 0x027649 (0x3159 bytes) 000665 1783136071.629668 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x35f5c): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35f5c): Mirror 10: 0x28107060 (stale) Mirror 11: 0x28107060 (stale) Mirror 12: 0x28107060 (stale) Mirror 13: 0x28107060 (stale) Mirror 16: 0x28107060 (stale) Mirror 17: 0x28107060 (stale) Mirror 19: 0x32769ceb (stale) CRC-32 checksum value for chunk [0, 0x35f5c): Mirror 1: 0xc9f03581 Mirror 20: 0xc9f03581 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35f5c: skipped 000666 1783136072.652814 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35f5c): Mirror 10: 0x28107060 (stale) Mirror 11: 0x28107060 (stale) Mirror 12: 0x28107060 (stale) Mirror 13: 0x28107060 (stale) Mirror 16: 0x28107060 (stale) Mirror 19: 0x32769ceb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35f5c): Mirror 10: 0x28107060 (stale) Mirror 11: 0x28107060 (stale) Mirror 12: 0x28107060 (stale) Mirror 13: 0x28107060 (stale) Mirror 16: 0x28107060 (stale) Mirror 19: 0x32769ceb (stale) CRC-32 checksum value for chunk [0, 0x35f5c): Mirror 1: 0xc9f03581 Mirror 20: 0xc9f03581 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35f5c: skipped 000667 1783136073.608425 trunc from 0x00617d to 0x006edc (0xd60 bytes) 000668 1783136073.657185 mapwrite 0x015bff thru 0x024773 (0xeb75 bytes) 000669 1783136073.723639 trunc from 0x035f5c to 0x026eff (0xf05c bytes) 000670 1783136073.774141 trunc from 0x0039a9 to 0x0060fc (0x2754 bytes) 000671 1783136073.783732 fallocate 0x0020d8 thru 0x00ede9 (0xcd12 bytes) 000672 1783136073.805330 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26f00): Mirror 10: 0x2b5215a2 (stale) Mirror 11: 0x2b5215a2 (stale) Mirror 12: 0x2b5215a2 (stale) Mirror 13: 0x2b5215a2 (stale) Mirror 16: 0x2b5215a2 (stale) Mirror 20: 0x65d10a4a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26f00): Mirror 10: 0x2b5215a2 (stale) Mirror 11: 0x2b5215a2 (stale) Mirror 12: 0x2b5215a2 (stale) Mirror 13: 0x2b5215a2 (stale) Mirror 16: 0x2b5215a2 (stale) Mirror 20: 0x65d10a4a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26f00: skipped 000673 1783136074.194941 read 0x007ab0 thru 0x009c26 (0x2177 bytes) 000674 1783136074.202983 read 0x0263c6 thru 0x026eff (0xb3a bytes) 000675 1783136074.240139 fallocate 0x02e8e4 thru 0x0303ee (0x1b0b bytes) 000676 1783136074.251692 write 0x004b4e thru 0x012986 (0xde39 bytes) 000677 1783136074.260779 fallocate 0x01cd8f thru 0x020cb3 (0x3f25 bytes) 000678 1783136074.268360 write 0x017734 thru 0x020aca (0x9397 bytes) 000680 1783136074.270413 mapwrite 0x01a1e2 thru 0x02703c (0xce5b bytes) 000681 1783136074.343267 read 0x00c930 thru 0x0173b8 (0xaa89 bytes) 000682 1783136074.344337 write 0x0360c1 thru 0x03ffff (0x9f3f bytes) 000683 1783136074.348098 mapread 0x031b5c thru 0x03d643 (0xbae8 bytes) 000685 1783136074.362434 trunc from 0x040000 to 0x03c60d (0x39f2 bytes) 000686 1783136074.384919 mapwrite 0x02cdd6 thru 0x02cf26 (0x151 bytes) 000687 1783136074.414866 trunc from 0x00c83f to 0x0177bc (0xaf7e bytes) 000688 1783136074.422050 write 0x02894d thru 0x02ef61 (0x6615 bytes) 000689 1783136074.423552 trunc from 0x03c60e to 0x02dd5a (0xe8b3 bytes) 000690 1783136074.455905 read 0x005e86 thru 0x0101e2 (0xa35d bytes) 000691 1783136074.473273 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2dd5b): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2dd5b): Mirror 10: 0xa1b320d8 (stale) Mirror 11: 0xa1b320d8 (stale) Mirror 12: 0xa1b320d8 (stale) Mirror 13: 0xa1b320d8 (stale) Mirror 16: 0xa1b320d8 (stale) Mirror 20: 0xc512b2f0 (stale) CRC-32 checksum value for chunk [0, 0x2dd5b): Mirror 1: 0x17c0bdce Mirror 21: 0x17c0bdce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2dd5b: skipped 000692 1783136075.614112 mapwrite 0x01bef1 thru 0x027dbb (0xbecb bytes) 000693 1783136075.772352 mapread 0x0160d3 thru 0x01e496 (0x83c4 bytes) 000694 1783136075.773798 punch from 0x029a03 to 0x02dd5a (0x4358 bytes) 000695 1783136075.790361 fallocate 0x017043 thru 0x02030a (0x92c8 bytes) 000696 1783136075.800651 trunc from 0x02dd5b to 0x02eb9f (0xe45 bytes) 000697 1783136075.861835 punch from 0x0163c2 to 0x0205ed (0xa22c bytes) 000698 1783136075.870769 write 0x02b920 thru 0x035afd (0xa1de bytes) 000699 1783136075.878402 mapread 0x007eaf thru 0x010781 (0x88d3 bytes) 000700 1783136075.907796 mapread 0x00a1dc thru 0x0135d1 (0x93f6 bytes) 000701 1783136075.928788 MIRROR_RESYNC 8 mirrors 000702 1783136078.492509 write 0x024096 thru 0x032844 (0xe7af bytes) 000703 1783136078.569943 punch from 0x00e136 to 0x017b01 (0x99cc bytes) 000704 1783136078.580671 mapwrite 0x0312fa thru 0x03c07c (0xad83 bytes) 000706 1783136078.679888 punch from 0x0036c8 to 0x00dc9d (0xa5d6 bytes) 000707 1783136078.693104 fallocate 0x032ad3 thru 0x037dc1 (0x52ef bytes) 000709 1783136078.706068 write 0x03b42e thru 0x03ffff (0x4bd2 bytes) 000710 1783136078.708138 fallocate 0x01332a thru 0x01ddd7 (0xaaae bytes) 000711 1783136078.718052 mapwrite 0x01110a thru 0x01c043 (0xaf3a bytes) 000712 1783136078.782247 mapread 0x02bb13 thru 0x02bf2f (0x41d bytes) 000713 1783136078.784339 punch from 0x03c1ec to 0x03d895 (0x16aa bytes) 000714 1783136078.798529 write 0x0019df thru 0x006f8b (0x55ad bytes) 000715 1783136078.824023 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x1cf9cc64 (stale) Mirror 11: 0x1cf9cc64 (stale) Mirror 12: 0x1cf9cc64 (stale) Mirror 13: 0x1cf9cc64 (stale) Mirror 16: 0x1cf9cc64 (stale) Mirror 20: 0x1cf9cc64 (stale) Mirror 21: 0x1cf9cc64 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5e549a2d Mirror 22: 0x5e549a2d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000716 1783136079.965159 punch from 0x025748 to 0x025c7b (0x534 bytes) 000717 1783136080.058413 MIRROR_RESYNC 9 mirrors 000718 1783136082.773335 trunc from 0x01e4ce to 0x02a506 (0xc039 bytes) 000719 1783136082.834859 trunc from 0x02b53a to 0x02ebe2 (0x36a9 bytes) 000720 1783136082.842019 punch from 0x0068ed to 0x00cdbd (0x64d1 bytes) 000721 1783136082.847110 write 0x0096d5 thru 0x00bb1c (0x2448 bytes) 000722 1783136082.857973 mapread 0x01dc57 thru 0x026a97 (0x8e41 bytes) 000723 1783136082.883824 write 0x012bbd thru 0x01c6bb (0x9aff bytes) 000724 1783136082.891336 mapwrite 0x02abf6 thru 0x02d216 (0x2621 bytes) 000725 1783136082.930969 punch from 0x00f2e8 to 0x0140c8 (0x4de1 bytes) 000726 1783136082.938951 mapwrite 0x028e8a thru 0x02a9ff (0x1b76 bytes) 000728 1783136082.968902 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xf038ef5f (stale) Mirror 11: 0xf038ef5f (stale) Mirror 12: 0xf038ef5f (stale) Mirror 13: 0xf038ef5f (stale) Mirror 16: 0xf038ef5f (stale) Mirror 20: 0xf038ef5f (stale) Mirror 22: 0xf038ef5f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xf038ef5f (stale) Mirror 11: 0xf038ef5f (stale) Mirror 12: 0xf038ef5f (stale) Mirror 13: 0xf038ef5f (stale) Mirror 16: 0xf038ef5f (stale) Mirror 20: 0xf038ef5f (stale) Mirror 22: 0xf038ef5f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000729 1783136083.592959 mapwrite 0x0106da thru 0x01b5c4 (0xaeeb bytes) 000730 1783136083.682343 fallocate 0x03e5b3 thru 0x03ffff (0x1a4d bytes) 000731 1783136083.688984 mapwrite 0x01c8af thru 0x028aa0 (0xc1f2 bytes) 000732 1783136083.721079 mapread 0x03f758 thru 0x03ffff (0x8a8 bytes) 000733 1783136083.731719 write 0x009bab thru 0x015d15 (0xc16b bytes) 000734 1783136083.740286 trunc from 0x03ca33 to 0x03de64 (0x1432 bytes) 000735 1783136083.749952 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xf038ef5f (stale) Mirror 11: 0xf038ef5f (stale) Mirror 12: 0xf038ef5f (stale) Mirror 13: 0xf038ef5f (stale) Mirror 16: 0xf038ef5f (stale) Mirror 20: 0xf038ef5f (stale) Mirror 22: 0xf038ef5f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3af5d21c Mirror 23: 0x3af5d21c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000736 1783136084.876346 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xf038ef5f (stale) Mirror 11: 0xf038ef5f (stale) Mirror 12: 0xf038ef5f (stale) Mirror 13: 0xf038ef5f (stale) Mirror 16: 0xf038ef5f (stale) Mirror 20: 0xf038ef5f (stale) Mirror 22: 0xf038ef5f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3af5d21c Mirror 23: 0x3af5d21c Mirror 24: 0x3af5d21c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000737 1783136086.083081 trunc from 0x040000 to 0x013897 (0x2c768 bytes) 000738 1783136086.131998 punch from 0x00fc9a to 0x013897 (0x3bfe bytes) 000739 1783136086.138869 mapwrite 0x021cbb thru 0x031139 (0xf47f bytes) 000740 1783136086.208887 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3113a): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3113a): Mirror 10: 0x5320533b (stale) Mirror 11: 0x5320533b (stale) Mirror 12: 0x5320533b (stale) Mirror 13: 0x5320533b (stale) Mirror 16: 0x5320533b (stale) Mirror 20: 0x5320533b (stale) Mirror 22: 0x5320533b (stale) Mirror 23: 0xbdb47e1a (stale) Mirror 24: 0xbdb47e1a (stale) CRC-32 checksum value for chunk [0, 0x3113a): Mirror 1: 0xd5b41834 Mirror 25: 0xd5b41834 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3113a: skipped 000741 1783136087.312139 write 0x0079da thru 0x01132f (0x9956 bytes) 000742 1783136087.363874 punch from 0x01fe15 to 0x022393 (0x257f bytes) 000743 1783136087.369065 write 0x00d9e0 thru 0x017f3e (0xa55f bytes) 000744 1783136087.375451 punch from 0x030e01 to 0x031139 (0x339 bytes) 000745 1783136087.379862 punch from 0x01e8d3 to 0x02c3b9 (0xdae7 bytes) 000746 1783136087.385915 fallocate 0x020d03 thru 0x0300a4 (0xf3a2 bytes) 000747 1783136087.391882 mapwrite 0x0374a4 thru 0x03d604 (0x6161 bytes) 000749 1783136087.467858 mapread 0x0309a7 thru 0x03aade (0xa138 bytes) 000750 1783136087.477647 read 0x0219b8 thru 0x02ece7 (0xd330 bytes) 000751 1783136087.486676 write 0x01f043 thru 0x02ca43 (0xda01 bytes) 000753 1783136087.492563 mapwrite 0x003536 thru 0x008989 (0x5454 bytes) 000754 1783136087.518945 mapread 0x028d5f thru 0x03840b (0xf6ad bytes) 000755 1783136087.520565 mapwrite 0x00e803 thru 0x010e5f (0x265d bytes) 000756 1783136087.533779 read 0x01bda8 thru 0x02518d (0x93e6 bytes) 000758 1783136087.544463 trunc from 0x03d605 to 0x0215fd (0x1c007 bytes) 000759 1783136087.561057 mapwrite 0x027d8c thru 0x02f177 (0x73ec bytes) 000760 1783136087.636960 trunc from 0x02f178 to 0x013dfb (0x1b37c bytes) 000761 1783136087.657321 trunc from 0x0022a9 to 0x008bb8 (0x6910 bytes) 000762 1783136087.662835 trunc from 0x013dfc to 0x03fe6f (0x2c074 bytes) 000763 1783136087.681117 trunc from 0x03fe70 to 0x03860d (0x7862 bytes) 000764 1783136087.696772 trunc from 0x03860e to 0x021aca (0x16b43 bytes) 000765 1783136087.712221 read 0x001087 thru 0x00f901 (0xe87b bytes) 000767 1783136087.723649 write 0x014c81 thru 0x0234c3 (0xe843 bytes) 000768 1783136087.726407 mapwrite 0x02b1ef thru 0x03086e (0x5680 bytes) 000769 1783136087.772025 MIRROR_RESYNC 11 mirrors 000770 1783136090.709874 read 0x02273c thru 0x03086e (0xe133 bytes) 000771 1783136090.732434 mapwrite 0x0170f7 thru 0x022e9b (0xbda5 bytes) 000772 1783136090.969424 write 0x037666 thru 0x03aaa7 (0x3442 bytes) 000773 1783136090.970881 mapwrite 0x0066c1 thru 0x0112d0 (0xac10 bytes) 000774 1783136091.094423 write 0x03349a thru 0x0352b3 (0x1e1a bytes) 000775 1783136091.121065 mapwrite 0x0066c9 thru 0x0080c9 (0x1a01 bytes) 000776 1783136091.142672 mapread 0x012259 thru 0x020c51 (0xe9f9 bytes) 000777 1783136091.145744 mapread 0x022526 thru 0x0253ab (0x2e86 bytes) 000778 1783136091.147381 read 0x0328c3 thru 0x03aaa7 (0x81e5 bytes) 000779 1783136091.164400 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3aaa8): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aaa8): Mirror 10: 0x14468e7d (stale) Mirror 11: 0x14468e7d (stale) Mirror 12: 0x14468e7d (stale) Mirror 13: 0x14468e7d (stale) Mirror 16: 0x14468e7d (stale) Mirror 20: 0x14468e7d (stale) Mirror 22: 0x14468e7d (stale) Mirror 23: 0x14468e7d (stale) Mirror 24: 0x14468e7d (stale) Mirror 25: 0x14468e7d (stale) CRC-32 checksum value for chunk [0, 0x3aaa8): Mirror 1: 0x3f1624c4 Mirror 26: 0x3f1624c4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aaa8: skipped 000781 1783136092.842063 mapread 0x01a7a4 thru 0x021949 (0x71a6 bytes) 000782 1783136092.910138 mapwrite 0x00a620 thru 0x00bdd1 (0x17b2 bytes) 000783 1783136093.075083 MIRROR_SPLIT mirror 5 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3aaa8): Mirror 10: 0x14468e7d (stale) Mirror 11: 0x14468e7d (stale) Mirror 12: 0x14468e7d (stale) Mirror 13: 0x14468e7d (stale) Mirror 20: 0x14468e7d (stale) Mirror 22: 0x14468e7d (stale) Mirror 23: 0x14468e7d (stale) Mirror 24: 0x14468e7d (stale) Mirror 25: 0x14468e7d (stale) Mirror 26: 0x3f1624c4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aaa8): Mirror 10: 0x14468e7d (stale) Mirror 11: 0x14468e7d (stale) Mirror 12: 0x14468e7d (stale) Mirror 13: 0x14468e7d (stale) Mirror 20: 0x14468e7d (stale) Mirror 22: 0x14468e7d (stale) Mirror 23: 0x14468e7d (stale) Mirror 24: 0x14468e7d (stale) Mirror 25: 0x14468e7d (stale) Mirror 26: 0x3f1624c4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aaa8: skipped 000784 1783136093.959090 trunc from 0x03aaa8 to 0x009396 (0x31711 bytes) 000785 1783136094.057742 trunc from 0x009397 to 0x02f6f3 (0x2635d bytes) 000786 1783136094.080801 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x2f6f4): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f6f4): Mirror 10: 0xd762d8f4 (stale) Mirror 11: 0xd762d8f4 (stale) Mirror 12: 0xd762d8f4 (stale) Mirror 13: 0xd762d8f4 (stale) Mirror 20: 0xd762d8f4 (stale) Mirror 22: 0xd762d8f4 (stale) Mirror 23: 0xd762d8f4 (stale) Mirror 24: 0xd762d8f4 (stale) Mirror 25: 0xd762d8f4 (stale) Mirror 26: 0x1d6f23a8 (stale) CRC-32 checksum value for chunk [0, 0x2f6f4): Mirror 1: 0x27d8d685 Mirror 27: 0x27d8d685 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f6f4: skipped 000787 1783136095.236384 mapread 0x028eaf thru 0x02e76e (0x58c0 bytes) 000788 1783136095.286271 trunc from 0x02f6f4 to 0x00bacf (0x23c24 bytes) 000789 1783136095.367781 punch from 0x0071b6 to 0x00bacf (0x491a bytes) 000790 1783136095.377435 trunc from 0x00299f to 0x00bacf (0x9131 bytes) 000791 1783136095.392349 mapread 0x005e89 thru 0x00bacf (0x5c47 bytes) 000792 1783136095.409874 trunc from 0x00bad0 to 0x017568 (0xba99 bytes) 000793 1783136095.444025 mapread 0x010c88 thru 0x0173b4 (0x672d bytes) 000795 1783136095.468076 fallocate 0x006292 thru 0x00b00d (0x4d7c bytes) 000796 1783136095.474579 mapread 0x00a901 thru 0x01347a (0x8b7a bytes) 000797 1783136095.475949 read 0x005672 thru 0x00c6f4 (0x7083 bytes) 000798 1783136095.479114 punch from 0x00ac5e to 0x017568 (0xc90b bytes) 000799 1783136095.486183 write 0x00d0b3 thru 0x011d92 (0x4ce0 bytes) 000800 1783136095.500038 read 0x00ffc6 thru 0x017568 (0x75a3 bytes) 000801 1783136095.520843 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x17569): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17569): Mirror 10: 0x5b24a7a3 (stale) Mirror 11: 0x5b24a7a3 (stale) Mirror 12: 0x5b24a7a3 (stale) Mirror 13: 0x5b24a7a3 (stale) Mirror 20: 0x5b24a7a3 (stale) Mirror 22: 0x5b24a7a3 (stale) Mirror 23: 0x5b24a7a3 (stale) Mirror 24: 0x5b24a7a3 (stale) Mirror 25: 0x5b24a7a3 (stale) Mirror 26: 0x437d2cd0 (stale) Mirror 27: 0x11ad9b06 (stale) CRC-32 checksum value for chunk [0, 0x17569): Mirror 1: 0xcd3fe2c2 Mirror 28: 0xcd3fe2c2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17569: skipped 000803 1783136096.867925 trunc from 0x0065dd to 0x007677 (0x109b bytes) 000804 1783136096.948254 trunc from 0x017569 to 0x01d101 (0x5b99 bytes) 000805 1783136096.983254 read 0x0063d8 thru 0x00874d (0x2376 bytes) 000806 1783136096.992519 fallocate 0x00ae21 thru 0x00ed12 (0x3ef2 bytes) 000807 1783136097.002696 read 0x002fff thru 0x006830 (0x3832 bytes) 000808 1783136097.031899 MIRROR_SPLIT mirror 12 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1d102): Mirror 10: 0x4dabde55 (stale) Mirror 11: 0x4dabde55 (stale) Mirror 12: 0x4dabde55 (stale) Mirror 13: 0x4dabde55 (stale) Mirror 20: 0x4dabde55 (stale) Mirror 22: 0x4dabde55 (stale) Mirror 23: 0x4dabde55 (stale) Mirror 24: 0x4dabde55 (stale) Mirror 25: 0x4dabde55 (stale) Mirror 26: 0xb3bfe2ed (stale) Mirror 27: 0xcf682bff (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d102): Mirror 10: 0x4dabde55 (stale) Mirror 11: 0x4dabde55 (stale) Mirror 12: 0x4dabde55 (stale) Mirror 13: 0x4dabde55 (stale) Mirror 20: 0x4dabde55 (stale) Mirror 22: 0x4dabde55 (stale) Mirror 23: 0x4dabde55 (stale) Mirror 24: 0x4dabde55 (stale) Mirror 25: 0x4dabde55 (stale) Mirror 26: 0xb3bfe2ed (stale) Mirror 27: 0xcf682bff (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d102: skipped 000810 1783136097.939515 trunc from 0x0074b1 to 0x010467 (0x8fb7 bytes) 000811 1783136097.949109 read 0x015f8e thru 0x01a5f2 (0x4665 bytes) 000812 1783136097.961228 mapread 0x00adff thru 0x017d7f (0xcf81 bytes) 000813 1783136097.984788 read 0x01a374 thru 0x01d101 (0x2d8e bytes) 000814 1783136097.996542 write 0x01dba4 thru 0x01fbc5 (0x2022 bytes) 000815 1783136098.005231 fallocate 0x017fe8 thru 0x01bcd7 (0x3cf0 bytes) 000816 1783136098.011791 read 0x012e42 thru 0x019e8d (0x704c bytes) 000817 1783136098.013367 punch from 0x0184b6 to 0x01fbc5 (0x7710 bytes) 000821 1783136098.028933 fallocate 0x03ab11 thru 0x03d826 (0x2d16 bytes) 000822 1783136098.039163 MIRROR_SPLIT mirror 10 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d827): Mirror 10: 0x163c73bd (stale) Mirror 11: 0x163c73bd (stale) Mirror 12: 0x163c73bd (stale) Mirror 13: 0x163c73bd (stale) Mirror 20: 0x163c73bd (stale) Mirror 22: 0x163c73bd (stale) Mirror 23: 0x163c73bd (stale) Mirror 24: 0x163c73bd (stale) Mirror 25: 0x163c73bd (stale) Mirror 27: 0x608ce508 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d827): Mirror 10: 0x163c73bd (stale) Mirror 11: 0x163c73bd (stale) Mirror 12: 0x163c73bd (stale) Mirror 13: 0x163c73bd (stale) Mirror 20: 0x163c73bd (stale) Mirror 22: 0x163c73bd (stale) Mirror 23: 0x163c73bd (stale) Mirror 24: 0x163c73bd (stale) Mirror 25: 0x163c73bd (stale) Mirror 27: 0x608ce508 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d827: skipped 000823 1783136098.648577 write 0x02fc3f thru 0x0383e1 (0x87a3 bytes) 000825 1783136098.670410 write 0x02e99d thru 0x035179 (0x67dd bytes) 000827 1783136098.685679 mapwrite 0x02369c thru 0x02466d (0xfd2 bytes) 000828 1783136098.748850 trunc from 0x01fc2b to 0x025172 (0x5548 bytes) 000829 1783136098.755418 mapwrite 0x0227d8 thru 0x02859c (0x5dc5 bytes) 000832 1783136098.799751 MIRROR_SPLIT mirror 10 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d827): Mirror 10: 0x163c73bd (stale) Mirror 11: 0x163c73bd (stale) Mirror 12: 0x163c73bd (stale) Mirror 13: 0x163c73bd (stale) Mirror 20: 0x163c73bd (stale) Mirror 22: 0x163c73bd (stale) Mirror 23: 0x163c73bd (stale) Mirror 24: 0x163c73bd (stale) Mirror 25: 0x163c73bd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d827): Mirror 10: 0x163c73bd (stale) Mirror 11: 0x163c73bd (stale) Mirror 12: 0x163c73bd (stale) Mirror 13: 0x163c73bd (stale) Mirror 20: 0x163c73bd (stale) Mirror 22: 0x163c73bd (stale) Mirror 23: 0x163c73bd (stale) Mirror 24: 0x163c73bd (stale) Mirror 25: 0x163c73bd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d827: skipped 000833 1783136099.429095 mapwrite 0x0336ae thru 0x03ffff (0xc952 bytes) 000834 1783136099.492898 fallocate 0x0253bc thru 0x0254aa (0xef bytes) 000835 1783136099.503722 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xa2100e6c (stale) Mirror 11: 0xa2100e6c (stale) Mirror 12: 0xa2100e6c (stale) Mirror 13: 0xa2100e6c (stale) Mirror 20: 0xa2100e6c (stale) Mirror 22: 0xa2100e6c (stale) Mirror 23: 0xa2100e6c (stale) Mirror 24: 0xa2100e6c (stale) Mirror 25: 0xa2100e6c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd98fdc47 Mirror 26: 0xd98fdc47 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000836 1783136101.009210 read 0x03244e thru 0x03497e (0x2531 bytes) 000838 1783136101.030167 mapwrite 0x032499 thru 0x0360b0 (0x3c18 bytes) 000839 1783136101.118961 mapwrite 0x0191fc thru 0x01c794 (0x3599 bytes) 000840 1783136101.146329 fallocate 0x02990d thru 0x03031e (0x6a12 bytes) 000841 1783136101.152706 trunc from 0x040000 to 0x03c059 (0x3fa6 bytes) 000842 1783136101.175343 MIRROR_RESYNC 11 mirrors 000843 1783136105.408855 trunc from 0x023956 to 0x0315dc (0xdc87 bytes) 000844 1783136105.505710 fallocate 0x007bf5 thru 0x010d80 (0x918c bytes) 000845 1783136105.513776 write 0x002920 thru 0x00ca06 (0xa0e7 bytes) 000846 1783136105.555445 fallocate 0x00d7c5 thru 0x019073 (0xb8af bytes) 000848 1783136105.574379 mapwrite 0x0244e6 thru 0x03118d (0xcca8 bytes) 000849 1783136105.649759 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c05a): Mirror 11: 0xd4c390ce (stale) Mirror 12: 0xd4c390ce (stale) Mirror 13: 0xd4c390ce (stale) Mirror 20: 0xd4c390ce (stale) Mirror 22: 0xd4c390ce (stale) Mirror 23: 0xd4c390ce (stale) Mirror 24: 0xd4c390ce (stale) Mirror 25: 0xd4c390ce (stale) Mirror 26: 0xd4c390ce (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c05a): Mirror 11: 0xd4c390ce (stale) Mirror 12: 0xd4c390ce (stale) Mirror 13: 0xd4c390ce (stale) Mirror 20: 0xd4c390ce (stale) Mirror 22: 0xd4c390ce (stale) Mirror 23: 0xd4c390ce (stale) Mirror 24: 0xd4c390ce (stale) Mirror 25: 0xd4c390ce (stale) Mirror 26: 0xd4c390ce (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c05a: skipped 000850 1783136106.195109 mapwrite 0x01cb41 thru 0x021ba5 (0x5065 bytes) 000851 1783136106.263689 read 0x03154d thru 0x036fc3 (0x5a77 bytes) 000852 1783136106.281679 write 0x0048e4 thru 0x0096a9 (0x4dc6 bytes) 000853 1783136106.315491 mapwrite 0x00e01b thru 0x01d713 (0xf6f9 bytes) 000855 1783136106.397896 punch from 0x00ea6e to 0x01694d (0x7ee0 bytes) 000856 1783136106.412812 mapwrite 0x02b132 thru 0x0324cf (0x739e bytes) 000857 1783136106.461018 mapwrite 0x00de06 thru 0x012622 (0x481d bytes) 000858 1783136106.507081 mapwrite 0x0265f2 thru 0x032468 (0xbe77 bytes) 000859 1783136106.540098 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3c05a): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c05a): Mirror 11: 0xd4c390ce (stale) Mirror 12: 0xd4c390ce (stale) Mirror 13: 0xd4c390ce (stale) Mirror 20: 0xd4c390ce (stale) Mirror 22: 0xd4c390ce (stale) Mirror 23: 0xd4c390ce (stale) Mirror 24: 0xd4c390ce (stale) Mirror 25: 0xd4c390ce (stale) Mirror 26: 0xd4c390ce (stale) CRC-32 checksum value for chunk [0, 0x3c05a): Mirror 1: 0x5503ff91 Mirror 27: 0x5503ff91 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c05a: skipped 000860 1783136108.351054 write 0x033c3b thru 0x03ffff (0xc3c5 bytes) 000861 1783136108.429567 fallocate 0x03e05e thru 0x03ffff (0x1fa2 bytes) 000862 1783136108.435396 mapwrite 0x003bbe thru 0x00a723 (0x6b66 bytes) 000863 1783136108.484108 trunc from 0x027a70 to 0x03435d (0xc8ee bytes) 000864 1783136108.492987 write 0x0164cd thru 0x019eab (0x39df bytes) 000865 1783136108.509463 mapread 0x014cd5 thru 0x0181ca (0x34f6 bytes) 000866 1783136108.522915 fallocate 0x02f26f thru 0x031e8b (0x2c1d bytes) 000867 1783136108.530499 fallocate 0x035f53 thru 0x03d16e (0x721c bytes) 000868 1783136108.536480 trunc from 0x01c245 to 0x0217f2 (0x55ae bytes) 000870 1783136108.545072 punch from 0x03ceee to 0x03ffff (0x3112 bytes) 000872 1783136108.553652 mapread 0x0378b8 thru 0x03ffff (0x8748 bytes) 000874 1783136108.563184 trunc from 0x040000 to 0x02c846 (0x137b9 bytes) 000875 1783136108.585755 trunc from 0x00adc1 to 0x0168f3 (0xbb33 bytes) 000876 1783136108.605024 mapread 0x01fde4 thru 0x02aa6a (0xac87 bytes) 000877 1783136108.664025 punch from 0x02990b to 0x02c846 (0x2f3c bytes) 000878 1783136108.673578 trunc from 0x02c847 to 0x02d94d (0x1107 bytes) 000879 1783136108.706247 write 0x022c2c thru 0x0322d9 (0xf6ae bytes) 000880 1783136108.712259 trunc from 0x0322da to 0x002e51 (0x2f488 bytes) 000881 1783136108.763366 fallocate 0x01e716 thru 0x02de68 (0xf753 bytes) 000882 1783136108.783731 trunc from 0x02de69 to 0x000f2e (0x2cf3a bytes) 000883 1783136108.811850 trunc from 0x000387 to 0x000f2e (0xba8 bytes) 000884 1783136108.822253 read 0x000f16 thru 0x000f2e (0x19 bytes) 000885 1783136108.828509 read 0x00014f thru 0x000f2e (0xde0 bytes) 000886 1783136108.829376 write 0x02269a thru 0x02b595 (0x8efc bytes) 000887 1783136108.832465 write 0x03015e thru 0x031bcf (0x1a72 bytes) 000888 1783136108.833903 write 0x009e57 thru 0x00dee8 (0x4092 bytes) 000889 1783136108.857684 mapread 0x02d597 thru 0x031bcf (0x4639 bytes) 000890 1783136108.862759 trunc from 0x031bd0 to 0x018584 (0x1964b bytes) 000891 1783136108.906828 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x18585): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18585): Mirror 11: 0xaa494741 (stale) Mirror 12: 0xaa494741 (stale) Mirror 13: 0xaa494741 (stale) Mirror 20: 0xaa494741 (stale) Mirror 22: 0xaa494741 (stale) Mirror 23: 0xaa494741 (stale) Mirror 24: 0xaa494741 (stale) Mirror 25: 0xaa494741 (stale) Mirror 26: 0xaa494741 (stale) Mirror 27: 0xb400fecc (stale) CRC-32 checksum value for chunk [0, 0x18585): Mirror 1: 0x82a1d1ad Mirror 28: 0x82a1d1ad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18585: skipped 000892 1783136110.197054 read 0x00bd66 thru 0x00ea6b (0x2d06 bytes) 000893 1783136110.236618 trunc from 0x001b54 to 0x00441f (0x28cc bytes) 000894 1783136110.332217 fallocate 0x01a251 thru 0x01a72e (0x4de bytes) 000895 1783136110.349374 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x18585): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18585): Mirror 11: 0xaa494741 (stale) Mirror 12: 0xaa494741 (stale) Mirror 13: 0xaa494741 (stale) Mirror 20: 0xaa494741 (stale) Mirror 22: 0xaa494741 (stale) Mirror 23: 0xaa494741 (stale) Mirror 24: 0xaa494741 (stale) Mirror 25: 0xaa494741 (stale) Mirror 26: 0xaa494741 (stale) Mirror 27: 0xb400fecc (stale) Mirror 28: 0x82a1d1ad (stale) CRC-32 checksum value for chunk [0, 0x18585): Mirror 1: 0x82a1d1ad Mirror 29: 0x82a1d1ad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18585: skipped 000896 1783136112.029256 MIRROR_SPLIT mirror 7 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18585): Mirror 11: 0xaa494741 (stale) Mirror 12: 0xaa494741 (stale) Mirror 13: 0xaa494741 (stale) Mirror 20: 0xaa494741 (stale) Mirror 22: 0xaa494741 (stale) Mirror 23: 0xaa494741 (stale) Mirror 25: 0xaa494741 (stale) Mirror 26: 0xaa494741 (stale) Mirror 27: 0xb400fecc (stale) Mirror 28: 0x82a1d1ad (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18585): Mirror 11: 0xaa494741 (stale) Mirror 12: 0xaa494741 (stale) Mirror 13: 0xaa494741 (stale) Mirror 20: 0xaa494741 (stale) Mirror 22: 0xaa494741 (stale) Mirror 23: 0xaa494741 (stale) Mirror 25: 0xaa494741 (stale) Mirror 26: 0xaa494741 (stale) Mirror 27: 0xb400fecc (stale) Mirror 28: 0x82a1d1ad (stale) CRC-32 checksum value for chunk [0, 0x18585): Mirror 1: 0x82a1d1ad Mirror 29: 0x82a1d1ad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18585: skipped 000897 1783136113.746939 fallocate 0x03e4e1 thru 0x03ffff (0x1b1f bytes) 000898 1783136113.866219 trunc from 0x00bbca to 0x010194 (0x45cb bytes) 000899 1783136113.891197 mapread 0x001d66 thru 0x00b0f4 (0x938f bytes) 000900 1783136113.967533 fallocate 0x00decf thru 0x010ebb (0x2fed bytes) 000901 1783136113.986418 trunc from 0x00bffd to 0x00dd5e (0x1d62 bytes) 000902 1783136114.011534 fallocate 0x009eb7 thru 0x00b62e (0x1778 bytes) 000903 1783136114.022410 mapwrite 0x00d40b thru 0x013774 (0x636a bytes) 000904 1783136114.088880 trunc from 0x0102bd to 0x017894 (0x75d8 bytes) 000905 1783136114.095751 mapread 0x0106ee thru 0x01207d (0x1990 bytes) 000906 1783136114.106034 write 0x03171d thru 0x034205 (0x2ae9 bytes) 000907 1783136114.112578 read 0x003a2f thru 0x009970 (0x5f42 bytes) 000909 1783136114.115437 mapread 0x007c1e thru 0x00bfae (0x4391 bytes) 000910 1783136114.117327 trunc from 0x034206 to 0x039a25 (0x5820 bytes) 000911 1783136114.140205 write 0x001a34 thru 0x005d5c (0x4329 bytes) 000912 1783136114.141819 mapread 0x00854e thru 0x009b17 (0x15ca bytes) 000913 1783136114.144386 mapread 0x01470c thru 0x0233d4 (0xecc9 bytes) 000914 1783136114.163357 mapread 0x036de2 thru 0x038bfd (0x1e1c bytes) 000915 1783136114.173123 fallocate 0x01b888 thru 0x02826f (0xc9e8 bytes) 000916 1783136114.178673 trunc from 0x02eee4 to 0x039746 (0xa863 bytes) 000917 1783136114.198068 trunc from 0x039a26 to 0x022a2b (0x16ffa bytes) 000918 1783136114.222284 fallocate 0x020271 thru 0x02a222 (0x9fb2 bytes) 000919 1783136114.228437 trunc from 0x029aa4 to 0x02a222 (0x77f bytes) 000920 1783136114.240821 MIRROR_SPLIT mirror 11 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a223): Mirror 11: 0xa7c66f8e (stale) Mirror 12: 0xa7c66f8e (stale) Mirror 13: 0xa7c66f8e (stale) Mirror 20: 0xa7c66f8e (stale) Mirror 22: 0xa7c66f8e (stale) Mirror 23: 0xa7c66f8e (stale) Mirror 25: 0xa7c66f8e (stale) Mirror 26: 0xa7c66f8e (stale) Mirror 27: 0x7fa04069 (stale) Mirror 28: 0x3cb7866b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a223): Mirror 11: 0xa7c66f8e (stale) Mirror 12: 0xa7c66f8e (stale) Mirror 13: 0xa7c66f8e (stale) Mirror 20: 0xa7c66f8e (stale) Mirror 22: 0xa7c66f8e (stale) Mirror 23: 0xa7c66f8e (stale) Mirror 25: 0xa7c66f8e (stale) Mirror 26: 0xa7c66f8e (stale) Mirror 27: 0x7fa04069 (stale) Mirror 28: 0x3cb7866b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a223: skipped 000921 1783136114.858690 mapread 0x013534 thru 0x021350 (0xde1d bytes) 000922 1783136114.903388 MIRROR_RESYNC 11 mirrors 000923 1783136118.280391 read 0x022781 thru 0x029625 (0x6ea5 bytes) 000924 1783136118.291623 mapread 0x024619 thru 0x0250bb (0xaa3 bytes) 000926 1783136118.293262 write 0x022c52 thru 0x02c7ae (0x9b5d bytes) 000927 1783136118.331871 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c7af): Mirror 11: 0x79ccc777 (stale) Mirror 12: 0x79ccc777 (stale) Mirror 13: 0x79ccc777 (stale) Mirror 20: 0x79ccc777 (stale) Mirror 22: 0x79ccc777 (stale) Mirror 25: 0x79ccc777 (stale) Mirror 26: 0x79ccc777 (stale) Mirror 27: 0x79ccc777 (stale) Mirror 28: 0x79ccc777 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c7af): Mirror 11: 0x79ccc777 (stale) Mirror 12: 0x79ccc777 (stale) Mirror 13: 0x79ccc777 (stale) Mirror 20: 0x79ccc777 (stale) Mirror 22: 0x79ccc777 (stale) Mirror 25: 0x79ccc777 (stale) Mirror 26: 0x79ccc777 (stale) Mirror 27: 0x79ccc777 (stale) Mirror 28: 0x79ccc777 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c7af: skipped 000928 1783136118.993485 write 0x00b4ea thru 0x01b45d (0xff74 bytes) 000929 1783136119.016443 mapwrite 0x00150f thru 0x002a1c (0x150e bytes) 000930 1783136119.051770 mapread 0x000c65 thru 0x007655 (0x69f1 bytes) 000932 1783136119.061038 punch from 0x00835b to 0x00b7b3 (0x3459 bytes) 000933 1783136119.065902 write 0x01f978 thru 0x02849b (0x8b24 bytes) 000934 1783136119.074440 trunc from 0x02c7af to 0x03d01f (0x10871 bytes) 000935 1783136119.092396 trunc from 0x03d020 to 0x009353 (0x33ccc bytes) 000936 1783136119.138172 trunc from 0x001f26 to 0x0075a1 (0x567c bytes) 000937 1783136119.146140 punch from 0x004e17 to 0x009353 (0x453d bytes) 000938 1783136119.151554 punch from 0x0070a1 to 0x009353 (0x22b3 bytes) 000939 1783136119.156869 punch from 0x005b29 to 0x009353 (0x382b bytes) 000940 1783136119.172448 trunc from 0x002445 to 0x00886d (0x6429 bytes) 000941 1783136119.189670 fallocate 0x029bda thru 0x030592 (0x69b9 bytes) 000942 1783136119.203306 trunc from 0x009354 to 0x00f6f2 (0x639f bytes) 000943 1783136119.227307 trunc from 0x0076e7 to 0x007e97 (0x7b1 bytes) 000944 1783136119.238697 trunc from 0x00f6f3 to 0x038cde (0x295ec bytes) 000945 1783136119.269343 MIRROR_RESYNC 10 mirrors 000946 1783136121.213240 mapwrite 0x0366b3 thru 0x03fa4d (0x939b bytes) 000947 1783136121.377005 trunc from 0x0183ed to 0x02837c (0xff90 bytes) 000948 1783136121.391927 read 0x028d46 thru 0x038766 (0xfa21 bytes) 000949 1783136121.412036 punch from 0x009b76 to 0x014935 (0xadc0 bytes) 000950 1783136121.431029 mapwrite 0x0009d6 thru 0x00937b (0x89a6 bytes) 000951 1783136121.512473 trunc from 0x03fa4e to 0x03b416 (0x4637 bytes) 000952 1783136121.572810 mapread 0x01f38a thru 0x0289fc (0x9673 bytes) 000953 1783136121.592513 write 0x0103b1 thru 0x019020 (0x8c70 bytes) 000954 1783136121.598917 mapread 0x0320f3 thru 0x03b416 (0x9324 bytes) 000956 1783136121.616430 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b417): Mirror 12: 0xd9bdc662 (stale) Mirror 13: 0xd9bdc662 (stale) Mirror 20: 0xd9bdc662 (stale) Mirror 22: 0xd9bdc662 (stale) Mirror 25: 0xd9bdc662 (stale) Mirror 26: 0xd9bdc662 (stale) Mirror 27: 0xd9bdc662 (stale) Mirror 28: 0xd9bdc662 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b417): Mirror 12: 0xd9bdc662 (stale) Mirror 13: 0xd9bdc662 (stale) Mirror 20: 0xd9bdc662 (stale) Mirror 22: 0xd9bdc662 (stale) Mirror 25: 0xd9bdc662 (stale) Mirror 26: 0xd9bdc662 (stale) Mirror 27: 0xd9bdc662 (stale) Mirror 28: 0xd9bdc662 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b417: skipped 000957 1783136122.196365 trunc from 0x034f55 to 0x03b416 (0x64c2 bytes) 000958 1783136122.201198 fallocate 0x022570 thru 0x0231ae (0xc3f bytes) 000959 1783136122.208188 trunc from 0x012089 to 0x013d43 (0x1cbb bytes) 000960 1783136122.214050 trunc from 0x01897d to 0x020dac (0x8430 bytes) 000961 1783136122.219204 write 0x00eed8 thru 0x015c7d (0x6da6 bytes) 000962 1783136122.234968 fallocate 0x01a2af thru 0x0285c9 (0xe31b bytes) 000963 1783136122.240346 fallocate 0x00cec4 thru 0x00eb9e (0x1cdb bytes) 000964 1783136122.246180 write 0x02234d thru 0x023a35 (0x16e9 bytes) 000965 1783136122.256365 punch from 0x010588 to 0x019487 (0x8f00 bytes) 000966 1783136122.272499 punch from 0x02232f to 0x02fad1 (0xd7a3 bytes) 000967 1783136122.278260 mapread 0x00c71a thru 0x00fe4c (0x3733 bytes) 000968 1783136122.296066 mapread 0x031b30 thru 0x03298c (0xe5d bytes) 000970 1783136122.325094 read 0x0058a1 thru 0x00dc6c (0x83cc bytes) 000971 1783136122.337625 mapwrite 0x013976 thru 0x01551e (0x1ba9 bytes) 000972 1783136122.361525 trunc from 0x03b417 to 0x0026ae (0x38d68 bytes) 000973 1783136122.387766 mapread 0x0021e4 thru 0x0026ae (0x4cb bytes) 000974 1783136122.400365 read 0x00155a thru 0x0026ae (0x1155 bytes) 000975 1783136122.401508 punch from 0x00102e to 0x0026ae (0x1681 bytes) 000977 1783136122.417575 punch from 0x001fa4 to 0x0026ae (0x70b bytes) 000978 1783136122.434540 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x26af): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26af): Mirror 12: 0x1c3c561e (stale) Mirror 13: 0x1c3c561e (stale) Mirror 20: 0x1c3c561e (stale) Mirror 22: 0x1c3c561e (stale) Mirror 25: 0x1c3c561e (stale) Mirror 26: 0x1c3c561e (stale) Mirror 27: 0x1c3c561e (stale) Mirror 28: 0x1c3c561e (stale) CRC-32 checksum value for chunk [0, 0x26af): Mirror 1: 0x872c7187 Mirror 29: 0x872c7187 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26af: skipped 000980 1783136123.266134 write 0x034cc6 thru 0x03ffff (0xb33a bytes) 000981 1783136123.356344 mapread 0x0245a5 thru 0x025e9f (0x18fb bytes) 000982 1783136123.392206 read 0x015477 thru 0x017c75 (0x27ff bytes) 000983 1783136123.415890 fallocate 0x031b5f thru 0x0374fe (0x59a0 bytes) 000984 1783136123.430478 trunc from 0x013a4e to 0x015bc7 (0x217a bytes) 000986 1783136123.454530 mapread 0x016f0a thru 0x0234c2 (0xc5b9 bytes) 000987 1783136123.546105 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xaf9c3473 (stale) Mirror 20: 0xaf9c3473 (stale) Mirror 22: 0xaf9c3473 (stale) Mirror 25: 0xaf9c3473 (stale) Mirror 26: 0xaf9c3473 (stale) Mirror 27: 0xaf9c3473 (stale) Mirror 28: 0xaf9c3473 (stale) Mirror 29: 0xba1529e3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xaf9c3473 (stale) Mirror 20: 0xaf9c3473 (stale) Mirror 22: 0xaf9c3473 (stale) Mirror 25: 0xaf9c3473 (stale) Mirror 26: 0xaf9c3473 (stale) Mirror 27: 0xaf9c3473 (stale) Mirror 28: 0xaf9c3473 (stale) Mirror 29: 0xba1529e3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000988 1783136124.193937 mapread 0x0044a1 thru 0x0079d4 (0x3534 bytes) 000989 1783136124.222043 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x17d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xaf9c3473 (stale) Mirror 20: 0xaf9c3473 (stale) Mirror 22: 0xaf9c3473 (stale) Mirror 25: 0xaf9c3473 (stale) Mirror 26: 0xaf9c3473 (stale) Mirror 28: 0xaf9c3473 (stale) Mirror 29: 0xba1529e3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xaf9c3473 (stale) Mirror 20: 0xaf9c3473 (stale) Mirror 22: 0xaf9c3473 (stale) Mirror 25: 0xaf9c3473 (stale) Mirror 26: 0xaf9c3473 (stale) Mirror 28: 0xaf9c3473 (stale) Mirror 29: 0xba1529e3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000990 1783136124.658550 trunc from 0x01a0fc to 0x021cde (0x7be3 bytes) 000991 1783136124.665534 punch from 0x003486 to 0x01317b (0xfcf6 bytes) 000992 1783136124.671223 mapread 0x03c16d thru 0x03edb5 (0x2c49 bytes) 000993 1783136124.686983 mapwrite 0x01043b thru 0x015862 (0x5428 bytes) 000994 1783136124.708236 mapwrite 0x00e456 thru 0x012b2f (0x46da bytes) 000995 1783136124.724513 punch from 0x02a0b2 to 0x0393f0 (0xf33f bytes) 000997 1783136124.737376 trunc from 0x0082f6 to 0x015b96 (0xd8a1 bytes) 000998 1783136124.742379 mapread 0x02b0a3 thru 0x03323a (0x8198 bytes) 000999 1783136124.756788 mapwrite 0x029ac2 thru 0x0346b0 (0xabef bytes) 001000 1783136124.791523 read 0x038789 thru 0x03f5fc (0x6e74 bytes) All operations completed A-OK!