== sanity-flr test 70a: flr mode fsx test ================ 08:07:11 (1775218031) striped dir -i0 -c2 -H crush /mnt/lustre/d70a.sanity-flr Seed set to 8033 fallocating to largest ever: 0x40000 000001 1775218033.471148 fallocate 0x03de86 thru 0x03ffff (0x217a bytes) 000002 1775218033.483035 mapread 0x03d388 thru 0x03ffff (0x2c78 bytes) 000003 1775218033.508718 trunc from 0x02dbde to 0x02efce (0x13f1 bytes) 000004 1775218033.515989 mapwrite 0x02b7cd thru 0x032213 (0x6a47 bytes) 000005 1775218033.549077 mapwrite 0x002455 thru 0x00c387 (0x9f33 bytes) 000006 1775218033.589812 trunc from 0x00ba7d to 0x00cb04 (0x1088 bytes) 000008 1775218033.597812 read 0x003298 thru 0x011239 (0xdfa2 bytes) 000010 1775218033.614172 MIRROR_EXTEND to 2 mirrors 000011 1775218034.436761 fallocate 0x0177de thru 0x0234c5 (0xbce8 bytes) 000012 1775218034.491353 MIRROR_RESYNC 2 mirrors 000013 1775218035.437924 mapwrite 0x023b8c thru 0x024fa8 (0x141d bytes) 000014 1775218035.549287 mapwrite 0x014596 thru 0x018559 (0x3fc4 bytes) 000015 1775218035.583887 trunc from 0x016931 to 0x018362 (0x1a32 bytes) 000016 1775218035.590034 write 0x03656e thru 0x03ffff (0x9a92 bytes) 000018 1775218035.611579 write 0x00fbd9 thru 0x00fe6e (0x296 bytes) 000019 1775218035.613883 write 0x010e9c thru 0x01a16d (0x92d2 bytes) 000020 1775218035.617016 read 0x036d56 thru 0x03ffff (0x92aa bytes) 000021 1775218035.618135 punch from 0x005f07 to 0x007e6b (0x1f65 bytes) 000022 1775218035.625327 write 0x008bfa thru 0x012f5e (0xa365 bytes) 000023 1775218035.647334 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x9594563f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbeae5fa4 Mirror 3: 0xbeae5fa4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000024 1775218037.027069 fallocate 0x029144 thru 0x02960f (0x4cc bytes) 000025 1775218037.072224 punch from 0x000cfd to 0x00ddcb (0xd0cf bytes) 000026 1775218037.077377 mapread 0x038975 thru 0x03d30b (0x4997 bytes) 000027 1775218037.098281 write 0x01b50d thru 0x028957 (0xd44b bytes) 000028 1775218037.148125 trunc from 0x040000 to 0x006b72 (0x3948d bytes) 000029 1775218037.219456 trunc from 0x000620 to 0x006b72 (0x6553 bytes) 000030 1775218037.236889 MIRROR_RESYNC 3 mirrors 000032 1775218038.173456 trunc from 0x006b73 to 0x014fbf (0xe44d bytes) 000033 1775218038.275264 write 0x003adc thru 0x0097c1 (0x5ce6 bytes) 000034 1775218038.324653 trunc from 0x013528 to 0x014fbf (0x1a98 bytes) 000035 1775218038.356253 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x14fc0): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14fc0): Mirror 2: 0xaca51c6 (stale) Mirror 3: 0xaca51c6 (stale) CRC-32 checksum value for chunk [0, 0x14fc0): Mirror 1: 0x1228dffe Mirror 4: 0x1228dffe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14fc0: skipped 000036 1775218039.728268 write 0x0260fc thru 0x02a25d (0x4162 bytes) 000037 1775218039.779224 mapwrite 0x008cd6 thru 0x00ab1e (0x1e49 bytes) 000039 1775218039.897837 trunc from 0x02a25e to 0x027dcd (0x2490 bytes) 000040 1775218039.972033 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x27dce): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27dce): Mirror 2: 0x82f89b5a (stale) Mirror 3: 0x82f89b5a (stale) Mirror 4: 0x78ca7f3d (stale) CRC-32 checksum value for chunk [0, 0x27dce): Mirror 1: 0x88939800 Mirror 5: 0x88939800 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27dce: skipped 000041 1775218041.468869 trunc from 0x027dce to 0x0307cf (0x8a02 bytes) 000042 1775218041.542879 trunc from 0x0307d0 to 0x019d21 (0x16aae bytes) 000043 1775218041.583123 MIRROR_RESYNC 5 mirrors 000044 1775218042.642429 mapwrite 0x0070f5 thru 0x008e64 (0x1d70 bytes) 000045 1775218042.744824 write 0x021da6 thru 0x031428 (0xf683 bytes) 000046 1775218042.750037 punch from 0x003d85 to 0x0089ce (0x4c4a bytes) 000047 1775218042.759977 punch from 0x008a46 to 0x00f82d (0x6de8 bytes) 000048 1775218042.772954 read 0x021d3a thru 0x02e1fd (0xc4c4 bytes) 000049 1775218042.774773 read 0x010b03 thru 0x012842 (0x1d40 bytes) 000050 1775218042.788092 mapread 0x0135b7 thru 0x014c2b (0x1675 bytes) 000051 1775218042.789267 mapread 0x023b78 thru 0x02b7e2 (0x7c6b bytes) 000052 1775218042.790544 punch from 0x00400b to 0x009f1d (0x5f13 bytes) 000053 1775218042.796948 MIRROR_RESYNC 5 mirrors 000055 1775218044.069939 MIRROR_EXTEND to 6 mirrors 000056 1775218044.809713 write 0x00d1e3 thru 0x00f65f (0x247d bytes) 000057 1775218044.866379 trunc from 0x031429 to 0x01cb47 (0x148e1 bytes) 000058 1775218044.891832 trunc from 0x01cb48 to 0x016f7c (0x5bcb bytes) 000059 1775218044.914886 write 0x01ff17 thru 0x0262e7 (0x63d1 bytes) 000060 1775218044.916466 trunc from 0x01d95a to 0x025c63 (0x830a bytes) 000061 1775218044.934668 trunc from 0x0262e8 to 0x02ccd4 (0x69ed bytes) 000062 1775218044.949562 trunc from 0x017b94 to 0x01f329 (0x7796 bytes) 000063 1775218044.957416 mapwrite 0x03215b thru 0x034cd5 (0x2b7b bytes) 000064 1775218045.041797 MIRROR_RESYNC 6 mirrors 000065 1775218047.427076 mapread 0x01e6aa thru 0x02db91 (0xf4e8 bytes) 000066 1775218047.536317 mapwrite 0x03a5fb thru 0x03ffff (0x5a05 bytes) 000067 1775218047.647191 trunc from 0x040000 to 0x038017 (0x7fe8 bytes) 000068 1775218047.690709 mapread 0x02731a thru 0x028b1d (0x1804 bytes) 000069 1775218047.702358 read 0x010031 thru 0x013f04 (0x3ed4 bytes) 000070 1775218047.723068 trunc from 0x023a03 to 0x029e9c (0x649a bytes) 000071 1775218047.736735 mapread 0x0138f1 thru 0x018951 (0x5061 bytes) 000072 1775218047.764500 trunc from 0x038018 to 0x02509b (0x12f7c bytes) 000073 1775218047.790914 trunc from 0x01d6a8 to 0x02427b (0x6bd4 bytes) 000074 1775218047.805086 mapwrite 0x0339bf thru 0x03ffff (0xc641 bytes) 000075 1775218047.921148 trunc from 0x036c90 to 0x03ffff (0x9370 bytes) 000076 1775218047.927470 trunc from 0x0195dd to 0x027ac8 (0xe4ec bytes) 000077 1775218047.937586 write 0x0229c6 thru 0x0289cc (0x6007 bytes) 000078 1775218047.951174 write 0x02cbef thru 0x02d873 (0xc85 bytes) 000079 1775218047.952360 mapread 0x038c63 thru 0x03d5a7 (0x4945 bytes) 000080 1775218047.965545 trunc from 0x040000 to 0x00fbb1 (0x3044e bytes) 000081 1775218047.998739 punch from 0x00a593 to 0x00ce74 (0x28e2 bytes) 000082 1775218048.010197 mapread 0x00972d thru 0x00bfc7 (0x289b bytes) 000084 1775218048.031065 fallocate 0x027a4b thru 0x03313b (0xb6f1 bytes) 000085 1775218048.061861 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0xfbb2): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xfbb2): Mirror 2: 0x15bfc5c4 (stale) Mirror 3: 0x15bfc5c4 (stale) Mirror 4: 0x15bfc5c4 (stale) Mirror 5: 0x15bfc5c4 (stale) Mirror 6: 0x15bfc5c4 (stale) CRC-32 checksum value for chunk [0, 0xfbb2): Mirror 1: 0x15bfc5c4 Mirror 7: 0x15bfc5c4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xfbb2: skipped 000086 1775218049.582208 trunc from 0x0065f3 to 0x008753 (0x2161 bytes) 000087 1775218049.742169 MIRROR_RESYNC 7 mirrors 000089 1775218052.239135 trunc from 0x00fbb2 to 0x0192aa (0x96f9 bytes) 000090 1775218052.316518 write 0x0003d7 thru 0x004c4b (0x4875 bytes) 000091 1775218052.331836 trunc from 0x002be7 to 0x008ba1 (0x5fbb bytes) 000094 1775218052.351517 mapread 0x018805 thru 0x0192aa (0xaa6 bytes) 000095 1775218052.374283 punch from 0x007603 to 0x0156b2 (0xe0b0 bytes) 000096 1775218052.383482 fallocate 0x00a3f7 thru 0x012030 (0x7c3a bytes) 000098 1775218052.403427 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x192ab): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x192ab): Mirror 2: 0xbf42f210 (stale) Mirror 3: 0xbf42f210 (stale) Mirror 4: 0xbf42f210 (stale) Mirror 5: 0xbf42f210 (stale) Mirror 6: 0xbf42f210 (stale) Mirror 7: 0xbf42f210 (stale) CRC-32 checksum value for chunk [0, 0x192ab): Mirror 1: 0x82410064 Mirror 8: 0x82410064 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x192ab: skipped 000099 1775218054.323671 mapwrite 0x0215cf thru 0x026aa1 (0x54d3 bytes) 000100 1775218054.576717 trunc from 0x026aa2 to 0x002938 (0x24169 bytes) 000101 1775218054.638526 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2939): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2939): Mirror 2: 0x5db703a8 (stale) Mirror 3: 0x5db703a8 (stale) Mirror 4: 0x5db703a8 (stale) Mirror 5: 0x5db703a8 (stale) Mirror 6: 0x5db703a8 (stale) Mirror 7: 0x5db703a8 (stale) Mirror 8: 0x8f292c78 (stale) CRC-32 checksum value for chunk [0, 0x2939): Mirror 1: 0x8f292c78 Mirror 9: 0x8f292c78 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2939: skipped 000102 1775218056.258307 trunc from 0x0028f1 to 0x002938 (0x48 bytes) 000103 1775218056.389677 read 0x00230c thru 0x002938 (0x62d bytes) 000105 1775218056.404901 trunc from 0x0009dc to 0x002938 (0x1f5d bytes) 000106 1775218056.420843 fallocate 0x01bb02 thru 0x01cdee (0x12ed bytes) 000107 1775218056.442739 mapread 0x000af1 thru 0x002938 (0x1e48 bytes) 000108 1775218056.470545 mapwrite 0x0051f8 thru 0x014060 (0xee69 bytes) 000109 1775218056.588608 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x14061): Mirror 2: 0x36dbdedf (stale) Mirror 3: 0x36dbdedf (stale) Mirror 4: 0x36dbdedf (stale) Mirror 5: 0x36dbdedf (stale) Mirror 7: 0x36dbdedf (stale) Mirror 8: 0x59288e57 (stale) Mirror 9: 0x960d4cc6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14061): Mirror 2: 0x36dbdedf (stale) Mirror 3: 0x36dbdedf (stale) Mirror 4: 0x36dbdedf (stale) Mirror 5: 0x36dbdedf (stale) Mirror 7: 0x36dbdedf (stale) Mirror 8: 0x59288e57 (stale) Mirror 9: 0x960d4cc6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14061: skipped 000110 1775218057.154567 mapwrite 0x026756 thru 0x03634c (0xfbf7 bytes) 000111 1775218057.295504 mapread 0x028001 thru 0x02eec1 (0x6ec1 bytes) 000112 1775218057.305403 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3634d): Mirror 2: 0xaa867660 (stale) Mirror 3: 0xaa867660 (stale) Mirror 5: 0xaa867660 (stale) Mirror 7: 0xaa867660 (stale) Mirror 8: 0x30e8698c (stale) Mirror 9: 0x93684b93 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3634d): Mirror 2: 0xaa867660 (stale) Mirror 3: 0xaa867660 (stale) Mirror 5: 0xaa867660 (stale) Mirror 7: 0xaa867660 (stale) Mirror 8: 0x30e8698c (stale) Mirror 9: 0x93684b93 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3634d: skipped 000114 1775218058.238272 write 0x024e73 thru 0x02cd9b (0x7f29 bytes) 000115 1775218058.302550 mapread 0x00188a thru 0x008392 (0x6b09 bytes) 000116 1775218058.319151 mapread 0x00dad4 thru 0x019671 (0xbb9e bytes) 000117 1775218058.364023 trunc from 0x03634d to 0x016899 (0x1fab3 bytes) 000118 1775218058.431548 mapread 0x00f1d5 thru 0x011dc9 (0x2bf5 bytes) 000119 1775218058.432881 mapread 0x00f496 thru 0x016899 (0x7404 bytes) 000121 1775218058.442836 mapread 0x0009c2 thru 0x00779c (0x6ddb bytes) 000122 1775218058.485096 trunc from 0x01689a to 0x00b387 (0xb512 bytes) 000123 1775218058.527880 fallocate 0x02dc74 thru 0x03519d (0x752a bytes) 000124 1775218058.542831 punch from 0x00615a to 0x015a15 (0xf8bc bytes) 000125 1775218058.564791 fallocate 0x0087e8 thru 0x00ffb5 (0x77ce bytes) 000126 1775218058.589403 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3519e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3519e): Mirror 2: 0xf1f6e5d9 (stale) Mirror 3: 0xf1f6e5d9 (stale) Mirror 5: 0xf1f6e5d9 (stale) Mirror 7: 0xf1f6e5d9 (stale) Mirror 8: 0xa46e6a4c (stale) Mirror 9: 0xbe612ee1 (stale) CRC-32 checksum value for chunk [0, 0x3519e): Mirror 1: 0x810e4720 Mirror 10: 0x810e4720 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3519e: skipped 000127 1775218059.752709 mapread 0x0339eb thru 0x03519d (0x17b3 bytes) 000128 1775218059.840896 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3519e): Mirror 2: 0xf1f6e5d9 (stale) Mirror 3: 0xf1f6e5d9 (stale) Mirror 5: 0xf1f6e5d9 (stale) Mirror 8: 0xa46e6a4c (stale) Mirror 9: 0xbe612ee1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3519e): Mirror 2: 0xf1f6e5d9 (stale) Mirror 3: 0xf1f6e5d9 (stale) Mirror 5: 0xf1f6e5d9 (stale) Mirror 8: 0xa46e6a4c (stale) Mirror 9: 0xbe612ee1 (stale) CRC-32 checksum value for chunk [0, 0x3519e): Mirror 1: 0x810e4720 Mirror 10: 0x810e4720 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3519e: skipped 000129 1775218060.770374 punch from 0x000b6e to 0x006380 (0x5813 bytes) 000130 1775218060.929398 punch from 0x006726 to 0x011250 (0xab2b bytes) 000131 1775218060.945517 read 0x01c885 thru 0x02644e (0x9bca bytes) 000132 1775218060.969848 punch from 0x0256a3 to 0x02e8fe (0x925c bytes) 000134 1775218060.988113 write 0x00602a thru 0x008f06 (0x2edd bytes) 000135 1775218061.025478 trunc from 0x015620 to 0x018f2d (0x390e bytes) 000136 1775218061.038961 read 0x00d876 thru 0x01ae2e (0xd5b9 bytes) 000137 1775218061.072434 mapread 0x0204ad thru 0x02473b (0x428f bytes) 000138 1775218061.073571 trunc from 0x03519e to 0x03f6a0 (0xa503 bytes) 000139 1775218061.145471 punch from 0x026325 to 0x02b04c (0x4d28 bytes) 000141 1775218061.164768 fallocate 0x009a2d thru 0x00a376 (0x94a bytes) 000142 1775218061.205402 punch from 0x000fa4 to 0x0066d4 (0x5731 bytes) 000143 1775218061.255738 mapread 0x0067ef thru 0x010084 (0x9896 bytes) 000144 1775218061.299159 mapread 0x017a71 thru 0x025787 (0xdd17 bytes) 000145 1775218061.321233 mapread 0x01fb36 thru 0x02d2f3 (0xd7be bytes) 000147 1775218061.452462 fallocate 0x000188 thru 0x00edb7 (0xec30 bytes) 000148 1775218061.479692 punch from 0x0100d1 to 0x01516b (0x509b bytes) 000149 1775218061.499637 fallocate 0x03445e thru 0x037618 (0x31bb bytes) 000150 1775218061.517043 read 0x03370c thru 0x03f6a0 (0xbf95 bytes) 000151 1775218061.517724 mapread 0x031ed7 thru 0x03c2b0 (0xa3da bytes) 000152 1775218061.530983 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f6a1): Mirror 2: 0x6c773919 (stale) Mirror 3: 0x6c773919 (stale) Mirror 5: 0x6c773919 (stale) Mirror 8: 0xc9d3d145 (stale) Mirror 9: 0x4d2061e5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f6a1): Mirror 2: 0x6c773919 (stale) Mirror 3: 0x6c773919 (stale) Mirror 5: 0x6c773919 (stale) Mirror 8: 0xc9d3d145 (stale) Mirror 9: 0x4d2061e5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f6a1: skipped 000153 1775218062.273304 trunc from 0x03f6a1 to 0x018511 (0x2718f bytes) 000154 1775218062.294382 trunc from 0x018512 to 0x020aa9 (0x8598 bytes) 000155 1775218062.317840 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x20aaa): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20aaa): Mirror 2: 0x48b06422 (stale) Mirror 3: 0x48b06422 (stale) Mirror 5: 0x48b06422 (stale) Mirror 8: 0xb3193b53 (stale) Mirror 9: 0x74bb7b8e (stale) CRC-32 checksum value for chunk [0, 0x20aaa): Mirror 1: 0x3da41281 Mirror 10: 0x3da41281 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20aaa: skipped 000156 1775218063.939921 trunc from 0x01debd to 0x020aa9 (0x2bed bytes) 000157 1775218064.052585 mapwrite 0x014bc0 thru 0x01f54e (0xa98f bytes) 000158 1775218064.148555 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20aaa): Mirror 2: 0x48b06422 (stale) Mirror 3: 0x48b06422 (stale) Mirror 5: 0x48b06422 (stale) Mirror 8: 0xb3193b53 (stale) Mirror 9: 0x74bb7b8e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20aaa): Mirror 2: 0x48b06422 (stale) Mirror 3: 0x48b06422 (stale) Mirror 5: 0x48b06422 (stale) Mirror 8: 0xb3193b53 (stale) Mirror 9: 0x74bb7b8e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20aaa: skipped 000159 1775218065.209883 read 0x00da2d thru 0x00eaf4 (0x10c8 bytes) 000160 1775218065.217461 fallocate 0x00eb25 thru 0x01ca9d (0xdf79 bytes) 000161 1775218065.223228 trunc from 0x020aaa to 0x02a544 (0x9a9b bytes) 000162 1775218065.265759 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2a545): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a545): Mirror 2: 0xa050d65a (stale) Mirror 3: 0xa050d65a (stale) Mirror 5: 0xa050d65a (stale) Mirror 8: 0x62e4a851 (stale) Mirror 9: 0xf2757cdb (stale) CRC-32 checksum value for chunk [0, 0x2a545): Mirror 1: 0xf4a3c2da Mirror 10: 0xf4a3c2da lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a545: skipped 000163 1775218067.211481 write 0x038707 thru 0x03f8bd (0x71b7 bytes) 000164 1775218067.337295 read 0x00c683 thru 0x012a5d (0x63db bytes) 000165 1775218067.373050 punch from 0x012725 to 0x013f11 (0x17ed bytes) 000166 1775218067.380470 write 0x01719d thru 0x02072f (0x9593 bytes) 000167 1775218067.400683 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f8be): Mirror 2: 0x37805d21 (stale) Mirror 3: 0x37805d21 (stale) Mirror 5: 0x37805d21 (stale) Mirror 8: 0xbc6e53a7 (stale) Mirror 9: 0xe6a8fb4e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f8be): Mirror 2: 0x37805d21 (stale) Mirror 3: 0x37805d21 (stale) Mirror 5: 0x37805d21 (stale) Mirror 8: 0xbc6e53a7 (stale) Mirror 9: 0xe6a8fb4e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f8be: skipped 000168 1775218068.213086 fallocate 0x00abfe thru 0x00c5bc (0x19bf bytes) 000170 1775218068.244419 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f8be): Mirror 3: 0x37805d21 (stale) Mirror 5: 0x37805d21 (stale) Mirror 8: 0xbc6e53a7 (stale) Mirror 9: 0xe6a8fb4e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f8be): Mirror 3: 0x37805d21 (stale) Mirror 5: 0x37805d21 (stale) Mirror 8: 0xbc6e53a7 (stale) Mirror 9: 0xe6a8fb4e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f8be: skipped 000171 1775218068.805904 trunc from 0x03f8be to 0x0316a5 (0xe218 bytes) 000172 1775218068.852265 trunc from 0x0316a6 to 0x031c4a (0x5a5 bytes) 000173 1775218068.883014 write 0x02bdb4 thru 0x034b3c (0x8d89 bytes) 000174 1775218068.895041 write 0x002961 thru 0x00c620 (0x9cc0 bytes) 000175 1775218068.917136 trunc from 0x01d989 to 0x024c54 (0x72cc bytes) 000176 1775218068.941350 trunc from 0x00fba8 to 0x014202 (0x465b bytes) 000177 1775218068.951412 mapread 0x0091b9 thru 0x0187ac (0xf5f4 bytes) 000179 1775218068.988381 fallocate 0x0292ec thru 0x02ec9e (0x59b3 bytes) 000180 1775218068.995591 trunc from 0x00d257 to 0x00e6ac (0x1456 bytes) 000181 1775218069.019521 trunc from 0x0256d6 to 0x02b1c1 (0x5aec bytes) 000182 1775218069.135393 read 0x0333f4 thru 0x034b3c (0x1749 bytes) 000183 1775218069.137441 punch from 0x02ada5 to 0x034b3c (0x9d98 bytes) 000184 1775218069.171521 fallocate 0x02aa4a thru 0x0312b8 (0x686f bytes) 000186 1775218069.194466 mapread 0x020330 thru 0x027e38 (0x7b09 bytes) 000187 1775218069.279110 write 0x03d94a thru 0x03ffff (0x26b6 bytes) 000189 1775218069.284319 read 0x039964 thru 0x03ecf3 (0x5390 bytes) 000190 1775218069.302490 fallocate 0x009937 thru 0x017958 (0xe022 bytes) 000191 1775218069.323056 trunc from 0x040000 to 0x013222 (0x2cddd bytes) 000192 1775218069.348222 write 0x031a68 thru 0x03594d (0x3ee6 bytes) 000193 1775218069.350300 fallocate 0x0271de thru 0x030e4f (0x9c72 bytes) 000194 1775218069.357991 fallocate 0x008a0b thru 0x015876 (0xce6c bytes) 000195 1775218069.364251 punch from 0x02bac1 to 0x03594d (0x9e8d bytes) 000196 1775218069.387944 trunc from 0x011807 to 0x012541 (0xd3b bytes) 000197 1775218069.398028 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3594e): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3594e): Mirror 3: 0xd986f38d (stale) Mirror 5: 0xd986f38d (stale) Mirror 8: 0x49da97fe (stale) Mirror 9: 0x2b26b901 (stale) CRC-32 checksum value for chunk [0, 0x3594e): Mirror 1: 0xc7b5639 Mirror 10: 0xc7b5639 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3594e: skipped 000198 1775218071.188552 fallocate 0x03e4af thru 0x03ffff (0x1b51 bytes) 000199 1775218071.311809 read 0x001be4 thru 0x004549 (0x2966 bytes) 000200 1775218071.323092 trunc from 0x00ee27 to 0x01a2d7 (0xb4b1 bytes) 000201 1775218071.349528 fallocate 0x02bcca thru 0x034ba3 (0x8eda bytes) 000202 1775218071.364574 mapwrite 0x030b89 thru 0x03cf3d (0xc3b5 bytes) 000203 1775218071.580711 read 0x0089d6 thru 0x014f13 (0xc53e bytes) 000204 1775218071.643818 fallocate 0x02d469 thru 0x033ff8 (0x6b90 bytes) 000205 1775218071.667661 mapread 0x01faaa thru 0x0275b8 (0x7b0f bytes) 000206 1775218071.677726 mapwrite 0x00182d thru 0x00533f (0x3b13 bytes) 000207 1775218071.752999 write 0x01820c thru 0x0227f2 (0xa5e7 bytes) 000208 1775218071.754389 write 0x01dde0 thru 0x021d88 (0x3fa9 bytes) 000209 1775218071.777850 mapwrite 0x0350bf thru 0x03e197 (0x90d9 bytes) 000210 1775218071.928425 trunc from 0x03e198 to 0x019249 (0x24f4e bytes) 000211 1775218071.978330 mapwrite 0x02430b thru 0x030fd5 (0xcccb bytes) 000212 1775218072.349440 trunc from 0x030fd6 to 0x03ab4e (0x9b79 bytes) 000214 1775218072.391058 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ab4f): Mirror 3: 0x68d0955c (stale) Mirror 8: 0xc9dcb282 (stale) Mirror 9: 0x121ba07f (stale) Mirror 10: 0x6bc70d60 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ab4f): Mirror 3: 0x68d0955c (stale) Mirror 8: 0xc9dcb282 (stale) Mirror 9: 0x121ba07f (stale) Mirror 10: 0x6bc70d60 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ab4f: skipped 000215 1775218073.133676 trunc from 0x0220e1 to 0x02bc07 (0x9b27 bytes) 000216 1775218073.140527 write 0x025ff2 thru 0x02c10a (0x6119 bytes) 000217 1775218073.170460 punch from 0x009403 to 0x01116b (0x7d69 bytes) 000218 1775218073.180385 mapwrite 0x01ea29 thru 0x02e3e9 (0xf9c1 bytes) 000219 1775218073.244832 trunc from 0x038299 to 0x0391c9 (0xf31 bytes) 000220 1775218073.251762 fallocate 0x029fb8 thru 0x03379d (0x97e6 bytes) 000221 1775218073.262411 mapwrite 0x009cd9 thru 0x00c33e (0x2666 bytes) 000222 1775218073.300298 mapwrite 0x01dba8 thru 0x021991 (0x3dea bytes) 000223 1775218073.342267 read 0x03672f thru 0x03ab4e (0x4420 bytes) 000224 1775218073.398296 write 0x00aa36 thru 0x015e8a (0xb455 bytes) 000225 1775218073.412523 mapread 0x01dcef thru 0x02318d (0x549f bytes) 000226 1775218073.421174 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ab4f): Mirror 3: 0x68d0955c (stale) Mirror 8: 0xc9dcb282 (stale) Mirror 9: 0x121ba07f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ab4f): Mirror 3: 0x68d0955c (stale) Mirror 8: 0xc9dcb282 (stale) Mirror 9: 0x121ba07f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ab4f: skipped 000227 1775218073.852924 mapread 0x027634 thru 0x036e92 (0xf85f bytes) 000228 1775218073.902298 punch from 0x01dae6 to 0x02317f (0x569a bytes) 000229 1775218073.936318 read 0x003bf3 thru 0x008e0a (0x5218 bytes) 000230 1775218073.982048 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3ab4f): Mirror 3: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ab4f): Mirror 3: 0x68d0955c (stale) Mirror 8: 0xc9dcb282 (stale) Mirror 9: 0x121ba07f (stale) CRC-32 checksum value for chunk [0, 0x3ab4f): Mirror 1: 0x5fe70c70 Mirror 10: 0x5fe70c70 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ab4f: skipped 000231 1775218076.396728 read 0x0069db thru 0x009062 (0x2688 bytes) 000232 1775218076.457606 mapread 0x01e5d8 thru 0x022c63 (0x468c bytes) 000233 1775218076.549279 read 0x02722e thru 0x032ca6 (0xba79 bytes) 000234 1775218076.586250 write 0x015533 thru 0x016c2e (0x16fc bytes) 000236 1775218076.711263 read 0x010a95 thru 0x01a37b (0x98e7 bytes) 000237 1775218076.743371 trunc from 0x02ebae to 0x0337c6 (0x4c19 bytes) 000238 1775218076.764132 mapwrite 0x0192c4 thru 0x025b37 (0xc874 bytes) 000239 1775218076.846179 punch from 0x01c5ec to 0x029a57 (0xd46c bytes) 000240 1775218076.867337 trunc from 0x03ab4f to 0x004d36 (0x35e18 bytes) 000241 1775218076.909455 MIRROR_RESYNC 5 mirrors 000242 1775218078.747143 fallocate 0x03de16 thru 0x03ffff (0x21ea bytes) 000243 1775218078.815196 fallocate 0x00720f thru 0x011c56 (0xaa48 bytes) 000244 1775218078.836941 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x4d37): Mirror 3: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4d37): Mirror 3: 0x10b97134 (stale) Mirror 8: 0x10b97134 (stale) Mirror 9: 0x10b97134 (stale) Mirror 10: 0x10b97134 (stale) CRC-32 checksum value for chunk [0, 0x4d37): Mirror 1: 0x10b97134 Mirror 11: 0x10b97134 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4d37: skipped 000245 1775218080.948461 mapread 0x004810 thru 0x004d36 (0x527 bytes) 000246 1775218081.003745 punch from 0x002716 to 0x004d36 (0x2621 bytes) 000248 1775218081.058107 trunc from 0x0030ec to 0x004d36 (0x1c4b bytes) 000249 1775218081.064306 fallocate 0x0187ec thru 0x01ebb0 (0x63c5 bytes) 000250 1775218081.071270 trunc from 0x000dca to 0x004d36 (0x3f6d bytes) 000251 1775218081.080369 read 0x00028d thru 0x004d36 (0x4aaa bytes) 000252 1775218081.130463 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x4d37): Mirror 3: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4d37): Mirror 3: 0x10b97134 (stale) Mirror 8: 0x10b97134 (stale) Mirror 9: 0x10b97134 (stale) Mirror 10: 0x10b97134 (stale) Mirror 11: 0x10b97134 (stale) CRC-32 checksum value for chunk [0, 0x4d37): Mirror 1: 0x1f11ce32 Mirror 12: 0x1f11ce32 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4d37: skipped 000254 1775218082.986153 punch from 0x0029b2 to 0x004d36 (0x2385 bytes) 000255 1775218083.071887 trunc from 0x001d97 to 0x004d36 (0x2fa0 bytes) 000256 1775218083.106246 trunc from 0x000161 to 0x004d36 (0x4bd6 bytes) 000257 1775218083.128231 trunc from 0x001758 to 0x004d36 (0x35df bytes) 000258 1775218083.136086 fallocate 0x011da5 thru 0x020624 (0xe880 bytes) 000259 1775218083.144752 write 0x006554 thru 0x007056 (0xb03 bytes) 000260 1775218083.171993 MIRROR_RESYNC 7 mirrors 000261 1775218086.912504 mapread 0x018a1b thru 0x01e8cf (0x5eb5 bytes) 000262 1775218086.945076 mapwrite 0x032400 thru 0x03494f (0x2550 bytes) 000263 1775218087.053080 trunc from 0x018221 to 0x0247f8 (0xc5d8 bytes) 000264 1775218087.059471 fallocate 0x028c7e thru 0x0293da (0x75d bytes) 000265 1775218087.066038 fallocate 0x02a1ca thru 0x037886 (0xd6bd bytes) 000267 1775218087.072336 fallocate 0x00e0dd thru 0x01ce46 (0xed6a bytes) 000268 1775218087.081997 trunc from 0x034950 to 0x015801 (0x1f14e bytes) 000269 1775218087.149429 read 0x0059fd thru 0x014ca6 (0xf2aa bytes) 000270 1775218087.164337 mapwrite 0x01b036 thru 0x020abd (0x5a88 bytes) 000271 1775218087.299736 trunc from 0x00e260 to 0x00f183 (0xf24 bytes) 000272 1775218087.318236 write 0x01239c thru 0x014db5 (0x2a1a bytes) 000273 1775218087.326503 fallocate 0x02dbd6 thru 0x038529 (0xa954 bytes) 000274 1775218087.354290 MIRROR_RESYNC 7 mirrors 000275 1775218091.577885 mapread 0x013b3c thru 0x0140c0 (0x585 bytes) 000276 1775218091.598082 fallocate 0x008a60 thru 0x0116c5 (0x8c66 bytes) 000277 1775218091.687409 fallocate 0x03ee80 thru 0x03ffff (0x1180 bytes) 000278 1775218091.715231 mapwrite 0x010df2 thru 0x02061a (0xf829 bytes) 000279 1775218091.818551 trunc from 0x03852a to 0x013264 (0x252c5 bytes) 000280 1775218091.874292 read 0x00f72a thru 0x013264 (0x3b3b bytes) 000281 1775218091.879293 mapread 0x00f2f5 thru 0x013264 (0x3f70 bytes) 000282 1775218091.881368 trunc from 0x000ee0 to 0x005b27 (0x4c48 bytes) 000283 1775218091.895939 mapread 0x00ac42 thru 0x013264 (0x8623 bytes) 000284 1775218091.906038 MIRROR_RESYNC 7 mirrors 000285 1775218094.181006 fallocate 0x00a74a thru 0x017694 (0xcf4b bytes) 000286 1775218094.204568 mapread 0x014428 thru 0x017694 (0x326d bytes) 000287 1775218094.216459 trunc from 0x017695 to 0x01c4f2 (0x4e5e bytes) 000288 1775218094.232003 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1c4f3): Mirror 3: 0x4d49befe (stale) Mirror 8: 0x4d49befe (stale) Mirror 9: 0x4d49befe (stale) Mirror 11: 0x4d49befe (stale) Mirror 12: 0x4d49befe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c4f3): Mirror 3: 0x4d49befe (stale) Mirror 8: 0x4d49befe (stale) Mirror 9: 0x4d49befe (stale) Mirror 11: 0x4d49befe (stale) Mirror 12: 0x4d49befe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c4f3: skipped 000289 1775218094.636334 write 0x026296 thru 0x02db99 (0x7904 bytes) 000292 1775218094.646828 trunc from 0x02db9a to 0x02cb9c (0xffd bytes) 000293 1775218094.672357 trunc from 0x0275d3 to 0x02cb9c (0x55ca bytes) 000294 1775218094.692479 punch from 0x01181f to 0x01f7d0 (0xdfb2 bytes) 000295 1775218094.702891 fallocate 0x00455e thru 0x00d3e3 (0x8e86 bytes) 000296 1775218094.709509 mapread 0x008868 thru 0x00aa4e (0x21e7 bytes) 000297 1775218094.735191 trunc from 0x00bb64 to 0x018dec (0xd289 bytes) 000299 1775218094.741928 mapread 0x02207d thru 0x027677 (0x55fb bytes) 000300 1775218094.773136 fallocate 0x014797 thru 0x01a470 (0x5cda bytes) 000301 1775218094.794149 mapwrite 0x01cff6 thru 0x022c02 (0x5c0d bytes) 000302 1775218094.837678 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2cb9d): Mirror 3: 0x7910f19a (stale) Mirror 9: 0x7910f19a (stale) Mirror 11: 0x7910f19a (stale) Mirror 12: 0x7910f19a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cb9d): Mirror 3: 0x7910f19a (stale) Mirror 9: 0x7910f19a (stale) Mirror 11: 0x7910f19a (stale) Mirror 12: 0x7910f19a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cb9d: skipped 000303 1775218095.318103 read 0x01d128 thru 0x026744 (0x961d bytes) 000304 1775218095.336803 mapwrite 0x018e1e thru 0x020f18 (0x80fb bytes) 000305 1775218095.421050 read 0x01c36f thru 0x0207b8 (0x444a bytes) 000306 1775218095.430453 read 0x004c40 thru 0x00cca1 (0x8062 bytes) 000307 1775218095.459720 trunc from 0x02cb9d to 0x033946 (0x6daa bytes) 000308 1775218095.518050 mapread 0x00b7e9 thru 0x00f5b0 (0x3dc8 bytes) 000309 1775218095.529037 MIRROR_RESYNC 5 mirrors 000310 1775218098.844001 MIRROR_EXTEND to 6 mirrors 000311 1775218100.146511 read 0x0105a9 thru 0x019e3f (0x9897 bytes) 000312 1775218100.160364 trunc from 0x021037 to 0x02f705 (0xe6cf bytes) 000313 1775218100.206545 punch from 0x00b8d3 to 0x018f83 (0xd6b1 bytes) 000314 1775218100.212170 trunc from 0x033947 to 0x01c206 (0x17740 bytes) 000315 1775218100.243512 read 0x015a36 thru 0x01c1ec (0x67b7 bytes) 000316 1775218100.268396 fallocate 0x0396b1 thru 0x03ffff (0x694f bytes) 000317 1775218100.298365 write 0x0208ae thru 0x029460 (0x8bb3 bytes) 000318 1775218100.312876 fallocate 0x029aba thru 0x035dfb (0xc342 bytes) 000319 1775218100.341848 MIRROR_RESYNC 6 mirrors 000320 1775218102.133821 write 0x02c5aa thru 0x03ae56 (0xe8ad bytes) 000321 1775218102.195029 read 0x015817 thru 0x0223e9 (0xcbd3 bytes) 000322 1775218102.226565 mapwrite 0x01ed75 thru 0x0253c0 (0x664c bytes) 000323 1775218102.401058 write 0x02e6a8 thru 0x039af5 (0xb44e bytes) 000324 1775218102.409498 read 0x02003a thru 0x0280e9 (0x80b0 bytes) 000325 1775218102.421556 trunc from 0x01c56c to 0x027bf1 (0xb686 bytes) 000326 1775218102.441789 mapread 0x0192f7 thru 0x01b653 (0x235d bytes) 000327 1775218102.462414 MIRROR_RESYNC 6 mirrors 000328 1775218105.117090 trunc from 0x026fa5 to 0x02ee87 (0x7ee3 bytes) 000329 1775218105.149532 fallocate 0x03a08f thru 0x03ffff (0x5f71 bytes) 000331 1775218105.162720 mapwrite 0x03a1e8 thru 0x03a89b (0x6b4 bytes) 000332 1775218105.191769 trunc from 0x03ae57 to 0x0138eb (0x2756b bytes) 000333 1775218105.226054 fallocate 0x00a133 thru 0x017a94 (0xd962 bytes) 000334 1775218105.233307 mapread 0x0040c6 thru 0x0045d3 (0x50e bytes) 000335 1775218105.240720 trunc from 0x0138ec to 0x0141ea (0x8ff bytes) 000336 1775218105.258731 read 0x01392c thru 0x0141ea (0x8bf bytes) 000339 1775218105.273061 write 0x01bed1 thru 0x023fa2 (0x80d2 bytes) 000340 1775218105.285593 MIRROR_RESYNC 6 mirrors 000341 1775218107.069947 MIRROR_RESYNC 6 mirrors 000342 1775218108.121217 fallocate 0x024271 thru 0x02ea2f (0xa7bf bytes) 000344 1775218108.171055 write 0x03e79e thru 0x03ffff (0x1862 bytes) 000346 1775218108.176478 trunc from 0x040000 to 0x012ab2 (0x2d54d bytes) 000347 1775218108.213820 mapread 0x011e17 thru 0x012ab2 (0xc9c bytes) 000348 1775218108.238139 trunc from 0x012ab3 to 0x0088b1 (0xa201 bytes) 000349 1775218108.278965 mapwrite 0x0352a8 thru 0x03ffff (0xad58 bytes) 000350 1775218108.411541 fallocate 0x02be0b thru 0x032ecf (0x70c5 bytes) 000351 1775218108.427734 trunc from 0x01d993 to 0x0225be (0x4c2c bytes) 000352 1775218108.438569 trunc from 0x03049b to 0x03e520 (0xe086 bytes) 000353 1775218108.454303 read 0x02195f thru 0x028e57 (0x74f9 bytes) 000354 1775218108.462868 trunc from 0x040000 to 0x00fd69 (0x30296 bytes) 000355 1775218108.488437 fallocate 0x029e87 thru 0x02b8b0 (0x1a2a bytes) 000356 1775218108.507857 read 0x00704e thru 0x014635 (0xd5e8 bytes) 000357 1775218108.563423 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2b8b1): Mirror 3: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b8b1): Mirror 3: 0x461dacc2 (stale) Mirror 9: 0x461dacc2 (stale) Mirror 11: 0x461dacc2 (stale) Mirror 12: 0x461dacc2 (stale) Mirror 13: 0x461dacc2 (stale) CRC-32 checksum value for chunk [0, 0x2b8b1): Mirror 1: 0xeecaf60c Mirror 14: 0xeecaf60c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b8b1: skipped 000358 1775218109.979811 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2b8b1): Mirror 3: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b8b1): Mirror 3: 0x461dacc2 (stale) Mirror 9: 0x461dacc2 (stale) Mirror 11: 0x461dacc2 (stale) Mirror 12: 0x461dacc2 (stale) Mirror 13: 0x461dacc2 (stale) CRC-32 checksum value for chunk [0, 0x2b8b1): Mirror 1: 0xeecaf60c Mirror 14: 0xeecaf60c Mirror 15: 0xeecaf60c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b8b1: skipped 000359 1775218111.470556 trunc from 0x026b46 to 0x02b8b0 (0x4d6b bytes) 000360 1775218111.601337 mapread 0x00542d thru 0x0061ee (0xdc2 bytes) 000361 1775218111.654997 MIRROR_RESYNC 8 mirrors 000362 1775218113.713199 trunc from 0x029ffd to 0x02b8b0 (0x18b4 bytes) 000363 1775218113.767919 punch from 0x0207aa to 0x020d14 (0x56b bytes) 000364 1775218113.779864 mapwrite 0x021ab2 thru 0x0314ad (0xf9fc bytes) 000365 1775218113.952347 trunc from 0x00fcc8 to 0x018b96 (0x8ecf bytes) 000366 1775218113.965156 trunc from 0x01bf0e to 0x0257fa (0x98ed bytes) 000367 1775218113.981479 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x314ae): Mirror 3: 0x2f4474c1 (stale) Mirror 9: 0x2f4474c1 (stale) Mirror 11: 0x2f4474c1 (stale) Mirror 12: 0x2f4474c1 (stale) Mirror 14: 0x2f4474c1 (stale) Mirror 15: 0x2f4474c1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x314ae): Mirror 3: 0x2f4474c1 (stale) Mirror 9: 0x2f4474c1 (stale) Mirror 11: 0x2f4474c1 (stale) Mirror 12: 0x2f4474c1 (stale) Mirror 14: 0x2f4474c1 (stale) Mirror 15: 0x2f4474c1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x314ae: skipped 000368 1775218114.672834 trunc from 0x0314ae to 0x03ef38 (0xda8b bytes) 000369 1775218114.705156 trunc from 0x03e440 to 0x03ef38 (0xaf9 bytes) 000370 1775218114.712396 punch from 0x03612b to 0x03a764 (0x463a bytes) 000371 1775218114.720982 fallocate 0x037033 thru 0x03b3e4 (0x43b2 bytes) 000372 1775218114.729736 punch from 0x028032 to 0x02bbc8 (0x3b97 bytes) 000373 1775218114.738824 fallocate 0x039daa thru 0x03ffff (0x6256 bytes) 000374 1775218114.756388 write 0x031bd6 thru 0x03e30e (0xc739 bytes) 000375 1775218114.795703 trunc from 0x03ef39 to 0x00fc28 (0x2f310 bytes) 000377 1775218114.843004 fallocate 0x00f294 thru 0x01b329 (0xc096 bytes) 000378 1775218114.876335 MIRROR_RESYNC 7 mirrors 000379 1775218117.209230 trunc from 0x00fc29 to 0x03223a (0x22612 bytes) 000380 1775218117.270931 mapread 0x01b8d9 thru 0x01c1e8 (0x910 bytes) 000381 1775218117.285462 write 0x007ec9 thru 0x012fdc (0xb114 bytes) 000382 1775218117.311503 trunc from 0x003ee4 to 0x007197 (0x32b4 bytes) 000383 1775218117.333447 trunc from 0x000bdd to 0x005157 (0x457b bytes) 000384 1775218117.343109 mapwrite 0x02f089 thru 0x0365ff (0x7577 bytes) 000385 1775218117.441452 trunc from 0x02b74e to 0x02db31 (0x23e4 bytes) 000386 1775218117.464080 trunc from 0x019d5d to 0x024380 (0xa624 bytes) 000387 1775218117.486351 mapwrite 0x038f37 thru 0x03a245 (0x130f bytes) 000388 1775218117.558423 mapread 0x034a77 thru 0x03a245 (0x57cf bytes) 000389 1775218117.565428 punch from 0x0191ae to 0x0256a9 (0xc4fc bytes) 000390 1775218117.582426 trunc from 0x01f8ff to 0x02822f (0x8931 bytes) 000391 1775218117.597526 write 0x029d81 thru 0x032f7b (0x91fb bytes) 000392 1775218117.605255 mapwrite 0x027f2f thru 0x029a9c (0x1b6e bytes) 000393 1775218117.678684 read 0x035d47 thru 0x038cb5 (0x2f6f bytes) 000395 1775218117.693832 read 0x0190c4 thru 0x022677 (0x95b4 bytes) 000396 1775218117.733171 trunc from 0x029f6f to 0x0362c9 (0xc35b bytes) 000397 1775218117.744469 write 0x01c9aa thru 0x024d76 (0x83cd bytes) 000398 1775218117.746174 punch from 0x008d03 to 0x010ce1 (0x7fdf bytes) 000399 1775218117.790916 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a246): Mirror 3: 0xad3d87e3 (stale) Mirror 9: 0xad3d87e3 (stale) Mirror 11: 0xad3d87e3 (stale) Mirror 12: 0xad3d87e3 (stale) Mirror 14: 0xad3d87e3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a246): Mirror 3: 0xad3d87e3 (stale) Mirror 9: 0xad3d87e3 (stale) Mirror 11: 0xad3d87e3 (stale) Mirror 12: 0xad3d87e3 (stale) Mirror 14: 0xad3d87e3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a246: skipped 000400 1775218118.473407 mapwrite 0x03001e thru 0x030ab6 (0xa99 bytes) 000403 1775218118.509156 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a246): Mirror 3: 0xad3d87e3 (stale) Mirror 9: 0xad3d87e3 (stale) Mirror 11: 0xad3d87e3 (stale) Mirror 12: 0xad3d87e3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a246): Mirror 3: 0xad3d87e3 (stale) Mirror 9: 0xad3d87e3 (stale) Mirror 11: 0xad3d87e3 (stale) Mirror 12: 0xad3d87e3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a246: skipped 000404 1775218119.032203 MIRROR_RESYNC 5 mirrors 000405 1775218121.781270 MIRROR_RESYNC 5 mirrors 000406 1775218122.534747 write 0x027838 thru 0x036942 (0xf10b bytes) 000407 1775218122.630534 trunc from 0x03a246 to 0x0095ee (0x30c57 bytes) 000408 1775218122.669521 read 0x000309 thru 0x0095ee (0x92e6 bytes) 000409 1775218122.692693 write 0x008403 thru 0x00a2d7 (0x1ed5 bytes) 000410 1775218122.696786 mapwrite 0x0062b2 thru 0x01418d (0xdedc bytes) 000411 1775218122.834642 punch from 0x0036a4 to 0x00ea42 (0xb39f bytes) 000412 1775218122.855150 fallocate 0x005449 thru 0x00af55 (0x5b0d bytes) 000413 1775218122.870518 trunc from 0x012231 to 0x01418d (0x1f5d bytes) 000414 1775218122.884535 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1418e): Mirror 9: 0x48eecc42 (stale) Mirror 11: 0x48eecc42 (stale) Mirror 12: 0x48eecc42 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1418e): Mirror 9: 0x48eecc42 (stale) Mirror 11: 0x48eecc42 (stale) Mirror 12: 0x48eecc42 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1418e: skipped 000415 1775218123.471168 mapwrite 0x03e66c thru 0x03ffff (0x1994 bytes) 000416 1775218123.525955 read 0x01e891 thru 0x021414 (0x2b84 bytes) 000417 1775218123.536613 fallocate 0x035d7a thru 0x038f57 (0x31de bytes) 000418 1775218123.544201 mapread 0x031ed7 thru 0x03bae4 (0x9c0e bytes) 000419 1775218123.565654 fallocate 0x01096f thru 0x0155b8 (0x4c4a bytes) 000421 1775218123.574433 read 0x02b048 thru 0x030205 (0x51be bytes) 000422 1775218123.581407 MIRROR_RESYNC 4 mirrors 000423 1775218125.369403 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) 000424 1775218125.822736 fallocate 0x024cf0 thru 0x0271db (0x24ec bytes) 000426 1775218125.904586 fallocate 0x024849 thru 0x02b66c (0x6e24 bytes) 000427 1775218125.923517 trunc from 0x040000 to 0x00a7d4 (0x3582b bytes) 000428 1775218125.986710 mapwrite 0x03c553 thru 0x03ffff (0x3aad bytes) 000429 1775218126.072509 punch from 0x03f575 to 0x03ffff (0xa8b bytes) 000430 1775218126.086206 trunc from 0x040000 to 0x031d2a (0xe2d5 bytes) 000431 1775218126.112698 punch from 0x022431 to 0x02f3d1 (0xcfa1 bytes) 000432 1775218126.124799 punch from 0x0128e3 to 0x0161c3 (0x38e1 bytes) 000433 1775218126.139551 punch from 0x012bce to 0x01fe9b (0xd2ce bytes) 000434 1775218126.147743 punch from 0x02d00f to 0x031d2a (0x4d1c bytes) 000435 1775218126.155189 trunc from 0x02a483 to 0x02cc94 (0x2812 bytes) 000436 1775218126.168544 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x31d2b): Mirror 9: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31d2b): Mirror 9: 0x7cfc2be3 (stale) Mirror 11: 0x7cfc2be3 (stale) CRC-32 checksum value for chunk [0, 0x31d2b): Mirror 1: 0x6655d282 Mirror 12: 0x6655d282 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31d2b: skipped 000437 1775218127.737206 trunc from 0x031d2b to 0x003b91 (0x2e199 bytes) 000438 1775218127.804977 read 0x001c6d thru 0x003b91 (0x1f25 bytes) 000439 1775218127.813146 trunc from 0x003b92 to 0x02c91d (0x28d8c bytes) 000440 1775218127.840191 fallocate 0x01776e thru 0x01dc21 (0x64b4 bytes) 000441 1775218127.848546 read 0x0017a9 thru 0x007398 (0x5bf0 bytes) 000442 1775218127.863136 mapwrite 0x03f4e6 thru 0x03ffff (0xb1a bytes) 000443 1775218127.923409 write 0x004db1 thru 0x0050ed (0x33d bytes) 000444 1775218127.926465 punch from 0x00bfc5 to 0x018b00 (0xcb3c bytes) 000445 1775218127.937592 trunc from 0x0108d2 to 0x011eba (0x15e9 bytes) 000446 1775218127.943744 mapwrite 0x013dc4 thru 0x01e59d (0xa7da bytes) 000447 1775218128.036518 MIRROR_RESYNC 4 mirrors 000448 1775218130.221180 read 0x009b18 thru 0x0161ab (0xc694 bytes) 000449 1775218130.230040 read 0x0074c2 thru 0x013f4f (0xca8e bytes) 000450 1775218130.244134 MIRROR_EXTEND to 5 mirrors 000451 1775218131.669740 mapwrite 0x00497d thru 0x00f6f9 (0xad7d bytes) 000452 1775218131.833090 trunc from 0x040000 to 0x035e17 (0xa1e8 bytes) 000453 1775218131.867277 trunc from 0x0112e5 to 0x020dda (0xfaf6 bytes) 000454 1775218131.874982 punch from 0x032e57 to 0x035567 (0x2711 bytes) 000455 1775218131.881990 read 0x0042d4 thru 0x009101 (0x4e2e bytes) 000456 1775218131.883582 read 0x00fb11 thru 0x01d9b8 (0xdea8 bytes) 000457 1775218131.915512 write 0x018050 thru 0x027ef0 (0xfea1 bytes) 000458 1775218131.918392 read 0x00858e thru 0x012759 (0xa1cc bytes) 000460 1775218131.920586 read 0x007c5c thru 0x012e1f (0xb1c4 bytes) 000462 1775218131.922235 mapread 0x0341df thru 0x035e17 (0x1c39 bytes) 000463 1775218131.928221 MIRROR_RESYNC 5 mirrors 000464 1775218134.248312 MIRROR_EXTEND to 6 mirrors 000465 1775218136.236890 trunc from 0x035e18 to 0x035595 (0x882 bytes) 000466 1775218136.364192 write 0x01e763 thru 0x02a1c1 (0xba5f bytes) 000467 1775218136.398073 write 0x023bac thru 0x031995 (0xddea bytes) 000470 1775218136.444369 trunc from 0x0193d2 to 0x01dc3d (0x486c bytes) 000471 1775218136.467608 write 0x02cfcf thru 0x039c73 (0xcca5 bytes) 000472 1775218136.471707 mapwrite 0x017e35 thru 0x01883f (0xa0b bytes) 000473 1775218136.599131 trunc from 0x039c74 to 0x00b3d0 (0x2e8a3 bytes) 000475 1775218136.685539 mapwrite 0x023294 thru 0x02614c (0x2eb9 bytes) 000476 1775218136.847001 mapread 0x024eb0 thru 0x02614c (0x129d bytes) 000477 1775218136.848090 mapread 0x017be0 thru 0x023efa (0xc31b bytes) 000478 1775218136.866465 mapwrite 0x01d933 thru 0x021e54 (0x4522 bytes) 000479 1775218136.903916 write 0x01df41 thru 0x0253ca (0x748a bytes) 000480 1775218136.905350 punch from 0x020653 to 0x0260fa (0x5aa8 bytes) 000481 1775218136.936421 trunc from 0x00af5c to 0x01499b (0x9a40 bytes) 000482 1775218136.946885 trunc from 0x02614d to 0x01810b (0xe041 bytes) 000483 1775218136.965886 trunc from 0x008a7c to 0x00d570 (0x4af5 bytes) 000485 1775218136.987986 trunc from 0x0062a6 to 0x0115cc (0xb327 bytes) 000486 1775218137.001500 punch from 0x01389a to 0x01810b (0x4872 bytes) 000487 1775218137.019326 mapwrite 0x024ed1 thru 0x0256a0 (0x7d0 bytes) 000488 1775218137.113140 punch from 0x018f3b to 0x024e09 (0xbecf bytes) 000489 1775218137.126076 trunc from 0x0007f1 to 0x008a89 (0x8299 bytes) 000490 1775218137.141945 read 0x00a4ec thru 0x0199fb (0xf510 bytes) 000491 1775218137.168397 mapwrite 0x006f80 thru 0x01003a (0x90bb bytes) 000492 1775218137.237998 trunc from 0x0256a1 to 0x02d8e7 (0x8247 bytes) 000493 1775218137.279775 mapwrite 0x03db7d thru 0x03ffff (0x2483 bytes) 000494 1775218137.320612 punch from 0x03b3bc to 0x03bfd8 (0xc1d bytes) 000495 1775218137.329903 write 0x010cbd thru 0x018bef (0x7f33 bytes) 000496 1775218137.331465 trunc from 0x014394 to 0x0237d5 (0xf442 bytes) 000497 1775218137.371560 read 0x010a13 thru 0x019753 (0x8d41 bytes) 000498 1775218137.405229 fallocate 0x035ac0 thru 0x03f836 (0x9d77 bytes) 000499 1775218137.434503 fallocate 0x023995 thru 0x02cfeb (0x9657 bytes) 000500 1775218137.464415 trunc from 0x040000 to 0x017e80 (0x2817f bytes) 000501 1775218137.511308 trunc from 0x01096a to 0x01336c (0x2a03 bytes) 000502 1775218137.526082 write 0x034a73 thru 0x03c2c4 (0x7852 bytes) 000503 1775218137.527810 mapwrite 0x0094ac thru 0x00a100 (0xc55 bytes) 000504 1775218137.609825 punch from 0x004962 to 0x00c731 (0x7dd0 bytes) 000505 1775218137.622197 mapread 0x01c75d thru 0x01ce9a (0x73e bytes) 000506 1775218137.640933 mapwrite 0x03ee09 thru 0x03ffff (0x11f7 bytes) 000507 1775218137.836268 MIRROR_RESYNC 6 mirrors 000508 1775218141.665333 mapread 0x009d0a thru 0x014a3d (0xad34 bytes) 000509 1775218141.733911 read 0x002e4e thru 0x004883 (0x1a36 bytes) 000510 1775218141.747013 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) 000511 1775218142.518787 fallocate 0x032f2c thru 0x03be9b (0x8f70 bytes) 000512 1775218142.599521 read 0x01bc30 thru 0x027283 (0xb654 bytes) 000513 1775218142.615165 fallocate 0x0023d0 thru 0x009706 (0x7337 bytes) 000515 1775218142.629537 read 0x0278cf thru 0x02ae00 (0x3532 bytes) 000516 1775218142.683294 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xc662c02d (stale) Mirror 11: 0xc662c02d (stale) Mirror 12: 0xc662c02d (stale) Mirror 13: 0xc662c02d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc662c02d Mirror 14: 0xc662c02d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000517 1775218144.897924 read 0x010d3d thru 0x016207 (0x54cb bytes) 000519 1775218144.953935 punch from 0x01a85b to 0x023d6e (0x9514 bytes) 000520 1775218145.083928 read 0x00f5f4 thru 0x01c807 (0xd214 bytes) 000521 1775218145.107419 trunc from 0x040000 to 0x01c17b (0x23e84 bytes) 000522 1775218145.192762 mapwrite 0x03d993 thru 0x03ffff (0x266d bytes) 000523 1775218145.264390 trunc from 0x040000 to 0x0337d1 (0xc82e bytes) 000524 1775218145.285602 punch from 0x023ffd to 0x031a51 (0xda55 bytes) 000525 1775218145.294983 mapwrite 0x017fa4 thru 0x023a5b (0xbab8 bytes) 000526 1775218145.462152 write 0x037b75 thru 0x03ffff (0x848b bytes) 000527 1775218145.466823 trunc from 0x026772 to 0x027623 (0xeb2 bytes) 000528 1775218145.485785 fallocate 0x012474 thru 0x016a8e (0x461b bytes) 000529 1775218145.500275 mapwrite 0x000b8a thru 0x00f372 (0xe7e9 bytes) 000530 1775218145.603261 trunc from 0x040000 to 0x01fac0 (0x2053f bytes) 000531 1775218145.623008 trunc from 0x011115 to 0x019522 (0x840e bytes) 000532 1775218145.628862 write 0x00de5b thru 0x0112d7 (0x347d bytes) 000533 1775218145.639231 mapwrite 0x03cef9 thru 0x03d62c (0x734 bytes) 000534 1775218145.744194 trunc from 0x029010 to 0x02ac37 (0x1c28 bytes) 000535 1775218145.796905 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3d62d): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d62d): Mirror 9: 0x9c55646f (stale) Mirror 11: 0x9c55646f (stale) Mirror 12: 0x9c55646f (stale) Mirror 13: 0x9c55646f (stale) Mirror 14: 0x9c55646f (stale) CRC-32 checksum value for chunk [0, 0x3d62d): Mirror 1: 0xca514cd4 Mirror 15: 0xca514cd4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d62d: skipped 000536 1775218147.889888 punch from 0x01d153 to 0x026c31 (0x9adf bytes) 000537 1775218147.950519 trunc from 0x03d62d to 0x03515a (0x84d2 bytes) 000538 1775218147.980063 write 0x03a090 thru 0x03ffff (0x5f70 bytes) 000539 1775218147.981282 punch from 0x01c492 to 0x028208 (0xbd77 bytes) 000540 1775218147.994054 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xc662c02d (stale) Mirror 11: 0xc662c02d (stale) Mirror 12: 0xc662c02d (stale) Mirror 13: 0xc662c02d (stale) Mirror 14: 0xc662c02d (stale) Mirror 15: 0xe83bf223 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc311815d Mirror 16: 0xc311815d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000541 1775218149.907055 mapread 0x017be4 thru 0x01c063 (0x4480 bytes) 000542 1775218149.994310 punch from 0x007a70 to 0x00cdca (0x535b bytes) 000543 1775218150.053103 MIRROR_RESYNC 8 mirrors 000544 1775218153.181321 punch from 0x010895 to 0x01d933 (0xd09f bytes) 000546 1775218153.220085 trunc from 0x004736 to 0x004ceb (0x5b6 bytes) 000547 1775218153.229146 mapwrite 0x0118c0 thru 0x011f78 (0x6b9 bytes) 000549 1775218153.310284 punch from 0x000dd7 to 0x00b5e0 (0xa80a bytes) 000550 1775218153.326233 mapread 0x026202 thru 0x02ba66 (0x5865 bytes) 000551 1775218153.389090 mapwrite 0x03eef2 thru 0x03ffff (0x110e bytes) 000553 1775218153.431875 punch from 0x03f481 to 0x03ffff (0xb7f bytes) 000554 1775218153.442566 read 0x032981 thru 0x033e6c (0x14ec bytes) 000555 1775218153.451075 fallocate 0x03daea thru 0x03ffff (0x2516 bytes) 000556 1775218153.460295 trunc from 0x026692 to 0x02aac0 (0x442f bytes) 000557 1775218153.472829 trunc from 0x000d15 to 0x0075ee (0x68da bytes) 000558 1775218153.484249 punch from 0x035698 to 0x036f42 (0x18ab bytes) 000559 1775218153.491022 mapwrite 0x026665 thru 0x02ccde (0x667a bytes) 000560 1775218153.553769 MIRROR_RESYNC 8 mirrors 000561 1775218157.286614 MIRROR_EXTEND to 9 mirrors 000562 1775218158.412735 MIRROR_EXTEND to 10 mirrors 000563 1775218159.661254 punch from 0x013856 to 0x01fd0d (0xc4b8 bytes) 000564 1775218159.722457 punch from 0x02f645 to 0x037277 (0x7c33 bytes) 000565 1775218159.731673 trunc from 0x040000 to 0x0077a8 (0x38857 bytes) 000566 1775218159.753415 trunc from 0x0077a9 to 0x03bff1 (0x34849 bytes) 000567 1775218159.766068 punch from 0x039cff to 0x03bff1 (0x22f3 bytes) 000568 1775218159.775176 trunc from 0x019bfb to 0x01cef4 (0x32fa bytes) 000569 1775218159.787939 punch from 0x025469 to 0x034de5 (0xf97d bytes) 000570 1775218159.797133 fallocate 0x032ab7 thru 0x03ffff (0xd549 bytes) 000571 1775218159.802803 mapwrite 0x036a44 thru 0x03ed90 (0x834d bytes) 000572 1775218159.872898 mapread 0x004ceb thru 0x005901 (0xc17 bytes) 000573 1775218159.898043 trunc from 0x0096b2 to 0x01577f (0xc0ce bytes) 000574 1775218159.906821 read 0x026e6c thru 0x02eddd (0x7f72 bytes) 000575 1775218159.924113 mapread 0x01ef19 thru 0x025cc1 (0x6da9 bytes) 000576 1775218159.943855 trunc from 0x040000 to 0x0260b4 (0x19f4b bytes) 000577 1775218159.975999 mapread 0x001cb4 thru 0x0026df (0xa2c bytes) 000578 1775218159.978832 read 0x004705 thru 0x00b4b5 (0x6db1 bytes) 000579 1775218159.992426 fallocate 0x00655c thru 0x013c47 (0xd6ec bytes) 000580 1775218159.998523 fallocate 0x0094e6 thru 0x012b32 (0x964d bytes) 000581 1775218160.007433 trunc from 0x012555 to 0x01e848 (0xc2f4 bytes) 000582 1775218160.014095 punch from 0x0035c2 to 0x011277 (0xdcb6 bytes) 000583 1775218160.024103 trunc from 0x0260b5 to 0x02f626 (0x9572 bytes) 000584 1775218160.048160 fallocate 0x033b45 thru 0x03ffff (0xc4bb bytes) 000585 1775218160.056290 mapwrite 0x01d9f0 thru 0x027d98 (0xa3a9 bytes) 000586 1775218160.142916 trunc from 0x040000 to 0x01b0f7 (0x24f08 bytes) 000587 1775218160.172911 trunc from 0x004f9c to 0x010d2e (0xbd93 bytes) 000588 1775218160.188107 mapread 0x00f398 thru 0x01b0f7 (0xbd60 bytes) 000589 1775218160.284200 write 0x035c89 thru 0x03ffff (0xa377 bytes) 000592 1775218160.288811 write 0x028245 thru 0x03645d (0xe219 bytes) 000594 1775218160.307774 MIRROR_SPLIT mirror 5 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xa48062e7 (stale) Mirror 11: 0xa48062e7 (stale) Mirror 12: 0xa48062e7 (stale) Mirror 13: 0xa48062e7 (stale) Mirror 15: 0xa48062e7 (stale) Mirror 16: 0xa48062e7 (stale) Mirror 17: 0xa48062e7 (stale) Mirror 18: 0xa48062e7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xa48062e7 (stale) Mirror 11: 0xa48062e7 (stale) Mirror 12: 0xa48062e7 (stale) Mirror 13: 0xa48062e7 (stale) Mirror 15: 0xa48062e7 (stale) Mirror 16: 0xa48062e7 (stale) Mirror 17: 0xa48062e7 (stale) Mirror 18: 0xa48062e7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000595 1775218161.046245 trunc from 0x02881c to 0x031181 (0x8966 bytes) 000596 1775218161.056305 punch from 0x022b76 to 0x02586e (0x2cf9 bytes) 000597 1775218161.065845 punch from 0x03d5fc to 0x03db11 (0x516 bytes) 000598 1775218161.074150 trunc from 0x03f1e2 to 0x03ffff (0xe1e bytes) 000599 1775218161.080951 trunc from 0x040000 to 0x00e6fb (0x31904 bytes) 000600 1775218161.114983 trunc from 0x0014fe to 0x00e6fb (0xd1fe bytes) 000601 1775218161.128085 write 0x00c8b3 thru 0x013abd (0x720b bytes) 000602 1775218161.141319 write 0x0380b0 thru 0x03dbf2 (0x5b43 bytes) 000603 1775218161.149904 trunc from 0x0183ad to 0x01c8ad (0x4501 bytes) 000605 1775218161.158844 write 0x021d12 thru 0x031548 (0xf837 bytes) 000606 1775218161.179098 punch from 0x020f84 to 0x0272f3 (0x6370 bytes) 000607 1775218161.244903 mapwrite 0x0047d3 thru 0x012f5f (0xe78d bytes) 000608 1775218161.290795 trunc from 0x034c72 to 0x03af33 (0x62c2 bytes) 000609 1775218161.297811 trunc from 0x005b8b to 0x014711 (0xeb87 bytes) 000610 1775218161.309009 trunc from 0x03dbf3 to 0x037c11 (0x5fe1 bytes) 000611 1775218161.333828 read 0x0228cd thru 0x02a94c (0x8080 bytes) 000612 1775218161.345921 trunc from 0x037c12 to 0x02d78c (0xa485 bytes) 000613 1775218161.367923 mapread 0x001645 thru 0x00b053 (0x9a0f bytes) 000614 1775218161.377038 punch from 0x003925 to 0x00569d (0x1d79 bytes) 000615 1775218161.381804 mapread 0x00a231 thru 0x00a438 (0x208 bytes) 000616 1775218161.382922 mapwrite 0x01034f thru 0x01ef37 (0xebe9 bytes) 000617 1775218161.423158 trunc from 0x02d78d to 0x011ff9 (0x1b793 bytes) 000619 1775218161.440177 trunc from 0x011ffa to 0x0373c3 (0x253ca bytes) 000620 1775218161.475857 trunc from 0x017e69 to 0x019504 (0x169c bytes) 000621 1775218161.495072 mapwrite 0x03530a thru 0x03e95b (0x9652 bytes) 000622 1775218161.555965 read 0x03367c thru 0x03e95b (0xb2e0 bytes) 000623 1775218161.557036 trunc from 0x027e94 to 0x02fdb7 (0x7f24 bytes) 000624 1775218161.563244 read 0x01bb2e thru 0x025eab (0xa37e bytes) 000625 1775218161.575731 mapread 0x0364c1 thru 0x03e95b (0x849b bytes) 000626 1775218161.577912 trunc from 0x03e95c to 0x030508 (0xe453 bytes) 000627 1775218161.592962 mapread 0x01a2d8 thru 0x02878a (0xe4b3 bytes) 000628 1775218161.596755 mapwrite 0x0052c6 thru 0x00cab5 (0x77f0 bytes) 000629 1775218161.620234 trunc from 0x001de2 to 0x00a678 (0x8897 bytes) 000630 1775218161.626499 read 0x01dc18 thru 0x020f29 (0x3312 bytes) 000631 1775218161.634951 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x30509): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30509): Mirror 9: 0xc6fd5988 (stale) Mirror 11: 0xc6fd5988 (stale) Mirror 12: 0xc6fd5988 (stale) Mirror 13: 0xc6fd5988 (stale) Mirror 15: 0xc6fd5988 (stale) Mirror 16: 0xc6fd5988 (stale) Mirror 17: 0xc6fd5988 (stale) Mirror 18: 0xc6fd5988 (stale) CRC-32 checksum value for chunk [0, 0x30509): Mirror 1: 0x5596abb1 Mirror 19: 0x5596abb1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30509: skipped 000632 1775218163.226506 read 0x00aa0f thru 0x00bb58 (0x114a bytes) 000633 1775218163.252795 fallocate 0x01c714 thru 0x01f4e8 (0x2dd5 bytes) 000636 1775218163.317799 read 0x02994e thru 0x030508 (0x6bbb bytes) 000637 1775218163.332795 trunc from 0x00150c to 0x003318 (0x1e0d bytes) 000638 1775218163.338207 mapwrite 0x024087 thru 0x02912a (0x50a4 bytes) 000639 1775218163.356909 trunc from 0x006180 to 0x007428 (0x12a9 bytes) 000640 1775218163.363913 read 0x01a04e thru 0x02334b (0x92fe bytes) 000641 1775218163.370552 MIRROR_RESYNC 10 mirrors 000642 1775218167.276030 read 0x00ff71 thru 0x01f618 (0xf6a8 bytes) 000643 1775218167.286535 mapwrite 0x035097 thru 0x03d2eb (0x8255 bytes) 000644 1775218167.388398 fallocate 0x000351 thru 0x00c4dc (0xc18c bytes) 000645 1775218167.394991 trunc from 0x026222 to 0x02e736 (0x8515 bytes) 000646 1775218167.403152 fallocate 0x0042ea thru 0x00c0dd (0x7df4 bytes) 000647 1775218167.408871 mapwrite 0x019ac2 thru 0x02561d (0xbb5c bytes) 000648 1775218167.511452 write 0x03f32f thru 0x03ffff (0xcd1 bytes) 000650 1775218167.513332 mapwrite 0x02dca1 thru 0x033f25 (0x6285 bytes) 000651 1775218167.571747 read 0x016369 thru 0x01f4f3 (0x918b bytes) 000652 1775218167.572716 write 0x011df6 thru 0x01e953 (0xcb5e bytes) 000653 1775218167.591525 mapread 0x033650 thru 0x03ee74 (0xb825 bytes) 000654 1775218167.605867 MIRROR_RESYNC 10 mirrors 000656 1775218173.893320 mapread 0x016608 thru 0x021c85 (0xb67e bytes) 000657 1775218173.947411 trunc from 0x001686 to 0x0096cf (0x804a bytes) 000658 1775218173.992308 punch from 0x023f56 to 0x02421d (0x2c8 bytes) 000659 1775218174.000258 fallocate 0x03f017 thru 0x03ffff (0xfe9 bytes) 000660 1775218174.007585 fallocate 0x0278ec thru 0x0348ca (0xcfdf bytes) 000661 1775218174.017514 read 0x01cd9f thru 0x01cf21 (0x183 bytes) 000662 1775218174.025497 mapwrite 0x012361 thru 0x021265 (0xef05 bytes) 000663 1775218174.097765 mapwrite 0x01676d thru 0x025de7 (0xf67b bytes) 000664 1775218174.177476 mapwrite 0x00f575 thru 0x01189e (0x232a bytes) 000666 1775218174.202303 write 0x00155f thru 0x00878f (0x7231 bytes) 000668 1775218174.242978 mapwrite 0x032908 thru 0x038d0b (0x6404 bytes) 000669 1775218174.301356 write 0x0280fe thru 0x02aee1 (0x2de4 bytes) 000671 1775218174.312470 read 0x0343eb thru 0x03ffff (0xbc15 bytes) 000672 1775218174.353751 write 0x0217e9 thru 0x023d9f (0x25b7 bytes) 000673 1775218174.363914 punch from 0x00be29 to 0x017835 (0xba0d bytes) 000674 1775218174.380127 mapread 0x018fe3 thru 0x024a9b (0xbab9 bytes) 000675 1775218174.382313 mapread 0x009075 thru 0x00f283 (0x620f bytes) 000676 1775218174.472522 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x1a66f3b6 (stale) Mirror 11: 0x1a66f3b6 (stale) Mirror 12: 0x1a66f3b6 (stale) Mirror 13: 0x1a66f3b6 (stale) Mirror 15: 0x1a66f3b6 (stale) Mirror 16: 0x1a66f3b6 (stale) Mirror 17: 0x1a66f3b6 (stale) Mirror 18: 0x1a66f3b6 (stale) Mirror 19: 0x1a66f3b6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8313a66b Mirror 20: 0x8313a66b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000677 1775218176.141519 trunc from 0x040000 to 0x024f9d (0x1b062 bytes) 000678 1775218176.293146 punch from 0x0123a5 to 0x020b8d (0xe7e9 bytes) 000679 1775218176.311249 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x24f9e): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24f9e): Mirror 9: 0x763344eb (stale) Mirror 11: 0x763344eb (stale) Mirror 12: 0x763344eb (stale) Mirror 13: 0x763344eb (stale) Mirror 15: 0x763344eb (stale) Mirror 16: 0x763344eb (stale) Mirror 17: 0x763344eb (stale) Mirror 18: 0x763344eb (stale) Mirror 19: 0x763344eb (stale) Mirror 20: 0x15a7c511 (stale) CRC-32 checksum value for chunk [0, 0x24f9e): Mirror 1: 0x29e118f4 Mirror 21: 0x29e118f4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24f9e: skipped 000680 1775218178.283803 trunc from 0x003236 to 0x00fca7 (0xca72 bytes) 000681 1775218178.351369 write 0x01b75d thru 0x01dcc7 (0x256b bytes) 000682 1775218178.374125 punch from 0x00bc0e to 0x0163a1 (0xa794 bytes) 000683 1775218178.380519 fallocate 0x0298e8 thru 0x02a4d5 (0xbee bytes) 000684 1775218178.390726 fallocate 0x015f33 thru 0x020784 (0xa852 bytes) 000685 1775218178.404359 punch from 0x017cf9 to 0x01cff2 (0x52fa bytes) 000686 1775218178.424793 fallocate 0x02f9de thru 0x0368f7 (0x6f1a bytes) 000687 1775218178.435780 mapread 0x015872 thru 0x024f34 (0xf6c3 bytes) 000688 1775218178.476820 mapread 0x01b083 thru 0x024f9d (0x9f1b bytes) 000689 1775218178.483162 mapread 0x01687c thru 0x0175d0 (0xd55 bytes) 000690 1775218178.501890 MIRROR_RESYNC 12 mirrors 000691 1775218181.533427 write 0x03a7e1 thru 0x03d057 (0x2877 bytes) 000692 1775218181.617723 punch from 0x02a79a to 0x032c6b (0x84d2 bytes) 000693 1775218181.633161 fallocate 0x00be43 thru 0x00f73d (0x38fb bytes) 000694 1775218181.640445 write 0x0060aa thru 0x00891c (0x2873 bytes) 000695 1775218181.683416 read 0x021e96 thru 0x0292bf (0x742a bytes) 000696 1775218181.706338 read 0x03c4d9 thru 0x03d057 (0xb7f bytes) 000697 1775218181.711402 trunc from 0x03d058 to 0x00c6a2 (0x309b5 bytes) 000698 1775218181.761402 trunc from 0x00c6a3 to 0x0128b2 (0x6210 bytes) 000699 1775218181.789658 trunc from 0x010f36 to 0x011af8 (0xbc3 bytes) 000700 1775218181.795436 fallocate 0x00d8b1 thru 0x00eab7 (0x1207 bytes) 000701 1775218181.804933 write 0x009634 thru 0x014c3d (0xb60a bytes) 000702 1775218181.831448 punch from 0x007f7d to 0x01026b (0x82ef bytes) 000704 1775218181.876285 trunc from 0x014c3e to 0x028112 (0x134d5 bytes) 000705 1775218181.896522 trunc from 0x028113 to 0x0299e3 (0x18d1 bytes) 000706 1775218181.918480 mapread 0x01bdd2 thru 0x01ff66 (0x4195 bytes) 000707 1775218181.940257 MIRROR_RESYNC 12 mirrors 000708 1775218186.617501 mapread 0x018ddc thru 0x0234c1 (0xa6e6 bytes) 000709 1775218186.676428 write 0x01d0e6 thru 0x021fb0 (0x4ecb bytes) 000710 1775218186.755498 write 0x030337 thru 0x0339be (0x3688 bytes) 000711 1775218186.759340 write 0x03ed50 thru 0x03ffff (0x12b0 bytes) 000712 1775218186.761429 write 0x03d5b2 thru 0x03ffff (0x2a4e bytes) 000713 1775218186.772488 trunc from 0x040000 to 0x035531 (0xaace bytes) 000714 1775218186.803445 write 0x031d77 thru 0x03353e (0x17c8 bytes) 000715 1775218186.804782 read 0x0076f2 thru 0x0112f0 (0x9bff bytes) 000716 1775218186.833892 MIRROR_RESYNC 12 mirrors 000717 1775218193.103007 MIRROR_EXTEND to 13 mirrors 000718 1775218194.463422 trunc from 0x035532 to 0x01850f (0x1d022 bytes) 000719 1775218194.553401 MIRROR_RESYNC 13 mirrors 000720 1775218198.751074 punch from 0x00c9ef to 0x00f8c1 (0x2ed3 bytes) 000721 1775218198.831592 write 0x025307 thru 0x02707d (0x1d77 bytes) 000722 1775218198.834590 punch from 0x00956d to 0x0108fa (0x738e bytes) 000723 1775218198.847079 fallocate 0x02c61b thru 0x039de2 (0xd7c8 bytes) 000724 1775218198.867422 punch from 0x02da54 to 0x03432a (0x68d7 bytes) 000725 1775218198.879658 punch from 0x00fe68 to 0x00fea3 (0x3c bytes) 000726 1775218198.891372 trunc from 0x039de3 to 0x006e8a (0x32f58 bytes) 000727 1775218198.968177 trunc from 0x006ccd to 0x006e8a (0x1be bytes) 000728 1775218199.001460 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x6e8b): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6e8b): Mirror 9: 0xd6b6c188 (stale) Mirror 11: 0xd6b6c188 (stale) Mirror 12: 0xd6b6c188 (stale) Mirror 13: 0xd6b6c188 (stale) Mirror 15: 0xd6b6c188 (stale) Mirror 16: 0xd6b6c188 (stale) Mirror 17: 0xd6b6c188 (stale) Mirror 18: 0xd6b6c188 (stale) Mirror 19: 0xd6b6c188 (stale) Mirror 20: 0xd6b6c188 (stale) Mirror 21: 0xd6b6c188 (stale) Mirror 22: 0xd6b6c188 (stale) CRC-32 checksum value for chunk [0, 0x6e8b): Mirror 1: 0xf2ee9bf8 Mirror 23: 0xf2ee9bf8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6e8b: skipped 000729 1775218200.760985 punch from 0x002725 to 0x006e8a (0x4766 bytes) 000731 1775218200.831752 mapread 0x001a5c thru 0x006e8a (0x542f bytes) 000732 1775218200.866294 MIRROR_SPLIT mirror 12 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x6e8b): Mirror 9: 0xd6b6c188 (stale) Mirror 11: 0xd6b6c188 (stale) Mirror 12: 0xd6b6c188 (stale) Mirror 13: 0xd6b6c188 (stale) Mirror 15: 0xd6b6c188 (stale) Mirror 16: 0xd6b6c188 (stale) Mirror 17: 0xd6b6c188 (stale) Mirror 18: 0xd6b6c188 (stale) Mirror 19: 0xd6b6c188 (stale) Mirror 20: 0xd6b6c188 (stale) Mirror 21: 0xd6b6c188 (stale) Mirror 23: 0xf2ee9bf8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6e8b): Mirror 9: 0xd6b6c188 (stale) Mirror 11: 0xd6b6c188 (stale) Mirror 12: 0xd6b6c188 (stale) Mirror 13: 0xd6b6c188 (stale) Mirror 15: 0xd6b6c188 (stale) Mirror 16: 0xd6b6c188 (stale) Mirror 17: 0xd6b6c188 (stale) Mirror 18: 0xd6b6c188 (stale) Mirror 19: 0xd6b6c188 (stale) Mirror 20: 0xd6b6c188 (stale) Mirror 21: 0xd6b6c188 (stale) Mirror 23: 0xf2ee9bf8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6e8b: skipped 000733 1775218201.458244 write 0x02f890 thru 0x03c2be (0xca2f bytes) 000734 1775218201.465017 write 0x011c82 thru 0x01d722 (0xbaa1 bytes) 000735 1775218201.477833 trunc from 0x001582 to 0x002b71 (0x15f0 bytes) 000736 1775218201.484326 fallocate 0x017a3f thru 0x019226 (0x17e8 bytes) 000737 1775218201.492068 fallocate 0x0264f0 thru 0x035966 (0xf477 bytes) 000738 1775218201.498320 write 0x020bb8 thru 0x023dac (0x31f5 bytes) 000739 1775218201.522013 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3c2bf): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c2bf): Mirror 9: 0xdd1810b8 (stale) Mirror 11: 0xdd1810b8 (stale) Mirror 12: 0xdd1810b8 (stale) Mirror 13: 0xdd1810b8 (stale) Mirror 15: 0xdd1810b8 (stale) Mirror 16: 0xdd1810b8 (stale) Mirror 17: 0xdd1810b8 (stale) Mirror 18: 0xdd1810b8 (stale) Mirror 19: 0xdd1810b8 (stale) Mirror 20: 0xdd1810b8 (stale) Mirror 21: 0xdd1810b8 (stale) Mirror 23: 0xb82e1a38 (stale) CRC-32 checksum value for chunk [0, 0x3c2bf): Mirror 1: 0xd966f2fb Mirror 24: 0xd966f2fb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c2bf: skipped 000740 1775218202.967598 MIRROR_SPLIT mirror 9 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c2bf): Mirror 9: 0xdd1810b8 (stale) Mirror 11: 0xdd1810b8 (stale) Mirror 12: 0xdd1810b8 (stale) Mirror 13: 0xdd1810b8 (stale) Mirror 15: 0xdd1810b8 (stale) Mirror 16: 0xdd1810b8 (stale) Mirror 17: 0xdd1810b8 (stale) Mirror 18: 0xdd1810b8 (stale) Mirror 20: 0xdd1810b8 (stale) Mirror 21: 0xdd1810b8 (stale) Mirror 23: 0xb82e1a38 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c2bf): Mirror 9: 0xdd1810b8 (stale) Mirror 11: 0xdd1810b8 (stale) Mirror 12: 0xdd1810b8 (stale) Mirror 13: 0xdd1810b8 (stale) Mirror 15: 0xdd1810b8 (stale) Mirror 16: 0xdd1810b8 (stale) Mirror 17: 0xdd1810b8 (stale) Mirror 18: 0xdd1810b8 (stale) Mirror 20: 0xdd1810b8 (stale) Mirror 21: 0xdd1810b8 (stale) Mirror 23: 0xb82e1a38 (stale) CRC-32 checksum value for chunk [0, 0x3c2bf): Mirror 1: 0xd966f2fb Mirror 24: 0xd966f2fb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c2bf: skipped 000741 1775218204.702298 mapread 0x006404 thru 0x014fc5 (0xebc2 bytes) 000742 1775218204.824352 mapread 0x01445c thru 0x01f99c (0xb541 bytes) 000743 1775218204.937990 trunc from 0x03c2bf to 0x021971 (0x1a94d bytes) 000744 1775218205.070904 MIRROR_RESYNC 13 mirrors 000745 1775218208.678021 mapwrite 0x02a4a6 thru 0x034bba (0xa715 bytes) 000746 1775218208.831945 mapread 0x01789f thru 0x0230be (0xb820 bytes) 000747 1775218208.893312 trunc from 0x01e815 to 0x0204a0 (0x1c8c bytes) 000748 1775218208.905344 mapwrite 0x038753 thru 0x03e61d (0x5ecb bytes) 000749 1775218209.030577 mapread 0x01bc18 thru 0x023f0d (0x82f6 bytes) 000751 1775218209.043148 read 0x039cac thru 0x03e61d (0x4972 bytes) 000752 1775218209.046829 mapwrite 0x032f89 thru 0x03342e (0x4a6 bytes) 000753 1775218209.076495 read 0x016365 thru 0x01ca35 (0x66d1 bytes) 000754 1775218209.077387 trunc from 0x03e61e to 0x00e195 (0x30488 bytes) 000755 1775218209.166852 read 0x007c3d thru 0x00b16d (0x3531 bytes) 000756 1775218209.196394 trunc from 0x002309 to 0x002e31 (0xb29 bytes) 000757 1775218209.221856 MIRROR_SPLIT mirror 5 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe196): Mirror 9: 0x2bcc20ac (stale) Mirror 11: 0x2bcc20ac (stale) Mirror 12: 0x2bcc20ac (stale) Mirror 13: 0x2bcc20ac (stale) Mirror 16: 0x2bcc20ac (stale) Mirror 17: 0x2bcc20ac (stale) Mirror 18: 0x2bcc20ac (stale) Mirror 20: 0x2bcc20ac (stale) Mirror 21: 0x2bcc20ac (stale) Mirror 23: 0x2bcc20ac (stale) Mirror 24: 0x2bcc20ac (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe196): Mirror 9: 0x2bcc20ac (stale) Mirror 11: 0x2bcc20ac (stale) Mirror 12: 0x2bcc20ac (stale) Mirror 13: 0x2bcc20ac (stale) Mirror 16: 0x2bcc20ac (stale) Mirror 17: 0x2bcc20ac (stale) Mirror 18: 0x2bcc20ac (stale) Mirror 20: 0x2bcc20ac (stale) Mirror 21: 0x2bcc20ac (stale) Mirror 23: 0x2bcc20ac (stale) Mirror 24: 0x2bcc20ac (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe196: skipped 000758 1775218210.287965 trunc from 0x00dbf3 to 0x00e195 (0x5a3 bytes) 000759 1775218210.300846 trunc from 0x005867 to 0x00e195 (0x892f bytes) 000760 1775218210.309098 fallocate 0x01619b thru 0x023e5d (0xdcc3 bytes) 000761 1775218210.314126 mapread 0x0099f1 thru 0x00e195 (0x47a5 bytes) 000762 1775218210.338196 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0xe196): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe196): Mirror 9: 0x2bcc20ac (stale) Mirror 11: 0x2bcc20ac (stale) Mirror 12: 0x2bcc20ac (stale) Mirror 13: 0x2bcc20ac (stale) Mirror 16: 0x2bcc20ac (stale) Mirror 17: 0x2bcc20ac (stale) Mirror 18: 0x2bcc20ac (stale) Mirror 20: 0x2bcc20ac (stale) Mirror 21: 0x2bcc20ac (stale) Mirror 23: 0x2bcc20ac (stale) Mirror 24: 0x2bcc20ac (stale) CRC-32 checksum value for chunk [0, 0xe196): Mirror 1: 0x2bcc20ac Mirror 25: 0x2bcc20ac lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe196: skipped 000763 1775218212.073365 trunc from 0x0038d7 to 0x004a4b (0x1175 bytes) 000764 1775218212.144345 read 0x0025a0 thru 0x00e195 (0xbbf6 bytes) 000765 1775218212.157727 punch from 0x007fd0 to 0x00e195 (0x61c6 bytes) 000766 1775218212.162966 mapread 0x0051d5 thru 0x00ccc2 (0x7aee bytes) 000767 1775218212.187891 MIRROR_SPLIT mirror 12 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe196): Mirror 9: 0x2bcc20ac (stale) Mirror 11: 0x2bcc20ac (stale) Mirror 12: 0x2bcc20ac (stale) Mirror 13: 0x2bcc20ac (stale) Mirror 16: 0x2bcc20ac (stale) Mirror 17: 0x2bcc20ac (stale) Mirror 18: 0x2bcc20ac (stale) Mirror 20: 0x2bcc20ac (stale) Mirror 21: 0x2bcc20ac (stale) Mirror 23: 0x2bcc20ac (stale) Mirror 24: 0x2bcc20ac (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe196): Mirror 9: 0x2bcc20ac (stale) Mirror 11: 0x2bcc20ac (stale) Mirror 12: 0x2bcc20ac (stale) Mirror 13: 0x2bcc20ac (stale) Mirror 16: 0x2bcc20ac (stale) Mirror 17: 0x2bcc20ac (stale) Mirror 18: 0x2bcc20ac (stale) Mirror 20: 0x2bcc20ac (stale) Mirror 21: 0x2bcc20ac (stale) Mirror 23: 0x2bcc20ac (stale) Mirror 24: 0x2bcc20ac (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe196: skipped 000768 1775218212.909357 write 0x03fc4b thru 0x03ffff (0x3b5 bytes) 000769 1775218212.922305 MIRROR_RESYNC 12 mirrors 000770 1775218215.247898 read 0x03d3ba thru 0x03ffff (0x2c46 bytes) 000771 1775218215.254800 mapwrite 0x00fd06 thru 0x01b4a8 (0xb7a3 bytes) 000772 1775218215.480500 mapread 0x0126d8 thru 0x013d49 (0x1672 bytes) 000773 1775218215.482765 punch from 0x01de23 to 0x025d0e (0x7eec bytes) 000774 1775218215.493078 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x9bab9cf0 (stale) Mirror 11: 0x9bab9cf0 (stale) Mirror 12: 0x9bab9cf0 (stale) Mirror 13: 0x9bab9cf0 (stale) Mirror 16: 0x9bab9cf0 (stale) Mirror 17: 0x9bab9cf0 (stale) Mirror 18: 0x9bab9cf0 (stale) Mirror 20: 0x9bab9cf0 (stale) Mirror 21: 0x9bab9cf0 (stale) Mirror 23: 0x9bab9cf0 (stale) Mirror 24: 0x9bab9cf0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1f54d6a4 Mirror 25: 0x1f54d6a4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000775 1775218217.253824 fallocate 0x00b170 thru 0x00d499 (0x232a bytes) 000776 1775218217.354805 mapwrite 0x031d94 thru 0x03880b (0x6a78 bytes) 000777 1775218217.416194 mapwrite 0x000d88 thru 0x00775c (0x69d5 bytes) 000778 1775218217.507020 mapread 0x014bdb thru 0x018f5a (0x4380 bytes) 000779 1775218217.535532 read 0x014969 thru 0x0195ad (0x4c45 bytes) 000780 1775218217.536285 trunc from 0x00e1fb to 0x0115da (0x33e0 bytes) 000781 1775218217.576931 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x9bab9cf0 (stale) Mirror 12: 0x9bab9cf0 (stale) Mirror 13: 0x9bab9cf0 (stale) Mirror 16: 0x9bab9cf0 (stale) Mirror 17: 0x9bab9cf0 (stale) Mirror 18: 0x9bab9cf0 (stale) Mirror 20: 0x9bab9cf0 (stale) Mirror 21: 0x9bab9cf0 (stale) Mirror 23: 0x9bab9cf0 (stale) Mirror 24: 0x9bab9cf0 (stale) Mirror 25: 0x1f54d6a4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x9bab9cf0 (stale) Mirror 12: 0x9bab9cf0 (stale) Mirror 13: 0x9bab9cf0 (stale) Mirror 16: 0x9bab9cf0 (stale) Mirror 17: 0x9bab9cf0 (stale) Mirror 18: 0x9bab9cf0 (stale) Mirror 20: 0x9bab9cf0 (stale) Mirror 21: 0x9bab9cf0 (stale) Mirror 23: 0x9bab9cf0 (stale) Mirror 24: 0x9bab9cf0 (stale) Mirror 25: 0x1f54d6a4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000782 1775218218.595154 MIRROR_RESYNC 12 mirrors 000783 1775218222.427982 mapwrite 0x01a0af thru 0x029705 (0xf657 bytes) 000784 1775218222.555839 trunc from 0x0066c3 to 0x0095b2 (0x2ef0 bytes) 000785 1775218222.569578 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xc91a5b6a (stale) Mirror 12: 0xc91a5b6a (stale) Mirror 13: 0xc91a5b6a (stale) Mirror 16: 0xc91a5b6a (stale) Mirror 17: 0xc91a5b6a (stale) Mirror 18: 0xc91a5b6a (stale) Mirror 20: 0xc91a5b6a (stale) Mirror 21: 0xc91a5b6a (stale) Mirror 23: 0xc91a5b6a (stale) Mirror 24: 0xc91a5b6a (stale) Mirror 25: 0xc91a5b6a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x45f6ac9 Mirror 26: 0x45f6ac9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000786 1775218224.098971 read 0x02fd3f thru 0x030f44 (0x1206 bytes) 000787 1775218224.113919 write 0x01e273 thru 0x02df9d (0xfd2b bytes) 000788 1775218224.179044 mapwrite 0x007aee thru 0x0163ca (0xe8dd bytes) 000789 1775218224.225050 fallocate 0x02c1e6 thru 0x03457a (0x8395 bytes) 000790 1775218224.231304 trunc from 0x040000 to 0x00cf6c (0x33093 bytes) 000791 1775218224.259663 write 0x028640 thru 0x02f091 (0x6a52 bytes) 000792 1775218224.262372 trunc from 0x0246cc to 0x02f091 (0xa9c6 bytes) 000793 1775218224.276802 trunc from 0x01d9a4 to 0x0237c1 (0x5e1e bytes) 000794 1775218224.280375 trunc from 0x02f092 to 0x02aa62 (0x462f bytes) 000796 1775218224.295444 mapwrite 0x02eb73 thru 0x03b648 (0xcad6 bytes) 000797 1775218224.414888 trunc from 0x03b649 to 0x02008c (0x1b5bc bytes) 000798 1775218224.444470 fallocate 0x01bb0e thru 0x01e3f3 (0x28e6 bytes) 000799 1775218224.475083 mapwrite 0x02dd7b thru 0x03b881 (0xdb07 bytes) 000800 1775218224.610210 trunc from 0x033935 to 0x03b881 (0x7f4d bytes) 000802 1775218224.636778 mapread 0x00f40a thru 0x019b20 (0xa717 bytes) 000803 1775218224.674454 punch from 0x02fffb to 0x03876d (0x8773 bytes) 000804 1775218224.689408 read 0x0205e4 thru 0x02cc9a (0xc6b7 bytes) 000805 1775218224.706105 mapwrite 0x023b32 thru 0x0245f6 (0xac5 bytes) 000806 1775218224.751602 trunc from 0x03b882 to 0x004ec3 (0x369be bytes) 000807 1775218224.798028 trunc from 0x000d23 to 0x004ec3 (0x41a1 bytes) 000808 1775218224.810485 mapwrite 0x0293ed thru 0x02b021 (0x1c35 bytes) 000809 1775218224.917920 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x2b022): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b022): Mirror 11: 0x3be4e66f (stale) Mirror 12: 0x3be4e66f (stale) Mirror 13: 0x3be4e66f (stale) Mirror 16: 0x3be4e66f (stale) Mirror 17: 0x3be4e66f (stale) Mirror 18: 0x3be4e66f (stale) Mirror 20: 0x3be4e66f (stale) Mirror 21: 0x3be4e66f (stale) Mirror 23: 0x3be4e66f (stale) Mirror 24: 0x3be4e66f (stale) Mirror 25: 0x3be4e66f (stale) Mirror 26: 0xdc8b28ac (stale) CRC-32 checksum value for chunk [0, 0x2b022): Mirror 1: 0x438645cf Mirror 27: 0x438645cf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b022: skipped 000810 1775218226.622703 fallocate 0x0382ca thru 0x03ecd5 (0x6a0c bytes) 000812 1775218226.711374 trunc from 0x02b022 to 0x02eff6 (0x3fd5 bytes) 000814 1775218226.741817 write 0x0299b4 thru 0x02b481 (0x1ace bytes) 000815 1775218226.755593 punch from 0x024d54 to 0x02eff6 (0xa2a3 bytes) 000816 1775218226.767895 trunc from 0x014ada to 0x017310 (0x2837 bytes) 000817 1775218226.779291 MIRROR_RESYNC 14 mirrors 000818 1775218229.755424 MIRROR_SPLIT mirror 6 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) 000819 1775218230.485557 trunc from 0x020176 to 0x020a0c (0x897 bytes) 000820 1775218230.538067 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x2eff7): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2eff7): Mirror 11: 0x4137fe17 (stale) Mirror 12: 0x4137fe17 (stale) Mirror 13: 0x4137fe17 (stale) Mirror 16: 0x4137fe17 (stale) Mirror 17: 0x4137fe17 (stale) Mirror 20: 0x4137fe17 (stale) Mirror 21: 0x4137fe17 (stale) Mirror 23: 0x4137fe17 (stale) Mirror 24: 0x4137fe17 (stale) Mirror 25: 0x4137fe17 (stale) Mirror 26: 0x4137fe17 (stale) Mirror 27: 0x4137fe17 (stale) CRC-32 checksum value for chunk [0, 0x2eff7): Mirror 1: 0x4137fe17 Mirror 28: 0x4137fe17 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2eff7: skipped 000821 1775218232.153162 read 0x006599 thru 0x009cd1 (0x3739 bytes) 000822 1775218232.181978 fallocate 0x032b76 thru 0x036b2c (0x3fb7 bytes) 000823 1775218232.247509 mapread 0x00e026 thru 0x01378b (0x5766 bytes) 000824 1775218232.273534 read 0x032f9a thru 0x0353a1 (0x2408 bytes) 000825 1775218232.299276 fallocate 0x035640 thru 0x03a952 (0x5313 bytes) 000826 1775218232.305965 punch from 0x0153cf to 0x0230b2 (0xdce4 bytes) 000827 1775218232.312658 trunc from 0x00070a to 0x0018a9 (0x11a0 bytes) 000828 1775218232.319514 mapread 0x02d945 thru 0x038adb (0xb197 bytes) 000830 1775218232.328056 mapwrite 0x02ee15 thru 0x03cbf3 (0xdddf bytes) 000831 1775218232.397367 mapread 0x00cd0c thru 0x017b3e (0xae33 bytes) 000832 1775218232.413671 fallocate 0x02de71 thru 0x033450 (0x55e0 bytes) 000834 1775218232.421563 mapwrite 0x030afb thru 0x03b5d3 (0xaad9 bytes) 000836 1775218232.446226 punch from 0x023b33 to 0x028a72 (0x4f40 bytes) 000837 1775218232.459397 MIRROR_SPLIT mirror 5 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cbf4): Mirror 11: 0x7fe7d7d7 (stale) Mirror 12: 0x7fe7d7d7 (stale) Mirror 13: 0x7fe7d7d7 (stale) Mirror 16: 0x7fe7d7d7 (stale) Mirror 20: 0x7fe7d7d7 (stale) Mirror 21: 0x7fe7d7d7 (stale) Mirror 23: 0x7fe7d7d7 (stale) Mirror 24: 0x7fe7d7d7 (stale) Mirror 25: 0x7fe7d7d7 (stale) Mirror 26: 0x7fe7d7d7 (stale) Mirror 27: 0x7fe7d7d7 (stale) Mirror 28: 0x7fe7d7d7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cbf4): Mirror 11: 0x7fe7d7d7 (stale) Mirror 12: 0x7fe7d7d7 (stale) Mirror 13: 0x7fe7d7d7 (stale) Mirror 16: 0x7fe7d7d7 (stale) Mirror 20: 0x7fe7d7d7 (stale) Mirror 21: 0x7fe7d7d7 (stale) Mirror 23: 0x7fe7d7d7 (stale) Mirror 24: 0x7fe7d7d7 (stale) Mirror 25: 0x7fe7d7d7 (stale) Mirror 26: 0x7fe7d7d7 (stale) Mirror 27: 0x7fe7d7d7 (stale) Mirror 28: 0x7fe7d7d7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cbf4: skipped 000838 1775218233.764257 trunc from 0x03cbf4 to 0x02fa67 (0xd18c bytes) 000839 1775218233.841369 read 0x00e70f thru 0x010edd (0x27cf bytes) 000840 1775218233.872385 mapwrite 0x030775 thru 0x032125 (0x19b1 bytes) 000841 1775218233.972434 write 0x0229f1 thru 0x02a480 (0x7a90 bytes) 000842 1775218233.994549 punch from 0x01b010 to 0x020c0b (0x5bfc bytes) 000843 1775218234.007760 write 0x0084a5 thru 0x00cb55 (0x46b1 bytes) 000844 1775218234.045705 fallocate 0x021a05 thru 0x027a07 (0x6003 bytes) 000845 1775218234.060135 mapread 0x00050c thru 0x006f3b (0x6a30 bytes) 000846 1775218234.067855 fallocate 0x0070e0 thru 0x00ee30 (0x7d51 bytes) 000847 1775218234.074439 trunc from 0x032126 to 0x03c09b (0x9f76 bytes) 000848 1775218234.117562 MIRROR_RESYNC 13 mirrors 000849 1775218240.553871 trunc from 0x03c09c to 0x0389d3 (0x36c8 bytes) 000850 1775218240.660361 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x389d4): Mirror 12: 0x8c17fb51 (stale) Mirror 13: 0x8c17fb51 (stale) Mirror 16: 0x8c17fb51 (stale) Mirror 20: 0x8c17fb51 (stale) Mirror 21: 0x8c17fb51 (stale) Mirror 23: 0x8c17fb51 (stale) Mirror 24: 0x8c17fb51 (stale) Mirror 25: 0x8c17fb51 (stale) Mirror 26: 0x8c17fb51 (stale) Mirror 27: 0x8c17fb51 (stale) Mirror 28: 0x8c17fb51 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x389d4): Mirror 12: 0x8c17fb51 (stale) Mirror 13: 0x8c17fb51 (stale) Mirror 16: 0x8c17fb51 (stale) Mirror 20: 0x8c17fb51 (stale) Mirror 21: 0x8c17fb51 (stale) Mirror 23: 0x8c17fb51 (stale) Mirror 24: 0x8c17fb51 (stale) Mirror 25: 0x8c17fb51 (stale) Mirror 26: 0x8c17fb51 (stale) Mirror 27: 0x8c17fb51 (stale) Mirror 28: 0x8c17fb51 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x389d4: skipped 000851 1775218241.909714 mapread 0x024615 thru 0x02b865 (0x7251 bytes) 000853 1775218241.942064 trunc from 0x01ae34 to 0x0231a1 (0x836e bytes) 000854 1775218241.957686 mapread 0x023196 thru 0x02f58d (0xc3f8 bytes) 000856 1775218241.998548 mapread 0x02655c thru 0x02c38d (0x5e32 bytes) 000857 1775218242.006556 mapread 0x035f1c thru 0x0389d3 (0x2ab8 bytes) 000858 1775218242.020519 punch from 0x029203 to 0x036bf1 (0xd9ef bytes) 000859 1775218242.034053 MIRROR_SPLIT mirror 11 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x389d4): Mirror 12: 0x8c17fb51 (stale) Mirror 13: 0x8c17fb51 (stale) Mirror 16: 0x8c17fb51 (stale) Mirror 20: 0x8c17fb51 (stale) Mirror 21: 0x8c17fb51 (stale) Mirror 23: 0x8c17fb51 (stale) Mirror 24: 0x8c17fb51 (stale) Mirror 25: 0x8c17fb51 (stale) Mirror 26: 0x8c17fb51 (stale) Mirror 27: 0x8c17fb51 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x389d4): Mirror 12: 0x8c17fb51 (stale) Mirror 13: 0x8c17fb51 (stale) Mirror 16: 0x8c17fb51 (stale) Mirror 20: 0x8c17fb51 (stale) Mirror 21: 0x8c17fb51 (stale) Mirror 23: 0x8c17fb51 (stale) Mirror 24: 0x8c17fb51 (stale) Mirror 25: 0x8c17fb51 (stale) Mirror 26: 0x8c17fb51 (stale) Mirror 27: 0x8c17fb51 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x389d4: skipped 000860 1775218242.837868 write 0x01bd8c thru 0x02b5c0 (0xf835 bytes) 000861 1775218242.866587 trunc from 0x0361fa to 0x036f3c (0xd43 bytes) 000862 1775218242.872587 punch from 0x02ced7 to 0x0311e8 (0x4312 bytes) 000863 1775218242.881515 trunc from 0x025776 to 0x02a2e4 (0x4b6f bytes) 000864 1775218242.908123 trunc from 0x008224 to 0x010688 (0x8465 bytes) 000865 1775218242.926586 fallocate 0x025261 thru 0x026237 (0xfd7 bytes) 000866 1775218242.935928 mapwrite 0x007fdf thru 0x008819 (0x83b bytes) 000867 1775218242.966249 trunc from 0x000755 to 0x00bebd (0xb769 bytes) 000868 1775218242.983455 punch from 0x00ca53 to 0x0101d9 (0x3787 bytes) 000869 1775218242.993052 punch from 0x0349d4 to 0x0389d3 (0x4000 bytes) 000870 1775218243.005060 punch from 0x02e03a to 0x02eb79 (0xb40 bytes) 000871 1775218243.016307 write 0x005596 thru 0x011b46 (0xc5b1 bytes) 000872 1775218243.038880 write 0x011398 thru 0x0137be (0x2427 bytes) 000873 1775218243.062512 punch from 0x01a34d to 0x024d99 (0xaa4d bytes) 000874 1775218243.076119 write 0x00f567 thru 0x018544 (0x8fde bytes) 000875 1775218243.079809 mapread 0x00c26a thru 0x01abc7 (0xe95e bytes) 000876 1775218243.097197 trunc from 0x02e238 to 0x031808 (0x35d1 bytes) 000877 1775218243.137450 MIRROR_RESYNC 11 mirrors 000878 1775218248.553489 trunc from 0x0389d4 to 0x001542 (0x37491 bytes) 000879 1775218248.625588 trunc from 0x0012bb to 0x001542 (0x288 bytes) 000880 1775218248.640416 fallocate 0x01b411 thru 0x023399 (0x7f89 bytes) 000881 1775218248.653854 read 0x00949e thru 0x00ad93 (0x18f6 bytes) 000882 1775218248.679492 MIRROR_SPLIT mirror 4 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2339a): Mirror 12: 0xf767454e (stale) Mirror 13: 0xf767454e (stale) Mirror 16: 0xf767454e (stale) Mirror 21: 0xf767454e (stale) Mirror 23: 0xf767454e (stale) Mirror 24: 0xf767454e (stale) Mirror 25: 0xf767454e (stale) Mirror 26: 0xf767454e (stale) Mirror 27: 0xf767454e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2339a): Mirror 12: 0xf767454e (stale) Mirror 13: 0xf767454e (stale) Mirror 16: 0xf767454e (stale) Mirror 21: 0xf767454e (stale) Mirror 23: 0xf767454e (stale) Mirror 24: 0xf767454e (stale) Mirror 25: 0xf767454e (stale) Mirror 26: 0xf767454e (stale) Mirror 27: 0xf767454e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2339a: skipped 000883 1775218249.657070 MIRROR_RESYNC 10 mirrors 000884 1775218252.430465 trunc from 0x0194a0 to 0x023399 (0x9efa bytes) 000885 1775218252.514229 mapwrite 0x00f124 thru 0x0168dd (0x77ba bytes) 000886 1775218252.618587 mapwrite 0x037abe thru 0x03ffff (0x8542 bytes) 000887 1775218252.687445 write 0x01a343 thru 0x01b90e (0x15cc bytes) 000888 1775218252.699463 fallocate 0x00b567 thru 0x00e0dd (0x2b77 bytes) 000889 1775218252.707554 mapread 0x011bb8 thru 0x01a325 (0x876e bytes) 000890 1775218252.711404 punch from 0x030122 to 0x03495a (0x4839 bytes) 000891 1775218252.718024 trunc from 0x040000 to 0x02d09f (0x12f60 bytes) 000892 1775218252.745376 trunc from 0x02d0a0 to 0x02019d (0xcf02 bytes) 000893 1775218252.771752 MIRROR_RESYNC 10 mirrors 000894 1775218256.645307 trunc from 0x02019e to 0x03d603 (0x1d466 bytes) 000895 1775218256.689577 trunc from 0x03d604 to 0x01ac8d (0x22976 bytes) 000896 1775218256.714254 mapread 0x011626 thru 0x01ac8d (0x9668 bytes) 000897 1775218256.757132 mapread 0x006b9b thru 0x010116 (0x957c bytes) 000899 1775218256.776000 read 0x00ac0a thru 0x014d32 (0xa129 bytes) 000900 1775218256.777361 mapread 0x013087 thru 0x01ac8d (0x7c07 bytes) 000901 1775218256.778861 punch from 0x00efad to 0x01ac8d (0xbce1 bytes) 000902 1775218256.786899 read 0x0074b4 thru 0x00a62a (0x3177 bytes) 000903 1775218256.797301 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x1ac8e): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ac8e): Mirror 12: 0x24c5a8c3 (stale) Mirror 13: 0x24c5a8c3 (stale) Mirror 16: 0x24c5a8c3 (stale) Mirror 21: 0x24c5a8c3 (stale) Mirror 23: 0x24c5a8c3 (stale) Mirror 24: 0x24c5a8c3 (stale) Mirror 25: 0x24c5a8c3 (stale) Mirror 26: 0x24c5a8c3 (stale) Mirror 27: 0x24c5a8c3 (stale) CRC-32 checksum value for chunk [0, 0x1ac8e): Mirror 1: 0xdb4f6d8c Mirror 28: 0xdb4f6d8c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ac8e: skipped 000904 1775218258.450789 mapread 0x008f6f thru 0x00e891 (0x5923 bytes) 000905 1775218258.487422 trunc from 0x000eec to 0x007acd (0x6be2 bytes) 000906 1775218258.584199 write 0x03bb2a thru 0x03faf6 (0x3fcd bytes) 000907 1775218258.598546 read 0x00dde7 thru 0x01943e (0xb658 bytes) 000908 1775218258.637649 write 0x00717d thru 0x014402 (0xd286 bytes) 000909 1775218258.665197 trunc from 0x02927b to 0x03019f (0x6f25 bytes) 000910 1775218258.673099 trunc from 0x00fdf1 to 0x010af9 (0xd09 bytes) 000911 1775218258.729388 mapwrite 0x028b3c thru 0x02cbce (0x4093 bytes) 000912 1775218258.808989 MIRROR_RESYNC 11 mirrors 000913 1775218264.107423 MIRROR_EXTEND to 12 mirrors 000914 1775218265.738235 mapread 0x005096 thru 0x00d5f6 (0x8561 bytes) 000915 1775218265.766580 mapwrite 0x01a6e2 thru 0x0251da (0xaaf9 bytes) 000916 1775218265.901229 mapwrite 0x02393b thru 0x031b8b (0xe251 bytes) 000917 1775218265.951824 mapread 0x00f34c thru 0x012cd2 (0x3987 bytes) 000918 1775218265.975083 trunc from 0x022363 to 0x028742 (0x63e0 bytes) 000919 1775218265.983049 read 0x0022ec thru 0x00ab2e (0x8843 bytes) 000920 1775218265.996317 fallocate 0x02b37f thru 0x032f3d (0x7bbf bytes) 000921 1775218266.004157 punch from 0x00d3e1 to 0x0101b7 (0x2dd7 bytes) 000923 1775218266.013092 trunc from 0x03faf7 to 0x01ba3c (0x240ba bytes) 000924 1775218266.058303 mapwrite 0x02e78b thru 0x038b5e (0xa3d4 bytes) 000925 1775218266.126252 punch from 0x012989 to 0x019803 (0x6e7b bytes) 000926 1775218266.132808 fallocate 0x03f82b thru 0x03ffff (0x7d5 bytes) 000927 1775218266.139823 mapread 0x030472 thru 0x030cae (0x83d bytes) 000928 1775218266.141826 write 0x02e341 thru 0x03852b (0xa1eb bytes) 000929 1775218266.143801 fallocate 0x022b53 thru 0x02ffdd (0xd48b bytes) 000931 1775218266.159680 MIRROR_SPLIT mirror 2 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38b5f): Mirror 12: 0x7731c7ee (stale) Mirror 16: 0x7731c7ee (stale) Mirror 21: 0x7731c7ee (stale) Mirror 23: 0x7731c7ee (stale) Mirror 24: 0x7731c7ee (stale) Mirror 25: 0x7731c7ee (stale) Mirror 26: 0x7731c7ee (stale) Mirror 27: 0x7731c7ee (stale) Mirror 28: 0x7731c7ee (stale) Mirror 29: 0x7731c7ee (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38b5f): Mirror 12: 0x7731c7ee (stale) Mirror 16: 0x7731c7ee (stale) Mirror 21: 0x7731c7ee (stale) Mirror 23: 0x7731c7ee (stale) Mirror 24: 0x7731c7ee (stale) Mirror 25: 0x7731c7ee (stale) Mirror 26: 0x7731c7ee (stale) Mirror 27: 0x7731c7ee (stale) Mirror 28: 0x7731c7ee (stale) Mirror 29: 0x7731c7ee (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38b5f: skipped 000933 1775218266.934903 trunc from 0x025ce0 to 0x027658 (0x1979 bytes) 000934 1775218266.940037 trunc from 0x0049eb to 0x00732a (0x2940 bytes) 000935 1775218266.947753 read 0x00b984 thru 0x00c4dd (0xb5a bytes) 000936 1775218266.956050 mapwrite 0x03bfe4 thru 0x03e377 (0x2394 bytes) 000937 1775218267.026067 mapread 0x0105a6 thru 0x01236f (0x1dca bytes) 000938 1775218267.039355 mapwrite 0x03d507 thru 0x03ffff (0x2af9 bytes) 000939 1775218267.085171 MIRROR_RESYNC 11 mirrors 000940 1775218270.942307 fallocate 0x014fc7 thru 0x019dbf (0x4df9 bytes) 000941 1775218270.988187 mapwrite 0x004919 thru 0x00f3be (0xaaa6 bytes) 000942 1775218271.028601 mapwrite 0x020cac thru 0x02b39b (0xa6f0 bytes) 000943 1775218271.070329 mapread 0x024a33 thru 0x025b96 (0x1164 bytes) 000944 1775218271.071785 write 0x021f68 thru 0x022e05 (0xe9e bytes) 000945 1775218271.074608 trunc from 0x040000 to 0x001083 (0x3ef7c bytes) 000946 1775218271.104191 fallocate 0x031c0a thru 0x03d817 (0xbc0e bytes) 000947 1775218271.110879 fallocate 0x01c512 thru 0x01fce4 (0x37d3 bytes) 000949 1775218271.118727 read 0x0064dc thru 0x00908a (0x2baf bytes) 000950 1775218271.126213 fallocate 0x01a009 thru 0x025868 (0xb860 bytes) 000951 1775218271.132995 write 0x00acf0 thru 0x00f3d7 (0x46e8 bytes) 000952 1775218271.144119 mapwrite 0x022fc7 thru 0x030271 (0xd2ab bytes) 000953 1775218271.224782 trunc from 0x009027 to 0x00f40b (0x63e5 bytes) 000954 1775218271.232866 read 0x0236fd thru 0x02f7f0 (0xc0f4 bytes) 000955 1775218271.235082 fallocate 0x03b864 thru 0x03ffff (0x479c bytes) 000956 1775218271.240730 read 0x02b5cc thru 0x030271 (0x4ca6 bytes) 000957 1775218271.241986 fallocate 0x02fae8 thru 0x03ada2 (0xb2bb bytes) 000958 1775218271.247025 read 0x01804f thru 0x027fc9 (0xff7b bytes) 000959 1775218271.255982 trunc from 0x007af4 to 0x011404 (0x9911 bytes) 000960 1775218271.261185 read 0x0282a4 thru 0x02b0c1 (0x2e1e bytes) 000962 1775218271.262817 trunc from 0x010b96 to 0x0176e7 (0x6b52 bytes) 000963 1775218271.268598 mapwrite 0x01e081 thru 0x02583c (0x77bc bytes) 000964 1775218271.287756 mapread 0x02f0e5 thru 0x030271 (0x118d bytes) 000965 1775218271.294546 MIRROR_RESYNC 11 mirrors 000966 1775218273.396386 mapread 0x0192cd thru 0x01e356 (0x508a bytes) 000967 1775218273.446855 MIRROR_EXTEND to 12 mirrors 000968 1775218274.886219 trunc from 0x0153fc to 0x022a44 (0xd649 bytes) 000969 1775218274.935581 trunc from 0x030272 to 0x029d7e (0x64f3 bytes) 000971 1775218274.969664 fallocate 0x006d1b thru 0x008b0d (0x1df3 bytes) 000972 1775218274.976249 punch from 0x00046b to 0x0046ab (0x4241 bytes) 000973 1775218274.981598 fallocate 0x03e8e1 thru 0x03ffff (0x171f bytes) 000974 1775218274.990898 trunc from 0x040000 to 0x033655 (0xc9aa bytes) 000975 1775218275.008090 mapwrite 0x035e3e thru 0x03fd55 (0x9f18 bytes) 000977 1775218275.078262 fallocate 0x025515 thru 0x030d0d (0xb7f9 bytes) 000978 1775218275.085221 mapread 0x01c93a thru 0x02b7e8 (0xeeaf bytes) 000979 1775218275.106936 fallocate 0x008c70 thru 0x011df8 (0x9189 bytes) 000980 1775218275.114872 fallocate 0x03a1a4 thru 0x03ffff (0x5e5c bytes) 000981 1775218275.121050 trunc from 0x03fd56 to 0x03cdab (0x2faa bytes) 000982 1775218275.135737 mapread 0x030d10 thru 0x0394ee (0x87df bytes) 000983 1775218275.142456 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3cdac): Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cdac): Mirror 12: 0xa1f2ba03 (stale) Mirror 16: 0xa1f2ba03 (stale) Mirror 21: 0xa1f2ba03 (stale) Mirror 23: 0xa1f2ba03 (stale) Mirror 24: 0xa1f2ba03 (stale) Mirror 25: 0xa1f2ba03 (stale) Mirror 26: 0xa1f2ba03 (stale) Mirror 27: 0xa1f2ba03 (stale) Mirror 28: 0xa1f2ba03 (stale) Mirror 29: 0xa1f2ba03 (stale) Mirror 30: 0xa1f2ba03 (stale) CRC-32 checksum value for chunk [0, 0x3cdac): Mirror 1: 0xdd9208d5 Mirror 31: 0xdd9208d5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cdac: skipped 000984 1775218276.949443 read 0x0218e1 thru 0x02c39c (0xaabc bytes) 000985 1775218277.005399 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3cdac): Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cdac): Mirror 12: 0xa1f2ba03 (stale) Mirror 16: 0xa1f2ba03 (stale) Mirror 21: 0xa1f2ba03 (stale) Mirror 23: 0xa1f2ba03 (stale) Mirror 24: 0xa1f2ba03 (stale) Mirror 25: 0xa1f2ba03 (stale) Mirror 26: 0xa1f2ba03 (stale) Mirror 27: 0xa1f2ba03 (stale) Mirror 28: 0xa1f2ba03 (stale) Mirror 29: 0xa1f2ba03 (stale) Mirror 30: 0xa1f2ba03 (stale) CRC-32 checksum value for chunk [0, 0x3cdac): Mirror 1: 0xdd9208d5 Mirror 31: 0xdd9208d5 Mirror 32: 0xdd9208d5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cdac: skipped 000986 1775218278.174197 mapread 0x027189 thru 0x03640f (0xf287 bytes) 000987 1775218278.229432 read 0x02816e thru 0x030d3b (0x8bce bytes) 000988 1775218278.229939 mapread 0x03b902 thru 0x03cdab (0x14aa bytes) 000989 1775218278.241744 mapwrite 0x027bf2 thru 0x02b009 (0x3418 bytes) 000990 1775218278.358865 mapwrite 0x019bb7 thru 0x02132c (0x7776 bytes) 000991 1775218278.404360 trunc from 0x03cdac to 0x02c86a (0x10541 bytes) 000992 1775218278.507319 MIRROR_RESYNC 14 mirrors 000993 1775218281.258959 mapread 0x00a88e thru 0x00eeeb (0x465e bytes) 000994 1775218281.303563 trunc from 0x02b19b to 0x02c86a (0x16d0 bytes) 000995 1775218281.376859 MIRROR_RESYNC 14 mirrors 000996 1775218283.662384 MIRROR_SPLIT mirror 10 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1c3:0x0]: Invalid argument (22) 000998 1775218284.367321 MIRROR_RESYNC 13 mirrors 000999 1775218285.169371 MIRROR_EXTEND to 14 mirrors 001000 1775218286.128464 MIRROR_RESYNC 14 mirrors All operations completed A-OK!