== sanity-flr test 70a: flr mode fsx test ================ 04:06:46 (1786003606) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 3609 000001 1786003609.424436 mapwrite 0x03aa47 thru 0x03ffff (0x55b9 bytes) zero_range to largest ever: 0x17647 000002 1786003609.507451 trunc from 0x00d951 to 0x017646 (0x9cf6 bytes) 000003 1786003609.519202 MIRROR_EXTEND to 2 mirrors zero_range to largest ever: 0x40000 000005 1786003610.536826 trunc from 0x03dda9 to 0x03ffff (0x2257 bytes) 000006 1786003610.585192 trunc from 0x040000 to 0x003a4e (0x3c5b1 bytes) 000007 1786003610.630540 punch from 0x003997 to 0x003a4e (0xb8 bytes) 000008 1786003610.643572 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3a4f): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a4f): Mirror 2: 0x81347a5e (stale) CRC-32 checksum value for chunk [0, 0x3a4f): Mirror 1: 0x81347a5e Mirror 3: 0x81347a5e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a4f: skipped 000009 1786003612.236546 fallocate 0x006645 thru 0x00bfd4 (0x5990 bytes) 000010 1786003612.287263 fallocate 0x03d4d4 thru 0x03ffff (0x2b2c bytes) 000012 1786003612.295216 fallocate 0x00829a thru 0x015869 (0xd5d0 bytes) 000013 1786003612.302206 write 0x036204 thru 0x03ef1f (0x8d1c bytes) 000014 1786003612.321433 punch from 0x02c80a to 0x02fc29 (0x3420 bytes) 000015 1786003612.327967 punch from 0x02b87d to 0x02f523 (0x3ca7 bytes) 000016 1786003612.338426 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5aba527a (stale) Mirror 3: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf74fbe1f Mirror 4: 0xf74fbe1f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000017 1786003613.408686 read 0x02ef67 thru 0x03e7cd (0xf867 bytes) 000018 1786003613.439513 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5aba527a (stale) Mirror 3: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5aba527a (stale) Mirror 3: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000019 1786003614.058399 read 0x03d21f thru 0x03ffff (0x2de1 bytes) 000023 1786003614.071308 mapread 0x02b233 thru 0x032ba6 (0x7974 bytes) 000025 1786003614.111036 read 0x024edb thru 0x02ff6e (0xb094 bytes) 000026 1786003614.133121 mapwrite 0x01320b thru 0x015463 (0x2259 bytes) 000027 1786003614.249066 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5aba527a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5aba527a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000028 1786003614.678574 fallocate 0x033cdf thru 0x03c0a0 (0x83c2 bytes) 000029 1786003614.686308 punch from 0x02e092 to 0x03cca4 (0xec13 bytes) 000030 1786003614.692228 trunc from 0x00c67f to 0x015779 (0x90fb bytes) 000031 1786003614.698219 punch from 0x0153a3 to 0x019701 (0x435f bytes) 000032 1786003614.708918 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) 000033 1786003614.869159 mapread 0x0028e3 thru 0x009b3c (0x725a bytes) 000034 1786003614.897082 mapwrite 0x01d52c thru 0x0267c5 (0x929a bytes) 000035 1786003614.949115 mapread 0x006bab thru 0x014a2e (0xde84 bytes) 000036 1786003614.961898 write 0x022468 thru 0x02b5f8 (0x9191 bytes) 000037 1786003614.968953 punch from 0x032698 to 0x03732b (0x4c94 bytes) 000038 1786003614.976129 mapread 0x011d30 thru 0x01e30b (0xc5dc bytes) 000039 1786003614.979723 mapwrite 0x00e63f thru 0x01ce56 (0xe818 bytes) 000040 1786003615.012567 mapwrite 0x0018b5 thru 0x0116ad (0xfdf9 bytes) 000042 1786003615.042225 punch from 0x022818 to 0x024580 (0x1d69 bytes) 000043 1786003615.049142 punch from 0x009ebc to 0x011cfd (0x7e42 bytes) 000044 1786003615.056743 punch from 0x010cff to 0x01975f (0x8a61 bytes) 000045 1786003615.064257 mapread 0x01ee31 thru 0x02308b (0x425b bytes) 000046 1786003615.071565 mapread 0x030a76 thru 0x0349a4 (0x3f2f bytes) 000047 1786003615.083633 read 0x017369 thru 0x0208e5 (0x957d bytes) 000048 1786003615.090322 mapwrite 0x024fe2 thru 0x0342cb (0xf2ea bytes) 000049 1786003615.128553 trunc from 0x03f95a to 0x03ffff (0x6a6 bytes) 000050 1786003615.140795 MIRROR_EXTEND to 2 mirrors 000051 1786003616.483688 read 0x000031 thru 0x00a1ce (0xa19e bytes) 000052 1786003616.505081 trunc from 0x040000 to 0x02ba41 (0x145be bytes) 000053 1786003616.602759 write 0x006ebc thru 0x011e99 (0xafde bytes) 000054 1786003616.635740 punch from 0x0157f0 to 0x024bdd (0xf3ee bytes) 000055 1786003616.651577 mapread 0x005c40 thru 0x00f82a (0x9beb bytes) 000056 1786003616.667897 fallocate 0x00779d thru 0x011e84 (0xa6e8 bytes) 000057 1786003616.681105 mapread 0x028d26 thru 0x02ba41 (0x2d1c bytes) 000058 1786003616.709082 mapwrite 0x024c30 thru 0x027bd8 (0x2fa9 bytes) 000059 1786003616.734214 write 0x026bdf thru 0x02e900 (0x7d22 bytes) 000060 1786003616.737286 fallocate 0x01fe3c thru 0x026fb0 (0x7175 bytes) 000061 1786003616.743108 read 0x02ac33 thru 0x02e900 (0x3cce bytes) 000063 1786003616.744469 trunc from 0x014140 to 0x017eaa (0x3d6b bytes) 000064 1786003616.751080 trunc from 0x02e901 to 0x02c48b (0x2475 bytes) 000065 1786003616.782806 mapread 0x01dfce thru 0x01f608 (0x163b bytes) 000067 1786003616.795876 fallocate 0x013378 thru 0x02334b (0xffd4 bytes) 000068 1786003616.801870 write 0x012b22 thru 0x01add3 (0x82b2 bytes) 000069 1786003616.804056 punch from 0x011f55 to 0x0201e6 (0xe292 bytes) 000070 1786003616.821131 trunc from 0x00fbb5 to 0x012de1 (0x322d bytes) 000071 1786003616.827865 mapread 0x014f74 thru 0x01b446 (0x64d3 bytes) 000072 1786003616.877396 fallocate 0x02e160 thru 0x02e6ad (0x54e bytes) 000074 1786003616.891419 write 0x03d48c thru 0x03ffff (0x2b74 bytes) 000075 1786003616.894990 mapread 0x02d75c thru 0x038d72 (0xb617 bytes) 000076 1786003616.907651 read 0x002e2a thru 0x012d33 (0xff0a bytes) 000080 1786003616.927120 punch from 0x0115f0 to 0x01adce (0x97df bytes) 000081 1786003616.933670 write 0x03f420 thru 0x03ffff (0xbe0 bytes) 000082 1786003616.934733 fallocate 0x01c6e5 thru 0x01db53 (0x146f bytes) 000083 1786003616.941124 trunc from 0x02488c to 0x026156 (0x18cb bytes) 000084 1786003616.948232 fallocate 0x01f72f thru 0x01fd87 (0x659 bytes) 000086 1786003616.955264 punch from 0x00ba76 to 0x01858b (0xcb16 bytes) 000087 1786003616.961530 punch from 0x001f73 to 0x010c64 (0xecf2 bytes) 000088 1786003616.967661 punch from 0x00a620 to 0x00bc6d (0x164e bytes) 000089 1786003616.972301 punch from 0x0143e2 to 0x019d0a (0x5929 bytes) 000090 1786003616.977290 trunc from 0x03e28b to 0x03f547 (0x12bd bytes) 000091 1786003616.993820 MIRROR_RESYNC 2 mirrors 000092 1786003618.029499 trunc from 0x0366e1 to 0x03fa7f (0x939f bytes) 000093 1786003618.093763 read 0x03e014 thru 0x03ffff (0x1fec bytes) 000094 1786003618.102483 mapread 0x007af8 thru 0x009a11 (0x1f1a bytes) 000095 1786003618.141675 mapread 0x01ae4c thru 0x023a0f (0x8bc4 bytes) 000096 1786003618.197581 trunc from 0x040000 to 0x00656d (0x39a92 bytes) 000097 1786003618.237834 trunc from 0x00656e to 0x02ebda (0x2866d bytes) 000098 1786003618.293641 MIRROR_RESYNC 2 mirrors 000099 1786003619.338595 punch from 0x025bb7 to 0x02ebda (0x9024 bytes) 000100 1786003619.406279 trunc from 0x02ebdb to 0x0153a8 (0x19832 bytes) 000101 1786003619.457032 mapwrite 0x02e9cd thru 0x02fc75 (0x12a9 bytes) 000102 1786003619.511041 mapwrite 0x03a74c thru 0x03d026 (0x28db bytes) 000103 1786003619.566909 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d027): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d027): Mirror 2: 0x319be509 (stale) CRC-32 checksum value for chunk [0, 0x3d027): Mirror 1: 0xed2b428 Mirror 3: 0xed2b428 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d027: skipped 000105 1786003621.069800 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3d027): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d027): Mirror 2: 0x319be509 (stale) CRC-32 checksum value for chunk [0, 0x3d027): Mirror 1: 0xed2b428 Mirror 3: 0xed2b428 Mirror 4: 0xed2b428 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d027: skipped 000107 1786003622.566131 write 0x004645 thru 0x00e212 (0x9bce bytes) 000108 1786003622.716910 trunc from 0x024dd5 to 0x028de2 (0x400e bytes) 000110 1786003622.730411 fallocate 0x036554 thru 0x03d523 (0x6fd0 bytes) 000112 1786003622.751001 punch from 0x027800 to 0x0327a0 (0xafa1 bytes) 000113 1786003622.769499 punch from 0x012490 to 0x016b6d (0x46de bytes) 000114 1786003622.784608 mapread 0x02e488 thru 0x02fa09 (0x1582 bytes) 000115 1786003622.811809 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3d524): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d524): Mirror 2: 0x9de4d108 (stale) Mirror 3: 0x95094b5e (stale) Mirror 4: 0x95094b5e (stale) CRC-32 checksum value for chunk [0, 0x3d524): Mirror 1: 0xe5d6d3aa Mirror 5: 0xe5d6d3aa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d524: skipped 000116 1786003624.463610 mapwrite 0x027a94 thru 0x0313d9 (0x9946 bytes) 000117 1786003624.639136 trunc from 0x003a03 to 0x00846d (0x4a6b bytes) 000118 1786003624.659158 trunc from 0x03621e to 0x03d523 (0x7306 bytes) 000119 1786003624.668824 trunc from 0x03d524 to 0x01e284 (0x1f29f bytes) 000120 1786003624.731213 trunc from 0x01e285 to 0x00c2eb (0x11f99 bytes) 000121 1786003624.769258 trunc from 0x00c2ec to 0x018f5e (0xcc73 bytes) 000122 1786003624.835008 write 0x0059ee thru 0x013b7d (0xe190 bytes) 000123 1786003624.891500 mapread 0x000eb3 thru 0x00f0c6 (0xe214 bytes) 000124 1786003624.923198 read 0x00dbd3 thru 0x018f5e (0xb38c bytes) 000125 1786003624.981597 trunc from 0x018f5f to 0x039625 (0x206c7 bytes) 000126 1786003625.036030 mapwrite 0x019c53 thru 0x02827f (0xe62d bytes) 000127 1786003625.116647 MIRROR_RESYNC 5 mirrors 000128 1786003627.667940 write 0x013daa thru 0x014769 (0x9c0 bytes) 000129 1786003627.720312 read 0x001c1e thru 0x00a135 (0x8518 bytes) 000131 1786003627.737334 write 0x00d46c thru 0x0135a9 (0x613e bytes) 000132 1786003627.770122 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39626): Mirror 3: 0x5cdd1e1b (stale) Mirror 4: 0x5cdd1e1b (stale) Mirror 5: 0x5cdd1e1b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39626): Mirror 3: 0x5cdd1e1b (stale) Mirror 4: 0x5cdd1e1b (stale) Mirror 5: 0x5cdd1e1b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39626: skipped 000133 1786003628.470584 fallocate 0x03d9a3 thru 0x03ffff (0x265d bytes) 000134 1786003628.482963 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xa05d9a70 (stale) Mirror 5: 0xa05d9a70 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xa05d9a70 (stale) Mirror 5: 0xa05d9a70 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000135 1786003628.827369 trunc from 0x00cb2e to 0x014601 (0x7ad4 bytes) 000136 1786003628.842360 read 0x034fd4 thru 0x03ddd6 (0x8e03 bytes) 000137 1786003628.854390 read 0x02828a thru 0x0300a9 (0x7e20 bytes) 000138 1786003628.867591 mapread 0x012223 thru 0x01d074 (0xae52 bytes) 000139 1786003628.869669 write 0x032963 thru 0x03ffff (0xd69d bytes) 000140 1786003628.878031 fallocate 0x002f3f thru 0x007cc3 (0x4d85 bytes) 000141 1786003628.885979 trunc from 0x040000 to 0x03d97d (0x2682 bytes) 000142 1786003628.903668 fallocate 0x005ab2 thru 0x00e75c (0x8cab bytes) 000143 1786003628.909985 write 0x022ce5 thru 0x02ad1c (0x8038 bytes) 000146 1786003628.913152 mapwrite 0x02dd19 thru 0x03be83 (0xe16b bytes) 000147 1786003628.952021 mapread 0x03bafa thru 0x03cf2f (0x1436 bytes) 000148 1786003628.953344 mapwrite 0x034ed6 thru 0x03ffff (0xb12a bytes) 000150 1786003629.089823 mapread 0x011dfa thru 0x01547b (0x3682 bytes) 000151 1786003629.093040 trunc from 0x0110aa to 0x01123d (0x194 bytes) 000154 1786003629.115049 trunc from 0x01f70e to 0x02445b (0x4d4e bytes) 000156 1786003629.130675 write 0x03cebe thru 0x03e043 (0x1186 bytes) 000157 1786003629.143631 mapread 0x02cf89 thru 0x0377e5 (0xa85d bytes) 000158 1786003629.153061 MIRROR_RESYNC 3 mirrors 000159 1786003631.050678 write 0x0251e6 thru 0x02b6e6 (0x6501 bytes) 000160 1786003631.113746 mapwrite 0x035ae3 thru 0x0396ad (0x3bcb bytes) 000161 1786003631.178334 trunc from 0x020949 to 0x02fd87 (0xf43f bytes) 000162 1786003631.201314 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x447e2bdb (stale) Mirror 5: 0x447e2bdb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb8657766 Mirror 6: 0xb8657766 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000163 1786003632.366887 mapread 0x005224 thru 0x00d6a9 (0x8486 bytes) 000164 1786003632.413325 MIRROR_RESYNC 4 mirrors 000165 1786003633.864008 trunc from 0x040000 to 0x02c26e (0x13d91 bytes) 000166 1786003633.923183 mapread 0x0175be thru 0x026027 (0xea6a bytes) 000167 1786003633.957121 write 0x012fc0 thru 0x016f62 (0x3fa3 bytes) 000168 1786003633.964799 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c26f): Mirror 4: 0x17807d12 (stale) Mirror 6: 0x17807d12 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c26f): Mirror 4: 0x17807d12 (stale) Mirror 6: 0x17807d12 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c26f: skipped 000169 1786003634.365100 mapwrite 0x032d2b thru 0x034ede (0x21b4 bytes) 000170 1786003634.510593 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x34edf): Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34edf): Mirror 4: 0x527f0f9a (stale) Mirror 6: 0x527f0f9a (stale) CRC-32 checksum value for chunk [0, 0x34edf): Mirror 1: 0x68dd973b Mirror 7: 0x68dd973b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34edf: skipped 000171 1786003635.797401 trunc from 0x00129d to 0x00238a (0x10ee bytes) 000172 1786003635.851528 trunc from 0x034edf to 0x017c2e (0x1d2b0 bytes) 000173 1786003635.882533 punch from 0x00c077 to 0x00ccc9 (0xc53 bytes) 000174 1786003635.887649 trunc from 0x00c227 to 0x017c2e (0xba08 bytes) 000175 1786003635.893878 read 0x001c88 thru 0x002da6 (0x111f bytes) 000176 1786003635.899777 mapwrite 0x035a99 thru 0x035fa7 (0x50f bytes) 000177 1786003635.953796 write 0x02aa3a thru 0x02bfd9 (0x15a0 bytes) 000178 1786003635.982009 fallocate 0x03484e thru 0x037361 (0x2b14 bytes) 000179 1786003635.996987 write 0x006602 thru 0x00fa36 (0x9435 bytes) 000181 1786003636.019516 fallocate 0x01178a thru 0x01a9c4 (0x923b bytes) 000182 1786003636.026860 write 0x03c458 thru 0x03ffff (0x3ba8 bytes) 000183 1786003636.029302 mapread 0x036386 thru 0x03b5d4 (0x524f bytes) 000184 1786003636.045723 fallocate 0x03c80b thru 0x03ffff (0x37f5 bytes) 000185 1786003636.051909 read 0x000940 thru 0x003147 (0x2808 bytes) 000186 1786003636.081681 read 0x034068 thru 0x03bb48 (0x7ae1 bytes) 000187 1786003636.084359 write 0x009ffd thru 0x00eac8 (0x4acc bytes) 000190 1786003636.091850 punch from 0x02ac95 to 0x0361a5 (0xb511 bytes) 000191 1786003636.135963 fallocate 0x00eac7 thru 0x01b9b0 (0xceea bytes) 000192 1786003636.143999 write 0x01d963 thru 0x01e0d8 (0x776 bytes) 000193 1786003636.147353 trunc from 0x040000 to 0x019cf4 (0x2630b bytes) 000194 1786003636.169476 punch from 0x0122af to 0x019cf4 (0x7a46 bytes) 000195 1786003636.194559 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x19cf5): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19cf5): Mirror 4: 0x581f913c (stale) Mirror 6: 0x581f913c (stale) Mirror 7: 0x4358748c (stale) CRC-32 checksum value for chunk [0, 0x19cf5): Mirror 1: 0xa39ed2ef Mirror 8: 0xa39ed2ef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19cf5: skipped 000196 1786003637.478944 mapwrite 0x03e07b thru 0x03ffff (0x1f85 bytes) 000197 1786003637.684092 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xb8657766 (stale) Mirror 7: 0xd6b7254a (stale) Mirror 8: 0xeed37175 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xb8657766 (stale) Mirror 7: 0xd6b7254a (stale) Mirror 8: 0xeed37175 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000198 1786003638.182731 write 0x02f183 thru 0x03b14e (0xbfcc bytes) 000199 1786003638.245023 trunc from 0x040000 to 0x008462 (0x37b9d bytes) 000200 1786003638.277535 write 0x000d21 thru 0x00c40c (0xb6ec bytes) 000201 1786003638.285992 mapwrite 0x032145 thru 0x034ec7 (0x2d83 bytes) 000202 1786003638.386257 mapwrite 0x0032d0 thru 0x0045d7 (0x1308 bytes) 000203 1786003638.401819 punch from 0x03364f to 0x034ec7 (0x1879 bytes) 000204 1786003638.412342 mapwrite 0x033a5b thru 0x03c1a6 (0x874c bytes) 000205 1786003638.484909 punch from 0x020424 to 0x025142 (0x4d1f bytes) 000206 1786003638.490607 trunc from 0x03c1a7 to 0x0339bb (0x87eb bytes) 000207 1786003638.515930 trunc from 0x0339bc to 0x03105e (0x295d bytes) 000208 1786003638.551141 mapread 0x000c77 thru 0x00b71e (0xaaa8 bytes) 000209 1786003638.554507 trunc from 0x0044f2 to 0x01256a (0xe079 bytes) 000211 1786003638.567631 read 0x0061ee thru 0x014341 (0xe154 bytes) 000212 1786003638.581160 mapwrite 0x002563 thru 0x009928 (0x73c6 bytes) 000213 1786003638.620917 fallocate 0x03abfe thru 0x03ffff (0x5402 bytes) 000214 1786003638.632498 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xb8657766 (stale) Mirror 7: 0xd6b7254a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xb8657766 (stale) Mirror 7: 0xd6b7254a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000215 1786003639.074679 mapread 0x0015eb thru 0x006fa7 (0x59bd bytes) 000216 1786003639.108010 read 0x00983f thru 0x010395 (0x6b57 bytes) 000218 1786003639.110183 mapwrite 0x038c8a thru 0x039d6e (0x10e5 bytes) 000219 1786003639.156912 mapwrite 0x007bec thru 0x00934a (0x175f bytes) 000220 1786003639.176052 fallocate 0x02e5e4 thru 0x02e6bf (0xdc bytes) 000221 1786003639.184329 punch from 0x0272a0 to 0x032a1c (0xb77d bytes) 000222 1786003639.192267 fallocate 0x00fa0c thru 0x01e603 (0xebf8 bytes) 000223 1786003639.200012 mapwrite 0x01b24d thru 0x01fcb6 (0x4a6a bytes) 000224 1786003639.236057 fallocate 0x00caa9 thru 0x01c7c7 (0xfd1f bytes) 000225 1786003639.241920 punch from 0x00665e to 0x00aadd (0x4480 bytes) 000226 1786003639.252279 MIRROR_RESYNC 3 mirrors 000227 1786003640.697670 trunc from 0x010347 to 0x013f21 (0x3bdb bytes) 000228 1786003640.730923 fallocate 0x03e254 thru 0x03ffff (0x1dac bytes) 000229 1786003640.738635 punch from 0x03a460 to 0x03ffff (0x5ba0 bytes) 000230 1786003640.748281 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x654e2a65 (stale) Mirror 7: 0x654e2a65 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x654e2a65 Mirror 8: 0x654e2a65 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000231 1786003642.111216 write 0x000b4c thru 0x00681d (0x5cd2 bytes) 000232 1786003642.198596 punch from 0x03037b to 0x03e5fb (0xe281 bytes) 000234 1786003642.210494 fallocate 0x03fd6f thru 0x03ffff (0x291 bytes) 000235 1786003642.236384 trunc from 0x01f6c1 to 0x02970a (0xa04a bytes) 000237 1786003642.262630 mapwrite 0x01cc1c thru 0x028905 (0xbcea bytes) 000239 1786003642.365206 trunc from 0x035988 to 0x03c852 (0x6ecb bytes) 000240 1786003642.385317 read 0x013600 thru 0x0173e1 (0x3de2 bytes) 000241 1786003642.400739 mapwrite 0x010e1c thru 0x0161eb (0x53d0 bytes) 000242 1786003642.457647 trunc from 0x040000 to 0x001df3 (0x3e20c bytes) 000244 1786003642.515278 trunc from 0x001df4 to 0x03d8cb (0x3bad8 bytes) 000245 1786003642.548469 trunc from 0x015a7c to 0x01c49b (0x6a20 bytes) 000246 1786003642.554609 read 0x00fd0a thru 0x0115f3 (0x18ea bytes) 000248 1786003642.569433 punch from 0x00770a to 0x014d7e (0xd675 bytes) 000249 1786003642.575087 trunc from 0x03d8cc to 0x00c3b4 (0x31517 bytes) 000250 1786003642.594251 trunc from 0x00c3b5 to 0x019051 (0xcc9d bytes) 000252 1786003642.621622 MIRROR_RESYNC 4 mirrors 000253 1786003643.548054 write 0x01d8ef thru 0x02465b (0x6d6d bytes) 000254 1786003643.601507 trunc from 0x0008d4 to 0x00abc3 (0xa2f0 bytes) 000255 1786003643.613491 read 0x00075c thru 0x009475 (0x8d1a bytes) 000256 1786003643.630332 trunc from 0x017e96 to 0x019832 (0x199d bytes) 000257 1786003643.643608 write 0x02df55 thru 0x034235 (0x62e1 bytes) 000258 1786003643.647092 trunc from 0x034236 to 0x03181a (0x2a1b bytes) 000259 1786003643.717662 punch from 0x0314e2 to 0x03181a (0x339 bytes) 000260 1786003643.758657 mapwrite 0x00c052 thru 0x00e0f8 (0x20a7 bytes) 000261 1786003643.830241 punch from 0x02e903 to 0x03181a (0x2f18 bytes) 000262 1786003643.837853 mapread 0x0233e0 thru 0x0240b6 (0xcd7 bytes) 000263 1786003643.845329 MIRROR_RESYNC 4 mirrors 000264 1786003645.641635 fallocate 0x02cb36 thru 0x03a8ab (0xdd76 bytes) 000265 1786003645.729629 trunc from 0x03a8ac to 0x0118de (0x28fcd bytes) 000266 1786003645.770587 trunc from 0x00f857 to 0x0118de (0x2088 bytes) 000267 1786003645.775381 punch from 0x00cf2f to 0x0118de (0x49b0 bytes) 000268 1786003645.781647 trunc from 0x0118df to 0x002a12 (0xeecc bytes) 000269 1786003645.814556 MIRROR_RESYNC 4 mirrors 000270 1786003646.708834 mapwrite 0x013f91 thru 0x019f11 (0x5f81 bytes) 000271 1786003646.812242 mapread 0x016857 thru 0x019f11 (0x36bb bytes) 000272 1786003646.814176 mapwrite 0x010a25 thru 0x01ee64 (0xe440 bytes) 000273 1786003646.870536 trunc from 0x01ee65 to 0x00cfd2 (0x11e92 bytes) 000275 1786003646.900295 trunc from 0x0006d7 to 0x00bb10 (0xb43a bytes) 000276 1786003646.917001 fallocate 0x023993 thru 0x02f7b6 (0xbe24 bytes) 000277 1786003646.936173 write 0x03d448 thru 0x03ffff (0x2bb8 bytes) 000278 1786003646.940297 mapread 0x010d2a thru 0x013861 (0x2b38 bytes) 000279 1786003646.967522 trunc from 0x02956f to 0x030361 (0x6df3 bytes) 000280 1786003646.982171 read 0x033c5e thru 0x03ffff (0xc3a2 bytes) 000281 1786003647.007993 trunc from 0x021e06 to 0x024c1e (0x2e19 bytes) 000282 1786003647.022581 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xe20eea22 (stale) Mirror 7: 0xe20eea22 (stale) Mirror 8: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd5ec6997 Mirror 9: 0xd5ec6997 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000283 1786003648.294943 fallocate 0x010f9d thru 0x01fa1b (0xea7f bytes) 000284 1786003648.341001 mapwrite 0x00fd74 thru 0x01d55e (0xd7eb bytes) 000285 1786003648.404924 punch from 0x0240ff to 0x02d212 (0x9114 bytes) 000286 1786003648.413462 punch from 0x02bb35 to 0x02c091 (0x55d bytes) 000287 1786003648.420392 trunc from 0x040000 to 0x01af8b (0x25074 bytes) 000288 1786003648.449611 trunc from 0x01af8c to 0x0028a5 (0x186e6 bytes) 000289 1786003648.477331 read 0x0025f1 thru 0x0028a5 (0x2b5 bytes) 000290 1786003648.484128 mapwrite 0x02f067 thru 0x0352fe (0x6298 bytes) 000291 1786003648.541339 read 0x031107 thru 0x0352fe (0x41f8 bytes) 000292 1786003648.542222 write 0x03324d thru 0x03ffff (0xcdb3 bytes) 000293 1786003648.553758 MIRROR_RESYNC 5 mirrors 000294 1786003649.929406 read 0x00e04d thru 0x01a8ab (0xc85f bytes) 000296 1786003649.963036 mapread 0x00504d thru 0x008ed1 (0x3e85 bytes) 000297 1786003650.002282 mapwrite 0x003781 thru 0x009320 (0x5ba0 bytes) 000299 1786003650.132853 MIRROR_RESYNC 5 mirrors 000300 1786003651.572971 trunc from 0x00a69d to 0x0177b2 (0xd116 bytes) 000302 1786003651.610731 trunc from 0x040000 to 0x036eba (0x9145 bytes) 000303 1786003651.634653 mapwrite 0x035bbd thru 0x03967d (0x3ac1 bytes) 000304 1786003651.695633 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3967e): Mirror 7: 0x3cdc0c19 (stale) Mirror 8: 0x3cdc0c19 (stale) Mirror 9: 0x3cdc0c19 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3967e): Mirror 7: 0x3cdc0c19 (stale) Mirror 8: 0x3cdc0c19 (stale) Mirror 9: 0x3cdc0c19 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3967e: skipped 000305 1786003652.254182 mapwrite 0x0007af thru 0x003405 (0x2c57 bytes) 000306 1786003652.361095 mapwrite 0x010cb5 thru 0x01b6b6 (0xaa02 bytes) 000308 1786003652.476220 write 0x00bfd0 thru 0x01a943 (0xe974 bytes) 000309 1786003652.495669 read 0x00111f thru 0x009889 (0x876b bytes) 000310 1786003652.496564 write 0x012a26 thru 0x021f56 (0xf531 bytes) 000311 1786003652.506869 write 0x02d932 thru 0x03d62c (0xfcfb bytes) 000312 1786003652.541941 trunc from 0x032bb2 to 0x037eb1 (0x5300 bytes) 000313 1786003652.608341 trunc from 0x03d62d to 0x00920a (0x34422 bytes) 000315 1786003652.653304 trunc from 0x001257 to 0x00920a (0x7fb4 bytes) 000316 1786003652.673816 mapwrite 0x029855 thru 0x02b4df (0x1c8b bytes) 000317 1786003652.755070 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2b4e0): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b4e0): Mirror 7: 0xbad830a3 (stale) Mirror 8: 0xbad830a3 (stale) Mirror 9: 0xbad830a3 (stale) CRC-32 checksum value for chunk [0, 0x2b4e0): Mirror 1: 0x4988a4c2 Mirror 10: 0x4988a4c2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b4e0: skipped 000318 1786003654.020496 fallocate 0x03a09c thru 0x03aa08 (0x96d bytes) 000319 1786003654.091421 read 0x012e73 thru 0x01f68f (0xc81d bytes) 000320 1786003654.108125 punch from 0x027e10 to 0x02b4df (0x36d0 bytes) 000321 1786003654.115482 trunc from 0x00f35a to 0x010994 (0x163b bytes) 000322 1786003654.119764 punch from 0x002beb to 0x00d8c5 (0xacdb bytes) 000323 1786003654.125517 read 0x018be0 thru 0x01b6a1 (0x2ac2 bytes) 000324 1786003654.127789 fallocate 0x030302 thru 0x03e66d (0xe36c bytes) 000325 1786003654.138000 punch from 0x01d550 to 0x0207e4 (0x3295 bytes) 000326 1786003654.158385 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e66e): Mirror 7: 0x88616477 (stale) Mirror 9: 0x88616477 (stale) Mirror 10: 0xef39c3c5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e66e): Mirror 7: 0x88616477 (stale) Mirror 9: 0x88616477 (stale) Mirror 10: 0xef39c3c5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e66e: skipped 000327 1786003654.535312 trunc from 0x03e66e to 0x02b875 (0x12df8 bytes) 000328 1786003654.562553 read 0x002bd2 thru 0x00505f (0x248e bytes) 000329 1786003654.573407 mapwrite 0x0285da thru 0x02a2bb (0x1ce2 bytes) 000330 1786003654.630555 trunc from 0x00b1b1 to 0x017bca (0xca1a bytes) 000331 1786003654.638045 trunc from 0x02b876 to 0x02dfca (0x2755 bytes) 000332 1786003654.651504 mapwrite 0x02ed96 thru 0x03333f (0x45aa bytes) 000333 1786003654.753914 trunc from 0x033340 to 0x02eb97 (0x47a8 bytes) 000334 1786003654.781644 write 0x00c863 thru 0x00fe96 (0x3634 bytes) 000335 1786003654.800393 fallocate 0x03d0b7 thru 0x03ffff (0x2f49 bytes) 000336 1786003654.820483 trunc from 0x02eb98 to 0x0201bc (0xe9db bytes) 000337 1786003654.862126 read 0x018c23 thru 0x01ea60 (0x5e3e bytes) 000338 1786003654.881616 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x201bd): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x201bd): Mirror 7: 0x5f3e1f92 (stale) Mirror 9: 0x5f3e1f92 (stale) Mirror 10: 0x7300fb9a (stale) CRC-32 checksum value for chunk [0, 0x201bd): Mirror 1: 0xc456e5ec Mirror 11: 0xc456e5ec lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x201bd: skipped 000339 1786003656.029900 fallocate 0x036c6c thru 0x037bc2 (0xf57 bytes) 000341 1786003656.133431 write 0x00e7d5 thru 0x01cb84 (0xe3b0 bytes) 000342 1786003656.163033 trunc from 0x0201bd to 0x0264a0 (0x62e4 bytes) 000343 1786003656.191603 mapwrite 0x0228ec thru 0x02da1a (0xb12f bytes) 000344 1786003656.292585 mapread 0x01da72 thru 0x02ca29 (0xefb8 bytes) 000345 1786003656.295427 fallocate 0x01e303 thru 0x01f39c (0x109a bytes) 000347 1786003656.302015 trunc from 0x0260de to 0x027c07 (0x1b2a bytes) 000348 1786003656.307843 punch from 0x0207dd to 0x02bc88 (0xb4ac bytes) 000349 1786003656.313649 mapread 0x02c3a3 thru 0x02da1a (0x1678 bytes) 000351 1786003656.316217 fallocate 0x02108d thru 0x021529 (0x49d bytes) 000352 1786003656.321138 trunc from 0x02503a to 0x02af3d (0x5f04 bytes) 000353 1786003656.326810 trunc from 0x02da1b to 0x02c3b9 (0x1661 bytes) 000354 1786003656.346460 trunc from 0x02c3ba to 0x005d21 (0x26698 bytes) 000355 1786003656.363974 write 0x02bbf3 thru 0x02c028 (0x436 bytes) 000357 1786003656.365748 punch from 0x0190de to 0x01afd3 (0x1ef6 bytes) 000358 1786003656.375168 fallocate 0x020f28 thru 0x021421 (0x4fa bytes) 000359 1786003656.384844 write 0x01249c thru 0x01b9af (0x9514 bytes) 000360 1786003656.398126 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c029): Mirror 9: 0x644d92ad (stale) Mirror 10: 0x581b949f (stale) Mirror 11: 0xfa84b1b4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c029): Mirror 9: 0x644d92ad (stale) Mirror 10: 0x581b949f (stale) Mirror 11: 0xfa84b1b4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c029: skipped 000361 1786003656.831674 fallocate 0x03b670 thru 0x03ffff (0x4990 bytes) 000363 1786003656.839279 read 0x02825f thru 0x02c028 (0x3dca bytes) 000364 1786003656.864093 punch from 0x004d56 to 0x00c885 (0x7b30 bytes) 000365 1786003656.873934 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2c029): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c029): Mirror 9: 0x644d92ad (stale) Mirror 10: 0x581b949f (stale) Mirror 11: 0xfa84b1b4 (stale) CRC-32 checksum value for chunk [0, 0x2c029): Mirror 1: 0x974504d2 Mirror 12: 0x974504d2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c029: skipped 000366 1786003657.912958 trunc from 0x02c029 to 0x00ec5b (0x1d3cd bytes) 000367 1786003657.983499 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xec5c): Mirror 10: 0x72130a78 (stale) Mirror 11: 0x62caaaf5 (stale) Mirror 12: 0x72130a78 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xec5c): Mirror 10: 0x72130a78 (stale) Mirror 11: 0x62caaaf5 (stale) Mirror 12: 0x72130a78 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xec5c: skipped 000368 1786003658.427414 mapwrite 0x01a5c6 thru 0x026517 (0xbf52 bytes) 000369 1786003658.520343 fallocate 0x018364 thru 0x01dd0b (0x59a8 bytes) 000370 1786003658.527340 mapwrite 0x007887 thru 0x00eb0b (0x7285 bytes) 000371 1786003658.565065 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26518): Mirror 10: 0x642738dc (stale) Mirror 11: 0x1809c192 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26518): Mirror 10: 0x642738dc (stale) Mirror 11: 0x1809c192 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26518: skipped 000372 1786003658.957681 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x26518): Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26518): Mirror 10: 0x642738dc (stale) Mirror 11: 0x1809c192 (stale) CRC-32 checksum value for chunk [0, 0x26518): Mirror 1: 0xe1c1660c Mirror 12: 0xe1c1660c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26518: skipped 000373 1786003659.783434 write 0x000e72 thru 0x010366 (0xf4f5 bytes) 000374 1786003659.843299 write 0x0163c7 thru 0x021c1f (0xb859 bytes) 000375 1786003659.856011 write 0x036bab thru 0x03ffff (0x9455 bytes) 000376 1786003659.860263 read 0x03e583 thru 0x03ffff (0x1a7d bytes) 000377 1786003659.861174 mapwrite 0x010dda thru 0x0153a0 (0x45c7 bytes) 000378 1786003659.897028 trunc from 0x040000 to 0x03f8b3 (0x74c bytes) 000379 1786003659.923107 trunc from 0x03f8b4 to 0x02d40a (0x124a9 bytes) 000380 1786003659.936188 write 0x026db6 thru 0x0366ae (0xf8f9 bytes) 000381 1786003659.944528 fallocate 0x0386fb thru 0x0399f4 (0x12fa bytes) 000382 1786003659.955062 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x366af): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x366af): Mirror 10: 0x54518db8 (stale) Mirror 11: 0xb15f210a (stale) Mirror 12: 0x6c702f70 (stale) CRC-32 checksum value for chunk [0, 0x366af): Mirror 1: 0xa016722d Mirror 13: 0xa016722d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x366af: skipped 000383 1786003660.767404 trunc from 0x0285ee to 0x033f9b (0xb9ae bytes) 000384 1786003660.816520 trunc from 0x01656f to 0x024b48 (0xe5da bytes) 000385 1786003660.822264 trunc from 0x0366af to 0x01d5d2 (0x190dc bytes) 000386 1786003660.867519 trunc from 0x009724 to 0x0177c0 (0xe09d bytes) 000387 1786003660.880233 punch from 0x004c28 to 0x00726e (0x2647 bytes) 000389 1786003660.889377 mapread 0x011855 thru 0x0169c0 (0x516c bytes) 000390 1786003660.915910 write 0x01547f thru 0x01df89 (0x8b0b bytes) 000391 1786003660.925136 read 0x0021bf thru 0x002916 (0x758 bytes) 000392 1786003660.943476 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1df8a): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1df8a): Mirror 10: 0x64861697 (stale) Mirror 11: 0x2006d65c (stale) Mirror 12: 0x6cf71186 (stale) Mirror 13: 0xb624dee3 (stale) CRC-32 checksum value for chunk [0, 0x1df8a): Mirror 1: 0xdb6ea878 Mirror 14: 0xdb6ea878 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1df8a: skipped 000393 1786003661.869381 fallocate 0x004634 thru 0x012982 (0xe34f bytes) 000394 1786003661.918009 write 0x00d261 thru 0x01654b (0x92eb bytes) 000395 1786003661.933313 trunc from 0x005aed to 0x00dc9a (0x81ae bytes) 000396 1786003661.946977 trunc from 0x01df8a to 0x015d2e (0x825b bytes) 000397 1786003661.969958 punch from 0x00376c to 0x010733 (0xcfc8 bytes) 000398 1786003661.987452 MIRROR_RESYNC 6 mirrors 000399 1786003663.235210 fallocate 0x020d02 thru 0x027603 (0x6902 bytes) 000400 1786003663.273343 write 0x0296c8 thru 0x0384ca (0xee03 bytes) 000401 1786003663.275289 trunc from 0x0384cb to 0x00950d (0x2efbd bytes) 000402 1786003663.302496 read 0x005696 thru 0x00950d (0x3e78 bytes) 000403 1786003663.316120 write 0x0185db thru 0x0233a5 (0xadcb bytes) 000404 1786003663.319621 read 0x004cfd thru 0x00d73e (0x8a42 bytes) 000405 1786003663.331412 fallocate 0x03e14d thru 0x03f95e (0x1812 bytes) 000406 1786003663.338823 trunc from 0x03f95f to 0x016b3b (0x28e23 bytes) 000407 1786003663.360624 trunc from 0x016b3c to 0x01fa72 (0x8f37 bytes) 000408 1786003663.391511 write 0x003846 thru 0x0122dc (0xea97 bytes) 000409 1786003663.396092 mapwrite 0x02ffe1 thru 0x039542 (0x9562 bytes) 000410 1786003663.489977 mapwrite 0x00f3c9 thru 0x01eafc (0xf734 bytes) 000411 1786003663.557615 read 0x036323 thru 0x039542 (0x3220 bytes) 000412 1786003663.558910 fallocate 0x0072e0 thru 0x015e00 (0xeb21 bytes) 000413 1786003663.565651 read 0x007282 thru 0x0169a9 (0xf728 bytes) 000414 1786003663.566780 read 0x015775 thru 0x01bff1 (0x687d bytes) 000415 1786003663.567668 trunc from 0x039543 to 0x007cdd (0x31865 bytes) 000416 1786003663.588400 trunc from 0x002fac to 0x007cdd (0x4d32 bytes) 000417 1786003663.598229 fallocate 0x00eb4c thru 0x01a90b (0xbdc0 bytes) 000418 1786003663.604275 write 0x035ff2 thru 0x03d6de (0x76ed bytes) 000419 1786003663.606453 fallocate 0x00e953 thru 0x011e9f (0x354d bytes) 000420 1786003663.611833 trunc from 0x0322b4 to 0x03d5d8 (0xb325 bytes) 000422 1786003663.631099 trunc from 0x03d6df to 0x00b0c8 (0x32616 bytes) 000423 1786003663.654985 fallocate 0x0219f2 thru 0x024b60 (0x316f bytes) 000424 1786003663.670438 trunc from 0x00b0c9 to 0x00ccf3 (0x1c2b bytes) 000425 1786003663.694234 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xccf4): Mirror 11: 0xebc38943 (stale) Mirror 12: 0xebc38943 (stale) Mirror 13: 0xebc38943 (stale) Mirror 14: 0xebc38943 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xccf4): Mirror 11: 0xebc38943 (stale) Mirror 12: 0xebc38943 (stale) Mirror 13: 0xebc38943 (stale) Mirror 14: 0xebc38943 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xccf4: skipped 000426 1786003664.118762 mapread 0x00a299 thru 0x00ccf3 (0x2a5b bytes) 000427 1786003664.171638 MIRROR_RESYNC 5 mirrors 000428 1786003665.819169 read 0x006e37 thru 0x00ccf3 (0x5ebd bytes) 000429 1786003665.828390 mapwrite 0x01656b thru 0x01df80 (0x7a16 bytes) 000430 1786003665.910204 mapread 0x019bae thru 0x01a025 (0x478 bytes) 000431 1786003665.912371 fallocate 0x03f5c9 thru 0x03ffff (0xa37 bytes) 000432 1786003665.936398 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x1f3cd7f1 (stale) Mirror 13: 0x1f3cd7f1 (stale) Mirror 14: 0x1f3cd7f1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x1f3cd7f1 (stale) Mirror 13: 0x1f3cd7f1 (stale) Mirror 14: 0x1f3cd7f1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000433 1786003666.729454 punch from 0x012274 to 0x01b6ba (0x9447 bytes) 000434 1786003666.736564 punch from 0x0247d0 to 0x024e34 (0x665 bytes) 000435 1786003666.745278 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x1f3cd7f1 (stale) Mirror 13: 0x1f3cd7f1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x1f3cd7f1 (stale) Mirror 13: 0x1f3cd7f1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000437 1786003667.098397 read 0x01305e thru 0x022993 (0xf936 bytes) 000438 1786003667.127581 punch from 0x025358 to 0x0276cc (0x2375 bytes) 000439 1786003667.141607 mapwrite 0x03b239 thru 0x03da60 (0x2828 bytes) 000440 1786003667.200982 trunc from 0x040000 to 0x00107e (0x3ef81 bytes) 000441 1786003667.238864 trunc from 0x00107f to 0x02fa7a (0x2e9fc bytes) 000442 1786003667.256521 write 0x0000e7 thru 0x0023f0 (0x230a bytes) 000443 1786003667.277208 fallocate 0x02d288 thru 0x039e64 (0xcbdd bytes) 000444 1786003667.287952 read 0x0235aa thru 0x028b8e (0x55e5 bytes) 000446 1786003667.304115 MIRROR_RESYNC 3 mirrors 000447 1786003668.287449 punch from 0x01c11a to 0x02236e (0x6255 bytes) 000448 1786003668.396747 mapread 0x005c37 thru 0x00ca22 (0x6dec bytes) 000450 1786003668.436013 mapread 0x02e851 thru 0x035cf8 (0x74a8 bytes) 000451 1786003668.450558 fallocate 0x02bcd9 thru 0x0322d9 (0x6601 bytes) 000452 1786003668.456337 mapwrite 0x036b02 thru 0x03b2b3 (0x47b2 bytes) 000453 1786003668.573872 mapread 0x01bafc thru 0x027ede (0xc3e3 bytes) 000454 1786003668.613492 mapwrite 0x007c3d thru 0x0112aa (0x966e bytes) 000455 1786003668.657678 read 0x02750d thru 0x02855a (0x104e bytes) 000456 1786003668.658748 trunc from 0x02e7c7 to 0x031bdf (0x3419 bytes) 000457 1786003668.669688 write 0x025bd3 thru 0x030020 (0xa44e bytes) 000458 1786003668.679975 trunc from 0x03b2b4 to 0x03c1b5 (0xf02 bytes) 000460 1786003668.702736 trunc from 0x020001 to 0x02994d (0x994d bytes) 000463 1786003668.753115 read 0x022cbc thru 0x023efd (0x1242 bytes) 000464 1786003668.790348 write 0x03cf3c thru 0x03ffff (0x30c4 bytes) 000465 1786003668.791632 mapwrite 0x008840 thru 0x009a32 (0x11f3 bytes) 000468 1786003668.845797 read 0x01a1df thru 0x02807a (0xde9c bytes) 000469 1786003668.851230 punch from 0x0164f6 to 0x025a2e (0xf539 bytes) 000470 1786003668.876740 write 0x03c467 thru 0x03ef2f (0x2ac9 bytes) 000471 1786003668.887007 trunc from 0x040000 to 0x00ced6 (0x33129 bytes) 000472 1786003668.909005 mapwrite 0x01015f thru 0x019858 (0x96fa bytes) 000473 1786003669.000211 mapwrite 0x0155f1 thru 0x0186b8 (0x30c8 bytes) 000474 1786003669.038093 read 0x011a62 thru 0x017360 (0x58ff bytes) 000475 1786003669.038754 trunc from 0x016fce to 0x019858 (0x288b bytes) 000476 1786003669.056803 read 0x01330d thru 0x01758d (0x4281 bytes) 000477 1786003669.067249 mapwrite 0x00d678 thru 0x01ba70 (0xe3f9 bytes) 000478 1786003669.154116 write 0x01d63b thru 0x025deb (0x87b1 bytes) 000479 1786003669.157822 mapread 0x004c4c thru 0x0122c4 (0xd679 bytes) 000480 1786003669.164377 punch from 0x01b792 to 0x01fbd2 (0x4441 bytes) 000481 1786003669.186756 punch from 0x012738 to 0x01c376 (0x9c3f bytes) 000482 1786003669.193442 punch from 0x0252b7 to 0x025deb (0xb35 bytes) 000483 1786003669.215833 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25dec): Mirror 13: 0xf54ca371 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25dec): Mirror 13: 0xf54ca371 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25dec: skipped 000484 1786003669.706646 trunc from 0x025dec to 0x021834 (0x45b7 bytes) 000485 1786003669.760818 write 0x029be5 thru 0x038ad4 (0xeef0 bytes) 000486 1786003669.765877 mapwrite 0x016e35 thru 0x01f9f1 (0x8bbd bytes) 000487 1786003669.896771 mapread 0x023aea thru 0x02e090 (0xa5a7 bytes) 000488 1786003669.930835 read 0x016e67 thru 0x0266f7 (0xf891 bytes) 000489 1786003669.935652 write 0x021246 thru 0x02931d (0x80d8 bytes) 000490 1786003669.942845 mapwrite 0x03390f thru 0x03ffff (0xc6f1 bytes) 000491 1786003670.049180 trunc from 0x040000 to 0x000116 (0x3fee9 bytes) 000492 1786003670.083823 read 0x0000b8 thru 0x000116 (0x5f bytes) 000493 1786003670.091178 mapwrite 0x030219 thru 0x037456 (0x723e bytes) 000494 1786003670.213783 fallocate 0x02f646 thru 0x03c13e (0xcaf9 bytes) 000495 1786003670.221686 mapwrite 0x00517b thru 0x0137b4 (0xe63a bytes) 000496 1786003670.272709 mapwrite 0x019fed thru 0x01f3a7 (0x53bb bytes) 000497 1786003670.307226 write 0x0134ce thru 0x01d761 (0xa294 bytes) 000499 1786003670.309154 fallocate 0x031888 thru 0x03aa39 (0x91b2 bytes) 000500 1786003670.314382 read 0x032088 thru 0x03c13e (0xa0b7 bytes) 000501 1786003670.322331 punch from 0x016fa5 to 0x01ee3e (0x7e9a bytes) 000502 1786003670.348671 fallocate 0x03e69e thru 0x03ffff (0x1962 bytes) 000503 1786003670.378669 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) 000504 1786003670.578326 mapread 0x02aaad thru 0x02c336 (0x188a bytes) 000505 1786003670.600575 trunc from 0x03c13f to 0x00b794 (0x309aa bytes) 000506 1786003670.626915 mapwrite 0x01125d thru 0x01eaa6 (0xd84a bytes) 000507 1786003670.719078 mapread 0x0011aa thru 0x0031ad (0x2004 bytes) 000508 1786003670.731139 read 0x0161e9 thru 0x016b60 (0x978 bytes) 000509 1786003670.731793 trunc from 0x01eaa7 to 0x031b76 (0x130d0 bytes) 000510 1786003670.747518 trunc from 0x018085 to 0x023a42 (0xb9be bytes) 000511 1786003670.755361 punch from 0x0233ac to 0x026897 (0x34ec bytes) 000512 1786003670.759752 punch from 0x018e6a to 0x01c3c1 (0x3558 bytes) 000513 1786003670.781837 trunc from 0x031b77 to 0x02e96f (0x3207 bytes) 000514 1786003670.806137 fallocate 0x02768b thru 0x032a77 (0xb3ed bytes) 000515 1786003670.819687 punch from 0x01cfd8 to 0x02cbb1 (0xfbda bytes) 000516 1786003670.825085 punch from 0x004239 to 0x005455 (0x121d bytes) 000517 1786003670.834152 fallocate 0x03d5e7 thru 0x03fdf7 (0x2811 bytes) 000518 1786003670.843348 punch from 0x020cdb to 0x02cb89 (0xbeaf bytes) 000519 1786003670.851841 mapwrite 0x01c1b1 thru 0x02589d (0x96ed bytes) 000523 1786003670.912109 read 0x016db3 thru 0x016e91 (0xdf bytes) 000524 1786003670.912946 read 0x02aaa2 thru 0x02c64a (0x1ba9 bytes) 000525 1786003670.918902 write 0x03acb6 thru 0x03ffff (0x534a bytes) 000526 1786003670.944229 trunc from 0x040000 to 0x0179ad (0x28652 bytes) 000527 1786003670.974282 read 0x0145a9 thru 0x015e40 (0x1898 bytes) 000529 1786003670.975899 read 0x014e25 thru 0x0179ad (0x2b89 bytes) 000530 1786003670.985334 mapread 0x006b4f thru 0x00b5da (0x4a8c bytes) 000533 1786003670.992579 fallocate 0x02db43 thru 0x038d2e (0xb1ec bytes) 000534 1786003671.003357 mapread 0x0091ab thru 0x01065a (0x74b0 bytes) 000535 1786003671.006898 fallocate 0x0331b2 thru 0x03ffff (0xce4e bytes) 000536 1786003671.020332 MIRROR_EXTEND to 2 mirrors 000537 1786003672.269124 mapread 0x03756a thru 0x038d2e (0x17c5 bytes) 000538 1786003672.288304 write 0x018bee thru 0x027e96 (0xf2a9 bytes) 000540 1786003672.355191 mapread 0x036fe4 thru 0x038d2e (0x1d4b bytes) 000541 1786003672.371607 mapwrite 0x00be99 thru 0x0161b9 (0xa321 bytes) 000543 1786003672.407369 mapwrite 0x01738a thru 0x026d22 (0xf999 bytes) 000544 1786003672.463049 trunc from 0x02e654 to 0x03637c (0x7d29 bytes) 000545 1786003672.473965 mapwrite 0x024ab9 thru 0x026e9b (0x23e3 bytes) 000546 1786003672.502305 read 0x036de0 thru 0x038d2e (0x1f4f bytes) 000547 1786003672.508662 read 0x00920e thru 0x00e9dc (0x57cf bytes) 000548 1786003672.510354 trunc from 0x038d2f to 0x003964 (0x353ca bytes) 000550 1786003672.546337 punch from 0x002de6 to 0x003964 (0xb7f bytes) 000551 1786003672.550597 trunc from 0x003965 to 0x035825 (0x31ec1 bytes) 000552 1786003672.582685 fallocate 0x02253d thru 0x028277 (0x5d3b bytes) 000553 1786003672.602341 read 0x01f1ef thru 0x02a0a2 (0xaeb4 bytes) 000554 1786003672.630077 trunc from 0x000209 to 0x00b86c (0xb664 bytes) 000555 1786003672.651979 trunc from 0x035826 to 0x00f9c8 (0x25e5d bytes) 000556 1786003672.683711 punch from 0x003121 to 0x00f9c8 (0xc8a8 bytes) 000557 1786003672.692552 trunc from 0x00f9c9 to 0x019f55 (0xa58d bytes) 000558 1786003672.709138 mapwrite 0x00a087 thru 0x01697f (0xc8f9 bytes) 000559 1786003672.818524 trunc from 0x019f56 to 0x03d38e (0x23439 bytes) 000561 1786003672.843662 fallocate 0x00a823 thru 0x00b1dd (0x9bb bytes) 000562 1786003672.850464 trunc from 0x01e9e6 to 0x02b4f6 (0xcb11 bytes) 000563 1786003672.855886 trunc from 0x01c04c to 0x021daf (0x5d64 bytes) 000564 1786003672.861261 mapread 0x01b5f1 thru 0x020ab8 (0x54c8 bytes) 000565 1786003672.898687 mapwrite 0x01647d thru 0x025dab (0xf92f bytes) 000567 1786003672.975058 trunc from 0x03d38f to 0x010bce (0x2c7c0 bytes) 000568 1786003672.998811 trunc from 0x010bcf to 0x03c9e4 (0x2be16 bytes) 000569 1786003673.033934 fallocate 0x012054 thru 0x0124b8 (0x465 bytes) 000571 1786003673.050924 trunc from 0x02e88a to 0x033683 (0x4dfa bytes) 000572 1786003673.068906 punch from 0x010338 to 0x01fde0 (0xfaa9 bytes) 000573 1786003673.088306 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3c9e5): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c9e5): Mirror 2: 0x397c8f67 (stale) CRC-32 checksum value for chunk [0, 0x3c9e5): Mirror 1: 0xbc289ed2 Mirror 3: 0xbc289ed2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c9e5: skipped 000574 1786003675.085857 mapwrite 0x030170 thru 0x03ad63 (0xabf4 bytes) 000575 1786003675.366044 mapread 0x020eee thru 0x02374f (0x2862 bytes) 000576 1786003675.385403 punch from 0x031d0f to 0x036dba (0x50ac bytes) 000579 1786003675.427841 trunc from 0x03b5c5 to 0x03c9e4 (0x1420 bytes) 000580 1786003675.440848 mapwrite 0x021228 thru 0x03008a (0xee63 bytes) 000581 1786003675.531737 fallocate 0x0302bb thru 0x031a58 (0x179e bytes) 000582 1786003675.540243 mapread 0x034bca thru 0x03c9e4 (0x7e1b bytes) 000583 1786003675.554947 trunc from 0x03c9e5 to 0x0301b6 (0xc82e bytes) 000584 1786003675.610276 trunc from 0x0301b7 to 0x03fac9 (0xf913 bytes) 000585 1786003675.668879 fallocate 0x014270 thru 0x0227f8 (0xe589 bytes) 000586 1786003675.679048 trunc from 0x01b391 to 0x01f8b8 (0x4528 bytes) 000587 1786003675.715006 mapread 0x01ee10 thru 0x02e855 (0xfa46 bytes) 000588 1786003675.763828 trunc from 0x03faca to 0x01a655 (0x25474 bytes) 000589 1786003675.797520 write 0x004cdb thru 0x01122f (0xc555 bytes) 000590 1786003675.825648 punch from 0x00ff2f to 0x015ff9 (0x60cb bytes) 000591 1786003675.846245 mapwrite 0x0363ae thru 0x03791c (0x156f bytes) 000592 1786003675.875632 mapwrite 0x01d489 thru 0x026a89 (0x9601 bytes) 000593 1786003675.913662 mapread 0x00eb8c thru 0x01dfba (0xf42f bytes) 000594 1786003675.923914 fallocate 0x03aa2d thru 0x03ffff (0x55d3 bytes) 000595 1786003675.929886 punch from 0x030947 to 0x0384f8 (0x7bb2 bytes) 000596 1786003675.935738 mapwrite 0x003609 thru 0x009408 (0x5e00 bytes) 000597 1786003675.960890 mapwrite 0x013fdb thru 0x01aa1c (0x6a42 bytes) 000598 1786003675.978480 read 0x02bb0f thru 0x03a601 (0xeaf3 bytes) 000599 1786003675.992672 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x337ba99c (stale) Mirror 3: 0x7fd0bced (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd01de5fa Mirror 4: 0xd01de5fa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000600 1786003677.482689 trunc from 0x005550 to 0x00bf89 (0x6a3a bytes) 000601 1786003677.517224 write 0x001283 thru 0x00cc0a (0xb988 bytes) 000602 1786003677.527048 mapwrite 0x00b1bd thru 0x017737 (0xc57b bytes) 000604 1786003677.575393 fallocate 0x013caf thru 0x01fff2 (0xc344 bytes) 000605 1786003677.588844 trunc from 0x005c8c to 0x009b1b (0x3e90 bytes) 000606 1786003677.598407 punch from 0x01cafa to 0x01e05e (0x1565 bytes) 000607 1786003677.606007 trunc from 0x03b3bc to 0x03ffff (0x4c44 bytes) 000608 1786003677.613169 fallocate 0x001138 thru 0x010874 (0xf73d bytes) 000609 1786003677.619853 fallocate 0x0101d8 thru 0x0133ad (0x31d6 bytes) 000610 1786003677.640491 fallocate 0x00f4d6 thru 0x0163aa (0x6ed5 bytes) 000611 1786003677.676529 trunc from 0x014a5f to 0x021ee0 (0xd482 bytes) 000613 1786003677.704329 trunc from 0x009ada to 0x018e39 (0xf360 bytes) 000614 1786003677.717682 punch from 0x00f411 to 0x01bcfb (0xc8eb bytes) 000615 1786003677.750175 write 0x03f01d thru 0x03ffff (0xfe3 bytes) 000616 1786003677.764063 fallocate 0x0036ec thru 0x00f3dc (0xbcf1 bytes) 000617 1786003677.777495 mapwrite 0x02a86d thru 0x02d001 (0x2795 bytes) 000618 1786003677.843097 fallocate 0x014a1c thru 0x0233ed (0xe9d2 bytes) 000619 1786003677.850382 read 0x01f4d1 thru 0x025923 (0x6453 bytes) 000620 1786003677.860728 trunc from 0x016943 to 0x01a0f0 (0x37ae bytes) 000621 1786003677.875075 mapwrite 0x007e1b thru 0x00e967 (0x6b4d bytes) 000623 1786003677.947391 MIRROR_RESYNC 4 mirrors 000624 1786003680.092649 read 0x029724 thru 0x031ac3 (0x83a0 bytes) 000625 1786003680.104851 write 0x00271f thru 0x00469c (0x1f7e bytes) 000626 1786003680.208536 fallocate 0x003b53 thru 0x003e81 (0x32f bytes) 000627 1786003680.222614 trunc from 0x012cda to 0x017edc (0x5203 bytes) 000628 1786003680.240461 read 0x003b6c thru 0x011389 (0xd81e bytes) 000629 1786003680.256338 trunc from 0x0337c3 to 0x0391a0 (0x59de bytes) 000630 1786003680.265771 trunc from 0x023c80 to 0x02ceb7 (0x9238 bytes) 000631 1786003680.279987 write 0x03c3c9 thru 0x03c664 (0x29c bytes) 000632 1786003680.281272 trunc from 0x040000 to 0x0045b7 (0x3ba48 bytes) 000633 1786003680.356746 trunc from 0x00127d to 0x0045b7 (0x333b bytes) 000634 1786003680.378730 fallocate 0x02cf8b thru 0x02fa89 (0x2aff bytes) 000635 1786003680.403983 mapwrite 0x026803 thru 0x0344dd (0xdcdb bytes) 000636 1786003680.668785 trunc from 0x0344de to 0x012ba3 (0x2193a bytes) 000637 1786003680.691595 mapwrite 0x02c54b thru 0x038747 (0xc1fd bytes) 000638 1786003680.914570 trunc from 0x038748 to 0x0095d2 (0x2f175 bytes) 000640 1786003680.945502 write 0x01ff56 thru 0x0227cc (0x2877 bytes) 000641 1786003680.961674 mapread 0x0042c4 thru 0x00c0a7 (0x7de4 bytes) 000642 1786003681.083601 mapwrite 0x017c97 thru 0x027139 (0xf4a3 bytes) 000643 1786003681.341204 trunc from 0x02713a to 0x019d7e (0xd3bb bytes) 000644 1786003681.401672 MIRROR_RESYNC 4 mirrors 000645 1786003683.220439 trunc from 0x019d7f to 0x0326ad (0x1892f bytes) 000646 1786003683.408496 write 0x0266e7 thru 0x031a69 (0xb383 bytes) 000647 1786003683.452387 write 0x03ce90 thru 0x03ffff (0x3170 bytes) 000648 1786003683.463819 read 0x021552 thru 0x02ceb5 (0xb964 bytes) 000649 1786003683.524546 mapread 0x03af66 thru 0x03f309 (0x43a4 bytes) 000650 1786003683.582257 mapwrite 0x02a983 thru 0x037bcd (0xd24b bytes) 000651 1786003683.721614 fallocate 0x025aa1 thru 0x02da1c (0x7f7c bytes) 000652 1786003683.746219 trunc from 0x040000 to 0x036231 (0x9dce bytes) 000653 1786003683.842061 mapread 0x00172e thru 0x00f71d (0xdff0 bytes) 000654 1786003683.882211 mapread 0x030df3 thru 0x036231 (0x543f bytes) 000655 1786003683.883393 trunc from 0x005c25 to 0x011b14 (0xbef0 bytes) 000656 1786003683.903826 write 0x02efa0 thru 0x030766 (0x17c7 bytes) 000657 1786003683.905488 trunc from 0x00aaf9 to 0x0177a2 (0xccaa bytes) 000659 1786003683.917292 mapread 0x00d434 thru 0x012f38 (0x5b05 bytes) 000660 1786003683.929409 mapwrite 0x02f506 thru 0x0364d5 (0x6fd0 bytes) 000661 1786003683.964492 fallocate 0x02aec2 thru 0x02f2ba (0x43f9 bytes) 000662 1786003683.971363 read 0x00186f thru 0x0060ed (0x487f bytes) 000663 1786003683.981024 fallocate 0x01b265 thru 0x027392 (0xc12e bytes) 000664 1786003683.986215 write 0x01fe90 thru 0x02cf09 (0xd07a bytes) 000665 1786003683.997585 mapwrite 0x02ee40 thru 0x03c740 (0xd901 bytes) 000666 1786003684.065355 trunc from 0x03c741 to 0x039b5a (0x2be6 bytes) 000667 1786003684.099003 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39b5b): Mirror 2: 0x14c8fef3 (stale) Mirror 3: 0x14c8fef3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39b5b): Mirror 2: 0x14c8fef3 (stale) Mirror 3: 0x14c8fef3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39b5b: skipped 000668 1786003684.553972 read 0x00609f thru 0x00c6fc (0x665e bytes) 000669 1786003684.570664 fallocate 0x01dc96 thru 0x02371d (0x5a88 bytes) 000670 1786003684.579179 trunc from 0x039b5b to 0x03df17 (0x43bd bytes) 000671 1786003684.607679 read 0x0358b0 thru 0x03de3b (0x858c bytes) 000672 1786003684.633488 mapread 0x01b31b thru 0x022930 (0x7616 bytes) 000673 1786003684.641667 trunc from 0x036152 to 0x03d58c (0x743b bytes) 000674 1786003684.651175 fallocate 0x007d3b thru 0x0153bd (0xd683 bytes) 000675 1786003684.659015 trunc from 0x037e32 to 0x03af6a (0x3139 bytes) 000676 1786003684.664825 mapread 0x01b503 thru 0x02b314 (0xfe12 bytes) 000677 1786003684.675637 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3df18): Mirror 2: 0x5f328a77 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3df18): Mirror 2: 0x5f328a77 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3df18: skipped 000678 1786003685.064544 trunc from 0x03df18 to 0x022e35 (0x1b0e2 bytes) 000680 1786003685.102563 fallocate 0x00dd75 thru 0x015afe (0x7d8a bytes) 000681 1786003685.109141 fallocate 0x023223 thru 0x0250c9 (0x1ea7 bytes) 000682 1786003685.120654 mapread 0x000981 thru 0x00fba0 (0xf220 bytes) 000683 1786003685.164335 mapread 0x016079 thru 0x01b817 (0x579f bytes) 000684 1786003685.184781 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x22e36): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22e36): Mirror 2: 0xe1acd845 (stale) CRC-32 checksum value for chunk [0, 0x22e36): Mirror 1: 0xc37be618 Mirror 3: 0xc37be618 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22e36: skipped 000685 1786003686.446117 trunc from 0x022e36 to 0x000376 (0x22abf bytes) 000686 1786003686.546483 read 0x000275 thru 0x000376 (0x102 bytes) 000687 1786003686.552925 fallocate 0x017891 thru 0x01ac36 (0x33a6 bytes) 000688 1786003686.558312 mapwrite 0x024827 thru 0x02a86d (0x6047 bytes) 000689 1786003686.616936 trunc from 0x011171 to 0x016ba9 (0x5a39 bytes) 000691 1786003686.630881 mapread 0x026383 thru 0x02a86d (0x44eb bytes) 000693 1786003686.649087 MIRROR_RESYNC 3 mirrors 000695 1786003687.946116 punch from 0x016fad to 0x01bb03 (0x4b57 bytes) 000696 1786003688.062035 read 0x0199a0 thru 0x028d78 (0xf3d9 bytes) 000697 1786003688.085830 trunc from 0x02a86e to 0x01ebde (0xbc8f bytes) 000698 1786003688.128467 trunc from 0x01ebdf to 0x024092 (0x54b4 bytes) 000699 1786003688.198418 trunc from 0x010b74 to 0x015eff (0x538c bytes) 000700 1786003688.211531 mapwrite 0x00be7f thru 0x011d66 (0x5ee8 bytes) 000701 1786003688.309798 trunc from 0x024093 to 0x00858a (0x1bb08 bytes) 000702 1786003688.369933 mapread 0x005654 thru 0x00858a (0x2f37 bytes) 000703 1786003688.387976 read 0x000778 thru 0x00858a (0x7e13 bytes) 000704 1786003688.403100 trunc from 0x00858b to 0x0175f4 (0xf06a bytes) 000705 1786003688.450750 fallocate 0x01342f thru 0x01bbc0 (0x8792 bytes) 000706 1786003688.461477 write 0x03ae12 thru 0x03ffff (0x51ee bytes) 000707 1786003688.498069 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x6ab6480b (stale) Mirror 3: 0x6ab6480b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf3ad90c9 Mirror 4: 0xf3ad90c9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000708 1786003689.818402 mapread 0x0300ca thru 0x03ff67 (0xfe9e bytes) 000709 1786003689.863955 read 0x01472c thru 0x023419 (0xecee bytes) 000710 1786003689.891967 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x6ab6480b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x6ab6480b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf3ad90c9 Mirror 4: 0xf3ad90c9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000711 1786003690.980395 mapread 0x007fc9 thru 0x00fd83 (0x7dbb bytes) 000712 1786003691.045021 fallocate 0x038e19 thru 0x03d0df (0x42c7 bytes) 000714 1786003691.140935 trunc from 0x031f85 to 0x0360b1 (0x412d bytes) 000715 1786003691.153168 mapread 0x002ead thru 0x00a7cc (0x7920 bytes) 000716 1786003691.184157 fallocate 0x01b4db thru 0x0250e9 (0x9c0f bytes) 000718 1786003691.204055 mapwrite 0x005291 thru 0x00ddbd (0x8b2d bytes) 000719 1786003691.280129 MIRROR_RESYNC 3 mirrors 000720 1786003693.132002 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) 000721 1786003694.074411 trunc from 0x040000 to 0x010425 (0x2fbda bytes) 000723 1786003694.198675 write 0x01155b thru 0x0210a4 (0xfb4a bytes) 000724 1786003694.210907 trunc from 0x0210a5 to 0x0199fd (0x76a7 bytes) 000726 1786003694.262057 punch from 0x005aa1 to 0x0123ea (0xc94a bytes) 000727 1786003694.299535 fallocate 0x038b20 thru 0x03d9ea (0x4ecb bytes) 000729 1786003694.330424 write 0x030cae thru 0x035c40 (0x4f93 bytes) 000730 1786003694.362623 fallocate 0x034fac thru 0x03c70b (0x7760 bytes) 000731 1786003694.369326 write 0x01ca26 thru 0x02b36e (0xe949 bytes) 000732 1786003694.426947 punch from 0x025997 to 0x02d56f (0x7bd9 bytes) 000733 1786003694.476827 mapwrite 0x00709d thru 0x009c9a (0x2bfe bytes) 000734 1786003694.564663 read 0x039468 thru 0x0394cd (0x66 bytes) 000735 1786003694.577003 mapwrite 0x006fb6 thru 0x00aea2 (0x3eed bytes) 000736 1786003694.612617 punch from 0x00e3d6 to 0x019d50 (0xb97b bytes) 000737 1786003694.626835 mapwrite 0x013e04 thru 0x018b23 (0x4d20 bytes) 000738 1786003694.716971 trunc from 0x00a54b to 0x010387 (0x5e3d bytes) 000739 1786003694.739292 mapread 0x03b2c1 thru 0x03d9ea (0x272a bytes) 000740 1786003694.775348 write 0x00c019 thru 0x01b39a (0xf382 bytes) 000741 1786003694.798767 fallocate 0x031620 thru 0x0329ba (0x139b bytes) 000744 1786003694.808908 punch from 0x02710c to 0x0314bb (0xa3b0 bytes) 000745 1786003694.816203 mapread 0x037288 thru 0x03d9ea (0x6763 bytes) 000746 1786003694.818326 fallocate 0x035d2d thru 0x038912 (0x2be6 bytes) 000747 1786003694.833424 mapwrite 0x001b85 thru 0x00c4f1 (0xa96d bytes) 000748 1786003694.905608 punch from 0x02db9f to 0x02f1d6 (0x1638 bytes) 000749 1786003694.919264 write 0x02f435 thru 0x03724e (0x7e1a bytes) 000750 1786003694.947575 mapwrite 0x02bb45 thru 0x03ac91 (0xf14d bytes) 000751 1786003695.073417 trunc from 0x00e82c to 0x012c1b (0x43f0 bytes) 000752 1786003695.114143 write 0x03bb16 thru 0x03ffff (0x44ea bytes) 000754 1786003695.145919 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe74d915 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9117558a Mirror 5: 0x9117558a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000755 1786003697.012046 trunc from 0x040000 to 0x010e44 (0x2f1bb bytes) 000757 1786003697.113916 punch from 0x00747a to 0x010e44 (0x99cb bytes) 000758 1786003697.128045 trunc from 0x010e45 to 0x03205e (0x2121a bytes) 000759 1786003697.170294 punch from 0x018594 to 0x02148e (0x8efb bytes) 000760 1786003697.189305 fallocate 0x0313d5 thru 0x03ae2d (0x9a59 bytes) 000761 1786003697.205098 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3205f): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3205f): Mirror 4: 0x5e2edd17 (stale) Mirror 5: 0xff4f54a6 (stale) CRC-32 checksum value for chunk [0, 0x3205f): Mirror 1: 0x36bab313 Mirror 6: 0x36bab313 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3205f: skipped 000762 1786003698.815292 mapread 0x0187eb thru 0x01a144 (0x195a bytes) 000763 1786003698.874417 trunc from 0x03205f to 0x00b405 (0x26c59 bytes) 000764 1786003698.994254 trunc from 0x00b406 to 0x014fde (0x9bd9 bytes) 000765 1786003699.029878 punch from 0x0060da to 0x00621c (0x143 bytes) 000766 1786003699.040815 trunc from 0x003c86 to 0x003f46 (0x2c1 bytes) 000767 1786003699.053076 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x14fdf): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14fdf): Mirror 4: 0x9158eeb6 (stale) Mirror 5: 0xf30d0381 (stale) Mirror 6: 0x6db644ca (stale) CRC-32 checksum value for chunk [0, 0x14fdf): Mirror 1: 0x1e5955c3 Mirror 7: 0x1e5955c3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14fdf: skipped 000768 1786003700.659830 mapwrite 0x0384d6 thru 0x039cb7 (0x17e2 bytes) 000769 1786003700.864030 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x39cb8): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39cb8): Mirror 4: 0xfedddd8d (stale) Mirror 5: 0x7a13e300 (stale) Mirror 6: 0x87b1392c (stale) Mirror 7: 0x6720bf2a (stale) CRC-32 checksum value for chunk [0, 0x39cb8): Mirror 1: 0xb5bcc4fe Mirror 8: 0xb5bcc4fe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39cb8: skipped 000770 1786003702.620876 mapwrite 0x016f0c thru 0x022856 (0xb94b bytes) 000771 1786003702.791282 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39cb8): Mirror 5: 0x7a13e300 (stale) Mirror 6: 0x87b1392c (stale) Mirror 7: 0x6720bf2a (stale) Mirror 8: 0xb5bcc4fe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39cb8): Mirror 5: 0x7a13e300 (stale) Mirror 6: 0x87b1392c (stale) Mirror 7: 0x6720bf2a (stale) Mirror 8: 0xb5bcc4fe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39cb8: skipped 000772 1786003703.240424 mapwrite 0x01c0ad thru 0x02c097 (0xffeb bytes) 000773 1786003703.290357 mapwrite 0x02601a thru 0x02b13c (0x5123 bytes) 000774 1786003703.309498 punch from 0x0175e3 to 0x0203a9 (0x8dc7 bytes) 000775 1786003703.315240 write 0x02062a thru 0x02f64b (0xf022 bytes) 000776 1786003703.324735 trunc from 0x039cb8 to 0x019e09 (0x1feae bytes) 000777 1786003703.337168 punch from 0x00bbaa to 0x00ffe3 (0x443a bytes) 000778 1786003703.342318 trunc from 0x005893 to 0x0099e5 (0x4153 bytes) 000779 1786003703.351256 MIRROR_RESYNC 5 mirrors 000780 1786003704.433211 mapread 0x00d3e6 thru 0x013356 (0x5f71 bytes) 000781 1786003704.452022 trunc from 0x019e0a to 0x005b83 (0x14286 bytes) 000782 1786003704.488834 punch from 0x002a80 to 0x005b83 (0x3104 bytes) 000783 1786003704.496812 trunc from 0x0003fc to 0x005b83 (0x5788 bytes) 000784 1786003704.503219 trunc from 0x005b84 to 0x0233c3 (0x1d840 bytes) 000785 1786003704.530824 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x233c4): Mirror 5: 0xe300a3cf (stale) Mirror 7: 0xe300a3cf (stale) Mirror 8: 0xe300a3cf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x233c4): Mirror 5: 0xe300a3cf (stale) Mirror 7: 0xe300a3cf (stale) Mirror 8: 0xe300a3cf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x233c4: skipped 000786 1786003704.847687 fallocate 0x014bec thru 0x019044 (0x4459 bytes) 000787 1786003704.858753 MIRROR_RESYNC 4 mirrors 000788 1786003705.971486 trunc from 0x0233c4 to 0x0104c1 (0x12f02 bytes) 000789 1786003706.075652 punch from 0x008b85 to 0x00e0b3 (0x552f bytes) 000790 1786003706.083237 fallocate 0x03fe3c thru 0x03ffff (0x1c4 bytes) 000791 1786003706.088676 mapread 0x00893f thru 0x018768 (0xfe2a bytes) 000792 1786003706.153755 fallocate 0x0342ea thru 0x03cd85 (0x8a9c bytes) 000793 1786003706.161190 write 0x01f397 thru 0x027d05 (0x896f bytes) 000794 1786003706.175612 mapread 0x024d5f thru 0x029795 (0x4a37 bytes) 000795 1786003706.206653 mapread 0x020d71 thru 0x024942 (0x3bd2 bytes) 000797 1786003706.214319 mapwrite 0x039326 thru 0x03b428 (0x2103 bytes) 000798 1786003706.278745 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x33d66b23 (stale) Mirror 7: 0x33d66b23 (stale) Mirror 8: 0x33d66b23 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xad72f25c Mirror 9: 0xad72f25c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000799 1786003707.415385 mapread 0x0079de thru 0x0135ee (0xbc11 bytes) 000800 1786003707.525278 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x33d66b23 (stale) Mirror 8: 0x33d66b23 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x33d66b23 (stale) Mirror 8: 0x33d66b23 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xad72f25c Mirror 9: 0xad72f25c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000802 1786003708.321183 trunc from 0x040000 to 0x0294a7 (0x16b58 bytes) 000804 1786003708.460067 mapread 0x01c7bc thru 0x01ec24 (0x2469 bytes) 000805 1786003708.495945 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x294a8): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x294a8): Mirror 5: 0x851934ee (stale) Mirror 8: 0x851934ee (stale) Mirror 9: 0xdf256bad (stale) CRC-32 checksum value for chunk [0, 0x294a8): Mirror 1: 0xdf256bad Mirror 10: 0xdf256bad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x294a8: skipped 000806 1786003709.906037 write 0x0362e5 thru 0x03ffff (0x9d1b bytes) 000807 1786003709.943963 trunc from 0x040000 to 0x02e255 (0x11daa bytes) 000808 1786003709.966061 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e256): Mirror 5: 0x1bd8b1ae (stale) Mirror 9: 0xec2d101f (stale) Mirror 10: 0xec2d101f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e256): Mirror 5: 0x1bd8b1ae (stale) Mirror 9: 0xec2d101f (stale) Mirror 10: 0xec2d101f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e256: skipped 000809 1786003710.312771 punch from 0x02098a to 0x02be03 (0xb47a bytes) 000810 1786003710.319421 punch from 0x006fa2 to 0x00e0a4 (0x7103 bytes) 000811 1786003710.333401 trunc from 0x02e256 to 0x02abbe (0x3697 bytes) 000812 1786003710.357380 trunc from 0x008aa0 to 0x00f273 (0x67d4 bytes) 000813 1786003710.367918 write 0x03130f thru 0x035a21 (0x4713 bytes) 000814 1786003710.387885 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x35a22): Mirror 5: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35a22): Mirror 5: 0xfe143eba (stale) Mirror 9: 0x85485c5b (stale) Mirror 10: 0x85485c5b (stale) CRC-32 checksum value for chunk [0, 0x35a22): Mirror 1: 0xeb9d0632 Mirror 11: 0xeb9d0632 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35a22: skipped 000815 1786003712.152855 mapread 0x000a50 thru 0x00be0f (0xb3c0 bytes) 000816 1786003712.232259 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x35a22): Mirror 5: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35a22): Mirror 5: 0xfe143eba (stale) Mirror 9: 0x85485c5b (stale) Mirror 10: 0x85485c5b (stale) CRC-32 checksum value for chunk [0, 0x35a22): Mirror 1: 0xeb9d0632 Mirror 11: 0xeb9d0632 Mirror 12: 0xeb9d0632 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35a22: skipped 000817 1786003713.848434 punch from 0x0271b3 to 0x02c819 (0x5667 bytes) 000818 1786003713.940057 trunc from 0x031a1e to 0x03267a (0xc5d bytes) 000819 1786003713.955049 punch from 0x009f58 to 0x00bf27 (0x1fd0 bytes) 000820 1786003713.962616 fallocate 0x030cb9 thru 0x033bb8 (0x2f00 bytes) 000821 1786003713.974498 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x35a22): Mirror 5: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35a22): Mirror 5: 0xfe143eba (stale) Mirror 9: 0x85485c5b (stale) Mirror 10: 0x85485c5b (stale) Mirror 11: 0xeb9d0632 (stale) Mirror 12: 0xeb9d0632 (stale) CRC-32 checksum value for chunk [0, 0x35a22): Mirror 1: 0x8e3c5ab Mirror 13: 0x8e3c5ab lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35a22: skipped 000822 1786003716.424509 mapwrite 0x038b12 thru 0x03ffff (0x74ee bytes) 000823 1786003716.643470 trunc from 0x02897e to 0x036abf (0xe142 bytes) 000824 1786003716.653435 punch from 0x015491 to 0x01e9d7 (0x9547 bytes) 000825 1786003716.665424 mapread 0x0029b6 thru 0x005b69 (0x31b4 bytes) 000826 1786003716.698075 fallocate 0x0342d3 thru 0x03b948 (0x7676 bytes) 000827 1786003716.738603 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x33d66b23 (stale) Mirror 9: 0xad72f25c (stale) Mirror 11: 0x8a9cb6d2 (stale) Mirror 12: 0x8a9cb6d2 (stale) Mirror 13: 0x2b96abf3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x33d66b23 (stale) Mirror 9: 0xad72f25c (stale) Mirror 11: 0x8a9cb6d2 (stale) Mirror 12: 0x8a9cb6d2 (stale) Mirror 13: 0x2b96abf3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000828 1786003717.276105 fallocate 0x006da1 thru 0x00b261 (0x44c1 bytes) 000829 1786003717.282836 punch from 0x03ff64 to 0x03ffff (0x9c bytes) 000830 1786003717.288161 read 0x001960 thru 0x009519 (0x7bba bytes) 000831 1786003717.297440 punch from 0x011c5a to 0x0196f0 (0x7a97 bytes) 000832 1786003717.303815 trunc from 0x040000 to 0x0088fc (0x37703 bytes) 000833 1786003717.326426 mapwrite 0x02f4a6 thru 0x03f47f (0xffda bytes) 000834 1786003717.392452 read 0x00b059 thru 0x0180d7 (0xd07f bytes) 000835 1786003717.404645 trunc from 0x02c25a to 0x02cc91 (0xa38 bytes) 000836 1786003717.415264 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f480): Mirror 9: 0xba552698 (stale) Mirror 11: 0x97fd3cab (stale) Mirror 12: 0x97fd3cab (stale) Mirror 13: 0x845b05d0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f480): Mirror 9: 0xba552698 (stale) Mirror 11: 0x97fd3cab (stale) Mirror 12: 0x97fd3cab (stale) Mirror 13: 0x845b05d0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f480: skipped 000837 1786003718.185661 punch from 0x027a76 to 0x02ef35 (0x74c0 bytes) 000838 1786003718.204304 MIRROR_RESYNC 5 mirrors 000839 1786003720.477359 mapwrite 0x001331 thru 0x00456f (0x323f bytes) 000840 1786003720.663520 write 0x010a16 thru 0x01c962 (0xbf4d bytes) 000841 1786003720.683537 trunc from 0x034581 to 0x03f47f (0xaeff bytes) 000842 1786003720.691661 mapwrite 0x0036f5 thru 0x004b8c (0x1498 bytes) 000843 1786003720.738493 fallocate 0x011272 thru 0x02113d (0xfecc bytes) 000844 1786003720.748859 fallocate 0x01392a thru 0x013edc (0x5b3 bytes) 000845 1786003720.766039 fallocate 0x01f071 thru 0x0298fb (0xa88b bytes) 000846 1786003720.773099 trunc from 0x0318c1 to 0x03f47f (0xdbbf bytes) 000847 1786003720.778294 fallocate 0x035d90 thru 0x03ee92 (0x9103 bytes) 000848 1786003720.793743 MIRROR_RESYNC 5 mirrors 000849 1786003722.793124 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) 000850 1786003723.178380 fallocate 0x00de6a thru 0x016357 (0x84ee bytes) 000851 1786003723.246393 write 0x01a268 thru 0x0208af (0x6648 bytes) 000852 1786003723.261634 trunc from 0x03f480 to 0x00fdbb (0x2f6c4 bytes) 000853 1786003723.287744 write 0x007d4d thru 0x00c543 (0x47f7 bytes) 000855 1786003723.300346 read 0x000f7d thru 0x009823 (0x88a7 bytes) 000856 1786003723.311034 read 0x00f565 thru 0x00fdbb (0x857 bytes) 000858 1786003723.318253 mapread 0x00c256 thru 0x00fdbb (0x3b66 bytes) 000859 1786003723.319392 fallocate 0x02b207 thru 0x032cee (0x7ae8 bytes) 000860 1786003723.330052 MIRROR_RESYNC 4 mirrors 000861 1786003724.441185 write 0x03a602 thru 0x03ffff (0x59fe bytes) 000862 1786003724.511349 mapwrite 0x00223c thru 0x007492 (0x5257 bytes) 000863 1786003724.587352 punch from 0x013e69 to 0x017b60 (0x3cf8 bytes) 000864 1786003724.593468 trunc from 0x040000 to 0x0051cb (0x3ae34 bytes) 000867 1786003724.654468 MIRROR_RESYNC 4 mirrors 000868 1786003725.774527 MIRROR_EXTEND to 5 mirrors 000869 1786003726.632057 trunc from 0x0038c2 to 0x0051cb (0x190a bytes) 000870 1786003726.696555 mapread 0x002a81 thru 0x0051cb (0x274b bytes) 000871 1786003726.725295 trunc from 0x0051cc to 0x01ffc0 (0x1adf5 bytes) 000872 1786003726.781289 write 0x030c9e thru 0x03a9be (0x9d21 bytes) 000873 1786003726.787806 mapread 0x022cb9 thru 0x02348e (0x7d6 bytes) 000874 1786003726.800585 trunc from 0x007752 to 0x00e733 (0x6fe2 bytes) 000875 1786003726.814598 read 0x038baa thru 0x03a9be (0x1e15 bytes) 000876 1786003726.822997 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a9bf): Mirror 12: 0x4e08be2b (stale) Mirror 13: 0x4e08be2b (stale) Mirror 14: 0x4e08be2b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a9bf): Mirror 12: 0x4e08be2b (stale) Mirror 13: 0x4e08be2b (stale) Mirror 14: 0x4e08be2b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a9bf: skipped 000877 1786003727.298788 fallocate 0x01a2d2 thru 0x022e2a (0x8b59 bytes) 000878 1786003727.305760 trunc from 0x02d2f9 to 0x032e4f (0x5b57 bytes) 000879 1786003727.320741 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a9bf): Mirror 13: 0x4e08be2b (stale) Mirror 14: 0x4e08be2b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a9bf): Mirror 13: 0x4e08be2b (stale) Mirror 14: 0x4e08be2b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a9bf: skipped 000880 1786003727.611409 mapwrite 0x00477b thru 0x010df5 (0xc67b bytes) 000881 1786003727.667347 fallocate 0x012b9d thru 0x01342d (0x891 bytes) 000882 1786003727.674901 mapread 0x03670a thru 0x03a9be (0x42b5 bytes) 000883 1786003727.694332 trunc from 0x03a9bf to 0x03e7ce (0x3e10 bytes) 000884 1786003727.723670 fallocate 0x01538b thru 0x01c30d (0x6f83 bytes) 000885 1786003727.734892 read 0x0329d7 thru 0x034166 (0x1790 bytes) 000886 1786003727.742114 MIRROR_RESYNC 3 mirrors 000887 1786003728.955751 read 0x01ce78 thru 0x028944 (0xbacd bytes) 000888 1786003728.968791 mapread 0x02b58f thru 0x02e783 (0x31f5 bytes) 000889 1786003729.016076 fallocate 0x02040e thru 0x02d90e (0xd501 bytes) 000890 1786003729.066519 punch from 0x00d882 to 0x015ef0 (0x866f bytes) 000891 1786003729.073225 trunc from 0x03e7cf to 0x038858 (0x5f76 bytes) 000892 1786003729.103001 trunc from 0x038859 to 0x01b27d (0x1d5db bytes) 000894 1786003729.126202 trunc from 0x017afe to 0x01b27d (0x3780 bytes) 000895 1786003729.133584 mapwrite 0x036032 thru 0x03ffff (0x9fce bytes) 000896 1786003729.203244 punch from 0x002cb2 to 0x00ba9f (0x8dee bytes) 000897 1786003729.216252 mapwrite 0x006d3e thru 0x008314 (0x15d7 bytes) 000899 1786003729.274252 trunc from 0x02773c to 0x030ce1 (0x95a6 bytes) 000900 1786003729.281252 read 0x0037d0 thru 0x008280 (0x4ab1 bytes) 000901 1786003729.283299 mapwrite 0x02d82c thru 0x0380c3 (0xa898 bytes) 000902 1786003729.342121 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xfcb32b2a (stale) Mirror 14: 0xfcb32b2a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1d8172e3 Mirror 15: 0x1d8172e3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000903 1786003730.706469 read 0x02d67d thru 0x030f36 (0x38ba bytes) 000904 1786003730.718391 trunc from 0x022cf3 to 0x0274cd (0x47db bytes) 000905 1786003730.792586 punch from 0x0170a0 to 0x01d18b (0x60ec bytes) 000906 1786003730.798904 trunc from 0x0384ed to 0x03a215 (0x1d29 bytes) 000907 1786003730.809573 MIRROR_RESYNC 4 mirrors 000908 1786003732.358090 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) 000909 1786003732.935000 mapread 0x012bae thru 0x016fa0 (0x43f3 bytes) 000910 1786003732.953322 fallocate 0x036802 thru 0x0396c3 (0x2ec2 bytes) 000911 1786003733.004622 punch from 0x03c432 to 0x03ffff (0x3bce bytes) 000912 1786003733.009207 trunc from 0x040000 to 0x0052ce (0x3ad31 bytes) 000913 1786003733.032355 punch from 0x0049b0 to 0x0052ce (0x91f bytes) 000914 1786003733.037418 fallocate 0x0300d7 thru 0x0377cd (0x76f7 bytes) 000915 1786003733.042890 mapread 0x03516b thru 0x0377cd (0x2663 bytes) 000916 1786003733.053434 punch from 0x003e85 to 0x005be5 (0x1d61 bytes) 000917 1786003733.059064 trunc from 0x00d062 to 0x00fd01 (0x2ca0 bytes) 000918 1786003733.064080 read 0x00c95d thru 0x016ff8 (0xa69c bytes) 000919 1786003733.077423 write 0x015441 thru 0x0216ff (0xc2bf bytes) 000920 1786003733.084061 trunc from 0x008b6b to 0x01707b (0xe511 bytes) 000922 1786003733.100037 fallocate 0x03d2c3 thru 0x03ffff (0x2d3d bytes) 000923 1786003733.105799 write 0x014f25 thru 0x01c31a (0x73f6 bytes) 000924 1786003733.116872 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x377ce): Mirror 13: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x377ce): Mirror 13: 0xd4e00b11 (stale) Mirror 15: 0xd4e00b11 (stale) CRC-32 checksum value for chunk [0, 0x377ce): Mirror 1: 0x693b1b8c Mirror 16: 0x693b1b8c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x377ce: skipped 000925 1786003734.174999 read 0x01b615 thru 0x024756 (0x9142 bytes) 000926 1786003734.195207 write 0x02dfdc thru 0x02ed83 (0xda8 bytes) 000927 1786003734.307386 trunc from 0x0377ce to 0x024e8b (0x12942 bytes) 000928 1786003734.427634 write 0x007995 thru 0x0156d8 (0xdd44 bytes) 000929 1786003734.469847 write 0x02df0e thru 0x035c20 (0x7d13 bytes) 000930 1786003734.479967 MIRROR_RESYNC 4 mirrors 000931 1786003736.197057 read 0x0334b2 thru 0x035c20 (0x276f bytes) 000932 1786003736.206942 mapwrite 0x0282fc thru 0x035f8c (0xdc91 bytes) 000933 1786003736.398744 fallocate 0x014d84 thru 0x01d759 (0x89d6 bytes) 000934 1786003736.408797 fallocate 0x028391 thru 0x02f88c (0x74fc bytes) 000935 1786003736.425079 write 0x02ba00 thru 0x030001 (0x4602 bytes) 000936 1786003736.426585 punch from 0x0002c8 to 0x00c8c1 (0xc5fa bytes) 000937 1786003736.441174 punch from 0x022605 to 0x027975 (0x5371 bytes) 000938 1786003736.451495 fallocate 0x02ce36 thru 0x0360c1 (0x928c bytes) 000939 1786003736.463783 punch from 0x0339cd to 0x0360c1 (0x26f5 bytes) 000940 1786003736.476381 read 0x019435 thru 0x020ca3 (0x786f bytes) 000941 1786003736.511412 mapread 0x02c286 thru 0x035c64 (0x99df bytes) 000942 1786003736.517174 trunc from 0x0360c2 to 0x01b753 (0x1a96e bytes) 000943 1786003736.549791 trunc from 0x01b754 to 0x02203b (0x68e8 bytes) 000944 1786003736.583804 fallocate 0x016d61 thru 0x01a2b8 (0x3558 bytes) 000945 1786003736.597149 mapread 0x0103ee thru 0x01b272 (0xae85 bytes) 000946 1786003736.606800 trunc from 0x02203c to 0x011884 (0x107b7 bytes) 000947 1786003736.634510 trunc from 0x011885 to 0x000039 (0x1184b bytes) 000948 1786003736.660151 trunc from 0x000005 to 0x000039 (0x35 bytes) 000950 1786003736.693639 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a): Mirror 15: 0xc6de621c (stale) Mirror 16: 0xc6de621c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a): Mirror 15: 0xc6de621c (stale) Mirror 16: 0xc6de621c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a: skipped 000951 1786003737.118600 fallocate 0x02af03 thru 0x032730 (0x782e bytes) 000952 1786003737.126741 read 0x0014f6 thru 0x00d559 (0xc064 bytes) 000953 1786003737.141331 mapwrite 0x0322a2 thru 0x03d342 (0xb0a1 bytes) 000954 1786003737.266251 trunc from 0x02a3e2 to 0x03711e (0xcd3d bytes) 000955 1786003737.272200 trunc from 0x03d343 to 0x031d74 (0xb5ce bytes) 000956 1786003737.309803 fallocate 0x03bd4b thru 0x03ffff (0x42b5 bytes) 000957 1786003737.317611 trunc from 0x031d75 to 0x039b4a (0x7dd6 bytes) 000958 1786003737.342067 mapread 0x021af3 thru 0x029aed (0x7ffb bytes) 000959 1786003737.360071 mapwrite 0x007ded thru 0x015fc4 (0xe1d8 bytes) 000960 1786003737.404797 trunc from 0x039b4b to 0x000938 (0x39212 bytes) 000961 1786003737.427435 read 0x00081f thru 0x000938 (0x11a bytes) 000962 1786003737.437113 mapread 0x000771 thru 0x000938 (0x1c8 bytes) 000963 1786003737.439208 fallocate 0x02b156 thru 0x02b6e3 (0x58e bytes) 000964 1786003737.447887 write 0x02ff43 thru 0x030927 (0x9e5 bytes) 000965 1786003737.450645 mapread 0x008b9a thru 0x00ac96 (0x20fd bytes) 000966 1786003737.465643 mapwrite 0x037f2d thru 0x03ffff (0x80d3 bytes) 000967 1786003737.523632 punch from 0x009828 to 0x019786 (0xff5f bytes) 000968 1786003737.530190 trunc from 0x01ba38 to 0x02467e (0x8c47 bytes) 000971 1786003737.540410 fallocate 0x03fd96 thru 0x03ffff (0x26a bytes) 000972 1786003737.547625 trunc from 0x040000 to 0x01a065 (0x25f9a bytes) 000973 1786003737.566743 trunc from 0x01a066 to 0x0093c1 (0x10ca4 bytes) 000974 1786003737.588584 trunc from 0x0003f0 to 0x0093c1 (0x8fd2 bytes) 000975 1786003737.601555 punch from 0x003972 to 0x0093c1 (0x5a50 bytes) 000976 1786003737.607450 read 0x00723e thru 0x0093c1 (0x2184 bytes) 000977 1786003737.622012 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x93c2): Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x93c2): Mirror 15: 0xc6471f18 (stale) Mirror 16: 0xc6471f18 (stale) CRC-32 checksum value for chunk [0, 0x93c2): Mirror 1: 0x6a9fa989 Mirror 17: 0x6a9fa989 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x93c2: skipped 000978 1786003738.860921 trunc from 0x005443 to 0x0093c1 (0x3f7f bytes) 000979 1786003738.908194 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x93c2): Mirror 15: 0xc6471f18 (stale) Mirror 17: 0x6a9fa989 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x93c2): Mirror 15: 0xc6471f18 (stale) Mirror 17: 0x6a9fa989 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x93c2: skipped 000980 1786003739.389989 fallocate 0x021c66 thru 0x029877 (0x7c12 bytes) 000982 1786003739.414959 trunc from 0x00318c to 0x0093c1 (0x6236 bytes) 000983 1786003739.429008 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x93c2): Mirror 15: 0xc6471f18 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x93c2): Mirror 15: 0xc6471f18 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x93c2: skipped 000984 1786003739.762118 trunc from 0x0093c2 to 0x02f304 (0x25f43 bytes) 000985 1786003739.789489 trunc from 0x02f305 to 0x03b515 (0xc211 bytes) 000986 1786003739.806954 mapwrite 0x01df57 thru 0x022579 (0x4623 bytes) 000987 1786003739.846645 read 0x0053e5 thru 0x010e4b (0xba67 bytes) 000988 1786003739.857983 mapwrite 0x019301 thru 0x01d893 (0x4593 bytes) 000989 1786003739.876573 write 0x03e193 thru 0x03ffff (0x1e6d bytes) 000990 1786003739.882932 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1d:0x0]: Invalid argument (22) 000991 1786003740.036370 punch from 0x0157f4 to 0x0245b5 (0xedc2 bytes) 000992 1786003740.042740 write 0x00e249 thru 0x0167f8 (0x85b0 bytes) 000993 1786003740.072301 mapread 0x01cc2a thru 0x02c934 (0xfd0b bytes) 000995 1786003740.117160 punch from 0x00d7a4 to 0x01af37 (0xd794 bytes) 000996 1786003740.143458 punch from 0x01a9c4 to 0x01d882 (0x2ebf bytes) 000997 1786003740.149479 write 0x0083d4 thru 0x011bce (0x97fb bytes) 000998 1786003740.162876 write 0x00c81c thru 0x017ef3 (0xb6d8 bytes) 000999 1786003740.172595 fallocate 0x0095af thru 0x013cb1 (0xa703 bytes) 001000 1786003740.182165 fallocate 0x0060f9 thru 0x00b018 (0x4f20 bytes) All operations completed A-OK!