== sanity-flr test 70a: flr mode fsx test ================ 00:35:48 (1781238948) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 8950 000001 1781238951.007330 write 0x015c1a thru 0x01f685 (0x9a6c bytes) zero_range to largest ever: 0xac57 000004 1781238951.026083 trunc from 0x0042ab to 0x00ac56 (0x69ac bytes) zero_range to largest ever: 0x1f686 000005 1781238951.032180 trunc from 0x013fae to 0x01f685 (0xb6d8 bytes) 000006 1781238951.050078 read 0x01972c thru 0x01e20d (0x4ae2 bytes) 000007 1781238951.064895 trunc from 0x01496f to 0x01adf4 (0x6486 bytes) 000008 1781238951.075028 fallocate 0x00729e thru 0x010d46 (0x9aa9 bytes) 000010 1781238951.105400 mapread 0x01ebc7 thru 0x01f685 (0xabf bytes) 000011 1781238951.115498 mapwrite 0x03e265 thru 0x03ffff (0x1d9b bytes) 000012 1781238951.165130 write 0x02c59c thru 0x031cd4 (0x5739 bytes) 000014 1781238951.181905 write 0x008709 thru 0x017921 (0xf219 bytes) zero_range to largest ever: 0x245f7 000015 1781238951.202189 trunc from 0x01b51c to 0x0245f6 (0x90db bytes) 000016 1781238951.211063 mapwrite 0x0208f7 thru 0x02d3c8 (0xcad2 bytes) fallocating to largest ever: 0x40000 000017 1781238951.253018 fallocate 0x034a92 thru 0x03ffff (0xb56e bytes) 000018 1781238951.261378 mapwrite 0x0118d5 thru 0x01373b (0x1e67 bytes) 000019 1781238951.277933 write 0x031f04 thru 0x032f91 (0x108e bytes) 000020 1781238951.279833 mapread 0x026174 thru 0x02ab4c (0x49d9 bytes) 000021 1781238951.283868 read 0x03ad96 thru 0x03e20e (0x3479 bytes) 000023 1781238951.286118 trunc from 0x040000 to 0x00a629 (0x359d6 bytes) 000024 1781238951.309995 read 0x0072a6 thru 0x009b8e (0x28e9 bytes) 000025 1781238951.311827 write 0x00bacd thru 0x00cda2 (0x12d6 bytes) 000026 1781238951.315102 trunc from 0x0038f9 to 0x00671e (0x2e26 bytes) 000027 1781238951.327509 MIRROR_EXTEND to 2 mirrors 000029 1781238952.012092 read 0x00cb7f thru 0x00cda2 (0x224 bytes) 000030 1781238952.016040 read 0x00166b thru 0x00c719 (0xb0af bytes) 000031 1781238952.024621 write 0x004ac8 thru 0x010482 (0xb9bb bytes) 000032 1781238952.104854 read 0x004641 thru 0x010482 (0xbe42 bytes) 000033 1781238952.105591 punch from 0x0035c8 to 0x00f214 (0xbc4d bytes) 000034 1781238952.132829 mapwrite 0x0180c4 thru 0x0254c2 (0xd3ff bytes) 000036 1781238952.231471 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) 000037 1781238952.379711 mapread 0x0222f7 thru 0x0254c2 (0x31cc bytes) 000038 1781238952.397383 read 0x01aa59 thru 0x0254c2 (0xaa6a bytes) 000039 1781238952.402492 trunc from 0x0111ff to 0x014dd0 (0x3bd2 bytes) 000040 1781238952.407723 read 0x0225a8 thru 0x0254c2 (0x2f1b bytes) 000041 1781238952.409671 write 0x006a9b thru 0x00c038 (0x559e bytes) 000042 1781238952.426337 write 0x02bac3 thru 0x038e65 (0xd3a3 bytes) 000043 1781238952.428591 punch from 0x021120 to 0x025891 (0x4772 bytes) 000044 1781238952.434350 mapwrite 0x015740 thru 0x0161a7 (0xa68 bytes) 000045 1781238952.454305 trunc from 0x01bb88 to 0x01dc19 (0x2092 bytes) 000046 1781238952.460439 write 0x00cc4c thru 0x01b901 (0xecb6 bytes) 000047 1781238952.470582 punch from 0x0148bf to 0x02175d (0xce9f bytes) 000049 1781238952.488298 read 0x02af52 thru 0x02f783 (0x4832 bytes) 000050 1781238952.489143 mapwrite 0x025a30 thru 0x02f805 (0x9dd6 bytes) 000051 1781238952.531200 trunc from 0x035c83 to 0x0364b4 (0x832 bytes) 000052 1781238952.537628 trunc from 0x038e66 to 0x0100ed (0x28d78 bytes) 000054 1781238952.555453 mapwrite 0x03da85 thru 0x03efbe (0x153a bytes) 000055 1781238952.589758 write 0x00c9e1 thru 0x01213b (0x575b bytes) 000056 1781238952.595270 mapwrite 0x020d2f thru 0x0261f1 (0x54c3 bytes) 000057 1781238952.638261 read 0x03a6ca thru 0x03b895 (0x11cc bytes) 000058 1781238952.639519 mapread 0x0017cd thru 0x0102f2 (0xeb26 bytes) 000059 1781238952.641080 trunc from 0x03e0d2 to 0x03efbe (0xeed bytes) 000060 1781238952.652523 MIRROR_EXTEND to 2 mirrors 000061 1781238953.334751 mapread 0x00f019 thru 0x01697b (0x7963 bytes) 000063 1781238953.364275 mapread 0x0204f1 thru 0x0207dc (0x2ec bytes) 000064 1781238953.380208 trunc from 0x03efbf to 0x001099 (0x3df25 bytes) 000065 1781238953.423195 mapwrite 0x003cd3 thru 0x01352f (0xf85d bytes) 000066 1781238953.501959 fallocate 0x030242 thru 0x0317e7 (0x15a6 bytes) 000067 1781238953.509902 mapwrite 0x0035ec thru 0x012f5d (0xf972 bytes) 000068 1781238953.553669 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x13530): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13530): Mirror 2: 0x277f3da9 (stale) CRC-32 checksum value for chunk [0, 0x13530): Mirror 1: 0x6d21a11f Mirror 3: 0x6d21a11f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13530: skipped 000069 1781238954.273292 write 0x0197f0 thru 0x023ed1 (0xa6e2 bytes) 000070 1781238954.321596 read 0x01e026 thru 0x023ed1 (0x5eac bytes) 000071 1781238954.332927 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x23ed2): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23ed2): Mirror 2: 0xd81f54b0 (stale) Mirror 3: 0xf2a2cec9 (stale) CRC-32 checksum value for chunk [0, 0x23ed2): Mirror 1: 0x6642dbde Mirror 4: 0x6642dbde lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23ed2: skipped 000072 1781238955.201652 mapread 0x0236da thru 0x023ed1 (0x7f8 bytes) 000073 1781238955.209859 trunc from 0x0144e4 to 0x022dda (0xe8f7 bytes) 000074 1781238955.266725 mapwrite 0x010146 thru 0x017867 (0x7722 bytes) 000075 1781238955.348181 mapwrite 0x0041a9 thru 0x00d578 (0x93d0 bytes) 000076 1781238955.415947 read 0x010677 thru 0x016037 (0x59c1 bytes) 000077 1781238955.418205 read 0x022361 thru 0x023ed1 (0x1b71 bytes) 000080 1781238955.459525 fallocate 0x00d1d3 thru 0x016e00 (0x9c2e bytes) 000081 1781238955.472074 mapwrite 0x03694f thru 0x03ffff (0x96b1 bytes) 000082 1781238955.624877 trunc from 0x040000 to 0x00cb5a (0x334a5 bytes) 000083 1781238955.641251 trunc from 0x00cb5b to 0x0067d6 (0x6384 bytes) 000084 1781238955.657189 trunc from 0x0067d7 to 0x00e5a2 (0x7dcc bytes) 000085 1781238955.685896 mapwrite 0x00b964 thru 0x01866a (0xcd07 bytes) 000086 1781238955.832965 punch from 0x006547 to 0x00ada0 (0x485a bytes) 000087 1781238955.848860 trunc from 0x01866b to 0x020d6b (0x8701 bytes) 000088 1781238955.895022 mapread 0x001954 thru 0x00c430 (0xaadd bytes) 000089 1781238955.954661 punch from 0x004689 to 0x00b6b3 (0x702b bytes) 000090 1781238955.963772 mapread 0x011321 thru 0x01e289 (0xcf69 bytes) 000091 1781238956.007909 fallocate 0x030612 thru 0x035cfe (0x56ed bytes) 000093 1781238956.013685 trunc from 0x020d6c to 0x030c63 (0xfef8 bytes) 000094 1781238956.043652 trunc from 0x02e718 to 0x030c63 (0x254c bytes) 000095 1781238956.054915 trunc from 0x030c64 to 0x01b410 (0x15853 bytes) 000096 1781238956.082985 fallocate 0x03f5df thru 0x03ffff (0xa21 bytes) 000097 1781238956.088280 trunc from 0x00264f to 0x00fb2f (0xd4e1 bytes) 000099 1781238956.096099 punch from 0x015f73 to 0x022925 (0xc9b3 bytes) 000100 1781238956.102257 mapread 0x0129e2 thru 0x01bdbd (0x93dc bytes) 000101 1781238956.139511 mapread 0x038499 thru 0x03ffff (0x7b67 bytes) 000102 1781238956.199669 punch from 0x001c0a to 0x01156a (0xf961 bytes) 000104 1781238956.212114 write 0x001d26 thru 0x009e7e (0x8159 bytes) 000105 1781238956.233648 fallocate 0x01bfac thru 0x026244 (0xa299 bytes) 000106 1781238956.242030 write 0x00ef03 thru 0x01138a (0x2488 bytes) 000107 1781238956.258335 mapread 0x00e44f thru 0x016c90 (0x8842 bytes) 000109 1781238956.260990 trunc from 0x040000 to 0x00d718 (0x328e7 bytes) 000110 1781238956.295100 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xd719): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd719): Mirror 2: 0x8d2124e9 (stale) Mirror 3: 0xa0046602 (stale) Mirror 4: 0xa0046602 (stale) CRC-32 checksum value for chunk [0, 0xd719): Mirror 1: 0x3d6d9029 Mirror 5: 0x3d6d9029 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd719: skipped 000111 1781238957.350595 trunc from 0x00d719 to 0x01b10a (0xd9f2 bytes) 000112 1781238957.409444 trunc from 0x016f5b to 0x0191b3 (0x2259 bytes) 000113 1781238957.416932 mapread 0x00c670 thru 0x016fb5 (0xa946 bytes) 000114 1781238957.443945 mapread 0x011f49 thru 0x0123fc (0x4b4 bytes) 000115 1781238957.445753 mapread 0x00d0b4 thru 0x00de2e (0xd7b bytes) 000116 1781238957.447948 write 0x03c720 thru 0x03ffff (0x38e0 bytes) 000117 1781238957.449568 trunc from 0x040000 to 0x00f13a (0x30ec5 bytes) 000118 1781238957.479967 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xf13b): Mirror 3: 0x686e5adc (stale) Mirror 4: 0x686e5adc (stale) Mirror 5: 0x82fdd9eb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf13b): Mirror 3: 0x686e5adc (stale) Mirror 4: 0x686e5adc (stale) Mirror 5: 0x82fdd9eb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf13b: skipped 000120 1781238957.998407 mapwrite 0x0342c3 thru 0x03ffff (0xbd3d bytes) 000121 1781238958.155478 read 0x0137c2 thru 0x01bb04 (0x8343 bytes) 000123 1781238958.170054 read 0x01c9b4 thru 0x0208c0 (0x3f0d bytes) 000125 1781238958.198325 trunc from 0x006e99 to 0x00a723 (0x388b bytes) 000126 1781238958.222795 trunc from 0x040000 to 0x01ff2f (0x200d0 bytes) 000127 1781238958.288161 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ff30): Mirror 3: 0xc0e7c0d (stale) Mirror 4: 0xf0742c2e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ff30): Mirror 3: 0xc0e7c0d (stale) Mirror 4: 0xf0742c2e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ff30: skipped 000128 1781238958.611254 punch from 0x0001f5 to 0x00ad16 (0xab22 bytes) 000129 1781238958.616566 write 0x00df76 thru 0x01df46 (0xffd1 bytes) 000130 1781238958.636701 MIRROR_RESYNC 3 mirrors 000131 1781238959.512678 write 0x00f30c thru 0x00fb66 (0x85b bytes) 000132 1781238959.576124 write 0x0216f5 thru 0x029813 (0x811f bytes) 000133 1781238959.584309 mapwrite 0x01b5d7 thru 0x029c4f (0xe679 bytes) 000134 1781238959.722999 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29c50): Mirror 4: 0x3acbe8cc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29c50): Mirror 4: 0x3acbe8cc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29c50: skipped 000135 1781238960.008954 trunc from 0x01afb6 to 0x020ba4 (0x5bef bytes) 000136 1781238960.014210 trunc from 0x029c50 to 0x01ae0c (0xee43 bytes) 000137 1781238960.037763 write 0x001249 thru 0x006c7a (0x5a32 bytes) 000138 1781238960.047104 fallocate 0x03dc49 thru 0x03e254 (0x60c bytes) 000139 1781238960.052708 fallocate 0x03c801 thru 0x03ffff (0x37ff bytes) 000140 1781238960.057793 write 0x02a810 thru 0x03a0c0 (0xf8b1 bytes) 000141 1781238960.061185 mapread 0x011e02 thru 0x012260 (0x45f bytes) 000142 1781238960.069394 read 0x024c11 thru 0x02806d (0x345d bytes) 000143 1781238960.077963 fallocate 0x02b49e thru 0x033138 (0x7c9b bytes) 000144 1781238960.086627 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3a0c1): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a0c1): Mirror 4: 0x783c1d9b (stale) CRC-32 checksum value for chunk [0, 0x3a0c1): Mirror 1: 0xb588d4b9 Mirror 5: 0xb588d4b9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a0c1: skipped 000145 1781238961.153996 mapread 0x02fde9 thru 0x03a0c0 (0xa2d8 bytes) 000146 1781238961.219036 mapread 0x013dd2 thru 0x017d11 (0x3f40 bytes) 000147 1781238961.242943 mapwrite 0x02fe63 thru 0x03dd6f (0xdf0d bytes) 000148 1781238961.411559 trunc from 0x03dd70 to 0x03e784 (0xa15 bytes) 000149 1781238961.433316 read 0x02c6e0 thru 0x031f8f (0x58b0 bytes) 000150 1781238961.434043 punch from 0x0396e1 to 0x03da82 (0x43a2 bytes) 000151 1781238961.440322 trunc from 0x03e785 to 0x03c8f4 (0x1e90 bytes) 000152 1781238961.455858 mapwrite 0x035c72 thru 0x03ffff (0xa38e bytes) 000153 1781238961.505334 fallocate 0x026dd8 thru 0x0311ae (0xa3d7 bytes) 000154 1781238961.516765 MIRROR_RESYNC 3 mirrors 000155 1781238962.654112 read 0x01d737 thru 0x025461 (0x7d2b bytes) 000156 1781238962.666811 punch from 0x035128 to 0x03ffff (0xaed8 bytes) 000157 1781238962.703963 trunc from 0x040000 to 0x0091a9 (0x36e56 bytes) 000158 1781238962.727502 mapread 0x0011f9 thru 0x001bf8 (0xa00 bytes) 000159 1781238962.736999 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x91aa): Mirror 4: 0x39da116b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x91aa): Mirror 4: 0x39da116b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x91aa: skipped 000160 1781238963.042327 trunc from 0x0091aa to 0x002b52 (0x6657 bytes) 000161 1781238963.072906 mapwrite 0x03ce38 thru 0x03e13a (0x1303 bytes) 000162 1781238963.167663 read 0x037c20 thru 0x03e13a (0x651b bytes) 000163 1781238963.169190 fallocate 0x020daf thru 0x029aff (0x8d51 bytes) 000165 1781238963.191122 read 0x02e18e thru 0x033cf9 (0x5b6c bytes) 000167 1781238963.230958 read 0x01024e thru 0x01f13e (0xeef1 bytes) 000168 1781238963.233480 mapread 0x02cfc4 thru 0x036437 (0x9474 bytes) 000169 1781238963.237946 trunc from 0x03e13b to 0x01af2d (0x2320d bytes) 000170 1781238963.275831 fallocate 0x032746 thru 0x0350f8 (0x29b3 bytes) 000172 1781238963.293318 write 0x00d64c thru 0x011740 (0x40f5 bytes) 000173 1781238963.302977 fallocate 0x036ba0 thru 0x03d197 (0x65f8 bytes) 000174 1781238963.311175 write 0x00e027 thru 0x01c8ba (0xe894 bytes) 000175 1781238963.313507 punch from 0x00bc65 to 0x0119ab (0x5d47 bytes) 000176 1781238963.328986 mapread 0x00e2a0 thru 0x0112d1 (0x3032 bytes) 000177 1781238963.355423 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1c8bb): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c8bb): Mirror 4: 0xd3e59c30 (stale) CRC-32 checksum value for chunk [0, 0x1c8bb): Mirror 1: 0x387e6ab4 Mirror 5: 0x387e6ab4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c8bb: skipped 000178 1781238964.363103 fallocate 0x03e160 thru 0x03ffff (0x1ea0 bytes) 000180 1781238964.424779 trunc from 0x040000 to 0x000acc (0x3f533 bytes) 000181 1781238964.492486 trunc from 0x0000b0 to 0x000acc (0xa1d bytes) 000182 1781238964.521125 mapread 0x000537 thru 0x000acc (0x596 bytes) 000183 1781238964.531761 trunc from 0x0009aa to 0x000acc (0x123 bytes) 000184 1781238964.537189 read 0x0005f8 thru 0x000acc (0x4d5 bytes) 000185 1781238964.554570 trunc from 0x000acd to 0x0354d6 (0x34a0a bytes) 000186 1781238964.584117 read 0x01b3ef thru 0x021b46 (0x6758 bytes) 000187 1781238964.609933 read 0x00e84d thru 0x0163ac (0x7b60 bytes) 000188 1781238964.616190 write 0x02f6ec thru 0x03addc (0xb6f1 bytes) 000189 1781238964.635038 mapwrite 0x01faf9 thru 0x01ff83 (0x48b bytes) 000191 1781238964.723664 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3addd): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3addd): Mirror 4: 0x3f7eae5b (stale) Mirror 5: 0xb1bd886f (stale) CRC-32 checksum value for chunk [0, 0x3addd): Mirror 1: 0x714be3fe Mirror 6: 0x714be3fe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3addd: skipped 000192 1781238965.674743 write 0x00b67c thru 0x012baa (0x752f bytes) 000193 1781238965.720582 read 0x0165df thru 0x023678 (0xd09a bytes) 000194 1781238965.729791 mapwrite 0x01db00 thru 0x020d8c (0x328d bytes) 000195 1781238965.753809 read 0x02c485 thru 0x039939 (0xd4b5 bytes) 000196 1781238965.775429 trunc from 0x03addd to 0x008cfd (0x320df bytes) 000197 1781238965.797984 mapread 0x004e5e thru 0x008cfd (0x3ea0 bytes) 000198 1781238965.800178 punch from 0x0011e4 to 0x008cfd (0x7b1a bytes) 000199 1781238965.806185 mapread 0x003a93 thru 0x008cfd (0x526b bytes) 000200 1781238965.846136 mapwrite 0x030a52 thru 0x03525d (0x480c bytes) 000201 1781238965.916793 write 0x02b943 thru 0x02e727 (0x2de5 bytes) 000202 1781238965.926058 read 0x017151 thru 0x023985 (0xc835 bytes) 000203 1781238965.948777 fallocate 0x005ece thru 0x00f666 (0x9799 bytes) 000204 1781238965.954019 mapread 0x003e4d thru 0x00c273 (0x8427 bytes) 000205 1781238965.956349 fallocate 0x015892 thru 0x018c3a (0x33a9 bytes) 000206 1781238965.961389 trunc from 0x03525e to 0x01a79a (0x1aac3 bytes) 000208 1781238965.978151 mapwrite 0x00ad09 thru 0x00e0f8 (0x33f0 bytes) 000209 1781238966.001159 write 0x01e722 thru 0x0246a4 (0x5f83 bytes) 000210 1781238966.002770 mapwrite 0x03241e thru 0x037c46 (0x5829 bytes) 000211 1781238966.083885 trunc from 0x025b72 to 0x02fe3e (0xa2cd bytes) 000212 1781238966.090726 punch from 0x006d43 to 0x01580a (0xeac8 bytes) 000213 1781238966.095400 fallocate 0x0080a8 thru 0x017387 (0xf2e0 bytes) 000215 1781238966.103616 write 0x038f7f thru 0x03ffff (0x7081 bytes) 000216 1781238966.107480 trunc from 0x00f096 to 0x01e8ee (0xf859 bytes) 000217 1781238966.125095 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x99666e06 (stale) Mirror 5: 0x350458f0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x99666e06 (stale) Mirror 5: 0x350458f0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000218 1781238966.517891 trunc from 0x002124 to 0x010a93 (0xe970 bytes) 000219 1781238966.526867 trunc from 0x002e89 to 0x00ad7e (0x7ef6 bytes) 000220 1781238966.534013 fallocate 0x038ea4 thru 0x03e987 (0x5ae4 bytes) 000221 1781238966.539126 trunc from 0x025a03 to 0x0326d3 (0xccd1 bytes) 000222 1781238966.549757 MIRROR_RESYNC 3 mirrors 000223 1781238967.493481 MIRROR_RESYNC 3 mirrors 000224 1781238967.888446 trunc from 0x040000 to 0x00e2b7 (0x31d48 bytes) 000225 1781238968.017920 fallocate 0x019ade thru 0x02739e (0xd8c1 bytes) 000226 1781238968.026817 mapread 0x00831c thru 0x00a9d8 (0x26bd bytes) 000227 1781238968.085746 trunc from 0x001a2f to 0x004b6a (0x313c bytes) 000228 1781238968.093945 fallocate 0x024ffd thru 0x02f99d (0xa9a1 bytes) 000229 1781238968.099658 write 0x026ad9 thru 0x033ccf (0xd1f7 bytes) 000230 1781238968.112165 read 0x00810c thru 0x0083b5 (0x2aa bytes) 000231 1781238968.113366 trunc from 0x033cd0 to 0x01c208 (0x17ac7 bytes) 000232 1781238968.136475 punch from 0x00b489 to 0x00b599 (0x111 bytes) 000233 1781238968.149092 trunc from 0x01c209 to 0x034c85 (0x18a7d bytes) 000234 1781238968.165764 trunc from 0x034c86 to 0x03364b (0x163a bytes) 000235 1781238968.198740 punch from 0x01961f to 0x01b321 (0x1d03 bytes) 000236 1781238968.205609 fallocate 0x01f4da thru 0x02483b (0x5362 bytes) 000237 1781238968.212953 fallocate 0x03f3fb thru 0x03ffff (0xc05 bytes) 000238 1781238968.240473 read 0x013a00 thru 0x021779 (0xdd7a bytes) 000239 1781238968.258059 mapwrite 0x018e1e thru 0x0256ab (0xc88e bytes) 000240 1781238968.302512 mapwrite 0x02d9fd thru 0x037c92 (0xa296 bytes) 000241 1781238968.350830 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x37c93): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37c93): Mirror 4: 0xa5b5e1cc (stale) Mirror 5: 0xa5b5e1cc (stale) CRC-32 checksum value for chunk [0, 0x37c93): Mirror 1: 0x7eb14696 Mirror 6: 0x7eb14696 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37c93: skipped 000242 1781238969.256961 punch from 0x01cef5 to 0x0284b5 (0xb5c1 bytes) 000243 1781238969.327800 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x37c93): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37c93): Mirror 4: 0xa5b5e1cc (stale) Mirror 5: 0xa5b5e1cc (stale) Mirror 6: 0x7eb14696 (stale) CRC-32 checksum value for chunk [0, 0x37c93): Mirror 1: 0x1ab32d90 Mirror 7: 0x1ab32d90 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37c93: skipped 000244 1781238970.369781 read 0x00d343 thru 0x01ac99 (0xd957 bytes) 000245 1781238970.381672 mapread 0x0014db thru 0x0101de (0xed04 bytes) 000246 1781238970.416800 trunc from 0x037c93 to 0x01121b (0x26a77 bytes) 000247 1781238970.477731 read 0x0080cc thru 0x0080cf (0x4 bytes) 000248 1781238970.488105 punch from 0x000be9 to 0x008cf9 (0x8111 bytes) 000249 1781238970.493903 mapwrite 0x00c4df thru 0x00d564 (0x1086 bytes) 000250 1781238970.514764 mapread 0x006551 thru 0x00ca6f (0x651f bytes) 000251 1781238970.537789 trunc from 0x01121c to 0x02156d (0x10352 bytes) 000252 1781238970.573529 mapwrite 0x003747 thru 0x012550 (0xee0a bytes) 000253 1781238970.627043 fallocate 0x0251bd thru 0x02801c (0x2e60 bytes) 000254 1781238970.633078 fallocate 0x03b36c thru 0x03efcb (0x3c60 bytes) 000256 1781238970.641775 read 0x001aa3 thru 0x00ac52 (0x91b0 bytes) 000257 1781238970.650652 read 0x00122d thru 0x00a58d (0x9361 bytes) 000258 1781238970.651523 trunc from 0x02801d to 0x03dc88 (0x15c6c bytes) 000260 1781238970.669408 read 0x0376ae thru 0x03a980 (0x32d3 bytes) 000261 1781238970.693788 write 0x039e67 thru 0x03bd2a (0x1ec4 bytes) 000262 1781238970.695344 trunc from 0x02d5f6 to 0x031a43 (0x444e bytes) 000263 1781238970.711324 fallocate 0x009839 thru 0x00a9c7 (0x118f bytes) 000264 1781238970.722398 write 0x0326f9 thru 0x03866b (0x5f73 bytes) 000265 1781238970.724343 trunc from 0x03dc89 to 0x01d1ba (0x20ace bytes) 000266 1781238970.759321 mapwrite 0x022db4 thru 0x0281bc (0x5409 bytes) 000267 1781238970.865342 mapread 0x022ff5 thru 0x0281bc (0x51c8 bytes) 000268 1781238970.867149 mapwrite 0x0087f8 thru 0x0149b1 (0xc1ba bytes) 000269 1781238970.893090 read 0x00c4ea thru 0x00f5e9 (0x3100 bytes) 000271 1781238970.895783 trunc from 0x014722 to 0x01b13c (0x6a1b bytes) 000272 1781238970.904047 fallocate 0x0136eb thru 0x01f99a (0xc2b0 bytes) 000273 1781238970.912311 trunc from 0x0281bd to 0x031315 (0x9159 bytes) 000274 1781238970.935036 mapwrite 0x01ad6b thru 0x02a5d7 (0xf86d bytes) 000275 1781238971.000559 read 0x002434 thru 0x003a00 (0x15cd bytes) 000276 1781238971.004922 trunc from 0x01bc36 to 0x0247c1 (0x8b8c bytes) 000277 1781238971.028020 punch from 0x0028ef to 0x0058cd (0x2fdf bytes) 000278 1781238971.044901 trunc from 0x01c66d to 0x028e06 (0xc79a bytes) 000279 1781238971.052709 trunc from 0x017e9c to 0x01d86d (0x59d2 bytes) 000280 1781238971.067596 MIRROR_RESYNC 5 mirrors 000281 1781238972.421079 trunc from 0x00c13c to 0x01072c (0x45f1 bytes) 000282 1781238972.459823 punch from 0x00d343 to 0x016d50 (0x9a0e bytes) 000283 1781238972.464605 punch from 0x01cb51 to 0x02a8e7 (0xdd97 bytes) 000285 1781238972.473036 write 0x036461 thru 0x03ffff (0x9b9f bytes) 000286 1781238972.476984 read 0x003f41 thru 0x00da9d (0x9b5d bytes) 000288 1781238972.492380 trunc from 0x040000 to 0x01da22 (0x225dd bytes) 000289 1781238972.519065 trunc from 0x01da23 to 0x027ab3 (0xa091 bytes) 000291 1781238972.542944 trunc from 0x027ab4 to 0x00d655 (0x1a45e bytes) 000292 1781238972.565020 read 0x00bc75 thru 0x00d655 (0x19e1 bytes) 000293 1781238972.565940 mapread 0x008edc thru 0x00d655 (0x477a bytes) 000294 1781238972.567645 read 0x002b13 thru 0x00d655 (0xab43 bytes) 000295 1781238972.578779 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xd656): Mirror 4: 0x61bafd78 (stale) Mirror 5: 0x61bafd78 (stale) Mirror 7: 0x61bafd78 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd656): Mirror 4: 0x61bafd78 (stale) Mirror 5: 0x61bafd78 (stale) Mirror 7: 0x61bafd78 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd656: skipped 000296 1781238972.969532 fallocate 0x015ecb thru 0x02322a (0xd360 bytes) 000297 1781238972.975385 trunc from 0x01aa02 to 0x02322a (0x8829 bytes) 000298 1781238972.979495 mapwrite 0x03b503 thru 0x03ffff (0x4afd bytes) 000299 1781238973.089106 trunc from 0x0190f3 to 0x020af2 (0x7a00 bytes) 000300 1781238973.101593 mapwrite 0x021bb1 thru 0x026dfe (0x524e bytes) 000303 1781238973.175362 read 0x01f4bb thru 0x02e472 (0xefb8 bytes) 000304 1781238973.188267 trunc from 0x040000 to 0x024280 (0x1bd7f bytes) 000305 1781238973.240157 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x24281): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24281): Mirror 4: 0xd2f6400f (stale) Mirror 5: 0xd2f6400f (stale) Mirror 7: 0xd2f6400f (stale) CRC-32 checksum value for chunk [0, 0x24281): Mirror 1: 0x2f8b06c9 Mirror 8: 0x2f8b06c9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24281: skipped 000306 1781238974.102412 trunc from 0x001079 to 0x003051 (0x1fd9 bytes) 000308 1781238974.144513 mapwrite 0x023052 thru 0x02a87e (0x782d bytes) 000309 1781238974.228503 read 0x020a63 thru 0x021c5e (0x11fc bytes) 000310 1781238974.229411 mapwrite 0x023453 thru 0x0240ee (0xc9c bytes) 000311 1781238974.244645 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2a87f): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a87f): Mirror 4: 0x80fbdf06 (stale) Mirror 5: 0x80fbdf06 (stale) Mirror 7: 0x80fbdf06 (stale) Mirror 8: 0x73742a1 (stale) CRC-32 checksum value for chunk [0, 0x2a87f): Mirror 1: 0x7c52d266 Mirror 9: 0x7c52d266 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a87f: skipped 000312 1781238974.899342 trunc from 0x02a87f to 0x02eb42 (0x42c4 bytes) 000313 1781238974.954443 mapwrite 0x012db1 thru 0x01e33f (0xb58f bytes) 000314 1781238975.003985 trunc from 0x02eb43 to 0x009e3c (0x24d06 bytes) 000315 1781238975.022629 punch from 0x0080d4 to 0x009e3c (0x1d69 bytes) 000316 1781238975.029819 trunc from 0x000a56 to 0x0025aa (0x1b55 bytes) 000317 1781238975.035718 trunc from 0x009e3d to 0x023f33 (0x1a0f7 bytes) 000318 1781238975.059265 punch from 0x014db3 to 0x020313 (0xb561 bytes) 000319 1781238975.063618 read 0x01bb54 thru 0x01d840 (0x1ced bytes) 000320 1781238975.069323 punch from 0x01ae2f to 0x01d99a (0x2b6c bytes) 000321 1781238975.074502 trunc from 0x01770f to 0x01bdc5 (0x46b7 bytes) 000323 1781238975.079907 fallocate 0x013766 thru 0x019801 (0x609c bytes) 000324 1781238975.084932 trunc from 0x022c98 to 0x023f33 (0x129c bytes) 000325 1781238975.089365 fallocate 0x03811d thru 0x03c12b (0x400f bytes) 000326 1781238975.098931 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3c12c): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c12c): Mirror 4: 0xcd1a8d74 (stale) Mirror 5: 0xcd1a8d74 (stale) Mirror 7: 0xcd1a8d74 (stale) Mirror 8: 0x7f267da6 (stale) Mirror 9: 0x6fad4097 (stale) CRC-32 checksum value for chunk [0, 0x3c12c): Mirror 1: 0x9c49d7a7 Mirror 10: 0x9c49d7a7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c12c: skipped 000327 1781238975.976563 mapread 0x03bc3d thru 0x03c12b (0x4ef bytes) 000328 1781238975.988588 punch from 0x035e05 to 0x03c12b (0x6327 bytes) 000329 1781238976.033032 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c12c): Mirror 4: 0xcd1a8d74 (stale) Mirror 5: 0xcd1a8d74 (stale) Mirror 8: 0x7f267da6 (stale) Mirror 9: 0x6fad4097 (stale) Mirror 10: 0x9c49d7a7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c12c): Mirror 4: 0xcd1a8d74 (stale) Mirror 5: 0xcd1a8d74 (stale) Mirror 8: 0x7f267da6 (stale) Mirror 9: 0x6fad4097 (stale) Mirror 10: 0x9c49d7a7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c12c: skipped 000330 1781238976.476251 write 0x00d8da thru 0x018740 (0xae67 bytes) 000331 1781238976.493670 read 0x036edc thru 0x03c12b (0x5250 bytes) 000332 1781238976.509814 punch from 0x03919b to 0x03c12b (0x2f91 bytes) 000333 1781238976.518432 trunc from 0x00fcf2 to 0x0195b6 (0x98c5 bytes) 000334 1781238976.567152 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3c12c): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c12c): Mirror 4: 0xcd1a8d74 (stale) Mirror 5: 0xcd1a8d74 (stale) Mirror 8: 0x7f267da6 (stale) Mirror 9: 0x6fad4097 (stale) Mirror 10: 0x9c49d7a7 (stale) CRC-32 checksum value for chunk [0, 0x3c12c): Mirror 1: 0xd54e9a9c Mirror 11: 0xd54e9a9c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c12c: skipped 000335 1781238977.745906 mapwrite 0x024af6 thru 0x027f4b (0x3456 bytes) 000336 1781238977.852945 read 0x0018d1 thru 0x0107f6 (0xef26 bytes) 000337 1781238977.868484 MIRROR_RESYNC 7 mirrors 000338 1781238980.552102 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) 000339 1781238981.072344 read 0x00efc3 thru 0x011105 (0x2143 bytes) 000340 1781238981.078843 trunc from 0x01a3e6 to 0x026fba (0xcbd5 bytes) 000341 1781238981.125891 MIRROR_RESYNC 6 mirrors 000343 1781238983.589630 write 0x03baff thru 0x03ffff (0x4501 bytes) 000345 1781238983.629514 trunc from 0x040000 to 0x00f378 (0x30c87 bytes) 000347 1781238983.653348 mapwrite 0x02d0ca thru 0x03adb3 (0xdcea bytes) 000348 1781238983.733695 fallocate 0x00d20a thru 0x011378 (0x416f bytes) 000349 1781238983.750911 write 0x00e1b3 thru 0x010230 (0x207e bytes) 000350 1781238983.767159 read 0x03750a thru 0x03a23c (0x2d33 bytes) 000351 1781238983.767887 punch from 0x000ffa to 0x0106be (0xf6c5 bytes) 000352 1781238983.789881 write 0x03cefd thru 0x03e9d9 (0x1add bytes) 000353 1781238983.791110 read 0x036a92 thru 0x03e9d9 (0x7f48 bytes) 000354 1781238983.805153 write 0x01ceb7 thru 0x027370 (0xa4ba bytes) 000355 1781238983.806615 read 0x01b95b thru 0x027dd0 (0xc476 bytes) 000356 1781238983.807303 trunc from 0x02d28d to 0x0371bf (0x9f33 bytes) 000357 1781238983.832395 mapread 0x03738c thru 0x039f26 (0x2b9b bytes) 000359 1781238983.855965 mapwrite 0x039b24 thru 0x03d91c (0x3df9 bytes) 000360 1781238983.884149 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e9da): Mirror 5: 0x68e32d54 (stale) Mirror 8: 0x68e32d54 (stale) Mirror 9: 0x68e32d54 (stale) Mirror 11: 0x68e32d54 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e9da): Mirror 5: 0x68e32d54 (stale) Mirror 8: 0x68e32d54 (stale) Mirror 9: 0x68e32d54 (stale) Mirror 11: 0x68e32d54 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e9da: skipped 000361 1781238984.366978 trunc from 0x035fa1 to 0x03b678 (0x56d8 bytes) 000362 1781238984.375305 trunc from 0x03e9da to 0x024605 (0x1a3d4 bytes) 000363 1781238984.404706 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24606): Mirror 5: 0x4d7e7d58 (stale) Mirror 8: 0x4d7e7d58 (stale) Mirror 11: 0x4d7e7d58 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24606): Mirror 5: 0x4d7e7d58 (stale) Mirror 8: 0x4d7e7d58 (stale) Mirror 11: 0x4d7e7d58 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24606: skipped 000364 1781238984.731951 mapread 0x021fee thru 0x022008 (0x1b bytes) 000365 1781238984.741516 fallocate 0x03cdb0 thru 0x03ffff (0x3250 bytes) 000366 1781238984.746776 punch from 0x0024c9 to 0x00c8e3 (0xa41b bytes) 000367 1781238984.752082 trunc from 0x01b2fe to 0x024605 (0x9308 bytes) 000368 1781238984.757623 punch from 0x021626 to 0x024605 (0x2fe0 bytes) 000369 1781238984.766482 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24606): Mirror 5: 0x4d7e7d58 (stale) Mirror 8: 0x4d7e7d58 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24606): Mirror 5: 0x4d7e7d58 (stale) Mirror 8: 0x4d7e7d58 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24606: skipped 000370 1781238985.008703 fallocate 0x017129 thru 0x020803 (0x96db bytes) 000372 1781238985.014518 mapwrite 0x001115 thru 0x00e1f7 (0xd0e3 bytes) 000373 1781238985.054559 write 0x0271aa thru 0x02c823 (0x567a bytes) 000374 1781238985.059310 trunc from 0x012c2d to 0x013bce (0xfa2 bytes) 000375 1781238985.064360 mapread 0x0103ea thru 0x017f28 (0x7b3f bytes) 000376 1781238985.073728 trunc from 0x018897 to 0x01a47a (0x1be4 bytes) 000377 1781238985.078034 write 0x02798b thru 0x0321ed (0xa863 bytes) 000378 1781238985.079824 mapread 0x01cf8f thru 0x028f5b (0xbfcd bytes) 000379 1781238985.098808 MIRROR_RESYNC 3 mirrors 000380 1781238986.229755 write 0x02adfd thru 0x02b1cc (0x3d0 bytes) 000381 1781238986.312937 fallocate 0x0178fc thru 0x0271fb (0xf900 bytes) 000382 1781238986.321143 trunc from 0x01cf4d to 0x022c60 (0x5d14 bytes) 000383 1781238986.337079 fallocate 0x00c5ec thru 0x00d204 (0xc19 bytes) 000384 1781238986.343590 read 0x02dd50 thru 0x030ac8 (0x2d79 bytes) 000385 1781238986.350943 trunc from 0x026cc9 to 0x02c36a (0x56a2 bytes) 000387 1781238986.368143 mapwrite 0x020e46 thru 0x0294b2 (0x866d bytes) 000388 1781238986.462762 trunc from 0x00bcb6 to 0x014c5e (0x8fa9 bytes) 000390 1781238986.472656 trunc from 0x005450 to 0x007374 (0x1f25 bytes) 000391 1781238986.479558 mapread 0x001956 thru 0x011751 (0xfdfc bytes) 000393 1781238986.509508 mapwrite 0x01c1ab thru 0x021325 (0x517b bytes) 000394 1781238986.535107 mapread 0x0061b3 thru 0x00bd51 (0x5b9f bytes) 000395 1781238986.536254 trunc from 0x02a14d to 0x031a70 (0x7924 bytes) 000396 1781238986.543382 read 0x00ca34 thru 0x01bf90 (0xf55d bytes) 000397 1781238986.544416 mapread 0x008738 thru 0x00ce3a (0x4703 bytes) 000398 1781238986.554016 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x321ee): Mirror 5: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x321ee): Mirror 5: 0xb2a8176c (stale) Mirror 8: 0xb2a8176c (stale) CRC-32 checksum value for chunk [0, 0x321ee): Mirror 1: 0xb2185335 Mirror 9: 0xb2185335 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x321ee: skipped 000399 1781238987.675324 read 0x02d3ff thru 0x0321ed (0x4def bytes) 000400 1781238987.714534 read 0x012361 thru 0x018929 (0x65c9 bytes) 000401 1781238987.738679 trunc from 0x0321ee to 0x018076 (0x1a177 bytes) 000402 1781238987.843849 fallocate 0x009db2 thru 0x019d33 (0xff82 bytes) 000403 1781238987.850074 punch from 0x009b87 to 0x0146ca (0xab44 bytes) 000404 1781238987.858563 punch from 0x00e92c to 0x013bf5 (0x52ca bytes) 000405 1781238987.866080 punch from 0x002fd8 to 0x00ccfa (0x9d23 bytes) 000406 1781238987.872438 fallocate 0x030233 thru 0x039d07 (0x9ad5 bytes) 000407 1781238987.877513 punch from 0x01998f to 0x02732c (0xd99e bytes) 000408 1781238987.883392 mapread 0x039050 thru 0x039aca (0xa7b bytes) 000409 1781238987.895780 write 0x03c18a thru 0x03ffff (0x3e76 bytes) 000410 1781238987.897022 trunc from 0x040000 to 0x02ad02 (0x152fd bytes) 000411 1781238987.918766 fallocate 0x0033b5 thru 0x0069db (0x3627 bytes) 000412 1781238987.932946 write 0x03c909 thru 0x03ffff (0x36f7 bytes) 000413 1781238987.943833 punch from 0x02cf33 to 0x0303aa (0x3478 bytes) 000414 1781238987.956176 write 0x012a59 thru 0x014504 (0x1aac bytes) 000415 1781238987.980487 punch from 0x014a14 to 0x0240f0 (0xf6dd bytes) 000416 1781238987.996481 read 0x0020d0 thru 0x005fa3 (0x3ed4 bytes) 000418 1781238988.010478 trunc from 0x040000 to 0x038cad (0x7352 bytes) 000419 1781238988.024791 read 0x02d27f thru 0x02d7a8 (0x52a bytes) 000420 1781238988.025805 mapwrite 0x02b323 thru 0x0393c6 (0xe0a4 bytes) 000421 1781238988.073990 MIRROR_RESYNC 4 mirrors 000422 1781238989.267537 fallocate 0x03e318 thru 0x03ffff (0x1ce8 bytes) 000423 1781238989.300982 mapwrite 0x00998b thru 0x00dabe (0x4134 bytes) 000424 1781238989.331673 write 0x00cdfc thru 0x00f2a1 (0x24a6 bytes) 000425 1781238989.332789 write 0x027149 thru 0x03647c (0xf334 bytes) 000426 1781238989.350533 trunc from 0x03b889 to 0x03ffff (0x4777 bytes) 000427 1781238989.355540 mapread 0x03511b thru 0x03b61d (0x6503 bytes) 000428 1781238989.364823 write 0x001df7 thru 0x00e2cd (0xc4d7 bytes) 000429 1781238989.372076 fallocate 0x0303ad thru 0x035165 (0x4db9 bytes) 000430 1781238989.382765 trunc from 0x0198d0 to 0x0272a1 (0xd9d2 bytes) 000431 1781238989.410082 trunc from 0x040000 to 0x01b348 (0x24cb7 bytes) 000432 1781238989.468518 mapread 0x01336c thru 0x014c5f (0x18f4 bytes) 000433 1781238989.515463 read 0x0131f0 thru 0x01434a (0x115b bytes) 000435 1781238989.516913 mapwrite 0x01dbf0 thru 0x027bb8 (0x9fc9 bytes) 000436 1781238989.584331 mapread 0x00bb62 thru 0x015a91 (0x9f30 bytes) 000437 1781238989.588607 trunc from 0x027bb9 to 0x01580b (0x123ad bytes) 000438 1781238989.606666 trunc from 0x01580c to 0x01e3fb (0x8bf0 bytes) 000439 1781238989.631705 mapread 0x005ce7 thru 0x009e90 (0x41aa bytes) 000441 1781238989.640542 trunc from 0x009e46 to 0x0129de (0x8b99 bytes) 000442 1781238989.656763 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e3fc): Mirror 5: 0x7ef42f39 (stale) Mirror 8: 0x7ef42f39 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e3fc): Mirror 5: 0x7ef42f39 (stale) Mirror 8: 0x7ef42f39 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e3fc: skipped 000443 1781238989.934313 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1e3fc): Mirror 5: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e3fc): Mirror 5: 0x7ef42f39 (stale) Mirror 8: 0x7ef42f39 (stale) CRC-32 checksum value for chunk [0, 0x1e3fc): Mirror 1: 0xb82ad005 Mirror 9: 0xb82ad005 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e3fc: skipped 000444 1781238990.886680 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e3fc): Mirror 8: 0x7ef42f39 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e3fc): Mirror 8: 0x7ef42f39 (stale) CRC-32 checksum value for chunk [0, 0x1e3fc): Mirror 1: 0xb82ad005 Mirror 9: 0xb82ad005 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e3fc: skipped 000445 1781238991.498738 trunc from 0x005256 to 0x00cbdf (0x798a bytes) 000446 1781238991.548582 write 0x02457e thru 0x02cc6a (0x86ed bytes) 000448 1781238991.561783 trunc from 0x017310 to 0x01e096 (0x6d87 bytes) 000449 1781238991.568922 trunc from 0x02cc6b to 0x0263fe (0x686c bytes) 000450 1781238991.599087 mapread 0x01a59e thru 0x01c3aa (0x1e0d bytes) 000451 1781238991.654072 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x263ff): Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x263ff): Mirror 8: 0x2d00a2e0 (stale) Mirror 9: 0x8de7feba (stale) CRC-32 checksum value for chunk [0, 0x263ff): Mirror 1: 0x365068c6 Mirror 10: 0x365068c6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x263ff: skipped 000452 1781238992.651100 mapwrite 0x03d9bf thru 0x03ffff (0x2641 bytes) 000453 1781238992.829824 trunc from 0x0015b4 to 0x00ba3f (0xa48c bytes) 000454 1781238992.847135 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x9f76e506 (stale) Mirror 9: 0x553e7423 (stale) Mirror 10: 0x5d8acec (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x45534b85 Mirror 11: 0x45534b85 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000455 1781238994.134010 mapwrite 0x001eee thru 0x00cb33 (0xac46 bytes) 000456 1781238994.295282 mapwrite 0x016fd8 thru 0x01f2e8 (0x8311 bytes) 000457 1781238994.371687 punch from 0x001c37 to 0x0101da (0xe5a4 bytes) 000458 1781238994.379861 fallocate 0x03c974 thru 0x03ffff (0x368c bytes) 000459 1781238994.386596 punch from 0x02aeae to 0x02e292 (0x33e5 bytes) 000460 1781238994.394012 mapwrite 0x03bfb8 thru 0x03ffff (0x4048 bytes) 000461 1781238994.430056 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x9f76e506 (stale) Mirror 10: 0x5d8acec (stale) Mirror 11: 0x45534b85 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x9f76e506 (stale) Mirror 10: 0x5d8acec (stale) Mirror 11: 0x45534b85 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000462 1781238994.869028 mapwrite 0x005846 thru 0x00c96b (0x7126 bytes) 000463 1781238994.913042 mapwrite 0x036c72 thru 0x03ffff (0x938e bytes) 000464 1781238994.954521 fallocate 0x002efe thru 0x005b50 (0x2c53 bytes) 000465 1781238994.959095 mapwrite 0x030d3c thru 0x03d1d7 (0xc49c bytes) 000466 1781238994.983524 write 0x003afb thru 0x011fa8 (0xe4ae bytes) 000467 1781238994.999582 mapread 0x0234af thru 0x025384 (0x1ed6 bytes) 000468 1781238995.023557 fallocate 0x02f9f6 thru 0x03d326 (0xd931 bytes) 000469 1781238995.029328 mapread 0x02edab thru 0x02f62d (0x883 bytes) 000470 1781238995.038151 trunc from 0x040000 to 0x031857 (0xe7a8 bytes) 000471 1781238995.058717 write 0x00a011 thru 0x01084d (0x683d bytes) 000472 1781238995.060007 read 0x014763 thru 0x01f919 (0xb1b7 bytes) 000475 1781238995.074907 fallocate 0x014dbf thru 0x02397d (0xebbf bytes) 000477 1781238995.081354 punch from 0x006bb3 to 0x00ee0e (0x825c bytes) 000478 1781238995.100441 trunc from 0x031858 to 0x013789 (0x1e0ce bytes) 000479 1781238995.113320 fallocate 0x0117d8 thru 0x01a708 (0x8f31 bytes) 000480 1781238995.120014 trunc from 0x012865 to 0x01a708 (0x7ea4 bytes) 000481 1781238995.125442 write 0x0183a7 thru 0x0190bc (0xd16 bytes) 000482 1781238995.140461 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1a709): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a709): Mirror 8: 0x8355d953 (stale) Mirror 10: 0xae961112 (stale) Mirror 11: 0x101e90c7 (stale) CRC-32 checksum value for chunk [0, 0x1a709): Mirror 1: 0x43f0ac3 Mirror 12: 0x43f0ac3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a709: skipped 000483 1781238996.278289 write 0x0199d3 thru 0x01f001 (0x562f bytes) 000484 1781238996.325445 mapwrite 0x005a58 thru 0x00d82b (0x7dd4 bytes) 000485 1781238996.360174 trunc from 0x01f002 to 0x015a58 (0x95a9 bytes) 000486 1781238996.399463 read 0x011350 thru 0x015a58 (0x4709 bytes) 000487 1781238996.409903 mapwrite 0x007dfd thru 0x00b03a (0x323e bytes) 000488 1781238996.470029 mapread 0x014bfc thru 0x015a58 (0xe5d bytes) 000489 1781238996.471068 punch from 0x00547a to 0x012692 (0xd219 bytes) 000490 1781238996.482694 punch from 0x001bb4 to 0x011552 (0xf99f bytes) 000491 1781238996.489828 read 0x003235 thru 0x004b67 (0x1933 bytes) 000492 1781238996.507692 trunc from 0x015a59 to 0x038ea2 (0x2344a bytes) 000493 1781238996.523895 mapread 0x038b1c thru 0x038ea2 (0x387 bytes) 000494 1781238996.545165 trunc from 0x038ea3 to 0x03d1b4 (0x4312 bytes) 000495 1781238996.563192 write 0x013aef thru 0x01d6a1 (0x9bb3 bytes) 000496 1781238996.566047 mapread 0x038513 thru 0x03bba4 (0x3692 bytes) 000497 1781238996.575516 trunc from 0x03d1b5 to 0x0159e2 (0x277d2 bytes) 000498 1781238996.593690 mapread 0x008132 thru 0x009f6e (0x1e3d bytes) 000499 1781238996.594821 write 0x0122f7 thru 0x0163f6 (0x4100 bytes) 000500 1781238996.598028 write 0x039a17 thru 0x03ffff (0x65e9 bytes) 000501 1781238996.601021 trunc from 0x035256 to 0x03736d (0x2118 bytes) 000502 1781238996.607338 write 0x00882b thru 0x00a4d6 (0x1cac bytes) 000503 1781238996.608874 punch from 0x002d37 to 0x004fe6 (0x22b0 bytes) 000504 1781238996.622549 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x9f76e506 (stale) Mirror 11: 0x45534b85 (stale) Mirror 12: 0x307df677 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x9f76e506 (stale) Mirror 11: 0x45534b85 (stale) Mirror 12: 0x307df677 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000505 1781238997.122919 trunc from 0x040000 to 0x03a200 (0x5dff bytes) 000507 1781238997.153844 fallocate 0x039ba1 thru 0x03ec3e (0x509e bytes) 000508 1781238997.162389 trunc from 0x03a201 to 0x02fcac (0xa554 bytes) 000509 1781238997.181044 write 0x001b20 thru 0x002f7e (0x145f bytes) 000510 1781238997.200579 write 0x00fa80 thru 0x01b08e (0xb60f bytes) 000511 1781238997.226730 punch from 0x026407 to 0x02fcac (0x98a6 bytes) 000512 1781238997.231957 trunc from 0x02662f to 0x02aef8 (0x48ca bytes) 000513 1781238997.242023 MIRROR_RESYNC 4 mirrors 000514 1781238998.647872 read 0x018c35 thru 0x023df7 (0xb1c3 bytes) 000515 1781238998.658713 trunc from 0x02fcad to 0x026a61 (0x924b bytes) 000516 1781238998.710380 trunc from 0x026a62 to 0x002ffe (0x23a63 bytes) 000517 1781238998.735768 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2fff): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fff): Mirror 8: 0x1fd09cf (stale) Mirror 11: 0x1fd09cf (stale) Mirror 12: 0x1fd09cf (stale) CRC-32 checksum value for chunk [0, 0x2fff): Mirror 1: 0x1fd09cf Mirror 13: 0x1fd09cf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fff: skipped 000519 1781238999.748796 MIRROR_RESYNC 5 mirrors 000520 1781239000.632791 punch from 0x000112 to 0x002ffe (0x2eed bytes) 000521 1781239000.701963 trunc from 0x002fff to 0x01889e (0x158a0 bytes) 000522 1781239000.727119 trunc from 0x00c30f to 0x013855 (0x7547 bytes) 000523 1781239000.731155 read 0x004c57 thru 0x00efcf (0xa379 bytes) 000524 1781239000.746480 trunc from 0x01889f to 0x016aa0 (0x1dfe bytes) 000525 1781239000.762990 write 0x03439a thru 0x03a60e (0x6275 bytes) 000527 1781239000.765815 write 0x02dafb thru 0x0303ea (0x28f0 bytes) 000529 1781239000.784548 mapread 0x001b38 thru 0x0113d0 (0xf899 bytes) 000530 1781239000.817549 trunc from 0x013477 to 0x021269 (0xddf3 bytes) 000531 1781239000.833906 fallocate 0x02a896 thru 0x0375f1 (0xcd5c bytes) 000532 1781239000.843104 fallocate 0x02d3d6 thru 0x02f6b0 (0x22db bytes) 000533 1781239000.857652 mapread 0x01cc5d thru 0x02a2fc (0xd6a0 bytes) 000535 1781239000.898891 punch from 0x034161 to 0x036e41 (0x2ce1 bytes) 000536 1781239000.926052 mapread 0x0058eb thru 0x00ed40 (0x9456 bytes) 000537 1781239000.927484 write 0x0162bd thru 0x017a3b (0x177f bytes) 000538 1781239000.932096 read 0x0395b2 thru 0x03a60e (0x105d bytes) 000539 1781239000.945353 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3a60f): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a60f): Mirror 8: 0x322f6901 (stale) Mirror 11: 0x322f6901 (stale) Mirror 12: 0x322f6901 (stale) Mirror 13: 0x322f6901 (stale) CRC-32 checksum value for chunk [0, 0x3a60f): Mirror 1: 0xe4f69f59 Mirror 14: 0xe4f69f59 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a60f: skipped 000540 1781239002.174491 mapwrite 0x00184b thru 0x005c37 (0x43ed bytes) 000541 1781239002.263564 mapwrite 0x011ef1 thru 0x01a373 (0x8483 bytes) 000542 1781239002.311162 mapwrite 0x0071cb thru 0x007f07 (0xd3d bytes) 000543 1781239002.342339 fallocate 0x009359 thru 0x01856e (0xf216 bytes) 000544 1781239002.348871 trunc from 0x03a60f to 0x0078b9 (0x32d55 bytes) 000545 1781239002.378167 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x78ba): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x78ba): Mirror 8: 0xa653ba7f (stale) Mirror 11: 0xa653ba7f (stale) Mirror 12: 0xa653ba7f (stale) Mirror 13: 0xa653ba7f (stale) Mirror 14: 0x320b5def (stale) CRC-32 checksum value for chunk [0, 0x78ba): Mirror 1: 0x7d834edf Mirror 15: 0x7d834edf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x78ba: skipped 000547 1781239003.386352 trunc from 0x0078ba to 0x03ca43 (0x3518a bytes) 000549 1781239003.439539 trunc from 0x015a0d to 0x02086a (0xae5e bytes) 000550 1781239003.445433 trunc from 0x03ca44 to 0x00fcf0 (0x2cd53 bytes) 000551 1781239003.477580 fallocate 0x01a9fd thru 0x0202ba (0x58be bytes) 000553 1781239003.499923 MIRROR_RESYNC 7 mirrors 000554 1781239005.485781 mapwrite 0x03e62d thru 0x03ffff (0x19d3 bytes) 000555 1781239005.646612 read 0x008804 thru 0x0137fa (0xaff7 bytes) 000556 1781239005.663163 fallocate 0x02f243 thru 0x037434 (0x81f2 bytes) 000557 1781239005.669554 trunc from 0x040000 to 0x00e706 (0x318f9 bytes) 000558 1781239005.697560 read 0x003886 thru 0x00a2d6 (0x6a51 bytes) 000559 1781239005.714770 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe707): Mirror 8: 0x4fce3bc9 (stale) Mirror 12: 0x4fce3bc9 (stale) Mirror 13: 0x4fce3bc9 (stale) Mirror 14: 0x4fce3bc9 (stale) Mirror 15: 0x4fce3bc9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe707): Mirror 8: 0x4fce3bc9 (stale) Mirror 12: 0x4fce3bc9 (stale) Mirror 13: 0x4fce3bc9 (stale) Mirror 14: 0x4fce3bc9 (stale) Mirror 15: 0x4fce3bc9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe707: skipped 000560 1781239006.228408 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xe707): Mirror 8: 0x4fce3bc9 (stale) Mirror 13: 0x4fce3bc9 (stale) Mirror 14: 0x4fce3bc9 (stale) Mirror 15: 0x4fce3bc9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe707): Mirror 8: 0x4fce3bc9 (stale) Mirror 13: 0x4fce3bc9 (stale) Mirror 14: 0x4fce3bc9 (stale) Mirror 15: 0x4fce3bc9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe707: skipped 000561 1781239006.587992 fallocate 0x0213cb thru 0x025742 (0x4378 bytes) 000562 1781239006.594132 mapwrite 0x02e37a thru 0x0357c8 (0x744f bytes) 000563 1781239006.688434 fallocate 0x02cc30 thru 0x02cec8 (0x299 bytes) 000564 1781239006.694617 read 0x01e22b thru 0x02ddb1 (0xfb87 bytes) 000565 1781239006.705241 trunc from 0x0357c9 to 0x01835f (0x1d469 bytes) 000566 1781239006.739767 write 0x02846d thru 0x0321ed (0x9d81 bytes) 000567 1781239006.741592 punch from 0x01e311 to 0x02776c (0x945c bytes) 000568 1781239006.762028 MIRROR_RESYNC 5 mirrors 000569 1781239008.020125 mapwrite 0x0368bf thru 0x03ffff (0x9741 bytes) 000570 1781239008.101589 fallocate 0x016390 thru 0x024d1b (0xe98c bytes) 000571 1781239008.107503 trunc from 0x02f18e to 0x03775a (0x85cd bytes) 000572 1781239008.114692 mapread 0x013a76 thru 0x0212a6 (0xd831 bytes) 000573 1781239008.135031 read 0x022333 thru 0x02de6d (0xbb3b bytes) 000574 1781239008.143992 mapwrite 0x01cad9 thru 0x02a356 (0xd87e bytes) 000576 1781239008.166213 trunc from 0x040000 to 0x030938 (0xf6c7 bytes) 000578 1781239008.230850 mapwrite 0x0355f1 thru 0x03bdcc (0x67dc bytes) 000579 1781239008.296420 mapwrite 0x035ff3 thru 0x03b66a (0x5678 bytes) 000581 1781239008.336626 punch from 0x004fd1 to 0x010b1a (0xbb4a bytes) 000582 1781239008.341355 fallocate 0x02db0f thru 0x03a8d4 (0xcdc6 bytes) 000583 1781239008.354490 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bdcd): Mirror 13: 0x33e0e7df (stale) Mirror 14: 0x33e0e7df (stale) Mirror 15: 0x33e0e7df (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bdcd): Mirror 13: 0x33e0e7df (stale) Mirror 14: 0x33e0e7df (stale) Mirror 15: 0x33e0e7df (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bdcd: skipped 000586 1781239008.732986 fallocate 0x00a1f1 thru 0x00eb60 (0x4970 bytes) 000587 1781239008.739157 write 0x00dc95 thru 0x0181ac (0xa518 bytes) 000589 1781239008.755723 mapwrite 0x03b443 thru 0x03ffff (0x4bbd bytes) 000590 1781239008.789819 mapwrite 0x019775 thru 0x01df38 (0x47c4 bytes) 000591 1781239008.811033 punch from 0x02aece to 0x036d2f (0xbe62 bytes) 000592 1781239008.816749 punch from 0x026ba0 to 0x02b1f2 (0x4653 bytes) 000593 1781239008.825498 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x24e46b83 (stale) Mirror 14: 0x24e46b83 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x24e46b83 (stale) Mirror 14: 0x24e46b83 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000594 1781239009.087015 mapread 0x03a038 thru 0x03ffff (0x5fc8 bytes) 000595 1781239009.104033 mapread 0x037a4d thru 0x03dbe0 (0x6194 bytes) 000597 1781239009.110212 MIRROR_RESYNC 3 mirrors 000598 1781239010.043003 mapwrite 0x023104 thru 0x0322bf (0xf1bc bytes) 000599 1781239010.238761 punch from 0x02406f to 0x02e41e (0xa3b0 bytes) 000602 1781239010.262174 punch from 0x01b644 to 0x01e1e3 (0x2ba0 bytes) 000603 1781239010.274402 fallocate 0x0297c8 thru 0x02f62f (0x5e68 bytes) 000604 1781239010.281246 write 0x003e30 thru 0x008c49 (0x4e1a bytes) 000605 1781239010.295178 read 0x005351 thru 0x00e03e (0x8cee bytes) 000606 1781239010.298150 trunc from 0x040000 to 0x02b8e1 (0x1471e bytes) 000607 1781239010.328703 write 0x039ee3 thru 0x03ffff (0x611d bytes) 000608 1781239010.332179 read 0x00e713 thru 0x0146e5 (0x5fd3 bytes) 000609 1781239010.372993 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xc5bbac43 (stale) Mirror 14: 0xc5bbac43 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa635def4 Mirror 15: 0xa635def4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000610 1781239011.346418 mapwrite 0x01dd0f thru 0x022f61 (0x5253 bytes) 000611 1781239011.487201 mapread 0x036ca4 thru 0x03ffff (0x935c bytes) 000612 1781239011.553806 mapwrite 0x03b989 thru 0x03ffff (0x4677 bytes) 000613 1781239011.600194 mapread 0x01d763 thru 0x02339b (0x5c39 bytes) 000614 1781239011.607206 fallocate 0x035847 thru 0x039920 (0x40da bytes) 000615 1781239011.615329 trunc from 0x040000 to 0x02c28b (0x13d74 bytes) 000616 1781239011.699509 write 0x0154f3 thru 0x02428a (0xed98 bytes) 000617 1781239011.716622 mapwrite 0x036527 thru 0x03c098 (0x5b72 bytes) 000618 1781239011.768204 mapwrite 0x0138d5 thru 0x01a1fd (0x6929 bytes) 000619 1781239011.792901 trunc from 0x038fad to 0x03c098 (0x30ec bytes) 000620 1781239011.803334 read 0x01b11d thru 0x025613 (0xa4f7 bytes) 000621 1781239011.803991 mapwrite 0x00d0d2 thru 0x0188bf (0xb7ee bytes) 000622 1781239011.859653 mapwrite 0x01c42c thru 0x026fda (0xabaf bytes) 000623 1781239011.893394 fallocate 0x0083e2 thru 0x00fa07 (0x7626 bytes) 000624 1781239011.905312 mapread 0x01eb05 thru 0x02168a (0x2b86 bytes) 000625 1781239011.906380 read 0x006c4f thru 0x006e8a (0x23c bytes) 000626 1781239011.907353 write 0x029f0e thru 0x03847d (0xe570 bytes) 000628 1781239011.931942 read 0x02604e thru 0x0295dc (0x358f bytes) 000629 1781239011.933053 trunc from 0x03c099 to 0x016e5b (0x2523d bytes) 000630 1781239011.948635 trunc from 0x016e5c to 0x039dd0 (0x22f75 bytes) 000632 1781239011.964854 write 0x0140f6 thru 0x01e25f (0xa16a bytes) 000633 1781239011.974781 write 0x018c38 thru 0x0229a9 (0x9d72 bytes) 000634 1781239011.987909 punch from 0x025aa7 to 0x02dcdf (0x8239 bytes) 000635 1781239011.994392 trunc from 0x039dd1 to 0x008938 (0x31498 bytes) 000636 1781239012.008514 read 0x004fdd thru 0x008938 (0x395c bytes) 000637 1781239012.009158 mapread 0x0086f4 thru 0x008938 (0x245 bytes) 000638 1781239012.010028 mapread 0x001751 thru 0x003f39 (0x27e9 bytes) 000640 1781239012.011732 read 0x004f3f thru 0x008938 (0x39fa bytes) 000641 1781239012.012383 read 0x005182 thru 0x008938 (0x37b7 bytes) 000642 1781239012.012919 punch from 0x006d67 to 0x008938 (0x1bd2 bytes) 000643 1781239012.021442 trunc from 0x008939 to 0x00128f (0x76a9 bytes) 000644 1781239012.053599 write 0x03fbd5 thru 0x03ffff (0x42b bytes) 000645 1781239012.056051 mapwrite 0x02f37b thru 0x02fe96 (0xb1c bytes) 000646 1781239012.088502 punch from 0x02f805 to 0x03923e (0x9a3a bytes) 000647 1781239012.097961 mapwrite 0x016663 thru 0x0186f5 (0x2093 bytes) 000648 1781239012.116308 write 0x01d5de thru 0x01d915 (0x338 bytes) 000649 1781239012.117325 punch from 0x00fb5d to 0x0123d3 (0x2877 bytes) 000650 1781239012.141502 trunc from 0x01d41e to 0x02062c (0x320f bytes) 000651 1781239012.167883 MIRROR_RESYNC 4 mirrors 000653 1781239013.583092 write 0x00d9ad thru 0x012096 (0x46ea bytes) 000654 1781239013.637426 mapwrite 0x002372 thru 0x00d818 (0xb4a7 bytes) 000655 1781239013.671097 mapwrite 0x023c29 thru 0x02f3c0 (0xb798 bytes) 000656 1781239013.732677 write 0x01f0a7 thru 0x02dab1 (0xea0b bytes) 000657 1781239013.735758 mapread 0x01c5cd thru 0x01e126 (0x1b5a bytes) 000658 1781239013.738497 mapwrite 0x00a420 thru 0x00bb58 (0x1739 bytes) 000659 1781239013.768031 punch from 0x01ccb4 to 0x0200d5 (0x3422 bytes) 000661 1781239013.773577 mapread 0x0226c9 thru 0x02b086 (0x89be bytes) 000662 1781239013.774808 mapwrite 0x001281 thru 0x010265 (0xefe5 bytes) 000663 1781239013.801034 trunc from 0x0347d9 to 0x0354e7 (0xd0f bytes) 000664 1781239013.806286 mapwrite 0x03ceb0 thru 0x03ffff (0x3150 bytes) 000665 1781239013.832880 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xfd0c63a3 (stale) Mirror 14: 0xfd0c63a3 (stale) Mirror 15: 0xfd0c63a3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4c4913f6 Mirror 16: 0x4c4913f6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000666 1781239014.958719 mapwrite 0x010f0b thru 0x012752 (0x1848 bytes) 000667 1781239015.129848 write 0x01dd8b thru 0x01e489 (0x6ff bytes) 000668 1781239015.151369 trunc from 0x040000 to 0x028748 (0x178b7 bytes) 000669 1781239015.173130 mapread 0x0025ca thru 0x010c28 (0xe65f bytes) 000670 1781239015.193127 trunc from 0x028749 to 0x03385d (0xb115 bytes) 000671 1781239015.214970 punch from 0x01d59c to 0x01d8d2 (0x337 bytes) 000672 1781239015.220656 trunc from 0x00e494 to 0x018498 (0xa005 bytes) 000673 1781239015.227595 mapwrite 0x01c026 thru 0x026cc8 (0xaca3 bytes) 000674 1781239015.291540 fallocate 0x031fe0 thru 0x03ffff (0xe020 bytes) 000675 1781239015.306595 trunc from 0x03385e to 0x00dbf6 (0x25c67 bytes) 000676 1781239015.347758 read 0x008539 thru 0x00dbf6 (0x56be bytes) 000677 1781239015.353139 fallocate 0x03ee49 thru 0x03ffff (0x11b7 bytes) 000678 1781239015.363954 trunc from 0x0060f6 to 0x00dbf6 (0x7b01 bytes) 000679 1781239015.373585 mapread 0x00d521 thru 0x00dbf6 (0x6d6 bytes) 000680 1781239015.398564 trunc from 0x00d556 to 0x00dbf6 (0x6a1 bytes) 000681 1781239015.419756 trunc from 0x00dbf7 to 0x01cf41 (0xf34b bytes) 000682 1781239015.450381 mapread 0x0036cf thru 0x00ae75 (0x77a7 bytes) 000683 1781239015.456854 MIRROR_RESYNC 5 mirrors 000684 1781239017.045744 mapwrite 0x00aa2c thru 0x01a605 (0xfbda bytes) 000685 1781239017.242083 mapread 0x000bc6 thru 0x00522a (0x4665 bytes) 000686 1781239017.263829 punch from 0x00aeae to 0x01678e (0xb8e1 bytes) 000687 1781239017.270553 trunc from 0x00104b to 0x006df3 (0x5da9 bytes) 000688 1781239017.275393 punch from 0x0068ec to 0x00d3a9 (0x6abe bytes) 000689 1781239017.283243 read 0x01c72b thru 0x01cf41 (0x817 bytes) 000690 1781239017.283926 mapwrite 0x017045 thru 0x017478 (0x434 bytes) 000691 1781239017.316659 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1cf42): Mirror 14: 0x41ab3b46 (stale) Mirror 15: 0x41ab3b46 (stale) Mirror 16: 0x41ab3b46 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1cf42): Mirror 14: 0x41ab3b46 (stale) Mirror 15: 0x41ab3b46 (stale) Mirror 16: 0x41ab3b46 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1cf42: skipped 000692 1781239017.799730 punch from 0x000543 to 0x009092 (0x8b50 bytes) 000693 1781239017.804009 trunc from 0x0119e0 to 0x01cf41 (0xb562 bytes) 000694 1781239017.812290 read 0x010577 thru 0x014168 (0x3bf2 bytes) 000695 1781239017.831146 trunc from 0x01a386 to 0x01cf41 (0x2bbc bytes) 000696 1781239017.844387 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1cf42): Mirror 14: 0x41ab3b46 (stale) Mirror 16: 0x41ab3b46 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1cf42): Mirror 14: 0x41ab3b46 (stale) Mirror 16: 0x41ab3b46 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1cf42: skipped 000697 1781239018.305716 write 0x03fc85 thru 0x03ffff (0x37b bytes) 000698 1781239018.313766 trunc from 0x0392c8 to 0x03ffff (0x6d38 bytes) 000699 1781239018.341596 punch from 0x01023b to 0x019015 (0x8ddb bytes) 000701 1781239018.358746 trunc from 0x02853a to 0x0317b6 (0x927d bytes) 000702 1781239018.377608 MIRROR_RESYNC 3 mirrors 000703 1781239019.265645 trunc from 0x03dbcc to 0x03ffff (0x2434 bytes) 000704 1781239019.322655 mapwrite 0x0189e6 thru 0x020ed1 (0x84ec bytes) 000705 1781239019.423987 punch from 0x012df5 to 0x01a2dd (0x74e9 bytes) 000706 1781239019.438119 trunc from 0x01374a to 0x022107 (0xe9be bytes) 000707 1781239019.449847 fallocate 0x032038 thru 0x037164 (0x512d bytes) 000708 1781239019.456022 trunc from 0x0198a8 to 0x023b5e (0xa2b7 bytes) 000709 1781239019.468647 mapwrite 0x037775 thru 0x03ffff (0x888b bytes) 000710 1781239019.520626 fallocate 0x0144d2 thru 0x01c6ed (0x821c bytes) 000711 1781239019.535326 mapread 0x0079de thru 0x015a68 (0xe08b bytes) 000712 1781239019.573656 write 0x00af0e thru 0x012e52 (0x7f45 bytes) 000713 1781239019.578054 trunc from 0x02c261 to 0x033203 (0x6fa3 bytes) 000714 1781239019.591199 write 0x020fe4 thru 0x0296ef (0x870c bytes) 000715 1781239019.627804 punch from 0x019a2b to 0x0243c1 (0xa997 bytes) 000716 1781239019.657517 fallocate 0x017369 thru 0x024012 (0xccaa bytes) 000717 1781239019.668319 mapread 0x029883 thru 0x02b1be (0x193c bytes) 000718 1781239019.703654 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 16: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000719 1781239020.190305 trunc from 0x02c8e9 to 0x02d7cb (0xee3 bytes) 000720 1781239020.202889 mapwrite 0x036896 thru 0x03f8cd (0x9038 bytes) 000721 1781239020.274310 trunc from 0x040000 to 0x01cdef (0x23210 bytes) 000722 1781239020.321522 mapread 0x015ec0 thru 0x01cdef (0x6f30 bytes) 000723 1781239020.352839 read 0x00ec9b thru 0x01bfd2 (0xd338 bytes) 000724 1781239020.363602 MIRROR_RESYNC 2 mirrors 000725 1781239021.333940 trunc from 0x00d7de to 0x01cdef (0xf612 bytes) 000726 1781239021.375987 mapread 0x00a81e thru 0x00da97 (0x327a bytes) 000727 1781239021.406488 MIRROR_RESYNC 2 mirrors 000728 1781239022.243070 punch from 0x0165f5 to 0x01cdef (0x67fb bytes) 000729 1781239022.293136 fallocate 0x000b87 thru 0x00edfd (0xe277 bytes) 000730 1781239022.299191 fallocate 0x00ee51 thru 0x017ac4 (0x8c74 bytes) 000731 1781239022.305827 fallocate 0x022106 thru 0x0290c6 (0x6fc1 bytes) 000733 1781239022.313190 trunc from 0x0187cc to 0x01cdef (0x4624 bytes) 000734 1781239022.318310 read 0x01ca2e thru 0x01cdef (0x3c2 bytes) 000736 1781239022.328708 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1cdf0): Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1cdf0): Mirror 16: 0x7bf66e05 (stale) CRC-32 checksum value for chunk [0, 0x1cdf0): Mirror 1: 0x7bf66e05 Mirror 17: 0x7bf66e05 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1cdf0: skipped 000737 1781239023.149268 punch from 0x01594a to 0x0182ee (0x29a5 bytes) 000738 1781239023.225080 write 0x0198d9 thru 0x028400 (0xeb28 bytes) 000740 1781239023.243853 mapread 0x00f497 thru 0x01d05e (0xdbc8 bytes) 000741 1781239023.276451 write 0x0314a3 thru 0x038bdb (0x7739 bytes) 000742 1781239023.277883 trunc from 0x038bdc to 0x032494 (0x6747 bytes) 000743 1781239023.313055 read 0x007571 thru 0x009b85 (0x2615 bytes) 000745 1781239023.325038 read 0x0180f7 thru 0x0229d8 (0xa8e2 bytes) 000746 1781239023.341647 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x32495): Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32495): Mirror 16: 0xe5b10387 (stale) Mirror 17: 0xe5b10387 (stale) CRC-32 checksum value for chunk [0, 0x32495): Mirror 1: 0xe1c1be80 Mirror 18: 0xe1c1be80 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32495: skipped 000747 1781239024.586832 trunc from 0x032495 to 0x02743e (0xb056 bytes) 000749 1781239024.757281 trunc from 0x022478 to 0x0259f2 (0x357b bytes) 000750 1781239024.770011 mapread 0x009cc8 thru 0x0129be (0x8cf7 bytes) 000751 1781239024.857056 mapwrite 0x000e83 thru 0x00f332 (0xe4b0 bytes) 000752 1781239024.898263 punch from 0x01acf8 to 0x027329 (0xc632 bytes) 000753 1781239024.905787 trunc from 0x014e1a to 0x01ad75 (0x5f5c bytes) 000754 1781239024.933861 mapwrite 0x02cef6 thru 0x039ecc (0xcfd7 bytes) 000755 1781239025.076260 trunc from 0x00a173 to 0x015938 (0xb7c6 bytes) 000757 1781239025.112039 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x39ecd): Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39ecd): Mirror 16: 0x1d6e1258 (stale) Mirror 17: 0x1d6e1258 (stale) Mirror 18: 0x333efa06 (stale) CRC-32 checksum value for chunk [0, 0x39ecd): Mirror 1: 0xe5346d3c Mirror 19: 0xe5346d3c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39ecd: skipped 000758 1781239026.858545 punch from 0x00e41b to 0x010856 (0x243c bytes) 000759 1781239026.900522 read 0x007975 thru 0x011398 (0x9a24 bytes) 000760 1781239026.909285 trunc from 0x039ecd to 0x017bdb (0x222f1 bytes) 000762 1781239026.935482 trunc from 0x008c18 to 0x016124 (0xd50d bytes) 000763 1781239026.941740 mapread 0x0067c7 thru 0x0114c3 (0xacfd bytes) 000764 1781239026.993249 fallocate 0x02db36 thru 0x0331a6 (0x5671 bytes) 000765 1781239026.999629 fallocate 0x00346c thru 0x00f89f (0xc434 bytes) 000766 1781239027.006877 trunc from 0x0331a7 to 0x01ec79 (0x1452d bytes) 000767 1781239027.022591 fallocate 0x0104e3 thru 0x0143b0 (0x3ece bytes) 000768 1781239027.029954 trunc from 0x01ec7a to 0x00b32a (0x1394f bytes) 000769 1781239027.097136 trunc from 0x00b32b to 0x02a980 (0x1f656 bytes) 000770 1781239027.133132 punch from 0x017efd to 0x01ee0f (0x6f13 bytes) 000771 1781239027.159644 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a981): Mirror 16: 0x8f2988e7 (stale) Mirror 18: 0xc739fa93 (stale) Mirror 19: 0x62f3944f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a981): Mirror 16: 0x8f2988e7 (stale) Mirror 18: 0xc739fa93 (stale) Mirror 19: 0x62f3944f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a981: skipped 000772 1781239027.726073 punch from 0x01616c to 0x018f4a (0x2ddf bytes) 000773 1781239027.733920 mapwrite 0x004c9b thru 0x00e7c6 (0x9b2c bytes) 000774 1781239027.786976 MIRROR_RESYNC 4 mirrors 000775 1781239028.775981 mapread 0x027149 thru 0x028772 (0x162a bytes) 000776 1781239028.800948 trunc from 0x02a981 to 0x02bd7c (0x13fc bytes) 000777 1781239028.884867 mapwrite 0x013fc0 thru 0x01761e (0x365f bytes) 000778 1781239028.934286 fallocate 0x01ea36 thru 0x028297 (0x9862 bytes) 000779 1781239028.944374 mapwrite 0x00a143 thru 0x015546 (0xb404 bytes) 000781 1781239029.005749 mapwrite 0x02978d thru 0x02f17e (0x59f2 bytes) 000782 1781239029.091849 read 0x02a0f0 thru 0x02b70f (0x1620 bytes) 000783 1781239029.093160 read 0x025f67 thru 0x02f17e (0x9218 bytes) 000784 1781239029.096197 trunc from 0x02f17f to 0x013b9b (0x1b5e3 bytes) 000785 1781239029.124879 write 0x03f13b thru 0x03ffff (0xec5 bytes) 000786 1781239029.130983 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0xa6682823 (stale) Mirror 19: 0xa6682823 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 18: 0xa6682823 (stale) Mirror 19: 0xa6682823 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000787 1781239029.806529 fallocate 0x0308c8 thru 0x03f5a4 (0xecdd bytes) 000788 1781239029.829837 mapread 0x02e067 thru 0x037f8d (0x9f27 bytes) 000789 1781239029.867767 mapread 0x03dc48 thru 0x03ffff (0x23b8 bytes) 000790 1781239029.880889 fallocate 0x01fb64 thru 0x027896 (0x7d33 bytes) 000791 1781239029.890035 mapread 0x00f4ed thru 0x01d458 (0xdf6c bytes) 000792 1781239029.919632 write 0x028646 thru 0x034948 (0xc303 bytes) 000793 1781239029.935278 punch from 0x02b1f4 to 0x02ca3f (0x184c bytes) 000794 1781239029.951938 mapwrite 0x019936 thru 0x01cbb3 (0x327e bytes) 000795 1781239029.979715 mapread 0x01954f thru 0x02723f (0xdcf1 bytes) 000796 1781239029.982562 trunc from 0x040000 to 0x010a7a (0x2f585 bytes) 000797 1781239030.020599 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x10a7b): Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10a7b): Mirror 18: 0x2b9a54e (stale) Mirror 19: 0x2b9a54e (stale) CRC-32 checksum value for chunk [0, 0x10a7b): Mirror 1: 0xe839cb5e Mirror 20: 0xe839cb5e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10a7b: skipped 000799 1781239030.846127 fallocate 0x017aa5 thru 0x01dcc5 (0x6221 bytes) 000800 1781239030.894040 mapwrite 0x025936 thru 0x02ae12 (0x54dd bytes) 000801 1781239030.948566 punch from 0x010154 to 0x01fbba (0xfa67 bytes) 000802 1781239030.954304 punch from 0x01599d to 0x024b57 (0xf1bb bytes) 000803 1781239030.959743 mapread 0x0260d2 thru 0x02ae12 (0x4d41 bytes) 000804 1781239030.960837 punch from 0x01086d to 0x01dbe9 (0xd37d bytes) 000805 1781239030.972143 write 0x014c1c thru 0x01bc66 (0x704b bytes) 000806 1781239030.991661 trunc from 0x028331 to 0x02ae12 (0x2ae2 bytes) 000807 1781239030.998028 trunc from 0x02ae13 to 0x00d24e (0x1dbc4 bytes) 000808 1781239031.017303 trunc from 0x00d24f to 0x023d39 (0x16aeb bytes) 000810 1781239031.038922 read 0x00c94d thru 0x014b68 (0x821c bytes) 000812 1781239031.069313 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x23d3a): Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23d3a): Mirror 18: 0xc94e6b25 (stale) Mirror 19: 0xc94e6b25 (stale) Mirror 20: 0xedf0559b (stale) CRC-32 checksum value for chunk [0, 0x23d3a): Mirror 1: 0x1e66b73b Mirror 21: 0x1e66b73b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23d3a: skipped 000813 1781239032.080941 trunc from 0x023d3a to 0x005f20 (0x1de19 bytes) 000815 1781239032.217796 trunc from 0x005f21 to 0x026f66 (0x21046 bytes) 000816 1781239032.289361 trunc from 0x026f67 to 0x008dae (0x1e1b8 bytes) 000817 1781239032.326741 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x8daf): Mirror 18: 0xa709d46c (stale) Mirror 20: 0xa709d46c (stale) Mirror 21: 0xa709d46c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8daf): Mirror 18: 0xa709d46c (stale) Mirror 20: 0xa709d46c (stale) Mirror 21: 0xa709d46c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8daf: skipped 000818 1781239032.617113 write 0x02fde1 thru 0x032763 (0x2983 bytes) 000819 1781239032.621965 mapread 0x02e3fe thru 0x032763 (0x4366 bytes) 000820 1781239032.628852 fallocate 0x03f2b7 thru 0x03ffff (0xd49 bytes) 000821 1781239032.634130 write 0x03cb5d thru 0x03f460 (0x2904 bytes) 000822 1781239032.636414 fallocate 0x038173 thru 0x03aad4 (0x2962 bytes) 000823 1781239032.641367 punch from 0x010b99 to 0x011d3f (0x11a7 bytes) 000824 1781239032.645847 trunc from 0x03f461 to 0x000697 (0x3edc9 bytes) 000825 1781239032.666259 read 0x0002c2 thru 0x000697 (0x3d6 bytes) 000826 1781239032.673895 read 0x0002e0 thru 0x000697 (0x3b8 bytes) 000827 1781239032.674925 mapwrite 0x033bf4 thru 0x03f5ae (0xb9bb bytes) 000828 1781239032.729023 mapread 0x01589d thru 0x0253ef (0xfb53 bytes) 000829 1781239032.731153 fallocate 0x010357 thru 0x01b9d9 (0xb683 bytes) 000830 1781239032.737336 mapread 0x00b2b8 thru 0x00ccb5 (0x19fe bytes) 000831 1781239032.738484 mapwrite 0x001083 thru 0x0083a6 (0x7324 bytes) 000832 1781239032.803159 MIRROR_RESYNC 4 mirrors 000833 1781239034.321361 mapread 0x031d44 thru 0x035373 (0x3630 bytes) 000834 1781239034.395114 MIRROR_EXTEND to 5 mirrors 000835 1781239035.479082 read 0x00edd6 thru 0x00f8ef (0xb1a bytes) 000836 1781239035.484124 fallocate 0x010537 thru 0x01fbd6 (0xf6a0 bytes) 000838 1781239035.552708 trunc from 0x03f5af to 0x0220aa (0x1d504 bytes) 000839 1781239035.587010 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x220ab): Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x220ab): Mirror 18: 0x417a1a6b (stale) Mirror 20: 0x417a1a6b (stale) Mirror 21: 0x417a1a6b (stale) Mirror 22: 0x417a1a6b (stale) CRC-32 checksum value for chunk [0, 0x220ab): Mirror 1: 0x417a1a6b Mirror 23: 0x417a1a6b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x220ab: skipped 000840 1781239036.587542 mapread 0x004311 thru 0x0139e0 (0xf6d0 bytes) 000841 1781239036.645451 punch from 0x011dd7 to 0x01581a (0x3a44 bytes) 000843 1781239036.755415 trunc from 0x00c8cd to 0x018f60 (0xc694 bytes) 000844 1781239036.763489 punch from 0x00c656 to 0x01ac50 (0xe5fb bytes) 000845 1781239036.774975 mapread 0x015a94 thru 0x01d4b4 (0x7a21 bytes) 000846 1781239036.794764 punch from 0x008bb8 to 0x015432 (0xc87b bytes) 000847 1781239036.804722 write 0x028451 thru 0x033958 (0xb508 bytes) 000848 1781239036.817023 mapread 0x000a80 thru 0x00fe7b (0xf3fc bytes) 000851 1781239036.846662 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33959): Mirror 18: 0x611ca4d5 (stale) Mirror 21: 0x611ca4d5 (stale) Mirror 22: 0x611ca4d5 (stale) Mirror 23: 0x611ca4d5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33959): Mirror 18: 0x611ca4d5 (stale) Mirror 21: 0x611ca4d5 (stale) Mirror 22: 0x611ca4d5 (stale) Mirror 23: 0x611ca4d5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33959: skipped 000852 1781239037.490022 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x33959): Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33959): Mirror 18: 0x611ca4d5 (stale) Mirror 21: 0x611ca4d5 (stale) Mirror 22: 0x611ca4d5 (stale) Mirror 23: 0x611ca4d5 (stale) CRC-32 checksum value for chunk [0, 0x33959): Mirror 1: 0x3eb0b3e5 Mirror 24: 0x3eb0b3e5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33959: skipped 000853 1781239038.746757 read 0x000d13 thru 0x001f8b (0x1279 bytes) 000854 1781239038.761115 trunc from 0x033959 to 0x02cd3a (0x6c1e bytes) 000855 1781239038.819557 read 0x0284d8 thru 0x02cd3a (0x4863 bytes) 000856 1781239038.840115 punch from 0x00aa2f to 0x00d521 (0x2af3 bytes) 000857 1781239038.845690 trunc from 0x02cd3b to 0x0007c8 (0x2c572 bytes) 000858 1781239038.869016 mapwrite 0x01b025 thru 0x01d9eb (0x29c7 bytes) 000859 1781239038.915053 trunc from 0x0102c4 to 0x01d9eb (0xd728 bytes) 000860 1781239038.919970 trunc from 0x01d9ec to 0x024f0d (0x7522 bytes) 000861 1781239038.944084 MIRROR_RESYNC 6 mirrors 000862 1781239040.231813 trunc from 0x013d99 to 0x01b3c3 (0x762b bytes) 000863 1781239040.262036 trunc from 0x01774c to 0x022ba8 (0xb45d bytes) 000864 1781239040.267294 punch from 0x010188 to 0x01ea3b (0xe8b4 bytes) 000865 1781239040.275160 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x24f0e): Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24f0e): Mirror 18: 0x3dd9a11f (stale) Mirror 21: 0x3dd9a11f (stale) Mirror 22: 0x3dd9a11f (stale) Mirror 23: 0x3dd9a11f (stale) Mirror 24: 0x3dd9a11f (stale) CRC-32 checksum value for chunk [0, 0x24f0e): Mirror 1: 0x3dd9a11f Mirror 25: 0x3dd9a11f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24f0e: skipped 000866 1781239041.016652 punch from 0x00b3d2 to 0x018d4f (0xd97e bytes) 000868 1781239041.053764 write 0x035602 thru 0x03ba45 (0x6444 bytes) 000869 1781239041.058260 mapread 0x01bd28 thru 0x02344e (0x7727 bytes) 000870 1781239041.074169 read 0x02e847 thru 0x03640d (0x7bc7 bytes) 000871 1781239041.082045 read 0x01516c thru 0x0155ba (0x44f bytes) 000872 1781239041.102197 trunc from 0x03ba46 to 0x030bf8 (0xae4d bytes) 000873 1781239041.124956 fallocate 0x01dc2d thru 0x021ba5 (0x3f79 bytes) 000875 1781239041.138411 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30bf9): Mirror 18: 0x574c5c3a (stale) Mirror 21: 0x574c5c3a (stale) Mirror 23: 0x574c5c3a (stale) Mirror 24: 0x574c5c3a (stale) Mirror 25: 0x574c5c3a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30bf9): Mirror 18: 0x574c5c3a (stale) Mirror 21: 0x574c5c3a (stale) Mirror 23: 0x574c5c3a (stale) Mirror 24: 0x574c5c3a (stale) Mirror 25: 0x574c5c3a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30bf9: skipped 000876 1781239041.541052 mapwrite 0x022fa8 thru 0x027cd8 (0x4d31 bytes) 000877 1781239041.586114 mapwrite 0x02b6d5 thru 0x03b61c (0xff48 bytes) 000878 1781239041.664639 write 0x01f048 thru 0x0214f5 (0x24ae bytes) 000879 1781239041.665829 write 0x035a7a thru 0x0397b8 (0x3d3f bytes) 000880 1781239041.667449 read 0x0170b9 thru 0x023311 (0xc259 bytes) 000881 1781239041.678610 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b61d): Mirror 21: 0x5e88be79 (stale) Mirror 23: 0x5e88be79 (stale) Mirror 24: 0x5e88be79 (stale) Mirror 25: 0x5e88be79 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b61d): Mirror 21: 0x5e88be79 (stale) Mirror 23: 0x5e88be79 (stale) Mirror 24: 0x5e88be79 (stale) Mirror 25: 0x5e88be79 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b61d: skipped 000882 1781239042.179604 read 0x00f871 thru 0x01599d (0x612d bytes) 000883 1781239042.196654 mapwrite 0x0287ed thru 0x029e85 (0x1699 bytes) 000884 1781239042.236315 trunc from 0x011291 to 0x01f045 (0xddb5 bytes) 000885 1781239042.250397 trunc from 0x033829 to 0x03b61c (0x7df4 bytes) 000886 1781239042.266526 punch from 0x01e54b to 0x027619 (0x90cf bytes) 000887 1781239042.274985 mapwrite 0x0171d2 thru 0x019a70 (0x289f bytes) 000888 1781239042.313607 fallocate 0x00eb67 thru 0x0120dc (0x3576 bytes) 000890 1781239042.327968 read 0x015729 thru 0x02489b (0xf173 bytes) 000891 1781239042.342195 trunc from 0x01b4b6 to 0x022675 (0x71c0 bytes) 000893 1781239042.357021 trunc from 0x03b61d to 0x006529 (0x350f3 bytes) 000894 1781239042.385948 punch from 0x00407e to 0x006529 (0x24ac bytes) 000895 1781239042.391319 trunc from 0x00652a to 0x02cc88 (0x2675f bytes) 000896 1781239042.406890 read 0x00a44d thru 0x012ea6 (0x8a5a bytes) 000897 1781239042.422396 read 0x027fbe thru 0x02cc88 (0x4ccb bytes) 000898 1781239042.423091 mapread 0x00a8d9 thru 0x01a543 (0xfc6b bytes) 000899 1781239042.424459 fallocate 0x01451e thru 0x023898 (0xf37b bytes) 000900 1781239042.447742 MIRROR_RESYNC 5 mirrors 000901 1781239043.303830 trunc from 0x02cc89 to 0x02edd2 (0x214a bytes) 000903 1781239043.399937 mapwrite 0x003911 thru 0x009fde (0x66ce bytes) 000905 1781239043.436474 write 0x0255f6 thru 0x034db0 (0xf7bb bytes) 000906 1781239043.453771 punch from 0x00992e to 0x00a41c (0xaef bytes) 000907 1781239043.461612 mapwrite 0x0066b0 thru 0x00bfa3 (0x58f4 bytes) 000908 1781239043.502930 mapwrite 0x011a88 thru 0x01ff61 (0xe4da bytes) 000909 1781239043.593904 fallocate 0x01a633 thru 0x021143 (0x6b11 bytes) 000910 1781239043.601202 read 0x029139 thru 0x02c2a8 (0x3170 bytes) 000911 1781239043.602447 trunc from 0x034db1 to 0x02b131 (0x9c7f bytes) 000912 1781239043.636421 fallocate 0x0369cb thru 0x03ffff (0x9635 bytes) 000913 1781239043.641214 trunc from 0x040000 to 0x022120 (0x1dedf bytes) 000914 1781239043.662602 trunc from 0x022121 to 0x00b56b (0x16bb5 bytes) 000916 1781239043.683722 trunc from 0x00b56c to 0x02edd7 (0x2386c bytes) 000917 1781239043.699046 trunc from 0x00791c to 0x0161a0 (0xe885 bytes) 000918 1781239043.704319 trunc from 0x022818 to 0x02edd7 (0xc5c0 bytes) 000919 1781239043.709807 mapwrite 0x026905 thru 0x0275ea (0xce6 bytes) 000920 1781239043.731035 trunc from 0x01b463 to 0x024209 (0x8da7 bytes) 000921 1781239043.735747 fallocate 0x02bc84 thru 0x030682 (0x49ff bytes) 000922 1781239043.740417 read 0x025366 thru 0x02edd7 (0x9a72 bytes) 000924 1781239043.741655 mapwrite 0x00442d thru 0x00671e (0x22f2 bytes) 000925 1781239043.762484 trunc from 0x02edd8 to 0x03b9e6 (0xcc0f bytes) 000926 1781239043.785827 punch from 0x0258ec to 0x029e85 (0x459a bytes) 000927 1781239043.792674 trunc from 0x026242 to 0x0271e1 (0xfa0 bytes) 000928 1781239043.798015 trunc from 0x020496 to 0x023d45 (0x38b0 bytes) 000929 1781239043.803765 read 0x0312c5 thru 0x039ea0 (0x8bdc bytes) 000931 1781239043.825535 trunc from 0x001f4e to 0x00da38 (0xbaeb bytes) 000932 1781239043.830765 mapwrite 0x036494 thru 0x03ffff (0x9b6c bytes) 000933 1781239043.885951 trunc from 0x011a31 to 0x01c80c (0xaddc bytes) 000934 1781239043.896132 MIRROR_RESYNC 5 mirrors 000935 1781239045.033442 MIRROR_RESYNC 5 mirrors 000936 1781239045.523764 write 0x035460 thru 0x03d048 (0x7be9 bytes) 000937 1781239045.595449 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0xf8465e81 (stale) Mirror 24: 0xf8465e81 (stale) Mirror 25: 0xf8465e81 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0xf8465e81 (stale) Mirror 24: 0xf8465e81 (stale) Mirror 25: 0xf8465e81 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000938 1781239045.950867 punch from 0x03a52f to 0x03ffff (0x5ad1 bytes) 000939 1781239045.959971 mapread 0x0170aa thru 0x026a6f (0xf9c6 bytes) 000940 1781239045.987833 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 24: 0xf8465e81 (stale) Mirror 25: 0xf8465e81 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 24: 0xf8465e81 (stale) Mirror 25: 0xf8465e81 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000941 1781239046.286916 trunc from 0x022754 to 0x0320c3 (0xf970 bytes) 000942 1781239046.291846 trunc from 0x040000 to 0x02458e (0x1ba71 bytes) 000943 1781239046.319562 write 0x01ef18 thru 0x02c7c1 (0xd8aa bytes) 000944 1781239046.326255 mapread 0x006952 thru 0x01036c (0x9a1b bytes) 000945 1781239046.343652 mapread 0x0006df thru 0x006660 (0x5f82 bytes) 000946 1781239046.349011 write 0x005797 thru 0x007bd6 (0x2440 bytes) 000947 1781239046.355079 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2c7c2): Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c7c2): Mirror 24: 0x4c728697 (stale) Mirror 25: 0x4c728697 (stale) CRC-32 checksum value for chunk [0, 0x2c7c2): Mirror 1: 0x54fac03d Mirror 26: 0x54fac03d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c7c2: skipped 000948 1781239047.250200 mapread 0x0113de thru 0x01c0c7 (0xacea bytes) 000949 1781239047.303684 trunc from 0x0127fb to 0x01a365 (0x7b6b bytes) 000950 1781239047.388749 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c7c2): Mirror 24: 0x4c728697 (stale) Mirror 26: 0x54fac03d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c7c2): Mirror 24: 0x4c728697 (stale) Mirror 26: 0x54fac03d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c7c2: skipped 000951 1781239047.736383 mapwrite 0x02333b thru 0x0233c6 (0x8c bytes) 000952 1781239047.755471 read 0x010d4e thru 0x014bc0 (0x3e73 bytes) 000954 1781239047.772655 trunc from 0x02c7c2 to 0x00e6ae (0x1e113 bytes) 000955 1781239047.814891 trunc from 0x009314 to 0x00e6ae (0x539b bytes) 000956 1781239047.823188 write 0x03fff0 thru 0x03ffff (0x10 bytes) 000957 1781239047.824921 trunc from 0x040000 to 0x02c6ac (0x13953 bytes) 000958 1781239047.840385 MIRROR_RESYNC 3 mirrors 000959 1781239048.712663 trunc from 0x00ff5a to 0x01bc3f (0xbce6 bytes) 000960 1781239048.769878 fallocate 0x00d6ff thru 0x01d0af (0xf9b1 bytes) 000961 1781239048.778440 write 0x02900c thru 0x0345d8 (0xb5cd bytes) 000962 1781239048.799747 mapread 0x002951 thru 0x002da5 (0x455 bytes) 000963 1781239048.819912 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x345d9): Mirror 24: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x345d9): Mirror 24: 0xc4ada260 (stale) Mirror 26: 0xc4ada260 (stale) CRC-32 checksum value for chunk [0, 0x345d9): Mirror 1: 0xc5487fe1 Mirror 27: 0xc5487fe1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x345d9: skipped 000964 1781239049.714062 punch from 0x006aab to 0x0110ef (0xa645 bytes) 000965 1781239049.763748 trunc from 0x010a34 to 0x01b3f4 (0xa9c1 bytes) 000966 1781239049.770741 trunc from 0x02f354 to 0x0345d8 (0x5285 bytes) 000967 1781239049.777144 punch from 0x01382b to 0x014f2c (0x1702 bytes) 000968 1781239049.783069 fallocate 0x010873 thru 0x01d8a2 (0xd030 bytes) 000969 1781239049.788489 write 0x03acd6 thru 0x03ff94 (0x52bf bytes) 000970 1781239049.794412 write 0x0052ef thru 0x006e98 (0x1baa bytes) 000971 1781239049.813162 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ff95): Mirror 26: 0x49ca918 (stale) Mirror 27: 0x59bc619c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ff95): Mirror 26: 0x49ca918 (stale) Mirror 27: 0x59bc619c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ff95: skipped 000972 1781239050.327724 write 0x012ed4 thru 0x01e5a5 (0xb6d2 bytes) 000973 1781239050.346218 mapwrite 0x02abab thru 0x030737 (0x5b8d bytes) 000974 1781239050.386049 write 0x0167ff thru 0x01af83 (0x4785 bytes) 000975 1781239050.387551 trunc from 0x03ff95 to 0x00af0f (0x35085 bytes) 000976 1781239050.402840 read 0x003ca9 thru 0x006021 (0x2379 bytes) 000977 1781239050.416357 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x19d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xaf10): Mirror 27: 0xd9c6ffaa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xaf10): Mirror 27: 0xd9c6ffaa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xaf10: skipped 000978 1781239050.705749 read 0x0030d5 thru 0x00a5b3 (0x74df bytes) 000979 1781239050.722461 trunc from 0x00af10 to 0x0106c4 (0x57b5 bytes) 000980 1781239050.748096 mapwrite 0x008deb thru 0x01476e (0xb984 bytes) 000981 1781239050.821555 punch from 0x000b3e to 0x009ba3 (0x9066 bytes) 000982 1781239050.828707 mapread 0x00b8a3 thru 0x01476e (0x8ecc bytes) 000983 1781239050.834890 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1476f): Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1476f): Mirror 27: 0x721b276c (stale) CRC-32 checksum value for chunk [0, 0x1476f): Mirror 1: 0x27d5782f Mirror 28: 0x27d5782f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1476f: skipped 000984 1781239051.567469 mapread 0x001901 thru 0x00e913 (0xd013 bytes) 000985 1781239051.585902 mapread 0x0039f3 thru 0x00ef21 (0xb52f bytes) 000986 1781239051.586875 trunc from 0x011954 to 0x01476e (0x2e1b bytes) 000987 1781239051.629012 trunc from 0x004e54 to 0x00becc (0x7079 bytes) 000988 1781239051.633827 trunc from 0x013252 to 0x01476e (0x151d bytes) 000989 1781239051.638557 trunc from 0x01476f to 0x0271cd (0x12a5f bytes) 000990 1781239051.659648 write 0x005c36 thru 0x00a97c (0x4d47 bytes) 000991 1781239051.670142 trunc from 0x013ebc to 0x020e81 (0xcfc6 bytes) 000992 1781239051.673846 mapread 0x012710 thru 0x01b8b0 (0x91a1 bytes) 000993 1781239051.690200 trunc from 0x00e320 to 0x01614f (0x7e30 bytes) 000994 1781239051.696735 write 0x0145c1 thru 0x0200df (0xbb1f bytes) 000995 1781239051.705342 mapwrite 0x02b743 thru 0x035154 (0x9a12 bytes) 000996 1781239051.765491 mapwrite 0x021ebf thru 0x0221dc (0x31e bytes) 000997 1781239051.790103 write 0x03bff8 thru 0x03ffff (0x4008 bytes) 000998 1781239051.791599 mapwrite 0x0393a3 thru 0x03ffff (0x6c5d bytes) 001000 1781239051.832440 write 0x02600f thru 0x035331 (0xf323 bytes) All operations completed A-OK!