== sanity-flr test 70a: flr mode fsx test ================ 02:20:52 (1788589252) Seed set to 9254 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000002 1788589255.122856 write 0x002f40 thru 0x006859 (0x391a bytes) 000003 1788589255.126674 mapwrite 0x011ae6 thru 0x01f663 (0xdb7e bytes) 000004 1788589255.257719 read 0x01cd78 thru 0x01d747 (0x9d0 bytes) 000005 1788589255.258885 write 0x00c245 thru 0x00dbd3 (0x198f bytes) truncating to largest ever: 0x2b8a4 000006 1788589255.262510 trunc from 0x01f664 to 0x02b8a3 (0xc240 bytes) 000007 1788589255.289015 read 0x01242f thru 0x02157a (0xf14c bytes) 000008 1788589255.309889 read 0x01eb43 thru 0x023284 (0x4742 bytes) 000009 1788589255.311282 mapwrite 0x039a03 thru 0x03ffff (0x65fd bytes) 000010 1788589255.408770 mapread 0x02a542 thru 0x034b96 (0xa655 bytes) 000012 1788589255.410436 mapwrite 0x011921 thru 0x014e96 (0x3576 bytes) 000013 1788589255.454918 write 0x00539f thru 0x0087ee (0x3450 bytes) 000016 1788589255.458848 mapread 0x0055f1 thru 0x007b55 (0x2565 bytes) 000017 1788589255.460467 mapread 0x03b70e thru 0x03ffff (0x48f2 bytes) 000018 1788589255.462984 punch from 0x03edd6 to 0x03ffff (0x122a bytes) 000020 1788589255.481409 mapread 0x034f47 thru 0x0386e9 (0x37a3 bytes) truncating to largest ever: 0x30a80 000022 1788589255.484569 trunc from 0x040000 to 0x030a7f (0xf580 bytes) 000023 1788589255.515372 punch from 0x001b88 to 0x00c682 (0xaafb bytes) 000025 1788589255.523469 write 0x032da7 thru 0x03e73f (0xb999 bytes) 000028 1788589255.544083 MIRROR_EXTEND to 2 mirrors 000029 1788589256.619285 trunc from 0x03e740 to 0x02d28a (0x114b5 bytes) 000031 1788589256.711762 mapwrite 0x00d5e0 thru 0x013bf9 (0x661a bytes) 000032 1788589256.843991 trunc from 0x02d28b to 0x00d719 (0x1fb71 bytes) 000033 1788589256.901959 read 0x0087e6 thru 0x00d719 (0x4f34 bytes) 000034 1788589256.904516 read 0x00b83b thru 0x00d719 (0x1edf bytes) 000035 1788589256.916688 mapwrite 0x02cb1e thru 0x031125 (0x4608 bytes) 000037 1788589257.091401 read 0x003e24 thru 0x00c006 (0x81e3 bytes) 000038 1788589257.092564 trunc from 0x031126 to 0x02c453 (0x4cd2 bytes) 000040 1788589257.136404 read 0x01ac18 thru 0x029cfe (0xf0e7 bytes) 000041 1788589257.137714 write 0x03148f thru 0x03d93d (0xc4af bytes) 000043 1788589257.149568 trunc from 0x03d93e to 0x02dae0 (0xfe5d bytes) 000045 1788589257.183182 mapwrite 0x038250 thru 0x03ffff (0x7db0 bytes) 000046 1788589257.353635 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) 000047 1788589257.518210 write 0x0202c4 thru 0x0273ce (0x710b bytes) 000048 1788589257.530913 write 0x01c206 thru 0x026977 (0xa772 bytes) 000050 1788589257.538489 trunc from 0x040000 to 0x001d0c (0x3e2f3 bytes) 000051 1788589257.570474 write 0x0201c9 thru 0x02a8b3 (0xa6eb bytes) 000053 1788589257.576425 mapwrite 0x036dcd thru 0x03ffff (0x9233 bytes) 000055 1788589257.680286 mapwrite 0x02be78 thru 0x02c972 (0xafb bytes) 000058 1788589257.759898 MIRROR_EXTEND to 2 mirrors 000059 1788589258.861972 punch from 0x02cc34 to 0x039bb3 (0xcf80 bytes) 000060 1788589258.967421 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xd4973b7e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x157f15cb Mirror 3: 0x157f15cb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000062 1788589260.115476 mapwrite 0x02ee43 thru 0x038b95 (0x9d53 bytes) 000063 1788589260.316825 mapread 0x01dbaf thru 0x024b08 (0x6f5a bytes) 000064 1788589260.329530 mapread 0x03c17a thru 0x03ffff (0x3e86 bytes) 000065 1788589260.330793 punch from 0x02a4b2 to 0x037da0 (0xd8ef bytes) 000066 1788589260.337558 punch from 0x035b78 to 0x03ffff (0xa488 bytes) 000068 1788589260.343491 write 0x00e91f thru 0x014dfa (0x64dc bytes) 000069 1788589260.362334 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x157f15cb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x157f15cb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000070 1788589260.696004 mapread 0x002e45 thru 0x012219 (0xf3d5 bytes) 000071 1788589260.735564 punch from 0x007ee3 to 0x013576 (0xb694 bytes) truncating to largest ever: 0x3fa43 000072 1788589260.743719 trunc from 0x040000 to 0x03fa42 (0x5bd bytes) 000073 1788589260.764049 trunc from 0x03fa43 to 0x001819 (0x3e229 bytes) 000074 1788589260.782609 mapwrite 0x020915 thru 0x0235be (0x2caa bytes) 000075 1788589260.869819 write 0x023ef4 thru 0x028fa8 (0x50b5 bytes) 000077 1788589260.872963 mapread 0x01f881 thru 0x0258c3 (0x6043 bytes) 000078 1788589260.874585 mapread 0x0040c1 thru 0x00afe0 (0x6f20 bytes) 000079 1788589260.887403 trunc from 0x028fa9 to 0x00b155 (0x1de53 bytes) 000081 1788589260.921446 mapread 0x006861 thru 0x00b155 (0x48f5 bytes) 000082 1788589260.922673 read 0x00ad2a thru 0x00b155 (0x42c bytes) 000084 1788589260.928697 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xb156): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb156): Mirror 3: 0x2362fa1c (stale) CRC-32 checksum value for chunk [0, 0xb156): Mirror 1: 0x2362fa1c Mirror 4: 0x2362fa1c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb156: skipped 000085 1788589261.891751 mapread 0x002a8b thru 0x007859 (0x4dcf bytes) 000086 1788589261.964003 punch from 0x00689d to 0x00b155 (0x48b9 bytes) 000087 1788589262.110424 mapwrite 0x023f2a thru 0x027ea9 (0x3f80 bytes) truncating to largest ever: 0x3fc13 000088 1788589262.257841 trunc from 0x027eaa to 0x03fc12 (0x17d69 bytes) 000089 1788589262.286243 trunc from 0x03fc13 to 0x00cead (0x32d65 bytes) 000090 1788589262.311085 trunc from 0x00ceae to 0x031976 (0x24ac9 bytes) 000091 1788589262.338318 punch from 0x00b7df to 0x00deea (0x270c bytes) 000092 1788589262.348619 read 0x00c47c thru 0x0116cf (0x5254 bytes) 000093 1788589262.364715 trunc from 0x031977 to 0x010d1e (0x20c58 bytes) 000094 1788589262.393609 mapread 0x008431 thru 0x00fe22 (0x79f2 bytes) 000095 1788589262.418689 MIRROR_RESYNC 3 mirrors 000097 1788589263.312900 write 0x014ac8 thru 0x020ed9 (0xc412 bytes) 000098 1788589263.366517 read 0x01d0e7 thru 0x020ed9 (0x3df3 bytes) 000099 1788589263.367144 mapread 0x01d4e2 thru 0x020ed9 (0x39f8 bytes) 000100 1788589263.367939 punch from 0x01339e to 0x01747a (0x40dd bytes) 000101 1788589263.386086 mapwrite 0x02a70f thru 0x0382e4 (0xdbd6 bytes) 000102 1788589263.501723 read 0x02409b thru 0x030155 (0xc0bb bytes) 000104 1788589263.509271 read 0x0291f7 thru 0x03153e (0x8348 bytes) 000105 1788589263.510323 trunc from 0x0382e5 to 0x0240e9 (0x141fb bytes) 000106 1788589263.531528 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x240ea): Mirror 3: 0x2dab751b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x240ea): Mirror 3: 0x2dab751b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x240ea: skipped 000108 1788589263.844321 read 0x009606 thru 0x00a1d7 (0xbd2 bytes) 000109 1788589263.851087 read 0x021c4f thru 0x0240e9 (0x249b bytes) 000110 1788589263.880914 mapwrite 0x0260cf thru 0x02ba00 (0x5932 bytes) 000112 1788589263.958066 punch from 0x0003c3 to 0x00b0db (0xad19 bytes) 000113 1788589263.963947 read 0x01aa87 thru 0x020dbf (0x6339 bytes) 000114 1788589263.964627 trunc from 0x02ba01 to 0x00fdc4 (0x1bc3c bytes) 000115 1788589263.984535 read 0x00aa9d thru 0x00fdc4 (0x5328 bytes) 000116 1788589263.993563 trunc from 0x00fdc5 to 0x02321d (0x13459 bytes) 000117 1788589264.012003 write 0x012657 thru 0x01fa1d (0xd3c7 bytes) 000118 1788589264.023527 trunc from 0x02321e to 0x0159d7 (0xd846 bytes) 000119 1788589264.051606 trunc from 0x0159d8 to 0x015acb (0xf4 bytes) 000120 1788589264.081348 mapwrite 0x0225a7 thru 0x0225d6 (0x30 bytes) 000121 1788589264.164804 mapwrite 0x003609 thru 0x011ee7 (0xe8df bytes) 000123 1788589264.212968 punch from 0x01de7b to 0x020644 (0x27ca bytes) 000124 1788589264.215974 mapread 0x011a15 thru 0x01200c (0x5f8 bytes) 000125 1788589264.216739 mapread 0x00843b thru 0x013e3c (0xba02 bytes) 000126 1788589264.217382 mapread 0x00f1ed thru 0x01d1b4 (0xdfc8 bytes) 000127 1788589264.245360 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) 000128 1788589264.370020 mapread 0x01a48d thru 0x0225d6 (0x814a bytes) 000129 1788589264.404007 read 0x00470f thru 0x007b44 (0x3436 bytes) 000131 1788589264.410970 punch from 0x019a35 to 0x01b63b (0x1c07 bytes) 000134 1788589264.419995 read 0x020ee9 thru 0x0225d6 (0x16ee bytes) 000136 1788589264.422777 mapread 0x00fe07 thru 0x012281 (0x247b bytes) 000137 1788589264.442702 write 0x01691c thru 0x02433a (0xda1f bytes) 000138 1788589264.443935 punch from 0x014175 to 0x014c41 (0xacd bytes) 000139 1788589264.462082 trunc from 0x02433b to 0x015d4a (0xe5f0 bytes) 000141 1788589264.485306 mapwrite 0x0374b6 thru 0x03ffff (0x8b4a bytes) 000142 1788589264.569949 trunc from 0x040000 to 0x0318de (0xe721 bytes) 000144 1788589264.589786 trunc from 0x0318df to 0x0239cf (0xdf0f bytes) 000145 1788589264.617452 punch from 0x004718 to 0x00762e (0x2f17 bytes) 000148 1788589264.623490 punch from 0x011322 to 0x0186b5 (0x7394 bytes) 000149 1788589264.628864 read 0x01081b thru 0x01bf5d (0xb743 bytes) 000150 1788589264.636763 write 0x024b8d thru 0x029cb7 (0x512b bytes) 000151 1788589264.637848 write 0x018af6 thru 0x027681 (0xeb8c bytes) 000153 1788589264.642337 write 0x01004b thru 0x014c0d (0x4bc3 bytes) 000154 1788589264.643853 mapwrite 0x020116 thru 0x0274f2 (0x73dd bytes) 000156 1788589264.695035 punch from 0x023394 to 0x029cb7 (0x6924 bytes) 000157 1788589264.707722 MIRROR_EXTEND to 2 mirrors 000158 1788589265.501399 trunc from 0x029cb8 to 0x0032cb (0x269ec bytes) 000159 1788589265.599640 mapwrite 0x0116c1 thru 0x01d803 (0xc143 bytes) 000161 1788589265.760727 write 0x001c02 thru 0x00e78b (0xcb8a bytes) 000162 1788589265.770580 write 0x005935 thru 0x00c8c2 (0x6f8e bytes) 000163 1788589265.771692 punch from 0x013e49 to 0x01d803 (0x99bb bytes) 000164 1788589265.792650 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1d804): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d804): Mirror 2: 0x5819f4ba (stale) CRC-32 checksum value for chunk [0, 0x1d804): Mirror 1: 0xb0e296af Mirror 3: 0xb0e296af lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d804: skipped 000166 1788589266.682627 read 0x0048a9 thru 0x00d371 (0x8ac9 bytes) 000167 1788589266.700769 write 0x008608 thru 0x0148f4 (0xc2ed bytes) 000169 1788589266.786898 punch from 0x00ca6a to 0x00f22c (0x27c3 bytes) 000171 1788589266.818077 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1d804): Mirror 3: 0xb0e296af (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d804): Mirror 3: 0xb0e296af (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d804: skipped 000174 1788589267.138353 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) 000176 1788589267.305403 MIRROR_EXTEND to 2 mirrors 000177 1788589268.183286 mapread 0x0066dc thru 0x0124ce (0xbdf3 bytes) 000178 1788589268.233872 punch from 0x0107c2 to 0x012426 (0x1c65 bytes) 000179 1788589268.290349 trunc from 0x01d804 to 0x004d61 (0x18aa2 bytes) 000181 1788589268.307099 trunc from 0x004d62 to 0x03f683 (0x3a922 bytes) 000182 1788589268.322183 trunc from 0x03f684 to 0x01b79e (0x23ee5 bytes) 000183 1788589268.334280 read 0x010c22 thru 0x01b79e (0xab7d bytes) 000184 1788589268.350766 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) 000185 1788589268.597045 write 0x01eae6 thru 0x02c553 (0xda6e bytes) 000187 1788589268.609354 mapwrite 0x03fb15 thru 0x03ffff (0x4eb bytes) 000189 1788589268.759055 mapread 0x02b6bb thru 0x0345eb (0x8f31 bytes) 000190 1788589268.787440 write 0x00ede3 thru 0x0154c7 (0x66e5 bytes) 000194 1788589268.803530 read 0x010153 thru 0x01ea5b (0xe909 bytes) 000197 1788589268.812946 trunc from 0x040000 to 0x0312d9 (0xed26 bytes) 000199 1788589268.831565 mapread 0x0177d2 thru 0x0205eb (0x8e1a bytes) 000200 1788589268.832464 write 0x037458 thru 0x03ffff (0x8ba8 bytes) 000201 1788589268.838452 read 0x03b83c thru 0x03f05a (0x381f bytes) 000202 1788589268.839658 trunc from 0x040000 to 0x027ab9 (0x18546 bytes) 000204 1788589268.893583 trunc from 0x027aba to 0x039d47 (0x1228e bytes) 000205 1788589268.923596 mapread 0x025b71 thru 0x02bd27 (0x61b7 bytes) 000212 1788589268.941740 write 0x006a03 thru 0x00b09d (0x469b bytes) 000214 1788589268.944673 punch from 0x028251 to 0x0379ac (0xf75c bytes) 000215 1788589268.966828 MIRROR_EXTEND to 2 mirrors 000216 1788589269.821823 punch from 0x00ea82 to 0x01baa6 (0xd025 bytes) 000217 1788589269.886354 mapwrite 0x013d8c thru 0x0200ea (0xc35f bytes) 000219 1788589269.939445 trunc from 0x039d48 to 0x001d7c (0x37fcb bytes) 000220 1788589269.964757 punch from 0x00081f to 0x001d7c (0x155e bytes) 000221 1788589269.972763 trunc from 0x001d7d to 0x03763a (0x358be bytes) 000222 1788589269.993926 punch from 0x02659b to 0x02debc (0x7922 bytes) 000223 1788589270.004835 punch from 0x018e30 to 0x01a409 (0x15da bytes) 000225 1788589270.012617 trunc from 0x03763b to 0x00d013 (0x2a627 bytes) 000226 1788589270.033052 write 0x00a264 thru 0x011edd (0x7c7a bytes) 000227 1788589270.039958 mapwrite 0x0182b0 thru 0x021e0e (0x9b5f bytes) 000228 1788589270.146686 MIRROR_RESYNC 2 mirrors 000229 1788589270.790433 mapwrite 0x02c48a thru 0x02dce7 (0x185e bytes) 000231 1788589270.992682 write 0x028328 thru 0x037f28 (0xfc01 bytes) 000232 1788589271.002917 mapread 0x008a85 thru 0x014c42 (0xc1be bytes) 000233 1788589271.037622 mapread 0x010c5e thru 0x01132d (0x6d0 bytes) 000234 1788589271.052734 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x37f29): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37f29): Mirror 2: 0xbcd898e (stale) CRC-32 checksum value for chunk [0, 0x37f29): Mirror 1: 0xdf3fc3b2 Mirror 3: 0xdf3fc3b2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37f29: skipped 000235 1788589271.812794 mapwrite 0x01080d thru 0x0113b6 (0xbaa bytes) 000236 1788589271.952522 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x37f29): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37f29): Mirror 2: 0xbcd898e (stale) Mirror 3: 0xdf3fc3b2 (stale) CRC-32 checksum value for chunk [0, 0x37f29): Mirror 1: 0xa1d72ba2 Mirror 4: 0xa1d72ba2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37f29: skipped 000237 1788589272.776490 write 0x03e0f7 thru 0x03ffff (0x1f09 bytes) 000238 1788589272.859403 punch from 0x03c414 to 0x03ffff (0x3bec bytes) 000239 1788589272.869972 mapread 0x00f9ec thru 0x016527 (0x6b3c bytes) 000243 1788589272.896254 mapread 0x002171 thru 0x00bb81 (0x9a11 bytes) 000244 1788589272.917979 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x767cf5fb (stale) Mirror 4: 0x6bc4df51 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x767cf5fb (stale) Mirror 4: 0x6bc4df51 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000246 1788589273.250861 punch from 0x03181b to 0x03b2c6 (0x9aac bytes) 000249 1788589273.260543 read 0x006b72 thru 0x00ff85 (0x9414 bytes) 000251 1788589273.272901 mapwrite 0x016d3b thru 0x01934b (0x2611 bytes) 000252 1788589273.340879 write 0x0019a5 thru 0x005474 (0x3ad0 bytes) 000254 1788589273.361245 MIRROR_RESYNC 3 mirrors 000255 1788589274.165943 mapwrite 0x02a957 thru 0x02e7e8 (0x3e92 bytes) 000256 1788589274.314567 mapwrite 0x012267 thru 0x0126a6 (0x440 bytes) 000257 1788589274.371707 trunc from 0x040000 to 0x03c34d (0x3cb2 bytes) 000258 1788589274.412507 trunc from 0x03c34e to 0x01793d (0x24a10 bytes) 000260 1788589274.435587 mapwrite 0x0349ad thru 0x03d88e (0x8ee2 bytes) 000261 1788589274.533370 trunc from 0x03d88f to 0x026b37 (0x16d57 bytes) 000262 1788589274.552800 read 0x016dff thru 0x02223c (0xb43e bytes) 000263 1788589274.561328 trunc from 0x026b38 to 0x023269 (0x38ce bytes) 000265 1788589274.586397 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2326a): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2326a): Mirror 3: 0xf5d7d72f (stale) Mirror 4: 0xf5d7d72f (stale) CRC-32 checksum value for chunk [0, 0x2326a): Mirror 1: 0x396300fb Mirror 5: 0x396300fb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2326a: skipped 000266 1788589275.630938 punch from 0x01d784 to 0x023269 (0x5ae6 bytes) 000270 1788589275.706887 trunc from 0x02326a to 0x038fc3 (0x15d5a bytes) 000273 1788589275.729591 mapread 0x018ba9 thru 0x025a22 (0xce7a bytes) 000274 1788589275.763402 read 0x02f13a thru 0x038fc3 (0x9e8a bytes) 000275 1788589275.777347 write 0x025e8f thru 0x0272e3 (0x1455 bytes) 000277 1788589275.778785 write 0x031922 thru 0x03b2f8 (0x99d7 bytes) 000279 1788589275.782327 read 0x02bd94 thru 0x03a05f (0xe2cc bytes) 000280 1788589275.802786 read 0x01070f thru 0x0164e5 (0x5dd7 bytes) 000281 1788589275.803640 mapwrite 0x0035e7 thru 0x008d2f (0x5749 bytes) 000282 1788589275.896244 mapread 0x006b1e thru 0x011fca (0xb4ad bytes) 000283 1788589275.906308 MIRROR_RESYNC 4 mirrors 000284 1788589276.825584 read 0x028778 thru 0x032477 (0x9d00 bytes) 000285 1788589276.836138 trunc from 0x03b2f9 to 0x028fd9 (0x1231f bytes) 000286 1788589276.914396 punch from 0x00aa04 to 0x00acd0 (0x2cd bytes) 000287 1788589276.921595 punch from 0x004300 to 0x00911e (0x4e1f bytes) 000289 1788589276.929504 mapread 0x01db2f thru 0x028fd9 (0xb4ab bytes) 000290 1788589276.962594 punch from 0x01368b to 0x01d545 (0x9ebb bytes) 000291 1788589276.972698 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x28fda): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28fda): Mirror 3: 0xe6a53760 (stale) Mirror 4: 0xe6a53760 (stale) Mirror 5: 0xe6a53760 (stale) CRC-32 checksum value for chunk [0, 0x28fda): Mirror 1: 0xc749c0b2 Mirror 6: 0xc749c0b2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28fda: skipped 000292 1788589277.859593 read 0x007be4 thru 0x00896f (0xd8c bytes) 000294 1788589277.878056 punch from 0x002ebc to 0x012411 (0xf556 bytes) 000295 1788589277.948695 trunc from 0x028fda to 0x00cb72 (0x1c467 bytes) 000296 1788589277.971853 read 0x004436 thru 0x008696 (0x4261 bytes) 000297 1788589277.993859 punch from 0x0010af to 0x003684 (0x25d6 bytes) 000301 1788589278.016953 write 0x022976 thru 0x02d77f (0xae0a bytes) 000302 1788589278.027001 mapread 0x019e91 thru 0x021762 (0x78d2 bytes) 000304 1788589278.045168 mapwrite 0x0219a6 thru 0x02a559 (0x8bb4 bytes) 000305 1788589278.143356 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2d780): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d780): Mirror 3: 0x961fb1cd (stale) Mirror 4: 0x961fb1cd (stale) Mirror 5: 0x961fb1cd (stale) Mirror 6: 0xb1289bb2 (stale) CRC-32 checksum value for chunk [0, 0x2d780): Mirror 1: 0x8ff0d34 Mirror 7: 0x8ff0d34 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d780: skipped 000306 1788589279.165342 read 0x004be3 thru 0x00dc41 (0x905f bytes) 000307 1788589279.194613 write 0x006d0c thru 0x00deca (0x71bf bytes) 000308 1788589279.391277 read 0x02a208 thru 0x02d77f (0x3578 bytes) 000309 1788589279.437437 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d780): Mirror 4: 0x961fb1cd (stale) Mirror 5: 0x961fb1cd (stale) Mirror 6: 0xb1289bb2 (stale) Mirror 7: 0x8ff0d34 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d780): Mirror 4: 0x961fb1cd (stale) Mirror 5: 0x961fb1cd (stale) Mirror 6: 0xb1289bb2 (stale) Mirror 7: 0x8ff0d34 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d780: skipped 000314 1788589279.840072 trunc from 0x02d780 to 0x00ac4e (0x22b31 bytes) 000317 1788589279.908257 trunc from 0x00ac4f to 0x020a6c (0x15e1e bytes) 000319 1788589279.926955 mapwrite 0x001f42 thru 0x00517a (0x3239 bytes) 000321 1788589279.992195 punch from 0x004c22 to 0x00a91d (0x5cfc bytes) 000322 1788589280.004786 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x20a6d): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20a6d): Mirror 4: 0xc790d37d (stale) Mirror 5: 0xc790d37d (stale) Mirror 6: 0x87ad90e4 (stale) Mirror 7: 0x9737d5a8 (stale) CRC-32 checksum value for chunk [0, 0x20a6d): Mirror 1: 0x580473d5 Mirror 8: 0x580473d5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20a6d: skipped 000323 1788589281.849883 trunc from 0x020a6d to 0x03ddee (0x1d382 bytes) 000324 1788589281.949721 mapread 0x02cd12 thru 0x02f187 (0x2476 bytes) 000325 1788589281.977778 mapread 0x0174a3 thru 0x018524 (0x1082 bytes) 000327 1788589281.992874 punch from 0x02ac0f to 0x030bc7 (0x5fb9 bytes) 000328 1788589281.999237 trunc from 0x03ddef to 0x03373a (0xa6b4 bytes) 000330 1788589282.022977 mapwrite 0x010f93 thru 0x01ecef (0xdd5d bytes) 000331 1788589282.061387 mapwrite 0x00a937 thru 0x01799b (0xd065 bytes) 000332 1788589282.210701 mapwrite 0x0202ca thru 0x0274b7 (0x71ee bytes) 000333 1788589282.338636 write 0x02b451 thru 0x033f1b (0x8acb bytes) 000334 1788589282.352729 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x33f1c): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33f1c): Mirror 4: 0xf668b891 (stale) Mirror 5: 0xf668b891 (stale) Mirror 6: 0xbe7901b7 (stale) Mirror 7: 0xb7a5a526 (stale) Mirror 8: 0xce5b1239 (stale) CRC-32 checksum value for chunk [0, 0x33f1c): Mirror 1: 0x739030ee Mirror 9: 0x739030ee lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33f1c: skipped 000336 1788589283.229330 mapread 0x02b650 thru 0x0310d2 (0x5a83 bytes) 000337 1788589283.262559 punch from 0x022c13 to 0x02433c (0x172a bytes) 000338 1788589283.330925 write 0x01faf4 thru 0x02ddc4 (0xe2d1 bytes) 000340 1788589283.344546 mapwrite 0x034b68 thru 0x03b7c7 (0x6c60 bytes) 000341 1788589283.535288 mapread 0x03a6dd thru 0x03b7c7 (0x10eb bytes) 000342 1788589283.536335 mapwrite 0x01d022 thru 0x0225d3 (0x55b2 bytes) 000344 1788589283.582330 punch from 0x0175c4 to 0x0262de (0xed1b bytes) 000346 1788589283.599796 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b7c8): Mirror 4: 0x8d996e44 (stale) Mirror 6: 0x276c837 (stale) Mirror 7: 0x453c9c08 (stale) Mirror 8: 0x5bcfc531 (stale) Mirror 9: 0x4c034ada (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b7c8): Mirror 4: 0x8d996e44 (stale) Mirror 6: 0x276c837 (stale) Mirror 7: 0x453c9c08 (stale) Mirror 8: 0x5bcfc531 (stale) Mirror 9: 0x4c034ada (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b7c8: skipped 000347 1788589284.078814 mapread 0x002b6b thru 0x00f6fa (0xcb90 bytes) 000348 1788589284.119169 mapread 0x03b599 thru 0x03b7c7 (0x22f bytes) 000349 1788589284.140815 mapwrite 0x0151af thru 0x01af25 (0x5d77 bytes) 000350 1788589284.228265 write 0x021c08 thru 0x02c7e6 (0xabdf bytes) 000352 1788589284.245332 punch from 0x034233 to 0x03722a (0x2ff8 bytes) 000353 1788589284.262603 write 0x02bc3c thru 0x034ff7 (0x93bc bytes) 000354 1788589284.271551 punch from 0x0149b2 to 0x01759f (0x2bee bytes) 000357 1788589284.289331 read 0x02dbde thru 0x0387e6 (0xac09 bytes) 000358 1788589284.298917 read 0x00be8d thru 0x00ec84 (0x2df8 bytes) 000360 1788589284.299959 mapwrite 0x00af1e thru 0x0172a0 (0xc383 bytes) 000362 1788589284.366697 trunc from 0x03b7c8 to 0x02d56e (0xe259 bytes) 000363 1788589284.385798 mapread 0x0173b4 thru 0x0252df (0xdf2c bytes) 000364 1788589284.387010 mapread 0x02d012 thru 0x02d56e (0x55d bytes) 000365 1788589284.390238 trunc from 0x02d56f to 0x029aac (0x3ac2 bytes) 000366 1788589284.440186 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x29aad): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29aad): Mirror 4: 0xcc32cbb8 (stale) Mirror 6: 0x6bcf3f29 (stale) Mirror 7: 0x1ba3dafe (stale) Mirror 8: 0x3272a79d (stale) Mirror 9: 0x8673f2a7 (stale) CRC-32 checksum value for chunk [0, 0x29aad): Mirror 1: 0x8e164e46 Mirror 10: 0x8e164e46 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29aad: skipped 000367 1788589285.483989 mapread 0x0226db thru 0x022c68 (0x58e bytes) 000369 1788589285.493577 punch from 0x017c00 to 0x020ed6 (0x92d7 bytes) 000370 1788589285.596509 mapwrite 0x001839 thru 0x001e4c (0x614 bytes) 000371 1788589285.642454 trunc from 0x029aad to 0x0332e4 (0x9838 bytes) 000373 1788589285.691257 read 0x020a5b thru 0x025bb0 (0x5156 bytes) 000374 1788589285.704714 MIRROR_RESYNC 7 mirrors 000376 1788589287.172552 read 0x009997 thru 0x015aff (0xc169 bytes) 000377 1788589287.185197 trunc from 0x0332e5 to 0x037a53 (0x476f bytes) 000378 1788589287.304651 mapwrite 0x03fb76 thru 0x03ffff (0x48a bytes) 000379 1788589287.392935 punch from 0x00c40e to 0x012f7a (0x6b6d bytes) 000380 1788589287.409937 mapread 0x024edd thru 0x02d98e (0x8ab2 bytes) 000382 1788589287.432262 trunc from 0x040000 to 0x024c12 (0x1b3ed bytes) 000384 1788589287.450454 read 0x00b6f6 thru 0x00f7e3 (0x40ee bytes) 000385 1788589287.468004 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24c13): Mirror 6: 0xc1ba6e2f (stale) Mirror 7: 0xc1ba6e2f (stale) Mirror 8: 0xc1ba6e2f (stale) Mirror 9: 0xc1ba6e2f (stale) Mirror 10: 0xc1ba6e2f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24c13): Mirror 6: 0xc1ba6e2f (stale) Mirror 7: 0xc1ba6e2f (stale) Mirror 8: 0xc1ba6e2f (stale) Mirror 9: 0xc1ba6e2f (stale) Mirror 10: 0xc1ba6e2f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24c13: skipped 000386 1788589287.905098 write 0x023b86 thru 0x02b87f (0x7cfa bytes) 000387 1788589287.913384 punch from 0x012888 to 0x0217c2 (0xef3b bytes) 000389 1788589287.936450 write 0x01180c thru 0x015b2a (0x431f bytes) 000393 1788589287.954856 read 0x01a6f0 thru 0x01d708 (0x3019 bytes) 000394 1788589287.966864 read 0x01513a thru 0x01eaa0 (0x9967 bytes) 000396 1788589287.979715 punch from 0x003883 to 0x00b0d7 (0x7855 bytes) 000398 1788589288.005804 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2b880): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b880): Mirror 6: 0x4c3e8b3 (stale) Mirror 7: 0x4c3e8b3 (stale) Mirror 8: 0x4c3e8b3 (stale) Mirror 9: 0x4c3e8b3 (stale) Mirror 10: 0x4c3e8b3 (stale) CRC-32 checksum value for chunk [0, 0x2b880): Mirror 1: 0x2395d100 Mirror 11: 0x2395d100 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b880: skipped 000399 1788589289.140475 mapread 0x00b301 thru 0x0107a5 (0x54a5 bytes) 000402 1788589289.178348 trunc from 0x02b880 to 0x02eec0 (0x3641 bytes) 000405 1788589289.313242 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2eec1): Mirror 6: 0xc6c84a30 (stale) Mirror 7: 0xc6c84a30 (stale) Mirror 8: 0xc6c84a30 (stale) Mirror 10: 0xc6c84a30 (stale) Mirror 11: 0xdf257b0e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2eec1): Mirror 6: 0xc6c84a30 (stale) Mirror 7: 0xc6c84a30 (stale) Mirror 8: 0xc6c84a30 (stale) Mirror 10: 0xc6c84a30 (stale) Mirror 11: 0xdf257b0e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2eec1: skipped 000407 1788589289.688517 trunc from 0x02eec1 to 0x02106b (0xde55 bytes) 000408 1788589289.705727 trunc from 0x02106c to 0x006f69 (0x1a102 bytes) 000409 1788589289.732913 MIRROR_RESYNC 6 mirrors 000410 1788589291.646000 read 0x00559a thru 0x006f69 (0x19d0 bytes) 000414 1788589291.655811 read 0x001b47 thru 0x006f69 (0x5423 bytes) 000415 1788589291.670405 punch from 0x006e02 to 0x006f69 (0x168 bytes) 000417 1788589291.790211 mapwrite 0x01cccd thru 0x01e2f0 (0x1624 bytes) 000419 1788589291.897349 mapwrite 0x00b989 thru 0x00d016 (0x168e bytes) 000420 1788589291.964589 mapread 0x00654b thru 0x00d0fd (0x6bb3 bytes) 000421 1788589291.969248 read 0x009aa0 thru 0x00b0e3 (0x1644 bytes) 000424 1788589291.974802 mapread 0x0052cd thru 0x0134b2 (0xe1e6 bytes) 000426 1788589291.994898 mapwrite 0x02f092 thru 0x0383c1 (0x9330 bytes) 000427 1788589292.164837 write 0x01045a thru 0x01e825 (0xe3cc bytes) 000428 1788589292.167274 mapwrite 0x00255b thru 0x0044d5 (0x1f7b bytes) 000429 1788589292.209505 mapwrite 0x01d495 thru 0x020a04 (0x3570 bytes) 000430 1788589292.279338 mapwrite 0x0329db thru 0x03bb68 (0x918e bytes) 000431 1788589292.368807 punch from 0x01728f to 0x023fec (0xcd5e bytes) 000433 1788589292.409059 MIRROR_RESYNC 6 mirrors 000434 1788589293.806352 mapwrite 0x0179a8 thru 0x019ad3 (0x212c bytes) 000436 1788589294.157624 write 0x0288e7 thru 0x03486a (0xbf84 bytes) 000438 1788589294.194185 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bb69): Mirror 7: 0xf81400ff (stale) Mirror 8: 0xf81400ff (stale) Mirror 10: 0xf81400ff (stale) Mirror 11: 0xf81400ff (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bb69): Mirror 7: 0xf81400ff (stale) Mirror 8: 0xf81400ff (stale) Mirror 10: 0xf81400ff (stale) Mirror 11: 0xf81400ff (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bb69: skipped 000440 1788589294.856941 write 0x005d80 thru 0x00d48e (0x770f bytes) 000441 1788589294.872495 write 0x03440e thru 0x03ba59 (0x764c bytes) 000442 1788589294.884220 write 0x019d6c thru 0x01bd53 (0x1fe8 bytes) 000443 1788589294.895072 trunc from 0x03bb69 to 0x00e915 (0x2d253 bytes) 000444 1788589294.918156 mapread 0x002485 thru 0x007ed8 (0x5a54 bytes) 000445 1788589294.937940 read 0x0039d8 thru 0x00e915 (0xaf3e bytes) 000446 1788589294.939225 mapwrite 0x021142 thru 0x02a25a (0x9119 bytes) 000447 1788589295.019835 mapread 0x013882 thru 0x013948 (0xc7 bytes) 000448 1788589295.030044 write 0x0379d0 thru 0x03ffff (0x8630 bytes) 000449 1788589295.036863 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xcc079416 (stale) Mirror 8: 0xcc079416 (stale) Mirror 10: 0xcc079416 (stale) Mirror 11: 0xcc079416 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x31e444af Mirror 12: 0x31e444af lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000450 1788589296.257003 read 0x039cb2 thru 0x03f988 (0x5cd7 bytes) 000451 1788589296.276924 mapwrite 0x02ba49 thru 0x0370ea (0xb6a2 bytes) 000452 1788589296.469685 read 0x007b65 thru 0x014f2a (0xd3c6 bytes) 000453 1788589296.485244 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xcc079416 (stale) Mirror 8: 0xcc079416 (stale) Mirror 10: 0xcc079416 (stale) Mirror 11: 0xcc079416 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xcc079416 (stale) Mirror 8: 0xcc079416 (stale) Mirror 10: 0xcc079416 (stale) Mirror 11: 0xcc079416 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000454 1788589296.843784 read 0x02bda9 thru 0x03b577 (0xf7cf bytes) 000455 1788589296.852476 trunc from 0x040000 to 0x03a234 (0x5dcb bytes) 000456 1788589296.894592 mapread 0x03473f thru 0x03a234 (0x5af6 bytes) 000457 1788589296.896756 trunc from 0x03a235 to 0x00e710 (0x2bb24 bytes) 000458 1788589296.915042 punch from 0x00d9ee to 0x00e710 (0xd23 bytes) 000459 1788589296.923409 mapread 0x00d272 thru 0x00e710 (0x149f bytes) 000460 1788589296.937833 mapread 0x0063d5 thru 0x00d4bb (0x70e7 bytes) 000462 1788589296.948022 trunc from 0x00e711 to 0x023e53 (0x15743 bytes) 000463 1788589296.969292 trunc from 0x023e54 to 0x01040f (0x13a44 bytes) 000464 1788589296.999015 trunc from 0x010410 to 0x001787 (0xec88 bytes) 000465 1788589297.024371 punch from 0x00101b to 0x001787 (0x76d bytes) 000466 1788589297.032027 read 0x000649 thru 0x001787 (0x113f bytes) 000468 1788589297.045334 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1788): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1788): Mirror 7: 0xdef72423 (stale) Mirror 8: 0xdef72423 (stale) Mirror 10: 0xdef72423 (stale) Mirror 11: 0xdef72423 (stale) CRC-32 checksum value for chunk [0, 0x1788): Mirror 1: 0xdef72423 Mirror 12: 0xdef72423 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1788: skipped 000470 1788589298.066728 mapread 0x000ff2 thru 0x001787 (0x796 bytes) 000471 1788589298.108401 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1788): Mirror 8: 0xdef72423 (stale) Mirror 10: 0xdef72423 (stale) Mirror 11: 0xdef72423 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1788): Mirror 8: 0xdef72423 (stale) Mirror 10: 0xdef72423 (stale) Mirror 11: 0xdef72423 (stale) CRC-32 checksum value for chunk [0, 0x1788): Mirror 1: 0xdef72423 Mirror 12: 0xdef72423 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1788: skipped 000473 1788589298.814954 punch from 0x000bb4 to 0x0013d5 (0x822 bytes) 000474 1788589298.893278 punch from 0x000a4b to 0x001787 (0xd3d bytes) 000475 1788589298.900094 write 0x03d153 thru 0x03ffff (0x2ead bytes) 000476 1788589298.901964 trunc from 0x040000 to 0x03082c (0xf7d3 bytes) 000477 1788589298.929214 write 0x0111dc thru 0x018843 (0x7668 bytes) 000481 1788589298.943073 mapwrite 0x00fb5b thru 0x012f06 (0x33ac bytes) 000483 1788589299.015417 trunc from 0x03082d to 0x036f5e (0x6732 bytes) 000484 1788589299.036181 mapread 0x0064d8 thru 0x00b546 (0x506f bytes) 000486 1788589299.056264 mapwrite 0x00b580 thru 0x00fff9 (0x4a7a bytes) 000489 1788589299.092544 read 0x031996 thru 0x036f5e (0x55c9 bytes) 000490 1788589299.100516 trunc from 0x036f5f to 0x023545 (0x13a19 bytes) 000492 1788589299.124558 mapread 0x012549 thru 0x020525 (0xdfdd bytes) 000493 1788589299.139021 trunc from 0x023546 to 0x00a940 (0x18c05 bytes) 000494 1788589299.159927 mapread 0x00407d thru 0x00514c (0x10d0 bytes) 000495 1788589299.161875 read 0x001beb thru 0x006e00 (0x5216 bytes) 000497 1788589299.164090 read 0x002236 thru 0x00a940 (0x870b bytes) 000499 1788589299.165521 mapread 0x00537f thru 0x00a940 (0x55c2 bytes) 000500 1788589299.168308 mapwrite 0x006794 thru 0x0132e8 (0xcb55 bytes) 000501 1788589299.254944 punch from 0x007302 to 0x0132e8 (0xbfe7 bytes) 000503 1788589299.262832 write 0x012b3f thru 0x0150f5 (0x25b7 bytes) 000505 1788589299.270159 read 0x012d16 thru 0x0150f5 (0x23e0 bytes) 000509 1788589299.278413 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x150f6): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x150f6): Mirror 8: 0xc5ec1057 (stale) Mirror 10: 0xc5ec1057 (stale) Mirror 11: 0xc5ec1057 (stale) Mirror 12: 0x6d5e42a5 (stale) CRC-32 checksum value for chunk [0, 0x150f6): Mirror 1: 0x90458e6e Mirror 13: 0x90458e6e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x150f6: skipped 000510 1788589300.312943 punch from 0x008e36 to 0x0138c5 (0xaa90 bytes) 000511 1788589300.387051 punch from 0x0041a0 to 0x008205 (0x4066 bytes) 000512 1788589300.391014 mapread 0x002d0a thru 0x012b68 (0xfe5f bytes) 000513 1788589300.431234 trunc from 0x0150f6 to 0x0388fe (0x23809 bytes) 000514 1788589300.478605 trunc from 0x0388ff to 0x015c0a (0x22cf4 bytes) 000515 1788589300.503931 punch from 0x014573 to 0x015c0a (0x1698 bytes) 000516 1788589300.509016 mapread 0x00ef1f thru 0x014439 (0x551b bytes) 000517 1788589300.519272 write 0x00c8d1 thru 0x016fde (0xa70e bytes) 000518 1788589300.528000 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16fdf): Mirror 8: 0xdda030ac (stale) Mirror 10: 0xdda030ac (stale) Mirror 11: 0xdda030ac (stale) Mirror 12: 0x163afade (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16fdf): Mirror 8: 0xdda030ac (stale) Mirror 10: 0xdda030ac (stale) Mirror 11: 0xdda030ac (stale) Mirror 12: 0x163afade (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16fdf: skipped 000519 1788589300.923896 mapwrite 0x0154aa thru 0x01f22a (0x9d81 bytes) 000521 1788589301.023008 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f22b): Mirror 8: 0xb8e747eb (stale) Mirror 11: 0xb8e747eb (stale) Mirror 12: 0x31c4e167 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f22b): Mirror 8: 0xb8e747eb (stale) Mirror 11: 0xb8e747eb (stale) Mirror 12: 0x31c4e167 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f22b: skipped 000523 1788589301.415329 MIRROR_RESYNC 4 mirrors 000527 1788589302.712654 read 0x00f833 thru 0x0158c4 (0x6092 bytes) 000528 1788589302.738166 trunc from 0x01f22b to 0x01573d (0x9aed bytes) 000529 1788589302.862195 mapread 0x001982 thru 0x00770e (0x5d8d bytes) 000530 1788589302.897983 mapwrite 0x01d26b thru 0x02870a (0xb4a0 bytes) 000531 1788589303.105080 read 0x00aeb6 thru 0x00b067 (0x1b2 bytes) 000532 1788589303.119508 mapread 0x00fdb0 thru 0x013e9c (0x40ed bytes) 000533 1788589303.188723 write 0x03c0bd thru 0x03ffff (0x3f43 bytes) 000534 1788589303.206164 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x41e64017 (stale) Mirror 11: 0x41e64017 (stale) Mirror 12: 0x41e64017 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x88b971a5 Mirror 13: 0x88b971a5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000535 1788589304.648058 punch from 0x03534b to 0x037adf (0x2795 bytes) 000536 1788589304.723298 trunc from 0x040000 to 0x009d20 (0x362df bytes) 000538 1788589304.783848 mapread 0x003b61 thru 0x009d20 (0x61c0 bytes) 000540 1788589304.808174 read 0x003ba3 thru 0x009d20 (0x617e bytes) 000541 1788589304.809072 read 0x0011bb thru 0x0084bc (0x7302 bytes) 000542 1788589304.810321 punch from 0x007402 to 0x009d20 (0x291f bytes) 000543 1788589304.815770 mapwrite 0x03ada4 thru 0x03ffff (0x525c bytes) 000544 1788589304.920153 read 0x0328bb thru 0x03dd85 (0xb4cb bytes) 000545 1788589304.922188 mapread 0x01102d thru 0x012e3c (0x1e10 bytes) 000547 1788589304.925323 trunc from 0x040000 to 0x0188e1 (0x2771e bytes) 000550 1788589304.955631 trunc from 0x0188e2 to 0x027ff7 (0xf716 bytes) 000551 1788589304.983255 write 0x01eae2 thru 0x026db2 (0x82d1 bytes) 000552 1788589305.030009 read 0x0175a8 thru 0x017740 (0x199 bytes) 000553 1788589305.031074 trunc from 0x027ff8 to 0x0315a3 (0x95ac bytes) 000555 1788589305.066873 punch from 0x003b01 to 0x00faa3 (0xbfa3 bytes) 000556 1788589305.088760 trunc from 0x0315a4 to 0x00e803 (0x22da0 bytes) 000557 1788589305.112159 trunc from 0x00e804 to 0x032f5e (0x2475b bytes) 000559 1788589305.144003 punch from 0x01b4ca to 0x01f664 (0x419b bytes) 000561 1788589305.154614 trunc from 0x032f5f to 0x00e686 (0x248d8 bytes) 000562 1788589305.170551 trunc from 0x00e687 to 0x01cf39 (0xe8b3 bytes) 000563 1788589305.203930 mapwrite 0x0225b5 thru 0x02caff (0xa54b bytes) 000564 1788589305.316550 read 0x00895d thru 0x008d69 (0x40d bytes) 000565 1788589305.333017 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2cb00): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cb00): Mirror 8: 0x54665a64 (stale) Mirror 11: 0x54665a64 (stale) Mirror 12: 0x54665a64 (stale) Mirror 13: 0xbab771cb (stale) CRC-32 checksum value for chunk [0, 0x2cb00): Mirror 1: 0x4b26bfc0 Mirror 14: 0x4b26bfc0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cb00: skipped 000566 1788589306.650430 mapwrite 0x03b3c9 thru 0x03d231 (0x1e69 bytes) 000568 1788589306.837850 write 0x022b64 thru 0x032b62 (0xffff bytes) 000569 1788589306.855421 write 0x03f31f thru 0x03ffff (0xce1 bytes) 000570 1788589306.862908 trunc from 0x040000 to 0x01c836 (0x237c9 bytes) 000571 1788589306.891324 mapwrite 0x02dc8e thru 0x03904b (0xb3be bytes) 000572 1788589307.019826 trunc from 0x03904c to 0x01b3b8 (0x1dc93 bytes) 000573 1788589307.046019 mapread 0x0173fe thru 0x01b3b8 (0x3fbb bytes) 000575 1788589307.061591 write 0x0201e8 thru 0x02db91 (0xd9aa bytes) 000576 1788589307.065005 write 0x014e0d thru 0x01f4c5 (0xa6b9 bytes) 000578 1788589307.074526 mapwrite 0x002c83 thru 0x00822e (0x55ac bytes) 000582 1788589307.164900 trunc from 0x02db92 to 0x006302 (0x2788f bytes) 000584 1788589307.200835 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x6303): Mirror 8: 0x2e7b4182 (stale) Mirror 11: 0x2e7b4182 (stale) Mirror 13: 0x2e7b4182 (stale) Mirror 14: 0x2e7b4182 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6303): Mirror 8: 0x2e7b4182 (stale) Mirror 11: 0x2e7b4182 (stale) Mirror 13: 0x2e7b4182 (stale) Mirror 14: 0x2e7b4182 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6303: skipped 000585 1788589307.737633 MIRROR_RESYNC 5 mirrors 000588 1788589308.985735 read 0x005510 thru 0x006302 (0xdf3 bytes) 000589 1788589308.997906 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) 000591 1788589309.344224 write 0x0185d4 thru 0x01916d (0xb9a bytes) 000593 1788589309.434509 punch from 0x0169a7 to 0x01916d (0x27c7 bytes) 000595 1788589309.452498 punch from 0x0069f1 to 0x007b2e (0x113e bytes) 000596 1788589309.457470 punch from 0x006668 to 0x011136 (0xaacf bytes) 000598 1788589309.462591 trunc from 0x01916e to 0x011af6 (0x7677 bytes) 000599 1788589309.491052 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x11af7): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11af7): Mirror 8: 0x6ae6c665 (stale) Mirror 11: 0x6ae6c665 (stale) Mirror 14: 0x6ae6c665 (stale) CRC-32 checksum value for chunk [0, 0x11af7): Mirror 1: 0x6ae6c665 Mirror 15: 0x6ae6c665 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11af7: skipped 000600 1788589310.336287 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x11af7): Mirror 8: 0x6ae6c665 (stale) Mirror 11: 0x6ae6c665 (stale) Mirror 14: 0x6ae6c665 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11af7): Mirror 8: 0x6ae6c665 (stale) Mirror 11: 0x6ae6c665 (stale) Mirror 14: 0x6ae6c665 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11af7: skipped 000601 1788589310.645966 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x11af7): Mirror 8: 0x6ae6c665 (stale) Mirror 14: 0x6ae6c665 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11af7): Mirror 8: 0x6ae6c665 (stale) Mirror 14: 0x6ae6c665 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11af7: skipped 000602 1788589310.958778 mapread 0x004746 thru 0x011af6 (0xd3b1 bytes) 000603 1788589310.982251 punch from 0x0074e5 to 0x008308 (0xe24 bytes) 000604 1788589310.999810 write 0x000712 thru 0x00f8f5 (0xf1e4 bytes) 000605 1788589311.010271 trunc from 0x011af7 to 0x037c18 (0x26122 bytes) 000607 1788589311.026075 punch from 0x013d36 to 0x01b965 (0x7c30 bytes) 000608 1788589311.040990 write 0x015046 thru 0x01e3c3 (0x937e bytes) 000612 1788589311.053075 read 0x026ada thru 0x035c93 (0xf1ba bytes) 000613 1788589311.061323 trunc from 0x037c19 to 0x00185d (0x363bb bytes) 000614 1788589311.076531 write 0x02ffc9 thru 0x03f537 (0xf56f bytes) 000617 1788589311.085335 mapread 0x033032 thru 0x03f537 (0xc506 bytes) 000618 1788589311.087274 trunc from 0x03f538 to 0x0211b7 (0x1e380 bytes) 000619 1788589311.107293 punch from 0x003d8b to 0x007931 (0x3ba7 bytes) 000621 1788589311.113339 mapwrite 0x015a3e thru 0x01d539 (0x7afc bytes) 000622 1788589311.170074 read 0x01d6a2 thru 0x0211b7 (0x3b16 bytes) 000624 1788589311.181169 write 0x02f2f4 thru 0x03ce6c (0xdb79 bytes) 000625 1788589311.187463 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ce6d): Mirror 8: 0x498f5e75 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ce6d): Mirror 8: 0x498f5e75 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ce6d: skipped 000626 1788589311.409093 trunc from 0x03ce6d to 0x0076bc (0x357b0 bytes) 000627 1788589311.418684 write 0x01eee0 thru 0x01efb6 (0xd7 bytes) 000628 1788589311.419634 mapwrite 0x01179e thru 0x0185ca (0x6e2d bytes) 000631 1788589311.462980 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1efb7): Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1efb7): Mirror 8: 0xe4cf1f1b (stale) CRC-32 checksum value for chunk [0, 0x1efb7): Mirror 1: 0xc272672e Mirror 9: 0xc272672e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1efb7: skipped 000632 1788589312.206093 mapread 0x00bb38 thru 0x014ee0 (0x93a9 bytes) 000633 1788589312.244739 write 0x029c94 thru 0x02ff33 (0x62a0 bytes) 000636 1788589312.362611 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ff34): Mirror 9: 0x94a9ef46 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ff34): Mirror 9: 0x94a9ef46 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ff34: skipped 000637 1788589312.684701 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) 000638 1788589312.818982 mapwrite 0x03ba2e thru 0x03c793 (0xd66 bytes) 000640 1788589312.908605 mapwrite 0x02d0ca thru 0x0383f4 (0xb32b bytes) 000642 1788589312.990833 MIRROR_EXTEND to 2 mirrors 000643 1788589313.724284 mapwrite 0x034146 thru 0x03ffff (0xbeba bytes) 000644 1788589314.022401 trunc from 0x040000 to 0x028851 (0x177ae bytes) 000645 1788589314.053939 write 0x002bc4 thru 0x011fc2 (0xf3ff bytes) 000647 1788589314.078475 write 0x012cfe thru 0x018f7b (0x627e bytes) 000650 1788589314.085829 read 0x002a6c thru 0x00bbdd (0x9172 bytes) 000654 1788589314.089850 write 0x001bde thru 0x010db5 (0xf1d8 bytes) 000655 1788589314.098567 trunc from 0x028852 to 0x03e2d0 (0x15a7f bytes) 000657 1788589314.123776 mapwrite 0x0165ca thru 0x0221b1 (0xbbe8 bytes) 000659 1788589314.195935 mapwrite 0x0091f8 thru 0x00f254 (0x605d bytes) 000660 1788589314.243189 write 0x01a3f7 thru 0x028b8f (0xe799 bytes) 000661 1788589314.244880 read 0x004956 thru 0x014758 (0xfe03 bytes) 000662 1788589314.247719 read 0x037d56 thru 0x03e2d0 (0x657b bytes) 000663 1788589314.256288 write 0x03579a thru 0x03da47 (0x82ae bytes) 000664 1788589314.258614 mapwrite 0x000589 thru 0x00f732 (0xf1aa bytes) 000668 1788589314.307484 trunc from 0x03e2d1 to 0x028c74 (0x1565c bytes) 000669 1788589314.331585 write 0x013f45 thru 0x01c5b1 (0x866d bytes) 000671 1788589314.334657 trunc from 0x028c75 to 0x011c73 (0x17001 bytes) 000673 1788589314.355489 mapread 0x00efe6 thru 0x011c73 (0x2c8e bytes) 000675 1788589314.356981 mapread 0x00830a thru 0x011c73 (0x996a bytes) 000676 1788589314.359913 read 0x000898 thru 0x00629c (0x5a05 bytes) 000677 1788589314.361579 mapwrite 0x02835d thru 0x02f2a4 (0x6f48 bytes) 000678 1788589314.442356 write 0x037e49 thru 0x03820a (0x3c2 bytes) 000679 1788589314.450896 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) 000681 1788589314.599591 MIRROR_EXTEND to 2 mirrors 000682 1788589315.467982 trunc from 0x03820b to 0x038a69 (0x85f bytes) 000684 1788589315.542423 punch from 0x01ef17 to 0x023fe3 (0x50cd bytes) 000686 1788589315.552468 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x38a6a): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38a6a): Mirror 2: 0x7ac43c25 (stale) CRC-32 checksum value for chunk [0, 0x38a6a): Mirror 1: 0x7ac43c25 Mirror 3: 0x7ac43c25 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38a6a: skipped 000687 1788589316.527991 mapread 0x0172c7 thru 0x01ec21 (0x795b bytes) 000691 1788589316.605853 mapwrite 0x013fa2 thru 0x0204d2 (0xc531 bytes) 000693 1788589316.751845 mapread 0x017e7f thru 0x026487 (0xe609 bytes) 000694 1788589316.770340 trunc from 0x038a6a to 0x0090f3 (0x2f976 bytes) 000695 1788589316.805505 punch from 0x002556 to 0x0090f3 (0x6b9e bytes) 000697 1788589316.818943 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x90f4): Mirror 2: 0x218dd21a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x90f4): Mirror 2: 0x218dd21a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x90f4: skipped 000698 1788589317.240786 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) 000700 1788589317.395997 mapwrite 0x01554e thru 0x015a45 (0x4f8 bytes) 000702 1788589317.484654 mapwrite 0x033b7e thru 0x03c86c (0x8cef bytes) 000703 1788589317.581010 read 0x01ce02 thru 0x0248f5 (0x7af4 bytes) 000704 1788589317.592082 mapwrite 0x035d01 thru 0x03ffff (0xa2ff bytes) 000708 1788589317.681960 mapread 0x0372ef thru 0x03e5b8 (0x72ca bytes) 000709 1788589317.683182 trunc from 0x040000 to 0x03215b (0xdea4 bytes) 000710 1788589317.708968 mapread 0x00ce77 thru 0x01a7db (0xd965 bytes) 000711 1788589317.729010 trunc from 0x03215c to 0x011766 (0x209f5 bytes) 000713 1788589317.746772 trunc from 0x011767 to 0x01eca4 (0xd53e bytes) 000714 1788589317.762677 punch from 0x019fb1 to 0x01eca4 (0x4cf4 bytes) 000715 1788589317.772020 read 0x007c81 thru 0x0137fa (0xbb7a bytes) 000717 1788589317.781032 punch from 0x019113 to 0x01e1f6 (0x50e4 bytes) 000718 1788589317.785957 punch from 0x012f80 to 0x01b1a0 (0x8221 bytes) 000720 1788589317.790916 mapread 0x0043b0 thru 0x009651 (0x52a2 bytes) 000722 1788589317.792716 write 0x00fe3b thru 0x01e0d1 (0xe297 bytes) 000723 1788589317.799873 punch from 0x019ed5 to 0x01eca4 (0x4dd0 bytes) 000724 1788589317.818059 mapwrite 0x0333a3 thru 0x035297 (0x1ef5 bytes) 000725 1788589317.914814 trunc from 0x035298 to 0x01183b (0x23a5c bytes) 000727 1788589317.939929 read 0x00690f thru 0x0078b6 (0xfa8 bytes) 000728 1788589317.941021 mapwrite 0x00de1d thru 0x0189e3 (0xabc7 bytes) 000730 1788589318.081232 read 0x009c60 thru 0x011a9b (0x7e3c bytes) 000731 1788589318.094944 MIRROR_EXTEND to 2 mirrors 000732 1788589318.720075 write 0x012248 thru 0x01e0d9 (0xbe92 bytes) 000735 1788589318.809076 MIRROR_RESYNC 2 mirrors 000736 1788589319.716912 punch from 0x01c5e8 to 0x01e0d9 (0x1af2 bytes) 000737 1788589319.789983 punch from 0x00cc56 to 0x012454 (0x57ff bytes) 000740 1788589319.805200 punch from 0x00116d to 0x0059f1 (0x4885 bytes) 000744 1788589319.816701 write 0x024eb9 thru 0x031016 (0xc15e bytes) 000745 1788589319.825957 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) 000746 1788589320.083261 punch from 0x02a9e4 to 0x031016 (0x6633 bytes) 000747 1788589320.088734 trunc from 0x031017 to 0x037636 (0x6620 bytes) 000749 1788589320.104981 trunc from 0x037637 to 0x03e01b (0x69e5 bytes) 000751 1788589320.131044 read 0x00a9be thru 0x00dcf9 (0x333c bytes) 000752 1788589320.140930 read 0x009b78 thru 0x015107 (0xb590 bytes) 000754 1788589320.170773 mapwrite 0x00a776 thru 0x00bcf8 (0x1583 bytes) 000755 1788589320.243701 mapwrite 0x00d15e thru 0x011633 (0x44d6 bytes) 000756 1788589320.300065 read 0x0307fc thru 0x03e01b (0xd820 bytes) 000758 1788589320.301216 punch from 0x03dc72 to 0x03e01b (0x3aa bytes) 000759 1788589320.307467 trunc from 0x03e01c to 0x00016a (0x3deb1 bytes) 000760 1788589320.325513 write 0x036de0 thru 0x03a107 (0x3328 bytes) 000761 1788589320.327185 mapread 0x017ecb thru 0x01d32b (0x5461 bytes) 000763 1788589320.339538 mapread 0x032e5d thru 0x0352d1 (0x2475 bytes) 000764 1788589320.340316 mapread 0x0044dd thru 0x01000d (0xbb31 bytes) 000765 1788589320.341087 trunc from 0x03a108 to 0x0169fe (0x23709 bytes) 000766 1788589320.362318 punch from 0x0141d9 to 0x0169fe (0x2826 bytes) 000769 1788589320.379760 mapwrite 0x0068ee thru 0x00e628 (0x7d3b bytes) 000770 1788589320.430635 trunc from 0x0169ff to 0x02777c (0x10d7e bytes) 000771 1788589320.465078 write 0x025c3d thru 0x02a7cf (0x4b93 bytes) 000772 1788589320.477977 read 0x00287c thru 0x006e97 (0x461c bytes) 000773 1788589320.478763 mapread 0x007d8f thru 0x010ed9 (0x914b bytes) 000775 1788589320.487820 MIRROR_EXTEND to 2 mirrors 000776 1788589321.418406 MIRROR_EXTEND to 3 mirrors 000777 1788589322.188550 mapwrite 0x014d8d thru 0x023ef2 (0xf166 bytes) 000779 1788589322.437427 trunc from 0x02a7d0 to 0x03f023 (0x14854 bytes) 000780 1788589322.503830 trunc from 0x03f024 to 0x03f2eb (0x2c8 bytes) 000781 1788589322.524933 mapwrite 0x003f67 thru 0x011b79 (0xdc13 bytes) 000782 1788589322.580533 read 0x00936f thru 0x0111f4 (0x7e86 bytes) 000783 1788589322.581804 mapwrite 0x011446 thru 0x01e054 (0xcc0f bytes) 000784 1788589322.619549 write 0x01b05b thru 0x01d8c9 (0x286f bytes) 000785 1788589322.620729 punch from 0x0115aa to 0x01f4f7 (0xdf4e bytes) 000786 1788589322.633994 MIRROR_RESYNC 3 mirrors 000787 1788589323.653742 write 0x03f8e2 thru 0x03ffff (0x71e bytes) 000788 1788589323.759919 write 0x01a217 thru 0x01a27e (0x68 bytes) 000789 1788589323.765793 mapwrite 0x03c227 thru 0x03ffff (0x3dd9 bytes) 000791 1788589323.859543 punch from 0x026a62 to 0x02dd22 (0x72c1 bytes) 000792 1788589323.867171 trunc from 0x040000 to 0x00df9b (0x32064 bytes) 000796 1788589323.901092 punch from 0x00cd79 to 0x00df9b (0x1223 bytes) 000797 1788589323.908786 mapwrite 0x02340e thru 0x028d46 (0x5939 bytes) 000798 1788589323.997452 mapread 0x01f86a thru 0x026f8e (0x7725 bytes) 000799 1788589323.998861 mapwrite 0x02b071 thru 0x02f157 (0x40e7 bytes) 000801 1788589324.080561 trunc from 0x02f158 to 0x0160ac (0x190ab bytes) 000805 1788589324.109844 mapread 0x0151e1 thru 0x0160ac (0xecc bytes) 000806 1788589324.121922 read 0x011674 thru 0x0160ac (0x4a39 bytes) 000807 1788589324.128923 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x160ad): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x160ad): Mirror 2: 0xa0004a01 (stale) Mirror 3: 0xa0004a01 (stale) CRC-32 checksum value for chunk [0, 0x160ad): Mirror 1: 0xc10aeded Mirror 4: 0xc10aeded lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x160ad: skipped 000808 1788589325.137758 mapwrite 0x02c3d8 thru 0x034b32 (0x875b bytes) 000809 1788589325.364851 write 0x0045f8 thru 0x012bd9 (0xe5e2 bytes) 000810 1788589325.383492 trunc from 0x034b33 to 0x01937f (0x1b7b3 bytes) 000811 1788589325.443268 read 0x00ae30 thru 0x011cba (0x6e8b bytes) 000813 1788589325.444924 read 0x013a46 thru 0x01937f (0x593a bytes) 000814 1788589325.453778 trunc from 0x019380 to 0x01a22c (0xead bytes) 000815 1788589325.498978 mapwrite 0x020b4e thru 0x024c7a (0x412d bytes) 000816 1788589325.580862 read 0x022deb thru 0x024c7a (0x1e90 bytes) 000817 1788589325.581643 punch from 0x01deab to 0x024c7a (0x6dd0 bytes) 000820 1788589325.590906 punch from 0x002d04 to 0x00d3ad (0xa6aa bytes) 000821 1788589325.600433 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24c7b): Mirror 3: 0x3aa5fa6c (stale) Mirror 4: 0x42e89207 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24c7b): Mirror 3: 0x3aa5fa6c (stale) Mirror 4: 0x42e89207 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24c7b: skipped 000823 1788589325.919012 punch from 0x017d70 to 0x0198ae (0x1b3f bytes) 000826 1788589325.930270 punch from 0x005c76 to 0x012c8d (0xd018 bytes) 000827 1788589325.935095 read 0x00922f thru 0x00ca0a (0x37dc bytes) 000828 1788589325.944215 write 0x022c51 thru 0x02d0b9 (0xa469 bytes) 000829 1788589325.951353 write 0x02eb58 thru 0x03d332 (0xe7db bytes) 000830 1788589325.954257 mapread 0x00a0d0 thru 0x0187f1 (0xe722 bytes) 000831 1788589325.995763 mapread 0x02b092 thru 0x02feda (0x4e49 bytes) 000833 1788589325.998668 punch from 0x02f40c to 0x031290 (0x1e85 bytes) 000834 1788589326.025962 read 0x01c0e5 thru 0x0299da (0xd8f6 bytes) 000835 1788589326.034903 read 0x022507 thru 0x028ce5 (0x67df bytes) 000836 1788589326.035427 mapread 0x02b38d thru 0x0346c6 (0x933a bytes) 000838 1788589326.037467 mapread 0x03126e thru 0x0359fd (0x4790 bytes) 000839 1788589326.049741 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3d333): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d333): Mirror 3: 0xaa9d8bbc (stale) Mirror 4: 0xc3b09d37 (stale) CRC-32 checksum value for chunk [0, 0x3d333): Mirror 1: 0xc69cc9de Mirror 5: 0xc69cc9de lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d333: skipped 000841 1788589327.202714 MIRROR_RESYNC 4 mirrors 000842 1788589327.949983 trunc from 0x03d333 to 0x0130b3 (0x2a27f bytes) 000843 1788589328.040005 punch from 0x00bb8e to 0x0130b3 (0x7526 bytes) 000845 1788589328.047803 punch from 0x006e76 to 0x0130b3 (0xc23e bytes) 000847 1788589328.054901 trunc from 0x0130b4 to 0x037b3e (0x24a8b bytes) 000848 1788589328.081046 punch from 0x03093d to 0x033a10 (0x30d4 bytes) 000849 1788589328.087614 write 0x03407e thru 0x03e9c9 (0xa94c bytes) 000850 1788589328.106017 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e9ca): Mirror 4: 0x69678466 (stale) Mirror 5: 0x69678466 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e9ca): Mirror 4: 0x69678466 (stale) Mirror 5: 0x69678466 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e9ca: skipped 000851 1788589328.466635 read 0x005111 thru 0x0068d2 (0x17c2 bytes) 000852 1788589328.473772 mapwrite 0x0128aa thru 0x0169f3 (0x414a bytes) 000853 1788589328.535679 mapread 0x02cfc8 thru 0x036e87 (0x9ec0 bytes) 000854 1788589328.551719 punch from 0x0176d8 to 0x01db85 (0x64ae bytes) 000857 1788589328.558735 trunc from 0x03e9ca to 0x01b074 (0x23955 bytes) 000858 1788589328.576770 write 0x01e548 thru 0x02db92 (0xf64b bytes) 000859 1788589328.579494 read 0x00282f thru 0x00e1f5 (0xb9c7 bytes) 000860 1788589328.588487 read 0x00324c thru 0x008dce (0x5b83 bytes) 000861 1788589328.589611 mapwrite 0x02378d thru 0x02f3a7 (0xbc1b bytes) 000862 1788589328.655961 read 0x0263fc thru 0x02f3a7 (0x8fac bytes) 000863 1788589328.657225 write 0x022f25 thru 0x02797d (0x4a59 bytes) 000864 1788589328.659481 mapwrite 0x00b25c thru 0x01504d (0x9df2 bytes) 000865 1788589328.703330 punch from 0x001055 to 0x00d292 (0xc23e bytes) 000867 1788589328.709501 mapwrite 0x017302 thru 0x01f0fe (0x7dfd bytes) 000868 1788589328.745464 mapread 0x02ca85 thru 0x02f3a7 (0x2923 bytes) 000869 1788589328.746519 read 0x02aca2 thru 0x02d73f (0x2a9e bytes) 000870 1788589328.748242 write 0x03b7b7 thru 0x03ffff (0x4849 bytes) 000873 1788589328.750964 trunc from 0x040000 to 0x020d2c (0x1f2d3 bytes) 000874 1788589328.771564 read 0x01934b thru 0x020d2c (0x79e2 bytes) 000876 1788589328.772716 mapread 0x00a7d1 thru 0x00b70e (0xf3e bytes) 000878 1788589328.781454 mapwrite 0x03058a thru 0x031552 (0xfc9 bytes) 000879 1788589328.843645 read 0x00ea5e thru 0x010b47 (0x20ea bytes) 000880 1788589328.849677 MIRROR_RESYNC 3 mirrors 000881 1788589329.809248 trunc from 0x031553 to 0x00934f (0x28203 bytes) 000883 1788589329.894415 mapread 0x005c4b thru 0x00934f (0x3705 bytes) 000884 1788589329.921590 trunc from 0x009350 to 0x034955 (0x2b606 bytes) 000888 1788589329.948950 read 0x02d7ba thru 0x034955 (0x719c bytes) 000889 1788589329.967602 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x34956): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34956): Mirror 4: 0xf0748314 (stale) Mirror 5: 0xf0748314 (stale) CRC-32 checksum value for chunk [0, 0x34956): Mirror 1: 0x5f9d2f92 Mirror 6: 0x5f9d2f92 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34956: skipped 000890 1788589331.043697 trunc from 0x034956 to 0x0130a4 (0x218b1 bytes) 000891 1788589331.139860 write 0x002b3f thru 0x0055e7 (0x2aa9 bytes) 000892 1788589331.154698 write 0x0083d3 thru 0x008cd9 (0x907 bytes) 000893 1788589331.160470 write 0x00ce3d thru 0x018abd (0xbc81 bytes) 000896 1788589331.168882 read 0x00edce thru 0x010062 (0x1295 bytes) 000899 1788589331.171597 read 0x0159b5 thru 0x018abd (0x3109 bytes) 000900 1788589331.172734 mapwrite 0x02ce58 thru 0x03c1ec (0xf395 bytes) 000901 1788589331.272715 write 0x016745 thru 0x023b41 (0xd3fd bytes) 000902 1788589331.275459 write 0x03f314 thru 0x03ffff (0xcec bytes) 000903 1788589331.277098 mapwrite 0x03a120 thru 0x03ffff (0x5ee0 bytes) 000905 1788589331.326577 mapread 0x0162f1 thru 0x0253bc (0xf0cc bytes) 000906 1788589331.327726 punch from 0x01957d to 0x025d65 (0xc7e9 bytes) 000908 1788589331.339833 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xf5186884 (stale) Mirror 5: 0xf5186884 (stale) Mirror 6: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc2ee74fb Mirror 7: 0xc2ee74fb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000909 1788589332.319520 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xf5186884 (stale) Mirror 6: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xf5186884 (stale) Mirror 6: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc2ee74fb Mirror 7: 0xc2ee74fb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000912 1788589332.938406 mapread 0x0066b5 thru 0x007078 (0x9c4 bytes) 000913 1788589332.967428 punch from 0x015cbc to 0x02599f (0xfce4 bytes) 000914 1788589333.056249 trunc from 0x040000 to 0x009cca (0x36335 bytes) 000916 1788589333.103609 write 0x017cf6 thru 0x025aa9 (0xddb4 bytes) 000917 1788589333.106690 trunc from 0x025aaa to 0x0210d7 (0x49d2 bytes) 000918 1788589333.124846 read 0x01c53b thru 0x0210d7 (0x4b9d bytes) 000919 1788589333.125696 read 0x016ea3 thru 0x017e18 (0xf76 bytes) 000920 1788589333.142972 mapread 0x011a40 thru 0x012fec (0x15ad bytes) 000922 1788589333.144835 read 0x0134cb thru 0x0210d7 (0xdc0d bytes) 000923 1788589333.145625 mapwrite 0x001e84 thru 0x00d805 (0xb982 bytes) 000924 1788589333.185447 mapwrite 0x00b295 thru 0x0172ee (0xc05a bytes) 000926 1788589333.239663 write 0x008932 thru 0x010d60 (0x842f bytes) 000927 1788589333.246068 MIRROR_RESYNC 4 mirrors 000929 1788589334.264450 read 0x007733 thru 0x013d7f (0xc64d bytes) 000930 1788589334.277310 MIRROR_EXTEND to 5 mirrors 000931 1788589334.974687 write 0x01c2db thru 0x023cf6 (0x7a1c bytes) 000932 1788589335.121250 mapwrite 0x018076 thru 0x024479 (0xc404 bytes) 000935 1788589335.254827 write 0x01eb7e thru 0x02d76f (0xebf2 bytes) 000937 1788589335.259650 punch from 0x00d6dc to 0x01c153 (0xea78 bytes) 000939 1788589335.282412 write 0x0289b5 thru 0x03442b (0xba77 bytes) 000940 1788589335.284921 read 0x0073f3 thru 0x01486b (0xd479 bytes) 000942 1788589335.299507 write 0x03994b thru 0x03ffff (0x66b5 bytes) 000943 1788589335.306597 MIRROR_RESYNC 5 mirrors 000944 1788589336.790001 read 0x02eee2 thru 0x03e8c6 (0xf9e5 bytes) 000947 1788589336.812643 mapwrite 0x020575 thru 0x02b8cf (0xb35b bytes) 000949 1788589337.123422 trunc from 0x040000 to 0x022e41 (0x1d1be bytes) 000951 1788589337.164280 punch from 0x0227dd to 0x022e41 (0x665 bytes) 000952 1788589337.170680 trunc from 0x022e42 to 0x00e53f (0x14902 bytes) 000953 1788589337.191512 write 0x030704 thru 0x032016 (0x1913 bytes) 000957 1788589337.197438 punch from 0x02ff9b to 0x0300ee (0x154 bytes) 000958 1788589337.207735 read 0x00b06a thru 0x01387a (0x8811 bytes) 000959 1788589337.252730 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x32017): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32017): Mirror 5: 0x413d7351 (stale) Mirror 6: 0x413d7351 (stale) Mirror 7: 0x413d7351 (stale) Mirror 8: 0x413d7351 (stale) CRC-32 checksum value for chunk [0, 0x32017): Mirror 1: 0xba48e436 Mirror 9: 0xba48e436 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32017: skipped 000960 1788589338.228517 punch from 0x013226 to 0x021847 (0xe622 bytes) 000961 1788589338.299912 write 0x00a4b2 thru 0x01a1a2 (0xfcf1 bytes) 000962 1788589338.311684 write 0x01a319 thru 0x01c730 (0x2418 bytes) 000965 1788589338.323280 MIRROR_RESYNC 6 mirrors 000967 1788589339.519587 write 0x015699 thru 0x023f8b (0xe8f3 bytes) 000968 1788589339.622706 punch from 0x0193c3 to 0x02258c (0x91ca bytes) 000969 1788589339.640696 mapwrite 0x011618 thru 0x0119b7 (0x3a0 bytes) 000970 1788589339.730547 mapread 0x016cd9 thru 0x017040 (0x368 bytes) 000971 1788589339.734576 punch from 0x030a76 to 0x032016 (0x15a1 bytes) 000972 1788589339.750329 write 0x0009f8 thru 0x008ced (0x82f6 bytes) 000973 1788589339.777659 mapread 0x01364b thru 0x02248a (0xee40 bytes) 000974 1788589339.812526 mapread 0x00e3c4 thru 0x0140d9 (0x5d16 bytes) 000975 1788589339.813812 punch from 0x0210ff to 0x02a0ce (0x8fd0 bytes) 000976 1788589339.831415 punch from 0x007c86 to 0x0084a1 (0x81c bytes) 000977 1788589339.837028 mapwrite 0x021087 thru 0x0216ac (0x626 bytes) 000978 1788589339.904432 trunc from 0x032017 to 0x02d5a0 (0x4a76 bytes) 000979 1788589339.930444 mapread 0x00d880 thru 0x00ece2 (0x1463 bytes) 000981 1788589339.932912 punch from 0x00077f to 0x0097a3 (0x9025 bytes) 000982 1788589339.938802 write 0x03b58c thru 0x03ffff (0x4a74 bytes) 000983 1788589339.941399 mapwrite 0x007d07 thru 0x00d652 (0x594c bytes) 000984 1788589340.001271 mapread 0x010cdd thru 0x0136f3 (0x2a17 bytes) 000985 1788589340.002603 punch from 0x01967d to 0x019b3f (0x4c3 bytes) 000987 1788589340.009544 punch from 0x005d5c to 0x00c305 (0x65aa bytes) 000988 1788589340.014493 mapread 0x017a59 thru 0x01d49d (0x5a45 bytes) 000989 1788589340.020397 punch from 0x0114f9 to 0x019a1c (0x8524 bytes) 000991 1788589340.025935 punch from 0x00bd4c to 0x01324d (0x7502 bytes) 000993 1788589340.031627 read 0x0173de thru 0x01856b (0x118e bytes) 000996 1788589340.039540 read 0x030ad1 thru 0x034f4a (0x447a bytes) 000998 1788589340.067804 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x8f1910cf (stale) Mirror 6: 0x8f1910cf (stale) Mirror 7: 0x8f1910cf (stale) Mirror 8: 0x8f1910cf (stale) Mirror 9: 0x8f1910cf (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd4a150ea Mirror 10: 0xd4a150ea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000999 1788589341.177589 mapwrite 0x034d85 thru 0x03d8a5 (0x8b21 bytes) All operations completed A-OK!