== sanity-flr test 70a: flr mode fsx test ================ 09:16:12 (1788614172) Seed set to 4174 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000004 1788614174.580312 mapwrite 0x018edc thru 0x01a0ff (0x1224 bytes) 000005 1788614174.702465 punch from 0x00dc89 to 0x01a0ff (0xc477 bytes) 000006 1788614174.716578 punch from 0x013ac7 to 0x01803a (0x4574 bytes) 000008 1788614174.725284 mapread 0x008f71 thru 0x00de8a (0x4f1a bytes) 000009 1788614174.735755 read 0x004971 thru 0x00adce (0x645e bytes) 000011 1788614174.736992 read 0x0162fc thru 0x018d1d (0x2a22 bytes) 000013 1788614174.744070 punch from 0x008920 to 0x00e2bb (0x599c bytes) 000015 1788614174.748941 mapread 0x00181f thru 0x0071ce (0x59b0 bytes) 000016 1788614174.750098 mapwrite 0x00c9c7 thru 0x019b55 (0xd18f bytes) 000017 1788614174.805005 mapread 0x0074bb thru 0x016e04 (0xf94a bytes) 000020 1788614174.825341 read 0x006c53 thru 0x00b36b (0x4719 bytes) 000023 1788614174.830925 MIRROR_EXTEND to 2 mirrors 000025 1788614175.676583 mapwrite 0x00a3fd thru 0x013521 (0x9125 bytes) 000026 1788614175.880619 mapwrite 0x02145d thru 0x02be80 (0xaa24 bytes) 000027 1788614176.059761 mapread 0x01ec71 thru 0x020df4 (0x2184 bytes) 000028 1788614176.061782 punch from 0x013e13 to 0x016d16 (0x2f04 bytes) 000029 1788614176.066300 mapread 0x023bd4 thru 0x02be80 (0x82ad bytes) 000030 1788614176.071696 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2be81): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2be81): Mirror 2: 0xeae64ced (stale) CRC-32 checksum value for chunk [0, 0x2be81): Mirror 1: 0x6b82008a Mirror 3: 0x6b82008a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2be81: skipped 000031 1788614177.188773 read 0x0006aa thru 0x0073f0 (0x6d47 bytes) 000032 1788614177.208973 MIRROR_RESYNC 3 mirrors 000033 1788614178.287478 punch from 0x020e3a to 0x027245 (0x640c bytes) 000034 1788614178.392634 write 0x019341 thru 0x028f91 (0xfc51 bytes) 000035 1788614178.413201 read 0x020183 thru 0x02285f (0x26dd bytes) 000036 1788614178.413949 mapread 0x028ad4 thru 0x02b3aa (0x28d7 bytes) 000037 1788614178.437778 MIRROR_RESYNC 3 mirrors 000039 1788614179.300772 read 0x01941e thru 0x01de32 (0x4a15 bytes) 000040 1788614179.308769 mapwrite 0x004722 thru 0x00df11 (0x97f0 bytes) truncating to largest ever: 0x24f40 000041 1788614179.477382 trunc from 0x02be81 to 0x024f3f (0x6f41 bytes) 000043 1788614179.508453 punch from 0x003365 to 0x004490 (0x112c bytes) truncating to largest ever: 0x3f196 000045 1788614179.517758 trunc from 0x024f40 to 0x03f195 (0x1a256 bytes) 000046 1788614179.555791 read 0x03e7aa thru 0x03f195 (0x9ec bytes) 000047 1788614179.577202 punch from 0x033862 to 0x036c9b (0x343a bytes) 000048 1788614179.591736 trunc from 0x03f196 to 0x003a02 (0x3b793 bytes) 000049 1788614179.646825 read 0x0028cf thru 0x003a02 (0x1134 bytes) 000050 1788614179.649668 mapwrite 0x013b9e thru 0x01d827 (0x9c8a bytes) 000051 1788614179.768819 mapwrite 0x02de56 thru 0x032b18 (0x4cc3 bytes) 000052 1788614179.846672 mapread 0x002b7c thru 0x012b68 (0xffed bytes) 000053 1788614179.851714 read 0x01e6fb thru 0x02514c (0x6a52 bytes) 000054 1788614179.853857 write 0x01a783 thru 0x023eb9 (0x9737 bytes) 000055 1788614179.866101 MIRROR_RESYNC 3 mirrors 000057 1788614181.069440 mapread 0x015177 thru 0x022523 (0xd3ad bytes) 000058 1788614181.099765 punch from 0x026e8d to 0x027bfa (0xd6e bytes) 000059 1788614181.255904 trunc from 0x032b19 to 0x0395d8 (0x6ac0 bytes) 000060 1788614181.283737 read 0x02d352 thru 0x0395d8 (0xc287 bytes) 000061 1788614181.292512 mapwrite 0x01fe61 thru 0x02e889 (0xea29 bytes) 000062 1788614181.395541 read 0x0058e7 thru 0x00d6a8 (0x7dc2 bytes) 000063 1788614181.414698 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x395d9): Mirror 3: 0x26c60044 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x395d9): Mirror 3: 0x26c60044 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x395d9: skipped 000064 1788614181.783693 punch from 0x0070f9 to 0x0086ab (0x15b3 bytes) 000066 1788614181.795237 write 0x00c7c7 thru 0x010242 (0x3a7c bytes) 000067 1788614181.819804 punch from 0x037f7f to 0x0395d8 (0x165a bytes) 000070 1788614181.833742 punch from 0x020e6f to 0x0211d9 (0x36b bytes) 000071 1788614181.840563 trunc from 0x0395d9 to 0x034935 (0x4ca3 bytes) 000072 1788614181.858775 write 0x025a01 thru 0x031137 (0xb737 bytes) 000074 1788614181.876939 trunc from 0x034936 to 0x00f206 (0x2572f bytes) 000076 1788614181.895289 mapwrite 0x019c69 thru 0x01d94d (0x3ce5 bytes) 000077 1788614181.973833 mapwrite 0x0077b5 thru 0x0077d6 (0x22 bytes) 000079 1788614182.084177 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1d94e): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d94e): Mirror 3: 0x406a7d0e (stale) CRC-32 checksum value for chunk [0, 0x1d94e): Mirror 1: 0xcbf5610b Mirror 4: 0xcbf5610b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d94e: skipped 000081 1788614183.165641 punch from 0x00190b to 0x00deac (0xc5a2 bytes) 000082 1788614183.247641 mapwrite 0x005ff0 thru 0x014c2a (0xec3b bytes) 000083 1788614183.329932 read 0x01ad51 thru 0x01d94d (0x2bfd bytes) 000086 1788614183.339687 trunc from 0x01d94e to 0x00ea6a (0xeee3 bytes) 000087 1788614183.363900 read 0x007f7d thru 0x00ac2e (0x2cb2 bytes) 000088 1788614183.365369 punch from 0x001cb4 to 0x00e1e0 (0xc52d bytes) 000089 1788614183.371002 trunc from 0x00ea6b to 0x0140ad (0x5643 bytes) 000090 1788614183.386457 punch from 0x00a56b to 0x00f2fe (0x4d94 bytes) 000093 1788614183.394792 write 0x005a71 thru 0x01238f (0xc91f bytes) 000094 1788614183.406914 write 0x02cf9a thru 0x035cf4 (0x8d5b bytes) 000096 1788614183.409968 trunc from 0x035cf5 to 0x01cced (0x19007 bytes) 000097 1788614183.425379 mapwrite 0x01a645 thru 0x02828d (0xdc49 bytes) 000100 1788614183.522972 mapwrite 0x02fabe thru 0x03f0ba (0xf5fd bytes) 000101 1788614183.615681 punch from 0x02ba7a to 0x033184 (0x770b bytes) 000103 1788614183.623910 punch from 0x038662 to 0x03f0ba (0x6a59 bytes) 000104 1788614183.631712 mapwrite 0x02e0ac thru 0x031fe2 (0x3f37 bytes) 000105 1788614183.737293 mapwrite 0x0394c8 thru 0x03e7b3 (0x52ec bytes) 000106 1788614183.823608 trunc from 0x03f0bb to 0x007eaf (0x3720b bytes) 000107 1788614183.848174 mapread 0x003c8b thru 0x007eaf (0x4225 bytes) 000108 1788614183.849229 punch from 0x005bdf to 0x007eaf (0x22d1 bytes) 000109 1788614183.861280 write 0x012d15 thru 0x01eb0b (0xbdf7 bytes) 000111 1788614183.864892 mapwrite 0x023cf6 thru 0x02b7be (0x7ac9 bytes) 000112 1788614183.995666 MIRROR_RESYNC 3 mirrors 000113 1788614185.321004 read 0x00367e thru 0x00e5cc (0xaf4f bytes) 000114 1788614185.327563 mapread 0x0084b2 thru 0x00fa0d (0x755c bytes) 000115 1788614185.330917 mapread 0x0281cf thru 0x02b7be (0x35f0 bytes) 000116 1788614185.340427 trunc from 0x02b7bf to 0x02b1f3 (0x5cb bytes) 000118 1788614185.465753 write 0x01b434 thru 0x01bb30 (0x6fd bytes) 000119 1788614185.474277 punch from 0x00c466 to 0x00e8d9 (0x2474 bytes) 000121 1788614185.487021 read 0x028099 thru 0x0299ea (0x1952 bytes) 000122 1788614185.510710 trunc from 0x02b1f4 to 0x0286a7 (0x2b4c bytes) 000123 1788614185.535983 punch from 0x001576 to 0x00dab8 (0xc543 bytes) 000125 1788614185.542866 read 0x005705 thru 0x00f73a (0xa036 bytes) 000126 1788614185.551009 write 0x013398 thru 0x01c9bf (0x9628 bytes) 000127 1788614185.556530 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x286a8): Mirror 4: 0xe43aa7b8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x286a8): Mirror 4: 0xe43aa7b8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x286a8: skipped 000128 1788614185.933037 mapwrite 0x005982 thru 0x007f2b (0x25aa bytes) 000129 1788614186.050870 mapread 0x019f9b thru 0x021ef5 (0x7f5b bytes) 000130 1788614186.064803 punch from 0x009674 to 0x00b6db (0x2068 bytes) 000131 1788614186.069761 write 0x0016bc thru 0x004482 (0x2dc7 bytes) 000132 1788614186.070771 punch from 0x00b55d to 0x01122d (0x5cd1 bytes) 000133 1788614186.088856 read 0x026a85 thru 0x0286a7 (0x1c23 bytes) 000135 1788614186.102617 trunc from 0x0286a8 to 0x022992 (0x5d15 bytes) 000138 1788614186.130023 trunc from 0x022993 to 0x02aa63 (0x80d1 bytes) 000139 1788614186.146930 mapread 0x02397f thru 0x02aa63 (0x70e5 bytes) 000140 1788614186.156943 read 0x0227de thru 0x02aa63 (0x8286 bytes) 000142 1788614186.158710 read 0x000d05 thru 0x0024a7 (0x17a3 bytes) 000143 1788614186.166373 write 0x024c69 thru 0x026ae7 (0x1e7f bytes) 000144 1788614186.168010 write 0x020821 thru 0x025157 (0x4937 bytes) 000145 1788614186.173905 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2aa64): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2aa64): Mirror 4: 0xe23f5c24 (stale) CRC-32 checksum value for chunk [0, 0x2aa64): Mirror 1: 0x4068d199 Mirror 5: 0x4068d199 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2aa64: skipped 000146 1788614187.221099 mapwrite 0x00e4dd thru 0x00fc0c (0x1730 bytes) 000148 1788614187.400862 read 0x00d3fc thru 0x011963 (0x4568 bytes) 000150 1788614187.402281 punch from 0x00a86c to 0x01a4ad (0xfc42 bytes) 000152 1788614187.409935 punch from 0x023fd8 to 0x02aa63 (0x6a8c bytes) 000153 1788614187.421382 read 0x01c9c7 thru 0x027cf9 (0xb333 bytes) 000155 1788614187.436262 mapwrite 0x03467b thru 0x03ffff (0xb985 bytes) 000157 1788614187.660219 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x806cf98e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x806cf98e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000159 1788614188.155466 write 0x01e52b thru 0x028a4f (0xa525 bytes) 000160 1788614188.176764 trunc from 0x040000 to 0x025963 (0x1a69c bytes) 000163 1788614188.201768 write 0x00f87f thru 0x010f21 (0x16a3 bytes) 000164 1788614188.214356 MIRROR_RESYNC 2 mirrors 000165 1788614189.476889 MIRROR_RESYNC 2 mirrors 000166 1788614189.750705 punch from 0x0011ee to 0x00fb8c (0xe99f bytes) 000167 1788614189.851904 mapread 0x00dcd6 thru 0x0164fc (0x8827 bytes) 000169 1788614189.869535 write 0x0058d7 thru 0x012b64 (0xd28e bytes) 000170 1788614189.875892 mapread 0x014b0a thru 0x015019 (0x510 bytes) 000171 1788614189.876872 write 0x00163c thru 0x00fcb1 (0xe676 bytes) 000172 1788614189.882968 read 0x01ebac thru 0x025963 (0x6db8 bytes) 000173 1788614189.889164 write 0x0349a7 thru 0x036909 (0x1f63 bytes) 000174 1788614189.890256 mapread 0x002371 thru 0x010917 (0xe5a7 bytes) 000177 1788614189.892347 trunc from 0x03690a to 0x01797f (0x1ef8a bytes) 000178 1788614189.915024 mapread 0x004b33 thru 0x00ea3a (0x9f08 bytes) 000180 1788614189.916919 mapwrite 0x00095c thru 0x001b4d (0x11f2 bytes) 000181 1788614189.976208 mapwrite 0x013789 thru 0x01743d (0x3cb5 bytes) 000182 1788614190.007036 trunc from 0x017980 to 0x01303b (0x4944 bytes) 000183 1788614190.020052 mapwrite 0x035de3 thru 0x03a805 (0x4a23 bytes) 000185 1788614190.124318 mapwrite 0x01f354 thru 0x020641 (0x12ee bytes) 000188 1788614190.188107 MIRROR_RESYNC 2 mirrors 000191 1788614191.110821 mapread 0x031a36 thru 0x03a805 (0x8dd0 bytes) 000192 1788614191.129901 trunc from 0x03a806 to 0x014275 (0x26590 bytes) 000193 1788614191.261301 read 0x002f5a thru 0x005495 (0x253c bytes) 000194 1788614191.266615 trunc from 0x014276 to 0x0239ed (0xf778 bytes) 000195 1788614191.312841 mapwrite 0x03c665 thru 0x03d371 (0xd0d bytes) 000197 1788614191.489500 read 0x002fc1 thru 0x00836d (0x53ad bytes) 000198 1788614191.502725 punch from 0x03addd to 0x03d371 (0x2595 bytes) 000199 1788614191.527979 mapwrite 0x021ac2 thru 0x0222d9 (0x818 bytes) 000201 1788614191.584996 mapwrite 0x008db4 thru 0x00e158 (0x53a5 bytes) 000202 1788614191.683984 trunc from 0x03d372 to 0x011be4 (0x2b78d bytes) 000203 1788614191.700074 write 0x0314f6 thru 0x033223 (0x1d2e bytes) 000204 1788614191.721695 MIRROR_RESYNC 2 mirrors 000209 1788614192.732824 mapwrite 0x03a3da thru 0x03c773 (0x239a bytes) 000210 1788614193.011203 trunc from 0x03c774 to 0x036b09 (0x5c6a bytes) 000211 1788614193.037885 mapread 0x02834e thru 0x030a3d (0x86f0 bytes) 000212 1788614193.047355 mapread 0x02e394 thru 0x034bdb (0x6848 bytes) 000213 1788614193.056542 punch from 0x020e07 to 0x0263e1 (0x55db bytes) 000214 1788614193.062208 read 0x010660 thru 0x01775f (0x7100 bytes) 000215 1788614193.070503 mapwrite 0x006db3 thru 0x0136d2 (0xc920 bytes) 000217 1788614193.154273 trunc from 0x036b0a to 0x01ee54 (0x17cb5 bytes) 000218 1788614193.173032 mapread 0x01ac43 thru 0x01c9f5 (0x1db3 bytes) 000219 1788614193.180959 write 0x03fbf7 thru 0x03ffff (0x409 bytes) 000221 1788614193.188180 read 0x029646 thru 0x02f6b5 (0x6070 bytes) 000223 1788614193.199609 trunc from 0x040000 to 0x0001d7 (0x3fe28 bytes) 000224 1788614193.224214 punch from 0x00009e to 0x0001d7 (0x13a bytes) 000228 1788614193.235879 trunc from 0x0001d8 to 0x016603 (0x1642c bytes) 000229 1788614193.256058 mapread 0x015249 thru 0x016603 (0x13bb bytes) 000230 1788614193.274590 mapread 0x00753e thru 0x009562 (0x2025 bytes) 000231 1788614193.314877 mapwrite 0x001006 thru 0x008d33 (0x7d2e bytes) 000232 1788614193.444601 read 0x011edd thru 0x016603 (0x4727 bytes) 000233 1788614193.455066 mapread 0x01311d thru 0x016454 (0x3338 bytes) 000234 1788614193.456564 punch from 0x0044e6 to 0x013384 (0xee9f bytes) 000235 1788614193.461238 mapread 0x00379f thru 0x00f8cc (0xc12e bytes) 000236 1788614193.530545 read 0x0159e1 thru 0x015a94 (0xb4 bytes) 000238 1788614193.531726 mapread 0x0117e3 thru 0x016603 (0x4e21 bytes) 000239 1788614193.539392 trunc from 0x016604 to 0x0374bb (0x20eb8 bytes) 000240 1788614193.553861 write 0x02bb07 thru 0x037497 (0xb991 bytes) 000241 1788614193.562738 trunc from 0x0374bc to 0x01a458 (0x1d063 bytes) 000245 1788614193.578312 write 0x03606f thru 0x03d6ff (0x7691 bytes) 000246 1788614193.584377 MIRROR_RESYNC 2 mirrors 000248 1788614194.565885 read 0x00c5cb thru 0x01b393 (0xedc9 bytes) 000251 1788614194.575249 trunc from 0x03d700 to 0x00bc68 (0x31a97 bytes) 000252 1788614194.640017 read 0x00b3fc thru 0x00bc68 (0x86d bytes) 000254 1788614194.651869 MIRROR_RESYNC 2 mirrors 000255 1788614195.407377 read 0x002cbe thru 0x00bc68 (0x8fab bytes) 000257 1788614195.420489 mapread 0x00aef7 thru 0x00bc68 (0xd72 bytes) 000260 1788614195.427453 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a1:0x0]: Invalid argument (22) 000261 1788614195.565682 mapwrite 0x01a84c thru 0x028ea7 (0xe65c bytes) 000265 1788614195.695887 punch from 0x003b8d to 0x010ee3 (0xd357 bytes) 000268 1788614195.703524 write 0x0302bb thru 0x032350 (0x2096 bytes) 000269 1788614195.706244 trunc from 0x032351 to 0x03bce6 (0x9996 bytes) 000271 1788614195.719096 punch from 0x0330f4 to 0x03b76f (0x867c bytes) 000274 1788614195.729366 trunc from 0x03bce7 to 0x005548 (0x3679e bytes) 000276 1788614195.752458 punch from 0x001825 to 0x005548 (0x3d24 bytes) 000281 1788614195.760372 read 0x0054dd thru 0x005548 (0x6c bytes) 000282 1788614195.772374 mapwrite 0x03a5d3 thru 0x03e8df (0x430d bytes) 000283 1788614195.907319 write 0x0346e6 thru 0x036d52 (0x266d bytes) 000284 1788614195.909391 mapwrite 0x02eae7 thru 0x03b151 (0xc66b bytes) 000285 1788614196.059341 MIRROR_EXTEND to 2 mirrors 000286 1788614196.934571 mapwrite 0x01bda2 thru 0x027b73 (0xbdd2 bytes) 000288 1788614197.245713 write 0x0079b8 thru 0x016d3d (0xf386 bytes) 000289 1788614197.269645 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e8e0): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e8e0): Mirror 2: 0x1de92db (stale) CRC-32 checksum value for chunk [0, 0x3e8e0): Mirror 1: 0x8a822b24 Mirror 3: 0x8a822b24 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e8e0: skipped 000290 1788614198.681630 read 0x023178 thru 0x02fbcd (0xca56 bytes) 000292 1788614198.773534 punch from 0x02ab53 to 0x02cd2b (0x21d9 bytes) 000293 1788614198.938956 punch from 0x00276c to 0x007427 (0x4cbc bytes) 000294 1788614198.945631 write 0x008601 thru 0x00f55e (0x6f5e bytes) 000296 1788614198.961099 mapwrite 0x03e313 thru 0x03ffff (0x1ced bytes) 000298 1788614199.111158 punch from 0x003894 to 0x00c528 (0x8c95 bytes) 000300 1788614199.120068 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd0886ecc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd0886ecc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000301 1788614199.590186 read 0x03dc81 thru 0x03ffff (0x237f bytes) 000302 1788614199.604350 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd0886ecc (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x277d4c02 Mirror 4: 0x277d4c02 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000304 1788614201.001509 mapwrite 0x0188fd thru 0x01ef5a (0x665e bytes) 000305 1788614201.216481 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x277d4c02 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x277d4c02 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000307 1788614201.494697 mapwrite 0x007b2d thru 0x00dc8a (0x615e bytes) 000308 1788614201.549023 mapread 0x00b1cc thru 0x019819 (0xe64e bytes) 000309 1788614201.559797 mapread 0x015f76 thru 0x01a6e9 (0x4774 bytes) 000310 1788614201.561632 mapwrite 0x02d09e thru 0x0316d6 (0x4639 bytes) 000311 1788614201.616621 MIRROR_RESYNC 2 mirrors 000312 1788614202.448748 MIRROR_RESYNC 2 mirrors 000313 1788614202.802739 read 0x022954 thru 0x026294 (0x3941 bytes) 000314 1788614202.819585 MIRROR_RESYNC 2 mirrors 000318 1788614203.348931 trunc from 0x040000 to 0x026c40 (0x193bf bytes) 000320 1788614203.529480 mapwrite 0x03f4b5 thru 0x03ffff (0xb4b bytes) 000321 1788614203.679263 trunc from 0x040000 to 0x001cb9 (0x3e346 bytes) 000324 1788614203.709065 write 0x036c7d thru 0x03ffff (0x9383 bytes) 000326 1788614203.715143 write 0x028d50 thru 0x034983 (0xbc34 bytes) 000327 1788614203.728870 mapwrite 0x00db1e thru 0x00edf6 (0x12d9 bytes) 000328 1788614203.854924 trunc from 0x040000 to 0x03c8de (0x3721 bytes) 000329 1788614203.892524 read 0x01d032 thru 0x024a26 (0x79f5 bytes) 000330 1788614203.905607 write 0x00c8ab thru 0x014cf7 (0x844d bytes) 000331 1788614203.910097 mapwrite 0x031186 thru 0x038da2 (0x7c1d bytes) 000332 1788614204.008615 trunc from 0x03c8df to 0x00ce64 (0x2fa7a bytes) 000333 1788614204.050307 write 0x011e76 thru 0x016eda (0x5065 bytes) 000334 1788614204.055217 mapread 0x016239 thru 0x016eda (0xca2 bytes) 000335 1788614204.058178 punch from 0x0147ca to 0x016eda (0x2711 bytes) 000336 1788614204.079771 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x16edb): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16edb): Mirror 4: 0x7fc844bd (stale) CRC-32 checksum value for chunk [0, 0x16edb): Mirror 1: 0xa743f984 Mirror 5: 0xa743f984 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16edb: skipped 000337 1788614205.263599 mapread 0x012909 thru 0x016eda (0x45d2 bytes) 000338 1788614205.294717 read 0x010207 thru 0x015b3d (0x5937 bytes) 000340 1788614205.311496 mapwrite 0x0069ec thru 0x00caba (0x60cf bytes) 000342 1788614205.532766 mapwrite 0x0057c0 thru 0x00a302 (0x4b43 bytes) 000343 1788614205.645764 read 0x01505d thru 0x016eda (0x1e7e bytes) 000344 1788614205.668441 write 0x033b7d thru 0x03a91d (0x6da1 bytes) 000346 1788614205.676621 trunc from 0x03a91e to 0x02cd35 (0xdbe8 bytes) 000347 1788614205.740329 read 0x020f68 thru 0x025eb2 (0x4f4b bytes) 000348 1788614205.763641 mapwrite 0x00cca2 thru 0x012e0e (0x616d bytes) 000350 1788614205.805887 write 0x00bb98 thru 0x00c763 (0xbcc bytes) 000351 1788614205.806992 mapwrite 0x03acdd thru 0x03ffff (0x5323 bytes) 000352 1788614205.897636 punch from 0x02258f to 0x02ed9a (0xc80c bytes) 000354 1788614205.902780 read 0x006c2f thru 0x00f6b6 (0x8a88 bytes) 000355 1788614205.903512 punch from 0x0311aa to 0x031826 (0x67d bytes) 000357 1788614205.910203 trunc from 0x040000 to 0x03095e (0xf6a1 bytes) 000358 1788614205.955327 trunc from 0x03095f to 0x020d83 (0xfbdb bytes) 000360 1788614205.991574 trunc from 0x020d84 to 0x012afb (0xe288 bytes) 000361 1788614206.022393 trunc from 0x012afc to 0x00dad2 (0x5029 bytes) 000362 1788614206.076796 write 0x011c5f thru 0x01f023 (0xd3c5 bytes) 000364 1788614206.079624 punch from 0x0069d1 to 0x00f615 (0x8c45 bytes) 000366 1788614206.103053 mapwrite 0x02bff3 thru 0x02d303 (0x1311 bytes) 000367 1788614206.227582 write 0x036abc thru 0x03ffff (0x9544 bytes) 000368 1788614206.245532 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xd0c3a183 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xd0c3a183 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000369 1788614206.746696 trunc from 0x040000 to 0x038708 (0x78f7 bytes) 000370 1788614206.768430 read 0x0275fd thru 0x034d09 (0xd70d bytes) 000371 1788614206.777502 punch from 0x025cb1 to 0x02ab36 (0x4e86 bytes) 000373 1788614206.784389 punch from 0x020d09 to 0x026c06 (0x5efe bytes) 000376 1788614206.791518 mapread 0x02e09a thru 0x02e269 (0x1d0 bytes) 000377 1788614206.792600 write 0x03798f thru 0x03c5a7 (0x4c19 bytes) 000382 1788614206.803495 mapread 0x003892 thru 0x009b14 (0x6283 bytes) 000383 1788614206.827849 punch from 0x02ebf4 to 0x03a749 (0xbb56 bytes) 000384 1788614206.847550 mapread 0x02b9ad thru 0x02f43f (0x3a93 bytes) 000387 1788614206.864810 read 0x020d18 thru 0x02dbe3 (0xcecc bytes) 000388 1788614206.884614 mapread 0x012c9d thru 0x01b065 (0x83c9 bytes) 000389 1788614206.886776 read 0x025b5b thru 0x02d457 (0x78fd bytes) 000392 1788614206.889851 write 0x0224b1 thru 0x02e7ca (0xc31a bytes) 000395 1788614206.892923 mapwrite 0x03597a thru 0x03d3e9 (0x7a70 bytes) 000397 1788614207.022798 read 0x030d9f thru 0x0364f2 (0x5754 bytes) 000398 1788614207.028291 mapwrite 0x0049f0 thru 0x010e5c (0xc46d bytes) 000399 1788614207.190193 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d3ea): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d3ea): Mirror 4: 0x9724c54b (stale) CRC-32 checksum value for chunk [0, 0x3d3ea): Mirror 1: 0xee9a965a Mirror 5: 0xee9a965a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d3ea: skipped 000401 1788614208.340547 read 0x0153f7 thru 0x0169cf (0x15d9 bytes) 000402 1788614208.382109 read 0x028a61 thru 0x031213 (0x87b3 bytes) 000403 1788614208.410483 read 0x00daf3 thru 0x015773 (0x7c81 bytes) 000404 1788614208.425428 write 0x01ee8d thru 0x028aad (0x9c21 bytes) 000405 1788614208.588340 read 0x034811 thru 0x03a28f (0x5a7f bytes) 000406 1788614208.591442 write 0x017b94 thru 0x01af37 (0x33a4 bytes) 000407 1788614208.593825 write 0x0208c6 thru 0x024cc7 (0x4402 bytes) 000408 1788614208.619457 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3d3ea): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d3ea): Mirror 4: 0x9724c54b (stale) Mirror 5: 0xee9a965a (stale) CRC-32 checksum value for chunk [0, 0x3d3ea): Mirror 1: 0x8b38e5b6 Mirror 6: 0x8b38e5b6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d3ea: skipped 000409 1788614209.867865 mapread 0x0179f2 thru 0x01e657 (0x6c66 bytes) 000410 1788614209.892353 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3d3ea): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d3ea): Mirror 4: 0x9724c54b (stale) Mirror 5: 0xee9a965a (stale) CRC-32 checksum value for chunk [0, 0x3d3ea): Mirror 1: 0x8b38e5b6 Mirror 6: 0x8b38e5b6 Mirror 7: 0x8b38e5b6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d3ea: skipped 000411 1788614211.357456 MIRROR_RESYNC 5 mirrors 000412 1788614212.583483 write 0x01d94b thru 0x0222c9 (0x497f bytes) 000413 1788614212.664221 write 0x039107 thru 0x03ffff (0x6ef9 bytes) 000416 1788614212.671699 punch from 0x022d5b to 0x02aeb2 (0x8158 bytes) 000417 1788614212.681675 write 0x00ce83 thru 0x012a1d (0x5b9b bytes) 000419 1788614212.690918 trunc from 0x040000 to 0x032eb1 (0xd14e bytes) 000420 1788614212.709905 mapread 0x002366 thru 0x008615 (0x62b0 bytes) 000421 1788614212.724010 mapread 0x021cde thru 0x0274df (0x5802 bytes) 000422 1788614212.730612 trunc from 0x032eb2 to 0x008fea (0x29ec7 bytes) 000424 1788614212.750532 write 0x02f7d7 thru 0x030f24 (0x174e bytes) 000425 1788614212.751823 mapread 0x001c47 thru 0x009e55 (0x820f bytes) 000426 1788614212.759741 punch from 0x00f4a3 to 0x0125b2 (0x3110 bytes) 000427 1788614212.772330 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x30f25): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30f25): Mirror 4: 0x1dfa23b8 (stale) Mirror 5: 0x1dfa23b8 (stale) Mirror 6: 0x1dfa23b8 (stale) Mirror 7: 0x1dfa23b8 (stale) CRC-32 checksum value for chunk [0, 0x30f25): Mirror 1: 0x1adfeede Mirror 8: 0x1adfeede lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30f25: skipped 000429 1788614213.759342 trunc from 0x030f25 to 0x0379be (0x6a9a bytes) 000430 1788614213.877820 punch from 0x01b882 to 0x029529 (0xdca8 bytes) 000431 1788614213.883758 punch from 0x016d74 to 0x01a220 (0x34ad bytes) 000432 1788614213.896016 mapwrite 0x03f040 thru 0x03ffff (0xfc0 bytes) 000433 1788614214.001730 write 0x020873 thru 0x022c67 (0x23f5 bytes) 000434 1788614214.020804 mapwrite 0x025400 thru 0x02db5e (0x875f bytes) 000439 1788614214.088468 read 0x03e725 thru 0x03ffff (0x18db bytes) 000441 1788614214.093579 read 0x03847c thru 0x03ffff (0x7b84 bytes) 000442 1788614214.103048 mapread 0x02f7f6 thru 0x034a40 (0x524b bytes) 000443 1788614214.104363 trunc from 0x040000 to 0x00f723 (0x308dc bytes) 000445 1788614214.118184 trunc from 0x00f724 to 0x003ea3 (0xb880 bytes) 000447 1788614214.133224 mapwrite 0x0183de thru 0x023409 (0xb02c bytes) 000448 1788614214.296368 MIRROR_RESYNC 6 mirrors 000449 1788614216.350319 mapread 0x01acc4 thru 0x023409 (0x8746 bytes) 000451 1788614216.369211 write 0x0094b5 thru 0x01510a (0xbc56 bytes) 000452 1788614216.446216 mapwrite 0x012e39 thru 0x01c947 (0x9b0f bytes) 000453 1788614216.524923 write 0x01ef48 thru 0x022db2 (0x3e6b bytes) 000455 1788614216.533581 punch from 0x01ca1a to 0x021771 (0x4d58 bytes) 000456 1788614216.567235 trunc from 0x02340a to 0x02d43c (0xa033 bytes) 000461 1788614216.609686 trunc from 0x02d43d to 0x01add9 (0x12663 bytes) 000462 1788614216.641639 write 0x0318a3 thru 0x035f53 (0x46b1 bytes) 000464 1788614216.648841 punch from 0x0118ac to 0x019e53 (0x85a8 bytes) 000465 1788614216.675659 mapread 0x032bac thru 0x035f53 (0x33a8 bytes) 000466 1788614216.691574 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x35f54): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35f54): Mirror 4: 0xab99d1c (stale) Mirror 5: 0xab99d1c (stale) Mirror 6: 0xab99d1c (stale) Mirror 7: 0xab99d1c (stale) Mirror 8: 0xab99d1c (stale) CRC-32 checksum value for chunk [0, 0x35f54): Mirror 1: 0x54b744bb Mirror 9: 0x54b744bb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35f54: skipped 000467 1788614218.334516 write 0x02f248 thru 0x03372a (0x44e3 bytes) 000468 1788614218.413600 punch from 0x0335c2 to 0x035f53 (0x2992 bytes) 000469 1788614218.430180 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35f54): Mirror 5: 0xab99d1c (stale) Mirror 6: 0xab99d1c (stale) Mirror 7: 0xab99d1c (stale) Mirror 8: 0xab99d1c (stale) Mirror 9: 0x54b744bb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35f54): Mirror 5: 0xab99d1c (stale) Mirror 6: 0xab99d1c (stale) Mirror 7: 0xab99d1c (stale) Mirror 8: 0xab99d1c (stale) Mirror 9: 0x54b744bb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35f54: skipped 000470 1788614218.826057 read 0x014fe3 thru 0x01d668 (0x8686 bytes) 000471 1788614218.835547 mapread 0x0167f7 thru 0x01ae4d (0x4657 bytes) 000473 1788614218.845634 write 0x02eda3 thru 0x036559 (0x77b7 bytes) 000474 1788614218.852937 mapwrite 0x01147e thru 0x017629 (0x61ac bytes) 000475 1788614218.933590 MIRROR_RESYNC 6 mirrors 000476 1788614221.258108 read 0x017112 thru 0x024386 (0xd275 bytes) 000477 1788614221.265716 trunc from 0x03655a to 0x02cc4d (0x990c bytes) 000478 1788614221.334382 write 0x028900 thru 0x02dd0f (0x5410 bytes) 000480 1788614221.343793 mapread 0x0284c8 thru 0x02dd0f (0x5848 bytes) 000481 1788614221.351564 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2dd10): Mirror 5: 0x9e68ac25 (stale) Mirror 6: 0x9e68ac25 (stale) Mirror 7: 0x9e68ac25 (stale) Mirror 9: 0x9e68ac25 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2dd10): Mirror 5: 0x9e68ac25 (stale) Mirror 6: 0x9e68ac25 (stale) Mirror 7: 0x9e68ac25 (stale) Mirror 9: 0x9e68ac25 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2dd10: skipped 000483 1788614221.635337 read 0x004b96 thru 0x01375c (0xebc7 bytes) 000484 1788614221.645853 trunc from 0x02dd10 to 0x023377 (0xa998 bytes) 000485 1788614221.658957 trunc from 0x023378 to 0x0327a3 (0xf42c bytes) 000486 1788614221.673772 mapwrite 0x035f91 thru 0x03ffff (0xa06f bytes) 000488 1788614221.758958 trunc from 0x040000 to 0x00db5d (0x324a2 bytes) 000490 1788614221.777614 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xdb5e): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xdb5e): Mirror 5: 0x5ab35b66 (stale) Mirror 6: 0x5ab35b66 (stale) Mirror 7: 0x5ab35b66 (stale) Mirror 9: 0x5ab35b66 (stale) CRC-32 checksum value for chunk [0, 0xdb5e): Mirror 1: 0x5ab35b66 Mirror 10: 0x5ab35b66 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xdb5e: skipped 000491 1788614222.990361 mapread 0x00a46b thru 0x00db5d (0x36f3 bytes) 000492 1788614223.034547 write 0x03d9c2 thru 0x03ffff (0x263e bytes) 000493 1788614223.110611 read 0x03ee62 thru 0x03ffff (0x119e bytes) 000494 1788614223.116451 MIRROR_RESYNC 6 mirrors 000495 1788614224.968329 write 0x023ef1 thru 0x0323f0 (0xe500 bytes) 000496 1788614225.081887 read 0x033ef2 thru 0x036c6f (0x2d7e bytes) 000497 1788614225.091329 mapread 0x0380be thru 0x03fd5d (0x7ca0 bytes) 000498 1788614225.127884 punch from 0x01d4df to 0x0203c6 (0x2ee8 bytes) 000499 1788614225.150553 mapwrite 0x03a5c9 thru 0x03ffff (0x5a37 bytes) 000500 1788614225.211206 write 0x01b74f thru 0x01cfbf (0x1871 bytes) 000501 1788614225.220715 write 0x00c167 thru 0x01a8b1 (0xe74b bytes) 000503 1788614225.231436 mapwrite 0x006a83 thru 0x00a7a1 (0x3d1f bytes) 000504 1788614225.303961 mapread 0x0031f5 thru 0x00f6b2 (0xc4be bytes) 000505 1788614225.304948 mapwrite 0x0176a7 thru 0x01d309 (0x5c63 bytes) 000506 1788614225.371726 read 0x03b21c thru 0x03ffff (0x4de4 bytes) 000507 1788614225.372382 write 0x011481 thru 0x0198dc (0x845c bytes) 000510 1788614225.376602 punch from 0x01b499 to 0x0275f2 (0xc15a bytes) 000511 1788614225.398997 mapread 0x027361 thru 0x02e1c7 (0x6e67 bytes) 000514 1788614225.423870 MIRROR_RESYNC 6 mirrors 000515 1788614227.621913 MIRROR_RESYNC 6 mirrors 000516 1788614228.152886 mapread 0x019a53 thru 0x01f507 (0x5ab5 bytes) 000517 1788614228.194445 mapwrite 0x001fa1 thru 0x00b7b8 (0x9818 bytes) 000518 1788614228.454998 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xc9e3adba (stale) Mirror 6: 0xc9e3adba (stale) Mirror 7: 0xc9e3adba (stale) Mirror 9: 0xc9e3adba (stale) Mirror 10: 0xc9e3adba (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x51531869 Mirror 11: 0x51531869 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000519 1788614229.542848 MIRROR_RESYNC 7 mirrors 000520 1788614231.607555 mapwrite 0x0160c2 thru 0x01a0af (0x3fee bytes) 000522 1788614231.769425 read 0x023e03 thru 0x02ea47 (0xac45 bytes) 000524 1788614231.787046 punch from 0x00bd4f to 0x018e0b (0xd0bd bytes) 000525 1788614231.792538 write 0x00138c thru 0x003e52 (0x2ac7 bytes) 000526 1788614231.806191 write 0x00ca53 thru 0x00ed67 (0x2315 bytes) 000529 1788614231.820472 mapread 0x0344f9 thru 0x03e660 (0xa168 bytes) 000530 1788614231.837606 mapwrite 0x01aa06 thru 0x0270de (0xc6d9 bytes) 000531 1788614231.904474 write 0x00e38a thru 0x015c16 (0x788d bytes) 000532 1788614231.913226 mapwrite 0x016246 thru 0x01ce1d (0x6bd8 bytes) 000533 1788614231.982628 write 0x028eee thru 0x036421 (0xd534 bytes) 000534 1788614231.989261 punch from 0x0321e6 to 0x0328b8 (0x6d3 bytes) 000535 1788614232.016826 punch from 0x0370ba to 0x038507 (0x144e bytes) 000536 1788614232.026293 read 0x008396 thru 0x016221 (0xde8c bytes) 000537 1788614232.039673 mapwrite 0x002f22 thru 0x0116b2 (0xe791 bytes) 000538 1788614232.075129 mapwrite 0x0355b6 thru 0x03724b (0x1c96 bytes) 000540 1788614232.108014 read 0x034e81 thru 0x03b625 (0x67a5 bytes) 000542 1788614232.109279 mapread 0x0342fd thru 0x03f80f (0xb513 bytes) 000543 1788614232.110164 mapwrite 0x00fc24 thru 0x0182d4 (0x86b1 bytes) 000548 1788614232.147965 write 0x03734d thru 0x03ffff (0x8cb3 bytes) 000549 1788614232.149116 trunc from 0x040000 to 0x01f9a0 (0x2065f bytes) 000550 1788614232.170594 trunc from 0x01f9a1 to 0x00a170 (0x15830 bytes) 000551 1788614232.188099 MIRROR_RESYNC 7 mirrors 000552 1788614233.084678 MIRROR_EXTEND to 8 mirrors 000553 1788614233.762234 MIRROR_EXTEND to 9 mirrors 000554 1788614234.676038 trunc from 0x00a171 to 0x0352b6 (0x2b146 bytes) 000555 1788614234.869133 write 0x033236 thru 0x033a4b (0x816 bytes) 000556 1788614234.884554 mapread 0x02ebe6 thru 0x0352b6 (0x66d1 bytes) 000557 1788614234.909244 read 0x013eb3 thru 0x01d9a7 (0x9af5 bytes) 000558 1788614234.926139 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x352b7): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x352b7): Mirror 5: 0xc89a9bb0 (stale) Mirror 6: 0xc89a9bb0 (stale) Mirror 7: 0xc89a9bb0 (stale) Mirror 9: 0xc89a9bb0 (stale) Mirror 10: 0xc89a9bb0 (stale) Mirror 11: 0xc89a9bb0 (stale) Mirror 12: 0xc89a9bb0 (stale) Mirror 13: 0xc89a9bb0 (stale) CRC-32 checksum value for chunk [0, 0x352b7): Mirror 1: 0xacd0ee78 Mirror 14: 0xacd0ee78 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x352b7: skipped 000559 1788614236.530967 mapread 0x0311d7 thru 0x0352b6 (0x40e0 bytes) 000560 1788614236.606854 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x352b7): Mirror 5: 0xc89a9bb0 (stale) Mirror 7: 0xc89a9bb0 (stale) Mirror 9: 0xc89a9bb0 (stale) Mirror 10: 0xc89a9bb0 (stale) Mirror 11: 0xc89a9bb0 (stale) Mirror 12: 0xc89a9bb0 (stale) Mirror 13: 0xc89a9bb0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x352b7): Mirror 5: 0xc89a9bb0 (stale) Mirror 7: 0xc89a9bb0 (stale) Mirror 9: 0xc89a9bb0 (stale) Mirror 10: 0xc89a9bb0 (stale) Mirror 11: 0xc89a9bb0 (stale) Mirror 12: 0xc89a9bb0 (stale) Mirror 13: 0xc89a9bb0 (stale) CRC-32 checksum value for chunk [0, 0x352b7): Mirror 1: 0xacd0ee78 Mirror 14: 0xacd0ee78 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x352b7: skipped 000562 1788614237.790358 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x352b7): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x352b7): Mirror 5: 0xc89a9bb0 (stale) Mirror 7: 0xc89a9bb0 (stale) Mirror 9: 0xc89a9bb0 (stale) Mirror 10: 0xc89a9bb0 (stale) Mirror 11: 0xc89a9bb0 (stale) Mirror 12: 0xc89a9bb0 (stale) Mirror 13: 0xc89a9bb0 (stale) CRC-32 checksum value for chunk [0, 0x352b7): Mirror 1: 0xacd0ee78 Mirror 14: 0xacd0ee78 Mirror 15: 0xacd0ee78 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x352b7: skipped 000563 1788614239.302185 mapwrite 0x01770e thru 0x01a6b6 (0x2fa9 bytes) 000564 1788614239.493248 write 0x02ba5b thru 0x02c5f1 (0xb97 bytes) 000565 1788614239.510335 MIRROR_RESYNC 10 mirrors 000566 1788614243.389702 mapread 0x01bbf2 thru 0x01bd1a (0x129 bytes) 000567 1788614243.396463 punch from 0x0046c0 to 0x00e6ae (0x9fef bytes) 000568 1788614243.509871 trunc from 0x0352b7 to 0x013a78 (0x2183e bytes) 000569 1788614243.547866 trunc from 0x013a79 to 0x02f522 (0x1baaa bytes) 000570 1788614243.583303 punch from 0x029c53 to 0x02f522 (0x58d0 bytes) 000571 1788614243.598661 trunc from 0x02f523 to 0x03ebf9 (0xf6d7 bytes) 000572 1788614243.635844 MIRROR_RESYNC 10 mirrors 000573 1788614246.815788 write 0x0392bb thru 0x03ffff (0x6d45 bytes) 000574 1788614246.889273 write 0x01a09a thru 0x02063a (0x65a1 bytes) 000575 1788614246.903168 read 0x032437 thru 0x038d2b (0x68f5 bytes) 000577 1788614246.911969 trunc from 0x040000 to 0x028d1c (0x172e3 bytes) 000579 1788614246.935303 read 0x007f36 thru 0x016fc1 (0xf08c bytes) 000581 1788614246.946390 punch from 0x010acf to 0x01fad2 (0xf004 bytes) 000582 1788614246.962062 write 0x008ed4 thru 0x0126c4 (0x97f1 bytes) 000583 1788614246.967793 read 0x0036a4 thru 0x005071 (0x19ce bytes) 000584 1788614246.968577 mapread 0x00a0f2 thru 0x013790 (0x969f bytes) 000585 1788614246.977215 trunc from 0x028d1d to 0x03667a (0xd95e bytes) 000586 1788614246.992307 mapwrite 0x02a3ed thru 0x02c1fd (0x1e11 bytes) 000587 1788614247.047555 mapwrite 0x01ab30 thru 0x029426 (0xe8f7 bytes) 000588 1788614247.096179 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3667b): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3667b): Mirror 5: 0xc0cba144 (stale) Mirror 7: 0xc0cba144 (stale) Mirror 9: 0xc0cba144 (stale) Mirror 10: 0xc0cba144 (stale) Mirror 11: 0xc0cba144 (stale) Mirror 12: 0xc0cba144 (stale) Mirror 13: 0xc0cba144 (stale) Mirror 14: 0xc0cba144 (stale) Mirror 15: 0xc0cba144 (stale) CRC-32 checksum value for chunk [0, 0x3667b): Mirror 1: 0x46740e05 Mirror 16: 0x46740e05 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3667b: skipped 000589 1788614248.376749 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3667b): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3667b): Mirror 5: 0xc0cba144 (stale) Mirror 7: 0xc0cba144 (stale) Mirror 9: 0xc0cba144 (stale) Mirror 10: 0xc0cba144 (stale) Mirror 11: 0xc0cba144 (stale) Mirror 12: 0xc0cba144 (stale) Mirror 13: 0xc0cba144 (stale) Mirror 14: 0xc0cba144 (stale) Mirror 15: 0xc0cba144 (stale) CRC-32 checksum value for chunk [0, 0x3667b): Mirror 1: 0x46740e05 Mirror 16: 0x46740e05 Mirror 17: 0x46740e05 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3667b: skipped 000590 1788614249.708467 punch from 0x00afe3 to 0x013b23 (0x8b41 bytes) 000591 1788614249.838208 mapwrite 0x02ad8c thru 0x039fd0 (0xf245 bytes) 000592 1788614250.057097 mapread 0x03185d thru 0x033b5a (0x22fe bytes) 000594 1788614250.058561 mapread 0x02547c thru 0x0286c2 (0x3247 bytes) 000595 1788614250.059334 write 0x021d61 thru 0x0227a8 (0xa48 bytes) 000596 1788614250.091825 mapread 0x02c5cb thru 0x035367 (0x8d9d bytes) 000600 1788614250.097746 trunc from 0x039fd1 to 0x03ec3d (0x4c6d bytes) 000602 1788614250.140479 write 0x021454 thru 0x023a48 (0x25f5 bytes) 000603 1788614250.174600 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3ec3e): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ec3e): Mirror 5: 0xe0f9b2a9 (stale) Mirror 7: 0xe0f9b2a9 (stale) Mirror 9: 0xe0f9b2a9 (stale) Mirror 10: 0xe0f9b2a9 (stale) Mirror 11: 0xe0f9b2a9 (stale) Mirror 12: 0xe0f9b2a9 (stale) Mirror 13: 0xe0f9b2a9 (stale) Mirror 14: 0xe0f9b2a9 (stale) Mirror 15: 0xe0f9b2a9 (stale) Mirror 16: 0x67b09aa9 (stale) Mirror 17: 0x67b09aa9 (stale) CRC-32 checksum value for chunk [0, 0x3ec3e): Mirror 1: 0xd54b4ee6 Mirror 18: 0xd54b4ee6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ec3e: skipped 000604 1788614252.112666 mapwrite 0x01640b thru 0x01e967 (0x855d bytes) 000605 1788614252.289300 read 0x025692 thru 0x02a0ea (0x4a59 bytes) 000606 1788614252.298375 mapread 0x000473 thru 0x0012e5 (0xe73 bytes) 000607 1788614252.306522 trunc from 0x03ec3e to 0x028e4d (0x15df0 bytes) 000608 1788614252.327980 trunc from 0x028e4e to 0x00dbd7 (0x1b276 bytes) 000609 1788614252.344042 mapread 0x00c960 thru 0x00dbd7 (0x1278 bytes) 000610 1788614252.345250 mapread 0x0007ef thru 0x0067ad (0x5fbf bytes) 000611 1788614252.350947 MIRROR_RESYNC 13 mirrors 000612 1788614255.548032 mapread 0x00422c thru 0x0046b6 (0x48b bytes) 000614 1788614255.558946 MIRROR_SPLIT mirror 10 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a1:0x0]: Invalid argument (22) 000615 1788614255.979954 write 0x02f548 thru 0x03b97d (0xc436 bytes) 000617 1788614256.082235 mapread 0x01ccfe thru 0x0289cd (0xbcd0 bytes) 000618 1788614256.125202 MIRROR_RESYNC 12 mirrors 000620 1788614259.110022 trunc from 0x03b97e to 0x005aa0 (0x35edd bytes) 000621 1788614259.202683 read 0x001d63 thru 0x005aa0 (0x3d3e bytes) 000622 1788614259.210104 write 0x02dbba thru 0x0398fa (0xbd41 bytes) 000623 1788614259.211710 write 0x03da4b thru 0x03ffff (0x25b5 bytes) 000624 1788614259.217471 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x5783b23e (stale) Mirror 7: 0x5783b23e (stale) Mirror 9: 0x5783b23e (stale) Mirror 10: 0x5783b23e (stale) Mirror 11: 0x5783b23e (stale) Mirror 12: 0x5783b23e (stale) Mirror 13: 0x5783b23e (stale) Mirror 14: 0x5783b23e (stale) Mirror 15: 0x5783b23e (stale) Mirror 17: 0x5783b23e (stale) Mirror 18: 0x5783b23e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbc9147df Mirror 19: 0xbc9147df lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000625 1788614260.672378 write 0x02b252 thru 0x0330ec (0x7e9b bytes) 000626 1788614260.801669 trunc from 0x040000 to 0x029575 (0x16a8a bytes) 000627 1788614260.851863 write 0x007b36 thru 0x00fb85 (0x8050 bytes) 000628 1788614260.881328 punch from 0x011c2a to 0x013b17 (0x1eee bytes) 000629 1788614260.906261 read 0x0049ed thru 0x006a34 (0x2048 bytes) 000630 1788614260.919950 trunc from 0x029576 to 0x024734 (0x4e41 bytes) 000633 1788614260.950343 mapwrite 0x006c7a thru 0x01571b (0xeaa2 bytes) 000634 1788614261.083564 write 0x00ff6c thru 0x017ed1 (0x7f66 bytes) 000635 1788614261.103236 MIRROR_RESYNC 13 mirrors 000638 1788614263.689247 trunc from 0x024735 to 0x037d9e (0x1366a bytes) 000639 1788614263.842827 mapwrite 0x0123d3 thru 0x013702 (0x1330 bytes) 000641 1788614263.947644 trunc from 0x037d9f to 0x01a7bb (0x1d5e3 bytes) 000642 1788614263.991616 write 0x03a680 thru 0x03ffff (0x5980 bytes) 000643 1788614264.000239 mapwrite 0x01c3ba thru 0x021218 (0x4e5f bytes) 000645 1788614264.067722 mapread 0x009a09 thru 0x015134 (0xb72c bytes) 000646 1788614264.090576 punch from 0x020888 to 0x0261bc (0x5935 bytes) 000647 1788614264.096667 trunc from 0x040000 to 0x0346c6 (0xb939 bytes) 000648 1788614264.114963 trunc from 0x0346c7 to 0x02d5a0 (0x7126 bytes) 000649 1788614264.133809 read 0x014bbe thru 0x0172b9 (0x26fc bytes) 000651 1788614264.134875 mapwrite 0x02ff36 thru 0x038d11 (0x8ddc bytes) 000653 1788614264.235598 punch from 0x00465c to 0x0131a8 (0xeb4d bytes) 000654 1788614264.242103 mapwrite 0x0182b4 thru 0x01943c (0x1189 bytes) 000655 1788614264.288090 read 0x017e6c thru 0x019d94 (0x1f29 bytes) 000656 1788614264.288682 mapread 0x021686 thru 0x022191 (0xb0c bytes) 000657 1788614264.304077 punch from 0x013e47 to 0x0178a1 (0x3a5b bytes) 000661 1788614264.312044 trunc from 0x038d12 to 0x023fad (0x14d64 bytes) 000662 1788614264.333223 MIRROR_SPLIT mirror 6 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23fae): Mirror 5: 0x7adba860 (stale) Mirror 7: 0x7adba860 (stale) Mirror 9: 0x7adba860 (stale) Mirror 10: 0x7adba860 (stale) Mirror 11: 0x7adba860 (stale) Mirror 13: 0x7adba860 (stale) Mirror 14: 0x7adba860 (stale) Mirror 15: 0x7adba860 (stale) Mirror 17: 0x7adba860 (stale) Mirror 18: 0x7adba860 (stale) Mirror 19: 0x7adba860 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23fae): Mirror 5: 0x7adba860 (stale) Mirror 7: 0x7adba860 (stale) Mirror 9: 0x7adba860 (stale) Mirror 10: 0x7adba860 (stale) Mirror 11: 0x7adba860 (stale) Mirror 13: 0x7adba860 (stale) Mirror 14: 0x7adba860 (stale) Mirror 15: 0x7adba860 (stale) Mirror 17: 0x7adba860 (stale) Mirror 18: 0x7adba860 (stale) Mirror 19: 0x7adba860 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23fae: skipped 000667 1788614265.111909 write 0x012818 thru 0x019251 (0x6a3a bytes) 000668 1788614265.125206 read 0x006340 thru 0x01237e (0xc03f bytes) 000669 1788614265.133064 mapread 0x022644 thru 0x023fad (0x196a bytes) 000670 1788614265.149433 MIRROR_RESYNC 12 mirrors 000671 1788614267.833740 write 0x014f06 thru 0x018542 (0x363d bytes) 000672 1788614267.896778 write 0x0275a7 thru 0x03612a (0xeb84 bytes) 000673 1788614267.900353 read 0x00dd1d thru 0x01bdae (0xe092 bytes) 000674 1788614267.909269 trunc from 0x03612b to 0x012c0a (0x23520 bytes) 000675 1788614267.936763 write 0x02cebb thru 0x03b0b3 (0xe1f9 bytes) 000676 1788614267.940483 write 0x03b394 thru 0x03ffff (0x4c6c bytes) 000677 1788614267.941883 write 0x023549 thru 0x02f148 (0xbc00 bytes) truncating to largest ever: 0x3f95f 000678 1788614267.951319 trunc from 0x040000 to 0x03f95e (0x6a1 bytes) 000679 1788614267.981310 mapwrite 0x015657 thru 0x01d819 (0x81c3 bytes) 000680 1788614268.118106 punch from 0x03ee22 to 0x03f95e (0xb3d bytes) 000681 1788614268.126119 mapwrite 0x0006f9 thru 0x00493b (0x4243 bytes) 000682 1788614268.215581 mapwrite 0x00260d thru 0x00e8f8 (0xc2ec bytes) 000683 1788614268.291363 write 0x00c41b thru 0x013a22 (0x7608 bytes) 000687 1788614268.294383 read 0x011af1 thru 0x018ef5 (0x7405 bytes) 000688 1788614268.297969 mapread 0x02c129 thru 0x037146 (0xb01e bytes) 000689 1788614268.300077 mapread 0x002528 thru 0x007640 (0x5119 bytes) 000691 1788614268.304207 trunc from 0x03f95f to 0x02ebac (0x10db2 bytes) 000692 1788614268.332684 trunc from 0x02ebad to 0x020893 (0xe319 bytes) 000695 1788614268.357206 mapwrite 0x019f84 thru 0x01c52e (0x25ab bytes) 000696 1788614268.405653 trunc from 0x020894 to 0x019a1a (0x6e79 bytes) 000697 1788614268.423992 punch from 0x012d81 to 0x01641c (0x369c bytes) 000698 1788614268.437370 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x19a1b): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19a1b): Mirror 5: 0xe7069252 (stale) Mirror 7: 0xe7069252 (stale) Mirror 9: 0xe7069252 (stale) Mirror 10: 0xe7069252 (stale) Mirror 11: 0xe7069252 (stale) Mirror 13: 0xe7069252 (stale) Mirror 14: 0xe7069252 (stale) Mirror 15: 0xe7069252 (stale) Mirror 17: 0xe7069252 (stale) Mirror 18: 0xe7069252 (stale) Mirror 19: 0xe7069252 (stale) CRC-32 checksum value for chunk [0, 0x19a1b): Mirror 1: 0xd30b5a07 Mirror 20: 0xd30b5a07 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19a1b: skipped 000701 1788614269.434713 mapread 0x00d355 thru 0x00e995 (0x1641 bytes) 000702 1788614269.456684 read 0x0016b0 thru 0x004411 (0x2d62 bytes) 000703 1788614269.472221 mapwrite 0x012040 thru 0x01e42d (0xc3ee bytes) 000705 1788614269.717425 MIRROR_RESYNC 13 mirrors 000706 1788614271.573935 trunc from 0x01e42e to 0x025ba7 (0x777a bytes) 000707 1788614271.657023 read 0x003ae0 thru 0x00e3c8 (0xa8e9 bytes) 000708 1788614271.666321 mapwrite 0x00e454 thru 0x01a520 (0xc0cd bytes) 000710 1788614271.759838 mapwrite 0x02eea5 thru 0x034544 (0x56a0 bytes) 000711 1788614271.837060 write 0x0283cb thru 0x03740b (0xf041 bytes) 000712 1788614271.839079 write 0x02c377 thru 0x02e689 (0x2313 bytes) 000713 1788614271.840992 mapread 0x03350f thru 0x03740b (0x3efd bytes) 000714 1788614271.843017 mapread 0x01d012 thru 0x020053 (0x3042 bytes) 000715 1788614271.844024 punch from 0x009152 to 0x00bda0 (0x2c4f bytes) 000716 1788614271.858597 read 0x01fc92 thru 0x022756 (0x2ac5 bytes) 000717 1788614271.863870 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3740c): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3740c): Mirror 5: 0x13394cff (stale) Mirror 7: 0x13394cff (stale) Mirror 9: 0x13394cff (stale) Mirror 10: 0x13394cff (stale) Mirror 11: 0x13394cff (stale) Mirror 13: 0x13394cff (stale) Mirror 14: 0x13394cff (stale) Mirror 15: 0x13394cff (stale) Mirror 17: 0x13394cff (stale) Mirror 18: 0x13394cff (stale) Mirror 19: 0x13394cff (stale) Mirror 20: 0x13394cff (stale) CRC-32 checksum value for chunk [0, 0x3740c): Mirror 1: 0x2adaf75b Mirror 21: 0x2adaf75b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3740c: skipped 000721 1788614273.089507 mapread 0x004967 thru 0x01107c (0xc716 bytes) 000722 1788614273.135937 read 0x00c04d thru 0x016aa4 (0xaa58 bytes) 000723 1788614273.149553 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x3740c): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3740c): Mirror 5: 0x13394cff (stale) Mirror 7: 0x13394cff (stale) Mirror 9: 0x13394cff (stale) Mirror 10: 0x13394cff (stale) Mirror 11: 0x13394cff (stale) Mirror 13: 0x13394cff (stale) Mirror 14: 0x13394cff (stale) Mirror 15: 0x13394cff (stale) Mirror 17: 0x13394cff (stale) Mirror 18: 0x13394cff (stale) Mirror 19: 0x13394cff (stale) Mirror 20: 0x13394cff (stale) CRC-32 checksum value for chunk [0, 0x3740c): Mirror 1: 0x2adaf75b Mirror 21: 0x2adaf75b Mirror 22: 0x2adaf75b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3740c: skipped 000724 1788614273.990819 trunc from 0x03740c to 0x0215aa (0x15e61 bytes) 000725 1788614274.073442 mapread 0x00eafc thru 0x014b8b (0x6090 bytes) 000726 1788614274.092776 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x215ab): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x215ab): Mirror 5: 0x144be5ee (stale) Mirror 7: 0x144be5ee (stale) Mirror 9: 0x144be5ee (stale) Mirror 10: 0x144be5ee (stale) Mirror 11: 0x144be5ee (stale) Mirror 13: 0x144be5ee (stale) Mirror 14: 0x144be5ee (stale) Mirror 15: 0x144be5ee (stale) Mirror 17: 0x144be5ee (stale) Mirror 18: 0x144be5ee (stale) Mirror 19: 0x144be5ee (stale) Mirror 20: 0x144be5ee (stale) Mirror 21: 0x92050b18 (stale) Mirror 22: 0x92050b18 (stale) CRC-32 checksum value for chunk [0, 0x215ab): Mirror 1: 0x92050b18 Mirror 23: 0x92050b18 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x215ab: skipped 000727 1788614275.327818 write 0x018c86 thru 0x022c35 (0x9fb0 bytes) 000728 1788614275.440073 punch from 0x01c846 to 0x020eeb (0x46a6 bytes) 000729 1788614275.467249 punch from 0x005037 to 0x013e68 (0xee32 bytes) 000730 1788614275.476641 mapwrite 0x03b4fe thru 0x03ffff (0x4b02 bytes) 000732 1788614275.619717 write 0x006032 thru 0x00f25e (0x922d bytes) 000736 1788614275.639875 mapwrite 0x00633b thru 0x00e9c3 (0x8689 bytes) 000738 1788614275.717049 trunc from 0x040000 to 0x01bab5 (0x2454a bytes) 000739 1788614275.773585 trunc from 0x01bab6 to 0x02430c (0x8857 bytes) 000740 1788614275.797584 mapwrite 0x0124ad thru 0x01b75c (0x92b0 bytes) 000741 1788614275.856132 read 0x023813 thru 0x02430c (0xafa bytes) 000743 1788614275.863298 trunc from 0x02430d to 0x014d3c (0xf5d0 bytes) 000744 1788614275.899089 punch from 0x002f78 to 0x01173b (0xe7c4 bytes) 000746 1788614275.903273 write 0x02b005 thru 0x02dc1f (0x2c1b bytes) 000747 1788614275.904354 mapwrite 0x02e494 thru 0x038ff0 (0xab5d bytes) 000748 1788614276.066371 mapwrite 0x02e902 thru 0x02fd30 (0x142f bytes) 000750 1788614276.122960 MIRROR_RESYNC 16 mirrors 000751 1788614281.113914 punch from 0x01a8b7 to 0x02277d (0x7ec7 bytes) 000753 1788614281.253990 mapread 0x01201c thru 0x013bd9 (0x1bbe bytes) 000754 1788614281.262841 mapread 0x02fa52 thru 0x038ff0 (0x959f bytes) 000755 1788614281.280066 punch from 0x00b77f to 0x00c8fd (0x117f bytes) 000756 1788614281.285166 write 0x00099a thru 0x008f62 (0x85c9 bytes) 000759 1788614281.305589 mapwrite 0x01cf12 thru 0x026a49 (0x9b38 bytes) 000760 1788614281.426874 trunc from 0x038ff1 to 0x0375b4 (0x1a3c bytes) 000761 1788614281.458940 MIRROR_RESYNC 16 mirrors 000763 1788614286.354835 MIRROR_RESYNC 16 mirrors 000764 1788614287.221740 write 0x0329b6 thru 0x03d37f (0xa9ca bytes) 000765 1788614287.319739 punch from 0x020aa9 to 0x022a90 (0x1fe8 bytes) 000766 1788614287.332975 mapread 0x00e39f thru 0x01d69a (0xf2fc bytes) 000768 1788614287.354438 mapread 0x02449d thru 0x02da45 (0x95a9 bytes) 000769 1788614287.367142 mapwrite 0x008287 thru 0x016aba (0xe834 bytes) 000770 1788614287.433149 read 0x011793 thru 0x016071 (0x48df bytes) 000771 1788614287.433775 write 0x033f73 thru 0x03b1f1 (0x727f bytes) 000772 1788614287.434792 mapread 0x0022bb thru 0x00631e (0x4064 bytes) 000773 1788614287.440494 MIRROR_SPLIT mirror 15 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d380): Mirror 5: 0x2d8e4656 (stale) Mirror 7: 0x2d8e4656 (stale) Mirror 9: 0x2d8e4656 (stale) Mirror 10: 0x2d8e4656 (stale) Mirror 11: 0x2d8e4656 (stale) Mirror 13: 0x2d8e4656 (stale) Mirror 14: 0x2d8e4656 (stale) Mirror 15: 0x2d8e4656 (stale) Mirror 17: 0x2d8e4656 (stale) Mirror 18: 0x2d8e4656 (stale) Mirror 19: 0x2d8e4656 (stale) Mirror 20: 0x2d8e4656 (stale) Mirror 21: 0x2d8e4656 (stale) Mirror 22: 0x2d8e4656 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d380): Mirror 5: 0x2d8e4656 (stale) Mirror 7: 0x2d8e4656 (stale) Mirror 9: 0x2d8e4656 (stale) Mirror 10: 0x2d8e4656 (stale) Mirror 11: 0x2d8e4656 (stale) Mirror 13: 0x2d8e4656 (stale) Mirror 14: 0x2d8e4656 (stale) Mirror 15: 0x2d8e4656 (stale) Mirror 17: 0x2d8e4656 (stale) Mirror 18: 0x2d8e4656 (stale) Mirror 19: 0x2d8e4656 (stale) Mirror 20: 0x2d8e4656 (stale) Mirror 21: 0x2d8e4656 (stale) Mirror 22: 0x2d8e4656 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d380: skipped 000774 1788614288.285277 mapwrite 0x00b1f5 thru 0x0132de (0x80ea bytes) 000777 1788614288.349105 read 0x01aa50 thru 0x01bf0a (0x14bb bytes) 000778 1788614288.355250 mapwrite 0x00657c thru 0x0153e8 (0xee6d bytes) 000779 1788614288.398777 read 0x03c2ea thru 0x03d37f (0x1096 bytes) 000780 1788614288.409879 punch from 0x02383d to 0x029afd (0x62c1 bytes) 000781 1788614288.414384 read 0x005636 thru 0x00d359 (0x7d24 bytes) 000782 1788614288.415074 trunc from 0x03d380 to 0x03c768 (0xc17 bytes) 000783 1788614288.433839 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x3c769): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c769): Mirror 5: 0x14c5e1d7 (stale) Mirror 7: 0x14c5e1d7 (stale) Mirror 9: 0x14c5e1d7 (stale) Mirror 10: 0x14c5e1d7 (stale) Mirror 11: 0x14c5e1d7 (stale) Mirror 13: 0x14c5e1d7 (stale) Mirror 14: 0x14c5e1d7 (stale) Mirror 15: 0x14c5e1d7 (stale) Mirror 17: 0x14c5e1d7 (stale) Mirror 18: 0x14c5e1d7 (stale) Mirror 19: 0x14c5e1d7 (stale) Mirror 20: 0x14c5e1d7 (stale) Mirror 21: 0x14c5e1d7 (stale) Mirror 22: 0x14c5e1d7 (stale) CRC-32 checksum value for chunk [0, 0x3c769): Mirror 1: 0xa1be9f62 Mirror 23: 0xa1be9f62 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c769: skipped 000785 1788614290.066936 read 0x02a145 thru 0x031a39 (0x78f5 bytes) 000786 1788614290.088863 trunc from 0x03c769 to 0x00be29 (0x3093f bytes) 000787 1788614290.267560 write 0x022253 thru 0x02e046 (0xbdf4 bytes) 000790 1788614290.288864 MIRROR_SPLIT mirror 5 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e047): Mirror 5: 0x61acc7c0 (stale) Mirror 7: 0x61acc7c0 (stale) Mirror 9: 0x61acc7c0 (stale) Mirror 10: 0x61acc7c0 (stale) Mirror 13: 0x61acc7c0 (stale) Mirror 14: 0x61acc7c0 (stale) Mirror 15: 0x61acc7c0 (stale) Mirror 17: 0x61acc7c0 (stale) Mirror 18: 0x61acc7c0 (stale) Mirror 19: 0x61acc7c0 (stale) Mirror 20: 0x61acc7c0 (stale) Mirror 21: 0x61acc7c0 (stale) Mirror 22: 0x61acc7c0 (stale) Mirror 23: 0x460f404 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e047): Mirror 5: 0x61acc7c0 (stale) Mirror 7: 0x61acc7c0 (stale) Mirror 9: 0x61acc7c0 (stale) Mirror 10: 0x61acc7c0 (stale) Mirror 13: 0x61acc7c0 (stale) Mirror 14: 0x61acc7c0 (stale) Mirror 15: 0x61acc7c0 (stale) Mirror 17: 0x61acc7c0 (stale) Mirror 18: 0x61acc7c0 (stale) Mirror 19: 0x61acc7c0 (stale) Mirror 20: 0x61acc7c0 (stale) Mirror 21: 0x61acc7c0 (stale) Mirror 22: 0x61acc7c0 (stale) Mirror 23: 0x460f404 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e047: skipped 000791 1788614291.172829 mapread 0x017647 thru 0x02226b (0xac25 bytes) 000792 1788614291.203221 trunc from 0x02e047 to 0x027e60 (0x61e6 bytes) 000793 1788614291.220776 trunc from 0x027e61 to 0x01cd63 (0xb0fd bytes) 000794 1788614291.242465 MIRROR_SPLIT mirror 11 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1cd64): Mirror 5: 0xaea5a6d2 (stale) Mirror 7: 0xaea5a6d2 (stale) Mirror 9: 0xaea5a6d2 (stale) Mirror 10: 0xaea5a6d2 (stale) Mirror 13: 0xaea5a6d2 (stale) Mirror 14: 0xaea5a6d2 (stale) Mirror 15: 0xaea5a6d2 (stale) Mirror 17: 0xaea5a6d2 (stale) Mirror 18: 0xaea5a6d2 (stale) Mirror 19: 0xaea5a6d2 (stale) Mirror 21: 0xaea5a6d2 (stale) Mirror 22: 0xaea5a6d2 (stale) Mirror 23: 0xaa6f6139 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1cd64): Mirror 5: 0xaea5a6d2 (stale) Mirror 7: 0xaea5a6d2 (stale) Mirror 9: 0xaea5a6d2 (stale) Mirror 10: 0xaea5a6d2 (stale) Mirror 13: 0xaea5a6d2 (stale) Mirror 14: 0xaea5a6d2 (stale) Mirror 15: 0xaea5a6d2 (stale) Mirror 17: 0xaea5a6d2 (stale) Mirror 18: 0xaea5a6d2 (stale) Mirror 19: 0xaea5a6d2 (stale) Mirror 21: 0xaea5a6d2 (stale) Mirror 22: 0xaea5a6d2 (stale) Mirror 23: 0xaa6f6139 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1cd64: skipped 000795 1788614291.878950 write 0x03d765 thru 0x03ffff (0x289b bytes) 000796 1788614291.887049 mapread 0x01316f thru 0x014004 (0xe96 bytes) 000797 1788614291.898113 write 0x01ff96 thru 0x026ffe (0x7069 bytes) 000799 1788614291.912069 mapwrite 0x0156e7 thru 0x0165af (0xec9 bytes) 000800 1788614291.971254 trunc from 0x040000 to 0x0097c4 (0x3683b bytes) 000801 1788614291.999501 read 0x0062ab thru 0x00849c (0x21f2 bytes) 000802 1788614292.007149 mapread 0x000594 thru 0x0097c4 (0x9231 bytes) 000804 1788614292.015975 mapread 0x004f0f thru 0x006019 (0x110b bytes) 000806 1788614292.018281 write 0x01b5d6 thru 0x0206c5 (0x50f0 bytes) 000808 1788614292.030249 MIRROR_RESYNC 14 mirrors 000812 1788614295.229734 trunc from 0x0206c6 to 0x02d2ed (0xcc28 bytes) 000813 1788614295.324770 punch from 0x016970 to 0x021e35 (0xb4c6 bytes) 000814 1788614295.334606 read 0x012b67 thru 0x01fcfc (0xd196 bytes) 000815 1788614295.342886 read 0x029fa5 thru 0x02d2ed (0x3349 bytes) 000816 1788614295.353875 write 0x00205c thru 0x0050b5 (0x305a bytes) 000819 1788614295.355961 trunc from 0x02d2ee to 0x032c01 (0x5914 bytes) 000820 1788614295.388379 trunc from 0x032c02 to 0x0103f3 (0x2280e bytes) 000821 1788614295.410372 punch from 0x009b13 to 0x00ce06 (0x32f4 bytes) 000824 1788614295.425145 trunc from 0x0103f4 to 0x00e8e6 (0x1b0d bytes) 000825 1788614295.458933 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0xe8e7): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe8e7): Mirror 5: 0x1ff71d22 (stale) Mirror 7: 0x1ff71d22 (stale) Mirror 9: 0x1ff71d22 (stale) Mirror 10: 0x1ff71d22 (stale) Mirror 13: 0x1ff71d22 (stale) Mirror 14: 0x1ff71d22 (stale) Mirror 15: 0x1ff71d22 (stale) Mirror 17: 0x1ff71d22 (stale) Mirror 18: 0x1ff71d22 (stale) Mirror 19: 0x1ff71d22 (stale) Mirror 21: 0x1ff71d22 (stale) Mirror 22: 0x1ff71d22 (stale) Mirror 23: 0x1ff71d22 (stale) CRC-32 checksum value for chunk [0, 0xe8e7): Mirror 1: 0x898b5166 Mirror 24: 0x898b5166 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe8e7: skipped 000827 1788614297.056920 trunc from 0x00e8e7 to 0x003f88 (0xa95e bytes) 000828 1788614297.148724 MIRROR_RESYNC 15 mirrors 000829 1788614298.983231 punch from 0x00340a to 0x003f88 (0xb7f bytes) 000830 1788614299.057189 read 0x0033d4 thru 0x003f88 (0xbb5 bytes) 000831 1788614299.065361 write 0x03778a thru 0x039e6b (0x26e2 bytes) 000832 1788614299.068970 read 0x001c1c thru 0x011b12 (0xfef7 bytes) 000835 1788614299.082877 mapread 0x000bf0 thru 0x0061d9 (0x55ea bytes) 000836 1788614299.083986 punch from 0x01d12d to 0x02017a (0x304e bytes) 000837 1788614299.095150 punch from 0x03039d to 0x035abc (0x5720 bytes) 000839 1788614299.105964 punch from 0x028d58 to 0x034a8b (0xbd34 bytes) 000840 1788614299.110930 trunc from 0x039e6c to 0x007b7f (0x322ec bytes) 000842 1788614299.149041 mapwrite 0x008eed thru 0x015e07 (0xcf1b bytes) 000843 1788614299.319773 mapread 0x010760 thru 0x01345b (0x2cfc bytes) 000845 1788614299.321909 read 0x0125da thru 0x015e07 (0x382e bytes) 000846 1788614299.322962 write 0x02e0e8 thru 0x03650c (0x8425 bytes) 000847 1788614299.324830 punch from 0x0057a5 to 0x00ba25 (0x6281 bytes) 000849 1788614299.335685 mapwrite 0x016ca3 thru 0x01c818 (0x5b76 bytes) 000851 1788614299.412273 read 0x01722f thru 0x017b69 (0x93b bytes) 000852 1788614299.413113 mapwrite 0x0035c3 thru 0x00dc8d (0xa6cb bytes) 000853 1788614299.464843 read 0x034a14 thru 0x03650c (0x1af9 bytes) 000854 1788614299.466906 trunc from 0x03650d to 0x0257e0 (0x10d2c bytes) 000855 1788614299.482249 read 0x01e8b2 thru 0x0257e0 (0x6f2f bytes) 000856 1788614299.483923 write 0x02d6e0 thru 0x032dfe (0x571f bytes) 000857 1788614299.485929 trunc from 0x032dff to 0x015dbe (0x1d040 bytes) 000859 1788614299.502033 punch from 0x0118f7 to 0x015dbe (0x44c8 bytes) 000860 1788614299.507579 mapread 0x00457b thru 0x004e9d (0x923 bytes) 000861 1788614299.508391 trunc from 0x015dbf to 0x00e44c (0x7972 bytes) 000862 1788614299.524847 punch from 0x00648b to 0x00e44c (0x7fc2 bytes) 000863 1788614299.532109 write 0x01d229 thru 0x028320 (0xb0f8 bytes) 000864 1788614299.533792 punch from 0x00cbb7 to 0x010f22 (0x436c bytes) 000865 1788614299.563567 punch from 0x004dde to 0x00db68 (0x8d8b bytes) 000866 1788614299.572467 mapread 0x01d527 thru 0x01dec8 (0x9a2 bytes) 000868 1788614299.574846 trunc from 0x028321 to 0x00a4b1 (0x1de6f bytes) 000869 1788614299.590581 write 0x03a45c thru 0x03ffff (0x5ba4 bytes) 000871 1788614299.594033 punch from 0x0285e9 to 0x02e9c4 (0x63dc bytes) 000874 1788614299.610673 write 0x011c56 thru 0x013469 (0x1814 bytes) 000876 1788614299.623858 trunc from 0x040000 to 0x034139 (0xbec6 bytes) 000877 1788614299.657364 punch from 0x00dad1 to 0x01d316 (0xf846 bytes) 000878 1788614299.673475 punch from 0x01376d to 0x0224ed (0xed81 bytes) 000880 1788614299.682072 read 0x004f5b thru 0x0113e9 (0xc48f bytes) 000881 1788614299.694159 mapwrite 0x00784a thru 0x012be2 (0xb399 bytes) 000882 1788614299.746524 MIRROR_SPLIT mirror 14 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3413a): Mirror 5: 0xd01b7293 (stale) Mirror 7: 0xd01b7293 (stale) Mirror 9: 0xd01b7293 (stale) Mirror 10: 0xd01b7293 (stale) Mirror 13: 0xd01b7293 (stale) Mirror 14: 0xd01b7293 (stale) Mirror 15: 0xd01b7293 (stale) Mirror 17: 0xd01b7293 (stale) Mirror 18: 0xd01b7293 (stale) Mirror 19: 0xd01b7293 (stale) Mirror 21: 0xd01b7293 (stale) Mirror 22: 0xd01b7293 (stale) Mirror 23: 0xd01b7293 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3413a): Mirror 5: 0xd01b7293 (stale) Mirror 7: 0xd01b7293 (stale) Mirror 9: 0xd01b7293 (stale) Mirror 10: 0xd01b7293 (stale) Mirror 13: 0xd01b7293 (stale) Mirror 14: 0xd01b7293 (stale) Mirror 15: 0xd01b7293 (stale) Mirror 17: 0xd01b7293 (stale) Mirror 18: 0xd01b7293 (stale) Mirror 19: 0xd01b7293 (stale) Mirror 21: 0xd01b7293 (stale) Mirror 22: 0xd01b7293 (stale) Mirror 23: 0xd01b7293 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3413a: skipped 000883 1788614300.357215 punch from 0x02710a to 0x032b66 (0xba5d bytes) 000884 1788614300.362054 write 0x01edbd thru 0x02b1be (0xc402 bytes) 000885 1788614300.370798 mapwrite 0x0061d6 thru 0x00fd94 (0x9bbf bytes) 000886 1788614300.444773 MIRROR_SPLIT mirror 8 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3413a): Mirror 5: 0xd01b7293 (stale) Mirror 7: 0xd01b7293 (stale) Mirror 9: 0xd01b7293 (stale) Mirror 10: 0xd01b7293 (stale) Mirror 13: 0xd01b7293 (stale) Mirror 14: 0xd01b7293 (stale) Mirror 15: 0xd01b7293 (stale) Mirror 18: 0xd01b7293 (stale) Mirror 19: 0xd01b7293 (stale) Mirror 21: 0xd01b7293 (stale) Mirror 22: 0xd01b7293 (stale) Mirror 23: 0xd01b7293 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3413a): Mirror 5: 0xd01b7293 (stale) Mirror 7: 0xd01b7293 (stale) Mirror 9: 0xd01b7293 (stale) Mirror 10: 0xd01b7293 (stale) Mirror 13: 0xd01b7293 (stale) Mirror 14: 0xd01b7293 (stale) Mirror 15: 0xd01b7293 (stale) Mirror 18: 0xd01b7293 (stale) Mirror 19: 0xd01b7293 (stale) Mirror 21: 0xd01b7293 (stale) Mirror 22: 0xd01b7293 (stale) Mirror 23: 0xd01b7293 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3413a: skipped 000889 1788614301.090789 write 0x03834b thru 0x03bcc4 (0x397a bytes) 000891 1788614301.092906 mapread 0x02a783 thru 0x035f38 (0xb7b6 bytes) 000892 1788614301.121714 trunc from 0x03bcc5 to 0x01a75a (0x2156a bytes) 000894 1788614301.140619 mapread 0x000f58 thru 0x00f306 (0xe3af bytes) 000895 1788614301.154564 write 0x004457 thru 0x00966f (0x5219 bytes) 000897 1788614301.157682 mapread 0x0149c8 thru 0x01a75a (0x5d93 bytes) 000898 1788614301.186681 punch from 0x01a409 to 0x01a75a (0x352 bytes) 000899 1788614301.204806 write 0x028a59 thru 0x029592 (0xb3a bytes) 000900 1788614301.205804 write 0x021d22 thru 0x02a4af (0x878e bytes) 000901 1788614301.217651 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x2a4b0): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a4b0): Mirror 5: 0x3ebb8d00 (stale) Mirror 7: 0x3ebb8d00 (stale) Mirror 9: 0x3ebb8d00 (stale) Mirror 10: 0x3ebb8d00 (stale) Mirror 13: 0x3ebb8d00 (stale) Mirror 14: 0x3ebb8d00 (stale) Mirror 15: 0x3ebb8d00 (stale) Mirror 18: 0x3ebb8d00 (stale) Mirror 19: 0x3ebb8d00 (stale) Mirror 21: 0x3ebb8d00 (stale) Mirror 22: 0x3ebb8d00 (stale) Mirror 23: 0x3ebb8d00 (stale) CRC-32 checksum value for chunk [0, 0x2a4b0): Mirror 1: 0xcfbd44b8 Mirror 24: 0xcfbd44b8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a4b0: skipped 000904 1788614302.777946 mapread 0x012025 thru 0x012399 (0x375 bytes) 000905 1788614302.821486 write 0x0179ef thru 0x01e369 (0x697b bytes) 000906 1788614303.000056 trunc from 0x02a4b0 to 0x015732 (0x14d7d bytes) 000907 1788614303.070395 mapread 0x007ce5 thru 0x008049 (0x365 bytes) 000908 1788614303.089432 punch from 0x005477 to 0x0068b7 (0x1441 bytes) 000910 1788614303.099296 MIRROR_SPLIT mirror 9 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x15733): Mirror 5: 0x618a0dd7 (stale) Mirror 7: 0x618a0dd7 (stale) Mirror 9: 0x618a0dd7 (stale) Mirror 10: 0x618a0dd7 (stale) Mirror 13: 0x618a0dd7 (stale) Mirror 14: 0x618a0dd7 (stale) Mirror 15: 0x618a0dd7 (stale) Mirror 18: 0x618a0dd7 (stale) Mirror 21: 0x618a0dd7 (stale) Mirror 22: 0x618a0dd7 (stale) Mirror 23: 0x618a0dd7 (stale) Mirror 24: 0x31de9f04 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15733): Mirror 5: 0x618a0dd7 (stale) Mirror 7: 0x618a0dd7 (stale) Mirror 9: 0x618a0dd7 (stale) Mirror 10: 0x618a0dd7 (stale) Mirror 13: 0x618a0dd7 (stale) Mirror 14: 0x618a0dd7 (stale) Mirror 15: 0x618a0dd7 (stale) Mirror 18: 0x618a0dd7 (stale) Mirror 21: 0x618a0dd7 (stale) Mirror 22: 0x618a0dd7 (stale) Mirror 23: 0x618a0dd7 (stale) Mirror 24: 0x31de9f04 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15733: skipped 000911 1788614303.826213 MIRROR_SPLIT mirror 9 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x15733): Mirror 5: 0x618a0dd7 (stale) Mirror 7: 0x618a0dd7 (stale) Mirror 9: 0x618a0dd7 (stale) Mirror 10: 0x618a0dd7 (stale) Mirror 13: 0x618a0dd7 (stale) Mirror 14: 0x618a0dd7 (stale) Mirror 15: 0x618a0dd7 (stale) Mirror 18: 0x618a0dd7 (stale) Mirror 22: 0x618a0dd7 (stale) Mirror 23: 0x618a0dd7 (stale) Mirror 24: 0x31de9f04 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15733): Mirror 5: 0x618a0dd7 (stale) Mirror 7: 0x618a0dd7 (stale) Mirror 9: 0x618a0dd7 (stale) Mirror 10: 0x618a0dd7 (stale) Mirror 13: 0x618a0dd7 (stale) Mirror 14: 0x618a0dd7 (stale) Mirror 15: 0x618a0dd7 (stale) Mirror 18: 0x618a0dd7 (stale) Mirror 22: 0x618a0dd7 (stale) Mirror 23: 0x618a0dd7 (stale) Mirror 24: 0x31de9f04 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15733: skipped 000912 1788614304.432379 MIRROR_RESYNC 12 mirrors 000914 1788614306.920768 read 0x00350c thru 0x00fac8 (0xc5bd bytes) 000916 1788614306.935986 punch from 0x000f67 to 0x009532 (0x85cc bytes) 000917 1788614307.115994 trunc from 0x015733 to 0x02b570 (0x15e3e bytes) 000918 1788614307.148982 mapread 0x0027cb thru 0x0084ec (0x5d22 bytes) 000919 1788614307.174306 mapread 0x01c281 thru 0x024306 (0x8086 bytes) 000920 1788614307.187255 read 0x0270fe thru 0x02b570 (0x4473 bytes) 000921 1788614307.202338 read 0x027aad thru 0x02b570 (0x3ac4 bytes) 000922 1788614307.204466 mapwrite 0x030784 thru 0x039cf5 (0x9572 bytes) 000923 1788614307.331872 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x39cf6): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39cf6): Mirror 5: 0x76619a73 (stale) Mirror 7: 0x76619a73 (stale) Mirror 9: 0x76619a73 (stale) Mirror 10: 0x76619a73 (stale) Mirror 13: 0x76619a73 (stale) Mirror 14: 0x76619a73 (stale) Mirror 15: 0x76619a73 (stale) Mirror 18: 0x76619a73 (stale) Mirror 22: 0x76619a73 (stale) Mirror 23: 0x76619a73 (stale) Mirror 24: 0x76619a73 (stale) CRC-32 checksum value for chunk [0, 0x39cf6): Mirror 1: 0x5d512504 Mirror 25: 0x5d512504 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39cf6: skipped 000925 1788614308.805537 MIRROR_SPLIT mirror 10 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39cf6): Mirror 5: 0x76619a73 (stale) Mirror 7: 0x76619a73 (stale) Mirror 9: 0x76619a73 (stale) Mirror 10: 0x76619a73 (stale) Mirror 13: 0x76619a73 (stale) Mirror 14: 0x76619a73 (stale) Mirror 15: 0x76619a73 (stale) Mirror 18: 0x76619a73 (stale) Mirror 22: 0x76619a73 (stale) Mirror 24: 0x76619a73 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39cf6): Mirror 5: 0x76619a73 (stale) Mirror 7: 0x76619a73 (stale) Mirror 9: 0x76619a73 (stale) Mirror 10: 0x76619a73 (stale) Mirror 13: 0x76619a73 (stale) Mirror 14: 0x76619a73 (stale) Mirror 15: 0x76619a73 (stale) Mirror 18: 0x76619a73 (stale) Mirror 22: 0x76619a73 (stale) Mirror 24: 0x76619a73 (stale) CRC-32 checksum value for chunk [0, 0x39cf6): Mirror 1: 0x5d512504 Mirror 25: 0x5d512504 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39cf6: skipped 000926 1788614310.327514 write 0x00d19b thru 0x0190ba (0xbf20 bytes) 000927 1788614310.534872 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x39cf6): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39cf6): Mirror 5: 0x76619a73 (stale) Mirror 7: 0x76619a73 (stale) Mirror 9: 0x76619a73 (stale) Mirror 10: 0x76619a73 (stale) Mirror 13: 0x76619a73 (stale) Mirror 14: 0x76619a73 (stale) Mirror 15: 0x76619a73 (stale) Mirror 18: 0x76619a73 (stale) Mirror 22: 0x76619a73 (stale) Mirror 24: 0x76619a73 (stale) Mirror 25: 0x5d512504 (stale) CRC-32 checksum value for chunk [0, 0x39cf6): Mirror 1: 0x339cbb3 Mirror 26: 0x339cbb3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39cf6: skipped 000928 1788614312.502033 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x39cf6): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39cf6): Mirror 5: 0x76619a73 (stale) Mirror 7: 0x76619a73 (stale) Mirror 9: 0x76619a73 (stale) Mirror 10: 0x76619a73 (stale) Mirror 13: 0x76619a73 (stale) Mirror 14: 0x76619a73 (stale) Mirror 15: 0x76619a73 (stale) Mirror 18: 0x76619a73 (stale) Mirror 22: 0x76619a73 (stale) Mirror 24: 0x76619a73 (stale) Mirror 25: 0x5d512504 (stale) CRC-32 checksum value for chunk [0, 0x39cf6): Mirror 1: 0x339cbb3 Mirror 26: 0x339cbb3 Mirror 27: 0x339cbb3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39cf6: skipped 000929 1788614314.277131 read 0x009cbb thru 0x0162a9 (0xc5ef bytes) 000930 1788614314.298184 MIRROR_RESYNC 14 mirrors 000931 1788614318.375732 MIRROR_RESYNC 14 mirrors 000934 1788614319.209109 read 0x02fb08 thru 0x039cf5 (0xa1ee bytes) 000935 1788614319.239113 punch from 0x0362fe to 0x039cf5 (0x39f8 bytes) 000936 1788614319.444874 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x39cf6): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39cf6): Mirror 5: 0x339cbb3 (stale) Mirror 7: 0x339cbb3 (stale) Mirror 9: 0x339cbb3 (stale) Mirror 10: 0x339cbb3 (stale) Mirror 13: 0x339cbb3 (stale) Mirror 14: 0x339cbb3 (stale) Mirror 15: 0x339cbb3 (stale) Mirror 18: 0x339cbb3 (stale) Mirror 22: 0x339cbb3 (stale) Mirror 24: 0x339cbb3 (stale) Mirror 25: 0x339cbb3 (stale) Mirror 26: 0x339cbb3 (stale) Mirror 27: 0x339cbb3 (stale) CRC-32 checksum value for chunk [0, 0x39cf6): Mirror 1: 0x55af20ce Mirror 28: 0x55af20ce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39cf6: skipped 000937 1788614321.459549 punch from 0x0302c6 to 0x039cf5 (0x9a30 bytes) 000938 1788614321.613290 punch from 0x038246 to 0x039cf5 (0x1ab0 bytes) 000939 1788614321.634175 read 0x006811 thru 0x00cce2 (0x64d2 bytes) 000942 1788614321.656057 mapwrite 0x010a25 thru 0x017d7d (0x7359 bytes) 000943 1788614321.805258 mapread 0x0050ab thru 0x0075db (0x2531 bytes) 000945 1788614321.825155 MIRROR_SPLIT mirror 4 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39cf6): Mirror 5: 0x339cbb3 (stale) Mirror 7: 0x339cbb3 (stale) Mirror 9: 0x339cbb3 (stale) Mirror 13: 0x339cbb3 (stale) Mirror 14: 0x339cbb3 (stale) Mirror 15: 0x339cbb3 (stale) Mirror 18: 0x339cbb3 (stale) Mirror 22: 0x339cbb3 (stale) Mirror 24: 0x339cbb3 (stale) Mirror 25: 0x339cbb3 (stale) Mirror 26: 0x339cbb3 (stale) Mirror 27: 0x339cbb3 (stale) Mirror 28: 0x55af20ce (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39cf6): Mirror 5: 0x339cbb3 (stale) Mirror 7: 0x339cbb3 (stale) Mirror 9: 0x339cbb3 (stale) Mirror 13: 0x339cbb3 (stale) Mirror 14: 0x339cbb3 (stale) Mirror 15: 0x339cbb3 (stale) Mirror 18: 0x339cbb3 (stale) Mirror 22: 0x339cbb3 (stale) Mirror 24: 0x339cbb3 (stale) Mirror 25: 0x339cbb3 (stale) Mirror 26: 0x339cbb3 (stale) Mirror 27: 0x339cbb3 (stale) Mirror 28: 0x55af20ce (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39cf6: skipped 000946 1788614322.534936 read 0x002bad thru 0x00ce5b (0xa2af bytes) 000947 1788614322.545388 trunc from 0x039cf6 to 0x01e00c (0x1bce9 bytes) 000949 1788614322.571656 mapwrite 0x01d5cd thru 0x0220e4 (0x4b18 bytes) 000950 1788614322.713036 trunc from 0x0220e5 to 0x002962 (0x1f782 bytes) 000951 1788614322.735535 trunc from 0x002963 to 0x01be5f (0x194fd bytes) 000952 1788614322.749891 trunc from 0x01be60 to 0x013aab (0x83b4 bytes) 000953 1788614322.773455 punch from 0x001026 to 0x002273 (0x124e bytes) 000954 1788614322.780326 mapread 0x00a2f9 thru 0x013aab (0x97b3 bytes) 000956 1788614322.801340 write 0x02bd94 thru 0x033f31 (0x819e bytes) 000957 1788614322.802798 mapread 0x017bfe thru 0x01e82e (0x6c31 bytes) 000959 1788614322.812205 read 0x019811 thru 0x0254d6 (0xbcc6 bytes) 000960 1788614322.826510 read 0x0167a7 thru 0x01793f (0x1199 bytes) 000961 1788614322.829627 punch from 0x01692b to 0x01a10b (0x37e1 bytes) 000962 1788614322.843630 trunc from 0x033f32 to 0x034f2d (0xffc bytes) 000963 1788614322.867375 read 0x0042e9 thru 0x004483 (0x19b bytes) 000964 1788614322.867989 write 0x016667 thru 0x01e5cc (0x7f66 bytes) 000965 1788614322.892323 write 0x0361b3 thru 0x03e0eb (0x7f39 bytes) 000966 1788614322.897161 write 0x01d7ae thru 0x027a51 (0xa2a4 bytes) 000967 1788614322.904608 trunc from 0x03e0ec to 0x03f73e (0x1653 bytes) 000969 1788614322.933246 read 0x00aeb8 thru 0x018eb0 (0xdff9 bytes) 000970 1788614322.934715 mapread 0x023ea0 thru 0x027f43 (0x40a4 bytes) 000971 1788614322.936640 trunc from 0x03f73f to 0x0094f2 (0x3624c bytes) 000972 1788614322.953788 punch from 0x009085 to 0x0094f2 (0x46e bytes) 000974 1788614322.959562 write 0x00fe0c thru 0x0166bd (0x68b2 bytes) 000975 1788614322.961199 mapread 0x002cb7 thru 0x00764d (0x4997 bytes) 000976 1788614322.963496 punch from 0x002288 to 0x012168 (0xfee1 bytes) 000980 1788614322.978728 write 0x039051 thru 0x03ffff (0x6faf bytes) 000981 1788614322.980751 write 0x016afd thru 0x01e475 (0x7979 bytes) 000982 1788614322.991725 trunc from 0x040000 to 0x03f53f (0xac0 bytes) 000983 1788614323.028635 read 0x03d145 thru 0x03f53f (0x23fb bytes) 000984 1788614323.036791 write 0x011986 thru 0x01ef98 (0xd613 bytes) 000985 1788614323.044497 punch from 0x03de51 to 0x03f53f (0x16ef bytes) 000987 1788614323.097494 MIRROR_SPLIT mirror 7 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f540): Mirror 5: 0xf9f4c64e (stale) Mirror 7: 0xf9f4c64e (stale) Mirror 9: 0xf9f4c64e (stale) Mirror 13: 0xf9f4c64e (stale) Mirror 14: 0xf9f4c64e (stale) Mirror 15: 0xf9f4c64e (stale) Mirror 22: 0xf9f4c64e (stale) Mirror 24: 0xf9f4c64e (stale) Mirror 25: 0xf9f4c64e (stale) Mirror 26: 0xf9f4c64e (stale) Mirror 27: 0xf9f4c64e (stale) Mirror 28: 0x4880d076 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f540): Mirror 5: 0xf9f4c64e (stale) Mirror 7: 0xf9f4c64e (stale) Mirror 9: 0xf9f4c64e (stale) Mirror 13: 0xf9f4c64e (stale) Mirror 14: 0xf9f4c64e (stale) Mirror 15: 0xf9f4c64e (stale) Mirror 22: 0xf9f4c64e (stale) Mirror 24: 0xf9f4c64e (stale) Mirror 25: 0xf9f4c64e (stale) Mirror 26: 0xf9f4c64e (stale) Mirror 27: 0xf9f4c64e (stale) Mirror 28: 0x4880d076 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f540: skipped 000989 1788614323.991253 write 0x02375a thru 0x02ffa8 (0xc84f bytes) 000990 1788614324.008613 MIRROR_SPLIT mirror 10 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a1:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f540): Mirror 5: 0xf9f4c64e (stale) Mirror 7: 0xf9f4c64e (stale) Mirror 9: 0xf9f4c64e (stale) Mirror 13: 0xf9f4c64e (stale) Mirror 14: 0xf9f4c64e (stale) Mirror 15: 0xf9f4c64e (stale) Mirror 22: 0xf9f4c64e (stale) Mirror 24: 0xf9f4c64e (stale) Mirror 25: 0xf9f4c64e (stale) Mirror 27: 0xf9f4c64e (stale) Mirror 28: 0x4880d076 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f540): Mirror 5: 0xf9f4c64e (stale) Mirror 7: 0xf9f4c64e (stale) Mirror 9: 0xf9f4c64e (stale) Mirror 13: 0xf9f4c64e (stale) Mirror 14: 0xf9f4c64e (stale) Mirror 15: 0xf9f4c64e (stale) Mirror 22: 0xf9f4c64e (stale) Mirror 24: 0xf9f4c64e (stale) Mirror 25: 0xf9f4c64e (stale) Mirror 27: 0xf9f4c64e (stale) Mirror 28: 0x4880d076 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f540: skipped 000992 1788614324.640119 punch from 0x03d916 to 0x03f53f (0x1c2a bytes) 000994 1788614324.647038 punch from 0x018adc to 0x01cf3a (0x445f bytes) 000995 1788614324.653036 punch from 0x000715 to 0x00ddbf (0xd6ab bytes) 000999 1788614324.660810 read 0x00c701 thru 0x0156b3 (0x8fb3 bytes) All operations completed A-OK!