== sanity-flr test 70a: flr mode fsx test ================ 08:07:29 (1788264449) Seed set to 4451 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero length punch hole skipping zero size read 000006 1788264451.668149 mapwrite 0x03d080 thru 0x03ffff (0x2f80 bytes) 000008 1788264451.815586 punch from 0x008d0c to 0x00b2d6 (0x25cb bytes) 000010 1788264451.822104 read 0x033f75 thru 0x037658 (0x36e4 bytes) 000013 1788264451.831967 read 0x03230a thru 0x03ffff (0xdcf6 bytes) 000014 1788264451.847232 write 0x00e0c4 thru 0x01ccc0 (0xebfd bytes) 000017 1788264451.850857 punch from 0x00f698 to 0x010b13 (0x147c bytes) truncating to largest ever: 0x20fec 000019 1788264451.866346 trunc from 0x040000 to 0x020feb (0x1f014 bytes) 000021 1788264451.902875 MIRROR_EXTEND to 2 mirrors 000022 1788264453.195952 mapread 0x00f871 thru 0x010690 (0xe20 bytes) 000023 1788264453.215625 read 0x002c4e thru 0x007c6e (0x5021 bytes) 000024 1788264453.229938 punch from 0x00afbe to 0x00ef9e (0x3fe1 bytes) 000026 1788264453.327764 write 0x03c1cd thru 0x03ffff (0x3e33 bytes) 000027 1788264453.335860 MIRROR_RESYNC 2 mirrors truncating to largest ever: 0x27b39 000029 1788264454.145364 trunc from 0x040000 to 0x027b38 (0x184c7 bytes) 000030 1788264454.227773 trunc from 0x027b39 to 0x011789 (0x163af bytes) 000031 1788264454.265115 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) 000032 1788264454.527389 punch from 0x002036 to 0x00d6c0 (0xb68b bytes) 000033 1788264454.539079 MIRROR_EXTEND to 2 mirrors 000034 1788264455.659201 MIRROR_EXTEND to 3 mirrors 000035 1788264456.819617 mapread 0x002d10 thru 0x008f1c (0x620d bytes) 000036 1788264456.842631 mapwrite 0x035e18 thru 0x03bc8c (0x5e75 bytes) 000039 1788264456.992166 mapread 0x0160fa thru 0x01a62d (0x4534 bytes) 000042 1788264457.004523 write 0x008aac thru 0x017a05 (0xef5a bytes) 000044 1788264457.018693 MIRROR_RESYNC 3 mirrors 000045 1788264458.419578 mapread 0x028ee1 thru 0x03286f (0x998f bytes) 000046 1788264458.464501 trunc from 0x03bc8d to 0x01bbc7 (0x200c5 bytes) 000047 1788264458.571355 read 0x00a3a0 thru 0x00cb84 (0x27e5 bytes) 000048 1788264458.578121 trunc from 0x01bbc8 to 0x020635 (0x4a6e bytes) 000050 1788264458.608518 write 0x00c454 thru 0x016086 (0x9c33 bytes) 000051 1788264458.615969 mapread 0x0020d1 thru 0x0100fd (0xe02d bytes) 000052 1788264458.639616 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20636): Mirror 3: 0xc40feeca (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20636): Mirror 3: 0xc40feeca (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20636: skipped 000053 1788264459.169934 write 0x03ec7d thru 0x03ffff (0x1383 bytes) 000054 1788264459.179840 punch from 0x032971 to 0x036aa3 (0x4133 bytes) 000055 1788264459.191155 write 0x00fcee thru 0x0123bb (0x26ce bytes) 000056 1788264459.201670 mapwrite 0x005f83 thru 0x01210c (0xc18a bytes) 000057 1788264459.360982 mapwrite 0x038fbf thru 0x03b854 (0x2896 bytes) 000059 1788264459.447571 mapread 0x013088 thru 0x022025 (0xef9e bytes) 000062 1788264459.473126 trunc from 0x040000 to 0x006cf1 (0x3930e bytes) 000063 1788264459.503199 read 0x005d3e thru 0x006cf1 (0xfb4 bytes) 000064 1788264459.514299 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) 000065 1788264459.733132 mapread 0x003571 thru 0x006cf1 (0x3781 bytes) 000068 1788264459.756855 mapread 0x00035e thru 0x002f6c (0x2c0f bytes) 000071 1788264459.769075 MIRROR_EXTEND to 2 mirrors 000072 1788264461.091584 punch from 0x005d2a to 0x006cf1 (0xfc8 bytes) 000073 1788264461.323284 mapread 0x000d37 thru 0x006cf1 (0x5fbb bytes) 000075 1788264461.397912 mapwrite 0x03ae1b thru 0x03f2d1 (0x44b7 bytes) 000076 1788264461.611565 read 0x016c46 thru 0x0187d6 (0x1b91 bytes) truncating to largest ever: 0x39efd 000077 1788264461.632978 trunc from 0x03f2d2 to 0x039efc (0x53d5 bytes) 000078 1788264461.693333 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x39efd): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39efd): Mirror 2: 0x8aab1772 (stale) CRC-32 checksum value for chunk [0, 0x39efd): Mirror 1: 0xa65d7a42 Mirror 3: 0xa65d7a42 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39efd: skipped 000080 1788264463.495479 trunc from 0x039efd to 0x0361b2 (0x3d4a bytes) 000081 1788264463.683293 read 0x028834 thru 0x02cf4d (0x471a bytes) 000082 1788264463.703085 punch from 0x005976 to 0x01021a (0xa8a5 bytes) 000084 1788264463.719044 mapread 0x00f354 thru 0x015656 (0x6303 bytes) 000086 1788264463.768065 trunc from 0x0361b3 to 0x020409 (0x15da9 bytes) 000088 1788264463.810888 mapread 0x00ecd8 thru 0x0144bc (0x57e5 bytes) 000089 1788264463.811811 mapread 0x0123fa thru 0x020409 (0xe010 bytes) 000090 1788264463.822863 mapwrite 0x02b8c6 thru 0x02bbc9 (0x304 bytes) 000091 1788264463.918819 mapread 0x029fb5 thru 0x02aef1 (0xf3d bytes) 000092 1788264463.919709 mapwrite 0x011ec0 thru 0x0206ca (0xe80b bytes) 000093 1788264464.074566 mapread 0x001623 thru 0x00d600 (0xbfde bytes) 000094 1788264464.106802 punch from 0x027a7f to 0x02bbc9 (0x414b bytes) 000095 1788264464.123233 mapwrite 0x03a04e thru 0x03d3ad (0x3360 bytes) 000096 1788264464.252172 read 0x02633e thru 0x02a279 (0x3f3c bytes) 000097 1788264464.283167 mapread 0x00a634 thru 0x013e0c (0x97d9 bytes) 000098 1788264464.290582 mapread 0x024510 thru 0x02c0ce (0x7bbf bytes) 000099 1788264464.293166 read 0x024e5b thru 0x02681c (0x19c2 bytes) 000100 1788264464.294345 trunc from 0x03d3ae to 0x029822 (0x13b8b bytes) 000102 1788264464.338707 write 0x005616 thru 0x0066cf (0x10ba bytes) 000103 1788264464.339799 punch from 0x02103d to 0x023b3a (0x2afe bytes) 000105 1788264464.358260 MIRROR_RESYNC 3 mirrors 000106 1788264465.646299 mapread 0x01a88e thru 0x021e5f (0x75d2 bytes) 000109 1788264465.698597 mapread 0x00a81a thru 0x00e491 (0x3c78 bytes) 000110 1788264465.713250 mapread 0x029816 thru 0x029822 (0xd bytes) 000113 1788264465.726080 write 0x033331 thru 0x03c111 (0x8de1 bytes) 000114 1788264465.840464 read 0x02423c thru 0x0248d1 (0x696 bytes) 000115 1788264465.856382 write 0x03c83b thru 0x03ffff (0x37c5 bytes) 000116 1788264465.862105 trunc from 0x040000 to 0x03768e (0x8971 bytes) 000118 1788264465.906042 read 0x0346a9 thru 0x034817 (0x16f bytes) 000120 1788264465.907221 mapwrite 0x01ec0f thru 0x0271da (0x85cc bytes) 000121 1788264466.025245 read 0x035fc2 thru 0x03768e (0x16cd bytes) 000122 1788264466.026021 trunc from 0x03768f to 0x033b82 (0x3b0c bytes) 000123 1788264466.040943 mapwrite 0x02ac45 thru 0x03ab39 (0xfef5 bytes) 000124 1788264466.130293 read 0x039a9d thru 0x03ab39 (0x109d bytes) 000125 1788264466.130978 punch from 0x0382e3 to 0x03a265 (0x1f83 bytes) 000127 1788264466.138321 punch from 0x004a19 to 0x008a77 (0x405f bytes) 000128 1788264466.143675 mapread 0x00094d thru 0x00a3eb (0x9a9f bytes) 000131 1788264466.155322 mapwrite 0x02434a thru 0x02d6b9 (0x9370 bytes) 000133 1788264466.222121 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3ab3a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ab3a): Mirror 2: 0x182f87f4 (stale) Mirror 3: 0x182f87f4 (stale) CRC-32 checksum value for chunk [0, 0x3ab3a): Mirror 1: 0xce9f7eff Mirror 4: 0xce9f7eff lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ab3a: skipped 000134 1788264467.534647 trunc from 0x03ab3a to 0x00ed06 (0x2be33 bytes) 000135 1788264467.715850 trunc from 0x00ed07 to 0x002199 (0xcb6d bytes) 000136 1788264467.763532 write 0x027c90 thru 0x02f687 (0x79f8 bytes) 000137 1788264467.772531 punch from 0x026c68 to 0x02f687 (0x8a20 bytes) 000140 1788264467.788245 trunc from 0x02f688 to 0x02af6e (0x4719 bytes) 000143 1788264467.848918 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2af6f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2af6f): Mirror 2: 0xe3e687c (stale) Mirror 3: 0xe3e687c (stale) Mirror 4: 0xdf02bb66 (stale) CRC-32 checksum value for chunk [0, 0x2af6f): Mirror 1: 0x4243a482 Mirror 5: 0x4243a482 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2af6f: skipped 000145 1788264469.499583 mapread 0x025795 thru 0x02af6e (0x57da bytes) 000146 1788264469.588823 punch from 0x013719 to 0x019e76 (0x675e bytes) 000147 1788264469.825912 punch from 0x02af10 to 0x02af6e (0x5f bytes) 000148 1788264469.834247 trunc from 0x02af6f to 0x033dec (0x8e7e bytes) 000149 1788264469.874989 mapwrite 0x03ff92 thru 0x03ffff (0x6e bytes) 000154 1788264470.007907 mapwrite 0x031da1 thru 0x03ba78 (0x9cd8 bytes) 000155 1788264470.107771 write 0x03dfbd thru 0x03ffff (0x2043 bytes) 000156 1788264470.116638 MIRROR_RESYNC 5 mirrors 000157 1788264473.037948 punch from 0x025114 to 0x0308c3 (0xb7b0 bytes) 000158 1788264473.138956 MIRROR_RESYNC 5 mirrors 000159 1788264474.870052 write 0x03a604 thru 0x03ffff (0x59fc bytes) 000160 1788264474.966084 read 0x010115 thru 0x01ad2b (0xac17 bytes) 000163 1788264474.976561 mapread 0x002aec thru 0x00d56c (0xaa81 bytes) 000165 1788264475.016611 MIRROR_RESYNC 5 mirrors 000166 1788264476.603793 mapwrite 0x02306d thru 0x0327a8 (0xf73c bytes) 000167 1788264476.909126 write 0x0072b5 thru 0x00f360 (0x80ac bytes) 000168 1788264476.921699 mapwrite 0x01a4af thru 0x0211bf (0x6d11 bytes) 000169 1788264476.999184 read 0x01bc72 thru 0x021850 (0x5bdf bytes) 000170 1788264476.999914 read 0x02b5af thru 0x02cf6c (0x19be bytes) 000172 1788264477.000971 punch from 0x00b8f8 to 0x00d96c (0x2075 bytes) 000173 1788264477.007609 write 0x039f50 thru 0x03ffff (0x60b0 bytes) 000175 1788264477.025562 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xabb955f8 (stale) Mirror 3: 0xabb955f8 (stale) Mirror 4: 0xabb955f8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xabb955f8 (stale) Mirror 3: 0xabb955f8 (stale) Mirror 4: 0xabb955f8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000176 1788264477.529354 read 0x028742 thru 0x030183 (0x7a42 bytes) 000178 1788264477.543010 write 0x030973 thru 0x034ab1 (0x413f bytes) 000179 1788264477.550046 write 0x023d09 thru 0x0249cf (0xcc7 bytes) 000180 1788264477.560474 punch from 0x02c102 to 0x036397 (0xa296 bytes) 000182 1788264477.578941 punch from 0x036a28 to 0x0370f2 (0x6cb bytes) 000183 1788264477.590968 MIRROR_RESYNC 4 mirrors 000187 1788264480.576668 read 0x00e149 thru 0x0161d8 (0x8090 bytes) 000188 1788264480.596222 MIRROR_EXTEND to 5 mirrors 000189 1788264482.607120 punch from 0x01cca4 to 0x023484 (0x67e1 bytes) 000190 1788264482.715087 trunc from 0x040000 to 0x0314ef (0xeb10 bytes) 000192 1788264482.744617 mapread 0x024081 thru 0x0302bd (0xc23d bytes) 000194 1788264482.774345 write 0x0208dc thru 0x0245c3 (0x3ce8 bytes) 000196 1788264482.776196 mapwrite 0x02224e thru 0x030e2b (0xebde bytes) 000198 1788264482.857982 trunc from 0x0314f0 to 0x009346 (0x281a9 bytes) 000200 1788264482.883936 mapread 0x0052a8 thru 0x009346 (0x409f bytes) 000201 1788264482.896893 mapwrite 0x02933c thru 0x03252d (0x91f2 bytes) 000202 1788264483.025555 punch from 0x02037d to 0x02962b (0x92af bytes) 000203 1788264483.050495 MIRROR_RESYNC 5 mirrors 000204 1788264485.409279 mapwrite 0x01f333 thru 0x023c4b (0x4919 bytes) 000205 1788264485.703888 trunc from 0x03252e to 0x004c3f (0x2d8ee bytes) 000206 1788264485.740370 write 0x00d875 thru 0x01203d (0x47c9 bytes) 000207 1788264485.741763 trunc from 0x01203e to 0x00cf46 (0x50f7 bytes) 000210 1788264485.766850 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xcf47): Mirror 3: 0x24f54e34 (stale) Mirror 4: 0x24f54e34 (stale) Mirror 5: 0x24f54e34 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xcf47): Mirror 3: 0x24f54e34 (stale) Mirror 4: 0x24f54e34 (stale) Mirror 5: 0x24f54e34 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xcf47: skipped 000211 1788264486.299112 trunc from 0x00cf47 to 0x012a10 (0x5aca bytes) 000212 1788264486.327232 read 0x002f86 thru 0x00deaf (0xaf2a bytes) 000213 1788264486.340964 write 0x023f7d thru 0x033756 (0xf7da bytes) 000214 1788264486.347304 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x33757): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33757): Mirror 3: 0xf1196890 (stale) Mirror 4: 0xf1196890 (stale) Mirror 5: 0xf1196890 (stale) CRC-32 checksum value for chunk [0, 0x33757): Mirror 1: 0xb0b0b1db Mirror 6: 0xb0b0b1db lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33757: skipped 000215 1788264487.934066 trunc from 0x033757 to 0x0314ae (0x22a8 bytes) 000217 1788264488.045395 mapwrite 0x02653e thru 0x0297fe (0x32c1 bytes) 000218 1788264488.210130 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x314af): Mirror 3: 0x1b7687a (stale) Mirror 4: 0x1b7687a (stale) Mirror 5: 0x1b7687a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x314af): Mirror 3: 0x1b7687a (stale) Mirror 4: 0x1b7687a (stale) Mirror 5: 0x1b7687a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x314af: skipped 000220 1788264488.732996 read 0x01e0a3 thru 0x028007 (0x9f65 bytes) 000222 1788264488.747018 write 0x00fccc thru 0x0126af (0x29e4 bytes) 000223 1788264488.777837 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x314af): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x314af): Mirror 3: 0x1b7687a (stale) Mirror 4: 0x1b7687a (stale) Mirror 5: 0x1b7687a (stale) CRC-32 checksum value for chunk [0, 0x314af): Mirror 1: 0x7e4e7778 Mirror 6: 0x7e4e7778 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x314af: skipped 000224 1788264490.351072 read 0x011760 thru 0x016e3e (0x56df bytes) 000225 1788264490.368963 read 0x01711e thru 0x019e2d (0x2d10 bytes) 000226 1788264490.391957 punch from 0x01d2a5 to 0x029a5a (0xc7b6 bytes) 000227 1788264490.492411 punch from 0x000f59 to 0x006519 (0x55c1 bytes) 000229 1788264490.498403 punch from 0x00c8e3 to 0x01a849 (0xdf67 bytes) 000230 1788264490.505383 mapwrite 0x00e4fb thru 0x014b14 (0x661a bytes) 000231 1788264490.708389 punch from 0x00035f to 0x00fb80 (0xf822 bytes) 000232 1788264490.721201 trunc from 0x0314af to 0x013a3e (0x1da70 bytes) 000233 1788264490.787146 punch from 0x010ff3 to 0x0124fa (0x1508 bytes) 000235 1788264490.801290 punch from 0x002428 to 0x008ab4 (0x668d bytes) truncating to largest ever: 0x39f6e 000236 1788264490.813408 trunc from 0x013a3f to 0x039f6d (0x2652f bytes) 000237 1788264490.854321 mapread 0x0246b7 thru 0x02806f (0x39b9 bytes) 000238 1788264490.909477 write 0x0161b2 thru 0x0221aa (0xbff9 bytes) 000239 1788264490.932090 punch from 0x0127e8 to 0x0199bc (0x71d5 bytes) 000240 1788264490.955290 write 0x0245db thru 0x027a10 (0x3436 bytes) 000241 1788264490.956296 write 0x022aa6 thru 0x0232ab (0x806 bytes) 000242 1788264490.970189 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39f6e): Mirror 3: 0x95cd21 (stale) Mirror 4: 0x95cd21 (stale) Mirror 6: 0x25a060ec (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39f6e): Mirror 3: 0x95cd21 (stale) Mirror 4: 0x95cd21 (stale) Mirror 6: 0x25a060ec (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39f6e: skipped 000245 1788264491.496893 read 0x02a8cb thru 0x02bfb7 (0x16ed bytes) 000246 1788264491.503758 read 0x023dbb thru 0x0278bf (0x3b05 bytes) 000248 1788264491.530638 write 0x0340b0 thru 0x03fa72 (0xb9c3 bytes) 000249 1788264491.534637 trunc from 0x03fa73 to 0x01284b (0x2d227 bytes) 000250 1788264491.568106 mapwrite 0x015fe8 thru 0x01c28b (0x62a4 bytes) 000251 1788264491.772100 punch from 0x010970 to 0x014d5f (0x43f0 bytes) 000252 1788264491.790164 mapwrite 0x011016 thru 0x014fcc (0x3fb7 bytes) 000254 1788264491.920343 trunc from 0x01c28c to 0x00391a (0x18971 bytes) 000255 1788264491.948917 mapread 0x00035a thru 0x00391a (0x35c1 bytes) 000256 1788264491.949818 trunc from 0x00391b to 0x0022b7 (0x1663 bytes) 000258 1788264491.977101 read 0x0006b6 thru 0x0022b7 (0x1c02 bytes) 000259 1788264491.977970 punch from 0x001a59 to 0x0022b7 (0x85f bytes) 000260 1788264491.984583 read 0x000b01 thru 0x0022b7 (0x17b7 bytes) 000261 1788264491.991155 mapwrite 0x016f10 thru 0x01ea2e (0x7b1f bytes) 000263 1788264492.132183 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ea2f): Mirror 3: 0x43b21b37 (stale) Mirror 4: 0x43b21b37 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ea2f): Mirror 3: 0x43b21b37 (stale) Mirror 4: 0x43b21b37 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ea2f: skipped 000266 1788264492.673738 read 0x00587d thru 0x014a55 (0xf1d9 bytes) 000267 1788264492.691300 mapread 0x00f85c thru 0x010bf3 (0x1398 bytes) 000268 1788264492.692996 mapwrite 0x02fa6d thru 0x039b7e (0xa112 bytes) 000270 1788264492.866540 MIRROR_RESYNC 3 mirrors 000271 1788264494.476627 write 0x03cae5 thru 0x03ffff (0x351b bytes) 000272 1788264494.622280 read 0x0339ca thru 0x03591e (0x1f55 bytes) 000273 1788264494.633507 mapwrite 0x033e1f thru 0x0342f6 (0x4d8 bytes) 000274 1788264494.740644 mapread 0x01bc60 thru 0x01f84a (0x3beb bytes) 000275 1788264494.774966 mapread 0x022ee1 thru 0x02a0fc (0x721c bytes) 000276 1788264494.798058 read 0x03c03a thru 0x03ffff (0x3fc6 bytes) 000277 1788264494.800058 mapwrite 0x01c667 thru 0x023ab7 (0x7451 bytes) 000278 1788264494.919687 mapwrite 0x03827f thru 0x03cf62 (0x4ce4 bytes) 000279 1788264495.095229 punch from 0x037043 to 0x03ffff (0x8fbd bytes) 000280 1788264495.105445 punch from 0x031dbd to 0x033d6c (0x1fb0 bytes) 000281 1788264495.111088 write 0x01e788 thru 0x0256b8 (0x6f31 bytes) 000282 1788264495.113845 mapread 0x03e3a5 thru 0x03f708 (0x1364 bytes) 000283 1788264495.127768 punch from 0x01369e to 0x01a6e1 (0x7044 bytes) 000284 1788264495.155803 read 0x0229a1 thru 0x02a49d (0x7afd bytes) 000285 1788264495.156645 punch from 0x01392e to 0x014ed5 (0x15a8 bytes) 000286 1788264495.163879 mapread 0x004065 thru 0x00c164 (0x8100 bytes) 000289 1788264495.169818 mapwrite 0x02ec44 thru 0x03dd9f (0xf15c bytes) 000290 1788264495.289816 read 0x0267d7 thru 0x0309c8 (0xa1f2 bytes) 000291 1788264495.290596 write 0x010c6a thru 0x013218 (0x25af bytes) 000295 1788264495.295847 mapwrite 0x0280ef thru 0x028c7d (0xb8f bytes) 000297 1788264495.390901 punch from 0x021ed4 to 0x02c55d (0xa68a bytes) 000298 1788264495.405634 punch from 0x001556 to 0x00889c (0x7347 bytes) 000299 1788264495.426931 MIRROR_RESYNC 3 mirrors truncating to largest ever: 0x3bbfe 000300 1788264497.001950 trunc from 0x040000 to 0x03bbfd (0x4402 bytes) 000302 1788264497.118101 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bbfe): Mirror 4: 0xb767a4a0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bbfe): Mirror 4: 0xb767a4a0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bbfe: skipped 000304 1788264497.585980 mapread 0x006279 thru 0x006435 (0x1bd bytes) 000305 1788264497.593535 mapwrite 0x030d3c thru 0x036444 (0x5709 bytes) 000306 1788264497.665192 trunc from 0x03bbfe to 0x02b272 (0x1098b bytes) 000307 1788264497.694395 read 0x001cbd thru 0x00cf2e (0xb272 bytes) 000310 1788264497.707609 mapwrite 0x010572 thru 0x01c734 (0xc1c3 bytes) 000311 1788264497.861771 mapwrite 0x00aa43 thru 0x00e8cf (0x3e8d bytes) 000312 1788264497.921649 punch from 0x01aee3 to 0x01edfb (0x3f19 bytes) 000313 1788264497.930568 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) 000314 1788264498.097861 mapwrite 0x01b05c thru 0x0283df (0xd384 bytes) 000315 1788264498.228650 trunc from 0x02b273 to 0x027ec3 (0x33af bytes) 000317 1788264498.254254 mapread 0x005c85 thru 0x00f2b8 (0x9634 bytes) 000319 1788264498.270976 MIRROR_EXTEND to 2 mirrors 000320 1788264499.521465 trunc from 0x027ec4 to 0x019258 (0xec6b bytes) 000321 1788264499.755839 mapwrite 0x0145d5 thru 0x01c2a9 (0x7cd5 bytes) 000322 1788264499.903530 mapwrite 0x03a526 thru 0x03ffff (0x5ada bytes) 000323 1788264500.014052 mapread 0x00a0e7 thru 0x017a40 (0xd95a bytes) 000324 1788264500.033368 mapwrite 0x01d730 thru 0x02646b (0x8d3c bytes) 000325 1788264500.173653 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xdb2f8fdf (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdaf72be1 Mirror 3: 0xdaf72be1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000327 1788264501.328648 write 0x00fe36 thru 0x01d179 (0xd344 bytes) 000328 1788264501.484195 mapwrite 0x01cd47 thru 0x02cba9 (0xfe63 bytes) 000329 1788264501.621753 trunc from 0x040000 to 0x036770 (0x988f bytes) 000330 1788264501.675830 mapwrite 0x00cbcf thru 0x014618 (0x7a4a bytes) 000331 1788264501.816530 punch from 0x01bbdc to 0x02a21b (0xe640 bytes) 000332 1788264501.844397 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36771): Mirror 3: 0xcb3971c1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36771): Mirror 3: 0xcb3971c1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36771: skipped 000333 1788264502.198571 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x36771): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36771): Mirror 3: 0xcb3971c1 (stale) CRC-32 checksum value for chunk [0, 0x36771): Mirror 1: 0x9371e6c0 Mirror 4: 0x9371e6c0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36771: skipped 000334 1788264503.807689 write 0x00815d thru 0x0177ed (0xf691 bytes) 000335 1788264503.932999 write 0x01d126 thru 0x01f861 (0x273c bytes) 000336 1788264503.949450 punch from 0x00abdc to 0x013762 (0x8b87 bytes) 000338 1788264503.978755 mapwrite 0x006e48 thru 0x008dc3 (0x1f7c bytes) 000339 1788264504.147068 trunc from 0x036771 to 0x031858 (0x4f18 bytes) 000341 1788264504.237848 read 0x01efff thru 0x020971 (0x1973 bytes) 000342 1788264504.258679 punch from 0x00096f to 0x00fb3b (0xf1cd bytes) 000343 1788264504.282075 trunc from 0x031859 to 0x033c93 (0x243b bytes) 000344 1788264504.335306 MIRROR_RESYNC 3 mirrors 000345 1788264506.513833 read 0x025ff7 thru 0x02965a (0x3664 bytes) 000346 1788264506.524099 read 0x001137 thru 0x002a35 (0x18ff bytes) 000347 1788264506.549364 mapwrite 0x0191e3 thru 0x0236af (0xa4cd bytes) 000348 1788264506.875326 mapread 0x00dc5e thru 0x00e3ec (0x78f bytes) 000349 1788264506.891877 mapread 0x02f2c2 thru 0x03051e (0x125d bytes) 000350 1788264506.909967 write 0x00d685 thru 0x018b4c (0xb4c8 bytes) 000352 1788264506.926639 read 0x01a5d6 thru 0x025b98 (0xb5c3 bytes) 000353 1788264506.950358 mapread 0x020c21 thru 0x02308e (0x246e bytes) 000354 1788264506.961092 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33c94): Mirror 4: 0xfdbcc039 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33c94): Mirror 4: 0xfdbcc039 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33c94: skipped 000355 1788264507.351071 mapread 0x0204dc thru 0x02a075 (0x9b9a bytes) 000356 1788264507.396039 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) 000358 1788264507.603331 mapwrite 0x019188 thru 0x01e054 (0x4ecd bytes) 000359 1788264507.754863 punch from 0x00d734 to 0x0172dd (0x9baa bytes) 000360 1788264507.760059 trunc from 0x033c94 to 0x01324c (0x20a47 bytes) 000361 1788264507.780472 trunc from 0x01324d to 0x00bdae (0x749e bytes) 000362 1788264507.802622 punch from 0x003045 to 0x00b8d6 (0x8892 bytes) 000364 1788264507.811847 read 0x00a24d thru 0x00bdae (0x1b62 bytes) 000365 1788264507.817343 trunc from 0x00bdaf to 0x0399cf (0x2dc21 bytes) 000366 1788264507.834332 write 0x00055f thru 0x00ee5c (0xe8fe bytes) 000368 1788264507.849404 trunc from 0x0399d0 to 0x00f31b (0x2a6b4 bytes) 000369 1788264507.886393 read 0x00bc31 thru 0x00bdc6 (0x196 bytes) 000370 1788264507.887305 trunc from 0x00f31c to 0x017f01 (0x8be6 bytes) 000371 1788264507.906660 read 0x00b84d thru 0x017d5b (0xc50f bytes) 000372 1788264507.916922 read 0x01715b thru 0x017f01 (0xda7 bytes) 000374 1788264507.925899 MIRROR_EXTEND to 2 mirrors 000375 1788264509.431930 MIRROR_RESYNC 2 mirrors 000376 1788264510.002349 write 0x004f66 thru 0x00b0f2 (0x618d bytes) 000377 1788264510.153151 trunc from 0x017f02 to 0x0136c8 (0x4839 bytes) 000379 1788264510.183357 read 0x00c4b1 thru 0x0136c8 (0x7218 bytes) 000380 1788264510.220995 MIRROR_RESYNC 2 mirrors 000382 1788264511.456830 write 0x0172ac thru 0x01dc23 (0x6978 bytes) 000383 1788264511.633023 write 0x01128c thru 0x0179c9 (0x673e bytes) 000384 1788264511.645857 mapwrite 0x01be9d thru 0x024ebb (0x901f bytes) 000385 1788264511.814301 punch from 0x00ac43 to 0x01868c (0xda4a bytes) 000386 1788264511.828866 MIRROR_RESYNC 2 mirrors 000387 1788264513.016862 MIRROR_RESYNC 2 mirrors 000388 1788264513.427675 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) 000389 1788264513.561814 trunc from 0x024ebc to 0x013e07 (0x110b4 bytes) 000390 1788264513.597516 write 0x02f2b6 thru 0x035654 (0x639f bytes) 000392 1788264513.601857 write 0x0273ac thru 0x028eb4 (0x1b09 bytes) 000394 1788264513.612752 trunc from 0x035655 to 0x003462 (0x321f2 bytes) 000398 1788264513.642350 punch from 0x0021ee to 0x003462 (0x1275 bytes) 000399 1788264513.660163 read 0x001b3e thru 0x003462 (0x1925 bytes) 000401 1788264513.676976 mapread 0x000925 thru 0x001266 (0x942 bytes) 000402 1788264513.688717 mapwrite 0x0034e6 thru 0x008cde (0x57f9 bytes) 000405 1788264513.890903 mapread 0x005bbc thru 0x008cde (0x3123 bytes) 000406 1788264513.892903 trunc from 0x008cdf to 0x012970 (0x9c92 bytes) 000407 1788264513.915853 mapwrite 0x035854 thru 0x03ccfd (0x74aa bytes) 000408 1788264514.011482 punch from 0x025c38 to 0x026916 (0xcdf bytes) 000410 1788264514.018345 write 0x00700e thru 0x01248e (0xb481 bytes) 000411 1788264514.025957 trunc from 0x03ccfe to 0x01f92c (0x1d3d1 bytes) 000412 1788264514.046717 write 0x02c59c thru 0x038fb7 (0xca1c bytes) 000414 1788264514.050841 mapwrite 0x016160 thru 0x01eb5e (0x89ff bytes) 000415 1788264514.117054 mapwrite 0x00494d thru 0x00a41d (0x5ad1 bytes) 000416 1788264514.158693 mapwrite 0x03b5e4 thru 0x03ffff (0x4a1c bytes) 000417 1788264514.236482 write 0x018888 thru 0x01b05e (0x27d7 bytes) 000418 1788264514.237740 read 0x026077 thru 0x029012 (0x2f9c bytes) 000428 1788264514.271854 trunc from 0x040000 to 0x002a36 (0x3d5c9 bytes) 000431 1788264514.320336 MIRROR_EXTEND to 2 mirrors 000432 1788264515.208291 mapwrite 0x0040bb thru 0x00d864 (0x97aa bytes) 000434 1788264515.445885 read 0x00c361 thru 0x00d864 (0x1504 bytes) 000435 1788264515.454879 MIRROR_RESYNC 2 mirrors 000436 1788264516.379765 trunc from 0x00d865 to 0x026665 (0x18e01 bytes) 000437 1788264516.494709 trunc from 0x026666 to 0x00ab52 (0x1bb13 bytes) 000440 1788264516.531365 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xab53): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xab53): Mirror 2: 0xa6d94bae (stale) CRC-32 checksum value for chunk [0, 0xab53): Mirror 1: 0xa6d94bae Mirror 3: 0xa6d94bae lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xab53: skipped 000442 1788264518.167216 read 0x002281 thru 0x00ab52 (0x88d2 bytes) 000443 1788264518.177373 write 0x011bbc thru 0x01bfff (0xa444 bytes) 000444 1788264518.311449 read 0x001391 thru 0x002e83 (0x1af3 bytes) 000445 1788264518.329345 read 0x00d1f6 thru 0x011661 (0x446c bytes) truncating to largest ever: 0x3cddc 000447 1788264518.330515 trunc from 0x01c000 to 0x03cddb (0x20ddc bytes) 000452 1788264518.407710 MIRROR_RESYNC 3 mirrors 000453 1788264520.313360 read 0x012c70 thru 0x016d26 (0x40b7 bytes) 000454 1788264520.323167 write 0x02d29e thru 0x038954 (0xb6b7 bytes) 000455 1788264520.445504 punch from 0x01e32a to 0x029865 (0xb53c bytes) 000456 1788264520.462505 punch from 0x037a78 to 0x03cddb (0x5364 bytes) 000457 1788264520.470901 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3cddc): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cddc): Mirror 2: 0x8f0cb51f (stale) Mirror 3: 0x8f0cb51f (stale) CRC-32 checksum value for chunk [0, 0x3cddc): Mirror 1: 0xd7ae6401 Mirror 4: 0xd7ae6401 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cddc: skipped 000459 1788264522.618483 read 0x00b2b9 thru 0x011203 (0x5f4b bytes) 000461 1788264522.645324 read 0x00c605 thru 0x0140d9 (0x7ad5 bytes) 000462 1788264522.662406 write 0x03160c thru 0x03a563 (0x8f58 bytes) 000463 1788264522.852827 write 0x01827d thru 0x0206fb (0x847f bytes) 000464 1788264522.864339 write 0x02daf0 thru 0x03c659 (0xeb6a bytes) 000465 1788264522.888864 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cddc): Mirror 2: 0x8f0cb51f (stale) Mirror 3: 0x8f0cb51f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cddc): Mirror 2: 0x8f0cb51f (stale) Mirror 3: 0x8f0cb51f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cddc: skipped 000466 1788264523.527138 mapwrite 0x00bd0f thru 0x015df5 (0xa0e7 bytes) 000467 1788264523.696568 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3cddc): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cddc): Mirror 2: 0x8f0cb51f (stale) Mirror 3: 0x8f0cb51f (stale) CRC-32 checksum value for chunk [0, 0x3cddc): Mirror 1: 0xeb0bc08d Mirror 4: 0xeb0bc08d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cddc: skipped 000468 1788264525.135944 mapread 0x03c9d6 thru 0x03cddb (0x406 bytes) 000469 1788264525.144344 punch from 0x03c135 to 0x03cddb (0xca7 bytes) 000470 1788264525.213148 trunc from 0x03cddc to 0x03b3ab (0x1a30 bytes) 000471 1788264525.235402 punch from 0x039927 to 0x03b3ab (0x1a85 bytes) 000473 1788264525.249651 read 0x021bd4 thru 0x030c04 (0xf031 bytes) 000474 1788264525.262798 mapwrite 0x03d149 thru 0x03ffff (0x2eb7 bytes) 000475 1788264525.355271 mapread 0x01acf0 thru 0x021f3b (0x724c bytes) 000476 1788264525.368985 write 0x022418 thru 0x02f744 (0xd32d bytes) 000477 1788264525.370506 punch from 0x020a48 to 0x02edc3 (0xe37c bytes) 000479 1788264525.396668 write 0x007d74 thru 0x00f2b7 (0x7544 bytes) 000480 1788264525.431807 read 0x0207f0 thru 0x02eea0 (0xe6b1 bytes) 000481 1788264525.448752 mapwrite 0x01be92 thru 0x023055 (0x71c4 bytes) 000482 1788264525.569620 read 0x019fd6 thru 0x01a436 (0x461 bytes) 000483 1788264525.571195 mapread 0x02161d thru 0x02631d (0x4d01 bytes) 000484 1788264525.573591 punch from 0x004e9b to 0x00765a (0x27c0 bytes) 000485 1788264525.579471 write 0x01a397 thru 0x022c5f (0x88c9 bytes) 000486 1788264525.592020 MIRROR_RESYNC 4 mirrors 000487 1788264528.116175 mapread 0x005925 thru 0x00f5a9 (0x9c85 bytes) 000488 1788264528.138043 mapread 0x0111b4 thru 0x018acc (0x7919 bytes) 000489 1788264528.146884 write 0x03e2cc thru 0x03ffff (0x1d34 bytes) 000492 1788264528.230222 trunc from 0x040000 to 0x0064cf (0x39b30 bytes) 000494 1788264528.264056 trunc from 0x0064d0 to 0x02a354 (0x23e85 bytes) 000495 1788264528.282057 write 0x00717f thru 0x012a41 (0xb8c3 bytes) 000496 1788264528.297524 trunc from 0x02a355 to 0x0241e2 (0x6172 bytes) 000497 1788264528.320841 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x241e3): Mirror 2: 0x16f91715 (stale) Mirror 3: 0x16f91715 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x241e3): Mirror 2: 0x16f91715 (stale) Mirror 3: 0x16f91715 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x241e3: skipped 000498 1788264528.626157 punch from 0x01fda6 to 0x01fea1 (0xfc bytes) 000499 1788264528.632260 read 0x002a61 thru 0x0114aa (0xea4a bytes) 000501 1788264528.641406 write 0x02cccd thru 0x036700 (0x9a34 bytes) 000503 1788264528.643741 punch from 0x0128b3 to 0x01abb4 (0x8302 bytes) 000504 1788264528.659926 write 0x015e2a thru 0x021c73 (0xbe4a bytes) 000505 1788264528.674624 write 0x0135b7 thru 0x01911c (0x5b66 bytes) 000506 1788264528.684269 mapread 0x005827 thru 0x0104fb (0xacd5 bytes) 000507 1788264528.702836 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36701): Mirror 3: 0xa7d15892 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36701): Mirror 3: 0xa7d15892 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36701: skipped 000508 1788264529.087954 mapwrite 0x006cff thru 0x00df38 (0x723a bytes) 000509 1788264529.210929 write 0x0164d9 thru 0x01cfb3 (0x6adb bytes) 000510 1788264529.230166 read 0x03380b thru 0x036700 (0x2ef6 bytes) 000511 1788264529.239878 write 0x029598 thru 0x0371e9 (0xdc52 bytes) 000512 1788264529.253970 punch from 0x01aaf0 to 0x01c256 (0x1767 bytes) 000514 1788264529.289914 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x371ea): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x371ea): Mirror 3: 0x1d474b95 (stale) CRC-32 checksum value for chunk [0, 0x371ea): Mirror 1: 0x93514218 Mirror 4: 0x93514218 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x371ea: skipped 000515 1788264530.702014 read 0x02dbfe thru 0x0371e9 (0x95ec bytes) 000516 1788264530.723044 read 0x0102bf thru 0x01c72c (0xc46e bytes) 000517 1788264530.741250 read 0x0223ea thru 0x03217e (0xfd95 bytes) 000518 1788264530.742356 punch from 0x0310ba to 0x0371e9 (0x6130 bytes) 000519 1788264530.963875 mapwrite 0x0365d3 thru 0x03a37f (0x3dad bytes) 000521 1788264531.090033 trunc from 0x03a380 to 0x039f2a (0x455 bytes) 000523 1788264531.108597 MIRROR_RESYNC 3 mirrors 000524 1788264533.563900 punch from 0x032e41 to 0x039f2a (0x70ea bytes) 000526 1788264533.663129 read 0x0078ef thru 0x010d4a (0x945c bytes) 000527 1788264533.674537 mapread 0x00371e thru 0x0110e7 (0xd9ca bytes) 000532 1788264533.727767 trunc from 0x039f2b to 0x022d0c (0x1721e bytes) 000533 1788264533.767814 read 0x009434 thru 0x01444f (0xb01c bytes) 000534 1788264533.770696 mapwrite 0x0013e5 thru 0x001d1a (0x936 bytes) 000536 1788264533.816709 read 0x0218a6 thru 0x022d0c (0x1467 bytes) 000537 1788264533.826865 mapwrite 0x0171f5 thru 0x01ee41 (0x7c4d bytes) 000538 1788264533.978806 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x22d0d): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22d0d): Mirror 3: 0x5a1a789e (stale) Mirror 4: 0x5a1a789e (stale) CRC-32 checksum value for chunk [0, 0x22d0d): Mirror 1: 0x1d885c79 Mirror 5: 0x1d885c79 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22d0d: skipped 000540 1788264535.555143 trunc from 0x022d0d to 0x0240ce (0x13c2 bytes) 000541 1788264535.698892 punch from 0x0157ba to 0x022f70 (0xd7b7 bytes) 000542 1788264535.712639 write 0x03008f thru 0x03f9d1 (0xf943 bytes) 000544 1788264535.715992 mapwrite 0x00c0ec thru 0x00ec9f (0x2bb4 bytes) 000545 1788264535.834612 MIRROR_RESYNC 4 mirrors 000546 1788264537.942201 mapread 0x022c83 thru 0x02ca8e (0x9e0c bytes) 000547 1788264537.967357 read 0x0075cc thru 0x008ed1 (0x1906 bytes) 000548 1788264537.972849 punch from 0x024184 to 0x03086a (0xc6e7 bytes) 000549 1788264538.096714 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f9d2): Mirror 3: 0xd219d329 (stale) Mirror 5: 0xd219d329 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f9d2): Mirror 3: 0xd219d329 (stale) Mirror 5: 0xd219d329 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f9d2: skipped 000550 1788264538.525897 read 0x021f97 thru 0x024006 (0x2070 bytes) 000553 1788264538.533099 mapwrite 0x03b568 thru 0x03ffff (0x4a98 bytes) 000554 1788264538.628998 trunc from 0x040000 to 0x016afa (0x29505 bytes) 000557 1788264538.650155 read 0x0133aa thru 0x016afa (0x3751 bytes) 000559 1788264538.661082 punch from 0x01303a to 0x016afa (0x3ac1 bytes) 000560 1788264538.674988 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16afb): Mirror 5: 0xa03cfdfd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16afb): Mirror 5: 0xa03cfdfd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16afb: skipped 000561 1788264539.082569 trunc from 0x016afb to 0x019972 (0x2e78 bytes) 000563 1788264539.144827 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) 000565 1788264539.371993 trunc from 0x019973 to 0x021e5a (0x84e8 bytes) 000566 1788264539.409068 MIRROR_EXTEND to 2 mirrors 000571 1788264540.700808 read 0x00c4a1 thru 0x0111fb (0x4d5b bytes) 000572 1788264540.710287 mapwrite 0x02a50a thru 0x02bbd5 (0x16cc bytes) 000573 1788264540.954095 read 0x01fd18 thru 0x02831e (0x8607 bytes) 000574 1788264540.975649 punch from 0x0268ef to 0x02bbd5 (0x52e7 bytes) 000576 1788264540.990490 mapwrite 0x03659d thru 0x03db33 (0x7597 bytes) 000577 1788264541.196334 mapwrite 0x01e3d0 thru 0x02a76c (0xc39d bytes) 000578 1788264541.337109 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3db34): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3db34): Mirror 2: 0xdaf31138 (stale) CRC-32 checksum value for chunk [0, 0x3db34): Mirror 1: 0x864e64f5 Mirror 3: 0x864e64f5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3db34: skipped 000579 1788264542.880766 mapread 0x0296a4 thru 0x032bc8 (0x9525 bytes) 000580 1788264542.933788 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) 000582 1788264543.343583 punch from 0x018882 to 0x01a19b (0x191a bytes) 000583 1788264543.427196 punch from 0x012617 to 0x016dfa (0x47e4 bytes) 000586 1788264543.434338 read 0x032d6c thru 0x03c4eb (0x9780 bytes) 000587 1788264543.448837 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3db34): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3db34): Mirror 3: 0x864e64f5 (stale) CRC-32 checksum value for chunk [0, 0x3db34): Mirror 1: 0xe1d91c95 Mirror 4: 0xe1d91c95 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3db34: skipped 000588 1788264544.765910 punch from 0x01d9e2 to 0x02968c (0xbcab bytes) 000590 1788264544.909385 write 0x039df4 thru 0x03c380 (0x258d bytes) 000591 1788264544.930197 trunc from 0x03db34 to 0x003087 (0x3aaac bytes) 000592 1788264544.971816 mapwrite 0x000450 thru 0x00929e (0x8e4f bytes) 000594 1788264545.242565 mapread 0x008858 thru 0x008baa (0x353 bytes) 000596 1788264545.245848 mapread 0x002722 thru 0x00929e (0x6b7d bytes) 000597 1788264545.248487 mapread 0x002b2d thru 0x00929e (0x6772 bytes) 000598 1788264545.256232 MIRROR_RESYNC 3 mirrors 000599 1788264546.304086 write 0x022b10 thru 0x02b586 (0x8a77 bytes) 000601 1788264546.377125 trunc from 0x02b587 to 0x005605 (0x25f81 bytes) 000602 1788264546.421651 write 0x01fb80 thru 0x0274de (0x795f bytes) 000603 1788264546.423109 write 0x0367b6 thru 0x039a6d (0x32b8 bytes) 000605 1788264546.431029 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x39a6e): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39a6e): Mirror 3: 0xf5b6ab65 (stale) Mirror 4: 0xf5b6ab65 (stale) CRC-32 checksum value for chunk [0, 0x39a6e): Mirror 1: 0x2644fb29 Mirror 5: 0x2644fb29 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39a6e: skipped 000606 1788264547.993634 mapread 0x012b83 thru 0x015bc1 (0x303f bytes) 000607 1788264548.052667 mapwrite 0x03ab58 thru 0x03ffff (0x54a8 bytes) 000608 1788264548.443997 write 0x00f0f3 thru 0x01397d (0x488b bytes) 000610 1788264548.483345 trunc from 0x040000 to 0x034477 (0xbb88 bytes) 000611 1788264548.517209 read 0x018976 thru 0x01a6db (0x1d66 bytes) 000613 1788264548.529291 punch from 0x0053ab to 0x00f8c1 (0xa517 bytes) 000614 1788264548.562331 mapread 0x00a56c thru 0x01844c (0xdee1 bytes) 000615 1788264548.586880 mapread 0x0026d2 thru 0x00d6a5 (0xafd4 bytes) 000616 1788264548.596457 write 0x003f59 thru 0x013158 (0xf200 bytes) 000618 1788264548.602253 read 0x020a64 thru 0x02fd55 (0xf2f2 bytes) 000619 1788264548.615544 mapwrite 0x03e65d thru 0x03ffff (0x19a3 bytes) 000620 1788264548.768595 mapread 0x01f4ba thru 0x025496 (0x5fdd bytes) 000622 1788264548.769963 mapwrite 0x00b73a thru 0x015a25 (0xa2ec bytes) 000623 1788264548.823931 read 0x0066d2 thru 0x012bde (0xc50d bytes) 000624 1788264548.824579 mapread 0x01b08e thru 0x027aa3 (0xca16 bytes) 000627 1788264548.826382 mapread 0x0342d6 thru 0x03ffff (0xbd2a bytes) truncating to largest ever: 0x3d042 000628 1788264548.829311 trunc from 0x040000 to 0x03d041 (0x2fbe bytes) 000629 1788264548.844656 write 0x026808 thru 0x035e1b (0xf614 bytes) 000631 1788264548.849581 mapread 0x00ee49 thru 0x00f85e (0xa16 bytes) 000633 1788264548.851474 trunc from 0x03d042 to 0x021e92 (0x1b1af bytes) 000635 1788264548.874020 mapread 0x01dfb9 thru 0x01fa83 (0x1acb bytes) 000637 1788264548.876237 write 0x0139c2 thru 0x0169f9 (0x3038 bytes) 000638 1788264548.880087 write 0x0337b9 thru 0x035b19 (0x2361 bytes) 000640 1788264548.887018 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35b1a): Mirror 3: 0xa8e446c1 (stale) Mirror 5: 0x9f92a570 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35b1a): Mirror 3: 0xa8e446c1 (stale) Mirror 5: 0x9f92a570 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35b1a: skipped 000641 1788264549.255957 write 0x029006 thru 0x032b7b (0x9b76 bytes) 000642 1788264549.267193 punch from 0x013e8b to 0x01b657 (0x77cd bytes) 000643 1788264549.283288 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35b1a): Mirror 3: 0xa8e446c1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35b1a): Mirror 3: 0xa8e446c1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35b1a: skipped 000644 1788264549.712713 write 0x03f1c8 thru 0x03ffff (0xe38 bytes) 000645 1788264549.713983 read 0x01fa71 thru 0x02d8c4 (0xde54 bytes) 000646 1788264549.725288 trunc from 0x040000 to 0x00161f (0x3e9e0 bytes) 000649 1788264549.778518 punch from 0x0010d3 to 0x00161f (0x54d bytes) 000650 1788264549.787379 punch from 0x0003f1 to 0x001033 (0xc43 bytes) 000651 1788264549.798550 read 0x000302 thru 0x00161f (0x131e bytes) 000653 1788264549.815607 trunc from 0x001620 to 0x0334a7 (0x31e88 bytes) 000654 1788264549.858780 punch from 0x004696 to 0x004c4d (0x5b8 bytes) 000655 1788264549.873410 trunc from 0x0334a8 to 0x02e308 (0x519f bytes) 000657 1788264549.914220 mapwrite 0x01f928 thru 0x027018 (0x76f1 bytes) 000659 1788264550.006914 MIRROR_RESYNC 2 mirrors 000660 1788264551.131764 write 0x034530 thru 0x03d00e (0x8adf bytes) 000661 1788264551.217522 trunc from 0x03d00f to 0x0162ff (0x26d0f bytes) 000662 1788264551.246977 punch from 0x000573 to 0x00e26b (0xdcf9 bytes) 000663 1788264551.258165 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x16300): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16300): Mirror 3: 0x4f3281c3 (stale) CRC-32 checksum value for chunk [0, 0x16300): Mirror 1: 0x1a7e5fb6 Mirror 4: 0x1a7e5fb6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16300: skipped 000665 1788264552.400313 mapwrite 0x03da38 thru 0x03ffff (0x25c8 bytes) 000667 1788264552.594136 read 0x019cdd thru 0x01a7c3 (0xae7 bytes) 000669 1788264552.603211 read 0x037052 thru 0x03ab8d (0x3b3c bytes) 000670 1788264552.615508 punch from 0x02b874 to 0x02f7e5 (0x3f72 bytes) 000672 1788264552.621296 mapwrite 0x010bb5 thru 0x017a45 (0x6e91 bytes) 000673 1788264552.681278 trunc from 0x040000 to 0x030b51 (0xf4ae bytes) 000674 1788264552.752816 MIRROR_RESYNC 3 mirrors 000675 1788264554.601379 read 0x01c629 thru 0x0245a6 (0x7f7e bytes) 000677 1788264554.614133 read 0x00cb1f thru 0x00cc29 (0x10b bytes) 000678 1788264554.648679 write 0x0223d3 thru 0x02cddd (0xaa0b bytes) 000679 1788264554.779361 read 0x005876 thru 0x00906b (0x37f6 bytes) 000680 1788264554.805226 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x30b52): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30b52): Mirror 3: 0xb56463b3 (stale) Mirror 4: 0xb56463b3 (stale) CRC-32 checksum value for chunk [0, 0x30b52): Mirror 1: 0x63c526bc Mirror 5: 0x63c526bc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30b52: skipped 000681 1788264556.678096 punch from 0x027bb9 to 0x02e750 (0x6b98 bytes) 000682 1788264556.859914 trunc from 0x030b52 to 0x01b1ba (0x15997 bytes) 000685 1788264556.919373 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b1bb): Mirror 3: 0x5328398e (stale) Mirror 5: 0x5328398e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b1bb): Mirror 3: 0x5328398e (stale) Mirror 5: 0x5328398e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b1bb: skipped 000686 1788264557.457504 trunc from 0x01b1bb to 0x01335f (0x7e5b bytes) truncating to largest ever: 0x3d5ac 000688 1788264557.508530 trunc from 0x013360 to 0x03d5ab (0x2a24c bytes) 000689 1788264557.555152 mapwrite 0x035979 thru 0x03f262 (0x98ea bytes) 000690 1788264557.782835 mapwrite 0x03dd86 thru 0x03ffff (0x227a bytes) 000691 1788264557.901615 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xcbab6c00 (stale) Mirror 5: 0x4662d0ae (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc9ff545b Mirror 6: 0xc9ff545b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000693 1788264559.347914 write 0x0086e0 thru 0x012338 (0x9c59 bytes) 000694 1788264559.444149 trunc from 0x040000 to 0x02b23a (0x14dc5 bytes) 000695 1788264559.468505 mapwrite 0x0163fc thru 0x0176cd (0x12d2 bytes) 000696 1788264559.540276 read 0x01db79 thru 0x022691 (0x4b19 bytes) 000697 1788264559.549365 write 0x013a85 thru 0x022cfe (0xf27a bytes) 000700 1788264559.556233 write 0x003c1a thru 0x00ba0d (0x7df4 bytes) 000702 1788264559.562210 punch from 0x01bf68 to 0x025425 (0x94be bytes) 000706 1788264559.580798 read 0x0045c1 thru 0x00dbfb (0x963b bytes) 000708 1788264559.583493 mapwrite 0x001c9d thru 0x0110dd (0xf441 bytes) 000709 1788264559.684783 punch from 0x017418 to 0x01e510 (0x70f9 bytes) 000710 1788264559.689483 write 0x006691 thru 0x0135bc (0xcf2c bytes) 000711 1788264559.690793 mapwrite 0x03f374 thru 0x03fe47 (0xad4 bytes) 000713 1788264559.877525 trunc from 0x03fe48 to 0x02de48 (0x11fff bytes) 000714 1788264559.915339 trunc from 0x02de49 to 0x011410 (0x1ca38 bytes) 000715 1788264559.938681 trunc from 0x011411 to 0x02d47c (0x1c06c bytes) 000717 1788264559.968888 read 0x006343 thru 0x015e3b (0xfaf9 bytes) 000718 1788264559.982384 punch from 0x0087fa to 0x010339 (0x7b40 bytes) 000721 1788264559.992400 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d47d): Mirror 3: 0x583134ab (stale) Mirror 6: 0x956c57f6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d47d): Mirror 3: 0x583134ab (stale) Mirror 6: 0x956c57f6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d47d: skipped 000722 1788264560.355015 trunc from 0x02d47d to 0x008d30 (0x2474c bytes) 000723 1788264560.377851 read 0x000a85 thru 0x003c50 (0x31cc bytes) 000724 1788264560.387752 punch from 0x0068c7 to 0x008d30 (0x246a bytes) 000727 1788264560.395130 read 0x003077 thru 0x0045ac (0x1536 bytes) 000728 1788264560.407135 mapwrite 0x02b1d5 thru 0x02f503 (0x432f bytes) 000730 1788264560.509926 mapread 0x00bb45 thru 0x00edf7 (0x32b3 bytes) 000731 1788264560.510743 mapread 0x02ede8 thru 0x02f503 (0x71c bytes) 000732 1788264560.511486 punch from 0x01e8b1 to 0x025d0d (0x745d bytes) 000733 1788264560.552287 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2f504): Mirror 3: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f504): Mirror 3: 0x260d2b88 (stale) Mirror 6: 0xeae69fea (stale) CRC-32 checksum value for chunk [0, 0x2f504): Mirror 1: 0xf247686 Mirror 7: 0xf247686 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f504: skipped 000734 1788264561.950208 write 0x0023fe thru 0x003ec1 (0x1ac4 bytes) 000735 1788264562.197189 punch from 0x00741b to 0x00c7b0 (0x5396 bytes) 000736 1788264562.231124 punch from 0x01e0d4 to 0x025bcd (0x7afa bytes) 000737 1788264562.257147 mapread 0x00b755 thru 0x00db2c (0x23d8 bytes) 000738 1788264562.319585 write 0x01a34a thru 0x01ae91 (0xb48 bytes) 000739 1788264562.342785 mapread 0x01232a thru 0x01ecd0 (0xc9a7 bytes) 000741 1788264562.355334 read 0x009abd thru 0x014e5e (0xb3a2 bytes) 000742 1788264562.357030 trunc from 0x02f504 to 0x032ea6 (0x39a3 bytes) 000743 1788264562.391162 read 0x01365c thru 0x01e9ce (0xb373 bytes) 000745 1788264562.392894 mapread 0x00a0e7 thru 0x00df56 (0x3e70 bytes) 000746 1788264562.394668 trunc from 0x032ea7 to 0x006de7 (0x2c0bf bytes) 000747 1788264562.435125 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x6de8): Mirror 6: 0x317a1f8a (stale) Mirror 7: 0x3ce61ee3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6de8): Mirror 6: 0x317a1f8a (stale) Mirror 7: 0x3ce61ee3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6de8: skipped 000748 1788264562.916297 trunc from 0x006de8 to 0x000cc8 (0x611f bytes) 000749 1788264562.972924 MIRROR_RESYNC 3 mirrors 000750 1788264564.043709 mapwrite 0x027d51 thru 0x02b4c1 (0x3771 bytes) 000751 1788264564.240030 trunc from 0x02b4c2 to 0x00ff01 (0x1b5c0 bytes) 000752 1788264564.266325 read 0x00826c thru 0x00ff01 (0x7c96 bytes) 000753 1788264564.277365 mapwrite 0x0247c9 thru 0x0312d0 (0xcb08 bytes) 000754 1788264564.360636 mapread 0x02a294 thru 0x0312d0 (0x703d bytes) 000755 1788264564.361609 write 0x006652 thru 0x01142c (0xaddb bytes) 000756 1788264564.375094 write 0x020d64 thru 0x027892 (0x6b2f bytes) 000757 1788264564.376308 mapwrite 0x02a146 thru 0x033cb3 (0x9b6e bytes) 000758 1788264564.479117 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x33cb4): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33cb4): Mirror 6: 0x6808e20f (stale) Mirror 7: 0x6808e20f (stale) CRC-32 checksum value for chunk [0, 0x33cb4): Mirror 1: 0x168e7cee Mirror 8: 0x168e7cee lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33cb4: skipped 000759 1788264566.269103 punch from 0x003dc4 to 0x00b336 (0x7573 bytes) 000761 1788264566.530654 read 0x02600d thru 0x02bcdd (0x5cd1 bytes) 000762 1788264566.544752 mapwrite 0x00db1c thru 0x00dbac (0x91 bytes) 000765 1788264566.664744 mapwrite 0x012665 thru 0x01a6ec (0x8088 bytes) 000766 1788264566.776531 read 0x01916b thru 0x01b423 (0x22b9 bytes) 000767 1788264566.777345 read 0x02c1f5 thru 0x02eb4d (0x2959 bytes) 000768 1788264566.799173 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x33cb4): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33cb4): Mirror 6: 0x6808e20f (stale) Mirror 7: 0x6808e20f (stale) Mirror 8: 0x168e7cee (stale) CRC-32 checksum value for chunk [0, 0x33cb4): Mirror 1: 0x846aba62 Mirror 9: 0x846aba62 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33cb4: skipped 000769 1788264568.452350 mapwrite 0x005f9d thru 0x00af00 (0x4f64 bytes) 000770 1788264568.740850 mapwrite 0x01a118 thru 0x01bb6a (0x1a53 bytes) 000771 1788264568.877960 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x33cb4): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33cb4): Mirror 6: 0x6808e20f (stale) Mirror 7: 0x6808e20f (stale) Mirror 8: 0x168e7cee (stale) Mirror 9: 0x846aba62 (stale) CRC-32 checksum value for chunk [0, 0x33cb4): Mirror 1: 0x1feb8fab Mirror 10: 0x1feb8fab lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33cb4: skipped 000772 1788264570.589150 punch from 0x02bc22 to 0x033cb3 (0x8092 bytes) 000774 1788264570.841256 punch from 0x01a085 to 0x028ff9 (0xef75 bytes) 000775 1788264570.864506 mapread 0x01147e thru 0x018b95 (0x7718 bytes) 000777 1788264570.910341 punch from 0x02c50e to 0x033cb3 (0x77a6 bytes) 000778 1788264570.915630 mapwrite 0x021986 thru 0x025eb1 (0x452c bytes) 000779 1788264571.107402 read 0x00cc94 thru 0x00efad (0x231a bytes) 000780 1788264571.109705 mapread 0x02b0cb thru 0x033cb3 (0x8be9 bytes) 000781 1788264571.144909 write 0x01e638 thru 0x02d6ee (0xf0b7 bytes) 000783 1788264571.154520 mapwrite 0x009e22 thru 0x0153d2 (0xb5b1 bytes) 000784 1788264571.283525 read 0x0141b4 thru 0x019728 (0x5575 bytes) 000787 1788264571.288153 read 0x0325ec thru 0x033cb3 (0x16c8 bytes) 000788 1788264571.289566 punch from 0x01ac59 to 0x01e380 (0x3728 bytes) 000789 1788264571.297870 write 0x039df8 thru 0x03ffff (0x6208 bytes) 000790 1788264571.302972 write 0x00b5dd thru 0x012199 (0x6bbd bytes) 000792 1788264571.308966 mapwrite 0x01eac4 thru 0x027544 (0x8a81 bytes) 000793 1788264571.412805 punch from 0x007180 to 0x00d9b7 (0x6838 bytes) 000794 1788264571.428373 MIRROR_RESYNC 6 mirrors 000795 1788264575.596097 write 0x03ac62 thru 0x03ffff (0x539e bytes) 000796 1788264575.715689 read 0x02b066 thru 0x033927 (0x88c2 bytes) 000801 1788264575.738467 mapread 0x004d28 thru 0x006981 (0x1c5a bytes) 000802 1788264575.768025 read 0x012e77 thru 0x01db74 (0xacfe bytes) 000803 1788264575.796323 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x8640f4cd (stale) Mirror 8: 0x8640f4cd (stale) Mirror 9: 0x8640f4cd (stale) Mirror 10: 0x8640f4cd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x8640f4cd (stale) Mirror 8: 0x8640f4cd (stale) Mirror 9: 0x8640f4cd (stale) Mirror 10: 0x8640f4cd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000804 1788264576.442197 trunc from 0x040000 to 0x01d543 (0x22abc bytes) 000805 1788264576.463026 trunc from 0x01d544 to 0x01cbd4 (0x96f bytes) 000806 1788264576.497116 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1cbd5): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1cbd5): Mirror 6: 0x8b64936b (stale) Mirror 8: 0x8b64936b (stale) Mirror 9: 0x8b64936b (stale) Mirror 10: 0x8b64936b (stale) CRC-32 checksum value for chunk [0, 0x1cbd5): Mirror 1: 0x8b64936b Mirror 11: 0x8b64936b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1cbd5: skipped 000807 1788264578.051094 read 0x00131a thru 0x00efdf (0xdcc6 bytes) 000809 1788264578.060697 mapwrite 0x00c27d thru 0x013b65 (0x78e9 bytes) 000810 1788264578.274792 trunc from 0x01cbd5 to 0x030d8c (0x141b8 bytes) 000811 1788264578.307875 read 0x029148 thru 0x030d8c (0x7c45 bytes) 000813 1788264578.334304 mapread 0x0216f8 thru 0x02fd37 (0xe640 bytes) 000814 1788264578.342246 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x30d8d): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30d8d): Mirror 6: 0x7e63cfb (stale) Mirror 8: 0x7e63cfb (stale) Mirror 9: 0x7e63cfb (stale) Mirror 10: 0x7e63cfb (stale) Mirror 11: 0xbbf38bf9 (stale) CRC-32 checksum value for chunk [0, 0x30d8d): Mirror 1: 0x96f2d07e Mirror 12: 0x96f2d07e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30d8d: skipped 000815 1788264580.007612 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x30d8d): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30d8d): Mirror 6: 0x7e63cfb (stale) Mirror 8: 0x7e63cfb (stale) Mirror 9: 0x7e63cfb (stale) Mirror 10: 0x7e63cfb (stale) Mirror 11: 0xbbf38bf9 (stale) CRC-32 checksum value for chunk [0, 0x30d8d): Mirror 1: 0x96f2d07e Mirror 12: 0x96f2d07e Mirror 13: 0x96f2d07e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30d8d: skipped 000816 1788264581.648900 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30d8d): Mirror 6: 0x7e63cfb (stale) Mirror 8: 0x7e63cfb (stale) Mirror 10: 0x7e63cfb (stale) Mirror 11: 0xbbf38bf9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30d8d): Mirror 6: 0x7e63cfb (stale) Mirror 8: 0x7e63cfb (stale) Mirror 10: 0x7e63cfb (stale) Mirror 11: 0xbbf38bf9 (stale) CRC-32 checksum value for chunk [0, 0x30d8d): Mirror 1: 0x96f2d07e Mirror 12: 0x96f2d07e Mirror 13: 0x96f2d07e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30d8d: skipped 000819 1788264582.584668 read 0x009f6a thru 0x011116 (0x71ad bytes) 000822 1788264582.599248 read 0x00930c thru 0x00c1a7 (0x2e9c bytes) 000824 1788264582.600065 trunc from 0x030d8d to 0x02a25c (0x6b30 bytes) 000825 1788264582.764949 read 0x00b2b9 thru 0x00e8db (0x3623 bytes) 000827 1788264582.777725 mapwrite 0x02d6ed thru 0x0328c5 (0x51d9 bytes) 000828 1788264582.865245 trunc from 0x0328c6 to 0x020d46 (0x11b7f bytes) 000829 1788264582.902012 mapread 0x017b08 thru 0x018bd0 (0x10c9 bytes) 000830 1788264582.904324 read 0x016ddd thru 0x01e590 (0x77b4 bytes) 000834 1788264582.912267 punch from 0x01a0ec to 0x020d46 (0x6c5b bytes) 000837 1788264582.920071 mapwrite 0x02f925 thru 0x032ec4 (0x35a0 bytes) 000838 1788264583.081140 mapread 0x020851 thru 0x02e5b3 (0xdd63 bytes) 000839 1788264583.088541 read 0x01c87c thru 0x024ddc (0x8561 bytes) 000840 1788264583.093407 read 0x01ce36 thru 0x029484 (0xc64f bytes) 000841 1788264583.094593 read 0x022883 thru 0x027b1c (0x529a bytes) 000842 1788264583.097800 read 0x00183d thru 0x010d0c (0xf4d0 bytes) 000843 1788264583.098551 mapread 0x00aa81 thru 0x019379 (0xe8f9 bytes) 000845 1788264583.107330 mapwrite 0x033a84 thru 0x035552 (0x1acf bytes) 000850 1788264583.176316 punch from 0x02bcc1 to 0x035552 (0x9892 bytes) 000851 1788264583.182210 trunc from 0x035553 to 0x00605e (0x2f4f4 bytes) 000852 1788264583.206838 read 0x001158 thru 0x00605e (0x4f07 bytes) 000853 1788264583.208540 mapread 0x001f5c thru 0x00605e (0x4103 bytes) 000854 1788264583.210541 punch from 0x004546 to 0x00605e (0x1b19 bytes) 000855 1788264583.215844 mapread 0x00525d thru 0x00605e (0xe02 bytes) 000856 1788264583.229932 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x605f): Mirror 8: 0x3d190912 (stale) Mirror 10: 0x3d190912 (stale) Mirror 11: 0x3d190912 (stale) Mirror 12: 0x3d190912 (stale) Mirror 13: 0x3d190912 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x605f): Mirror 8: 0x3d190912 (stale) Mirror 10: 0x3d190912 (stale) Mirror 11: 0x3d190912 (stale) Mirror 12: 0x3d190912 (stale) Mirror 13: 0x3d190912 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x605f: skipped 000857 1788264583.836515 write 0x015d18 thru 0x019232 (0x351b bytes) 000858 1788264583.839386 write 0x02072c thru 0x02cd6c (0xc641 bytes) 000859 1788264583.841159 read 0x00a03d thru 0x018a32 (0xe9f6 bytes) 000860 1788264583.856202 punch from 0x02ba51 to 0x02cd6c (0x131c bytes) 000861 1788264583.886638 trunc from 0x02cd6d to 0x035ea5 (0x9139 bytes) 000862 1788264583.919795 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x35ea6): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35ea6): Mirror 8: 0xc40538bf (stale) Mirror 10: 0xc40538bf (stale) Mirror 11: 0x41ff555e (stale) Mirror 12: 0x11a4ba55 (stale) Mirror 13: 0x11a4ba55 (stale) CRC-32 checksum value for chunk [0, 0x35ea6): Mirror 1: 0x2f24d934 Mirror 14: 0x2f24d934 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35ea6: skipped 000863 1788264585.718898 mapwrite 0x03fab3 thru 0x03ffff (0x54d bytes) 000864 1788264585.969890 write 0x032cba thru 0x0347ce (0x1b15 bytes) 000865 1788264585.999489 mapwrite 0x02fdff thru 0x033c65 (0x3e67 bytes) 000867 1788264586.143803 read 0x0151b7 thru 0x0191ee (0x4038 bytes) 000868 1788264586.165767 write 0x00fe63 thru 0x0134eb (0x3689 bytes) 000869 1788264586.188024 mapread 0x03ebb3 thru 0x03ffff (0x144d bytes) 000870 1788264586.203780 punch from 0x00318b to 0x005d91 (0x2c07 bytes) 000871 1788264586.244140 punch from 0x03a685 to 0x03ffff (0x597b bytes) 000872 1788264586.254337 read 0x0181b3 thru 0x019852 (0x16a0 bytes) 000874 1788264586.260871 mapread 0x0190a5 thru 0x01cc43 (0x3b9f bytes) 000875 1788264586.277405 trunc from 0x040000 to 0x031a79 (0xe586 bytes) 000876 1788264586.306150 write 0x014358 thru 0x01674f (0x23f8 bytes) 000877 1788264586.307289 write 0x03ff17 thru 0x03ffff (0xe9 bytes) 000879 1788264586.310932 read 0x00c72e thru 0x01b74d (0xf020 bytes) 000881 1788264586.313270 mapwrite 0x0039ea thru 0x00ae4c (0x7463 bytes) 000884 1788264586.368811 write 0x02edeb thru 0x032fb7 (0x41cd bytes) 000886 1788264586.376943 punch from 0x027421 to 0x036fea (0xfbca bytes) 000887 1788264586.390343 read 0x013f32 thru 0x01f343 (0xb412 bytes) 000889 1788264586.392389 mapwrite 0x02b115 thru 0x030094 (0x4f80 bytes) 000892 1788264586.462010 punch from 0x0035c5 to 0x0094a9 (0x5ee5 bytes) 000895 1788264586.470702 mapwrite 0x008b9a thru 0x00c716 (0x3b7d bytes) 000896 1788264586.547528 punch from 0x0214ae to 0x02dcd2 (0xc825 bytes) 000897 1788264586.552887 trunc from 0x040000 to 0x02e90c (0x116f3 bytes) 000898 1788264586.587410 trunc from 0x02e90d to 0x004b91 (0x29d7b bytes) 000899 1788264586.621880 punch from 0x0010d0 to 0x004b91 (0x3ac2 bytes) 000903 1788264586.637626 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x4b92): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4b92): Mirror 8: 0xbfc00687 (stale) Mirror 10: 0xbfc00687 (stale) Mirror 11: 0xbfc00687 (stale) Mirror 12: 0xbfc00687 (stale) Mirror 13: 0xbfc00687 (stale) Mirror 14: 0xbfc00687 (stale) CRC-32 checksum value for chunk [0, 0x4b92): Mirror 1: 0xbfc00687 Mirror 15: 0xbfc00687 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4b92: skipped 000904 1788264588.243677 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x4b92): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4b92): Mirror 8: 0xbfc00687 (stale) Mirror 10: 0xbfc00687 (stale) Mirror 11: 0xbfc00687 (stale) Mirror 12: 0xbfc00687 (stale) Mirror 13: 0xbfc00687 (stale) Mirror 14: 0xbfc00687 (stale) CRC-32 checksum value for chunk [0, 0x4b92): Mirror 1: 0xbfc00687 Mirror 15: 0xbfc00687 Mirror 16: 0xbfc00687 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4b92: skipped 000905 1788264589.790468 read 0x0010f7 thru 0x004b91 (0x3a9b bytes) 000906 1788264589.798001 mapwrite 0x02b796 thru 0x02f0c8 (0x3933 bytes) 000909 1788264590.078485 MIRROR_RESYNC 9 mirrors 000910 1788264592.333031 mapwrite 0x02e1ca thru 0x02e410 (0x247 bytes) 000911 1788264592.497229 mapwrite 0x007700 thru 0x011594 (0x9e95 bytes) 000912 1788264592.572995 write 0x01bd7d thru 0x01e0c2 (0x2346 bytes) 000914 1788264592.583447 write 0x02cec8 thru 0x03092a (0x3a63 bytes) 000916 1788264592.592919 punch from 0x0079c7 to 0x0134b1 (0xbaeb bytes) 000918 1788264592.620403 trunc from 0x03092b to 0x01b0bf (0x1586b bytes) 000919 1788264592.670372 punch from 0x00a932 to 0x0154f0 (0xabbf bytes) 000920 1788264592.679677 write 0x00ee8d thru 0x017e8c (0x9000 bytes) 000921 1788264592.700403 mapwrite 0x024b40 thru 0x032429 (0xd8ea bytes) 000922 1788264592.856919 trunc from 0x03242a to 0x001b33 (0x308f6 bytes) 000923 1788264592.905978 write 0x007fbb thru 0x0155b8 (0xd5fe bytes) 000927 1788264592.913301 write 0x03c2f5 thru 0x03ffff (0x3d0b bytes) 000928 1788264592.915968 write 0x022f7a thru 0x0323b0 (0xf437 bytes) 000929 1788264592.943131 read 0x011edd thru 0x01658c (0x46b0 bytes) 000932 1788264592.952737 read 0x0123cb thru 0x0200b0 (0xdce6 bytes) 000934 1788264592.988359 mapwrite 0x007f36 thru 0x01553e (0xd609 bytes) 000935 1788264593.160764 MIRROR_RESYNC 9 mirrors 000936 1788264597.256329 write 0x032e8e thru 0x0388d2 (0x5a45 bytes) 000939 1788264597.442760 mapread 0x0381c0 thru 0x03b364 (0x31a5 bytes) 000941 1788264597.466717 read 0x028a68 thru 0x02f2f7 (0x6890 bytes) 000942 1788264597.476748 mapread 0x0067e2 thru 0x00ebaf (0x83ce bytes) 000944 1788264597.490333 read 0x003c2b thru 0x006308 (0x26de bytes) 000946 1788264597.493355 mapread 0x014de8 thru 0x01b5e7 (0x6800 bytes) 000948 1788264597.512622 punch from 0x01bae6 to 0x01d681 (0x1b9c bytes) 000951 1788264597.540194 punch from 0x0110dd to 0x012db9 (0x1cdd bytes) 000953 1788264597.550649 write 0x01cb7d thru 0x029ed8 (0xd35c bytes) 000954 1788264597.557388 mapwrite 0x025b8d thru 0x030acf (0xaf43 bytes) 000955 1788264597.662325 mapread 0x03f3cf thru 0x03ffff (0xc31 bytes) 000958 1788264597.665120 mapwrite 0x01a19c thru 0x0290be (0xef23 bytes) 000959 1788264597.740151 read 0x027381 thru 0x02a8c9 (0x3549 bytes) 000960 1788264597.743157 punch from 0x037b7e to 0x03ffff (0x8482 bytes) 000961 1788264597.765272 mapread 0x006096 thru 0x006d7c (0xce7 bytes) 000964 1788264597.768333 write 0x03e9d0 thru 0x03ffff (0x1630 bytes) 000968 1788264597.807031 MIRROR_RESYNC 9 mirrors 000969 1788264602.695538 mapwrite 0x016af3 thru 0x01cb58 (0x6066 bytes) 000972 1788264602.893023 write 0x01abf2 thru 0x01f40c (0x481b bytes) 000973 1788264602.895573 mapread 0x039d68 thru 0x03be56 (0x20ef bytes) 000974 1788264602.905253 read 0x015e92 thru 0x01fbbe (0x9d2d bytes) 000975 1788264602.906033 mapwrite 0x009b69 thru 0x009e98 (0x330 bytes) 000976 1788264602.955618 mapwrite 0x03d13a thru 0x03ffff (0x2ec6 bytes) 000977 1788264602.998480 trunc from 0x040000 to 0x011cf6 (0x2e309 bytes) 000978 1788264603.028397 mapread 0x00596a thru 0x00b221 (0x58b8 bytes) 000980 1788264603.033211 punch from 0x00f5a7 to 0x011cf6 (0x2750 bytes) 000981 1788264603.042403 punch from 0x010394 to 0x011cf6 (0x1963 bytes) 000984 1788264603.051163 punch from 0x000b3c to 0x00471e (0x3be3 bytes) 000986 1788264603.058356 trunc from 0x011cf7 to 0x00f32c (0x29ca bytes) 000987 1788264603.075903 mapwrite 0x0062d5 thru 0x008e3e (0x2b6a bytes) 000991 1788264603.133709 punch from 0x0027dc to 0x00d8f6 (0xb11b bytes) 000993 1788264603.139587 mapwrite 0x007694 thru 0x016b38 (0xf4a5 bytes) 000996 1788264603.275155 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x16b39): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16b39): Mirror 8: 0xdfc9ee90 (stale) Mirror 10: 0xdfc9ee90 (stale) Mirror 11: 0xdfc9ee90 (stale) Mirror 12: 0xdfc9ee90 (stale) Mirror 13: 0xdfc9ee90 (stale) Mirror 14: 0xdfc9ee90 (stale) Mirror 15: 0xdfc9ee90 (stale) Mirror 16: 0xdfc9ee90 (stale) CRC-32 checksum value for chunk [0, 0x16b39): Mirror 1: 0x647298ed Mirror 17: 0x647298ed lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16b39: skipped 000997 1788264604.946571 punch from 0x007616 to 0x00b589 (0x3f74 bytes) 000998 1788264605.138691 read 0x0028a4 thru 0x00682f (0x3f8c bytes) 000999 1788264605.159745 mapwrite 0x03bfae thru 0x03ffff (0x4052 bytes) All operations completed A-OK!