== sanity-flr test 70a: flr mode fsx test ================ 05:25:09 (1788600309) striped dir -i0 -c2 -H crush /mnt/lustre/d70a.sanity-flr Seed set to 310 000001 1788600311.197978 mapwrite 0x0399c3 thru 0x03a432 (0xa70 bytes) 000002 1788600311.330556 trunc from 0x016e6f to 0x024074 (0xd206 bytes) 000003 1788600311.338665 mapread 0x02ab0f thru 0x0346c0 (0x9bb2 bytes) 000004 1788600311.369359 mapwrite 0x01f7c6 thru 0x02eb74 (0xf3af bytes) fallocating to largest ever: 0x2b7cd 000005 1788600311.439867 fallocate 0x02b006 thru 0x02b7cc (0x7c7 bytes) 000006 1788600311.450962 mapread 0x013f9e thru 0x014163 (0x1c6 bytes) 000007 1788600311.478072 read 0x01062a thru 0x016231 (0x5c08 bytes) 000008 1788600311.478874 mapread 0x025dca thru 0x033f66 (0xe19d bytes) 000009 1788600311.480177 read 0x014102 thru 0x014a3d (0x93c bytes) 000011 1788600311.484329 read 0x01dcf8 thru 0x02cef3 (0xf1fc bytes) 000012 1788600311.485109 fallocate 0x010e6f thru 0x01b1d8 (0xa36a bytes) 000014 1788600311.502110 trunc from 0x03a433 to 0x022b3f (0x178f3 bytes) 000016 1788600311.533489 mapread 0x011926 thru 0x01946e (0x7b49 bytes) 000018 1788600311.535253 mapread 0x00d0d7 thru 0x012096 (0x4fc0 bytes) 000020 1788600311.537485 read 0x000ea7 thru 0x007b0a (0x6c64 bytes) 000021 1788600311.544977 mapwrite 0x003330 thru 0x00f3fb (0xc0cc bytes) 000022 1788600311.571094 read 0x0127a5 thru 0x021cad (0xf509 bytes) 000023 1788600311.572164 mapwrite 0x0249d7 thru 0x033a6e (0xf098 bytes) 000026 1788600311.645424 mapread 0x022fb6 thru 0x02ac12 (0x7c5d bytes) 000027 1788600311.646180 trunc from 0x03302a to 0x033a6e (0xa45 bytes) 000028 1788600311.659509 mapread 0x000438 thru 0x001db0 (0x1979 bytes) 000031 1788600311.663429 trunc from 0x033a6f to 0x010064 (0x23a0a bytes) 000032 1788600311.687560 trunc from 0x00aeb2 to 0x00b607 (0x756 bytes) 000033 1788600311.694705 write 0x0200e1 thru 0x02a7e8 (0xa708 bytes) 000034 1788600311.698129 punch from 0x007313 to 0x01645a (0xf148 bytes) 000035 1788600311.723606 read 0x025720 thru 0x02a7e8 (0x50c9 bytes) 000036 1788600311.726860 mapwrite 0x0163a5 thru 0x0220da (0xbd36 bytes) 000037 1788600311.782166 read 0x021007 thru 0x0280c4 (0x70be bytes) 000038 1788600311.783275 mapread 0x021f5b thru 0x023375 (0x141b bytes) truncating to largest ever: 0x34b66 000039 1788600311.787182 trunc from 0x02a7e9 to 0x034b65 (0xa37d bytes) 000040 1788600311.823018 mapwrite 0x01148b thru 0x01dfcc (0xcb42 bytes) fallocating to largest ever: 0x3bee2 000042 1788600311.862359 fallocate 0x034705 thru 0x03bee1 (0x77dd bytes) 000044 1788600311.870718 trunc from 0x00e29d to 0x016acf (0x8833 bytes) 000045 1788600311.883245 trunc from 0x034b66 to 0x00a3ee (0x2a777 bytes) 000046 1788600311.918365 trunc from 0x00a3ef to 0x02fd04 (0x25916 bytes) 000047 1788600311.947138 write 0x011b8c thru 0x021969 (0xfdde bytes) 000048 1788600311.959617 mapread 0x0228a0 thru 0x029a42 (0x71a3 bytes) 000049 1788600311.960803 trunc from 0x0238a1 to 0x0278e9 (0x4049 bytes) 000050 1788600311.967634 trunc from 0x028d92 to 0x02fd04 (0x6f73 bytes) 000053 1788600311.975180 fallocate 0x00d343 thru 0x01cf62 (0xfc20 bytes) 000054 1788600311.986267 MIRROR_EXTEND to 2 mirrors 000055 1788600312.831245 trunc from 0x024b96 to 0x02d652 (0x8abd bytes) 000056 1788600312.849983 read 0x007905 thru 0x007bfc (0x2f8 bytes) 000057 1788600312.855041 mapread 0x02eb2d thru 0x02fd04 (0x11d8 bytes) 000058 1788600312.863916 write 0x026310 thru 0x033982 (0xd673 bytes) 000059 1788600312.877351 trunc from 0x033983 to 0x034a3c (0x10ba bytes) 000060 1788600312.904485 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x34a3d): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34a3d): Mirror 2: 0x3923ffb5 (stale) CRC-32 checksum value for chunk [0, 0x34a3d): Mirror 1: 0x740795b6 Mirror 3: 0x740795b6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34a3d: skipped 000061 1788600314.150552 read 0x0168de thru 0x01d372 (0x6a95 bytes) 000063 1788600314.188950 read 0x011977 thru 0x0122a2 (0x92c bytes) 000064 1788600314.228178 write 0x03efd9 thru 0x03ffff (0x1027 bytes) 000066 1788600314.314795 trunc from 0x040000 to 0x022b60 (0x1d49f bytes) 000067 1788600314.371866 mapwrite 0x03cdd9 thru 0x03ffff (0x3227 bytes) 000068 1788600314.442915 fallocate 0x01747e thru 0x0176f6 (0x279 bytes) 000069 1788600314.476380 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x1cdca843 (stale) Mirror 3: 0xa8bc1c55 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5e28c3e Mirror 4: 0x5e28c3e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000070 1788600315.659411 trunc from 0x023587 to 0x03077f (0xd1f9 bytes) 000071 1788600315.718252 mapwrite 0x00713c thru 0x00f103 (0x7fc8 bytes) 000073 1788600315.818304 punch from 0x024c29 to 0x02c37e (0x7756 bytes) 000074 1788600315.824144 punch from 0x008fc3 to 0x010554 (0x7592 bytes) 000075 1788600315.830630 write 0x016908 thru 0x01a9f6 (0x40ef bytes) 000076 1788600315.844143 trunc from 0x040000 to 0x03aadf (0x5520 bytes) 000077 1788600315.863900 read 0x00e235 thru 0x011e2c (0x3bf8 bytes) 000078 1788600315.870704 trunc from 0x03aae0 to 0x029e21 (0x10cbe bytes) 000080 1788600315.887544 mapread 0x00ee0d thru 0x015a39 (0x6c2d bytes) 000081 1788600315.889813 mapwrite 0x006a1b thru 0x0083f7 (0x19dd bytes) 000082 1788600315.915658 write 0x00c824 thru 0x00fece (0x36ab bytes) 000083 1788600315.916923 write 0x023d78 thru 0x028cac (0x4f35 bytes) 000084 1788600315.927049 mapwrite 0x009447 thru 0x01647c (0xd036 bytes) 000085 1788600315.947484 mapwrite 0x0188ae thru 0x02474f (0xbea2 bytes) 000087 1788600315.968348 trunc from 0x029e22 to 0x0398fe (0xfadd bytes) 000088 1788600315.984380 punch from 0x028ebc to 0x034020 (0xb165 bytes) 000089 1788600315.990381 write 0x01f8c4 thru 0x025d05 (0x6442 bytes) 000090 1788600315.993016 write 0x03bfeb thru 0x03ffff (0x4015 bytes) 000091 1788600315.994570 mapwrite 0x02624e thru 0x03513d (0xeef0 bytes) 000093 1788600316.038911 MIRROR_RESYNC 4 mirrors 000094 1788600317.292494 mapread 0x00ec69 thru 0x01cf74 (0xe30c bytes) 000095 1788600317.345795 fallocate 0x011b55 thru 0x013134 (0x15e0 bytes) 000096 1788600317.397816 punch from 0x0123e0 to 0x0201ca (0xddeb bytes) 000097 1788600317.409134 read 0x02aa19 thru 0x03747f (0xca67 bytes) 000098 1788600317.429640 mapwrite 0x0136e0 thru 0x019686 (0x5fa7 bytes) 000100 1788600317.543491 MIRROR_RESYNC 4 mirrors 000101 1788600319.021695 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) 000102 1788600319.580467 write 0x01970d thru 0x0203f5 (0x6ce9 bytes) 000103 1788600319.687348 read 0x03745b thru 0x03bd9f (0x4945 bytes) 000104 1788600319.699082 write 0x01cbc1 thru 0x02b592 (0xe9d2 bytes) 000105 1788600319.715472 mapwrite 0x006a33 thru 0x00a138 (0x3706 bytes) 000107 1788600319.771994 trunc from 0x040000 to 0x008fae (0x37051 bytes) 000108 1788600319.810973 write 0x023cad thru 0x0310ce (0xd422 bytes) 000109 1788600319.817937 read 0x011e9a thru 0x01e987 (0xcaee bytes) 000110 1788600319.842752 write 0x0248e3 thru 0x025d66 (0x1484 bytes) 000111 1788600319.846082 trunc from 0x0240e8 to 0x02c8cf (0x87e8 bytes) 000112 1788600319.885992 mapwrite 0x01b56a thru 0x02a503 (0xef9a bytes) 000113 1788600320.010339 mapread 0x011f86 thru 0x015cd9 (0x3d54 bytes) 000114 1788600320.014849 trunc from 0x02b2ca to 0x0308ef (0x5626 bytes) 000115 1788600320.034815 mapread 0x02104d thru 0x022f37 (0x1eeb bytes) 000116 1788600320.041796 MIRROR_RESYNC 3 mirrors 000118 1788600321.498182 mapwrite 0x032fcc thru 0x03b728 (0x875d bytes) 000119 1788600321.643731 mapwrite 0x012bf0 thru 0x019585 (0x6996 bytes) 000121 1788600321.708006 write 0x015187 thru 0x01d6be (0x8538 bytes) 000122 1788600321.722888 fallocate 0x002cd0 thru 0x00dfe9 (0xb31a bytes) 000125 1788600321.737173 trunc from 0x03374e to 0x03b728 (0x7fdb bytes) 000126 1788600321.744597 trunc from 0x03b729 to 0x00a471 (0x312b7 bytes) 000127 1788600321.786021 write 0x032509 thru 0x033167 (0xc5f bytes) 000130 1788600321.792770 write 0x0318cf thru 0x03c2af (0xa9e1 bytes) 000132 1788600321.818524 fallocate 0x00eff3 thru 0x010356 (0x1364 bytes) 000133 1788600321.825116 trunc from 0x015416 to 0x01998e (0x4579 bytes) 000134 1788600321.847522 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c2b0): Mirror 2: 0xec2bcff7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c2b0): Mirror 2: 0xec2bcff7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c2b0: skipped 000135 1788600322.245821 read 0x01a3ee thru 0x0227e2 (0x83f5 bytes) 000136 1788600322.255873 fallocate 0x02d215 thru 0x03592a (0x8716 bytes) 000137 1788600322.266436 punch from 0x0112f7 to 0x0158e0 (0x45ea bytes) 000138 1788600322.290497 trunc from 0x01d767 to 0x01f9f7 (0x2291 bytes) 000139 1788600322.295472 read 0x037911 thru 0x03c2af (0x499f bytes) 000140 1788600322.316566 fallocate 0x02c457 thru 0x037cac (0xb856 bytes) 000141 1788600322.332670 read 0x036bb6 thru 0x03c2af (0x56fa bytes) 000142 1788600322.336497 fallocate 0x0113e4 thru 0x01ca71 (0xb68e bytes) 000143 1788600322.348550 MIRROR_RESYNC 2 mirrors 000144 1788600323.117229 punch from 0x00fe67 to 0x015dde (0x5f78 bytes) 000145 1788600323.169563 fallocate 0x02b64e thru 0x0322c0 (0x6c73 bytes) 000146 1788600323.175013 mapread 0x02f3f9 thru 0x02feef (0xaf7 bytes) 000147 1788600323.182865 punch from 0x00969a to 0x00d3f8 (0x3d5f bytes) 000148 1788600323.189547 fallocate 0x00dac4 thru 0x012d40 (0x527d bytes) 000149 1788600323.210626 MIRROR_RESYNC 2 mirrors 000150 1788600323.927425 MIRROR_RESYNC 2 mirrors 000151 1788600324.435837 mapread 0x019261 thru 0x01eef6 (0x5c96 bytes) 000152 1788600324.474540 MIRROR_EXTEND to 3 mirrors 000153 1788600325.208300 write 0x0119aa thru 0x01a616 (0x8c6d bytes) 000154 1788600325.292055 read 0x00dfb0 thru 0x015832 (0x7883 bytes) 000155 1788600325.311862 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3c2b0): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c2b0): Mirror 2: 0x8a5c8959 (stale) Mirror 3: 0x8a5c8959 (stale) CRC-32 checksum value for chunk [0, 0x3c2b0): Mirror 1: 0x3a921093 Mirror 4: 0x3a921093 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c2b0: skipped 000156 1788600326.381266 trunc from 0x01f15c to 0x029c2d (0xaad2 bytes) 000157 1788600326.464039 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3c2b0): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c2b0): Mirror 2: 0x8a5c8959 (stale) Mirror 3: 0x8a5c8959 (stale) Mirror 4: 0x3a921093 (stale) CRC-32 checksum value for chunk [0, 0x3c2b0): Mirror 1: 0x3a921093 Mirror 5: 0x3a921093 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c2b0: skipped 000158 1788600327.422014 trunc from 0x03c2b0 to 0x00a85e (0x31a51 bytes) 000159 1788600327.513372 punch from 0x003086 to 0x00a85e (0x77d9 bytes) fallocating to largest ever: 0x40000 000160 1788600327.519168 fallocate 0x03ecb0 thru 0x03ffff (0x1350 bytes) 000162 1788600327.524950 read 0x009f67 thru 0x00a85e (0x8f8 bytes) 000164 1788600327.537518 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xa85f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa85f): Mirror 2: 0xf721079c (stale) Mirror 3: 0xf721079c (stale) Mirror 4: 0xf721079c (stale) Mirror 5: 0xf721079c (stale) CRC-32 checksum value for chunk [0, 0xa85f): Mirror 1: 0x48670e15 Mirror 6: 0x48670e15 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa85f: skipped 000165 1788600328.596284 write 0x00dbc0 thru 0x016166 (0x85a7 bytes) 000166 1788600328.704628 mapwrite 0x02d901 thru 0x03aad4 (0xd1d4 bytes) 000168 1788600328.865076 write 0x0118b8 thru 0x01833d (0x6a86 bytes) 000169 1788600328.886079 punch from 0x038a47 to 0x03aad4 (0x208e bytes) 000172 1788600328.907650 write 0x0080a3 thru 0x00ac09 (0x2b67 bytes) 000173 1788600328.940500 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3aad5): Mirror 3: 0x7971684 (stale) Mirror 4: 0xf49f64f2 (stale) Mirror 5: 0xf49f64f2 (stale) Mirror 6: 0x6621526d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aad5): Mirror 3: 0x7971684 (stale) Mirror 4: 0xf49f64f2 (stale) Mirror 5: 0xf49f64f2 (stale) Mirror 6: 0x6621526d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aad5: skipped 000175 1788600329.680369 write 0x008a11 thru 0x00e7f3 (0x5de3 bytes) 000176 1788600329.708996 mapread 0x020afe thru 0x030842 (0xfd45 bytes) 000177 1788600329.738637 trunc from 0x03aad5 to 0x017897 (0x2323d bytes) 000178 1788600329.756288 fallocate 0x0395fd thru 0x03ffff (0x6a03 bytes) 000179 1788600329.762120 mapread 0x0085ea thru 0x012fba (0xa9d1 bytes) 000180 1788600329.790654 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x17898): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17898): Mirror 3: 0xe6d0bad8 (stale) Mirror 4: 0xf9d7e39a (stale) Mirror 5: 0xf9d7e39a (stale) Mirror 6: 0x5809761c (stale) CRC-32 checksum value for chunk [0, 0x17898): Mirror 1: 0x12ffa4a7 Mirror 7: 0x12ffa4a7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17898: skipped 000181 1788600330.858375 mapread 0x013542 thru 0x017897 (0x4356 bytes) 000182 1788600330.905672 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17898): Mirror 3: 0xe6d0bad8 (stale) Mirror 4: 0xf9d7e39a (stale) Mirror 5: 0xf9d7e39a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17898): Mirror 3: 0xe6d0bad8 (stale) Mirror 4: 0xf9d7e39a (stale) Mirror 5: 0xf9d7e39a (stale) CRC-32 checksum value for chunk [0, 0x17898): Mirror 1: 0x12ffa4a7 Mirror 7: 0x12ffa4a7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17898: skipped 000183 1788600331.559095 MIRROR_RESYNC 5 mirrors 000184 1788600332.666764 write 0x02ec0c thru 0x0349e4 (0x5dd9 bytes) 000185 1788600332.731373 write 0x03ddf7 thru 0x03efad (0x11b7 bytes) 000186 1788600332.748393 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3efae): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3efae): Mirror 3: 0xabdceaa9 (stale) Mirror 4: 0xabdceaa9 (stale) Mirror 5: 0xabdceaa9 (stale) Mirror 7: 0xabdceaa9 (stale) CRC-32 checksum value for chunk [0, 0x3efae): Mirror 1: 0xd1bbb94b Mirror 8: 0xd1bbb94b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3efae: skipped 000187 1788600333.650318 punch from 0x01c5d7 to 0x024048 (0x7a72 bytes) 000188 1788600333.703338 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3efae): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3efae): Mirror 3: 0xabdceaa9 (stale) Mirror 4: 0xabdceaa9 (stale) Mirror 5: 0xabdceaa9 (stale) Mirror 7: 0xabdceaa9 (stale) Mirror 8: 0xd1bbb94b (stale) CRC-32 checksum value for chunk [0, 0x3efae): Mirror 1: 0xd1bbb94b Mirror 9: 0xd1bbb94b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3efae: skipped 000189 1788600334.872558 trunc from 0x01f567 to 0x020266 (0xd00 bytes) 000190 1788600334.921977 write 0x02cdba thru 0x037498 (0xa6df bytes) 000191 1788600334.942166 mapread 0x0076fa thru 0x010314 (0x8c1b bytes) 000192 1788600334.960004 MIRROR_RESYNC 7 mirrors 000193 1788600337.590510 fallocate 0x020748 thru 0x02483c (0x40f5 bytes) 000194 1788600337.640866 trunc from 0x03efae to 0x0026a3 (0x3c90a bytes) 000195 1788600337.672771 trunc from 0x0026a4 to 0x0335e1 (0x30f3e bytes) 000196 1788600337.693910 fallocate 0x02cb60 thru 0x037261 (0xa702 bytes) 000197 1788600337.702919 fallocate 0x00d4a2 thru 0x018cf8 (0xb857 bytes) 000198 1788600337.713148 read 0x000256 thru 0x00fa81 (0xf82c bytes) 000199 1788600337.740134 MIRROR_RESYNC 7 mirrors 000200 1788600339.115786 punch from 0x00bd49 to 0x0128ac (0x6b64 bytes) 000202 1788600339.156753 trunc from 0x024b77 to 0x02581c (0xca6 bytes) 000203 1788600339.163706 punch from 0x019ed3 to 0x0265fd (0xc72b bytes) 000204 1788600339.169162 write 0x022c04 thru 0x02941c (0x6819 bytes) 000205 1788600339.182472 mapread 0x0207bb thru 0x029746 (0x8f8c bytes) 000206 1788600339.193135 mapwrite 0x034914 thru 0x03d2c6 (0x89b3 bytes) 000207 1788600339.269396 write 0x02d52c thru 0x03caad (0xf582 bytes) 000208 1788600339.274291 trunc from 0x02a200 to 0x0398d8 (0xf6d9 bytes) 000209 1788600339.294411 fallocate 0x03d60e thru 0x03ffff (0x29f2 bytes) 000210 1788600339.300526 trunc from 0x03d2c7 to 0x01a0d0 (0x231f6 bytes) 000212 1788600339.321674 write 0x01d95e thru 0x021ebc (0x455f bytes) 000213 1788600339.324057 write 0x024543 thru 0x02f753 (0xb211 bytes) 000214 1788600339.326012 mapread 0x014588 thru 0x01e280 (0x9cf9 bytes) 000215 1788600339.343738 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f754): Mirror 3: 0x1c01ff4f (stale) Mirror 5: 0x1c01ff4f (stale) Mirror 7: 0x1c01ff4f (stale) Mirror 8: 0x1c01ff4f (stale) Mirror 9: 0x1c01ff4f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f754): Mirror 3: 0x1c01ff4f (stale) Mirror 5: 0x1c01ff4f (stale) Mirror 7: 0x1c01ff4f (stale) Mirror 8: 0x1c01ff4f (stale) Mirror 9: 0x1c01ff4f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f754: skipped 000216 1788600340.108441 trunc from 0x0091a7 to 0x013cfc (0xab56 bytes) 000217 1788600340.118553 trunc from 0x018c34 to 0x0235a2 (0xa96f bytes) 000218 1788600340.135808 trunc from 0x02f257 to 0x02f753 (0x4fd bytes) 000219 1788600340.153442 trunc from 0x009422 to 0x0115de (0x81bd bytes) 000220 1788600340.165194 fallocate 0x00281b thru 0x00308e (0x874 bytes) 000221 1788600340.172311 read 0x01a826 thru 0x023543 (0x8d1e bytes) 000222 1788600340.186192 trunc from 0x02f754 to 0x020666 (0xf0ed bytes) 000223 1788600340.215847 mapread 0x01fef6 thru 0x020666 (0x771 bytes) 000224 1788600340.216956 read 0x012173 thru 0x017d04 (0x5b92 bytes) 000225 1788600340.250726 trunc from 0x0192b9 to 0x01fe22 (0x6b6a bytes) 000226 1788600340.257983 write 0x029142 thru 0x02bceb (0x2baa bytes) 000227 1788600340.259172 mapread 0x014faf thru 0x01bbe7 (0x6c39 bytes) 000228 1788600340.297109 trunc from 0x00da4d to 0x0157d9 (0x7d8d bytes) 000229 1788600340.304931 mapwrite 0x02919f thru 0x02e7e1 (0x5643 bytes) 000230 1788600340.378046 punch from 0x0210ed to 0x02761c (0x6530 bytes) 000231 1788600340.398284 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2e7e2): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e7e2): Mirror 3: 0x2345623e (stale) Mirror 5: 0x2345623e (stale) Mirror 7: 0x2345623e (stale) Mirror 8: 0x2345623e (stale) Mirror 9: 0x2345623e (stale) CRC-32 checksum value for chunk [0, 0x2e7e2): Mirror 1: 0x2fc114b6 Mirror 10: 0x2fc114b6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e7e2: skipped 000232 1788600341.620794 fallocate 0x03b8fe thru 0x03da63 (0x2166 bytes) 000233 1788600341.722752 trunc from 0x0185ed to 0x01f194 (0x6ba8 bytes) 000234 1788600341.732281 mapwrite 0x0253c1 thru 0x02afe9 (0x5c29 bytes) 000235 1788600341.780638 punch from 0x021c29 to 0x026ffb (0x53d3 bytes) 000236 1788600341.786782 trunc from 0x0270ea to 0x030abc (0x99d3 bytes) 000237 1788600341.792386 mapread 0x031ff8 thru 0x0361b7 (0x41c0 bytes) 000238 1788600341.809380 fallocate 0x029eda thru 0x0329d0 (0x8af7 bytes) 000239 1788600341.817567 mapwrite 0x035dc3 thru 0x039409 (0x3647 bytes) 000240 1788600341.839716 fallocate 0x01233d thru 0x02005a (0xdd1e bytes) 000241 1788600341.846054 punch from 0x021df0 to 0x0276ed (0x58fe bytes) 000242 1788600341.852483 trunc from 0x03da64 to 0x00206e (0x3b9f5 bytes) 000243 1788600341.902989 mapwrite 0x029ee9 thru 0x02afe0 (0x10f8 bytes) 000244 1788600341.972132 mapread 0x01cd27 thru 0x02a647 (0xd921 bytes) 000245 1788600342.020156 read 0x01c539 thru 0x022a0f (0x64d7 bytes) 000246 1788600342.024183 trunc from 0x0129ee to 0x015c8b (0x329e bytes) 000247 1788600342.034052 punch from 0x00f83d to 0x015b24 (0x62e8 bytes) 000248 1788600342.039290 fallocate 0x01de03 thru 0x029c1a (0xbe18 bytes) 000249 1788600342.049230 trunc from 0x017a31 to 0x01f1a6 (0x7776 bytes) 000250 1788600342.061907 trunc from 0x02afe1 to 0x01333f (0x17ca1 bytes) 000251 1788600342.094870 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x13340): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13340): Mirror 3: 0x61f0a44b (stale) Mirror 5: 0x61f0a44b (stale) Mirror 7: 0x61f0a44b (stale) Mirror 8: 0x61f0a44b (stale) Mirror 9: 0x61f0a44b (stale) Mirror 10: 0x61f0a44b (stale) CRC-32 checksum value for chunk [0, 0x13340): Mirror 1: 0x61f0a44b Mirror 11: 0x61f0a44b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13340: skipped 000252 1788600343.189509 read 0x00cd2f thru 0x01333f (0x6611 bytes) 000253 1788600343.232000 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x13340): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13340): Mirror 3: 0x61f0a44b (stale) Mirror 5: 0x61f0a44b (stale) Mirror 7: 0x61f0a44b (stale) Mirror 8: 0x61f0a44b (stale) Mirror 9: 0x61f0a44b (stale) Mirror 10: 0x61f0a44b (stale) CRC-32 checksum value for chunk [0, 0x13340): Mirror 1: 0x61f0a44b Mirror 11: 0x61f0a44b Mirror 12: 0x61f0a44b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13340: skipped 000254 1788600344.298138 mapwrite 0x0223bf thru 0x022ec8 (0xb0a bytes) 000255 1788600344.437483 read 0x019217 thru 0x01dfd0 (0x4dba bytes) 000256 1788600344.461189 read 0x022c4a thru 0x022ec8 (0x27f bytes) 000257 1788600344.462665 trunc from 0x022ec9 to 0x01b6c5 (0x7803 bytes) 000258 1788600344.507538 trunc from 0x01b6c6 to 0x0010ab (0x1a61a bytes) 000260 1788600344.545026 write 0x02300f thru 0x028d69 (0x5d5b bytes) 000261 1788600344.554856 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28d6a): Mirror 3: 0xd2bc3a75 (stale) Mirror 5: 0xd2bc3a75 (stale) Mirror 7: 0xd2bc3a75 (stale) Mirror 8: 0xd2bc3a75 (stale) Mirror 9: 0xd2bc3a75 (stale) Mirror 10: 0xd2bc3a75 (stale) Mirror 12: 0xd2bc3a75 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28d6a): Mirror 3: 0xd2bc3a75 (stale) Mirror 5: 0xd2bc3a75 (stale) Mirror 7: 0xd2bc3a75 (stale) Mirror 8: 0xd2bc3a75 (stale) Mirror 9: 0xd2bc3a75 (stale) Mirror 10: 0xd2bc3a75 (stale) Mirror 12: 0xd2bc3a75 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28d6a: skipped 000263 1788600345.435148 trunc from 0x0271ae to 0x028d69 (0x1bbc bytes) 000264 1788600345.448965 trunc from 0x028d6a to 0x00ac04 (0x1e165 bytes) 000265 1788600345.497817 punch from 0x001768 to 0x00a0b8 (0x8951 bytes) 000266 1788600345.510516 trunc from 0x0077b0 to 0x007f3e (0x78f bytes) 000267 1788600345.523064 trunc from 0x00ac05 to 0x0161b6 (0xb5b2 bytes) 000268 1788600345.559520 mapwrite 0x02803f thru 0x02b067 (0x3029 bytes) 000269 1788600345.625415 trunc from 0x01a520 to 0x026765 (0xc246 bytes) 000270 1788600345.636127 write 0x00a9f4 thru 0x013790 (0x8d9d bytes) 000271 1788600345.661786 read 0x01587f thru 0x01f66b (0x9ded bytes) 000272 1788600345.684140 mapread 0x00e96f thru 0x0160f6 (0x7788 bytes) 000273 1788600345.694810 read 0x0008e9 thru 0x00a61a (0x9d32 bytes) 000274 1788600345.707157 trunc from 0x02b068 to 0x01a421 (0x10c46 bytes) 000275 1788600345.775808 fallocate 0x02f408 thru 0x039e85 (0xaa7e bytes) 000277 1788600345.783842 fallocate 0x011b59 thru 0x01f5d5 (0xda7d bytes) 000278 1788600345.791577 write 0x01752e thru 0x0186fc (0x11cf bytes) 000279 1788600345.800870 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x39e86): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39e86): Mirror 3: 0xd0b07711 (stale) Mirror 5: 0xd0b07711 (stale) Mirror 7: 0xd0b07711 (stale) Mirror 8: 0xd0b07711 (stale) Mirror 9: 0xd0b07711 (stale) Mirror 10: 0x241bc0a4 (stale) Mirror 12: 0xd0b07711 (stale) CRC-32 checksum value for chunk [0, 0x39e86): Mirror 1: 0x65b2a8e7 Mirror 13: 0x65b2a8e7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39e86: skipped 000280 1788600347.001652 mapwrite 0x02abe1 thru 0x02f176 (0x4596 bytes) 000281 1788600347.183254 fallocate 0x036a63 thru 0x03ffff (0x959d bytes) 000282 1788600347.189874 trunc from 0x02f79f to 0x030ebc (0x171e bytes) 000283 1788600347.206853 read 0x033a11 thru 0x03d660 (0x9c50 bytes) 000284 1788600347.245918 fallocate 0x02338c thru 0x028980 (0x55f5 bytes) 000285 1788600347.265072 fallocate 0x00ede9 thru 0x019cb2 (0xaeca bytes) 000287 1788600347.287319 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) Mirror 5: 0xe20eea22 (stale) Mirror 7: 0xe20eea22 (stale) Mirror 8: 0xe20eea22 (stale) Mirror 9: 0xe20eea22 (stale) Mirror 10: 0x8143ad28 (stale) Mirror 12: 0xe20eea22 (stale) Mirror 13: 0xc59c9e2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa0d35eda Mirror 14: 0xa0d35eda lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000288 1788600348.770658 trunc from 0x040000 to 0x005656 (0x3a9a9 bytes) 000290 1788600348.907176 trunc from 0x005657 to 0x02c5d1 (0x26f7b bytes) 000291 1788600348.944400 trunc from 0x02c5d2 to 0x031f62 (0x5991 bytes) 000294 1788600348.960936 trunc from 0x031f63 to 0x003d15 (0x2e24d bytes) 000295 1788600348.993799 fallocate 0x02ebe2 thru 0x035e4b (0x726a bytes) 000296 1788600348.999618 fallocate 0x035ab9 thru 0x03d189 (0x76d1 bytes) 000298 1788600349.006399 fallocate 0x02ae6a thru 0x039742 (0xe8d9 bytes) 000299 1788600349.014799 trunc from 0x01a6aa to 0x023ff7 (0x994e bytes) 000300 1788600349.038259 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x35e4c): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35e4c): Mirror 3: 0x6a08776 (stale) Mirror 5: 0x6a08776 (stale) Mirror 7: 0x6a08776 (stale) Mirror 8: 0x6a08776 (stale) Mirror 9: 0x6a08776 (stale) Mirror 10: 0xf63a47ec (stale) Mirror 12: 0x6a08776 (stale) Mirror 13: 0x8a5e9d3a (stale) Mirror 14: 0xa34cfadb (stale) CRC-32 checksum value for chunk [0, 0x35e4c): Mirror 1: 0x6a08776 Mirror 15: 0x6a08776 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35e4c: skipped 000301 1788600350.528718 read 0x01907d thru 0x020650 (0x75d4 bytes) 000303 1788600350.557382 trunc from 0x026829 to 0x02b080 (0x4858 bytes) 000304 1788600350.611735 write 0x036328 thru 0x03ac0a (0x48e3 bytes) 000305 1788600350.619991 mapwrite 0x013b06 thru 0x01501b (0x1516 bytes) 000306 1788600350.664550 read 0x02e179 thru 0x02f2dd (0x1165 bytes) 000307 1788600350.678641 fallocate 0x02f28c thru 0x036abc (0x7831 bytes) 000309 1788600350.689479 punch from 0x01b222 to 0x027644 (0xc423 bytes) 000310 1788600350.695726 trunc from 0x0299ab to 0x02d86a (0x3ec0 bytes) 000311 1788600350.702365 trunc from 0x03ac0b to 0x01373a (0x274d0 bytes) 000312 1788600350.731857 read 0x010ea2 thru 0x01373a (0x2899 bytes) 000313 1788600350.732904 trunc from 0x00b876 to 0x01373a (0x7ec5 bytes) 000314 1788600350.741054 mapread 0x00c269 thru 0x01373a (0x74d2 bytes) 000315 1788600350.755002 trunc from 0x01373b to 0x0061fd (0xd53d bytes) 000316 1788600350.779592 punch from 0x005f12 to 0x0061fd (0x2ec bytes) 000317 1788600350.787104 write 0x008271 thru 0x00ea8e (0x681e bytes) 000318 1788600350.792532 write 0x0342d5 thru 0x03ffff (0xbd2b bytes) 000319 1788600350.794489 punch from 0x010ddb to 0x01592e (0x4b54 bytes) 000321 1788600350.801915 write 0x020d3f thru 0x0246d3 (0x3995 bytes) 000322 1788600350.811484 read 0x001943 thru 0x008ede (0x759c bytes) 000323 1788600350.823101 mapread 0x03073b thru 0x036e67 (0x672d bytes) 000324 1788600350.824721 punch from 0x00b7cd to 0x015f0a (0xa73e bytes) 000325 1788600350.845647 read 0x033fac thru 0x03ffff (0xc054 bytes) 000326 1788600350.846822 read 0x010b7b thru 0x01a2ae (0x9734 bytes) 000327 1788600350.866991 trunc from 0x040000 to 0x00008f (0x3ff70 bytes) 000328 1788600350.886838 punch from 0x000078 to 0x00008f (0x18 bytes) 000329 1788600350.895493 read 0x00008b thru 0x00008f (0x5 bytes) 000331 1788600350.905406 mapwrite 0x0347be thru 0x03a42a (0x5c6d bytes) 000332 1788600351.009775 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3a42b): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a42b): Mirror 3: 0xde9f7ddb (stale) Mirror 5: 0xde9f7ddb (stale) Mirror 7: 0xde9f7ddb (stale) Mirror 8: 0xde9f7ddb (stale) Mirror 9: 0xde9f7ddb (stale) Mirror 10: 0xaeba1128 (stale) Mirror 12: 0xde9f7ddb (stale) Mirror 13: 0x78d92cfd (stale) Mirror 14: 0x5b5d32ac (stale) Mirror 15: 0xde9f7ddb (stale) CRC-32 checksum value for chunk [0, 0x3a42b): Mirror 1: 0x926c218b Mirror 16: 0x926c218b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a42b: skipped 000333 1788600352.691491 fallocate 0x0295aa thru 0x03496a (0xb3c1 bytes) 000334 1788600352.766807 trunc from 0x030b5a to 0x03a42a (0x98d1 bytes) 000335 1788600352.775066 write 0x02db04 thru 0x039282 (0xb77f bytes) 000336 1788600352.799818 punch from 0x02a2ec to 0x02d6b5 (0x33ca bytes) 000337 1788600352.827296 trunc from 0x0041de to 0x0048fd (0x720 bytes) 000338 1788600352.838957 read 0x00a3d2 thru 0x019425 (0xf054 bytes) 000339 1788600352.854826 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3a42b): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a42b): Mirror 3: 0xde9f7ddb (stale) Mirror 5: 0xde9f7ddb (stale) Mirror 7: 0xde9f7ddb (stale) Mirror 8: 0xde9f7ddb (stale) Mirror 9: 0xde9f7ddb (stale) Mirror 10: 0xaeba1128 (stale) Mirror 12: 0xde9f7ddb (stale) Mirror 13: 0x78d92cfd (stale) Mirror 14: 0x5b5d32ac (stale) Mirror 15: 0xde9f7ddb (stale) Mirror 16: 0x926c218b (stale) CRC-32 checksum value for chunk [0, 0x3a42b): Mirror 1: 0x8ce904a8 Mirror 17: 0x8ce904a8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a42b: skipped 000340 1788600354.161304 trunc from 0x006d60 to 0x0114c7 (0xa768 bytes) 000341 1788600354.206869 punch from 0x018497 to 0x026f82 (0xeaec bytes) 000342 1788600354.211647 punch from 0x002f6f to 0x00b1c9 (0x825b bytes) 000343 1788600354.216611 mapread 0x014ce8 thru 0x014ff3 (0x30c bytes) 000344 1788600354.221969 mapread 0x034329 thru 0x0397fe (0x54d6 bytes) 000345 1788600354.238861 mapwrite 0x03cbb2 thru 0x03e28f (0x16de bytes) 000346 1788600354.284635 trunc from 0x007883 to 0x014981 (0xd0ff bytes) 000347 1788600354.290675 mapwrite 0x010588 thru 0x016857 (0x62d0 bytes) 000348 1788600354.323608 MIRROR_SPLIT mirror 2 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e290): Mirror 3: 0x264a234e (stale) Mirror 7: 0x264a234e (stale) Mirror 8: 0x264a234e (stale) Mirror 9: 0x264a234e (stale) Mirror 10: 0xad762474 (stale) Mirror 12: 0x264a234e (stale) Mirror 13: 0x5a3de602 (stale) Mirror 14: 0x220c6262 (stale) Mirror 15: 0x264a234e (stale) Mirror 16: 0x957ff6a5 (stale) Mirror 17: 0x5ccd4674 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e290): Mirror 3: 0x264a234e (stale) Mirror 7: 0x264a234e (stale) Mirror 8: 0x264a234e (stale) Mirror 9: 0x264a234e (stale) Mirror 10: 0xad762474 (stale) Mirror 12: 0x264a234e (stale) Mirror 13: 0x5a3de602 (stale) Mirror 14: 0x220c6262 (stale) Mirror 15: 0x264a234e (stale) Mirror 16: 0x957ff6a5 (stale) Mirror 17: 0x5ccd4674 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e290: skipped 000349 1788600355.281698 write 0x00766d thru 0x014e56 (0xd7ea bytes) 000350 1788600355.304709 read 0x005a2f thru 0x008369 (0x293b bytes) 000352 1788600355.314812 fallocate 0x03afad thru 0x03ffff (0x5053 bytes) 000353 1788600355.324193 trunc from 0x01d926 to 0x02c129 (0xe804 bytes) 000354 1788600355.331173 fallocate 0x01806a thru 0x021b89 (0x9b20 bytes) 000355 1788600355.341478 trunc from 0x00207c to 0x0099cf (0x7954 bytes) 000356 1788600355.376728 MIRROR_RESYNC 12 mirrors 000357 1788600359.121692 write 0x03c8d2 thru 0x03f5a6 (0x2cd5 bytes) 000358 1788600359.171916 write 0x019382 thru 0x026b8e (0xd80d bytes) 000359 1788600359.192610 fallocate 0x022d35 thru 0x02a9ee (0x7cba bytes) 000360 1788600359.198354 write 0x03d532 thru 0x03fc9a (0x2769 bytes) 000361 1788600359.207342 MIRROR_RESYNC 12 mirrors 000362 1788600362.534526 mapwrite 0x037725 thru 0x03ffff (0x88db bytes) 000363 1788600362.643832 read 0x016142 thru 0x016c4b (0xb0a bytes) 000364 1788600362.652077 mapread 0x016358 thru 0x023a45 (0xd6ee bytes) 000365 1788600362.673997 trunc from 0x01815f to 0x02739c (0xf23e bytes) 000366 1788600362.684436 MIRROR_RESYNC 12 mirrors 000367 1788600365.068430 mapread 0x025e2e thru 0x028a86 (0x2c59 bytes) 000368 1788600365.101740 trunc from 0x040000 to 0x019bfa (0x26405 bytes) 000369 1788600365.145149 mapwrite 0x03dd51 thru 0x03e54b (0x7fb bytes) 000370 1788600365.190374 punch from 0x00724d to 0x014f83 (0xdd37 bytes) 000372 1788600365.197971 trunc from 0x0164e5 to 0x01eb4f (0x866b bytes) 000373 1788600365.203622 fallocate 0x026c00 thru 0x02bb25 (0x4f26 bytes) 000374 1788600365.208529 read 0x0097f7 thru 0x011750 (0x7f5a bytes) 000375 1788600365.218066 trunc from 0x008937 to 0x008c4a (0x314 bytes) 000377 1788600365.222998 trunc from 0x03e54c to 0x02f46f (0xf0dc bytes) 000378 1788600365.240936 fallocate 0x0035b8 thru 0x01246e (0xeeb7 bytes) 000379 1788600365.249484 mapread 0x007559 thru 0x01709e (0xfb46 bytes) 000380 1788600365.264674 trunc from 0x02f470 to 0x02b4c1 (0x3fae bytes) 000381 1788600365.278822 trunc from 0x02b4c2 to 0x02737b (0x4146 bytes) 000382 1788600365.291429 trunc from 0x02737c to 0x03b005 (0x13c8a bytes) 000383 1788600365.308837 fallocate 0x02bb45 thru 0x032a73 (0x6f2f bytes) 000384 1788600365.314746 fallocate 0x02bae6 thru 0x02dfc3 (0x24de bytes) 000385 1788600365.324489 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3b006): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b006): Mirror 3: 0x181ae4cd (stale) Mirror 7: 0x181ae4cd (stale) Mirror 8: 0x181ae4cd (stale) Mirror 9: 0x181ae4cd (stale) Mirror 10: 0x181ae4cd (stale) Mirror 12: 0x181ae4cd (stale) Mirror 13: 0x181ae4cd (stale) Mirror 14: 0x181ae4cd (stale) Mirror 15: 0x181ae4cd (stale) Mirror 16: 0x181ae4cd (stale) Mirror 17: 0x181ae4cd (stale) CRC-32 checksum value for chunk [0, 0x3b006): Mirror 1: 0x7d178c00 Mirror 18: 0x7d178c00 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b006: skipped 000386 1788600366.211119 punch from 0x01a0af to 0x0249af (0xa901 bytes) 000387 1788600366.255313 read 0x03833e thru 0x03b005 (0x2cc8 bytes) 000388 1788600366.262670 punch from 0x018d99 to 0x01e7c1 (0x5a29 bytes) 000389 1788600366.267498 fallocate 0x0176a1 thru 0x0240ee (0xca4e bytes) 000390 1788600366.272810 mapwrite 0x036b4a thru 0x03ffff (0x94b6 bytes) 000391 1788600366.371386 MIRROR_SPLIT mirror 4 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe4af62a9 (stale) Mirror 7: 0xe4af62a9 (stale) Mirror 8: 0xe4af62a9 (stale) Mirror 10: 0xe4af62a9 (stale) Mirror 12: 0xe4af62a9 (stale) Mirror 13: 0xe4af62a9 (stale) Mirror 14: 0xe4af62a9 (stale) Mirror 15: 0xe4af62a9 (stale) Mirror 16: 0xe4af62a9 (stale) Mirror 17: 0xe4af62a9 (stale) Mirror 18: 0x7e7e5c3b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe4af62a9 (stale) Mirror 7: 0xe4af62a9 (stale) Mirror 8: 0xe4af62a9 (stale) Mirror 10: 0xe4af62a9 (stale) Mirror 12: 0xe4af62a9 (stale) Mirror 13: 0xe4af62a9 (stale) Mirror 14: 0xe4af62a9 (stale) Mirror 15: 0xe4af62a9 (stale) Mirror 16: 0xe4af62a9 (stale) Mirror 17: 0xe4af62a9 (stale) Mirror 18: 0x7e7e5c3b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000392 1788600367.009068 read 0x0319d9 thru 0x03ffff (0xe627 bytes) 000393 1788600367.028510 fallocate 0x029e79 thru 0x02ea47 (0x4bcf bytes) 000394 1788600367.034493 write 0x0089d0 thru 0x00fb90 (0x71c1 bytes) 000395 1788600367.050492 write 0x019159 thru 0x0252e8 (0xc190 bytes) 000396 1788600367.076720 read 0x003e7d thru 0x0061e4 (0x2368 bytes) 000397 1788600367.097709 write 0x037f9a thru 0x03ffff (0x8066 bytes) 000398 1788600367.099608 mapread 0x022c33 thru 0x028f8b (0x6359 bytes) 000399 1788600367.101735 mapread 0x01ccc0 thru 0x027830 (0xab71 bytes) 000400 1788600367.103750 fallocate 0x024ff9 thru 0x032c86 (0xdc8e bytes) 000402 1788600367.110584 read 0x01a1f5 thru 0x01db1f (0x392b bytes) 000404 1788600367.112684 trunc from 0x040000 to 0x00f8d8 (0x30727 bytes) 000405 1788600367.141424 write 0x00163e thru 0x00e56c (0xcf2f bytes) 000406 1788600367.143082 read 0x00c0f7 thru 0x00cb87 (0xa91 bytes) 000407 1788600367.144726 mapwrite 0x029fce thru 0x0375ea (0xd61d bytes) 000408 1788600367.206669 trunc from 0x014a16 to 0x01e61f (0x9c0a bytes) 000409 1788600367.219061 mapread 0x004841 thru 0x004999 (0x159 bytes) 000410 1788600367.220122 trunc from 0x003443 to 0x006db3 (0x3971 bytes) 000411 1788600367.236699 trunc from 0x03099b to 0x0375ea (0x6c50 bytes) 000412 1788600367.242529 trunc from 0x0375eb to 0x036471 (0x1179 bytes) 000413 1788600367.275400 fallocate 0x028e8b thru 0x0375cc (0xe742 bytes) 000414 1788600367.284846 write 0x021c80 thru 0x02ee80 (0xd201 bytes) 000415 1788600367.290915 mapread 0x025fbf thru 0x02a992 (0x49d4 bytes) 000416 1788600367.308031 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x375cd): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x375cd): Mirror 3: 0x12595139 (stale) Mirror 7: 0x12595139 (stale) Mirror 8: 0x12595139 (stale) Mirror 10: 0x12595139 (stale) Mirror 12: 0x12595139 (stale) Mirror 13: 0x12595139 (stale) Mirror 14: 0x12595139 (stale) Mirror 15: 0x12595139 (stale) Mirror 16: 0x12595139 (stale) Mirror 17: 0x12595139 (stale) Mirror 18: 0xef1efc34 (stale) CRC-32 checksum value for chunk [0, 0x375cd): Mirror 1: 0x64715f19 Mirror 19: 0x64715f19 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x375cd: skipped 000417 1788600368.815742 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x375cd): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x375cd): Mirror 3: 0x12595139 (stale) Mirror 7: 0x12595139 (stale) Mirror 8: 0x12595139 (stale) Mirror 10: 0x12595139 (stale) Mirror 12: 0x12595139 (stale) Mirror 13: 0x12595139 (stale) Mirror 14: 0x12595139 (stale) Mirror 15: 0x12595139 (stale) Mirror 16: 0x12595139 (stale) Mirror 17: 0x12595139 (stale) Mirror 18: 0xef1efc34 (stale) CRC-32 checksum value for chunk [0, 0x375cd): Mirror 1: 0x64715f19 Mirror 19: 0x64715f19 Mirror 20: 0x64715f19 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x375cd: skipped 000418 1788600369.959867 mapwrite 0x010bdb thru 0x01d682 (0xcaa8 bytes) 000419 1788600370.191423 trunc from 0x019048 to 0x022832 (0x97eb bytes) 000420 1788600370.204733 read 0x016134 thru 0x01e93e (0x880b bytes) 000421 1788600370.232600 fallocate 0x01ed25 thru 0x02c779 (0xda55 bytes) 000422 1788600370.241466 trunc from 0x0375cd to 0x02cd23 (0xa8a9 bytes) 000424 1788600370.291336 mapread 0x00a5d8 thru 0x00c3fa (0x1e23 bytes) 000425 1788600370.314137 MIRROR_RESYNC 14 mirrors 000426 1788600373.624966 trunc from 0x02cd24 to 0x0197c6 (0x1355d bytes) 000427 1788600373.674195 fallocate 0x02a7f2 thru 0x032c16 (0x8425 bytes) 000428 1788600373.680412 mapread 0x020fc5 thru 0x02d54b (0xc587 bytes) 000429 1788600373.717518 punch from 0x001246 to 0x010b69 (0xf924 bytes) 000431 1788600373.723512 trunc from 0x0026b9 to 0x00c217 (0x9b5f bytes) 000432 1788600373.730040 read 0x00b4fd thru 0x018c84 (0xd788 bytes) 000433 1788600373.755372 MIRROR_RESYNC 14 mirrors 000434 1788600377.260076 punch from 0x002a19 to 0x0042b4 (0x189c bytes) 000436 1788600377.307149 mapread 0x0317e8 thru 0x032c16 (0x142f bytes) 000437 1788600377.321319 fallocate 0x023fe6 thru 0x027adc (0x3af7 bytes) 000438 1788600377.330104 trunc from 0x032c17 to 0x0258e9 (0xd32d bytes) 000439 1788600377.349695 mapwrite 0x0331df thru 0x03d5fb (0xa41d bytes) 000440 1788600377.405848 punch from 0x00174e to 0x00b46c (0x9d1f bytes) 000441 1788600377.417285 mapread 0x035480 thru 0x0390c2 (0x3c43 bytes) 000442 1788600377.418413 trunc from 0x037dee to 0x03d5fb (0x580e bytes) 000443 1788600377.426063 mapread 0x008f3c thru 0x011548 (0x860d bytes) 000444 1788600377.458865 MIRROR_RESYNC 14 mirrors 000445 1788600382.011015 trunc from 0x026518 to 0x02a697 (0x4180 bytes) 000446 1788600382.086899 mapread 0x016686 thru 0x018333 (0x1cae bytes) 000447 1788600382.114060 mapread 0x011c03 thru 0x01fca6 (0xe0a4 bytes) 000448 1788600382.115451 mapwrite 0x0134c2 thru 0x0174ad (0x3fec bytes) 000449 1788600382.152604 trunc from 0x035b53 to 0x03c93d (0x6deb bytes) 000450 1788600382.158927 fallocate 0x027274 thru 0x029745 (0x24d2 bytes) 000451 1788600382.163696 mapread 0x03c359 thru 0x03d5fb (0x12a3 bytes) 000452 1788600382.171445 mapread 0x03b017 thru 0x03d5fb (0x25e5 bytes) 000453 1788600382.172724 read 0x010dc3 thru 0x01e640 (0xd87e bytes) 000454 1788600382.177536 trunc from 0x03d5fc to 0x01e925 (0x1ecd6 bytes) 000455 1788600382.207436 trunc from 0x00658b to 0x011e89 (0xb8ff bytes) 000456 1788600382.213293 punch from 0x00e5e3 to 0x01da6f (0xf48d bytes) 000457 1788600382.225373 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x1e926): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e926): Mirror 3: 0x15265d12 (stale) Mirror 7: 0x15265d12 (stale) Mirror 8: 0x15265d12 (stale) Mirror 10: 0x15265d12 (stale) Mirror 12: 0x15265d12 (stale) Mirror 13: 0x15265d12 (stale) Mirror 14: 0x15265d12 (stale) Mirror 15: 0x15265d12 (stale) Mirror 16: 0x15265d12 (stale) Mirror 17: 0x15265d12 (stale) Mirror 18: 0x15265d12 (stale) Mirror 19: 0x15265d12 (stale) Mirror 20: 0x15265d12 (stale) CRC-32 checksum value for chunk [0, 0x1e926): Mirror 1: 0xccf6c630 Mirror 21: 0xccf6c630 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e926: skipped 000458 1788600383.302756 write 0x005e07 thru 0x014d1e (0xef18 bytes) 000459 1788600383.368656 mapread 0x01990e thru 0x01e925 (0x5018 bytes) 000460 1788600383.381463 write 0x01d343 thru 0x02a0a6 (0xcd64 bytes) 000461 1788600383.384526 trunc from 0x02a0a7 to 0x004af8 (0x255ae bytes) 000462 1788600383.438952 mapread 0x0028c6 thru 0x004af8 (0x2233 bytes) 000463 1788600383.446482 mapwrite 0x019073 thru 0x01c92f (0x38bd bytes) 000464 1788600383.497377 mapwrite 0x00f1de thru 0x00ff3e (0xd61 bytes) 000465 1788600383.526597 read 0x01237d thru 0x01c92f (0xa5b3 bytes) 000467 1788600383.529326 punch from 0x0026dc to 0x0106d9 (0xdffe bytes) 000468 1788600383.535450 read 0x006c5b thru 0x00f08c (0x8432 bytes) 000469 1788600383.549324 read 0x016df5 thru 0x01c92f (0x5b3b bytes) 000471 1788600383.554055 read 0x00b38c thru 0x014b9d (0x9812 bytes) 000472 1788600383.555474 trunc from 0x01c930 to 0x01d95a (0x102b bytes) 000473 1788600383.571653 write 0x02171b thru 0x029371 (0x7c57 bytes) 000474 1788600383.574713 read 0x0199f2 thru 0x01d388 (0x3997 bytes) 000475 1788600383.581776 trunc from 0x013b78 to 0x01fec4 (0xc34d bytes) 000476 1788600383.589721 MIRROR_SPLIT mirror 6 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29372): Mirror 3: 0xfe83ee86 (stale) Mirror 7: 0xfe83ee86 (stale) Mirror 8: 0xfe83ee86 (stale) Mirror 10: 0xfe83ee86 (stale) Mirror 12: 0xfe83ee86 (stale) Mirror 14: 0xfe83ee86 (stale) Mirror 15: 0xfe83ee86 (stale) Mirror 16: 0xfe83ee86 (stale) Mirror 17: 0xfe83ee86 (stale) Mirror 18: 0xfe83ee86 (stale) Mirror 19: 0xfe83ee86 (stale) Mirror 20: 0xfe83ee86 (stale) Mirror 21: 0x44407ef8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29372): Mirror 3: 0xfe83ee86 (stale) Mirror 7: 0xfe83ee86 (stale) Mirror 8: 0xfe83ee86 (stale) Mirror 10: 0xfe83ee86 (stale) Mirror 12: 0xfe83ee86 (stale) Mirror 14: 0xfe83ee86 (stale) Mirror 15: 0xfe83ee86 (stale) Mirror 16: 0xfe83ee86 (stale) Mirror 17: 0xfe83ee86 (stale) Mirror 18: 0xfe83ee86 (stale) Mirror 19: 0xfe83ee86 (stale) Mirror 20: 0xfe83ee86 (stale) Mirror 21: 0x44407ef8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29372: skipped 000478 1788600384.398343 fallocate 0x0276b7 thru 0x030197 (0x8ae1 bytes) 000479 1788600384.405525 write 0x00fd2e thru 0x01cb06 (0xcdd9 bytes) 000480 1788600384.433723 MIRROR_SPLIT mirror 10 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29372): Mirror 3: 0xfe83ee86 (stale) Mirror 7: 0xfe83ee86 (stale) Mirror 8: 0xfe83ee86 (stale) Mirror 10: 0xfe83ee86 (stale) Mirror 12: 0xfe83ee86 (stale) Mirror 14: 0xfe83ee86 (stale) Mirror 15: 0xfe83ee86 (stale) Mirror 16: 0xfe83ee86 (stale) Mirror 17: 0xfe83ee86 (stale) Mirror 19: 0xfe83ee86 (stale) Mirror 20: 0xfe83ee86 (stale) Mirror 21: 0x44407ef8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29372): Mirror 3: 0xfe83ee86 (stale) Mirror 7: 0xfe83ee86 (stale) Mirror 8: 0xfe83ee86 (stale) Mirror 10: 0xfe83ee86 (stale) Mirror 12: 0xfe83ee86 (stale) Mirror 14: 0xfe83ee86 (stale) Mirror 15: 0xfe83ee86 (stale) Mirror 16: 0xfe83ee86 (stale) Mirror 17: 0xfe83ee86 (stale) Mirror 19: 0xfe83ee86 (stale) Mirror 20: 0xfe83ee86 (stale) Mirror 21: 0x44407ef8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29372: skipped 000481 1788600385.264185 write 0x0331d4 thru 0x03d3fd (0xa22a bytes) 000482 1788600385.275117 write 0x02fc0f thru 0x03d3ad (0xd79f bytes) 000483 1788600385.285746 write 0x00799d thru 0x00fd81 (0x83e5 bytes) 000484 1788600385.304614 trunc from 0x03d3fe to 0x0174d7 (0x25f26 bytes) 000485 1788600385.341465 mapwrite 0x033ad5 thru 0x03fa19 (0xbf45 bytes) 000486 1788600385.435927 mapwrite 0x01550c thru 0x01718d (0x1c82 bytes) 000487 1788600385.502374 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3fa1a): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fa1a): Mirror 3: 0xfd87dfe7 (stale) Mirror 7: 0xfd87dfe7 (stale) Mirror 8: 0xfd87dfe7 (stale) Mirror 10: 0xfd87dfe7 (stale) Mirror 12: 0xfd87dfe7 (stale) Mirror 14: 0xfd87dfe7 (stale) Mirror 15: 0xfd87dfe7 (stale) Mirror 16: 0xfd87dfe7 (stale) Mirror 17: 0xfd87dfe7 (stale) Mirror 19: 0xfd87dfe7 (stale) Mirror 20: 0xfd87dfe7 (stale) Mirror 21: 0x9771c1c8 (stale) CRC-32 checksum value for chunk [0, 0x3fa1a): Mirror 1: 0x2bc2833 Mirror 22: 0x2bc2833 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fa1a: skipped 000488 1788600387.013283 MIRROR_SPLIT mirror 7 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fa1a): Mirror 3: 0xfd87dfe7 (stale) Mirror 7: 0xfd87dfe7 (stale) Mirror 8: 0xfd87dfe7 (stale) Mirror 10: 0xfd87dfe7 (stale) Mirror 12: 0xfd87dfe7 (stale) Mirror 14: 0xfd87dfe7 (stale) Mirror 16: 0xfd87dfe7 (stale) Mirror 17: 0xfd87dfe7 (stale) Mirror 19: 0xfd87dfe7 (stale) Mirror 20: 0xfd87dfe7 (stale) Mirror 21: 0x9771c1c8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fa1a): Mirror 3: 0xfd87dfe7 (stale) Mirror 7: 0xfd87dfe7 (stale) Mirror 8: 0xfd87dfe7 (stale) Mirror 10: 0xfd87dfe7 (stale) Mirror 12: 0xfd87dfe7 (stale) Mirror 14: 0xfd87dfe7 (stale) Mirror 16: 0xfd87dfe7 (stale) Mirror 17: 0xfd87dfe7 (stale) Mirror 19: 0xfd87dfe7 (stale) Mirror 20: 0xfd87dfe7 (stale) Mirror 21: 0x9771c1c8 (stale) CRC-32 checksum value for chunk [0, 0x3fa1a): Mirror 1: 0x2bc2833 Mirror 22: 0x2bc2833 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fa1a: skipped 000489 1788600388.087831 fallocate 0x00fd8d thru 0x011723 (0x1997 bytes) 000490 1788600388.174937 punch from 0x00f102 to 0x01b838 (0xc737 bytes) 000491 1788600388.183238 mapwrite 0x03e7e3 thru 0x03ffff (0x181d bytes) 000492 1788600388.274086 mapwrite 0x02121e thru 0x02cbe9 (0xb9cc bytes) 000493 1788600388.388268 MIRROR_RESYNC 13 mirrors 000495 1788600392.608701 read 0x000394 thru 0x0093a7 (0x9014 bytes) 000496 1788600392.615443 mapwrite 0x01ddd8 thru 0x026c96 (0x8ebf bytes) 000497 1788600392.722084 trunc from 0x040000 to 0x00ac56 (0x353a9 bytes) 000499 1788600392.750326 punch from 0x006ccd to 0x00ac56 (0x3f8a bytes) 000501 1788600392.758307 mapread 0x00826a thru 0x00a295 (0x202c bytes) 000502 1788600392.768320 punch from 0x006179 to 0x00ac56 (0x4ade bytes) 000503 1788600392.773379 mapwrite 0x02f350 thru 0x034027 (0x4cd8 bytes) 000504 1788600392.828084 read 0x018c31 thru 0x01bc58 (0x3028 bytes) 000505 1788600392.850480 MIRROR_RESYNC 13 mirrors 000506 1788600396.248194 read 0x00fa37 thru 0x014db1 (0x537b bytes) 000508 1788600396.274811 trunc from 0x026722 to 0x034027 (0xd906 bytes) 000509 1788600396.322315 mapread 0x003699 thru 0x00ce63 (0x97cb bytes) 000511 1788600396.340566 mapwrite 0x0173f5 thru 0x0253c0 (0xdfcc bytes) 000512 1788600396.383096 write 0x00c45c thru 0x01457e (0x8123 bytes) 000513 1788600396.385572 read 0x004ba3 thru 0x014708 (0xfb66 bytes) 000514 1788600396.390830 MIRROR_SPLIT mirror 2 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34028): Mirror 3: 0x418a571c (stale) Mirror 8: 0x418a571c (stale) Mirror 10: 0x418a571c (stale) Mirror 12: 0x418a571c (stale) Mirror 14: 0x418a571c (stale) Mirror 16: 0x418a571c (stale) Mirror 17: 0x418a571c (stale) Mirror 19: 0x418a571c (stale) Mirror 20: 0x418a571c (stale) Mirror 21: 0x418a571c (stale) Mirror 22: 0x418a571c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34028): Mirror 3: 0x418a571c (stale) Mirror 8: 0x418a571c (stale) Mirror 10: 0x418a571c (stale) Mirror 12: 0x418a571c (stale) Mirror 14: 0x418a571c (stale) Mirror 16: 0x418a571c (stale) Mirror 17: 0x418a571c (stale) Mirror 19: 0x418a571c (stale) Mirror 20: 0x418a571c (stale) Mirror 21: 0x418a571c (stale) Mirror 22: 0x418a571c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34028: skipped 000515 1788600397.072164 trunc from 0x034028 to 0x03b57b (0x7554 bytes) 000516 1788600397.127143 read 0x0376d0 thru 0x03b57b (0x3eac bytes) 000518 1788600397.144945 MIRROR_SPLIT mirror 4 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b57c): Mirror 3: 0x6e927af9 (stale) Mirror 8: 0x6e927af9 (stale) Mirror 10: 0x6e927af9 (stale) Mirror 14: 0x6e927af9 (stale) Mirror 16: 0x6e927af9 (stale) Mirror 17: 0x6e927af9 (stale) Mirror 19: 0x6e927af9 (stale) Mirror 20: 0x6e927af9 (stale) Mirror 21: 0x6e927af9 (stale) Mirror 22: 0x6e927af9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b57c): Mirror 3: 0x6e927af9 (stale) Mirror 8: 0x6e927af9 (stale) Mirror 10: 0x6e927af9 (stale) Mirror 14: 0x6e927af9 (stale) Mirror 16: 0x6e927af9 (stale) Mirror 17: 0x6e927af9 (stale) Mirror 19: 0x6e927af9 (stale) Mirror 20: 0x6e927af9 (stale) Mirror 21: 0x6e927af9 (stale) Mirror 22: 0x6e927af9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b57c: skipped 000519 1788600397.773720 fallocate 0x0344de thru 0x03ffff (0xbb22 bytes) 000520 1788600397.780174 punch from 0x011806 to 0x01b944 (0xa13f bytes) 000521 1788600397.790055 MIRROR_RESYNC 11 mirrors 000522 1788600401.834613 punch from 0x017452 to 0x02027e (0x8e2d bytes) 000524 1788600401.887434 mapwrite 0x023c08 thru 0x025258 (0x1651 bytes) 000525 1788600401.943536 trunc from 0x040000 to 0x01c67e (0x23981 bytes) 000526 1788600401.969425 read 0x01288e thru 0x01c67e (0x9df1 bytes) 000527 1788600401.979096 mapread 0x0030ac thru 0x007211 (0x4166 bytes) 000528 1788600401.992400 punch from 0x016d0c to 0x01c139 (0x542e bytes) 000529 1788600401.997698 read 0x00b24a thru 0x0127f7 (0x75ae bytes) 000530 1788600402.006745 trunc from 0x00b146 to 0x00d509 (0x23c4 bytes) 000532 1788600402.013391 mapread 0x003e02 thru 0x006ac9 (0x2cc8 bytes) 000533 1788600402.014597 punch from 0x008a4e to 0x0148fa (0xbead bytes) 000534 1788600402.021107 mapwrite 0x03f1a2 thru 0x03ffff (0xe5e bytes) 000537 1788600402.072788 punch from 0x00c2b6 to 0x012107 (0x5e52 bytes) 000538 1788600402.077927 read 0x003784 thru 0x0068d8 (0x3155 bytes) 000539 1788600402.079144 mapwrite 0x01022d thru 0x017c8e (0x7a62 bytes) 000540 1788600402.112874 punch from 0x00b194 to 0x00eaf6 (0x3963 bytes) 000544 1788600402.120924 trunc from 0x040000 to 0x02d210 (0x12def bytes) 000545 1788600402.150746 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d211): Mirror 3: 0x198aa82e (stale) Mirror 8: 0x198aa82e (stale) Mirror 10: 0x198aa82e (stale) Mirror 14: 0x198aa82e (stale) Mirror 16: 0x198aa82e (stale) Mirror 19: 0x198aa82e (stale) Mirror 20: 0x198aa82e (stale) Mirror 21: 0x198aa82e (stale) Mirror 22: 0x198aa82e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d211): Mirror 3: 0x198aa82e (stale) Mirror 8: 0x198aa82e (stale) Mirror 10: 0x198aa82e (stale) Mirror 14: 0x198aa82e (stale) Mirror 16: 0x198aa82e (stale) Mirror 19: 0x198aa82e (stale) Mirror 20: 0x198aa82e (stale) Mirror 21: 0x198aa82e (stale) Mirror 22: 0x198aa82e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d211: skipped 000546 1788600402.804103 mapwrite 0x017cae thru 0x0181ba (0x50d bytes) 000547 1788600402.854029 write 0x03d7e2 thru 0x03ffff (0x281e bytes) 000548 1788600402.866878 fallocate 0x01da6d thru 0x02d510 (0xfaa4 bytes) 000549 1788600402.879311 trunc from 0x040000 to 0x014e84 (0x2b17b bytes) 000550 1788600402.921028 trunc from 0x014e85 to 0x0353e6 (0x20562 bytes) 000551 1788600402.945911 mapwrite 0x008df7 thru 0x011011 (0x821b bytes) 000552 1788600403.008144 trunc from 0x0142f1 to 0x0193b7 (0x50c7 bytes) 000553 1788600403.017956 trunc from 0x0353e7 to 0x030346 (0x50a0 bytes) 000554 1788600403.044498 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x30347): Mirror 3: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30347): Mirror 3: 0x3095f447 (stale) Mirror 8: 0x3095f447 (stale) Mirror 10: 0x3095f447 (stale) Mirror 14: 0x3095f447 (stale) Mirror 16: 0x3095f447 (stale) Mirror 19: 0x3095f447 (stale) Mirror 20: 0x3095f447 (stale) Mirror 21: 0x3095f447 (stale) Mirror 22: 0x3095f447 (stale) CRC-32 checksum value for chunk [0, 0x30347): Mirror 1: 0x21ddd8df Mirror 23: 0x21ddd8df lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30347: skipped 000555 1788600404.283939 fallocate 0x0000c5 thru 0x00bbf3 (0xbb2f bytes) 000556 1788600404.327550 fallocate 0x012161 thru 0x01dd38 (0xbbd8 bytes) 000557 1788600404.332133 mapread 0x001a09 thru 0x007d54 (0x634c bytes) 000558 1788600404.351009 write 0x001cc1 thru 0x00ff23 (0xe263 bytes) 000559 1788600404.360325 trunc from 0x0020ef to 0x00f0e3 (0xcff5 bytes) 000560 1788600404.379846 trunc from 0x030347 to 0x02ed6b (0x15db bytes) 000561 1788600404.409877 mapread 0x003b14 thru 0x00bbfc (0x80e9 bytes) 000562 1788600404.443927 fallocate 0x028bd3 thru 0x03307d (0xa4ab bytes) 000563 1788600404.454297 trunc from 0x00a0b6 to 0x01699b (0xc8e6 bytes) 000564 1788600404.459237 mapread 0x00cadc thru 0x0154b3 (0x89d8 bytes) 000565 1788600404.494996 mapread 0x02cdc1 thru 0x02ed6b (0x1fab bytes) 000566 1788600404.504256 trunc from 0x02ed6c to 0x024986 (0xa3e5 bytes) 000567 1788600404.520880 punch from 0x015a1f to 0x021d19 (0xc2fb bytes) 000568 1788600404.525690 fallocate 0x039b2e thru 0x03ffff (0x64d2 bytes) 000569 1788600404.530137 punch from 0x02af43 to 0x02b666 (0x724 bytes) 000570 1788600404.536481 mapread 0x02d531 thru 0x03c53c (0xf00c bytes) 000571 1788600404.558059 mapread 0x010abb thru 0x01bdd9 (0xb31f bytes) 000572 1788600404.569143 trunc from 0x040000 to 0x02053b (0x1fac4 bytes) 000573 1788600404.584685 punch from 0x0125d5 to 0x02053b (0xdf67 bytes) 000574 1788600404.590751 trunc from 0x02053c to 0x012a5c (0xdadf bytes) 000575 1788600404.604146 fallocate 0x0384b1 thru 0x03fe0a (0x795a bytes) 000576 1788600404.609408 fallocate 0x01b533 thru 0x025406 (0x9ed4 bytes) 000577 1788600404.615599 punch from 0x0367e0 to 0x03fe0a (0x962b bytes) 000578 1788600404.620299 mapwrite 0x0113c7 thru 0x01598e (0x45c8 bytes) 000579 1788600404.645794 write 0x038ff6 thru 0x03d536 (0x4541 bytes) 000580 1788600404.660811 mapread 0x02f5c3 thru 0x033d24 (0x4762 bytes) 000581 1788600404.673495 mapread 0x012eb9 thru 0x020347 (0xd48f bytes) 000582 1788600404.685556 punch from 0x03512f to 0x03fe0a (0xacdc bytes) 000584 1788600404.701465 write 0x02ec7e thru 0x03b4e5 (0xc868 bytes) 000585 1788600404.712647 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fe0b): Mirror 3: 0xe23d56db (stale) Mirror 8: 0xe23d56db (stale) Mirror 10: 0xe23d56db (stale) Mirror 14: 0xe23d56db (stale) Mirror 16: 0xe23d56db (stale) Mirror 20: 0xe23d56db (stale) Mirror 21: 0xe23d56db (stale) Mirror 22: 0xe23d56db (stale) Mirror 23: 0x4573e623 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fe0b): Mirror 3: 0xe23d56db (stale) Mirror 8: 0xe23d56db (stale) Mirror 10: 0xe23d56db (stale) Mirror 14: 0xe23d56db (stale) Mirror 16: 0xe23d56db (stale) Mirror 20: 0xe23d56db (stale) Mirror 21: 0xe23d56db (stale) Mirror 22: 0xe23d56db (stale) Mirror 23: 0x4573e623 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fe0b: skipped 000586 1788600405.426147 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fe0b): Mirror 8: 0xe23d56db (stale) Mirror 10: 0xe23d56db (stale) Mirror 14: 0xe23d56db (stale) Mirror 16: 0xe23d56db (stale) Mirror 20: 0xe23d56db (stale) Mirror 21: 0xe23d56db (stale) Mirror 22: 0xe23d56db (stale) Mirror 23: 0x4573e623 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fe0b): Mirror 8: 0xe23d56db (stale) Mirror 10: 0xe23d56db (stale) Mirror 14: 0xe23d56db (stale) Mirror 16: 0xe23d56db (stale) Mirror 20: 0xe23d56db (stale) Mirror 21: 0xe23d56db (stale) Mirror 22: 0xe23d56db (stale) Mirror 23: 0x4573e623 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fe0b: skipped 000587 1788600406.031751 trunc from 0x0042bd to 0x00591d (0x1661 bytes) 000588 1788600406.045693 punch from 0x01d65f to 0x0290e4 (0xba86 bytes) 000589 1788600406.054979 fallocate 0x0038da thru 0x011f66 (0xe68d bytes) 000590 1788600406.060080 punch from 0x00dd4a to 0x00e04b (0x302 bytes) 000591 1788600406.068117 read 0x013919 thru 0x01c3bd (0x8aa5 bytes) 000592 1788600406.089099 MIRROR_RESYNC 9 mirrors 000593 1788600408.520006 trunc from 0x02492f to 0x0259ba (0x108c bytes) 000594 1788600408.549045 punch from 0x03610e to 0x03a2d8 (0x41cb bytes) 000595 1788600408.555829 mapwrite 0x0277d1 thru 0x0309d6 (0x9206 bytes) 000596 1788600408.590539 mapwrite 0x02d411 thru 0x037221 (0x9e11 bytes) 000597 1788600408.639147 fallocate 0x01ac8a thru 0x01e750 (0x3ac7 bytes) 000598 1788600408.647780 mapwrite 0x025972 thru 0x031143 (0xb7d2 bytes) 000599 1788600408.672223 fallocate 0x02af41 thru 0x038901 (0xd9c1 bytes) 000600 1788600408.678938 trunc from 0x009ade to 0x01707c (0xd59f bytes) 000601 1788600408.684042 trunc from 0x03fe0b to 0x006e48 (0x38fc2 bytes) 000602 1788600408.706690 trunc from 0x006e49 to 0x021c80 (0x1ae38 bytes) 000603 1788600408.733865 trunc from 0x021c81 to 0x02d310 (0xb690 bytes) 000604 1788600408.750114 write 0x0107dc thru 0x01237a (0x1b9f bytes) 000605 1788600408.764856 fallocate 0x02b586 thru 0x03a662 (0xf0dd bytes) 000608 1788600408.772469 trunc from 0x02d243 to 0x0360b1 (0x8e6f bytes) 000609 1788600408.777063 trunc from 0x03a663 to 0x032b2b (0x7b37 bytes) 000610 1788600408.790104 write 0x020543 thru 0x02ba3c (0xb4fa bytes) 000611 1788600408.807598 trunc from 0x003b48 to 0x008531 (0x49ea bytes) 000612 1788600408.814455 fallocate 0x00c7ef thru 0x010dfd (0x460f bytes) 000613 1788600408.818681 read 0x00f342 thru 0x01a6af (0xb36e bytes) 000614 1788600408.819176 trunc from 0x020b1a to 0x02bd7f (0xb266 bytes) 000615 1788600408.836785 read 0x02fe6b thru 0x032242 (0x23d8 bytes) 000616 1788600408.856987 fallocate 0x03642a thru 0x0368e2 (0x4b9 bytes) 000617 1788600408.861255 trunc from 0x0368e3 to 0x013b39 (0x22da9 bytes) 000618 1788600408.876512 trunc from 0x010156 to 0x013b39 (0x39e4 bytes) 000620 1788600408.882977 trunc from 0x013b3a to 0x00796e (0xc1cb bytes) 000621 1788600408.908832 MIRROR_RESYNC 9 mirrors 000622 1788600410.558802 trunc from 0x000e48 to 0x00796e (0x6b27 bytes) 000623 1788600410.610756 punch from 0x000ce4 to 0x00796e (0x6c8b bytes) 000624 1788600410.619500 mapwrite 0x02ecb5 thru 0x039c2f (0xaf7b bytes) 000625 1788600410.740408 write 0x029f58 thru 0x038df6 (0xee9f bytes) 000626 1788600410.742068 punch from 0x037810 to 0x039c2f (0x2420 bytes) 000628 1788600410.767655 MIRROR_RESYNC 9 mirrors 000629 1788600412.639533 read 0x0198bc thru 0x021a7d (0x81c2 bytes) 000631 1788600412.649834 trunc from 0x039c30 to 0x029d00 (0xff2f bytes) 000632 1788600412.696192 mapread 0x0198b9 thru 0x02675c (0xcea4 bytes) 000633 1788600412.725612 trunc from 0x029d01 to 0x02fd1f (0x601f bytes) 000634 1788600412.753669 MIRROR_RESYNC 9 mirrors 000635 1788600414.809484 mapread 0x02c595 thru 0x02e620 (0x208c bytes) 000636 1788600414.846024 read 0x01411f thru 0x017b04 (0x39e6 bytes) 000637 1788600414.860432 write 0x016c1a thru 0x01f1c2 (0x85a9 bytes) 000638 1788600414.943598 punch from 0x0015df to 0x007c44 (0x6666 bytes) 000639 1788600414.953944 write 0x02714a thru 0x031534 (0xa3eb bytes) 000640 1788600414.978893 punch from 0x026e76 to 0x031534 (0xa6bf bytes) 000641 1788600415.008404 punch from 0x01d71f to 0x02751b (0x9dfd bytes) 000642 1788600415.014487 write 0x009be3 thru 0x018749 (0xeb67 bytes) 000643 1788600415.041069 punch from 0x01c8db to 0x027703 (0xae29 bytes) 000644 1788600415.048655 mapread 0x005350 thru 0x011a82 (0xc733 bytes) 000646 1788600415.056828 read 0x00982f thru 0x010328 (0x6afa bytes) 000647 1788600415.058734 trunc from 0x006f77 to 0x007a2e (0xab8 bytes) 000648 1788600415.073616 MIRROR_RESYNC 9 mirrors 000649 1788600417.054574 punch from 0x02f0ac to 0x031534 (0x2489 bytes) 000650 1788600417.096849 mapread 0x02554d thru 0x028e91 (0x3945 bytes) 000651 1788600417.121557 fallocate 0x03c3ad thru 0x03db41 (0x1795 bytes) 000652 1788600417.137273 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3db42): Mirror 8: 0xeea48eed (stale) Mirror 10: 0xeea48eed (stale) Mirror 14: 0xeea48eed (stale) Mirror 16: 0xeea48eed (stale) Mirror 21: 0xeea48eed (stale) Mirror 22: 0xeea48eed (stale) Mirror 23: 0xeea48eed (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3db42): Mirror 8: 0xeea48eed (stale) Mirror 10: 0xeea48eed (stale) Mirror 14: 0xeea48eed (stale) Mirror 16: 0xeea48eed (stale) Mirror 21: 0xeea48eed (stale) Mirror 22: 0xeea48eed (stale) Mirror 23: 0xeea48eed (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3db42: skipped 000653 1788600417.785922 write 0x03394b thru 0x0394da (0x5b90 bytes) 000654 1788600417.811970 punch from 0x01163e to 0x01d652 (0xc015 bytes) 000655 1788600417.823984 write 0x03955d thru 0x03ffff (0x6aa3 bytes) 000656 1788600417.826494 mapread 0x022604 thru 0x028992 (0x638f bytes) 000657 1788600417.843869 trunc from 0x040000 to 0x01ce26 (0x231d9 bytes) 000658 1788600417.881732 read 0x00b716 thru 0x0104e3 (0x4dce bytes) 000659 1788600417.892869 trunc from 0x01ce27 to 0x01a709 (0x271d bytes) 000660 1788600417.921667 mapwrite 0x02cae6 thru 0x02cf4e (0x469 bytes) 000661 1788600418.021136 read 0x01b743 thru 0x02aea3 (0xf761 bytes) 000662 1788600418.045715 mapwrite 0x029a24 thru 0x029e6f (0x44c bytes) 000663 1788600418.071332 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2cf4f): Mirror 10: 0x976e0415 (stale) Mirror 14: 0x976e0415 (stale) Mirror 16: 0x976e0415 (stale) Mirror 21: 0x976e0415 (stale) Mirror 22: 0x976e0415 (stale) Mirror 23: 0x976e0415 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cf4f): Mirror 10: 0x976e0415 (stale) Mirror 14: 0x976e0415 (stale) Mirror 16: 0x976e0415 (stale) Mirror 21: 0x976e0415 (stale) Mirror 22: 0x976e0415 (stale) Mirror 23: 0x976e0415 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cf4f: skipped 000664 1788600418.659737 fallocate 0x018548 thru 0x01a7a3 (0x225c bytes) 000665 1788600418.666524 write 0x00bf08 thru 0x011238 (0x5331 bytes) 000666 1788600418.682025 write 0x02ecb8 thru 0x03d4fc (0xe845 bytes) 000667 1788600418.695594 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d4fd): Mirror 10: 0xa211e61b (stale) Mirror 16: 0xa211e61b (stale) Mirror 21: 0xa211e61b (stale) Mirror 22: 0xa211e61b (stale) Mirror 23: 0xa211e61b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d4fd): Mirror 10: 0xa211e61b (stale) Mirror 16: 0xa211e61b (stale) Mirror 21: 0xa211e61b (stale) Mirror 22: 0xa211e61b (stale) Mirror 23: 0xa211e61b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d4fd: skipped 000668 1788600419.361448 read 0x020a43 thru 0x023951 (0x2f0f bytes) 000669 1788600419.385013 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d4fd): Mirror 10: 0xa211e61b (stale) Mirror 16: 0xa211e61b (stale) Mirror 22: 0xa211e61b (stale) Mirror 23: 0xa211e61b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d4fd): Mirror 10: 0xa211e61b (stale) Mirror 16: 0xa211e61b (stale) Mirror 22: 0xa211e61b (stale) Mirror 23: 0xa211e61b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d4fd: skipped 000670 1788600419.903863 punch from 0x02afa6 to 0x038a82 (0xdadd bytes) 000671 1788600419.909326 fallocate 0x020a55 thru 0x02dc0b (0xd1b7 bytes) 000672 1788600419.919116 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3d4fd): Mirror 10: (stale - read error) Mirror 16: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d4fd): Mirror 10: 0xa211e61b (stale) Mirror 16: 0xa211e61b (stale) Mirror 22: 0xa211e61b (stale) Mirror 23: 0xa211e61b (stale) CRC-32 checksum value for chunk [0, 0x3d4fd): Mirror 1: 0x73ed4b7 Mirror 24: 0x73ed4b7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d4fd: skipped 000673 1788600421.126758 write 0x024757 thru 0x028e09 (0x46b3 bytes) 000674 1788600421.205430 write 0x0379e7 thru 0x03f4f1 (0x7b0b bytes) 000675 1788600421.216688 fallocate 0x03b8ba thru 0x03ffff (0x4746 bytes) 000676 1788600421.224024 write 0x02186f thru 0x02c64a (0xaddc bytes) 000677 1788600421.242704 mapwrite 0x02e087 thru 0x038536 (0xa4b0 bytes) 000678 1788600421.286441 mapread 0x0172b1 thru 0x021743 (0xa493 bytes) 000679 1788600421.297411 mapread 0x02a852 thru 0x03a807 (0xffb6 bytes) 000680 1788600421.299788 trunc from 0x000dfb to 0x00ca0e (0xbc14 bytes) 000681 1788600421.314831 fallocate 0x018c8e thru 0x024e4e (0xc1c1 bytes) 000682 1788600421.321793 read 0x00cb7c thru 0x019739 (0xcbbe bytes) 000683 1788600421.352103 punch from 0x019d80 to 0x01ef94 (0x5215 bytes) 000684 1788600421.363703 mapread 0x025c98 thru 0x02a050 (0x43b9 bytes) 000685 1788600421.365252 fallocate 0x0272e4 thru 0x02cedd (0x5bfa bytes) 000686 1788600421.387087 MIRROR_RESYNC 6 mirrors 000687 1788600423.231494 trunc from 0x03f4f2 to 0x00ce49 (0x326a8 bytes) 000688 1788600423.307062 fallocate 0x03bf5b thru 0x03fc09 (0x3caf bytes) 000689 1788600423.317468 trunc from 0x00bd54 to 0x00ce49 (0x10f6 bytes) 000690 1788600423.341113 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0xce4a): Mirror 10: (stale - read error) Mirror 16: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xce4a): Mirror 10: 0x90ddf3a7 (stale) Mirror 16: 0x90ddf3a7 (stale) Mirror 22: 0x90ddf3a7 (stale) Mirror 23: 0x90ddf3a7 (stale) Mirror 24: 0x90ddf3a7 (stale) CRC-32 checksum value for chunk [0, 0xce4a): Mirror 1: 0x70858c8a Mirror 25: 0x70858c8a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xce4a: skipped 000691 1788600424.282837 mapread 0x0051bf thru 0x00c045 (0x6e87 bytes) 000692 1788600424.314703 mapread 0x00aeec thru 0x00ce49 (0x1f5e bytes) 000693 1788600424.351024 fallocate 0x034606 thru 0x03fe8e (0xb889 bytes) 000695 1788600424.408401 read 0x0094ff thru 0x00ce49 (0x394b bytes) 000696 1788600424.415541 fallocate 0x03e85c thru 0x03ffff (0x17a4 bytes) 000697 1788600424.422971 mapwrite 0x023510 thru 0x0304a4 (0xcf95 bytes) 000698 1788600424.486404 write 0x02d3f9 thru 0x039efa (0xcb02 bytes) 000699 1788600424.489565 read 0x006603 thru 0x013124 (0xcb22 bytes) 000700 1788600424.507854 trunc from 0x039efb to 0x035252 (0x4ca8 bytes) 000701 1788600424.529857 fallocate 0x0312eb thru 0x038ca3 (0x79b9 bytes) 000702 1788600424.536943 trunc from 0x035253 to 0x00c79a (0x28ab8 bytes) 000703 1788600424.558046 trunc from 0x00c79b to 0x01cd94 (0x105fa bytes) 000704 1788600424.577592 punch from 0x0101db to 0x0163b8 (0x61de bytes) 000705 1788600424.587122 MIRROR_RESYNC 7 mirrors 000706 1788600426.454171 MIRROR_EXTEND to 8 mirrors 000707 1788600427.288406 mapwrite 0x010cd5 thru 0x012481 (0x17ad bytes) 000708 1788600427.399647 fallocate 0x00b71b thru 0x00d342 (0x1c28 bytes) 000709 1788600427.405935 mapwrite 0x02b805 thru 0x02d751 (0x1f4d bytes) 000710 1788600427.468727 punch from 0x0157ac to 0x01634a (0xb9f bytes) 000711 1788600427.479045 trunc from 0x02d752 to 0x023869 (0x9ee8 bytes) 000713 1788600427.506325 fallocate 0x0162a6 thru 0x01a50d (0x4268 bytes) 000714 1788600427.513660 mapread 0x0140eb thru 0x01c134 (0x804a bytes) 000716 1788600427.525615 trunc from 0x00e27f to 0x0100a7 (0x1e29 bytes) 000717 1788600427.538090 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2386a): Mirror 10: (stale - read error) Mirror 16: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2386a): Mirror 10: 0x548efde0 (stale) Mirror 16: 0x548efde0 (stale) Mirror 22: 0x548efde0 (stale) Mirror 23: 0x548efde0 (stale) Mirror 24: 0x548efde0 (stale) Mirror 25: 0x548efde0 (stale) Mirror 26: 0x548efde0 (stale) CRC-32 checksum value for chunk [0, 0x2386a): Mirror 1: 0x367e422d Mirror 27: 0x367e422d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2386a: skipped 000718 1788600429.217517 trunc from 0x02386a to 0x03527c (0x11a13 bytes) 000719 1788600429.298573 fallocate 0x025438 thru 0x0314f5 (0xc0be bytes) 000720 1788600429.314454 mapwrite 0x01f443 thru 0x024c3f (0x57fd bytes) 000721 1788600429.364173 read 0x00a93f thru 0x01a3f5 (0xfab7 bytes) 000722 1788600429.375942 write 0x002a1c thru 0x00e5f6 (0xbbdb bytes) 000723 1788600429.434705 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3527d): Mirror 10: 0x60c3d6c5 (stale) Mirror 16: 0x60c3d6c5 (stale) Mirror 22: 0x60c3d6c5 (stale) Mirror 23: 0x60c3d6c5 (stale) Mirror 24: 0x60c3d6c5 (stale) Mirror 25: 0x60c3d6c5 (stale) Mirror 27: 0xb6bb558e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3527d): Mirror 10: 0x60c3d6c5 (stale) Mirror 16: 0x60c3d6c5 (stale) Mirror 22: 0x60c3d6c5 (stale) Mirror 23: 0x60c3d6c5 (stale) Mirror 24: 0x60c3d6c5 (stale) Mirror 25: 0x60c3d6c5 (stale) Mirror 27: 0xb6bb558e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3527d: skipped 000724 1788600430.218785 mapwrite 0x016537 thru 0x02456d (0xe037 bytes) 000725 1788600430.304859 trunc from 0x01652d to 0x01a601 (0x40d5 bytes) 000726 1788600430.314697 read 0x001474 thru 0x003c36 (0x27c3 bytes) 000727 1788600430.331104 punch from 0x020c5f to 0x028d28 (0x80ca bytes) 000728 1788600430.352792 write 0x015aec thru 0x0183bd (0x28d2 bytes) 000729 1788600430.371690 punch from 0x034e4a to 0x03527c (0x433 bytes) 000730 1788600430.380917 trunc from 0x025294 to 0x025949 (0x6b6 bytes) 000731 1788600430.390239 mapwrite 0x007431 thru 0x00d14e (0x5d1e bytes) 000732 1788600430.451713 mapwrite 0x002bb8 thru 0x00d4eb (0xa934 bytes) 000733 1788600430.473266 mapread 0x034770 thru 0x03527c (0xb0d bytes) 000735 1788600430.494582 punch from 0x0273d9 to 0x02bbee (0x4816 bytes) 000736 1788600430.503508 mapwrite 0x00efed thru 0x018695 (0x96a9 bytes) 000737 1788600430.540291 mapread 0x00418e thru 0x00df1d (0x9d90 bytes) 000738 1788600430.552535 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3527d): Mirror 10: (stale - read error) Mirror 16: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3527d): Mirror 10: 0x60c3d6c5 (stale) Mirror 16: 0x60c3d6c5 (stale) Mirror 22: 0x60c3d6c5 (stale) Mirror 23: 0x60c3d6c5 (stale) Mirror 24: 0x60c3d6c5 (stale) Mirror 25: 0x60c3d6c5 (stale) Mirror 27: 0xb6bb558e (stale) CRC-32 checksum value for chunk [0, 0x3527d): Mirror 1: 0x4db4e894 Mirror 28: 0x4db4e894 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3527d: skipped 000739 1788600431.963314 read 0x032fc1 thru 0x03527c (0x22bc bytes) 000740 1788600431.978292 punch from 0x0282f9 to 0x03527c (0xcf84 bytes) 000741 1788600432.033816 mapwrite 0x005363 thru 0x00b659 (0x62f7 bytes) 000742 1788600432.084651 MIRROR_RESYNC 9 mirrors 000743 1788600434.505766 mapwrite 0x033c10 thru 0x03ebfd (0xafee bytes) 000744 1788600434.625230 trunc from 0x004c6c to 0x00a574 (0x5909 bytes) 000745 1788600434.635064 mapread 0x00633b thru 0x0095dd (0x32a3 bytes) 000747 1788600434.648651 read 0x028767 thru 0x0357ec (0xd086 bytes) 000748 1788600434.662815 mapread 0x038c6f thru 0x03d871 (0x4c03 bytes) 000749 1788600434.666322 trunc from 0x03ebfe to 0x00b838 (0x333c5 bytes) 000750 1788600434.686056 write 0x03a1b9 thru 0x03ffff (0x5e47 bytes) 000751 1788600434.687649 write 0x00fd48 thru 0x01dc9a (0xdf53 bytes) 000752 1788600434.700410 read 0x0054f9 thru 0x015233 (0xfd3b bytes) 000753 1788600434.701354 fallocate 0x01b33f thru 0x01c1e5 (0xea7 bytes) 000754 1788600434.706803 read 0x03863d thru 0x03b84e (0x3212 bytes) 000755 1788600434.719271 punch from 0x014e72 to 0x0238e7 (0xea76 bytes) 000756 1788600434.743521 MIRROR_RESYNC 9 mirrors 000757 1788600437.566625 read 0x016ea8 thru 0x01f7d9 (0x8932 bytes) 000758 1788600437.599454 MIRROR_EXTEND to 10 mirrors 000759 1788600438.475354 MIRROR_SPLIT mirror 5 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) 000760 1788600438.905985 fallocate 0x028f44 thru 0x033033 (0xa0f0 bytes) 000761 1788600438.979673 mapwrite 0x017c4f thru 0x0227a9 (0xab5b bytes) 000762 1788600439.032167 trunc from 0x0041bb to 0x00bfaf (0x7df5 bytes) 000763 1788600439.037298 read 0x02e6b8 thru 0x03276d (0x40b6 bytes) 000764 1788600439.046249 fallocate 0x016557 thru 0x023a45 (0xd4ef bytes) 000765 1788600439.055867 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xbb343043 (stale) Mirror 16: 0xbb343043 (stale) Mirror 23: 0xbb343043 (stale) Mirror 25: 0xbb343043 (stale) Mirror 27: 0xbb343043 (stale) Mirror 28: 0xbb343043 (stale) Mirror 29: 0xbb343043 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xbb343043 (stale) Mirror 16: 0xbb343043 (stale) Mirror 23: 0xbb343043 (stale) Mirror 25: 0xbb343043 (stale) Mirror 27: 0xbb343043 (stale) Mirror 28: 0xbb343043 (stale) Mirror 29: 0xbb343043 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000767 1788600439.556510 mapwrite 0x01d2a8 thru 0x025059 (0x7db2 bytes) 000768 1788600439.603563 fallocate 0x0126c1 thru 0x022353 (0xfc93 bytes) 000769 1788600439.608537 fallocate 0x018af7 thru 0x025bbd (0xd0c7 bytes) 000770 1788600439.618517 write 0x03bd3a thru 0x03d42b (0x16f2 bytes) 000771 1788600439.645045 fallocate 0x03db76 thru 0x03ffff (0x248a bytes) 000772 1788600439.652451 punch from 0x039fe8 to 0x03ffff (0x6018 bytes) 000773 1788600439.666469 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 16: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xbb343043 (stale) Mirror 16: 0xbb343043 (stale) Mirror 23: 0xbb343043 (stale) Mirror 25: 0xbb343043 (stale) Mirror 27: 0xbb343043 (stale) Mirror 28: 0xbb343043 (stale) Mirror 29: 0xbb343043 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf74f54fc Mirror 30: 0xf74f54fc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000774 1788600440.815058 fallocate 0x01cc63 thru 0x020cb2 (0x4050 bytes) 000775 1788600440.879981 MIRROR_RESYNC 9 mirrors 000777 1788600444.343851 write 0x03865c thru 0x03ffff (0x79a4 bytes) 000778 1788600444.382323 trunc from 0x040000 to 0x0230b9 (0x1cf46 bytes) 000779 1788600444.403035 punch from 0x002987 to 0x00d794 (0xae0e bytes) 000780 1788600444.409715 fallocate 0x01671c thru 0x024347 (0xdc2c bytes) 000781 1788600444.414745 trunc from 0x0230ba to 0x02f21e (0xc165 bytes) 000782 1788600444.435157 fallocate 0x01a8de thru 0x025ed2 (0xb5f5 bytes) 000783 1788600444.441593 write 0x032bc2 thru 0x03c966 (0x9da5 bytes) 000785 1788600444.445956 trunc from 0x03c967 to 0x01b6f5 (0x21271 bytes) 000786 1788600444.466932 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b6f6): Mirror 10: 0x625df025 (stale) Mirror 16: 0x625df025 (stale) Mirror 23: 0x625df025 (stale) Mirror 27: 0x625df025 (stale) Mirror 28: 0x625df025 (stale) Mirror 29: 0x625df025 (stale) Mirror 30: 0x625df025 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b6f6): Mirror 10: 0x625df025 (stale) Mirror 16: 0x625df025 (stale) Mirror 23: 0x625df025 (stale) Mirror 27: 0x625df025 (stale) Mirror 28: 0x625df025 (stale) Mirror 29: 0x625df025 (stale) Mirror 30: 0x625df025 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b6f6: skipped 000787 1788600444.978054 fallocate 0x0233b0 thru 0x03177d (0xe3ce bytes) 000788 1788600444.988960 punch from 0x014880 to 0x01a7bb (0x5f3c bytes) 000789 1788600444.994818 write 0x0112ce thru 0x01ac3f (0x9972 bytes) 000791 1788600445.012570 punch from 0x018b45 to 0x01b6f5 (0x2bb1 bytes) 000792 1788600445.025192 write 0x0380ee thru 0x03a9e5 (0x28f8 bytes) 000793 1788600445.027020 trunc from 0x01625f to 0x01802d (0x1dcf bytes) 000794 1788600445.032903 mapwrite 0x038d8f thru 0x039d18 (0xf8a bytes) 000795 1788600445.046463 trunc from 0x03a9e6 to 0x0042fb (0x366ea bytes) 000796 1788600445.070459 punch from 0x00374f to 0x0042fb (0xbad bytes) 000797 1788600445.080676 mapread 0x00274b thru 0x0042fb (0x1bb1 bytes) 000798 1788600445.089006 trunc from 0x001e89 to 0x0042fb (0x2473 bytes) 000799 1788600445.100973 mapwrite 0x024d6f thru 0x03245a (0xd6ec bytes) 000800 1788600445.165049 trunc from 0x025ea1 to 0x026032 (0x192 bytes) 000801 1788600445.172110 punch from 0x0211be to 0x0282fa (0x713d bytes) 000802 1788600445.181045 mapwrite 0x01cac9 thru 0x02a0e9 (0xd621 bytes) 000804 1788600445.226512 trunc from 0x0097fc to 0x009dca (0x5cf bytes) 000805 1788600445.232792 mapwrite 0x037cb1 thru 0x03a39b (0x26eb bytes) 000806 1788600445.261650 trunc from 0x02bd1d to 0x034957 (0x8c3b bytes) 000807 1788600445.266042 mapread 0x030d6a thru 0x036a31 (0x5cc8 bytes) 000808 1788600445.273012 mapwrite 0x003c55 thru 0x00eb7c (0xaf28 bytes) 000809 1788600445.293137 read 0x00fa62 thru 0x017db5 (0x8354 bytes) 000810 1788600445.304878 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a39c): Mirror 10: 0x14e4c057 (stale) Mirror 16: 0x14e4c057 (stale) Mirror 23: 0x14e4c057 (stale) Mirror 28: 0x14e4c057 (stale) Mirror 29: 0x14e4c057 (stale) Mirror 30: 0x14e4c057 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a39c): Mirror 10: 0x14e4c057 (stale) Mirror 16: 0x14e4c057 (stale) Mirror 23: 0x14e4c057 (stale) Mirror 28: 0x14e4c057 (stale) Mirror 29: 0x14e4c057 (stale) Mirror 30: 0x14e4c057 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a39c: skipped 000811 1788600445.713659 fallocate 0x02713a thru 0x03528f (0xe156 bytes) 000813 1788600445.722494 fallocate 0x0235fe thru 0x02c4bc (0x8ebf bytes) 000814 1788600445.727942 write 0x036b25 thru 0x03ffff (0x94db bytes) 000815 1788600445.738716 punch from 0x03088a to 0x0356d0 (0x4e47 bytes) 000816 1788600445.746148 read 0x008051 thru 0x017d37 (0xfce7 bytes) 000817 1788600445.756153 write 0x0245ae thru 0x02e182 (0x9bd5 bytes) 000819 1788600445.767794 mapread 0x000875 thru 0x003b83 (0x330f bytes) 000820 1788600445.777168 fallocate 0x026e2d thru 0x033688 (0xc85c bytes) 000821 1788600445.785660 MIRROR_RESYNC 7 mirrors 000822 1788600448.024388 MIRROR_EXTEND to 8 mirrors 000823 1788600449.345082 read 0x033ec0 thru 0x03ee4a (0xaf8b bytes) 000824 1788600449.372390 mapwrite 0x02006e thru 0x02cc3c (0xcbcf bytes) 000825 1788600449.542730 mapread 0x01c498 thru 0x02ba9e (0xf607 bytes) 000826 1788600449.549085 read 0x0154fa thru 0x018c1b (0x3722 bytes) 000827 1788600449.569308 write 0x01a9e3 thru 0x01c373 (0x1991 bytes) 000829 1788600449.580487 mapwrite 0x02af94 thru 0x032a09 (0x7a76 bytes) 000830 1788600449.609670 trunc from 0x040000 to 0x002f3c (0x3d0c3 bytes) 000831 1788600449.643102 trunc from 0x002f3d to 0x025529 (0x225ed bytes) 000832 1788600449.666550 punch from 0x0143ce to 0x015cc6 (0x18f9 bytes) 000833 1788600449.672540 mapread 0x012f1b thru 0x01465c (0x1742 bytes) 000834 1788600449.698024 mapread 0x01e3ed thru 0x023dfb (0x5a0f bytes) 000835 1788600449.750995 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2552a): Mirror 10: (stale - read error) Mirror 16: (stale - read error) Mirror 23: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2552a): Mirror 10: 0xde07bc28 (stale) Mirror 16: 0xde07bc28 (stale) Mirror 23: 0xde07bc28 (stale) Mirror 28: 0xde07bc28 (stale) Mirror 29: 0xde07bc28 (stale) Mirror 30: 0xde07bc28 (stale) Mirror 31: 0xde07bc28 (stale) CRC-32 checksum value for chunk [0, 0x2552a): Mirror 1: 0xaba9b6ed Mirror 32: 0xaba9b6ed lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2552a: skipped 000836 1788600451.002170 mapwrite 0x0066bd thru 0x00ab41 (0x4485 bytes) 000837 1788600451.151678 MIRROR_RESYNC 9 mirrors 000838 1788600453.361314 trunc from 0x002009 to 0x006f92 (0x4f8a bytes) 000839 1788600453.402820 punch from 0x00e0c8 to 0x01326c (0x51a5 bytes) 000840 1788600453.430274 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2552a): Mirror 10: (stale - read error) Mirror 16: (stale - read error) Mirror 23: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2552a): Mirror 10: 0x5fbc1fd3 (stale) Mirror 16: 0x5fbc1fd3 (stale) Mirror 23: 0x5fbc1fd3 (stale) Mirror 28: 0x5fbc1fd3 (stale) Mirror 29: 0x5fbc1fd3 (stale) Mirror 30: 0x5fbc1fd3 (stale) Mirror 31: 0x5fbc1fd3 (stale) Mirror 32: 0x5fbc1fd3 (stale) CRC-32 checksum value for chunk [0, 0x2552a): Mirror 1: 0xb2560acb Mirror 33: 0xb2560acb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2552a: skipped 000841 1788600455.278081 read 0x00514c thru 0x005de1 (0xc96 bytes) 000842 1788600455.311842 read 0x013644 thru 0x01ebf6 (0xb5b3 bytes) 000843 1788600455.377369 write 0x007a8c thru 0x0175e2 (0xfb57 bytes) 000844 1788600455.479000 read 0x023b0e thru 0x025529 (0x1a1c bytes) 000845 1788600455.498106 fallocate 0x00665d thru 0x0109cf (0xa373 bytes) 000848 1788600455.507420 read 0x021e64 thru 0x025529 (0x36c6 bytes) 000850 1788600455.510362 read 0x0143cb thru 0x016889 (0x24bf bytes) 000851 1788600455.511157 write 0x005711 thru 0x012394 (0xcc84 bytes) 000852 1788600455.513729 trunc from 0x02552a to 0x018fde (0xc54b bytes) 000853 1788600455.537650 read 0x00c32c thru 0x00d957 (0x162c bytes) 000854 1788600455.539874 mapread 0x00985e thru 0x018330 (0xead3 bytes) 000855 1788600455.542396 punch from 0x001c88 to 0x002c1d (0xf96 bytes) 000856 1788600455.564348 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x18fdf): Mirror 10: (stale - read error) Mirror 16: (stale - read error) Mirror 23: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18fdf): Mirror 10: 0xe4a76bbd (stale) Mirror 16: 0xe4a76bbd (stale) Mirror 23: 0xe4a76bbd (stale) Mirror 28: 0xe4a76bbd (stale) Mirror 29: 0xe4a76bbd (stale) Mirror 30: 0xe4a76bbd (stale) Mirror 31: 0xe4a76bbd (stale) Mirror 32: 0xe4a76bbd (stale) Mirror 33: 0xc5020bb1 (stale) CRC-32 checksum value for chunk [0, 0x18fdf): Mirror 1: 0x4e5b14be Mirror 34: 0x4e5b14be lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18fdf: skipped 000857 1788600456.790495 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18fdf): Mirror 10: 0xe4a76bbd (stale) Mirror 16: 0xe4a76bbd (stale) Mirror 23: 0xe4a76bbd (stale) Mirror 28: 0xe4a76bbd (stale) Mirror 29: 0xe4a76bbd (stale) Mirror 30: 0xe4a76bbd (stale) Mirror 32: 0xe4a76bbd (stale) Mirror 33: 0xc5020bb1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18fdf): Mirror 10: 0xe4a76bbd (stale) Mirror 16: 0xe4a76bbd (stale) Mirror 23: 0xe4a76bbd (stale) Mirror 28: 0xe4a76bbd (stale) Mirror 29: 0xe4a76bbd (stale) Mirror 30: 0xe4a76bbd (stale) Mirror 32: 0xe4a76bbd (stale) Mirror 33: 0xc5020bb1 (stale) CRC-32 checksum value for chunk [0, 0x18fdf): Mirror 1: 0x4e5b14be Mirror 34: 0x4e5b14be lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18fdf: skipped 000858 1788600458.102803 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18fdf): Mirror 10: 0xe4a76bbd (stale) Mirror 16: 0xe4a76bbd (stale) Mirror 23: 0xe4a76bbd (stale) Mirror 28: 0xe4a76bbd (stale) Mirror 29: 0xe4a76bbd (stale) Mirror 30: 0xe4a76bbd (stale) Mirror 32: 0xe4a76bbd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18fdf): Mirror 10: 0xe4a76bbd (stale) Mirror 16: 0xe4a76bbd (stale) Mirror 23: 0xe4a76bbd (stale) Mirror 28: 0xe4a76bbd (stale) Mirror 29: 0xe4a76bbd (stale) Mirror 30: 0xe4a76bbd (stale) Mirror 32: 0xe4a76bbd (stale) CRC-32 checksum value for chunk [0, 0x18fdf): Mirror 1: 0x4e5b14be Mirror 34: 0x4e5b14be lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18fdf: skipped 000859 1788600459.337970 read 0x001efb thru 0x006682 (0x4788 bytes) 000860 1788600459.380374 trunc from 0x013104 to 0x018fde (0x5edb bytes) 000861 1788600459.513459 mapread 0x0008e9 thru 0x002b38 (0x2250 bytes) 000862 1788600459.551826 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x18fdf): Mirror 10: (stale - read error) Mirror 16: (stale - read error) Mirror 23: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 32: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18fdf): Mirror 10: 0xe4a76bbd (stale) Mirror 16: 0xe4a76bbd (stale) Mirror 23: 0xe4a76bbd (stale) Mirror 28: 0xe4a76bbd (stale) Mirror 29: 0xe4a76bbd (stale) Mirror 30: 0xe4a76bbd (stale) Mirror 32: 0xe4a76bbd (stale) Mirror 34: 0x4e5b14be (stale) CRC-32 checksum value for chunk [0, 0x18fdf): Mirror 1: 0x953896b2 Mirror 35: 0x953896b2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18fdf: skipped 000863 1788600461.385711 trunc from 0x018fdf to 0x021a89 (0x8aab bytes) 000864 1788600461.467620 read 0x019d7b thru 0x01f8e9 (0x5b6f bytes) 000865 1788600461.478805 fallocate 0x00bb18 thru 0x016cd2 (0xb1bb bytes) 000867 1788600461.487610 read 0x01c7b6 thru 0x021a89 (0x52d4 bytes) 000868 1788600461.502570 fallocate 0x031e34 thru 0x0389c0 (0x6b8d bytes) 000869 1788600461.510015 write 0x011025 thru 0x0206f2 (0xf6ce bytes) 000870 1788600461.514139 write 0x022235 thru 0x031e72 (0xfc3e bytes) 000871 1788600461.518802 read 0x00ab8e thru 0x00b894 (0xd07 bytes) 000872 1788600461.520971 read 0x01cd8b thru 0x0217ee (0x4a64 bytes) 000873 1788600461.522084 punch from 0x017a8a to 0x020f85 (0x94fc bytes) 000874 1788600461.545457 punch from 0x01fedc to 0x024c25 (0x4d4a bytes) 000875 1788600461.551868 mapwrite 0x01a864 thru 0x029fb5 (0xf752 bytes) 000876 1788600461.617052 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31e73): Mirror 10: 0xeea364b8 (stale) Mirror 16: 0xeea364b8 (stale) Mirror 23: 0xeea364b8 (stale) Mirror 28: 0xeea364b8 (stale) Mirror 29: 0xeea364b8 (stale) Mirror 30: 0xeea364b8 (stale) Mirror 34: 0xf122554c (stale) Mirror 35: 0x91458d92 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31e73): Mirror 10: 0xeea364b8 (stale) Mirror 16: 0xeea364b8 (stale) Mirror 23: 0xeea364b8 (stale) Mirror 28: 0xeea364b8 (stale) Mirror 29: 0xeea364b8 (stale) Mirror 30: 0xeea364b8 (stale) Mirror 34: 0xf122554c (stale) Mirror 35: 0x91458d92 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31e73: skipped 000877 1788600462.603363 write 0x025eb6 thru 0x02c71f (0x686a bytes) 000879 1788600462.628402 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31e73): Mirror 10: 0xeea364b8 (stale) Mirror 16: 0xeea364b8 (stale) Mirror 23: 0xeea364b8 (stale) Mirror 28: 0xeea364b8 (stale) Mirror 29: 0xeea364b8 (stale) Mirror 30: 0xeea364b8 (stale) Mirror 35: 0x91458d92 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31e73): Mirror 10: 0xeea364b8 (stale) Mirror 16: 0xeea364b8 (stale) Mirror 23: 0xeea364b8 (stale) Mirror 28: 0xeea364b8 (stale) Mirror 29: 0xeea364b8 (stale) Mirror 30: 0xeea364b8 (stale) Mirror 35: 0x91458d92 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31e73: skipped skipping zero size read 000881 1788600463.214247 read 0x000692 thru 0x005d84 (0x56f3 bytes) 000885 1788600463.227127 mapwrite 0x013cb9 thru 0x01ccc6 (0x900e bytes) 000886 1788600463.276097 fallocate 0x0166b1 thru 0x01a9eb (0x433b bytes) 000887 1788600463.293533 MIRROR_RESYNC 8 mirrors 000889 1788600465.387245 fallocate 0x028820 thru 0x03107a (0x885b bytes) 000890 1788600465.425616 read 0x0069b1 thru 0x00b94a (0x4f9a bytes) 000891 1788600465.436566 mapwrite 0x004d78 thru 0x00b6e8 (0x6971 bytes) 000892 1788600465.483092 write 0x0031ab thru 0x0094a2 (0x62f8 bytes) 000893 1788600465.496710 mapwrite 0x02a3bd thru 0x02e5a0 (0x41e4 bytes) 000894 1788600465.542093 fallocate 0x00f694 thru 0x016df6 (0x7763 bytes) 000895 1788600465.554531 fallocate 0x026a21 thru 0x02be58 (0x5438 bytes) 000896 1788600465.567648 read 0x017b2f thru 0x021ac3 (0x9f95 bytes) 000898 1788600465.616875 MIRROR_RESYNC 8 mirrors 000899 1788600467.402756 write 0x01c0ab thru 0x02909c (0xcff2 bytes) 000900 1788600467.444637 mapread 0x017566 thru 0x022ede (0xb979 bytes) 000901 1788600467.455631 fallocate 0x00b484 thru 0x00c5ec (0x1169 bytes) 000902 1788600467.461770 trunc from 0x021929 to 0x0244f6 (0x2bce bytes) 000903 1788600467.479148 fallocate 0x001ef8 thru 0x00fcc8 (0xddd1 bytes) 000904 1788600467.485078 write 0x016ea6 thru 0x01c9f2 (0x5b4d bytes) 000905 1788600467.487671 trunc from 0x031e73 to 0x032e20 (0xfae bytes) 000906 1788600467.510602 fallocate 0x03a637 thru 0x03c533 (0x1efd bytes) 000907 1788600467.515118 fallocate 0x00e0bd thru 0x011704 (0x3648 bytes) 000908 1788600467.520665 punch from 0x011f33 to 0x021145 (0xf213 bytes) 000909 1788600467.555506 trunc from 0x032e21 to 0x00df73 (0x24ead bytes) 000911 1788600467.587660 trunc from 0x00df74 to 0x02a7e9 (0x1c876 bytes) 000912 1788600467.609926 punch from 0x01bfcb to 0x01f041 (0x3077 bytes) 000913 1788600467.615726 trunc from 0x02a7ea to 0x0365f0 (0xbe07 bytes) 000914 1788600467.649436 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x365f1): Mirror 10: (stale - read error) Mirror 16: (stale - read error) Mirror 23: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 35: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x365f1): Mirror 10: 0x4b6b3c0a (stale) Mirror 16: 0x4b6b3c0a (stale) Mirror 23: 0x4b6b3c0a (stale) Mirror 28: 0x4b6b3c0a (stale) Mirror 29: 0x4b6b3c0a (stale) Mirror 30: 0x4b6b3c0a (stale) Mirror 35: 0x4b6b3c0a (stale) CRC-32 checksum value for chunk [0, 0x365f1): Mirror 1: 0x1f3939aa Mirror 36: 0x1f3939aa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x365f1: skipped 000915 1788600469.341771 trunc from 0x0365f1 to 0x01cbaf (0x19a41 bytes) 000916 1788600469.466683 fallocate 0x018b17 thru 0x028292 (0xf77c bytes) 000917 1788600469.480150 write 0x01fe52 thru 0x02d513 (0xd6c2 bytes) 000918 1788600469.492566 trunc from 0x02d514 to 0x01b37d (0x12196 bytes) 000919 1788600469.533125 trunc from 0x01139b to 0x01674a (0x53b0 bytes) 000920 1788600469.551261 punch from 0x018c5c to 0x01b37d (0x2722 bytes) 000921 1788600469.568099 MIRROR_RESYNC 9 mirrors 000922 1788600472.068139 fallocate 0x018d52 thru 0x024b42 (0xbdf1 bytes) 000923 1788600472.107919 mapread 0x006f3e thru 0x016938 (0xf9fb bytes) 000924 1788600472.149507 write 0x014882 thru 0x0236f7 (0xee76 bytes) 000926 1788600472.152940 punch from 0x0050ba to 0x00670a (0x1651 bytes) 000927 1788600472.167781 MIRROR_RESYNC 9 mirrors 000928 1788600474.177446 read 0x0199f2 thru 0x01ee88 (0x5497 bytes) 000929 1788600474.186766 trunc from 0x01eec7 to 0x0236f7 (0x4831 bytes) 000931 1788600474.211029 read 0x005d69 thru 0x011241 (0xb4d9 bytes) 000932 1788600474.226397 mapwrite 0x02006d thru 0x02b9bf (0xb953 bytes) 000933 1788600474.326681 trunc from 0x02b9c0 to 0x00df3d (0x1da82 bytes) 000934 1788600474.355678 read 0x007da6 thru 0x0080ef (0x34a bytes) 000935 1788600474.359474 write 0x00c83d thru 0x01c530 (0xfcf4 bytes) 000936 1788600474.368979 fallocate 0x034630 thru 0x03726c (0x2c3d bytes) 000937 1788600474.387758 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3726d): Mirror 16: 0x35229a66 (stale) Mirror 23: 0x35229a66 (stale) Mirror 28: 0x35229a66 (stale) Mirror 29: 0x35229a66 (stale) Mirror 30: 0x35229a66 (stale) Mirror 35: 0x35229a66 (stale) Mirror 36: 0x35229a66 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3726d): Mirror 16: 0x35229a66 (stale) Mirror 23: 0x35229a66 (stale) Mirror 28: 0x35229a66 (stale) Mirror 29: 0x35229a66 (stale) Mirror 30: 0x35229a66 (stale) Mirror 35: 0x35229a66 (stale) Mirror 36: 0x35229a66 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3726d: skipped 000938 1788600475.063742 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3726d): Mirror 23: 0x35229a66 (stale) Mirror 28: 0x35229a66 (stale) Mirror 29: 0x35229a66 (stale) Mirror 30: 0x35229a66 (stale) Mirror 35: 0x35229a66 (stale) Mirror 36: 0x35229a66 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3726d): Mirror 23: 0x35229a66 (stale) Mirror 28: 0x35229a66 (stale) Mirror 29: 0x35229a66 (stale) Mirror 30: 0x35229a66 (stale) Mirror 35: 0x35229a66 (stale) Mirror 36: 0x35229a66 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3726d: skipped 000939 1788600475.524152 MIRROR_RESYNC 7 mirrors 000940 1788600476.797632 MIRROR_EXTEND to 8 mirrors 000941 1788600477.662610 MIRROR_RESYNC 8 mirrors 000942 1788600478.274866 mapwrite 0x03328b thru 0x03613f (0x2eb5 bytes) 000943 1788600478.449303 mapread 0x011ae2 thru 0x016668 (0x4b87 bytes) 000944 1788600478.472625 fallocate 0x00639c thru 0x00a382 (0x3fe7 bytes) 000945 1788600478.486634 mapwrite 0x03d75b thru 0x03ffff (0x28a5 bytes) 000946 1788600478.597402 trunc from 0x040000 to 0x00cd3e (0x332c1 bytes) 000947 1788600478.625741 write 0x0152cb thru 0x0216d8 (0xc40e bytes) 000948 1788600478.628017 trunc from 0x0216d9 to 0x018c6d (0x8a6b bytes) 000950 1788600478.646683 mapread 0x0038cc thru 0x00438f (0xac4 bytes) 000951 1788600478.658091 mapread 0x0098fd thru 0x00d2e2 (0x39e6 bytes) 000952 1788600478.659128 punch from 0x0154fb to 0x018c6d (0x3773 bytes) 000953 1788600478.675521 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x18c6e): Mirror 23: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18c6e): Mirror 23: 0xc93b0a53 (stale) Mirror 28: 0xc93b0a53 (stale) Mirror 29: 0xc93b0a53 (stale) Mirror 30: 0xc93b0a53 (stale) Mirror 35: 0xc93b0a53 (stale) Mirror 36: 0xc93b0a53 (stale) Mirror 37: 0xc93b0a53 (stale) CRC-32 checksum value for chunk [0, 0x18c6e): Mirror 1: 0xa1cdf74c Mirror 38: 0xa1cdf74c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18c6e: skipped 000954 1788600479.515939 read 0x0145e3 thru 0x018c6d (0x468b bytes) 000955 1788600479.532133 read 0x0010be thru 0x006e29 (0x5d6c bytes) 000956 1788600479.548587 trunc from 0x004092 to 0x00e200 (0xa16f bytes) 000958 1788600479.584677 mapread 0x00a1fc thru 0x012c41 (0x8a46 bytes) 000960 1788600479.627965 fallocate 0x00fe59 thru 0x0171ab (0x7353 bytes) 000961 1788600479.634811 fallocate 0x02c3f7 thru 0x02e703 (0x230d bytes) 000962 1788600479.642022 mapread 0x014dfc thru 0x018418 (0x361d bytes) 000963 1788600479.671563 mapwrite 0x003ee7 thru 0x006077 (0x2191 bytes) 000964 1788600479.696672 trunc from 0x0096ae to 0x01069b (0x6fee bytes) 000965 1788600479.704549 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18c6e): Mirror 23: 0xc93b0a53 (stale) Mirror 28: 0xc93b0a53 (stale) Mirror 29: 0xc93b0a53 (stale) Mirror 30: 0xc93b0a53 (stale) Mirror 35: 0xc93b0a53 (stale) Mirror 36: 0xc93b0a53 (stale) Mirror 38: 0xa1cdf74c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18c6e): Mirror 23: 0xc93b0a53 (stale) Mirror 28: 0xc93b0a53 (stale) Mirror 29: 0xc93b0a53 (stale) Mirror 30: 0xc93b0a53 (stale) Mirror 35: 0xc93b0a53 (stale) Mirror 36: 0xc93b0a53 (stale) Mirror 38: 0xa1cdf74c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18c6e: skipped 000967 1788600480.468566 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x18c6e): Mirror 23: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 38: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18c6e): Mirror 23: 0xc93b0a53 (stale) Mirror 28: 0xc93b0a53 (stale) Mirror 29: 0xc93b0a53 (stale) Mirror 30: 0xc93b0a53 (stale) Mirror 35: 0xc93b0a53 (stale) Mirror 36: 0xc93b0a53 (stale) Mirror 38: 0xa1cdf74c (stale) CRC-32 checksum value for chunk [0, 0x18c6e): Mirror 1: 0x32f4e4c1 Mirror 39: 0x32f4e4c1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18c6e: skipped 000969 1788600482.085143 read 0x0075fd thru 0x013b9f (0xc5a3 bytes) 000970 1788600482.126709 write 0x01cf01 thru 0x0243ac (0x74ac bytes) 000971 1788600482.207907 trunc from 0x0243ad to 0x0013ae (0x22ffe bytes) 000972 1788600482.261696 mapwrite 0x0293b4 thru 0x02b832 (0x247f bytes) 000974 1788600482.358683 fallocate 0x02284a thru 0x031553 (0xed0a bytes) 000975 1788600482.384003 punch from 0x014b42 to 0x0177d6 (0x2c95 bytes) 000976 1788600482.411614 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2b833): Mirror 23: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 38: (stale - read error) Mirror 39: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b833): Mirror 23: 0x425a3706 (stale) Mirror 28: 0x425a3706 (stale) Mirror 29: 0x425a3706 (stale) Mirror 30: 0x425a3706 (stale) Mirror 35: 0x425a3706 (stale) Mirror 36: 0x425a3706 (stale) Mirror 38: 0x4ddc0101 (stale) Mirror 39: 0x337edeb9 (stale) CRC-32 checksum value for chunk [0, 0x2b833): Mirror 1: 0x8808f43f Mirror 40: 0x8808f43f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b833: skipped 000977 1788600483.463298 trunc from 0x02b833 to 0x039291 (0xda5f bytes) 000978 1788600483.570762 write 0x038234 thru 0x03fac9 (0x7896 bytes) 000979 1788600483.580709 punch from 0x02c053 to 0x03b1aa (0xf158 bytes) 000981 1788600483.598517 mapread 0x01d2e6 thru 0x02177e (0x4499 bytes) 000982 1788600483.627744 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3faca): Mirror 23: 0x7d5d3bc5 (stale) Mirror 28: 0x7d5d3bc5 (stale) Mirror 29: 0x7d5d3bc5 (stale) Mirror 30: 0x7d5d3bc5 (stale) Mirror 35: 0x7d5d3bc5 (stale) Mirror 36: 0x7d5d3bc5 (stale) Mirror 39: 0xd1277b7e (stale) Mirror 40: 0x7b926a20 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3faca): Mirror 23: 0x7d5d3bc5 (stale) Mirror 28: 0x7d5d3bc5 (stale) Mirror 29: 0x7d5d3bc5 (stale) Mirror 30: 0x7d5d3bc5 (stale) Mirror 35: 0x7d5d3bc5 (stale) Mirror 36: 0x7d5d3bc5 (stale) Mirror 39: 0xd1277b7e (stale) Mirror 40: 0x7b926a20 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3faca: skipped 000983 1788600484.644694 punch from 0x024292 to 0x026503 (0x2272 bytes) 000984 1788600484.651464 punch from 0x02c786 to 0x039b1a (0xd395 bytes) 000985 1788600484.661486 mapwrite 0x03d8ba thru 0x03ffff (0x2746 bytes) 000986 1788600484.762279 punch from 0x03469e to 0x03ffff (0xb962 bytes) 000988 1788600484.769382 fallocate 0x030836 thru 0x039817 (0x8fe2 bytes) 000989 1788600484.783453 mapread 0x02bc6e thru 0x02ec09 (0x2f9c bytes) 000990 1788600484.800699 read 0x03f23e thru 0x03ffff (0xdc2 bytes) 000991 1788600484.829858 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 39: (stale - read error) Mirror 40: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0xbea83a25 (stale) Mirror 28: 0xbea83a25 (stale) Mirror 29: 0xbea83a25 (stale) Mirror 30: 0xbea83a25 (stale) Mirror 35: 0xbea83a25 (stale) Mirror 36: 0xbea83a25 (stale) Mirror 39: 0x17a7754a (stale) Mirror 40: 0xddf79c9a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xddf79c9a Mirror 41: 0xddf79c9a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000992 1788600486.589882 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 39: (stale - read error) Mirror 40: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0xbea83a25 (stale) Mirror 28: 0xbea83a25 (stale) Mirror 29: 0xbea83a25 (stale) Mirror 30: 0xbea83a25 (stale) Mirror 35: 0xbea83a25 (stale) Mirror 36: 0xbea83a25 (stale) Mirror 39: 0x17a7754a (stale) Mirror 40: 0xddf79c9a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xddf79c9a Mirror 41: 0xddf79c9a Mirror 42: 0xddf79c9a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000994 1788600487.867616 mapwrite 0x031e72 thru 0x03ef26 (0xd0b5 bytes) 000995 1788600487.983479 fallocate 0x02a635 thru 0x0302ae (0x5c7a bytes) 000996 1788600487.995245 MIRROR_RESYNC 11 mirrors 000997 1788600490.928986 mapread 0x03fe2d thru 0x03ffff (0x1d3 bytes) 000998 1788600490.938815 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x18a:0x0]: Invalid argument (22) 000999 1788600491.344691 mapwrite 0x038b2d thru 0x03ffff (0x74d3 bytes) 001000 1788600491.512075 punch from 0x020ca6 to 0x0298c1 (0x8c1c bytes) All operations completed A-OK!