== sanity-flr test 70a: flr mode fsx test ================ 11:34:56 (1788190496) Seed set to 499 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read truncating to largest ever: 0x36b39 000008 1788190499.722409 trunc from 00000000 to 0x036b38 (0x36b39 bytes) 000011 1788190499.749491 mapwrite 0x00f529 thru 0x01147d (0x1f55 bytes) 000013 1788190499.829920 mapwrite 0x03259d thru 0x03cedf (0xa943 bytes) 000014 1788190499.903702 mapread 0x029599 thru 0x02f226 (0x5c8e bytes) 000016 1788190499.919046 trunc from 0x03cee0 to 0x001db5 (0x3b12a bytes) 000017 1788190499.938340 read 0x001743 thru 0x001db5 (0x673 bytes) 000018 1788190499.947668 mapread 0x00084e thru 0x001db5 (0x1568 bytes) 000021 1788190499.959892 mapwrite 0x02301c thru 0x029b12 (0x6af7 bytes) 000023 1788190500.119522 MIRROR_EXTEND to 2 mirrors 000024 1788190501.423288 trunc from 0x029b13 to 0x02bb7a (0x2068 bytes) 000025 1788190501.575473 mapread 0x01720d thru 0x01a54b (0x333f bytes) 000027 1788190501.612552 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2bb7b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bb7b): Mirror 2: 0xb83fecde (stale) CRC-32 checksum value for chunk [0, 0x2bb7b): Mirror 1: 0xb83fecde Mirror 3: 0xb83fecde lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bb7b: skipped 000028 1788190503.260271 trunc from 0x02bb7b to 0x007083 (0x24af7 bytes) 000029 1788190503.364884 mapwrite 0x0279be thru 0x02b19b (0x37de bytes) 000031 1788190503.474393 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b19c): Mirror 3: 0x14b52c79 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b19c): Mirror 3: 0x14b52c79 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b19c: skipped 000032 1788190503.878859 read 0x006531 thru 0x014cdd (0xe7ad bytes) 000034 1788190503.919800 trunc from 0x02b19c to 0x034151 (0x8fb6 bytes) 000037 1788190503.940984 write 0x01e6f5 thru 0x02ae52 (0xc75e bytes) 000038 1788190503.961336 mapwrite 0x019208 thru 0x01c1d3 (0x2fcc bytes) 000040 1788190504.093328 trunc from 0x034152 to 0x032857 (0x18fa bytes) 000045 1788190504.121613 mapwrite 0x03e0c9 thru 0x03ffff (0x1f37 bytes) 000047 1788190504.224764 read 0x023d76 thru 0x02fff9 (0xc284 bytes) 000050 1788190504.256568 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x6fc06cd2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x74928688 Mirror 4: 0x74928688 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000054 1788190505.349114 mapread 0x02c900 thru 0x02e9fc (0x20fd bytes) 000055 1788190505.372617 write 0x00d515 thru 0x012f43 (0x5a2f bytes) 000057 1788190505.542108 mapwrite 0x00d28c thru 0x0148b6 (0x762b bytes) 000058 1788190505.626408 mapwrite 0x02e978 thru 0x0335f3 (0x4c7c bytes) 000059 1788190505.741179 write 0x00bef3 thru 0x013fae (0x80bc bytes) 000061 1788190505.753686 read 0x009006 thru 0x0097aa (0x7a5 bytes) 000062 1788190505.763252 read 0x00d5d3 thru 0x01120c (0x3c3a bytes) 000063 1788190505.764399 mapwrite 0x015e92 thru 0x01ab5b (0x4cca bytes) 000064 1788190505.862660 read 0x01409b thru 0x01f23c (0xb1a2 bytes) 000065 1788190505.863442 mapwrite 0x00b70f thru 0x01b431 (0xfd23 bytes) 000066 1788190505.978087 MIRROR_RESYNC 3 mirrors 000068 1788190508.255877 write 0x001383 thru 0x005fa2 (0x4c20 bytes) 000070 1788190508.357700 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa11e02d (stale) Mirror 4: 0xa11e02d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x19407e3c Mirror 5: 0x19407e3c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000071 1788190510.042716 mapread 0x029e5f thru 0x032949 (0x8aeb bytes) truncating to largest ever: 0x3d490 000073 1788190510.087299 trunc from 0x040000 to 0x03d48f (0x2b70 bytes) 000076 1788190510.293585 read 0x0155ee thru 0x023e90 (0xe8a3 bytes) 000077 1788190510.321504 mapwrite 0x026daf thru 0x031b33 (0xad85 bytes) 000078 1788190510.463411 mapread 0x03b514 thru 0x03d48f (0x1f7c bytes) 000080 1788190510.479621 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d490): Mirror 3: 0xbf3f063a (stale) Mirror 5: 0x951e8a70 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d490): Mirror 3: 0xbf3f063a (stale) Mirror 5: 0x951e8a70 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d490: skipped 000081 1788190511.009065 mapread 0x02fe66 thru 0x031dde (0x1f79 bytes) 000082 1788190511.038286 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3d490): Mirror 3: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d490): Mirror 3: 0xbf3f063a (stale) Mirror 5: 0x951e8a70 (stale) CRC-32 checksum value for chunk [0, 0x3d490): Mirror 1: 0xa36266d8 Mirror 6: 0xa36266d8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d490: skipped 000084 1788190512.876348 read 0x006e2b thru 0x014df1 (0xdfc7 bytes) 000085 1788190512.901067 mapread 0x03aa1b thru 0x03cd45 (0x232b bytes) 000088 1788190512.933000 read 0x02e68f thru 0x03d48f (0xee01 bytes) 000089 1788190512.954307 mapwrite 0x006084 thru 0x009f70 (0x3eed bytes) 000090 1788190513.222471 MIRROR_RESYNC 4 mirrors 000091 1788190515.276269 read 0x01a497 thru 0x01ed46 (0x48b0 bytes) 000092 1788190515.284039 trunc from 0x03d490 to 0x015a9b (0x279f4 bytes) 000094 1788190515.391961 mapwrite 0x0169a7 thru 0x0188d7 (0x1f31 bytes) 000095 1788190515.488087 mapread 0x00a3f8 thru 0x017956 (0xd55f bytes) 000096 1788190515.505940 write 0x02f4f0 thru 0x030f65 (0x1a76 bytes) 000097 1788190515.508050 trunc from 0x030f66 to 0x00a713 (0x26852 bytes) 000099 1788190515.537104 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xa714): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa714): Mirror 3: 0xace7827e (stale) Mirror 5: 0xace7827e (stale) Mirror 6: 0xace7827e (stale) CRC-32 checksum value for chunk [0, 0xa714): Mirror 1: 0xace7827e Mirror 7: 0xace7827e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa714: skipped 000100 1788190517.153694 mapwrite 0x022367 thru 0x0285ba (0x6254 bytes) 000102 1788190517.499836 write 0x009d35 thru 0x00a7c2 (0xa8e bytes) 000103 1788190517.512120 mapwrite 0x010094 thru 0x012870 (0x27dd bytes) 000104 1788190517.589079 MIRROR_RESYNC 5 mirrors 000108 1788190519.526117 mapread 0x010ea8 thru 0x019be8 (0x8d41 bytes) 000110 1788190519.550551 MIRROR_RESYNC 5 mirrors 000112 1788190520.126050 write 0x02ef53 thru 0x0397a2 (0xa850 bytes) 000113 1788190520.215407 mapwrite 0x02c5d1 thru 0x039ff2 (0xda22 bytes) 000115 1788190520.361525 write 0x001f5a thru 0x00845f (0x6506 bytes) 000116 1788190520.382103 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x39ff3): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39ff3): Mirror 3: 0x894f565c (stale) Mirror 5: 0x894f565c (stale) Mirror 6: 0x894f565c (stale) Mirror 7: 0x894f565c (stale) CRC-32 checksum value for chunk [0, 0x39ff3): Mirror 1: 0x3aca1795 Mirror 8: 0x3aca1795 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39ff3: skipped 000123 1788190522.148642 write 0x032419 thru 0x03a883 (0x846b bytes) 000124 1788190522.324518 mapread 0x01be8e thru 0x01c3dd (0x550 bytes) 000128 1788190522.347482 write 0x00740f thru 0x011072 (0x9c64 bytes) 000129 1788190522.364193 mapwrite 0x00635c thru 0x0078b9 (0x155e bytes) 000130 1788190522.464358 read 0x02b945 thru 0x02eadf (0x319b bytes) 000133 1788190522.474844 write 0x02505e thru 0x034235 (0xf1d8 bytes) 000134 1788190522.482071 read 0x01ed5e thru 0x02968e (0xa931 bytes) 000136 1788190522.493572 mapwrite 0x00ddb7 thru 0x01c38c (0xe5d6 bytes) 000137 1788190522.587799 mapwrite 0x03770d thru 0x03ffff (0x88f3 bytes) 000138 1788190522.770516 mapwrite 0x033efe thru 0x03ffff (0xc102 bytes) 000139 1788190522.831006 mapwrite 0x00cce3 thru 0x0182a5 (0xb5c3 bytes) 000142 1788190522.894185 write 0x03af99 thru 0x03ffff (0x5067 bytes) 000143 1788190522.896131 trunc from 0x040000 to 0x02e3bc (0x11c43 bytes) 000144 1788190522.915091 mapread 0x0267d9 thru 0x02e1f2 (0x7a1a bytes) 000146 1788190522.918137 mapread 0x02545e thru 0x02e3bc (0x8f5f bytes) 000148 1788190522.921255 mapread 0x003202 thru 0x011eb3 (0xecb2 bytes) 000149 1788190522.923149 trunc from 0x02e3bd to 0x02e184 (0x238 bytes) 000150 1788190522.946061 mapread 0x01cb4c thru 0x01dd81 (0x1236 bytes) 000155 1788190522.959060 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2e185): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e185): Mirror 3: 0x6129d82c (stale) Mirror 5: 0x6129d82c (stale) Mirror 6: 0x6129d82c (stale) Mirror 7: 0x6129d82c (stale) Mirror 8: 0x70944096 (stale) CRC-32 checksum value for chunk [0, 0x2e185): Mirror 1: 0x7bed1e9b Mirror 9: 0x7bed1e9b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e185: skipped 000158 1788190524.610263 trunc from 0x02e185 to 0x00b1e2 (0x22fa2 bytes) 000161 1788190524.820142 mapwrite 0x036b7a thru 0x03ffff (0x9486 bytes) 000162 1788190525.023925 MIRROR_RESYNC 7 mirrors 000163 1788190527.789218 mapwrite 0x02c760 thru 0x0366b2 (0x9f53 bytes) 000164 1788190528.315479 mapread 0x02e79a thru 0x03df80 (0xf7e7 bytes) 000165 1788190528.317035 write 0x0247f6 thru 0x02dda3 (0x95ae bytes) 000166 1788190528.331014 write 0x00399c thru 0x00612c (0x2791 bytes) 000167 1788190528.347352 mapwrite 0x01375c thru 0x01c37b (0x8c20 bytes) 000168 1788190528.506593 mapwrite 0x015faa thru 0x021ee6 (0xbf3d bytes) 000169 1788190528.601236 mapread 0x00c0de thru 0x015e51 (0x9d74 bytes) 000170 1788190528.602470 mapread 0x01ed6f thru 0x02e0ba (0xf34c bytes) 000172 1788190528.605949 read 0x0073f6 thru 0x013906 (0xc511 bytes) 000173 1788190528.621964 mapread 0x0242db thru 0x028f75 (0x4c9b bytes) 000174 1788190528.623894 trunc from 0x040000 to 0x0314fa (0xeb05 bytes) 000175 1788190528.673535 write 0x0090c0 thru 0x013788 (0xa6c9 bytes) 000176 1788190528.674905 write 0x008b14 thru 0x00b2ee (0x27db bytes) 000177 1788190528.678346 trunc from 0x0314fb to 0x02bb57 (0x59a3 bytes) 000178 1788190528.712419 write 0x031f0d thru 0x03cc06 (0xacfa bytes) 000182 1788190528.725766 MIRROR_RESYNC 7 mirrors 000184 1788190533.106897 trunc from 0x03cc07 to 0x03a228 (0x29de bytes) 000185 1788190533.212592 mapwrite 0x02f785 thru 0x03ec45 (0xf4c1 bytes) 000187 1788190533.380197 write 0x0158ae thru 0x019c0e (0x4361 bytes) 000188 1788190533.422273 mapwrite 0x01ebbb thru 0x020933 (0x1d79 bytes) 000190 1788190533.614449 read 0x033222 thru 0x03c8d2 (0x96b1 bytes) 000191 1788190533.615214 mapread 0x0314f6 thru 0x0379df (0x64ea bytes) 000192 1788190533.624686 mapread 0x03d13f thru 0x03ec45 (0x1b07 bytes) 000195 1788190533.635361 mapwrite 0x01c2ce thru 0x01cbbe (0x8f1 bytes) 000196 1788190533.795205 mapread 0x026baa thru 0x036792 (0xfbe9 bytes) 000197 1788190533.815516 read 0x03ec00 thru 0x03ec45 (0x46 bytes) 000199 1788190533.816759 mapwrite 0x03417f thru 0x039d48 (0x5bca bytes) 000201 1788190534.073273 read 0x033cba thru 0x038622 (0x4969 bytes) 000203 1788190534.090337 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3ec46): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ec46): Mirror 3: 0xa6b9eeb5 (stale) Mirror 5: 0xa6b9eeb5 (stale) Mirror 6: 0xa6b9eeb5 (stale) Mirror 7: 0xa6b9eeb5 (stale) Mirror 8: 0xa6b9eeb5 (stale) Mirror 9: 0xa6b9eeb5 (stale) CRC-32 checksum value for chunk [0, 0x3ec46): Mirror 1: 0x67358e14 Mirror 10: 0x67358e14 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ec46: skipped 000204 1788190536.093341 read 0x00f2eb thru 0x018b41 (0x9857 bytes) 000206 1788190536.149604 trunc from 0x03ec46 to 0x038431 (0x6814 bytes) 000207 1788190536.376279 mapread 0x0141ed thru 0x01d31b (0x912f bytes) 000208 1788190536.413556 mapread 0x0005b9 thru 0x00496e (0x43b6 bytes) 000210 1788190536.445964 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38432): Mirror 3: 0xe666d34 (stale) Mirror 5: 0xe666d34 (stale) Mirror 6: 0xe666d34 (stale) Mirror 8: 0xe666d34 (stale) Mirror 9: 0xe666d34 (stale) Mirror 10: 0xe0017339 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38432): Mirror 3: 0xe666d34 (stale) Mirror 5: 0xe666d34 (stale) Mirror 6: 0xe666d34 (stale) Mirror 8: 0xe666d34 (stale) Mirror 9: 0xe666d34 (stale) Mirror 10: 0xe0017339 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38432: skipped 000212 1788190537.485553 read 0x01eb3c thru 0x02adab (0xc270 bytes) 000213 1788190537.498658 mapread 0x003f9f thru 0x012eb5 (0xef17 bytes) 000214 1788190537.535642 trunc from 0x038432 to 0x03cc1b (0x47ea bytes) 000215 1788190537.569277 MIRROR_RESYNC 7 mirrors 000216 1788190540.860491 write 0x014455 thru 0x01b4b3 (0x705f bytes) 000217 1788190540.957780 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3cc1c): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cc1c): Mirror 3: 0x1d21851b (stale) Mirror 5: 0x1d21851b (stale) Mirror 6: 0x1d21851b (stale) Mirror 8: 0x1d21851b (stale) Mirror 9: 0x1d21851b (stale) Mirror 10: 0x1d21851b (stale) CRC-32 checksum value for chunk [0, 0x3cc1c): Mirror 1: 0x7aad98c5 Mirror 11: 0x7aad98c5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cc1c: skipped 000218 1788190542.814915 write 0x02c617 thru 0x02eb3c (0x2526 bytes) 000219 1788190542.937810 read 0x0244b1 thru 0x03417b (0xfccb bytes) 000220 1788190542.973833 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3cc1c): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cc1c): Mirror 3: 0x1d21851b (stale) Mirror 5: 0x1d21851b (stale) Mirror 6: 0x1d21851b (stale) Mirror 8: 0x1d21851b (stale) Mirror 9: 0x1d21851b (stale) Mirror 10: 0x1d21851b (stale) Mirror 11: 0x7aad98c5 (stale) CRC-32 checksum value for chunk [0, 0x3cc1c): Mirror 1: 0xa32439c5 Mirror 12: 0xa32439c5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cc1c: skipped 000221 1788190544.789635 trunc from 0x03cc1c to 0x0248cb (0x18350 bytes) 000223 1788190544.930979 mapread 0x018a35 thru 0x01bf77 (0x3543 bytes) 000224 1788190544.947141 write 0x00d4db thru 0x00dbc9 (0x6ef bytes) 000225 1788190544.952364 read 0x01b43a thru 0x0248cb (0x9492 bytes) 000226 1788190544.957384 read 0x005df8 thru 0x007592 (0x179b bytes) 000227 1788190544.966200 trunc from 0x0248cc to 0x018c39 (0xbc92 bytes) 000228 1788190544.986010 read 0x016923 thru 0x0180f3 (0x17d1 bytes) 000232 1788190544.989106 trunc from 0x018c3a to 0x01345f (0x57da bytes) 000238 1788190545.009695 read 0x00f5cd thru 0x01345f (0x3e93 bytes) 000239 1788190545.017035 MIRROR_RESYNC 9 mirrors 000240 1788190547.429164 trunc from 0x013460 to 0x038cb0 (0x25851 bytes) 000242 1788190547.577251 write 0x021ab7 thru 0x02e2bc (0xc806 bytes) 000243 1788190547.603239 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x38cb1): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38cb1): Mirror 3: 0x6c0cab6f (stale) Mirror 5: 0x6c0cab6f (stale) Mirror 6: 0x6c0cab6f (stale) Mirror 8: 0x6c0cab6f (stale) Mirror 9: 0x6c0cab6f (stale) Mirror 10: 0x6c0cab6f (stale) Mirror 11: 0x6c0cab6f (stale) Mirror 12: 0x6c0cab6f (stale) CRC-32 checksum value for chunk [0, 0x38cb1): Mirror 1: 0x70760c2d Mirror 13: 0x70760c2d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38cb1: skipped 000244 1788190549.180577 write 0x00b35f thru 0x0172b9 (0xbf5b bytes) 000245 1788190549.280678 mapwrite 0x0045eb thru 0x00f65a (0xb070 bytes) 000247 1788190549.371591 mapread 0x00001d thru 0x00a1de (0xa1c2 bytes) 000249 1788190549.379522 mapread 0x0058d5 thru 0x0128e4 (0xd010 bytes) 000250 1788190549.383851 mapwrite 0x03d454 thru 0x03ffff (0x2bac bytes) 000251 1788190549.453562 trunc from 0x040000 to 0x021f32 (0x1e0cd bytes) 000252 1788190549.478316 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x21f33): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21f33): Mirror 3: 0xc3c01f7 (stale) Mirror 5: 0xc3c01f7 (stale) Mirror 6: 0xc3c01f7 (stale) Mirror 8: 0xc3c01f7 (stale) Mirror 9: 0xc3c01f7 (stale) Mirror 10: 0xc3c01f7 (stale) Mirror 11: 0xc3c01f7 (stale) Mirror 12: 0xc3c01f7 (stale) Mirror 13: 0xa62651c2 (stale) CRC-32 checksum value for chunk [0, 0x21f33): Mirror 1: 0xeb5f4f94 Mirror 14: 0xeb5f4f94 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21f33: skipped 000253 1788190551.026317 mapwrite 0x0146c9 thru 0x02181e (0xd156 bytes) 000254 1788190551.354596 read 0x0144d5 thru 0x017a4a (0x3576 bytes) 000257 1788190551.357330 read 0x002a1b thru 0x00b943 (0x8f29 bytes) 000258 1788190551.378390 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x21f33): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21f33): Mirror 3: 0xc3c01f7 (stale) Mirror 5: 0xc3c01f7 (stale) Mirror 6: 0xc3c01f7 (stale) Mirror 8: 0xc3c01f7 (stale) Mirror 9: 0xc3c01f7 (stale) Mirror 10: 0xc3c01f7 (stale) Mirror 11: 0xc3c01f7 (stale) Mirror 12: 0xc3c01f7 (stale) Mirror 13: 0xa62651c2 (stale) Mirror 14: 0xeb5f4f94 (stale) CRC-32 checksum value for chunk [0, 0x21f33): Mirror 1: 0x9bbc3722 Mirror 15: 0x9bbc3722 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21f33: skipped 000262 1788190552.730716 read 0x01a7c5 thru 0x021f32 (0x776e bytes) 000263 1788190552.743544 read 0x005129 thru 0x00ef8d (0x9e65 bytes) 000264 1788190552.760163 mapwrite 0x036939 thru 0x03e390 (0x7a58 bytes) 000266 1788190553.059769 MIRROR_RESYNC 12 mirrors 000267 1788190558.793558 write 0x013be5 thru 0x018cbf (0x50db bytes) 000268 1788190558.990397 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3e391): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e391): Mirror 3: 0x7be9f6c1 (stale) Mirror 5: 0x7be9f6c1 (stale) Mirror 6: 0x7be9f6c1 (stale) Mirror 8: 0x7be9f6c1 (stale) Mirror 9: 0x7be9f6c1 (stale) Mirror 10: 0x7be9f6c1 (stale) Mirror 11: 0x7be9f6c1 (stale) Mirror 12: 0x7be9f6c1 (stale) Mirror 13: 0x7be9f6c1 (stale) Mirror 14: 0x7be9f6c1 (stale) Mirror 15: 0x7be9f6c1 (stale) CRC-32 checksum value for chunk [0, 0x3e391): Mirror 1: 0xbc9c5e98 Mirror 16: 0xbc9c5e98 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e391: skipped 000269 1788190561.347063 mapwrite 0x0042f0 thru 0x00e8a4 (0xa5b5 bytes) 000270 1788190561.698504 MIRROR_RESYNC 13 mirrors 000272 1788190566.408101 read 0x02de14 thru 0x033ba0 (0x5d8d bytes) 000274 1788190566.443895 MIRROR_RESYNC 13 mirrors 000275 1788190567.635356 mapread 0x016c46 thru 0x024842 (0xdbfd bytes) 000276 1788190567.718881 MIRROR_RESYNC 13 mirrors 000277 1788190568.926645 write 0x01b24c thru 0x01bcae (0xa63 bytes) 000278 1788190569.120647 mapread 0x00efac thru 0x01b027 (0xc07c bytes) 000279 1788190569.195130 mapread 0x016bc9 thru 0x018cd0 (0x2108 bytes) 000280 1788190569.196190 write 0x03f826 thru 0x03ffff (0x7da bytes) 000281 1788190569.205375 mapwrite 0x03058f thru 0x030b94 (0x606 bytes) 000282 1788190569.363246 read 0x01f63b thru 0x021b5d (0x2523 bytes) 000284 1788190569.364472 trunc from 0x040000 to 0x00133f (0x3ecc0 bytes) 000287 1788190569.440390 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x1340): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1340): Mirror 3: 0xa75b3f89 (stale) Mirror 5: 0xa75b3f89 (stale) Mirror 6: 0xa75b3f89 (stale) Mirror 8: 0xa75b3f89 (stale) Mirror 9: 0xa75b3f89 (stale) Mirror 10: 0xa75b3f89 (stale) Mirror 11: 0xa75b3f89 (stale) Mirror 12: 0xa75b3f89 (stale) Mirror 13: 0xa75b3f89 (stale) Mirror 14: 0xa75b3f89 (stale) Mirror 15: 0xa75b3f89 (stale) Mirror 16: 0xa75b3f89 (stale) CRC-32 checksum value for chunk [0, 0x1340): Mirror 1: 0xa75b3f89 Mirror 17: 0xa75b3f89 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1340: skipped 000288 1788190571.095940 mapwrite 0x00adbc thru 0x0173b3 (0xc5f8 bytes) 000290 1788190571.361623 mapread 0x00664e thru 0x00bc21 (0x55d4 bytes) 000291 1788190571.364129 write 0x03e6bf thru 0x03ffff (0x1941 bytes) 000292 1788190571.368453 mapwrite 0x0168f8 thru 0x0214ab (0xabb4 bytes) 000295 1788190571.459117 mapwrite 0x019a3f thru 0x0264ac (0xca6e bytes) 000296 1788190571.589427 write 0x0089dd thru 0x009a04 (0x1028 bytes) 000300 1788190571.600001 mapread 0x00ad68 thru 0x00d669 (0x2902 bytes) 000305 1788190571.607465 mapread 0x0019db thru 0x00accc (0x92f2 bytes) 000306 1788190571.619532 write 0x0351c7 thru 0x03c5a4 (0x73de bytes) 000307 1788190571.641659 trunc from 0x040000 to 0x031a2a (0xe5d5 bytes) 000308 1788190571.689230 mapwrite 0x02f9c1 thru 0x03298c (0x2fcc bytes) 000309 1788190571.921627 mapread 0x029b45 thru 0x03298c (0x8e48 bytes) 000311 1788190571.954090 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x3298d): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3298d): Mirror 3: 0xc7c0f3a3 (stale) Mirror 5: 0xc7c0f3a3 (stale) Mirror 6: 0xc7c0f3a3 (stale) Mirror 8: 0xc7c0f3a3 (stale) Mirror 9: 0xc7c0f3a3 (stale) Mirror 10: 0xc7c0f3a3 (stale) Mirror 11: 0xc7c0f3a3 (stale) Mirror 12: 0xc7c0f3a3 (stale) Mirror 13: 0xc7c0f3a3 (stale) Mirror 14: 0xc7c0f3a3 (stale) Mirror 15: 0xc7c0f3a3 (stale) Mirror 16: 0xc7c0f3a3 (stale) Mirror 17: 0xdff10c4e (stale) CRC-32 checksum value for chunk [0, 0x3298d): Mirror 1: 0x854067e4 Mirror 18: 0x854067e4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3298d: skipped 000313 1788190573.562109 mapread 0x01e44c thru 0x02de09 (0xf9be bytes) 000314 1788190573.647276 mapwrite 0x024c98 thru 0x02dbf8 (0x8f61 bytes) 000318 1788190573.951901 write 0x009d4d thru 0x0137e9 (0x9a9d bytes) 000319 1788190573.970443 write 0x033ed4 thru 0x038b30 (0x4c5d bytes) 000320 1788190573.973305 trunc from 0x038b31 to 0x024a38 (0x140f8 bytes) 000321 1788190574.001508 mapwrite 0x009250 thru 0x00a48d (0x123e bytes) 000322 1788190574.062900 trunc from 0x024a39 to 0x006863 (0x1e1d5 bytes) 000323 1788190574.083503 mapread 0x006446 thru 0x006863 (0x41e bytes) 000324 1788190574.098389 trunc from 0x006864 to 0x032963 (0x2c100 bytes) 000325 1788190574.115639 mapwrite 0x02b412 thru 0x034239 (0x8e28 bytes) 000326 1788190574.192016 trunc from 0x03423a to 0x032de4 (0x1455 bytes) 000327 1788190574.212347 read 0x00911d thru 0x00adbb (0x1c9f bytes) 000328 1788190574.218901 trunc from 0x032de5 to 0x01cf2f (0x15eb5 bytes) 000329 1788190574.238315 read 0x00ab61 thru 0x0100da (0x557a bytes) 000331 1788190574.249585 read 0x003e3d thru 0x00c71d (0x88e1 bytes) 000332 1788190574.250439 write 0x03cfb6 thru 0x03ffff (0x304a bytes) 000334 1788190574.256221 trunc from 0x040000 to 0x00e4c8 (0x31b37 bytes) 000337 1788190574.274358 write 0x01d424 thru 0x0273af (0x9f8c bytes) 000338 1788190574.280449 trunc from 0x0273b0 to 0x02e59b (0x71ec bytes) 000339 1788190574.304927 write 0x01818a thru 0x01d311 (0x5188 bytes) 000340 1788190574.314031 trunc from 0x02e59c to 0x01a4e2 (0x140b9 bytes) 000343 1788190574.330235 mapwrite 0x035c94 thru 0x03954f (0x38bc bytes) 000344 1788190574.412144 mapread 0x0049df thru 0x0071ad (0x27cf bytes) 000348 1788190574.416981 mapwrite 0x001f52 thru 0x009072 (0x7121 bytes) 000349 1788190574.499368 mapwrite 0x019d2a thru 0x01c7fb (0x2ad2 bytes) 000351 1788190574.578051 write 0x026005 thru 0x0350ec (0xf0e8 bytes) 000359 1788190574.603297 mapread 0x008c54 thru 0x009db9 (0x1166 bytes) 000360 1788190574.605964 mapwrite 0x026d80 thru 0x033eb6 (0xd137 bytes) 000361 1788190574.688288 read 0x015d83 thru 0x01ccec (0x6f6a bytes) 000362 1788190574.689034 read 0x007492 thru 0x0089a1 (0x1510 bytes) 000364 1788190574.690153 mapwrite 0x01df01 thru 0x01e50f (0x60f bytes) truncating to largest ever: 0x3f86e 000365 1788190574.766652 trunc from 0x039550 to 0x03f86d (0x631e bytes) 000366 1788190574.785950 write 0x019cb6 thru 0x024856 (0xaba1 bytes) 000371 1788190574.796570 trunc from 0x03f86e to 0x006226 (0x39647 bytes) 000376 1788190574.828324 trunc from 0x006227 to 0x001010 (0x5216 bytes) 000377 1788190574.855659 mapwrite 0x036669 thru 0x038d08 (0x26a0 bytes) 000378 1788190575.011587 trunc from 0x038d09 to 0x00000b (0x38cfd bytes) 000382 1788190575.045944 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0xc): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc): Mirror 3: 0x7bd5c66f (stale) Mirror 5: 0x7bd5c66f (stale) Mirror 6: 0x7bd5c66f (stale) Mirror 8: 0x7bd5c66f (stale) Mirror 9: 0x7bd5c66f (stale) Mirror 10: 0x7bd5c66f (stale) Mirror 11: 0x7bd5c66f (stale) Mirror 12: 0x7bd5c66f (stale) Mirror 13: 0x7bd5c66f (stale) Mirror 14: 0x7bd5c66f (stale) Mirror 15: 0x7bd5c66f (stale) Mirror 16: 0x7bd5c66f (stale) Mirror 17: 0x7bd5c66f (stale) Mirror 18: 0x7bd5c66f (stale) CRC-32 checksum value for chunk [0, 0xc): Mirror 1: 0x7bd5c66f Mirror 19: 0x7bd5c66f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc: skipped 000384 1788190576.357531 MIRROR_RESYNC 16 mirrors 000388 1788190578.547712 write 0x02d924 thru 0x03bff0 (0xe6cd bytes) 000389 1788190578.681007 read 0x02f271 thru 0x0334b2 (0x4242 bytes) 000390 1788190578.681793 write 0x029669 thru 0x039024 (0xf9bc bytes) 000393 1788190578.693225 trunc from 0x03bff1 to 0x00f9a7 (0x2c649 bytes) 000394 1788190578.730804 mapread 0x00500e thru 0x00f9a7 (0xa99a bytes) 000400 1788190578.772859 trunc from 0x00f9a8 to 0x01cd52 (0xd3ab bytes) 000402 1788190578.799617 mapwrite 0x023f03 thru 0x030381 (0xc47f bytes) 000404 1788190578.966996 trunc from 0x030382 to 0x025ee2 (0xa49f bytes) 000406 1788190579.017827 mapwrite 0x025aab thru 0x03018b (0xa6e1 bytes) 000407 1788190579.191489 MIRROR_RESYNC 16 mirrors 000408 1788190581.714298 read 0x004a56 thru 0x01144c (0xc9f7 bytes) 000410 1788190581.726073 trunc from 0x03018c to 0x03456b (0x43e0 bytes) 000414 1788190581.809992 mapwrite 0x01a0af thru 0x01b45e (0x13b0 bytes) 000416 1788190581.897275 mapwrite 0x009b44 thru 0x0133b8 (0x9875 bytes) 000418 1788190581.963009 mapread 0x014926 thru 0x01b872 (0x6f4d bytes) 000420 1788190581.965248 mapread 0x02f2b3 thru 0x03456b (0x52b9 bytes) 000421 1788190581.982052 mapread 0x002b87 thru 0x010c4a (0xe0c4 bytes) 000422 1788190581.983417 mapread 0x01da79 thru 0x022ff0 (0x5578 bytes) 000425 1788190582.032869 write 0x0047b2 thru 0x0085c6 (0x3e15 bytes) 000426 1788190582.034495 read 0x024d41 thru 0x033a0b (0xeccb bytes) 000427 1788190582.055044 mapwrite 0x032fdf thru 0x03e0d3 (0xb0f5 bytes) 000433 1788190582.188328 write 0x024dd6 thru 0x034975 (0xfba0 bytes) 000435 1788190582.195850 mapread 0x030945 thru 0x033a0c (0x30c8 bytes) 000436 1788190582.197369 trunc from 0x03e0d4 to 0x03796e (0x6765 bytes) 000438 1788190582.235334 trunc from 0x03796f to 0x006435 (0x31539 bytes) 000439 1788190582.257491 read 0x00552d thru 0x005ad9 (0x5ad bytes) 000443 1788190582.262227 mapread 0x003cc8 thru 0x006435 (0x276e bytes) 000444 1788190582.263899 mapread 0x004bfc thru 0x006435 (0x183a bytes) 000445 1788190582.265876 mapread 0x002de9 thru 0x003364 (0x57c bytes) 000446 1788190582.266869 mapwrite 0x00c10c thru 0x0154da (0x93cf bytes) 000447 1788190582.350560 mapwrite 0x0067a6 thru 0x014994 (0xe1ef bytes) 000450 1788190582.416081 read 0x0041e3 thru 0x0098cf (0x56ed bytes) 000452 1788190582.419277 trunc from 0x0154db to 0x039613 (0x24139 bytes) 000454 1788190582.445640 mapwrite 0x0323ad thru 0x037bb6 (0x580a bytes) 000455 1788190582.515907 mapread 0x007806 thru 0x010ba3 (0x939e bytes) 000456 1788190582.519859 read 0x00643f thru 0x006c36 (0x7f8 bytes) 000458 1788190582.523913 mapread 0x0049d8 thru 0x00eb1a (0xa143 bytes) 000459 1788190582.543521 MIRROR_SPLIT mirror 2 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39614): Mirror 3: 0xfdf4500a (stale) Mirror 6: 0xfdf4500a (stale) Mirror 8: 0xfdf4500a (stale) Mirror 9: 0xfdf4500a (stale) Mirror 10: 0xfdf4500a (stale) Mirror 11: 0xfdf4500a (stale) Mirror 12: 0xfdf4500a (stale) Mirror 13: 0xfdf4500a (stale) Mirror 14: 0xfdf4500a (stale) Mirror 15: 0xfdf4500a (stale) Mirror 16: 0xfdf4500a (stale) Mirror 17: 0xfdf4500a (stale) Mirror 18: 0xfdf4500a (stale) Mirror 19: 0xfdf4500a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39614): Mirror 3: 0xfdf4500a (stale) Mirror 6: 0xfdf4500a (stale) Mirror 8: 0xfdf4500a (stale) Mirror 9: 0xfdf4500a (stale) Mirror 10: 0xfdf4500a (stale) Mirror 11: 0xfdf4500a (stale) Mirror 12: 0xfdf4500a (stale) Mirror 13: 0xfdf4500a (stale) Mirror 14: 0xfdf4500a (stale) Mirror 15: 0xfdf4500a (stale) Mirror 16: 0xfdf4500a (stale) Mirror 17: 0xfdf4500a (stale) Mirror 18: 0xfdf4500a (stale) Mirror 19: 0xfdf4500a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39614: skipped 000460 1788190583.394367 write 0x02335f thru 0x0285df (0x5281 bytes) 000464 1788190583.407320 mapwrite 0x005d6e thru 0x011a1f (0xbcb2 bytes) 000467 1788190583.498572 MIRROR_RESYNC 15 mirrors 000468 1788190590.313134 MIRROR_RESYNC 15 mirrors 000471 1788190591.069087 trunc from 0x039614 to 0x031469 (0x81aa bytes) 000473 1788190591.168940 mapread 0x01605f thru 0x01bb46 (0x5ae8 bytes) 000474 1788190591.190587 mapread 0x006191 thru 0x00eae5 (0x8955 bytes) 000475 1788190591.199684 mapwrite 0x0216f1 thru 0x02ac61 (0x9571 bytes) 000476 1788190591.264156 mapread 0x0049d8 thru 0x009570 (0x4b99 bytes) 000478 1788190591.265835 mapread 0x018f76 thru 0x026c55 (0xdce0 bytes) 000479 1788190591.268233 trunc from 0x03146a to 0x004861 (0x2cc08 bytes) 000480 1788190591.296979 MIRROR_RESYNC 15 mirrors 000481 1788190593.643456 write 0x01f18d thru 0x02cd0c (0xdb80 bytes) 000483 1788190593.705948 mapwrite 0x01a41c thru 0x022840 (0x8425 bytes) 000484 1788190593.784183 mapwrite 0x02eaf2 thru 0x03113c (0x264b bytes) 000488 1788190593.859827 read 0x02f910 thru 0x03113c (0x182d bytes) 000489 1788190593.864916 MIRROR_RESYNC 15 mirrors 000490 1788190599.746239 mapread 0x0041be thru 0x008172 (0x3fb5 bytes) 000492 1788190599.769372 mapwrite 0x023da2 thru 0x03089c (0xcafb bytes) 000493 1788190600.005937 write 0x02b84e thru 0x02d0c1 (0x1874 bytes) 000494 1788190600.015840 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x3113d): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3113d): Mirror 3: 0xb213887e (stale) Mirror 6: 0xb213887e (stale) Mirror 8: 0xb213887e (stale) Mirror 9: 0xb213887e (stale) Mirror 10: 0xb213887e (stale) Mirror 11: 0xb213887e (stale) Mirror 12: 0xb213887e (stale) Mirror 13: 0xb213887e (stale) Mirror 14: 0xb213887e (stale) Mirror 15: 0xb213887e (stale) Mirror 16: 0xb213887e (stale) Mirror 17: 0xb213887e (stale) Mirror 18: 0xb213887e (stale) Mirror 19: 0xb213887e (stale) CRC-32 checksum value for chunk [0, 0x3113d): Mirror 1: 0x6ecb8bf3 Mirror 20: 0x6ecb8bf3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3113d: skipped 000495 1788190601.602602 mapread 0x02c0a8 thru 0x02e46f (0x23c8 bytes) 000496 1788190601.632588 read 0x01412b thru 0x01ed49 (0xac1f bytes) 000497 1788190601.651692 MIRROR_SPLIT mirror 4 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3113d): Mirror 3: 0xb213887e (stale) Mirror 6: 0xb213887e (stale) Mirror 8: 0xb213887e (stale) Mirror 10: 0xb213887e (stale) Mirror 11: 0xb213887e (stale) Mirror 12: 0xb213887e (stale) Mirror 13: 0xb213887e (stale) Mirror 14: 0xb213887e (stale) Mirror 15: 0xb213887e (stale) Mirror 16: 0xb213887e (stale) Mirror 17: 0xb213887e (stale) Mirror 18: 0xb213887e (stale) Mirror 19: 0xb213887e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3113d): Mirror 3: 0xb213887e (stale) Mirror 6: 0xb213887e (stale) Mirror 8: 0xb213887e (stale) Mirror 10: 0xb213887e (stale) Mirror 11: 0xb213887e (stale) Mirror 12: 0xb213887e (stale) Mirror 13: 0xb213887e (stale) Mirror 14: 0xb213887e (stale) Mirror 15: 0xb213887e (stale) Mirror 16: 0xb213887e (stale) Mirror 17: 0xb213887e (stale) Mirror 18: 0xb213887e (stale) Mirror 19: 0xb213887e (stale) CRC-32 checksum value for chunk [0, 0x3113d): Mirror 1: 0x6ecb8bf3 Mirror 20: 0x6ecb8bf3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3113d: skipped 000498 1788190602.903472 mapread 0x00d0d8 thru 0x01263b (0x5564 bytes) 000499 1788190603.007046 MIRROR_RESYNC 15 mirrors 000501 1788190608.527119 trunc from 0x03113d to 0x03294b (0x180f bytes) 000506 1788190608.722274 trunc from 0x03294c to 0x0114cd (0x2147e bytes) 000507 1788190608.762202 mapread 0x00b48e thru 0x00c972 (0x14e5 bytes) 000508 1788190608.787667 mapread 0x009c3f thru 0x0114cd (0x788f bytes) 000509 1788190608.805119 trunc from 0x0114ce to 0x022728 (0x1125b bytes) 000511 1788190608.838033 mapwrite 0x03b4c3 thru 0x03ca4b (0x1589 bytes) 000512 1788190609.003584 mapwrite 0x03015c thru 0x03b84a (0xb6ef bytes) 000514 1788190609.147201 MIRROR_SPLIT mirror 14 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ca4c): Mirror 3: 0x2a344ce6 (stale) Mirror 6: 0x2a344ce6 (stale) Mirror 8: 0x2a344ce6 (stale) Mirror 10: 0x2a344ce6 (stale) Mirror 11: 0x2a344ce6 (stale) Mirror 12: 0x2a344ce6 (stale) Mirror 13: 0x2a344ce6 (stale) Mirror 14: 0x2a344ce6 (stale) Mirror 15: 0x2a344ce6 (stale) Mirror 16: 0x2a344ce6 (stale) Mirror 17: 0x2a344ce6 (stale) Mirror 18: 0x2a344ce6 (stale) Mirror 19: 0x2a344ce6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ca4c): Mirror 3: 0x2a344ce6 (stale) Mirror 6: 0x2a344ce6 (stale) Mirror 8: 0x2a344ce6 (stale) Mirror 10: 0x2a344ce6 (stale) Mirror 11: 0x2a344ce6 (stale) Mirror 12: 0x2a344ce6 (stale) Mirror 13: 0x2a344ce6 (stale) Mirror 14: 0x2a344ce6 (stale) Mirror 15: 0x2a344ce6 (stale) Mirror 16: 0x2a344ce6 (stale) Mirror 17: 0x2a344ce6 (stale) Mirror 18: 0x2a344ce6 (stale) Mirror 19: 0x2a344ce6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ca4c: skipped 000516 1788190610.725852 MIRROR_SPLIT mirror 10 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ca4c): Mirror 3: 0x2a344ce6 (stale) Mirror 6: 0x2a344ce6 (stale) Mirror 8: 0x2a344ce6 (stale) Mirror 10: 0x2a344ce6 (stale) Mirror 11: 0x2a344ce6 (stale) Mirror 12: 0x2a344ce6 (stale) Mirror 13: 0x2a344ce6 (stale) Mirror 14: 0x2a344ce6 (stale) Mirror 15: 0x2a344ce6 (stale) Mirror 17: 0x2a344ce6 (stale) Mirror 18: 0x2a344ce6 (stale) Mirror 19: 0x2a344ce6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ca4c): Mirror 3: 0x2a344ce6 (stale) Mirror 6: 0x2a344ce6 (stale) Mirror 8: 0x2a344ce6 (stale) Mirror 10: 0x2a344ce6 (stale) Mirror 11: 0x2a344ce6 (stale) Mirror 12: 0x2a344ce6 (stale) Mirror 13: 0x2a344ce6 (stale) Mirror 14: 0x2a344ce6 (stale) Mirror 15: 0x2a344ce6 (stale) Mirror 17: 0x2a344ce6 (stale) Mirror 18: 0x2a344ce6 (stale) Mirror 19: 0x2a344ce6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ca4c: skipped 000519 1788190611.814194 mapread 0x015db8 thru 0x0187f7 (0x2a40 bytes) 000520 1788190611.837802 MIRROR_RESYNC 13 mirrors 000522 1788190616.564223 write 0x01b2d3 thru 0x0200b4 (0x4de2 bytes) 000523 1788190616.756154 MIRROR_SPLIT mirror 6 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ca4c): Mirror 3: 0xabe294b8 (stale) Mirror 6: 0xabe294b8 (stale) Mirror 8: 0xabe294b8 (stale) Mirror 10: 0xabe294b8 (stale) Mirror 11: 0xabe294b8 (stale) Mirror 13: 0xabe294b8 (stale) Mirror 14: 0xabe294b8 (stale) Mirror 15: 0xabe294b8 (stale) Mirror 17: 0xabe294b8 (stale) Mirror 18: 0xabe294b8 (stale) Mirror 19: 0xabe294b8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ca4c): Mirror 3: 0xabe294b8 (stale) Mirror 6: 0xabe294b8 (stale) Mirror 8: 0xabe294b8 (stale) Mirror 10: 0xabe294b8 (stale) Mirror 11: 0xabe294b8 (stale) Mirror 13: 0xabe294b8 (stale) Mirror 14: 0xabe294b8 (stale) Mirror 15: 0xabe294b8 (stale) Mirror 17: 0xabe294b8 (stale) Mirror 18: 0xabe294b8 (stale) Mirror 19: 0xabe294b8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ca4c: skipped 000524 1788190617.733090 trunc from 0x03ca4c to 0x0326b9 (0xa392 bytes) 000526 1788190617.749601 mapread 0x00e280 thru 0x01ce2a (0xebab bytes) 000531 1788190617.779562 read 0x006718 thru 0x0095f9 (0x2ee2 bytes) 000532 1788190617.785346 mapwrite 0x0046d8 thru 0x005208 (0xb31 bytes) 000533 1788190617.873295 trunc from 0x0326ba to 0x017956 (0x1ad63 bytes) 000534 1788190617.921440 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x17957): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17957): Mirror 3: 0xe07ab6f7 (stale) Mirror 6: 0xe07ab6f7 (stale) Mirror 8: 0xe07ab6f7 (stale) Mirror 10: 0xe07ab6f7 (stale) Mirror 11: 0xe07ab6f7 (stale) Mirror 13: 0xe07ab6f7 (stale) Mirror 14: 0xe07ab6f7 (stale) Mirror 15: 0xe07ab6f7 (stale) Mirror 17: 0xe07ab6f7 (stale) Mirror 18: 0xe07ab6f7 (stale) Mirror 19: 0xe07ab6f7 (stale) CRC-32 checksum value for chunk [0, 0x17957): Mirror 1: 0x668558b3 Mirror 20: 0x668558b3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17957: skipped 000535 1788190619.587843 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x17957): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17957): Mirror 3: 0xe07ab6f7 (stale) Mirror 6: 0xe07ab6f7 (stale) Mirror 8: 0xe07ab6f7 (stale) Mirror 10: 0xe07ab6f7 (stale) Mirror 11: 0xe07ab6f7 (stale) Mirror 13: 0xe07ab6f7 (stale) Mirror 14: 0xe07ab6f7 (stale) Mirror 15: 0xe07ab6f7 (stale) Mirror 17: 0xe07ab6f7 (stale) Mirror 18: 0xe07ab6f7 (stale) Mirror 19: 0xe07ab6f7 (stale) CRC-32 checksum value for chunk [0, 0x17957): Mirror 1: 0x668558b3 Mirror 20: 0x668558b3 Mirror 21: 0x668558b3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17957: skipped 000537 1788190621.176117 read 0x00bb3c thru 0x012454 (0x6919 bytes) 000538 1788190621.191625 MIRROR_SPLIT mirror 6 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17957): Mirror 3: 0xe07ab6f7 (stale) Mirror 6: 0xe07ab6f7 (stale) Mirror 8: 0xe07ab6f7 (stale) Mirror 10: 0xe07ab6f7 (stale) Mirror 11: 0xe07ab6f7 (stale) Mirror 14: 0xe07ab6f7 (stale) Mirror 15: 0xe07ab6f7 (stale) Mirror 17: 0xe07ab6f7 (stale) Mirror 18: 0xe07ab6f7 (stale) Mirror 19: 0xe07ab6f7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17957): Mirror 3: 0xe07ab6f7 (stale) Mirror 6: 0xe07ab6f7 (stale) Mirror 8: 0xe07ab6f7 (stale) Mirror 10: 0xe07ab6f7 (stale) Mirror 11: 0xe07ab6f7 (stale) Mirror 14: 0xe07ab6f7 (stale) Mirror 15: 0xe07ab6f7 (stale) Mirror 17: 0xe07ab6f7 (stale) Mirror 18: 0xe07ab6f7 (stale) Mirror 19: 0xe07ab6f7 (stale) CRC-32 checksum value for chunk [0, 0x17957): Mirror 1: 0x668558b3 Mirror 20: 0x668558b3 Mirror 21: 0x668558b3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17957: skipped 000540 1788190622.066323 MIRROR_RESYNC 13 mirrors 000541 1788190624.700777 mapwrite 0x01020f thru 0x01650e (0x6300 bytes) 000542 1788190625.136841 mapwrite 0x002b31 thru 0x011f37 (0xf407 bytes) 000543 1788190625.436415 MIRROR_RESYNC 13 mirrors 000544 1788190630.200935 mapwrite 0x009a15 thru 0x017a38 (0xe024 bytes) 000546 1788190630.575206 trunc from 0x017a39 to 0x03c3e4 (0x249ac bytes) 000547 1788190630.621462 mapread 0x01098d thru 0x01c7c2 (0xbe36 bytes) 000548 1788190630.655549 MIRROR_RESYNC 13 mirrors 000549 1788190634.284256 read 0x00cd23 thru 0x016b83 (0x9e61 bytes) 000550 1788190634.293696 write 0x03fa27 thru 0x03ffff (0x5d9 bytes) 000551 1788190634.369266 mapwrite 0x031ef1 thru 0x03a672 (0x8782 bytes) 000552 1788190634.472042 read 0x02a1f3 thru 0x0384fd (0xe30b bytes) 000553 1788190634.498120 mapread 0x030b41 thru 0x03bd69 (0xb229 bytes) 000556 1788190634.501475 write 0x0387fa thru 0x03ffff (0x7806 bytes) 000557 1788190634.508334 read 0x005a4d thru 0x00d4aa (0x7a5e bytes) 000565 1788190634.531482 mapwrite 0x036ae1 thru 0x03ffff (0x951f bytes) 000566 1788190634.626116 read 0x01bd64 thru 0x022d7e (0x701b bytes) 000568 1788190634.627450 write 0x026346 thru 0x0266ec (0x3a7 bytes) 000570 1788190634.633774 read 0x020dea thru 0x029f56 (0x916d bytes) 000571 1788190634.636911 write 0x0363ca thru 0x03ffff (0x9c36 bytes) 000572 1788190634.642187 write 0x020942 thru 0x027873 (0x6f32 bytes) 000573 1788190634.647481 write 0x01ba42 thru 0x024fcd (0x958c bytes) 000575 1788190634.655225 trunc from 0x040000 to 0x0279b6 (0x18649 bytes) 000576 1788190634.695532 trunc from 0x0279b7 to 0x039b8b (0x121d5 bytes) 000578 1788190634.724519 mapwrite 0x03e2f6 thru 0x03ffff (0x1d0a bytes) 000580 1788190634.917175 mapwrite 0x00d8d2 thru 0x010486 (0x2bb5 bytes) 000582 1788190635.053677 trunc from 0x040000 to 0x035c0b (0xa3f4 bytes) 000583 1788190635.075599 trunc from 0x035c0c to 0x002f7c (0x32c8f bytes) 000584 1788190635.091298 write 0x01093b thru 0x019a60 (0x9126 bytes) 000585 1788190635.092944 trunc from 0x019a61 to 0x030fce (0x1756e bytes) 000589 1788190635.117025 mapread 0x019c8c thru 0x02057c (0x68f1 bytes) 000590 1788190635.164903 mapread 0x0045a4 thru 0x00568a (0x10e7 bytes) 000591 1788190635.183987 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x30fcf): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30fcf): Mirror 3: 0x30e74ce1 (stale) Mirror 6: 0x30e74ce1 (stale) Mirror 8: 0x30e74ce1 (stale) Mirror 10: 0x30e74ce1 (stale) Mirror 11: 0x30e74ce1 (stale) Mirror 14: 0x30e74ce1 (stale) Mirror 15: 0x30e74ce1 (stale) Mirror 17: 0x30e74ce1 (stale) Mirror 18: 0x30e74ce1 (stale) Mirror 19: 0x30e74ce1 (stale) Mirror 20: 0x30e74ce1 (stale) Mirror 21: 0x30e74ce1 (stale) CRC-32 checksum value for chunk [0, 0x30fcf): Mirror 1: 0x2985fe45 Mirror 22: 0x2985fe45 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30fcf: skipped 000592 1788190637.370185 read 0x021b46 thru 0x0257e3 (0x3c9e bytes) 000594 1788190637.437249 mapread 0x027242 thru 0x030fce (0x9d8d bytes) 000595 1788190637.490893 read 0x030786 thru 0x030fce (0x849 bytes) 000598 1788190637.520238 write 0x0049d0 thru 0x010093 (0xb6c4 bytes) 000600 1788190637.775358 mapread 0x01fb88 thru 0x023ffa (0x4473 bytes) 000603 1788190637.780763 mapread 0x001cb3 thru 0x009535 (0x7883 bytes) 000606 1788190637.786219 mapwrite 0x03db38 thru 0x03ffff (0x24c8 bytes) 000607 1788190638.072626 MIRROR_RESYNC 14 mirrors 000608 1788190646.321699 mapread 0x01a9ad thru 0x02682e (0xbe82 bytes) 000609 1788190646.364897 write 0x0323f5 thru 0x03c8af (0xa4bb bytes) 000610 1788190646.489852 write 0x021e95 thru 0x02fbac (0xdd18 bytes) 000613 1788190646.508647 trunc from 0x040000 to 0x03d18d (0x2e72 bytes) 000614 1788190646.555160 read 0x01fafa thru 0x0235e3 (0x3aea bytes) 000618 1788190646.565076 write 0x00466c thru 0x008abc (0x4451 bytes) 000619 1788190646.580629 mapwrite 0x03f734 thru 0x03ffff (0x8cc bytes) 000621 1788190646.710668 read 0x0138a1 thru 0x013e18 (0x578 bytes) 000623 1788190646.729024 read 0x011cbf thru 0x01a65b (0x899d bytes) 000625 1788190646.733078 trunc from 0x040000 to 0x01cc82 (0x2337d bytes) 000630 1788190646.784185 mapwrite 0x0114d9 thru 0x01c960 (0xb488 bytes) 000632 1788190646.941103 MIRROR_RESYNC 14 mirrors 000633 1788190652.881241 read 0x0152a4 thru 0x017b26 (0x2883 bytes) 000635 1788190652.893921 trunc from 0x01cc83 to 0x018e96 (0x3dec bytes) 000636 1788190653.210382 read 0x0012d4 thru 0x010df5 (0xfb22 bytes) 000639 1788190653.232649 write 0x014493 thru 0x01fa37 (0xb5a5 bytes) 000640 1788190653.247525 MIRROR_RESYNC 14 mirrors 000642 1788190658.963957 write 0x01e993 thru 0x02161c (0x2c8a bytes) 000645 1788190659.214100 read 0x00668c thru 0x007de5 (0x175a bytes) 000647 1788190659.226835 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x2161d): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2161d): Mirror 3: 0x3e66871 (stale) Mirror 6: 0x3e66871 (stale) Mirror 8: 0x3e66871 (stale) Mirror 10: 0x3e66871 (stale) Mirror 11: 0x3e66871 (stale) Mirror 14: 0x3e66871 (stale) Mirror 15: 0x3e66871 (stale) Mirror 17: 0x3e66871 (stale) Mirror 18: 0x3e66871 (stale) Mirror 19: 0x3e66871 (stale) Mirror 20: 0x3e66871 (stale) Mirror 21: 0x3e66871 (stale) Mirror 22: 0x3e66871 (stale) CRC-32 checksum value for chunk [0, 0x2161d): Mirror 1: 0x82d655cd Mirror 23: 0x82d655cd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2161d: skipped 000650 1788190662.113221 trunc from 0x02161d to 0x0205a0 (0x107c bytes) 000652 1788190662.519258 read 0x01817e thru 0x01ee76 (0x6cf9 bytes) 000653 1788190662.538083 write 0x025640 thru 0x0264cb (0xe8c bytes) 000657 1788190662.555319 mapread 0x022430 thru 0x0264cb (0x409c bytes) 000659 1788190662.603655 mapread 0x0243f1 thru 0x0264cb (0x20db bytes) 000661 1788190662.613310 mapwrite 0x00537f thru 0x009832 (0x44b4 bytes) 000663 1788190662.791357 MIRROR_SPLIT mirror 1 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x264cc): Mirror 6: 0xf17f6e6b (stale) Mirror 8: 0xf17f6e6b (stale) Mirror 10: 0xf17f6e6b (stale) Mirror 11: 0xf17f6e6b (stale) Mirror 14: 0xf17f6e6b (stale) Mirror 15: 0xf17f6e6b (stale) Mirror 17: 0xf17f6e6b (stale) Mirror 18: 0xf17f6e6b (stale) Mirror 19: 0xf17f6e6b (stale) Mirror 20: 0xf17f6e6b (stale) Mirror 21: 0xf17f6e6b (stale) Mirror 22: 0xf17f6e6b (stale) Mirror 23: 0x634f510d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x264cc): Mirror 6: 0xf17f6e6b (stale) Mirror 8: 0xf17f6e6b (stale) Mirror 10: 0xf17f6e6b (stale) Mirror 11: 0xf17f6e6b (stale) Mirror 14: 0xf17f6e6b (stale) Mirror 15: 0xf17f6e6b (stale) Mirror 17: 0xf17f6e6b (stale) Mirror 18: 0xf17f6e6b (stale) Mirror 19: 0xf17f6e6b (stale) Mirror 20: 0xf17f6e6b (stale) Mirror 21: 0xf17f6e6b (stale) Mirror 22: 0xf17f6e6b (stale) Mirror 23: 0x634f510d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x264cc: skipped 000664 1788190663.875372 MIRROR_RESYNC 14 mirrors 000665 1788190669.261273 MIRROR_RESYNC 14 mirrors 000666 1788190670.184921 trunc from 0x0264cc to 0x03885c (0x12391 bytes) 000672 1788190670.443914 write 0x0169c0 thru 0x01fd99 (0x93da bytes) 000675 1788190670.464423 read 0x02c238 thru 0x0314ee (0x52b7 bytes) 000677 1788190670.487213 mapread 0x005a1d thru 0x012faf (0xd593 bytes) 000678 1788190670.541296 read 0x027110 thru 0x028ff7 (0x1ee8 bytes) 000680 1788190670.572520 mapread 0x029cb4 thru 0x02ce3f (0x318c bytes) 000682 1788190670.579428 read 0x003550 thru 0x00fe98 (0xc949 bytes) 000684 1788190670.586085 mapread 0x00e3fa thru 0x0125c1 (0x41c8 bytes) 000688 1788190670.612661 trunc from 0x03885d to 0x0308d4 (0x7f88 bytes) 000689 1788190670.656661 write 0x03e2b6 thru 0x03ffff (0x1d4a bytes) 000690 1788190670.659587 write 0x026ffc thru 0x02e06a (0x706f bytes) 000691 1788190670.662377 write 0x025b92 thru 0x02bbd1 (0x6040 bytes) 000693 1788190670.669513 MIRROR_RESYNC 14 mirrors 000694 1788190678.069026 mapwrite 0x013c02 thru 0x01766b (0x3a6a bytes) 000695 1788190678.426445 write 0x023b39 thru 0x031889 (0xdd51 bytes) truncating to largest ever: 0x3fc9a 000696 1788190678.448958 trunc from 0x040000 to 0x03fc99 (0x366 bytes) 000697 1788190678.554696 read 0x03e7f4 thru 0x03fc99 (0x14a6 bytes) 000698 1788190678.594557 write 0x0268d9 thru 0x02acf8 (0x4420 bytes) 000699 1788190678.603958 mapread 0x005deb thru 0x008b7b (0x2d91 bytes) 000701 1788190678.639719 mapwrite 0x036d66 thru 0x03ffff (0x929a bytes) 000702 1788190678.904909 trunc from 0x040000 to 0x016f3b (0x290c4 bytes) 000704 1788190678.929878 mapread 0x0125c1 thru 0x016258 (0x3c98 bytes) 000705 1788190678.934935 read 0x00a8eb thru 0x00dfc6 (0x36dc bytes) 000706 1788190678.935868 mapwrite 0x025bdf thru 0x03436a (0xe78c bytes) 000708 1788190679.215617 mapread 0x00b781 thru 0x00e1de (0x2a5e bytes) 000709 1788190679.225800 mapwrite 0x03033c thru 0x034a18 (0x46dd bytes) 000710 1788190679.426088 read 0x01e454 thru 0x026362 (0x7f0f bytes) 000711 1788190679.427584 read 0x02608e thru 0x02f475 (0x93e8 bytes) 000713 1788190679.443796 MIRROR_SPLIT mirror 9 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34a19): Mirror 6: 0x92bf6cbf (stale) Mirror 8: 0x92bf6cbf (stale) Mirror 10: 0x92bf6cbf (stale) Mirror 11: 0x92bf6cbf (stale) Mirror 14: 0x92bf6cbf (stale) Mirror 15: 0x92bf6cbf (stale) Mirror 17: 0x92bf6cbf (stale) Mirror 18: 0x92bf6cbf (stale) Mirror 20: 0x92bf6cbf (stale) Mirror 21: 0x92bf6cbf (stale) Mirror 22: 0x92bf6cbf (stale) Mirror 23: 0x92bf6cbf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34a19): Mirror 6: 0x92bf6cbf (stale) Mirror 8: 0x92bf6cbf (stale) Mirror 10: 0x92bf6cbf (stale) Mirror 11: 0x92bf6cbf (stale) Mirror 14: 0x92bf6cbf (stale) Mirror 15: 0x92bf6cbf (stale) Mirror 17: 0x92bf6cbf (stale) Mirror 18: 0x92bf6cbf (stale) Mirror 20: 0x92bf6cbf (stale) Mirror 21: 0x92bf6cbf (stale) Mirror 22: 0x92bf6cbf (stale) Mirror 23: 0x92bf6cbf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34a19: skipped 000714 1788190680.711243 MIRROR_RESYNC 13 mirrors 000717 1788190686.747421 MIRROR_EXTEND to 14 mirrors 000718 1788190688.354276 MIRROR_RESYNC 14 mirrors 000720 1788190689.532433 MIRROR_EXTEND to 15 mirrors 000724 1788190690.869130 write 0x0235f4 thru 0x024f45 (0x1952 bytes) 000725 1788190690.976851 mapwrite 0x02df0d thru 0x036272 (0x8366 bytes) 000727 1788190691.089113 write 0x03307f thru 0x039284 (0x6206 bytes) 000728 1788190691.091603 mapwrite 0x01fe67 thru 0x02f21d (0xf3b7 bytes) 000731 1788190691.153103 read 0x030886 thru 0x031164 (0x8df bytes) 000732 1788190691.155602 mapwrite 0x02050a thru 0x0283f8 (0x7eef bytes) 000733 1788190691.206792 mapread 0x009835 thru 0x010ad8 (0x72a4 bytes) 000734 1788190691.217253 read 0x028bc5 thru 0x031cbc (0x90f8 bytes) 000735 1788190691.219503 trunc from 0x039285 to 0x0266b9 (0x12bcb bytes) 000736 1788190691.235605 write 0x039ed6 thru 0x03ec4f (0x4d7a bytes) 000737 1788190691.236889 trunc from 0x03ec50 to 0x039b1b (0x5134 bytes) 000739 1788190691.263002 trunc from 0x039b1c to 0x02a73b (0xf3e0 bytes) 000740 1788190691.281407 trunc from 0x02a73c to 0x0190a2 (0x11699 bytes) 000741 1788190691.294881 write 0x000c4b thru 0x00dd11 (0xd0c7 bytes) 000742 1788190691.309662 MIRROR_RESYNC 15 mirrors 000746 1788190694.199407 trunc from 0x0190a3 to 0x02e845 (0x157a3 bytes) 000748 1788190694.277904 write 0x022e03 thru 0x029e31 (0x702f bytes) 000749 1788190694.294311 write 0x03a610 thru 0x03ffff (0x59f0 bytes) 000753 1788190694.300578 read 0x0177ab thru 0x01b54b (0x3da1 bytes) 000754 1788190694.312178 mapread 0x02617d thru 0x02aaf4 (0x4978 bytes) 000755 1788190694.328049 mapread 0x019247 thru 0x0273bf (0xe179 bytes) 000756 1788190694.343988 read 0x0370f7 thru 0x03ffff (0x8f09 bytes) 000757 1788190694.356185 mapwrite 0x013745 thru 0x01a059 (0x6915 bytes) 000759 1788190694.429878 trunc from 0x040000 to 0x03cc6b (0x3394 bytes) 000760 1788190694.474639 trunc from 0x03cc6c to 0x030bab (0xc0c0 bytes) 000763 1788190694.490151 write 0x033861 thru 0x03ffff (0xc79f bytes) 000765 1788190694.494468 read 0x00728d thru 0x00a919 (0x368d bytes) 000767 1788190694.496210 mapread 0x03afa3 thru 0x03ffff (0x505d bytes) 000768 1788190694.499294 write 0x0211ea thru 0x02db5f (0xc976 bytes) 000769 1788190694.509495 MIRROR_RESYNC 15 mirrors 000770 1788190699.739352 mapread 0x0016bc thru 0x00b848 (0xa18d bytes) 000771 1788190699.775508 read 0x03eea1 thru 0x03ffff (0x115f bytes) 000774 1788190699.787175 read 0x014111 thru 0x020869 (0xc759 bytes) 000776 1788190699.808343 write 0x01d634 thru 0x01db4f (0x51c bytes) 000777 1788190699.953826 write 0x00e334 thru 0x015e04 (0x7ad1 bytes) 000778 1788190699.971380 trunc from 0x040000 to 0x011bc6 (0x2e439 bytes) 000780 1788190700.028117 trunc from 0x011bc7 to 0x016ee2 (0x531c bytes) 000782 1788190700.066040 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x16ee3): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16ee3): Mirror 6: 0x7a9f7ff6 (stale) Mirror 8: 0x7a9f7ff6 (stale) Mirror 10: 0x7a9f7ff6 (stale) Mirror 11: 0x7a9f7ff6 (stale) Mirror 14: 0x7a9f7ff6 (stale) Mirror 15: 0x7a9f7ff6 (stale) Mirror 17: 0x7a9f7ff6 (stale) Mirror 18: 0x7a9f7ff6 (stale) Mirror 20: 0x7a9f7ff6 (stale) Mirror 21: 0x7a9f7ff6 (stale) Mirror 22: 0x7a9f7ff6 (stale) Mirror 23: 0x7a9f7ff6 (stale) Mirror 24: 0x7a9f7ff6 (stale) Mirror 25: 0x7a9f7ff6 (stale) CRC-32 checksum value for chunk [0, 0x16ee3): Mirror 1: 0x678d2a4a Mirror 26: 0x678d2a4a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16ee3: skipped 000784 1788190701.478473 write 0x001836 thru 0x0102db (0xeaa6 bytes) 000785 1788190701.637328 mapwrite 0x0146e8 thru 0x021909 (0xd222 bytes) 000787 1788190701.758701 MIRROR_SPLIT mirror 14 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2190a): Mirror 6: 0xe009f327 (stale) Mirror 8: 0xe009f327 (stale) Mirror 10: 0xe009f327 (stale) Mirror 11: 0xe009f327 (stale) Mirror 14: 0xe009f327 (stale) Mirror 15: 0xe009f327 (stale) Mirror 17: 0xe009f327 (stale) Mirror 18: 0xe009f327 (stale) Mirror 20: 0xe009f327 (stale) Mirror 21: 0xe009f327 (stale) Mirror 22: 0xe009f327 (stale) Mirror 23: 0xe009f327 (stale) Mirror 24: 0xe009f327 (stale) Mirror 26: 0x3f8587a8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2190a): Mirror 6: 0xe009f327 (stale) Mirror 8: 0xe009f327 (stale) Mirror 10: 0xe009f327 (stale) Mirror 11: 0xe009f327 (stale) Mirror 14: 0xe009f327 (stale) Mirror 15: 0xe009f327 (stale) Mirror 17: 0xe009f327 (stale) Mirror 18: 0xe009f327 (stale) Mirror 20: 0xe009f327 (stale) Mirror 21: 0xe009f327 (stale) Mirror 22: 0xe009f327 (stale) Mirror 23: 0xe009f327 (stale) Mirror 24: 0xe009f327 (stale) Mirror 26: 0x3f8587a8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2190a: skipped 000788 1788190702.433998 MIRROR_SPLIT mirror 5 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2190a): Mirror 6: 0xe009f327 (stale) Mirror 8: 0xe009f327 (stale) Mirror 10: 0xe009f327 (stale) Mirror 11: 0xe009f327 (stale) Mirror 15: 0xe009f327 (stale) Mirror 17: 0xe009f327 (stale) Mirror 18: 0xe009f327 (stale) Mirror 20: 0xe009f327 (stale) Mirror 21: 0xe009f327 (stale) Mirror 22: 0xe009f327 (stale) Mirror 23: 0xe009f327 (stale) Mirror 24: 0xe009f327 (stale) Mirror 26: 0x3f8587a8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2190a): Mirror 6: 0xe009f327 (stale) Mirror 8: 0xe009f327 (stale) Mirror 10: 0xe009f327 (stale) Mirror 11: 0xe009f327 (stale) Mirror 15: 0xe009f327 (stale) Mirror 17: 0xe009f327 (stale) Mirror 18: 0xe009f327 (stale) Mirror 20: 0xe009f327 (stale) Mirror 21: 0xe009f327 (stale) Mirror 22: 0xe009f327 (stale) Mirror 23: 0xe009f327 (stale) Mirror 24: 0xe009f327 (stale) Mirror 26: 0x3f8587a8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2190a: skipped 000791 1788190703.193654 mapwrite 0x00f672 thru 0x019768 (0xa0f7 bytes) 000793 1788190703.263614 mapwrite 0x00b076 thru 0x00eca7 (0x3c32 bytes) 000796 1788190703.305008 mapread 0x01cd03 thru 0x021909 (0x4c07 bytes) 000797 1788190703.313953 write 0x03815e thru 0x03e692 (0x6535 bytes) 000799 1788190703.321097 MIRROR_RESYNC 14 mirrors 000800 1788190707.050506 MIRROR_EXTEND to 15 mirrors 000801 1788190708.394865 trunc from 0x03e693 to 0x03515d (0x9535 bytes) 000803 1788190708.523169 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x3515e): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3515e): Mirror 6: 0xbfd9e919 (stale) Mirror 8: 0xbfd9e919 (stale) Mirror 10: 0xbfd9e919 (stale) Mirror 11: 0xbfd9e919 (stale) Mirror 15: 0xbfd9e919 (stale) Mirror 17: 0xbfd9e919 (stale) Mirror 18: 0xbfd9e919 (stale) Mirror 20: 0xbfd9e919 (stale) Mirror 21: 0xbfd9e919 (stale) Mirror 22: 0xbfd9e919 (stale) Mirror 23: 0xbfd9e919 (stale) Mirror 24: 0xbfd9e919 (stale) Mirror 26: 0xbfd9e919 (stale) Mirror 27: 0xbfd9e919 (stale) CRC-32 checksum value for chunk [0, 0x3515e): Mirror 1: 0xbfd9e919 Mirror 28: 0xbfd9e919 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3515e: skipped 000804 1788190709.508476 mapwrite 0x00a799 thru 0x0110fc (0x6964 bytes) 000806 1788190709.695500 MIRROR_RESYNC 16 mirrors 000808 1788190712.667662 write 0x00d938 thru 0x016ba3 (0x926c bytes) 000810 1788190712.790441 read 0x02dd3b thru 0x02e60e (0x8d4 bytes) 000811 1788190712.805005 trunc from 0x03515e to 0x019096 (0x1c0c7 bytes) 000812 1788190712.830605 trunc from 0x019097 to 0x016c6d (0x2429 bytes) 000813 1788190712.854986 read 0x001808 thru 0x00ce58 (0xb651 bytes) 000815 1788190712.863116 read 0x004350 thru 0x011a3a (0xd6eb bytes) 000818 1788190712.869698 MIRROR_SPLIT mirror 8 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16c6e): Mirror 6: 0xf2356695 (stale) Mirror 8: 0xf2356695 (stale) Mirror 10: 0xf2356695 (stale) Mirror 11: 0xf2356695 (stale) Mirror 15: 0xf2356695 (stale) Mirror 17: 0xf2356695 (stale) Mirror 18: 0xf2356695 (stale) Mirror 21: 0xf2356695 (stale) Mirror 22: 0xf2356695 (stale) Mirror 23: 0xf2356695 (stale) Mirror 24: 0xf2356695 (stale) Mirror 26: 0xf2356695 (stale) Mirror 27: 0xf2356695 (stale) Mirror 28: 0xf2356695 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16c6e): Mirror 6: 0xf2356695 (stale) Mirror 8: 0xf2356695 (stale) Mirror 10: 0xf2356695 (stale) Mirror 11: 0xf2356695 (stale) Mirror 15: 0xf2356695 (stale) Mirror 17: 0xf2356695 (stale) Mirror 18: 0xf2356695 (stale) Mirror 21: 0xf2356695 (stale) Mirror 22: 0xf2356695 (stale) Mirror 23: 0xf2356695 (stale) Mirror 24: 0xf2356695 (stale) Mirror 26: 0xf2356695 (stale) Mirror 27: 0xf2356695 (stale) Mirror 28: 0xf2356695 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16c6e: skipped 000819 1788190713.787015 mapread 0x0082e0 thru 0x00bd82 (0x3aa3 bytes) 000820 1788190713.815179 write 0x037989 thru 0x03ffff (0x8677 bytes) 000821 1788190713.818986 mapread 0x00436a thru 0x0058ae (0x1545 bytes) 000823 1788190713.821292 trunc from 0x040000 to 0x025aba (0x1a545 bytes) 000824 1788190713.871383 MIRROR_SPLIT mirror 11 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25abb): Mirror 6: 0xce2c815a (stale) Mirror 8: 0xce2c815a (stale) Mirror 10: 0xce2c815a (stale) Mirror 11: 0xce2c815a (stale) Mirror 15: 0xce2c815a (stale) Mirror 17: 0xce2c815a (stale) Mirror 18: 0xce2c815a (stale) Mirror 21: 0xce2c815a (stale) Mirror 22: 0xce2c815a (stale) Mirror 23: 0xce2c815a (stale) Mirror 26: 0xce2c815a (stale) Mirror 27: 0xce2c815a (stale) Mirror 28: 0xce2c815a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25abb): Mirror 6: 0xce2c815a (stale) Mirror 8: 0xce2c815a (stale) Mirror 10: 0xce2c815a (stale) Mirror 11: 0xce2c815a (stale) Mirror 15: 0xce2c815a (stale) Mirror 17: 0xce2c815a (stale) Mirror 18: 0xce2c815a (stale) Mirror 21: 0xce2c815a (stale) Mirror 22: 0xce2c815a (stale) Mirror 23: 0xce2c815a (stale) Mirror 26: 0xce2c815a (stale) Mirror 27: 0xce2c815a (stale) Mirror 28: 0xce2c815a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25abb: skipped 000826 1788190714.590359 trunc from 0x025abb to 0x010b5c (0x14f5e bytes) 000827 1788190714.602774 mapwrite 0x009f8f thru 0x0160d6 (0xc148 bytes) 000829 1788190714.697253 mapread 0x0050dc thru 0x00c874 (0x7799 bytes) 000830 1788190714.699750 mapwrite 0x0136b4 thru 0x01872e (0x507b bytes) 000831 1788190714.772072 write 0x025f8f thru 0x02c6f0 (0x6762 bytes) 000832 1788190714.773596 trunc from 0x02c6f1 to 0x01277f (0x19f71 bytes) 000833 1788190714.798984 MIRROR_SPLIT mirror 3 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x12780): Mirror 6: 0x4e577d28 (stale) Mirror 8: 0x4e577d28 (stale) Mirror 11: 0x4e577d28 (stale) Mirror 15: 0x4e577d28 (stale) Mirror 17: 0x4e577d28 (stale) Mirror 18: 0x4e577d28 (stale) Mirror 21: 0x4e577d28 (stale) Mirror 22: 0x4e577d28 (stale) Mirror 23: 0x4e577d28 (stale) Mirror 26: 0x4e577d28 (stale) Mirror 27: 0x4e577d28 (stale) Mirror 28: 0x4e577d28 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12780): Mirror 6: 0x4e577d28 (stale) Mirror 8: 0x4e577d28 (stale) Mirror 11: 0x4e577d28 (stale) Mirror 15: 0x4e577d28 (stale) Mirror 17: 0x4e577d28 (stale) Mirror 18: 0x4e577d28 (stale) Mirror 21: 0x4e577d28 (stale) Mirror 22: 0x4e577d28 (stale) Mirror 23: 0x4e577d28 (stale) Mirror 26: 0x4e577d28 (stale) Mirror 27: 0x4e577d28 (stale) Mirror 28: 0x4e577d28 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12780: skipped 000834 1788190715.443677 trunc from 0x012780 to 0x007019 (0xb766 bytes) 000835 1788190715.458540 trunc from 0x00701a to 0x014d28 (0xdd0f bytes) 000836 1788190715.476217 trunc from 0x014d29 to 0x0065fd (0xe72b bytes) 000839 1788190715.489027 mapread 0x0049e9 thru 0x0065fd (0x1c15 bytes) 000840 1788190715.506267 mapwrite 0x026795 thru 0x031fe5 (0xb851 bytes) 000841 1788190715.595334 mapwrite 0x02b1ac thru 0x02b8e6 (0x73b bytes) 000843 1788190715.627850 write 0x0349cc thru 0x03ffff (0xb634 bytes) 000844 1788190715.630420 mapread 0x015617 thru 0x01d30e (0x7cf8 bytes) 000846 1788190715.644375 trunc from 0x040000 to 0x024be4 (0x1b41b bytes) 000847 1788190715.679281 write 0x032a16 thru 0x03ffff (0xd5ea bytes) 000849 1788190715.698858 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xa0f8e4cc (stale) Mirror 11: 0xa0f8e4cc (stale) Mirror 15: 0xa0f8e4cc (stale) Mirror 17: 0xa0f8e4cc (stale) Mirror 18: 0xa0f8e4cc (stale) Mirror 21: 0xa0f8e4cc (stale) Mirror 22: 0xa0f8e4cc (stale) Mirror 23: 0xa0f8e4cc (stale) Mirror 26: 0xa0f8e4cc (stale) Mirror 27: 0xa0f8e4cc (stale) Mirror 28: 0xa0f8e4cc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xa0f8e4cc (stale) Mirror 11: 0xa0f8e4cc (stale) Mirror 15: 0xa0f8e4cc (stale) Mirror 17: 0xa0f8e4cc (stale) Mirror 18: 0xa0f8e4cc (stale) Mirror 21: 0xa0f8e4cc (stale) Mirror 22: 0xa0f8e4cc (stale) Mirror 23: 0xa0f8e4cc (stale) Mirror 26: 0xa0f8e4cc (stale) Mirror 27: 0xa0f8e4cc (stale) Mirror 28: 0xa0f8e4cc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000850 1788190716.660260 read 0x0095a8 thru 0x010b3c (0x7595 bytes) 000851 1788190716.673302 read 0x036283 thru 0x03ffff (0x9d7d bytes) 000854 1788190716.705946 trunc from 0x040000 to 0x027701 (0x188fe bytes) 000856 1788190716.745135 write 0x011a3f thru 0x01a207 (0x87c9 bytes) 000857 1788190716.757681 read 0x0165a6 thru 0x01bb55 (0x55b0 bytes) 000858 1788190716.770986 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x27702): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27702): Mirror 8: 0xfd168756 (stale) Mirror 11: 0xfd168756 (stale) Mirror 15: 0xfd168756 (stale) Mirror 17: 0xfd168756 (stale) Mirror 18: 0xfd168756 (stale) Mirror 21: 0xfd168756 (stale) Mirror 22: 0xfd168756 (stale) Mirror 23: 0xfd168756 (stale) Mirror 26: 0xfd168756 (stale) Mirror 27: 0xfd168756 (stale) Mirror 28: 0xfd168756 (stale) CRC-32 checksum value for chunk [0, 0x27702): Mirror 1: 0xaf29be84 Mirror 29: 0xaf29be84 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27702: skipped 000859 1788190717.998771 mapread 0x021ecd thru 0x027701 (0x5835 bytes) 000861 1788190718.033773 mapwrite 0x004ad0 thru 0x00cfab (0x84dc bytes) 000863 1788190718.275999 mapwrite 0x01d0c3 thru 0x02897e (0xb8bc bytes) 000864 1788190718.406848 trunc from 0x02897f to 0x0125bd (0x163c1 bytes) 000865 1788190718.421903 mapread 0x006eb0 thru 0x009aa4 (0x2bf5 bytes) 000866 1788190718.423021 mapwrite 0x027d18 thru 0x02d175 (0x545e bytes) 000868 1788190718.557264 trunc from 0x02d176 to 0x03b791 (0xe61c bytes) 000869 1788190718.581997 write 0x01984d thru 0x024fa7 (0xb75b bytes) 000870 1788190718.588938 mapwrite 0x0383f9 thru 0x03ae49 (0x2a51 bytes) 000872 1788190718.639104 mapwrite 0x034eb7 thru 0x03ffff (0xb149 bytes) 000873 1788190718.711684 MIRROR_SPLIT mirror 7 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xa0f8e4cc (stale) Mirror 11: 0xa0f8e4cc (stale) Mirror 15: 0xa0f8e4cc (stale) Mirror 17: 0xa0f8e4cc (stale) Mirror 18: 0xa0f8e4cc (stale) Mirror 21: 0xa0f8e4cc (stale) Mirror 23: 0xa0f8e4cc (stale) Mirror 26: 0xa0f8e4cc (stale) Mirror 27: 0xa0f8e4cc (stale) Mirror 28: 0xa0f8e4cc (stale) Mirror 29: 0xbe5e0164 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xa0f8e4cc (stale) Mirror 11: 0xa0f8e4cc (stale) Mirror 15: 0xa0f8e4cc (stale) Mirror 17: 0xa0f8e4cc (stale) Mirror 18: 0xa0f8e4cc (stale) Mirror 21: 0xa0f8e4cc (stale) Mirror 23: 0xa0f8e4cc (stale) Mirror 26: 0xa0f8e4cc (stale) Mirror 27: 0xa0f8e4cc (stale) Mirror 28: 0xa0f8e4cc (stale) Mirror 29: 0xbe5e0164 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000874 1788190719.555433 mapwrite 0x00b809 thru 0x012843 (0x703b bytes) 000875 1788190719.651396 mapwrite 0x01b38e thru 0x021210 (0x5e83 bytes) 000876 1788190719.744062 trunc from 0x040000 to 0x01b73e (0x248c1 bytes) 000879 1788190719.765967 read 0x00c654 thru 0x016d79 (0xa726 bytes) 000880 1788190719.767534 trunc from 0x01b73f to 0x00ba53 (0xfceb bytes) 000881 1788190719.798224 mapwrite 0x026a1a thru 0x030425 (0x9a0c bytes) 000882 1788190719.895812 write 0x01f98c thru 0x01fdf5 (0x46a bytes) 000883 1788190719.902489 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x30426): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30426): Mirror 8: 0x44fa3215 (stale) Mirror 11: 0x44fa3215 (stale) Mirror 15: 0x44fa3215 (stale) Mirror 17: 0x44fa3215 (stale) Mirror 18: 0x44fa3215 (stale) Mirror 21: 0x44fa3215 (stale) Mirror 23: 0x44fa3215 (stale) Mirror 26: 0x44fa3215 (stale) Mirror 27: 0x44fa3215 (stale) Mirror 28: 0x44fa3215 (stale) Mirror 29: 0xf574795b (stale) CRC-32 checksum value for chunk [0, 0x30426): Mirror 1: 0xae9ad7e5 Mirror 30: 0xae9ad7e5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30426: skipped 000884 1788190721.361670 read 0x000b0c thru 0x010109 (0xf5fe bytes) 000885 1788190721.383777 mapwrite 0x00b72f thru 0x01a54b (0xee1d bytes) 000888 1788190721.596936 trunc from 0x030426 to 0x00d1c0 (0x23265 bytes) 000890 1788190721.624518 write 0x038bbe thru 0x03ffff (0x7442 bytes) 000892 1788190721.629174 mapwrite 0x0015e3 thru 0x004b2c (0x354a bytes) 000893 1788190721.699443 mapread 0x00dddb thru 0x017d1a (0x9f40 bytes) 000894 1788190721.709215 read 0x031db6 thru 0x0326c4 (0x90f bytes) 000895 1788190721.717406 write 0x009e5e thru 0x019e0a (0xffad bytes) 000896 1788190721.718917 write 0x01d021 thru 0x01f1ed (0x21cd bytes) 000897 1788190721.720751 mapwrite 0x023818 thru 0x02deae (0xa697 bytes) 000899 1788190721.776568 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xa0f8e4cc (stale) Mirror 11: 0xa0f8e4cc (stale) Mirror 15: 0xa0f8e4cc (stale) Mirror 17: 0xa0f8e4cc (stale) Mirror 18: 0xa0f8e4cc (stale) Mirror 21: 0xa0f8e4cc (stale) Mirror 23: 0xa0f8e4cc (stale) Mirror 26: 0xa0f8e4cc (stale) Mirror 27: 0xa0f8e4cc (stale) Mirror 28: 0xa0f8e4cc (stale) Mirror 29: 0xbe5e0164 (stale) Mirror 30: 0xe9d0712f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdbbb27b6 Mirror 31: 0xdbbb27b6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000900 1788190723.450231 read 0x02eab2 thru 0x0314b4 (0x2a03 bytes) 000902 1788190723.490207 trunc from 0x040000 to 0x00916e (0x36e91 bytes) 000905 1788190723.697281 read 0x00685f thru 0x00916e (0x2910 bytes) 000907 1788190723.710568 mapwrite 0x00e100 thru 0x011246 (0x3147 bytes) 000909 1788190723.848106 mapwrite 0x0149fd thru 0x022010 (0xd614 bytes) 000910 1788190724.017597 mapwrite 0x023c06 thru 0x02b798 (0x7b93 bytes) 000911 1788190724.120245 mapwrite 0x012f00 thru 0x014608 (0x1709 bytes) 000912 1788190724.199325 MIRROR_RESYNC 14 mirrors 000913 1788190728.399417 read 0x023a35 thru 0x02b029 (0x75f5 bytes) 000915 1788190728.411600 mapwrite 0x01d0bd thru 0x02a2a0 (0xd1e4 bytes) 000916 1788190728.785248 MIRROR_RESYNC 14 mirrors 000918 1788190732.446184 mapread 0x003322 thru 0x009f6d (0x6c4c bytes) 000919 1788190732.472048 read 0x01d94e thru 0x02b798 (0xde4b bytes) 000921 1788190732.483078 read 0x016e3a thru 0x01ac81 (0x3e48 bytes) 000922 1788190732.496498 write 0x0214ab thru 0x0271be (0x5d14 bytes) 000923 1788190732.660126 mapread 0x01a43d thru 0x022f5d (0x8b21 bytes) 000924 1788190732.753797 write 0x032f58 thru 0x03c51a (0x95c3 bytes) 000925 1788190732.761128 write 0x03bcae thru 0x03ffff (0x4352 bytes) 000926 1788190732.768511 read 0x011735 thru 0x01f7b2 (0xe07e bytes) 000928 1788190732.804042 read 0x0098a6 thru 0x00fe6b (0x65c6 bytes) 000930 1788190732.818589 read 0x000509 thru 0x00e187 (0xdc7f bytes) 000931 1788190732.820108 trunc from 0x040000 to 0x02e48c (0x11b73 bytes) 000933 1788190732.896372 MIRROR_SPLIT mirror 6 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e48d): Mirror 8: 0x80cc046b (stale) Mirror 11: 0x80cc046b (stale) Mirror 15: 0x80cc046b (stale) Mirror 17: 0x80cc046b (stale) Mirror 18: 0x80cc046b (stale) Mirror 23: 0x80cc046b (stale) Mirror 26: 0x80cc046b (stale) Mirror 27: 0x80cc046b (stale) Mirror 28: 0x80cc046b (stale) Mirror 29: 0x80cc046b (stale) Mirror 30: 0x80cc046b (stale) Mirror 31: 0x80cc046b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e48d): Mirror 8: 0x80cc046b (stale) Mirror 11: 0x80cc046b (stale) Mirror 15: 0x80cc046b (stale) Mirror 17: 0x80cc046b (stale) Mirror 18: 0x80cc046b (stale) Mirror 23: 0x80cc046b (stale) Mirror 26: 0x80cc046b (stale) Mirror 27: 0x80cc046b (stale) Mirror 28: 0x80cc046b (stale) Mirror 29: 0x80cc046b (stale) Mirror 30: 0x80cc046b (stale) Mirror 31: 0x80cc046b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e48d: skipped 000934 1788190734.154654 mapwrite 0x029087 thru 0x030265 (0x71df bytes) 000938 1788190734.334446 read 0x02b7a6 thru 0x02c0c3 (0x91e bytes) 000939 1788190734.339413 read 0x014fa4 thru 0x019eaa (0x4f07 bytes) 000940 1788190734.382463 mapwrite 0x00cc1b thru 0x010543 (0x3929 bytes) 000941 1788190734.522588 mapwrite 0x0281ad thru 0x032b03 (0xa957 bytes) 000942 1788190734.700268 mapwrite 0x01cad3 thru 0x029c80 (0xd1ae bytes) 000943 1788190734.830496 trunc from 0x032b04 to 0x009b9a (0x28f69 bytes) 000944 1788190734.861430 write 0x0193e7 thru 0x01c998 (0x35b2 bytes) 000945 1788190734.862808 mapwrite 0x018121 thru 0x0262c9 (0xe1a9 bytes) 000946 1788190735.107232 mapread 0x016be0 thru 0x019535 (0x2956 bytes) 000949 1788190735.121217 mapread 0x017e96 thru 0x024782 (0xc8ed bytes) 000950 1788190735.123464 read 0x002fd8 thru 0x008e97 (0x5ec0 bytes) 000953 1788190735.126374 write 0x00bd48 thru 0x013388 (0x7641 bytes) 000954 1788190735.137203 mapread 0x016018 thru 0x01a06d (0x4056 bytes) 000955 1788190735.139081 mapread 0x0252e8 thru 0x0262c9 (0xfe2 bytes) 000961 1788190735.149288 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x262ca): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 23: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x262ca): Mirror 8: 0x2f7498f0 (stale) Mirror 11: 0x2f7498f0 (stale) Mirror 15: 0x2f7498f0 (stale) Mirror 17: 0x2f7498f0 (stale) Mirror 18: 0x2f7498f0 (stale) Mirror 23: 0x2f7498f0 (stale) Mirror 26: 0x2f7498f0 (stale) Mirror 27: 0x2f7498f0 (stale) Mirror 28: 0x2f7498f0 (stale) Mirror 29: 0x2f7498f0 (stale) Mirror 30: 0x2f7498f0 (stale) Mirror 31: 0x2f7498f0 (stale) CRC-32 checksum value for chunk [0, 0x262ca): Mirror 1: 0xc322e19f Mirror 32: 0xc322e19f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x262ca: skipped 000965 1788190737.553430 MIRROR_SPLIT mirror 7 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x262ca): Mirror 8: 0x2f7498f0 (stale) Mirror 11: 0x2f7498f0 (stale) Mirror 15: 0x2f7498f0 (stale) Mirror 17: 0x2f7498f0 (stale) Mirror 18: 0x2f7498f0 (stale) Mirror 23: 0x2f7498f0 (stale) Mirror 27: 0x2f7498f0 (stale) Mirror 28: 0x2f7498f0 (stale) Mirror 29: 0x2f7498f0 (stale) Mirror 30: 0x2f7498f0 (stale) Mirror 31: 0x2f7498f0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x262ca): Mirror 8: 0x2f7498f0 (stale) Mirror 11: 0x2f7498f0 (stale) Mirror 15: 0x2f7498f0 (stale) Mirror 17: 0x2f7498f0 (stale) Mirror 18: 0x2f7498f0 (stale) Mirror 23: 0x2f7498f0 (stale) Mirror 27: 0x2f7498f0 (stale) Mirror 28: 0x2f7498f0 (stale) Mirror 29: 0x2f7498f0 (stale) Mirror 30: 0x2f7498f0 (stale) Mirror 31: 0x2f7498f0 (stale) CRC-32 checksum value for chunk [0, 0x262ca): Mirror 1: 0xc322e19f Mirror 32: 0xc322e19f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x262ca: skipped 000973 1788190739.163144 write 0x005548 thru 0x008377 (0x2e30 bytes) 000974 1788190739.327080 write 0x006d55 thru 0x012037 (0xb2e3 bytes) 000975 1788190739.340183 read 0x0199fe thru 0x0260cb (0xc6ce bytes) 000977 1788190739.358051 mapread 0x001618 thru 0x010cd3 (0xf6bc bytes) 000980 1788190739.389346 mapwrite 0x030ecf thru 0x038145 (0x7277 bytes) 000981 1788190739.681704 trunc from 0x038146 to 0x0191d7 (0x1ef6e bytes) 000983 1788190739.714762 trunc from 0x0191d8 to 0x015a1d (0x37ba bytes) 000984 1788190739.735072 read 0x00c0ab thru 0x015a1d (0x9973 bytes) 000985 1788190739.743422 mapread 0x0033ff thru 0x00c839 (0x943b bytes) 000987 1788190739.745254 mapread 0x006fde thru 0x011885 (0xa8a8 bytes) 000988 1788190739.748632 write 0x00fd3d thru 0x01e707 (0xe9cb bytes) 000989 1788190739.751201 read 0x0161be thru 0x01e707 (0x854a bytes) 000991 1788190739.753398 trunc from 0x01e708 to 0x0199df (0x4d28 bytes) 000992 1788190739.784794 MIRROR_SPLIT mirror 7 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x199e0): Mirror 8: 0x2bb27b00 (stale) Mirror 11: 0x2bb27b00 (stale) Mirror 15: 0x2bb27b00 (stale) Mirror 17: 0x2bb27b00 (stale) Mirror 18: 0x2bb27b00 (stale) Mirror 23: 0x2bb27b00 (stale) Mirror 28: 0x2bb27b00 (stale) Mirror 29: 0x2bb27b00 (stale) Mirror 30: 0x2bb27b00 (stale) Mirror 31: 0x2bb27b00 (stale) Mirror 32: 0xb7744fa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x199e0): Mirror 8: 0x2bb27b00 (stale) Mirror 11: 0x2bb27b00 (stale) Mirror 15: 0x2bb27b00 (stale) Mirror 17: 0x2bb27b00 (stale) Mirror 18: 0x2bb27b00 (stale) Mirror 23: 0x2bb27b00 (stale) Mirror 28: 0x2bb27b00 (stale) Mirror 29: 0x2bb27b00 (stale) Mirror 30: 0x2bb27b00 (stale) Mirror 31: 0x2bb27b00 (stale) Mirror 32: 0xb7744fa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x199e0: skipped 000993 1788190740.529707 MIRROR_SPLIT mirror 9 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x193:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x199e0): Mirror 8: 0x2bb27b00 (stale) Mirror 11: 0x2bb27b00 (stale) Mirror 15: 0x2bb27b00 (stale) Mirror 17: 0x2bb27b00 (stale) Mirror 18: 0x2bb27b00 (stale) Mirror 23: 0x2bb27b00 (stale) Mirror 28: 0x2bb27b00 (stale) Mirror 29: 0x2bb27b00 (stale) Mirror 31: 0x2bb27b00 (stale) Mirror 32: 0xb7744fa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x199e0): Mirror 8: 0x2bb27b00 (stale) Mirror 11: 0x2bb27b00 (stale) Mirror 15: 0x2bb27b00 (stale) Mirror 17: 0x2bb27b00 (stale) Mirror 18: 0x2bb27b00 (stale) Mirror 23: 0x2bb27b00 (stale) Mirror 28: 0x2bb27b00 (stale) Mirror 29: 0x2bb27b00 (stale) Mirror 31: 0x2bb27b00 (stale) Mirror 32: 0xb7744fa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x199e0: skipped 000994 1788190741.191912 write 0x000614 thru 0x004e5a (0x4847 bytes) 000996 1788190741.208281 write 0x0387fa thru 0x03eb90 (0x6397 bytes) 000999 1788190741.214188 mapwrite 0x020528 thru 0x02e93d (0xe416 bytes) 001000 1788190741.348820 write 0x01d765 thru 0x022926 (0x51c2 bytes) All operations completed A-OK!