== sanity-flr test 70a: flr mode fsx test ================ 09:23:42 (1789478622) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 8624 truncating to largest ever: 0xd81d 000001 1789478624.807787 trunc from 00000000 to 0x00d81c (0xd81d bytes) 000002 1789478624.824200 write 0x0264a8 thru 0x027e5f (0x19b8 bytes) 000003 1789478624.825273 mapread 0x00b966 thru 0x01492d (0x8fc8 bytes) 000004 1789478624.850423 write 0x016dce thru 0x017609 (0x83c bytes) fallocating to largest ever: 0x309a0 000005 1789478624.860058 fallocate 0x02b088 thru 0x03099f (0x5918 bytes) 000006 1789478624.864427 write 0x00a094 thru 0x014bde (0xab4b bytes) 000007 1789478624.866262 trunc from 0x0309a0 to 0x00787f (0x29120 bytes) 000008 1789478624.883205 trunc from 0x00305a to 0x00787f (0x4826 bytes) 000009 1789478624.888029 read 0x002c12 thru 0x00787f (0x4c6e bytes) truncating to largest ever: 0x390df 000010 1789478624.897858 trunc from 0x007880 to 0x0390de (0x3185f bytes) 000011 1789478624.912186 trunc from 0x0390df to 0x007ba8 (0x31536 bytes) 000012 1789478624.929866 punch from 0x0002f2 to 0x003916 (0x3625 bytes) 000013 1789478624.938499 MIRROR_EXTEND to 2 mirrors 000014 1789478625.661231 write 0x035d97 thru 0x03ffff (0xa269 bytes) 000015 1789478625.716209 MIRROR_RESYNC 2 mirrors 000016 1789478626.211504 mapwrite 0x03255d thru 0x03d964 (0xb408 bytes) 000017 1789478626.305838 mapwrite 0x02fbe3 thru 0x030886 (0xca4 bytes) 000018 1789478626.323867 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x7785cb70 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x748d20d8 Mirror 3: 0x748d20d8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000019 1789478627.457248 trunc from 0x040000 to 0x015e85 (0x2a17a bytes) 000020 1789478627.577485 mapwrite 0x03e3a7 thru 0x03e476 (0xd0 bytes) 000022 1789478627.626888 trunc from 0x03e477 to 0x01b79c (0x22cda bytes) 000023 1789478627.644230 write 0x012ab6 thru 0x0150cd (0x2618 bytes) 000024 1789478627.652756 mapwrite 0x01ee65 thru 0x029036 (0xa1d2 bytes) 000025 1789478627.702882 trunc from 0x029037 to 0x0385b4 (0xf57e bytes) 000027 1789478627.717019 trunc from 0x030301 to 0x0385b4 (0x82b4 bytes) 000029 1789478627.722669 fallocate 0x021f1e thru 0x02ea23 (0xcb06 bytes) 000030 1789478627.727202 read 0x017df9 thru 0x01e4e0 (0x66e8 bytes) 000031 1789478627.732748 trunc from 0x0385b5 to 0x02cd3b (0xb879 bytes) 000032 1789478627.746714 trunc from 0x02cd3c to 0x0159b3 (0x17388 bytes) 000033 1789478627.769493 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x159b4): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x159b4): Mirror 2: 0x87426bb9 (stale) Mirror 3: 0x87426bb9 (stale) CRC-32 checksum value for chunk [0, 0x159b4): Mirror 1: 0x85a8c006 Mirror 4: 0x85a8c006 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x159b4: skipped 000034 1789478628.633336 punch from 0x001bfd to 0x006369 (0x476d bytes) 000035 1789478628.689885 fallocate 0x016e66 thru 0x01f99a (0x8b35 bytes) 000036 1789478628.696456 trunc from 0x011b67 to 0x0159b3 (0x3e4d bytes) 000037 1789478628.702307 read 0x006909 thru 0x0159b3 (0xf0ab bytes) 000038 1789478628.710603 trunc from 0x00920f to 0x00a73c (0x152e bytes) 000040 1789478628.717601 write 0x0384ff thru 0x03ffff (0x7b01 bytes) 000042 1789478628.725700 fallocate 0x028f8b thru 0x02c9b8 (0x3a2e bytes) 000043 1789478628.735206 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x7785cb70 (stale) Mirror 3: 0x748d20d8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x7785cb70 (stale) Mirror 3: 0x748d20d8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000044 1789478629.159233 punch from 0x015545 to 0x0179ae (0x246a bytes) 000045 1789478629.173784 fallocate 0x01ff40 thru 0x02332c (0x33ed bytes) 000046 1789478629.185372 mapwrite 0x0167c0 thru 0x01a00e (0x384f bytes) 000047 1789478629.308162 trunc from 0x040000 to 0x004c7f (0x3b380 bytes) 000048 1789478629.332926 mapread 0x0019c3 thru 0x002b03 (0x1141 bytes) 000049 1789478629.341616 write 0x025708 thru 0x0327be (0xd0b7 bytes) 000051 1789478629.347332 trunc from 0x019805 to 0x026ed5 (0xd6d1 bytes) 000052 1789478629.374777 punch from 0x0262b6 to 0x02d927 (0x7672 bytes) 000053 1789478629.390415 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x327bf): Mirror 3: 0x1582ccc3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x327bf): Mirror 3: 0x1582ccc3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x327bf: skipped 000054 1789478629.762669 trunc from 0x020b2f to 0x021b52 (0x1024 bytes) 000055 1789478629.769530 write 0x023b21 thru 0x0324ca (0xe9aa bytes) 000056 1789478629.785284 mapwrite 0x030fe8 thru 0x037b45 (0x6b5e bytes) 000058 1789478629.841799 trunc from 0x02c8fe to 0x036265 (0x9968 bytes) 000059 1789478629.846290 mapwrite 0x03c9f9 thru 0x03ffff (0x3607 bytes) 000060 1789478629.898903 write 0x01547e thru 0x01f6b3 (0xa236 bytes) fallocating to largest ever: 0x40000 000061 1789478629.913480 fallocate 0x03c172 thru 0x03ffff (0x3e8e bytes) 000062 1789478629.921165 mapwrite 0x032e38 thru 0x03a4d4 (0x769d bytes) 000063 1789478629.947081 read 0x015539 thru 0x019dc6 (0x488e bytes) 000064 1789478629.948402 mapread 0x03ba51 thru 0x03ffff (0x45af bytes) 000066 1789478629.950588 trunc from 0x040000 to 0x03ed37 (0x12c8 bytes) 000067 1789478629.979190 write 0x035854 thru 0x03c40c (0x6bb9 bytes) 000068 1789478629.982509 fallocate 0x034e74 thru 0x03ffff (0xb18c bytes) 000069 1789478629.997214 mapwrite 0x021262 thru 0x02d88e (0xc62d bytes) 000070 1789478630.037338 read 0x01af5e thru 0x02811a (0xd1bd bytes) 000071 1789478630.049749 MIRROR_RESYNC 2 mirrors 000072 1789478630.905002 MIRROR_EXTEND to 3 mirrors 000073 1789478631.466813 mapwrite 0x037614 thru 0x03cbc3 (0x55b0 bytes) 000074 1789478631.591918 fallocate 0x01701e thru 0x01abeb (0x3bce bytes) 000075 1789478631.597789 read 0x03f138 thru 0x03ffff (0xec8 bytes) 000076 1789478631.602920 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xb320ef92 (stale) Mirror 4: 0xb320ef92 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3cb36cc8 Mirror 5: 0x3cb36cc8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000077 1789478632.592125 fallocate 0x022e9c thru 0x02b0f2 (0x8257 bytes) 000078 1789478632.648759 trunc from 0x040000 to 0x03ea69 (0x1596 bytes) 000079 1789478632.676790 trunc from 0x03ea6a to 0x01ed87 (0x1fce2 bytes) 000080 1789478632.691563 trunc from 0x01ed88 to 0x0339a6 (0x14c1f bytes) 000081 1789478632.708204 fallocate 0x03e35a thru 0x03ffff (0x1ca6 bytes) 000082 1789478632.713797 fallocate 0x020b40 thru 0x02ad90 (0xa251 bytes) 000083 1789478632.719085 trunc from 0x0339a7 to 0x0243e6 (0xf5c0 bytes) 000084 1789478632.741182 read 0x00726b thru 0x00fbd0 (0x8966 bytes) 000085 1789478632.751229 write 0x0047f1 thru 0x004840 (0x50 bytes) 000086 1789478632.757170 write 0x028b7d thru 0x02b8c7 (0x2d4b bytes) 000087 1789478632.760715 read 0x019d22 thru 0x01e3b0 (0x468f bytes) 000088 1789478632.783776 mapread 0x012da1 thru 0x013de0 (0x1040 bytes) 000089 1789478632.784639 write 0x00a9b4 thru 0x012746 (0x7d93 bytes) 000090 1789478632.785853 mapread 0x021a3d thru 0x02b8c7 (0x9e8b bytes) 000091 1789478632.787399 trunc from 0x02b8c8 to 0x02450d (0x73ba bytes) 000093 1789478632.803141 write 0x03f6f7 thru 0x03ffff (0x909 bytes) 000094 1789478632.804177 mapwrite 0x01bd9a thru 0x01c3c1 (0x628 bytes) 000095 1789478632.828942 mapwrite 0x008942 thru 0x011629 (0x8ce8 bytes) 000096 1789478632.847166 write 0x03cc59 thru 0x03ffff (0x33a7 bytes) 000097 1789478632.854742 punch from 0x03a534 to 0x03d466 (0x2f33 bytes) 000098 1789478632.866724 read 0x009b0c thru 0x00cd06 (0x31fb bytes) 000099 1789478632.867409 trunc from 0x03b505 to 0x03dc62 (0x275e bytes) 000100 1789478632.872749 read 0x034d6f thru 0x03ffff (0xb291 bytes) 000101 1789478632.886196 punch from 0x008bb7 to 0x00a8b4 (0x1cfe bytes) 000102 1789478632.891023 fallocate 0x023456 thru 0x02bb98 (0x8743 bytes) 000103 1789478632.899821 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xb320ef92 (stale) Mirror 4: 0xb320ef92 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xb320ef92 (stale) Mirror 4: 0xb320ef92 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000104 1789478633.191266 MIRROR_RESYNC 3 mirrors 000105 1789478634.692814 read 0x02900b thru 0x036046 (0xd03c bytes) 000106 1789478634.711908 fallocate 0x008b41 thru 0x0125f5 (0x9ab5 bytes) 000107 1789478634.796003 read 0x02ec1a thru 0x038ffa (0xa3e1 bytes) 000108 1789478634.815134 trunc from 0x040000 to 0x02d745 (0x128ba bytes) 000109 1789478634.851342 read 0x006678 thru 0x006bb2 (0x53b bytes) 000111 1789478634.861830 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2d746): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d746): Mirror 3: 0xc3ffbc8e (stale) Mirror 4: 0xc3ffbc8e (stale) CRC-32 checksum value for chunk [0, 0x2d746): Mirror 1: 0xc3ffbc8e Mirror 5: 0xc3ffbc8e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d746: skipped 000112 1789478635.848031 read 0x00a9fe thru 0x00ff1c (0x551f bytes) 000113 1789478635.894909 MIRROR_RESYNC 4 mirrors 000114 1789478637.305297 fallocate 0x015c89 thru 0x021d0c (0xc084 bytes) 000115 1789478637.373135 mapwrite 0x03b3c1 thru 0x03ffff (0x4c3f bytes) 000116 1789478637.552420 mapread 0x03d2ed thru 0x03ffff (0x2d13 bytes) 000117 1789478637.558328 mapwrite 0x022034 thru 0x02c104 (0xa0d1 bytes) 000119 1789478637.672190 trunc from 0x036eb0 to 0x03b756 (0x48a7 bytes) 000120 1789478637.678274 read 0x038cf8 thru 0x03ffff (0x7308 bytes) 000121 1789478637.699313 read 0x03f992 thru 0x03ffff (0x66e bytes) 000122 1789478637.706963 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x332e5af3 (stale) Mirror 4: 0x332e5af3 (stale) Mirror 5: 0x332e5af3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x20b15c2d Mirror 6: 0x20b15c2d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000123 1789478639.160561 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x332e5af3 (stale) Mirror 4: 0x332e5af3 (stale) Mirror 5: 0x332e5af3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x20b15c2d Mirror 6: 0x20b15c2d Mirror 7: 0x20b15c2d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000124 1789478640.422125 write 0x02e1f0 thru 0x02fa39 (0x184a bytes) 000125 1789478640.517820 trunc from 0x02a188 to 0x035391 (0xb20a bytes) 000126 1789478640.540661 mapwrite 0x023b93 thru 0x032e5c (0xf2ca bytes) 000127 1789478640.641568 punch from 0x012c59 to 0x012d90 (0x138 bytes) 000128 1789478640.648340 mapwrite 0x00952d thru 0x00fbc6 (0x669a bytes) 000129 1789478640.676720 punch from 0x022426 to 0x024d09 (0x28e4 bytes) 000130 1789478640.682306 mapwrite 0x034e45 thru 0x03ffff (0xb1bb bytes) 000131 1789478640.741994 punch from 0x0160f2 to 0x020d21 (0xac30 bytes) 000132 1789478640.749396 trunc from 0x00b648 to 0x01a5c8 (0xef81 bytes) 000133 1789478640.755047 fallocate 0x015142 thru 0x016d9d (0x1c5c bytes) 000134 1789478640.759734 write 0x01ab51 thru 0x020b02 (0x5fb2 bytes) 000135 1789478640.772135 fallocate 0x01ea06 thru 0x02d641 (0xec3c bytes) 000136 1789478640.777089 trunc from 0x03844a to 0x03ffff (0x7bb6 bytes) 000137 1789478640.782512 fallocate 0x015de4 thru 0x0216eb (0xb908 bytes) 000138 1789478640.788789 mapread 0x03115f thru 0x037303 (0x61a5 bytes) 000139 1789478640.794108 trunc from 0x040000 to 0x02c525 (0x13ada bytes) 000141 1789478640.823261 trunc from 0x01c5f2 to 0x02bc72 (0xf681 bytes) 000142 1789478640.840501 trunc from 0x0267ae to 0x02c525 (0x5d78 bytes) 000143 1789478640.848291 trunc from 0x02725d to 0x02c525 (0x52c9 bytes) 000144 1789478640.853867 fallocate 0x028ffa thru 0x0332e6 (0xa2ed bytes) 000145 1789478640.862883 fallocate 0x01b402 thru 0x02aa4f (0xf64e bytes) 000146 1789478640.868885 punch from 0x02873b to 0x02ca1d (0x42e3 bytes) 000148 1789478640.875340 trunc from 0x0332e7 to 0x00ee4f (0x24497 bytes) 000149 1789478640.898317 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0xee50): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xee50): Mirror 3: 0x359b51d4 (stale) Mirror 4: 0x359b51d4 (stale) Mirror 5: 0x359b51d4 (stale) Mirror 6: 0x359b51d4 (stale) Mirror 7: 0x359b51d4 (stale) CRC-32 checksum value for chunk [0, 0xee50): Mirror 1: 0xac0d021d Mirror 8: 0xac0d021d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xee50: skipped 000150 1789478641.768731 fallocate 0x0344f2 thru 0x03c260 (0x7d6f bytes) 000151 1789478641.821001 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c261): Mirror 3: 0x4111b7a7 (stale) Mirror 5: 0x4111b7a7 (stale) Mirror 6: 0x4e7858b6 (stale) Mirror 7: 0x4e7858b6 (stale) Mirror 8: 0x5cf3d752 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c261): Mirror 3: 0x4111b7a7 (stale) Mirror 5: 0x4111b7a7 (stale) Mirror 6: 0x4e7858b6 (stale) Mirror 7: 0x4e7858b6 (stale) Mirror 8: 0x5cf3d752 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c261: skipped 000153 1789478642.248760 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3c261): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c261): Mirror 3: 0x4111b7a7 (stale) Mirror 5: 0x4111b7a7 (stale) Mirror 6: 0x4e7858b6 (stale) Mirror 7: 0x4e7858b6 (stale) Mirror 8: 0x5cf3d752 (stale) CRC-32 checksum value for chunk [0, 0x3c261): Mirror 1: 0x5cf3d752 Mirror 9: 0x5cf3d752 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c261: skipped 000154 1789478643.233369 mapread 0x0207c2 thru 0x02fd40 (0xf57f bytes) 000155 1789478643.274143 write 0x017454 thru 0x017997 (0x544 bytes) 000156 1789478643.322867 punch from 0x005203 to 0x0095eb (0x43e9 bytes) 000157 1789478643.328617 write 0x014e8b thru 0x01edb3 (0x9f29 bytes) 000158 1789478643.338119 mapwrite 0x03570c thru 0x03ffff (0xa8f4 bytes) 000159 1789478643.412585 write 0x02613e thru 0x02ca1d (0x68e0 bytes) 000161 1789478643.424266 mapread 0x0126b4 thru 0x019720 (0x706d bytes) 000162 1789478643.451068 fallocate 0x00ab8a thru 0x00d2c2 (0x2739 bytes) 000163 1789478643.456840 punch from 0x01fc7d to 0x027f5c (0x82e0 bytes) 000164 1789478643.472728 trunc from 0x040000 to 0x02d99a (0x12665 bytes) 000165 1789478643.498386 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2d99b): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d99b): Mirror 3: 0x8b38c452 (stale) Mirror 5: 0x8b38c452 (stale) Mirror 6: 0xd131ce5c (stale) Mirror 7: 0xd131ce5c (stale) Mirror 8: 0xab10651d (stale) Mirror 9: 0xab10651d (stale) CRC-32 checksum value for chunk [0, 0x2d99b): Mirror 1: 0x1e96a01c Mirror 10: 0x1e96a01c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d99b: skipped 000166 1789478645.047807 trunc from 0x004867 to 0x00f7a4 (0xaf3e bytes) 000167 1789478645.081150 mapread 0x02c658 thru 0x02d99a (0x1343 bytes) 000168 1789478645.091326 punch from 0x029dcc to 0x02d99a (0x3bcf bytes) 000169 1789478645.096786 fallocate 0x00e413 thru 0x01053c (0x212a bytes) 000170 1789478645.105323 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d99b): Mirror 3: 0x8b38c452 (stale) Mirror 5: 0x8b38c452 (stale) Mirror 6: 0xd131ce5c (stale) Mirror 7: 0xd131ce5c (stale) Mirror 8: 0xab10651d (stale) Mirror 9: 0xab10651d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d99b): Mirror 3: 0x8b38c452 (stale) Mirror 5: 0x8b38c452 (stale) Mirror 6: 0xd131ce5c (stale) Mirror 7: 0xd131ce5c (stale) Mirror 8: 0xab10651d (stale) Mirror 9: 0xab10651d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d99b: skipped 000171 1789478645.723094 trunc from 0x02d99b to 0x003f67 (0x29a33 bytes) 000172 1789478645.754051 mapread 0x0023a9 thru 0x003f67 (0x1bbf bytes) 000173 1789478645.773128 fallocate 0x00a6d8 thru 0x01730b (0xcc34 bytes) 000174 1789478645.777996 fallocate 0x01dd53 thru 0x02d799 (0xfa47 bytes) 000175 1789478645.783346 mapwrite 0x006239 thru 0x0065f0 (0x3b8 bytes) 000176 1789478645.811297 punch from 0x00b4b2 to 0x012907 (0x7456 bytes) 000177 1789478645.816251 trunc from 0x02d79a to 0x027fbd (0x57dc bytes) 000178 1789478645.830961 fallocate 0x01a859 thru 0x0213a3 (0x6b4b bytes) 000179 1789478645.840564 punch from 0x027b02 to 0x027fbd (0x4bc bytes) 000180 1789478645.849848 mapread 0x01b93a thru 0x02113d (0x5804 bytes) 000181 1789478645.870229 read 0x01068d thru 0x01abb3 (0xa527 bytes) 000182 1789478645.880475 mapwrite 0x020896 thru 0x029ea8 (0x9613 bytes) 000183 1789478645.926916 write 0x009dc5 thru 0x014d52 (0xaf8e bytes) 000184 1789478645.928448 fallocate 0x01d4fa thru 0x026fa7 (0x9aae bytes) 000185 1789478645.934840 fallocate 0x037593 thru 0x03ffff (0x8a6d bytes) 000186 1789478645.940071 mapread 0x033788 thru 0x0399ee (0x6267 bytes) 000187 1789478645.984884 MIRROR_RESYNC 7 mirrors 000188 1789478648.505945 trunc from 0x034018 to 0x0343f7 (0x3e0 bytes) 000189 1789478648.615301 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x152f8161 (stale) Mirror 5: 0x152f8161 (stale) Mirror 6: 0x152f8161 (stale) Mirror 7: 0x152f8161 (stale) Mirror 8: 0x152f8161 (stale) Mirror 9: 0x152f8161 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x152f8161 Mirror 10: 0x152f8161 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000190 1789478650.058085 fallocate 0x02c854 thru 0x0386a0 (0xbe4d bytes) 000191 1789478650.107432 fallocate 0x00ccb4 thru 0x01ae5e (0xe1ab bytes) 000192 1789478650.111049 mapwrite 0x02ed2b thru 0x031f99 (0x326f bytes) 000193 1789478650.142826 fallocate 0x036e8c thru 0x03ffff (0x9174 bytes) 000194 1789478650.152336 trunc from 0x040000 to 0x00169a (0x3e965 bytes) 000195 1789478650.183063 punch from 0x001214 to 0x00169a (0x487 bytes) 000196 1789478650.188468 mapread 0x000fb9 thru 0x00169a (0x6e2 bytes) 000197 1789478650.194308 mapwrite 0x02b8f5 thru 0x03086b (0x4f77 bytes) 000198 1789478650.234549 trunc from 0x03086c to 0x02d73b (0x3130 bytes) 000199 1789478650.255609 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2d73c): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d73c): Mirror 3: 0x5a9a5829 (stale) Mirror 5: 0x5a9a5829 (stale) Mirror 6: 0x5a9a5829 (stale) Mirror 7: 0x5a9a5829 (stale) Mirror 8: 0x5a9a5829 (stale) Mirror 9: 0x5a9a5829 (stale) Mirror 10: 0x5a9a5829 (stale) CRC-32 checksum value for chunk [0, 0x2d73c): Mirror 1: 0x8d937739 Mirror 11: 0x8d937739 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d73c: skipped 000201 1789478651.320964 fallocate 0x01555e thru 0x02156c (0xc00f bytes) 000202 1789478651.370362 MIRROR_RESYNC 9 mirrors 000204 1789478653.022212 MIRROR_EXTEND to 10 mirrors 000205 1789478653.870758 mapread 0x02d431 thru 0x02d73b (0x30b bytes) 000206 1789478653.880521 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) 000208 1789478654.357583 write 0x039550 thru 0x03ffff (0x6ab0 bytes) 000209 1789478654.432979 read 0x020e1a thru 0x026d72 (0x5f59 bytes) 000210 1789478654.444587 trunc from 0x040000 to 0x03d998 (0x2667 bytes) 000211 1789478654.467636 punch from 0x011803 to 0x01b9ad (0xa1ab bytes) 000212 1789478654.475479 punch from 0x036bfe to 0x03d998 (0x6d9b bytes) 000213 1789478654.489239 read 0x03c1bb thru 0x03d998 (0x17de bytes) 000214 1789478654.508412 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d999): Mirror 5: 0x8aaf3811 (stale) Mirror 6: 0x8aaf3811 (stale) Mirror 7: 0x8aaf3811 (stale) Mirror 8: 0x8aaf3811 (stale) Mirror 10: 0x8aaf3811 (stale) Mirror 11: 0x8aaf3811 (stale) Mirror 12: 0x8aaf3811 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d999): Mirror 5: 0x8aaf3811 (stale) Mirror 6: 0x8aaf3811 (stale) Mirror 7: 0x8aaf3811 (stale) Mirror 8: 0x8aaf3811 (stale) Mirror 10: 0x8aaf3811 (stale) Mirror 11: 0x8aaf3811 (stale) Mirror 12: 0x8aaf3811 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d999: skipped 000215 1789478655.215781 trunc from 0x03d999 to 0x0176f1 (0x262a7 bytes) 000216 1789478655.286123 punch from 0x00439f to 0x00c749 (0x83ab bytes) 000217 1789478655.292654 read 0x00a964 thru 0x0136ed (0x8d8a bytes) 000218 1789478655.319211 fallocate 0x01c290 thru 0x022a35 (0x67a6 bytes) 000219 1789478655.325445 mapread 0x00886b thru 0x00a4a8 (0x1c3e bytes) 000220 1789478655.355272 punch from 0x00399e to 0x012525 (0xeb88 bytes) 000221 1789478655.376236 mapwrite 0x013e73 thru 0x01fb72 (0xbd00 bytes) 000222 1789478655.509926 trunc from 0x00863a to 0x00bb67 (0x352e bytes) 000224 1789478655.549801 MIRROR_RESYNC 8 mirrors 000226 1789478657.011602 read 0x006e9a thru 0x011a0c (0xab73 bytes) 000227 1789478657.028040 write 0x00f57d thru 0x01e2eb (0xed6f bytes) 000228 1789478657.066614 trunc from 0x01fb73 to 0x03f746 (0x1fbd4 bytes) 000230 1789478657.090785 trunc from 0x03f747 to 0x023565 (0x1c1e1 bytes) 000231 1789478657.119347 write 0x03f093 thru 0x03ffff (0xf6d bytes) 000232 1789478657.144973 MIRROR_RESYNC 8 mirrors 000233 1789478659.143465 write 0x034c5d thru 0x035ecc (0x1270 bytes) 000234 1789478659.224977 trunc from 0x01ae69 to 0x02a506 (0xf69e bytes) 000235 1789478659.237130 write 0x001894 thru 0x00ce6e (0xb5db bytes) 000237 1789478659.274601 read 0x00b445 thru 0x010f4c (0x5b08 bytes) 000238 1789478659.314953 punch from 0x000667 to 0x0040a4 (0x3a3e bytes) 000239 1789478659.346197 mapwrite 0x01c86a thru 0x0211a5 (0x493c bytes) 000240 1789478659.443559 trunc from 0x02b801 to 0x034b2a (0x932a bytes) 000241 1789478659.451167 trunc from 0x040000 to 0x00af3b (0x350c4 bytes) 000242 1789478659.494560 trunc from 0x00872a to 0x00af3b (0x2812 bytes) 000243 1789478659.517395 MIRROR_RESYNC 8 mirrors 000244 1789478661.803263 punch from 0x005094 to 0x00af3b (0x5ea8 bytes) 000245 1789478661.876857 read 0x00811e thru 0x00af3b (0x2e1e bytes) 000246 1789478661.896186 trunc from 0x0046c1 to 0x00af3b (0x687b bytes) 000247 1789478661.904206 punch from 0x0012a6 to 0x007926 (0x6681 bytes) 000248 1789478661.919482 fallocate 0x016ec1 thru 0x01acc4 (0x3e04 bytes) 000249 1789478661.931042 punch from 0x00f450 to 0x013dcc (0x497d bytes) 000250 1789478661.940156 trunc from 0x00c2de to 0x00c9d4 (0x6f7 bytes) 000251 1789478661.949618 trunc from 0x01acc5 to 0x01b763 (0xa9f bytes) 000252 1789478661.987482 mapread 0x00bed7 thru 0x01438f (0x84b9 bytes) 000253 1789478662.016464 mapread 0x0190d3 thru 0x01b763 (0x2691 bytes) 000254 1789478662.027485 mapwrite 0x001800 thru 0x00b5fc (0x9dfd bytes) 000255 1789478662.071576 mapread 0x00bc60 thru 0x00c39e (0x73f bytes) 000256 1789478662.073131 trunc from 0x01b764 to 0x0205b2 (0x4e4f bytes) 000257 1789478662.093405 mapread 0x00848d thru 0x013d06 (0xb87a bytes) 000258 1789478662.096424 punch from 0x01f7c0 to 0x0205b2 (0xdf3 bytes) 000259 1789478662.114120 mapread 0x01dc60 thru 0x0205b2 (0x2953 bytes) 000260 1789478662.138949 punch from 0x01e083 to 0x0205b2 (0x2530 bytes) 000261 1789478662.144424 trunc from 0x0205b3 to 0x01fa5c (0xb56 bytes) 000262 1789478662.175951 read 0x002923 thru 0x009684 (0x6d62 bytes) 000263 1789478662.176643 trunc from 0x0062f0 to 0x00be91 (0x5ba2 bytes) 000264 1789478662.190605 write 0x029041 thru 0x02d04e (0x400e bytes) 000265 1789478662.196201 read 0x010015 thru 0x01344d (0x3439 bytes) 000267 1789478662.198540 trunc from 0x01b57c to 0x028843 (0xd2c8 bytes) 000268 1789478662.213547 MIRROR_RESYNC 8 mirrors 000269 1789478665.304475 MIRROR_EXTEND to 9 mirrors 000270 1789478666.685127 write 0x019124 thru 0x01b534 (0x2411 bytes) 000271 1789478666.771252 read 0x009bbe thru 0x0143db (0xa81e bytes) 000272 1789478666.788220 mapwrite 0x024db3 thru 0x0287e9 (0x3a37 bytes) 000273 1789478666.863283 punch from 0x01499a to 0x023f19 (0xf580 bytes) 000274 1789478666.868707 mapwrite 0x011854 thru 0x0180a5 (0x6852 bytes) 000275 1789478666.942110 write 0x0315fc thru 0x037c1c (0x6621 bytes) 000276 1789478666.951007 mapwrite 0x00447b thru 0x00c264 (0x7dea bytes) 000278 1789478667.031208 write 0x016989 thru 0x016b16 (0x18e bytes) 000279 1789478667.035007 trunc from 0x037c1d to 0x01c36a (0x1b8b2 bytes) 000280 1789478667.085644 punch from 0x017b2f to 0x01c36a (0x483c bytes) 000281 1789478667.093090 mapwrite 0x038931 thru 0x03ffff (0x76cf bytes) 000282 1789478667.144151 mapwrite 0x033da2 thru 0x03ffff (0xc25e bytes) 000283 1789478667.172569 write 0x03d750 thru 0x03ffff (0x28b0 bytes) 000284 1789478667.175256 trunc from 0x03911d to 0x03ffff (0x6ee3 bytes) 000285 1789478667.186666 mapread 0x004a38 thru 0x005b6b (0x1134 bytes) 000286 1789478667.195555 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x8d44fdcc (stale) Mirror 7: 0x8d44fdcc (stale) Mirror 8: 0x8d44fdcc (stale) Mirror 10: 0x8d44fdcc (stale) Mirror 11: 0x8d44fdcc (stale) Mirror 12: 0x8d44fdcc (stale) Mirror 13: 0x8d44fdcc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x8d44fdcc (stale) Mirror 7: 0x8d44fdcc (stale) Mirror 8: 0x8d44fdcc (stale) Mirror 10: 0x8d44fdcc (stale) Mirror 11: 0x8d44fdcc (stale) Mirror 12: 0x8d44fdcc (stale) Mirror 13: 0x8d44fdcc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000287 1789478668.121268 fallocate 0x03e09b thru 0x03ffff (0x1f65 bytes) 000288 1789478668.128648 mapwrite 0x03d442 thru 0x03ffff (0x2bbe bytes) 000289 1789478668.197847 trunc from 0x040000 to 0x03fd5e (0x2a1 bytes) 000290 1789478668.233006 mapread 0x023d84 thru 0x032367 (0xe5e4 bytes) 000291 1789478668.272913 mapwrite 0x0198dc thru 0x01cd84 (0x34a9 bytes) 000292 1789478668.301330 read 0x015dec thru 0x0227db (0xc9f0 bytes) 000293 1789478668.302056 trunc from 0x017475 to 0x018fcc (0x1b58 bytes) 000294 1789478668.307306 read 0x03ea1a thru 0x03fd5e (0x1345 bytes) 000295 1789478668.318535 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fd5f): Mirror 7: 0x4f3d937 (stale) Mirror 8: 0x4f3d937 (stale) Mirror 10: 0x4f3d937 (stale) Mirror 11: 0x4f3d937 (stale) Mirror 12: 0x4f3d937 (stale) Mirror 13: 0x4f3d937 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fd5f): Mirror 7: 0x4f3d937 (stale) Mirror 8: 0x4f3d937 (stale) Mirror 10: 0x4f3d937 (stale) Mirror 11: 0x4f3d937 (stale) Mirror 12: 0x4f3d937 (stale) Mirror 13: 0x4f3d937 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fd5f: skipped 000296 1789478669.172171 fallocate 0x01d2ba thru 0x02cfc9 (0xfd10 bytes) 000297 1789478669.177376 read 0x027299 thru 0x02936b (0x20d3 bytes) 000298 1789478669.186196 fallocate 0x034705 thru 0x03ffff (0xb8fb bytes) 000300 1789478669.191168 fallocate 0x029a59 thru 0x029f7c (0x524 bytes) 000301 1789478669.196054 read 0x02229f thru 0x02abb6 (0x8918 bytes) 000302 1789478669.207443 read 0x038716 thru 0x03ffff (0x78ea bytes) 000303 1789478669.208163 trunc from 0x040000 to 0x0054c7 (0x3ab38 bytes) 000304 1789478669.258879 fallocate 0x03bd2a thru 0x03ffff (0x42d6 bytes) 000305 1789478669.266358 read 0x01c51d thru 0x02621d (0x9d01 bytes) 000306 1789478669.293371 write 0x009e5e thru 0x017551 (0xd6f4 bytes) 000307 1789478669.311869 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x8d44fdcc (stale) Mirror 8: 0x8d44fdcc (stale) Mirror 10: 0x8d44fdcc (stale) Mirror 11: 0x8d44fdcc (stale) Mirror 12: 0x8d44fdcc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x8d44fdcc (stale) Mirror 8: 0x8d44fdcc (stale) Mirror 10: 0x8d44fdcc (stale) Mirror 11: 0x8d44fdcc (stale) Mirror 12: 0x8d44fdcc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000308 1789478670.226650 read 0x0163c8 thru 0x01fd84 (0x99bd bytes) 000309 1789478670.270622 fallocate 0x038f3f thru 0x03ffff (0x70c1 bytes) 000311 1789478670.282845 read 0x01d80d thru 0x0231bd (0x59b1 bytes) 000313 1789478670.317784 write 0x01faad thru 0x02808f (0x85e3 bytes) 000314 1789478670.327547 trunc from 0x040000 to 0x025d17 (0x1a2e8 bytes) 000317 1789478670.362494 punch from 0x019b9d to 0x025d17 (0xc17b bytes) 000318 1789478670.386824 mapread 0x01fb67 thru 0x021adb (0x1f75 bytes) 000319 1789478670.401879 fallocate 0x0247b5 thru 0x029f47 (0x5793 bytes) 000320 1789478670.406936 mapwrite 0x036088 thru 0x03d276 (0x71ef bytes) 000321 1789478670.467885 mapwrite 0x037409 thru 0x03b81f (0x4417 bytes) 000322 1789478670.487908 mapwrite 0x028803 thru 0x02ff5c (0x775a bytes) 000323 1789478670.539750 write 0x039ec9 thru 0x03edae (0x4ee6 bytes) 000324 1789478670.541528 write 0x0110bb thru 0x017e80 (0x6dc6 bytes) 000325 1789478670.543020 trunc from 0x03edaf to 0x03c4f8 (0x28b6 bytes) 000327 1789478670.566376 fallocate 0x01c8aa thru 0x026605 (0x9d5c bytes) 000328 1789478670.574627 mapwrite 0x014132 thru 0x01d69f (0x956e bytes) 000329 1789478670.632777 mapread 0x00eb70 thru 0x01c4f7 (0xd988 bytes) 000330 1789478670.634847 mapwrite 0x0018ca thru 0x0115f3 (0xfd2a bytes) 000332 1789478670.659096 trunc from 0x01faeb to 0x0291e9 (0x96ff bytes) 000333 1789478670.665769 mapwrite 0x006b9d thru 0x0107dc (0x9c40 bytes) 000334 1789478670.688040 fallocate 0x0318c7 thru 0x03400c (0x2746 bytes) 000335 1789478670.693791 mapread 0x034ea0 thru 0x03c4f8 (0x7659 bytes) 000336 1789478670.706952 trunc from 0x03c4f9 to 0x00ce62 (0x2f696 bytes) 000337 1789478670.736931 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xce63): Mirror 8: 0x56be33db (stale) Mirror 10: 0x56be33db (stale) Mirror 11: 0x56be33db (stale) Mirror 12: 0x56be33db (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xce63): Mirror 8: 0x56be33db (stale) Mirror 10: 0x56be33db (stale) Mirror 11: 0x56be33db (stale) Mirror 12: 0x56be33db (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xce63: skipped 000338 1789478671.208882 mapread 0x005b5f thru 0x00ce62 (0x7304 bytes) 000339 1789478671.231594 mapread 0x008651 thru 0x00ce62 (0x4812 bytes) 000340 1789478671.233013 fallocate 0x00ce68 thru 0x0174c7 (0xa660 bytes) 000341 1789478671.238803 write 0x015076 thru 0x0232c8 (0xe253 bytes) 000342 1789478671.245437 trunc from 0x0232c9 to 0x03f2a5 (0x1bfdd bytes) 000343 1789478671.263958 fallocate 0x01be13 thru 0x02231e (0x650c bytes) 000344 1789478671.269207 trunc from 0x03f2a6 to 0x0188dd (0x269c8 bytes) 000345 1789478671.290570 trunc from 0x0188de to 0x017c0e (0xccf bytes) 000346 1789478671.307995 write 0x038db3 thru 0x03ffff (0x724d bytes) 000347 1789478671.311324 mapread 0x00172d thru 0x00f25a (0xdb2e bytes) 000348 1789478671.319932 mapread 0x01a755 thru 0x01dfec (0x3898 bytes) 000349 1789478671.332209 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x8d44fdcc (stale) Mirror 10: 0x8d44fdcc (stale) Mirror 11: 0x8d44fdcc (stale) Mirror 12: 0x8d44fdcc (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9382d3c8 Mirror 13: 0x9382d3c8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000351 1789478672.597945 mapread 0x00b94b thru 0x01b4b8 (0xfb6e bytes) 000352 1789478672.683281 mapwrite 0x002196 thru 0x00369a (0x1505 bytes) 000353 1789478672.790819 trunc from 0x040000 to 0x01505f (0x2afa0 bytes) 000354 1789478672.859953 mapwrite 0x004d27 thru 0x012d14 (0xdfee bytes) 000355 1789478672.891789 fallocate 0x01fc04 thru 0x0271be (0x75bb bytes) 000356 1789478672.896956 punch from 0x0146f4 to 0x017d6f (0x367c bytes) 000357 1789478672.904032 read 0x021233 thru 0x0271be (0x5f8c bytes) 000358 1789478672.914639 trunc from 0x026683 to 0x0271be (0xb3c bytes) 000359 1789478672.920931 trunc from 0x019be8 to 0x01e2d9 (0x46f2 bytes) 000360 1789478672.925771 fallocate 0x00ea60 thru 0x017c28 (0x91c9 bytes) 000361 1789478672.931054 read 0x01983b thru 0x022957 (0x911d bytes) 000363 1789478672.942448 write 0x030431 thru 0x030e20 (0x9f0 bytes) 000364 1789478672.944101 fallocate 0x011098 thru 0x014964 (0x38cd bytes) 000366 1789478672.955510 MIRROR_RESYNC 6 mirrors 000367 1789478674.337957 read 0x02c471 thru 0x030e20 (0x49b0 bytes) 000368 1789478674.345629 fallocate 0x0326bc thru 0x03398a (0x12cf bytes) 000369 1789478674.380490 mapwrite 0x02207e thru 0x027bcc (0x5b4f bytes) 000370 1789478674.415901 mapread 0x02c872 thru 0x03398a (0x7119 bytes) 000371 1789478674.425020 punch from 0x00565f to 0x00aa16 (0x53b8 bytes) 000372 1789478674.429985 mapwrite 0x02315d thru 0x02ba49 (0x88ed bytes) 000373 1789478674.451745 MIRROR_RESYNC 6 mirrors 000374 1789478676.902182 trunc from 0x00c972 to 0x012ae8 (0x6177 bytes) 000375 1789478676.936558 mapwrite 0x0307cb thru 0x035853 (0x5089 bytes) 000376 1789478676.987550 trunc from 0x035854 to 0x00bb58 (0x29cfb bytes) 000377 1789478677.008754 trunc from 0x007a4a to 0x00b5e0 (0x3b97 bytes) 000378 1789478677.014253 trunc from 0x00bb59 to 0x015dd5 (0xa27d bytes) 000379 1789478677.043413 write 0x03c4cf thru 0x03ffff (0x3b31 bytes) 000381 1789478677.045408 punch from 0x03810f to 0x03cd51 (0x4c43 bytes) 000382 1789478677.054304 mapwrite 0x0368ea thru 0x03aac7 (0x41de bytes) 000383 1789478677.071483 punch from 0x005013 to 0x0075d8 (0x25c6 bytes) 000384 1789478677.079502 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xde7aab99 (stale) Mirror 10: 0xde7aab99 (stale) Mirror 11: 0xde7aab99 (stale) Mirror 12: 0xde7aab99 (stale) Mirror 13: 0xde7aab99 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6dd53bb0 Mirror 14: 0x6dd53bb0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000385 1789478678.154757 mapwrite 0x03cf3e thru 0x03ffff (0x30c2 bytes) 000387 1789478678.333429 mapread 0x02deca thru 0x02f2ef (0x1426 bytes) 000388 1789478678.346512 mapread 0x007eda thru 0x017ceb (0xfe12 bytes) 000390 1789478678.408945 trunc from 0x02d36f to 0x02da3a (0x6cc bytes) 000393 1789478678.416202 write 0x01557b thru 0x01e547 (0x8fcd bytes) 000394 1789478678.447063 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xde7aab99 (stale) Mirror 10: 0xde7aab99 (stale) Mirror 11: 0xde7aab99 (stale) Mirror 12: 0xde7aab99 (stale) Mirror 13: 0xde7aab99 (stale) Mirror 14: 0x6dd53bb0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdb8fff5d Mirror 15: 0xdb8fff5d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000396 1789478679.778150 trunc from 0x040000 to 0x004a85 (0x3b57a bytes) 000397 1789478679.850120 mapwrite 0x03cfef thru 0x03ffff (0x3011 bytes) 000398 1789478679.964278 mapread 0x02f0b5 thru 0x032e1e (0x3d6a bytes) 000399 1789478679.973428 punch from 0x03fd36 to 0x03ffff (0x2ca bytes) 000400 1789478679.978399 mapwrite 0x01cd62 thru 0x023a38 (0x6cd7 bytes) 000401 1789478679.998990 trunc from 0x040000 to 0x021d53 (0x1e2ac bytes) 000402 1789478680.010399 read 0x014d6c thru 0x021d53 (0xcfe8 bytes) 000403 1789478680.015019 fallocate 0x0141a8 thru 0x022efa (0xed53 bytes) 000404 1789478680.018405 mapread 0x0145c9 thru 0x015ed4 (0x190c bytes) 000405 1789478680.019319 mapwrite 0x00d6e7 thru 0x011d6a (0x4684 bytes) 000406 1789478680.063022 trunc from 0x01ac94 to 0x022efa (0x8267 bytes) 000407 1789478680.068167 mapwrite 0x004711 thru 0x00bafa (0x73ea bytes) 000408 1789478680.099151 MIRROR_RESYNC 8 mirrors 000409 1789478682.170779 write 0x032623 thru 0x032843 (0x221 bytes) 000410 1789478682.204335 read 0x023edf thru 0x024d35 (0xe57 bytes) 000411 1789478682.214914 read 0x0024ed thru 0x00a43d (0x7f51 bytes) 000412 1789478682.227267 read 0x01ef3d thru 0x02d25b (0xe31f bytes) 000413 1789478682.228317 punch from 0x006572 to 0x00c9e2 (0x6471 bytes) 000414 1789478682.233658 mapread 0x008d1d thru 0x00a3d9 (0x16bd bytes) 000415 1789478682.244008 write 0x0090d7 thru 0x00e129 (0x5053 bytes) 000417 1789478682.245908 write 0x0124f3 thru 0x017a92 (0x55a0 bytes) 000418 1789478682.250272 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32844): Mirror 8: 0x84f0572 (stale) Mirror 10: 0x84f0572 (stale) Mirror 11: 0x84f0572 (stale) Mirror 12: 0x84f0572 (stale) Mirror 13: 0x84f0572 (stale) Mirror 14: 0x84f0572 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32844): Mirror 8: 0x84f0572 (stale) Mirror 10: 0x84f0572 (stale) Mirror 11: 0x84f0572 (stale) Mirror 12: 0x84f0572 (stale) Mirror 13: 0x84f0572 (stale) Mirror 14: 0x84f0572 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32844: skipped 000419 1789478682.878270 trunc from 0x032844 to 0x01705a (0x1b7e9 bytes) 000420 1789478682.901080 mapread 0x012ace thru 0x01705a (0x458d bytes) 000422 1789478682.934277 mapwrite 0x0292de thru 0x0326bb (0x93de bytes) 000423 1789478683.059167 mapread 0x02b6f2 thru 0x0326bb (0x6fca bytes) 000424 1789478683.060085 read 0x014fd2 thru 0x024bd3 (0xfc02 bytes) 000425 1789478683.077789 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x326bc): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x326bc): Mirror 8: 0x83940643 (stale) Mirror 10: 0x83940643 (stale) Mirror 11: 0x83940643 (stale) Mirror 12: 0x83940643 (stale) Mirror 13: 0x83940643 (stale) Mirror 14: 0x83940643 (stale) CRC-32 checksum value for chunk [0, 0x326bc): Mirror 1: 0xb05b552 Mirror 15: 0xb05b552 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x326bc: skipped 000426 1789478684.423638 MIRROR_RESYNC 8 mirrors 000427 1789478687.481701 trunc from 0x0326bc to 0x0165eb (0x1c0d0 bytes) 000428 1789478687.660768 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x165ec): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x165ec): Mirror 8: 0xf7543dfa (stale) Mirror 10: 0xf7543dfa (stale) Mirror 11: 0xf7543dfa (stale) Mirror 12: 0xf7543dfa (stale) Mirror 13: 0xf7543dfa (stale) Mirror 14: 0xf7543dfa (stale) Mirror 15: 0xf7543dfa (stale) CRC-32 checksum value for chunk [0, 0x165ec): Mirror 1: 0xf7543dfa Mirror 16: 0xf7543dfa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x165ec: skipped 000429 1789478689.358195 punch from 0x00a1c2 to 0x00e1e9 (0x4028 bytes) 000430 1789478689.486639 trunc from 0x002f38 to 0x004158 (0x1221 bytes) 000431 1789478689.514655 trunc from 0x00ea0d to 0x0136bb (0x4caf bytes) 000432 1789478689.522637 punch from 0x011a6f to 0x0165eb (0x4b7d bytes) 000433 1789478689.536853 trunc from 0x0165ec to 0x0313cb (0x1ade0 bytes) 000434 1789478689.569595 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x313cc): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x313cc): Mirror 8: 0xd2d33603 (stale) Mirror 10: 0xd2d33603 (stale) Mirror 11: 0xd2d33603 (stale) Mirror 12: 0xd2d33603 (stale) Mirror 13: 0xd2d33603 (stale) Mirror 14: 0xd2d33603 (stale) Mirror 15: 0xd2d33603 (stale) Mirror 16: 0xcb86abc6 (stale) CRC-32 checksum value for chunk [0, 0x313cc): Mirror 1: 0xff299834 Mirror 17: 0xff299834 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x313cc: skipped 000435 1789478691.048657 punch from 0x01d1d9 to 0x01d5c1 (0x3e9 bytes) 000436 1789478691.110187 mapread 0x0118b6 thru 0x01e054 (0xc79f bytes) 000437 1789478691.142336 mapwrite 0x01db7c thru 0x025f0d (0x8392 bytes) 000438 1789478691.166605 read 0x02e346 thru 0x0313cb (0x3086 bytes) 000439 1789478691.180096 punch from 0x01a864 to 0x0250e1 (0xa87e bytes) 000440 1789478691.190326 mapread 0x00a727 thru 0x011d04 (0x75de bytes) 000441 1789478691.231807 write 0x0262e6 thru 0x0350cd (0xede8 bytes) 000442 1789478691.270597 read 0x01db0a thru 0x029292 (0xb789 bytes) 000443 1789478691.303530 punch from 0x00bbc7 to 0x01a807 (0xec41 bytes) 000444 1789478691.319968 trunc from 0x0350ce to 0x03570e (0x641 bytes) 000445 1789478691.346183 mapwrite 0x03a320 thru 0x03ffff (0x5ce0 bytes) 000447 1789478691.417925 mapwrite 0x015daa thru 0x020e51 (0xb0a8 bytes) 000448 1789478691.513382 mapwrite 0x014f56 thru 0x01a2b6 (0x5361 bytes) 000449 1789478691.547268 fallocate 0x01ca56 thru 0x02b8d7 (0xee82 bytes) 000450 1789478691.553619 trunc from 0x040000 to 0x0023d7 (0x3dc28 bytes) 000451 1789478691.605922 trunc from 0x00099d to 0x0023d7 (0x1a3b bytes) 000452 1789478691.628480 mapread 0x000c48 thru 0x0023d7 (0x1790 bytes) 000453 1789478691.665276 mapread 0x0000e4 thru 0x0023d7 (0x22f4 bytes) 000454 1789478691.670610 trunc from 0x0023d8 to 0x02e456 (0x2c07f bytes) 000455 1789478691.714342 MIRROR_RESYNC 10 mirrors 000457 1789478694.244666 fallocate 0x019927 thru 0x01d767 (0x3e41 bytes) 000458 1789478694.294103 mapwrite 0x025fe3 thru 0x026571 (0x58f bytes) 000460 1789478694.339864 fallocate 0x01f17e thru 0x02be97 (0xcd1a bytes) 000461 1789478694.356043 MIRROR_RESYNC 10 mirrors 000462 1789478695.926139 trunc from 0x006902 to 0x012cfe (0xc3fd bytes) 000463 1789478695.966116 write 0x037a99 thru 0x03ffff (0x8567 bytes) 000464 1789478695.967640 mapread 0x028032 thru 0x033746 (0xb715 bytes) 000465 1789478695.988245 fallocate 0x006e73 thru 0x00ba55 (0x4be3 bytes) 000466 1789478695.992656 mapwrite 0x00d320 thru 0x01a988 (0xd669 bytes) 000467 1789478696.044871 MIRROR_RESYNC 10 mirrors 000469 1789478697.748463 read 0x009302 thru 0x010683 (0x7382 bytes) 000470 1789478697.757354 read 0x008edf thru 0x013b0d (0xac2f bytes) 000471 1789478697.768004 MIRROR_EXTEND to 11 mirrors 000472 1789478698.316057 mapwrite 0x03b37f thru 0x03ffff (0x4c81 bytes) 000475 1789478698.422305 mapwrite 0x01c898 thru 0x024992 (0x80fb bytes) 000476 1789478698.454116 trunc from 0x040000 to 0x00398e (0x3c671 bytes) 000479 1789478698.508263 write 0x00e9c1 thru 0x01e898 (0xfed8 bytes) 000480 1789478698.510002 read 0x01b12a thru 0x01e898 (0x376f bytes) 000482 1789478698.515170 read 0x00049b thru 0x004258 (0x3dbe bytes) 000483 1789478698.547865 fallocate 0x026991 thru 0x02e871 (0x7ee1 bytes) 000484 1789478698.564252 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x1e899): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e899): Mirror 8: 0x12ab58c9 (stale) Mirror 10: 0x12ab58c9 (stale) Mirror 11: 0x12ab58c9 (stale) Mirror 12: 0x12ab58c9 (stale) Mirror 13: 0x12ab58c9 (stale) Mirror 14: 0x12ab58c9 (stale) Mirror 15: 0x12ab58c9 (stale) Mirror 16: 0x12ab58c9 (stale) Mirror 17: 0x12ab58c9 (stale) Mirror 18: 0x12ab58c9 (stale) CRC-32 checksum value for chunk [0, 0x1e899): Mirror 1: 0x1a4b435 Mirror 19: 0x1a4b435 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e899: skipped 000485 1789478699.416922 read 0x007ee9 thru 0x017594 (0xf6ac bytes) 000486 1789478699.425790 punch from 0x0178c2 to 0x01e3df (0x6b1e bytes) 000487 1789478699.445427 write 0x0184d6 thru 0x01bf76 (0x3aa1 bytes) 000488 1789478699.464466 mapwrite 0x0120b4 thru 0x01c628 (0xa575 bytes) 000489 1789478699.495073 fallocate 0x0230c5 thru 0x0299f3 (0x692f bytes) 000490 1789478699.499532 read 0x0064a9 thru 0x006723 (0x27b bytes) 000491 1789478699.507527 punch from 0x016cd2 to 0x01a6ce (0x39fd bytes) 000492 1789478699.511043 trunc from 0x015039 to 0x018c40 (0x3c08 bytes) 000493 1789478699.514423 mapread 0x012bbe thru 0x01acc3 (0x8106 bytes) 000494 1789478699.534476 mapwrite 0x01d414 thru 0x0213e4 (0x3fd1 bytes) 000495 1789478699.585393 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x213e5): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x213e5): Mirror 8: 0x436d62d1 (stale) Mirror 10: 0x436d62d1 (stale) Mirror 11: 0x436d62d1 (stale) Mirror 12: 0x436d62d1 (stale) Mirror 13: 0x436d62d1 (stale) Mirror 14: 0x436d62d1 (stale) Mirror 15: 0x436d62d1 (stale) Mirror 16: 0x436d62d1 (stale) Mirror 17: 0x436d62d1 (stale) Mirror 18: 0x436d62d1 (stale) Mirror 19: 0xea587183 (stale) CRC-32 checksum value for chunk [0, 0x213e5): Mirror 1: 0xe80bed6f Mirror 20: 0xe80bed6f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x213e5: skipped 000496 1789478700.786082 write 0x01a1ec thru 0x022728 (0x853d bytes) 000497 1789478700.873348 write 0x03e68d thru 0x03ffff (0x1973 bytes) 000498 1789478700.877179 punch from 0x00f33b to 0x0150dd (0x5da3 bytes) 000499 1789478700.889823 write 0x012032 thru 0x0146e3 (0x26b2 bytes) 000500 1789478700.909164 write 0x004f93 thru 0x007da5 (0x2e13 bytes) 000501 1789478700.927745 mapread 0x02d598 thru 0x033f28 (0x6991 bytes) 000502 1789478700.951752 read 0x003572 thru 0x00919e (0x5c2d bytes) 000503 1789478700.967374 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xf54d5fab (stale) Mirror 10: 0xf54d5fab (stale) Mirror 11: 0xf54d5fab (stale) Mirror 12: 0xf54d5fab (stale) Mirror 13: 0xf54d5fab (stale) Mirror 14: 0xf54d5fab (stale) Mirror 15: 0xf54d5fab (stale) Mirror 16: 0xf54d5fab (stale) Mirror 17: 0xf54d5fab (stale) Mirror 18: 0xf54d5fab (stale) Mirror 19: 0x4c01bb6a (stale) Mirror 20: 0x507dcfe2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5ceb6c75 Mirror 21: 0x5ceb6c75 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000504 1789478702.687760 trunc from 0x034d26 to 0x038b52 (0x3e2d bytes) 000505 1789478702.754580 mapwrite 0x00b577 thru 0x011005 (0x5a8f bytes) 000506 1789478702.802157 mapread 0x032dc5 thru 0x038477 (0x56b3 bytes) 000507 1789478702.815157 trunc from 0x0365f1 to 0x03cc99 (0x66a9 bytes) 000508 1789478702.821597 write 0x01555f thru 0x02309f (0xdb41 bytes) 000509 1789478702.835823 punch from 0x03db2c to 0x03dba4 (0x79 bytes) 000510 1789478702.841104 trunc from 0x0364cb to 0x03d1fe (0x6d34 bytes) 000511 1789478702.847700 trunc from 0x020ee7 to 0x022e1f (0x1f39 bytes) 000512 1789478702.866896 mapwrite 0x03a894 thru 0x03fa89 (0x51f6 bytes) 000513 1789478702.903468 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xf54d5fab (stale) Mirror 10: 0xf54d5fab (stale) Mirror 11: 0xf54d5fab (stale) Mirror 12: 0xf54d5fab (stale) Mirror 13: 0xf54d5fab (stale) Mirror 14: 0xf54d5fab (stale) Mirror 15: 0xf54d5fab (stale) Mirror 16: 0xf54d5fab (stale) Mirror 17: 0xf54d5fab (stale) Mirror 18: 0xf54d5fab (stale) Mirror 19: 0x4c01bb6a (stale) Mirror 20: 0x507dcfe2 (stale) Mirror 21: 0x5ceb6c75 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x96aa529c Mirror 22: 0x96aa529c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000514 1789478704.438261 fallocate 0x0177a7 thru 0x026954 (0xf1ae bytes) 000515 1789478704.481118 write 0x0395f2 thru 0x03ffff (0x6a0e bytes) 000516 1789478704.493443 MIRROR_RESYNC 15 mirrors 000517 1789478708.687451 trunc from 0x03a8b9 to 0x03ffff (0x5747 bytes) 000518 1789478708.729422 MIRROR_SPLIT mirror 10 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x85b82a55 (stale) Mirror 10: 0x85b82a55 (stale) Mirror 11: 0x85b82a55 (stale) Mirror 12: 0x85b82a55 (stale) Mirror 13: 0x85b82a55 (stale) Mirror 14: 0x85b82a55 (stale) Mirror 15: 0x85b82a55 (stale) Mirror 16: 0x85b82a55 (stale) Mirror 17: 0x85b82a55 (stale) Mirror 19: 0x85b82a55 (stale) Mirror 20: 0x85b82a55 (stale) Mirror 21: 0x85b82a55 (stale) Mirror 22: 0x85b82a55 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x85b82a55 (stale) Mirror 10: 0x85b82a55 (stale) Mirror 11: 0x85b82a55 (stale) Mirror 12: 0x85b82a55 (stale) Mirror 13: 0x85b82a55 (stale) Mirror 14: 0x85b82a55 (stale) Mirror 15: 0x85b82a55 (stale) Mirror 16: 0x85b82a55 (stale) Mirror 17: 0x85b82a55 (stale) Mirror 19: 0x85b82a55 (stale) Mirror 20: 0x85b82a55 (stale) Mirror 21: 0x85b82a55 (stale) Mirror 22: 0x85b82a55 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000519 1789478709.338836 punch from 0x00753d to 0x00d147 (0x5c0b bytes) 000520 1789478709.345573 punch from 0x00952d to 0x009d53 (0x827 bytes) 000521 1789478709.354358 read 0x00fe9f thru 0x01a51b (0xa67d bytes) 000522 1789478709.362192 mapread 0x02d91a thru 0x03a99a (0xd081 bytes) 000523 1789478709.388586 write 0x002a0e thru 0x007377 (0x496a bytes) 000524 1789478709.404603 punch from 0x0127fd to 0x018577 (0x5d7b bytes) 000525 1789478709.411380 mapwrite 0x036bbe thru 0x03ffff (0x9442 bytes) 000528 1789478709.433131 fallocate 0x0123c0 thru 0x015bf7 (0x3838 bytes) 000529 1789478709.438500 fallocate 0x01872c thru 0x020b4c (0x8421 bytes) 000530 1789478709.443898 mapread 0x014470 thru 0x01e4b3 (0xa044 bytes) 000531 1789478709.464050 write 0x015b72 thru 0x02473d (0xebcc bytes) 000532 1789478709.466485 fallocate 0x005382 thru 0x00d956 (0x85d5 bytes) 000533 1789478709.471855 mapread 0x03b077 thru 0x03ffff (0x4f89 bytes) 000534 1789478709.476881 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x85b82a55 (stale) Mirror 10: 0x85b82a55 (stale) Mirror 11: 0x85b82a55 (stale) Mirror 12: 0x85b82a55 (stale) Mirror 13: 0x85b82a55 (stale) Mirror 14: 0x85b82a55 (stale) Mirror 15: 0x85b82a55 (stale) Mirror 16: 0x85b82a55 (stale) Mirror 17: 0x85b82a55 (stale) Mirror 19: 0x85b82a55 (stale) Mirror 20: 0x85b82a55 (stale) Mirror 21: 0x85b82a55 (stale) Mirror 22: 0x85b82a55 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x93f37ac8 Mirror 23: 0x93f37ac8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000535 1789478710.715046 fallocate 0x02a81d thru 0x039303 (0xeae7 bytes) 000537 1789478710.768109 MIRROR_SPLIT mirror 14 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x85b82a55 (stale) Mirror 10: 0x85b82a55 (stale) Mirror 11: 0x85b82a55 (stale) Mirror 12: 0x85b82a55 (stale) Mirror 13: 0x85b82a55 (stale) Mirror 14: 0x85b82a55 (stale) Mirror 15: 0x85b82a55 (stale) Mirror 16: 0x85b82a55 (stale) Mirror 17: 0x85b82a55 (stale) Mirror 19: 0x85b82a55 (stale) Mirror 20: 0x85b82a55 (stale) Mirror 21: 0x85b82a55 (stale) Mirror 22: 0x85b82a55 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x85b82a55 (stale) Mirror 10: 0x85b82a55 (stale) Mirror 11: 0x85b82a55 (stale) Mirror 12: 0x85b82a55 (stale) Mirror 13: 0x85b82a55 (stale) Mirror 14: 0x85b82a55 (stale) Mirror 15: 0x85b82a55 (stale) Mirror 16: 0x85b82a55 (stale) Mirror 17: 0x85b82a55 (stale) Mirror 19: 0x85b82a55 (stale) Mirror 20: 0x85b82a55 (stale) Mirror 21: 0x85b82a55 (stale) Mirror 22: 0x85b82a55 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000538 1789478711.412088 mapwrite 0x0093d8 thru 0x01385a (0xa483 bytes) 000539 1789478711.455672 punch from 0x03800a to 0x038de9 (0xde0 bytes) 000540 1789478711.460919 mapwrite 0x014b37 thru 0x016ee8 (0x23b2 bytes) 000541 1789478711.480267 mapread 0x0360b0 thru 0x03ec8c (0x8bdd bytes) 000543 1789478711.490187 mapwrite 0x02badf thru 0x036124 (0xa646 bytes) 000544 1789478711.515943 trunc from 0x021ecf to 0x02420c (0x233e bytes) 000547 1789478711.521862 read 0x01abd6 thru 0x020b51 (0x5f7c bytes) 000548 1789478711.528938 trunc from 0x040000 to 0x000795 (0x3f86a bytes) 000550 1789478711.570092 read 0x000734 thru 0x000795 (0x62 bytes) 000551 1789478711.575128 write 0x03afb1 thru 0x03ffff (0x504f bytes) 000552 1789478711.576673 punch from 0x03dc70 to 0x03ffff (0x2390 bytes) 000553 1789478711.594356 fallocate 0x03ef2a thru 0x03ffff (0x10d6 bytes) 000554 1789478711.599223 fallocate 0x0196b4 thru 0x02624d (0xcb9a bytes) 000555 1789478711.607490 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x85b82a55 (stale) Mirror 10: 0x85b82a55 (stale) Mirror 11: 0x85b82a55 (stale) Mirror 12: 0x85b82a55 (stale) Mirror 13: 0x85b82a55 (stale) Mirror 14: 0x85b82a55 (stale) Mirror 15: 0x85b82a55 (stale) Mirror 16: 0x85b82a55 (stale) Mirror 17: 0x85b82a55 (stale) Mirror 19: 0x85b82a55 (stale) Mirror 20: 0x85b82a55 (stale) Mirror 21: 0x85b82a55 (stale) Mirror 22: 0x85b82a55 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x72850e39 Mirror 23: 0x72850e39 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000556 1789478712.553846 trunc from 0x031ebf to 0x03fe99 (0xdfdb bytes) 000557 1789478712.628093 write 0x0234f5 thru 0x02fda3 (0xc8af bytes) 000558 1789478712.695749 mapread 0x020542 thru 0x025385 (0x4e44 bytes) 000559 1789478712.740124 trunc from 0x00fa40 to 0x014c64 (0x5225 bytes) 000560 1789478712.748095 write 0x032817 thru 0x03d5c2 (0xadac bytes) 000561 1789478712.785386 fallocate 0x039dc9 thru 0x03bcc8 (0x1f00 bytes) 000562 1789478712.814421 MIRROR_SPLIT mirror 11 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x85b82a55 (stale) Mirror 10: 0x85b82a55 (stale) Mirror 11: 0x85b82a55 (stale) Mirror 12: 0x85b82a55 (stale) Mirror 13: 0x85b82a55 (stale) Mirror 14: 0x85b82a55 (stale) Mirror 15: 0x85b82a55 (stale) Mirror 16: 0x85b82a55 (stale) Mirror 17: 0x85b82a55 (stale) Mirror 19: 0x85b82a55 (stale) Mirror 21: 0x85b82a55 (stale) Mirror 22: 0x85b82a55 (stale) Mirror 23: 0x72850e39 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x85b82a55 (stale) Mirror 10: 0x85b82a55 (stale) Mirror 11: 0x85b82a55 (stale) Mirror 12: 0x85b82a55 (stale) Mirror 13: 0x85b82a55 (stale) Mirror 14: 0x85b82a55 (stale) Mirror 15: 0x85b82a55 (stale) Mirror 16: 0x85b82a55 (stale) Mirror 17: 0x85b82a55 (stale) Mirror 19: 0x85b82a55 (stale) Mirror 21: 0x85b82a55 (stale) Mirror 22: 0x85b82a55 (stale) Mirror 23: 0x72850e39 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000563 1789478714.069621 fallocate 0x03743f thru 0x03b1f4 (0x3db6 bytes) 000564 1789478714.075656 mapread 0x018164 thru 0x0227b0 (0xa64d bytes) 000567 1789478714.105713 fallocate 0x02eb5a thru 0x035d9e (0x7245 bytes) 000568 1789478714.112445 fallocate 0x004ef9 thru 0x014a7e (0xfb86 bytes) 000569 1789478714.117221 trunc from 0x0101ac to 0x018e8b (0x8ce0 bytes) 000570 1789478714.123077 read 0x020064 thru 0x02cf4d (0xceea bytes) 000571 1789478714.131898 write 0x0114a7 thru 0x01a6c3 (0x921d bytes) 000572 1789478714.143063 trunc from 0x040000 to 0x00b519 (0x34ae6 bytes) 000574 1789478714.184008 write 0x0255b1 thru 0x03550b (0xff5b bytes) 000575 1789478714.187440 fallocate 0x03e3b9 thru 0x03ffff (0x1c47 bytes) 000576 1789478714.193343 trunc from 0x025345 to 0x02b192 (0x5e4e bytes) 000577 1789478714.207765 write 0x000094 thru 0x00daef (0xda5c bytes) 000579 1789478714.218029 trunc from 0x00a61f to 0x010d5c (0x673e bytes) 000580 1789478714.230981 punch from 0x01706e to 0x017823 (0x7b6 bytes) 000581 1789478714.235007 trunc from 0x003a1a to 0x00ef2f (0xb516 bytes) 000582 1789478714.240213 trunc from 0x03550c to 0x01d127 (0x183e4 bytes) 000583 1789478714.258129 fallocate 0x00302d thru 0x004c25 (0x1bf9 bytes) 000584 1789478714.263671 mapread 0x002c06 thru 0x006e82 (0x427d bytes) 000585 1789478714.284401 MIRROR_SPLIT mirror 11 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1d128): Mirror 8: 0xe1d06c70 (stale) Mirror 10: 0xe1d06c70 (stale) Mirror 11: 0xe1d06c70 (stale) Mirror 12: 0xe1d06c70 (stale) Mirror 13: 0xe1d06c70 (stale) Mirror 14: 0xe1d06c70 (stale) Mirror 15: 0xe1d06c70 (stale) Mirror 16: 0xe1d06c70 (stale) Mirror 17: 0xe1d06c70 (stale) Mirror 19: 0xe1d06c70 (stale) Mirror 22: 0xe1d06c70 (stale) Mirror 23: 0xefeafc20 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d128): Mirror 8: 0xe1d06c70 (stale) Mirror 10: 0xe1d06c70 (stale) Mirror 11: 0xe1d06c70 (stale) Mirror 12: 0xe1d06c70 (stale) Mirror 13: 0xe1d06c70 (stale) Mirror 14: 0xe1d06c70 (stale) Mirror 15: 0xe1d06c70 (stale) Mirror 16: 0xe1d06c70 (stale) Mirror 17: 0xe1d06c70 (stale) Mirror 19: 0xe1d06c70 (stale) Mirror 22: 0xe1d06c70 (stale) Mirror 23: 0xefeafc20 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d128: skipped 000586 1789478715.003407 trunc from 0x015fc3 to 0x0166bc (0x6fa bytes) 000587 1789478715.009176 mapread 0x010191 thru 0x015a96 (0x5906 bytes) 000588 1789478715.038151 write 0x03b699 thru 0x03ffff (0x4967 bytes) 000589 1789478715.043482 trunc from 0x019cab to 0x01b481 (0x17d7 bytes) 000590 1789478715.049310 mapread 0x027cfe thru 0x02fd32 (0x8035 bytes) 000591 1789478715.066536 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x85b82a55 (stale) Mirror 10: 0x85b82a55 (stale) Mirror 11: 0x85b82a55 (stale) Mirror 12: 0x85b82a55 (stale) Mirror 13: 0x85b82a55 (stale) Mirror 14: 0x85b82a55 (stale) Mirror 15: 0x85b82a55 (stale) Mirror 16: 0x85b82a55 (stale) Mirror 17: 0x85b82a55 (stale) Mirror 19: 0x85b82a55 (stale) Mirror 22: 0x85b82a55 (stale) Mirror 23: 0x72850e39 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdcec836d Mirror 24: 0xdcec836d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000592 1789478716.170912 punch from 0x03daa3 to 0x03ffff (0x255d bytes) 000593 1789478716.302536 mapwrite 0x023006 thru 0x027246 (0x4241 bytes) 000594 1789478716.351870 mapread 0x0216d4 thru 0x027753 (0x6080 bytes) 000595 1789478716.353355 punch from 0x02aab0 to 0x0377b4 (0xcd05 bytes) 000596 1789478716.359200 mapread 0x001c75 thru 0x005e87 (0x4213 bytes) 000597 1789478716.373956 trunc from 0x006f4b to 0x009b26 (0x2bdc bytes) 000598 1789478716.379448 punch from 0x0061ba to 0x00c7c5 (0x660c bytes) 000599 1789478716.385646 trunc from 0x040000 to 0x010f1c (0x2f0e3 bytes) 000600 1789478716.444657 mapwrite 0x00636c thru 0x00b815 (0x54aa bytes) 000601 1789478716.471071 mapwrite 0x0382bc thru 0x03f595 (0x72da bytes) 000602 1789478716.520402 trunc from 0x03f596 to 0x0093b0 (0x361e5 bytes) 000603 1789478716.542822 mapwrite 0x001f96 thru 0x00e361 (0xc3cc bytes) 000604 1789478716.582358 trunc from 0x00e362 to 0x036f47 (0x28be6 bytes) 000605 1789478716.601970 trunc from 0x001702 to 0x00443d (0x2d3c bytes) 000606 1789478716.607116 trunc from 0x036f48 to 0x03664e (0x8f9 bytes) 000607 1789478716.622791 mapread 0x02b720 thru 0x0340b0 (0x8991 bytes) 000608 1789478716.642879 mapread 0x001d2b thru 0x002497 (0x76d bytes) 000609 1789478716.651139 write 0x01761e thru 0x017d19 (0x6fc bytes) 000610 1789478716.656872 mapwrite 0x03b97c thru 0x03ffff (0x4684 bytes) 000611 1789478716.699176 read 0x03de39 thru 0x03ffff (0x21c7 bytes) 000612 1789478716.700002 fallocate 0x038132 thru 0x03919c (0x106b bytes) 000613 1789478716.708104 punch from 0x0370a9 to 0x03ffff (0x8f57 bytes) 000614 1789478716.717099 MIRROR_RESYNC 14 mirrors 000615 1789478719.591262 mapread 0x02c974 thru 0x03accc (0xe359 bytes) 000616 1789478719.626580 punch from 0x00a87c to 0x0114e0 (0x6c65 bytes) 000617 1789478719.670875 read 0x03afd1 thru 0x03d6ed (0x271d bytes) 000618 1789478719.678402 trunc from 0x040000 to 0x01500f (0x2aff0 bytes) 000619 1789478719.704612 mapread 0x00644a thru 0x0089fa (0x25b1 bytes) 000620 1789478719.719998 mapwrite 0x03a3a6 thru 0x03baf6 (0x1751 bytes) 000621 1789478719.778847 trunc from 0x02aed2 to 0x03053c (0x566b bytes) 000622 1789478719.785930 read 0x009ba9 thru 0x011ccc (0x8124 bytes) 000623 1789478719.805403 write 0x009ea4 thru 0x0189dd (0xeb3a bytes) 000624 1789478719.811129 punch from 0x00fb84 to 0x01c424 (0xc8a1 bytes) 000626 1789478719.842387 MIRROR_RESYNC 14 mirrors 000627 1789478722.636746 fallocate 0x008d9f thru 0x008f6e (0x1d0 bytes) 000628 1789478722.686984 read 0x00812b thru 0x00b618 (0x34ee bytes) 000629 1789478722.696853 mapread 0x03a70f thru 0x03baf6 (0x13e8 bytes) 000631 1789478722.712595 write 0x021cdf thru 0x02edbb (0xd0dd bytes) 000633 1789478722.727587 trunc from 0x03baf7 to 0x00337e (0x38778 bytes) 000634 1789478722.751125 punch from 0x002ee2 to 0x00337e (0x49d bytes) 000635 1789478722.756863 fallocate 0x0112e0 thru 0x0173a2 (0x60c3 bytes) 000636 1789478722.765255 read 0x006f99 thru 0x00df5b (0x6fc3 bytes) 000637 1789478722.788766 MIRROR_SPLIT mirror 1 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x173a3): Mirror 10: 0x16117b6c (stale) Mirror 11: 0x16117b6c (stale) Mirror 12: 0x16117b6c (stale) Mirror 13: 0x16117b6c (stale) Mirror 14: 0x16117b6c (stale) Mirror 15: 0x16117b6c (stale) Mirror 16: 0x16117b6c (stale) Mirror 17: 0x16117b6c (stale) Mirror 19: 0x16117b6c (stale) Mirror 22: 0x16117b6c (stale) Mirror 23: 0x16117b6c (stale) Mirror 24: 0x16117b6c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x173a3): Mirror 10: 0x16117b6c (stale) Mirror 11: 0x16117b6c (stale) Mirror 12: 0x16117b6c (stale) Mirror 13: 0x16117b6c (stale) Mirror 14: 0x16117b6c (stale) Mirror 15: 0x16117b6c (stale) Mirror 16: 0x16117b6c (stale) Mirror 17: 0x16117b6c (stale) Mirror 19: 0x16117b6c (stale) Mirror 22: 0x16117b6c (stale) Mirror 23: 0x16117b6c (stale) Mirror 24: 0x16117b6c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x173a3: skipped 000638 1789478723.362007 write 0x0046e1 thru 0x0070ba (0x29da bytes) 000639 1789478723.377724 mapwrite 0x036401 thru 0x03ffff (0x9bff bytes) 000640 1789478723.448797 trunc from 0x040000 to 0x003f81 (0x3c07e bytes) 000641 1789478723.475888 MIRROR_SPLIT mirror 2 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f82): Mirror 10: 0x77fecf9b (stale) Mirror 12: 0x77fecf9b (stale) Mirror 13: 0x77fecf9b (stale) Mirror 14: 0x77fecf9b (stale) Mirror 15: 0x77fecf9b (stale) Mirror 16: 0x77fecf9b (stale) Mirror 17: 0x77fecf9b (stale) Mirror 19: 0x77fecf9b (stale) Mirror 22: 0x77fecf9b (stale) Mirror 23: 0x77fecf9b (stale) Mirror 24: 0x77fecf9b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f82): Mirror 10: 0x77fecf9b (stale) Mirror 12: 0x77fecf9b (stale) Mirror 13: 0x77fecf9b (stale) Mirror 14: 0x77fecf9b (stale) Mirror 15: 0x77fecf9b (stale) Mirror 16: 0x77fecf9b (stale) Mirror 17: 0x77fecf9b (stale) Mirror 19: 0x77fecf9b (stale) Mirror 22: 0x77fecf9b (stale) Mirror 23: 0x77fecf9b (stale) Mirror 24: 0x77fecf9b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f82: skipped 000642 1789478724.037822 trunc from 0x003f82 to 0x02eac1 (0x2ab40 bytes) 000643 1789478724.056429 trunc from 0x02eac2 to 0x025b42 (0x8f7f bytes) 000645 1789478724.075397 write 0x01ee48 thru 0x027b53 (0x8d0c bytes) 000646 1789478724.082157 fallocate 0x00425b thru 0x00cdc4 (0x8b6a bytes) 000647 1789478724.086553 read 0x01523a thru 0x01830d (0x30d4 bytes) 000648 1789478724.093366 write 0x034fdd thru 0x03bdcd (0x6df1 bytes) 000649 1789478724.095278 write 0x025733 thru 0x02ad28 (0x55f6 bytes) 000650 1789478724.104536 MIRROR_RESYNC 12 mirrors 000651 1789478726.916213 MIRROR_RESYNC 12 mirrors 000652 1789478727.992104 read 0x02d0ff thru 0x02d524 (0x426 bytes) 000653 1789478728.000159 fallocate 0x02b035 thru 0x02fa23 (0x49ef bytes) 000654 1789478728.088025 MIRROR_RESYNC 12 mirrors 000655 1789478730.763353 mapread 0x03a8ef thru 0x03bdcd (0x14df bytes) 000656 1789478730.772941 punch from 0x00c3d4 to 0x0189c9 (0xc5f6 bytes) 000657 1789478730.814241 write 0x0326a4 thru 0x03304f (0x9ac bytes) 000658 1789478730.823793 mapread 0x036148 thru 0x03bdcd (0x5c86 bytes) 000659 1789478730.832866 mapread 0x0205ff thru 0x024d45 (0x4747 bytes) 000660 1789478730.842752 punch from 0x0038d4 to 0x00b4ce (0x7bfb bytes) 000661 1789478730.848665 read 0x01ce06 thru 0x026161 (0x935c bytes) 000662 1789478730.849442 mapread 0x03575f thru 0x0357f1 (0x93 bytes) 000663 1789478730.851169 trunc from 0x0387df to 0x039ac3 (0x12e5 bytes) 000664 1789478730.856504 trunc from 0x01bfae to 0x01ff63 (0x3fb6 bytes) 000665 1789478730.861311 fallocate 0x028b41 thru 0x02cfda (0x449a bytes) 000666 1789478730.866645 trunc from 0x01cc55 to 0x029565 (0xc911 bytes) 000667 1789478730.872015 mapread 0x019613 thru 0x01f65a (0x6048 bytes) 000668 1789478730.883988 read 0x01a9ff thru 0x02573b (0xad3d bytes) 000670 1789478730.896323 trunc from 0x03bdce to 0x01de7b (0x1df52 bytes) 000671 1789478730.920144 mapread 0x013d83 thru 0x01de7b (0xa0f9 bytes) 000673 1789478730.921618 trunc from 0x017e0f to 0x01de7b (0x606d bytes) 000676 1789478730.928918 mapwrite 0x00296b thru 0x011482 (0xeb18 bytes) 000677 1789478730.959054 trunc from 0x01de7c to 0x010162 (0xdd19 bytes) 000678 1789478730.978552 mapread 0x000fb2 thru 0x00cc9d (0xbcec bytes) 000679 1789478730.980305 trunc from 0x010163 to 0x00d5ea (0x2b78 bytes) 000680 1789478731.003992 trunc from 0x00c7eb to 0x00d5ea (0xe00 bytes) 000681 1789478731.009521 trunc from 0x001909 to 0x009f1d (0x8615 bytes) 000682 1789478731.015215 fallocate 0x01ca81 thru 0x021ead (0x542d bytes) 000683 1789478731.020348 mapwrite 0x019b61 thru 0x022542 (0x89e2 bytes) 000684 1789478731.149115 read 0x01f6a3 thru 0x0200a1 (0x9ff bytes) 000686 1789478731.150796 mapwrite 0x00a68d thru 0x00e88f (0x4203 bytes) 000687 1789478731.211106 fallocate 0x03a130 thru 0x03ced3 (0x2da4 bytes) 000688 1789478731.219469 write 0x006a69 thru 0x01621f (0xf7b7 bytes) 000689 1789478731.222966 fallocate 0x01e995 thru 0x0294ae (0xab1a bytes) 000690 1789478731.226888 punch from 0x013736 to 0x01da94 (0xa35f bytes) 000691 1789478731.266465 MIRROR_SPLIT mirror 11 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ced4): Mirror 10: 0x7259ff2d (stale) Mirror 12: 0x7259ff2d (stale) Mirror 13: 0x7259ff2d (stale) Mirror 14: 0x7259ff2d (stale) Mirror 15: 0x7259ff2d (stale) Mirror 16: 0x7259ff2d (stale) Mirror 17: 0x7259ff2d (stale) Mirror 19: 0x7259ff2d (stale) Mirror 22: 0x7259ff2d (stale) Mirror 23: 0x7259ff2d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ced4): Mirror 10: 0x7259ff2d (stale) Mirror 12: 0x7259ff2d (stale) Mirror 13: 0x7259ff2d (stale) Mirror 14: 0x7259ff2d (stale) Mirror 15: 0x7259ff2d (stale) Mirror 16: 0x7259ff2d (stale) Mirror 17: 0x7259ff2d (stale) Mirror 19: 0x7259ff2d (stale) Mirror 22: 0x7259ff2d (stale) Mirror 23: 0x7259ff2d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ced4: skipped 000692 1789478732.093411 trunc from 0x00a1b1 to 0x016d7f (0xcbcf bytes) 000693 1789478732.101348 fallocate 0x035883 thru 0x037785 (0x1f03 bytes) 000694 1789478732.107419 mapread 0x00e0ba thru 0x01a3c9 (0xc310 bytes) 000695 1789478732.164664 fallocate 0x038778 thru 0x03ebb9 (0x6442 bytes) 000696 1789478732.173524 mapread 0x01f558 thru 0x024569 (0x5012 bytes) 000697 1789478732.195972 fallocate 0x026b55 thru 0x0329ad (0xbe59 bytes) 000698 1789478732.212258 read 0x035160 thru 0x03c343 (0x71e4 bytes) 000699 1789478732.227282 mapread 0x00f689 thru 0x0194a1 (0x9e19 bytes) 000700 1789478732.234657 MIRROR_RESYNC 11 mirrors 000701 1789478735.586955 punch from 0x03aaef to 0x03ebb9 (0x40cb bytes) 000702 1789478735.631351 mapwrite 0x01dd85 thru 0x022f12 (0x518e bytes) 000703 1789478735.678628 mapread 0x03b862 thru 0x03bf38 (0x6d7 bytes) 000704 1789478735.704502 MIRROR_RESYNC 11 mirrors 000705 1789478738.351380 punch from 0x0319b1 to 0x0345f6 (0x2c46 bytes) 000706 1789478738.384808 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3ebba): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ebba): Mirror 10: 0xb88957c3 (stale) Mirror 12: 0xb88957c3 (stale) Mirror 13: 0xb88957c3 (stale) Mirror 14: 0xb88957c3 (stale) Mirror 15: 0xb88957c3 (stale) Mirror 16: 0xb88957c3 (stale) Mirror 17: 0xb88957c3 (stale) Mirror 19: 0xb88957c3 (stale) Mirror 22: 0xb88957c3 (stale) Mirror 23: 0xb88957c3 (stale) CRC-32 checksum value for chunk [0, 0x3ebba): Mirror 1: 0xb88957c3 Mirror 24: 0xb88957c3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ebba: skipped 000707 1789478739.513373 mapread 0x013bcb thru 0x013e31 (0x267 bytes) 000708 1789478739.545599 punch from 0x0254a3 to 0x0293c1 (0x3f1f bytes) 000709 1789478739.592380 mapread 0x02c633 thru 0x02ef94 (0x2962 bytes) 000710 1789478739.613519 mapwrite 0x026452 thru 0x033efb (0xdaaa bytes) 000711 1789478739.635819 mapwrite 0x002962 thru 0x005137 (0x27d6 bytes) 000712 1789478739.656876 mapwrite 0x01b5f1 thru 0x02513b (0x9b4b bytes) 000713 1789478739.699922 punch from 0x021984 to 0x02a81b (0x8e98 bytes) 000714 1789478739.705126 write 0x00784e thru 0x016c19 (0xf3cc bytes) 000715 1789478739.710597 trunc from 0x000bfb to 0x00eb1e (0xdf24 bytes) 000716 1789478739.727581 read 0x01c42d thru 0x022e63 (0x6a37 bytes) 000717 1789478739.732927 mapwrite 0x01a4cb thru 0x01ab45 (0x67b bytes) 000718 1789478739.742647 read 0x01447d thru 0x01e02e (0x9bb2 bytes) 000719 1789478739.744099 punch from 0x039969 to 0x03ebb9 (0x5251 bytes) 000720 1789478739.748229 trunc from 0x00fbf7 to 0x0142aa (0x46b4 bytes) 000721 1789478739.754726 mapwrite 0x00e984 thru 0x01b15b (0xc7d8 bytes) 000722 1789478739.785186 trunc from 0x0008f5 to 0x000e84 (0x590 bytes) 000723 1789478739.789268 fallocate 0x03a41a thru 0x03ffff (0x5be6 bytes) 000724 1789478739.793858 fallocate 0x004201 thru 0x00fc6a (0xba6a bytes) 000725 1789478739.797842 punch from 0x03af01 to 0x03ebb9 (0x3cb9 bytes) 000726 1789478739.802622 write 0x028b5d thru 0x036bde (0xe082 bytes) 000727 1789478739.804330 fallocate 0x034b84 thru 0x036a55 (0x1ed2 bytes) 000728 1789478739.808825 fallocate 0x02f8f8 thru 0x035466 (0x5b6f bytes) 000729 1789478739.813814 read 0x000c22 thru 0x00fe0d (0xf1ec bytes) 000730 1789478739.825809 trunc from 0x03ebba to 0x011b92 (0x2d027 bytes) 000731 1789478739.852287 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x11b93): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11b93): Mirror 10: 0x3ae2d84c (stale) Mirror 12: 0x3ae2d84c (stale) Mirror 13: 0x3ae2d84c (stale) Mirror 14: 0x3ae2d84c (stale) Mirror 15: 0x3ae2d84c (stale) Mirror 16: 0x3ae2d84c (stale) Mirror 17: 0x3ae2d84c (stale) Mirror 19: 0x3ae2d84c (stale) Mirror 22: 0x3ae2d84c (stale) Mirror 23: 0x3ae2d84c (stale) Mirror 24: 0x3ae2d84c (stale) CRC-32 checksum value for chunk [0, 0x11b93): Mirror 1: 0x25144f65 Mirror 25: 0x25144f65 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11b93: skipped 000732 1789478740.694227 write 0x028a64 thru 0x029e48 (0x13e5 bytes) 000734 1789478740.741431 write 0x027765 thru 0x02ca9c (0x5338 bytes) 000735 1789478740.747084 trunc from 0x01ea40 to 0x0222da (0x389b bytes) 000736 1789478740.751374 fallocate 0x03fb70 thru 0x03ffff (0x490 bytes) 000737 1789478740.758261 write 0x034f9c thru 0x03af95 (0x5ffa bytes) 000738 1789478740.771114 mapread 0x0292c6 thru 0x0341fe (0xaf39 bytes) 000739 1789478740.789739 fallocate 0x024e30 thru 0x02ccdc (0x7ead bytes) 000740 1789478740.795425 trunc from 0x040000 to 0x002a04 (0x3d5fb bytes) 000741 1789478740.811950 write 0x0196e7 thru 0x0283e2 (0xecfc bytes) 000742 1789478740.818517 MIRROR_RESYNC 13 mirrors 000743 1789478742.806664 trunc from 0x02246c to 0x0283e2 (0x5f77 bytes) 000744 1789478742.839605 write 0x008952 thru 0x013263 (0xa912 bytes) 000745 1789478742.848153 trunc from 0x00d053 to 0x00f937 (0x28e5 bytes) 000746 1789478742.859214 punch from 0x020324 to 0x0283e2 (0x80bf bytes) 000747 1789478742.868258 MIRROR_SPLIT mirror 11 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x283e3): Mirror 10: 0xfbbb08c1 (stale) Mirror 12: 0xfbbb08c1 (stale) Mirror 13: 0xfbbb08c1 (stale) Mirror 14: 0xfbbb08c1 (stale) Mirror 15: 0xfbbb08c1 (stale) Mirror 16: 0xfbbb08c1 (stale) Mirror 17: 0xfbbb08c1 (stale) Mirror 19: 0xfbbb08c1 (stale) Mirror 22: 0xfbbb08c1 (stale) Mirror 23: 0xfbbb08c1 (stale) Mirror 25: 0xfbbb08c1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x283e3): Mirror 10: 0xfbbb08c1 (stale) Mirror 12: 0xfbbb08c1 (stale) Mirror 13: 0xfbbb08c1 (stale) Mirror 14: 0xfbbb08c1 (stale) Mirror 15: 0xfbbb08c1 (stale) Mirror 16: 0xfbbb08c1 (stale) Mirror 17: 0xfbbb08c1 (stale) Mirror 19: 0xfbbb08c1 (stale) Mirror 22: 0xfbbb08c1 (stale) Mirror 23: 0xfbbb08c1 (stale) Mirror 25: 0xfbbb08c1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x283e3: skipped 000748 1789478743.416838 trunc from 0x0283e3 to 0x02f276 (0x6e94 bytes) 000749 1789478743.441321 trunc from 0x011813 to 0x01d4e8 (0xbcd6 bytes) 000750 1789478743.446060 read 0x02284d thru 0x022e25 (0x5d9 bytes) 000751 1789478743.452016 mapread 0x025d2b thru 0x02da48 (0x7d1e bytes) 000753 1789478743.477279 trunc from 0x02f277 to 0x00cbd3 (0x226a3 bytes) 000754 1789478743.505347 mapread 0x00c92f thru 0x00cbd3 (0x2a5 bytes) 000755 1789478743.515599 punch from 0x0083b3 to 0x00cbd3 (0x4821 bytes) 000757 1789478743.525647 mapread 0x007c18 thru 0x0099eb (0x1dd4 bytes) 000758 1789478743.543439 fallocate 0x02a082 thru 0x02d87b (0x37fa bytes) 000759 1789478743.548261 read 0x000806 thru 0x00cbd3 (0xc3ce bytes) 000761 1789478743.554935 mapread 0x0064bd thru 0x006eb0 (0x9f4 bytes) 000762 1789478743.557873 trunc from 0x00cbd4 to 0x01fd5c (0x13189 bytes) 000763 1789478743.576395 mapread 0x0064f4 thru 0x00fb4e (0x965b bytes) 000764 1789478743.593368 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x1fd5d): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fd5d): Mirror 10: 0xa0cbc002 (stale) Mirror 12: 0xa0cbc002 (stale) Mirror 13: 0xa0cbc002 (stale) Mirror 14: 0xa0cbc002 (stale) Mirror 15: 0xa0cbc002 (stale) Mirror 16: 0xa0cbc002 (stale) Mirror 17: 0xa0cbc002 (stale) Mirror 19: 0xa0cbc002 (stale) Mirror 22: 0xa0cbc002 (stale) Mirror 23: 0xa0cbc002 (stale) Mirror 25: 0xa0cbc002 (stale) CRC-32 checksum value for chunk [0, 0x1fd5d): Mirror 1: 0xa09812e Mirror 26: 0xa09812e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fd5d: skipped 000765 1789478744.517157 trunc from 0x010d37 to 0x015e04 (0x50ce bytes) 000766 1789478744.560348 mapread 0x00f769 thru 0x014ee2 (0x577a bytes) 000767 1789478744.582396 mapwrite 0x03a15b thru 0x03ffff (0x5ea5 bytes) 000769 1789478744.650604 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xaf9549e (stale) Mirror 12: 0xaf9549e (stale) Mirror 13: 0xaf9549e (stale) Mirror 14: 0xaf9549e (stale) Mirror 15: 0xaf9549e (stale) Mirror 16: 0xaf9549e (stale) Mirror 17: 0xaf9549e (stale) Mirror 19: 0xaf9549e (stale) Mirror 22: 0xaf9549e (stale) Mirror 23: 0xaf9549e (stale) Mirror 25: 0xaf9549e (stale) Mirror 26: 0x9a54c62 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1f435ebc Mirror 27: 0x1f435ebc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000770 1789478745.775942 punch from 0x022120 to 0x0231ea (0x10cb bytes) 000772 1789478745.834379 mapread 0x039831 thru 0x03ffff (0x67cf bytes) 000773 1789478745.860526 mapread 0x03b79a thru 0x03ffff (0x4866 bytes) 000774 1789478745.862178 punch from 0x01831e to 0x01bceb (0x39ce bytes) 000776 1789478745.871297 punch from 0x03382c to 0x03e2bf (0xaa94 bytes) 000777 1789478745.877303 mapread 0x00aec6 thru 0x018577 (0xd6b2 bytes) 000778 1789478745.900384 trunc from 0x00c26a to 0x01ba26 (0xf7bd bytes) 000779 1789478745.907104 mapwrite 0x01638f thru 0x018919 (0x258b bytes) 000780 1789478745.939606 fallocate 0x016441 thru 0x01ffcf (0x9b8f bytes) 000782 1789478745.944615 read 0x000a3c thru 0x00bfd3 (0xb598 bytes) 000783 1789478745.949913 trunc from 0x02bca8 to 0x03aac7 (0xee20 bytes) 000785 1789478745.954741 trunc from 0x0314a6 to 0x03bea7 (0xaa02 bytes) 000787 1789478745.961504 punch from 0x005270 to 0x00ff1f (0xacb0 bytes) 000788 1789478745.966839 trunc from 0x040000 to 0x006390 (0x39c6f bytes) 000791 1789478746.001652 trunc from 0x006391 to 0x03d2ab (0x36f1b bytes) 000793 1789478746.030809 read 0x01de9a thru 0x01e9ed (0xb54 bytes) 000794 1789478746.060999 read 0x012f1d thru 0x015b92 (0x2c76 bytes) 000795 1789478746.064903 trunc from 0x03d2ac to 0x00f609 (0x2dca2 bytes) 000798 1789478746.110282 read 0x00b951 thru 0x00cec8 (0x1578 bytes) 000799 1789478746.113908 write 0x0040f3 thru 0x012688 (0xe596 bytes) 000800 1789478746.124132 trunc from 0x003877 to 0x00428b (0xa15 bytes) 000801 1789478746.155429 mapread 0x009b31 thru 0x012688 (0x8b58 bytes) 000802 1789478746.156403 mapread 0x007894 thru 0x008758 (0xec5 bytes) 000803 1789478746.157150 read 0x005496 thru 0x00a854 (0x53bf bytes) 000804 1789478746.159279 punch from 0x0070dc to 0x00cf77 (0x5e9c bytes) 000805 1789478746.166295 trunc from 0x012689 to 0x00ae3c (0x784c bytes) 000806 1789478746.178858 trunc from 0x00650c to 0x00ae3c (0x4931 bytes) 000807 1789478746.183145 trunc from 0x00ae3d to 0x020f08 (0x160cc bytes) 000808 1789478746.195508 fallocate 0x018640 thru 0x0223a3 (0x9d64 bytes) 000809 1789478746.208305 read 0x01a666 thru 0x0223a3 (0x7d3e bytes) 000810 1789478746.221023 mapread 0x01febe thru 0x0223a3 (0x24e6 bytes) 000812 1789478746.229990 MIRROR_SPLIT mirror 7 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x223a4): Mirror 10: 0xac78d060 (stale) Mirror 12: 0xac78d060 (stale) Mirror 13: 0xac78d060 (stale) Mirror 14: 0xac78d060 (stale) Mirror 15: 0xac78d060 (stale) Mirror 16: 0xac78d060 (stale) Mirror 19: 0xac78d060 (stale) Mirror 22: 0xac78d060 (stale) Mirror 23: 0xac78d060 (stale) Mirror 25: 0xac78d060 (stale) Mirror 26: 0xe364663d (stale) Mirror 27: 0xe364663d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x223a4): Mirror 10: 0xac78d060 (stale) Mirror 12: 0xac78d060 (stale) Mirror 13: 0xac78d060 (stale) Mirror 14: 0xac78d060 (stale) Mirror 15: 0xac78d060 (stale) Mirror 16: 0xac78d060 (stale) Mirror 19: 0xac78d060 (stale) Mirror 22: 0xac78d060 (stale) Mirror 23: 0xac78d060 (stale) Mirror 25: 0xac78d060 (stale) Mirror 26: 0xe364663d (stale) Mirror 27: 0xe364663d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x223a4: skipped 000813 1789478747.063543 trunc from 0x0223a4 to 0x027350 (0x4fad bytes) 000814 1789478747.087084 mapread 0x013822 thru 0x0211b1 (0xd990 bytes) 000815 1789478747.111997 fallocate 0x009490 thru 0x00ed9f (0x5910 bytes) 000816 1789478747.117308 mapread 0x018d23 thru 0x024e15 (0xc0f3 bytes) 000817 1789478747.119343 fallocate 0x03f2ec thru 0x03ffff (0xd14 bytes) 000818 1789478747.127900 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x27351): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27351): Mirror 10: 0x48c24090 (stale) Mirror 12: 0x48c24090 (stale) Mirror 13: 0x48c24090 (stale) Mirror 14: 0x48c24090 (stale) Mirror 15: 0x48c24090 (stale) Mirror 16: 0x48c24090 (stale) Mirror 19: 0x48c24090 (stale) Mirror 22: 0x48c24090 (stale) Mirror 23: 0x48c24090 (stale) Mirror 25: 0x48c24090 (stale) Mirror 26: 0x7c63b2b8 (stale) Mirror 27: 0x7c63b2b8 (stale) CRC-32 checksum value for chunk [0, 0x27351): Mirror 1: 0xea984ad7 Mirror 28: 0xea984ad7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27351: skipped 000819 1789478748.244604 read 0x017b7f thru 0x01dd66 (0x61e8 bytes) 000820 1789478748.264206 mapwrite 0x026e30 thru 0x02b50d (0x46de bytes) 000821 1789478748.396577 trunc from 0x00f307 to 0x018b94 (0x988e bytes) 000822 1789478748.401848 trunc from 0x02b50e to 0x034e11 (0x9904 bytes) 000823 1789478748.419816 mapwrite 0x03ce12 thru 0x03ffff (0x31ee bytes) 000824 1789478748.473257 MIRROR_SPLIT mirror 12 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xaf9549e (stale) Mirror 12: 0xaf9549e (stale) Mirror 13: 0xaf9549e (stale) Mirror 14: 0xaf9549e (stale) Mirror 15: 0xaf9549e (stale) Mirror 16: 0xaf9549e (stale) Mirror 19: 0xaf9549e (stale) Mirror 22: 0xaf9549e (stale) Mirror 23: 0xaf9549e (stale) Mirror 25: 0xaf9549e (stale) Mirror 26: 0x9a54c62 (stale) Mirror 28: 0x4867ee5e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0xaf9549e (stale) Mirror 12: 0xaf9549e (stale) Mirror 13: 0xaf9549e (stale) Mirror 14: 0xaf9549e (stale) Mirror 15: 0xaf9549e (stale) Mirror 16: 0xaf9549e (stale) Mirror 19: 0xaf9549e (stale) Mirror 22: 0xaf9549e (stale) Mirror 23: 0xaf9549e (stale) Mirror 25: 0xaf9549e (stale) Mirror 26: 0x9a54c62 (stale) Mirror 28: 0x4867ee5e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000825 1789478749.138821 mapwrite 0x00279a thru 0x008b76 (0x63dd bytes) 000826 1789478749.235868 fallocate 0x025a7b thru 0x034d46 (0xf2cc bytes) 000827 1789478749.260088 MIRROR_RESYNC 13 mirrors 000828 1789478752.771656 trunc from 0x0165ca to 0x019fe6 (0x3a1d bytes) 000829 1789478752.815107 mapwrite 0x02cf03 thru 0x031c8b (0x4d89 bytes) 000830 1789478752.849325 fallocate 0x00848d thru 0x00f897 (0x740b bytes) 000831 1789478752.859028 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x7cf0755d (stale) Mirror 12: 0x7cf0755d (stale) Mirror 13: 0x7cf0755d (stale) Mirror 14: 0x7cf0755d (stale) Mirror 15: 0x7cf0755d (stale) Mirror 16: 0x7cf0755d (stale) Mirror 19: 0x7cf0755d (stale) Mirror 22: 0x7cf0755d (stale) Mirror 23: 0x7cf0755d (stale) Mirror 25: 0x7cf0755d (stale) Mirror 26: 0x7cf0755d (stale) Mirror 28: 0x7cf0755d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc9d69839 Mirror 29: 0xc9d69839 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000832 1789478753.989100 mapread 0x02e392 thru 0x035655 (0x72c4 bytes) 000834 1789478754.034402 mapwrite 0x0398d8 thru 0x03e8c8 (0x4ff1 bytes) 000835 1789478754.231088 trunc from 0x040000 to 0x03bef8 (0x4107 bytes) 000836 1789478754.270009 punch from 0x008b39 to 0x00b84d (0x2d15 bytes) 000837 1789478754.274926 punch from 0x001650 to 0x00744d (0x5dfe bytes) 000838 1789478754.281303 trunc from 0x03bef9 to 0x01152f (0x2a9c9 bytes) 000839 1789478754.300001 mapread 0x00b024 thru 0x01152f (0x650c bytes) 000841 1789478754.313571 fallocate 0x03f29b thru 0x03ffff (0xd65 bytes) 000842 1789478754.320587 trunc from 0x040000 to 0x0353a8 (0xac57 bytes) 000843 1789478754.344215 read 0x02caa6 thru 0x0353a8 (0x8903 bytes) 000844 1789478754.359633 read 0x0269ac thru 0x032924 (0xbf79 bytes) 000845 1789478754.393058 punch from 0x01a90a to 0x023b04 (0x91fb bytes) 000846 1789478754.398604 mapwrite 0x01bff7 thru 0x01d514 (0x151e bytes) 000848 1789478754.455313 fallocate 0x024718 thru 0x02fc3a (0xb523 bytes) 000849 1789478754.467547 mapwrite 0x01e0a5 thru 0x01ed93 (0xcef bytes) 000850 1789478754.504414 mapread 0x0048fd thru 0x0113fa (0xcafe bytes) 000851 1789478754.512518 fallocate 0x00ae04 thru 0x013472 (0x866f bytes) 000852 1789478754.527082 trunc from 0x0353a9 to 0x023cc0 (0x116e8 bytes) 000853 1789478754.590241 fallocate 0x01615d thru 0x020fb6 (0xae5a bytes) 000854 1789478754.616954 fallocate 0x03c1d6 thru 0x03e347 (0x2172 bytes) 000855 1789478754.622989 fallocate 0x020487 thru 0x025228 (0x4da2 bytes) 000856 1789478754.627983 trunc from 0x025229 to 0x03ad9a (0x15b72 bytes) 000858 1789478754.653312 MIRROR_SPLIT mirror 9 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ad9b): Mirror 10: 0x42c522 (stale) Mirror 12: 0x42c522 (stale) Mirror 13: 0x42c522 (stale) Mirror 14: 0x42c522 (stale) Mirror 15: 0x42c522 (stale) Mirror 16: 0x42c522 (stale) Mirror 19: 0x42c522 (stale) Mirror 22: 0x42c522 (stale) Mirror 25: 0x42c522 (stale) Mirror 26: 0x42c522 (stale) Mirror 28: 0x42c522 (stale) Mirror 29: 0xa88e0bcc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ad9b): Mirror 10: 0x42c522 (stale) Mirror 12: 0x42c522 (stale) Mirror 13: 0x42c522 (stale) Mirror 14: 0x42c522 (stale) Mirror 15: 0x42c522 (stale) Mirror 16: 0x42c522 (stale) Mirror 19: 0x42c522 (stale) Mirror 22: 0x42c522 (stale) Mirror 25: 0x42c522 (stale) Mirror 26: 0x42c522 (stale) Mirror 28: 0x42c522 (stale) Mirror 29: 0xa88e0bcc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ad9b: skipped 000859 1789478755.383139 mapread 0x012f79 thru 0x0172bf (0x4347 bytes) 000860 1789478755.404558 punch from 0x002410 to 0x009fb4 (0x7ba5 bytes) 000861 1789478755.408847 mapread 0x02dedb thru 0x031bf0 (0x3d16 bytes) 000862 1789478755.422913 mapread 0x0389f2 thru 0x038f56 (0x565 bytes) 000863 1789478755.437306 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3ad9b): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ad9b): Mirror 10: 0x42c522 (stale) Mirror 12: 0x42c522 (stale) Mirror 13: 0x42c522 (stale) Mirror 14: 0x42c522 (stale) Mirror 15: 0x42c522 (stale) Mirror 16: 0x42c522 (stale) Mirror 19: 0x42c522 (stale) Mirror 22: 0x42c522 (stale) Mirror 25: 0x42c522 (stale) Mirror 26: 0x42c522 (stale) Mirror 28: 0x42c522 (stale) Mirror 29: 0xa88e0bcc (stale) CRC-32 checksum value for chunk [0, 0x3ad9b): Mirror 1: 0x80cce688 Mirror 30: 0x80cce688 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ad9b: skipped 000866 1789478756.436901 fallocate 0x019d28 thru 0x01aad6 (0xdaf bytes) 000867 1789478756.487424 fallocate 0x03c13e thru 0x03ffff (0x3ec2 bytes) 000868 1789478756.493219 mapwrite 0x03f573 thru 0x03ffff (0xa8d bytes) 000869 1789478756.534248 mapwrite 0x02483e thru 0x03228b (0xda4e bytes) 000870 1789478756.574298 trunc from 0x02b16b to 0x032fae (0x7e44 bytes) 000871 1789478756.579429 trunc from 0x040000 to 0x02bbbd (0x14442 bytes) 000872 1789478756.595729 read 0x018d24 thru 0x0273e8 (0xe6c5 bytes) 000873 1789478756.602800 write 0x02b289 thru 0x02d1c8 (0x1f40 bytes) 000874 1789478756.608909 trunc from 0x0118ff to 0x01cfe7 (0xb6e9 bytes) 000875 1789478756.614792 trunc from 0x02d1c9 to 0x01157a (0x1bc4e bytes) 000876 1789478756.648406 trunc from 0x0053c5 to 0x0087e5 (0x3421 bytes) 000877 1789478756.654968 write 0x02cf19 thru 0x039a74 (0xcb5c bytes) 000878 1789478756.657027 trunc from 0x039a75 to 0x03b7c7 (0x1d53 bytes) 000879 1789478756.670611 mapwrite 0x03e0b8 thru 0x03ffff (0x1f48 bytes) 000880 1789478756.709584 trunc from 0x040000 to 0x0212e8 (0x1ed17 bytes) 000881 1789478756.725587 punch from 0x01712c to 0x01feb6 (0x8d8b bytes) 000882 1789478756.730985 punch from 0x0171b6 to 0x01732c (0x177 bytes) 000883 1789478756.735644 read 0x006c72 thru 0x016c3d (0xffcc bytes) 000884 1789478756.758796 punch from 0x012a12 to 0x01de2d (0xb41c bytes) 000885 1789478756.763639 read 0x00bece thru 0x00f53b (0x366e bytes) 000886 1789478756.764254 mapwrite 0x032562 thru 0x03a514 (0x7fb3 bytes) 000888 1789478756.814217 trunc from 0x02e541 to 0x0322f3 (0x3db3 bytes) 000889 1789478756.819446 write 0x03a82c thru 0x03ffff (0x57d4 bytes) 000890 1789478756.821634 trunc from 0x007311 to 0x008058 (0xd48 bytes) 000891 1789478756.826283 read 0x01019e thru 0x016a04 (0x6867 bytes) 000892 1789478756.827130 fallocate 0x039240 thru 0x03ffff (0x6dc0 bytes) 000894 1789478756.832595 trunc from 0x040000 to 0x025e5e (0x1a1a1 bytes) 000895 1789478756.847107 mapread 0x0238c9 thru 0x0238e5 (0x1d bytes) 000896 1789478756.848035 punch from 0x00a2ec to 0x018917 (0xe62c bytes) 000897 1789478756.853947 trunc from 0x025e5f to 0x02ac78 (0x4e1a bytes) 000898 1789478756.866778 read 0x01d166 thru 0x01f2f4 (0x218f bytes) 000900 1789478756.867893 read 0x0225c5 thru 0x025185 (0x2bc1 bytes) 000901 1789478756.868444 fallocate 0x03b70b thru 0x03f4bf (0x3db5 bytes) 000902 1789478756.873708 mapwrite 0x034e51 thru 0x0353a5 (0x555 bytes) 000903 1789478756.913130 fallocate 0x02dc8b thru 0x0334f3 (0x5869 bytes) 000904 1789478756.919305 mapwrite 0x01510a thru 0x01c0bb (0x6fb2 bytes) 000905 1789478756.935997 mapwrite 0x01bb64 thru 0x0219f4 (0x5e91 bytes) 000906 1789478756.954762 read 0x002e79 thru 0x00300f (0x197 bytes) 000907 1789478756.955597 mapread 0x0234bc thru 0x023b18 (0x65d bytes) 000908 1789478756.957935 fallocate 0x03ce24 thru 0x03ffff (0x31dc bytes) 000909 1789478756.968225 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 10: 0x7cf0755d (stale) Mirror 12: 0x7cf0755d (stale) Mirror 13: 0x7cf0755d (stale) Mirror 14: 0x7cf0755d (stale) Mirror 15: 0x7cf0755d (stale) Mirror 16: 0x7cf0755d (stale) Mirror 19: 0x7cf0755d (stale) Mirror 22: 0x7cf0755d (stale) Mirror 25: 0x7cf0755d (stale) Mirror 26: 0x7cf0755d (stale) Mirror 28: 0x7cf0755d (stale) Mirror 29: 0xc9d69839 (stale) Mirror 30: 0xf7200e1a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc957da73 Mirror 31: 0xc957da73 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000910 1789478757.887841 write 0x02125b thru 0x02443c (0x31e2 bytes) 000912 1789478757.965615 punch from 0x033e8c to 0x03d418 (0x958d bytes) 000913 1789478757.971434 mapwrite 0x003a34 thru 0x004d76 (0x1343 bytes) 000914 1789478758.021153 mapread 0x0363b3 thru 0x03d61b (0x7269 bytes) 000915 1789478758.036569 trunc from 0x040000 to 0x018ca2 (0x2735d bytes) 000916 1789478758.061941 trunc from 0x018ca3 to 0x009966 (0xf33c bytes) 000918 1789478758.081706 fallocate 0x013db5 thru 0x018771 (0x49bd bytes) 000921 1789478758.091578 mapwrite 0x01d3dd thru 0x020ae0 (0x3704 bytes) 000922 1789478758.159192 trunc from 0x020ae1 to 0x033953 (0x12e73 bytes) 000923 1789478758.181845 write 0x0256d3 thru 0x0338a1 (0xe1cf bytes) 000924 1789478758.199958 fallocate 0x02ebf7 thru 0x03cb78 (0xdf82 bytes) 000925 1789478758.206653 punch from 0x01ba23 to 0x01e29c (0x287a bytes) 000926 1789478758.214974 write 0x0015e3 thru 0x004fb5 (0x39d3 bytes) 000927 1789478758.221292 trunc from 0x00b545 to 0x01adff (0xf8bb bytes) 000928 1789478758.231209 MIRROR_SPLIT mirror 10 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33954): Mirror 10: 0x2e119978 (stale) Mirror 12: 0x2e119978 (stale) Mirror 13: 0x2e119978 (stale) Mirror 14: 0x2e119978 (stale) Mirror 15: 0x2e119978 (stale) Mirror 16: 0x2e119978 (stale) Mirror 19: 0x2e119978 (stale) Mirror 22: 0x2e119978 (stale) Mirror 25: 0x2e119978 (stale) Mirror 28: 0x2e119978 (stale) Mirror 29: 0x2ffeceac (stale) Mirror 30: 0xc03ebdab (stale) Mirror 31: 0x2c905063 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33954): Mirror 10: 0x2e119978 (stale) Mirror 12: 0x2e119978 (stale) Mirror 13: 0x2e119978 (stale) Mirror 14: 0x2e119978 (stale) Mirror 15: 0x2e119978 (stale) Mirror 16: 0x2e119978 (stale) Mirror 19: 0x2e119978 (stale) Mirror 22: 0x2e119978 (stale) Mirror 25: 0x2e119978 (stale) Mirror 28: 0x2e119978 (stale) Mirror 29: 0x2ffeceac (stale) Mirror 30: 0xc03ebdab (stale) Mirror 31: 0x2c905063 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33954: skipped 000929 1789478759.224438 mapread 0x00368c thru 0x003aed (0x462 bytes) 000930 1789478759.230093 trunc from 0x033954 to 0x014a6c (0x1eee7 bytes) 000931 1789478759.256411 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x14a6d): Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14a6d): Mirror 10: 0x5b9aeeb0 (stale) Mirror 12: 0x5b9aeeb0 (stale) Mirror 13: 0x5b9aeeb0 (stale) Mirror 14: 0x5b9aeeb0 (stale) Mirror 15: 0x5b9aeeb0 (stale) Mirror 16: 0x5b9aeeb0 (stale) Mirror 19: 0x5b9aeeb0 (stale) Mirror 22: 0x5b9aeeb0 (stale) Mirror 25: 0x5b9aeeb0 (stale) Mirror 28: 0x5b9aeeb0 (stale) Mirror 29: 0x5b9aeeb0 (stale) Mirror 30: 0x7c672153 (stale) Mirror 31: 0x7c672153 (stale) CRC-32 checksum value for chunk [0, 0x14a6d): Mirror 1: 0xde4bc142 Mirror 32: 0xde4bc142 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14a6d: skipped 000932 1789478760.779543 mapread 0x00002c thru 0x008c80 (0x8c55 bytes) 000933 1789478760.866127 mapread 0x00219f thru 0x00ec7f (0xcae1 bytes) 000934 1789478760.896102 trunc from 0x006b9a to 0x014a6c (0xded3 bytes) 000935 1789478760.999585 trunc from 0x008f82 to 0x013343 (0xa3c2 bytes) 000937 1789478761.031578 mapread 0x0057c8 thru 0x00ded8 (0x8711 bytes) 000938 1789478761.053557 fallocate 0x022c83 thru 0x023747 (0xac5 bytes) 000939 1789478761.066019 mapread 0x0079c4 thru 0x00ce45 (0x5482 bytes) 000940 1789478761.072745 mapread 0x005c59 thru 0x009b7c (0x3f24 bytes) 000941 1789478761.074484 trunc from 0x011049 to 0x014a6c (0x3a24 bytes) 000942 1789478761.092401 trunc from 0x014a6d to 0x00cbd7 (0x7e95 bytes) 000943 1789478761.135888 MIRROR_SPLIT mirror 1 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xcbd8): Mirror 12: 0xbe335dbb (stale) Mirror 13: 0xbe335dbb (stale) Mirror 14: 0xbe335dbb (stale) Mirror 15: 0xbe335dbb (stale) Mirror 16: 0xbe335dbb (stale) Mirror 19: 0xbe335dbb (stale) Mirror 22: 0xbe335dbb (stale) Mirror 25: 0xbe335dbb (stale) Mirror 28: 0xbe335dbb (stale) Mirror 29: 0xbe335dbb (stale) Mirror 30: 0xd138ca03 (stale) Mirror 31: 0xd138ca03 (stale) Mirror 32: 0xcb9493e3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xcbd8): Mirror 12: 0xbe335dbb (stale) Mirror 13: 0xbe335dbb (stale) Mirror 14: 0xbe335dbb (stale) Mirror 15: 0xbe335dbb (stale) Mirror 16: 0xbe335dbb (stale) Mirror 19: 0xbe335dbb (stale) Mirror 22: 0xbe335dbb (stale) Mirror 25: 0xbe335dbb (stale) Mirror 28: 0xbe335dbb (stale) Mirror 29: 0xbe335dbb (stale) Mirror 30: 0xd138ca03 (stale) Mirror 31: 0xd138ca03 (stale) Mirror 32: 0xcb9493e3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xcbd8: skipped 000944 1789478761.959572 fallocate 0x02acd5 thru 0x02ec49 (0x3f75 bytes) 000945 1789478761.969118 trunc from 0x00cbd8 to 0x00697b (0x625c bytes) 000946 1789478761.999592 write 0x0348c7 thru 0x03e927 (0xa061 bytes) 000947 1789478762.001295 trunc from 0x03e928 to 0x008e9b (0x35a8c bytes) 000948 1789478762.038543 trunc from 0x008e9c to 0x022ca6 (0x19e0b bytes) 000949 1789478762.092152 punch from 0x00159b to 0x00aecd (0x9933 bytes) 000950 1789478762.100329 mapread 0x017edc thru 0x01fa9c (0x7bc1 bytes) 000951 1789478762.158723 mapwrite 0x019a9e thru 0x020074 (0x65d7 bytes) 000952 1789478762.207649 punch from 0x00ede8 to 0x01003a (0x1253 bytes) 000953 1789478762.218140 trunc from 0x00509d to 0x00e467 (0x93cb bytes) 000954 1789478762.232537 fallocate 0x0204bd thru 0x0246bb (0x41ff bytes) 000955 1789478762.248421 MIRROR_RESYNC 14 mirrors 000956 1789478766.185074 trunc from 0x0246bc to 0x014b8e (0xfb2d bytes) 000957 1789478766.261429 MIRROR_RESYNC 14 mirrors 000958 1789478768.432123 mapread 0x00e92f thru 0x01026b (0x193d bytes) 000959 1789478768.457297 punch from 0x00abaf to 0x01472e (0x9b80 bytes) 000960 1789478768.504491 mapwrite 0x011c83 thru 0x019e65 (0x81e3 bytes) 000961 1789478768.565937 write 0x006105 thru 0x009eba (0x3db6 bytes) 000962 1789478768.581938 mapwrite 0x0112a2 thru 0x017a9f (0x67fe bytes) 000963 1789478768.610911 mapwrite 0x014d31 thru 0x01a3d0 (0x56a0 bytes) 000964 1789478768.662207 write 0x008349 thru 0x008d9b (0xa53 bytes) 000965 1789478768.663325 punch from 0x0094a1 to 0x012f5e (0x9abe bytes) 000966 1789478768.670551 read 0x010361 thru 0x01a3d0 (0xa070 bytes) 000967 1789478768.677123 punch from 0x013219 to 0x01a3d0 (0x71b8 bytes) 000968 1789478768.685879 write 0x03d7b5 thru 0x03ffff (0x284b bytes) 000969 1789478768.688488 read 0x032018 thru 0x03ffff (0xdfe8 bytes) 000970 1789478768.709098 trunc from 0x040000 to 0x00d7a9 (0x32856 bytes) 000971 1789478768.732077 fallocate 0x02ccc3 thru 0x03ae0e (0xe14c bytes) 000972 1789478768.740085 punch from 0x01bc5d to 0x027611 (0xb9b5 bytes) 000973 1789478768.762904 MIRROR_SPLIT mirror 3 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ae0f): Mirror 12: 0xc03b4585 (stale) Mirror 13: 0xc03b4585 (stale) Mirror 15: 0xc03b4585 (stale) Mirror 16: 0xc03b4585 (stale) Mirror 19: 0xc03b4585 (stale) Mirror 22: 0xc03b4585 (stale) Mirror 25: 0xc03b4585 (stale) Mirror 28: 0xc03b4585 (stale) Mirror 29: 0xc03b4585 (stale) Mirror 30: 0xc03b4585 (stale) Mirror 31: 0xc03b4585 (stale) Mirror 32: 0xc03b4585 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ae0f): Mirror 12: 0xc03b4585 (stale) Mirror 13: 0xc03b4585 (stale) Mirror 15: 0xc03b4585 (stale) Mirror 16: 0xc03b4585 (stale) Mirror 19: 0xc03b4585 (stale) Mirror 22: 0xc03b4585 (stale) Mirror 25: 0xc03b4585 (stale) Mirror 28: 0xc03b4585 (stale) Mirror 29: 0xc03b4585 (stale) Mirror 30: 0xc03b4585 (stale) Mirror 31: 0xc03b4585 (stale) Mirror 32: 0xc03b4585 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ae0f: skipped 000974 1789478769.736650 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ae0f): Mirror 13: 0xc03b4585 (stale) Mirror 15: 0xc03b4585 (stale) Mirror 16: 0xc03b4585 (stale) Mirror 19: 0xc03b4585 (stale) Mirror 22: 0xc03b4585 (stale) Mirror 25: 0xc03b4585 (stale) Mirror 28: 0xc03b4585 (stale) Mirror 29: 0xc03b4585 (stale) Mirror 30: 0xc03b4585 (stale) Mirror 31: 0xc03b4585 (stale) Mirror 32: 0xc03b4585 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ae0f): Mirror 13: 0xc03b4585 (stale) Mirror 15: 0xc03b4585 (stale) Mirror 16: 0xc03b4585 (stale) Mirror 19: 0xc03b4585 (stale) Mirror 22: 0xc03b4585 (stale) Mirror 25: 0xc03b4585 (stale) Mirror 28: 0xc03b4585 (stale) Mirror 29: 0xc03b4585 (stale) Mirror 30: 0xc03b4585 (stale) Mirror 31: 0xc03b4585 (stale) Mirror 32: 0xc03b4585 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ae0f: skipped 000975 1789478770.386313 fallocate 0x03f27e thru 0x03ffff (0xd82 bytes) 000976 1789478770.392783 trunc from 0x021c48 to 0x02cf3b (0xb2f4 bytes) 000977 1789478770.399292 trunc from 0x03ae0f to 0x02cdc3 (0xe04b bytes) 000978 1789478770.417092 fallocate 0x00b876 thru 0x0126d6 (0x6e61 bytes) 000979 1789478770.420605 trunc from 0x02cdc4 to 0x0083a4 (0x24a1f bytes) 000980 1789478770.431448 trunc from 0x002582 to 0x0083a4 (0x5e23 bytes) 000981 1789478770.434794 punch from 0x0045ed to 0x0083a4 (0x3db8 bytes) 000982 1789478770.438262 mapread 0x005239 thru 0x0083a4 (0x316c bytes) 000983 1789478770.449851 read 0x0047dd thru 0x0083a4 (0x3bc8 bytes) 000984 1789478770.450288 mapwrite 0x01f076 thru 0x0228c2 (0x384d bytes) 000985 1789478770.478945 trunc from 0x021885 to 0x0228c2 (0x103e bytes) 000986 1789478770.490097 read 0x01916b thru 0x01d572 (0x4408 bytes) 000987 1789478770.490857 trunc from 0x00bfad to 0x00daaa (0x1afe bytes) 000988 1789478770.499324 fallocate 0x03b664 thru 0x03ffff (0x499c bytes) 000989 1789478770.505446 mapread 0x01024a thru 0x01f9b4 (0xf76b bytes) 000990 1789478770.531307 punch from 0x0197c4 to 0x01d052 (0x388f bytes) 000991 1789478770.545555 MIRROR_RESYNC 12 mirrors 000992 1789478772.926887 mapwrite 0x0250d5 thru 0x033170 (0xe09c bytes) 000994 1789478773.020347 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x611b99db (stale) Mirror 15: 0x611b99db (stale) Mirror 16: 0x611b99db (stale) Mirror 19: 0x611b99db (stale) Mirror 22: 0x611b99db (stale) Mirror 25: 0x611b99db (stale) Mirror 28: 0x611b99db (stale) Mirror 29: 0x611b99db (stale) Mirror 30: 0x611b99db (stale) Mirror 31: 0x611b99db (stale) Mirror 32: 0x611b99db (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1cb8de64 Mirror 33: 0x1cb8de64 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000995 1789478773.966098 MIRROR_RESYNC 13 mirrors 000996 1789478777.000222 MIRROR_EXTEND to 14 mirrors 000998 1789478777.787580 trunc from 0x040000 to 0x01a786 (0x25879 bytes) 000999 1789478777.843858 trunc from 0x01a787 to 0x023175 (0x89ef bytes) 001000 1789478777.863814 read 0x0015d4 thru 0x00c53d (0xaf6a bytes) All operations completed A-OK!