== sanity-flr test 70a: flr mode fsx test ================ 14:59:58 (1789585198) striped dir -i0 -c2 -H all_char /mnt/lustre/d70a.sanity-flr Seed set to 5200 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero length punch hole 000004 1789585201.012597 mapwrite 0x025ed2 thru 0x029538 (0x3667 bytes) 000005 1789585201.217650 mapread 0x005dd3 thru 0x013a41 (0xdc6f bytes) 000006 1789585201.239760 mapwrite 0x02ba35 thru 0x02cadb (0x10a7 bytes) 000007 1789585201.323309 write 0x017581 thru 0x018e26 (0x18a6 bytes) 000008 1789585201.324189 punch from 0x010689 to 0x014626 (0x3f9e bytes) 000010 1789585201.339049 punch from 0x003ffd to 0x00c404 (0x8408 bytes) 000012 1789585201.347032 mapread 0x0204a7 thru 0x02affb (0xab55 bytes) 000013 1789585201.348728 read 0x014235 thru 0x01b750 (0x751c bytes) 000015 1789585201.362854 mapwrite 0x01ce06 thru 0x0255b6 (0x87b1 bytes) 000020 1789585201.471828 mapread 0x014a1f thru 0x023deb (0xf3cd bytes) 000021 1789585201.473563 read 0x00ae61 thru 0x00b2bd (0x45d bytes) 000022 1789585201.485936 read 0x003379 thru 0x00a9ca (0x7652 bytes) 000023 1789585201.486932 mapwrite 0x033bd8 thru 0x03b75c (0x7b85 bytes) truncating to largest ever: 0x1ee5f 000024 1789585201.610782 trunc from 0x03b75d to 0x01ee5e (0x1c8fe bytes) 000025 1789585201.656646 punch from 0x001efa to 0x005c3c (0x3d43 bytes) 000030 1789585201.698530 MIRROR_EXTEND to 2 mirrors 000032 1789585202.738037 write 0x03d48e thru 0x03ffff (0x2b72 bytes) 000034 1789585202.809581 read 0x010531 thru 0x01f949 (0xf419 bytes) 000035 1789585202.824735 MIRROR_RESYNC 2 mirrors 000036 1789585204.056939 read 0x030775 thru 0x0377aa (0x7036 bytes) 000037 1789585204.076618 mapwrite 0x02c0d5 thru 0x03804f (0xbf7b bytes) 000043 1789585204.405809 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x3a08856b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5d538fb1 Mirror 3: 0x5d538fb1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000044 1789585206.165806 read 0x00fc47 thru 0x01e3e6 (0xe7a0 bytes) 000045 1789585206.197020 write 0x030e7f thru 0x034965 (0x3ae7 bytes) 000046 1789585206.359147 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5d538fb1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5d538fb1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000048 1789585206.804972 mapwrite 0x02feb6 thru 0x0311c1 (0x130c bytes) 000049 1789585206.909383 read 0x009c80 thru 0x00eeec (0x526d bytes) 000050 1789585206.924183 MIRROR_RESYNC 2 mirrors 000051 1789585208.127681 trunc from 0x040000 to 0x007258 (0x38da7 bytes) 000054 1789585208.240719 punch from 0x003261 to 0x007258 (0x3ff8 bytes) 000055 1789585208.249796 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x7259): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7259): Mirror 3: 0xdcd6e4f8 (stale) CRC-32 checksum value for chunk [0, 0x7259): Mirror 1: 0xdcd6e4f8 Mirror 4: 0xdcd6e4f8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7259: skipped 000057 1789585209.514840 mapwrite 0x00b9c3 thru 0x017b5c (0xc19a bytes) 000058 1789585209.756056 MIRROR_RESYNC 3 mirrors 000059 1789585210.749945 read 0x010055 thru 0x013be0 (0x3b8c bytes) 000063 1789585210.760341 mapread 0x0068e2 thru 0x0082f9 (0x1a18 bytes) 000065 1789585210.801681 punch from 0x009d64 to 0x015978 (0xbc15 bytes) 000066 1789585210.924648 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17b5d): Mirror 4: 0x2a80b5f9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17b5d): Mirror 4: 0x2a80b5f9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17b5d: skipped 000067 1789585211.244710 write 0x013b0f thru 0x02332a (0xf81c bytes) 000068 1789585211.252699 write 0x02ac3b thru 0x03a798 (0xfb5e bytes) 000069 1789585211.256249 mapwrite 0x0109e5 thru 0x01a414 (0x9a30 bytes) 000072 1789585211.397919 MIRROR_RESYNC 2 mirrors 000073 1789585212.662871 mapwrite 0x0397e0 thru 0x03e9d6 (0x51f7 bytes) 000075 1789585212.839855 write 0x026883 thru 0x031072 (0xa7f0 bytes) truncating to largest ever: 0x23f06 000076 1789585212.852188 trunc from 0x03e9d7 to 0x023f05 (0x1aad1 bytes) 000077 1789585212.878379 punch from 0x01777f to 0x020e62 (0x96e4 bytes) 000079 1789585212.885703 write 0x03ad90 thru 0x03ffff (0x5270 bytes) 000080 1789585212.887292 punch from 0x036f4c to 0x03eecf (0x7f84 bytes) 000081 1789585212.911220 mapread 0x010918 thru 0x01fa86 (0xf16f bytes) 000082 1789585212.940138 punch from 0x02b0b8 to 0x033bd0 (0x8b19 bytes) 000083 1789585212.954265 mapwrite 0x004cbd thru 0x00d776 (0x8aba bytes) truncating to largest ever: 0x252cb 000084 1789585213.051645 trunc from 0x040000 to 0x0252ca (0x1ad35 bytes) 000086 1789585213.071146 read 0x00c3c8 thru 0x01be19 (0xfa52 bytes) 000088 1789585213.073395 mapwrite 0x03b21f thru 0x03ffff (0x4de1 bytes) 000090 1789585213.212712 mapwrite 0x007d18 thru 0x008798 (0xa81 bytes) 000091 1789585213.269160 write 0x01af68 thru 0x025957 (0xa9f0 bytes) 000095 1789585213.279355 punch from 0x01ff2b to 0x021b60 (0x1c36 bytes) 000096 1789585213.305523 mapread 0x03186d thru 0x033822 (0x1fb6 bytes) 000099 1789585213.318849 write 0x03a06b thru 0x03ffff (0x5f95 bytes) 000100 1789585213.320495 mapread 0x0325e5 thru 0x03ffff (0xda1b bytes) 000101 1789585213.326899 MIRROR_RESYNC 2 mirrors 000102 1789585214.891111 write 0x0291f0 thru 0x029816 (0x627 bytes) 000103 1789585215.000971 mapwrite 0x005930 thru 0x007fa9 (0x267a bytes) 000104 1789585215.114115 mapwrite 0x00da05 thru 0x00edad (0x13a9 bytes) 000105 1789585215.157056 read 0x0326c5 thru 0x039137 (0x6a73 bytes) 000106 1789585215.167394 punch from 0x03ad65 to 0x03ffff (0x529b bytes) 000108 1789585215.173637 mapwrite 0x00fcb7 thru 0x01c2af (0xc5f9 bytes) 000111 1789585215.268516 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x9e36c1ea (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x40ce03d0 Mirror 5: 0x40ce03d0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000113 1789585217.253938 punch from 0x03aa44 to 0x03ffff (0x55bc bytes) 000114 1789585217.394781 read 0x0119fe thru 0x012a70 (0x1073 bytes) 000115 1789585217.405947 punch from 0x012a12 to 0x020649 (0xdc38 bytes) 000116 1789585217.413407 punch from 0x00c0bf to 0x015823 (0x9765 bytes) 000117 1789585217.425799 write 0x03ee2a thru 0x03ffff (0x11d6 bytes) 000118 1789585217.438276 mapread 0x001e3b thru 0x003d1b (0x1ee1 bytes) 000119 1789585217.471643 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x40ce03d0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x40ce03d0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000124 1789585217.872477 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x40ce03d0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2e543e88 Mirror 6: 0x2e543e88 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped truncating to largest ever: 0x26bc7 000125 1789585219.916301 trunc from 0x040000 to 0x026bc6 (0x19439 bytes) 000126 1789585220.037174 mapread 0x01c946 thru 0x026bc6 (0xa281 bytes) 000129 1789585220.058978 punch from 0x000556 to 0x003d26 (0x37d1 bytes) 000130 1789585220.064281 trunc from 0x026bc7 to 0x021818 (0x53ae bytes) 000132 1789585220.088688 write 0x03f529 thru 0x03ffff (0xad7 bytes) truncating to largest ever: 0x3b0c8 000133 1789585220.090621 trunc from 0x040000 to 0x03b0c7 (0x4f38 bytes) 000134 1789585220.114597 trunc from 0x03b0c8 to 0x00736a (0x33d5d bytes) 000135 1789585220.134408 read 0x006333 thru 0x00736a (0x1038 bytes) 000136 1789585220.140503 punch from 0x005be3 to 0x00736a (0x1788 bytes) truncating to largest ever: 0x3fb67 000137 1789585220.146888 trunc from 0x00736b to 0x03fb66 (0x387fc bytes) 000139 1789585220.168126 mapwrite 0x028f48 thru 0x037daa (0xee63 bytes) 000141 1789585220.264927 trunc from 0x03fb67 to 0x0040b6 (0x3bab0 bytes) 000142 1789585220.305039 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40b7): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40b7): Mirror 5: 0x67cb285e (stale) Mirror 6: 0x67cb285e (stale) CRC-32 checksum value for chunk [0, 0x40b7): Mirror 1: 0x67cb285e Mirror 7: 0x67cb285e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40b7: skipped 000143 1789585221.393034 mapwrite 0x0072c4 thru 0x010582 (0x92bf bytes) 000145 1789585221.651452 punch from 0x00d62b to 0x010582 (0x2f58 bytes) 000146 1789585221.665712 write 0x03e6df thru 0x03ffff (0x1921 bytes) 000147 1789585221.666749 write 0x03c59e thru 0x03ffff (0x3a62 bytes) 000149 1789585221.682516 mapread 0x00ce1c thru 0x015fd9 (0x91be bytes) 000150 1789585221.703512 read 0x00c5d1 thru 0x011483 (0x4eb3 bytes) 000151 1789585221.713490 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x40ce03d0 (stale) Mirror 6: 0x2e543e88 (stale) Mirror 7: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9b01dc57 Mirror 8: 0x9b01dc57 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000152 1789585223.512921 mapwrite 0x035db4 thru 0x03effe (0x924b bytes) 000154 1789585223.823666 mapwrite 0x03eb25 thru 0x03ffff (0x14db bytes) 000156 1789585223.876041 mapwrite 0x01bd8f thru 0x02ada2 (0xf014 bytes) 000157 1789585223.987317 punch from 0x025e83 to 0x035e57 (0xffd5 bytes) 000159 1789585223.993918 trunc from 0x040000 to 0x02d539 (0x12ac6 bytes) 000160 1789585224.024685 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d53a): Mirror 5: 0x92ea0023 (stale) Mirror 6: 0x803c46b1 (stale) Mirror 8: 0x21f6fe9c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d53a): Mirror 5: 0x92ea0023 (stale) Mirror 6: 0x803c46b1 (stale) Mirror 8: 0x21f6fe9c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d53a: skipped 000161 1789585224.493154 mapread 0x00690b thru 0x00d5bf (0x6cb5 bytes) 000162 1789585224.533982 mapwrite 0x01b5dc thru 0x029029 (0xda4e bytes) 000164 1789585224.627419 mapread 0x01d766 thru 0x024abb (0x7356 bytes) 000165 1789585224.629588 mapwrite 0x02275b thru 0x02cc05 (0xa4ab bytes) 000167 1789585224.776599 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d53a): Mirror 5: 0x92ea0023 (stale) Mirror 8: 0x21f6fe9c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d53a): Mirror 5: 0x92ea0023 (stale) Mirror 8: 0x21f6fe9c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d53a: skipped 000168 1789585225.413327 punch from 0x024849 to 0x02b03e (0x67f6 bytes) 000169 1789585225.423844 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2d53a): Mirror 5: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d53a): Mirror 5: 0x92ea0023 (stale) Mirror 8: 0x21f6fe9c (stale) CRC-32 checksum value for chunk [0, 0x2d53a): Mirror 1: 0xbfd354c2 Mirror 9: 0xbfd354c2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d53a: skipped 000170 1789585227.100884 trunc from 0x02d53a to 0x0084f3 (0x25046 bytes) 000171 1789585227.250534 read 0x000557 thru 0x007a2c (0x74d6 bytes) 000172 1789585227.257918 trunc from 0x0084f4 to 0x039f88 (0x31a95 bytes) 000173 1789585227.283789 trunc from 0x039f89 to 0x03be14 (0x1e8c bytes) 000174 1789585227.302994 punch from 0x03396b to 0x0344f0 (0xb86 bytes) 000175 1789585227.307406 write 0x03f3bc thru 0x03ffff (0xc44 bytes) 000177 1789585227.314401 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x40ce03d0 (stale) Mirror 8: 0x9b01dc57 (stale) Mirror 9: 0xc6ecdcb7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x13d79ecb Mirror 10: 0x13d79ecb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000178 1789585228.576116 write 0x036c19 thru 0x03b859 (0x4c41 bytes) 000180 1789585228.671128 trunc from 0x040000 to 0x029c7d (0x16382 bytes) 000182 1789585228.697759 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x29c7e): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29c7e): Mirror 5: 0xc64ea5c4 (stale) Mirror 8: 0x34d734d1 (stale) Mirror 9: 0xd4cf4016 (stale) Mirror 10: 0x19d47f41 (stale) CRC-32 checksum value for chunk [0, 0x29c7e): Mirror 1: 0x19d47f41 Mirror 11: 0x19d47f41 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29c7e: skipped 000183 1789585230.222092 write 0x022520 thru 0x02b69d (0x917e bytes) 000184 1789585230.306922 trunc from 0x02b69e to 0x0307b7 (0x511a bytes) 000185 1789585230.337896 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x307b8): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x307b8): Mirror 5: 0x45d3e36f (stale) Mirror 8: 0x3175858a (stale) Mirror 9: 0xb63db974 (stale) Mirror 10: 0x5eb7f2e3 (stale) Mirror 11: 0x5eb7f2e3 (stale) CRC-32 checksum value for chunk [0, 0x307b8): Mirror 1: 0x7f2a6ebe Mirror 12: 0x7f2a6ebe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x307b8: skipped 000188 1789585231.963734 write 0x03e64e thru 0x03ffff (0x19b2 bytes) 000191 1789585232.041596 mapread 0x026024 thru 0x0343ab (0xe388 bytes) 000193 1789585232.078351 punch from 0x03fb20 to 0x03ffff (0x4e0 bytes) 000194 1789585232.095306 read 0x01af6a thru 0x020d4e (0x5de5 bytes) 000195 1789585232.112916 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x40ce03d0 (stale) Mirror 8: 0x9b01dc57 (stale) Mirror 9: 0xc6ecdcb7 (stale) Mirror 10: 0x13d79ecb (stale) Mirror 11: 0xef231ec6 (stale) Mirror 12: 0xecee70a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbbe41226 Mirror 13: 0xbbe41226 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000197 1789585233.965902 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x40ce03d0 (stale) Mirror 8: 0x9b01dc57 (stale) Mirror 9: 0xc6ecdcb7 (stale) Mirror 10: 0x13d79ecb (stale) Mirror 11: 0xef231ec6 (stale) Mirror 12: 0xecee70a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbbe41226 Mirror 13: 0xbbe41226 Mirror 14: 0xbbe41226 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000199 1789585235.668835 mapread 0x03821f thru 0x03df33 (0x5d15 bytes) 000200 1789585235.714063 mapread 0x017f13 thru 0x027ba7 (0xfc95 bytes) 000201 1789585235.778297 read 0x017a73 thru 0x021320 (0x98ae bytes) 000203 1789585235.778932 punch from 0x03c6e1 to 0x03ffff (0x391f bytes) 000204 1789585236.004254 MIRROR_RESYNC 9 mirrors 000205 1789585240.871860 write 0x028073 thru 0x033b2e (0xbabc bytes) 000207 1789585240.950845 mapwrite 0x0394cb thru 0x03ffff (0x6b35 bytes) 000208 1789585241.036319 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xecee70a (stale) Mirror 9: 0xecee70a (stale) Mirror 10: 0xecee70a (stale) Mirror 11: 0xecee70a (stale) Mirror 12: 0xecee70a (stale) Mirror 13: 0xecee70a (stale) Mirror 14: 0xecee70a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xecee70a (stale) Mirror 9: 0xecee70a (stale) Mirror 10: 0xecee70a (stale) Mirror 11: 0xecee70a (stale) Mirror 12: 0xecee70a (stale) Mirror 13: 0xecee70a (stale) Mirror 14: 0xecee70a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000209 1789585241.863354 mapread 0x00bbad thru 0x00da42 (0x1e96 bytes) 000210 1789585241.908328 write 0x029e2a thru 0x0361df (0xc3b6 bytes) 000211 1789585241.951600 punch from 0x01bc82 to 0x01d788 (0x1b07 bytes) 000212 1789585241.989071 write 0x0105ad thru 0x019fe5 (0x9a39 bytes) 000213 1789585242.040684 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xecee70a (stale) Mirror 9: 0xecee70a (stale) Mirror 10: 0xecee70a (stale) Mirror 11: 0xecee70a (stale) Mirror 13: 0xecee70a (stale) Mirror 14: 0xecee70a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xecee70a (stale) Mirror 9: 0xecee70a (stale) Mirror 10: 0xecee70a (stale) Mirror 11: 0xecee70a (stale) Mirror 13: 0xecee70a (stale) Mirror 14: 0xecee70a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000214 1789585242.582340 punch from 0x0391f7 to 0x03ffff (0x6e09 bytes) 000215 1789585242.590624 mapwrite 0x00ea9b thru 0x01959b (0xab01 bytes) 000217 1789585242.729369 write 0x000932 thru 0x00a92b (0x9ffa bytes) 000218 1789585242.743698 write 0x03ef37 thru 0x03ffff (0x10c9 bytes) 000220 1789585242.752101 mapwrite 0x01ef45 thru 0x024ba1 (0x5c5d bytes) 000221 1789585242.838044 trunc from 0x040000 to 0x008bf8 (0x37407 bytes) 000222 1789585242.854645 write 0x024b44 thru 0x02671a (0x1bd7 bytes) 000223 1789585242.855737 write 0x01e760 thru 0x02883b (0xa0dc bytes) 000224 1789585242.866239 mapwrite 0x003d20 thru 0x00f315 (0xb5f6 bytes) 000226 1789585242.986897 punch from 0x010df6 to 0x01c3ea (0xb5f5 bytes) 000227 1789585242.996267 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2883c): Mirror 9: 0x1cca8ce5 (stale) Mirror 10: 0x1cca8ce5 (stale) Mirror 11: 0x1cca8ce5 (stale) Mirror 13: 0x1cca8ce5 (stale) Mirror 14: 0x1cca8ce5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2883c): Mirror 9: 0x1cca8ce5 (stale) Mirror 10: 0x1cca8ce5 (stale) Mirror 11: 0x1cca8ce5 (stale) Mirror 13: 0x1cca8ce5 (stale) Mirror 14: 0x1cca8ce5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2883c: skipped 000229 1789585243.582338 write 0x023028 thru 0x02df55 (0xaf2e bytes) 000230 1789585243.592781 mapwrite 0x00ca9d thru 0x011641 (0x4ba5 bytes) 000232 1789585243.707962 trunc from 0x02df56 to 0x0040f7 (0x29e5e bytes) 000233 1789585243.753070 punch from 0x0037c5 to 0x0040f7 (0x933 bytes) 000234 1789585243.787042 punch from 0x0040d8 to 0x0040f7 (0x20 bytes) 000237 1789585243.796600 read 0x003a8c thru 0x0040f7 (0x66c bytes) 000239 1789585243.804270 write 0x03cdb5 thru 0x03ee18 (0x2064 bytes) 000240 1789585243.805395 trunc from 0x03ee19 to 0x02b8ff (0x13519 bytes) 000246 1789585243.839021 punch from 0x01195b to 0x017272 (0x5918 bytes) 000247 1789585243.846791 mapread 0x0029d4 thru 0x006a1a (0x4047 bytes) 000248 1789585243.861225 read 0x00ad82 thru 0x014f83 (0xa202 bytes) 000249 1789585243.880203 MIRROR_RESYNC 6 mirrors 000250 1789585246.510964 read 0x017d23 thru 0x02499f (0xcc7d bytes) 000252 1789585246.526850 mapwrite 0x020f5e thru 0x028ff6 (0x8099 bytes) 000253 1789585246.761570 write 0x00756d thru 0x00a687 (0x311b bytes) 000254 1789585246.777727 read 0x01c4f0 thru 0x02b8ff (0xf410 bytes) 000255 1789585246.793030 mapread 0x00b3f6 thru 0x012847 (0x7452 bytes) 000256 1789585246.794047 punch from 0x0212b4 to 0x0271ee (0x5f3b bytes) 000257 1789585246.812410 read 0x008638 thru 0x0086ee (0xb7 bytes) 000258 1789585246.813724 read 0x00694b thru 0x009996 (0x304c bytes) 000260 1789585246.820997 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b900): Mirror 9: 0x616932f5 (stale) Mirror 10: 0x616932f5 (stale) Mirror 13: 0x616932f5 (stale) Mirror 14: 0x616932f5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b900): Mirror 9: 0x616932f5 (stale) Mirror 10: 0x616932f5 (stale) Mirror 13: 0x616932f5 (stale) Mirror 14: 0x616932f5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b900: skipped 000262 1789585247.403073 write 0x00956d thru 0x00e9b7 (0x544b bytes) 000263 1789585247.415229 read 0x023788 thru 0x027738 (0x3fb1 bytes) 000265 1789585247.429237 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2b900): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b900): Mirror 9: 0x616932f5 (stale) Mirror 10: 0x616932f5 (stale) Mirror 13: 0x616932f5 (stale) Mirror 14: 0x616932f5 (stale) CRC-32 checksum value for chunk [0, 0x2b900): Mirror 1: 0xccbebfba Mirror 15: 0xccbebfba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b900: skipped 000266 1789585249.228689 read 0x009a0e thru 0x00f067 (0x565a bytes) 000267 1789585249.254731 MIRROR_RESYNC 6 mirrors 000268 1789585252.285117 write 0x00c872 thru 0x012450 (0x5bdf bytes) 000269 1789585252.395369 mapread 0x009855 thru 0x019367 (0xfb13 bytes) 000270 1789585252.460351 mapwrite 0x038d42 thru 0x03ffff (0x72be bytes) 000271 1789585252.615134 mapwrite 0x010cc6 thru 0x016493 (0x57ce bytes) 000273 1789585252.702389 write 0x001ee6 thru 0x009675 (0x7790 bytes) 000274 1789585252.713690 trunc from 0x040000 to 0x00069c (0x3f963 bytes) 000278 1789585252.743710 mapwrite 0x00ca6b thru 0x01254c (0x5ae2 bytes) 000280 1789585252.883383 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1254d): Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1254d): Mirror 9: 0xc8967184 (stale) Mirror 10: 0xc8967184 (stale) Mirror 13: 0xc8967184 (stale) Mirror 14: 0xc8967184 (stale) Mirror 15: 0xc8967184 (stale) CRC-32 checksum value for chunk [0, 0x1254d): Mirror 1: 0x14da7f66 Mirror 16: 0x14da7f66 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1254d: skipped 000281 1789585254.240890 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1254d): Mirror 9: 0xc8967184 (stale) Mirror 10: 0xc8967184 (stale) Mirror 13: 0xc8967184 (stale) Mirror 15: 0xc8967184 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1254d): Mirror 9: 0xc8967184 (stale) Mirror 10: 0xc8967184 (stale) Mirror 13: 0xc8967184 (stale) Mirror 15: 0xc8967184 (stale) CRC-32 checksum value for chunk [0, 0x1254d): Mirror 1: 0x14da7f66 Mirror 16: 0x14da7f66 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1254d: skipped 000282 1789585255.247027 write 0x01a4bd thru 0x01a9c1 (0x505 bytes) 000283 1789585255.342816 write 0x01fd68 thru 0x02404c (0x42e5 bytes) 000284 1789585255.345647 trunc from 0x02404d to 0x003efc (0x20150 bytes) 000286 1789585255.372119 mapread 0x0006d8 thru 0x003efc (0x3825 bytes) 000287 1789585255.416818 write 0x01d312 thru 0x01f5fc (0x22eb bytes) 000288 1789585255.418640 trunc from 0x01f5fd to 0x019402 (0x61fa bytes) 000289 1789585255.437872 write 0x02b845 thru 0x03a6de (0xee9a bytes) 000290 1789585255.440864 mapread 0x024c31 thru 0x028b97 (0x3f67 bytes) 000292 1789585255.450869 trunc from 0x03a6df to 0x0044a0 (0x3623e bytes) 000293 1789585255.478128 read 0x003d86 thru 0x0044a0 (0x71b bytes) 000295 1789585255.506769 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x44a1): Mirror 10: 0xdcfedaf9 (stale) Mirror 13: 0xdcfedaf9 (stale) Mirror 15: 0xdcfedaf9 (stale) Mirror 16: 0xf7f567f3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x44a1): Mirror 10: 0xdcfedaf9 (stale) Mirror 13: 0xdcfedaf9 (stale) Mirror 15: 0xdcfedaf9 (stale) Mirror 16: 0xf7f567f3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x44a1: skipped 000296 1789585256.083705 mapwrite 0x0387da thru 0x0392df (0xb06 bytes) 000299 1789585256.228872 mapwrite 0x002d61 thru 0x00b70c (0x89ac bytes) 000301 1789585256.328825 read 0x033d01 thru 0x0392df (0x55df bytes) 000302 1789585256.342234 write 0x03403c thru 0x036c92 (0x2c57 bytes) 000303 1789585256.361176 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x392e0): Mirror 10: 0xc5eb5cab (stale) Mirror 13: 0xc5eb5cab (stale) Mirror 15: 0xc5eb5cab (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x392e0): Mirror 10: 0xc5eb5cab (stale) Mirror 13: 0xc5eb5cab (stale) Mirror 15: 0xc5eb5cab (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x392e0: skipped 000304 1789585257.004756 punch from 0x00ecd5 to 0x017bb2 (0x8ede bytes) 000305 1789585257.012989 mapwrite 0x02ca66 thru 0x03a220 (0xd7bb bytes) 000306 1789585257.196390 punch from 0x012e17 to 0x015906 (0x2af0 bytes) 000307 1789585257.205978 punch from 0x03455e to 0x03a220 (0x5cc3 bytes) 000309 1789585257.216542 trunc from 0x03a221 to 0x009b48 (0x306d8 bytes) 000310 1789585257.248313 read 0x00272f thru 0x008d33 (0x6605 bytes) 000311 1789585257.262861 trunc from 0x009b49 to 0x034627 (0x2aadf bytes) 000312 1789585257.292885 read 0x0252b3 thru 0x028f4f (0x3c9d bytes) 000314 1789585257.332030 mapread 0x0204c4 thru 0x021252 (0xd8f bytes) 000315 1789585257.336168 trunc from 0x034628 to 0x02efad (0x567a bytes) 000317 1789585257.389744 trunc from 0x02efae to 0x017fe0 (0x16fcd bytes) 000318 1789585257.416462 mapwrite 0x017ade thru 0x01851d (0xa40 bytes) 000320 1789585257.549159 punch from 0x017dcd to 0x01851d (0x751 bytes) 000321 1789585257.560942 write 0x01cef9 thru 0x02cb5c (0xfc64 bytes) 000322 1789585257.580553 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2cb5d): Mirror 10: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cb5d): Mirror 10: 0x8666e50 (stale) Mirror 13: 0x8666e50 (stale) Mirror 15: 0x8666e50 (stale) CRC-32 checksum value for chunk [0, 0x2cb5d): Mirror 1: 0xe7ecc58f Mirror 16: 0xe7ecc58f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cb5d: skipped 000323 1789585259.948607 mapwrite 0x035ea5 thru 0x03ffff (0xa15b bytes) 000325 1789585260.306607 write 0x013f73 thru 0x01e872 (0xa900 bytes) 000326 1789585260.334806 trunc from 0x040000 to 0x00bc25 (0x343da bytes) 000328 1789585260.400294 trunc from 0x00bc26 to 0x0324d4 (0x268af bytes) 000329 1789585260.481948 mapwrite 0x03164e thru 0x03a831 (0x91e4 bytes) 000330 1789585260.752524 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a832): Mirror 13: 0xf69f3a20 (stale) Mirror 15: 0xf69f3a20 (stale) Mirror 16: 0x5353df5f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a832): Mirror 13: 0xf69f3a20 (stale) Mirror 15: 0xf69f3a20 (stale) Mirror 16: 0x5353df5f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a832: skipped 000331 1789585261.653056 trunc from 0x03a832 to 0x028c8d (0x11ba4 bytes) 000332 1789585261.735139 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x28c8e): Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28c8e): Mirror 13: 0x69b7566a (stale) Mirror 15: 0x69b7566a (stale) Mirror 16: 0xcecfc649 (stale) CRC-32 checksum value for chunk [0, 0x28c8e): Mirror 1: 0x5910e929 Mirror 17: 0x5910e929 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28c8e: skipped 000334 1789585263.991860 trunc from 0x028c8e to 0x02bce6 (0x3059 bytes) 000336 1789585264.145398 trunc from 0x02bce7 to 0x03d888 (0x11ba2 bytes) 000339 1789585264.200517 write 0x0077e3 thru 0x00bd4c (0x456a bytes) 000340 1789585264.221199 punch from 0x01663d to 0x020897 (0xa25b bytes) 000341 1789585264.254643 trunc from 0x03d889 to 0x03f63f (0x1db7 bytes) 000343 1789585264.313591 MIRROR_RESYNC 5 mirrors 000344 1789585267.590508 read 0x0015f0 thru 0x001b9e (0x5af bytes) 000345 1789585267.599787 write 0x011eac thru 0x01e5dc (0xc731 bytes) 000347 1789585267.765786 trunc from 0x03f640 to 0x01cae0 (0x22b5f bytes) 000349 1789585267.826795 mapwrite 0x02be7c thru 0x036e0d (0xaf92 bytes) 000352 1789585268.063984 punch from 0x0206d8 to 0x0274f6 (0x6e1f bytes) 000353 1789585268.070567 punch from 0x0345ba to 0x036e0d (0x2854 bytes) 000356 1789585268.091537 punch from 0x03450c to 0x036e0d (0x2902 bytes) 000357 1789585268.103684 punch from 0x0284af to 0x02b118 (0x2c6a bytes) 000358 1789585268.126259 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36e0e): Mirror 13: 0xa6f945f1 (stale) Mirror 15: 0xa6f945f1 (stale) Mirror 16: 0xa6f945f1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36e0e): Mirror 13: 0xa6f945f1 (stale) Mirror 15: 0xa6f945f1 (stale) Mirror 16: 0xa6f945f1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36e0e: skipped 000361 1789585268.744034 mapwrite 0x02addf thru 0x02fa83 (0x4ca5 bytes) 000362 1789585268.894745 mapwrite 0x02eb95 thru 0x034a21 (0x5e8d bytes) 000363 1789585268.997685 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36e0e): Mirror 15: 0xa6f945f1 (stale) Mirror 16: 0xa6f945f1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36e0e): Mirror 15: 0xa6f945f1 (stale) Mirror 16: 0xa6f945f1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36e0e: skipped 000364 1789585269.695161 mapread 0x023d72 thru 0x033673 (0xf902 bytes) 000366 1789585269.730480 write 0x01c977 thru 0x01fb29 (0x31b3 bytes) 000367 1789585269.750471 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36e0e): Mirror 16: 0xa6f945f1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36e0e): Mirror 16: 0xa6f945f1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36e0e: skipped 000368 1789585270.124658 trunc from 0x036e0e to 0x0245f6 (0x12817 bytes) 000369 1789585270.170348 MIRROR_RESYNC 2 mirrors 000370 1789585271.629117 read 0x008b76 thru 0x00ea32 (0x5ebd bytes) 000371 1789585271.643099 trunc from 0x0245f7 to 0x014e36 (0xf7c0 bytes) 000374 1789585271.743984 punch from 0x003654 to 0x00afab (0x7958 bytes) 000375 1789585271.748966 write 0x017738 thru 0x0270dc (0xf9a5 bytes) 000377 1789585271.752086 write 0x02ff48 thru 0x03ce1b (0xced4 bytes) 000378 1789585271.755048 trunc from 0x03ce1c to 0x02314f (0x19ccc bytes) 000380 1789585271.778339 trunc from 0x023150 to 0x03dde7 (0x1ac98 bytes) 000381 1789585271.802925 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3dde8): Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dde8): Mirror 16: 0xeb0a9bcd (stale) CRC-32 checksum value for chunk [0, 0x3dde8): Mirror 1: 0x9b63d7b1 Mirror 17: 0x9b63d7b1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dde8: skipped 000382 1789585273.580663 read 0x01a786 thru 0x01b2d3 (0xb4e bytes) 000383 1789585273.606742 mapwrite 0x031330 thru 0x03a4ab (0x917c bytes) 000385 1789585273.860496 mapwrite 0x03a9ff thru 0x03ffff (0x5601 bytes) 000386 1789585274.022296 mapread 0x029e5d thru 0x0379db (0xdb7f bytes) 000388 1789585274.045580 write 0x00025f thru 0x00dfa1 (0xdd43 bytes) 000390 1789585274.068926 punch from 0x013819 to 0x0150ac (0x1894 bytes) 000392 1789585274.098393 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0x3e5403d2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0x3e5403d2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000393 1789585274.497921 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 17: 0x3e5403d2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3b2f24c0 Mirror 18: 0x3b2f24c0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000395 1789585275.860266 punch from 0x000d74 to 0x00f4f3 (0xe780 bytes) 000396 1789585275.960025 trunc from 0x040000 to 0x0198cd (0x26732 bytes) 000397 1789585276.000005 mapread 0x00b598 thru 0x0198cd (0xe336 bytes) 000398 1789585276.043282 mapwrite 0x03ee15 thru 0x03ffff (0x11eb bytes) 000399 1789585276.166656 mapwrite 0x020a05 thru 0x03018f (0xf78b bytes) 000400 1789585276.267838 mapread 0x03cc6f thru 0x03ffff (0x3391 bytes) 000402 1789585276.269195 mapwrite 0x011cee thru 0x017eca (0x61dd bytes) 000403 1789585276.338314 write 0x01b9be thru 0x01ba36 (0x79 bytes) 000406 1789585276.341574 read 0x0184da thru 0x022d1d (0xa844 bytes) 000408 1789585276.343091 punch from 0x006581 to 0x00cea4 (0x6924 bytes) 000409 1789585276.358839 trunc from 0x040000 to 0x01de5d (0x221a2 bytes) 000412 1789585276.394224 mapwrite 0x0305ea thru 0x0370f1 (0x6b08 bytes) 000413 1789585276.521161 mapwrite 0x030c6c thru 0x039b4a (0x8edf bytes) 000414 1789585276.595028 write 0x012eea thru 0x01a7f6 (0x790d bytes) 000416 1789585276.597873 write 0x019e3a thru 0x026fc3 (0xd18a bytes) 000417 1789585276.605179 write 0x031e81 thru 0x0354fe (0x367e bytes) 000418 1789585276.607028 read 0x0338c5 thru 0x039b4a (0x6286 bytes) 000420 1789585276.608952 trunc from 0x039b4b to 0x01ea6a (0x1b0e0 bytes) 000421 1789585276.636658 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ea6b): Mirror 18: 0x7de784a3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ea6b): Mirror 18: 0x7de784a3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ea6b: skipped 000423 1789585277.108379 read 0x0080eb thru 0x0180c2 (0xffd8 bytes) 000425 1789585277.126031 MIRROR_RESYNC 2 mirrors 000426 1789585278.459252 trunc from 0x01ea6b to 0x003e41 (0x1ac29 bytes) 000427 1789585278.586134 read 0x001bf6 thru 0x003e41 (0x224c bytes) 000428 1789585278.599232 trunc from 0x003e42 to 0x010c08 (0xcdc7 bytes) 000430 1789585278.644367 trunc from 0x010c09 to 0x0382c1 (0x276b9 bytes) 000433 1789585278.692726 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) 000435 1789585278.900284 mapwrite 0x00f72e thru 0x01ebb5 (0xf488 bytes) 000437 1789585278.998794 read 0x02e8ad thru 0x0382c1 (0x9a15 bytes) 000439 1789585279.009033 trunc from 0x0382c2 to 0x02b1b3 (0xd10e bytes) 000440 1789585279.022881 mapread 0x01254a thru 0x018c85 (0x673c bytes) 000441 1789585279.024055 write 0x03beea thru 0x03ffff (0x4116 bytes) 000442 1789585279.026108 write 0x010f3d thru 0x018b3f (0x7c03 bytes) 000446 1789585279.031186 mapread 0x027b20 thru 0x03028a (0x876b bytes) 000447 1789585279.048982 read 0x0384dd thru 0x03c752 (0x4276 bytes) 000448 1789585279.057028 write 0x0295e7 thru 0x034026 (0xaa40 bytes) 000449 1789585279.062752 MIRROR_EXTEND to 2 mirrors 000452 1789585280.717043 mapwrite 0x0350f2 thru 0x037cb6 (0x2bc5 bytes) 000453 1789585281.007772 trunc from 0x040000 to 0x024204 (0x1bdfb bytes) 000455 1789585281.044688 mapwrite 0x031906 thru 0x0355fd (0x3cf8 bytes) 000456 1789585281.223532 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) 000457 1789585281.488305 mapread 0x00ca6b thru 0x013098 (0x662e bytes) 000458 1789585281.518474 trunc from 0x0355fe to 0x02ebd0 (0x6a2d bytes) 000459 1789585281.542094 write 0x0385b6 thru 0x03c7c3 (0x420e bytes) 000462 1789585281.545679 write 0x0087ee thru 0x00ab12 (0x2325 bytes) 000463 1789585281.546954 punch from 0x02d46a to 0x039869 (0xc400 bytes) 000469 1789585281.566191 trunc from 0x03c7c4 to 0x0076a8 (0x3511b bytes) 000470 1789585281.602330 write 0x01e6a7 thru 0x026480 (0x7dda bytes) 000471 1789585281.608058 mapread 0x00c60a thru 0x019053 (0xca4a bytes) 000473 1789585281.645388 read 0x01b40f thru 0x0240b0 (0x8ca2 bytes) 000476 1789585281.651554 punch from 0x018457 to 0x026480 (0xe02a bytes) 000479 1789585281.687883 mapwrite 0x0292e9 thru 0x03212e (0x8e46 bytes) 000480 1789585281.817827 read 0x027b73 thru 0x031ec5 (0xa353 bytes) 000483 1789585281.824897 mapwrite 0x00bfba thru 0x0184d0 (0xc517 bytes) 000484 1789585281.910113 punch from 0x019419 to 0x0242ff (0xaee7 bytes) 000487 1789585281.921744 punch from 0x021160 to 0x02122a (0xcb bytes) 000488 1789585281.928208 mapread 0x01d396 thru 0x02c920 (0xf58b bytes) 000490 1789585282.016516 mapwrite 0x0154c6 thru 0x015623 (0x15e bytes) 000491 1789585282.063871 write 0x03de37 thru 0x03f2cb (0x1495 bytes) 000492 1789585282.065366 write 0x006ea2 thru 0x00e0c7 (0x7226 bytes) 000493 1789585282.067581 write 0x01a61d thru 0x0281d4 (0xdbb8 bytes) 000494 1789585282.089388 read 0x02cd08 thru 0x02f700 (0x29f9 bytes) 000495 1789585282.090467 mapread 0x01c830 thru 0x01fe5c (0x362d bytes) 000496 1789585282.093028 read 0x03afcd thru 0x03f2cb (0x42ff bytes) 000499 1789585282.095660 mapwrite 0x00523d thru 0x011044 (0xbe08 bytes) 000501 1789585282.166810 punch from 0x00319c to 0x00f1b8 (0xc01d bytes) 000502 1789585282.173926 write 0x00476f thru 0x00609d (0x192f bytes) 000503 1789585282.197958 read 0x01f14c thru 0x026186 (0x703b bytes) 000504 1789585282.221778 MIRROR_EXTEND to 2 mirrors 000506 1789585283.782406 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) 000507 1789585284.010124 write 0x029e7b thru 0x02ba16 (0x1b9c bytes) 000509 1789585284.036089 punch from 0x0069c4 to 0x013660 (0xcc9d bytes) 000510 1789585284.046341 write 0x01cfb5 thru 0x021d3b (0x4d87 bytes) 000511 1789585284.056564 trunc from 0x03f2cc to 0x02862c (0x16c9f bytes) 000512 1789585284.075063 write 0x03c3e8 thru 0x03cdd4 (0x9ed bytes) 000513 1789585284.076272 punch from 0x00312e to 0x00dcfa (0xabcd bytes) 000514 1789585284.092234 mapwrite 0x023dfd thru 0x031560 (0xd764 bytes) 000516 1789585284.260241 mapwrite 0x00dcb7 thru 0x00e4a7 (0x7f1 bytes) 000522 1789585284.379729 mapread 0x029c7e thru 0x02fc7a (0x5ffd bytes) 000523 1789585284.380880 trunc from 0x03cdd5 to 0x03c5e7 (0x7ed bytes) 000524 1789585284.413102 punch from 0x0200c4 to 0x020341 (0x27e bytes) 000525 1789585284.420010 punch from 0x0019c5 to 0x00b47f (0x9abb bytes) 000526 1789585284.425935 write 0x039cb9 thru 0x03ffff (0x6347 bytes) 000527 1789585284.433147 mapread 0x037af6 thru 0x03ffff (0x850a bytes) 000528 1789585284.441176 trunc from 0x040000 to 0x0221a8 (0x1de57 bytes) 000532 1789585284.469173 mapwrite 0x03211f thru 0x03989f (0x7781 bytes) 000534 1789585284.567153 write 0x022fc8 thru 0x0246a9 (0x16e2 bytes) 000539 1789585284.577729 read 0x00a959 thru 0x01a621 (0xfcc9 bytes) 000540 1789585284.595553 read 0x00b634 thru 0x0127d1 (0x719e bytes) 000543 1789585284.597071 trunc from 0x0398a0 to 0x038151 (0x174e bytes) 000546 1789585284.626651 mapwrite 0x01d39c thru 0x022cd8 (0x593d bytes) 000548 1789585284.737220 trunc from 0x038152 to 0x02d2cc (0xae85 bytes) 000549 1789585284.760306 trunc from 0x02d2cd to 0x00b007 (0x222c5 bytes) 000551 1789585284.782829 write 0x01c736 thru 0x02347a (0x6d45 bytes) 000552 1789585284.785251 mapwrite 0x001c6a thru 0x0069ad (0x4d44 bytes) 000553 1789585284.859598 write 0x012c85 thru 0x01464f (0x19cb bytes) 000554 1789585284.869629 write 0x03ca4f thru 0x03deea (0x149c bytes) 000555 1789585284.870564 write 0x00ae62 thru 0x013d52 (0x8ef1 bytes) 000556 1789585284.872177 trunc from 0x03deeb to 0x03e923 (0xa39 bytes) 000557 1789585284.901363 MIRROR_EXTEND to 2 mirrors 000558 1789585286.291770 write 0x011fd7 thru 0x015ee2 (0x3f0c bytes) 000559 1789585286.367670 mapread 0x003766 thru 0x00f635 (0xbed0 bytes) 000562 1789585286.390953 write 0x001a01 thru 0x00b36d (0x996d bytes) 000563 1789585286.396669 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e924): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e924): Mirror 2: 0x99ce1ec3 (stale) CRC-32 checksum value for chunk [0, 0x3e924): Mirror 1: 0xbca9f978 Mirror 3: 0xbca9f978 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e924: skipped 000564 1789585287.664618 read 0x03aafc thru 0x03b929 (0xe2e bytes) 000565 1789585287.678929 mapread 0x012999 thru 0x01aefb (0x8563 bytes) 000566 1789585287.727943 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3e924): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e924): Mirror 2: 0x99ce1ec3 (stale) CRC-32 checksum value for chunk [0, 0x3e924): Mirror 1: 0xbca9f978 Mirror 3: 0xbca9f978 Mirror 4: 0xbca9f978 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e924: skipped 000567 1789585288.719333 punch from 0x03799d to 0x03ad3b (0x339f bytes) 000568 1789585288.838201 punch from 0x020b94 to 0x02a522 (0x998f bytes) 000569 1789585288.854295 write 0x03a415 thru 0x03da8f (0x367b bytes) 000570 1789585288.867781 punch from 0x01230b to 0x019601 (0x72f7 bytes) 000574 1789585288.891328 trunc from 0x03e924 to 0x00b47c (0x334a7 bytes) 000579 1789585288.947740 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xb47d): Mirror 3: 0x6efe2b5 (stale) Mirror 4: 0x6efe2b5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb47d): Mirror 3: 0x6efe2b5 (stale) Mirror 4: 0x6efe2b5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb47d: skipped 000580 1789585289.376088 read 0x00a340 thru 0x00b47c (0x113d bytes) 000581 1789585289.385731 write 0x01c7a1 thru 0x0239ad (0x720d bytes) 000584 1789585289.394685 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x239ae): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x239ae): Mirror 3: 0x8c833e3 (stale) Mirror 4: 0x8c833e3 (stale) CRC-32 checksum value for chunk [0, 0x239ae): Mirror 1: 0xc605134c Mirror 5: 0xc605134c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x239ae: skipped 000585 1789585290.852214 punch from 0x011e27 to 0x01cbd7 (0xadb1 bytes) 000586 1789585290.945977 write 0x02c041 thru 0x0330d4 (0x7094 bytes) 000587 1789585290.948329 trunc from 0x0330d5 to 0x00a576 (0x28b5e bytes) 000589 1789585290.970802 read 0x00a1a0 thru 0x00a27d (0xde bytes) 000591 1789585290.978080 trunc from 0x00a577 to 0x01cda3 (0x1282d bytes) 000592 1789585290.991889 mapread 0x013198 thru 0x01a184 (0x6fed bytes) 000593 1789585291.012089 mapwrite 0x01824a thru 0x018ab9 (0x870 bytes) 000594 1789585291.056149 punch from 0x008990 to 0x016a71 (0xe0e2 bytes) 000595 1789585291.064178 mapwrite 0x014a5d thru 0x024688 (0xfc2c bytes) 000596 1789585291.172076 mapread 0x00c0d9 thru 0x017879 (0xb7a1 bytes) 000597 1789585291.185995 trunc from 0x024689 to 0x027ad8 (0x3450 bytes) 000599 1789585291.218335 MIRROR_RESYNC 4 mirrors 000601 1789585293.126948 read 0x00719a thru 0x00b24c (0x40b3 bytes) 000602 1789585293.173641 read 0x009478 thru 0x015b14 (0xc69d bytes) 000604 1789585293.200293 write 0x02d9c7 thru 0x02df07 (0x541 bytes) 000605 1789585293.340248 read 0x00ca13 thru 0x01b6f2 (0xece0 bytes) 000607 1789585293.358274 write 0x03d4da thru 0x03ffff (0x2b26 bytes) 000608 1789585293.367914 mapread 0x001b8d thru 0x00ae97 (0x930b bytes) 000609 1789585293.373954 mapwrite 0x03cc2e thru 0x03f25e (0x2631 bytes) 000610 1789585293.469311 trunc from 0x040000 to 0x037257 (0x8da8 bytes) 000611 1789585293.503008 trunc from 0x037258 to 0x003dbe (0x33499 bytes) 000613 1789585293.526049 punch from 0x001302 to 0x003dbe (0x2abd bytes) 000614 1789585293.536925 write 0x00985a thru 0x00db2e (0x42d5 bytes) 000615 1789585293.538755 write 0x006097 thru 0x00ef4c (0x8eb6 bytes) 000616 1789585293.547285 mapwrite 0x032d61 thru 0x03ffff (0xd29f bytes) 000617 1789585293.808528 mapread 0x0042f2 thru 0x00ccce (0x89dd bytes) 000618 1789585293.830370 MIRROR_RESYNC 4 mirrors 000619 1789585296.275044 read 0x00fe85 thru 0x01314a (0x32c6 bytes) 000620 1789585296.284707 mapwrite 0x0069b4 thru 0x015e11 (0xf45e bytes) 000621 1789585296.620750 mapwrite 0x026f99 thru 0x031156 (0xa1be bytes) 000623 1789585296.810599 mapwrite 0x00e47c thru 0x01759b (0x9120 bytes) 000624 1789585296.888402 trunc from 0x040000 to 0x006eef (0x39110 bytes) 000625 1789585296.918414 write 0x029ec2 thru 0x02a5d6 (0x715 bytes) 000626 1789585296.921838 trunc from 0x02a5d7 to 0x02f773 (0x519d bytes) 000627 1789585296.957856 trunc from 0x02f774 to 0x036881 (0x710e bytes) 000632 1789585296.995877 MIRROR_RESYNC 4 mirrors 000633 1789585298.859947 punch from 0x029d0a to 0x036881 (0xcb78 bytes) 000634 1789585298.982696 trunc from 0x036882 to 0x02d090 (0x97f1 bytes) 000635 1789585299.024715 trunc from 0x02d091 to 0x029bba (0x34d6 bytes) 000636 1789585299.096022 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x29bbb): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29bbb): Mirror 3: 0x7b284bf5 (stale) Mirror 4: 0x7b284bf5 (stale) Mirror 5: 0x7b284bf5 (stale) CRC-32 checksum value for chunk [0, 0x29bbb): Mirror 1: 0x7b284bf5 Mirror 6: 0x7b284bf5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29bbb: skipped 000637 1789585300.591203 read 0x01adcb thru 0x022c3e (0x7e74 bytes) 000639 1789585300.624073 write 0x0150f9 thru 0x01605f (0xf67 bytes) 000640 1789585300.749890 mapwrite 0x015c0c thru 0x0173e4 (0x17d9 bytes) 000643 1789585300.815952 mapwrite 0x035ab0 thru 0x03b400 (0x5951 bytes) 000644 1789585300.930920 punch from 0x0159d0 to 0x017eec (0x251d bytes) 000646 1789585300.938690 read 0x01b8cc thru 0x02366f (0x7da4 bytes) 000647 1789585300.953303 trunc from 0x03b401 to 0x01341c (0x27fe4 bytes) 000648 1789585300.972707 mapwrite 0x010a18 thru 0x016850 (0x5e39 bytes) 000650 1789585301.114011 mapwrite 0x0204e9 thru 0x02bbca (0xb6e2 bytes) 000651 1789585301.436097 punch from 0x01d80c to 0x02bbca (0xe3bf bytes) 000654 1789585301.442963 write 0x0305e1 thru 0x036255 (0x5c75 bytes) 000656 1789585301.454778 mapwrite 0x00294b thru 0x00e269 (0xb91f bytes) 000657 1789585301.593008 trunc from 0x036256 to 0x02dca5 (0x85b0 bytes) 000658 1789585301.644626 trunc from 0x02dca6 to 0x005786 (0x2851f bytes) 000660 1789585301.683156 mapread 0x004212 thru 0x005786 (0x1575 bytes) 000662 1789585301.686389 punch from 0x002cfb to 0x0041e3 (0x14e9 bytes) 000663 1789585301.694280 write 0x023b95 thru 0x03305d (0xf4c9 bytes) 000664 1789585301.697555 punch from 0x00a250 to 0x015f79 (0xbd2a bytes) 000665 1789585301.732174 mapwrite 0x0050cd thru 0x00a594 (0x54c8 bytes) 000666 1789585301.876399 mapwrite 0x018898 thru 0x01e531 (0x5c9a bytes) 000668 1789585302.054342 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3305e): Mirror 3: 0x748123a8 (stale) Mirror 5: 0x748123a8 (stale) Mirror 6: 0x3f02f419 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3305e): Mirror 3: 0x748123a8 (stale) Mirror 5: 0x748123a8 (stale) Mirror 6: 0x3f02f419 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3305e: skipped 000669 1789585302.398667 mapwrite 0x007e2c thru 0x009d8c (0x1f61 bytes) 000670 1789585302.464924 mapwrite 0x02caa7 thru 0x03775a (0xacb4 bytes) 000671 1789585302.547691 write 0x01e4f5 thru 0x024dd4 (0x68e0 bytes) 000673 1789585302.560408 write 0x01e725 thru 0x02d18d (0xea69 bytes) 000675 1789585302.563083 trunc from 0x03775b to 0x012a32 (0x24d28 bytes) 000676 1789585302.578402 mapwrite 0x0034a3 thru 0x00cec2 (0x9a20 bytes) 000677 1789585302.659880 write 0x01b4a5 thru 0x01d767 (0x22c3 bytes) 000678 1789585302.662499 punch from 0x010a06 to 0x01481a (0x3e15 bytes) 000679 1789585302.678152 mapread 0x01d5bc thru 0x01d767 (0x1ac bytes) 000681 1789585302.680388 trunc from 0x01d768 to 0x001c56 (0x1bb11 bytes) 000682 1789585302.706677 mapread 0x00073c thru 0x001c56 (0x151b bytes) 000683 1789585302.725398 write 0x003037 thru 0x00ae1e (0x7de8 bytes) 000684 1789585302.726668 mapwrite 0x031dc0 thru 0x033915 (0x1b56 bytes) 000685 1789585302.844856 punch from 0x02b88b to 0x033915 (0x808b bytes) 000687 1789585302.850950 punch from 0x00fb6d to 0x019514 (0x99a8 bytes) 000688 1789585302.856105 trunc from 0x033916 to 0x029e7b (0x9a9a bytes) 000690 1789585302.879833 read 0x01540b thru 0x015b47 (0x73d bytes) 000691 1789585302.891106 mapread 0x008c2d thru 0x010523 (0x78f7 bytes) 000692 1789585302.912369 trunc from 0x029e7c to 0x024a77 (0x5404 bytes) 000693 1789585302.940204 mapwrite 0x022fdf thru 0x025c4e (0x2c70 bytes) 000694 1789585303.029348 read 0x022892 thru 0x025c4e (0x33bd bytes) 000695 1789585303.030143 write 0x0199bf thru 0x0238ba (0x9efc bytes) 000696 1789585303.043836 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x25c4f): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25c4f): Mirror 3: 0x93255d13 (stale) Mirror 5: 0x93255d13 (stale) Mirror 6: 0x93255d13 (stale) CRC-32 checksum value for chunk [0, 0x25c4f): Mirror 1: 0xe22bdf99 Mirror 7: 0xe22bdf99 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25c4f: skipped 000697 1789585304.474288 write 0x03a4b5 thru 0x03dd3b (0x3887 bytes) 000701 1789585304.573754 mapwrite 0x02201c thru 0x02f6b5 (0xd69a bytes) 000702 1789585304.711611 trunc from 0x03dd3c to 0x010012 (0x2dd29 bytes) 000703 1789585304.807692 trunc from 0x010013 to 0x03250b (0x224f9 bytes) 000704 1789585304.839346 mapread 0x02fa18 thru 0x02fd30 (0x319 bytes) 000706 1789585304.854266 mapwrite 0x022b1b thru 0x02b25a (0x8740 bytes) 000708 1789585304.936485 mapread 0x01e212 thru 0x01fe1c (0x1c0b bytes) 000709 1789585304.938719 mapwrite 0x0189e2 thru 0x018f4b (0x56a bytes) 000711 1789585305.044107 mapread 0x01ca01 thru 0x020686 (0x3c86 bytes) 000713 1789585305.046933 punch from 0x022ae2 to 0x027f24 (0x5443 bytes) 000715 1789585305.057455 mapwrite 0x03c64c thru 0x03ffff (0x39b4 bytes) 000718 1789585305.180163 punch from 0x015c03 to 0x018646 (0x2a44 bytes) 000719 1789585305.188380 mapwrite 0x01b640 thru 0x0216c6 (0x6087 bytes) 000722 1789585305.275632 write 0x0249a1 thru 0x0310a4 (0xc704 bytes) 000723 1789585305.290266 trunc from 0x040000 to 0x010c79 (0x2f386 bytes) 000726 1789585305.333804 read 0x00d094 thru 0x010c79 (0x3be6 bytes) 000727 1789585305.340962 write 0x008d7a thru 0x014fc6 (0xc24d bytes) 000728 1789585305.355123 MIRROR_RESYNC 5 mirrors 000729 1789585307.232051 mapwrite 0x004e6e thru 0x00be1c (0x6faf bytes) 000730 1789585307.449069 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x14fc7): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14fc7): Mirror 3: 0x91ba25e0 (stale) Mirror 5: 0x91ba25e0 (stale) Mirror 6: 0x91ba25e0 (stale) Mirror 7: 0x91ba25e0 (stale) CRC-32 checksum value for chunk [0, 0x14fc7): Mirror 1: 0x9803a12 Mirror 8: 0x9803a12 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14fc7: skipped 000732 1789585308.772708 read 0x003d09 thru 0x011b14 (0xde0c bytes) 000733 1789585308.796541 trunc from 0x014fc7 to 0x00cb81 (0x8445 bytes) 000735 1789585308.941568 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0xcb82): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xcb82): Mirror 3: 0x7ecb398d (stale) Mirror 5: 0x7ecb398d (stale) Mirror 6: 0x7ecb398d (stale) Mirror 7: 0x7ecb398d (stale) Mirror 8: 0x1b9b267b (stale) CRC-32 checksum value for chunk [0, 0xcb82): Mirror 1: 0x1b9b267b Mirror 9: 0x1b9b267b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xcb82: skipped 000737 1789585310.417960 trunc from 0x00cb82 to 0x029ec1 (0x1d340 bytes) 000739 1789585310.535644 mapwrite 0x02755f thru 0x02f89c (0x833e bytes) 000741 1789585310.728343 mapwrite 0x029cb5 thru 0x035aa2 (0xbdee bytes) 000742 1789585310.827582 write 0x00d4c4 thru 0x01abd8 (0xd715 bytes) 000744 1789585310.840168 read 0x0085c8 thru 0x011e37 (0x9870 bytes) 000745 1789585310.849194 trunc from 0x035aa3 to 0x028c1c (0xce86 bytes) 000746 1789585310.872750 trunc from 0x028c1d to 0x029c1a (0xffe bytes) 000747 1789585310.892642 trunc from 0x029c1b to 0x013fb6 (0x15c64 bytes) 000748 1789585310.915804 MIRROR_RESYNC 7 mirrors 000749 1789585312.994773 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) 000751 1789585313.350259 MIRROR_RESYNC 6 mirrors 000752 1789585313.737336 write 0x0093e8 thru 0x0104c7 (0x70e0 bytes) 000753 1789585313.829086 read 0x0123f5 thru 0x013fb6 (0x1bc2 bytes) 000755 1789585313.837286 read 0x00d772 thru 0x0109d6 (0x3265 bytes) 000756 1789585313.837982 punch from 0x009b18 to 0x00cf0c (0x33f5 bytes) 000757 1789585313.868135 punch from 0x00b584 to 0x00e5db (0x3058 bytes) 000759 1789585313.893909 mapread 0x01187c thru 0x013fb6 (0x273b bytes) 000760 1789585313.904965 write 0x0078d2 thru 0x00ba66 (0x4195 bytes) 000761 1789585313.913123 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x13fb7): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13fb7): Mirror 5: 0xdafae445 (stale) Mirror 6: 0xdafae445 (stale) Mirror 7: 0xdafae445 (stale) Mirror 8: 0xdafae445 (stale) Mirror 9: 0xdafae445 (stale) CRC-32 checksum value for chunk [0, 0x13fb7): Mirror 1: 0x3658bad0 Mirror 10: 0x3658bad0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13fb7: skipped 000763 1789585315.512380 mapread 0x00c0ec thru 0x013fb6 (0x7ecb bytes) 000765 1789585315.576148 mapwrite 0x03b927 thru 0x03e8fe (0x2fd8 bytes) 000768 1789585315.799378 mapread 0x029371 thru 0x02e97b (0x560b bytes) 000770 1789585315.810183 read 0x031eed thru 0x03657c (0x4690 bytes) 000771 1789585315.816006 write 0x012697 thru 0x02225b (0xfbc5 bytes) 000772 1789585315.828199 MIRROR_RESYNC 7 mirrors 000773 1789585319.469875 write 0x026afd thru 0x02d46e (0x6972 bytes) 000774 1789585319.567332 mapwrite 0x03194e thru 0x03ffff (0xe6b2 bytes) 000775 1789585319.707737 mapread 0x017470 thru 0x026409 (0xef9a bytes) 000777 1789585319.732338 mapread 0x0139a4 thru 0x017e71 (0x44ce bytes) 000778 1789585319.733966 punch from 0x02dfbd to 0x032409 (0x444d bytes) 000779 1789585319.741513 read 0x038b93 thru 0x03ffff (0x746d bytes) 000780 1789585319.743230 mapwrite 0x000594 thru 0x0079fd (0x746a bytes) 000781 1789585319.824027 mapwrite 0x01e57c thru 0x02bebe (0xd943 bytes) 000782 1789585319.909842 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x2d93f3a2 (stale) Mirror 6: 0x2d93f3a2 (stale) Mirror 7: 0x2d93f3a2 (stale) Mirror 8: 0x2d93f3a2 (stale) Mirror 9: 0x2d93f3a2 (stale) Mirror 10: 0x2d93f3a2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd4d6427c Mirror 11: 0xd4d6427c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000784 1789585321.120014 trunc from 0x040000 to 0x03cade (0x3521 bytes) 000787 1789585321.244494 write 0x018f74 thru 0x025852 (0xc8df bytes) 000788 1789585321.256245 punch from 0x031eb8 to 0x03224e (0x397 bytes) 000789 1789585321.277595 mapread 0x021c30 thru 0x02df11 (0xc2e2 bytes) 000790 1789585321.358089 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cadf): Mirror 6: 0xa4645afe (stale) Mirror 7: 0xa4645afe (stale) Mirror 8: 0xa4645afe (stale) Mirror 9: 0xa4645afe (stale) Mirror 10: 0xa4645afe (stale) Mirror 11: 0xe59d7095 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cadf): Mirror 6: 0xa4645afe (stale) Mirror 7: 0xa4645afe (stale) Mirror 8: 0xa4645afe (stale) Mirror 9: 0xa4645afe (stale) Mirror 10: 0xa4645afe (stale) Mirror 11: 0xe59d7095 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cadf: skipped 000793 1789585322.046973 mapread 0x019028 thru 0x01ac43 (0x1c1c bytes) 000795 1789585322.061397 write 0x02faf6 thru 0x038433 (0x893e bytes) 000796 1789585322.078407 punch from 0x01dd1a to 0x028d44 (0xb02b bytes) 000797 1789585322.104967 mapwrite 0x039b6b thru 0x03b790 (0x1c26 bytes) 000798 1789585322.168768 punch from 0x02a5e4 to 0x032237 (0x7c54 bytes) 000799 1789585322.174285 trunc from 0x03cadf to 0x03c534 (0x5aa bytes) 000800 1789585322.199716 mapread 0x02a0f3 thru 0x034e40 (0xad4e bytes) 000802 1789585322.212211 read 0x02532b thru 0x027499 (0x216f bytes) 000803 1789585322.217796 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c535): Mirror 6: 0xfc87721b (stale) Mirror 7: 0xfc87721b (stale) Mirror 9: 0xfc87721b (stale) Mirror 10: 0xfc87721b (stale) Mirror 11: 0xd1996df5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c535): Mirror 6: 0xfc87721b (stale) Mirror 7: 0xfc87721b (stale) Mirror 9: 0xfc87721b (stale) Mirror 10: 0xfc87721b (stale) Mirror 11: 0xd1996df5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c535: skipped 000805 1789585322.731962 MIRROR_RESYNC 6 mirrors 000808 1789585325.905588 trunc from 0x03c535 to 0x027a62 (0x14ad2 bytes) 000809 1789585326.005710 mapread 0x022f28 thru 0x027a62 (0x4b3b bytes) 000811 1789585326.036869 MIRROR_RESYNC 6 mirrors 000812 1789585328.216301 mapread 0x014917 thru 0x01ece1 (0xa3cb bytes) 000813 1789585328.243627 write 0x02ecff thru 0x03d86a (0xeb6c bytes) 000815 1789585328.370183 punch from 0x010d02 to 0x01283a (0x1b39 bytes) 000818 1789585328.400241 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d86b): Mirror 6: 0x277fd3be (stale) Mirror 7: 0x277fd3be (stale) Mirror 9: 0x277fd3be (stale) Mirror 10: 0x277fd3be (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d86b): Mirror 6: 0x277fd3be (stale) Mirror 7: 0x277fd3be (stale) Mirror 9: 0x277fd3be (stale) Mirror 10: 0x277fd3be (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d86b: skipped 000820 1789585328.913190 write 0x02315a thru 0x025f73 (0x2e1a bytes) 000821 1789585328.933170 trunc from 0x03d86b to 0x037b26 (0x5d44 bytes) 000823 1789585328.967015 mapwrite 0x02cc01 thru 0x0398a6 (0xcca6 bytes) 000824 1789585329.116013 mapread 0x0134d8 thru 0x01ef4d (0xba76 bytes) 000826 1789585329.134601 write 0x02fa11 thru 0x0303d4 (0x9c4 bytes) 000828 1789585329.137345 read 0x0339f0 thru 0x035155 (0x1766 bytes) 000829 1789585329.138151 punch from 0x030990 to 0x03244f (0x1ac0 bytes) 000830 1789585329.148224 trunc from 0x0398a7 to 0x0195c5 (0x202e1 bytes) 000832 1789585329.195273 MIRROR_RESYNC 5 mirrors 000837 1789585331.423709 mapwrite 0x00a692 thru 0x012737 (0x80a6 bytes) 000838 1789585331.702483 mapread 0x017d99 thru 0x0195c5 (0x182d bytes) 000840 1789585331.739548 MIRROR_RESYNC 5 mirrors 000842 1789585333.268190 punch from 0x011402 to 0x017415 (0x6014 bytes) 000845 1789585333.349729 mapread 0x0182b0 thru 0x0195c5 (0x1316 bytes) 000846 1789585333.361310 punch from 0x002f01 to 0x00b825 (0x8925 bytes) 000849 1789585333.370565 read 0x00d29c thru 0x0112c8 (0x402d bytes) 000850 1789585333.380794 write 0x02909b thru 0x033ba6 (0xab0c bytes) 000852 1789585333.384270 write 0x0025f2 thru 0x0056f0 (0x30ff bytes) 000853 1789585333.394322 read 0x025ae8 thru 0x02bde0 (0x62f9 bytes) 000854 1789585333.405734 trunc from 0x033ba7 to 0x038c3e (0x5098 bytes) 000855 1789585333.440308 MIRROR_RESYNC 5 mirrors 000856 1789585337.306401 write 0x036f49 thru 0x03ffff (0x90b7 bytes) 000857 1789585337.513305 write 0x002a30 thru 0x01029d (0xd86e bytes) 000858 1789585337.538150 write 0x00396f thru 0x007ec7 (0x4559 bytes) 000859 1789585337.545524 mapread 0x0079fc thru 0x012200 (0xa805 bytes) 000860 1789585337.575116 read 0x03155a thru 0x0364d7 (0x4f7e bytes) 000862 1789585337.615855 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x22d27287 (stale) Mirror 7: 0x22d27287 (stale) Mirror 9: 0x22d27287 (stale) Mirror 10: 0x22d27287 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x80b446bc Mirror 11: 0x80b446bc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000863 1789585339.255197 trunc from 0x040000 to 0x035100 (0xaeff bytes) 000864 1789585339.427067 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35101): Mirror 6: 0x759449d5 (stale) Mirror 7: 0x759449d5 (stale) Mirror 9: 0x759449d5 (stale) Mirror 11: 0x5d32ced0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35101): Mirror 6: 0x759449d5 (stale) Mirror 7: 0x759449d5 (stale) Mirror 9: 0x759449d5 (stale) Mirror 11: 0x5d32ced0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35101: skipped 000865 1789585339.974226 punch from 0x006e88 to 0x00f885 (0x89fe bytes) 000866 1789585339.983027 mapwrite 0x01ad67 thru 0x02ab49 (0xfde3 bytes) 000869 1789585340.094153 write 0x02f043 thru 0x039536 (0xa4f4 bytes) 000872 1789585340.101335 mapread 0x010c84 thru 0x0165be (0x593b bytes) 000873 1789585340.111963 mapread 0x0387b3 thru 0x039536 (0xd84 bytes) 000874 1789585340.112815 read 0x005a8d thru 0x00c7b6 (0x6d2a bytes) 000875 1789585340.120735 write 0x003815 thru 0x005053 (0x183f bytes) 000876 1789585340.128163 write 0x029cb1 thru 0x0360a6 (0xc3f6 bytes) 000877 1789585340.130417 write 0x0249d4 thru 0x0250f3 (0x720 bytes) 000878 1789585340.131992 punch from 0x02186c to 0x02fcb7 (0xe44c bytes) 000879 1789585340.146577 read 0x018f0b thru 0x022710 (0x9806 bytes) 000880 1789585340.161157 mapwrite 0x00310e thru 0x012a00 (0xf8f3 bytes) 000882 1789585340.233940 write 0x0298df thru 0x0397d2 (0xfef4 bytes) 000883 1789585340.235940 punch from 0x021e1e to 0x02edc4 (0xcfa7 bytes) 000884 1789585340.252655 trunc from 0x0397d3 to 0x035f28 (0x38aa bytes) 000886 1789585340.267612 punch from 0x00c304 to 0x00f0cf (0x2dcc bytes) 000887 1789585340.277225 read 0x023e65 thru 0x02e35b (0xa4f7 bytes) 000889 1789585340.289042 trunc from 0x035f29 to 0x03542e (0xafa bytes) 000890 1789585340.303827 punch from 0x009edc to 0x00fe56 (0x5f7b bytes) 000891 1789585340.310005 punch from 0x013953 to 0x0216a2 (0xdd50 bytes) 000893 1789585340.316936 mapwrite 0x023696 thru 0x03046e (0xcdd9 bytes) 000895 1789585340.403995 read 0x02e782 thru 0x03542e (0x6cad bytes) 000896 1789585340.404955 trunc from 0x03542f to 0x0054af (0x2ff7f bytes) 000899 1789585340.426468 punch from 0x003cbb to 0x0054af (0x17f5 bytes) 000900 1789585340.436364 mapwrite 0x018551 thru 0x02126a (0x8d1a bytes) 000902 1789585340.635622 MIRROR_RESYNC 5 mirrors 000903 1789585343.283809 read 0x015b3a thru 0x019bd7 (0x409e bytes) 000904 1789585343.295964 write 0x034f67 thru 0x03e7d1 (0x986b bytes) 000905 1789585343.384480 trunc from 0x03e7d2 to 0x02a10e (0x146c3 bytes) 000906 1789585343.410956 mapread 0x014afd thru 0x01b104 (0x6608 bytes) 000908 1789585343.432820 read 0x0299e7 thru 0x02a10e (0x728 bytes) 000910 1789585343.445955 mapread 0x01ecb7 thru 0x02a10e (0xb458 bytes) 000911 1789585343.447265 write 0x03a196 thru 0x03c947 (0x27b2 bytes) 000912 1789585343.449158 punch from 0x00639f to 0x011e42 (0xbaa4 bytes) 000914 1789585343.470360 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c948): Mirror 7: 0x8f96e2c (stale) Mirror 9: 0x8f96e2c (stale) Mirror 11: 0x8f96e2c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c948): Mirror 7: 0x8f96e2c (stale) Mirror 9: 0x8f96e2c (stale) Mirror 11: 0x8f96e2c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c948: skipped 000915 1789585343.973092 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3c948): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c948): Mirror 7: 0x8f96e2c (stale) Mirror 9: 0x8f96e2c (stale) Mirror 11: 0x8f96e2c (stale) CRC-32 checksum value for chunk [0, 0x3c948): Mirror 1: 0x2065977f Mirror 12: 0x2065977f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c948: skipped 000917 1789585345.826821 mapread 0x021921 thru 0x029c94 (0x8374 bytes) 000918 1789585345.883951 write 0x01b25f thru 0x022769 (0x750b bytes) 000919 1789585346.025119 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3c948): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c948): Mirror 7: 0x8f96e2c (stale) Mirror 9: 0x8f96e2c (stale) Mirror 11: 0x8f96e2c (stale) Mirror 12: 0x2065977f (stale) CRC-32 checksum value for chunk [0, 0x3c948): Mirror 1: 0xb56a3580 Mirror 13: 0xb56a3580 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c948: skipped 000920 1789585347.653918 trunc from 0x03c948 to 0x037cfc (0x4c4b bytes) 000921 1789585347.852737 punch from 0x02c89a to 0x033b29 (0x7290 bytes) 000922 1789585347.860296 mapread 0x02cc0a thru 0x02d8bb (0xcb2 bytes) 000923 1789585347.887762 punch from 0x01dd81 to 0x024069 (0x62e9 bytes) 000924 1789585347.896550 write 0x018de8 thru 0x01e586 (0x579f bytes) 000925 1789585347.909818 mapread 0x01bf2f thru 0x024d2d (0x8dff bytes) 000926 1789585347.922098 mapwrite 0x01ad97 thru 0x01d22a (0x2494 bytes) 000927 1789585347.985268 write 0x014059 thru 0x022dd9 (0xed81 bytes) 000929 1789585347.992074 mapwrite 0x032570 thru 0x03ecd1 (0xc762 bytes) 000930 1789585348.096526 read 0x02454f thru 0x0338ac (0xf35e bytes) 000932 1789585348.104886 punch from 0x03212a to 0x03557b (0x3452 bytes) 000934 1789585348.110410 mapwrite 0x009504 thru 0x01365e (0xa15b bytes) 000936 1789585348.180609 read 0x038136 thru 0x03ecd1 (0x6b9c bytes) 000938 1789585348.182730 mapwrite 0x00f250 thru 0x0164c5 (0x7276 bytes) 000940 1789585348.236776 read 0x01831a thru 0x026b49 (0xe830 bytes) 000942 1789585348.238273 mapwrite 0x01f191 thru 0x0239e7 (0x4857 bytes) 000943 1789585348.292942 mapwrite 0x037f44 thru 0x03ffff (0x80bc bytes) 000945 1789585348.385580 mapread 0x022f7e thru 0x028ed8 (0x5f5b bytes) 000946 1789585348.396721 MIRROR_RESYNC 6 mirrors 000947 1789585351.604981 punch from 0x0364db to 0x03be43 (0x5969 bytes) 000953 1789585351.701405 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xe699a1ad (stale) Mirror 11: 0xe699a1ad (stale) Mirror 12: 0xe699a1ad (stale) Mirror 13: 0xe699a1ad (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xe699a1ad (stale) Mirror 11: 0xe699a1ad (stale) Mirror 12: 0xe699a1ad (stale) Mirror 13: 0xe699a1ad (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000954 1789585352.339989 mapwrite 0x001385 thru 0x006991 (0x560d bytes) 000955 1789585352.422717 trunc from 0x040000 to 0x028a2b (0x175d4 bytes) 000956 1789585352.479871 write 0x02c3c9 thru 0x030adf (0x4717 bytes) 000957 1789585352.495016 MIRROR_RESYNC 5 mirrors 000958 1789585354.953389 MIRROR_EXTEND to 6 mirrors 000959 1789585355.881815 read 0x01addc thru 0x029bfb (0xee20 bytes) 000961 1789585355.949254 punch from 0x01cbaf to 0x02b5ef (0xea41 bytes) 000962 1789585356.111794 mapread 0x0174ea thru 0x020381 (0x8e98 bytes) 000963 1789585356.165831 mapwrite 0x02b408 thru 0x033364 (0x7f5d bytes) 000964 1789585356.250363 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33365): Mirror 7: 0x12bee409 (stale) Mirror 11: 0x12bee409 (stale) Mirror 12: 0x12bee409 (stale) Mirror 14: 0x12bee409 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33365): Mirror 7: 0x12bee409 (stale) Mirror 11: 0x12bee409 (stale) Mirror 12: 0x12bee409 (stale) Mirror 14: 0x12bee409 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33365: skipped 000966 1789585356.892360 write 0x010339 thru 0x0189c5 (0x868d bytes) 000967 1789585356.921684 mapread 0x013eed thru 0x020085 (0xc199 bytes) 000968 1789585356.971658 MIRROR_RESYNC 5 mirrors 000969 1789585359.187086 punch from 0x006b8d to 0x009b8b (0x2fff bytes) 000970 1789585359.280473 read 0x0280ba thru 0x02f6a7 (0x75ee bytes) 000977 1789585359.293580 read 0x02670b thru 0x031b82 (0xb478 bytes) 000978 1789585359.309014 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x33365): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33365): Mirror 7: 0x968ac328 (stale) Mirror 11: 0x968ac328 (stale) Mirror 12: 0x968ac328 (stale) Mirror 14: 0x968ac328 (stale) CRC-32 checksum value for chunk [0, 0x33365): Mirror 1: 0xf028a7ef Mirror 15: 0xf028a7ef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33365: skipped 000980 1789585360.717288 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33365): Mirror 7: 0x968ac328 (stale) Mirror 12: 0x968ac328 (stale) Mirror 14: 0x968ac328 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33365): Mirror 7: 0x968ac328 (stale) Mirror 12: 0x968ac328 (stale) Mirror 14: 0x968ac328 (stale) CRC-32 checksum value for chunk [0, 0x33365): Mirror 1: 0xf028a7ef Mirror 15: 0xf028a7ef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33365: skipped 000983 1789585361.748526 mapread 0x0223de thru 0x024e77 (0x2a9a bytes) 000984 1789585361.835148 punch from 0x02c410 to 0x033364 (0x6f55 bytes) 000985 1789585361.982715 write 0x007061 thru 0x015c49 (0xebe9 bytes) 000986 1789585362.017758 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x33365): Mirror 7: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33365): Mirror 7: 0x968ac328 (stale) Mirror 12: 0x968ac328 (stale) Mirror 14: 0x968ac328 (stale) Mirror 15: 0xf028a7ef (stale) CRC-32 checksum value for chunk [0, 0x33365): Mirror 1: 0x6f223ddf Mirror 16: 0x6f223ddf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33365: skipped 000987 1789585363.520475 read 0x01393a thru 0x01cc37 (0x92fe bytes) 000989 1789585363.561010 mapwrite 0x00647e thru 0x014712 (0xe295 bytes) 000990 1789585363.842936 trunc from 0x033365 to 0x0322c5 (0x109f bytes) 000991 1789585363.870105 read 0x00c56b thru 0x0176de (0xb174 bytes) 000992 1789585363.871284 mapread 0x02e327 thru 0x0322c5 (0x3f9f bytes) 000993 1789585363.883753 mapread 0x02fa9d thru 0x0322c5 (0x2829 bytes) 000994 1789585363.888865 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x3f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x322c6): Mirror 7: 0xccbc59eb (stale) Mirror 12: 0xccbc59eb (stale) Mirror 14: 0xccbc59eb (stale) Mirror 16: 0x5a1615c6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x322c6): Mirror 7: 0xccbc59eb (stale) Mirror 12: 0xccbc59eb (stale) Mirror 14: 0xccbc59eb (stale) Mirror 16: 0x5a1615c6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x322c6: skipped 000995 1789585364.569542 mapwrite 0x00236a thru 0x008450 (0x60e7 bytes) 000996 1789585364.696505 mapread 0x00baef thru 0x01a0ba (0xe5cc bytes) 000998 1789585364.752739 write 0x027a08 thru 0x02bae2 (0x40db bytes) 000999 1789585364.777156 write 0x02e025 thru 0x034bd8 (0x6bb4 bytes) 001000 1789585364.778332 write 0x02097b thru 0x028ad4 (0x815a bytes) All operations completed A-OK!