== sanity-flr test 70a: flr mode fsx test ================ 04:47:05 (1779698825) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 8827 skipping zero length zero range 000003 1779698827.412981 write 0x03ed68 thru 0x03ffff (0x1298 bytes) 000004 1779698827.417089 read 0x03e754 thru 0x03fc24 (0x14d1 bytes) 000005 1779698827.418585 write 0x02e700 thru 0x03c20f (0xdb10 bytes) fallocating to largest ever: 0x3bbad 000006 1779698827.434415 fallocate 0x03811a thru 0x03bbac (0x3a93 bytes) 000007 1779698827.442592 punch from 0x0143bc to 0x0161f7 (0x1e3c bytes) 000008 1779698827.450990 mapread 0x0298dd thru 0x030ee2 (0x7606 bytes) 000009 1779698827.464394 punch from 0x039e64 to 0x03ffff (0x619c bytes) 000010 1779698827.487263 trunc from 0x007385 to 0x014517 (0xd193 bytes) 000011 1779698827.493739 fallocate 0x00f2ec thru 0x0117b3 (0x24c8 bytes) 000012 1779698827.502646 fallocate 0x01ae2c thru 0x01ccb7 (0x1e8c bytes) 000013 1779698827.509619 fallocate 0x0070c2 thru 0x00b967 (0x48a6 bytes) 000014 1779698827.515465 write 0x002655 thru 0x00ea19 (0xc3c5 bytes) 000015 1779698827.534540 mapread 0x0231eb thru 0x0247b6 (0x15cc bytes) 000016 1779698827.536498 fallocate 0x001d95 thru 0x011812 (0xfa7e bytes) 000018 1779698827.557787 MIRROR_EXTEND to 2 mirrors fallocating to largest ever: 0x3c9c8 000019 1779698828.581046 fallocate 0x038dba thru 0x03c9c7 (0x3c0e bytes) 000020 1779698828.629381 write 0x000bbc thru 0x00810d (0x7552 bytes) 000021 1779698828.647539 punch from 0x015060 to 0x01edaa (0x9d4b bytes) 000022 1779698828.655104 read 0x017fce thru 0x0228f7 (0xa92a bytes) 000023 1779698828.670380 fallocate 0x033324 thru 0x03491f (0x15fc bytes) 000024 1779698828.676910 trunc from 0x01a6ef to 0x01e580 (0x3e92 bytes) 000025 1779698828.684669 write 0x007c3f thru 0x00d404 (0x57c6 bytes) 000026 1779698828.692736 mapwrite 0x03c21e thru 0x03ffff (0x3de2 bytes) 000028 1779698828.753703 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x157:0x0]: Invalid argument (22) 000029 1779698829.055356 fallocate 0x017347 thru 0x01b5d5 (0x428f bytes) 000030 1779698829.071610 MIRROR_EXTEND to 2 mirrors 000031 1779698830.368661 trunc from 0x006d3b to 0x0122a2 (0xb568 bytes) 000032 1779698830.429599 trunc from 0x000eac to 0x00426c (0x33c1 bytes) 000033 1779698830.435255 mapwrite 0x002a96 thru 0x007b60 (0x50cb bytes) 000034 1779698830.512098 punch from 0x008221 to 0x00e1e0 (0x5fc0 bytes) 000035 1779698830.517029 read 0x02cd82 thru 0x037c49 (0xaec8 bytes) 000036 1779698830.537318 read 0x03eb05 thru 0x03ffff (0x14fb bytes) 000037 1779698830.551102 mapread 0x0277ff thru 0x0316a9 (0x9eab bytes) 000038 1779698830.553686 punch from 0x0185f7 to 0x0204e9 (0x7ef3 bytes) 000039 1779698830.560913 write 0x02d1c2 thru 0x03b774 (0xe5b3 bytes) 000040 1779698830.579875 read 0x02a464 thru 0x02ae89 (0xa26 bytes) 000043 1779698830.594747 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe413face (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x587bc8b2 Mirror 3: 0x587bc8b2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000044 1779698832.002408 write 0x019225 thru 0x020e89 (0x7c65 bytes) 000046 1779698832.092662 mapread 0x022180 thru 0x024590 (0x2411 bytes) 000047 1779698832.106814 write 0x0108f2 thru 0x01b48b (0xab9a bytes) 000048 1779698832.132385 trunc from 0x01b06a to 0x0261a8 (0xb13f bytes) 000049 1779698832.147887 punch from 0x0117a4 to 0x015895 (0x40f2 bytes) truncating to largest ever: 0x3dd6c 000050 1779698832.154589 trunc from 0x040000 to 0x03dd6b (0x2294 bytes) 000052 1779698832.175872 fallocate 0x01e5f6 thru 0x022faa (0x49b5 bytes) 000053 1779698832.181868 fallocate 0x002a8a thru 0x00eb3f (0xc0b6 bytes) 000054 1779698832.188002 trunc from 0x01c44f to 0x024fee (0x8ba0 bytes) 000055 1779698832.202539 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3dd6c): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd6c): Mirror 2: 0xfd88d362 (stale) Mirror 3: 0xcc4d816a (stale) CRC-32 checksum value for chunk [0, 0x3dd6c): Mirror 1: 0xfb318c2a Mirror 4: 0xfb318c2a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd6c: skipped 000056 1779698833.763281 mapread 0x014f0b thru 0x020e9f (0xbf95 bytes) 000057 1779698833.844839 mapwrite 0x0324b3 thru 0x0338c7 (0x1415 bytes) fallocating to largest ever: 0x3edfc 000058 1779698834.023494 fallocate 0x038761 thru 0x03edfb (0x669b bytes) 000059 1779698834.030897 write 0x022c6c thru 0x02f825 (0xcbba bytes) 000060 1779698834.084261 punch from 0x02c75e to 0x02cdec (0x68f bytes) 000061 1779698834.141122 mapwrite 0x00171c thru 0x004524 (0x2e09 bytes) 000062 1779698834.197116 read 0x0239bb thru 0x0276f3 (0x3d39 bytes) 000063 1779698834.200511 mapwrite 0x02aa8b thru 0x02d2f5 (0x286b bytes) 000064 1779698834.228589 read 0x03c7c3 thru 0x03dd6b (0x15a9 bytes) 000065 1779698834.245715 trunc from 0x010965 to 0x01e193 (0xd82f bytes) 000066 1779698834.256715 write 0x004abe thru 0x0131bc (0xe6ff bytes) 000067 1779698834.264637 fallocate 0x000021 thru 0x0036e4 (0x36c4 bytes) 000070 1779698834.276446 mapread 0x007a77 thru 0x00abc7 (0x3151 bytes) 000071 1779698834.278296 mapread 0x019534 thru 0x02664b (0xd118 bytes) 000072 1779698834.326482 read 0x02cf62 thru 0x030a68 (0x3b07 bytes) 000073 1779698834.327419 mapwrite 0x02c7d2 thru 0x02f096 (0x28c5 bytes) 000074 1779698834.354420 mapwrite 0x008618 thru 0x012ba8 (0xa591 bytes) 000075 1779698834.378880 write 0x029e4c thru 0x033d6e (0x9f23 bytes) 000076 1779698834.380678 mapread 0x023f31 thru 0x02d524 (0x95f4 bytes) 000077 1779698834.382524 write 0x028200 thru 0x036cb6 (0xeab7 bytes) 000078 1779698834.384528 trunc from 0x03dd6c to 0x01cd18 (0x21053 bytes) 000079 1779698834.404912 mapread 0x0169d2 thru 0x01c539 (0x5b68 bytes) 000080 1779698834.414689 read 0x00f012 thru 0x01c5cc (0xd5bb bytes) 000081 1779698834.416488 mapread 0x0031b3 thru 0x00ba22 (0x8870 bytes) 000082 1779698834.417969 trunc from 0x01cd19 to 0x0342c4 (0x175ac bytes) 000083 1779698834.450580 mapread 0x00c41a thru 0x012197 (0x5d7e bytes) 000084 1779698834.455078 fallocate 0x017f8a thru 0x01ec46 (0x6cbd bytes) 000085 1779698834.464497 mapwrite 0x003ad4 thru 0x013721 (0xfc4e bytes) 000086 1779698834.542509 write 0x00ad71 thru 0x016e7d (0xc10d bytes) 000087 1779698834.558665 trunc from 0x0342c5 to 0x01389d (0x20a27 bytes) 000088 1779698834.602744 mapwrite 0x01ccf7 thru 0x026f7b (0xa285 bytes) 000089 1779698834.700241 read 0x010dd3 thru 0x0193bc (0x85ea bytes) 000090 1779698834.700971 write 0x00a0f5 thru 0x016e93 (0xcd9f bytes) 000091 1779698834.702410 punch from 0x003a38 to 0x00d16a (0x9733 bytes) 000092 1779698834.739050 trunc from 0x005754 to 0x00fff7 (0xa8a4 bytes) 000093 1779698834.747843 trunc from 0x00d515 to 0x012698 (0x5184 bytes) 000094 1779698834.765633 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26f7c): Mirror 2: 0x3df31294 (stale) Mirror 4: 0x412e0557 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26f7c): Mirror 2: 0x3df31294 (stale) Mirror 4: 0x412e0557 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26f7c: skipped 000095 1779698835.144437 trunc from 0x00a634 to 0x013814 (0x91e1 bytes) 000096 1779698835.150116 fallocate 0x0044e5 thru 0x00a938 (0x6454 bytes) 000097 1779698835.156538 mapread 0x01abac thru 0x02002b (0x5480 bytes) 000098 1779698835.209887 mapwrite 0x00a7ac thru 0x00b4f9 (0xd4e bytes) 000099 1779698835.245874 trunc from 0x026f7c to 0x019589 (0xd9f2 bytes) 000100 1779698835.279939 fallocate 0x011b92 thru 0x012cf4 (0x1163 bytes) 000101 1779698835.286714 punch from 0x017010 to 0x019589 (0x257a bytes) 000102 1779698835.293238 fallocate 0x01ef4a thru 0x02e8b4 (0xf96b bytes) 000103 1779698835.299732 write 0x02d832 thru 0x031fcb (0x479a bytes) 000104 1779698835.302514 mapread 0x01e566 thru 0x0263f2 (0x7e8d bytes) 000105 1779698835.317952 punch from 0x029b26 to 0x030b16 (0x6ff1 bytes) 000107 1779698835.342630 fallocate 0x00ce84 thru 0x012324 (0x54a1 bytes) 000108 1779698835.350066 read 0x018496 thru 0x01f699 (0x7204 bytes) 000109 1779698835.351446 punch from 0x0309fd to 0x031fcb (0x15cf bytes) 000111 1779698835.358118 read 0x02ffdf thru 0x0311c7 (0x11e9 bytes) 000112 1779698835.372877 read 0x009fc7 thru 0x014e63 (0xae9d bytes) 000113 1779698835.373628 punch from 0x02f93f to 0x031b1a (0x21dc bytes) 000115 1779698835.382866 trunc from 0x031fcc to 0x006cd6 (0x2b2f5 bytes) 000116 1779698835.406476 read 0x002f99 thru 0x006cd6 (0x3d3e bytes) 000117 1779698835.407638 punch from 0x00148d to 0x004a1f (0x3593 bytes) 000118 1779698835.414318 mapwrite 0x02aa8d thru 0x031f27 (0x749b bytes) 000119 1779698835.490089 trunc from 0x008e09 to 0x01088c (0x7a84 bytes) 000120 1779698835.505633 trunc from 0x031f28 to 0x0048d9 (0x2d64e bytes) 000121 1779698835.562006 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x48da): Mirror 4: 0x341d8815 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x48da): Mirror 4: 0x341d8815 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x48da: skipped 000122 1779698835.821123 trunc from 0x0048da to 0x03a892 (0x35fb9 bytes) 000123 1779698835.834868 punch from 0x03560a to 0x03583b (0x232 bytes) 000124 1779698835.841468 write 0x01718a thru 0x018e9f (0x1d16 bytes) 000126 1779698835.856048 trunc from 0x03a893 to 0x031905 (0x8f8d bytes) 000128 1779698835.897222 trunc from 0x031906 to 0x02ad22 (0x6be3 bytes) 000129 1779698835.926391 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x157:0x0]: Invalid argument (22) 000130 1779698836.116431 trunc from 0x018326 to 0x022bfe (0xa8d9 bytes) 000131 1779698836.125413 mapread 0x005b6d thru 0x006150 (0x5e4 bytes) 000132 1779698836.135629 mapwrite 0x036404 thru 0x03a282 (0x3e7f bytes) 000133 1779698836.175465 read 0x003cd6 thru 0x00cb9f (0x8eca bytes) 000135 1779698836.189088 read 0x01408e thru 0x01e47e (0xa3f1 bytes) 000136 1779698836.210997 punch from 0x037552 to 0x037f82 (0xa31 bytes) 000137 1779698836.220913 trunc from 0x03a283 to 0x015829 (0x24a59 bytes) 000138 1779698836.240462 write 0x00d691 thru 0x01aa24 (0xd394 bytes) 000139 1779698836.244083 trunc from 0x008bb4 to 0x011843 (0x8c90 bytes) 000140 1779698836.261606 mapwrite 0x02107d thru 0x029945 (0x88c9 bytes) 000142 1779698836.354543 read 0x020ef6 thru 0x029945 (0x8a50 bytes) 000143 1779698836.376639 trunc from 0x000057 to 0x001ab1 (0x1a5b bytes) 000144 1779698836.384936 punch from 0x0162ed to 0x020795 (0xa4a9 bytes) 000146 1779698836.392485 mapwrite 0x006b49 thru 0x0136f7 (0xcbaf bytes) 000147 1779698836.423426 punch from 0x018533 to 0x024df3 (0xc8c1 bytes) 000148 1779698836.432138 write 0x01d768 thru 0x01f5ea (0x1e83 bytes) 000149 1779698836.447643 punch from 0x00fa83 to 0x01ae5f (0xb3dd bytes) 000151 1779698836.456902 trunc from 0x029946 to 0x03d794 (0x13e4f bytes) 000152 1779698836.478455 write 0x00cccc thru 0x012a75 (0x5daa bytes) 000153 1779698836.497436 read 0x03c07a thru 0x03d794 (0x171b bytes) 000154 1779698836.499051 trunc from 0x03d795 to 0x03980e (0x3f86 bytes) 000155 1779698836.537644 MIRROR_EXTEND to 2 mirrors 000156 1779698837.658127 trunc from 0x018c07 to 0x01a0f9 (0x14f3 bytes) 000157 1779698837.699751 punch from 0x015c01 to 0x0236d5 (0xdad5 bytes) 000158 1779698837.713093 MIRROR_RESYNC 2 mirrors 000159 1779698838.540008 mapwrite 0x00db7a thru 0x019245 (0xb6cc bytes) 000160 1779698838.630312 read 0x01d356 thru 0x02376d (0x6418 bytes) 000161 1779698838.639997 trunc from 0x03980f to 0x00173a (0x380d4 bytes) 000162 1779698838.668568 mapwrite 0x0296e7 thru 0x036d52 (0xd66c bytes) 000163 1779698838.749727 mapread 0x00878b thru 0x00a788 (0x1ffe bytes) 000164 1779698838.762696 mapwrite 0x023da3 thru 0x026eb6 (0x3114 bytes) 000165 1779698838.788461 write 0x014998 thru 0x021b8d (0xd1f6 bytes) 000166 1779698838.810397 fallocate 0x02e7a2 thru 0x0389bd (0xa21c bytes) 000167 1779698838.816877 mapwrite 0x015777 thru 0x0161ea (0xa74 bytes) 000168 1779698838.837316 write 0x0170ba thru 0x024a26 (0xd96d bytes) 000169 1779698838.840085 trunc from 0x01782e to 0x01cac0 (0x5293 bytes) 000170 1779698838.857825 trunc from 0x01b515 to 0x01cc95 (0x1781 bytes) 000171 1779698838.868002 read 0x013f47 thru 0x02041e (0xc4d8 bytes) 000172 1779698838.877220 trunc from 0x01222a to 0x018c89 (0x6a60 bytes) 000173 1779698838.882313 trunc from 0x00d492 to 0x00f801 (0x2370 bytes) 000174 1779698838.890397 mapread 0x01d3d0 thru 0x026396 (0x8fc7 bytes) 000175 1779698838.898027 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x157:0x0]: Invalid argument (22) 000177 1779698839.053907 MIRROR_EXTEND to 2 mirrors 000178 1779698839.935682 fallocate 0x0286a4 thru 0x029756 (0x10b3 bytes) 000179 1779698839.976302 write 0x017150 thru 0x0255a4 (0xe455 bytes) 000180 1779698840.004381 trunc from 0x036d53 to 0x033f4b (0x2e07 bytes) 000181 1779698840.069843 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x33f4c): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33f4c): Mirror 2: 0x8bc1271f (stale) CRC-32 checksum value for chunk [0, 0x33f4c): Mirror 1: 0xf0bce9ed Mirror 3: 0xf0bce9ed lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33f4c: skipped 000182 1779698841.246406 read 0x014ec4 thru 0x019d78 (0x4eb5 bytes) 000183 1779698841.271992 trunc from 0x033f4c to 0x01c55c (0x179ef bytes) 000184 1779698841.398587 trunc from 0x01c55d to 0x0125f9 (0x9f63 bytes) 000185 1779698841.457479 trunc from 0x0061fc to 0x00d2f2 (0x70f7 bytes) 000186 1779698841.466897 trunc from 0x0061de to 0x006326 (0x149 bytes) 000187 1779698841.483363 trunc from 0x000cc2 to 0x0048c5 (0x3c04 bytes) 000188 1779698841.511537 mapread 0x00081a thru 0x00a420 (0x9c07 bytes) 000189 1779698841.575342 punch from 0x00abd8 to 0x00d86b (0x2c94 bytes) 000190 1779698841.581446 mapread 0x00b7b9 thru 0x0109b5 (0x51fd bytes) 000191 1779698841.603668 mapread 0x005904 thru 0x00e310 (0x8a0d bytes) 000192 1779698841.604820 mapwrite 0x037b15 thru 0x03ffff (0x84eb bytes) 000193 1779698841.671464 MIRROR_RESYNC 3 mirrors 000194 1779698842.476692 mapread 0x01ea8e thru 0x0206eb (0x1c5e bytes) 000195 1779698842.504825 fallocate 0x02a1d2 thru 0x03167b (0x74aa bytes) 000196 1779698842.546154 write 0x03c857 thru 0x03ffff (0x37a9 bytes) 000197 1779698842.564617 trunc from 0x040000 to 0x037b26 (0x84d9 bytes) 000198 1779698842.593496 mapread 0x005982 thru 0x012338 (0xc9b7 bytes) 000199 1779698842.627786 read 0x027ec2 thru 0x037b26 (0xfc65 bytes) 000200 1779698842.654657 fallocate 0x018cc2 thru 0x024dee (0xc12d bytes) 000201 1779698842.669481 read 0x017a9c thru 0x01e507 (0x6a6c bytes) 000202 1779698842.696870 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37b27): Mirror 2: 0xf3c2edeb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37b27): Mirror 2: 0xf3c2edeb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37b27: skipped 000203 1779698843.054894 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x37b27): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37b27): Mirror 2: 0xf3c2edeb (stale) CRC-32 checksum value for chunk [0, 0x37b27): Mirror 1: 0xf3c2edeb Mirror 3: 0xf3c2edeb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37b27: skipped 000204 1779698844.147403 trunc from 0x014e75 to 0x01b28d (0x6419 bytes) 000205 1779698844.207067 trunc from 0x033121 to 0x037b26 (0x4a06 bytes) 000206 1779698844.236870 trunc from 0x02c426 to 0x02e9db (0x25b6 bytes) 000209 1779698844.256519 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x37b27): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37b27): Mirror 2: 0xf3c2edeb (stale) Mirror 3: 0xf3c2edeb (stale) CRC-32 checksum value for chunk [0, 0x37b27): Mirror 1: 0x5f86a191 Mirror 4: 0x5f86a191 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37b27: skipped 000210 1779698845.892597 mapwrite 0x030716 thru 0x037057 (0x6942 bytes) 000211 1779698846.202666 trunc from 0x012979 to 0x01bc70 (0x92f8 bytes) 000212 1779698846.218475 mapwrite 0x039d0a thru 0x03d39f (0x3696 bytes) 000213 1779698846.407564 trunc from 0x019992 to 0x027c11 (0xe280 bytes) 000214 1779698846.429785 mapread 0x01e300 thru 0x0211d6 (0x2ed7 bytes) 000215 1779698846.453736 trunc from 0x03d3a0 to 0x03da25 (0x686 bytes) 000217 1779698846.486365 write 0x01be72 thru 0x02a46b (0xe5fa bytes) 000218 1779698846.491281 write 0x0221e1 thru 0x026ab0 (0x48d0 bytes) 000219 1779698846.503062 write 0x0364db thru 0x03bac5 (0x55eb bytes) 000220 1779698846.505509 trunc from 0x03da26 to 0x03a1a1 (0x3884 bytes) 000221 1779698846.554995 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a1a2): Mirror 3: 0xe69bd995 (stale) Mirror 4: 0x68ab7c13 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a1a2): Mirror 3: 0xe69bd995 (stale) Mirror 4: 0x68ab7c13 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a1a2: skipped 000223 1779698847.188432 punch from 0x01113f to 0x01a2db (0x919d bytes) 000224 1779698847.194506 trunc from 0x03a1a2 to 0x03504c (0x5155 bytes) 000225 1779698847.220366 trunc from 0x0168b4 to 0x023ac2 (0xd20f bytes) 000226 1779698847.228596 fallocate 0x008bcd thru 0x018639 (0xfa6d bytes) 000227 1779698847.236600 mapread 0x0144f9 thru 0x01f4c8 (0xafd0 bytes) 000228 1779698847.276438 mapread 0x00be53 thru 0x016ec4 (0xb072 bytes) 000229 1779698847.297392 mapread 0x02fe1a thru 0x032531 (0x2718 bytes) 000230 1779698847.320452 write 0x028290 thru 0x028cdb (0xa4c bytes) 000231 1779698847.324644 trunc from 0x03504d to 0x023810 (0x1183c bytes) 000232 1779698847.372837 mapread 0x01d778 thru 0x021031 (0x38ba bytes) 000234 1779698847.382238 MIRROR_RESYNC 3 mirrors 000235 1779698848.332953 fallocate 0x026f0a thru 0x0337a2 (0xc899 bytes) 000237 1779698848.397432 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23811): Mirror 3: 0xc1d11db (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23811): Mirror 3: 0xc1d11db (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23811: skipped 000238 1779698848.910977 punch from 0x007cf7 to 0x013fbc (0xc2c6 bytes) 000239 1779698848.919637 write 0x014c6f thru 0x0181a9 (0x353b bytes) 000240 1779698848.957540 write 0x01fe89 thru 0x0230dc (0x3254 bytes) 000241 1779698848.977339 trunc from 0x023811 to 0x01a06e (0x97a2 bytes) 000242 1779698849.051416 trunc from 0x00645b to 0x011d23 (0xb8c9 bytes) 000243 1779698849.056622 trunc from 0x01539b to 0x01a06e (0x4cd4 bytes) 000244 1779698849.076913 read 0x00c5a3 thru 0x01a06e (0xdacc bytes) 000245 1779698849.094924 mapwrite 0x00cf55 thru 0x01c81b (0xf8c7 bytes) 000246 1779698849.190412 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x157:0x0]: Invalid argument (22) 000247 1779698849.503120 fallocate 0x0242dc thru 0x0324a6 (0xe1cb bytes) 000248 1779698849.512566 mapwrite 0x005255 thru 0x008ecb (0x3c77 bytes) 000250 1779698849.595396 mapread 0x007125 thru 0x00cf19 (0x5df5 bytes) 000251 1779698849.599804 mapwrite 0x032278 thru 0x035363 (0x30ec bytes) 000252 1779698849.713081 trunc from 0x035364 to 0x03758e (0x222b bytes) 000253 1779698849.733645 mapread 0x026c9b thru 0x02e954 (0x7cba bytes) 000255 1779698849.759390 read 0x02be55 thru 0x031cef (0x5e9b bytes) 000256 1779698849.760951 mapwrite 0x017d0d thru 0x019730 (0x1a24 bytes) 000257 1779698849.795070 trunc from 0x03758f to 0x014fba (0x225d4 bytes) 000258 1779698849.824354 punch from 0x00073d to 0x00a920 (0xa1e4 bytes) 000262 1779698849.838987 read 0x0029f2 thru 0x00e321 (0xb930 bytes) 000263 1779698849.862257 mapwrite 0x031053 thru 0x037667 (0x6615 bytes) 000264 1779698849.926239 trunc from 0x030a5a to 0x033430 (0x29d7 bytes) 000265 1779698849.938470 punch from 0x01e08a to 0x024129 (0x60a0 bytes) 000268 1779698849.954908 read 0x010b5c thru 0x01da8a (0xcf2f bytes) 000269 1779698849.955680 trunc from 0x01b9b9 to 0x01c803 (0xe4b bytes) 000270 1779698849.985990 trunc from 0x0299d5 to 0x02d065 (0x3691 bytes) 000272 1779698850.000964 write 0x02c7e4 thru 0x0349c0 (0x81dd bytes) 000273 1779698850.018373 read 0x0262b4 thru 0x02c425 (0x6172 bytes) 000274 1779698850.019338 mapread 0x00e4df thru 0x015d65 (0x7887 bytes) 000275 1779698850.024840 trunc from 0x01eab0 to 0x02bf96 (0xd4e7 bytes) 000277 1779698850.031479 read 0x00bf12 thru 0x014278 (0x8367 bytes) 000278 1779698850.032217 fallocate 0x00eadf thru 0x01603f (0x7561 bytes) 000279 1779698850.044315 write 0x01a2c6 thru 0x0275af (0xd2ea bytes) 000281 1779698850.068248 trunc from 0x037668 to 0x03c95e (0x52f7 bytes) 000282 1779698850.087749 mapwrite 0x01d180 thru 0x029d73 (0xcbf4 bytes) 000283 1779698850.135764 fallocate 0x03620a thru 0x0398b5 (0x36ac bytes) 000284 1779698850.143043 trunc from 0x03c95f to 0x00fb04 (0x2ce5a bytes) fallocating to largest ever: 0x40000 000286 1779698850.163708 fallocate 0x0386ec thru 0x03ffff (0x7914 bytes) 000287 1779698850.171507 fallocate 0x005db3 thru 0x00f92a (0x9b78 bytes) 000288 1779698850.182966 write 0x01a03a thru 0x0289b8 (0xe97f bytes) 000289 1779698850.186963 mapwrite 0x02106f thru 0x02d732 (0xc6c4 bytes) 000290 1779698850.315399 punch from 0x00be56 to 0x017b07 (0xbcb2 bytes) 000291 1779698850.326571 fallocate 0x0013ff thru 0x005e53 (0x4a55 bytes) 000292 1779698850.349475 trunc from 0x02d733 to 0x03e566 (0x10e34 bytes) 000293 1779698850.389387 write 0x02879b thru 0x033321 (0xab87 bytes) 000294 1779698850.411839 punch from 0x035013 to 0x038c63 (0x3c51 bytes) 000295 1779698850.419068 mapwrite 0x00ce2a thru 0x00e345 (0x151c bytes) 000296 1779698850.477576 trunc from 0x011689 to 0x0143b6 (0x2d2e bytes) 000298 1779698850.495352 mapwrite 0x0098fe thru 0x019630 (0xfd33 bytes) 000299 1779698850.643588 mapwrite 0x020051 thru 0x0245e3 (0x4593 bytes) 000300 1779698850.673278 trunc from 0x03e567 to 0x03ff4e (0x19e8 bytes) 000301 1779698850.701717 read 0x001546 thru 0x008636 (0x70f1 bytes) 000302 1779698850.706761 trunc from 0x03ff4f to 0x02e52e (0x11a20 bytes) 000304 1779698850.727232 punch from 0x00738b to 0x011250 (0x9ec6 bytes) 000305 1779698850.736211 trunc from 0x02e52f to 0x0016ad (0x2ce81 bytes) 000309 1779698850.787158 mapread 0x001685 thru 0x0016ad (0x29 bytes) 000310 1779698850.789100 write 0x01609c thru 0x01b12a (0x508f bytes) 000311 1779698850.791334 write 0x02935a thru 0x02d314 (0x3fbb bytes) 000312 1779698850.792546 mapread 0x006293 thru 0x00f499 (0x9207 bytes) 000313 1779698850.811805 punch from 0x0074d2 to 0x00c62a (0x5159 bytes) 000315 1779698850.832483 trunc from 0x02d315 to 0x03180e (0x44fa bytes) 000316 1779698850.870841 mapwrite 0x03adec thru 0x03ffff (0x5214 bytes) 000318 1779698850.914992 fallocate 0x0390ea thru 0x03ffff (0x6f16 bytes) 000319 1779698850.919036 write 0x003bff thru 0x003df2 (0x1f4 bytes) 000320 1779698850.919997 read 0x00ddde thru 0x012f9d (0x51c0 bytes) 000321 1779698850.920761 write 0x001d1d thru 0x00e586 (0xc86a bytes) 000322 1779698850.922070 write 0x00cd43 thru 0x01b79d (0xea5b bytes) 000323 1779698850.923599 punch from 0x003fad to 0x00e2e3 (0xa337 bytes) 000324 1779698850.934055 punch from 0x022526 to 0x031628 (0xf103 bytes) 000325 1779698850.937670 read 0x00818a thru 0x010670 (0x84e7 bytes) 000326 1779698850.944131 mapwrite 0x01d600 thru 0x0203b1 (0x2db2 bytes) 000327 1779698850.965436 fallocate 0x0110ad thru 0x01a4fb (0x944f bytes) 000328 1779698850.970501 fallocate 0x02da8b thru 0x03847b (0xa9f1 bytes) 000329 1779698850.975490 mapread 0x030b07 thru 0x0341e9 (0x36e3 bytes) 000331 1779698850.976845 trunc from 0x040000 to 0x01ab6a (0x25495 bytes) 000332 1779698850.991918 mapwrite 0x018d17 thru 0x01bbb0 (0x2e9a bytes) 000333 1779698851.028101 write 0x0389b4 thru 0x03f291 (0x68de bytes) 000334 1779698851.029635 read 0x0175a6 thru 0x0196a2 (0x20fd bytes) 000335 1779698851.031302 trunc from 0x03f292 to 0x014626 (0x2ac6b bytes) 000336 1779698851.045041 mapwrite 0x034fe4 thru 0x03cf6d (0x7f8a bytes) 000337 1779698851.144009 mapread 0x00f301 thru 0x01abba (0xb8ba bytes) 000338 1779698851.159932 mapwrite 0x0382d8 thru 0x03f30b (0x7034 bytes) 000339 1779698851.245429 read 0x0318f4 thru 0x03f30b (0xda18 bytes) 000340 1779698851.249413 punch from 0x004e2b to 0x0056f6 (0x8cc bytes) 000341 1779698851.258381 mapwrite 0x03292a thru 0x032a4e (0x125 bytes) 000342 1779698851.289565 mapread 0x000b26 thru 0x00ece1 (0xe1bc bytes) 000343 1779698851.306933 trunc from 0x03f30c to 0x016888 (0x28a83 bytes) 000344 1779698851.329721 fallocate 0x016c2c thru 0x02062c (0x9a01 bytes) 000345 1779698851.336445 mapwrite 0x01866e thru 0x026808 (0xe19b bytes) 000346 1779698851.486125 write 0x024934 thru 0x027923 (0x2ff0 bytes) 000347 1779698851.487510 trunc from 0x027924 to 0x02790f (0x14 bytes) 000348 1779698851.541887 punch from 0x005196 to 0x00ce70 (0x7cdb bytes) 000349 1779698851.549038 mapwrite 0x01fddd thru 0x0224e0 (0x2704 bytes) 000351 1779698851.584695 mapread 0x0262fd thru 0x027481 (0x1185 bytes) 000352 1779698851.585637 punch from 0x014b5b to 0x023df2 (0xf298 bytes) 000353 1779698851.592403 write 0x001e79 thru 0x0092ac (0x7434 bytes) 000355 1779698851.602601 mapread 0x007eeb thru 0x0096f8 (0x180e bytes) 000356 1779698851.603925 mapread 0x02042e thru 0x021628 (0x11fb bytes) 000357 1779698851.623071 read 0x002d5b thru 0x010bf6 (0xde9c bytes) 000358 1779698851.660574 punch from 0x011f76 to 0x017d13 (0x5d9e bytes) 000359 1779698851.694925 trunc from 0x027910 to 0x01a08a (0xd885 bytes) 000360 1779698851.748652 read 0x007946 thru 0x00d9a9 (0x6064 bytes) 000361 1779698851.755589 mapread 0x007a62 thru 0x01037c (0x891b bytes) 000362 1779698851.757225 read 0x015fa3 thru 0x01a08a (0x40e8 bytes) 000363 1779698851.814491 write 0x01691e thru 0x022e0a (0xc4ed bytes) 000364 1779698851.816168 fallocate 0x019cd7 thru 0x01c5dc (0x2906 bytes) 000366 1779698851.839134 write 0x030553 thru 0x030ada (0x588 bytes) 000367 1779698851.840663 trunc from 0x00c785 to 0x01212e (0x59aa bytes) 000368 1779698851.848070 mapread 0x015f1b thru 0x019f13 (0x3ff9 bytes) 000369 1779698851.849724 read 0x029eda thru 0x030ada (0x6c01 bytes) 000370 1779698851.884961 write 0x02ff94 thru 0x031358 (0x13c5 bytes) 000371 1779698851.889559 trunc from 0x0027ba to 0x00e729 (0xbf70 bytes) 000372 1779698851.932432 write 0x034194 thru 0x03c6d4 (0x8541 bytes) 000373 1779698851.947160 trunc from 0x03c6d5 to 0x03667c (0x6058 bytes) 000374 1779698852.020507 trunc from 0x03603c to 0x03667c (0x641 bytes) 000375 1779698852.044071 read 0x013c36 thru 0x017be3 (0x3fae bytes) 000378 1779698852.054944 fallocate 0x02e9dc thru 0x031e7a (0x349f bytes) 000379 1779698852.074261 mapwrite 0x027dcd thru 0x02a7ae (0x29e2 bytes) 000380 1779698852.167285 MIRROR_EXTEND to 2 mirrors 000381 1779698853.047874 fallocate 0x02f206 thru 0x03219a (0x2f95 bytes) 000382 1779698853.124421 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x157:0x0]: Invalid argument (22) 000383 1779698853.249115 write 0x02ff51 thru 0x0377b5 (0x7865 bytes) 000385 1779698853.263933 mapread 0x033ffa thru 0x0377b5 (0x37bc bytes) 000386 1779698853.265441 trunc from 0x0377b6 to 0x03845a (0xca5 bytes) 000387 1779698853.303109 read 0x002f58 thru 0x009632 (0x66db bytes) 000388 1779698853.321510 mapwrite 0x00fc14 thru 0x01093d (0xd2a bytes) 000390 1779698853.367022 punch from 0x00a8c6 to 0x0167c9 (0xbf04 bytes) 000391 1779698853.379513 punch from 0x026b5b to 0x02b83c (0x4ce2 bytes) 000392 1779698853.394065 punch from 0x02b1fa to 0x03497b (0x9782 bytes) 000393 1779698853.411587 mapread 0x014f94 thru 0x0237c0 (0xe82d bytes) 000394 1779698853.452538 fallocate 0x036937 thru 0x03fd5f (0x9429 bytes) 000395 1779698853.461400 trunc from 0x02e70b to 0x03845a (0x9d50 bytes) 000396 1779698853.470294 mapread 0x017d91 thru 0x0227a8 (0xaa18 bytes) 000399 1779698853.472461 read 0x01ba4d thru 0x024f37 (0x94eb bytes) 000400 1779698853.476227 fallocate 0x02034c thru 0x02fae0 (0xf795 bytes) 000401 1779698853.487336 mapwrite 0x020cba thru 0x02c4c5 (0xb80c bytes) 000403 1779698853.552159 fallocate 0x01cdb3 thru 0x028550 (0xb79e bytes) 000404 1779698853.562560 write 0x03f89d thru 0x03ffff (0x763 bytes) 000405 1779698853.566785 read 0x008ad2 thru 0x01351c (0xaa4b bytes) 000406 1779698853.569508 write 0x012992 thru 0x017544 (0x4bb3 bytes) 000407 1779698853.572456 write 0x0148f7 thru 0x01b3a8 (0x6ab2 bytes) 000409 1779698853.576328 read 0x009339 thru 0x017cb3 (0xe97b bytes) 000410 1779698853.577687 trunc from 0x03e92f to 0x03ffff (0x16d1 bytes) 000411 1779698853.609321 fallocate 0x01fbc9 thru 0x028910 (0x8d48 bytes) 000412 1779698853.616821 read 0x010c94 thru 0x01f33b (0xe6a8 bytes) 000413 1779698853.617878 trunc from 0x040000 to 0x01c4da (0x23b25 bytes) 000415 1779698853.647045 read 0x009e1f thru 0x010c8b (0x6e6d bytes) 000416 1779698853.647698 mapwrite 0x0114a1 thru 0x0156b4 (0x4214 bytes) 000417 1779698853.681680 mapread 0x015ff4 thru 0x01728a (0x1297 bytes) 000418 1779698853.683442 mapread 0x0131a4 thru 0x016fb4 (0x3e11 bytes) 000419 1779698853.687114 write 0x01b64e thru 0x025fd9 (0xa98c bytes) 000421 1779698853.694002 read 0x01f5b7 thru 0x025fd9 (0x6a23 bytes) 000422 1779698853.695290 read 0x01ed69 thru 0x023fed (0x5285 bytes) 000423 1779698853.702123 read 0x0124c9 thru 0x01ceea (0xaa22 bytes) 000424 1779698853.702989 trunc from 0x025fda to 0x01a95a (0xb67f bytes) 000425 1779698853.766454 mapwrite 0x02f919 thru 0x032ef0 (0x35d8 bytes) 000426 1779698853.854711 mapread 0x0039dd thru 0x01119b (0xd7bf bytes) 000429 1779698853.857072 punch from 0x029973 to 0x032ef0 (0x957e bytes) 000430 1779698853.885360 punch from 0x02b362 to 0x032ef0 (0x7b8f bytes) 000431 1779698853.894358 punch from 0x0247f1 to 0x032584 (0xdd94 bytes) 000433 1779698853.916248 trunc from 0x032ef1 to 0x03880d (0x591d bytes) 000434 1779698853.968543 trunc from 0x018d7c to 0x01d6be (0x4943 bytes) 000435 1779698853.974219 mapread 0x036a96 thru 0x03880d (0x1d78 bytes) 000436 1779698853.988398 punch from 0x024d7b to 0x032894 (0xdb1a bytes) 000437 1779698853.996757 read 0x02f54b thru 0x03880d (0x92c3 bytes) 000438 1779698854.023303 read 0x02fc96 thru 0x033c82 (0x3fed bytes) 000439 1779698854.027679 write 0x034e03 thru 0x03ffff (0xb1fd bytes) 000442 1779698854.078312 MIRROR_EXTEND to 2 mirrors 000443 1779698855.216295 write 0x008f2a thru 0x014be7 (0xbcbe bytes) 000444 1779698855.281297 trunc from 0x0253e3 to 0x0343d9 (0xeff7 bytes) 000445 1779698855.293970 write 0x01c8d5 thru 0x01ea78 (0x21a4 bytes) 000446 1779698855.310734 mapwrite 0x03f5c9 thru 0x03ffff (0xa37 bytes) 000447 1779698855.343103 punch from 0x025cdb to 0x02ef1a (0x9240 bytes) 000448 1779698855.347622 read 0x010599 thru 0x019f90 (0x99f8 bytes) 000449 1779698855.348774 read 0x03ee85 thru 0x03ffff (0x117b bytes) 000450 1779698855.349861 punch from 0x027b85 to 0x028b6f (0xfeb bytes) 000451 1779698855.354691 mapread 0x02f44d thru 0x03b473 (0xc027 bytes) 000452 1779698855.366408 fallocate 0x019a4b thru 0x021129 (0x76df bytes) 000454 1779698855.372525 write 0x02ba27 thru 0x02ea83 (0x305d bytes) 000455 1779698855.374309 trunc from 0x03abfb to 0x03ffff (0x5405 bytes) 000456 1779698855.379463 trunc from 0x00e244 to 0x015162 (0x6f1f bytes) 000457 1779698855.395453 MIRROR_RESYNC 2 mirrors 000458 1779698856.628039 punch from 0x03ebde to 0x03ffff (0x1422 bytes) 000459 1779698856.675439 trunc from 0x004d66 to 0x00d31d (0x85b8 bytes) 000460 1779698856.682368 trunc from 0x040000 to 0x02f5a7 (0x10a58 bytes) 000463 1779698856.738978 write 0x0211cf thru 0x02dd62 (0xcb94 bytes) 000464 1779698856.757927 punch from 0x0102fd to 0x0177fb (0x74ff bytes) 000465 1779698856.770455 trunc from 0x02f5a8 to 0x00eeda (0x206cd bytes) 000466 1779698856.812431 punch from 0x00ca29 to 0x00eeda (0x24b2 bytes) 000467 1779698856.837129 mapread 0x00aa59 thru 0x00bb34 (0x10dc bytes) 000468 1779698856.911460 mapwrite 0x007ae6 thru 0x014484 (0xc99f bytes) 000469 1779698857.015459 mapread 0x0105aa thru 0x014484 (0x3edb bytes) 000470 1779698857.016726 trunc from 0x014485 to 0x015f5d (0x1ad9 bytes) 000471 1779698857.052916 write 0x01ce25 thru 0x0228f6 (0x5ad2 bytes) 000472 1779698857.054486 fallocate 0x00273b thru 0x0033e2 (0xca8 bytes) 000473 1779698857.059621 punch from 0x00bccf to 0x015aee (0x9e20 bytes) 000474 1779698857.071462 read 0x0214e1 thru 0x0228f6 (0x1416 bytes) 000475 1779698857.072144 write 0x01a30b thru 0x022284 (0x7f7a bytes) 000476 1779698857.085924 read 0x01e657 thru 0x0228f6 (0x42a0 bytes) 000477 1779698857.087226 fallocate 0x00aa65 thru 0x00ded7 (0x3473 bytes) 000478 1779698857.097254 mapwrite 0x02bbf5 thru 0x032c9a (0x70a6 bytes) 000479 1779698857.180107 read 0x019745 thru 0x023658 (0x9f14 bytes) 000480 1779698857.181538 read 0x0175ac thru 0x01c1b3 (0x4c08 bytes) 000481 1779698857.184299 punch from 0x0329bf to 0x032c9a (0x2dc bytes) 000482 1779698857.191349 trunc from 0x0117c9 to 0x017f7d (0x67b5 bytes) 000483 1779698857.197167 trunc from 0x00f16f to 0x01a0dd (0xaf6f bytes) 000484 1779698857.204343 trunc from 0x032c9b to 0x00073a (0x32560 bytes) 000485 1779698857.225821 fallocate 0x007514 thru 0x00cec3 (0x59b0 bytes) 000487 1779698857.234370 trunc from 0x0057a6 to 0x00b237 (0x5a92 bytes) 000488 1779698857.239637 read 0x008807 thru 0x00b954 (0x314e bytes) 000489 1779698857.251566 write 0x03d531 thru 0x03ffff (0x2acf bytes) 000490 1779698857.253528 mapread 0x0187bb thru 0x02022b (0x7a71 bytes) 000491 1779698857.263510 mapread 0x0167d0 thru 0x01d17b (0x69ac bytes) 000492 1779698857.265532 read 0x006f48 thru 0x00c132 (0x51eb bytes) 000493 1779698857.266525 trunc from 0x03a980 to 0x03ffff (0x5680 bytes) 000494 1779698857.283106 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x426e88a0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe20eea22 Mirror 3: 0xe20eea22 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000496 1779698858.369698 trunc from 0x040000 to 0x028ed9 (0x17126 bytes) 000497 1779698858.466283 mapread 0x0005b6 thru 0x007ddb (0x7826 bytes) 000498 1779698858.495671 mapwrite 0x00e99b thru 0x01b8fd (0xcf63 bytes) 000499 1779698858.535157 punch from 0x004628 to 0x012fe4 (0xe9bd bytes) 000502 1779698858.545904 read 0x01774f thru 0x01e6fb (0x6fad bytes) 000503 1779698858.546834 mapwrite 0x006217 thru 0x008576 (0x2360 bytes) 000504 1779698858.577619 write 0x02d4a4 thru 0x031af1 (0x464e bytes) 000505 1779698858.578874 punch from 0x001e70 to 0x007612 (0x57a3 bytes) 000507 1779698858.587547 trunc from 0x016db7 to 0x0259c9 (0xec13 bytes) 000508 1779698858.594814 trunc from 0x031af2 to 0x03f5cb (0xdada bytes) 000509 1779698858.624656 mapwrite 0x019d73 thru 0x0260be (0xc34c bytes) 000510 1779698858.711309 fallocate 0x010307 thru 0x0164a0 (0x619a bytes) 000511 1779698858.726447 read 0x00ebe8 thru 0x01a853 (0xbc6c bytes) 000512 1779698858.769986 mapread 0x0024e1 thru 0x00bef1 (0x9a11 bytes) 000514 1779698858.773548 fallocate 0x015046 thru 0x01d824 (0x87df bytes) 000515 1779698858.783508 mapwrite 0x01967f thru 0x021282 (0x7c04 bytes) 000516 1779698858.817266 trunc from 0x018b0e to 0x01b49c (0x298f bytes) 000517 1779698858.827295 mapread 0x022b11 thru 0x025b6b (0x305b bytes) 000518 1779698858.833564 trunc from 0x01310b to 0x018ddd (0x5cd3 bytes) 000519 1779698858.840609 fallocate 0x031442 thru 0x03ffff (0xebbe bytes) 000520 1779698858.847758 fallocate 0x00485e thru 0x00e9ee (0xa191 bytes) 000521 1779698858.859401 mapread 0x033917 thru 0x033ec0 (0x5aa bytes) 000522 1779698858.862524 punch from 0x027e25 to 0x028327 (0x503 bytes) 000523 1779698858.878875 read 0x03b7df thru 0x03f5cb (0x3ded bytes) 000524 1779698858.880506 punch from 0x03b008 to 0x03f5cb (0x45c4 bytes) 000526 1779698858.892527 read 0x00e943 thru 0x0136e9 (0x4da7 bytes) 000527 1779698858.918227 write 0x0294c7 thru 0x02cc73 (0x37ad bytes) 000528 1779698858.929542 mapread 0x02b187 thru 0x02c041 (0xebb bytes) 000529 1779698858.931285 write 0x023347 thru 0x02aaad (0x7767 bytes) 000530 1779698858.942496 write 0x008839 thru 0x016c1b (0xe3e3 bytes) 000531 1779698858.946820 trunc from 0x003e74 to 0x007cc8 (0x3e55 bytes) 000532 1779698858.956590 trunc from 0x03806c to 0x03eed2 (0x6e67 bytes) 000533 1779698858.966121 fallocate 0x00c336 thru 0x00db9a (0x1865 bytes) 000534 1779698858.984633 punch from 0x038322 to 0x03d1d5 (0x4eb4 bytes) 000535 1779698859.005159 trunc from 0x03f5cc to 0x00c343 (0x33288 bytes) 000536 1779698859.040148 trunc from 0x00c344 to 0x01f3de (0x1309b bytes) 000537 1779698859.071258 write 0x001b6e thru 0x010241 (0xe6d4 bytes) 000538 1779698859.097870 read 0x00d9b0 thru 0x017cd8 (0xa329 bytes) 000540 1779698859.137242 mapread 0x00c2c6 thru 0x01724a (0xaf85 bytes) 000542 1779698859.148680 trunc from 0x01f3df to 0x01b192 (0x424c bytes) 000543 1779698859.199018 trunc from 0x01b193 to 0x02bc15 (0x10a83 bytes) 000544 1779698859.233595 mapread 0x00b2c3 thru 0x0170a6 (0xbde4 bytes) 000545 1779698859.237713 punch from 0x0037ab to 0x010fcf (0xd825 bytes) 000547 1779698859.259906 mapwrite 0x01c00b thru 0x024e87 (0x8e7d bytes) 000548 1779698859.331048 punch from 0x026403 to 0x02bc15 (0x5813 bytes) 000549 1779698859.352776 fallocate 0x03c9a5 thru 0x03ffff (0x365b bytes) 000551 1779698859.368758 mapread 0x022ec5 thru 0x026442 (0x357e bytes) 000552 1779698859.380717 read 0x00bc7a thru 0x00ea18 (0x2d9f bytes) 000553 1779698859.397515 write 0x02d40b thru 0x02fba6 (0x279c bytes) 000554 1779698859.399207 punch from 0x02a328 to 0x02fba6 (0x587f bytes) 000556 1779698859.415156 read 0x017587 thru 0x0247fc (0xd276 bytes) 000557 1779698859.417980 mapwrite 0x01c145 thru 0x0229ec (0x68a8 bytes) 000558 1779698859.454935 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fba7): Mirror 3: 0xab63d1fd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fba7): Mirror 3: 0xab63d1fd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fba7: skipped 000559 1779698859.919644 mapread 0x02f214 thru 0x02fba6 (0x993 bytes) 000561 1779698859.942135 MIRROR_RESYNC 2 mirrors 000562 1779698861.716167 mapread 0x026a32 thru 0x02889c (0x1e6b bytes) 000563 1779698861.757620 trunc from 0x02fba7 to 0x02a166 (0x5a40 bytes) 000564 1779698861.831085 trunc from 0x000bd0 to 0x006294 (0x56c5 bytes) 000566 1779698861.844003 mapwrite 0x004452 thru 0x0132e0 (0xee8f bytes) 000567 1779698861.943078 trunc from 0x017f97 to 0x018c77 (0xce1 bytes) 000568 1779698861.982385 write 0x02b4a0 thru 0x032cd1 (0x7832 bytes) 000569 1779698861.988559 trunc from 0x019592 to 0x021719 (0x8188 bytes) 000570 1779698862.014052 read 0x01eefe thru 0x022561 (0x3664 bytes) 000571 1779698862.059514 punch from 0x01e08a to 0x02c75f (0xe6d6 bytes) 000572 1779698862.099873 mapwrite 0x01673b thru 0x023894 (0xd15a bytes) 000573 1779698862.235499 write 0x01f069 thru 0x01fc1e (0xbb6 bytes) 000574 1779698862.240788 mapread 0x00d73f thru 0x00d88a (0x14c bytes) 000575 1779698862.260425 fallocate 0x01f61b thru 0x024b99 (0x557f bytes) 000576 1779698862.280687 punch from 0x0029e5 to 0x00b830 (0x8e4c bytes) 000578 1779698862.299794 punch from 0x01564c to 0x01d1bc (0x7b71 bytes) 000579 1779698862.319965 fallocate 0x016f1d thru 0x020f6c (0xa050 bytes) 000580 1779698862.334671 mapwrite 0x01dec2 thru 0x02abb8 (0xccf7 bytes) 000581 1779698862.453402 trunc from 0x032cd2 to 0x023b8e (0xf143 bytes) 000582 1779698862.515322 fallocate 0x016d99 thru 0x0214f1 (0xa759 bytes) 000583 1779698862.564756 MIRROR_RESYNC 2 mirrors 000584 1779698863.691978 trunc from 0x00140c to 0x00633f (0x4f34 bytes) 000585 1779698863.751191 read 0x017ff9 thru 0x01df2a (0x5f32 bytes) 000586 1779698863.770132 punch from 0x018481 to 0x023b8e (0xb70e bytes) 000587 1779698863.778414 trunc from 0x023b8f to 0x035417 (0x11889 bytes) 000588 1779698863.818929 read 0x034575 thru 0x035417 (0xea3 bytes) 000589 1779698863.830014 punch from 0x0301b2 to 0x035417 (0x5266 bytes) 000590 1779698863.836437 mapwrite 0x01896f thru 0x020b62 (0x81f4 bytes) 000591 1779698863.864633 trunc from 0x00f166 to 0x010c64 (0x1aff bytes) 000592 1779698863.871264 trunc from 0x014416 to 0x018549 (0x4134 bytes) 000593 1779698863.876450 trunc from 0x035418 to 0x03a96c (0x5555 bytes) 000594 1779698863.901831 write 0x02cce5 thru 0x0381ba (0xb4d6 bytes) 000595 1779698863.914838 punch from 0x00ddc8 to 0x0105e4 (0x281d bytes) 000596 1779698863.929296 read 0x0050e1 thru 0x00f758 (0xa678 bytes) 000597 1779698863.940454 trunc from 0x03a51f to 0x03a96c (0x44e bytes) 000598 1779698863.946349 punch from 0x037b81 to 0x03a96c (0x2dec bytes) 000599 1779698863.964150 write 0x00f9b2 thru 0x01d529 (0xdb78 bytes) 000600 1779698863.966639 punch from 0x01f4c9 to 0x0254c3 (0x5ffb bytes) 000602 1779698863.981934 write 0x0098bf thru 0x00ccdc (0x341e bytes) 000603 1779698863.988241 punch from 0x01a8f0 to 0x0223cc (0x7add bytes) 000605 1779698864.006674 fallocate 0x010262 thru 0x0116f5 (0x1494 bytes) 000606 1779698864.016424 fallocate 0x0286b9 thru 0x03765b (0xefa3 bytes) 000607 1779698864.042439 MIRROR_RESYNC 2 mirrors 000608 1779698864.883070 mapread 0x01e41c thru 0x020486 (0x206b bytes) 000609 1779698864.897733 mapread 0x03534e thru 0x03a12e (0x4de1 bytes) 000610 1779698864.907661 write 0x032dbc thru 0x03b676 (0x88bb bytes) 000611 1779698864.959266 mapwrite 0x012b17 thru 0x01f099 (0xc583 bytes) 000612 1779698865.033079 mapread 0x01366c thru 0x014a66 (0x13fb bytes) 000613 1779698865.039946 MIRROR_RESYNC 2 mirrors 000614 1779698865.741225 trunc from 0x0065fc to 0x00fe0f (0x9814 bytes) 000615 1779698865.862297 punch from 0x018ea5 to 0x01947d (0x5d9 bytes) 000616 1779698865.877022 trunc from 0x03b677 to 0x02a907 (0x10d6f bytes) 000618 1779698865.952616 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x157:0x0]: Invalid argument (22) 000619 1779698866.273232 fallocate 0x0183a8 thru 0x023f12 (0xbb6b bytes) 000620 1779698866.288354 read 0x01efa9 thru 0x024ca8 (0x5d00 bytes) 000621 1779698866.305048 read 0x013096 thru 0x01ae9e (0x7e09 bytes) 000622 1779698866.359147 trunc from 0x005617 to 0x013eda (0xe8c4 bytes) 000623 1779698866.390254 trunc from 0x02a908 to 0x013821 (0x170e6 bytes) 000624 1779698866.454614 trunc from 0x0041e0 to 0x00e739 (0xa55a bytes) 000626 1779698866.471012 trunc from 0x013822 to 0x034748 (0x20f27 bytes) 000627 1779698866.510325 write 0x0258bc thru 0x02fce4 (0xa429 bytes) 000628 1779698866.538673 trunc from 0x00e5f8 to 0x013004 (0x4a0d bytes) 000629 1779698866.550711 trunc from 0x024e10 to 0x02f09d (0xa28e bytes) 000630 1779698866.577766 mapwrite 0x025493 thru 0x025dbd (0x92b bytes) 000631 1779698866.603000 trunc from 0x034749 to 0x010f80 (0x237c8 bytes) 000632 1779698866.638161 read 0x00e7c0 thru 0x010f80 (0x27c1 bytes) 000633 1779698866.655280 punch from 0x003a48 to 0x00c226 (0x87df bytes) 000634 1779698866.662275 trunc from 0x00bf1c to 0x00dc31 (0x1d16 bytes) 000635 1779698866.673567 write 0x03abaa thru 0x03ffff (0x5456 bytes) 000636 1779698866.676309 trunc from 0x040000 to 0x030f3d (0xf0c2 bytes) 000637 1779698866.709278 punch from 0x0221fa to 0x02dd55 (0xbb5c bytes) 000638 1779698866.722443 write 0x03b210 thru 0x03ffff (0x4df0 bytes) 000639 1779698866.724160 trunc from 0x040000 to 0x0181a2 (0x27e5d bytes) 000640 1779698866.785110 trunc from 0x005698 to 0x006a72 (0x13db bytes) 000641 1779698866.797230 mapread 0x00328c thru 0x009395 (0x610a bytes) 000642 1779698866.894134 mapwrite 0x003a7f thru 0x010254 (0xc7d6 bytes) 000643 1779698867.031039 MIRROR_EXTEND to 2 mirrors 000644 1779698868.736429 punch from 0x016b8b to 0x0173fa (0x870 bytes) 000645 1779698868.830360 read 0x007f15 thru 0x00f2b5 (0x73a1 bytes) 000647 1779698868.876549 punch from 0x00bd22 to 0x0180a4 (0xc383 bytes) 000648 1779698868.904254 read 0x011402 thru 0x0181a2 (0x6da1 bytes) 000649 1779698868.938375 read 0x001d09 thru 0x00ea2a (0xcd22 bytes) 000650 1779698868.948091 trunc from 0x0181a3 to 0x008732 (0xfa70 bytes) 000651 1779698869.024704 mapwrite 0x01f1b0 thru 0x025116 (0x5f67 bytes) 000652 1779698869.178287 read 0x024939 thru 0x025116 (0x7de bytes) 000653 1779698869.189992 read 0x00fe67 thru 0x01d277 (0xd411 bytes) 000654 1779698869.196026 fallocate 0x039eee thru 0x03ffff (0x6112 bytes) 000655 1779698869.211784 mapwrite 0x00426c thru 0x00dac6 (0x985b bytes) 000656 1779698869.315245 mapread 0x015534 thru 0x02150e (0xbfdb bytes) 000657 1779698869.332082 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe1946693 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6a23d39f Mirror 3: 0x6a23d39f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000658 1779698870.901436 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe1946693 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6a23d39f Mirror 3: 0x6a23d39f Mirror 4: 0x6a23d39f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000659 1779698871.925226 read 0x03a9da thru 0x03ffff (0x5626 bytes) 000660 1779698871.937917 mapwrite 0x027f21 thru 0x03610c (0xe1ec bytes) 000661 1779698872.202239 write 0x01460a thru 0x01756a (0x2f61 bytes) 000662 1779698872.248012 read 0x00a91f thru 0x014619 (0x9cfb bytes) 000663 1779698872.294363 mapread 0x03a834 thru 0x03ffff (0x57cc bytes) 000664 1779698872.299405 trunc from 0x040000 to 0x018d95 (0x2726a bytes) 000665 1779698872.346623 mapwrite 0x02374f thru 0x030add (0xd38f bytes) 000666 1779698872.601145 mapread 0x02489a thru 0x02c452 (0x7bb9 bytes) 000668 1779698872.605152 read 0x00e10d thru 0x00e3cb (0x2bf bytes) 000669 1779698872.606327 read 0x0144f0 thru 0x01c57a (0x808b bytes) 000670 1779698872.616283 mapread 0x00c3cd thru 0x01846c (0xc0a0 bytes) 000671 1779698872.618938 mapwrite 0x00bba4 thru 0x01a050 (0xe4ad bytes) 000672 1779698872.639991 write 0x02930c thru 0x02e30c (0x5001 bytes) 000674 1779698872.644495 mapwrite 0x00fd36 thru 0x0106b2 (0x97d bytes) 000675 1779698872.663969 fallocate 0x022c45 thru 0x028e87 (0x6243 bytes) 000676 1779698872.673066 mapwrite 0x01e463 thru 0x0274fe (0x909c bytes) 000677 1779698872.697671 trunc from 0x011b70 to 0x01ab07 (0x8f98 bytes) 000678 1779698872.708350 fallocate 0x002228 thru 0x002470 (0x249 bytes) 000679 1779698872.716134 write 0x02a644 thru 0x0366ec (0xc0a9 bytes) 000680 1779698872.724894 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x366ed): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x366ed): Mirror 2: 0x318940b (stale) Mirror 3: 0x7e1d6ca3 (stale) Mirror 4: 0x7e1d6ca3 (stale) CRC-32 checksum value for chunk [0, 0x366ed): Mirror 1: 0xabd59d55 Mirror 5: 0xabd59d55 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x366ed: skipped 000681 1779698875.534966 MIRROR_RESYNC 5 mirrors 000683 1779698877.606246 punch from 0x01cde3 to 0x021d42 (0x4f60 bytes) 000684 1779698877.660385 read 0x030de0 thru 0x0366ec (0x590d bytes) 000685 1779698877.673053 read 0x016ae1 thru 0x0222b6 (0xb7d6 bytes) 000686 1779698877.692227 trunc from 0x0366ed to 0x035585 (0x1167 bytes) 000687 1779698877.716473 write 0x03bfba thru 0x03ffff (0x4046 bytes) 000688 1779698877.717983 write 0x017518 thru 0x0209ad (0x9496 bytes) 000689 1779698877.721617 fallocate 0x0199a0 thru 0x02609d (0xc6fe bytes) 000690 1779698877.727713 fallocate 0x00d007 thru 0x0106c0 (0x36ba bytes) 000691 1779698877.732967 trunc from 0x0044f7 to 0x011639 (0xd143 bytes) 000692 1779698877.739116 write 0x02c68b thru 0x03923c (0xcbb2 bytes) 000693 1779698877.748106 trunc from 0x002c30 to 0x00bbc2 (0x8f93 bytes) 000694 1779698877.753559 read 0x008867 thru 0x00967c (0xe16 bytes) 000695 1779698877.764488 read 0x03496c thru 0x03714b (0x27e0 bytes) 000697 1779698877.770621 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xd3a6f3d3 (stale) Mirror 3: 0xd3a6f3d3 (stale) Mirror 4: 0xd3a6f3d3 (stale) Mirror 5: 0xd3a6f3d3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x17c60b98 Mirror 6: 0x17c60b98 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000698 1779698878.834978 mapwrite 0x0336b2 thru 0x03848b (0x4dda bytes) 000699 1779698878.951149 fallocate 0x009d6d thru 0x011af9 (0x7d8d bytes) 000700 1779698878.957140 fallocate 0x037bc9 thru 0x03ffff (0x8437 bytes) 000701 1779698878.963028 read 0x01c467 thru 0x02a27e (0xde18 bytes) 000702 1779698878.973550 mapwrite 0x03dd23 thru 0x03fbfb (0x1ed9 bytes) 000703 1779698878.993708 write 0x01ec80 thru 0x02257b (0x38fc bytes) 000704 1779698878.999804 write 0x0167e3 thru 0x017f08 (0x1726 bytes) 000705 1779698879.012613 trunc from 0x0180ae to 0x01e618 (0x656b bytes) 000706 1779698879.028723 punch from 0x005317 to 0x00ff18 (0xac02 bytes) 000708 1779698879.038804 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd3a6f3d3 (stale) Mirror 4: 0xd3a6f3d3 (stale) Mirror 5: 0xd3a6f3d3 (stale) Mirror 6: 0x17c60b98 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd3a6f3d3 (stale) Mirror 4: 0xd3a6f3d3 (stale) Mirror 5: 0xd3a6f3d3 (stale) Mirror 6: 0x17c60b98 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000709 1779698879.467072 fallocate 0x038668 thru 0x03ffff (0x7998 bytes) 000710 1779698879.473942 fallocate 0x03ae74 thru 0x03b9bc (0xb49 bytes) 000711 1779698879.479589 write 0x00b72c thru 0x012e71 (0x7746 bytes) 000712 1779698879.501924 trunc from 0x0013e1 to 0x008341 (0x6f61 bytes) 000713 1779698879.507391 trunc from 0x03000b to 0x034b2f (0x4b25 bytes) 000714 1779698879.514295 trunc from 0x00f452 to 0x01bca4 (0xc853 bytes) 000715 1779698879.538265 read 0x00268a thru 0x00ef8f (0xc906 bytes) 000716 1779698879.549396 punch from 0x01d1b0 to 0x024737 (0x7588 bytes) 000717 1779698879.556209 write 0x012a81 thru 0x018fe3 (0x6563 bytes) 000718 1779698879.566832 punch from 0x0243cd to 0x033487 (0xf0bb bytes) 000719 1779698879.572640 write 0x028413 thru 0x038121 (0xfd0f bytes) 000720 1779698879.591438 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd3a6f3d3 (stale) Mirror 5: 0xd3a6f3d3 (stale) Mirror 6: 0x17c60b98 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd3a6f3d3 (stale) Mirror 5: 0xd3a6f3d3 (stale) Mirror 6: 0x17c60b98 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000721 1779698880.013648 punch from 0x0339bc to 0x039652 (0x5c97 bytes) 000722 1779698880.022584 mapwrite 0x019c17 thru 0x025cba (0xc0a4 bytes) 000723 1779698880.078247 write 0x01c24c thru 0x0271f7 (0xafac bytes) 000724 1779698880.087348 trunc from 0x0285ca to 0x03750c (0xef43 bytes) 000725 1779698880.094624 mapwrite 0x006438 thru 0x00920e (0x2dd7 bytes) 000726 1779698880.125470 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xd3a6f3d3 (stale) Mirror 6: 0x17c60b98 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xd3a6f3d3 (stale) Mirror 6: 0x17c60b98 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000727 1779698880.572514 mapwrite 0x01fedc thru 0x02c270 (0xc395 bytes) 000728 1779698880.658211 trunc from 0x0160d7 to 0x01baa5 (0x59cf bytes) 000730 1779698880.666602 punch from 0x01e97f to 0x021eb8 (0x353a bytes) 000732 1779698880.678284 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xd3a6f3d3 (stale) Mirror 6: 0x17c60b98 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc4bf6cf5 Mirror 7: 0xc4bf6cf5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000734 1779698881.833503 read 0x011819 thru 0x01f846 (0xe02e bytes) 000735 1779698881.855097 trunc from 0x040000 to 0x017e2b (0x281d4 bytes) 000736 1779698881.908683 trunc from 0x017e2c to 0x02aa1a (0x12bef bytes) 000738 1779698881.934041 trunc from 0x028931 to 0x02aa1a (0x20ea bytes) 000739 1779698881.940134 write 0x000375 thru 0x00e18f (0xde1b bytes) 000740 1779698881.952485 write 0x004e55 thru 0x012213 (0xd3bf bytes) 000741 1779698881.960062 fallocate 0x02f998 thru 0x03a99b (0xb004 bytes) 000742 1779698881.967595 punch from 0x01629f to 0x022018 (0xbd7a bytes) 000743 1779698881.974279 mapwrite 0x02cbe8 thru 0x03c98d (0xfda6 bytes) 000744 1779698882.059093 read 0x038271 thru 0x03add4 (0x2b64 bytes) 000745 1779698882.061087 mapread 0x02522a thru 0x02c0d4 (0x6eab bytes) 000747 1779698882.067292 write 0x01d9a4 thru 0x022cd0 (0x532d bytes) 000748 1779698882.088462 mapwrite 0x02fc43 thru 0x033e41 (0x41ff bytes) 000749 1779698882.120241 write 0x00daaf thru 0x01809f (0xa5f1 bytes) 000750 1779698882.125824 fallocate 0x00cc0b thru 0x019792 (0xcb88 bytes) 000751 1779698882.143145 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c98e): Mirror 5: 0xc9debca4 (stale) Mirror 7: 0x414c0a33 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c98e): Mirror 5: 0xc9debca4 (stale) Mirror 7: 0x414c0a33 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c98e: skipped 000752 1779698882.741662 read 0x00e892 thru 0x0153cb (0x6b3a bytes) 000753 1779698882.766900 punch from 0x01a5e9 to 0x01ff84 (0x599c bytes) 000754 1779698882.780669 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3c98e): Mirror 5: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c98e): Mirror 5: 0xc9debca4 (stale) Mirror 7: 0x414c0a33 (stale) CRC-32 checksum value for chunk [0, 0x3c98e): Mirror 1: 0x3ef95b05 Mirror 8: 0x3ef95b05 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c98e: skipped 000755 1779698884.424484 write 0x00d6bd thru 0x00ee69 (0x17ad bytes) 000756 1779698884.509614 mapread 0x036050 thru 0x03c98d (0x693e bytes) 000757 1779698884.523982 mapwrite 0x037f86 thru 0x03ffff (0x807a bytes) 000758 1779698884.576166 write 0x0143b6 thru 0x021410 (0xd05b bytes) 000759 1779698884.607919 trunc from 0x01962e to 0x023af7 (0xa4ca bytes) 000760 1779698884.628647 fallocate 0x007a34 thru 0x01669f (0xec6c bytes) 000761 1779698884.634489 trunc from 0x040000 to 0x00e238 (0x31dc7 bytes) 000762 1779698884.653290 fallocate 0x02de42 thru 0x0382b9 (0xa478 bytes) 000763 1779698884.659617 trunc from 0x004239 to 0x00cae1 (0x88a9 bytes) 000764 1779698884.665469 mapread 0x00cb60 thru 0x00df42 (0x13e3 bytes) 000765 1779698884.681210 mapwrite 0x0066eb thru 0x007232 (0xb48 bytes) 000766 1779698884.709891 mapwrite 0x01230a thru 0x01e365 (0xc05c bytes) 000767 1779698884.807358 mapread 0x01bece thru 0x01e365 (0x2498 bytes) 000768 1779698884.812975 punch from 0x016e06 to 0x017516 (0x711 bytes) 000769 1779698884.820423 trunc from 0x004584 to 0x012eaf (0xe92c bytes) 000770 1779698884.824998 trunc from 0x01e366 to 0x007811 (0x16b54 bytes) 000771 1779698884.839013 trunc from 0x007812 to 0x03e5dc (0x36dcb bytes) 000772 1779698884.863127 trunc from 0x038978 to 0x03e1ae (0x5837 bytes) 000773 1779698884.871861 fallocate 0x02c44e thru 0x02f322 (0x2ed5 bytes) 000774 1779698884.877725 trunc from 0x022d32 to 0x02ef1f (0xc1ee bytes) 000775 1779698884.883528 mapwrite 0x014a24 thru 0x01d0dc (0x86b9 bytes) 000776 1779698884.935077 mapread 0x02984c thru 0x0386f8 (0xeead bytes) 000777 1779698884.959098 write 0x03a305 thru 0x03bbec (0x18e8 bytes) 000778 1779698884.968952 fallocate 0x02d3ed thru 0x0361c1 (0x8dd5 bytes) 000779 1779698884.980304 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3e5dd): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e5dd): Mirror 5: 0x375577d0 (stale) Mirror 7: 0x9e2f3b94 (stale) Mirror 8: 0x32f63997 (stale) CRC-32 checksum value for chunk [0, 0x3e5dd): Mirror 1: 0x6e2567f Mirror 9: 0x6e2567f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e5dd: skipped 000780 1779698886.690049 mapwrite 0x021445 thru 0x028ecf (0x7a8b bytes) 000781 1779698886.947202 mapwrite 0x002a47 thru 0x008ea6 (0x6460 bytes) 000782 1779698887.025161 trunc from 0x03a6ca to 0x03e5dc (0x3f13 bytes) 000783 1779698887.038021 mapwrite 0x00c45a thru 0x013133 (0x6cda bytes) 000784 1779698887.110452 MIRROR_RESYNC 5 mirrors 000785 1779698889.664636 mapwrite 0x02b6c0 thru 0x02ead3 (0x3414 bytes) 000786 1779698889.739991 read 0x02cb26 thru 0x03755c (0xaa37 bytes) 000787 1779698889.744208 mapread 0x005228 thru 0x013198 (0xdf71 bytes) 000788 1779698889.755663 trunc from 0x032d9b to 0x0336f4 (0x95a bytes) 000789 1779698889.759830 punch from 0x00e266 to 0x0121d4 (0x3f6f bytes) 000790 1779698889.769983 trunc from 0x03e5dd to 0x00c486 (0x32156 bytes) 000791 1779698889.790855 read 0x00c348 thru 0x00c486 (0x13f bytes) 000792 1779698889.791385 trunc from 0x0037e9 to 0x00c486 (0x8c9e bytes) 000793 1779698889.797563 read 0x007499 thru 0x00c486 (0x4fee bytes) 000794 1779698889.804672 trunc from 0x00c487 to 0x0300c2 (0x23c3c bytes) 000795 1779698889.815914 trunc from 0x01515f to 0x024163 (0xf005 bytes) 000796 1779698889.820748 read 0x026f0f thru 0x0300c2 (0x91b4 bytes) 000797 1779698889.829880 mapwrite 0x0040a4 thru 0x004a75 (0x9d2 bytes) 000798 1779698889.839849 read 0x017337 thru 0x0223c4 (0xb08e bytes) 000799 1779698889.840791 write 0x007f2f thru 0x014abf (0xcb91 bytes) 000800 1779698889.848057 MIRROR_RESYNC 5 mirrors 000801 1779698890.888345 write 0x0329e9 thru 0x0364a5 (0x3abd bytes) 000802 1779698890.909090 read 0x004567 thru 0x004aa4 (0x53e bytes) 000803 1779698890.912817 read 0x023dd4 thru 0x02ffa0 (0xc1cd bytes) 000805 1779698890.922401 mapwrite 0x0097b7 thru 0x00d85f (0x40a9 bytes) 000806 1779698890.936571 mapread 0x00311c thru 0x00a6f7 (0x75dc bytes) 000807 1779698890.937862 read 0x01d844 thru 0x026e89 (0x9646 bytes) 000808 1779698890.938911 fallocate 0x003b99 thru 0x005e22 (0x228a bytes) 000809 1779698890.942861 trunc from 0x0364a6 to 0x03482f (0x1c76 bytes) 000810 1779698890.959333 write 0x036e92 thru 0x0383b6 (0x1525 bytes) 000811 1779698890.960849 fallocate 0x03b3ca thru 0x03ffff (0x4c36 bytes) 000812 1779698890.965250 trunc from 0x03393f to 0x0383b6 (0x4a78 bytes) 000813 1779698890.973712 read 0x035523 thru 0x036704 (0x11e2 bytes) 000814 1779698890.982361 mapread 0x030896 thru 0x033f10 (0x367b bytes) 000815 1779698890.983291 write 0x01f1c7 thru 0x02af5e (0xbd98 bytes) 000816 1779698890.984427 punch from 0x037622 to 0x0383b6 (0xd95 bytes) 000817 1779698890.987802 trunc from 0x0383b7 to 0x00d508 (0x2aeae bytes) 000818 1779698890.999018 read 0x005519 thru 0x00c34b (0x6e33 bytes) 000819 1779698890.999575 mapwrite 0x01e5f7 thru 0x01ee71 (0x87b bytes) 000820 1779698891.029706 mapread 0x00f91f thru 0x01091f (0x1001 bytes) 000821 1779698891.030990 read 0x018225 thru 0x01ee71 (0x6c4d bytes) 000822 1779698891.033073 punch from 0x003c86 to 0x00ec2a (0xafa5 bytes) 000823 1779698891.040599 read 0x00ffa3 thru 0x0162d3 (0x6331 bytes) 000824 1779698891.041526 trunc from 0x01ee72 to 0x03ac79 (0x1be08 bytes) 000825 1779698891.053503 trunc from 0x03ac7a to 0x029d7b (0x10efe bytes) 000826 1779698891.062046 read 0x011e19 thru 0x01a804 (0x89ec bytes) 000827 1779698891.062724 mapwrite 0x023971 thru 0x02fecd (0xc55d bytes) 000828 1779698891.092648 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2fece): Mirror 5: 0x34104d9f (stale) Mirror 7: 0x34104d9f (stale) Mirror 8: 0x34104d9f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2fece): Mirror 5: 0x34104d9f (stale) Mirror 7: 0x34104d9f (stale) Mirror 8: 0x34104d9f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2fece: skipped 000829 1779698891.310046 trunc from 0x002b20 to 0x0042e2 (0x17c3 bytes) 000830 1779698891.314523 mapwrite 0x02b829 thru 0x032f9c (0x7774 bytes) 000831 1779698891.362480 mapread 0x01af26 thru 0x01be9b (0xf76 bytes) 000833 1779698891.378541 trunc from 0x0097af to 0x011c0b (0x845d bytes) 000834 1779698891.383444 write 0x00a900 thru 0x00b35c (0xa5d bytes) 000835 1779698891.391102 fallocate 0x03a880 thru 0x03ffff (0x5780 bytes) 000836 1779698891.394951 trunc from 0x00674a to 0x0142fc (0xdbb3 bytes) 000837 1779698891.404772 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xdce5f23a (stale) Mirror 8: 0xdce5f23a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xdce5f23a (stale) Mirror 8: 0xdce5f23a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000838 1779698891.683980 write 0x02aca5 thru 0x0309ed (0x5d49 bytes) 000839 1779698891.697103 fallocate 0x00a8f9 thru 0x0152f3 (0xa9fb bytes) 000840 1779698891.714942 MIRROR_RESYNC 3 mirrors 000841 1779698892.766341 read 0x038344 thru 0x039dc6 (0x1a83 bytes) 000842 1779698892.774769 read 0x032d10 thru 0x036a8b (0x3d7c bytes) 000843 1779698892.792511 fallocate 0x0234e5 thru 0x032e79 (0xf995 bytes) 000844 1779698892.825252 trunc from 0x0200bd to 0x02dc87 (0xdbcb bytes) 000845 1779698892.832508 trunc from 0x040000 to 0x00b058 (0x34fa7 bytes) 000847 1779698892.873317 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xb059): Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb059): Mirror 7: 0x68852c08 (stale) Mirror 8: 0x68852c08 (stale) CRC-32 checksum value for chunk [0, 0xb059): Mirror 1: 0x68852c08 Mirror 9: 0x68852c08 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb059: skipped 000848 1779698893.910163 read 0x003b8a thru 0x00b058 (0x74cf bytes) 000849 1779698893.929535 mapread 0x0047dd thru 0x0051ba (0x9de bytes) 000850 1779698893.941369 trunc from 0x009bf6 to 0x00b058 (0x1463 bytes) 000851 1779698893.971002 fallocate 0x0257f8 thru 0x032495 (0xcc9e bytes) 000852 1779698893.975477 trunc from 0x031683 to 0x032495 (0xe13 bytes) 000853 1779698893.978869 mapread 0x02cc30 thru 0x02ff1f (0x32f0 bytes) 000854 1779698893.991308 trunc from 0x032496 to 0x01ebe7 (0x138ae bytes) 000855 1779698894.008088 fallocate 0x0003ef thru 0x0078d7 (0x74e9 bytes) 000856 1779698894.012156 trunc from 0x008524 to 0x00e2bc (0x5d99 bytes) 000857 1779698894.018413 MIRROR_RESYNC 4 mirrors 000861 1779698895.068890 write 0x02f9da thru 0x03f83f (0xfe66 bytes) 000862 1779698895.132007 mapread 0x03f676 thru 0x03f83f (0x1ca bytes) 000863 1779698895.133216 write 0x013453 thru 0x01d270 (0x9e1e bytes) 000864 1779698895.157724 mapread 0x0365f9 thru 0x03f17f (0x8b87 bytes) 000865 1779698895.161925 fallocate 0x00ce92 thru 0x019a1c (0xcb8b bytes) 000866 1779698895.172845 write 0x0326c1 thru 0x03728e (0x4bce bytes) 000867 1779698895.176122 read 0x00638c thru 0x013e0d (0xda82 bytes) 000869 1779698895.193101 fallocate 0x013c34 thru 0x01de7c (0xa249 bytes) 000870 1779698895.205085 mapwrite 0x008a6d thru 0x015d56 (0xd2ea bytes) 000871 1779698895.270469 trunc from 0x03f840 to 0x02e8e3 (0x10f5c bytes) 000872 1779698895.323968 trunc from 0x016fb4 to 0x01e7bf (0x780c bytes) 000873 1779698895.331604 fallocate 0x01ca0c thru 0x023136 (0x672b bytes) 000874 1779698895.337865 trunc from 0x02e8e4 to 0x03a2ed (0xba0a bytes) 000875 1779698895.361679 mapwrite 0x020890 thru 0x02f820 (0xef91 bytes) 000876 1779698895.456569 trunc from 0x0211f1 to 0x028995 (0x77a5 bytes) 000877 1779698895.464915 mapwrite 0x006120 thru 0x010ca8 (0xab89 bytes) 000878 1779698895.543164 fallocate 0x01170a thru 0x020c6b (0xf562 bytes) 000880 1779698895.557002 mapwrite 0x00032b thru 0x0003d4 (0xaa bytes) 000881 1779698895.583088 fallocate 0x02fb2d thru 0x03d3e1 (0xd8b5 bytes) 000883 1779698895.608546 MIRROR_RESYNC 4 mirrors 000885 1779698897.590136 punch from 0x00ad77 to 0x015b85 (0xae0f bytes) 000887 1779698897.618702 read 0x037502 thru 0x03a2ed (0x2dec bytes) 000888 1779698897.628891 trunc from 0x0027ef to 0x00bcd9 (0x94eb bytes) 000889 1779698897.640494 fallocate 0x01d501 thru 0x02d27a (0xfd7a bytes) 000890 1779698897.662146 fallocate 0x003565 thru 0x004220 (0xcbc bytes) 000891 1779698897.669067 mapwrite 0x005d97 thru 0x011598 (0xb802 bytes) 000892 1779698897.756482 trunc from 0x02f6ad to 0x03a2ed (0xac41 bytes) 000893 1779698897.768387 fallocate 0x00affc thru 0x010e5e (0x5e63 bytes) 000894 1779698897.784115 punch from 0x0100e1 to 0x014627 (0x4547 bytes) 000895 1779698897.796636 mapwrite 0x01ce42 thru 0x0291d7 (0xc396 bytes) 000896 1779698897.888588 trunc from 0x03a2ee to 0x01d002 (0x1d2eb bytes) 000897 1779698897.928154 read 0x00c313 thru 0x00e92e (0x261c bytes) 000898 1779698897.930965 trunc from 0x0168c5 to 0x01d002 (0x673e bytes) 000899 1779698897.945790 mapwrite 0x030dfc thru 0x033d91 (0x2f96 bytes) 000900 1779698898.057951 read 0x005ad2 thru 0x009f14 (0x4443 bytes) 000901 1779698898.065279 trunc from 0x00d7a6 to 0x018251 (0xaaac bytes) 000902 1779698898.081387 trunc from 0x033d92 to 0x02a01b (0x9d76 bytes) 000903 1779698898.142958 fallocate 0x031686 thru 0x03bdc7 (0xa742 bytes) 000904 1779698898.152965 mapwrite 0x019fde thru 0x01aae6 (0xb09 bytes) 000905 1779698898.172843 read 0x018c88 thru 0x01e41a (0x5793 bytes) 000906 1779698898.183960 write 0x028249 thru 0x02f803 (0x75bb bytes) 000907 1779698898.185999 trunc from 0x01fd4c to 0x020c2d (0xee2 bytes) 000908 1779698898.198058 MIRROR_RESYNC 4 mirrors 000909 1779698899.540103 trunc from 0x02f804 to 0x011959 (0x1deaa bytes) 000910 1779698899.578362 punch from 0x009715 to 0x011959 (0x8245 bytes) 000911 1779698899.586345 fallocate 0x0110c4 thru 0x01accd (0x9c0a bytes) 000912 1779698899.592877 trunc from 0x00acac to 0x00dc86 (0x2fdb bytes) 000913 1779698899.598520 punch from 0x00ec13 to 0x011959 (0x2d47 bytes) 000914 1779698899.604752 read 0x00079a thru 0x001639 (0xea0 bytes) 000915 1779698899.611876 trunc from 0x0067e8 to 0x011959 (0xb172 bytes) 000916 1779698899.618375 mapread 0x00eb36 thru 0x011959 (0x2e24 bytes) 000917 1779698899.646384 fallocate 0x018efe thru 0x021180 (0x8283 bytes) 000918 1779698899.653116 punch from 0x00ec85 to 0x011959 (0x2cd5 bytes) 000919 1779698899.659505 fallocate 0x013229 thru 0x017eed (0x4cc5 bytes) 000920 1779698899.665859 trunc from 0x00033f to 0x00549e (0x5160 bytes) 000921 1779698899.673069 trunc from 0x005e96 to 0x012fbf (0xd12a bytes) 000922 1779698899.683823 fallocate 0x026b89 thru 0x031327 (0xa79f bytes) 000924 1779698899.695814 write 0x01b1c6 thru 0x0244ef (0x932a bytes) 000925 1779698899.747784 mapwrite 0x0325bf thru 0x03279d (0x1df bytes) 000926 1779698899.848102 punch from 0x0232f7 to 0x027391 (0x409b bytes) 000927 1779698899.857879 trunc from 0x03279e to 0x003282 (0x2f51b bytes) 000928 1779698899.894093 trunc from 0x0022e1 to 0x003282 (0xfa2 bytes) 000929 1779698899.908517 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3283): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3283): Mirror 7: 0xc3858b02 (stale) Mirror 8: 0xc3858b02 (stale) Mirror 9: 0xc3858b02 (stale) CRC-32 checksum value for chunk [0, 0x3283): Mirror 1: 0x61db03af Mirror 10: 0x61db03af lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3283: skipped 000930 1779698901.003559 trunc from 0x00178a to 0x003282 (0x1af9 bytes) 000932 1779698901.049252 read 0x0013a0 thru 0x003282 (0x1ee3 bytes) 000933 1779698901.084133 fallocate 0x03e5f9 thru 0x03faf3 (0x14fb bytes) 000934 1779698901.094495 trunc from 0x00086d to 0x001301 (0xa95 bytes) 000935 1779698901.105100 fallocate 0x01cbf7 thru 0x02643c (0x9846 bytes) 000936 1779698901.116511 fallocate 0x007f33 thru 0x011669 (0x9737 bytes) 000937 1779698901.130641 fallocate 0x008474 thru 0x00cd05 (0x4892 bytes) 000938 1779698901.136430 trunc from 0x00c0a3 to 0x01594b (0x98a9 bytes) 000939 1779698901.142965 trunc from 0x011951 to 0x01bc60 (0xa310 bytes) 000940 1779698901.148362 write 0x026435 thru 0x02c5f1 (0x61bd bytes) 000941 1779698901.163628 mapread 0x00bd53 thru 0x014814 (0x8ac2 bytes) 000942 1779698901.181920 write 0x027314 thru 0x029e09 (0x2af6 bytes) 000943 1779698901.183345 write 0x0277a9 thru 0x02b7a5 (0x3ffd bytes) 000944 1779698901.193317 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2c5f2): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c5f2): Mirror 7: 0x65d8dff5 (stale) Mirror 8: 0x65d8dff5 (stale) Mirror 9: 0x65d8dff5 (stale) Mirror 10: 0x78b8d17e (stale) CRC-32 checksum value for chunk [0, 0x2c5f2): Mirror 1: 0xecd4a611 Mirror 11: 0xecd4a611 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c5f2: skipped 000945 1779698902.688538 trunc from 0x001447 to 0x0075b3 (0x616d bytes) 000946 1779698902.730259 punch from 0x00a07b to 0x00a96e (0x8f4 bytes) 000947 1779698902.736092 trunc from 0x02bdc6 to 0x02c5f1 (0x82c bytes) 000948 1779698902.746488 MIRROR_RESYNC 6 mirrors 000949 1779698904.318500 trunc from 0x02c5f2 to 0x03153d (0x4f4c bytes) 000951 1779698904.424917 mapwrite 0x017502 thru 0x025501 (0xe000 bytes) 000952 1779698904.554663 mapread 0x028fe0 thru 0x03153d (0x855e bytes) 000953 1779698904.574210 mapwrite 0x03d8cc thru 0x03ffff (0x2734 bytes) 000954 1779698904.638145 punch from 0x02e3d3 to 0x034a21 (0x664f bytes) 000955 1779698904.649991 mapread 0x00f710 thru 0x0115da (0x1ecb bytes) 000957 1779698904.675272 write 0x01aa1e thru 0x01c00b (0x15ee bytes) 000958 1779698904.677615 trunc from 0x040000 to 0x0246be (0x1b941 bytes) 000959 1779698904.697494 mapread 0x01a028 thru 0x0246be (0xa697 bytes) 000960 1779698904.699536 write 0x02a4c9 thru 0x02e7c4 (0x42fc bytes) 000961 1779698904.700674 mapread 0x023433 thru 0x02e7c4 (0xb392 bytes) 000962 1779698904.710895 punch from 0x004bbe to 0x00dea2 (0x92e5 bytes) 000963 1779698904.729073 trunc from 0x02e7c5 to 0x03ad28 (0xc564 bytes) 000964 1779698904.747887 mapread 0x006f99 thru 0x015496 (0xe4fe bytes) 000965 1779698904.761488 trunc from 0x0029f6 to 0x00ccf4 (0xa2ff bytes) 000966 1779698904.767113 mapwrite 0x008cff thru 0x017fbd (0xf2bf bytes) 000967 1779698904.791572 read 0x0277e2 thru 0x02e356 (0x6b75 bytes) 000968 1779698904.792474 write 0x037837 thru 0x03c113 (0x48dd bytes) 000969 1779698904.813353 MIRROR_RESYNC 6 mirrors 000970 1779698907.720568 trunc from 0x03c114 to 0x00d6e9 (0x2ea2a bytes) 000971 1779698907.829272 punch from 0x00124a to 0x00d6e9 (0xc4a0 bytes) 000972 1779698907.841952 punch from 0x002f95 to 0x00cf95 (0xa001 bytes) 000973 1779698907.853877 mapread 0x004eac thru 0x009536 (0x468b bytes) 000974 1779698907.918980 read 0x0023ab thru 0x008c96 (0x68ec bytes) 000975 1779698907.925245 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xd6ea): Mirror 7: 0x866c44ae (stale) Mirror 8: 0x866c44ae (stale) Mirror 9: 0x866c44ae (stale) Mirror 10: 0x866c44ae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd6ea): Mirror 7: 0x866c44ae (stale) Mirror 8: 0x866c44ae (stale) Mirror 9: 0x866c44ae (stale) Mirror 10: 0x866c44ae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd6ea: skipped 000976 1779698908.755753 write 0x00bdc0 thru 0x01461c (0x885d bytes) 000977 1779698908.791499 read 0x012508 thru 0x01461c (0x2115 bytes) 000978 1779698908.792984 trunc from 0x00c8de to 0x01461c (0x7d3f bytes) 000980 1779698908.811652 mapwrite 0x0398cc thru 0x03ffff (0x6734 bytes) 000981 1779698908.965723 write 0x0016ba thru 0x0079d1 (0x6318 bytes) 000982 1779698908.992773 fallocate 0x00875c thru 0x017975 (0xf21a bytes) 000983 1779698909.006566 mapwrite 0x004e8a thru 0x0089b7 (0x3b2e bytes) 000984 1779698909.049211 mapwrite 0x0130b8 thru 0x013ca4 (0xbed bytes) 000986 1779698909.112724 mapwrite 0x03ee0c thru 0x03f534 (0x729 bytes) 000987 1779698909.151778 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x7bac5a8 (stale) Mirror 8: 0x7bac5a8 (stale) Mirror 9: 0x7bac5a8 (stale) Mirror 10: 0x7bac5a8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6e2d4b0e Mirror 11: 0x6e2d4b0e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000988 1779698910.824024 read 0x026f64 thru 0x033ec4 (0xcf61 bytes) 000989 1779698910.845926 write 0x00fb43 thru 0x015499 (0x5957 bytes) 000991 1779698910.917312 read 0x036277 thru 0x03a112 (0x3e9c bytes) 000992 1779698910.934116 mapread 0x00db16 thru 0x010651 (0x2b3c bytes) 000993 1779698910.935425 trunc from 0x003afb to 0x00d0be (0x95c4 bytes) 000994 1779698910.945592 mapwrite 0x033f3f thru 0x03ffff (0xc0c1 bytes) 000995 1779698910.990862 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x157:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x7bac5a8 (stale) Mirror 9: 0x7bac5a8 (stale) Mirror 10: 0x7bac5a8 (stale) Mirror 11: 0x6e2d4b0e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x7bac5a8 (stale) Mirror 9: 0x7bac5a8 (stale) Mirror 10: 0x7bac5a8 (stale) Mirror 11: 0x6e2d4b0e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000996 1779698911.631408 trunc from 0x0376b7 to 0x03ffff (0x8949 bytes) 000997 1779698911.642557 write 0x02fcf2 thru 0x03bae0 (0xbdef bytes) 000998 1779698911.699019 write 0x0144ee thru 0x020b86 (0xc699 bytes) 001000 1779698911.778847 mapwrite 0x0001ca thru 0x003817 (0x364e bytes) All operations completed A-OK!