== sanity-flr test 70a: flr mode fsx test ================ 00:58:37 (1780808317) Seed set to 8317 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read skipping zero size read skipping zero size read skipping zero size read skipping zero size read truncating to largest ever: 0x348eb 000009 1780808318.047963 trunc from 00000000 to 0x0348ea (0x348eb bytes) 000010 1780808318.053813 mapwrite 0x012fef thru 0x021374 (0xe386 bytes) truncating to largest ever: 0x3dab2 000014 1780808318.101577 trunc from 0x0348eb to 0x03dab1 (0x91c7 bytes) 000015 1780808318.109598 MIRROR_EXTEND to 2 mirrors 000016 1780808318.331608 mapwrite 0x03ca10 thru 0x03ffff (0x35f0 bytes) 000017 1780808318.386811 mapwrite 0x025f9d thru 0x0326e9 (0xc74d bytes) 000020 1780808318.418238 mapread 0x01eb08 thru 0x0240a2 (0x559b bytes) 000021 1780808318.422002 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x830ad19a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd9dfaf2d Mirror 3: 0xd9dfaf2d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000024 1780808318.709799 read 0x0000a6 thru 0x00fb2d (0xfa88 bytes) 000025 1780808318.714608 mapread 0x0138d0 thru 0x020cdf (0xd410 bytes) 000027 1780808318.727236 trunc from 0x040000 to 0x00a2f2 (0x35d0d bytes) 000029 1780808318.760587 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xa2f3): Mirror 3: 0x617f3a23 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa2f3): Mirror 3: 0x617f3a23 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa2f3: skipped 000030 1780808318.865317 mapread 0x001408 thru 0x002ca4 (0x189d bytes) 000031 1780808318.869237 trunc from 0x00a2f3 to 0x00d713 (0x3421 bytes) 000032 1780808318.874770 write 0x00c5b8 thru 0x013cb2 (0x76fb bytes) 000033 1780808318.878512 read 0x003f4a thru 0x0138bf (0xf976 bytes) 000034 1780808318.881111 trunc from 0x013cb3 to 0x03b72d (0x27a7b bytes) 000035 1780808318.888230 trunc from 0x03b72e to 0x02887f (0x12eae bytes) 000036 1780808318.894330 read 0x0021df thru 0x0068f3 (0x4715 bytes) 000037 1780808318.895013 mapwrite 0x00221d thru 0x010f18 (0xecfc bytes) 000039 1780808318.923915 write 0x0145c0 thru 0x01f3dd (0xae1e bytes) 000042 1780808318.931131 mapread 0x0239ff thru 0x023d6f (0x371 bytes) 000043 1780808318.932119 mapread 0x001367 thru 0x00b72b (0xa3c5 bytes) 000045 1780808318.933860 mapread 0x00a1e1 thru 0x00b5c6 (0x13e6 bytes) 000047 1780808318.935376 trunc from 0x028880 to 0x002696 (0x261e9 bytes) 000049 1780808318.947164 write 0x029142 thru 0x0338a1 (0xa760 bytes) 000051 1780808318.949648 mapwrite 0x02df58 thru 0x035b20 (0x7bc9 bytes) 000053 1780808318.992413 trunc from 0x035b21 to 0x02c0a0 (0x9a80 bytes) 000054 1780808319.004601 write 0x02f933 thru 0x0398b9 (0x9f87 bytes) 000055 1780808319.006179 write 0x0019a1 thru 0x0098b2 (0x7f12 bytes) 000057 1780808319.011343 mapwrite 0x033305 thru 0x0381d7 (0x4ed3 bytes) 000059 1780808319.043562 MIRROR_RESYNC 2 mirrors 000060 1780808319.234763 read 0x024ddf thru 0x02a550 (0x5772 bytes) 000061 1780808319.238143 mapread 0x01ba3c thru 0x02903e (0xd603 bytes) 000064 1780808319.246447 mapwrite 0x038ea4 thru 0x03ffff (0x715c bytes) 000066 1780808319.305278 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xea930913 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x35d573aa Mirror 4: 0x35d573aa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000067 1780808319.550688 write 0x025ebf thru 0x02777a (0x18bc bytes) 000068 1780808319.586047 trunc from 0x040000 to 0x016017 (0x29fe8 bytes) 000070 1780808319.604532 read 0x013c27 thru 0x016017 (0x23f1 bytes) 000071 1780808319.609250 trunc from 0x016018 to 0x0040e2 (0x11f35 bytes) 000072 1780808319.617726 mapwrite 0x01a2a7 thru 0x01e5f1 (0x434b bytes) 000074 1780808319.652195 write 0x0129c9 thru 0x015d4a (0x3382 bytes) 000077 1780808319.660922 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e5f2): Mirror 4: 0x3b79ef0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e5f2): Mirror 4: 0x3b79ef0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e5f2: skipped 000078 1780808319.763571 mapwrite 0x009eb7 thru 0x00b731 (0x187b bytes) 000079 1780808319.779742 mapread 0x01661e thru 0x01e5f1 (0x7fd4 bytes) 000082 1780808319.783143 mapwrite 0x02bd08 thru 0x039ef9 (0xe1f2 bytes) 000084 1780808319.808374 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) 000085 1780808319.848857 write 0x015c90 thru 0x01f94a (0x9cbb bytes) 000087 1780808319.853657 read 0x029f69 thru 0x02c429 (0x24c1 bytes) 000089 1780808319.857244 trunc from 0x039efa to 0x036481 (0x3a78 bytes) 000092 1780808319.864902 read 0x025506 thru 0x02c1f0 (0x6ceb bytes) 000094 1780808319.871594 MIRROR_EXTEND to 2 mirrors 000097 1780808320.068162 mapread 0x01875a thru 0x01bfe5 (0x388c bytes) 000099 1780808320.074261 mapwrite 0x006a59 thru 0x00acb8 (0x4260 bytes) 000101 1780808320.125935 mapread 0x00ff46 thru 0x01e900 (0xe9bb bytes) 000102 1780808320.134930 MIRROR_RESYNC 2 mirrors 000103 1780808320.333634 MIRROR_EXTEND to 3 mirrors 000105 1780808320.527571 read 0x01545e thru 0x021a0b (0xc5ae bytes) 000106 1780808320.531054 mapread 0x01c3f7 thru 0x020b9c (0x47a6 bytes) 000108 1780808320.532144 trunc from 0x036482 to 0x01cf84 (0x194fd bytes) 000109 1780808320.562653 write 0x033941 thru 0x039a06 (0x60c6 bytes) 000111 1780808320.564025 trunc from 0x039a07 to 0x008841 (0x311c5 bytes) 000113 1780808320.571121 mapread 0x0007c1 thru 0x003f9d (0x37dd bytes) 000116 1780808320.580823 mapread 0x004c9a thru 0x0055a6 (0x90d bytes) 000119 1780808320.584397 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x8842): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8842): Mirror 2: 0xc39f9996 (stale) Mirror 3: 0xc39f9996 (stale) CRC-32 checksum value for chunk [0, 0x8842): Mirror 1: 0xc39f9996 Mirror 4: 0xc39f9996 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8842: skipped 000121 1780808320.820644 read 0x008101 thru 0x008841 (0x741 bytes) 000123 1780808320.822623 read 0x001ab9 thru 0x006ac6 (0x500e bytes) 000124 1780808320.827044 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x8842): Mirror 3: 0xc39f9996 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8842): Mirror 3: 0xc39f9996 (stale) CRC-32 checksum value for chunk [0, 0x8842): Mirror 1: 0xc39f9996 Mirror 4: 0xc39f9996 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8842: skipped 000125 1780808320.985787 mapwrite 0x03cbbd thru 0x03ffff (0x3443 bytes) 000126 1780808321.045620 read 0x0258f0 thru 0x02d1d0 (0x78e1 bytes) 000127 1780808321.048979 read 0x01ac28 thru 0x0222f2 (0x76cb bytes) 000131 1780808321.055136 mapread 0x03ce40 thru 0x03dff6 (0x11b7 bytes) 000132 1780808321.058015 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x2e17f30a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x2e17f30a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000133 1780808321.160090 mapread 0x03c043 thru 0x03ed5b (0x2d19 bytes) 000134 1780808321.166194 read 0x02e3eb thru 0x031805 (0x341b bytes) 000137 1780808321.170147 write 0x023f39 thru 0x02a4d6 (0x659e bytes) 000138 1780808321.173721 write 0x039760 thru 0x03ffff (0x68a0 bytes) 000140 1780808321.175292 mapread 0x029245 thru 0x02a5d9 (0x1395 bytes) 000143 1780808321.177249 read 0x00b783 thru 0x00fc65 (0x44e3 bytes) 000144 1780808321.181888 mapwrite 0x011353 thru 0x01eb83 (0xd831 bytes) 000145 1780808321.201992 read 0x02809f thru 0x029aa9 (0x1a0b bytes) 000146 1780808321.204836 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x2e17f30a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb7967fbd Mirror 4: 0xb7967fbd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000147 1780808321.474653 mapwrite 0x029fcf thru 0x02e155 (0x4187 bytes) 000151 1780808321.531626 write 0x039c92 thru 0x03ffff (0x636e bytes) 000152 1780808321.536057 mapread 0x03a88f thru 0x03f815 (0x4f87 bytes) 000153 1780808321.537148 read 0x03a1ef thru 0x03d852 (0x3664 bytes) 000154 1780808321.537774 trunc from 0x040000 to 0x0183bf (0x27c40 bytes) 000156 1780808321.552258 write 0x00cb6f thru 0x014f69 (0x83fb bytes) 000157 1780808321.558045 MIRROR_RESYNC 3 mirrors 000159 1780808321.760457 read 0x0097e8 thru 0x00dd87 (0x45a0 bytes) 000160 1780808321.763647 mapread 0x0096e3 thru 0x00ff2f (0x684d bytes) 000161 1780808321.767982 write 0x01066e thru 0x011c70 (0x1603 bytes) truncating to largest ever: 0x3e98c 000162 1780808321.791643 trunc from 0x0183c0 to 0x03e98b (0x265cc bytes) 000165 1780808321.805230 trunc from 0x03e98c to 0x01b731 (0x2325a bytes) 000166 1780808321.810821 read 0x0069f7 thru 0x0121c4 (0xb7ce bytes) 000167 1780808321.815946 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b732): Mirror 3: 0x33b7a996 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b732): Mirror 3: 0x33b7a996 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b732: skipped 000173 1780808321.912986 read 0x01af4f thru 0x01b731 (0x7e3 bytes) 000176 1780808321.917881 mapread 0x014d55 thru 0x0186b0 (0x395c bytes) 000177 1780808321.926579 write 0x03b1dc thru 0x03ffff (0x4e24 bytes) 000178 1780808321.929940 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd398477a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4799e88b Mirror 4: 0x4799e88b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000179 1780808322.184544 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd398477a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4799e88b Mirror 4: 0x4799e88b Mirror 5: 0x4799e88b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped truncating to largest ever: 0x3f087 000182 1780808322.425523 trunc from 0x040000 to 0x03f086 (0xf79 bytes) 000183 1780808322.451340 mapread 0x02bb75 thru 0x02f8f7 (0x3d83 bytes) 000185 1780808322.460303 read 0x027052 thru 0x0281f9 (0x11a8 bytes) 000188 1780808322.464077 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3f087): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f087): Mirror 3: 0xe8a4f47d (stale) Mirror 4: 0x8fb5b4a1 (stale) Mirror 5: 0x8fb5b4a1 (stale) CRC-32 checksum value for chunk [0, 0x3f087): Mirror 1: 0x8fb5b4a1 Mirror 6: 0x8fb5b4a1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f087: skipped 000191 1780808322.720693 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f087): Mirror 3: 0xe8a4f47d (stale) Mirror 4: 0x8fb5b4a1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f087): Mirror 3: 0xe8a4f47d (stale) Mirror 4: 0x8fb5b4a1 (stale) CRC-32 checksum value for chunk [0, 0x3f087): Mirror 1: 0x8fb5b4a1 Mirror 6: 0x8fb5b4a1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f087: skipped 000193 1780808322.912607 mapread 0x020e90 thru 0x02abbb (0x9d2c bytes) 000196 1780808322.919510 trunc from 0x03f087 to 0x02e1f0 (0x10e96 bytes) 000197 1780808322.945169 read 0x00819b thru 0x008848 (0x6ae bytes) 000198 1780808322.947655 mapwrite 0x003d57 thru 0x009758 (0x5a02 bytes) 000199 1780808322.970273 mapwrite 0x03b0d8 thru 0x03ffff (0x4f28 bytes) 000201 1780808323.000971 write 0x028b99 thru 0x0358f3 (0xcd5b bytes) 000204 1780808323.006298 mapread 0x008ccc thru 0x00b3d8 (0x270d bytes) 000205 1780808323.007381 trunc from 0x040000 to 0x027d6d (0x18292 bytes) 000206 1780808323.015558 mapread 0x00d0e6 thru 0x00d70e (0x629 bytes) 000207 1780808323.016459 trunc from 0x027d6e to 0x02bff6 (0x4289 bytes) 000208 1780808323.021800 read 0x011b21 thru 0x013524 (0x1a04 bytes) 000209 1780808323.025850 mapwrite 0x026e10 thru 0x031423 (0xa614 bytes) 000213 1780808323.052227 write 0x02215a thru 0x024090 (0x1f37 bytes) 000214 1780808323.053287 read 0x016f59 thru 0x025a8d (0xeb35 bytes) 000217 1780808323.054861 mapwrite 0x039923 thru 0x03ffff (0x66dd bytes) 000218 1780808323.082203 write 0x02a641 thru 0x031e6a (0x782a bytes) 000219 1780808323.083094 mapread 0x01a42d thru 0x01bd24 (0x18f8 bytes) 000221 1780808323.084051 trunc from 0x040000 to 0x00f009 (0x30ff6 bytes) 000222 1780808323.093868 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xf00a): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf00a): Mirror 3: 0xe5092907 (stale) Mirror 4: 0xe5092907 (stale) Mirror 6: 0xe5092907 (stale) CRC-32 checksum value for chunk [0, 0xf00a): Mirror 1: 0xed668e2f Mirror 7: 0xed668e2f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf00a: skipped 000223 1780808323.406383 write 0x01cef4 thru 0x01e459 (0x1566 bytes) 000229 1780808323.429210 mapread 0x0121ad thru 0x01e459 (0xc2ad bytes) 000231 1780808323.436326 write 0x023930 thru 0x027f1c (0x45ed bytes) 000232 1780808323.437123 mapwrite 0x02248d thru 0x030528 (0xe09c bytes) 000236 1780808323.471069 write 0x026204 thru 0x02ac35 (0x4a32 bytes) 000238 1780808323.472431 read 0x01a5a1 thru 0x01e450 (0x3eb0 bytes) 000239 1780808323.474551 MIRROR_RESYNC 5 mirrors 000241 1780808323.773465 write 0x010bb8 thru 0x01bac6 (0xaf0f bytes) 000242 1780808323.795229 write 0x00a6a6 thru 0x00bfe3 (0x193e bytes) 000244 1780808323.799486 write 0x013ade thru 0x01b968 (0x7e8b bytes) 000245 1780808323.800717 write 0x003b2e thru 0x0091cd (0x56a0 bytes) 000247 1780808323.802029 mapread 0x003f79 thru 0x00e73d (0xa7c5 bytes) 000248 1780808323.802973 trunc from 0x030529 to 0x0295c5 (0x6f63 bytes) 000251 1780808323.816380 mapwrite 0x02b5f4 thru 0x0378dc (0xc2e9 bytes) 000252 1780808323.855086 mapwrite 0x01a9fa thru 0x0270ad (0xc6b4 bytes) 000256 1780808323.880773 mapread 0x00404e thru 0x004410 (0x3c3 bytes) 000257 1780808323.881615 read 0x00519a thru 0x007707 (0x256e bytes) 000258 1780808323.884256 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x378dd): Mirror 3: 0x7ab4ae2f (stale) Mirror 4: 0x7ab4ae2f (stale) Mirror 6: 0x7ab4ae2f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x378dd): Mirror 3: 0x7ab4ae2f (stale) Mirror 4: 0x7ab4ae2f (stale) Mirror 6: 0x7ab4ae2f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x378dd: skipped 000259 1780808324.007963 mapread 0x002982 thru 0x00cea6 (0xa525 bytes) 000260 1780808324.013623 mapwrite 0x02decb thru 0x03dde7 (0xff1d bytes) 000261 1780808324.042720 read 0x00956f thru 0x012f3b (0x99cd bytes) 000262 1780808324.045351 read 0x00d4b8 thru 0x01409b (0x6be4 bytes) 000268 1780808324.050994 read 0x00959e thru 0x00ac40 (0x16a3 bytes) 000272 1780808324.052615 mapread 0x01aefd thru 0x02841d (0xd521 bytes) 000273 1780808324.053652 mapwrite 0x03ddfe thru 0x03ffff (0x2202 bytes) 000275 1780808324.078389 read 0x02be99 thru 0x02c648 (0x7b0 bytes) 000276 1780808324.081149 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x9b66abb (stale) Mirror 4: 0x9b66abb (stale) Mirror 6: 0x9b66abb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf3f5dddd Mirror 7: 0xf3f5dddd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000277 1780808324.351954 read 0x00f97f thru 0x011def (0x2471 bytes) 000278 1780808324.355319 trunc from 0x040000 to 0x005a7a (0x3a585 bytes) 000279 1780808324.384990 MIRROR_RESYNC 5 mirrors 000280 1780808324.648162 mapread 0x000ced thru 0x000e4f (0x163 bytes) 000281 1780808324.650108 mapwrite 0x00de04 thru 0x012c34 (0x4e31 bytes) 000282 1780808324.698579 trunc from 0x012c35 to 0x0190c1 (0x648d bytes) 000283 1780808324.706871 mapread 0x014c7b thru 0x0190c1 (0x4447 bytes) 000285 1780808324.713917 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x190c2): Mirror 4: 0x1b863148 (stale) Mirror 6: 0x1b863148 (stale) Mirror 7: 0x1b863148 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x190c2): Mirror 4: 0x1b863148 (stale) Mirror 6: 0x1b863148 (stale) Mirror 7: 0x1b863148 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x190c2: skipped 000287 1780808324.832903 read 0x005692 thru 0x011629 (0xbf98 bytes) 000289 1780808324.837188 write 0x00302b thru 0x010909 (0xd8df bytes) 000290 1780808324.839959 mapread 0x006a12 thru 0x00e179 (0x7768 bytes) 000291 1780808324.840887 write 0x00230a thru 0x005dec (0x3ae3 bytes) 000293 1780808324.843957 mapread 0x016281 thru 0x0190c1 (0x2e41 bytes) 000295 1780808324.848316 trunc from 0x0190c2 to 0x009898 (0xf829 bytes) 000298 1780808324.857443 mapread 0x00988b thru 0x009898 (0xe bytes) 000300 1780808324.858471 write 0x01581c thru 0x0178ab (0x2090 bytes) 000301 1780808324.859383 mapread 0x00a76a thru 0x013b87 (0x941e bytes) 000302 1780808324.867799 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x178ac): Mirror 4: 0xf691f1f5 (stale) Mirror 7: 0xf691f1f5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x178ac): Mirror 4: 0xf691f1f5 (stale) Mirror 7: 0xf691f1f5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x178ac: skipped 000303 1780808324.968500 write 0x002761 thru 0x008ff3 (0x6893 bytes) 000304 1780808324.971993 read 0x00bfdf thru 0x013800 (0x7822 bytes) truncating to largest ever: 0x3f5f6 000305 1780808324.975075 trunc from 0x0178ac to 0x03f5f5 (0x27d4a bytes) 000306 1780808324.980104 read 0x03d075 thru 0x03f5f5 (0x2581 bytes) 000307 1780808324.984451 read 0x030892 thru 0x03652e (0x5c9d bytes) 000308 1780808324.985093 trunc from 0x03f5f6 to 0x0383d1 (0x7224 bytes) 000311 1780808324.993404 mapwrite 0x0338ce thru 0x03444e (0xb81 bytes) 000314 1780808325.011112 write 0x0248d7 thru 0x02e616 (0x9d40 bytes) 000315 1780808325.014207 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x383d2): Mirror 7: 0x9e633002 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x383d2): Mirror 7: 0x9e633002 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x383d2: skipped 000316 1780808325.104849 mapwrite 0x038bda thru 0x03ffff (0x7426 bytes) 000317 1780808325.138990 write 0x0054dc thru 0x00b7e9 (0x630e bytes) 000318 1780808325.144096 mapwrite 0x02ff7c thru 0x03f302 (0xf387 bytes) 000319 1780808325.166421 read 0x03a700 thru 0x03ffff (0x5900 bytes) 000320 1780808325.168916 MIRROR_RESYNC 2 mirrors 000322 1780808325.369350 trunc from 0x040000 to 0x021741 (0x1e8be bytes) 000323 1780808325.402298 read 0x008863 thru 0x016ade (0xe27c bytes) 000325 1780808325.407770 mapread 0x016b9a thru 0x01770b (0xb72 bytes) 000326 1780808325.410638 write 0x0198b3 thru 0x027647 (0xdd95 bytes) 000327 1780808325.413823 write 0x01f0fb thru 0x025a0e (0x6914 bytes) 000328 1780808325.414841 write 0x007983 thru 0x01436b (0xc9e9 bytes) 000330 1780808325.421292 write 0x01075c thru 0x01c094 (0xb939 bytes) 000332 1780808325.423160 write 0x01eb2d thru 0x028ed0 (0xa3a4 bytes) 000333 1780808325.426254 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) 000335 1780808325.483762 read 0x01d05e thru 0x024f91 (0x7f34 bytes) 000337 1780808325.488289 read 0x023acc thru 0x028ed0 (0x5405 bytes) 000338 1780808325.493204 mapread 0x028390 thru 0x028ed0 (0xb41 bytes) 000339 1780808325.493943 trunc from 0x028ed1 to 0x021358 (0x7b78 bytes) 000340 1780808325.500341 trunc from 0x021359 to 0x032b42 (0x117ea bytes) 000341 1780808325.508399 mapwrite 0x03e031 thru 0x03ffff (0x1fcf bytes) 000342 1780808325.538052 read 0x00fec8 thru 0x012341 (0x247a bytes) 000343 1780808325.538703 trunc from 0x040000 to 0x0293e0 (0x16c1f bytes) 000344 1780808325.544268 write 0x03acb9 thru 0x03ffff (0x5347 bytes) 000345 1780808325.548788 MIRROR_EXTEND to 2 mirrors 000346 1780808325.722811 write 0x012059 thru 0x01ca11 (0xa9b9 bytes) 000348 1780808325.747696 write 0x010867 thru 0x01451e (0x3cb8 bytes) 000351 1780808325.752085 trunc from 0x040000 to 0x01f26e (0x20d91 bytes) 000354 1780808325.769660 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) 000360 1780808325.837155 mapread 0x017618 thru 0x018c3b (0x1624 bytes) 000361 1780808325.841437 mapwrite 0x02a405 thru 0x036ec1 (0xcabd bytes) 000362 1780808325.870872 mapread 0x00e58b thru 0x01d347 (0xedbd bytes) 000368 1780808325.885333 MIRROR_EXTEND to 2 mirrors 000370 1780808326.064009 mapwrite 0x01d382 thru 0x02849f (0xb11e bytes) 000376 1780808326.134256 mapwrite 0x015ab6 thru 0x01ec46 (0x9191 bytes) 000377 1780808326.156623 mapread 0x029e1a thru 0x03679c (0xc983 bytes) 000378 1780808326.161039 trunc from 0x036ec2 to 0x02c29d (0xac24 bytes) 000379 1780808326.177154 mapread 0x028ead thru 0x02c29d (0x33f1 bytes) 000383 1780808326.179546 read 0x017627 thru 0x026535 (0xef0f bytes) 000384 1780808326.180233 write 0x00e6e5 thru 0x0173f2 (0x8d0e bytes) 000385 1780808326.181207 read 0x001050 thru 0x008129 (0x70da bytes) 000386 1780808326.186187 write 0x004396 thru 0x009bb1 (0x581c bytes) 000388 1780808326.187408 mapread 0x01aa5a thru 0x01cd9a (0x2341 bytes) 000389 1780808326.188096 mapread 0x01aabb thru 0x029c79 (0xf1bf bytes) 000390 1780808326.188976 mapread 0x01e91b thru 0x023ba2 (0x5288 bytes) 000391 1780808326.189849 mapread 0x020cf7 thru 0x02544f (0x4759 bytes) 000393 1780808326.191294 trunc from 0x02c29e to 0x019b61 (0x1273c bytes) 000394 1780808326.199847 trunc from 0x019b62 to 0x0275f5 (0xda94 bytes) 000395 1780808326.206483 write 0x013216 thru 0x013839 (0x624 bytes) 000396 1780808326.207139 read 0x00dbb8 thru 0x0119e6 (0x3e2f bytes) 000398 1780808326.208338 write 0x021239 thru 0x0295d7 (0x839f bytes) 000399 1780808326.213042 write 0x024847 thru 0x026cfe (0x24b8 bytes) 000402 1780808326.214955 read 0x00f040 thru 0x014c17 (0x5bd8 bytes) 000403 1780808326.217591 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x295d8): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x295d8): Mirror 2: 0xbad08ba6 (stale) CRC-32 checksum value for chunk [0, 0x295d8): Mirror 1: 0x5137e124 Mirror 3: 0x5137e124 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x295d8: skipped 000404 1780808326.480120 read 0x011900 thru 0x01458e (0x2c8f bytes) 000406 1780808326.483236 mapread 0x0005f1 thru 0x00aa0f (0xa41f bytes) 000409 1780808326.491866 mapread 0x0181af thru 0x01e4e2 (0x6334 bytes) 000410 1780808326.496628 trunc from 0x0295d8 to 0x02ef47 (0x5970 bytes) 000411 1780808326.534996 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ef48): Mirror 3: 0x63aad719 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ef48): Mirror 3: 0x63aad719 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ef48: skipped 000412 1780808326.630761 write 0x02cca7 thru 0x0318b9 (0x4c13 bytes) 000413 1780808326.632899 read 0x02aff6 thru 0x02ed0f (0x3d1a bytes) 000416 1780808326.635683 trunc from 0x0318ba to 0x013795 (0x1e124 bytes) 000418 1780808326.642205 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x13796): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13796): Mirror 3: 0xe8192d24 (stale) CRC-32 checksum value for chunk [0, 0x13796): Mirror 1: 0xe8192d24 Mirror 4: 0xe8192d24 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13796: skipped 000420 1780808326.876088 write 0x02ecda thru 0x03143f (0x2766 bytes) 000422 1780808326.900521 mapwrite 0x0327f8 thru 0x03ffff (0xd808 bytes) 000423 1780808326.944443 write 0x039ac8 thru 0x03a38d (0x8c6 bytes) 000425 1780808326.947694 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xbf7e5aa3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xbf7e5aa3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000427 1780808327.049013 trunc from 0x040000 to 0x03e284 (0x1d7b bytes) 000429 1780808327.056785 trunc from 0x03e285 to 0x00558b (0x38cf9 bytes) 000430 1780808327.065354 mapwrite 0x012a98 thru 0x013819 (0xd82 bytes) 000431 1780808327.089392 read 0x00be1b thru 0x010379 (0x455f bytes) 000435 1780808327.093636 mapwrite 0x007607 thru 0x0155b0 (0xdfaa bytes) 000436 1780808327.122707 mapread 0x00a1a5 thru 0x0155b0 (0xb40c bytes) 000437 1780808327.123901 mapread 0x002f64 thru 0x0036c5 (0x762 bytes) 000438 1780808327.124845 mapwrite 0x001748 thru 0x00b262 (0x9b1b bytes) 000440 1780808327.141072 read 0x001dc7 thru 0x00959a (0x77d4 bytes) 000441 1780808327.141733 read 0x006c38 thru 0x00b0ad (0x4476 bytes) 000445 1780808327.143169 write 0x03472c thru 0x03ffff (0xb8d4 bytes) 000446 1780808327.144050 read 0x00b839 thru 0x0124e3 (0x6cab bytes) 000447 1780808327.144470 read 0x03b0b0 thru 0x03c947 (0x1898 bytes) 000448 1780808327.144866 write 0x038458 thru 0x03ffff (0x7ba8 bytes) 000450 1780808327.145844 mapwrite 0x020fa5 thru 0x021b1b (0xb77 bytes) 000451 1780808327.161353 read 0x018382 thru 0x01a0e4 (0x1d63 bytes) 000452 1780808327.162022 trunc from 0x040000 to 0x002827 (0x3d7d8 bytes) 000453 1780808327.167727 mapread 0x000f16 thru 0x002827 (0x1912 bytes) 000456 1780808327.169150 write 0x02089d thru 0x020dee (0x552 bytes) 000458 1780808327.170200 read 0x00e76b thru 0x01289b (0x4131 bytes) 000460 1780808327.173793 mapread 0x010a5e thru 0x01ac3b (0xa1de bytes) 000462 1780808327.175018 write 0x03cd69 thru 0x03ffff (0x3297 bytes) 000463 1780808327.175874 trunc from 0x040000 to 0x026278 (0x19d87 bytes) 000465 1780808327.181337 write 0x01c82c thru 0x026417 (0x9bec bytes) 000466 1780808327.184411 write 0x01585f thru 0x01e901 (0x90a3 bytes) 000467 1780808327.185432 trunc from 0x026418 to 0x01426d (0x121aa bytes) 000468 1780808327.190600 mapwrite 0x006899 thru 0x006d22 (0x48a bytes) 000470 1780808327.203561 mapread 0x0034eb thru 0x00f56b (0xc081 bytes) 000471 1780808327.206771 MIRROR_RESYNC 2 mirrors 000472 1780808327.374201 write 0x002b60 thru 0x003bdf (0x1080 bytes) 000473 1780808327.394951 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) 000475 1780808327.436311 read 0x00f1c5 thru 0x0124b0 (0x32ec bytes) 000477 1780808327.439341 write 0x034a77 thru 0x03e02b (0x95b5 bytes) 000480 1780808327.442148 write 0x01d7be thru 0x01fcf9 (0x253c bytes) 000481 1780808327.445721 mapwrite 0x019367 thru 0x01ff99 (0x6c33 bytes) 000485 1780808327.465924 mapwrite 0x0054a9 thru 0x00ee3f (0x9997 bytes) 000488 1780808327.485124 mapwrite 0x00c1ef thru 0x0185b4 (0xc3c6 bytes) 000491 1780808327.501786 mapwrite 0x005dc7 thru 0x006c3a (0xe74 bytes) 000494 1780808327.514722 mapwrite 0x03f5f7 thru 0x03ffff (0xa09 bytes) 000495 1780808327.542532 read 0x00bd9c thru 0x00e4e6 (0x274b bytes) 000497 1780808327.543539 mapread 0x01f8f0 thru 0x02b5fb (0xbd0c bytes) 000498 1780808327.548873 read 0x03f7d4 thru 0x03ffff (0x82c bytes) 000502 1780808327.550742 read 0x02c713 thru 0x031c6d (0x555b bytes) 000503 1780808327.551343 mapread 0x036292 thru 0x038bb8 (0x2927 bytes) 000504 1780808327.552215 mapread 0x03a174 thru 0x03ffff (0x5e8c bytes) 000505 1780808327.552882 mapwrite 0x014a30 thru 0x0196ce (0x4c9f bytes) 000507 1780808327.568604 write 0x029cb0 thru 0x02d6e7 (0x3a38 bytes) 000510 1780808327.570414 mapwrite 0x0325e7 thru 0x03acc4 (0x86de bytes) 000511 1780808327.586481 write 0x01fc79 thru 0x0237c1 (0x3b49 bytes) 000512 1780808327.587453 mapread 0x01a809 thru 0x024abd (0xa2b5 bytes) 000513 1780808327.588273 mapwrite 0x00e68b thru 0x013226 (0x4b9c bytes) 000515 1780808327.604783 mapwrite 0x00fd9a thru 0x01b2cd (0xb534 bytes) 000517 1780808327.622954 read 0x004031 thru 0x007177 (0x3147 bytes) 000519 1780808327.623900 mapwrite 0x0005d9 thru 0x00e670 (0xe098 bytes) 000522 1780808327.642772 MIRROR_EXTEND to 2 mirrors 000523 1780808327.804975 trunc from 0x040000 to 0x02a28a (0x15d75 bytes) 000525 1780808327.829447 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2a28b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a28b): Mirror 2: 0x913c0aa3 (stale) CRC-32 checksum value for chunk [0, 0x2a28b): Mirror 1: 0x913c0aa3 Mirror 3: 0x913c0aa3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a28b: skipped 000526 1780808328.033508 read 0x01712c thru 0x019aa2 (0x2977 bytes) 000527 1780808328.035930 write 0x029549 thru 0x03234b (0x8e03 bytes) 000528 1780808328.060653 read 0x01f71a thru 0x0222c4 (0x2bab bytes) 000529 1780808328.067967 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3234c): Mirror 2: 0xef9d3f69 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3234c): Mirror 2: 0xef9d3f69 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3234c: skipped 000530 1780808328.165894 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) 000531 1780808328.211733 mapwrite 0x00e14b thru 0x01bee7 (0xdd9d bytes) 000532 1780808328.244465 mapread 0x0038b9 thru 0x011cf0 (0xe438 bytes) 000534 1780808328.251067 MIRROR_EXTEND to 2 mirrors 000535 1780808328.437174 write 0x01373e thru 0x01bd6d (0x8630 bytes) 000536 1780808328.461786 trunc from 0x03234c to 0x01ee2f (0x1351c bytes) 000537 1780808328.472334 mapread 0x01ccf6 thru 0x01ee2f (0x213a bytes) 000538 1780808328.475227 read 0x00b7e0 thru 0x012e52 (0x7673 bytes) 000540 1780808328.478274 trunc from 0x01ee30 to 0x03110a (0x122db bytes) 000541 1780808328.483114 mapread 0x003d32 thru 0x008bdf (0x4eae bytes) 000542 1780808328.486468 mapwrite 0x03fedc thru 0x03ffff (0x124 bytes) 000545 1780808328.509755 write 0x0211f4 thru 0x023ecc (0x2cd9 bytes) 000546 1780808328.515400 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) 000551 1780808328.559654 trunc from 0x040000 to 0x00e52f (0x31ad0 bytes) 000553 1780808328.566533 read 0x005c9a thru 0x007190 (0x14f7 bytes) 000555 1780808328.571176 MIRROR_EXTEND to 2 mirrors 000556 1780808328.743445 MIRROR_RESYNC 2 mirrors 000559 1780808328.848817 trunc from 0x00e530 to 0x03c293 (0x2dd64 bytes) 000563 1780808328.878959 mapread 0x033fc9 thru 0x03c293 (0x82cb bytes) 000564 1780808328.886541 mapread 0x00048d thru 0x00a14c (0x9cc0 bytes) 000565 1780808328.890652 trunc from 0x03c294 to 0x03b245 (0x104e bytes) 000566 1780808328.898133 read 0x019c67 thru 0x01a461 (0x7fb bytes) 000567 1780808328.900792 mapwrite 0x002f51 thru 0x003232 (0x2e2 bytes) 000570 1780808328.924657 write 0x03157d thru 0x03df08 (0xc98c bytes) 000571 1780808328.926077 mapwrite 0x00017d thru 0x007867 (0x76eb bytes) 000574 1780808328.949315 MIRROR_RESYNC 2 mirrors 000575 1780808329.120419 MIRROR_EXTEND to 3 mirrors 000576 1780808329.308637 mapwrite 0x032940 thru 0x03fe9b (0xd55c bytes) 000578 1780808329.358761 mapread 0x01c127 thru 0x01c370 (0x24a bytes) 000580 1780808329.362942 read 0x005150 thru 0x00a622 (0x54d3 bytes) 000582 1780808329.368050 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fe9c): Mirror 2: 0xf879ab08 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fe9c): Mirror 2: 0xf879ab08 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fe9c: skipped 000583 1780808329.454762 write 0x03e2fb thru 0x03ffff (0x1d05 bytes) 000585 1780808329.457844 mapwrite 0x009e7f thru 0x00a51b (0x69d bytes) 000586 1780808329.480188 mapwrite 0x019769 thru 0x0206c4 (0x6f5c bytes) 000587 1780808329.500595 mapwrite 0x00c277 thru 0x00d4ea (0x1274 bytes) 000588 1780808329.512840 read 0x03dae5 thru 0x03ffff (0x251b bytes) 000589 1780808329.517207 write 0x03e391 thru 0x03ffff (0x1c6f bytes) 000590 1780808329.518165 mapread 0x010c7f thru 0x01167a (0x9fc bytes) 000591 1780808329.518872 trunc from 0x040000 to 0x007d75 (0x3828a bytes) 000592 1780808329.525146 mapwrite 0x00db42 thru 0x01a78d (0xcc4c bytes) 000594 1780808329.555588 mapread 0x013bc7 thru 0x018547 (0x4981 bytes) 000595 1780808329.556500 mapread 0x00202b thru 0x00ca94 (0xaa6a bytes) 000596 1780808329.559773 MIRROR_RESYNC 2 mirrors 000599 1780808329.758084 trunc from 0x01a78e to 0x038f9f (0x1e812 bytes) 000600 1780808329.796928 read 0x03781d thru 0x038f9f (0x1783 bytes) 000602 1780808329.800694 mapread 0x0231bd thru 0x031ac2 (0xe906 bytes) 000603 1780808329.812806 read 0x0210d5 thru 0x027aa3 (0x69cf bytes) 000604 1780808329.813270 mapwrite 0x039c38 thru 0x03ffff (0x63c8 bytes) 000605 1780808329.841215 trunc from 0x040000 to 0x03921a (0x6de5 bytes) 000606 1780808329.847066 trunc from 0x03921b to 0x032bfb (0x661f bytes) 000608 1780808329.853387 read 0x01744f thru 0x01802a (0xbdc bytes) 000609 1780808329.855873 MIRROR_RESYNC 2 mirrors 000610 1780808330.047255 write 0x03c613 thru 0x03ffff (0x39ed bytes) 000612 1780808330.067630 write 0x0343cb thru 0x037ef9 (0x3b2f bytes) 000613 1780808330.073243 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) 000616 1780808330.122354 write 0x00991b thru 0x00ec2a (0x5310 bytes) 000617 1780808330.125624 trunc from 0x040000 to 0x0291ea (0x16e15 bytes) 000618 1780808330.134983 read 0x0197c5 thru 0x023a2a (0xa266 bytes) 000621 1780808330.139237 read 0x025da1 thru 0x028acc (0x2d2c bytes) 000622 1780808330.142549 trunc from 0x0291eb to 0x02d2b0 (0x40c6 bytes) 000624 1780808330.147960 trunc from 0x02d2b1 to 0x00f5d2 (0x1dcde bytes) 000625 1780808330.154497 MIRROR_EXTEND to 2 mirrors 000627 1780808330.340922 read 0x0072ef thru 0x00eed4 (0x7be6 bytes) 000628 1780808330.344491 mapread 0x0074e0 thru 0x00f5d2 (0x80f3 bytes) 000629 1780808330.347293 mapread 0x004e46 thru 0x00f5d2 (0xa78d bytes) 000630 1780808330.353162 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) 000631 1780808330.395817 read 0x00c60d thru 0x00f5d2 (0x2fc6 bytes) 000634 1780808330.399186 mapread 0x00075d thru 0x009780 (0x9024 bytes) 000639 1780808330.409401 read 0x00f0ae thru 0x00f5d2 (0x525 bytes) 000641 1780808330.410620 mapwrite 0x00cb8f thru 0x014903 (0x7d75 bytes) 000644 1780808330.449428 mapread 0x00387e thru 0x00fa9d (0xc220 bytes) 000645 1780808330.450474 read 0x005923 thru 0x011f7d (0xc65b bytes) 000647 1780808330.451373 mapwrite 0x03aa76 thru 0x03ffff (0x558a bytes) 000648 1780808330.475834 mapread 0x0394f3 thru 0x03ffff (0x6b0d bytes) 000655 1780808330.479852 mapwrite 0x03ecc6 thru 0x03ffff (0x133a bytes) 000657 1780808330.493834 mapread 0x0135d9 thru 0x0181ad (0x4bd5 bytes) 000661 1780808330.496480 write 0x00e68a thru 0x01470a (0x6081 bytes) 000662 1780808330.497581 write 0x032d7b thru 0x035f61 (0x31e7 bytes) 000663 1780808330.498630 mapwrite 0x03766a thru 0x03f2f3 (0x7c8a bytes) 000664 1780808330.518592 write 0x03b8ea thru 0x03ffff (0x4716 bytes) 000666 1780808330.520087 mapwrite 0x0025b6 thru 0x006edb (0x4926 bytes) 000668 1780808330.540820 write 0x038bbd thru 0x03ffff (0x7443 bytes) 000671 1780808330.542923 trunc from 0x040000 to 0x035588 (0xaa77 bytes) 000672 1780808330.550050 write 0x0364ea thru 0x03ea43 (0x855a bytes) 000674 1780808330.551728 read 0x004f42 thru 0x00ee2a (0x9ee9 bytes) 000676 1780808330.552917 mapwrite 0x00efa1 thru 0x012054 (0x30b4 bytes) 000678 1780808330.570738 trunc from 0x03ea44 to 0x0300a3 (0xe9a0 bytes) 000683 1780808330.578278 mapwrite 0x0375ac thru 0x03ffff (0x8a54 bytes) 000685 1780808330.603609 mapread 0x021d9f thru 0x02f7e9 (0xda4b bytes) 000689 1780808330.607281 mapwrite 0x03d776 thru 0x03dba7 (0x432 bytes) 000690 1780808330.620153 mapwrite 0x0240ed thru 0x02ea3a (0xa94e bytes) 000691 1780808330.635739 trunc from 0x040000 to 0x03c44e (0x3bb1 bytes) 000694 1780808330.642991 mapwrite 0x02f5e4 thru 0x035207 (0x5c24 bytes) 000695 1780808330.659815 mapwrite 0x03095e thru 0x03f442 (0xeae5 bytes) 000697 1780808330.687867 read 0x02936e thru 0x031b60 (0x87f3 bytes) 000699 1780808330.688916 trunc from 0x03f443 to 0x004160 (0x3b2e2 bytes) 000700 1780808330.695080 mapread 0x0008c8 thru 0x0036c8 (0x2e01 bytes) 000701 1780808330.696074 mapread 0x0037a1 thru 0x004160 (0x9c0 bytes) 000702 1780808330.696911 write 0x03108d thru 0x03e6e3 (0xd657 bytes) 000703 1780808330.698298 write 0x030889 thru 0x03b658 (0xadd0 bytes) 000705 1780808330.702883 read 0x00275e thru 0x00fbd9 (0xd47c bytes) 000708 1780808330.704188 trunc from 0x03e6e4 to 0x01c5b6 (0x2212d bytes) 000711 1780808330.710766 mapread 0x007d04 thru 0x010e0d (0x910a bytes) 000714 1780808330.712389 mapread 0x01c1c5 thru 0x01c5b6 (0x3f2 bytes) 000715 1780808330.713096 read 0x00fb3c thru 0x01072b (0xbf0 bytes) 000717 1780808330.714017 trunc from 0x01c5b7 to 0x0269c6 (0xa410 bytes) 000726 1780808330.722550 mapwrite 0x018661 thru 0x022f5e (0xa8fe bytes) 000727 1780808330.740400 trunc from 0x0269c7 to 0x01cfc4 (0x9a02 bytes) 000728 1780808330.745505 trunc from 0x01cfc5 to 0x037927 (0x1a963 bytes) 000729 1780808330.750201 mapwrite 0x014a21 thru 0x020407 (0xb9e7 bytes) 000731 1780808330.773789 write 0x004ee5 thru 0x00aa54 (0x5b70 bytes) 000732 1780808330.774658 mapwrite 0x01708e thru 0x023fe8 (0xcf5b bytes) 000735 1780808330.797590 trunc from 0x037928 to 0x026fd4 (0x10953 bytes) 000736 1780808330.803539 trunc from 0x026fd5 to 0x01b50b (0xbac9 bytes) 000739 1780808330.809653 mapwrite 0x034fd7 thru 0x03a232 (0x525c bytes) 000740 1780808330.837161 write 0x01b3d9 thru 0x02016c (0x4d94 bytes) 000741 1780808330.839701 write 0x02bcf6 thru 0x035265 (0x9570 bytes) 000743 1780808330.842538 write 0x013354 thru 0x01363a (0x2e7 bytes) 000744 1780808330.843246 write 0x010cd0 thru 0x01e19f (0xd4d0 bytes) 000746 1780808330.844797 write 0x02b1f1 thru 0x02faa4 (0x48b4 bytes) 000747 1780808330.845401 write 0x03df92 thru 0x03ffff (0x206e bytes) 000749 1780808330.846836 read 0x027079 thru 0x027afd (0xa85 bytes) 000750 1780808330.850227 trunc from 0x040000 to 0x020efc (0x1f103 bytes) 000752 1780808330.856252 mapwrite 0x015673 thru 0x015cad (0x63b bytes) 000753 1780808330.870449 write 0x03272f thru 0x03ffff (0xd8d1 bytes) 000755 1780808330.872294 mapread 0x026d49 thru 0x02ed26 (0x7fde bytes) 000756 1780808330.885726 trunc from 0x040000 to 0x034e26 (0xb1d9 bytes) 000757 1780808330.891564 mapread 0x015e3b thru 0x0185e4 (0x27aa bytes) 000758 1780808330.894815 MIRROR_EXTEND to 2 mirrors 000760 1780808331.104892 mapread 0x02d504 thru 0x034e26 (0x7923 bytes) 000762 1780808331.120878 trunc from 0x034e27 to 0x0344b3 (0x973 bytes) 000763 1780808331.144365 write 0x004f78 thru 0x007e3e (0x2ec7 bytes) 000764 1780808331.147503 mapread 0x0332c4 thru 0x0344b3 (0x11f0 bytes) 000765 1780808331.152345 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) 000766 1780808331.192732 mapread 0x01f90b thru 0x026685 (0x6d7b bytes) 000767 1780808331.200120 write 0x017701 thru 0x01c5da (0x4eda bytes) 000771 1780808331.205555 write 0x023838 thru 0x0286f8 (0x4ec1 bytes) 000773 1780808331.206608 mapwrite 0x03b2dc thru 0x03ffff (0x4d24 bytes) 000774 1780808331.234815 write 0x03158f thru 0x036959 (0x53cb bytes) 000776 1780808331.239643 write 0x03e1d8 thru 0x03ffff (0x1e28 bytes) 000778 1780808331.240936 mapread 0x011d71 thru 0x017b2e (0x5dbe bytes) 000779 1780808331.241806 mapwrite 0x003f4d thru 0x00f220 (0xb2d4 bytes) 000783 1780808331.262239 read 0x03133d thru 0x031646 (0x30a bytes) 000785 1780808331.263415 mapwrite 0x0303f0 thru 0x038a74 (0x8685 bytes) 000788 1780808331.280484 mapread 0x01b75b thru 0x02043a (0x4ce0 bytes) 000789 1780808331.281406 trunc from 0x040000 to 0x03c3d9 (0x3c26 bytes) 000797 1780808331.290728 write 0x0387e7 thru 0x0395fb (0xe15 bytes) 000798 1780808331.291472 write 0x035561 thru 0x037532 (0x1fd2 bytes) 000799 1780808331.294207 MIRROR_EXTEND to 2 mirrors 000800 1780808331.476905 mapwrite 0x0313d7 thru 0x031b98 (0x7c2 bytes) 000801 1780808331.527772 mapwrite 0x011695 thru 0x0157d6 (0x4142 bytes) 000802 1780808331.542598 read 0x03998d thru 0x03c3d9 (0x2a4d bytes) 000804 1780808331.545348 mapread 0x02b933 thru 0x030a1e (0x50ec bytes) 000805 1780808331.548790 mapwrite 0x027220 thru 0x02d031 (0x5e12 bytes) 000806 1780808331.561855 mapwrite 0x011a14 thru 0x020f52 (0xf53f bytes) 000807 1780808331.579526 write 0x01d359 thru 0x022c3e (0x58e6 bytes) 000809 1780808331.581285 trunc from 0x03c3da to 0x01aec3 (0x21516 bytes) 000810 1780808331.588097 trunc from 0x01aec4 to 0x03add6 (0x1ff13 bytes) 000812 1780808331.592885 trunc from 0x03add7 to 0x038368 (0x2a6e bytes) 000815 1780808331.599045 MIRROR_RESYNC 2 mirrors 000816 1780808331.756410 mapread 0x00da9b thru 0x0156d7 (0x7c3d bytes) 000818 1780808331.762655 read 0x004fcf thru 0x00bd6c (0x6d9e bytes) 000819 1780808331.764655 mapread 0x00c8c2 thru 0x01b291 (0xe9d0 bytes) 000821 1780808331.768141 mapread 0x01d2c2 thru 0x0235cd (0x630c bytes) 000822 1780808331.771067 write 0x02b672 thru 0x02cf6a (0x18f9 bytes) 000825 1780808331.790772 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x38369): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38369): Mirror 2: 0xdeda13ba (stale) CRC-32 checksum value for chunk [0, 0x38369): Mirror 1: 0xc70858c7 Mirror 3: 0xc70858c7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38369: skipped 000826 1780808332.002040 mapwrite 0x0305fa thru 0x03aec5 (0xa8cc bytes) 000828 1780808332.049908 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3aec6): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aec6): Mirror 2: 0x3177651 (stale) Mirror 3: 0x45bbed3f (stale) CRC-32 checksum value for chunk [0, 0x3aec6): Mirror 1: 0xf49f1e08 Mirror 4: 0xf49f1e08 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aec6: skipped 000829 1780808332.265336 MIRROR_RESYNC 4 mirrors 000830 1780808332.468146 trunc from 0x03aec6 to 0x02b093 (0xfe32 bytes) 000831 1780808332.493573 trunc from 0x02b094 to 0x018220 (0x12e73 bytes) 000832 1780808332.500217 mapread 0x011e09 thru 0x017ff7 (0x61ef bytes) 000833 1780808332.506575 trunc from 0x018221 to 0x031618 (0x193f8 bytes) 000834 1780808332.511865 mapread 0x01c2cd thru 0x02bc2e (0xf962 bytes) 000836 1780808332.518372 read 0x00199b thru 0x00406b (0x26d1 bytes) 000837 1780808332.522503 MIRROR_RESYNC 4 mirrors 000839 1780808332.765409 read 0x0187a1 thru 0x01dc64 (0x54c4 bytes) 000841 1780808332.769509 mapwrite 0x0241d4 thru 0x028199 (0x3fc6 bytes) 000844 1780808332.839373 mapread 0x01a424 thru 0x020c07 (0x67e4 bytes) 000845 1780808332.844446 mapread 0x0092ee thru 0x0126b0 (0x93c3 bytes) 000847 1780808332.850807 trunc from 0x031619 to 0x02954f (0x80c9 bytes) 000849 1780808332.865196 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x29550): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29550): Mirror 2: 0xd48ba84f (stale) Mirror 3: 0xd48ba84f (stale) Mirror 4: 0xd48ba84f (stale) CRC-32 checksum value for chunk [0, 0x29550): Mirror 1: 0x2677d3c Mirror 5: 0x2677d3c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29550: skipped 000850 1780808333.113354 mapread 0x014958 thru 0x018c37 (0x42e0 bytes) 000852 1780808333.124863 mapwrite 0x000f9a thru 0x010f33 (0xff9a bytes) 000853 1780808333.207587 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29550): Mirror 2: 0xd48ba84f (stale) Mirror 3: 0xd48ba84f (stale) Mirror 4: 0xd48ba84f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29550): Mirror 2: 0xd48ba84f (stale) Mirror 3: 0xd48ba84f (stale) Mirror 4: 0xd48ba84f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29550: skipped 000855 1780808333.333314 write 0x02c73d thru 0x0344fb (0x7dbf bytes) 000856 1780808333.334521 mapread 0x028b35 thru 0x031f63 (0x942f bytes) 000858 1780808333.343355 read 0x02b571 thru 0x0309d1 (0x5461 bytes) 000861 1780808333.345080 mapwrite 0x02ab11 thru 0x035c6a (0xb15a bytes) 000865 1780808333.386812 mapread 0x0094cc thru 0x015cc3 (0xc7f8 bytes) 000870 1780808333.400279 mapread 0x0326c0 thru 0x035c6a (0x35ab bytes) 000876 1780808333.403554 write 0x003ae2 thru 0x00b76f (0x7c8e bytes) 000877 1780808333.404636 mapread 0x008a67 thru 0x0141e3 (0xb77d bytes) 000878 1780808333.405574 mapread 0x0264cf thru 0x02f9f7 (0x9529 bytes) 000879 1780808333.406635 read 0x031354 thru 0x034acb (0x3778 bytes) 000880 1780808333.407270 trunc from 0x035c6b to 0x00c369 (0x29901 bytes) 000883 1780808333.417335 read 0x00746c thru 0x00c369 (0x4efe bytes) 000885 1780808333.418913 mapread 0x001ac1 thru 0x00bb18 (0xa058 bytes) 000886 1780808333.422836 trunc from 0x00c36a to 0x00d42d (0x10c4 bytes) 000887 1780808333.429582 write 0x036f82 thru 0x0388f2 (0x1971 bytes) 000888 1780808333.431131 mapwrite 0x013caa thru 0x016a33 (0x2d8a bytes) 000889 1780808333.456436 mapwrite 0x0271e9 thru 0x02b1e6 (0x3ffe bytes) 000890 1780808333.474249 read 0x00b988 thru 0x016eb4 (0xb52d bytes) 000893 1780808333.476029 mapwrite 0x00fa85 thru 0x01128e (0x180a bytes) 000894 1780808333.491483 read 0x010f81 thru 0x017dec (0x6e6c bytes) 000897 1780808333.493249 mapwrite 0x00828d thru 0x013d6f (0xbae3 bytes) 000900 1780808333.509680 trunc from 0x0388f3 to 0x030d23 (0x7bcf bytes) 000902 1780808333.516045 read 0x0199d1 thru 0x01c7e9 (0x2e19 bytes) 000904 1780808333.519197 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x30d24): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30d24): Mirror 2: 0x9fbb638 (stale) Mirror 3: 0x9fbb638 (stale) Mirror 4: 0x9fbb638 (stale) CRC-32 checksum value for chunk [0, 0x30d24): Mirror 1: 0xd9dba86a Mirror 5: 0xd9dba86a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30d24: skipped 000906 1780808333.761874 mapwrite 0x02eebc thru 0x03ea94 (0xfbd9 bytes) 000907 1780808333.826423 write 0x00a712 thru 0x014517 (0x9e06 bytes) 000908 1780808333.831192 read 0x03e34d thru 0x03ea94 (0x748 bytes) 000909 1780808333.831809 mapwrite 0x02002c thru 0x022664 (0x2639 bytes) 000912 1780808333.851493 write 0x00a457 thru 0x016003 (0xbbad bytes) 000913 1780808333.854501 trunc from 0x03ea95 to 0x0061a4 (0x388f0 bytes) 000914 1780808333.863303 mapwrite 0x00fbda thru 0x0169ea (0x6e11 bytes) 000918 1780808333.890271 mapread 0x009435 thru 0x00c260 (0x2e2c bytes) 000919 1780808333.891028 mapwrite 0x03488b thru 0x0366bd (0x1e33 bytes) 000920 1780808333.915634 mapread 0x012bda thru 0x021277 (0xe69e bytes) 000922 1780808333.924834 mapread 0x01ecc8 thru 0x02e2aa (0xf5e3 bytes) 000923 1780808333.929215 mapwrite 0x00ce75 thru 0x018c66 (0xbdf2 bytes) 000924 1780808333.955745 MIRROR_RESYNC 5 mirrors 000926 1780808334.248432 trunc from 0x0366be to 0x014e51 (0x2186c bytes) 000928 1780808334.272716 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x14e52): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14e52): Mirror 2: 0x8454a57e (stale) Mirror 3: 0x8454a57e (stale) Mirror 4: 0x8454a57e (stale) Mirror 5: 0x8454a57e (stale) CRC-32 checksum value for chunk [0, 0x14e52): Mirror 1: 0x8454a57e Mirror 6: 0x8454a57e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14e52: skipped 000929 1780808334.569350 read 0x00f409 thru 0x014e51 (0x5a49 bytes) 000930 1780808334.572522 mapwrite 0x000b02 thru 0x008bc9 (0x80c8 bytes) 000931 1780808334.633004 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x14e52): Mirror 2: 0x8454a57e (stale) Mirror 3: 0x8454a57e (stale) Mirror 4: 0x8454a57e (stale) Mirror 5: 0x8454a57e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14e52): Mirror 2: 0x8454a57e (stale) Mirror 3: 0x8454a57e (stale) Mirror 4: 0x8454a57e (stale) Mirror 5: 0x8454a57e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14e52: skipped 000932 1780808334.762116 trunc from 0x014e52 to 0x02077c (0xb92b bytes) 000933 1780808334.767814 mapread 0x00ee27 thru 0x0196e2 (0xa8bc bytes) 000934 1780808334.779441 trunc from 0x02077d to 0x03b459 (0x1acdd bytes) 000935 1780808334.786652 write 0x00f5b9 thru 0x0178e4 (0x832c bytes) 000938 1780808334.788866 trunc from 0x03b45a to 0x017d41 (0x23718 bytes) 000940 1780808334.794762 mapread 0x00a1aa thru 0x0120c0 (0x7f17 bytes) 000941 1780808334.797915 MIRROR_RESYNC 5 mirrors 000943 1780808335.084362 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) 000944 1780808335.222332 mapread 0x00e84c thru 0x017d41 (0x94f6 bytes) 000945 1780808335.231149 trunc from 0x017d42 to 0x02e932 (0x16bf1 bytes) 000946 1780808335.260159 trunc from 0x02e933 to 0x036f55 (0x8623 bytes) 000949 1780808335.266622 trunc from 0x036f56 to 0x01a842 (0x1c713 bytes) 000953 1780808335.272514 read 0x010c65 thru 0x0159dd (0x4d79 bytes) 000954 1780808335.275163 trunc from 0x01a843 to 0x015718 (0x512a bytes) 000955 1780808335.280861 MIRROR_RESYNC 4 mirrors 000956 1780808335.525735 read 0x005656 thru 0x0148b5 (0xf260 bytes) 000957 1780808335.529238 mapread 0x0141f2 thru 0x015718 (0x1527 bytes) 000958 1780808335.532009 mapwrite 0x02deac thru 0x036152 (0x82a7 bytes) 000959 1780808335.588910 mapwrite 0x01488e thru 0x015835 (0xfa8 bytes) 000960 1780808335.608481 trunc from 0x036153 to 0x0337e3 (0x296f bytes) 000961 1780808335.616540 write 0x01c028 thru 0x027328 (0xb301 bytes) 000963 1780808335.618287 write 0x004e4e thru 0x00a182 (0x5335 bytes) 000964 1780808335.623993 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x337e4): Mirror 4: 0xb6014df7 (stale) Mirror 5: 0xb6014df7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x337e4): Mirror 4: 0xb6014df7 (stale) Mirror 5: 0xb6014df7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x337e4: skipped 000965 1780808335.729324 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x337e4): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x337e4): Mirror 4: 0xb6014df7 (stale) Mirror 5: 0xb6014df7 (stale) CRC-32 checksum value for chunk [0, 0x337e4): Mirror 1: 0x6e535868 Mirror 6: 0x6e535868 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x337e4: skipped 000967 1780808335.965865 mapread 0x013129 thru 0x01f339 (0xc211 bytes) 000968 1780808335.974326 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x337e4): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x337e4): Mirror 4: 0xb6014df7 (stale) Mirror 5: 0xb6014df7 (stale) CRC-32 checksum value for chunk [0, 0x337e4): Mirror 1: 0x6e535868 Mirror 6: 0x6e535868 Mirror 7: 0x6e535868 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x337e4: skipped 000969 1780808336.252261 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x337e4): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x337e4): Mirror 4: 0xb6014df7 (stale) Mirror 5: 0xb6014df7 (stale) CRC-32 checksum value for chunk [0, 0x337e4): Mirror 1: 0x6e535868 Mirror 6: 0x6e535868 Mirror 7: 0x6e535868 Mirror 8: 0x6e535868 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x337e4: skipped 000970 1780808336.512534 mapread 0x010314 thru 0x0187b5 (0x84a2 bytes) 000971 1780808336.519845 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x337e4): Mirror 4: 0xb6014df7 (stale) Mirror 5: 0xb6014df7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x337e4): Mirror 4: 0xb6014df7 (stale) Mirror 5: 0xb6014df7 (stale) CRC-32 checksum value for chunk [0, 0x337e4): Mirror 1: 0x6e535868 Mirror 6: 0x6e535868 Mirror 7: 0x6e535868 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x337e4: skipped 000973 1780808336.703815 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x337e4): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x337e4): Mirror 4: 0xb6014df7 (stale) Mirror 5: 0xb6014df7 (stale) CRC-32 checksum value for chunk [0, 0x337e4): Mirror 1: 0x6e535868 Mirror 6: 0x6e535868 Mirror 7: 0x6e535868 Mirror 8: 0x6e535868 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x337e4: skipped 000974 1780808336.984897 read 0x02b266 thru 0x02cb26 (0x18c1 bytes) 000975 1780808336.987369 write 0x01f58c thru 0x024c71 (0x56e6 bytes) 000977 1780808337.017691 trunc from 0x0337e4 to 0x03d996 (0xa1b3 bytes) 000979 1780808337.028926 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x4c4:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d997): Mirror 4: 0x27af92b4 (stale) Mirror 5: 0x27af92b4 (stale) Mirror 7: 0x45749077 (stale) Mirror 8: 0x45749077 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d997): Mirror 4: 0x27af92b4 (stale) Mirror 5: 0x27af92b4 (stale) Mirror 7: 0x45749077 (stale) Mirror 8: 0x45749077 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d997: skipped 000980 1780808337.173843 read 0x006b51 thru 0x012b16 (0xbfc6 bytes) 000981 1780808337.179526 mapwrite 0x039156 thru 0x03aeb0 (0x1d5b bytes) 000982 1780808337.210415 mapread 0x03807c thru 0x03d996 (0x591b bytes) 000986 1780808337.219242 write 0x01c9e0 thru 0x0200ad (0x36ce bytes) 000987 1780808337.226743 mapwrite 0x014413 thru 0x016fe7 (0x2bd5 bytes) 000988 1780808337.251226 mapread 0x014d13 thru 0x016249 (0x1537 bytes) 000992 1780808337.253647 trunc from 0x03d997 to 0x03e2b6 (0x920 bytes) 000993 1780808337.261837 mapread 0x01fea9 thru 0x022810 (0x2968 bytes) 000996 1780808337.266133 MIRROR_RESYNC 5 mirrors 000997 1780808337.643998 mapwrite 0x02178f thru 0x0219e7 (0x259 bytes) All operations completed A-OK!