== sanity-flr test 70a: flr mode fsx test ================ 22:54:23 (1789786463) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 6465 skipping zero size read 000003 1789786466.006517 MIRROR_EXTEND to 2 mirrors truncating to largest ever: 0x16711 000004 1789786466.537851 trunc from 00000000 to 0x016710 (0x16711 bytes) 000006 1789786466.607317 mapwrite 0x031a15 thru 0x034c00 (0x31ec bytes) 000007 1789786466.705982 read 0x01630a thru 0x017a10 (0x1707 bytes) 000008 1789786466.715063 read 0x02081a thru 0x0276c9 (0x6eb0 bytes) 000009 1789786466.751975 punch from 0x02d61c to 0x02ed73 (0x1758 bytes) fallocating to largest ever: 0x260c1 000010 1789786466.765362 fallocate 0x01c27b thru 0x0260c0 (0x9e46 bytes) 000011 1789786466.779194 write 0x01f916 thru 0x0299d9 (0xa0c4 bytes) 000012 1789786466.783983 trunc from 0x034c01 to 0x011c6d (0x22f93 bytes) 000013 1789786466.826710 read 0x001758 thru 0x00f604 (0xdead bytes) 000014 1789786466.839371 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x163:0x0]: Invalid argument (22) 000015 1789786467.047495 read 0x00cf74 thru 0x00ec86 (0x1d13 bytes) 000016 1789786467.055348 write 0x022153 thru 0x02bc87 (0x9b35 bytes) 000017 1789786467.096572 MIRROR_EXTEND to 2 mirrors truncating to largest ever: 0x3391b 000020 1789786468.146605 trunc from 0x02bc88 to 0x03391a (0x7c93 bytes) 000021 1789786468.320773 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3391b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3391b): Mirror 2: 0x592f7c75 (stale) CRC-32 checksum value for chunk [0, 0x3391b): Mirror 1: 0x592f7c75 Mirror 3: 0x592f7c75 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3391b: skipped 000022 1789786469.382570 read 0x002c92 thru 0x00f8ee (0xcc5d bytes) 000023 1789786469.414335 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x163:0x0]: Invalid argument (22) 000024 1789786469.876845 punch from 0x00764f to 0x0106dc (0x908e bytes) 000025 1789786469.929637 write 0x02ed51 thru 0x034a79 (0x5d29 bytes) 000026 1789786469.946825 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x34a7a): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34a7a): Mirror 3: 0xda7555c3 (stale) CRC-32 checksum value for chunk [0, 0x34a7a): Mirror 1: 0xd3f2ff16 Mirror 4: 0xd3f2ff16 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34a7a: skipped 000027 1789786470.751631 read 0x02fdd9 thru 0x034a79 (0x4ca1 bytes) 000028 1789786470.792506 mapwrite 0x01af5b thru 0x0243f0 (0x9496 bytes) fallocating to largest ever: 0x3d3e7 000029 1789786470.910063 fallocate 0x02e48f thru 0x03d3e6 (0xef58 bytes) 000030 1789786470.916974 mapwrite 0x00f798 thru 0x01e499 (0xed02 bytes) 000031 1789786470.950528 trunc from 0x01e387 to 0x026080 (0x7cfa bytes) 000032 1789786470.961827 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3d3e7): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d3e7): Mirror 3: 0xa0d33d9 (stale) Mirror 4: 0x8c5c6927 (stale) CRC-32 checksum value for chunk [0, 0x3d3e7): Mirror 1: 0xe12a2509 Mirror 5: 0xe12a2509 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d3e7: skipped 000033 1789786471.977314 fallocate 0x00b969 thru 0x012fac (0x7644 bytes) 000034 1789786472.054930 read 0x02b183 thru 0x02ffb8 (0x4e36 bytes) 000035 1789786472.068638 trunc from 0x03d3e7 to 0x0394a2 (0x3f44 bytes) 000036 1789786472.118592 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x394a3): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x394a3): Mirror 3: 0x1cc34a48 (stale) Mirror 4: 0xe567aeda (stale) Mirror 5: 0xc4bac07b (stale) CRC-32 checksum value for chunk [0, 0x394a3): Mirror 1: 0xc4bac07b Mirror 6: 0xc4bac07b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x394a3: skipped 000038 1789786474.039416 MIRROR_RESYNC 5 mirrors 000039 1789786475.766627 MIRROR_EXTEND to 6 mirrors 000040 1789786477.024029 trunc from 0x0394a3 to 0x036632 (0x2e70 bytes) 000041 1789786477.098904 mapread 0x003fca thru 0x00a35c (0x6393 bytes) 000042 1789786477.139383 trunc from 0x036633 to 0x017fde (0x1e654 bytes) 000043 1789786477.197412 mapread 0x009207 thru 0x0154b8 (0xc2b2 bytes) 000044 1789786477.216874 mapread 0x0107b7 thru 0x01473f (0x3f89 bytes) 000045 1789786477.233022 MIRROR_RESYNC 6 mirrors 000046 1789786478.445908 mapwrite 0x024abe thru 0x027651 (0x2b94 bytes) 000047 1789786478.629509 punch from 0x004fd2 to 0x00d0e3 (0x8112 bytes) 000048 1789786478.634476 read 0x01b42f thru 0x021702 (0x62d4 bytes) 000049 1789786478.653885 write 0x03a86b thru 0x03cfd9 (0x276f bytes) 000050 1789786478.662829 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3cfda): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cfda): Mirror 3: 0xa4bc424 (stale) Mirror 4: 0xa4bc424 (stale) Mirror 5: 0xa4bc424 (stale) Mirror 6: 0xa4bc424 (stale) Mirror 7: 0xa4bc424 (stale) CRC-32 checksum value for chunk [0, 0x3cfda): Mirror 1: 0x7c8de81f Mirror 8: 0x7c8de81f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cfda: skipped 000051 1789786480.238322 fallocate 0x00001f thru 0x00a6f5 (0xa6d7 bytes) 000052 1789786480.284099 fallocate 0x01e4ae thru 0x02816f (0x9cc2 bytes) 000053 1789786480.290628 trunc from 0x03cfda to 0x00ee59 (0x2e180 bytes) 000055 1789786480.325803 trunc from 0x00ee5a to 0x016cd2 (0x7e79 bytes) 000056 1789786480.347846 read 0x008243 thru 0x012862 (0xa620 bytes) 000058 1789786480.365476 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x163:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16cd3): Mirror 3: 0xed60b5e5 (stale) Mirror 5: 0xed60b5e5 (stale) Mirror 6: 0xed60b5e5 (stale) Mirror 7: 0xed60b5e5 (stale) Mirror 8: 0xed60b5e5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16cd3): Mirror 3: 0xed60b5e5 (stale) Mirror 5: 0xed60b5e5 (stale) Mirror 6: 0xed60b5e5 (stale) Mirror 7: 0xed60b5e5 (stale) Mirror 8: 0xed60b5e5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16cd3: skipped 000059 1789786480.974934 fallocate 0x016ede thru 0x01f9c5 (0x8ae8 bytes) 000060 1789786480.994545 mapread 0x010c8b thru 0x016cd2 (0x6048 bytes) 000062 1789786481.047555 trunc from 0x016cd3 to 0x01614c (0xb86 bytes) 000063 1789786481.094370 punch from 0x015e64 to 0x01614c (0x2e9 bytes) 000064 1789786481.108950 mapwrite 0x02f4f9 thru 0x0302ba (0xdc2 bytes) 000065 1789786481.166757 punch from 0x02537e to 0x0302ba (0xaf3d bytes) 000066 1789786481.185338 fallocate 0x00b22d thru 0x00d404 (0x21d8 bytes) 000067 1789786481.192514 trunc from 0x0302bb to 0x00f57a (0x20d40 bytes) 000068 1789786481.223747 mapread 0x00643d thru 0x00836c (0x1f30 bytes) 000070 1789786481.261100 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x163:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xf57b): Mirror 5: 0xe0033c62 (stale) Mirror 6: 0xe0033c62 (stale) Mirror 7: 0xe0033c62 (stale) Mirror 8: 0xe0033c62 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf57b): Mirror 5: 0xe0033c62 (stale) Mirror 6: 0xe0033c62 (stale) Mirror 7: 0xe0033c62 (stale) Mirror 8: 0xe0033c62 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf57b: skipped 000071 1789786481.714899 punch from 0x000fc4 to 0x004319 (0x3356 bytes) 000073 1789786481.726083 MIRROR_RESYNC 5 mirrors 000074 1789786482.959579 punch from 0x00bb57 to 0x00d959 (0x1e03 bytes) 000075 1789786482.999885 trunc from 0x007d40 to 0x00ebb9 (0x6e7a bytes) 000076 1789786483.008499 fallocate 0x0235a6 thru 0x032f90 (0xf9eb bytes) 000078 1789786483.019838 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xf57b): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf57b): Mirror 5: 0xe0033c62 (stale) Mirror 6: 0xe0033c62 (stale) Mirror 7: 0xe0033c62 (stale) Mirror 8: 0xe0033c62 (stale) CRC-32 checksum value for chunk [0, 0xf57b): Mirror 1: 0xe0033c62 Mirror 9: 0xe0033c62 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf57b: skipped 000079 1789786484.367263 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x163:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xf57b): Mirror 5: 0xe0033c62 (stale) Mirror 7: 0xe0033c62 (stale) Mirror 8: 0xe0033c62 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf57b): Mirror 5: 0xe0033c62 (stale) Mirror 7: 0xe0033c62 (stale) Mirror 8: 0xe0033c62 (stale) CRC-32 checksum value for chunk [0, 0xf57b): Mirror 1: 0xe0033c62 Mirror 9: 0xe0033c62 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf57b: skipped 000080 1789786485.571245 mapread 0x00b979 thru 0x00f57a (0x3c02 bytes) 000081 1789786485.669700 mapwrite 0x03c5cb thru 0x03ffff (0x3a35 bytes) 000082 1789786485.820635 write 0x038945 thru 0x03ec7c (0x6338 bytes) 000083 1789786485.823433 trunc from 0x02cad4 to 0x03455f (0x7a8c bytes) 000084 1789786485.829088 trunc from 0x040000 to 0x02705c (0x18fa3 bytes) 000086 1789786485.862706 mapwrite 0x002b6b thru 0x003c30 (0x10c6 bytes) 000087 1789786485.895999 mapread 0x02209c thru 0x023044 (0xfa9 bytes) 000088 1789786485.917758 read 0x01256c thru 0x017702 (0x5197 bytes) 000090 1789786485.928724 mapwrite 0x0296de thru 0x032859 (0x917c bytes) 000091 1789786486.029348 trunc from 0x015334 to 0x02521f (0xfeec bytes) 000092 1789786486.039848 mapwrite 0x029b75 thru 0x031e1c (0x82a8 bytes) 000093 1789786486.074195 write 0x01265d thru 0x01cd69 (0xa70d bytes) 000094 1789786486.088792 punch from 0x01d5e7 to 0x02c6f8 (0xf112 bytes) 000095 1789786486.094740 read 0x0156eb thru 0x01bac5 (0x63db bytes) 000096 1789786486.095705 mapwrite 0x03ee6e thru 0x03ffff (0x1192 bytes) 000098 1789786486.169913 mapwrite 0x016ceb thru 0x0235c1 (0xc8d7 bytes) 000099 1789786486.226777 mapread 0x0251fc thru 0x03378d (0xe592 bytes) 000100 1789786486.233602 mapread 0x03fac5 thru 0x03ffff (0x53b bytes) 000101 1789786486.244549 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x163:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xe20eea22 (stale) Mirror 7: 0xe20eea22 (stale) Mirror 9: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xe20eea22 (stale) Mirror 7: 0xe20eea22 (stale) Mirror 9: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000103 1789786486.900599 trunc from 0x01b383 to 0x01c578 (0x11f6 bytes) 000104 1789786486.911623 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x163:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xe20eea22 (stale) Mirror 9: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xe20eea22 (stale) Mirror 9: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000105 1789786487.256764 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x163:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000106 1789786487.643446 read 0x01a5ee thru 0x01a737 (0x14a bytes) 000107 1789786487.647593 read 0x034cfb thru 0x03ffff (0xb305 bytes) 000108 1789786487.657531 write 0x007efe thru 0x012fcf (0xb0d2 bytes) 000109 1789786487.663912 mapwrite 0x037960 thru 0x03ffff (0x86a0 bytes) 000110 1789786487.686566 read 0x023462 thru 0x02a9d3 (0x7572 bytes) 000111 1789786487.688218 fallocate 0x02edbb thru 0x039141 (0xa387 bytes) 000113 1789786487.697214 trunc from 0x040000 to 0x00849e (0x37b61 bytes) 000114 1789786487.731849 trunc from 0x002c04 to 0x00849e (0x589b bytes) 000115 1789786487.743936 fallocate 0x0311c7 thru 0x03a2da (0x9114 bytes) 000116 1789786487.755531 trunc from 0x00849f to 0x02aa9f (0x22601 bytes) 000117 1789786487.781707 trunc from 0x02aaa0 to 0x0198af (0x111f0 bytes) 000118 1789786487.805849 mapwrite 0x002355 thru 0x00c87a (0xa526 bytes) 000119 1789786487.868620 trunc from 0x0198b0 to 0x00ce27 (0xca88 bytes) 000120 1789786487.906539 trunc from 0x0041b4 to 0x006a20 (0x286d bytes) 000121 1789786487.912295 mapread 0x000a96 thru 0x00b609 (0xab74 bytes) 000122 1789786487.928443 write 0x031fbc thru 0x03ea0d (0xca52 bytes) 000123 1789786487.930442 write 0x01be6b thru 0x02b139 (0xf2cf bytes) 000124 1789786487.940130 write 0x00437d thru 0x010893 (0xc517 bytes) 000125 1789786487.945454 trunc from 0x03ea0e to 0x001eb9 (0x3cb54 bytes) 000126 1789786487.966863 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x163:0x0]: Invalid argument (22) 000127 1789786488.101335 MIRROR_EXTEND to 2 mirrors 000128 1789786488.922269 trunc from 0x000904 to 0x001eb9 (0x15b6 bytes) 000129 1789786488.956412 write 0x0255a0 thru 0x031c96 (0xc6f7 bytes) 000131 1789786488.965914 trunc from 0x01c2ba to 0x0261a2 (0x9ee9 bytes) 000132 1789786488.996503 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x31c97): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31c97): Mirror 2: 0x543cea8d (stale) CRC-32 checksum value for chunk [0, 0x31c97): Mirror 1: 0xa674e9f2 Mirror 3: 0xa674e9f2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31c97: skipped 000133 1789786490.374448 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x163:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31c97): Mirror 2: 0x543cea8d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31c97): Mirror 2: 0x543cea8d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31c97: skipped 000134 1789786490.676072 trunc from 0x007776 to 0x008d63 (0x15ee bytes) 000135 1789786490.695901 trunc from 0x011922 to 0x018dd5 (0x74b4 bytes) 000136 1789786490.704506 MIRROR_RESYNC 2 mirrors 000137 1789786491.851806 trunc from 0x02c72c to 0x031c96 (0x556b bytes) 000138 1789786491.898040 mapread 0x00d978 thru 0x01cc79 (0xf302 bytes) 000139 1789786491.983564 trunc from 0x02d898 to 0x031c96 (0x43ff bytes) 000140 1789786492.003194 read 0x00c311 thru 0x00dc8a (0x197a bytes) fallocating to largest ever: 0x40000 000141 1789786492.003975 fallocate 0x036c17 thru 0x03ffff (0x93e9 bytes) 000142 1789786492.019387 mapread 0x00c1d9 thru 0x01abe8 (0xea10 bytes) 000143 1789786492.021357 fallocate 0x029d86 thru 0x037987 (0xdc02 bytes) 000144 1789786492.030794 fallocate 0x030224 thru 0x037641 (0x741e bytes) 000145 1789786492.038540 punch from 0x02698b to 0x0278ce (0xf44 bytes) 000146 1789786492.101195 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x163:0x0]: Invalid argument (22) 000147 1789786492.370023 fallocate 0x00717c thru 0x012394 (0xb219 bytes) 000148 1789786492.385711 trunc from 0x040000 to 0x01031f (0x2fce0 bytes) 000150 1789786492.415783 mapwrite 0x024108 thru 0x02e5d9 (0xa4d2 bytes) 000151 1789786492.548186 trunc from 0x02e5da to 0x02137b (0xd25e bytes) 000152 1789786492.584890 write 0x0100ff thru 0x015880 (0x5782 bytes) 000154 1789786492.610441 write 0x01da3c thru 0x02322d (0x57f2 bytes) 000155 1789786492.620527 write 0x019d8f thru 0x0275c9 (0xd83b bytes) 000156 1789786492.634178 read 0x024b4f thru 0x027431 (0x28e3 bytes) 000157 1789786492.634882 trunc from 0x0111e3 to 0x019503 (0x8321 bytes) 000159 1789786492.666509 mapread 0x010ef7 thru 0x01a588 (0x9692 bytes) 000160 1789786492.687300 mapread 0x001d7b thru 0x0077cf (0x5a55 bytes) 000161 1789786492.733778 MIRROR_EXTEND to 2 mirrors 000162 1789786493.678523 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x163:0x0]: Invalid argument (22) 000164 1789786493.875308 mapwrite 0x036728 thru 0x0368af (0x188 bytes) 000165 1789786493.999018 mapread 0x0350e7 thru 0x0368af (0x17c9 bytes) 000167 1789786494.007790 mapwrite 0x02eb07 thru 0x0368f0 (0x7dea bytes) 000168 1789786494.075971 trunc from 0x0368f1 to 0x021d2a (0x14bc6 bytes) 000169 1789786494.104325 trunc from 0x021d2b to 0x01005a (0x11cd0 bytes) 000171 1789786494.123382 mapread 0x001e20 thru 0x008bc1 (0x6da2 bytes) 000172 1789786494.135818 mapwrite 0x001a1b thru 0x00d914 (0xbefa bytes) 000173 1789786494.156402 fallocate 0x0297b3 thru 0x02bd70 (0x25be bytes) 000174 1789786494.162401 trunc from 0x02bd71 to 0x034ffb (0x928b bytes) 000175 1789786494.181108 read 0x000fb3 thru 0x00a950 (0x999e bytes) 000176 1789786494.187519 punch from 0x00830e to 0x017e6b (0xfb5e bytes) 000178 1789786494.194952 mapread 0x02eeb3 thru 0x034ffb (0x6149 bytes) 000179 1789786494.207068 write 0x01a1b3 thru 0x01fcdf (0x5b2d bytes) 000180 1789786494.217428 punch from 0x0011cb to 0x00aa62 (0x9898 bytes) 000181 1789786494.223704 read 0x00df6d thru 0x01c39d (0xe431 bytes) 000183 1789786494.237576 mapread 0x025244 thru 0x032a0d (0xd7ca bytes) 000184 1789786494.239088 punch from 0x023213 to 0x02a7fa (0x75e8 bytes) 000185 1789786494.244474 punch from 0x0037e6 to 0x00fbf6 (0xc411 bytes) 000186 1789786494.249453 fallocate 0x022b0e thru 0x0307d7 (0xdcca bytes) 000187 1789786494.255313 mapread 0x0037be thru 0x010409 (0xcc4c bytes) 000188 1789786494.318579 MIRROR_EXTEND to 2 mirrors 000189 1789786494.952394 mapread 0x0044e8 thru 0x00ba85 (0x759e bytes) 000190 1789786494.974020 fallocate 0x01879f thru 0x018dee (0x650 bytes) 000191 1789786495.015468 write 0x024616 thru 0x031484 (0xce6f bytes) 000192 1789786495.031939 mapwrite 0x0136ae thru 0x016805 (0x3158 bytes) 000193 1789786495.067318 mapwrite 0x020b8b thru 0x024f55 (0x43cb bytes) 000194 1789786495.095575 trunc from 0x034ffc to 0x00b191 (0x29e6a bytes) 000195 1789786495.149100 trunc from 0x00b192 to 0x001f9f (0x91f2 bytes) 000196 1789786495.169627 read 0x001575 thru 0x001f9f (0xa2b bytes) 000197 1789786495.176501 fallocate 0x02c596 thru 0x02c61e (0x89 bytes) 000198 1789786495.182082 read 0x0012cc thru 0x001f9f (0xcd4 bytes) 000199 1789786495.188112 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1fa0): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fa0): Mirror 2: 0xda974947 (stale) CRC-32 checksum value for chunk [0, 0x1fa0): Mirror 1: 0xda974947 Mirror 3: 0xda974947 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fa0: skipped 000200 1789786496.100692 punch from 0x000fbf to 0x001f9f (0xfe1 bytes) 000201 1789786496.197481 read 0x001d79 thru 0x001f9f (0x227 bytes) 000202 1789786496.214162 mapwrite 0x037dac thru 0x03ba2b (0x3c80 bytes) 000204 1789786496.367599 trunc from 0x03ba2c to 0x03b5e7 (0x444 bytes) 000205 1789786496.397358 punch from 0x0239f1 to 0x02d940 (0x9f50 bytes) 000206 1789786496.405834 trunc from 0x03b5e8 to 0x01e376 (0x1d271 bytes) 000207 1789786496.445574 mapread 0x00aad6 thru 0x015e87 (0xb3b2 bytes) 000209 1789786496.480056 trunc from 0x01e377 to 0x0283d1 (0xa05b bytes) 000210 1789786496.523842 punch from 0x00c180 to 0x012aae (0x692f bytes) 000211 1789786496.532527 read 0x006ff3 thru 0x014562 (0xd570 bytes) 000212 1789786496.548807 write 0x02a30e thru 0x036cc1 (0xc9b4 bytes) 000213 1789786496.552853 trunc from 0x036cc2 to 0x014c12 (0x220af bytes) 000214 1789786496.613481 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x14c13): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14c13): Mirror 2: 0x8f026fcc (stale) Mirror 3: 0x8f026fcc (stale) CRC-32 checksum value for chunk [0, 0x14c13): Mirror 1: 0x8f026fcc Mirror 4: 0x8f026fcc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14c13: skipped 000215 1789786498.026551 punch from 0x00d8a6 to 0x014c12 (0x736d bytes) 000216 1789786498.110140 fallocate 0x032350 thru 0x03d458 (0xb109 bytes) 000218 1789786498.116749 trunc from 0x02b774 to 0x03b700 (0xff8d bytes) 000219 1789786498.122169 mapwrite 0x00abe0 thru 0x018d44 (0xe165 bytes) 000220 1789786498.185515 write 0x006bbc thru 0x0161eb (0xf630 bytes) 000221 1789786498.192594 mapwrite 0x02095a thru 0x029cad (0x9354 bytes) 000222 1789786498.239429 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x163:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d459): Mirror 2: 0x58afdc4f (stale) Mirror 3: 0x850fa4c7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d459): Mirror 2: 0x58afdc4f (stale) Mirror 3: 0x850fa4c7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d459: skipped 000223 1789786498.593730 mapwrite 0x004775 thru 0x005bb4 (0x1440 bytes) 000224 1789786498.617319 read 0x033986 thru 0x03d458 (0x9ad3 bytes) 000225 1789786498.634441 MIRROR_RESYNC 3 mirrors 000226 1789786499.828259 fallocate 0x0141c1 thru 0x019c3f (0x5a7f bytes) 000227 1789786499.920969 write 0x003d4d thru 0x00c66c (0x8920 bytes) 000228 1789786499.940487 mapread 0x009585 thru 0x00fdd5 (0x6851 bytes) 000229 1789786499.994727 mapwrite 0x016487 thru 0x01d0ec (0x6c66 bytes) 000230 1789786500.069500 write 0x03e235 thru 0x03ffff (0x1dcb bytes) 000231 1789786500.075035 write 0x02f615 thru 0x02fc54 (0x640 bytes) 000232 1789786500.083853 write 0x0367bc thru 0x03a0f8 (0x393d bytes) 000233 1789786500.107481 trunc from 0x040000 to 0x0306d5 (0xf92a bytes) 000234 1789786500.157889 mapread 0x01c8a0 thru 0x023723 (0x6e84 bytes) 000235 1789786500.188599 trunc from 0x0306d6 to 0x0036f6 (0x2cfdf bytes) 000236 1789786500.216776 read 0x000959 thru 0x0036f6 (0x2d9e bytes) 000237 1789786500.238397 punch from 0x001461 to 0x001cdf (0x87f bytes) 000238 1789786500.244984 write 0x007705 thru 0x00bd21 (0x461d bytes) 000239 1789786500.246923 punch from 0x002e64 to 0x005b04 (0x2ca1 bytes) 000240 1789786500.272445 mapwrite 0x01fd57 thru 0x027743 (0x79ed bytes) 000242 1789786500.348361 fallocate 0x002fda thru 0x00968f (0x66b6 bytes) 000243 1789786500.354589 read 0x00d086 thru 0x0117ae (0x4729 bytes) 000244 1789786500.372223 read 0x00ea68 thru 0x01ca3a (0xdfd3 bytes) 000245 1789786500.378321 trunc from 0x027744 to 0x0096dc (0x1e067 bytes) 000246 1789786500.437228 trunc from 0x0096dd to 0x0016fa (0x7fe2 bytes) 000247 1789786500.457975 trunc from 0x000e56 to 0x0016fa (0x8a5 bytes) 000248 1789786500.465569 read 0x00079f thru 0x0016fa (0xf5c bytes) 000250 1789786500.474244 trunc from 0x0004a2 to 0x0016fa (0x1259 bytes) 000251 1789786500.480603 trunc from 0x000d66 to 0x0016fa (0x995 bytes) 000252 1789786500.486721 fallocate 0x002cf4 thru 0x004f31 (0x223e bytes) 000254 1789786500.498640 mapread 0x003d41 thru 0x004f31 (0x11f1 bytes) 000255 1789786500.510036 trunc from 0x0028be to 0x004f31 (0x2674 bytes) 000256 1789786500.516423 mapread 0x0009af thru 0x004f31 (0x4583 bytes) 000257 1789786500.579417 trunc from 0x004f32 to 0x02d07e (0x2814d bytes) 000258 1789786500.611505 punch from 0x0057bc to 0x014927 (0xf16c bytes) 000259 1789786500.621470 trunc from 0x02d07f to 0x00e8d8 (0x1e7a6 bytes) 000260 1789786500.692909 MIRROR_RESYNC 3 mirrors 000261 1789786501.924258 trunc from 0x00129f to 0x00de0b (0xcb6d bytes) 000262 1789786501.971426 trunc from 0x00e631 to 0x00e8d8 (0x2a8 bytes) 000263 1789786501.977496 trunc from 0x003de3 to 0x00e8d8 (0xaaf6 bytes) 000264 1789786501.982925 punch from 0x008e76 to 0x00923b (0x3c6 bytes) 000265 1789786501.990603 write 0x039612 thru 0x03ffff (0x69ee bytes) 000267 1789786501.993436 trunc from 0x005c1d to 0x008b49 (0x2f2d bytes) 000268 1789786502.001013 trunc from 0x040000 to 0x00f8cf (0x30730 bytes) 000270 1789786502.028017 mapread 0x004b1f thru 0x00f8cf (0xadb1 bytes) 000271 1789786502.056903 write 0x01d2f1 thru 0x0222e3 (0x4ff3 bytes) 000272 1789786502.062345 mapread 0x00d329 thru 0x0193bd (0xc095 bytes) 000273 1789786502.083526 MIRROR_RESYNC 3 mirrors 000274 1789786502.954517 mapread 0x000471 thru 0x00354b (0x30db bytes) 000275 1789786503.010482 mapwrite 0x01a684 thru 0x02a429 (0xfda6 bytes) 000276 1789786503.149121 punch from 0x000fb8 to 0x003b48 (0x2b91 bytes) 000277 1789786503.157971 trunc from 0x020fb4 to 0x02a429 (0x9476 bytes) 000278 1789786503.173720 trunc from 0x0203d2 to 0x0219ab (0x15da bytes) 000279 1789786503.183423 fallocate 0x0327b4 thru 0x03eb5f (0xc3ac bytes) 000280 1789786503.196763 trunc from 0x00135e to 0x010e66 (0xfb09 bytes) 000281 1789786503.204993 fallocate 0x021c58 thru 0x022fa7 (0x1350 bytes) 000282 1789786503.221424 punch from 0x028307 to 0x02a429 (0x2123 bytes) 000283 1789786503.238743 read 0x011d22 thru 0x015fa1 (0x4280 bytes) 000284 1789786503.257087 write 0x026ed3 thru 0x02f8f8 (0x8a26 bytes) 000285 1789786503.274575 punch from 0x024eed to 0x02f8f8 (0xaa0c bytes) 000286 1789786503.318254 mapwrite 0x026116 thru 0x026367 (0x252 bytes) 000287 1789786503.366500 mapwrite 0x020edc thru 0x02bd52 (0xae77 bytes) 000288 1789786503.398408 trunc from 0x027b4a to 0x02f8f8 (0x7daf bytes) 000289 1789786503.408226 trunc from 0x02f8f9 to 0x01751b (0x183dd bytes) 000291 1789786503.457390 trunc from 0x0026e4 to 0x00d262 (0xab7f bytes) 000292 1789786503.464191 read 0x016d7c thru 0x01751b (0x7a0 bytes) 000294 1789786503.465736 punch from 0x0086c7 to 0x016fd9 (0xe913 bytes) 000295 1789786503.485138 MIRROR_RESYNC 3 mirrors 000296 1789786504.441991 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x163:0x0]: Invalid argument (22) 000297 1789786504.981994 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x163:0x0]: Invalid argument (22) 000299 1789786505.195675 trunc from 0x0121da to 0x01751b (0x5342 bytes) 000300 1789786505.214371 punch from 0x006f1f to 0x00bbc0 (0x4ca2 bytes) 000301 1789786505.232829 fallocate 0x0150c3 thru 0x021264 (0xc1a2 bytes) 000302 1789786505.243812 write 0x015703 thru 0x02463b (0xef39 bytes) 000304 1789786505.261803 trunc from 0x00a866 to 0x0112e1 (0x6a7c bytes) 000306 1789786505.282323 trunc from 0x02463c to 0x015cc3 (0xe978 bytes) 000307 1789786505.342303 fallocate 0x02740c thru 0x036e60 (0xfa55 bytes) 000308 1789786505.351336 fallocate 0x0185aa thru 0x02335f (0xadb6 bytes) 000309 1789786505.356601 mapread 0x0240c9 thru 0x0294c6 (0x53fe bytes) 000310 1789786505.385944 fallocate 0x018e41 thru 0x01db1a (0x4cda bytes) 000311 1789786505.395940 read 0x0010fc thru 0x0021e5 (0x10ea bytes) 000312 1789786505.408629 write 0x02b42c thru 0x03669d (0xb272 bytes) 000313 1789786505.416721 write 0x02f641 thru 0x033240 (0x3c00 bytes) 000314 1789786505.417903 write 0x034371 thru 0x03f8f5 (0xb585 bytes) 000315 1789786505.420604 mapwrite 0x02af85 thru 0x034580 (0x95fc bytes) 000316 1789786505.452517 punch from 0x029d0e to 0x02c95d (0x2c50 bytes) 000317 1789786505.470522 trunc from 0x03f01b to 0x03f8f5 (0x8db bytes) 000318 1789786505.483424 MIRROR_EXTEND to 2 mirrors 000319 1789786506.296613 punch from 0x023369 to 0x030d74 (0xda0c bytes) 000320 1789786506.399931 MIRROR_RESYNC 2 mirrors 000321 1789786507.600362 trunc from 0x0376f4 to 0x03f8f5 (0x8202 bytes) 000322 1789786507.679356 mapread 0x039b6c thru 0x03f8f5 (0x5d8a bytes) 000323 1789786507.745175 read 0x00da27 thru 0x01d2f3 (0xf8cd bytes) 000324 1789786507.773420 punch from 0x02359c to 0x02a04a (0x6aaf bytes) 000326 1789786507.792911 trunc from 0x03f8f6 to 0x03540c (0xa4e9 bytes) 000329 1789786507.825866 trunc from 0x03540d to 0x0289d4 (0xca38 bytes) 000330 1789786507.860975 trunc from 0x00c70f to 0x010050 (0x3942 bytes) 000332 1789786507.885036 trunc from 0x003eb0 to 0x008f69 (0x50ba bytes) 000333 1789786507.897444 mapread 0x024963 thru 0x024a5d (0xfb bytes) 000334 1789786507.913233 write 0x0125db thru 0x01e85f (0xc285 bytes) 000335 1789786507.917632 write 0x00eaea thru 0x0140e4 (0x55fb bytes) 000337 1789786507.928984 trunc from 0x0289d5 to 0x03c53b (0x13b67 bytes) 000338 1789786507.960458 trunc from 0x007721 to 0x00e441 (0x6d21 bytes) 000339 1789786507.985556 read 0x0277e4 thru 0x02a426 (0x2c43 bytes) 000340 1789786508.005602 mapread 0x01a1e5 thru 0x01adae (0xbca bytes) 000341 1789786508.007053 mapread 0x0387ae thru 0x03c53b (0x3d8e bytes) 000342 1789786508.009039 fallocate 0x01bcb4 thru 0x023e03 (0x8150 bytes) 000343 1789786508.026263 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3c53c): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c53c): Mirror 2: 0xd97c3637 (stale) CRC-32 checksum value for chunk [0, 0x3c53c): Mirror 1: 0x40e1b4cc Mirror 3: 0x40e1b4cc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c53c: skipped 000344 1789786509.137027 trunc from 0x03c53c to 0x0014bb (0x3b080 bytes) 000345 1789786509.203547 trunc from 0x0014bc to 0x0264b4 (0x24ff9 bytes) 000346 1789786509.247049 MIRROR_RESYNC 3 mirrors 000348 1789786510.233232 trunc from 0x01d3dd to 0x01f102 (0x1d26 bytes) 000349 1789786510.301965 write 0x02a594 thru 0x03794a (0xd3b7 bytes) 000350 1789786510.307506 punch from 0x019e5c to 0x0266b0 (0xc855 bytes) 000351 1789786510.330878 MIRROR_RESYNC 3 mirrors 000352 1789786511.275054 mapread 0x014361 thru 0x01d088 (0x8d28 bytes) 000353 1789786511.301595 trunc from 0x03794b to 0x001723 (0x36227 bytes) 000354 1789786511.348279 punch from 0x0000e7 to 0x001723 (0x163d bytes) 000355 1789786511.353390 mapread 0x001080 thru 0x001311 (0x292 bytes) 000356 1789786511.366443 write 0x006e74 thru 0x012704 (0xb891 bytes) 000357 1789786511.368325 mapwrite 0x03d60d thru 0x03f653 (0x2047 bytes) 000358 1789786511.498905 write 0x03d36b thru 0x03ffff (0x2c95 bytes) 000359 1789786511.500406 trunc from 0x018c19 to 0x024d7e (0xc166 bytes) 000360 1789786511.519095 fallocate 0x000e4a thru 0x00679f (0x5956 bytes) 000361 1789786511.528129 write 0x0298bd thru 0x02b9e5 (0x2129 bytes) 000362 1789786511.559691 mapwrite 0x012410 thru 0x01507e (0x2c6f bytes) 000363 1789786511.626583 write 0x03b54d thru 0x03ffff (0x4ab3 bytes) 000364 1789786511.627930 write 0x019622 thru 0x024915 (0xb2f4 bytes) 000365 1789786511.654742 mapread 0x016366 thru 0x01d00c (0x6ca7 bytes) 000366 1789786511.655879 mapwrite 0x00cff9 thru 0x018bcc (0xbbd4 bytes) 000367 1789786511.733075 mapwrite 0x01b0ac thru 0x0246fe (0x9653 bytes) 000368 1789786511.796341 punch from 0x0009f3 to 0x006b54 (0x6162 bytes) 000369 1789786511.817528 trunc from 0x000462 to 0x00db84 (0xd723 bytes) 000370 1789786511.831822 MIRROR_RESYNC 3 mirrors 000371 1789786513.382343 trunc from 0x040000 to 0x005734 (0x3a8cb bytes) 000372 1789786513.528338 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x5735): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5735): Mirror 2: 0x6946646a (stale) Mirror 3: 0x6946646a (stale) CRC-32 checksum value for chunk [0, 0x5735): Mirror 1: 0x6946646a Mirror 4: 0x6946646a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5735: skipped 000373 1789786514.827460 mapread 0x002f01 thru 0x005734 (0x2834 bytes) 000374 1789786514.862177 mapwrite 0x0259c9 thru 0x034c56 (0xf28e bytes) 000376 1789786515.023505 mapwrite 0x02bf24 thru 0x03ae15 (0xeef2 bytes) 000377 1789786515.171380 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3ae16): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ae16): Mirror 2: 0xf4a9975 (stale) Mirror 3: 0xf4a9975 (stale) Mirror 4: 0xad4f9719 (stale) CRC-32 checksum value for chunk [0, 0x3ae16): Mirror 1: 0x1be9ec91 Mirror 5: 0x1be9ec91 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ae16: skipped 000378 1789786516.317132 punch from 0x004ffb to 0x00e8a8 (0x98ae bytes) 000379 1789786516.398289 punch from 0x00ca86 to 0x016411 (0x998c bytes) 000380 1789786516.411181 write 0x0075ce thru 0x015666 (0xe099 bytes) 000382 1789786516.442877 mapread 0x023d51 thru 0x02f260 (0xb510 bytes) 000383 1789786516.503850 trunc from 0x03ae16 to 0x01c572 (0x1e8a3 bytes) 000384 1789786516.587886 MIRROR_RESYNC 5 mirrors 000386 1789786517.968546 read 0x006eec thru 0x00b98d (0x4aa2 bytes) 000387 1789786517.990069 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x163:0x0]: Invalid argument (22) 000388 1789786518.387011 write 0x030877 thru 0x03b79f (0xaf29 bytes) 000389 1789786518.461373 mapwrite 0x0365bc thru 0x03ce84 (0x68c9 bytes) 000391 1789786518.539054 trunc from 0x03ce85 to 0x01cafb (0x20389 bytes) 000392 1789786518.600575 trunc from 0x00a2f8 to 0x0174fa (0xd203 bytes) 000393 1789786518.608257 trunc from 0x0155f8 to 0x01cafb (0x7504 bytes) 000394 1789786518.616851 write 0x0229bc thru 0x02a220 (0x7865 bytes) 000395 1789786518.619439 write 0x035b9e thru 0x03ffff (0xa462 bytes) 000396 1789786518.622353 trunc from 0x00249e to 0x00dc48 (0xb7ab bytes) 000397 1789786518.629863 punch from 0x03d935 to 0x03ffff (0x26cb bytes) 000398 1789786518.660254 mapwrite 0x030684 thru 0x037763 (0x70e0 bytes) 000399 1789786518.742460 trunc from 0x040000 to 0x02aeaa (0x15155 bytes) 000400 1789786518.772758 mapwrite 0x030f11 thru 0x03aca6 (0x9d96 bytes) 000401 1789786518.863026 read 0x01a337 thru 0x01f4d3 (0x519d bytes) 000402 1789786518.885853 trunc from 0x033f71 to 0x034c88 (0xd18 bytes) 000403 1789786518.893017 trunc from 0x03aca7 to 0x03a68d (0x619 bytes) 000404 1789786518.934390 trunc from 0x02e913 to 0x03a68d (0xbd7b bytes) 000405 1789786518.945159 fallocate 0x012692 thru 0x01383a (0x11a9 bytes) 000406 1789786518.953589 trunc from 0x000502 to 0x00f3d6 (0xeed5 bytes) 000407 1789786518.970109 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x163:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a68e): Mirror 3: 0x9f392865 (stale) Mirror 4: 0x9f392865 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a68e): Mirror 3: 0x9f392865 (stale) Mirror 4: 0x9f392865 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a68e: skipped 000408 1789786519.461695 mapwrite 0x0300bb thru 0x034391 (0x42d7 bytes) 000409 1789786519.505082 trunc from 0x02c380 to 0x03a68d (0xe30e bytes) 000410 1789786519.510538 fallocate 0x029998 thru 0x02c9f0 (0x3059 bytes) 000411 1789786519.515111 trunc from 0x03a68e to 0x033a1f (0x6c6e bytes) 000412 1789786519.539560 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x163:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33a20): Mirror 4: 0x6e2d164b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33a20): Mirror 4: 0x6e2d164b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33a20: skipped 000413 1789786519.928224 trunc from 0x033a20 to 0x00a766 (0x292b9 bytes) 000414 1789786519.981743 trunc from 0x00a767 to 0x012a02 (0x829c bytes) 000415 1789786519.997172 mapwrite 0x01bb54 thru 0x01f5a1 (0x3a4e bytes) 000416 1789786520.048996 mapread 0x004790 thru 0x014649 (0xfeba bytes) 000417 1789786520.071324 mapwrite 0x02adc1 thru 0x0300d6 (0x5316 bytes) 000418 1789786520.127584 punch from 0x026374 to 0x0300d6 (0x9d63 bytes) 000419 1789786520.138397 punch from 0x02ce58 to 0x02f61b (0x27c4 bytes) 000420 1789786520.164532 mapwrite 0x02b0ef thru 0x02f739 (0x464b bytes) 000421 1789786520.242130 punch from 0x0085ac to 0x015a48 (0xd49d bytes) 000422 1789786520.253427 mapread 0x02d0b7 thru 0x0300d6 (0x3020 bytes) 000423 1789786520.260370 read 0x004452 thru 0x004d2a (0x8d9 bytes) 000424 1789786520.262280 trunc from 0x026539 to 0x02dc35 (0x76fd bytes) 000425 1789786520.285749 mapread 0x013234 thru 0x01598b (0x2758 bytes) 000426 1789786520.309631 trunc from 0x0300d7 to 0x0111ea (0x1eeec bytes) 000427 1789786520.352575 fallocate 0x0356e5 thru 0x03b264 (0x5b80 bytes) 000428 1789786520.363563 mapread 0x00c4dd thru 0x0111ea (0x4d0e bytes) 000429 1789786520.374067 fallocate 0x00159f thru 0x002ec8 (0x192a bytes) 000430 1789786520.392348 read 0x00e985 thru 0x0111ea (0x2866 bytes) 000431 1789786520.395678 write 0x02298c thru 0x03123c (0xe8b1 bytes) 000432 1789786520.417347 MIRROR_RESYNC 2 mirrors 000433 1789786521.395004 trunc from 0x03123d to 0x03096e (0x8ce bytes) 000434 1789786521.515509 trunc from 0x03096f to 0x023006 (0xd968 bytes) 000435 1789786521.559143 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x163:0x0]: Invalid argument (22) 000436 1789786521.730268 mapwrite 0x0181df thru 0x01901f (0xe41 bytes) 000437 1789786521.780167 read 0x002ba2 thru 0x00707b (0x44da bytes) 000438 1789786521.794326 trunc from 0x01db14 to 0x022e5a (0x5347 bytes) 000439 1789786521.808133 punch from 0x011335 to 0x018121 (0x6ded bytes) 000440 1789786521.814215 write 0x00e113 thru 0x0118a5 (0x3793 bytes) 000441 1789786521.830173 fallocate 0x002474 thru 0x00da30 (0xb5bd bytes) 000444 1789786521.843512 mapread 0x014ae6 thru 0x020414 (0xb92f bytes) 000445 1789786521.900081 trunc from 0x003607 to 0x00e123 (0xab1d bytes) 000446 1789786521.922983 read 0x00c9e8 thru 0x011179 (0x4792 bytes) 000448 1789786521.947968 write 0x038b25 thru 0x03ffff (0x74db bytes) 000449 1789786521.956126 write 0x030127 thru 0x030d87 (0xc61 bytes) 000450 1789786521.975305 punch from 0x00096b to 0x00e05d (0xd6f3 bytes) 000451 1789786521.989493 punch from 0x02ae79 to 0x034443 (0x95cb bytes) 000453 1789786522.022255 mapread 0x032e8d thru 0x036e5e (0x3fd2 bytes) 000454 1789786522.064475 read 0x033757 thru 0x03b0b7 (0x7961 bytes) 000455 1789786522.066714 read 0x02cc53 thru 0x02fc2c (0x2fda bytes) 000456 1789786522.117434 read 0x00b1a2 thru 0x019c21 (0xea80 bytes) 000457 1789786522.123019 read 0x0299da thru 0x03787c (0xdea3 bytes) 000458 1789786522.127041 punch from 0x01f4b1 to 0x022903 (0x3453 bytes) 000459 1789786522.135393 write 0x038c0e thru 0x03ffff (0x73f2 bytes) 000460 1789786522.141195 mapread 0x015748 thru 0x021f56 (0xc80f bytes) 000461 1789786522.164753 trunc from 0x040000 to 0x011171 (0x2ee8e bytes) 000462 1789786522.195863 punch from 0x000e6f to 0x0066e8 (0x587a bytes) 000463 1789786522.202799 punch from 0x00d500 to 0x00ebbd (0x16be bytes) 000464 1789786522.213091 write 0x0317af thru 0x034ac8 (0x331a bytes) 000465 1789786522.224023 read 0x0270dd thru 0x02ef5e (0x7e82 bytes) 000466 1789786522.262141 trunc from 0x0263ff to 0x032016 (0xbc18 bytes) 000467 1789786522.285730 trunc from 0x033ffa to 0x034ac8 (0xacf bytes) 000468 1789786522.292557 fallocate 0x004d2d thru 0x005344 (0x618 bytes) 000469 1789786522.305009 mapwrite 0x030672 thru 0x03badc (0xb46b bytes) 000470 1789786522.436452 trunc from 0x03badd to 0x020569 (0x1b573 bytes) 000471 1789786522.458425 write 0x028e1b thru 0x0337ea (0xa9d0 bytes) 000472 1789786522.461298 fallocate 0x011507 thru 0x015686 (0x4180 bytes) 000473 1789786522.469347 punch from 0x022131 to 0x02e6b9 (0xc589 bytes) 000474 1789786522.486820 trunc from 0x00d141 to 0x00d151 (0x11 bytes) 000475 1789786522.493153 mapread 0x02408f thru 0x02e5fa (0xa56c bytes) 000477 1789786522.552295 mapread 0x01faf6 thru 0x02f429 (0xf934 bytes) 000478 1789786522.570827 mapwrite 0x03641b thru 0x03ffff (0x9be5 bytes) 000479 1789786522.649445 trunc from 0x027dc7 to 0x031932 (0x9b6c bytes) 000480 1789786522.656382 trunc from 0x040000 to 0x03a7bb (0x5844 bytes) 000482 1789786522.679379 write 0x0070dc thru 0x00ac07 (0x3b2c bytes) 000484 1789786522.684164 read 0x012aac thru 0x02135d (0xe8b2 bytes) 000485 1789786522.685179 fallocate 0x02312a thru 0x0261d6 (0x30ad bytes) 000486 1789786522.691375 trunc from 0x03a7bc to 0x009d28 (0x30a93 bytes) 000487 1789786522.707169 trunc from 0x009d29 to 0x0141c8 (0xa4a0 bytes) 000488 1789786522.734318 mapwrite 0x010b59 thru 0x011527 (0x9cf bytes) 000489 1789786522.764774 mapwrite 0x00fb05 thru 0x0134cd (0x39c9 bytes) 000490 1789786522.784199 mapread 0x00748f thru 0x00f3ce (0x7f40 bytes) 000491 1789786522.785984 read 0x000c41 thru 0x00c9c2 (0xbd82 bytes) 000492 1789786522.787757 punch from 0x010ba6 to 0x0141c8 (0x3623 bytes) 000493 1789786522.798261 trunc from 0x0141c9 to 0x002449 (0x11d7f bytes) 000494 1789786522.823421 punch from 0x001af1 to 0x002449 (0x959 bytes) 000495 1789786522.829953 punch from 0x001030 to 0x002449 (0x141a bytes) 000496 1789786522.842148 trunc from 0x00244a to 0x005d1a (0x38d1 bytes) 000497 1789786522.877096 mapwrite 0x01d2e2 thru 0x02bca7 (0xe9c6 bytes) 000498 1789786522.941004 trunc from 0x02bca8 to 0x023d93 (0x7f14 bytes) 000500 1789786522.972383 mapread 0x01b549 thru 0x023d93 (0x884b bytes) 000502 1789786522.977256 write 0x024fe0 thru 0x02576b (0x78c bytes) 000504 1789786522.981317 trunc from 0x02576c to 0x028aa5 (0x333a bytes) 000505 1789786523.016254 mapwrite 0x03eae9 thru 0x03ffff (0x1517 bytes) 000507 1789786523.115607 read 0x005a9d thru 0x007300 (0x1864 bytes) 000508 1789786523.117022 mapwrite 0x0314bc thru 0x039f18 (0x8a5d bytes) 000510 1789786523.160628 trunc from 0x040000 to 0x03ff5e (0xa1 bytes) 000511 1789786523.193766 mapread 0x02a55f thru 0x034826 (0xa2c8 bytes) 000512 1789786523.235067 MIRROR_EXTEND to 2 mirrors 000513 1789786524.173568 mapwrite 0x026edf thru 0x02fd78 (0x8e9a bytes) 000514 1789786524.329430 mapread 0x003398 thru 0x004d1c (0x1985 bytes) 000515 1789786524.380847 MIRROR_RESYNC 2 mirrors 000516 1789786525.192509 trunc from 0x03ff5f to 0x01aac2 (0x2549c bytes) 000517 1789786525.320345 mapwrite 0x02eef1 thru 0x03369e (0x47ae bytes) 000518 1789786525.450388 MIRROR_RESYNC 2 mirrors 000519 1789786526.241355 punch from 0x00d1c4 to 0x013fa5 (0x6de2 bytes) 000520 1789786526.298263 write 0x02991c thru 0x03962a (0xfd0f bytes) 000521 1789786526.306373 trunc from 0x035528 to 0x03962a (0x4103 bytes) 000522 1789786526.321567 trunc from 0x03962b to 0x03d443 (0x3e19 bytes) 000523 1789786526.362427 write 0x01712f thru 0x01faf5 (0x89c7 bytes) 000524 1789786526.375371 read 0x0365e3 thru 0x03d443 (0x6e61 bytes) 000525 1789786526.387203 trunc from 0x01b702 to 0x01eccf (0x35ce bytes) 000526 1789786526.404742 MIRROR_RESYNC 2 mirrors 000527 1789786527.437891 punch from 0x02270a to 0x02e49f (0xbd96 bytes) 000529 1789786527.506071 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3d444): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d444): Mirror 2: 0x844993f8 (stale) CRC-32 checksum value for chunk [0, 0x3d444): Mirror 1: 0xcf0d1849 Mirror 3: 0xcf0d1849 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d444: skipped 000531 1789786528.800962 mapread 0x0200e3 thru 0x02a1d3 (0xa0f1 bytes) 000532 1789786528.881037 mapread 0x0208dc thru 0x030371 (0xfa96 bytes) 000533 1789786528.912826 fallocate 0x00abb7 thru 0x00d7ac (0x2bf6 bytes) 000535 1789786528.983202 mapread 0x02e8ab thru 0x033d45 (0x549b bytes) 000536 1789786529.005689 trunc from 0x03d444 to 0x03e9fe (0x15bb bytes) 000537 1789786529.065055 write 0x0035f1 thru 0x00ffb0 (0xc9c0 bytes) 000538 1789786529.083432 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3e9ff): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e9ff): Mirror 2: 0x49bf92de (stale) Mirror 3: 0x582d449 (stale) CRC-32 checksum value for chunk [0, 0x3e9ff): Mirror 1: 0xc4e9e472 Mirror 4: 0xc4e9e472 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e9ff: skipped 000540 1789786530.366509 MIRROR_RESYNC 4 mirrors 000541 1789786532.032535 mapwrite 0x008a33 thru 0x00df58 (0x5526 bytes) 000543 1789786532.247903 mapwrite 0x027bb9 thru 0x035042 (0xd48a bytes) 000544 1789786532.305701 fallocate 0x032945 thru 0x03ffff (0xd6bb bytes) 000545 1789786532.319028 trunc from 0x03e9ff to 0x019864 (0x2519a bytes) 000546 1789786532.356929 trunc from 0x00314b to 0x011cff (0xebb5 bytes) 000547 1789786532.364378 write 0x015df3 thru 0x01a236 (0x4444 bytes) 000548 1789786532.374077 read 0x007933 thru 0x011aa8 (0xa176 bytes) 000550 1789786532.397949 fallocate 0x00872c thru 0x015c1e (0xd4f3 bytes) 000552 1789786532.407637 punch from 0x00df89 to 0x00ebb6 (0xc2e bytes) 000553 1789786532.418124 mapwrite 0x009712 thru 0x00b20d (0x1afc bytes) 000554 1789786532.463231 punch from 0x0141f3 to 0x01a236 (0x6044 bytes) 000555 1789786532.470273 mapread 0x004907 thru 0x00b292 (0x698c bytes) 000556 1789786532.494872 fallocate 0x026dcf thru 0x02af1e (0x4150 bytes) 000557 1789786532.504005 fallocate 0x007ee4 thru 0x0094bc (0x15d9 bytes) 000558 1789786532.523087 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1a237): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a237): Mirror 2: 0xa44982f8 (stale) Mirror 3: 0xa44982f8 (stale) Mirror 4: 0xa44982f8 (stale) CRC-32 checksum value for chunk [0, 0x1a237): Mirror 1: 0x7831456d Mirror 5: 0x7831456d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a237: skipped 000559 1789786533.655173 read 0x00b2bb thru 0x018256 (0xcf9c bytes) 000560 1789786533.675150 write 0x0004d0 thru 0x00a1f3 (0x9d24 bytes) 000561 1789786533.726293 read 0x00f440 thru 0x017f0d (0x8ace bytes) 000562 1789786533.738110 fallocate 0x025dc0 thru 0x02cb56 (0x6d97 bytes) 000563 1789786533.743104 mapread 0x02522b thru 0x02cb56 (0x792c bytes) 000564 1789786533.752982 mapwrite 0x039740 thru 0x03ffff (0x68c0 bytes) 000565 1789786533.801293 trunc from 0x040000 to 0x01a7f5 (0x2580a bytes) 000566 1789786533.821503 trunc from 0x01a7f6 to 0x02175b (0x6f66 bytes) 000567 1789786533.842048 trunc from 0x0097ef to 0x016964 (0xd176 bytes) 000568 1789786533.854593 fallocate 0x0319f1 thru 0x039a92 (0x80a2 bytes) 000570 1789786533.861082 punch from 0x00e687 to 0x01a22f (0xbba9 bytes) 000572 1789786533.874112 MIRROR_RESYNC 5 mirrors 000573 1789786535.261204 fallocate 0x02d836 thru 0x03295c (0x5127 bytes) 000574 1789786535.308624 read 0x002839 thru 0x0053d6 (0x2b9e bytes) 000575 1789786535.317707 MIRROR_RESYNC 5 mirrors 000576 1789786537.062339 write 0x0278d9 thru 0x030e85 (0x95ad bytes) 000577 1789786537.110679 mapread 0x024f65 thru 0x03113e (0xc1da bytes) 000579 1789786537.149378 MIRROR_RESYNC 5 mirrors 000580 1789786538.480928 trunc from 0x039a93 to 0x030498 (0x95fa bytes) 000581 1789786538.543043 mapwrite 0x0346ee thru 0x03ffff (0xb912 bytes) 000583 1789786538.637349 read 0x012460 thru 0x014afa (0x269b bytes) 000584 1789786538.652521 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x123dca2 (stale) Mirror 3: 0x123dca2 (stale) Mirror 4: 0x123dca2 (stale) Mirror 5: 0x123dca2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3d01e74b Mirror 6: 0x3d01e74b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000585 1789786540.305550 punch from 0x00a1c5 to 0x01052c (0x6368 bytes) 000586 1789786540.393849 mapwrite 0x0374b8 thru 0x03f8bb (0x8404 bytes) 000587 1789786540.526596 MIRROR_RESYNC 6 mirrors 000588 1789786543.246587 fallocate 0x03479a thru 0x03ffff (0xb866 bytes) 000589 1789786543.289623 trunc from 0x040000 to 0x0143a2 (0x2bc5d bytes) 000590 1789786543.325626 mapread 0x009b66 thru 0x013c5a (0xa0f5 bytes) 000591 1789786543.351397 write 0x02451c thru 0x03285d (0xe342 bytes) 000593 1789786543.355929 fallocate 0x00dbda thru 0x01998c (0xbdb3 bytes) 000594 1789786543.367472 mapwrite 0x00126b thru 0x0070e3 (0x5e79 bytes) 000596 1789786543.435799 read 0x00629d thru 0x00b920 (0x5684 bytes) 000597 1789786543.436246 mapread 0x0073ad thru 0x00d009 (0x5c5d bytes) 000598 1789786543.436917 punch from 0x01fea3 to 0x026bc5 (0x6d23 bytes) 000600 1789786543.454599 mapread 0x0230fd thru 0x024e16 (0x1d1a bytes) 000601 1789786543.481279 read 0x031324 thru 0x03285d (0x153a bytes) 000602 1789786543.484323 write 0x01fb87 thru 0x02a4d7 (0xa951 bytes) 000603 1789786543.494373 read 0x0207c2 thru 0x022cb5 (0x24f4 bytes) 000604 1789786543.497537 punch from 0x017a1e to 0x0216d2 (0x9cb5 bytes) 000605 1789786543.534050 fallocate 0x008de0 thru 0x00fc8b (0x6eac bytes) 000606 1789786543.548338 trunc from 0x03285e to 0x020b97 (0x11cc6 bytes) 000607 1789786543.584063 trunc from 0x002474 to 0x003945 (0x14d2 bytes) 000608 1789786543.596618 mapread 0x000da0 thru 0x007172 (0x63d3 bytes) 000609 1789786543.628058 punch from 0x01e029 to 0x020b97 (0x2b6f bytes) 000611 1789786543.637495 write 0x031e01 thru 0x039b73 (0x7d73 bytes) 000612 1789786543.639426 trunc from 0x039b74 to 0x00b6e1 (0x2e492 bytes) 000613 1789786543.661465 trunc from 0x008002 to 0x00b6e1 (0x36e0 bytes) 000614 1789786543.678375 mapread 0x005d62 thru 0x00b6e1 (0x5980 bytes) 000615 1789786543.716114 punch from 0x005862 to 0x00aa80 (0x521f bytes) 000616 1789786543.721298 punch from 0x00918e to 0x00b6e1 (0x2554 bytes) 000617 1789786543.727271 read 0x002578 thru 0x0053bd (0x2e46 bytes) 000618 1789786543.749425 mapread 0x00813a thru 0x008d54 (0xc1b bytes) 000620 1789786543.751448 mapread 0x009237 thru 0x00b6e1 (0x24ab bytes) 000621 1789786543.754370 read 0x0032eb thru 0x00b6e1 (0x83f7 bytes) 000622 1789786543.756189 read 0x0004e9 thru 0x0016e4 (0x11fc bytes) 000623 1789786543.758382 read 0x009a1a thru 0x00b6e1 (0x1cc8 bytes) 000624 1789786543.759004 trunc from 0x00b6e2 to 0x00fa33 (0x4352 bytes) 000625 1789786543.811841 read 0x00b304 thru 0x00f3bc (0x40b9 bytes) 000626 1789786543.826069 mapread 0x003341 thru 0x005d70 (0x2a30 bytes) 000627 1789786543.829373 mapwrite 0x01615e thru 0x025ba4 (0xfa47 bytes) 000628 1789786543.907450 trunc from 0x025ba5 to 0x018d6e (0xce36 bytes) 000629 1789786543.936910 trunc from 0x018d6f to 0x027a86 (0xed18 bytes) 000631 1789786543.975232 punch from 0x009854 to 0x0167a3 (0xcf50 bytes) 000632 1789786543.987625 trunc from 0x01f6bb to 0x027a86 (0x83cc bytes) 000633 1789786543.993330 mapwrite 0x01c360 thru 0x028554 (0xc1f5 bytes) 000634 1789786544.092407 mapwrite 0x00da87 thru 0x00db80 (0xfa bytes) 000635 1789786544.115743 punch from 0x01799d to 0x020269 (0x88cd bytes) 000637 1789786544.125027 mapread 0x024118 thru 0x026593 (0x247c bytes) 000639 1789786544.127779 trunc from 0x028555 to 0x00968f (0x1eec5 bytes) 000641 1789786544.155544 fallocate 0x0026c9 thru 0x00a147 (0x7a7f bytes) 000642 1789786544.163278 punch from 0x000e5e to 0x003ab9 (0x2c5c bytes) 000643 1789786544.170592 trunc from 0x00527d to 0x0079d9 (0x275d bytes) 000645 1789786544.182480 trunc from 0x006858 to 0x00968f (0x2e38 bytes) 000646 1789786544.195699 mapread 0x008c1b thru 0x00968f (0xa75 bytes) 000647 1789786544.220003 mapread 0x008ca9 thru 0x00968f (0x9e7 bytes) 000648 1789786544.220839 punch from 0x001cf9 to 0x008078 (0x6380 bytes) 000649 1789786544.229641 mapwrite 0x027673 thru 0x02d4d4 (0x5e62 bytes) 000650 1789786544.342604 trunc from 0x02d4d5 to 0x018327 (0x151ad bytes) 000651 1789786544.376608 write 0x022348 thru 0x0302b7 (0xdf70 bytes) 000652 1789786544.382592 read 0x010523 thru 0x01a402 (0x9ee0 bytes) 000653 1789786544.408573 punch from 0x025a54 to 0x0302b7 (0xa864 bytes) 000654 1789786544.437027 fallocate 0x00946f thru 0x00c0ca (0x2c5c bytes) 000655 1789786544.446542 write 0x025981 thru 0x0272e7 (0x1967 bytes) 000656 1789786544.460888 fallocate 0x015020 thru 0x0171e3 (0x21c4 bytes) 000657 1789786544.469609 trunc from 0x00c22e to 0x01582b (0x95fe bytes) 000658 1789786544.491326 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x163:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x302b8): Mirror 2: 0x19f7f2da (stale) Mirror 3: 0x19f7f2da (stale) Mirror 4: 0x19f7f2da (stale) Mirror 6: 0x19f7f2da (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x302b8): Mirror 2: 0x19f7f2da (stale) Mirror 3: 0x19f7f2da (stale) Mirror 4: 0x19f7f2da (stale) Mirror 6: 0x19f7f2da (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x302b8: skipped 000659 1789786545.147857 mapwrite 0x009b49 thru 0x00b597 (0x1a4f bytes) 000660 1789786545.184049 write 0x00678d thru 0x011406 (0xac7a bytes) 000661 1789786545.189542 punch from 0x000d1e to 0x002972 (0x1c55 bytes) 000662 1789786545.194880 mapwrite 0x021c8b thru 0x025bef (0x3f65 bytes) 000663 1789786545.230915 mapwrite 0x02675e thru 0x02f892 (0x9135 bytes) 000664 1789786545.297007 mapread 0x011f25 thru 0x01f219 (0xd2f5 bytes) 000665 1789786545.316797 mapwrite 0x03516b thru 0x03dc66 (0x8afc bytes) 000666 1789786545.374272 read 0x01dc36 thru 0x01fbc0 (0x1f8b bytes) 000667 1789786545.376122 read 0x003654 thru 0x007383 (0x3d30 bytes) 000668 1789786545.391328 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3dc67): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dc67): Mirror 2: 0x4109ca67 (stale) Mirror 3: 0x4109ca67 (stale) Mirror 4: 0x4109ca67 (stale) Mirror 6: 0x4109ca67 (stale) CRC-32 checksum value for chunk [0, 0x3dc67): Mirror 1: 0x448db38d Mirror 7: 0x448db38d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dc67: skipped 000669 1789786547.490733 punch from 0x003366 to 0x0062f6 (0x2f91 bytes) 000670 1789786547.557007 write 0x033e94 thru 0x03467b (0x7e8 bytes) 000671 1789786547.579068 mapwrite 0x02d6ae thru 0x034044 (0x6997 bytes) 000672 1789786547.636346 mapread 0x035592 thru 0x03dc66 (0x86d5 bytes) 000673 1789786547.655264 punch from 0x005f35 to 0x006391 (0x45d bytes) 000674 1789786547.662725 mapread 0x01e4b8 thru 0x02c202 (0xdd4b bytes) 000675 1789786547.692376 mapwrite 0x034e98 thru 0x03b6c4 (0x682d bytes) 000676 1789786547.721113 write 0x03bd3d thru 0x03ffff (0x42c3 bytes) 000677 1789786547.723578 read 0x01d353 thru 0x020ebe (0x3b6c bytes) 000678 1789786547.725864 trunc from 0x0097a1 to 0x017c45 (0xe4a5 bytes) 000680 1789786547.734985 read 0x01027d thru 0x0110b1 (0xe35 bytes) 000681 1789786547.748531 fallocate 0x025776 thru 0x02f6f5 (0x9f80 bytes) 000682 1789786547.754946 write 0x015d24 thru 0x020ccc (0xafa9 bytes) 000683 1789786547.762885 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x9c0ad8e (stale) Mirror 3: 0x9c0ad8e (stale) Mirror 4: 0x9c0ad8e (stale) Mirror 6: 0x9c0ad8e (stale) Mirror 7: 0xfc06b7ce (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xca635359 Mirror 8: 0xca635359 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000684 1789786549.543219 read 0x02c069 thru 0x03b3bf (0xf357 bytes) 000685 1789786549.593522 punch from 0x03445c to 0x03ffff (0xbba4 bytes) 000686 1789786549.718551 trunc from 0x040000 to 0x005a44 (0x3a5bb bytes) 000687 1789786549.787212 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x5a45): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5a45): Mirror 2: 0xe6365c3f (stale) Mirror 3: 0xe6365c3f (stale) Mirror 4: 0xe6365c3f (stale) Mirror 6: 0xe6365c3f (stale) Mirror 7: 0xf613c5c4 (stale) Mirror 8: 0xf613c5c4 (stale) CRC-32 checksum value for chunk [0, 0x5a45): Mirror 1: 0xf613c5c4 Mirror 9: 0xf613c5c4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5a45: skipped 000688 1789786551.688265 MIRROR_RESYNC 8 mirrors 000689 1789786553.320823 trunc from 0x005a45 to 0x03097f (0x2af3b bytes) 000690 1789786553.435419 punch from 0x01992f to 0x01f863 (0x5f35 bytes) 000691 1789786553.446973 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x163:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30980): Mirror 3: 0x96dfe3b2 (stale) Mirror 4: 0x96dfe3b2 (stale) Mirror 6: 0x96dfe3b2 (stale) Mirror 7: 0x96dfe3b2 (stale) Mirror 8: 0x96dfe3b2 (stale) Mirror 9: 0x96dfe3b2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30980): Mirror 3: 0x96dfe3b2 (stale) Mirror 4: 0x96dfe3b2 (stale) Mirror 6: 0x96dfe3b2 (stale) Mirror 7: 0x96dfe3b2 (stale) Mirror 8: 0x96dfe3b2 (stale) Mirror 9: 0x96dfe3b2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30980: skipped 000692 1789786554.042706 fallocate 0x03d239 thru 0x03ffff (0x2dc7 bytes) 000693 1789786554.058292 fallocate 0x002d56 thru 0x00476f (0x1a1a bytes) 000694 1789786554.070445 mapread 0x02db7f thru 0x02e523 (0x9a5 bytes) 000696 1789786554.099985 write 0x036842 thru 0x03e46c (0x7c2b bytes) 000697 1789786554.111516 trunc from 0x03e46d to 0x03483c (0x9c30 bytes) 000698 1789786554.138149 fallocate 0x03e5ad thru 0x03ffff (0x1a53 bytes) 000701 1789786554.149970 mapwrite 0x03af26 thru 0x03ed36 (0x3e11 bytes) 000702 1789786554.234499 mapwrite 0x0152ba thru 0x01c614 (0x735b bytes) 000703 1789786554.287866 write 0x0249a8 thru 0x032118 (0xd771 bytes) 000705 1789786554.319343 mapwrite 0x00390e thru 0x00f22a (0xb91d bytes) 000706 1789786554.409427 fallocate 0x012d60 thru 0x01bb81 (0x8e22 bytes) 000707 1789786554.423958 punch from 0x0367ae to 0x03ed36 (0x8589 bytes) 000708 1789786554.433991 write 0x01b67f thru 0x01cf90 (0x1912 bytes) 000709 1789786554.438730 trunc from 0x01f1d2 to 0x02ee91 (0xfcc0 bytes) 000712 1789786554.468274 trunc from 0x02080f to 0x02d5b2 (0xcda4 bytes) 000713 1789786554.485292 trunc from 0x022628 to 0x029d27 (0x7700 bytes) 000714 1789786554.495877 trunc from 0x005f2c to 0x014fb1 (0xf086 bytes) 000716 1789786554.507018 mapwrite 0x036231 thru 0x03ffff (0x9dcf bytes) 000718 1789786554.651787 mapwrite 0x031484 thru 0x03693a (0x54b7 bytes) 000719 1789786554.697783 trunc from 0x00f60d to 0x01e9f7 (0xf3eb bytes) 000720 1789786554.704056 mapread 0x03c25c thru 0x03ffff (0x3da4 bytes) 000721 1789786554.708244 trunc from 0x0286f0 to 0x029033 (0x944 bytes) 000722 1789786554.720084 mapwrite 0x01aff0 thru 0x01dffc (0x300d bytes) 000723 1789786554.781502 write 0x01712c thru 0x025b5f (0xea34 bytes) 000724 1789786554.801962 mapwrite 0x0139f7 thru 0x015d06 (0x2310 bytes) 000725 1789786554.877814 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x289375e9 (stale) Mirror 4: 0x289375e9 (stale) Mirror 6: 0x289375e9 (stale) Mirror 7: 0x289375e9 (stale) Mirror 8: 0x289375e9 (stale) Mirror 9: 0x289375e9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe8c7d631 Mirror 10: 0xe8c7d631 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000726 1789786556.735450 mapwrite 0x0375b4 thru 0x03ffff (0x8a4c bytes) 000727 1789786556.914825 fallocate 0x036fe0 thru 0x03d36d (0x638e bytes) 000728 1789786556.939579 punch from 0x03de2d to 0x03ffff (0x21d3 bytes) 000729 1789786556.968955 write 0x0022a7 thru 0x00645b (0x41b5 bytes) 000731 1789786557.038334 mapwrite 0x00235b thru 0x0057c3 (0x3469 bytes) 000732 1789786557.113099 trunc from 0x0016dd to 0x006aed (0x5411 bytes) 000733 1789786557.130207 write 0x021626 thru 0x02373a (0x2115 bytes) 000735 1789786557.191540 trunc from 0x0382f8 to 0x03ffff (0x7d08 bytes) 000736 1789786557.206583 mapwrite 0x002eb2 thru 0x00b021 (0x8170 bytes) 000737 1789786557.309690 trunc from 0x040000 to 0x021c44 (0x1e3bb bytes) 000738 1789786557.380384 trunc from 0x004f36 to 0x01198f (0xca5a bytes) 000739 1789786557.408264 mapread 0x0057e8 thru 0x0070bc (0x18d5 bytes) 000740 1789786557.430365 trunc from 0x021c45 to 0x019d58 (0x7eec bytes) 000741 1789786557.490109 write 0x00f960 thru 0x01d8cb (0xdf6c bytes) 000742 1789786557.498584 write 0x020dff thru 0x027aa8 (0x6caa bytes) 000743 1789786557.500039 write 0x000ca8 thru 0x005da3 (0x50fc bytes) 000744 1789786557.539221 trunc from 0x020380 to 0x022261 (0x1ee2 bytes) 000745 1789786557.577380 read 0x011685 thru 0x01f332 (0xdcae bytes) 000746 1789786557.604030 mapwrite 0x01533d thru 0x0239c8 (0xe68c bytes) 000747 1789786557.679064 write 0x000fee thru 0x00b5ee (0xa601 bytes) 000748 1789786557.693201 read 0x010096 thru 0x015021 (0x4f8c bytes) 000749 1789786557.693967 punch from 0x007358 to 0x008434 (0x10dd bytes) 000750 1789786557.735123 write 0x02b4e6 thru 0x02c5dd (0x10f8 bytes) 000751 1789786557.740918 fallocate 0x0056f3 thru 0x012d5e (0xd66c bytes) 000752 1789786557.771592 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2c5de): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c5de): Mirror 3: 0xd68d69f1 (stale) Mirror 4: 0xd68d69f1 (stale) Mirror 6: 0xd68d69f1 (stale) Mirror 7: 0xd68d69f1 (stale) Mirror 8: 0xd68d69f1 (stale) Mirror 9: 0xd68d69f1 (stale) Mirror 10: 0x276adf46 (stale) CRC-32 checksum value for chunk [0, 0x2c5de): Mirror 1: 0xec87005f Mirror 11: 0xec87005f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c5de: skipped 000753 1789786559.704906 write 0x00c5a6 thru 0x019e08 (0xd863 bytes) 000754 1789786559.760185 trunc from 0x009290 to 0x0191ec (0xff5d bytes) 000755 1789786559.779185 read 0x009cc3 thru 0x00c16a (0x24a8 bytes) 000757 1789786559.800932 MIRROR_RESYNC 9 mirrors 000758 1789786563.185390 punch from 0x00f9dd to 0x01022f (0x853 bytes) 000759 1789786563.226433 mapwrite 0x0054f7 thru 0x01063c (0xb146 bytes) 000760 1789786563.256171 fallocate 0x030c82 thru 0x03c7f0 (0xbb6f bytes) 000761 1789786563.266867 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2c5de): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c5de): Mirror 3: 0xf5ae9f40 (stale) Mirror 4: 0xf5ae9f40 (stale) Mirror 6: 0xf5ae9f40 (stale) Mirror 7: 0xf5ae9f40 (stale) Mirror 8: 0xf5ae9f40 (stale) Mirror 9: 0xf5ae9f40 (stale) Mirror 10: 0xf5ae9f40 (stale) Mirror 11: 0xf5ae9f40 (stale) CRC-32 checksum value for chunk [0, 0x2c5de): Mirror 1: 0x980d2c04 Mirror 12: 0x980d2c04 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c5de: skipped 000764 1789786564.866511 trunc from 0x02c5de to 0x00a52e (0x220af bytes) 000765 1789786564.953861 punch from 0x008534 to 0x00a52e (0x1ffb bytes) 000766 1789786564.967113 mapread 0x009b74 thru 0x00a52e (0x9bb bytes) 000767 1789786564.996301 punch from 0x0024a0 to 0x009c2e (0x778f bytes) 000768 1789786565.019612 trunc from 0x00a52f to 0x0243b8 (0x19e8a bytes) 000769 1789786565.073185 fallocate 0x02b9f2 thru 0x03b6bc (0xfccb bytes) 000770 1789786565.092198 punch from 0x001ed9 to 0x00d8d5 (0xb9fd bytes) 000771 1789786565.108998 read 0x0208bc thru 0x0243b8 (0x3afd bytes) 000772 1789786565.154803 MIRROR_SPLIT mirror 4 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x163:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x243b9): Mirror 3: 0x2d4c910c (stale) Mirror 4: 0x2d4c910c (stale) Mirror 6: 0x2d4c910c (stale) Mirror 8: 0x2d4c910c (stale) Mirror 9: 0x2d4c910c (stale) Mirror 10: 0x2d4c910c (stale) Mirror 11: 0x2d4c910c (stale) Mirror 12: 0x41df21cd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x243b9): Mirror 3: 0x2d4c910c (stale) Mirror 4: 0x2d4c910c (stale) Mirror 6: 0x2d4c910c (stale) Mirror 8: 0x2d4c910c (stale) Mirror 9: 0x2d4c910c (stale) Mirror 10: 0x2d4c910c (stale) Mirror 11: 0x2d4c910c (stale) Mirror 12: 0x41df21cd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x243b9: skipped 000774 1789786566.179064 trunc from 0x0243b9 to 0x002f54 (0x21464 bytes) 000776 1789786566.202499 fallocate 0x00dddb thru 0x0173fb (0x9621 bytes) 000777 1789786566.212997 read 0x000c12 thru 0x002f54 (0x2343 bytes) 000778 1789786566.217150 mapread 0x00294b thru 0x002f54 (0x60a bytes) 000779 1789786566.217960 trunc from 0x002a77 to 0x002f54 (0x4de bytes) 000780 1789786566.229728 read 0x001a7c thru 0x002f54 (0x14d9 bytes) 000781 1789786566.237077 punch from 0x001ae0 to 0x002f54 (0x1475 bytes) 000783 1789786566.244595 trunc from 0x002f55 to 0x01a509 (0x175b5 bytes) 000784 1789786566.265281 trunc from 0x01a50a to 0x006dbd (0x1374c bytes) 000785 1789786566.294371 punch from 0x000661 to 0x005d6e (0x570e bytes) 000786 1789786566.299870 mapwrite 0x014a1f thru 0x01a764 (0x5d46 bytes) 000787 1789786566.362848 trunc from 0x0016c2 to 0x0107cd (0xf10c bytes) 000788 1789786566.369838 mapwrite 0x02b764 thru 0x033aa6 (0x8343 bytes) 000789 1789786566.427503 read 0x033259 thru 0x033aa6 (0x84e bytes) 000790 1789786566.428038 read 0x013068 thru 0x019f46 (0x6edf bytes) 000792 1789786566.428900 fallocate 0x026d2e thru 0x02c3f8 (0x56cb bytes) 000793 1789786566.433404 trunc from 0x033aa7 to 0x02ba90 (0x8016 bytes) 000794 1789786566.462015 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2ba91): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ba91): Mirror 3: 0x31564c60 (stale) Mirror 4: 0x31564c60 (stale) Mirror 6: 0x31564c60 (stale) Mirror 8: 0x31564c60 (stale) Mirror 9: 0x31564c60 (stale) Mirror 10: 0x31564c60 (stale) Mirror 11: 0x31564c60 (stale) Mirror 12: 0xd946f714 (stale) CRC-32 checksum value for chunk [0, 0x2ba91): Mirror 1: 0xe084362d Mirror 13: 0xe084362d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ba91: skipped 000795 1789786567.709585 fallocate 0x001fb8 thru 0x00c1ad (0xa1f6 bytes) 000796 1789786567.803823 punch from 0x003546 to 0x00d618 (0xa0d3 bytes) 000797 1789786567.832503 fallocate 0x02d102 thru 0x03400d (0x6f0c bytes) 000798 1789786567.843382 write 0x029beb thru 0x02fd70 (0x6186 bytes) 000799 1789786567.897964 fallocate 0x03716d thru 0x03f35a (0x81ee bytes) 000800 1789786567.913807 trunc from 0x03f35b to 0x01b85b (0x23aff bytes) 000801 1789786567.985854 mapwrite 0x029dbf thru 0x02cc2b (0x2e6d bytes) 000802 1789786568.125971 trunc from 0x02cc2c to 0x013d11 (0x18f1a bytes) 000803 1789786568.179733 mapread 0x00102e thru 0x00d54b (0xc51e bytes) 000804 1789786568.210919 trunc from 0x013d12 to 0x037577 (0x23866 bytes) 000805 1789786568.250721 punch from 0x036b03 to 0x037577 (0xa75 bytes) 000806 1789786568.262596 write 0x020241 thru 0x0232d3 (0x3093 bytes) 000807 1789786568.279107 mapwrite 0x02a461 thru 0x02e806 (0x43a6 bytes) 000808 1789786568.339825 fallocate 0x02c7b0 thru 0x03ad69 (0xe5ba bytes) 000809 1789786568.349571 trunc from 0x03ad6a to 0x025093 (0x15cd6 bytes) 000810 1789786568.384736 mapread 0x00f49d thru 0x01c467 (0xcfcb bytes) 000811 1789786568.427902 write 0x0053e4 thru 0x00e44e (0x906b bytes) 000812 1789786568.430149 trunc from 0x025094 to 0x03c5ad (0x1751a bytes) 000813 1789786568.458017 fallocate 0x0226f1 thru 0x02ee99 (0xc7a9 bytes) 000815 1789786568.478010 mapread 0x020193 thru 0x023ff5 (0x3e63 bytes) 000816 1789786568.478980 trunc from 0x03c5ae to 0x01a8e7 (0x21cc6 bytes) 000817 1789786568.508883 punch from 0x001deb to 0x003bfb (0x1e11 bytes) 000818 1789786568.519601 fallocate 0x0355f1 thru 0x037e8e (0x289e bytes) 000819 1789786568.527635 mapwrite 0x005227 thru 0x00f91a (0xa6f4 bytes) 000820 1789786568.571530 trunc from 0x0085f7 to 0x00a8e4 (0x22ee bytes) 000821 1789786568.583831 trunc from 0x00815f to 0x012152 (0x9ff4 bytes) 000822 1789786568.594384 write 0x0379b3 thru 0x03d06e (0x56bc bytes) 000823 1789786568.602529 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3d06f): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d06f): Mirror 3: 0x70a229d2 (stale) Mirror 4: 0x70a229d2 (stale) Mirror 6: 0x70a229d2 (stale) Mirror 8: 0x70a229d2 (stale) Mirror 9: 0x70a229d2 (stale) Mirror 10: 0x70a229d2 (stale) Mirror 11: 0x70a229d2 (stale) Mirror 12: 0x6512289d (stale) Mirror 13: 0xb063e5b3 (stale) CRC-32 checksum value for chunk [0, 0x3d06f): Mirror 1: 0xc54d5eea Mirror 14: 0xc54d5eea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d06f: skipped 000824 1789786569.657226 write 0x03bb6e thru 0x03ef56 (0x33e9 bytes) 000825 1789786569.724202 mapread 0x03637a thru 0x03c519 (0x61a0 bytes) 000826 1789786569.754495 MIRROR_RESYNC 11 mirrors 000827 1789786572.753450 trunc from 0x03ef57 to 0x0260c6 (0x18e90 bytes) 000828 1789786572.796921 punch from 0x0180eb to 0x018faa (0xec0 bytes) 000829 1789786572.801900 read 0x01ee76 thru 0x01ff49 (0x10d4 bytes) 000830 1789786572.807811 punch from 0x00da8b to 0x00fcc6 (0x223c bytes) 000831 1789786572.814627 trunc from 0x0260c7 to 0x004b7c (0x2154a bytes) 000833 1789786572.867494 mapread 0x001b44 thru 0x004b7c (0x3039 bytes) 000834 1789786572.890298 fallocate 0x0375d3 thru 0x03ffff (0x8a2d bytes) 000835 1789786572.902041 fallocate 0x00f8c3 thru 0x0127d5 (0x2f13 bytes) 000836 1789786572.910459 read 0x004759 thru 0x00e6f6 (0x9f9e bytes) 000837 1789786572.934371 mapwrite 0x004900 thru 0x00981a (0x4f1b bytes) 000838 1789786572.958354 trunc from 0x006821 to 0x0068f2 (0xd2 bytes) 000839 1789786572.976289 write 0x002080 thru 0x00b963 (0x98e4 bytes) 000840 1789786572.979266 fallocate 0x016041 thru 0x024642 (0xe602 bytes) 000841 1789786572.991070 fallocate 0x03ee44 thru 0x03f613 (0x7d0 bytes) 000842 1789786573.004496 mapwrite 0x021a2c thru 0x029ea9 (0x847e bytes) 000843 1789786573.056711 trunc from 0x03f614 to 0x007f0d (0x37706 bytes) 000844 1789786573.088795 mapwrite 0x038f91 thru 0x03fc71 (0x6ce1 bytes) 000845 1789786573.199385 punch from 0x02cfbf to 0x033ffb (0x703d bytes) 000846 1789786573.205756 punch from 0x029a2d to 0x03621c (0xc7f0 bytes) 000847 1789786573.218426 MIRROR_RESYNC 11 mirrors 000848 1789786576.237467 trunc from 0x028a89 to 0x033ab7 (0xb02f bytes) 000849 1789786576.293857 trunc from 0x03fc72 to 0x003091 (0x3cbe0 bytes) 000850 1789786576.337169 MIRROR_RESYNC 11 mirrors 000851 1789786578.042445 trunc from 0x003092 to 0x03c36e (0x392dd bytes) 000852 1789786578.108366 mapread 0x00e407 thru 0x01a84d (0xc447 bytes) 000853 1789786578.152196 punch from 0x0327e5 to 0x037b4f (0x536b bytes) 000854 1789786578.158864 fallocate 0x037915 thru 0x03ffff (0x86eb bytes) 000855 1789786578.165252 punch from 0x004a0f to 0x00df25 (0x9517 bytes) 000856 1789786578.173083 read 0x016402 thru 0x016918 (0x517 bytes) 000857 1789786578.174446 trunc from 0x03c36f to 0x039861 (0x2b0d bytes) 000858 1789786578.203807 punch from 0x02e6fa to 0x02f32a (0xc31 bytes) 000859 1789786578.211592 fallocate 0x03bb1d thru 0x03ffff (0x44e3 bytes) 000860 1789786578.218163 mapwrite 0x006b36 thru 0x015c2d (0xf0f8 bytes) 000861 1789786578.280022 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x988b5155 (stale) Mirror 4: 0x988b5155 (stale) Mirror 6: 0x988b5155 (stale) Mirror 8: 0x988b5155 (stale) Mirror 9: 0x988b5155 (stale) Mirror 10: 0x988b5155 (stale) Mirror 11: 0x988b5155 (stale) Mirror 12: 0x988b5155 (stale) Mirror 13: 0x988b5155 (stale) Mirror 14: 0x988b5155 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6a1c8d9e Mirror 15: 0x6a1c8d9e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000862 1789786579.601977 mapwrite 0x00d5a8 thru 0x0101e3 (0x2c3c bytes) 000863 1789786579.765224 MIRROR_RESYNC 12 mirrors 000865 1789786583.279422 punch from 0x00cb1e to 0x011c4b (0x512e bytes) 000866 1789786583.326561 trunc from 0x040000 to 0x00e542 (0x31abd bytes) 000867 1789786583.356310 MIRROR_RESYNC 12 mirrors 000868 1789786586.025921 trunc from 0x00d13b to 0x00e542 (0x1408 bytes) 000869 1789786586.060899 mapread 0x00989f thru 0x00e542 (0x4ca4 bytes) 000870 1789786586.085076 trunc from 0x00e543 to 0x006966 (0x7bdc bytes) 000871 1789786586.110321 mapwrite 0x02b886 thru 0x0376a1 (0xbe1c bytes) 000872 1789786586.172531 trunc from 0x02c5f0 to 0x0376a1 (0xb0b2 bytes) 000873 1789786586.179203 punch from 0x00f4dc to 0x01aaba (0xb5df bytes) 000874 1789786586.185497 fallocate 0x005879 thru 0x00d548 (0x7cd0 bytes) 000875 1789786586.191096 mapread 0x011c5e thru 0x015bdb (0x3f7e bytes) 000876 1789786586.203477 mapread 0x010c4f thru 0x01fccd (0xf07f bytes) 000877 1789786586.215785 mapread 0x0295bd thru 0x02e27b (0x4cbf bytes) 000878 1789786586.231537 MIRROR_RESYNC 12 mirrors 000879 1789786590.399319 fallocate 0x023cb0 thru 0x033adb (0xfe2c bytes) 000880 1789786590.459194 trunc from 0x000ebb to 0x00bcc5 (0xae0b bytes) 000881 1789786590.478968 fallocate 0x013f9d thru 0x022253 (0xe2b7 bytes) 000882 1789786590.488568 trunc from 0x0185b6 to 0x01f8e2 (0x732d bytes) 000883 1789786590.497321 trunc from 0x01b3d9 to 0x01d2a9 (0x1ed1 bytes) 000884 1789786590.512548 trunc from 0x0376a2 to 0x001377 (0x3632a bytes) 000885 1789786590.536288 read 0x000392 thru 0x001377 (0xfe6 bytes) 000886 1789786590.541925 trunc from 0x0003b6 to 0x001377 (0xfc2 bytes) 000887 1789786590.552177 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x163:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1378): Mirror 4: 0x5fe9f21 (stale) Mirror 6: 0x5fe9f21 (stale) Mirror 8: 0x5fe9f21 (stale) Mirror 9: 0x5fe9f21 (stale) Mirror 10: 0x5fe9f21 (stale) Mirror 11: 0x5fe9f21 (stale) Mirror 12: 0x5fe9f21 (stale) Mirror 13: 0x5fe9f21 (stale) Mirror 14: 0x5fe9f21 (stale) Mirror 15: 0x5fe9f21 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1378): Mirror 4: 0x5fe9f21 (stale) Mirror 6: 0x5fe9f21 (stale) Mirror 8: 0x5fe9f21 (stale) Mirror 9: 0x5fe9f21 (stale) Mirror 10: 0x5fe9f21 (stale) Mirror 11: 0x5fe9f21 (stale) Mirror 12: 0x5fe9f21 (stale) Mirror 13: 0x5fe9f21 (stale) Mirror 14: 0x5fe9f21 (stale) Mirror 15: 0x5fe9f21 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1378: skipped 000888 1789786591.037283 mapwrite 0x02722a thru 0x028410 (0x11e7 bytes) 000889 1789786591.154123 MIRROR_RESYNC 11 mirrors 000890 1789786593.841585 trunc from 0x028411 to 0x030dbd (0x89ad bytes) 000891 1789786593.952371 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x30dbe): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30dbe): Mirror 4: 0x13408b03 (stale) Mirror 6: 0x13408b03 (stale) Mirror 8: 0x13408b03 (stale) Mirror 9: 0x13408b03 (stale) Mirror 10: 0x13408b03 (stale) Mirror 11: 0x13408b03 (stale) Mirror 12: 0x13408b03 (stale) Mirror 13: 0x13408b03 (stale) Mirror 14: 0x13408b03 (stale) Mirror 15: 0x13408b03 (stale) CRC-32 checksum value for chunk [0, 0x30dbe): Mirror 1: 0x13408b03 Mirror 16: 0x13408b03 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30dbe: skipped 000892 1789786595.522022 write 0x03a2fb thru 0x03d7bf (0x34c5 bytes) 000893 1789786595.623919 trunc from 0x013670 to 0x021a33 (0xe3c4 bytes) 000894 1789786595.641317 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3d7c0): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d7c0): Mirror 4: 0x51ce1ac9 (stale) Mirror 6: 0x51ce1ac9 (stale) Mirror 8: 0x51ce1ac9 (stale) Mirror 9: 0x51ce1ac9 (stale) Mirror 10: 0x51ce1ac9 (stale) Mirror 11: 0x51ce1ac9 (stale) Mirror 12: 0x51ce1ac9 (stale) Mirror 13: 0x51ce1ac9 (stale) Mirror 14: 0x51ce1ac9 (stale) Mirror 15: 0x51ce1ac9 (stale) Mirror 16: 0x51ce1ac9 (stale) CRC-32 checksum value for chunk [0, 0x3d7c0): Mirror 1: 0x70ee7de7 Mirror 17: 0x70ee7de7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d7c0: skipped 000895 1789786597.782166 read 0x0020c2 thru 0x006229 (0x4168 bytes) 000896 1789786597.834217 mapwrite 0x001a93 thru 0x007015 (0x5583 bytes) 000897 1789786598.123941 punch from 0x00e36c to 0x01bcca (0xd95f bytes) 000898 1789786598.131400 read 0x015a32 thru 0x01acbd (0x528c bytes) 000899 1789786598.150677 mapread 0x037cbd thru 0x03b5f4 (0x3938 bytes) 000900 1789786598.152502 read 0x008c6f thru 0x014ae7 (0xbe79 bytes) 000901 1789786598.153602 mapread 0x03075f thru 0x035276 (0x4b18 bytes) 000902 1789786598.155616 trunc from 0x030401 to 0x03d396 (0xcf96 bytes) 000903 1789786598.177002 MIRROR_RESYNC 13 mirrors 000904 1789786602.381521 read 0x004a72 thru 0x008974 (0x3f03 bytes) 000905 1789786602.389601 mapwrite 0x00e60c thru 0x0133e7 (0x4ddc bytes) 000906 1789786602.589566 trunc from 0x03d7c0 to 0x00fc43 (0x2db7c bytes) 000907 1789786602.654600 read 0x008841 thru 0x00fc43 (0x7403 bytes) 000908 1789786602.658553 read 0x009400 thru 0x00fc43 (0x6844 bytes) 000909 1789786602.659198 mapread 0x0028f7 thru 0x00fc43 (0xd34d bytes) 000910 1789786602.688104 read 0x00d248 thru 0x00fc43 (0x29fc bytes) 000911 1789786602.690626 mapread 0x000d1b thru 0x00f1c9 (0xe4af bytes) 000912 1789786602.691712 trunc from 0x00fc44 to 0x020f50 (0x1130d bytes) 000913 1789786602.737623 MIRROR_SPLIT mirror 9 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x163:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20f51): Mirror 4: 0xe05ce4f0 (stale) Mirror 6: 0xe05ce4f0 (stale) Mirror 8: 0xe05ce4f0 (stale) Mirror 9: 0xe05ce4f0 (stale) Mirror 10: 0xe05ce4f0 (stale) Mirror 11: 0xe05ce4f0 (stale) Mirror 12: 0xe05ce4f0 (stale) Mirror 13: 0xe05ce4f0 (stale) Mirror 15: 0xe05ce4f0 (stale) Mirror 16: 0xe05ce4f0 (stale) Mirror 17: 0xe05ce4f0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20f51): Mirror 4: 0xe05ce4f0 (stale) Mirror 6: 0xe05ce4f0 (stale) Mirror 8: 0xe05ce4f0 (stale) Mirror 9: 0xe05ce4f0 (stale) Mirror 10: 0xe05ce4f0 (stale) Mirror 11: 0xe05ce4f0 (stale) Mirror 12: 0xe05ce4f0 (stale) Mirror 13: 0xe05ce4f0 (stale) Mirror 15: 0xe05ce4f0 (stale) Mirror 16: 0xe05ce4f0 (stale) Mirror 17: 0xe05ce4f0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20f51: skipped 000914 1789786603.812287 trunc from 0x01f13b to 0x0200d4 (0xf9a bytes) 000915 1789786603.832309 MIRROR_RESYNC 12 mirrors 000916 1789786606.111879 trunc from 0x01eb4a to 0x020f50 (0x2407 bytes) 000917 1789786606.172340 write 0x0051b1 thru 0x00e791 (0x95e1 bytes) 000918 1789786606.184284 mapread 0x00d17b thru 0x011f11 (0x4d97 bytes) 000919 1789786606.208772 punch from 0x003aba to 0x005e3d (0x2384 bytes) 000920 1789786606.224029 trunc from 0x020f51 to 0x01176c (0xf7e4 bytes) 000921 1789786606.253220 trunc from 0x01176d to 0x01330d (0x1ba1 bytes) 000922 1789786606.272318 read 0x010404 thru 0x01330d (0x2f0a bytes) 000923 1789786606.283763 fallocate 0x01bd8f thru 0x029ffc (0xe26e bytes) 000925 1789786606.291251 read 0x00010c thru 0x00f5a9 (0xf49e bytes) 000926 1789786606.309616 trunc from 0x029ffd to 0x02242b (0x7bd1 bytes) 000927 1789786606.325418 write 0x019f70 thru 0x01cde7 (0x2e78 bytes) 000928 1789786606.327038 fallocate 0x02c57a thru 0x02c965 (0x3ec bytes) 000929 1789786606.332782 trunc from 0x015986 to 0x019ce5 (0x4360 bytes) 000930 1789786606.345753 punch from 0x008b59 to 0x00d10d (0x45b5 bytes) 000931 1789786606.352549 read 0x019b60 thru 0x01f682 (0x5b23 bytes) 000932 1789786606.362303 trunc from 0x01494a to 0x019195 (0x484c bytes) 000933 1789786606.368712 mapwrite 0x0100a5 thru 0x014123 (0x407f bytes) 000934 1789786606.397379 trunc from 0x02242c to 0x0002d9 (0x22152 bytes) 000935 1789786606.419233 trunc from 0x000097 to 0x0002d9 (0x243 bytes) 000936 1789786606.426424 write 0x004210 thru 0x00a502 (0x62f3 bytes) 000938 1789786606.428199 trunc from 0x00a503 to 0x03dfe5 (0x33ae3 bytes) 000940 1789786606.445384 write 0x02d83d thru 0x034563 (0x6d27 bytes) 000941 1789786606.458957 trunc from 0x02ce44 to 0x02eaa2 (0x1c5f bytes) 000942 1789786606.482702 trunc from 0x008efe to 0x014c71 (0xbd74 bytes) 000943 1789786606.489416 trunc from 0x02242b to 0x02535d (0x2f33 bytes) 000944 1789786606.496560 mapwrite 0x01f9cf thru 0x02cf3e (0xd570 bytes) 000945 1789786606.548512 read 0x016928 thru 0x018c15 (0x22ee bytes) 000946 1789786606.563449 MIRROR_RESYNC 12 mirrors 000947 1789786609.600390 mapread 0x008678 thru 0x0182a3 (0xfc2c bytes) 000948 1789786609.638317 mapread 0x018375 thru 0x0210d7 (0x8d63 bytes) 000949 1789786609.653179 punch from 0x018d80 to 0x019217 (0x498 bytes) 000950 1789786609.709534 read 0x007614 thru 0x00f900 (0x82ed bytes) 000951 1789786609.727199 punch from 0x01ac57 to 0x0288ba (0xdc64 bytes) 000952 1789786609.734175 mapread 0x00f4ac thru 0x0117e7 (0x233c bytes) 000953 1789786609.763981 MIRROR_RESYNC 12 mirrors 000954 1789786613.922321 mapread 0x0217aa thru 0x024a96 (0x32ed bytes) 000956 1789786613.949533 trunc from 0x00ccc9 to 0x010642 (0x397a bytes) 000957 1789786613.994940 read 0x026be9 thru 0x031e36 (0xb24e bytes) 000958 1789786614.012057 fallocate 0x01954c thru 0x026d2e (0xd7e3 bytes) 000959 1789786614.016919 write 0x0399be thru 0x03ffff (0x6642 bytes) 000960 1789786614.022388 mapread 0x02aba8 thru 0x0331e6 (0x863f bytes) 000961 1789786614.029047 fallocate 0x010cf3 thru 0x010fa8 (0x2b6 bytes) 000963 1789786614.033262 punch from 0x0198e9 to 0x01f161 (0x5879 bytes) 000964 1789786614.036467 fallocate 0x02299d thru 0x02317d (0x7e1 bytes) 000965 1789786614.039572 mapwrite 0x00515a thru 0x01423f (0xf0e6 bytes) 000966 1789786614.085207 mapread 0x001332 thru 0x00155b (0x22a bytes) 000967 1789786614.087315 read 0x0121c6 thru 0x01b6a6 (0x94e1 bytes) 000968 1789786614.098738 mapread 0x013b88 thru 0x0229f3 (0xee6c bytes) 000969 1789786614.100071 read 0x038a28 thru 0x03a71e (0x1cf7 bytes) 000970 1789786614.101144 mapwrite 0x00558d thru 0x00a359 (0x4dcd bytes) 000971 1789786614.132498 mapwrite 0x00ec4d thru 0x00f2a3 (0x657 bytes) 000973 1789786614.159580 fallocate 0x01c80f thru 0x01cb34 (0x326 bytes) 000974 1789786614.167801 fallocate 0x02700d thru 0x031cc6 (0xacba bytes) 000976 1789786614.178337 write 0x00812f thru 0x00baf4 (0x39c6 bytes) 000977 1789786614.187251 trunc from 0x00458a to 0x00e6ea (0xa161 bytes) 000978 1789786614.210863 MIRROR_RESYNC 12 mirrors 000979 1789786619.746412 trunc from 0x0270fc to 0x035774 (0xe679 bytes) 000980 1789786619.784837 write 0x017901 thru 0x01c069 (0x4769 bytes) 000981 1789786619.795313 trunc from 0x040000 to 0x004adc (0x3b523 bytes) 000982 1789786619.824898 mapread 0x0037f0 thru 0x004adc (0x12ed bytes) 000983 1789786619.835636 read 0x00237f thru 0x004adc (0x275e bytes) 000984 1789786619.841320 punch from 0x0011ba to 0x004adc (0x3923 bytes) 000985 1789786619.846510 write 0x007f49 thru 0x0146cc (0xc784 bytes) 000986 1789786619.848265 mapread 0x004bca thru 0x012079 (0xd4b0 bytes) 000988 1789786619.864043 read 0x001f08 thru 0x005c76 (0x3d6f bytes) 000989 1789786619.865129 punch from 0x0066ca to 0x007d05 (0x163c bytes) 000990 1789786619.886107 mapread 0x003ccd thru 0x013b95 (0xfec9 bytes) 000991 1789786619.894780 write 0x0187fc thru 0x01e7db (0x5fe0 bytes) 000992 1789786619.901248 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x1e7dc): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e7dc): Mirror 4: 0xe0a966df (stale) Mirror 6: 0xe0a966df (stale) Mirror 8: 0xe0a966df (stale) Mirror 9: 0xe0a966df (stale) Mirror 10: 0xe0a966df (stale) Mirror 11: 0xe0a966df (stale) Mirror 12: 0xe0a966df (stale) Mirror 13: 0xe0a966df (stale) Mirror 15: 0xe0a966df (stale) Mirror 16: 0xe0a966df (stale) Mirror 17: 0xe0a966df (stale) CRC-32 checksum value for chunk [0, 0x1e7dc): Mirror 1: 0x3c0e393d Mirror 18: 0x3c0e393d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e7dc: skipped 000993 1789786621.385896 write 0x030e9e thru 0x03a8d6 (0x9a39 bytes) 000995 1789786621.496743 fallocate 0x02d204 thru 0x02f737 (0x2534 bytes) 000996 1789786621.523079 read 0x01c933 thru 0x01f591 (0x2c5f bytes) 000997 1789786621.541908 trunc from 0x03a8d7 to 0x036e5a (0x3a7c bytes) 000998 1789786621.574113 read 0x00bf25 thru 0x0125a7 (0x6683 bytes) 000999 1789786621.585568 punch from 0x003e7c to 0x00f74e (0xb8d3 bytes) 001000 1789786621.593408 mapwrite 0x02f861 thru 0x0335b4 (0x3d54 bytes) All operations completed A-OK!