== sanity-flr test 70a: flr mode fsx test ================ 21:43:52 (1787708632) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 8634 fallocating to largest ever: 0x23d64 000001 1787708634.550989 fallocate 0x01d11a thru 0x023d63 (0x6c4a bytes) 000002 1787708634.560061 trunc from 00000000 to 0x0171c5 (0x171c6 bytes) 000003 1787708634.573316 write 0x03da27 thru 0x03ffff (0x25d9 bytes) truncating to largest ever: 0x3176a 000004 1787708634.574447 trunc from 0x040000 to 0x031769 (0xe896 bytes) fallocating to largest ever: 0x3a74e 000005 1787708634.587520 fallocate 0x02b677 thru 0x03a74d (0xf0d7 bytes) 000006 1787708634.591042 mapwrite 0x00f86d thru 0x01c6f9 (0xce8d bytes) 000007 1787708634.646475 trunc from 0x03176a to 0x019789 (0x17fe0 bytes) 000008 1787708634.660095 trunc from 0x01978a to 0x032139 (0x189b0 bytes) 000009 1787708634.680203 write 0x0244c3 thru 0x02b9b4 (0x74f2 bytes) 000010 1787708634.692283 mapwrite 0x00e90f thru 0x014e17 (0x6509 bytes) 000011 1787708634.715662 mapwrite 0x0240dc thru 0x02630b (0x2230 bytes) 000014 1787708634.742188 write 0x012c75 thru 0x01ebb8 (0xbf44 bytes) 000015 1787708634.752526 trunc from 0x02e476 to 0x032139 (0x3cc4 bytes) 000016 1787708634.762278 MIRROR_EXTEND to 2 mirrors 000017 1787708635.466806 mapwrite 0x011223 thru 0x018b1e (0x78fc bytes) 000018 1787708635.616220 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3213a): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3213a): Mirror 2: 0x656e04e8 (stale) CRC-32 checksum value for chunk [0, 0x3213a): Mirror 1: 0x46862750 Mirror 3: 0x46862750 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3213a: skipped 000019 1787708636.636400 trunc from 0x03213a to 0x01137e (0x20dbb bytes) 000020 1787708636.693097 mapwrite 0x026846 thru 0x0306bc (0x9e77 bytes) 000021 1787708636.763208 mapwrite 0x029334 thru 0x02b6b4 (0x2381 bytes) 000022 1787708636.775845 trunc from 0x0306bd to 0x005bdf (0x2aadd bytes) 000024 1787708636.792062 read 0x0058f5 thru 0x005bdf (0x2eb bytes) 000025 1787708636.805488 trunc from 0x0025ec to 0x005bdf (0x35f4 bytes) 000026 1787708636.816624 mapread 0x002fe2 thru 0x005bdf (0x2bfe bytes) 000027 1787708636.830570 write 0x025704 thru 0x027255 (0x1b52 bytes) 000028 1787708636.832559 read 0x00a862 thru 0x01547d (0xac1c bytes) 000029 1787708636.845663 mapwrite 0x01c970 thru 0x0212f2 (0x4983 bytes) 000030 1787708636.868400 mapread 0x01b191 thru 0x027255 (0xc0c5 bytes) 000033 1787708636.870263 mapwrite 0x0046a5 thru 0x00a598 (0x5ef4 bytes) 000034 1787708636.891612 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x27256): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27256): Mirror 2: 0x6e62e892 (stale) Mirror 3: 0xd9d73adc (stale) CRC-32 checksum value for chunk [0, 0x27256): Mirror 1: 0x880cbfa5 Mirror 4: 0x880cbfa5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27256: skipped 000035 1787708637.840633 trunc from 0x027256 to 0x0137eb (0x13a6a bytes) 000036 1787708637.896291 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x137ec): Mirror 3: 0xa60172ec (stale) Mirror 4: 0xfc22b89c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x137ec): Mirror 3: 0xa60172ec (stale) Mirror 4: 0xfc22b89c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x137ec: skipped fallocating to largest ever: 0x40000 000037 1787708638.230283 fallocate 0x03d6e4 thru 0x03ffff (0x291c bytes) 000038 1787708638.234356 mapwrite 0x01e5ab thru 0x02d379 (0xedcf bytes) 000039 1787708638.315661 mapread 0x00e7ae thru 0x01aded (0xc640 bytes) 000040 1787708638.334362 mapread 0x023779 thru 0x02a3d1 (0x6c59 bytes) 000041 1787708638.341638 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d37a): Mirror 3: 0xfdd98654 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d37a): Mirror 3: 0xfdd98654 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d37a: skipped 000042 1787708638.747983 mapwrite 0x018299 thru 0x020140 (0x7ea8 bytes) 000043 1787708638.800443 fallocate 0x016ded thru 0x0233f0 (0xc604 bytes) 000044 1787708638.806635 punch from 0x01ed78 to 0x028475 (0x96fe bytes) 000045 1787708638.814214 write 0x00eab8 thru 0x00fa3d (0xf86 bytes) 000047 1787708638.830129 read 0x029e24 thru 0x02c99f (0x2b7c bytes) 000048 1787708638.837786 trunc from 0x02d37a to 0x001967 (0x2ba12 bytes) 000049 1787708638.858614 trunc from 0x001968 to 0x0080b8 (0x6751 bytes) 000051 1787708638.876158 mapwrite 0x005859 thru 0x010f37 (0xb6df bytes) 000052 1787708638.956596 trunc from 0x010f38 to 0x013b98 (0x2c61 bytes) 000054 1787708638.987434 read 0x009da0 thru 0x0114c7 (0x7728 bytes) 000056 1787708639.003877 read 0x00062f thru 0x003aae (0x3480 bytes) 000057 1787708639.005616 trunc from 0x013b99 to 0x007ae7 (0xc0b1 bytes) 000058 1787708639.037359 mapread 0x000954 thru 0x007ae7 (0x7194 bytes) 000059 1787708639.039594 fallocate 0x01bd17 thru 0x02997d (0xdc67 bytes) 000061 1787708639.046336 fallocate 0x01ae73 thru 0x02285b (0x79e9 bytes) 000063 1787708639.050560 punch from 0x01ee5e to 0x02997d (0xab20 bytes) 000064 1787708639.055996 fallocate 0x0279c2 thru 0x033363 (0xb9a2 bytes) 000065 1787708639.060718 trunc from 0x00ccd6 to 0x01cb58 (0xfe83 bytes) 000066 1787708639.065451 fallocate 0x00bf63 thru 0x00e5ab (0x2649 bytes) 000067 1787708639.069891 mapwrite 0x0185c3 thru 0x02136f (0x8dad bytes) 000068 1787708639.097994 mapwrite 0x027e5c thru 0x02c639 (0x47de bytes) 000069 1787708639.133639 mapread 0x014edc thru 0x01c460 (0x7585 bytes) 000070 1787708639.140090 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2c63a): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c63a): Mirror 3: 0x1d732900 (stale) CRC-32 checksum value for chunk [0, 0x2c63a): Mirror 1: 0xcaa6ac6a Mirror 4: 0xcaa6ac6a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c63a: skipped 000071 1787708640.162061 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) 000072 1787708640.496479 mapread 0x024127 thru 0x02c639 (0x8513 bytes) 000073 1787708640.516936 mapwrite 0x03e2f4 thru 0x03ffff (0x1d0c bytes) 000074 1787708640.636196 trunc from 0x040000 to 0x016078 (0x29f87 bytes) 000075 1787708640.662601 mapwrite 0x037b6d thru 0x03ffff (0x8493 bytes) 000077 1787708640.737473 mapwrite 0x02ec24 thru 0x0372d4 (0x86b1 bytes) 000078 1787708640.799149 trunc from 0x005391 to 0x00c98a (0x75fa bytes) 000079 1787708640.806931 write 0x031cec thru 0x036c25 (0x4f3a bytes) 000080 1787708640.808537 trunc from 0x040000 to 0x007caf (0x38350 bytes) 000081 1787708640.834929 mapread 0x0012ca thru 0x007caf (0x69e6 bytes) 000082 1787708640.858061 mapread 0x0023e8 thru 0x007caf (0x58c8 bytes) 000083 1787708640.859016 mapread 0x006e0c thru 0x007caf (0xea4 bytes) 000084 1787708640.862079 punch from 0x000d3b to 0x007caf (0x6f75 bytes) 000085 1787708640.871258 mapwrite 0x034656 thru 0x03d427 (0x8dd2 bytes) 000086 1787708640.944146 read 0x000b60 thru 0x0032ae (0x274f bytes) 000087 1787708640.954390 trunc from 0x03d428 to 0x03b5dc (0x1e4b bytes) 000088 1787708640.978379 punch from 0x01e6db to 0x021024 (0x294a bytes) 000089 1787708640.984198 trunc from 0x00d321 to 0x01a9bb (0xd69b bytes) 000090 1787708640.991911 trunc from 0x03b5dd to 0x001864 (0x39d78 bytes) 000091 1787708641.010739 read 0x00065f thru 0x001864 (0x1206 bytes) 000092 1787708641.011478 write 0x00a8bb thru 0x014083 (0x97c9 bytes) 000093 1787708641.020654 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) 000094 1787708641.220755 read 0x007591 thru 0x011dae (0xa81e bytes) 000095 1787708641.236163 write 0x03c5ab thru 0x03ffff (0x3a55 bytes) 000096 1787708641.244060 trunc from 0x00d1fe to 0x00f821 (0x2624 bytes) 000097 1787708641.250582 trunc from 0x040000 to 0x031369 (0xec96 bytes) 000098 1787708641.268335 mapread 0x004210 thru 0x00bfb7 (0x7da8 bytes) 000100 1787708641.295973 punch from 0x02fd02 to 0x031369 (0x1668 bytes) 000102 1787708641.301767 write 0x03754f thru 0x03ffff (0x8ab1 bytes) 000103 1787708641.305226 read 0x03692d thru 0x03fd5e (0x9432 bytes) 000104 1787708641.320619 mapwrite 0x027ed2 thru 0x02806b (0x19a bytes) 000105 1787708641.338975 punch from 0x010e7e to 0x01fc4a (0xedcd bytes) 000106 1787708641.345143 trunc from 0x040000 to 0x013853 (0x2c7ac bytes) 000107 1787708641.362605 mapwrite 0x0071bf thru 0x00f126 (0x7f68 bytes) 000108 1787708641.393771 trunc from 0x013854 to 0x014ff0 (0x179d bytes) 000109 1787708641.414730 punch from 0x000fd4 to 0x00b056 (0xa083 bytes) 000111 1787708641.423377 mapread 0x000eba thru 0x009a10 (0x8b57 bytes) 000114 1787708641.485124 fallocate 0x01f838 thru 0x027d7f (0x8548 bytes) 000115 1787708641.491556 mapwrite 0x01e1ec thru 0x029b29 (0xb93e bytes) 000116 1787708641.626347 read 0x0114f3 thru 0x01a181 (0x8c8f bytes) 000117 1787708641.637401 read 0x013964 thru 0x01e87c (0xaf19 bytes) 000118 1787708641.638143 write 0x0061cf thru 0x00c3e8 (0x621a bytes) 000119 1787708641.640145 read 0x005ee0 thru 0x007ad1 (0x1bf2 bytes) 000120 1787708641.640749 mapread 0x01cb08 thru 0x029b29 (0xd022 bytes) 000121 1787708641.642230 mapread 0x022439 thru 0x0292a2 (0x6e6a bytes) 000122 1787708641.643598 mapwrite 0x0015aa thru 0x008c35 (0x768c bytes) 000123 1787708641.664297 fallocate 0x008749 thru 0x011c01 (0x94b9 bytes) 000124 1787708641.678484 mapwrite 0x01dcbe thru 0x0273de (0x9721 bytes) 000125 1787708641.701313 write 0x019ae3 thru 0x01d57a (0x3a98 bytes) 000126 1787708641.702856 write 0x037123 thru 0x03ffff (0x8edd bytes) 000127 1787708641.704027 read 0x03ea87 thru 0x03ffff (0x1579 bytes) 000128 1787708641.705800 trunc from 0x01adac to 0x02385a (0x8aaf bytes) 000130 1787708641.748120 punch from 0x0026eb to 0x00837d (0x5c93 bytes) 000131 1787708641.776052 read 0x02793f thru 0x028eae (0x1570 bytes) 000132 1787708641.776632 write 0x006794 thru 0x00b405 (0x4c72 bytes) 000133 1787708641.806595 punch from 0x0068ea to 0x010df5 (0xa50c bytes) 000135 1787708641.823058 punch from 0x034355 to 0x035580 (0x122c bytes) 000136 1787708641.829585 trunc from 0x01fbe5 to 0x025db8 (0x61d4 bytes) 000137 1787708641.835331 trunc from 0x040000 to 0x0396be (0x6941 bytes) 000138 1787708641.853465 trunc from 0x0396bf to 0x01b646 (0x1e078 bytes) 000139 1787708641.878494 trunc from 0x01b647 to 0x02e589 (0x12f43 bytes) 000140 1787708641.917534 punch from 0x0119c6 to 0x01a01e (0x8659 bytes) 000141 1787708641.930053 read 0x022866 thru 0x023861 (0xffc bytes) 000142 1787708641.971110 write 0x00fb9e thru 0x01d7cf (0xdc32 bytes) 000143 1787708641.977460 trunc from 0x02e58a to 0x02b7b8 (0x2dd1 bytes) 000144 1787708641.999474 mapread 0x01ea44 thru 0x02b7b8 (0xcd75 bytes) 000146 1787708642.001403 write 0x019e9c thru 0x0245a1 (0xa706 bytes) 000147 1787708642.004417 fallocate 0x0160b8 thru 0x02323b (0xd184 bytes) 000148 1787708642.010429 mapwrite 0x02fcc6 thru 0x036f29 (0x7264 bytes) 000149 1787708642.064263 mapread 0x011410 thru 0x01cef0 (0xbae1 bytes) 000150 1787708642.065484 mapwrite 0x038e89 thru 0x03ffff (0x7177 bytes) 000151 1787708642.119307 fallocate 0x03032e thru 0x03f4fc (0xf1cf bytes) 000152 1787708642.124840 punch from 0x00b066 to 0x00ee37 (0x3dd2 bytes) 000153 1787708642.130073 trunc from 0x00f503 to 0x01d543 (0xe041 bytes) 000154 1787708642.136301 write 0x03a611 thru 0x03b855 (0x1245 bytes) 000155 1787708642.137223 punch from 0x007e21 to 0x007f3c (0x11c bytes) 000156 1787708642.143117 trunc from 0x040000 to 0x01cf1f (0x230e0 bytes) 000157 1787708642.158524 write 0x009e3e thru 0x011746 (0x7909 bytes) 000160 1787708642.169594 write 0x00a5cf thru 0x016c62 (0xc694 bytes) 000161 1787708642.177774 fallocate 0x02177c thru 0x02f43e (0xdcc3 bytes) 000162 1787708642.184268 fallocate 0x01df5e thru 0x027dd0 (0x9e73 bytes) 000165 1787708642.203479 fallocate 0x01e0f8 thru 0x02b79d (0xd6a6 bytes) 000166 1787708642.214142 punch from 0x02561a to 0x027dd0 (0x27b7 bytes) 000168 1787708642.221300 trunc from 0x027dd1 to 0x01ae64 (0xcf6c bytes) 000169 1787708642.251361 punch from 0x009f29 to 0x01627c (0xc354 bytes) 000170 1787708642.270968 write 0x027d85 thru 0x033422 (0xb69e bytes) 000171 1787708642.272594 trunc from 0x00f2fc to 0x01305d (0x3d62 bytes) 000172 1787708642.280174 mapwrite 0x00844d thru 0x0182a3 (0xfe57 bytes) 000174 1787708642.425891 trunc from 0x0247bd to 0x024e4a (0x68e bytes) 000175 1787708642.440283 MIRROR_EXTEND to 2 mirrors 000177 1787708643.389278 read 0x0078d0 thru 0x00f0a1 (0x77d2 bytes) 000178 1787708643.405972 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) 000179 1787708643.533201 mapwrite 0x0102d6 thru 0x01eeef (0xec1a bytes) 000180 1787708643.755097 read 0x02c487 thru 0x033422 (0x6f9c bytes) 000181 1787708643.783663 write 0x03b9d3 thru 0x03f598 (0x3bc6 bytes) 000182 1787708643.793268 trunc from 0x007aef to 0x00c4b9 (0x49cb bytes) 000183 1787708643.802567 punch from 0x007fe3 to 0x00d672 (0x5690 bytes) 000184 1787708643.824675 read 0x014400 thru 0x0184cf (0x40d0 bytes) 000185 1787708643.826229 mapread 0x020b7c thru 0x02de6e (0xd2f3 bytes) 000186 1787708643.870155 trunc from 0x03f599 to 0x03b928 (0x3c70 bytes) 000187 1787708643.906951 trunc from 0x03b929 to 0x014d58 (0x26bd0 bytes) 000188 1787708643.980357 read 0x009ac2 thru 0x014d58 (0xb297 bytes) 000189 1787708643.982053 trunc from 0x013013 to 0x0148ce (0x18bc bytes) 000190 1787708644.006807 write 0x01f2e0 thru 0x024492 (0x51b3 bytes) 000191 1787708644.014898 write 0x0213b1 thru 0x030596 (0xf1e6 bytes) 000192 1787708644.025229 trunc from 0x02c08a to 0x02ea0c (0x2983 bytes) 000193 1787708644.081425 write 0x0073f0 thru 0x008d3e (0x194f bytes) 000194 1787708644.087265 trunc from 0x030597 to 0x03c3d0 (0xbe3a bytes) 000195 1787708644.112244 mapread 0x001eb2 thru 0x00f29f (0xd3ee bytes) 000196 1787708644.113751 trunc from 0x03c3d1 to 0x01a8ea (0x21ae6 bytes) 000197 1787708644.128485 fallocate 0x02d646 thru 0x031459 (0x3e14 bytes) 000199 1787708644.138322 read 0x0014c9 thru 0x00827f (0x6db7 bytes) 000200 1787708644.139253 trunc from 0x017fdf to 0x01f480 (0x74a2 bytes) 000202 1787708644.147253 punch from 0x011b81 to 0x01380a (0x1c8a bytes) 000203 1787708644.153338 punch from 0x00e838 to 0x01e201 (0xf9ca bytes) 000205 1787708644.160908 trunc from 0x03145a to 0x026664 (0xadf5 bytes) 000206 1787708644.182220 punch from 0x003015 to 0x00452e (0x151a bytes) 000207 1787708644.187546 punch from 0x015733 to 0x01ef4a (0x9818 bytes) 000208 1787708644.193529 mapwrite 0x0064bc thru 0x01158d (0xb0d2 bytes) 000210 1787708644.264036 mapread 0x00a7b2 thru 0x00c455 (0x1ca4 bytes) 000211 1787708644.264944 mapwrite 0x008694 thru 0x011dde (0x974b bytes) 000212 1787708644.337103 punch from 0x00d824 to 0x01134b (0x3b28 bytes) 000213 1787708644.350344 punch from 0x02171a to 0x0248c0 (0x31a7 bytes) 000214 1787708644.369985 mapread 0x02456a thru 0x026664 (0x20fb bytes) 000215 1787708644.388371 fallocate 0x023f2c thru 0x033d80 (0xfe55 bytes) 000216 1787708644.413872 mapwrite 0x028a2f thru 0x02ef55 (0x6527 bytes) 000217 1787708644.535311 fallocate 0x01247f thru 0x01a0a1 (0x7c23 bytes) 000218 1787708644.543955 read 0x006615 thru 0x00b511 (0x4efd bytes) 000219 1787708644.544954 mapread 0x011f9f thru 0x020935 (0xe997 bytes) 000220 1787708644.575367 mapread 0x01e933 thru 0x01ecd3 (0x3a1 bytes) 000221 1787708644.581418 write 0x00d9da thru 0x018810 (0xae37 bytes) 000222 1787708644.587421 trunc from 0x021364 to 0x023f49 (0x2be6 bytes) 000224 1787708644.611314 mapwrite 0x0074f0 thru 0x00ba7f (0x4590 bytes) 000227 1787708644.640925 read 0x01bb8f thru 0x02136a (0x57dc bytes) 000229 1787708644.648747 mapwrite 0x00a202 thru 0x011683 (0x7482 bytes) 000230 1787708644.668707 mapwrite 0x0261db thru 0x02a5b2 (0x43d8 bytes) 000231 1787708644.691718 mapread 0x007c69 thru 0x010cac (0x9044 bytes) 000233 1787708644.694520 read 0x02ab07 thru 0x02ef55 (0x444f bytes) 000235 1787708644.696233 read 0x00cfce thru 0x010c20 (0x3c53 bytes) 000236 1787708644.697286 trunc from 0x016464 to 0x01e4d0 (0x806d bytes) 000239 1787708644.706769 trunc from 0x02bf67 to 0x02ef55 (0x2fef bytes) 000240 1787708644.716621 trunc from 0x02c04b to 0x02ef55 (0x2f0b bytes) 000241 1787708644.723106 trunc from 0x02ef56 to 0x02251b (0xca3a bytes) 000242 1787708644.766245 trunc from 0x02251c to 0x0357c6 (0x132ab bytes) 000243 1787708644.803948 fallocate 0x003b13 thru 0x00ccf9 (0x91e7 bytes) 000244 1787708644.816953 mapwrite 0x028ed9 thru 0x02da40 (0x4b68 bytes) 000246 1787708644.857080 read 0x01dbad thru 0x02c3bb (0xe80f bytes) 000247 1787708644.858718 trunc from 0x01b4e5 to 0x027f9d (0xcab9 bytes) 000248 1787708644.872912 mapread 0x01a49f thru 0x0202d5 (0x5e37 bytes) 000249 1787708644.895445 trunc from 0x01a84d to 0x02914f (0xe903 bytes) 000250 1787708644.901517 punch from 0x014c79 to 0x01b6a7 (0x6a2f bytes) 000251 1787708644.908380 mapread 0x00ba34 thru 0x01069e (0x4c6b bytes) 000252 1787708644.909400 trunc from 0x0357c7 to 0x01932e (0x1c498 bytes) 000253 1787708644.931908 fallocate 0x015863 thru 0x017a59 (0x21f7 bytes) 000254 1787708644.941688 mapread 0x00274a thru 0x006f28 (0x47df bytes) 000255 1787708644.943329 trunc from 0x01932f to 0x015a54 (0x38da bytes) 000256 1787708644.959984 trunc from 0x00bd28 to 0x01325d (0x7536 bytes) 000257 1787708644.968001 mapread 0x00fc58 thru 0x015a54 (0x5dfd bytes) 000258 1787708645.019575 mapread 0x003edb thru 0x00fc54 (0xbd7a bytes) 000259 1787708645.047986 fallocate 0x01b1ba thru 0x01c4a3 (0x12ea bytes) 000261 1787708645.054412 fallocate 0x027590 thru 0x037200 (0xfc71 bytes) 000263 1787708645.061479 read 0x003f7d thru 0x004f8a (0x100e bytes) 000265 1787708645.066675 punch from 0x00fff0 to 0x015a54 (0x5a65 bytes) 000266 1787708645.074137 mapwrite 0x00fc85 thru 0x01de8c (0xe208 bytes) 000267 1787708645.186025 fallocate 0x02f812 thru 0x0320e3 (0x28d2 bytes) 000268 1787708645.197767 fallocate 0x002e73 thru 0x00fdf9 (0xcf87 bytes) 000269 1787708645.205714 trunc from 0x013f19 to 0x01de8c (0x9f74 bytes) 000270 1787708645.213682 mapread 0x001417 thru 0x009b10 (0x86fa bytes) 000271 1787708645.217517 trunc from 0x01de8d to 0x01344e (0xaa3e bytes) 000272 1787708645.240715 trunc from 0x01344f to 0x0000a4 (0x133aa bytes) 000273 1787708645.263651 mapwrite 0x034b64 thru 0x03c548 (0x79e5 bytes) 000274 1787708645.337613 mapwrite 0x01a17c thru 0x0284bd (0xe342 bytes) 000275 1787708645.406141 trunc from 0x03c549 to 0x034b01 (0x7a47 bytes) 000276 1787708645.429314 punch from 0x02ad2f to 0x02d676 (0x2948 bytes) 000277 1787708645.435054 mapread 0x017a13 thru 0x025182 (0xd770 bytes) 000278 1787708645.449540 trunc from 0x017472 to 0x02333d (0xbecc bytes) 000279 1787708645.456024 read 0x025e29 thru 0x02752b (0x1703 bytes) 000280 1787708645.457336 trunc from 0x034b02 to 0x01202c (0x22ad5 bytes) 000281 1787708645.474668 mapread 0x00da83 thru 0x01202c (0x45aa bytes) 000282 1787708645.494704 mapwrite 0x010681 thru 0x016991 (0x6311 bytes) 000283 1787708645.549662 read 0x01520c thru 0x016991 (0x1786 bytes) 000284 1787708645.551030 mapread 0x0053e1 thru 0x007ec7 (0x2ae7 bytes) 000285 1787708645.552373 trunc from 0x00de89 to 0x00fbc8 (0x1d40 bytes) 000286 1787708645.558081 trunc from 0x01485a to 0x016991 (0x2138 bytes) 000287 1787708645.565036 read 0x00c3d6 thru 0x014610 (0x823b bytes) 000290 1787708645.585048 trunc from 0x008357 to 0x00e39d (0x6047 bytes) 000291 1787708645.591651 read 0x001847 thru 0x003ce0 (0x249a bytes) 000292 1787708645.593437 mapwrite 0x018fb5 thru 0x021841 (0x888d bytes) 000293 1787708645.647489 read 0x01d547 thru 0x01f81b (0x22d5 bytes) 000294 1787708645.648331 read 0x005f74 thru 0x010f00 (0xaf8d bytes) 000295 1787708645.650180 write 0x037162 thru 0x03a675 (0x3514 bytes) 000296 1787708645.652044 read 0x002711 thru 0x003050 (0x940 bytes) 000297 1787708645.652797 read 0x03463a thru 0x0373a5 (0x2d6c bytes) 000299 1787708645.662541 trunc from 0x03a676 to 0x02456e (0x16107 bytes) 000301 1787708645.682486 trunc from 0x02456f to 0x02df4d (0x99df bytes) 000302 1787708645.703142 punch from 0x014f51 to 0x024795 (0xf845 bytes) 000303 1787708645.708987 mapread 0x0128e3 thru 0x01a95b (0x8079 bytes) 000304 1787708645.807343 punch from 0x01dd8f to 0x02d562 (0xf7d4 bytes) 000305 1787708645.815380 punch from 0x01fb6e to 0x0238be (0x3d51 bytes) 000306 1787708645.829366 mapread 0x01b357 thru 0x029817 (0xe4c1 bytes) 000307 1787708645.993466 mapread 0x021fc3 thru 0x02579d (0x37db bytes) 000308 1787708645.995056 punch from 0x00e946 to 0x01d8f0 (0xefab bytes) 000309 1787708646.002352 mapread 0x02cfab thru 0x02df4d (0xfa3 bytes) 000310 1787708646.022093 mapwrite 0x0354fc thru 0x03ffff (0xab04 bytes) 000311 1787708646.102154 read 0x02eabe thru 0x03b6ef (0xcc32 bytes) 000312 1787708646.111005 punch from 0x027b90 to 0x0351fd (0xd66e bytes) 000314 1787708646.118504 write 0x01f76c thru 0x02c10a (0xc99f bytes) 000316 1787708646.126643 trunc from 0x035745 to 0x03aa1a (0x52d6 bytes) 000318 1787708646.133572 trunc from 0x023f8d to 0x025055 (0x10c9 bytes) 000320 1787708646.169028 trunc from 0x000e30 to 0x00fbbb (0xed8c bytes) 000321 1787708646.178166 write 0x03b330 thru 0x03ffff (0x4cd0 bytes) 000323 1787708646.182392 punch from 0x03cd4d to 0x03ffff (0x32b3 bytes) 000324 1787708646.199600 punch from 0x011e12 to 0x01a1cc (0x83bb bytes) 000325 1787708646.206919 write 0x03e258 thru 0x03e3a7 (0x150 bytes) 000327 1787708646.216862 trunc from 0x02250c to 0x023b67 (0x165c bytes) 000328 1787708646.223465 read 0x0350e4 thru 0x039663 (0x4580 bytes) 000329 1787708646.237447 punch from 0x0087c5 to 0x00c35f (0x3b9b bytes) 000330 1787708646.247642 write 0x0148a5 thru 0x01b55b (0x6cb7 bytes) 000331 1787708646.252983 mapwrite 0x01610e thru 0x0169d3 (0x8c6 bytes) 000332 1787708646.297748 MIRROR_EXTEND to 2 mirrors 000333 1787708647.131286 mapread 0x0154ab thru 0x01db77 (0x86cd bytes) 000334 1787708647.163595 write 0x018350 thru 0x01c1be (0x3e6f bytes) 000335 1787708647.251455 punch from 0x02a761 to 0x02fdfb (0x569b bytes) 000336 1787708647.257404 mapwrite 0x0072c3 thru 0x00bab4 (0x47f2 bytes) 000337 1787708647.327057 punch from 0x02d169 to 0x03cb5f (0xf9f7 bytes) 000338 1787708647.337858 write 0x01a8b9 thru 0x01dd71 (0x34b9 bytes) 000339 1787708647.344570 punch from 0x03b6b9 to 0x03ffff (0x4947 bytes) 000340 1787708647.352606 write 0x02cfff thru 0x039cfe (0xcd00 bytes) 000341 1787708647.368170 mapwrite 0x0080bf thru 0x013d02 (0xbc44 bytes) 000343 1787708647.429602 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe1dfde01 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb42b9f25 Mirror 3: 0xb42b9f25 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000344 1787708648.680788 write 0x023794 thru 0x02a954 (0x71c1 bytes) 000345 1787708648.765462 read 0x03b3e8 thru 0x03ffff (0x4c18 bytes) 000346 1787708648.783406 write 0x036071 thru 0x03f875 (0x9805 bytes) 000347 1787708648.793174 punch from 0x00c9b6 to 0x01afe7 (0xe632 bytes) 000348 1787708648.805616 punch from 0x016484 to 0x01f1a3 (0x8d20 bytes) 000349 1787708648.811216 mapread 0x02c95c thru 0x02d2e9 (0x98e bytes) 000350 1787708648.826155 trunc from 0x0311b2 to 0x03ffff (0xee4e bytes) 000352 1787708648.844843 mapwrite 0x0371c7 thru 0x03a153 (0x2f8d bytes) 000353 1787708648.880347 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe1dfde01 (stale) Mirror 3: 0xb42b9f25 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc04cf309 Mirror 4: 0xc04cf309 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000354 1787708650.084614 read 0x01af2c thru 0x027119 (0xc1ee bytes) 000355 1787708650.104514 punch from 0x00ba39 to 0x01b5a0 (0xfb68 bytes) 000356 1787708650.155519 mapread 0x03a3b3 thru 0x03ffff (0x5c4d bytes) 000358 1787708650.195724 mapread 0x02aed5 thru 0x03a020 (0xf14c bytes) 000359 1787708650.228837 mapread 0x0040c9 thru 0x0134d0 (0xf408 bytes) 000361 1787708650.255330 mapread 0x01633d thru 0x017df7 (0x1abb bytes) 000362 1787708650.256371 mapread 0x029739 thru 0x035295 (0xbb5d bytes) 000364 1787708650.262951 punch from 0x01a8e9 to 0x026796 (0xbeae bytes) 000366 1787708650.269765 punch from 0x017983 to 0x01fe83 (0x8501 bytes) 000367 1787708650.275610 mapwrite 0x013731 thru 0x01cd2e (0x95fe bytes) 000368 1787708650.321656 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xb42b9f25 (stale) Mirror 4: 0xc04cf309 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xb42b9f25 (stale) Mirror 4: 0xc04cf309 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000369 1787708650.703442 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xc04cf309 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xc04cf309 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000371 1787708651.153726 read 0x022a42 thru 0x028395 (0x5954 bytes) 000373 1787708651.175327 write 0x01af94 thru 0x027572 (0xc5df bytes) 000374 1787708651.190344 mapread 0x01bffc thru 0x021538 (0x553d bytes) 000375 1787708651.191787 trunc from 0x00e394 to 0x019564 (0xb1d1 bytes) 000376 1787708651.206705 read 0x03d4a1 thru 0x03ffff (0x2b5f bytes) 000377 1787708651.224857 punch from 0x016720 to 0x02165d (0xaf3e bytes) 000378 1787708651.263189 trunc from 0x040000 to 0x030b36 (0xf4c9 bytes) 000379 1787708651.290371 read 0x0249c1 thru 0x030b36 (0xc176 bytes) 000380 1787708651.293152 read 0x02f99e thru 0x030b36 (0x1199 bytes) 000381 1787708651.293798 read 0x01e0ee thru 0x027e7b (0x9d8e bytes) 000382 1787708651.323130 mapwrite 0x004d07 thru 0x00eed3 (0xa1cd bytes) 000383 1787708651.361355 read 0x02160b thru 0x02f038 (0xda2e bytes) 000384 1787708651.362032 read 0x011fb6 thru 0x018ecd (0x6f18 bytes) 000385 1787708651.362576 write 0x03204d thru 0x03ffff (0xdfb3 bytes) 000386 1787708651.365968 mapwrite 0x03c3fb thru 0x03ffff (0x3c05 bytes) 000388 1787708651.403288 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xc04cf309 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe85f95cc Mirror 5: 0xe85f95cc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000389 1787708652.818884 trunc from 0x03a48b to 0x03ffff (0x5b75 bytes) 000391 1787708652.882154 fallocate 0x036336 thru 0x03cdc5 (0x6a90 bytes) 000392 1787708652.888353 punch from 0x038c4b to 0x03ffff (0x73b5 bytes) 000393 1787708652.893788 mapread 0x02a1ed thru 0x02b8f9 (0x170d bytes) 000394 1787708652.909280 MIRROR_RESYNC 3 mirrors 000395 1787708653.995489 trunc from 0x040000 to 0x03c166 (0x3e99 bytes) 000396 1787708654.059489 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c167): Mirror 5: 0x621c8e34 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c167): Mirror 5: 0x621c8e34 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c167: skipped 000397 1787708654.614728 mapwrite 0x026c56 thru 0x02b34d (0x46f8 bytes) 000398 1787708654.664199 mapread 0x01889e thru 0x01d8a3 (0x5006 bytes) 000399 1787708654.684216 fallocate 0x023781 thru 0x03209a (0xe91a bytes) 000400 1787708654.695309 read 0x02837d thru 0x031e0a (0x9a8e bytes) 000401 1787708654.722130 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3c167): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c167): Mirror 5: 0x621c8e34 (stale) CRC-32 checksum value for chunk [0, 0x3c167): Mirror 1: 0x1948cbc2 Mirror 6: 0x1948cbc2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c167: skipped 000402 1787708656.360073 mapwrite 0x003be0 thru 0x00e52b (0xa94c bytes) 000403 1787708656.524126 fallocate 0x0297f8 thru 0x02dbdf (0x43e8 bytes) 000404 1787708656.548417 trunc from 0x03c167 to 0x035d98 (0x63ce bytes) 000405 1787708656.605040 mapwrite 0x015be7 thru 0x024124 (0xe53e bytes) 000406 1787708656.714351 fallocate 0x0184e7 thru 0x022b28 (0xa642 bytes) 000407 1787708656.744014 MIRROR_RESYNC 3 mirrors 000408 1787708658.104578 punch from 0x00f694 to 0x01ba54 (0xc3c1 bytes) 000409 1787708658.145237 read 0x0057c3 thru 0x006da5 (0x15e3 bytes) 000410 1787708658.163181 MIRROR_RESYNC 3 mirrors 000411 1787708659.167867 mapread 0x021cc0 thru 0x02fa74 (0xddb5 bytes) 000412 1787708659.208029 fallocate 0x0279ff thru 0x03158d (0x9b8f bytes) 000413 1787708659.247166 write 0x003700 thru 0x004f66 (0x1867 bytes) 000414 1787708659.264293 punch from 0x004281 to 0x007f59 (0x3cd9 bytes) 000415 1787708659.294433 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35d99): Mirror 6: 0x5ffd003a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35d99): Mirror 6: 0x5ffd003a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35d99: skipped 000416 1787708659.718259 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x35d99): Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35d99): Mirror 6: 0x5ffd003a (stale) CRC-32 checksum value for chunk [0, 0x35d99): Mirror 1: 0xd44b79a5 Mirror 7: 0xd44b79a5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35d99: skipped 000418 1787708661.076465 mapread 0x031a30 thru 0x035d98 (0x4369 bytes) 000419 1787708661.129555 write 0x03a6bb thru 0x03ffff (0x5945 bytes) 000420 1787708661.181086 mapread 0x010c7a thru 0x01747a (0x6801 bytes) 000421 1787708661.201649 punch from 0x00ecfe to 0x0157d6 (0x6ad9 bytes) 000422 1787708661.212651 punch from 0x01813a to 0x026a19 (0xe8e0 bytes) 000423 1787708661.219281 mapread 0x02fcbd thru 0x039fb9 (0xa2fd bytes) 000424 1787708661.235257 mapread 0x0058ab thru 0x00724f (0x19a5 bytes) 000425 1787708661.252232 MIRROR_RESYNC 3 mirrors 000426 1787708662.535970 mapwrite 0x012020 thru 0x0192e9 (0x72ca bytes) 000428 1787708662.620328 read 0x038fbe thru 0x03ffff (0x7042 bytes) 000429 1787708662.632759 trunc from 0x040000 to 0x028997 (0x17668 bytes) 000430 1787708662.662795 trunc from 0x028998 to 0x02e1a0 (0x5809 bytes) 000431 1787708662.682649 fallocate 0x0147bb thru 0x01c509 (0x7d4f bytes) 000432 1787708662.690675 mapwrite 0x029448 thru 0x03092d (0x74e6 bytes) 000433 1787708662.759638 read 0x018034 thru 0x01fbbd (0x7b8a bytes) 000434 1787708662.777639 mapread 0x02fce5 thru 0x03092d (0xc49 bytes) 000435 1787708662.778539 write 0x013ff2 thru 0x01cf65 (0x8f74 bytes) 000436 1787708662.779720 trunc from 0x03092e to 0x00fb60 (0x20dcd bytes) 000437 1787708662.821780 trunc from 0x00fb61 to 0x00b902 (0x425e bytes) 000438 1787708662.854666 read 0x00861d thru 0x00b902 (0x32e6 bytes) 000439 1787708662.857786 punch from 0x0046d2 to 0x00b902 (0x7231 bytes) 000440 1787708662.870335 mapread 0x006ebf thru 0x00b902 (0x4a44 bytes) 000441 1787708662.892909 mapwrite 0x013af1 thru 0x0188d0 (0x4de0 bytes) 000442 1787708663.001627 trunc from 0x00386a to 0x00786d (0x4004 bytes) 000443 1787708663.010629 mapwrite 0x02bc64 thru 0x0368ff (0xac9c bytes) 000444 1787708663.119421 mapwrite 0x007355 thru 0x015453 (0xe0ff bytes) 000445 1787708663.159583 punch from 0x00ba24 to 0x0118c8 (0x5ea5 bytes) 000446 1787708663.164118 mapwrite 0x0177ad thru 0x0243b0 (0xcc04 bytes) 000447 1787708663.182052 fallocate 0x02a1e0 thru 0x02fb42 (0x5963 bytes) 000448 1787708663.186967 trunc from 0x036900 to 0x00b5f3 (0x2b30c bytes) 000449 1787708663.231910 mapread 0x0099d2 thru 0x00b5f3 (0x1c22 bytes) 000450 1787708663.250605 trunc from 0x007be8 to 0x00b5f3 (0x3a0c bytes) 000452 1787708663.257174 punch from 0x009f82 to 0x00b5f3 (0x1672 bytes) 000453 1787708663.268959 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xb5f4): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb5f4): Mirror 6: 0x8e49310f (stale) Mirror 7: 0x8e49310f (stale) CRC-32 checksum value for chunk [0, 0xb5f4): Mirror 1: 0xac3583bc Mirror 8: 0xac3583bc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb5f4: skipped 000454 1787708664.187540 read 0x0047b3 thru 0x00b5f3 (0x6e41 bytes) 000455 1787708664.211047 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xb5f4): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb5f4): Mirror 6: 0x8e49310f (stale) Mirror 7: 0x8e49310f (stale) CRC-32 checksum value for chunk [0, 0xb5f4): Mirror 1: 0xac3583bc Mirror 8: 0xac3583bc Mirror 9: 0xac3583bc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb5f4: skipped 000456 1787708665.179844 mapwrite 0x0058ab thru 0x00ea61 (0x91b7 bytes) 000457 1787708665.366196 fallocate 0x00e99f thru 0x0137bb (0x4e1d bytes) 000458 1787708665.371147 trunc from 0x006bbe to 0x009dcc (0x320f bytes) 000459 1787708665.376089 mapread 0x00ca59 thru 0x00ea61 (0x2009 bytes) 000460 1787708665.376726 trunc from 0x003e63 to 0x009baf (0x5d4d bytes) 000461 1787708665.381398 trunc from 0x00ea62 to 0x02e91c (0x1febb bytes) 000462 1787708665.398914 mapread 0x007b56 thru 0x012e3b (0xb2e6 bytes) 000463 1787708665.414568 read 0x013979 thru 0x020b0e (0xd196 bytes) 000465 1787708665.421677 punch from 0x029117 to 0x02e91c (0x5806 bytes) 000466 1787708665.425391 write 0x037ff7 thru 0x03ffff (0x8009 bytes) 000467 1787708665.426728 read 0x01bc9b thru 0x02324a (0x75b0 bytes) 000468 1787708665.433048 trunc from 0x001773 to 0x0034f8 (0x1d86 bytes) 000470 1787708665.436687 write 0x02ad89 thru 0x0346eb (0x9963 bytes) 000472 1787708665.438040 trunc from 0x040000 to 0x01a8b5 (0x2574a bytes) 000473 1787708665.448521 trunc from 0x00b13c to 0x01a576 (0xf43b bytes) 000474 1787708665.455521 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1a8b6): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a8b6): Mirror 6: 0x5d0f9a5e (stale) Mirror 7: 0x5d0f9a5e (stale) Mirror 8: 0xcc9b0ee (stale) Mirror 9: 0xcc9b0ee (stale) CRC-32 checksum value for chunk [0, 0x1a8b6): Mirror 1: 0x99f0a1d4 Mirror 10: 0x99f0a1d4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a8b6: skipped 000475 1787708666.793480 fallocate 0x02e6f2 thru 0x03b36b (0xcc7a bytes) 000476 1787708666.850658 mapwrite 0x03ca8a thru 0x03fbd2 (0x3149 bytes) 000477 1787708666.931328 trunc from 0x01cf5b to 0x0225b9 (0x565f bytes) 000478 1787708666.937136 read 0x035662 thru 0x03b989 (0x6328 bytes) 000479 1787708666.944738 read 0x02167a thru 0x029d46 (0x86cd bytes) 000480 1787708666.959928 read 0x00a284 thru 0x00b3ad (0x112a bytes) 000481 1787708666.960681 write 0x001a27 thru 0x0041e6 (0x27c0 bytes) 000483 1787708666.964162 fallocate 0x007bb6 thru 0x0164a8 (0xe8f3 bytes) 000484 1787708666.969716 mapwrite 0x02afb1 thru 0x0313f9 (0x6449 bytes) 000485 1787708666.992496 write 0x01f6e0 thru 0x027c7f (0x85a0 bytes) 000486 1787708666.994054 mapwrite 0x023376 thru 0x026742 (0x33cd bytes) 000487 1787708667.021750 fallocate 0x03d572 thru 0x03ffff (0x2a8e bytes) 000488 1787708667.027904 read 0x01df37 thru 0x023f19 (0x5fe3 bytes) 000489 1787708667.030635 write 0x001ff8 thru 0x0033af (0x13b8 bytes) 000490 1787708667.032747 trunc from 0x00d676 to 0x013f26 (0x68b1 bytes) 000491 1787708667.037723 mapread 0x0126be thru 0x012fe9 (0x92c bytes) 000492 1787708667.053520 mapread 0x000360 thru 0x001ba0 (0x1841 bytes) 000493 1787708667.056945 punch from 0x013870 to 0x01d21e (0x99af bytes) 000495 1787708667.068100 mapwrite 0x015ab3 thru 0x0202b3 (0xa801 bytes) 000496 1787708667.182702 write 0x011490 thru 0x020ad3 (0xf644 bytes) 000497 1787708667.184264 mapread 0x021c94 thru 0x021d36 (0xa3 bytes) 000499 1787708667.189778 trunc from 0x025e93 to 0x029366 (0x34d4 bytes) 000500 1787708667.204387 fallocate 0x01f386 thru 0x027182 (0x7dfd bytes) 000501 1787708667.224010 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fbd3): Mirror 6: 0xd534d83d (stale) Mirror 8: 0x1e455ad9 (stale) Mirror 9: 0x1e455ad9 (stale) Mirror 10: 0xac74af3a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fbd3): Mirror 6: 0xd534d83d (stale) Mirror 8: 0x1e455ad9 (stale) Mirror 9: 0x1e455ad9 (stale) Mirror 10: 0xac74af3a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fbd3: skipped 000502 1787708667.632674 mapread 0x02fd73 thru 0x03738f (0x761d bytes) 000503 1787708667.653989 trunc from 0x00a68e to 0x013fca (0x993d bytes) 000504 1787708667.664909 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3fbd3): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fbd3): Mirror 6: 0xd534d83d (stale) Mirror 8: 0x1e455ad9 (stale) Mirror 9: 0x1e455ad9 (stale) Mirror 10: 0xac74af3a (stale) CRC-32 checksum value for chunk [0, 0x3fbd3): Mirror 1: 0xcbd0ff69 Mirror 11: 0xcbd0ff69 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fbd3: skipped 000505 1787708669.100601 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fbd3): Mirror 8: 0x1e455ad9 (stale) Mirror 9: 0x1e455ad9 (stale) Mirror 10: 0xac74af3a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fbd3): Mirror 8: 0x1e455ad9 (stale) Mirror 9: 0x1e455ad9 (stale) Mirror 10: 0xac74af3a (stale) CRC-32 checksum value for chunk [0, 0x3fbd3): Mirror 1: 0xcbd0ff69 Mirror 11: 0xcbd0ff69 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fbd3: skipped 000506 1787708669.770881 MIRROR_RESYNC 5 mirrors 000508 1787708671.253945 trunc from 0x03fbd3 to 0x02c7d1 (0x13401 bytes) 000509 1787708671.306165 write 0x014b41 thru 0x02185b (0xcd1b bytes) 000510 1787708671.320669 mapread 0x01fc16 thru 0x02c7d1 (0xcbbc bytes) 000511 1787708671.351756 punch from 0x0239f8 to 0x02c7d1 (0x8dda bytes) 000512 1787708671.358649 fallocate 0x01af42 thru 0x025646 (0xa705 bytes) 000513 1787708671.366207 read 0x015eff thru 0x01a080 (0x4182 bytes) 000514 1787708671.367295 mapread 0x02c43c thru 0x02c7d1 (0x396 bytes) 000515 1787708671.390028 read 0x0253d6 thru 0x02c7d1 (0x73fc bytes) 000516 1787708671.391530 fallocate 0x032084 thru 0x034dd7 (0x2d54 bytes) 000517 1787708671.408237 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c7d2): Mirror 8: 0x6666ee74 (stale) Mirror 9: 0x6666ee74 (stale) Mirror 10: 0x6666ee74 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c7d2): Mirror 8: 0x6666ee74 (stale) Mirror 9: 0x6666ee74 (stale) Mirror 10: 0x6666ee74 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c7d2: skipped 000518 1787708671.831561 mapwrite 0x027941 thru 0x02e1ae (0x686e bytes) 000519 1787708671.900080 punch from 0x026849 to 0x029311 (0x2ac9 bytes) 000521 1787708671.907474 mapwrite 0x00173f thru 0x00b07b (0x993d bytes) 000522 1787708671.937626 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2e1af): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e1af): Mirror 8: 0x9d270eb4 (stale) Mirror 9: 0x9d270eb4 (stale) Mirror 10: 0x9d270eb4 (stale) CRC-32 checksum value for chunk [0, 0x2e1af): Mirror 1: 0xa817b584 Mirror 11: 0xa817b584 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e1af: skipped 000524 1787708672.904051 read 0x01db51 thru 0x028924 (0xadd4 bytes) 000525 1787708672.951742 trunc from 0x02e1af to 0x029923 (0x488b bytes) 000526 1787708673.088690 write 0x01d73e thru 0x02277c (0x503f bytes) 000527 1787708673.112858 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29924): Mirror 9: 0x86981c3d (stale) Mirror 10: 0x86981c3d (stale) Mirror 11: 0x5c63e8c8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29924): Mirror 9: 0x86981c3d (stale) Mirror 10: 0x86981c3d (stale) Mirror 11: 0x5c63e8c8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29924: skipped 000528 1787708673.562220 mapwrite 0x00af1f thru 0x018842 (0xd924 bytes) 000529 1787708673.647760 mapread 0x01a484 thru 0x01f75b (0x52d8 bytes) 000530 1787708673.658982 trunc from 0x029924 to 0x019eac (0xfa77 bytes) 000531 1787708673.693384 trunc from 0x019ead to 0x03dba1 (0x23cf5 bytes) 000532 1787708673.727627 punch from 0x03810a to 0x03dba1 (0x5a98 bytes) 000533 1787708673.738392 punch from 0x00c430 to 0x01a109 (0xdcda bytes) 000535 1787708673.756063 write 0x006eec thru 0x00da6e (0x6b83 bytes) 000536 1787708673.761866 trunc from 0x03dba2 to 0x035bcf (0x7fd2 bytes) 000537 1787708673.791969 write 0x0158a6 thru 0x018c94 (0x33ef bytes) 000538 1787708673.809217 write 0x03b728 thru 0x03d461 (0x1d3a bytes) 000539 1787708673.810758 read 0x01a712 thru 0x0200c2 (0x59b1 bytes) 000540 1787708673.818701 write 0x01bb55 thru 0x01c513 (0x9bf bytes) 000542 1787708673.820878 trunc from 0x03626f to 0x03d461 (0x71f3 bytes) 000543 1787708673.842759 trunc from 0x03d462 to 0x0365ee (0x6e73 bytes) 000544 1787708673.856897 fallocate 0x01108e thru 0x017e4b (0x6dbe bytes) 000545 1787708673.863064 punch from 0x01ff45 to 0x02d131 (0xd1ed bytes) 000546 1787708673.868531 read 0x006815 thru 0x0101c6 (0x99b2 bytes) 000547 1787708673.877883 mapwrite 0x004820 thru 0x004b46 (0x327 bytes) 000548 1787708673.889454 fallocate 0x0322d9 thru 0x039a1b (0x7743 bytes) 000549 1787708673.894410 trunc from 0x039a1c to 0x01e3c3 (0x1b658 bytes) 000550 1787708673.916723 trunc from 0x01e3c4 to 0x03097b (0x125b8 bytes) 000551 1787708673.935596 fallocate 0x03265f thru 0x03e679 (0xc01b bytes) 000552 1787708673.943227 punch from 0x0068e2 to 0x00da84 (0x71a3 bytes) 000554 1787708673.949875 trunc from 0x01f141 to 0x020de7 (0x1ca7 bytes) 000555 1787708673.954780 punch from 0x024c39 to 0x03097b (0xbd43 bytes) 000556 1787708673.963921 fallocate 0x02acf0 thru 0x0307a6 (0x5ab7 bytes) 000557 1787708673.970160 punch from 0x00c8c6 to 0x014717 (0x7e52 bytes) 000558 1787708673.974789 trunc from 0x001716 to 0x0070a8 (0x5993 bytes) 000559 1787708673.980786 write 0x01cec8 thru 0x021853 (0x498c bytes) 000560 1787708673.987381 mapread 0x02411c thru 0x027462 (0x3347 bytes) 000561 1787708674.007028 trunc from 0x03035f to 0x03097b (0x61d bytes) 000562 1787708674.013720 fallocate 0x03c1cf thru 0x03ec4f (0x2a81 bytes) 000563 1787708674.019846 mapread 0x009079 thru 0x00b893 (0x281b bytes) 000564 1787708674.044325 mapread 0x0196d1 thru 0x025180 (0xbab0 bytes) 000566 1787708674.056348 punch from 0x02c3bb to 0x03b1d0 (0xee16 bytes) 000567 1787708674.061558 punch from 0x03b078 to 0x03ec4f (0x3bd8 bytes) 000568 1787708674.068001 mapwrite 0x00f705 thru 0x010fb9 (0x18b5 bytes) 000569 1787708674.097877 punch from 0x012d2f to 0x01c824 (0x9af6 bytes) 000570 1787708674.104426 trunc from 0x03ec50 to 0x03daf7 (0x1158 bytes) 000571 1787708674.121806 punch from 0x021f11 to 0x02b263 (0x9353 bytes) 000572 1787708674.128392 fallocate 0x0163be thru 0x024900 (0xe543 bytes) 000574 1787708674.141955 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3daf8): Mirror 9: 0x3564e6f8 (stale) Mirror 11: 0x467a9e5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3daf8): Mirror 9: 0x3564e6f8 (stale) Mirror 11: 0x467a9e5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3daf8: skipped 000575 1787708674.501629 trunc from 0x0271b7 to 0x02fad0 (0x891a bytes) 000576 1787708674.509490 trunc from 0x03daf8 to 0x02d8dc (0x1021b bytes) 000577 1787708674.531908 read 0x01f821 thru 0x02546b (0x5c4b bytes) 000578 1787708674.542001 mapread 0x00e21b thru 0x018968 (0xa74e bytes) 000579 1787708674.567169 trunc from 0x02d8dd to 0x00f303 (0x1e5d9 bytes) 000580 1787708674.591594 trunc from 0x00f304 to 0x030b68 (0x21865 bytes) 000581 1787708674.619798 trunc from 0x029b75 to 0x02b848 (0x1cd4 bytes) 000582 1787708674.624913 punch from 0x02ae96 to 0x030b68 (0x5cd3 bytes) 000583 1787708674.631299 trunc from 0x030b69 to 0x010df3 (0x1fd75 bytes) 000584 1787708674.653719 write 0x03a5ab thru 0x03ffff (0x5a55 bytes) 000585 1787708674.657779 write 0x034ba9 thru 0x0358c8 (0xd20 bytes) 000586 1787708674.673523 read 0x029344 thru 0x02c682 (0x333f bytes) 000587 1787708674.696557 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x75fdb0bf (stale) Mirror 11: 0xef095769 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4dc5491a Mirror 12: 0x4dc5491a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000588 1787708676.224650 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0x75fdb0bf (stale) Mirror 11: 0xef095769 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4dc5491a Mirror 12: 0x4dc5491a Mirror 13: 0x4dc5491a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000589 1787708677.207991 mapread 0x00918e thru 0x012638 (0x94ab bytes) 000590 1787708677.236553 punch from 0x035431 to 0x0397fa (0x43ca bytes) 000591 1787708677.294788 punch from 0x013211 to 0x01e5dc (0xb3cc bytes) 000592 1787708677.301611 mapread 0x031f6b thru 0x038484 (0x651a bytes) 000593 1787708677.315761 write 0x0120a7 thru 0x01b9fe (0x9958 bytes) 000594 1787708677.334641 punch from 0x02da98 to 0x0356d2 (0x7c3b bytes) 000595 1787708677.342836 punch from 0x028e57 to 0x029755 (0x8ff bytes) 000596 1787708677.349640 trunc from 0x040000 to 0x02e4cf (0x11b30 bytes) 000597 1787708677.390184 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2e4d0): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e4d0): Mirror 9: 0x4f234c1 (stale) Mirror 11: 0x6c381237 (stale) Mirror 12: 0x395e8da8 (stale) Mirror 13: 0x395e8da8 (stale) CRC-32 checksum value for chunk [0, 0x2e4d0): Mirror 1: 0x1e42ebb6 Mirror 14: 0x1e42ebb6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e4d0: skipped 000598 1787708678.268523 read 0x008ffa thru 0x0093a4 (0x3ab bytes) 000599 1787708678.281159 write 0x029e00 thru 0x0318e0 (0x7ae1 bytes) 000600 1787708678.330344 fallocate 0x019eb1 thru 0x0234ac (0x95fc bytes) 000601 1787708678.335551 fallocate 0x02b8cd thru 0x036d88 (0xb4bc bytes) 000602 1787708678.345656 MIRROR_RESYNC 6 mirrors 000603 1787708680.280692 write 0x01729a thru 0x020649 (0x93b0 bytes) 000604 1787708680.329571 punch from 0x02e774 to 0x036d88 (0x8615 bytes) 000605 1787708680.340405 MIRROR_RESYNC 6 mirrors 000606 1787708683.046652 trunc from 0x01d47a to 0x027cf2 (0xa879 bytes) 000607 1787708683.089787 mapwrite 0x0384fa thru 0x03ffff (0x7b06 bytes) 000608 1787708683.185638 mapwrite 0x017cb1 thru 0x01e131 (0x6481 bytes) 000609 1787708683.280521 write 0x03344b thru 0x0380cf (0x4c85 bytes) 000610 1787708683.288656 write 0x00a320 thru 0x0106f3 (0x63d4 bytes) 000611 1787708683.298474 write 0x018a8e thru 0x02040b (0x797e bytes) 000612 1787708683.321944 MIRROR_RESYNC 6 mirrors 000613 1787708685.837715 read 0x02d060 thru 0x02f245 (0x21e6 bytes) 000614 1787708685.850005 fallocate 0x003191 thru 0x006e2a (0x3c9a bytes) 000615 1787708685.901614 fallocate 0x0200b0 thru 0x02a153 (0xa0a4 bytes) 000616 1787708685.908653 write 0x03685f thru 0x03ffff (0x97a1 bytes) 000617 1787708685.922637 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xef966a9e (stale) Mirror 11: 0xef966a9e (stale) Mirror 12: 0xef966a9e (stale) Mirror 14: 0xef966a9e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xef966a9e (stale) Mirror 11: 0xef966a9e (stale) Mirror 12: 0xef966a9e (stale) Mirror 14: 0xef966a9e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000618 1787708686.366720 mapwrite 0x02f329 thru 0x031cad (0x2985 bytes) 000619 1787708686.403145 read 0x01cc3d thru 0x025e77 (0x923b bytes) 000621 1787708686.415528 fallocate 0x0043c2 thru 0x008445 (0x4084 bytes) 000622 1787708686.421889 fallocate 0x0209c0 thru 0x027727 (0x6d68 bytes) 000623 1787708686.428297 fallocate 0x011dd0 thru 0x016354 (0x4585 bytes) 000624 1787708686.433625 trunc from 0x010aaf to 0x01a5d9 (0x9b2b bytes) 000625 1787708686.438557 punch from 0x0117c5 to 0x011f40 (0x77c bytes) 000626 1787708686.443260 fallocate 0x0111b2 thru 0x013e2b (0x2c7a bytes) 000627 1787708686.448291 trunc from 0x0064b9 to 0x00abd2 (0x471a bytes) 000629 1787708686.453958 trunc from 0x040000 to 0x021dc7 (0x1e238 bytes) 000630 1787708686.484155 mapwrite 0x039db7 thru 0x03ffff (0x6249 bytes) 000631 1787708686.528433 fallocate 0x0292bb thru 0x03209c (0x8de2 bytes) 000632 1787708686.534050 write 0x023b72 thru 0x030569 (0xc9f8 bytes) 000633 1787708686.544784 mapread 0x01711c thru 0x020e71 (0x9d56 bytes) 000634 1787708686.554617 punch from 0x009d3d to 0x018184 (0xe448 bytes) 000635 1787708686.559569 punch from 0x02a9b1 to 0x02c734 (0x1d84 bytes) 000636 1787708686.580469 trunc from 0x02cda0 to 0x0331d3 (0x6434 bytes) 000638 1787708686.587375 trunc from 0x040000 to 0x02dfe2 (0x1201d bytes) 000639 1787708686.612240 MIRROR_RESYNC 5 mirrors 000640 1787708688.288253 mapread 0x001f2b thru 0x00a445 (0x851b bytes) 000641 1787708688.313296 trunc from 0x02dfe3 to 0x0318ad (0x38cb bytes) 000642 1787708688.387724 trunc from 0x027e9e to 0x0291f9 (0x135c bytes) 000643 1787708688.397940 fallocate 0x014b16 thru 0x022783 (0xdc6e bytes) 000644 1787708688.404549 read 0x028ecc thru 0x0318ad (0x89e2 bytes) 000645 1787708688.418665 mapread 0x024b8b thru 0x027544 (0x29ba bytes) 000646 1787708688.434624 punch from 0x007524 to 0x01362a (0xc107 bytes) 000647 1787708688.439669 mapwrite 0x014e71 thru 0x01cbbf (0x7d4f bytes) 000648 1787708688.470659 mapwrite 0x01159b thru 0x020758 (0xf1be bytes) 000650 1787708688.495800 read 0x00d025 thru 0x00d375 (0x351 bytes) 000651 1787708688.501532 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x318ae): Mirror 9: 0xad93ca3 (stale) Mirror 11: 0xad93ca3 (stale) Mirror 12: 0xad93ca3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x318ae): Mirror 9: 0xad93ca3 (stale) Mirror 11: 0xad93ca3 (stale) Mirror 12: 0xad93ca3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x318ae: skipped 000652 1787708689.053703 trunc from 0x0318ae to 0x003b8a (0x2dd23 bytes) 000653 1787708689.120339 trunc from 0x002aad to 0x003b8a (0x10de bytes) 000654 1787708689.136703 write 0x023d3a thru 0x02a2aa (0x6571 bytes) 000655 1787708689.138133 punch from 0x02325d to 0x0278a8 (0x464c bytes) 000656 1787708689.172684 trunc from 0x022018 to 0x028048 (0x6031 bytes) 000657 1787708689.191570 trunc from 0x0159ba to 0x01e233 (0x887a bytes) 000658 1787708689.204649 read 0x016403 thru 0x01655e (0x15c bytes) 000659 1787708689.227514 read 0x0264d3 thru 0x02a2aa (0x3dd8 bytes) 000660 1787708689.331368 mapwrite 0x031c00 thru 0x03fc23 (0xe024 bytes) 000661 1787708689.439141 fallocate 0x010664 thru 0x01c688 (0xc025 bytes) 000662 1787708689.454345 read 0x03a37a thru 0x03fc23 (0x58aa bytes) 000665 1787708689.458266 fallocate 0x000752 thru 0x00bd49 (0xb5f8 bytes) 000666 1787708689.471998 mapread 0x00fd23 thru 0x019e0f (0xa0ed bytes) 000668 1787708689.474046 read 0x018c4c thru 0x027c68 (0xf01d bytes) 000669 1787708689.475298 mapwrite 0x024359 thru 0x02e44a (0xa0f2 bytes) 000671 1787708689.515161 mapread 0x03f10a thru 0x03fc23 (0xb1a bytes) 000672 1787708689.517225 trunc from 0x03fc24 to 0x02d941 (0x122e2 bytes) 000673 1787708689.553539 punch from 0x00777b to 0x009ab1 (0x2337 bytes) 000675 1787708689.570242 mapwrite 0x018be2 thru 0x020f46 (0x8365 bytes) 000676 1787708689.603964 write 0x028799 thru 0x033400 (0xac68 bytes) 000677 1787708689.605654 fallocate 0x03c16f thru 0x03ffff (0x3e91 bytes) 000678 1787708689.620583 write 0x0066cf thru 0x008115 (0x1a47 bytes) 000679 1787708689.633468 read 0x00eedb thru 0x01556b (0x6691 bytes) 000680 1787708689.646280 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x33401): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33401): Mirror 9: 0x425cba58 (stale) Mirror 11: 0x425cba58 (stale) Mirror 12: 0x425cba58 (stale) CRC-32 checksum value for chunk [0, 0x33401): Mirror 1: 0xc0690aa2 Mirror 13: 0xc0690aa2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33401: skipped 000681 1787708690.767602 mapwrite 0x01118d thru 0x01a993 (0x9807 bytes) 000682 1787708690.875380 fallocate 0x0084d5 thru 0x0150b9 (0xcbe5 bytes) 000683 1787708690.881473 mapread 0x032d48 thru 0x033400 (0x6b9 bytes) 000684 1787708690.896195 mapread 0x003da3 thru 0x00a05b (0x62b9 bytes) 000685 1787708690.908319 trunc from 0x033401 to 0x0145e7 (0x1ee19 bytes) 000686 1787708690.936374 trunc from 0x0145e8 to 0x00ad59 (0x988e bytes) 000687 1787708690.955612 trunc from 0x00ad5a to 0x016146 (0xb3ed bytes) 000688 1787708690.976747 mapread 0x013013 thru 0x016146 (0x3134 bytes) 000689 1787708691.000615 trunc from 0x016147 to 0x01ad45 (0x4bff bytes) 000690 1787708691.029948 fallocate 0x02d5e3 thru 0x0328ff (0x531d bytes) 000691 1787708691.040026 fallocate 0x00ae3e thru 0x011801 (0x69c4 bytes) 000692 1787708691.046612 mapread 0x006f13 thru 0x0168ae (0xf99c bytes) 000693 1787708691.053481 fallocate 0x03eb11 thru 0x03ffff (0x14ef bytes) 000694 1787708691.060280 write 0x036dc8 thru 0x037586 (0x7bf bytes) 000695 1787708691.072349 mapwrite 0x032242 thru 0x035705 (0x34c4 bytes) 000696 1787708691.110518 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xb2175db5 (stale) Mirror 11: 0xb2175db5 (stale) Mirror 13: 0x829a953f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xb2175db5 (stale) Mirror 11: 0xb2175db5 (stale) Mirror 13: 0x829a953f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000697 1787708691.588573 trunc from 0x00a8c7 to 0x00bc69 (0x13a3 bytes) 000698 1787708691.596928 mapread 0x02bc05 thru 0x037b07 (0xbf03 bytes) 000699 1787708691.627481 read 0x0276db thru 0x0301bd (0x8ae3 bytes) 000700 1787708691.628122 fallocate 0x023dae thru 0x0286b4 (0x4907 bytes) 000702 1787708691.633896 punch from 0x031d9c to 0x03910f (0x7374 bytes) 000703 1787708691.639392 fallocate 0x033a83 thru 0x036ba6 (0x3124 bytes) 000704 1787708691.644131 punch from 0x03582c to 0x03986a (0x403f bytes) 000705 1787708691.652605 fallocate 0x03c35d thru 0x03ffff (0x3ca3 bytes) 000706 1787708691.662929 read 0x026664 thru 0x035daa (0xf747 bytes) 000707 1787708691.679225 trunc from 0x024cff to 0x02f435 (0xa737 bytes) 000708 1787708691.687479 trunc from 0x0149aa to 0x01c832 (0x7e89 bytes) 000709 1787708691.693500 mapwrite 0x011dbe thru 0x01f796 (0xd9d9 bytes) 000710 1787708691.805636 read 0x03e1b7 thru 0x03ffbc (0x1e06 bytes) 000711 1787708691.806109 trunc from 0x00a0d9 to 0x01a04f (0xff77 bytes) 000712 1787708691.814099 mapwrite 0x012039 thru 0x0170a7 (0x506f bytes) 000713 1787708691.910331 punch from 0x030442 to 0x03a041 (0x9c00 bytes) 000714 1787708691.925133 mapwrite 0x028c75 thru 0x0369e3 (0xdd6f bytes) 000715 1787708692.108887 fallocate 0x017e7d thru 0x01ce21 (0x4fa5 bytes) 000716 1787708692.120092 fallocate 0x02a0ca thru 0x0325e6 (0x851d bytes) 000717 1787708692.131437 fallocate 0x021645 thru 0x026450 (0x4e0c bytes) 000718 1787708692.138437 trunc from 0x040000 to 0x02f47a (0x10b85 bytes) 000719 1787708692.189494 fallocate 0x0194f5 thru 0x01dd59 (0x4865 bytes) 000720 1787708692.196152 write 0x002db7 thru 0x010fdb (0xe225 bytes) 000721 1787708692.202449 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f47b): Mirror 11: 0x4d37839c (stale) Mirror 13: 0xd405c5df (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f47b): Mirror 11: 0x4d37839c (stale) Mirror 13: 0xd405c5df (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f47b: skipped 000722 1787708692.909803 mapread 0x0069be thru 0x015577 (0xebba bytes) 000723 1787708692.972909 punch from 0x0221d8 to 0x024b1a (0x2943 bytes) 000724 1787708692.993494 punch from 0x0058d4 to 0x014b4f (0xf27c bytes) 000725 1787708693.010590 trunc from 0x00c4fb to 0x011b8c (0x5692 bytes) 000726 1787708693.019166 write 0x037d57 thru 0x03a8c2 (0x2b6c bytes) 000727 1787708693.029298 trunc from 0x009b05 to 0x01503f (0xb53b bytes) 000728 1787708693.046899 mapread 0x033cf2 thru 0x0346ae (0x9bd bytes) 000729 1787708693.092424 trunc from 0x03805d to 0x03a8c2 (0x2866 bytes) 000730 1787708693.115272 mapwrite 0x0328a6 thru 0x03fca6 (0xd401 bytes) 000731 1787708693.195150 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fca7): Mirror 13: 0x93747e6b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fca7): Mirror 13: 0x93747e6b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fca7: skipped 000732 1787708693.591150 trunc from 0x03fca7 to 0x02b762 (0x14544 bytes) 000733 1787708693.615478 read 0x009620 thru 0x013972 (0xa353 bytes) 000734 1787708693.628478 punch from 0x015943 to 0x022a74 (0xd132 bytes) 000735 1787708693.638498 MIRROR_RESYNC 2 mirrors 000736 1787708694.583486 mapread 0x01c822 thru 0x021114 (0x48f3 bytes) 000737 1787708694.605834 write 0x03c31f thru 0x03c7f7 (0x4d9 bytes) 000738 1787708694.646285 trunc from 0x03c7f8 to 0x0187fb (0x23ffc bytes) 000739 1787708694.672039 trunc from 0x0187fc to 0x01c9f0 (0x41f5 bytes) 000740 1787708694.709185 MIRROR_RESYNC 2 mirrors 000741 1787708695.467740 mapread 0x01a182 thru 0x01c9f0 (0x286f bytes) 000742 1787708695.486884 mapread 0x01080c thru 0x0121fc (0x19f1 bytes) 000743 1787708695.495479 punch from 0x0083f3 to 0x015f02 (0xdb10 bytes) 000744 1787708695.537299 write 0x035b6c thru 0x03b08c (0x5521 bytes) 000745 1787708695.538902 trunc from 0x00de2c to 0x01526f (0x7444 bytes) 000747 1787708695.546587 fallocate 0x03be58 thru 0x03ffff (0x41a8 bytes) 000748 1787708695.559374 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) 000749 1787708695.826271 mapread 0x030686 thru 0x0337a1 (0x311c bytes) 000750 1787708695.866920 punch from 0x01fc3c to 0x023eab (0x4270 bytes) 000751 1787708695.881081 mapread 0x00b1f6 thru 0x010aa9 (0x58b4 bytes) 000752 1787708695.900660 write 0x033466 thru 0x03ffff (0xcb9a bytes) 000753 1787708695.910956 punch from 0x0065ad to 0x00a8c4 (0x4318 bytes) 000754 1787708695.923957 mapread 0x00e5d8 thru 0x0139a4 (0x53cd bytes) 000755 1787708695.959144 MIRROR_EXTEND to 2 mirrors 000756 1787708697.293313 trunc from 0x040000 to 0x006419 (0x39be6 bytes) 000757 1787708697.336518 mapread 0x0031a6 thru 0x006419 (0x3274 bytes) 000758 1787708697.355363 punch from 0x003553 to 0x006419 (0x2ec7 bytes) 000759 1787708697.360481 trunc from 0x00641a to 0x022c96 (0x1c87d bytes) 000760 1787708697.386470 fallocate 0x004643 thru 0x009176 (0x4b34 bytes) 000761 1787708697.391944 trunc from 0x022c97 to 0x0055bc (0x1d6da bytes) 000762 1787708697.410493 mapread 0x004744 thru 0x0049cf (0x28c bytes) 000763 1787708697.422635 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) 000765 1787708697.572522 mapread 0x000619 thru 0x004b89 (0x4571 bytes) 000766 1787708697.606082 fallocate 0x018205 thru 0x019421 (0x121d bytes) 000767 1787708697.611585 write 0x037d7d thru 0x03ca19 (0x4c9d bytes) 000768 1787708697.625518 MIRROR_EXTEND to 2 mirrors 000769 1787708698.662761 punch from 0x031376 to 0x03ca19 (0xb6a4 bytes) 000770 1787708698.712113 fallocate 0x0039ed thru 0x0125d0 (0xebe4 bytes) 000771 1787708698.720084 trunc from 0x03ca1a to 0x00b079 (0x319a0 bytes) 000772 1787708698.758715 trunc from 0x00b07a to 0x0091c3 (0x1eb6 bytes) 000773 1787708698.786170 punch from 0x004c14 to 0x0075d1 (0x29be bytes) 000774 1787708698.794233 trunc from 0x003fb7 to 0x008615 (0x465f bytes) 000775 1787708698.802044 write 0x01af95 thru 0x028dcc (0xde38 bytes) 000776 1787708698.809952 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) 000777 1787708698.979002 trunc from 0x001d62 to 0x00aa78 (0x8d17 bytes) 000778 1787708698.987449 punch from 0x00eb86 to 0x016773 (0x7bee bytes) 000779 1787708698.995143 trunc from 0x028dcd to 0x00cb08 (0x1c2c4 bytes) 000780 1787708699.022081 read 0x0046d4 thru 0x00cb08 (0x8435 bytes) 000781 1787708699.033409 fallocate 0x01b9a4 thru 0x02739e (0xb9fb bytes) 000782 1787708699.038880 trunc from 0x00a0f8 to 0x00cb08 (0x2a11 bytes) 000783 1787708699.044518 trunc from 0x009fd2 to 0x00cb08 (0x2b37 bytes) 000784 1787708699.050260 fallocate 0x03f590 thru 0x03ffff (0xa70 bytes) 000785 1787708699.055780 trunc from 0x00cb09 to 0x0215dc (0x14ad4 bytes) 000786 1787708699.076469 write 0x02db2f thru 0x03986e (0xbd40 bytes) 000787 1787708699.080044 punch from 0x00416d to 0x009385 (0x5219 bytes) 000789 1787708699.087767 mapread 0x00980e thru 0x0115f1 (0x7de4 bytes) 000790 1787708699.120036 MIRROR_EXTEND to 2 mirrors 000791 1787708699.934742 mapwrite 0x01a73c thru 0x01fac0 (0x5385 bytes) 000792 1787708700.120201 MIRROR_RESYNC 2 mirrors 000793 1787708701.287928 mapread 0x005e85 thru 0x012681 (0xc7fd bytes) 000794 1787708701.375629 read 0x014c33 thru 0x01cc78 (0x8046 bytes) 000795 1787708701.391779 read 0x025538 thru 0x033506 (0xdfcf bytes) 000796 1787708701.416226 trunc from 0x03986f to 0x00e397 (0x2b4d7 bytes) 000797 1787708701.477168 read 0x00d947 thru 0x00e397 (0xa51 bytes) 000798 1787708701.503448 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xe398): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe398): Mirror 2: 0x1750ca1f (stale) CRC-32 checksum value for chunk [0, 0xe398): Mirror 1: 0x1750ca1f Mirror 3: 0x1750ca1f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe398: skipped 000799 1787708702.900096 mapread 0x00a2a9 thru 0x00e397 (0x40ef bytes) 000800 1787708702.974132 trunc from 0x00da11 to 0x00e397 (0x987 bytes) 000801 1787708703.021552 trunc from 0x00e398 to 0x01ace3 (0xc94c bytes) 000802 1787708703.047034 mapread 0x019ce9 thru 0x01ace3 (0xffb bytes) 000803 1787708703.061450 read 0x01a91f thru 0x01ace3 (0x3c5 bytes) 000804 1787708703.062739 punch from 0x0070c3 to 0x01613d (0xf07b bytes) 000805 1787708703.070253 mapwrite 0x00aeef thru 0x00d5d4 (0x26e6 bytes) 000807 1787708703.109979 write 0x03d167 thru 0x03ffff (0x2e99 bytes) 000808 1787708703.117048 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x60175f35 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x60175f35 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000809 1787708703.450105 trunc from 0x040000 to 0x0219ac (0x1e653 bytes) 000810 1787708703.477122 fallocate 0x01ae1a thru 0x02659c (0xb783 bytes) 000811 1787708703.482055 punch from 0x01128c to 0x013f23 (0x2c98 bytes) 000812 1787708703.487597 mapwrite 0x011b2f thru 0x020a23 (0xeef5 bytes) 000814 1787708703.580379 write 0x01c925 thru 0x025acd (0x91a9 bytes) 000815 1787708703.583017 write 0x0329eb thru 0x03ffff (0xd615 bytes) 000816 1787708703.593171 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) 000817 1787708703.800112 punch from 0x03d4f3 to 0x03e5c3 (0x10d1 bytes) 000818 1787708703.810799 punch from 0x02ab1f to 0x033e8a (0x936c bytes) 000819 1787708703.816371 write 0x02181c thru 0x0258fc (0x40e1 bytes) 000820 1787708703.834401 mapwrite 0x001e98 thru 0x00e03b (0xc1a4 bytes) 000821 1787708703.892424 write 0x00623d thru 0x00f774 (0x9538 bytes) 000822 1787708703.897392 write 0x025850 thru 0x026a54 (0x1205 bytes) 000823 1787708703.907214 fallocate 0x018c3c thru 0x0202f4 (0x76b9 bytes) 000824 1787708703.915136 trunc from 0x040000 to 0x02913a (0x16ec5 bytes) 000825 1787708703.940437 fallocate 0x00d770 thru 0x014f02 (0x7793 bytes) 000826 1787708703.947968 write 0x03b43a thru 0x03ffff (0x4bc6 bytes) 000827 1787708703.952631 fallocate 0x00dcee thru 0x01c9f9 (0xed0c bytes) 000828 1787708703.960617 punch from 0x00b15a to 0x01ab3c (0xf9e3 bytes) 000829 1787708703.981174 trunc from 0x03bb84 to 0x03ffff (0x447c bytes) 000830 1787708703.990454 trunc from 0x040000 to 0x016ce9 (0x29316 bytes) 000831 1787708704.016151 fallocate 0x0262a5 thru 0x029f4b (0x3ca7 bytes) 000832 1787708704.025395 fallocate 0x01cffa thru 0x021ab2 (0x4ab9 bytes) 000833 1787708704.033691 read 0x0085e0 thru 0x015ea8 (0xd8c9 bytes) 000834 1787708704.050086 read 0x012348 thru 0x01b77a (0x9433 bytes) 000835 1787708704.066721 write 0x02eeba thru 0x03a270 (0xb3b7 bytes) 000836 1787708704.070130 mapwrite 0x026df5 thru 0x032454 (0xb660 bytes) 000838 1787708704.107877 mapwrite 0x006d38 thru 0x0074e2 (0x7ab bytes) 000839 1787708704.124920 trunc from 0x03a271 to 0x012ac0 (0x277b0 bytes) 000840 1787708704.146367 mapwrite 0x020264 thru 0x0212dd (0x107a bytes) 000841 1787708704.203336 fallocate 0x00bcf5 thru 0x00c1f7 (0x503 bytes) 000843 1787708704.214303 trunc from 0x0167be to 0x018f8e (0x27d1 bytes) 000844 1787708704.220433 trunc from 0x0156e8 to 0x0212dd (0xbbf6 bytes) 000845 1787708704.227431 trunc from 0x0212de to 0x03e38f (0x1d0b2 bytes) 000848 1787708704.282961 trunc from 0x037ba2 to 0x03a320 (0x277f bytes) 000850 1787708704.297881 fallocate 0x0297e0 thru 0x02eee5 (0x5706 bytes) 000851 1787708704.308392 punch from 0x00642a to 0x00664b (0x222 bytes) 000852 1787708704.327761 write 0x03b246 thru 0x03ffff (0x4dba bytes) 000854 1787708704.349729 MIRROR_EXTEND to 2 mirrors 000855 1787708705.226460 punch from 0x02af8b to 0x02cb6d (0x1be3 bytes) 000856 1787708705.276123 read 0x01e05f thru 0x01f38b (0x132d bytes) 000858 1787708705.290506 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xc3c8747 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc3c8747 Mirror 3: 0xc3c8747 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000859 1787708706.450269 punch from 0x0164dd to 0x025396 (0xeeba bytes) 000860 1787708706.516874 punch from 0x01325b to 0x017aa9 (0x484f bytes) 000861 1787708706.527782 read 0x0190ec thru 0x01a88d (0x17a2 bytes) 000862 1787708706.538119 punch from 0x005e85 to 0x006944 (0xac0 bytes) 000863 1787708706.555035 fallocate 0x03960f thru 0x03ffff (0x69f1 bytes) 000864 1787708706.566353 trunc from 0x03b641 to 0x03ffff (0x49bf bytes) 000865 1787708706.585218 fallocate 0x034a6c thru 0x03e2b6 (0x984b bytes) 000866 1787708706.608299 MIRROR_RESYNC 3 mirrors 000867 1787708707.559110 read 0x02c3d3 thru 0x039593 (0xd1c1 bytes) 000868 1787708707.572355 fallocate 0x0343d9 thru 0x03cde7 (0x8a0f bytes) 000869 1787708707.632282 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xd404d56e (stale) Mirror 3: 0xd404d56e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd404d56e Mirror 4: 0xd404d56e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000870 1787708708.751754 mapwrite 0x027a2c thru 0x02a107 (0x26dc bytes) 000871 1787708708.896938 mapwrite 0x01592f thru 0x023cf7 (0xe3c9 bytes) 000872 1787708708.944953 mapwrite 0x011002 thru 0x016bed (0x5bec bytes) 000873 1787708708.976340 trunc from 0x022e7b to 0x025b4e (0x2cd4 bytes) 000874 1787708708.981433 punch from 0x01e6f8 to 0x02757b (0x8e84 bytes) 000875 1787708708.988435 write 0x029b3b thru 0x037bd5 (0xe09b bytes) 000876 1787708709.001053 trunc from 0x03a942 to 0x03ffff (0x56be bytes) 000877 1787708709.006651 write 0x03d68b thru 0x03ffff (0x2975 bytes) 000878 1787708709.013294 mapwrite 0x03de93 thru 0x03ffff (0x216d bytes) 000879 1787708709.047588 mapread 0x01b78d thru 0x01f1b2 (0x3a26 bytes) 000880 1787708709.059917 mapwrite 0x03b7a3 thru 0x03c0fb (0x959 bytes) 000881 1787708709.085622 read 0x03a32f thru 0x03dc11 (0x38e3 bytes) 000882 1787708709.086356 read 0x00a1ed thru 0x0169d7 (0xc7eb bytes) 000883 1787708709.123578 read 0x01e9ed thru 0x0269e0 (0x7ff4 bytes) 000884 1787708709.129235 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xd404d56e (stale) Mirror 3: 0xd404d56e (stale) Mirror 4: 0xd404d56e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xee203cfd Mirror 5: 0xee203cfd lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000885 1787708710.515579 punch from 0x0166be to 0x024c38 (0xe57b bytes) 000886 1787708710.565299 trunc from 0x039845 to 0x03c5e6 (0x2da2 bytes) 000887 1787708710.571770 trunc from 0x02b392 to 0x02ccbc (0x192b bytes) 000888 1787708710.575850 fallocate 0x01c684 thru 0x02776f (0xb0ec bytes) 000889 1787708710.583061 write 0x020066 thru 0x022b61 (0x2afc bytes) 000890 1787708710.605245 MIRROR_RESYNC 5 mirrors 000891 1787708712.424258 trunc from 0x040000 to 0x03f5c0 (0xa3f bytes) 000892 1787708712.512598 mapwrite 0x01420b thru 0x0199ac (0x57a2 bytes) 000893 1787708712.612244 fallocate 0x034593 thru 0x038ec7 (0x4935 bytes) 000894 1787708712.625523 trunc from 0x03f5c1 to 0x025154 (0x1a46c bytes) 000895 1787708712.676953 punch from 0x00ec1c to 0x014208 (0x55ed bytes) 000896 1787708712.687612 read 0x0225f9 thru 0x025154 (0x2b5c bytes) 000897 1787708712.695466 mapread 0x00e418 thru 0x01b7e9 (0xd3d2 bytes) 000898 1787708712.710767 fallocate 0x03dbb3 thru 0x03ffff (0x244d bytes) 000899 1787708712.720775 punch from 0x010f77 to 0x01b0d7 (0xa161 bytes) 000900 1787708712.725453 trunc from 0x025155 to 0x02ad8a (0x5c36 bytes) 000902 1787708712.740302 read 0x01ff94 thru 0x02ad8a (0xadf7 bytes) 000903 1787708712.757367 fallocate 0x024031 thru 0x02fffb (0xbfcb bytes) 000904 1787708712.761713 fallocate 0x00ce53 thru 0x01a0d8 (0xd286 bytes) 000905 1787708712.771622 write 0x00fd1e thru 0x019a16 (0x9cf9 bytes) 000906 1787708712.774483 read 0x014048 thru 0x01af68 (0x6f21 bytes) 000908 1787708712.784514 punch from 0x003c7c to 0x009af0 (0x5e75 bytes) 000909 1787708712.798466 trunc from 0x025e07 to 0x02ad8a (0x4f84 bytes) 000910 1787708712.810273 fallocate 0x03d5c7 thru 0x03ffff (0x2a39 bytes) 000911 1787708712.839967 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ad8b): Mirror 2: 0xadc09e2a (stale) Mirror 3: 0xadc09e2a (stale) Mirror 4: 0xadc09e2a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ad8b): Mirror 2: 0xadc09e2a (stale) Mirror 3: 0xadc09e2a (stale) Mirror 4: 0xadc09e2a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ad8b: skipped 000912 1787708713.378998 mapwrite 0x03a18c thru 0x03ffff (0x5e74 bytes) 000913 1787708713.437385 mapread 0x01a7f6 thru 0x0200bb (0x58c6 bytes) 000914 1787708713.455764 fallocate 0x0284fc thru 0x036785 (0xe28a bytes) 000915 1787708713.461047 read 0x03c577 thru 0x03ffff (0x3a89 bytes) 000916 1787708713.461966 mapread 0x00b95f thru 0x01aec9 (0xf56b bytes) 000917 1787708713.473014 write 0x00c89b thru 0x01c01b (0xf781 bytes) 000918 1787708713.474951 trunc from 0x00df53 to 0x00e37f (0x42d bytes) 000919 1787708713.496322 punch from 0x027e54 to 0x033ca9 (0xbe56 bytes) 000920 1787708713.501410 mapread 0x00dcd6 thru 0x013795 (0x5ac0 bytes) 000921 1787708713.507968 punch from 0x03818c to 0x03eba3 (0x6a18 bytes) 000922 1787708713.514071 trunc from 0x02d8cf to 0x031e8b (0x45bd bytes) 000923 1787708713.519316 trunc from 0x022bce to 0x028d54 (0x6187 bytes) 000924 1787708713.526305 trunc from 0x040000 to 0x024352 (0x1bcad bytes) 000925 1787708713.550983 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24353): Mirror 3: 0xbd27c1d0 (stale) Mirror 4: 0xbd27c1d0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24353): Mirror 3: 0xbd27c1d0 (stale) Mirror 4: 0xbd27c1d0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24353: skipped 000926 1787708713.841130 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24353): Mirror 3: 0xbd27c1d0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24353): Mirror 3: 0xbd27c1d0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24353: skipped 000927 1787708714.211355 punch from 0x01b072 to 0x021cff (0x6c8e bytes) 000928 1787708714.225316 mapwrite 0x020edc thru 0x0233ba (0x24df bytes) 000929 1787708714.290094 punch from 0x0001a0 to 0x00f724 (0xf585 bytes) 000930 1787708714.305043 mapwrite 0x0023bf thru 0x00ff02 (0xdb44 bytes) 000931 1787708714.355078 trunc from 0x01d072 to 0x024352 (0x72e1 bytes) 000933 1787708714.368084 read 0x00cc41 thru 0x01b429 (0xe7e9 bytes) 000935 1787708714.401219 mapwrite 0x0106b9 thru 0x01fafd (0xf445 bytes) 000936 1787708714.470167 trunc from 0x002353 to 0x008cb9 (0x6967 bytes) 000937 1787708714.477725 mapwrite 0x012352 thru 0x01aeac (0x8b5b bytes) 000938 1787708714.510305 mapwrite 0x017c63 thru 0x01873c (0xada bytes) 000939 1787708714.528960 write 0x0360cb thru 0x037b1e (0x1a54 bytes) 000940 1787708714.535958 trunc from 0x037b1f to 0x035e98 (0x1c86 bytes) 000941 1787708714.551590 mapread 0x02a19b thru 0x02d07b (0x2ee1 bytes) 000942 1787708714.562688 fallocate 0x01c318 thru 0x02c10d (0xfdf6 bytes) 000944 1787708714.569081 fallocate 0x03e5bb thru 0x03ffff (0x1a45 bytes) 000945 1787708714.574294 mapread 0x0370f4 thru 0x03901f (0x1f2c bytes) 000946 1787708714.584780 mapwrite 0x000832 thru 0x00a76c (0x9f3b bytes) 000947 1787708714.612796 trunc from 0x008952 to 0x00b5e5 (0x2c94 bytes) 000948 1787708714.621286 mapread 0x0098ac thru 0x012b13 (0x9268 bytes) 000950 1787708714.633921 mapwrite 0x01e802 thru 0x02e1c0 (0xf9bf bytes) 000951 1787708714.677263 read 0x00fbec thru 0x01f52e (0xf943 bytes) 000952 1787708714.678134 mapwrite 0x026b67 thru 0x0329bb (0xbe55 bytes) 000954 1787708714.697639 mapread 0x024968 thru 0x025419 (0xab2 bytes) 000955 1787708714.698686 mapwrite 0x00c6fa thru 0x01384d (0x7154 bytes) 000956 1787708714.716266 trunc from 0x040000 to 0x02e37c (0x11c83 bytes) 000957 1787708714.738721 trunc from 0x002b26 to 0x012162 (0xf63d bytes) 000959 1787708714.752078 MIRROR_RESYNC 2 mirrors 000960 1787708715.911951 MIRROR_EXTEND to 3 mirrors 000961 1787708717.291463 trunc from 0x02e37d to 0x00ba62 (0x2291a bytes) 000962 1787708717.412930 mapwrite 0x030ee4 thru 0x03e78b (0xd8a8 bytes) 000964 1787708717.559224 punch from 0x031f50 to 0x03798e (0x5a3f bytes) 000965 1787708717.567643 punch from 0x0283a0 to 0x029763 (0x13c4 bytes) 000966 1787708717.576486 fallocate 0x01404f thru 0x01ff74 (0xbf26 bytes) 000967 1787708717.583150 mapread 0x02ebf2 thru 0x0334fa (0x4909 bytes) 000969 1787708717.628422 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e78c): Mirror 4: 0xbf6e6105 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e78c): Mirror 4: 0xbf6e6105 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e78c: skipped 000970 1787708718.169292 trunc from 0x03e78c to 0x0170bb (0x276d0 bytes) 000971 1787708718.207739 punch from 0x0130cb to 0x0170bb (0x3ff1 bytes) 000972 1787708718.211453 trunc from 0x0170bc to 0x00bc8b (0xb430 bytes) 000973 1787708718.226064 read 0x00904a thru 0x00bc8b (0x2c42 bytes) 000975 1787708718.233660 read 0x00bb2d thru 0x00bc8b (0x15f bytes) 000976 1787708718.234321 trunc from 0x00bc8c to 0x01771a (0xba8f bytes) 000977 1787708718.256607 fallocate 0x02f7e8 thru 0x03d1af (0xd9c8 bytes) 000978 1787708718.266309 write 0x02a661 thru 0x02dd04 (0x36a4 bytes) 000979 1787708718.298195 mapread 0x02840d thru 0x03102a (0x8c1e bytes) 000980 1787708718.308672 punch from 0x00555d to 0x005e8b (0x92f bytes) 000981 1787708718.328292 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000405:0x18d:0x0]: Invalid argument (22) 000984 1787708718.590196 write 0x00fb3c thru 0x01742c (0x78f1 bytes) 000985 1787708718.617094 write 0x03057d thru 0x03df64 (0xd9e8 bytes) 000987 1787708718.640110 trunc from 0x0237bf to 0x02dbf0 (0xa432 bytes) 000988 1787708718.657215 trunc from 0x03df65 to 0x0053cd (0x38b97 bytes) 000989 1787708718.680460 fallocate 0x01bba5 thru 0x01c8a5 (0xd01 bytes) 000990 1787708718.694400 punch from 0x00710c to 0x00d9c7 (0x68bc bytes) 000991 1787708718.700045 trunc from 0x014fcf to 0x0168d1 (0x1903 bytes) 000992 1787708718.705383 read 0x0020a6 thru 0x00c20a (0xa165 bytes) 000994 1787708718.719719 trunc from 0x01c8a6 to 0x01e3ab (0x1b06 bytes) 000995 1787708718.747194 mapwrite 0x0115fd thru 0x01ad2d (0x9731 bytes) 000996 1787708718.792954 punch from 0x01ce4d to 0x01e3ab (0x155f bytes) 000997 1787708718.800099 trunc from 0x01e3ac to 0x03d421 (0x1f076 bytes) 000998 1787708718.825718 read 0x0068f2 thru 0x011fd4 (0xb6e3 bytes) 000999 1787708718.826715 trunc from 0x03a3d2 to 0x03d421 (0x3050 bytes) All operations completed A-OK!