== sanity-flr test 70a: flr mode fsx test ================ 04:30:13 (1788942613) Seed set to 2615 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000003 1788942615.590036 write 0x0094ba thru 0x00a39e (0xee5 bytes) 000004 1788942615.592985 mapread 0x008b23 thru 0x00a39e (0x187c bytes) 000005 1788942615.599867 mapwrite 0x006643 thru 0x00fd1a (0x96d8 bytes) 000006 1788942615.734024 read 0x00efff thru 0x00fd1a (0xd1c bytes) truncating to largest ever: 0x1a6b4 000007 1788942615.735384 trunc from 0x00fd1b to 0x01a6b3 (0xa999 bytes) 000008 1788942615.750525 mapread 0x00d1c1 thru 0x017193 (0x9fd3 bytes) 000009 1788942615.759648 read 0x002cdd thru 0x00d868 (0xab8c bytes) 000012 1788942615.762781 mapread 0x00b23c thru 0x00d648 (0x240d bytes) truncating to largest ever: 0x22526 000013 1788942615.764193 trunc from 0x01a6b4 to 0x022525 (0x7e72 bytes) 000014 1788942615.778848 punch from 0x00bcc9 to 0x016ef6 (0xb22e bytes) 000016 1788942615.785279 write 0x001785 thru 0x00ad22 (0x959e bytes) truncating to largest ever: 0x34165 000017 1788942615.788005 trunc from 0x022526 to 0x034164 (0x11c3f bytes) 000018 1788942615.804606 read 0x00b4c3 thru 0x00de14 (0x2952 bytes) 000020 1788942615.818565 trunc from 0x034165 to 0x0093e6 (0x2ad7e bytes) 000022 1788942615.840238 trunc from 0x0093e7 to 0x02aaca (0x216e4 bytes) 000023 1788942615.860872 mapwrite 0x01d2de thru 0x02c181 (0xeea4 bytes) 000024 1788942616.006330 punch from 0x003488 to 0x007398 (0x3f11 bytes) 000027 1788942616.011909 punch from 0x01ae40 to 0x01eb0b (0x3ccc bytes) 000028 1788942616.016283 read 0x00f448 thru 0x0197ec (0xa3a5 bytes) 000029 1788942616.027280 punch from 0x01ff79 to 0x02a789 (0xa811 bytes) 000030 1788942616.033524 mapwrite 0x006e82 thru 0x008cd8 (0x1e57 bytes) 000031 1788942616.072345 read 0x003f34 thru 0x011076 (0xd143 bytes) 000032 1788942616.073034 read 0x01ea5b thru 0x02b915 (0xcebb bytes) 000035 1788942616.083291 mapread 0x00be9c thru 0x00f1fe (0x3363 bytes) 000036 1788942616.084508 mapwrite 0x01cee0 thru 0x01dd7d (0xe9e bytes) 000037 1788942616.136385 mapread 0x002d74 thru 0x011b9a (0xee27 bytes) 000040 1788942616.138610 punch from 0x00d955 to 0x0107b2 (0x2e5e bytes) 000041 1788942616.149794 punch from 0x00d65e to 0x013221 (0x5bc4 bytes) 000045 1788942616.166749 MIRROR_EXTEND to 2 mirrors 000048 1788942617.430507 write 0x0193b7 thru 0x01a53f (0x1189 bytes) 000049 1788942617.533446 mapread 0x00d735 thru 0x01d48b (0xfd57 bytes) 000050 1788942617.594495 punch from 0x0214b4 to 0x02c181 (0xacce bytes) 000051 1788942617.615547 mapread 0x013753 thru 0x023063 (0xf911 bytes) 000052 1788942617.639257 trunc from 0x02c182 to 0x016988 (0x157f9 bytes) 000053 1788942617.674108 mapwrite 0x0123a0 thru 0x016af0 (0x4751 bytes) 000054 1788942617.811478 write 0x022992 thru 0x027309 (0x4978 bytes) 000055 1788942617.814295 mapread 0x005930 thru 0x00d5bc (0x7c8d bytes) 000057 1788942617.836329 write 0x031f63 thru 0x03cfcf (0xb06d bytes) 000059 1788942617.839236 trunc from 0x03cfd0 to 0x005972 (0x3765d bytes) 000061 1788942617.854211 trunc from 0x005973 to 0x00b2c4 (0x5952 bytes) 000062 1788942617.871426 mapread 0x0048cf thru 0x007816 (0x2f48 bytes) 000063 1788942617.879436 trunc from 0x00b2c5 to 0x032ad8 (0x27814 bytes) 000064 1788942617.913762 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x32ad9): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32ad9): Mirror 2: 0x24ffa08b (stale) CRC-32 checksum value for chunk [0, 0x32ad9): Mirror 1: 0xde6aebbc Mirror 3: 0xde6aebbc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32ad9: skipped 000065 1788942618.952687 write 0x006c08 thru 0x0077ed (0xbe6 bytes) 000066 1788942619.047743 trunc from 0x032ad9 to 0x024914 (0xe1c4 bytes) 000067 1788942619.067114 trunc from 0x024915 to 0x02d878 (0x8f64 bytes) 000068 1788942619.087429 trunc from 0x02d879 to 0x005fe6 (0x27892 bytes) 000069 1788942619.106239 punch from 0x0044d5 to 0x005fe6 (0x1b12 bytes) 000070 1788942619.112168 mapwrite 0x003c99 thru 0x0128eb (0xec53 bytes) 000075 1788942619.206013 mapwrite 0x007a14 thru 0x00a58d (0x2b7a bytes) 000076 1788942619.259135 mapwrite 0x03912e thru 0x03ffff (0x6ed2 bytes) 000077 1788942619.356535 write 0x03ecd1 thru 0x03ffff (0x132f bytes) 000079 1788942619.358020 write 0x03a5b5 thru 0x03ffff (0x5a4b bytes) 000080 1788942619.370377 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x2becc432 (stale) Mirror 3: 0x5fd433d4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3f4f7b84 Mirror 4: 0x3f4f7b84 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000081 1788942620.729967 read 0x0393d9 thru 0x03ffff (0x6c27 bytes) truncating to largest ever: 0x38f2d 000083 1788942620.779806 trunc from 0x040000 to 0x038f2c (0x70d3 bytes) 000085 1788942620.937737 mapread 0x010b02 thru 0x020787 (0xfc86 bytes) truncating to largest ever: 0x3d327 000087 1788942620.968161 trunc from 0x038f2d to 0x03d326 (0x43fa bytes) 000089 1788942620.988259 punch from 0x029a4e to 0x033679 (0x9c2c bytes) 000090 1788942620.994257 write 0x03c122 thru 0x03ffff (0x3ede bytes) 000091 1788942621.013983 mapwrite 0x0081db thru 0x00c47c (0x42a2 bytes) 000092 1788942621.180623 write 0x03fe73 thru 0x03ffff (0x18d bytes) 000093 1788942621.186684 write 0x022279 thru 0x02b33a (0x90c2 bytes) 000095 1788942621.213763 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5fd433d4 (stale) Mirror 4: 0x3f4f7b84 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5fd433d4 (stale) Mirror 4: 0x3f4f7b84 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000098 1788942621.594320 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5fd433d4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x5fd433d4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000099 1788942621.817804 punch from 0x036e36 to 0x03b949 (0x4b14 bytes) 000100 1788942621.823931 read 0x01044e thru 0x01c091 (0xbc44 bytes) 000101 1788942621.834606 trunc from 0x040000 to 0x0307e7 (0xf818 bytes) 000102 1788942621.852340 trunc from 0x0307e8 to 0x0311dd (0x9f6 bytes) 000104 1788942621.865981 MIRROR_RESYNC 2 mirrors 000106 1788942622.669087 mapwrite 0x03d684 thru 0x03ffff (0x297c bytes) 000107 1788942622.753706 read 0x00dbac thru 0x01b0c1 (0xd516 bytes) 000108 1788942622.767784 mapread 0x01fc9e thru 0x021f43 (0x22a6 bytes) 000109 1788942622.795691 mapread 0x00f033 thru 0x00f2e0 (0x2ae bytes) 000110 1788942622.805770 MIRROR_RESYNC 2 mirrors 000112 1788942623.880810 trunc from 0x040000 to 0x01c44a (0x23bb5 bytes) 000113 1788942624.046999 read 0x01682a thru 0x017e80 (0x1657 bytes) 000115 1788942624.055358 write 0x01eadc thru 0x020828 (0x1d4d bytes) 000116 1788942624.057038 mapwrite 0x015dc3 thru 0x020ee9 (0xb127 bytes) 000117 1788942624.203554 write 0x032026 thru 0x033eac (0x1e87 bytes) 000118 1788942624.213565 MIRROR_RESYNC 2 mirrors 000119 1788942624.993733 read 0x024162 thru 0x03269d (0xe53c bytes) 000120 1788942625.015867 read 0x01b5ae thru 0x0230f3 (0x7b46 bytes) 000121 1788942625.032134 trunc from 0x033ead to 0x0209c6 (0x134e6 bytes) 000123 1788942625.224855 punch from 0x0159f3 to 0x01ceed (0x74fb bytes) 000127 1788942625.231835 mapread 0x017bb5 thru 0x0209c6 (0x8e12 bytes) 000130 1788942625.282768 mapwrite 0x00204a thru 0x00afae (0x8f65 bytes) 000131 1788942625.385965 read 0x0049ed thru 0x005b2b (0x113f bytes) 000132 1788942625.386591 punch from 0x018261 to 0x0209c6 (0x8766 bytes) 000134 1788942625.399446 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) 000135 1788942625.552224 write 0x02b308 thru 0x02ec91 (0x398a bytes) 000137 1788942625.561902 read 0x0123df thru 0x019b78 (0x779a bytes) 000139 1788942625.571883 mapwrite 0x020f6f thru 0x029bd7 (0x8c69 bytes) 000140 1788942625.642567 write 0x0290d1 thru 0x02a9a2 (0x18d2 bytes) 000141 1788942625.643527 mapwrite 0x02ddbd thru 0x03bc4c (0xde90 bytes) 000143 1788942625.708912 mapread 0x017950 thru 0x01972b (0x1ddc bytes) 000145 1788942625.711941 write 0x032ab0 thru 0x03c111 (0x9662 bytes) 000147 1788942625.714435 mapwrite 0x015744 thru 0x01b9d4 (0x6291 bytes) 000148 1788942625.784460 mapread 0x019d95 thru 0x021cad (0x7f19 bytes) 000149 1788942625.785479 punch from 0x0139ba to 0x01f489 (0xbad0 bytes) 000150 1788942625.790154 punch from 0x01e359 to 0x0296e6 (0xb38e bytes) 000151 1788942625.794503 mapwrite 0x02459d thru 0x033da8 (0xf80c bytes) 000152 1788942625.853241 read 0x000c74 thru 0x007d8e (0x711b bytes) 000153 1788942625.862268 write 0x022a01 thru 0x023801 (0xe01 bytes) 000154 1788942625.863280 read 0x00e8ad thru 0x017b12 (0x9266 bytes) 000159 1788942625.866593 punch from 0x0030df to 0x00754c (0x446e bytes) 000160 1788942625.874889 read 0x02390c thru 0x02a3a1 (0x6a96 bytes) 000161 1788942625.883559 mapread 0x0136d3 thru 0x013a2d (0x35b bytes) 000162 1788942625.884369 mapwrite 0x0169f7 thru 0x025630 (0xec3a bytes) 000163 1788942625.925923 punch from 0x02146a to 0x022359 (0xef0 bytes) 000164 1788942625.929323 punch from 0x002221 to 0x004ddb (0x2bbb bytes) 000166 1788942625.932229 punch from 0x03028f to 0x03431d (0x408f bytes) 000168 1788942625.936325 read 0x031b46 thru 0x03c111 (0xa5cc bytes) 000169 1788942625.945010 punch from 0x035a6b to 0x03b489 (0x5a1f bytes) 000171 1788942625.948786 write 0x01fdbe thru 0x022089 (0x22cc bytes) 000172 1788942625.953377 read 0x02a87e thru 0x033c12 (0x9395 bytes) 000173 1788942625.954437 write 0x01cf7d thru 0x02b9eb (0xea6f bytes) 000175 1788942625.957216 trunc from 0x03c112 to 0x00a718 (0x319f9 bytes) 000176 1788942625.980476 trunc from 0x00a719 to 0x0081d7 (0x2541 bytes) 000178 1788942626.001008 MIRROR_EXTEND to 2 mirrors 000179 1788942626.888362 read 0x0072e4 thru 0x0081d7 (0xef4 bytes) 000181 1788942626.908545 read 0x000c47 thru 0x007fef (0x73a9 bytes) 000182 1788942626.933374 trunc from 0x0081d8 to 0x0140ed (0xbf16 bytes) 000183 1788942627.033612 mapread 0x00dea8 thru 0x0140ed (0x6246 bytes) 000184 1788942627.048485 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) 000185 1788942627.165352 punch from 0x006eab to 0x009201 (0x2357 bytes) 000186 1788942627.174508 MIRROR_EXTEND to 2 mirrors 000187 1788942628.103194 punch from 0x010a66 to 0x0140ed (0x3688 bytes) 000189 1788942628.174242 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x140ee): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x140ee): Mirror 2: 0xd746382a (stale) CRC-32 checksum value for chunk [0, 0x140ee): Mirror 1: 0xd746382a Mirror 3: 0xd746382a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x140ee: skipped 000190 1788942629.400513 read 0x0013e4 thru 0x0044da (0x30f7 bytes) 000191 1788942629.421541 trunc from 0x0140ee to 0x01330f (0xdde bytes) 000192 1788942629.602833 punch from 0x007b7f to 0x01330f (0xb791 bytes) 000193 1788942629.628787 mapread 0x00ce9a thru 0x01330f (0x6476 bytes) 000194 1788942629.678683 write 0x03c780 thru 0x03ffff (0x3880 bytes) 000195 1788942629.686317 write 0x02a39b thru 0x039dd4 (0xfa3a bytes) 000196 1788942629.713912 trunc from 0x040000 to 0x039b0c (0x64f3 bytes) 000198 1788942629.759870 mapwrite 0x013ef2 thru 0x0168f2 (0x2a01 bytes) 000199 1788942629.838354 write 0x03166a thru 0x03ccea (0xb681 bytes) 000201 1788942629.854620 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cceb): Mirror 3: 0x7c0d275b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cceb): Mirror 3: 0x7c0d275b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cceb: skipped 000203 1788942630.319690 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) 000206 1788942630.510688 punch from 0x01852d to 0x024f9e (0xca72 bytes) 000207 1788942630.517192 read 0x034a63 thru 0x03ccea (0x8288 bytes) 000208 1788942630.536004 write 0x037a0a thru 0x03ffff (0x85f6 bytes) 000210 1788942630.539083 trunc from 0x040000 to 0x03c41b (0x3be4 bytes) 000213 1788942630.558378 punch from 0x008949 to 0x00a12e (0x17e6 bytes) 000214 1788942630.572124 read 0x02b15e thru 0x0368b8 (0xb75b bytes) 000215 1788942630.586274 mapwrite 0x0079fc thru 0x011a7d (0xa082 bytes) 000216 1788942630.662829 trunc from 0x03c41c to 0x022a81 (0x1999a bytes) 000217 1788942630.685772 trunc from 0x022a82 to 0x01d4d1 (0x55b0 bytes) 000219 1788942630.707471 trunc from 0x01d4d2 to 0x018134 (0x539d bytes) 000223 1788942630.732931 mapwrite 0x0323c9 thru 0x039501 (0x7139 bytes) 000224 1788942630.923736 trunc from 0x039502 to 0x012aba (0x26a47 bytes) 000225 1788942630.940468 write 0x0115de thru 0x013b9f (0x25c2 bytes) 000226 1788942630.941228 mapwrite 0x019606 thru 0x01bbaf (0x25aa bytes) 000227 1788942631.054456 mapread 0x012498 thru 0x016287 (0x3df0 bytes) 000228 1788942631.071210 punch from 0x01b623 to 0x01bbaf (0x58d bytes) 000230 1788942631.076159 read 0x017316 thru 0x01bbaf (0x489a bytes) 000233 1788942631.086180 write 0x03b003 thru 0x03ffff (0x4ffd bytes) 000235 1788942631.087738 trunc from 0x040000 to 0x016d23 (0x292dc bytes) 000236 1788942631.105255 trunc from 0x016d24 to 0x038ff9 (0x222d6 bytes) 000239 1788942631.133049 mapread 0x029286 thru 0x02c57f (0x32fa bytes) 000242 1788942631.145258 write 0x007872 thru 0x00d2c4 (0x5a53 bytes) 000243 1788942631.146208 mapwrite 0x0293cb thru 0x029db5 (0x9eb bytes) 000245 1788942631.197976 punch from 0x00e218 to 0x01dd33 (0xfb1c bytes) 000248 1788942631.204767 mapread 0x01893b thru 0x01c9d5 (0x409b bytes) 000251 1788942631.229021 punch from 0x02a4d8 to 0x02d54b (0x3074 bytes) 000253 1788942631.234212 mapwrite 0x009c9c thru 0x00dd04 (0x4069 bytes) 000255 1788942631.284702 trunc from 0x038ffa to 0x011f98 (0x27061 bytes) 000259 1788942631.303468 mapread 0x00d552 thru 0x011f98 (0x4a47 bytes) 000260 1788942631.323351 trunc from 0x011f99 to 0x03c4d1 (0x2a539 bytes) 000261 1788942631.361285 punch from 0x00f87d to 0x01aeb6 (0xb63a bytes) 000262 1788942631.375136 write 0x01d19b thru 0x01f242 (0x20a8 bytes) 000263 1788942631.390106 trunc from 0x03c4d2 to 0x0382fc (0x41d5 bytes) 000266 1788942631.435717 punch from 0x007c95 to 0x014dba (0xd126 bytes) 000267 1788942631.451873 read 0x02837e thru 0x02a34c (0x1fcf bytes) 000268 1788942631.470228 mapwrite 0x024d68 thru 0x02b466 (0x66ff bytes) 000271 1788942631.577174 mapread 0x02dc30 thru 0x0382fc (0xa6cd bytes) 000272 1788942631.578744 punch from 0x01297a to 0x018af9 (0x6180 bytes) 000274 1788942631.591327 punch from 0x008899 to 0x008afc (0x264 bytes) 000277 1788942631.604556 mapread 0x02b213 thru 0x037dca (0xcbb8 bytes) 000278 1788942631.605504 mapwrite 0x005dc4 thru 0x00790f (0x1b4c bytes) 000280 1788942631.704645 mapwrite 0x012ba9 thru 0x0212df (0xe737 bytes) 000281 1788942631.843811 write 0x02abed thru 0x02f954 (0x4d68 bytes) 000282 1788942631.851257 trunc from 0x0382fd to 0x02c5ae (0xbd4e bytes) 000283 1788942631.880201 write 0x00aebf thru 0x017f5b (0xd09d bytes) 000285 1788942631.883906 write 0x01b6b0 thru 0x0222a1 (0x6bf2 bytes) 000286 1788942631.884943 trunc from 0x02c5af to 0x00065a (0x2bf54 bytes) 000287 1788942631.904431 mapwrite 0x01eec3 thru 0x01fa4e (0xb8c bytes) 000288 1788942631.995561 mapread 0x001d9f thru 0x0083db (0x663d bytes) 000290 1788942632.038653 mapread 0x00633b thru 0x00ee85 (0x8b4b bytes) 000291 1788942632.094084 write 0x028a97 thru 0x03409c (0xb606 bytes) 000292 1788942632.104853 punch from 0x018647 to 0x01c391 (0x3d4b bytes) 000294 1788942632.143271 mapwrite 0x01dd4f thru 0x02d3e8 (0xf69a bytes) 000295 1788942632.256359 read 0x03100d thru 0x03409c (0x3090 bytes) 000298 1788942632.260353 mapread 0x015c3d thru 0x02083a (0xabfe bytes) 000299 1788942632.269891 write 0x035dad thru 0x03ffff (0xa253 bytes) 000300 1788942632.272231 trunc from 0x040000 to 0x00a7ad (0x35852 bytes) 000301 1788942632.297323 MIRROR_EXTEND to 2 mirrors 000302 1788942633.410617 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) 000303 1788942633.543630 trunc from 0x00a7ae to 0x00f608 (0x4e5b bytes) 000305 1788942633.573703 mapread 0x00bb36 thru 0x00f4b5 (0x3980 bytes) 000306 1788942633.593173 mapread 0x009d3d thru 0x00e6d5 (0x4999 bytes) 000307 1788942633.594362 punch from 0x00e1d6 to 0x00f608 (0x1433 bytes) 000308 1788942633.599719 mapwrite 0x0122ad thru 0x02214a (0xfe9e bytes) 000309 1788942633.721699 mapwrite 0x006829 thru 0x00787f (0x1057 bytes) 000311 1788942633.793732 MIRROR_EXTEND to 2 mirrors 000313 1788942635.155660 MIRROR_EXTEND to 3 mirrors 000314 1788942636.039970 MIRROR_RESYNC 3 mirrors 000315 1788942636.320887 mapwrite 0x034636 thru 0x03ffff (0xb9ca bytes) 000316 1788942636.479167 write 0x006787 thru 0x00d5e8 (0x6e62 bytes) 000318 1788942636.487757 mapwrite 0x015e2b thru 0x01fb91 (0x9d67 bytes) 000319 1788942636.549606 mapread 0x021e4c thru 0x025ce2 (0x3e97 bytes) 000320 1788942636.550492 punch from 0x00bc59 to 0x016828 (0xabd0 bytes) 000322 1788942636.558775 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x50ecf7a8 (stale) Mirror 3: 0x50ecf7a8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5aba611a Mirror 4: 0x5aba611a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000323 1788942637.753233 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x50ecf7a8 (stale) Mirror 3: 0x50ecf7a8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x50ecf7a8 (stale) Mirror 3: 0x50ecf7a8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000324 1788942638.347787 mapwrite 0x02cdeb thru 0x03a56f (0xd785 bytes) 000326 1788942638.557202 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x50ecf7a8 (stale) Mirror 3: 0x50ecf7a8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xeb3970f2 Mirror 4: 0xeb3970f2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000327 1788942639.984702 mapread 0x03c106 thru 0x03ffff (0x3efa bytes) 000330 1788942640.061102 mapwrite 0x037c84 thru 0x038413 (0x790 bytes) 000333 1788942640.276689 trunc from 0x040000 to 0x022c15 (0x1d3ea bytes) 000336 1788942640.337783 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x22c16): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22c16): Mirror 2: 0xe82b746b (stale) Mirror 3: 0xe82b746b (stale) Mirror 4: 0x3595e363 (stale) CRC-32 checksum value for chunk [0, 0x22c16): Mirror 1: 0x3595e363 Mirror 5: 0x3595e363 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22c16: skipped 000337 1788942642.410635 trunc from 0x022c16 to 0x00f198 (0x13a7d bytes) 000339 1788942642.603320 mapwrite 0x01a4f8 thru 0x026bb1 (0xc6ba bytes) 000340 1788942642.770246 read 0x002b11 thru 0x005239 (0x2729 bytes) 000341 1788942642.795527 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x26bb2): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26bb2): Mirror 2: 0x754ea161 (stale) Mirror 3: 0x754ea161 (stale) Mirror 4: 0x87d1b2d1 (stale) Mirror 5: 0x87d1b2d1 (stale) CRC-32 checksum value for chunk [0, 0x26bb2): Mirror 1: 0xee91888 Mirror 6: 0xee91888 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26bb2: skipped 000342 1788942644.645257 mapwrite 0x000d72 thru 0x007b1b (0x6daa bytes) 000344 1788942645.057054 mapwrite 0x0301d7 thru 0x03b0fb (0xaf25 bytes) 000345 1788942645.281316 trunc from 0x03b0fc to 0x0299d2 (0x11729 bytes) 000346 1788942645.320362 punch from 0x019dd8 to 0x02456f (0xa798 bytes) 000347 1788942645.337086 read 0x0151bb thru 0x019edc (0x4d22 bytes) 000348 1788942645.365276 trunc from 0x0299d3 to 0x0059aa (0x24028 bytes) 000349 1788942645.403780 punch from 0x00087f to 0x000b35 (0x2b7 bytes) 000350 1788942645.431018 read 0x0054d5 thru 0x0059aa (0x4d6 bytes) 000351 1788942645.445758 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x59ab): Mirror 2: 0xb36cb2d6 (stale) Mirror 3: 0xb36cb2d6 (stale) Mirror 5: 0xb36cb2d6 (stale) Mirror 6: 0xb36cb2d6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x59ab): Mirror 2: 0xb36cb2d6 (stale) Mirror 3: 0xb36cb2d6 (stale) Mirror 5: 0xb36cb2d6 (stale) Mirror 6: 0xb36cb2d6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x59ab: skipped 000352 1788942646.082203 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x59ab): Mirror 2: 0xb36cb2d6 (stale) Mirror 3: 0xb36cb2d6 (stale) Mirror 6: 0xb36cb2d6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x59ab): Mirror 2: 0xb36cb2d6 (stale) Mirror 3: 0xb36cb2d6 (stale) Mirror 6: 0xb36cb2d6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x59ab: skipped 000353 1788942646.739106 punch from 0x00176b to 0x005707 (0x3f9d bytes) 000354 1788942646.763538 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x59ab): Mirror 2: 0xb36cb2d6 (stale) Mirror 3: 0xb36cb2d6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x59ab): Mirror 2: 0xb36cb2d6 (stale) Mirror 3: 0xb36cb2d6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x59ab: skipped 000355 1788942647.233741 mapwrite 0x00ec0a thru 0x0169c7 (0x7dbe bytes) 000356 1788942647.483216 mapwrite 0x016f56 thru 0x01c57d (0x5628 bytes) 000358 1788942647.699046 punch from 0x007e89 to 0x0114a4 (0x961c bytes) 000359 1788942647.706306 read 0x011ef6 thru 0x013a19 (0x1b24 bytes) 000361 1788942647.726331 write 0x017986 thru 0x026c2e (0xf2a9 bytes) 000362 1788942647.729983 write 0x010381 thru 0x01a0c9 (0x9d49 bytes) 000363 1788942647.758313 MIRROR_RESYNC 3 mirrors 000364 1788942649.923714 write 0x012ec2 thru 0x0143a6 (0x14e5 bytes) 000365 1788942650.202835 write 0x03b99c thru 0x03ffff (0x4664 bytes) 000366 1788942650.203869 trunc from 0x040000 to 0x039a1c (0x65e3 bytes) 000367 1788942650.242239 MIRROR_RESYNC 3 mirrors 000368 1788942651.946883 punch from 0x007c7e to 0x01032f (0x86b2 bytes) 000369 1788942652.025335 mapread 0x000bf9 thru 0x007026 (0x642e bytes) 000370 1788942652.062234 read 0x007028 thru 0x00972e (0x2707 bytes) 000372 1788942652.074097 MIRROR_RESYNC 3 mirrors truncating to largest ever: 0x3d33d 000373 1788942653.641203 trunc from 0x039a1d to 0x03d33c (0x3920 bytes) 000374 1788942653.720632 trunc from 0x03d33d to 0x02f635 (0xdd07 bytes) 000376 1788942653.818334 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f636): Mirror 3: 0x6a9983c7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f636): Mirror 3: 0x6a9983c7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f636: skipped 000378 1788942654.509960 trunc from 0x02f636 to 0x02c2a0 (0x3395 bytes) 000379 1788942654.532708 trunc from 0x02c2a1 to 0x012a19 (0x19887 bytes) 000381 1788942654.608589 mapread 0x00abae thru 0x012a19 (0x7e6c bytes) 000382 1788942654.656710 read 0x00fcd0 thru 0x012a19 (0x2d4a bytes) 000383 1788942654.657580 read 0x01129a thru 0x012a19 (0x1780 bytes) 000384 1788942654.663955 write 0x027467 thru 0x02dee4 (0x6a7e bytes) 000386 1788942654.667070 trunc from 0x02dee5 to 0x029199 (0x4d4b bytes) 000388 1788942654.698290 punch from 0x01ba5b to 0x029199 (0xd73f bytes) 000389 1788942654.715037 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2919a): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2919a): Mirror 3: 0xf91711b1 (stale) CRC-32 checksum value for chunk [0, 0x2919a): Mirror 1: 0x81944ece Mirror 4: 0x81944ece lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2919a: skipped 000391 1788942657.534782 mapwrite 0x0335e8 thru 0x03dcdc (0xa6f5 bytes) 000393 1788942658.049002 read 0x00a5be thru 0x011415 (0x6e58 bytes) 000394 1788942658.061443 mapwrite 0x03d953 thru 0x03ffff (0x26ad bytes) 000396 1788942658.220230 trunc from 0x040000 to 0x00addb (0x35224 bytes) 000397 1788942658.242736 read 0x003b92 thru 0x00addb (0x724a bytes) 000399 1788942658.257939 read 0x006906 thru 0x00addb (0x44d6 bytes) 000400 1788942658.258567 write 0x01ef56 thru 0x02a684 (0xb72f bytes) 000401 1788942658.276018 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a685): Mirror 3: 0xf9c18eeb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a685): Mirror 3: 0xf9c18eeb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a685: skipped 000402 1788942658.665641 punch from 0x000c4c to 0x009b45 (0x8efa bytes) 000403 1788942658.673416 mapread 0x010dc9 thru 0x01e340 (0xd578 bytes) 000404 1788942658.708124 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) 000405 1788942658.932006 write 0x01f9fb thru 0x024148 (0x474e bytes) 000406 1788942658.952596 MIRROR_EXTEND to 2 mirrors 000409 1788942660.750121 mapwrite 0x008261 thru 0x00e394 (0x6134 bytes) 000411 1788942661.036522 mapread 0x00d38f thru 0x01224b (0x4ebd bytes) 000413 1788942661.045526 read 0x00595f thru 0x00d9f5 (0x8097 bytes) 000414 1788942661.046570 mapread 0x003145 thru 0x009381 (0x623d bytes) 000415 1788942661.048098 read 0x016753 thru 0x023897 (0xd145 bytes) 000416 1788942661.071210 trunc from 0x02a685 to 0x01842e (0x12256 bytes) 000419 1788942661.115869 read 0x0016ab thru 0x01018a (0xeae0 bytes) 000420 1788942661.117945 trunc from 0x01842f to 0x027b53 (0xf725 bytes) 000421 1788942661.153589 punch from 0x004df6 to 0x00e8e6 (0x9af1 bytes) 000423 1788942661.161258 mapread 0x00e575 thru 0x01bbe0 (0xd66c bytes) 000426 1788942661.174888 trunc from 0x027b54 to 0x00ac71 (0x1cee2 bytes) 000428 1788942661.228893 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xac72): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xac72): Mirror 2: 0xfe70aab6 (stale) CRC-32 checksum value for chunk [0, 0xac72): Mirror 1: 0xfe70aab6 Mirror 3: 0xfe70aab6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xac72: skipped 000429 1788942662.575886 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xac72): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xac72): Mirror 2: 0xfe70aab6 (stale) CRC-32 checksum value for chunk [0, 0xac72): Mirror 1: 0xfe70aab6 Mirror 3: 0xfe70aab6 Mirror 4: 0xfe70aab6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xac72: skipped 000430 1788942663.559161 punch from 0x00774a to 0x00ac71 (0x3528 bytes) 000435 1788942663.639564 mapwrite 0x02570f thru 0x02885c (0x314e bytes) 000438 1788942663.771639 punch from 0x020c14 to 0x023742 (0x2b2f bytes) 000442 1788942663.780800 read 0x00253f thru 0x00cf2b (0xa9ed bytes) 000443 1788942663.795772 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2885d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2885d): Mirror 2: 0x4df478c6 (stale) Mirror 3: 0xa25ee3c9 (stale) Mirror 4: 0xa25ee3c9 (stale) CRC-32 checksum value for chunk [0, 0x2885d): Mirror 1: 0xf742bb49 Mirror 5: 0xf742bb49 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2885d: skipped 000445 1788942664.671825 punch from 0x0202fd to 0x02885c (0x8560 bytes) 000447 1788942664.751927 trunc from 0x02885d to 0x00461b (0x24241 bytes) 000449 1788942664.775827 write 0x034378 thru 0x038601 (0x428a bytes) 000451 1788942664.784145 mapread 0x0137b7 thru 0x01a80e (0x7058 bytes) 000452 1788942664.810681 MIRROR_RESYNC 5 mirrors 000453 1788942666.411104 mapwrite 0x00a0d8 thru 0x013a3b (0x9964 bytes) 000455 1788942666.707893 mapwrite 0x00f961 thru 0x0137e2 (0x3e82 bytes) 000457 1788942666.809310 punch from 0x01d325 to 0x02afaa (0xdc86 bytes) 000458 1788942666.814280 mapread 0x01686d thru 0x023fe3 (0xd777 bytes) 000461 1788942666.840296 read 0x011716 thru 0x01b5b7 (0x9ea2 bytes) 000464 1788942666.842492 punch from 0x003790 to 0x00b22d (0x7a9e bytes) 000465 1788942666.847040 read 0x0001f0 thru 0x00e473 (0xe284 bytes) 000466 1788942666.871441 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x38602): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38602): Mirror 2: 0xf089d5d4 (stale) Mirror 3: 0xf089d5d4 (stale) Mirror 4: 0xf089d5d4 (stale) Mirror 5: 0xf089d5d4 (stale) CRC-32 checksum value for chunk [0, 0x38602): Mirror 1: 0xf0149154 Mirror 6: 0xf0149154 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38602: skipped 000467 1788942668.076767 punch from 0x028106 to 0x0321e0 (0xa0db bytes) 000468 1788942668.169440 trunc from 0x038602 to 0x0249fd (0x13c04 bytes) 000470 1788942668.212120 trunc from 0x0249fe to 0x034617 (0xfc1a bytes) 000472 1788942668.234565 read 0x006f61 thru 0x008c02 (0x1ca2 bytes) 000473 1788942668.263051 MIRROR_RESYNC 6 mirrors 000475 1788942669.881259 trunc from 0x034618 to 0x03724e (0x2c37 bytes) 000476 1788942669.946981 mapwrite 0x03b401 thru 0x03ffff (0x4bff bytes) 000481 1788942670.055787 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xba6d0acc (stale) Mirror 3: 0xba6d0acc (stale) Mirror 4: 0xba6d0acc (stale) Mirror 6: 0xba6d0acc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xba6d0acc (stale) Mirror 3: 0xba6d0acc (stale) Mirror 4: 0xba6d0acc (stale) Mirror 6: 0xba6d0acc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000482 1788942670.482495 punch from 0x00a4ff to 0x00f24d (0x4d4f bytes) 000483 1788942670.494688 trunc from 0x040000 to 0x023385 (0x1cc7a bytes) 000484 1788942670.516801 read 0x013aa7 thru 0x0216ea (0xdc44 bytes) 000485 1788942670.527198 punch from 0x01df6c to 0x023385 (0x541a bytes) 000486 1788942670.531994 mapread 0x00a3ad thru 0x013c84 (0x98d8 bytes) 000487 1788942670.548812 mapwrite 0x008882 thru 0x00ff4c (0x76cb bytes) 000488 1788942670.608896 mapread 0x01693c thru 0x01ff69 (0x962e bytes) 000489 1788942670.619955 mapread 0x0025ea thru 0x0038c8 (0x12df bytes) 000490 1788942670.628787 mapread 0x01bc49 thru 0x023385 (0x773d bytes) 000491 1788942670.630767 mapwrite 0x0039c3 thru 0x01135c (0xd99a bytes) 000492 1788942670.693380 mapread 0x0189ac thru 0x01a1d3 (0x1828 bytes) 000493 1788942670.694920 mapwrite 0x03eb17 thru 0x03ffff (0x14e9 bytes) 000494 1788942670.778117 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xba6d0acc (stale) Mirror 4: 0xba6d0acc (stale) Mirror 6: 0xba6d0acc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xba6d0acc (stale) Mirror 4: 0xba6d0acc (stale) Mirror 6: 0xba6d0acc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000495 1788942671.097255 MIRROR_RESYNC 4 mirrors 000496 1788942672.747614 trunc from 0x040000 to 0x00dc87 (0x32378 bytes) 000497 1788942672.859583 write 0x01c63c thru 0x01e702 (0x20c7 bytes) 000498 1788942672.875078 MIRROR_RESYNC 4 mirrors 000499 1788942673.986071 write 0x022d42 thru 0x02aad2 (0x7d91 bytes) 000500 1788942674.038645 mapread 0x003764 thru 0x011e76 (0xe713 bytes) 000502 1788942674.063713 mapread 0x025f0c thru 0x02aad2 (0x4bc7 bytes) 000503 1788942674.064728 read 0x00a713 thru 0x00fd82 (0x5670 bytes) 000504 1788942674.069283 MIRROR_RESYNC 4 mirrors 000507 1788942675.706092 mapwrite 0x0282d1 thru 0x028798 (0x4c8 bytes) 000508 1788942675.908943 mapread 0x00cd9f thru 0x011a47 (0x4ca9 bytes) 000509 1788942675.919708 mapread 0x0298f5 thru 0x02a2ee (0x9fa bytes) 000511 1788942675.933115 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2aad3): Mirror 2: 0x30813e96 (stale) Mirror 6: 0x30813e96 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2aad3): Mirror 2: 0x30813e96 (stale) Mirror 6: 0x30813e96 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2aad3: skipped 000512 1788942676.272436 write 0x034a1b thru 0x03ea7e (0xa064 bytes) 000513 1788942676.275232 mapwrite 0x038294 thru 0x03ffff (0x7d6c bytes) 000514 1788942676.346271 mapwrite 0x00573d thru 0x00bb3d (0x6401 bytes) 000515 1788942676.398094 punch from 0x0127ea to 0x020418 (0xdc2f bytes) 000516 1788942676.403262 trunc from 0x040000 to 0x012a61 (0x2d59e bytes) 000518 1788942676.427679 trunc from 0x012a62 to 0x01ffeb (0xd58a bytes) 000519 1788942676.449771 write 0x02b45d thru 0x02f3b6 (0x3f5a bytes) 000521 1788942676.457100 MIRROR_RESYNC 3 mirrors 000522 1788942677.344858 read 0x013a44 thru 0x01c2ee (0x88ab bytes) 000524 1788942677.369637 MIRROR_EXTEND to 4 mirrors 000525 1788942678.423549 mapwrite 0x0000e8 thru 0x0046a1 (0x45ba bytes) 000526 1788942678.699037 read 0x016d43 thru 0x02364b (0xc909 bytes) 000527 1788942678.724255 punch from 0x0293bc to 0x02e078 (0x4cbd bytes) 000530 1788942678.747124 MIRROR_RESYNC 4 mirrors 000531 1788942680.258586 mapwrite 0x019917 thru 0x026750 (0xce3a bytes) 000532 1788942680.470905 punch from 0x007813 to 0x00f3c6 (0x7bb4 bytes) 000535 1788942680.483944 mapwrite 0x00b7a7 thru 0x010003 (0x485d bytes) 000536 1788942680.562239 mapread 0x02e980 thru 0x02f3b6 (0xa37 bytes) 000537 1788942680.570907 read 0x01017d thru 0x01f7b4 (0xf638 bytes) 000538 1788942680.571993 mapwrite 0x036904 thru 0x038e7e (0x257b bytes) 000539 1788942680.688621 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x38e7f): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38e7f): Mirror 2: 0x7273550d (stale) Mirror 6: 0x7273550d (stale) Mirror 7: 0x7273550d (stale) CRC-32 checksum value for chunk [0, 0x38e7f): Mirror 1: 0x18a3617e Mirror 8: 0x18a3617e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38e7f: skipped 000540 1788942682.078586 mapwrite 0x0190ce thru 0x0223f2 (0x9325 bytes) 000541 1788942682.277274 mapread 0x0067e8 thru 0x0098ec (0x3105 bytes) 000542 1788942682.290773 mapread 0x02ddf9 thru 0x038e7e (0xb086 bytes) 000544 1788942682.311784 MIRROR_RESYNC 5 mirrors 000545 1788942684.589639 MIRROR_EXTEND to 6 mirrors 000548 1788942685.748805 write 0x022436 thru 0x02e0e3 (0xbcae bytes) 000549 1788942685.841017 write 0x0351ef thru 0x03fde1 (0xabf3 bytes) 000550 1788942685.848621 mapread 0x035d85 thru 0x03f511 (0x978d bytes) 000551 1788942685.850012 trunc from 0x03fde2 to 0x01157c (0x2e865 bytes) 000552 1788942685.875966 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1157d): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1157d): Mirror 2: 0x2a3e93ba (stale) Mirror 6: 0x2a3e93ba (stale) Mirror 7: 0x2a3e93ba (stale) Mirror 8: 0x2a3e93ba (stale) Mirror 9: 0x2a3e93ba (stale) CRC-32 checksum value for chunk [0, 0x1157d): Mirror 1: 0x2a3e93ba Mirror 10: 0x2a3e93ba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1157d: skipped 000553 1788942686.753763 mapread 0x002a27 thru 0x00397b (0xf55 bytes) 000555 1788942686.785551 read 0x00b399 thru 0x01157c (0x61e4 bytes) 000556 1788942686.804281 write 0x001bed thru 0x00a5b1 (0x89c5 bytes) 000558 1788942686.911106 trunc from 0x01157d to 0x00cdb3 (0x47c9 bytes) 000560 1788942686.949243 MIRROR_RESYNC 7 mirrors 000561 1788942688.293846 punch from 0x001235 to 0x002dda (0x1ba6 bytes) 000563 1788942688.348902 trunc from 0x00cdb4 to 0x0274aa (0x1a6f7 bytes) 000564 1788942688.384373 trunc from 0x0274ab to 0x00bda2 (0x1b708 bytes) 000566 1788942688.405581 mapread 0x00772a thru 0x00bda2 (0x4679 bytes) 000567 1788942688.419366 trunc from 0x00bda3 to 0x02bd03 (0x1ff61 bytes) 000569 1788942688.436282 punch from 0x011587 to 0x01c4ed (0xaf67 bytes) 000570 1788942688.445231 mapwrite 0x0108c6 thru 0x01ab78 (0xa2b3 bytes) 000571 1788942688.551292 mapwrite 0x000e25 thru 0x0042bb (0x3497 bytes) 000573 1788942688.609592 mapread 0x017315 thru 0x021e89 (0xab75 bytes) 000574 1788942688.610756 read 0x003f16 thru 0x007d1b (0x3e06 bytes) 000578 1788942688.612706 mapwrite 0x00bd6e thru 0x01abf6 (0xee89 bytes) truncating to largest ever: 0x3f0f9 000579 1788942688.678671 trunc from 0x02bd04 to 0x03f0f8 (0x133f5 bytes) 000580 1788942688.712941 read 0x03a7cb thru 0x03f0f8 (0x492e bytes) 000584 1788942688.733986 MIRROR_RESYNC 7 mirrors 000586 1788942690.111812 write 0x03fc88 thru 0x03ffff (0x378 bytes) 000587 1788942690.194311 trunc from 0x040000 to 0x023606 (0x1c9f9 bytes) 000588 1788942690.217994 mapwrite 0x002303 thru 0x00ec87 (0xc985 bytes) 000590 1788942690.310883 MIRROR_RESYNC 7 mirrors 000591 1788942691.686283 punch from 0x017164 to 0x01e9ce (0x786b bytes) 000592 1788942691.771897 read 0x00381e thru 0x008acf (0x52b2 bytes) 000593 1788942691.782583 mapread 0x004ec3 thru 0x005e08 (0xf46 bytes) 000594 1788942691.783855 mapread 0x017f0a thru 0x01a846 (0x293d bytes) 000595 1788942691.810258 mapwrite 0x0289a8 thru 0x02e6b0 (0x5d09 bytes) 000597 1788942691.943145 trunc from 0x02e6b1 to 0x022eaf (0xb801 bytes) 000599 1788942691.963778 mapwrite 0x00d748 thru 0x011022 (0x38db bytes) 000600 1788942692.047288 write 0x01e51b thru 0x029b2c (0xb612 bytes) 000602 1788942692.058869 mapwrite 0x00ea40 thru 0x01728c (0x884d bytes) 000603 1788942692.157885 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x29b2d): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29b2d): Mirror 2: 0xbbcb53c2 (stale) Mirror 6: 0xbbcb53c2 (stale) Mirror 7: 0xbbcb53c2 (stale) Mirror 8: 0xbbcb53c2 (stale) Mirror 9: 0xbbcb53c2 (stale) Mirror 10: 0xbbcb53c2 (stale) CRC-32 checksum value for chunk [0, 0x29b2d): Mirror 1: 0x1eb0b333 Mirror 11: 0x1eb0b333 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29b2d: skipped 000607 1788942693.413108 trunc from 0x029b2d to 0x03cd99 (0x1326d bytes) 000609 1788942693.574191 read 0x03809a thru 0x03cd99 (0x4d00 bytes) 000612 1788942693.584638 trunc from 0x03cd9a to 0x03890c (0x448d bytes) 000614 1788942693.617609 mapwrite 0x038640 thru 0x03ffff (0x79c0 bytes) 000617 1788942693.737921 mapread 0x003c82 thru 0x0091a1 (0x5520 bytes) 000618 1788942693.752283 MIRROR_RESYNC 8 mirrors 000619 1788942696.933647 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) 000620 1788942697.509523 read 0x01daa4 thru 0x026854 (0x8db1 bytes) 000621 1788942697.521947 mapread 0x01260e thru 0x01ba33 (0x9426 bytes) 000623 1788942697.565490 trunc from 0x040000 to 0x03ddd9 (0x2226 bytes) 000624 1788942697.732567 MIRROR_RESYNC 7 mirrors 000626 1788942701.225734 punch from 0x01946f to 0x01a1c0 (0xd52 bytes) 000627 1788942701.304487 read 0x004607 thru 0x00a8c2 (0x62bc bytes) 000628 1788942701.313054 write 0x0354dc thru 0x03ad5a (0x587f bytes) 000629 1788942701.334018 trunc from 0x03ddda to 0x0317ca (0xc60f bytes) 000630 1788942701.367731 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x317cb): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x317cb): Mirror 2: 0x912b52ad (stale) Mirror 6: 0x912b52ad (stale) Mirror 8: 0x912b52ad (stale) Mirror 9: 0x912b52ad (stale) Mirror 10: 0x912b52ad (stale) Mirror 11: 0x912b52ad (stale) CRC-32 checksum value for chunk [0, 0x317cb): Mirror 1: 0x912b52ad Mirror 12: 0x912b52ad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x317cb: skipped 000634 1788942702.863854 write 0x00f61a thru 0x015be7 (0x65ce bytes) 000636 1788942703.015784 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x317cb): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x317cb): Mirror 2: 0x912b52ad (stale) Mirror 6: 0x912b52ad (stale) Mirror 8: 0x912b52ad (stale) Mirror 9: 0x912b52ad (stale) Mirror 10: 0x912b52ad (stale) Mirror 11: 0x912b52ad (stale) Mirror 12: 0x912b52ad (stale) CRC-32 checksum value for chunk [0, 0x317cb): Mirror 1: 0xb4ecb536 Mirror 13: 0xb4ecb536 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x317cb: skipped 000639 1788942704.502650 mapwrite 0x003462 thru 0x0106ea (0xd289 bytes) 000640 1788942704.814744 write 0x03322d thru 0x03ffff (0xcdd3 bytes) 000641 1788942704.818815 read 0x03a5f4 thru 0x03ce44 (0x2851 bytes) 000642 1788942704.821359 write 0x02c5f3 thru 0x030b2b (0x4539 bytes) 000646 1788942704.868372 MIRROR_RESYNC 9 mirrors 000647 1788942708.990649 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) 000648 1788942709.670635 punch from 0x00a07b to 0x00fb1a (0x5aa0 bytes) 000650 1788942709.772695 read 0x0011f2 thru 0x0034ae (0x22bd bytes) 000653 1788942709.784961 MIRROR_RESYNC 8 mirrors 000654 1788942713.627803 write 0x0375c7 thru 0x03cb1a (0x5554 bytes) 000655 1788942713.700579 mapwrite 0x032c8a thru 0x03ffff (0xd376 bytes) 000657 1788942713.831597 write 0x02dcbf thru 0x033747 (0x5a89 bytes) 000658 1788942713.836909 read 0x03d2ae thru 0x03ffff (0x2d52 bytes) 000659 1788942713.838080 read 0x02e8ac thru 0x03afa5 (0xc6fa bytes) 000661 1788942713.840596 write 0x00b046 thru 0x00c962 (0x191d bytes) 000666 1788942713.857265 mapwrite 0x01a7a3 thru 0x01ca98 (0x22f6 bytes) 000667 1788942713.938982 write 0x02086c thru 0x0263df (0x5b74 bytes) 000668 1788942713.940725 punch from 0x037e19 to 0x03dbc1 (0x5da9 bytes) 000669 1788942713.956922 mapread 0x00e53f thru 0x018dc4 (0xa886 bytes) 000670 1788942713.958589 mapwrite 0x029a8c thru 0x033a34 (0x9fa9 bytes) 000672 1788942714.095263 read 0x0054e5 thru 0x005598 (0xb4 bytes) 000673 1788942714.095887 read 0x025192 thru 0x0315ac (0xc41b bytes) 000675 1788942714.100300 mapread 0x0117cd thru 0x01860c (0x6e40 bytes) 000676 1788942714.102319 mapread 0x03dee6 thru 0x03ffff (0x211a bytes) 000677 1788942714.126965 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe6996862 (stale) Mirror 6: 0xe6996862 (stale) Mirror 8: 0xe6996862 (stale) Mirror 9: 0xe6996862 (stale) Mirror 11: 0xe6996862 (stale) Mirror 12: 0xe6996862 (stale) Mirror 13: 0xe6996862 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xac690b2d Mirror 14: 0xac690b2d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000679 1788942715.484334 mapwrite 0x004681 thru 0x00f35f (0xacdf bytes) 000680 1788942715.779312 mapwrite 0x01e7de thru 0x027751 (0x8f74 bytes) 000681 1788942715.912647 write 0x00eae0 thru 0x01cc74 (0xe195 bytes) 000682 1788942715.914515 mapread 0x015e54 thru 0x01eeef (0x909c bytes) 000683 1788942715.924540 read 0x003717 thru 0x00bc0b (0x84f5 bytes) 000684 1788942715.929370 punch from 0x018388 to 0x01aa7d (0x26f6 bytes) 000686 1788942715.993975 read 0x016747 thru 0x01f98e (0x9248 bytes) 000687 1788942716.026572 punch from 0x01b3f4 to 0x026d85 (0xb992 bytes) 000688 1788942716.038049 read 0x01fc5c thru 0x027747 (0x7aec bytes) 000689 1788942716.063094 MIRROR_RESYNC 9 mirrors 000690 1788942720.210473 mapread 0x012b93 thru 0x019d4a (0x71b8 bytes) 000691 1788942720.229704 read 0x03ff7f thru 0x03ffff (0x81 bytes) 000694 1788942720.233511 read 0x013dfe thru 0x01ef69 (0xb16c bytes) 000696 1788942720.243759 read 0x0034e7 thru 0x013410 (0xff2a bytes) 000698 1788942720.245143 read 0x038fe9 thru 0x03ec50 (0x5c68 bytes) 000699 1788942720.245634 punch from 0x02840c to 0x032cd7 (0xa8cc bytes) 000700 1788942720.353206 punch from 0x038bf1 to 0x03ffff (0x740f bytes) 000701 1788942720.359781 mapread 0x0075b9 thru 0x011fbc (0xaa04 bytes) 000703 1788942720.384845 write 0x01bd3d thru 0x022b59 (0x6e1d bytes) 000704 1788942720.386085 trunc from 0x040000 to 0x00039e (0x3fc61 bytes) 000706 1788942720.461982 write 0x012004 thru 0x019b84 (0x7b81 bytes) 000708 1788942720.472289 mapwrite 0x01a601 thru 0x01dc2a (0x362a bytes) 000709 1788942720.657051 write 0x01007f thru 0x01d59f (0xd521 bytes) 000710 1788942720.689105 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x1dc2b): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1dc2b): Mirror 2: 0x42dacc98 (stale) Mirror 6: 0x42dacc98 (stale) Mirror 8: 0x42dacc98 (stale) Mirror 9: 0x42dacc98 (stale) Mirror 11: 0x42dacc98 (stale) Mirror 12: 0x42dacc98 (stale) Mirror 13: 0x42dacc98 (stale) Mirror 14: 0x42dacc98 (stale) CRC-32 checksum value for chunk [0, 0x1dc2b): Mirror 1: 0x87d7fc31 Mirror 15: 0x87d7fc31 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1dc2b: skipped 000711 1788942721.991945 read 0x018a7d thru 0x01ae85 (0x2409 bytes) 000712 1788942722.016247 mapread 0x00ac8e thru 0x01a302 (0xf675 bytes) 000713 1788942722.103612 mapwrite 0x01a2b9 thru 0x028a59 (0xe7a1 bytes) 000715 1788942722.243122 punch from 0x0245e3 to 0x0260c0 (0x1ade bytes) 000716 1788942722.251605 mapread 0x0203fe thru 0x02725c (0x6e5f bytes) 000718 1788942722.260215 punch from 0x015122 to 0x0223a2 (0xd281 bytes) 000720 1788942722.267242 write 0x000371 thru 0x0050d4 (0x4d64 bytes) 000721 1788942722.294000 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x28a5a): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28a5a): Mirror 2: 0x24976eec (stale) Mirror 6: 0x24976eec (stale) Mirror 8: 0x24976eec (stale) Mirror 9: 0x24976eec (stale) Mirror 11: 0x24976eec (stale) Mirror 12: 0x24976eec (stale) Mirror 13: 0x24976eec (stale) Mirror 14: 0x24976eec (stale) Mirror 15: 0xa03a56e8 (stale) CRC-32 checksum value for chunk [0, 0x28a5a): Mirror 1: 0xac885200 Mirror 16: 0xac885200 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28a5a: skipped 000722 1788942723.636043 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x28a5a): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28a5a): Mirror 2: 0x24976eec (stale) Mirror 6: 0x24976eec (stale) Mirror 8: 0x24976eec (stale) Mirror 9: 0x24976eec (stale) Mirror 11: 0x24976eec (stale) Mirror 12: 0x24976eec (stale) Mirror 13: 0x24976eec (stale) Mirror 14: 0x24976eec (stale) Mirror 15: 0xa03a56e8 (stale) CRC-32 checksum value for chunk [0, 0x28a5a): Mirror 1: 0xac885200 Mirror 16: 0xac885200 Mirror 17: 0xac885200 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28a5a: skipped 000723 1788942725.352287 punch from 0x00b68d to 0x019473 (0xdde7 bytes) 000724 1788942725.545654 mapread 0x01e177 thru 0x028a59 (0xa8e3 bytes) 000725 1788942725.627938 read 0x007236 thru 0x00ef4b (0x7d16 bytes) 000727 1788942725.644639 trunc from 0x028a5a to 0x037dd5 (0xf37c bytes) 000728 1788942725.707563 punch from 0x0204e9 to 0x0234ce (0x2fe6 bytes) 000729 1788942725.713195 trunc from 0x037dd6 to 0x033f91 (0x3e44 bytes) 000730 1788942725.734448 mapwrite 0x03c55f thru 0x03ffff (0x3aa1 bytes) 000731 1788942725.861743 write 0x0354fa thru 0x03b4a0 (0x5fa7 bytes) 000732 1788942725.870890 MIRROR_SPLIT mirror 10 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xaf6a536e (stale) Mirror 6: 0xaf6a536e (stale) Mirror 8: 0xaf6a536e (stale) Mirror 9: 0xaf6a536e (stale) Mirror 11: 0xaf6a536e (stale) Mirror 12: 0xaf6a536e (stale) Mirror 13: 0xaf6a536e (stale) Mirror 14: 0xaf6a536e (stale) Mirror 15: 0xe888c98c (stale) Mirror 17: 0xdf2a520f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xaf6a536e (stale) Mirror 6: 0xaf6a536e (stale) Mirror 8: 0xaf6a536e (stale) Mirror 9: 0xaf6a536e (stale) Mirror 11: 0xaf6a536e (stale) Mirror 12: 0xaf6a536e (stale) Mirror 13: 0xaf6a536e (stale) Mirror 14: 0xaf6a536e (stale) Mirror 15: 0xe888c98c (stale) Mirror 17: 0xdf2a520f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000733 1788942726.700884 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xaf6a536e (stale) Mirror 6: 0xaf6a536e (stale) Mirror 9: 0xaf6a536e (stale) Mirror 11: 0xaf6a536e (stale) Mirror 12: 0xaf6a536e (stale) Mirror 13: 0xaf6a536e (stale) Mirror 14: 0xaf6a536e (stale) Mirror 15: 0xe888c98c (stale) Mirror 17: 0xdf2a520f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xaf6a536e (stale) Mirror 6: 0xaf6a536e (stale) Mirror 9: 0xaf6a536e (stale) Mirror 11: 0xaf6a536e (stale) Mirror 12: 0xaf6a536e (stale) Mirror 13: 0xaf6a536e (stale) Mirror 14: 0xaf6a536e (stale) Mirror 15: 0xe888c98c (stale) Mirror 17: 0xdf2a520f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000734 1788942727.328869 mapwrite 0x033d25 thru 0x03cc7e (0x8f5a bytes) 000735 1788942727.426001 mapwrite 0x01e592 thru 0x02397b (0x53ea bytes) 000736 1788942727.519183 read 0x02aab2 thru 0x031d55 (0x72a4 bytes) 000737 1788942727.532792 trunc from 0x040000 to 0x0359f9 (0xa606 bytes) 000738 1788942727.551878 write 0x00f512 thru 0x011d2e (0x281d bytes) 000739 1788942727.562858 write 0x004967 thru 0x008477 (0x3b11 bytes) 000740 1788942727.574343 mapwrite 0x03009c thru 0x035046 (0x4fab bytes) 000741 1788942727.640977 mapread 0x018208 thru 0x021041 (0x8e3a bytes) 000742 1788942727.642310 read 0x024f16 thru 0x027bf4 (0x2cdf bytes) 000743 1788942727.654905 read 0x00e4a1 thru 0x01cc7b (0xe7db bytes) 000744 1788942727.656333 mapwrite 0x039df0 thru 0x03ffff (0x6210 bytes) 000746 1788942727.764495 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xaf6a536e (stale) Mirror 6: 0xaf6a536e (stale) Mirror 9: 0xaf6a536e (stale) Mirror 11: 0xaf6a536e (stale) Mirror 12: 0xaf6a536e (stale) Mirror 13: 0xaf6a536e (stale) Mirror 14: 0xaf6a536e (stale) Mirror 15: 0xe888c98c (stale) Mirror 17: 0xdf2a520f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6034bd5c Mirror 18: 0x6034bd5c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000747 1788942729.670242 trunc from 0x040000 to 0x0293ae (0x16c51 bytes) 000748 1788942729.858863 mapread 0x005c7e thru 0x011180 (0xb503 bytes) 000749 1788942729.885216 write 0x0132ac thru 0x020c22 (0xd977 bytes) 000753 1788942729.900453 MIRROR_RESYNC 11 mirrors 000754 1788942733.197437 mapread 0x00717d thru 0x014c13 (0xda97 bytes) 000755 1788942733.224820 read 0x01d870 thru 0x0263f3 (0x8b84 bytes) 000756 1788942733.235879 MIRROR_RESYNC 11 mirrors 000757 1788942734.125284 punch from 0x00fa7f to 0x01e1e9 (0xe76b bytes) 000758 1788942734.240620 mapread 0x007279 thru 0x015427 (0xe1af bytes) 000759 1788942734.267209 write 0x01eacf thru 0x02a7b2 (0xbce4 bytes) 000760 1788942734.272528 mapread 0x001ac2 thru 0x003db6 (0x22f5 bytes) 000761 1788942734.279003 write 0x0176a4 thru 0x023262 (0xbbbf bytes) 000766 1788942734.284252 trunc from 0x02a7b3 to 0x0243a4 (0x640e bytes) 000767 1788942734.315468 read 0x01992b thru 0x023634 (0x9d0a bytes) 000769 1788942734.317089 trunc from 0x0243a5 to 0x028ba4 (0x4800 bytes) 000770 1788942734.337358 trunc from 0x028ba5 to 0x03a209 (0x11665 bytes) 000771 1788942734.355788 punch from 0x01d8cd to 0x02a80f (0xcf43 bytes) 000773 1788942734.384147 read 0x014433 thru 0x021775 (0xd343 bytes) 000774 1788942734.392355 trunc from 0x03a20a to 0x02a87f (0xf98a bytes) 000775 1788942734.425262 read 0x029cc7 thru 0x02a87f (0xbb9 bytes) 000778 1788942734.430124 trunc from 0x02a880 to 0x001dee (0x28a91 bytes) 000779 1788942734.468331 trunc from 0x001def to 0x01e638 (0x1c84a bytes) 000780 1788942734.494313 punch from 0x00c391 to 0x015621 (0x9291 bytes) 000781 1788942734.501153 mapread 0x00bf0d thru 0x0121d9 (0x62cd bytes) 000782 1788942734.530276 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x1e639): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e639): Mirror 2: 0x36841531 (stale) Mirror 6: 0x36841531 (stale) Mirror 9: 0x36841531 (stale) Mirror 11: 0x36841531 (stale) Mirror 12: 0x36841531 (stale) Mirror 13: 0x36841531 (stale) Mirror 14: 0x36841531 (stale) Mirror 15: 0x36841531 (stale) Mirror 17: 0x36841531 (stale) Mirror 18: 0x36841531 (stale) CRC-32 checksum value for chunk [0, 0x1e639): Mirror 1: 0xd4d9c06 Mirror 19: 0xd4d9c06 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e639: skipped 000783 1788942736.638622 read 0x00e59e thru 0x01067f (0x20e2 bytes) 000785 1788942736.682303 write 0x03d592 thru 0x03ffff (0x2a6e bytes) 000786 1788942736.878378 read 0x00cf18 thru 0x014ccc (0x7db5 bytes) 000787 1788942736.891804 mapwrite 0x01e17d thru 0x029f8a (0xbe0e bytes) 000788 1788942736.964352 punch from 0x01f49a to 0x02047b (0xfe2 bytes) 000790 1788942736.973248 trunc from 0x040000 to 0x02210c (0x1def3 bytes) 000793 1788942737.002328 mapwrite 0x01af07 thru 0x02460f (0x9709 bytes) 000794 1788942737.103099 read 0x0039ca thru 0x01017e (0xc7b5 bytes) 000795 1788942737.103834 mapread 0x01b8e1 thru 0x02460f (0x8d2f bytes) 000796 1788942737.112211 MIRROR_RESYNC 12 mirrors 000797 1788942741.452116 mapread 0x016082 thru 0x02460f (0xe58e bytes) 000798 1788942741.497128 read 0x01ec2c thru 0x02460f (0x59e4 bytes) 000800 1788942741.499430 mapwrite 0x00cb00 thru 0x011a5f (0x4f60 bytes) 000801 1788942741.736886 MIRROR_SPLIT mirror 8 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24610): Mirror 2: 0xc45bebdc (stale) Mirror 6: 0xc45bebdc (stale) Mirror 9: 0xc45bebdc (stale) Mirror 11: 0xc45bebdc (stale) Mirror 12: 0xc45bebdc (stale) Mirror 13: 0xc45bebdc (stale) Mirror 14: 0xc45bebdc (stale) Mirror 17: 0xc45bebdc (stale) Mirror 18: 0xc45bebdc (stale) Mirror 19: 0xc45bebdc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24610): Mirror 2: 0xc45bebdc (stale) Mirror 6: 0xc45bebdc (stale) Mirror 9: 0xc45bebdc (stale) Mirror 11: 0xc45bebdc (stale) Mirror 12: 0xc45bebdc (stale) Mirror 13: 0xc45bebdc (stale) Mirror 14: 0xc45bebdc (stale) Mirror 17: 0xc45bebdc (stale) Mirror 18: 0xc45bebdc (stale) Mirror 19: 0xc45bebdc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24610: skipped 000802 1788942742.433815 mapwrite 0x03bd15 thru 0x03e49f (0x278b bytes) 000803 1788942742.522692 mapwrite 0x00f0db thru 0x00f908 (0x82e bytes) 000804 1788942742.576514 write 0x01a50d thru 0x025ff7 (0xbaeb bytes) 000806 1788942742.591964 write 0x00bffa thru 0x01436a (0x8371 bytes) 000807 1788942742.594057 read 0x020eae thru 0x0250cf (0x4222 bytes) 000809 1788942742.596200 mapread 0x02b1ce thru 0x03230d (0x7140 bytes) 000810 1788942742.606018 punch from 0x034e50 to 0x03e49f (0x9650 bytes) 000811 1788942742.626268 read 0x038aad thru 0x0399b2 (0xf06 bytes) 000813 1788942742.639661 mapwrite 0x0169ff thru 0x024b91 (0xe193 bytes) 000815 1788942742.705331 read 0x03821f thru 0x03e49f (0x6281 bytes) 000816 1788942742.709085 punch from 0x0068f0 to 0x00afab (0x46bc bytes) 000819 1788942742.717713 punch from 0x01cf7a to 0x029c67 (0xccee bytes) 000820 1788942742.724170 write 0x026e75 thru 0x03365b (0xc7e7 bytes) 000821 1788942742.736414 write 0x0116f6 thru 0x016308 (0x4c13 bytes) 000822 1788942742.738986 read 0x0387e2 thru 0x03c01c (0x383b bytes) 000825 1788942742.741302 write 0x023d28 thru 0x0244ac (0x785 bytes) 000826 1788942742.743178 read 0x01710f thru 0x01b4d9 (0x43cb bytes) 000827 1788942742.744481 mapread 0x01188c thru 0x01908d (0x7802 bytes) 000828 1788942742.746229 punch from 0x00a646 to 0x015a97 (0xb452 bytes) 000829 1788942742.764641 mapread 0x008926 thru 0x00968f (0xd6a bytes) 000830 1788942742.766472 mapread 0x0235ca thru 0x02b126 (0x7b5d bytes) 000831 1788942742.768291 mapread 0x022f25 thru 0x0269e2 (0x3abe bytes) 000832 1788942742.770692 mapwrite 0x032525 thru 0x0390f8 (0x6bd4 bytes) 000833 1788942742.838847 write 0x01a4df thru 0x0221b3 (0x7cd5 bytes) 000835 1788942742.842117 mapwrite 0x018939 thru 0x01b754 (0x2e1c bytes) 000836 1788942742.928113 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x3e4a0): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e4a0): Mirror 2: 0xfce6a1ea (stale) Mirror 6: 0xfce6a1ea (stale) Mirror 9: 0xfce6a1ea (stale) Mirror 11: 0xfce6a1ea (stale) Mirror 12: 0xfce6a1ea (stale) Mirror 13: 0xfce6a1ea (stale) Mirror 14: 0xfce6a1ea (stale) Mirror 17: 0xfce6a1ea (stale) Mirror 18: 0xfce6a1ea (stale) Mirror 19: 0xfce6a1ea (stale) CRC-32 checksum value for chunk [0, 0x3e4a0): Mirror 1: 0x5578c66d Mirror 20: 0x5578c66d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e4a0: skipped 000837 1788942744.684254 read 0x001bfc thru 0x00c4ad (0xa8b2 bytes) 000838 1788942744.726426 read 0x01b625 thru 0x023b2e (0x850a bytes) 000839 1788942744.783181 read 0x02d4e2 thru 0x0313df (0x3efe bytes) 000840 1788942744.791486 write 0x002a6f thru 0x00a33c (0x78ce bytes) 000842 1788942745.014619 MIRROR_SPLIT mirror 10 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e4a0): Mirror 2: 0xfce6a1ea (stale) Mirror 6: 0xfce6a1ea (stale) Mirror 9: 0xfce6a1ea (stale) Mirror 11: 0xfce6a1ea (stale) Mirror 12: 0xfce6a1ea (stale) Mirror 13: 0xfce6a1ea (stale) Mirror 14: 0xfce6a1ea (stale) Mirror 17: 0xfce6a1ea (stale) Mirror 18: 0xfce6a1ea (stale) Mirror 20: 0x5578c66d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e4a0): Mirror 2: 0xfce6a1ea (stale) Mirror 6: 0xfce6a1ea (stale) Mirror 9: 0xfce6a1ea (stale) Mirror 11: 0xfce6a1ea (stale) Mirror 12: 0xfce6a1ea (stale) Mirror 13: 0xfce6a1ea (stale) Mirror 14: 0xfce6a1ea (stale) Mirror 17: 0xfce6a1ea (stale) Mirror 18: 0xfce6a1ea (stale) Mirror 20: 0x5578c66d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e4a0: skipped 000843 1788942746.038079 trunc from 0x03e4a0 to 0x00ccc9 (0x317d6 bytes) 000844 1788942746.065859 read 0x0003f1 thru 0x00786b (0x747b bytes) 000847 1788942746.077852 mapwrite 0x03e6df thru 0x03ffff (0x1921 bytes) 000850 1788942746.209961 mapwrite 0x01cdcc thru 0x027b06 (0xad3b bytes) 000851 1788942746.403424 mapwrite 0x00a188 thru 0x011589 (0x7402 bytes) 000853 1788942746.546087 write 0x0280df thru 0x0351e7 (0xd109 bytes) 000854 1788942746.554077 write 0x03b8a5 thru 0x03ffff (0x475b bytes) 000856 1788942746.563220 punch from 0x00d76b to 0x017055 (0x98eb bytes) 000857 1788942746.603327 read 0x0122f4 thru 0x01e090 (0xbd9d bytes) 000859 1788942746.627368 mapwrite 0x009993 thru 0x00c5e7 (0x2c55 bytes) 000861 1788942746.722833 mapwrite 0x01b392 thru 0x0265ea (0xb259 bytes) 000864 1788942746.780016 trunc from 0x040000 to 0x00b1ba (0x34e45 bytes) 000866 1788942746.807479 read 0x008f83 thru 0x00b1ba (0x2238 bytes) 000867 1788942746.808067 read 0x006ca2 thru 0x00b1ba (0x4519 bytes) 000869 1788942746.813795 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xb1bb): Mirror 2: 0xbee1744d (stale) Mirror 6: 0xbee1744d (stale) Mirror 9: 0xbee1744d (stale) Mirror 11: 0xbee1744d (stale) Mirror 12: 0xbee1744d (stale) Mirror 14: 0xbee1744d (stale) Mirror 17: 0xbee1744d (stale) Mirror 18: 0xbee1744d (stale) Mirror 20: 0xbee1744d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb1bb): Mirror 2: 0xbee1744d (stale) Mirror 6: 0xbee1744d (stale) Mirror 9: 0xbee1744d (stale) Mirror 11: 0xbee1744d (stale) Mirror 12: 0xbee1744d (stale) Mirror 14: 0xbee1744d (stale) Mirror 17: 0xbee1744d (stale) Mirror 18: 0xbee1744d (stale) Mirror 20: 0xbee1744d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb1bb: skipped 000870 1788942747.265968 write 0x033fb9 thru 0x03ffff (0xc047 bytes) 000871 1788942747.273067 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x9e62d516 (stale) Mirror 6: 0x9e62d516 (stale) Mirror 9: 0x9e62d516 (stale) Mirror 11: 0x9e62d516 (stale) Mirror 12: 0x9e62d516 (stale) Mirror 14: 0x9e62d516 (stale) Mirror 17: 0x9e62d516 (stale) Mirror 18: 0x9e62d516 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x9e62d516 (stale) Mirror 6: 0x9e62d516 (stale) Mirror 9: 0x9e62d516 (stale) Mirror 11: 0x9e62d516 (stale) Mirror 12: 0x9e62d516 (stale) Mirror 14: 0x9e62d516 (stale) Mirror 17: 0x9e62d516 (stale) Mirror 18: 0x9e62d516 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000872 1788942747.910655 mapwrite 0x025ae8 thru 0x0314be (0xb9d7 bytes) 000873 1788942748.030981 mapwrite 0x025bd2 thru 0x02fb13 (0x9f42 bytes) 000874 1788942748.103725 mapread 0x026851 thru 0x0296a4 (0x2e54 bytes) 000876 1788942748.106690 trunc from 0x040000 to 0x024ec2 (0x1b13d bytes) 000877 1788942748.140566 punch from 0x01538c to 0x01e4b7 (0x912c bytes) 000880 1788942748.148338 trunc from 0x024ec3 to 0x02116e (0x3d54 bytes) 000881 1788942748.190298 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2116f): Mirror 2: 0x301543b5 (stale) Mirror 6: 0x301543b5 (stale) Mirror 9: 0x301543b5 (stale) Mirror 11: 0x301543b5 (stale) Mirror 14: 0x301543b5 (stale) Mirror 17: 0x301543b5 (stale) Mirror 18: 0x301543b5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2116f): Mirror 2: 0x301543b5 (stale) Mirror 6: 0x301543b5 (stale) Mirror 9: 0x301543b5 (stale) Mirror 11: 0x301543b5 (stale) Mirror 14: 0x301543b5 (stale) Mirror 17: 0x301543b5 (stale) Mirror 18: 0x301543b5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2116f: skipped 000882 1788942748.725345 trunc from 0x02116f to 0x00b844 (0x1592a bytes) 000884 1788942748.751420 read 0x0051b2 thru 0x00a142 (0x4f91 bytes) 000887 1788942748.761180 mapread 0x0014eb thru 0x00b6ff (0xa215 bytes) 000889 1788942748.782179 read 0x009742 thru 0x00b844 (0x2103 bytes) 000890 1788942748.783023 trunc from 0x00b845 to 0x00598d (0x5eb7 bytes) 000891 1788942748.801209 write 0x0284f7 thru 0x037a56 (0xf560 bytes) 000892 1788942748.804706 mapread 0x010c09 thru 0x018d04 (0x80fc bytes) 000893 1788942748.813051 read 0x01b4bd thru 0x01b828 (0x36c bytes) 000894 1788942748.818154 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37a57): Mirror 2: 0xdfb1a439 (stale) Mirror 6: 0xdfb1a439 (stale) Mirror 9: 0xdfb1a439 (stale) Mirror 14: 0xdfb1a439 (stale) Mirror 17: 0xdfb1a439 (stale) Mirror 18: 0xdfb1a439 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37a57): Mirror 2: 0xdfb1a439 (stale) Mirror 6: 0xdfb1a439 (stale) Mirror 9: 0xdfb1a439 (stale) Mirror 14: 0xdfb1a439 (stale) Mirror 17: 0xdfb1a439 (stale) Mirror 18: 0xdfb1a439 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37a57: skipped 000895 1788942749.366873 mapwrite 0x0050b2 thru 0x011a43 (0xc992 bytes) 000899 1788942749.497999 punch from 0x00fc0a to 0x01ee4a (0xf241 bytes) 000900 1788942749.505383 read 0x029fcd thru 0x02c2a6 (0x22da bytes) 000901 1788942749.513606 mapwrite 0x03f7c7 thru 0x03ffff (0x839 bytes) 000902 1788942749.597860 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x9e62d516 (stale) Mirror 6: 0x9e62d516 (stale) Mirror 9: 0x9e62d516 (stale) Mirror 14: 0x9e62d516 (stale) Mirror 17: 0x9e62d516 (stale) Mirror 18: 0x9e62d516 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf97a202b Mirror 19: 0xf97a202b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000906 1788942751.079517 mapread 0x03bdf0 thru 0x03d37e (0x158f bytes) 000908 1788942751.124525 mapread 0x0203b1 thru 0x024c67 (0x48b7 bytes) 000910 1788942751.163377 punch from 0x00d87d to 0x01cfcf (0xf753 bytes) 000911 1788942751.283367 write 0x03e112 thru 0x03ffff (0x1eee bytes) 000912 1788942751.305051 mapwrite 0x027b4b thru 0x029e26 (0x22dc bytes) 000913 1788942751.509608 mapwrite 0x007487 thru 0x00fe39 (0x89b3 bytes) 000916 1788942751.653274 write 0x0261c6 thru 0x02d851 (0x768c bytes) 000917 1788942751.663712 mapread 0x03b41d thru 0x03da4d (0x2631 bytes) 000918 1788942751.685121 punch from 0x01f48e to 0x02a337 (0xaeaa bytes) 000919 1788942751.731320 write 0x007c58 thru 0x01384d (0xbbf6 bytes) 000920 1788942751.751864 punch from 0x03395b to 0x039bc4 (0x626a bytes) 000921 1788942751.790074 mapwrite 0x02c654 thru 0x038a68 (0xc415 bytes) 000922 1788942751.967681 mapwrite 0x00082b thru 0x002cdc (0x24b2 bytes) 000924 1788942752.046288 trunc from 0x040000 to 0x009e6c (0x36193 bytes) 000926 1788942752.096153 mapwrite 0x0083d3 thru 0x00bcb5 (0x38e3 bytes) 000927 1788942752.256693 trunc from 0x00bcb6 to 0x01748b (0xb7d6 bytes) 000928 1788942752.282518 read 0x0045c8 thru 0x0084cd (0x3f06 bytes) 000929 1788942752.284177 write 0x03a5b5 thru 0x03ffff (0x5a4b bytes) 000931 1788942752.286578 mapwrite 0x013340 thru 0x01feba (0xcb7b bytes) 000933 1788942752.389000 read 0x038fcd thru 0x03ffff (0x7033 bytes) 000934 1788942752.407965 write 0x032c1e thru 0x032eea (0x2cd bytes) 000935 1788942752.408926 mapread 0x00604b thru 0x0069c5 (0x97b bytes) 000936 1788942752.409801 trunc from 0x040000 to 0x023613 (0x1c9ec bytes) 000938 1788942752.448136 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x23614): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23614): Mirror 2: 0x7438ede9 (stale) Mirror 6: 0x7438ede9 (stale) Mirror 9: 0x7438ede9 (stale) Mirror 14: 0x7438ede9 (stale) Mirror 17: 0x7438ede9 (stale) Mirror 18: 0x7438ede9 (stale) Mirror 19: 0xc4fc922c (stale) CRC-32 checksum value for chunk [0, 0x23614): Mirror 1: 0x1acb0029 Mirror 20: 0x1acb0029 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23614: skipped 000940 1788942754.396668 mapread 0x00a905 thru 0x013cf3 (0x93ef bytes) 000941 1788942754.446366 read 0x023142 thru 0x023613 (0x4d2 bytes) 000942 1788942754.484009 punch from 0x01afa6 to 0x022af9 (0x7b54 bytes) 000943 1788942754.693659 punch from 0x01de54 to 0x023613 (0x57c0 bytes) 000944 1788942754.699319 punch from 0x014c7c to 0x0152cb (0x650 bytes) 000945 1788942754.704611 trunc from 0x023614 to 0x01e518 (0x50fb bytes) 000946 1788942754.728218 punch from 0x018bba to 0x01e518 (0x595f bytes) 000947 1788942754.732799 trunc from 0x01e519 to 0x018a67 (0x5ab1 bytes) 000948 1788942754.752210 read 0x00656a thru 0x009736 (0x31cd bytes) 000949 1788942754.762704 trunc from 0x018a68 to 0x012cba (0x5dad bytes) 000950 1788942754.779773 mapwrite 0x03a8fa thru 0x03ffff (0x5706 bytes) 000951 1788942754.853042 mapread 0x0246b2 thru 0x03145d (0xcdac bytes) 000953 1788942754.855331 write 0x001438 thru 0x00f5d8 (0xe1a1 bytes) 000955 1788942754.859255 mapread 0x01076b thru 0x01e39c (0xdc32 bytes) 000956 1788942754.884820 write 0x03eaca thru 0x03ffff (0x1536 bytes) 000957 1788942754.885766 mapwrite 0x0259b8 thru 0x029754 (0x3d9d bytes) 000959 1788942754.944334 trunc from 0x040000 to 0x01c123 (0x23edc bytes) 000960 1788942754.963302 write 0x01ec6e thru 0x021c9d (0x3030 bytes) 000961 1788942754.965903 punch from 0x00dcb1 to 0x0195d6 (0xb926 bytes) 000963 1788942754.979571 mapwrite 0x03b502 thru 0x03fbf2 (0x46f1 bytes) 000964 1788942755.090059 mapread 0x02b271 thru 0x03a0af (0xee3f bytes) 000965 1788942755.244273 MIRROR_RESYNC 9 mirrors 000966 1788942759.096950 punch from 0x02f869 to 0x03ac43 (0xb3db bytes) 000967 1788942759.169309 trunc from 0x03fbf3 to 0x01efd1 (0x20c21 bytes) 000968 1788942759.181057 trunc from 0x01efd2 to 0x02141f (0x244e bytes) 000970 1788942759.194113 MIRROR_RESYNC 9 mirrors 000971 1788942762.221623 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1a2:0x0]: Invalid argument (22) 000972 1788942762.719735 write 0x02c8f6 thru 0x02d2c1 (0x9cc bytes) 000973 1788942762.788294 mapwrite 0x02bc5e thru 0x03711b (0xb4be bytes) 000975 1788942762.945615 read 0x0118a9 thru 0x0148b8 (0x3010 bytes) 000976 1788942762.954646 trunc from 0x03711c to 0x03cbcf (0x5ab4 bytes) 000978 1788942762.985972 write 0x0238cb thru 0x032862 (0xef98 bytes) 000979 1788942763.005263 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3cbd0): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cbd0): Mirror 2: 0x2a0a7eaa (stale) Mirror 6: 0x2a0a7eaa (stale) Mirror 14: 0x2a0a7eaa (stale) Mirror 17: 0x2a0a7eaa (stale) Mirror 18: 0x2a0a7eaa (stale) Mirror 19: 0x2a0a7eaa (stale) Mirror 20: 0x2a0a7eaa (stale) CRC-32 checksum value for chunk [0, 0x3cbd0): Mirror 1: 0xc9a504a7 Mirror 21: 0xc9a504a7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cbd0: skipped 000980 1788942764.832222 mapwrite 0x00a25e thru 0x011522 (0x72c5 bytes) 000981 1788942765.036091 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3cbd0): Mirror 2: (stale - read error) Mirror 6: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cbd0): Mirror 2: 0x2a0a7eaa (stale) Mirror 6: 0x2a0a7eaa (stale) Mirror 14: 0x2a0a7eaa (stale) Mirror 17: 0x2a0a7eaa (stale) Mirror 18: 0x2a0a7eaa (stale) Mirror 19: 0x2a0a7eaa (stale) Mirror 20: 0x2a0a7eaa (stale) Mirror 21: 0xc9a504a7 (stale) CRC-32 checksum value for chunk [0, 0x3cbd0): Mirror 1: 0x7645f465 Mirror 22: 0x7645f465 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cbd0: skipped 000982 1788942766.749899 read 0x022c2c thru 0x022d61 (0x136 bytes) 000983 1788942766.770222 trunc from 0x03cbd0 to 0x004e4b (0x37d84 bytes) 000984 1788942766.895048 read 0x002d09 thru 0x004e4b (0x2143 bytes) 000985 1788942766.906005 mapread 0x00467c thru 0x004e4b (0x7d0 bytes) 000987 1788942766.908220 read 0x001001 thru 0x004e4b (0x3e4b bytes) 000988 1788942766.910067 write 0x0022b7 thru 0x004b34 (0x287e bytes) 000989 1788942766.912134 read 0x000fda thru 0x004e4b (0x3e72 bytes) 000990 1788942766.913264 mapwrite 0x011768 thru 0x01e0cc (0xc965 bytes) 000992 1788942767.064405 mapread 0x00c680 thru 0x00d01f (0x9a0 bytes) 000993 1788942767.069050 write 0x0139a9 thru 0x01572c (0x1d84 bytes) 000996 1788942767.074067 punch from 0x006b08 to 0x00b3b8 (0x48b1 bytes) 000997 1788942767.088897 mapread 0x016386 thru 0x01e0cc (0x7d47 bytes) 000998 1788942767.090209 mapread 0x01b367 thru 0x01cd18 (0x19b2 bytes) 001000 1788942767.092258 trunc from 0x01e0cd to 0x01b75a (0x2972 bytes) All operations completed A-OK!