== sanity-flr test 70a: flr mode fsx test ================ 10:05:50 (1788876350) Seed set to 6352 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1788876352.693068 mapwrite 0x03260d thru 0x03cd88 (0xa77c bytes) 000002 1788876352.826015 write 0x02dd95 thru 0x036bdc (0x8e48 bytes) 000003 1788876352.828106 read 0x009d31 thru 0x0199ea (0xfcba bytes) 000004 1788876352.853099 mapwrite 0x01ee33 thru 0x02d9a5 (0xeb73 bytes) 000005 1788876353.036779 write 0x000d15 thru 0x005c79 (0x4f65 bytes) 000006 1788876353.050404 write 0x02efd1 thru 0x03c603 (0xd633 bytes) 000007 1788876353.053040 punch from 0x02d382 to 0x038d9c (0xba1b bytes) 000009 1788876353.070800 read 0x03148f thru 0x03be0d (0xa97f bytes) 000011 1788876353.086892 mapread 0x032187 thru 0x0340a2 (0x1f1c bytes) 000012 1788876353.088288 punch from 0x018aaa to 0x01e0e4 (0x563b bytes) 000016 1788876353.100491 mapwrite 0x03f0ee thru 0x03ffff (0xf12 bytes) 000018 1788876353.160746 punch from 0x00f1f5 to 0x01da6f (0xe87b bytes) truncating to largest ever: 0x3a8c6 000019 1788876353.165724 trunc from 0x040000 to 0x03a8c5 (0x573a bytes) 000021 1788876353.189838 trunc from 0x03a8c6 to 0x02fbaa (0xad1b bytes) 000022 1788876353.201101 mapwrite 0x03ad15 thru 0x03e0c2 (0x33ae bytes) 000023 1788876353.310056 punch from 0x035420 to 0x03e0c2 (0x8ca3 bytes) 000024 1788876353.318356 trunc from 0x03e0c3 to 0x037c06 (0x64bc bytes) 000026 1788876353.342589 mapwrite 0x02442d thru 0x031777 (0xd34b bytes) 000027 1788876353.390384 punch from 0x02e517 to 0x037c06 (0x96f0 bytes) 000029 1788876353.396272 read 0x0322c1 thru 0x037c06 (0x5946 bytes) 000030 1788876353.415162 trunc from 0x037c07 to 0x031623 (0x65e3 bytes) 000031 1788876353.430477 mapread 0x013b4c thru 0x014398 (0x84d bytes) 000032 1788876353.435435 write 0x0157a5 thru 0x01bb44 (0x63a0 bytes) 000035 1788876353.442187 write 0x00b3fc thru 0x00dc8a (0x288f bytes) 000036 1788876353.444364 mapread 0x024f8a thru 0x026072 (0x10e9 bytes) 000037 1788876353.446850 trunc from 0x031624 to 0x023256 (0xe3cd bytes) 000038 1788876353.466790 mapwrite 0x02bd22 thru 0x030e79 (0x5158 bytes) 000042 1788876353.553869 punch from 0x005a1a to 0x00a9a9 (0x4f90 bytes) 000044 1788876353.559186 punch from 0x019f47 to 0x023780 (0x983a bytes) 000045 1788876353.564221 mapread 0x000a96 thru 0x0070a0 (0x660b bytes) 000046 1788876353.576307 read 0x027e8f thru 0x02c5b5 (0x4727 bytes) 000047 1788876353.583605 trunc from 0x030e7a to 0x0011eb (0x2fc8e bytes) 000049 1788876353.594277 write 0x036bea thru 0x03cf51 (0x6368 bytes) 000050 1788876353.596158 trunc from 0x03cf52 to 0x013dc9 (0x29188 bytes) 000051 1788876353.610753 mapread 0x009de3 thru 0x011756 (0x7974 bytes) 000053 1788876353.669573 write 0x0067e5 thru 0x00c546 (0x5d62 bytes) 000054 1788876353.681288 trunc from 0x013dca to 0x014b10 (0xd47 bytes) 000055 1788876353.706028 read 0x0119e6 thru 0x014b10 (0x312b bytes) 000056 1788876353.724682 write 0x02d9a9 thru 0x03c2fc (0xe954 bytes) 000057 1788876353.740225 write 0x00ff21 thru 0x01e2ca (0xe3aa bytes) 000058 1788876353.767328 mapwrite 0x007eaf thru 0x01102d (0x917f bytes) 000059 1788876353.836943 mapread 0x03c0d4 thru 0x03c2fc (0x229 bytes) 000061 1788876353.837909 punch from 0x036eab to 0x03c2fc (0x5452 bytes) 000063 1788876353.842380 write 0x02acad thru 0x02bc07 (0xf5b bytes) 000064 1788876353.850218 mapwrite 0x0022a2 thru 0x00cf4d (0xacac bytes) 000065 1788876353.886584 write 0x010534 thru 0x017f79 (0x7a46 bytes) 000067 1788876353.888597 write 0x03e7f6 thru 0x03ffff (0x180a bytes) 000068 1788876353.889572 punch from 0x03e18e to 0x03ffff (0x1e72 bytes) 000069 1788876353.907550 mapwrite 0x0240ea thru 0x02b938 (0x784f bytes) 000070 1788876353.968097 mapread 0x015a5f thru 0x01daf2 (0x8094 bytes) 000071 1788876353.972451 read 0x01f2ce thru 0x02ecea (0xfa1d bytes) 000072 1788876353.973538 mapwrite 0x02477d thru 0x033526 (0xedaa bytes) 000073 1788876354.035351 punch from 0x02bd6c to 0x033419 (0x76ae bytes) 000074 1788876354.040004 punch from 0x027d0a to 0x03785f (0xfb56 bytes) 000076 1788876354.045947 read 0x01b3a5 thru 0x024257 (0x8eb3 bytes) 000077 1788876354.047170 punch from 0x0156f8 to 0x0188c9 (0x31d2 bytes) 000079 1788876354.054402 read 0x02b967 thru 0x03570c (0x9da6 bytes) 000080 1788876354.066710 read 0x01311a thru 0x01b340 (0x8227 bytes) 000081 1788876354.068206 write 0x03ba9a thru 0x03ffff (0x4566 bytes) 000082 1788876354.070048 read 0x023467 thru 0x02bd60 (0x88fa bytes) 000083 1788876354.071353 read 0x01f13a thru 0x021c44 (0x2b0b bytes) 000084 1788876354.072401 mapread 0x02aa67 thru 0x0317a8 (0x6d42 bytes) 000085 1788876354.074722 trunc from 0x040000 to 0x0009fc (0x3f603 bytes) 000086 1788876354.095065 mapread 0x000114 thru 0x0009fc (0x8e9 bytes) 000088 1788876354.096599 trunc from 0x0009fd to 0x02cd14 (0x2c318 bytes) 000090 1788876354.128394 read 0x02c4bf thru 0x02cd14 (0x856 bytes) 000091 1788876354.147391 punch from 0x01aa03 to 0x023ed9 (0x94d7 bytes) 000092 1788876354.151099 punch from 0x0076b4 to 0x01492d (0xd27a bytes) 000095 1788876354.155378 mapwrite 0x032a52 thru 0x033369 (0x918 bytes) 000096 1788876354.194303 write 0x00fe42 thru 0x016f45 (0x7104 bytes) 000097 1788876354.198467 mapread 0x0324de thru 0x033369 (0xe8c bytes) 000098 1788876354.199449 mapread 0x012fa2 thru 0x01c6ce (0x972d bytes) 000099 1788876354.211413 MIRROR_EXTEND to 2 mirrors 000100 1788876354.910496 punch from 0x00ce0b to 0x014573 (0x7769 bytes) 000103 1788876354.958005 trunc from 0x03336a to 0x0207f3 (0x12b76 bytes) 000104 1788876355.004770 write 0x034ddb thru 0x03ffff (0xb225 bytes) 000105 1788876355.021295 MIRROR_RESYNC 2 mirrors 000106 1788876355.939467 punch from 0x02f7ea to 0x03b8e7 (0xc0fe bytes) 000107 1788876356.048018 mapread 0x0130b0 thru 0x018c9f (0x5bf0 bytes) 000108 1788876356.074864 mapread 0x0338d9 thru 0x03f2b5 (0xb9dd bytes) 000109 1788876356.111374 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xd10529e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6cb52b61 Mirror 3: 0x6cb52b61 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000112 1788876356.899323 mapread 0x024223 thru 0x027884 (0x3662 bytes) 000115 1788876356.920032 trunc from 0x040000 to 0x0009a5 (0x3f65a bytes) 000116 1788876357.015254 punch from 0x0001ca to 0x0009a5 (0x7dc bytes) 000117 1788876357.031866 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x24f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x9a6): Mirror 2: 0xc5213506 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9a6): Mirror 2: 0xc5213506 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9a6: skipped 000119 1788876357.370852 read 0x00086f thru 0x0009a5 (0x137 bytes) 000120 1788876357.376896 trunc from 0x0009a6 to 0x01ef52 (0x1e5ad bytes) 000124 1788876357.396058 write 0x012eb0 thru 0x01a0b6 (0x7207 bytes) 000125 1788876357.408004 trunc from 0x01ef53 to 0x038819 (0x198c7 bytes) 000126 1788876357.425149 trunc from 0x03881a to 0x01b769 (0x1d0b0 bytes) truncating to largest ever: 0x3e5af 000128 1788876357.442677 trunc from 0x01b76a to 0x03e5ae (0x22e45 bytes) 000129 1788876357.464965 punch from 0x0109a9 to 0x016a83 (0x60db bytes) 000130 1788876357.480895 trunc from 0x03e5af to 0x038472 (0x613c bytes) 000131 1788876357.503000 read 0x022a52 thru 0x0235a1 (0xb50 bytes) 000133 1788876357.520404 trunc from 0x038473 to 0x0387b9 (0x347 bytes) 000134 1788876357.533995 read 0x037350 thru 0x0387b9 (0x146a bytes) 000135 1788876357.534883 trunc from 0x0387ba to 0x02b59f (0xd21a bytes) 000136 1788876357.557942 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x24f:0x0]: Invalid argument (22) 000138 1788876357.690956 write 0x02a314 thru 0x034707 (0xa3f4 bytes) 000139 1788876357.696171 mapread 0x02a9cc thru 0x034707 (0x9d3c bytes) 000140 1788876357.697377 write 0x03c294 thru 0x03ffff (0x3d6c bytes) 000141 1788876357.698419 write 0x032820 thru 0x03ffff (0xd7e0 bytes) 000143 1788876357.703928 trunc from 0x040000 to 0x00b51d (0x34ae2 bytes) 000144 1788876357.715698 punch from 0x004cc7 to 0x00b51d (0x6857 bytes) 000147 1788876357.720034 punch from 0x007450 to 0x00b51d (0x40ce bytes) 000149 1788876357.723471 mapread 0x00b2bc thru 0x00b51d (0x262 bytes) 000150 1788876357.727472 read 0x00a02f thru 0x00b51d (0x14ef bytes) 000151 1788876357.731834 mapwrite 0x010945 thru 0x017b1c (0x71d8 bytes) 000152 1788876357.805291 trunc from 0x017b1d to 0x03d8d0 (0x25db4 bytes) 000155 1788876357.833961 mapwrite 0x02307f thru 0x0277f6 (0x4778 bytes) 000161 1788876357.900737 mapwrite 0x01a83f thru 0x01f761 (0x4f23 bytes) 000162 1788876357.953928 write 0x03567c thru 0x03ffff (0xa984 bytes) 000165 1788876357.962009 trunc from 0x040000 to 0x036917 (0x96e8 bytes) 000167 1788876357.985499 write 0x0154c5 thru 0x017f9b (0x2ad7 bytes) 000168 1788876357.987153 write 0x0353a8 thru 0x037322 (0x1f7b bytes) 000170 1788876357.989751 read 0x020b14 thru 0x02245b (0x1948 bytes) 000171 1788876357.990731 write 0x0054b5 thru 0x012539 (0xd085 bytes) 000172 1788876358.000722 punch from 0x00f8b5 to 0x0169b7 (0x7103 bytes) 000175 1788876358.017056 mapread 0x01c9eb thru 0x02b2c5 (0xe8db bytes) 000176 1788876358.019071 mapread 0x0361e0 thru 0x037322 (0x1143 bytes) 000177 1788876358.024353 MIRROR_EXTEND to 2 mirrors 000178 1788876358.764923 read 0x02cf7a thru 0x036e98 (0x9f1f bytes) 000179 1788876358.775459 read 0x030c8c thru 0x035a5c (0x4dd1 bytes) 000180 1788876358.776011 mapread 0x01358b thru 0x0166dc (0x3152 bytes) 000182 1788876358.786223 trunc from 0x037323 to 0x034037 (0x32eb bytes) 000184 1788876358.891424 mapwrite 0x0316ee thru 0x03a509 (0x8e1c bytes) 000185 1788876358.989047 punch from 0x013494 to 0x01c161 (0x8cce bytes) 000186 1788876358.995288 mapwrite 0x005e1c thru 0x00790e (0x1af3 bytes) 000189 1788876359.056628 mapwrite 0x030007 thru 0x0328ee (0x28e8 bytes) 000190 1788876359.094814 mapread 0x017434 thru 0x01f0ab (0x7c78 bytes) 000192 1788876359.144431 trunc from 0x03a50a to 0x036cb6 (0x3853 bytes) 000193 1788876359.159930 punch from 0x002a83 to 0x00cd24 (0xa2a2 bytes) 000194 1788876359.165697 punch from 0x009338 to 0x0116ba (0x8383 bytes) 000195 1788876359.172717 punch from 0x002afb to 0x00711f (0x4625 bytes) 000196 1788876359.179056 write 0x02ec98 thru 0x0303ef (0x1758 bytes) 000197 1788876359.184641 mapwrite 0x028cd1 thru 0x02cdbe (0x40ee bytes) 000198 1788876359.263843 mapwrite 0x019cd2 thru 0x0275ee (0xd91d bytes) 000199 1788876359.348842 write 0x01ea21 thru 0x024e9f (0x647f bytes) 000200 1788876359.350082 mapwrite 0x018d23 thru 0x02407f (0xb35d bytes) 000201 1788876359.392798 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x24f:0x0]: Invalid argument (22) 000202 1788876359.506319 write 0x00735a thru 0x00d2f1 (0x5f98 bytes) 000203 1788876359.516620 trunc from 0x036cb7 to 0x02362d (0x13689 bytes) 000204 1788876359.539975 MIRROR_EXTEND to 2 mirrors 000205 1788876360.154569 write 0x025448 thru 0x02ccbd (0x7876 bytes) 000206 1788876360.220738 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x24f:0x0]: Invalid argument (22) 000208 1788876360.341789 mapwrite 0x0046c3 thru 0x013450 (0xed8e bytes) 000209 1788876360.433112 mapwrite 0x001b52 thru 0x00cfe8 (0xb497 bytes) 000210 1788876360.489456 write 0x03f7e3 thru 0x03ffff (0x81d bytes) 000211 1788876360.490439 mapread 0x023abb thru 0x02905b (0x55a1 bytes) 000212 1788876360.507410 trunc from 0x040000 to 0x014637 (0x2b9c8 bytes) 000214 1788876360.521760 mapread 0x0075e3 thru 0x014637 (0xd055 bytes) 000218 1788876360.524867 trunc from 0x014638 to 0x016a67 (0x2430 bytes) 000222 1788876360.538995 trunc from 0x016a68 to 0x00d025 (0x9a42 bytes) 000223 1788876360.551950 mapwrite 0x0329f3 thru 0x03edd7 (0xc3e5 bytes) 000224 1788876360.631222 mapread 0x00d211 thru 0x016e73 (0x9c63 bytes) 000225 1788876360.640995 mapread 0x0045bd thru 0x00812f (0x3b73 bytes) 000226 1788876360.642151 punch from 0x025b3b to 0x029fa7 (0x446d bytes) 000227 1788876360.647100 mapwrite 0x035622 thru 0x03ffff (0xa9de bytes) 000229 1788876360.709082 read 0x013c6d thru 0x01c433 (0x87c7 bytes) 000230 1788876360.718523 read 0x01a761 thru 0x02999c (0xf23c bytes) 000232 1788876360.734039 punch from 0x004fdf to 0x00a2b0 (0x52d2 bytes) 000233 1788876360.739443 trunc from 0x040000 to 0x0265f2 (0x19a0d bytes) 000235 1788876360.766961 read 0x00578d thru 0x00a02e (0x48a2 bytes) 000237 1788876360.782797 trunc from 0x0265f3 to 0x034ad1 (0xe4df bytes) 000241 1788876360.800192 punch from 0x02808a to 0x03179c (0x9713 bytes) 000244 1788876360.807016 mapwrite 0x01baa3 thru 0x023bee (0x814c bytes) 000245 1788876360.854118 punch from 0x022342 to 0x031d19 (0xf9d8 bytes) 000246 1788876360.861724 punch from 0x01c053 to 0x027ca3 (0xbc51 bytes) 000247 1788876360.866042 trunc from 0x034ad2 to 0x02577a (0xf357 bytes) 000248 1788876360.885127 punch from 0x0118dd to 0x01f2e7 (0xda0b bytes) 000249 1788876360.892427 write 0x0080b0 thru 0x009767 (0x16b8 bytes) 000251 1788876360.894985 punch from 0x0062d2 to 0x00821c (0x1f4b bytes) 000252 1788876360.904970 read 0x014c7b thru 0x01513c (0x4c2 bytes) 000253 1788876360.922883 trunc from 0x02577b to 0x0363ed (0x10c73 bytes) 000254 1788876360.941780 trunc from 0x0363ee to 0x00db1c (0x288d1 bytes) 000257 1788876360.967007 trunc from 0x00db1d to 0x023d63 (0x16247 bytes) 000258 1788876360.983787 punch from 0x01eeda to 0x023d63 (0x4e8a bytes) 000259 1788876360.988070 trunc from 0x023d64 to 0x017c61 (0xc102 bytes) 000260 1788876361.019985 punch from 0x01573f to 0x017c61 (0x2523 bytes) 000261 1788876361.027729 write 0x035d3d thru 0x03a3e0 (0x46a4 bytes) 000265 1788876361.030033 trunc from 0x03a3e1 to 0x006667 (0x33d79 bytes) 000266 1788876361.052936 trunc from 0x006668 to 0x03dd84 (0x3771d bytes) 000267 1788876361.079747 punch from 0x03a1e2 to 0x03dd84 (0x3ba3 bytes) 000269 1788876361.095042 trunc from 0x03dd85 to 0x03cfa0 (0xde4 bytes) 000270 1788876361.108307 read 0x011f8e thru 0x019e3c (0x7eaf bytes) 000271 1788876361.124138 read 0x01ebb3 thru 0x028ac8 (0x9f16 bytes) 000272 1788876361.125080 mapread 0x01890f thru 0x01f0db (0x67cd bytes) 000273 1788876361.126477 punch from 0x0364fe to 0x03cfa0 (0x6aa3 bytes) 000274 1788876361.132653 mapwrite 0x026f5e thru 0x0275d3 (0x676 bytes) 000277 1788876361.188608 read 0x039046 thru 0x039e6b (0xe26 bytes) 000278 1788876361.199175 write 0x013a00 thru 0x01bc86 (0x8287 bytes) 000279 1788876361.200422 mapread 0x016c83 thru 0x01d15f (0x64dd bytes) 000281 1788876361.202356 mapwrite 0x027e00 thru 0x0336ed (0xb8ee bytes) 000282 1788876361.274413 punch from 0x033a4b to 0x03997a (0x5f30 bytes) 000284 1788876361.280106 mapread 0x03be70 thru 0x03cfa0 (0x1131 bytes) 000285 1788876361.280935 mapwrite 0x0045e0 thru 0x00ffaa (0xb9cb bytes) 000286 1788876361.348050 read 0x028807 thru 0x02bf8b (0x3785 bytes) 000288 1788876361.351438 read 0x021b3b thru 0x027899 (0x5d5f bytes) 000289 1788876361.352738 trunc from 0x03cfa1 to 0x03906c (0x3f34 bytes) 000291 1788876361.376822 trunc from 0x03906d to 0x011479 (0x27bf3 bytes) 000292 1788876361.393028 punch from 0x010b9e to 0x011479 (0x8dc bytes) 000293 1788876361.401067 mapwrite 0x0243a9 thru 0x02ce50 (0x8aa8 bytes) 000294 1788876361.498666 write 0x0029d5 thru 0x003c73 (0x129f bytes) 000295 1788876361.499973 read 0x029412 thru 0x02ce50 (0x3a3f bytes) truncating to largest ever: 0x3ea32 000296 1788876361.501819 trunc from 0x02ce51 to 0x03ea31 (0x11be1 bytes) 000298 1788876361.523170 mapwrite 0x039fb6 thru 0x03ffff (0x604a bytes) 000300 1788876361.595128 read 0x02bab4 thru 0x0390d9 (0xd626 bytes) 000301 1788876361.595870 mapwrite 0x0141a2 thru 0x0195b6 (0x5415 bytes) 000302 1788876361.638671 punch from 0x029482 to 0x035dd9 (0xc958 bytes) 000303 1788876361.644108 mapread 0x03f1a2 thru 0x03ffff (0xe5e bytes) 000304 1788876361.644924 punch from 0x010975 to 0x01c3ab (0xba37 bytes) 000305 1788876361.649141 trunc from 0x040000 to 0x011d4d (0x2e2b2 bytes) 000309 1788876361.670731 read 0x0034d8 thru 0x00c1ea (0x8d13 bytes) 000313 1788876361.674431 mapwrite 0x02a698 thru 0x035720 (0xb089 bytes) 000315 1788876361.755057 mapread 0x008fca thru 0x0129ed (0x9a24 bytes) 000316 1788876361.755866 punch from 0x00f3e5 to 0x00fe12 (0xa2e bytes) 000317 1788876361.759884 punch from 0x01d0c6 to 0x020c7a (0x3bb5 bytes) 000318 1788876361.763771 punch from 0x009569 to 0x018386 (0xee1e bytes) 000321 1788876361.769153 mapread 0x02a4e6 thru 0x035720 (0xb23b bytes) 000322 1788876361.770688 punch from 0x01f0b7 to 0x02a628 (0xb572 bytes) 000324 1788876361.775770 read 0x01eea1 thru 0x029ae4 (0xac44 bytes) 000328 1788876361.790106 read 0x02d49f thru 0x02d8a3 (0x405 bytes) 000329 1788876361.791129 mapwrite 0x017177 thru 0x024877 (0xd701 bytes) 000332 1788876361.837411 mapwrite 0x03b8c1 thru 0x03ffff (0x473f bytes) 000334 1788876361.903836 mapwrite 0x03c324 thru 0x03ffff (0x3cdc bytes) 000335 1788876361.942368 mapread 0x005222 thru 0x00fe6b (0xac4a bytes) 000336 1788876361.943679 read 0x0049ce thru 0x00aa2d (0x6060 bytes) 000338 1788876361.945055 trunc from 0x040000 to 0x02cebb (0x13144 bytes) 000340 1788876361.960296 mapwrite 0x01186d thru 0x014623 (0x2db7 bytes) 000342 1788876361.996726 write 0x039fa4 thru 0x03ffff (0x605c bytes) 000343 1788876361.997907 mapread 0x03aeb8 thru 0x03fe75 (0x4fbe bytes) 000344 1788876362.004085 MIRROR_EXTEND to 2 mirrors 000345 1788876362.601955 MIRROR_RESYNC 2 mirrors 000346 1788876363.159907 punch from 0x030dff to 0x03e063 (0xd265 bytes) 000347 1788876363.303697 mapwrite 0x00fa83 thru 0x0166c8 (0x6c46 bytes) 000348 1788876363.442362 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x24f:0x0]: Invalid argument (22) 000351 1788876363.637912 read 0x028c0b thru 0x037da9 (0xf19f bytes) 000352 1788876363.650611 mapread 0x02116e thru 0x02c6d9 (0xb56c bytes) 000353 1788876363.675979 trunc from 0x040000 to 0x02e51e (0x11ae1 bytes) 000354 1788876363.702977 mapwrite 0x020bf1 thru 0x02a680 (0x9a90 bytes) 000355 1788876363.752784 trunc from 0x02e51f to 0x012c2a (0x1b8f4 bytes) 000357 1788876363.773978 mapread 0x005be8 thru 0x012c2a (0xd043 bytes) 000358 1788876363.802260 trunc from 0x012c2b to 0x00ac16 (0x8014 bytes) 000359 1788876363.819467 punch from 0x00660e to 0x00864b (0x203e bytes) 000361 1788876363.828064 mapwrite 0x005067 thru 0x00cf80 (0x7f1a bytes) 000362 1788876363.914833 mapwrite 0x008ad3 thru 0x0141d0 (0xb6fe bytes) 000363 1788876363.995144 mapread 0x00c424 thru 0x013543 (0x7120 bytes) 000364 1788876363.996699 trunc from 0x0141d1 to 0x002eb4 (0x1131c bytes) 000366 1788876364.012269 mapwrite 0x0293f4 thru 0x02f7bf (0x63cc bytes) 000367 1788876364.086737 mapread 0x001aa9 thru 0x00d083 (0xb5db bytes) 000368 1788876364.098300 write 0x00ac03 thru 0x00bbd5 (0xfd3 bytes) 000369 1788876364.101898 mapread 0x02280f thru 0x02af34 (0x8726 bytes) 000370 1788876364.103042 mapread 0x01e730 thru 0x023193 (0x4a64 bytes) 000371 1788876364.113953 read 0x0283a6 thru 0x02f7bf (0x741a bytes) 000373 1788876364.115094 trunc from 0x02f7c0 to 0x021d29 (0xda96 bytes) 000374 1788876364.132628 mapwrite 0x01b327 thru 0x02a82a (0xf504 bytes) 000377 1788876364.213089 punch from 0x00be3c to 0x00ca69 (0xc2e bytes) 000378 1788876364.218970 read 0x01f028 thru 0x02a82a (0xb803 bytes) 000379 1788876364.219808 mapread 0x026ca7 thru 0x02a82a (0x3b84 bytes) 000383 1788876364.223857 write 0x02ceb1 thru 0x039169 (0xc2b9 bytes) 000384 1788876364.225418 mapread 0x014582 thru 0x022f94 (0xea13 bytes) 000386 1788876364.228063 punch from 0x00624d to 0x00b93d (0x56f1 bytes) 000389 1788876364.245852 MIRROR_EXTEND to 2 mirrors 000390 1788876364.775087 mapread 0x0166ea thru 0x0211f0 (0xab07 bytes) 000392 1788876364.807067 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x24f:0x0]: Invalid argument (22) 000393 1788876364.941052 punch from 0x032909 to 0x039169 (0x6861 bytes) 000395 1788876364.959521 mapread 0x0185d9 thru 0x01b39e (0x2dc6 bytes) 000397 1788876364.983208 trunc from 0x03916a to 0x01a3b9 (0x1edb0 bytes) 000398 1788876365.033745 trunc from 0x01a3ba to 0x0192e3 (0x10d6 bytes) 000401 1788876365.054484 write 0x022f0a thru 0x025b9c (0x2c93 bytes) 000402 1788876365.057065 write 0x024a78 thru 0x031b31 (0xd0ba bytes) 000403 1788876365.062103 write 0x0334df thru 0x039631 (0x6153 bytes) 000405 1788876365.065217 punch from 0x024385 to 0x02af52 (0x6bce bytes) 000406 1788876365.081822 write 0x034654 thru 0x03ffff (0xb9ac bytes) 000407 1788876365.083979 mapwrite 0x032c5d thru 0x039368 (0x670c bytes) 000411 1788876365.133259 write 0x00a930 thru 0x01a2d7 (0xf9a8 bytes) 000414 1788876365.152362 mapwrite 0x028ea7 thru 0x02e28c (0x53e6 bytes) 000415 1788876365.211644 trunc from 0x040000 to 0x0366f5 (0x990a bytes) 000417 1788876365.224150 trunc from 0x0366f6 to 0x03b9df (0x52ea bytes) 000418 1788876365.239252 write 0x03c12b thru 0x03f259 (0x312f bytes) 000419 1788876365.240005 trunc from 0x03f25a to 0x003aba (0x3b79f bytes) 000423 1788876365.255698 write 0x015743 thru 0x018321 (0x2bdf bytes) 000424 1788876365.261130 trunc from 0x018322 to 0x011bbc (0x6765 bytes) 000429 1788876365.282815 trunc from 0x011bbd to 0x01d770 (0xbbb4 bytes) 000431 1788876365.299990 mapread 0x00cced thru 0x01047a (0x378e bytes) 000432 1788876365.312835 write 0x03d7d4 thru 0x03ffff (0x282c bytes) 000433 1788876365.313908 mapwrite 0x031187 thru 0x03cb19 (0xb993 bytes) 000435 1788876365.371674 read 0x03a830 thru 0x03c629 (0x1dfa bytes) 000436 1788876365.372286 mapread 0x00facc thru 0x01f0a6 (0xf5db bytes) 000437 1788876365.390546 MIRROR_EXTEND to 2 mirrors 000438 1788876366.251047 mapread 0x0138b8 thru 0x0217ea (0xdf33 bytes) 000443 1788876366.277866 write 0x0385c7 thru 0x03ffff (0x7a39 bytes) 000444 1788876366.344924 punch from 0x022277 to 0x02f654 (0xd3de bytes) 000445 1788876366.358268 mapread 0x035276 thru 0x03ffff (0xad8a bytes) 000446 1788876366.368169 mapwrite 0x010a75 thru 0x01345c (0x29e8 bytes) 000447 1788876366.432000 trunc from 0x040000 to 0x02bd5b (0x142a4 bytes) 000448 1788876366.462212 punch from 0x022ff0 to 0x02bd5b (0x8d6c bytes) 000450 1788876366.467211 write 0x000344 thru 0x0095d6 (0x9293 bytes) 000451 1788876366.473019 punch from 0x00e6f2 to 0x01c48d (0xdd9c bytes) 000452 1788876366.486645 mapwrite 0x031f90 thru 0x03aaae (0x8b1f bytes) 000453 1788876366.552333 mapread 0x007e49 thru 0x00af22 (0x30da bytes) 000455 1788876366.555460 write 0x00b992 thru 0x010ceb (0x535a bytes) 000456 1788876366.559778 write 0x025edb thru 0x02a043 (0x4169 bytes) 000457 1788876366.567677 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3aaaf): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aaaf): Mirror 2: 0x9adc26a2 (stale) CRC-32 checksum value for chunk [0, 0x3aaaf): Mirror 1: 0xab58a177 Mirror 3: 0xab58a177 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aaaf: skipped 000458 1788876367.257606 mapread 0x021f7c thru 0x02cb43 (0xabc8 bytes) 000459 1788876367.289501 MIRROR_RESYNC 3 mirrors 000460 1788876367.931950 write 0x015e5e thru 0x0247bb (0xe95e bytes) 000461 1788876368.032769 punch from 0x0197e5 to 0x01ef60 (0x577c bytes) 000464 1788876368.056731 MIRROR_RESYNC 3 mirrors 000465 1788876369.016028 mapwrite 0x038ff7 thru 0x03fce4 (0x6cee bytes) 000467 1788876369.218549 mapwrite 0x036c71 thru 0x03ffff (0x938f bytes) 000468 1788876369.294216 trunc from 0x040000 to 0x006188 (0x39e77 bytes) 000469 1788876369.312959 write 0x00f91d thru 0x013e46 (0x452a bytes) 000470 1788876369.315090 mapwrite 0x013182 thru 0x013220 (0x9f bytes) 000472 1788876369.356938 mapread 0x00736e thru 0x013e46 (0xcad9 bytes) 000475 1788876369.368664 punch from 0x00bf68 to 0x012aff (0x6b98 bytes) 000476 1788876369.374683 mapread 0x007d27 thru 0x0114fb (0x97d5 bytes) 000477 1788876369.385864 punch from 0x00b055 to 0x013e46 (0x8df2 bytes) 000478 1788876369.391329 punch from 0x00ee04 to 0x013e46 (0x5043 bytes) 000479 1788876369.395453 read 0x00a11b thru 0x013e46 (0x9d2c bytes) 000480 1788876369.400857 mapread 0x00e890 thru 0x013e46 (0x55b7 bytes) 000481 1788876369.401611 mapread 0x0107a0 thru 0x013e46 (0x36a7 bytes) 000483 1788876369.402588 read 0x00bdeb thru 0x00e6f9 (0x290f bytes) 000484 1788876369.402978 punch from 0x00cf18 to 0x00d269 (0x352 bytes) 000485 1788876369.405807 mapread 0x001059 thru 0x00172b (0x6d3 bytes) 000486 1788876369.406681 write 0x018241 thru 0x02667e (0xe43e bytes) 000488 1788876369.408450 write 0x0391df thru 0x03d064 (0x3e86 bytes) 000489 1788876369.409199 punch from 0x0043a6 to 0x00eb2a (0xa785 bytes) 000490 1788876369.416533 write 0x010d94 thru 0x016a89 (0x5cf6 bytes) 000491 1788876369.421430 trunc from 0x03d065 to 0x03a79f (0x28c5 bytes) 000493 1788876369.443047 mapwrite 0x028e20 thru 0x035aa7 (0xcc88 bytes) 000495 1788876369.495839 write 0x035b1c thru 0x03ce7e (0x7363 bytes) 000497 1788876369.498775 read 0x036edb thru 0x03b1fa (0x4320 bytes) 000498 1788876369.507888 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3ce7f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ce7f): Mirror 2: 0xd7be7325 (stale) Mirror 3: 0xd7be7325 (stale) CRC-32 checksum value for chunk [0, 0x3ce7f): Mirror 1: 0xbab0796c Mirror 4: 0xbab0796c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ce7f: skipped 000500 1788876370.317105 MIRROR_RESYNC 4 mirrors 000501 1788876371.017185 trunc from 0x03ce7f to 0x0346c6 (0x87b8 bytes) 000503 1788876371.093848 mapwrite 0x0173fb thru 0x021872 (0xa478 bytes) 000505 1788876371.159275 read 0x0017dc thru 0x008782 (0x6fa7 bytes) 000506 1788876371.168050 mapread 0x02d1b0 thru 0x0317f4 (0x4645 bytes) 000508 1788876371.178472 trunc from 0x0346c7 to 0x021497 (0x1322f bytes) 000509 1788876371.197991 read 0x013ec3 thru 0x021497 (0xd5d5 bytes) 000510 1788876371.198864 read 0x0020c6 thru 0x00980e (0x7749 bytes) 000511 1788876371.209478 trunc from 0x021498 to 0x03736f (0x15ed8 bytes) 000512 1788876371.226324 mapread 0x00dcd7 thru 0x00f186 (0x14b0 bytes) 000513 1788876371.227334 write 0x024df4 thru 0x0315e4 (0xc7f1 bytes) 000515 1788876371.242554 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x24f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37370): Mirror 2: 0xdaf1529a (stale) Mirror 4: 0xdaf1529a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37370): Mirror 2: 0xdaf1529a (stale) Mirror 4: 0xdaf1529a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37370: skipped 000516 1788876371.538283 read 0x02b3d1 thru 0x03736f (0xbf9f bytes) 000517 1788876371.547079 mapwrite 0x0079df thru 0x008167 (0x789 bytes) 000518 1788876371.611886 read 0x0049af thru 0x00c112 (0x7764 bytes) 000519 1788876371.622517 write 0x024c29 thru 0x02f12b (0xa503 bytes) 000520 1788876371.623948 trunc from 0x037370 to 0x013350 (0x2401f bytes) 000521 1788876371.645067 read 0x003fd5 thru 0x012892 (0xe8be bytes) 000522 1788876371.645904 mapread 0x0050b2 thru 0x010aca (0xba19 bytes) 000523 1788876371.652454 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x13351): Mirror 2: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13351): Mirror 2: 0xe4e7e4a3 (stale) Mirror 4: 0xe4e7e4a3 (stale) CRC-32 checksum value for chunk [0, 0x13351): Mirror 1: 0x9fa78aa1 Mirror 5: 0x9fa78aa1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13351: skipped 000525 1788876372.535833 trunc from 0x013351 to 0x03119f (0x1de4f bytes) 000527 1788876372.636871 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x311a0): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x311a0): Mirror 2: 0xdb6692f7 (stale) Mirror 4: 0xdb6692f7 (stale) Mirror 5: 0xd510fc3a (stale) CRC-32 checksum value for chunk [0, 0x311a0): Mirror 1: 0xd510fc3a Mirror 6: 0xd510fc3a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x311a0: skipped 000529 1788876373.618738 write 0x0305b4 thru 0x03b49e (0xaeeb bytes) 000530 1788876373.677628 trunc from 0x03b49f to 0x034787 (0x6d17 bytes) 000532 1788876373.697635 write 0x021c6e thru 0x02f5d7 (0xd96a bytes) 000534 1788876373.708799 write 0x00c96e thru 0x01c584 (0xfc17 bytes) 000537 1788876373.728613 punch from 0x01839d to 0x023ea7 (0xbb0b bytes) 000538 1788876373.746326 punch from 0x030f1e to 0x03411b (0x31fe bytes) 000540 1788876373.751905 punch from 0x004b29 to 0x0145c4 (0xfa9c bytes) 000541 1788876373.756043 mapwrite 0x02cb71 thru 0x03b083 (0xe513 bytes) 000542 1788876373.852974 read 0x02487b thru 0x02a1e8 (0x596e bytes) 000543 1788876373.853940 read 0x038880 thru 0x03b083 (0x2804 bytes) 000544 1788876373.855107 trunc from 0x03b084 to 0x00afdc (0x300a7 bytes) 000546 1788876373.887351 read 0x0000b2 thru 0x00afdc (0xaf2b bytes) 000547 1788876373.908336 read 0x002946 thru 0x00afdc (0x8697 bytes) 000548 1788876373.909006 trunc from 0x00afdd to 0x0392f1 (0x2e315 bytes) truncating to largest ever: 0x3f3fb 000549 1788876373.927389 trunc from 0x0392f2 to 0x03f3fa (0x6109 bytes) 000550 1788876373.944496 read 0x024e6e thru 0x030c3c (0xbdcf bytes) 000553 1788876373.955943 punch from 0x01ecb9 to 0x02e5ff (0xf947 bytes) 000554 1788876373.959961 read 0x02b840 thru 0x036f41 (0xb702 bytes) 000555 1788876373.970087 punch from 0x0222e3 to 0x025764 (0x3482 bytes) 000556 1788876373.978077 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x24f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f3fb): Mirror 2: 0x2022709f (stale) Mirror 4: 0x2022709f (stale) Mirror 6: 0xd8868c2f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f3fb): Mirror 2: 0x2022709f (stale) Mirror 4: 0x2022709f (stale) Mirror 6: 0xd8868c2f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f3fb: skipped 000559 1788876374.302844 write 0x02cf09 thru 0x034b7a (0x7c72 bytes) 000561 1788876374.312679 write 0x00a097 thru 0x014d07 (0xac71 bytes) 000562 1788876374.323637 trunc from 0x03f3fb to 0x03ce3a (0x25c0 bytes) 000563 1788876374.340845 mapwrite 0x00d082 thru 0x01654c (0x94cb bytes) 000564 1788876374.398827 mapread 0x006e03 thru 0x00b2e8 (0x44e6 bytes) 000566 1788876374.408524 trunc from 0x03ce3b to 0x0263ce (0x16a6c bytes) 000568 1788876374.421338 punch from 0x01a1dd to 0x0255df (0xb403 bytes) 000569 1788876374.424588 write 0x00c457 thru 0x00c6a8 (0x252 bytes) 000570 1788876374.425498 write 0x02163f thru 0x023508 (0x1eca bytes) 000571 1788876374.431560 read 0x009438 thru 0x0128ae (0x9477 bytes) 000573 1788876374.432609 mapwrite 0x01ab48 thru 0x028dfc (0xe2b5 bytes) 000574 1788876374.528038 MIRROR_RESYNC 4 mirrors 000576 1788876375.263656 write 0x01ecaf thru 0x022737 (0x3a89 bytes) 000577 1788876375.354897 mapwrite 0x01cd7a thru 0x0226f4 (0x597b bytes) 000580 1788876375.406188 read 0x019b89 thru 0x02392b (0x9da3 bytes) 000583 1788876375.413722 trunc from 0x028dfd to 0x01d53d (0xb8bf bytes) 000585 1788876375.456938 read 0x012256 thru 0x01d53d (0xb2e8 bytes) 000586 1788876375.463773 read 0x001a83 thru 0x00660b (0x4b89 bytes) 000587 1788876375.464598 mapwrite 0x031cf8 thru 0x03e6fa (0xca03 bytes) 000588 1788876375.514483 write 0x029557 thru 0x02f3b4 (0x5e5e bytes) 000590 1788876375.516816 trunc from 0x03e6fb to 0x01b613 (0x230e7 bytes) 000591 1788876375.530417 punch from 0x00be94 to 0x0108d8 (0x4a45 bytes) 000592 1788876375.538069 punch from 0x018d2c to 0x01b613 (0x28e8 bytes) 000594 1788876375.542617 read 0x01892a thru 0x01b613 (0x2cea bytes) 000596 1788876375.559558 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1b614): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b614): Mirror 2: 0x116b1b0e (stale) Mirror 4: 0x116b1b0e (stale) Mirror 6: 0x116b1b0e (stale) CRC-32 checksum value for chunk [0, 0x1b614): Mirror 1: 0xbb48d788 Mirror 7: 0xbb48d788 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b614: skipped 000597 1788876376.319455 punch from 0x00f87e to 0x00ffb0 (0x733 bytes) 000599 1788876376.422547 read 0x001f88 thru 0x0091ec (0x7265 bytes) 000602 1788876376.435007 mapwrite 0x00662d thru 0x011bb1 (0xb585 bytes) 000604 1788876376.486106 trunc from 0x01b614 to 0x010d78 (0xa89b bytes) 000606 1788876376.533771 trunc from 0x010d79 to 0x02531b (0x145a3 bytes) 000607 1788876376.553930 read 0x01825a thru 0x01b4bb (0x3262 bytes) 000608 1788876376.579745 MIRROR_RESYNC 5 mirrors 000609 1788876377.590963 mapwrite 0x03b3c5 thru 0x03ffff (0x4c3b bytes) 000610 1788876377.732086 mapwrite 0x005d57 thru 0x01113c (0xb3e6 bytes) 000611 1788876377.774337 mapwrite 0x023337 thru 0x031dd2 (0xea9c bytes) 000613 1788876377.839000 mapwrite 0x00ea78 thru 0x0176ec (0x8c75 bytes) 000614 1788876377.874907 punch from 0x0019a7 to 0x0104f0 (0xeb4a bytes) 000616 1788876377.881807 trunc from 0x040000 to 0x0333b3 (0xcc4c bytes) 000617 1788876377.906852 trunc from 0x0333b4 to 0x00b3ec (0x27fc7 bytes) 000618 1788876377.940170 write 0x02b607 thru 0x02c807 (0x1201 bytes) 000619 1788876377.948880 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2c808): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c808): Mirror 2: 0xe049d5d4 (stale) Mirror 4: 0xe049d5d4 (stale) Mirror 6: 0xe049d5d4 (stale) Mirror 7: 0xe049d5d4 (stale) CRC-32 checksum value for chunk [0, 0x2c808): Mirror 1: 0x439ff43b Mirror 8: 0x439ff43b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c808: skipped 000620 1788876378.990140 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2c808): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c808): Mirror 2: 0xe049d5d4 (stale) Mirror 4: 0xe049d5d4 (stale) Mirror 6: 0xe049d5d4 (stale) Mirror 7: 0xe049d5d4 (stale) CRC-32 checksum value for chunk [0, 0x2c808): Mirror 1: 0x439ff43b Mirror 8: 0x439ff43b Mirror 9: 0x439ff43b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c808: skipped 000622 1788876380.043059 punch from 0x0194b6 to 0x0215b9 (0x8104 bytes) 000623 1788876380.122993 punch from 0x007824 to 0x00ab01 (0x32de bytes) 000625 1788876380.133047 punch from 0x0101b2 to 0x01846c (0x82bb bytes) 000627 1788876380.137819 mapwrite 0x019bb2 thru 0x01ed4e (0x519d bytes) 000628 1788876380.210474 mapread 0x0153d1 thru 0x023ca9 (0xe8d9 bytes) 000630 1788876380.212628 punch from 0x02527a to 0x02c807 (0x758e bytes) 000631 1788876380.219057 punch from 0x012ad6 to 0x0201f7 (0xd722 bytes) 000632 1788876380.225981 read 0x021b04 thru 0x02c807 (0xad04 bytes) 000634 1788876380.237036 trunc from 0x02c808 to 0x032321 (0x5b1a bytes) 000635 1788876380.263991 mapread 0x024166 thru 0x02628b (0x2126 bytes) 000636 1788876380.266094 mapwrite 0x01afc1 thru 0x01e6ae (0x36ee bytes) 000637 1788876380.313814 write 0x00362b thru 0x010e66 (0xd83c bytes) 000638 1788876380.327419 write 0x026dee thru 0x02dfde (0x71f1 bytes) 000639 1788876380.338475 read 0x02bb93 thru 0x032321 (0x678f bytes) 000640 1788876380.348958 mapwrite 0x015cd8 thru 0x01f663 (0x998c bytes) 000642 1788876380.411874 mapwrite 0x02c0c5 thru 0x036e6e (0xadaa bytes) 000644 1788876380.487444 punch from 0x0130c3 to 0x0173ba (0x42f8 bytes) 000646 1788876380.493144 punch from 0x00471e to 0x009dd7 (0x56ba bytes) 000647 1788876380.499074 punch from 0x02c582 to 0x036e6e (0xa8ed bytes) 000648 1788876380.504949 trunc from 0x036e6f to 0x0187b4 (0x1e6ba bytes) 000650 1788876380.524883 write 0x005425 thru 0x005d18 (0x8f4 bytes) 000653 1788876380.532516 mapread 0x0128db thru 0x0187a4 (0x5eca bytes) 000654 1788876380.555643 punch from 0x013dd1 to 0x0187b4 (0x49e4 bytes) 000655 1788876380.571805 trunc from 0x0187b5 to 0x01c6d0 (0x3f1c bytes) 000657 1788876380.593778 trunc from 0x01c6d1 to 0x01ddbf (0x16ef bytes) 000659 1788876380.622033 read 0x00775f thru 0x01384d (0xc0ef bytes) 000662 1788876380.637034 mapwrite 0x0209f0 thru 0x02c7cf (0xbde0 bytes) 000663 1788876380.737490 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x24f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c7d0): Mirror 4: 0x9f80642e (stale) Mirror 6: 0x9f80642e (stale) Mirror 7: 0x9f80642e (stale) Mirror 8: 0x6ab771aa (stale) Mirror 9: 0x6ab771aa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c7d0): Mirror 4: 0x9f80642e (stale) Mirror 6: 0x9f80642e (stale) Mirror 7: 0x9f80642e (stale) Mirror 8: 0x6ab771aa (stale) Mirror 9: 0x6ab771aa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c7d0: skipped 000664 1788876381.141805 mapwrite 0x003e0f thru 0x003e2d (0x1f bytes) 000665 1788876381.170810 mapread 0x020548 thru 0x027367 (0x6e20 bytes) 000666 1788876381.189268 mapwrite 0x01bf51 thru 0x029380 (0xd430 bytes) 000667 1788876381.271808 mapread 0x011011 thru 0x012211 (0x1201 bytes) 000668 1788876381.283444 write 0x007a73 thru 0x0099b0 (0x1f3e bytes) 000672 1788876381.299400 MIRROR_RESYNC 6 mirrors 000675 1788876382.683787 punch from 0x001662 to 0x00210d (0xaac bytes) 000676 1788876382.777422 write 0x01d007 thru 0x023326 (0x6320 bytes) 000677 1788876382.791016 punch from 0x0152f6 to 0x02275f (0xd46a bytes) 000678 1788876382.804059 mapwrite 0x02b7e3 thru 0x02edb5 (0x35d3 bytes) 000679 1788876382.917568 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2edb6): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2edb6): Mirror 4: 0x450458d0 (stale) Mirror 6: 0x450458d0 (stale) Mirror 7: 0x450458d0 (stale) Mirror 8: 0x450458d0 (stale) Mirror 9: 0x450458d0 (stale) CRC-32 checksum value for chunk [0, 0x2edb6): Mirror 1: 0xb3e6f624 Mirror 10: 0xb3e6f624 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2edb6: skipped 000681 1788876384.187175 mapread 0x003590 thru 0x00b709 (0x817a bytes) 000685 1788876384.215473 read 0x021e46 thru 0x0269e5 (0x4ba0 bytes) 000687 1788876384.227657 read 0x020111 thru 0x025dae (0x5c9e bytes) 000688 1788876384.261543 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x24f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2edb6): Mirror 4: 0x450458d0 (stale) Mirror 6: 0x450458d0 (stale) Mirror 7: 0x450458d0 (stale) Mirror 8: 0x450458d0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2edb6): Mirror 4: 0x450458d0 (stale) Mirror 6: 0x450458d0 (stale) Mirror 7: 0x450458d0 (stale) Mirror 8: 0x450458d0 (stale) CRC-32 checksum value for chunk [0, 0x2edb6): Mirror 1: 0xb3e6f624 Mirror 10: 0xb3e6f624 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2edb6: skipped 000690 1788876384.975661 punch from 0x00fbe2 to 0x011fc8 (0x23e7 bytes) 000691 1788876385.084225 write 0x0396cd thru 0x03ffff (0x6933 bytes) 000692 1788876385.085675 mapread 0x03b229 thru 0x03ffff (0x4dd7 bytes) 000693 1788876385.088501 punch from 0x03dcb4 to 0x03ffff (0x234c bytes) 000694 1788876385.100803 punch from 0x00b5d1 to 0x01a8d3 (0xf303 bytes) 000696 1788876385.104655 mapwrite 0x006329 thru 0x00dc1d (0x78f5 bytes) 000697 1788876385.188551 write 0x03810f thru 0x03f760 (0x7652 bytes) 000699 1788876385.197809 read 0x02d9c6 thru 0x033d15 (0x6350 bytes) 000700 1788876385.211095 mapwrite 0x017bd9 thru 0x02622b (0xe653 bytes) 000701 1788876385.291273 write 0x03f13b thru 0x03ffff (0xec5 bytes) 000702 1788876385.291856 trunc from 0x040000 to 0x003f40 (0x3c0bf bytes) 000703 1788876385.304665 mapread 0x003361 thru 0x003f40 (0xbe0 bytes) 000704 1788876385.305290 mapread 0x0036b7 thru 0x003f40 (0x88a bytes) 000705 1788876385.305722 punch from 0x0016f6 to 0x0038c9 (0x21d4 bytes) 000708 1788876385.310124 trunc from 0x003f41 to 0x0318d7 (0x2d997 bytes) 000710 1788876385.320678 mapread 0x017d8f thru 0x0260ee (0xe360 bytes) 000712 1788876385.333444 punch from 0x01f60c to 0x02596b (0x6360 bytes) 000713 1788876385.336528 mapread 0x00684d thru 0x013ca3 (0xd457 bytes) 000714 1788876385.342212 mapread 0x016a58 thru 0x024247 (0xd7f0 bytes) 000716 1788876385.347573 punch from 0x024cff to 0x02dc35 (0x8f37 bytes) 000719 1788876385.351204 write 0x004ddb thru 0x0143aa (0xf5d0 bytes) 000722 1788876385.352837 mapread 0x010151 thru 0x010af2 (0x9a2 bytes) 000724 1788876385.353795 punch from 0x0111c6 to 0x019107 (0x7f42 bytes) 000725 1788876385.365070 MIRROR_RESYNC 6 mirrors 000728 1788876386.426861 MIRROR_EXTEND to 7 mirrors 000729 1788876387.196602 trunc from 0x0318d8 to 0x036ea4 (0x55cd bytes) 000730 1788876387.285021 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x24f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36ea5): Mirror 4: 0x78ebbc4f (stale) Mirror 6: 0x78ebbc4f (stale) Mirror 8: 0x78ebbc4f (stale) Mirror 10: 0x78ebbc4f (stale) Mirror 11: 0x78ebbc4f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36ea5): Mirror 4: 0x78ebbc4f (stale) Mirror 6: 0x78ebbc4f (stale) Mirror 8: 0x78ebbc4f (stale) Mirror 10: 0x78ebbc4f (stale) Mirror 11: 0x78ebbc4f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36ea5: skipped 000731 1788876387.677700 mapwrite 0x017789 thru 0x01c34e (0x4bc6 bytes) 000732 1788876387.728570 mapwrite 0x03887b thru 0x03ffff (0x7785 bytes) 000734 1788876387.789134 read 0x02c95c thru 0x03ab80 (0xe225 bytes) 000735 1788876387.804207 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xf38709dc (stale) Mirror 6: 0xf38709dc (stale) Mirror 8: 0xf38709dc (stale) Mirror 10: 0xf38709dc (stale) Mirror 11: 0xf38709dc (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x34b97781 Mirror 12: 0x34b97781 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000736 1788876388.748930 read 0x030ee6 thru 0x038f05 (0x8020 bytes) 000739 1788876388.782176 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x24f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xf38709dc (stale) Mirror 6: 0xf38709dc (stale) Mirror 8: 0xf38709dc (stale) Mirror 11: 0xf38709dc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xf38709dc (stale) Mirror 6: 0xf38709dc (stale) Mirror 8: 0xf38709dc (stale) Mirror 11: 0xf38709dc (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x34b97781 Mirror 12: 0x34b97781 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000740 1788876389.677501 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x24f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xf38709dc (stale) Mirror 6: 0xf38709dc (stale) Mirror 8: 0xf38709dc (stale) Mirror 11: 0xf38709dc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xf38709dc (stale) Mirror 6: 0xf38709dc (stale) Mirror 8: 0xf38709dc (stale) Mirror 11: 0xf38709dc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000741 1788876390.024256 mapwrite 0x03b5a7 thru 0x03ffff (0x4a59 bytes) 000743 1788876390.088834 mapread 0x024c00 thru 0x02d271 (0x8672 bytes) 000744 1788876390.100790 mapwrite 0x02b584 thru 0x02d9ed (0x246a bytes) 000745 1788876390.124400 write 0x024427 thru 0x027202 (0x2ddc bytes) 000746 1788876390.125340 write 0x03e7fe thru 0x03ffff (0x1802 bytes) 000747 1788876390.126134 punch from 0x00c474 to 0x0158de (0x946b bytes) 000749 1788876390.136088 punch from 0x033f6c to 0x034bf2 (0xc87 bytes) 000750 1788876390.141465 punch from 0x01206d to 0x01935d (0x72f1 bytes) 000751 1788876390.146304 read 0x031827 thru 0x039e6b (0x8645 bytes) 000752 1788876390.156827 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xf38709dc (stale) Mirror 6: 0xf38709dc (stale) Mirror 8: 0xf38709dc (stale) Mirror 11: 0xf38709dc (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xfdc4438a Mirror 12: 0xfdc4438a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000753 1788876390.877493 mapwrite 0x011352 thru 0x020307 (0xefb6 bytes) 000756 1788876391.044509 mapread 0x0397cf thru 0x03d6bc (0x3eee bytes) 000757 1788876391.057853 punch from 0x033649 to 0x03e3ea (0xada2 bytes) 000758 1788876391.062647 trunc from 0x040000 to 0x01c634 (0x239cb bytes) 000759 1788876391.112491 punch from 0x013fcc to 0x01c634 (0x8669 bytes) 000760 1788876391.118709 trunc from 0x01c635 to 0x021429 (0x4df5 bytes) 000764 1788876391.143353 mapwrite 0x0198ff thru 0x028afa (0xf1fc bytes) 000765 1788876391.217888 write 0x002412 thru 0x0063ef (0x3fde bytes) 000766 1788876391.228363 mapread 0x01e3de thru 0x028afa (0xa71d bytes) 000767 1788876391.229829 read 0x01be3d thru 0x020ceb (0x4eaf bytes) 000768 1788876391.232376 write 0x00c39a thru 0x00cebc (0xb23 bytes) 000769 1788876391.233628 read 0x01189d thru 0x01885d (0x6fc1 bytes) 000771 1788876391.235185 read 0x00131b thru 0x00a4df (0x91c5 bytes) 000772 1788876391.245424 read 0x02510d thru 0x0279b1 (0x28a5 bytes) 000773 1788876391.246751 mapread 0x009f96 thru 0x00a17a (0x1e5 bytes) 000774 1788876391.250938 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x24f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28afb): Mirror 4: 0x76240eef (stale) Mirror 6: 0x76240eef (stale) Mirror 11: 0x76240eef (stale) Mirror 12: 0xde9019f0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28afb): Mirror 4: 0x76240eef (stale) Mirror 6: 0x76240eef (stale) Mirror 11: 0x76240eef (stale) Mirror 12: 0xde9019f0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28afb: skipped 000775 1788876391.589328 write 0x039d91 thru 0x03ffff (0x626f bytes) 000777 1788876391.596742 mapwrite 0x03fa13 thru 0x03ffff (0x5ed bytes) 000778 1788876391.632842 punch from 0x00345b to 0x00f986 (0xc52c bytes) 000782 1788876391.638461 trunc from 0x040000 to 0x0048f9 (0x3b706 bytes) 000783 1788876391.649622 mapread 0x000f46 thru 0x0048f9 (0x39b4 bytes) 000784 1788876391.671513 write 0x01d533 thru 0x025da3 (0x8871 bytes) 000787 1788876391.675078 mapread 0x0051e4 thru 0x005e22 (0xc3f bytes) 000788 1788876391.682558 trunc from 0x025da4 to 0x03bab7 (0x15d14 bytes) 000789 1788876391.699425 write 0x03be86 thru 0x03ffff (0x417a bytes) 000792 1788876391.709900 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x24f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xf38709dc (stale) Mirror 6: 0xf38709dc (stale) Mirror 12: 0xfdc4438a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xf38709dc (stale) Mirror 6: 0xf38709dc (stale) Mirror 12: 0xfdc4438a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000793 1788876391.986132 trunc from 0x040000 to 0x01634d (0x29cb2 bytes) 000794 1788876391.997947 mapread 0x00fa9f thru 0x01634d (0x68af bytes) 000798 1788876392.010589 mapwrite 0x03efa0 thru 0x03ffff (0x1060 bytes) 000801 1788876392.065912 punch from 0x032168 to 0x032b3c (0x9d5 bytes) 000803 1788876392.071424 mapwrite 0x0071c7 thru 0x00cccd (0x5b07 bytes) 000804 1788876392.116441 mapread 0x024b96 thru 0x02ec08 (0xa073 bytes) 000805 1788876392.134131 MIRROR_RESYNC 4 mirrors 000806 1788876393.068336 punch from 0x033266 to 0x03b22a (0x7fc5 bytes) 000807 1788876393.126666 write 0x013221 thru 0x01477a (0x155a bytes) 000809 1788876393.135695 mapread 0x03b037 thru 0x03ffff (0x4fc9 bytes) 000810 1788876393.157872 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xfbbc4a83 (stale) Mirror 6: 0xfbbc4a83 (stale) Mirror 12: 0xfbbc4a83 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9ae4416d Mirror 13: 0x9ae4416d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000811 1788876394.027446 trunc from 0x040000 to 0x012b84 (0x2d47b bytes) 000812 1788876394.127327 trunc from 0x012b85 to 0x00322b (0xf959 bytes) 000813 1788876394.140413 read 0x001987 thru 0x00322b (0x18a5 bytes) 000814 1788876394.144926 read 0x0022e0 thru 0x00322b (0xf4c bytes) 000815 1788876394.145420 read 0x001042 thru 0x00322b (0x21ea bytes) 000817 1788876394.146359 read 0x001df2 thru 0x00322b (0x143a bytes) 000819 1788876394.147334 read 0x0002df thru 0x00288e (0x25b0 bytes) 000820 1788876394.151221 read 0x0024b6 thru 0x00322b (0xd76 bytes) 000822 1788876394.155138 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x322c): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x322c): Mirror 4: 0x23e1d165 (stale) Mirror 6: 0x23e1d165 (stale) Mirror 12: 0x23e1d165 (stale) Mirror 13: 0x23e1d165 (stale) CRC-32 checksum value for chunk [0, 0x322c): Mirror 1: 0x23e1d165 Mirror 14: 0x23e1d165 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x322c: skipped 000823 1788876394.830481 MIRROR_RESYNC 6 mirrors 000825 1788876395.649656 trunc from 0x00322c to 0x01460d (0x113e2 bytes) 000827 1788876395.718114 trunc from 0x01460e to 0x037a7c (0x2346f bytes) 000832 1788876395.739502 punch from 0x031db3 to 0x037a7c (0x5cca bytes) 000833 1788876395.751171 trunc from 0x037a7d to 0x02d01a (0xaa62 bytes) 000834 1788876395.777668 punch from 0x0204f7 to 0x02129b (0xda5 bytes) 000835 1788876395.783661 mapread 0x00f4b9 thru 0x01e5c8 (0xf110 bytes) 000837 1788876395.808073 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x24f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d01b): Mirror 4: 0x42509169 (stale) Mirror 6: 0x42509169 (stale) Mirror 12: 0x42509169 (stale) Mirror 14: 0x42509169 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d01b): Mirror 4: 0x42509169 (stale) Mirror 6: 0x42509169 (stale) Mirror 12: 0x42509169 (stale) Mirror 14: 0x42509169 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d01b: skipped 000840 1788876396.195030 trunc from 0x02d01b to 0x0030fd (0x29f1d bytes) 000842 1788876396.213002 mapwrite 0x03ba26 thru 0x03ffff (0x45da bytes) 000844 1788876396.280805 trunc from 0x040000 to 0x01fdaa (0x20255 bytes) 000846 1788876396.299490 mapread 0x016ae6 thru 0x01fdaa (0x92c5 bytes) 000848 1788876396.319077 read 0x00c141 thru 0x0199b5 (0xd875 bytes) 000849 1788876396.324816 trunc from 0x01fdab to 0x013c57 (0xc153 bytes) 000850 1788876396.343341 punch from 0x003adf to 0x0072e2 (0x3804 bytes) 000852 1788876396.349729 write 0x00cac0 thru 0x0181c4 (0xb705 bytes) 000853 1788876396.352455 trunc from 0x0181c5 to 0x032f4f (0x1ad8b bytes) 000854 1788876396.371127 trunc from 0x032f50 to 0x0156b0 (0x1d89f bytes) 000855 1788876396.395093 trunc from 0x0156b1 to 0x01128e (0x4422 bytes) 000856 1788876396.419173 punch from 0x006896 to 0x00f0c6 (0x8831 bytes) 000857 1788876396.430981 mapread 0x00ff09 thru 0x01128e (0x1386 bytes) 000858 1788876396.437812 mapread 0x00a890 thru 0x00b628 (0xd99 bytes) 000859 1788876396.438595 write 0x03b1cb thru 0x03ffff (0x4e35 bytes) 000860 1788876396.444027 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x97e2d8b6 (stale) Mirror 6: 0x97e2d8b6 (stale) Mirror 12: 0x97e2d8b6 (stale) Mirror 14: 0x97e2d8b6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9e63ca48 Mirror 15: 0x9e63ca48 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000861 1788876397.565798 mapread 0x01343c thru 0x015cfe (0x28c3 bytes) 000862 1788876397.605413 write 0x02d3ba thru 0x034d95 (0x79dc bytes) 000863 1788876397.709189 punch from 0x02fffa to 0x0378c6 (0x78cd bytes) 000864 1788876397.739848 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x24f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x97e2d8b6 (stale) Mirror 12: 0x97e2d8b6 (stale) Mirror 14: 0x97e2d8b6 (stale) Mirror 15: 0x9e63ca48 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x97e2d8b6 (stale) Mirror 12: 0x97e2d8b6 (stale) Mirror 14: 0x97e2d8b6 (stale) Mirror 15: 0x9e63ca48 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000865 1788876398.173523 punch from 0x01c8ca to 0x01e3e0 (0x1b17 bytes) 000866 1788876398.178779 mapread 0x01ab01 thru 0x022194 (0x7694 bytes) 000867 1788876398.201162 trunc from 0x040000 to 0x03687d (0x9782 bytes) 000868 1788876398.240003 punch from 0x00d5d8 to 0x01b558 (0xdf81 bytes) 000869 1788876398.249530 read 0x015812 thru 0x01d341 (0x7b30 bytes) 000870 1788876398.260197 read 0x0270a4 thru 0x02fe10 (0x8d6d bytes) 000871 1788876398.287122 punch from 0x00d5f1 to 0x013eba (0x68ca bytes) 000874 1788876398.302948 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x24f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3687e): Mirror 12: 0x3a06fdd (stale) Mirror 14: 0x3a06fdd (stale) Mirror 15: 0xd10aade (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3687e): Mirror 12: 0x3a06fdd (stale) Mirror 14: 0x3a06fdd (stale) Mirror 15: 0xd10aade (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3687e: skipped 000875 1788876398.594429 mapread 0x007187 thru 0x012ccc (0xbb46 bytes) 000876 1788876398.627035 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3687e): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3687e): Mirror 12: 0x3a06fdd (stale) Mirror 14: 0x3a06fdd (stale) Mirror 15: 0xd10aade (stale) CRC-32 checksum value for chunk [0, 0x3687e): Mirror 1: 0x5f0b064c Mirror 16: 0x5f0b064c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3687e: skipped 000877 1788876399.506263 mapwrite 0x0039a2 thru 0x005631 (0x1c90 bytes) 000878 1788876399.673136 punch from 0x003df5 to 0x00f163 (0xb36f bytes) 000879 1788876399.679723 punch from 0x00502d to 0x007e22 (0x2df6 bytes) 000881 1788876399.690103 punch from 0x020e26 to 0x021a0a (0xbe5 bytes) 000883 1788876399.703879 punch from 0x017d49 to 0x02738d (0xf645 bytes) 000884 1788876399.709678 punch from 0x00f12c to 0x015d58 (0x6c2d bytes) 000885 1788876399.721755 punch from 0x01f9e9 to 0x01fe94 (0x4ac bytes) 000886 1788876399.731530 read 0x00020e thru 0x00cf13 (0xcd06 bytes) 000887 1788876399.745514 read 0x027104 thru 0x035558 (0xe455 bytes) 000888 1788876399.754363 punch from 0x0019d3 to 0x0103e4 (0xea12 bytes) 000890 1788876399.759893 trunc from 0x03687e to 0x0285e0 (0xe29d bytes) 000892 1788876399.824362 write 0x013d5a thru 0x019cea (0x5f91 bytes) 000893 1788876399.825507 punch from 0x0110ac to 0x01bc8f (0xabe4 bytes) 000894 1788876399.843157 trunc from 0x0285e1 to 0x028e5e (0x87e bytes) 000895 1788876399.858150 mapwrite 0x02261d thru 0x02f0cd (0xcab1 bytes) 000896 1788876400.007736 write 0x01e1d4 thru 0x01e6e1 (0x50e bytes) 000897 1788876400.008664 write 0x013b03 thru 0x02399b (0xfe99 bytes) 000898 1788876400.015788 mapwrite 0x03a547 thru 0x03ffff (0x5ab9 bytes) 000901 1788876400.092632 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x24f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x97e2d8b6 (stale) Mirror 15: 0x9e63ca48 (stale) Mirror 16: 0x8721b7ff (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x97e2d8b6 (stale) Mirror 15: 0x9e63ca48 (stale) Mirror 16: 0x8721b7ff (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000902 1788876400.384827 mapread 0x037a63 thru 0x03d077 (0x5615 bytes) 000903 1788876400.403664 mapread 0x02df66 thru 0x03ad16 (0xcdb1 bytes) 000906 1788876400.416605 trunc from 0x040000 to 0x00827d (0x37d82 bytes) 000907 1788876400.438718 write 0x007109 thru 0x00d166 (0x605e bytes) 000908 1788876400.446052 punch from 0x00bfc9 to 0x00d166 (0x119e bytes) 000910 1788876400.458560 trunc from 0x00d167 to 0x01387a (0x6714 bytes) 000912 1788876400.482219 punch from 0x00fea9 to 0x0118b9 (0x1a11 bytes) 000913 1788876400.487544 mapread 0x001b5a thru 0x006a2b (0x4ed2 bytes) 000915 1788876400.497405 write 0x039a99 thru 0x03ffff (0x6567 bytes) 000916 1788876400.501077 write 0x0309f9 thru 0x032f4b (0x2553 bytes) 000917 1788876400.515078 mapread 0x00e531 thru 0x0152d5 (0x6da5 bytes) 000918 1788876400.524166 trunc from 0x040000 to 0x024fa0 (0x1b05f bytes) 000919 1788876400.545362 mapwrite 0x035da0 thru 0x03ffff (0xa260 bytes) 000920 1788876400.642595 punch from 0x0273cf to 0x02920c (0x1e3e bytes) 000921 1788876400.646314 read 0x03bbcd thru 0x03ffff (0x4433 bytes) 000922 1788876400.646814 mapread 0x005a29 thru 0x00bc0a (0x61e2 bytes) 000923 1788876400.647505 mapwrite 0x036d7f thru 0x037212 (0x494 bytes) 000924 1788876400.670981 trunc from 0x040000 to 0x03d998 (0x2667 bytes) 000927 1788876400.686967 read 0x00c383 thru 0x011497 (0x5115 bytes) 000928 1788876400.688263 read 0x00d48d thru 0x018b9d (0xb711 bytes) 000929 1788876400.691956 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x24f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d999): Mirror 12: 0x90286cc1 (stale) Mirror 15: 0xc22773b1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d999): Mirror 12: 0x90286cc1 (stale) Mirror 15: 0xc22773b1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d999: skipped 000930 1788876400.974010 mapread 0x020b14 thru 0x026de1 (0x62ce bytes) 000931 1788876400.999929 punch from 0x008944 to 0x01119c (0x8859 bytes) 000932 1788876401.004956 mapread 0x0081a6 thru 0x01151b (0x9376 bytes) 000933 1788876401.031604 punch from 0x01628e to 0x0250bb (0xee2e bytes) 000934 1788876401.036858 read 0x022534 thru 0x02d493 (0xaf60 bytes) 000935 1788876401.047179 mapread 0x015367 thru 0x01aa9a (0x5734 bytes) 000936 1788876401.057524 punch from 0x0312e4 to 0x031c7d (0x99a bytes) 000937 1788876401.063129 punch from 0x03af52 to 0x03d998 (0x2a47 bytes) 000938 1788876401.066513 write 0x02bcf0 thru 0x03b5d5 (0xf8e6 bytes) 000943 1788876401.074547 mapwrite 0x024efc thru 0x02ee15 (0x9f1a bytes) 000944 1788876401.147908 MIRROR_RESYNC 3 mirrors 000945 1788876401.884955 read 0x0336d5 thru 0x034d7b (0x16a7 bytes) 000946 1788876401.894983 read 0x00a77c thru 0x0115a3 (0x6e28 bytes) 000948 1788876401.907176 mapwrite 0x01cad6 thru 0x025c67 (0x9192 bytes) 000949 1788876402.136827 mapread 0x018518 thru 0x023f59 (0xba42 bytes) 000951 1788876402.163090 punch from 0x000b03 to 0x008ced (0x81eb bytes) 000952 1788876402.169392 mapread 0x03264f thru 0x0337d8 (0x118a bytes) 000953 1788876402.185946 write 0x03efb8 thru 0x03ffff (0x1048 bytes) 000954 1788876402.187480 mapread 0x023cb5 thru 0x02a912 (0x6c5e bytes) 000955 1788876402.244223 mapwrite 0x015e5f thru 0x02238a (0xc52c bytes) 000956 1788876402.308592 punch from 0x03ee33 to 0x03ffff (0x11cd bytes) 000957 1788876402.312910 mapread 0x001fdd thru 0x010b18 (0xeb3c bytes) 000958 1788876402.375374 trunc from 0x040000 to 0x0270de (0x18f21 bytes) 000959 1788876402.414535 mapwrite 0x020fd2 thru 0x02c706 (0xb735 bytes) 000961 1788876402.507407 punch from 0x014c16 to 0x01f05e (0xa449 bytes) 000962 1788876402.516904 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2c707): Mirror 12: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c707): Mirror 12: 0xf11d537a (stale) Mirror 15: 0xf11d537a (stale) CRC-32 checksum value for chunk [0, 0x2c707): Mirror 1: 0x23fe02fc Mirror 16: 0x23fe02fc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c707: skipped 000963 1788876403.441411 punch from 0x0112b0 to 0x018f18 (0x7c69 bytes) 000965 1788876403.516479 punch from 0x018020 to 0x027a9b (0xfa7c bytes) 000966 1788876403.532645 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2c707): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c707): Mirror 12: 0xf11d537a (stale) Mirror 15: 0xf11d537a (stale) Mirror 16: 0x23fe02fc (stale) CRC-32 checksum value for chunk [0, 0x2c707): Mirror 1: 0x978d071 Mirror 17: 0x978d071 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c707: skipped 000967 1788876404.238297 mapread 0x012183 thru 0x0194c9 (0x7347 bytes) 000969 1788876404.260021 write 0x01e1d2 thru 0x025878 (0x76a7 bytes) 000970 1788876404.334726 write 0x029f12 thru 0x0316d0 (0x77bf bytes) 000971 1788876404.338882 read 0x00eccb thru 0x0189af (0x9ce5 bytes) 000972 1788876404.351604 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x24f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x316d1): Mirror 15: 0x1ebd0e6c (stale) Mirror 16: 0xc2e62650 (stale) Mirror 17: 0xa5214573 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x316d1): Mirror 15: 0x1ebd0e6c (stale) Mirror 16: 0xc2e62650 (stale) Mirror 17: 0xa5214573 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x316d1: skipped 000973 1788876404.637965 trunc from 0x0316d1 to 0x013365 (0x1e36b bytes) 000974 1788876404.655494 mapwrite 0x00f24a thru 0x019963 (0xa71a bytes) 000975 1788876404.736074 trunc from 0x019964 to 0x00c573 (0xd3f0 bytes) 000977 1788876404.769075 write 0x02f2e8 thru 0x03f176 (0xfe8f bytes) 000980 1788876404.773367 read 0x030a92 thru 0x038125 (0x7694 bytes) 000981 1788876404.778977 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x24f:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f177): Mirror 16: 0xed5a885a (stale) Mirror 17: 0xcf4eb008 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f177): Mirror 16: 0xed5a885a (stale) Mirror 17: 0xcf4eb008 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f177: skipped 000983 1788876405.171394 mapread 0x0087fc thru 0x017998 (0xf19d bytes) 000989 1788876405.200615 write 0x008225 thru 0x00b004 (0x2de0 bytes) 000990 1788876405.201594 mapwrite 0x008810 thru 0x0185c4 (0xfdb5 bytes) 000992 1788876405.248367 mapread 0x03391e thru 0x03f176 (0xb859 bytes) 000993 1788876405.266617 mapread 0x01fe82 thru 0x02a157 (0xa2d6 bytes) 000994 1788876405.287291 write 0x01a11f thru 0x022295 (0x8177 bytes) 000995 1788876405.288476 read 0x035e73 thru 0x03f176 (0x9304 bytes) 000996 1788876405.292495 trunc from 0x03f177 to 0x007819 (0x3795d bytes) 000997 1788876405.313269 MIRROR_RESYNC 3 mirrors All operations completed A-OK!