== sanity-flr test 70a: flr mode fsx test ================ 12:41:57 (1785775317) Seed set to 5319 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1785775320.270333 mapwrite 0x032bf0 thru 0x03ffff (0xd410 bytes) 000003 1785775320.544493 mapwrite 0x01ab16 thru 0x021639 (0x6b24 bytes) 000005 1785775320.646274 mapread 0x02eb6f thru 0x035044 (0x64d6 bytes) 000006 1785775320.647557 read 0x0251c0 thru 0x02e4bc (0x92fd bytes) 000008 1785775320.666578 read 0x03d9a1 thru 0x03ffff (0x265f bytes) 000010 1785775320.667753 mapread 0x01dd29 thru 0x026e66 (0x913e bytes) 000011 1785775320.699110 mapwrite 0x01fc76 thru 0x029a8c (0x9e17 bytes) 000013 1785775320.810275 mapread 0x0392f0 thru 0x03d47a (0x418b bytes) 000014 1785775320.816292 write 0x018cef thru 0x027c2b (0xef3d bytes) 000015 1785775320.826512 read 0x00438c thru 0x00fa0b (0xb680 bytes) 000016 1785775320.833510 mapwrite 0x0003b3 thru 0x006d6b (0x69b9 bytes) 000018 1785775321.015554 mapread 0x035918 thru 0x03e425 (0x8b0e bytes) 000020 1785775321.017142 write 0x02d328 thru 0x02ea0e (0x16e7 bytes) 000021 1785775321.024176 mapwrite 0x0034c4 thru 0x01327c (0xfdb9 bytes) 000023 1785775321.207600 mapwrite 0x0029a8 thru 0x009230 (0x6889 bytes) truncating to largest ever: 0x11701 000024 1785775321.436928 trunc from 0x040000 to 0x011700 (0x2e8ff bytes) 000025 1785775321.463008 mapwrite 0x0290a3 thru 0x0361f3 (0xd151 bytes) truncating to largest ever: 0x2f6e2 000027 1785775321.789904 trunc from 0x0361f4 to 0x02f6e1 (0x6b12 bytes) 000028 1785775321.832477 trunc from 0x02f6e2 to 0x024c15 (0xaacc bytes) 000029 1785775321.882166 mapwrite 0x03e3bf thru 0x03ffff (0x1c41 bytes) 000030 1785775322.082361 MIRROR_EXTEND to 2 mirrors 000031 1785775323.399884 read 0x0051c6 thru 0x00fa4a (0xa885 bytes) 000032 1785775323.419263 mapread 0x03608f thru 0x03ffff (0x9f71 bytes) 000034 1785775323.521757 mapread 0x016b4a thru 0x01d0ca (0x6581 bytes) 000035 1785775323.587006 write 0x00a4e9 thru 0x00aab9 (0x5d1 bytes) 000036 1785775323.788914 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) truncating to largest ever: 0x309a4 000037 1785775324.076034 trunc from 0x040000 to 0x0309a3 (0xf65c bytes) 000038 1785775324.153527 write 0x01843a thru 0x021810 (0x93d7 bytes) 000041 1785775324.186909 write 0x015cca thru 0x01d853 (0x7b8a bytes) 000043 1785775324.207053 write 0x03c41e thru 0x03fd88 (0x396b bytes) 000044 1785775324.210543 mapread 0x02a464 thru 0x02a7da (0x377 bytes) 000045 1785775324.228668 mapread 0x01e5cc thru 0x0248cc (0x6301 bytes) 000046 1785775324.281571 trunc from 0x03fd89 to 0x018d37 (0x27051 bytes) 000049 1785775324.327332 write 0x01fe7d thru 0x02929c (0x9420 bytes) 000050 1785775324.329041 mapread 0x0238dd thru 0x02929c (0x59c0 bytes) 000051 1785775324.335612 write 0x03a74b thru 0x03ffff (0x58b5 bytes) 000052 1785775324.340482 mapwrite 0x024997 thru 0x025673 (0xcdd bytes) 000053 1785775324.448695 read 0x0136fa thru 0x01bf94 (0x889b bytes) 000054 1785775324.465504 read 0x03c5db thru 0x03e766 (0x218c bytes) 000056 1785775324.469440 read 0x03a4f6 thru 0x03ffff (0x5b0a bytes) 000057 1785775324.474876 mapread 0x03dc73 thru 0x03ffff (0x238d bytes) 000061 1785775324.489974 trunc from 0x040000 to 0x02a2e5 (0x15d1a bytes) truncating to largest ever: 0x3527a 000064 1785775324.524598 trunc from 0x02a2e6 to 0x035279 (0xaf94 bytes) 000065 1785775324.560874 write 0x012bad thru 0x016c3e (0x4092 bytes) 000068 1785775324.570745 write 0x02cf11 thru 0x030271 (0x3361 bytes) 000070 1785775324.579170 mapread 0x02a260 thru 0x03034e (0x60ef bytes) 000073 1785775324.585663 mapwrite 0x023e94 thru 0x0248ac (0xa19 bytes) 000077 1785775324.670029 trunc from 0x03527a to 0x00e85e (0x26a1b bytes) 000080 1785775324.700188 trunc from 0x00e85f to 0x01e6f7 (0xfe99 bytes) 000081 1785775324.748655 trunc from 0x01e6f8 to 0x0220c1 (0x39ca bytes) 000082 1785775324.770981 mapread 0x011462 thru 0x0159dd (0x457c bytes) 000083 1785775324.813452 mapread 0x00fae2 thru 0x011ed5 (0x23f4 bytes) 000084 1785775324.829704 mapread 0x00b675 thru 0x010620 (0x4fac bytes) 000085 1785775324.836446 mapwrite 0x003549 thru 0x00c5ad (0x9065 bytes) truncating to largest ever: 0x3cbdc 000088 1785775324.955607 trunc from 0x0220c2 to 0x03cbdb (0x1ab1a bytes) 000089 1785775324.991396 write 0x00574b thru 0x007560 (0x1e16 bytes) 000091 1785775324.995531 mapwrite 0x020b58 thru 0x024ef7 (0x43a0 bytes) 000093 1785775325.229381 write 0x012b01 thru 0x0191a1 (0x66a1 bytes) 000095 1785775325.261423 trunc from 0x03cbdc to 0x006ce3 (0x35ef8 bytes) 000096 1785775325.296512 read 0x00533b thru 0x006ce3 (0x19a9 bytes) 000097 1785775325.317622 MIRROR_EXTEND to 2 mirrors 000098 1785775325.901202 read 0x000d50 thru 0x006ce3 (0x5f94 bytes) 000101 1785775325.916997 mapread 0x0052bc thru 0x006ce3 (0x1a28 bytes) 000104 1785775325.932398 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) 000105 1785775326.154331 read 0x004878 thru 0x004999 (0x122 bytes) 000108 1785775326.176518 mapwrite 0x03ec6e thru 0x03fe47 (0x11da bytes) 000109 1785775326.413888 trunc from 0x03fe48 to 0x016a3f (0x29408 bytes) 000110 1785775326.429517 trunc from 0x016a40 to 0x00a5b7 (0xc488 bytes) 000111 1785775326.470571 read 0x0074d7 thru 0x00a5b7 (0x30e1 bytes) 000112 1785775326.482264 read 0x0043ff thru 0x00a5b7 (0x61b9 bytes) 000113 1785775326.484257 mapread 0x002807 thru 0x00a5b7 (0x7db1 bytes) 000116 1785775326.490507 read 0x007507 thru 0x00a5b7 (0x30b1 bytes) 000118 1785775326.491463 mapwrite 0x0375c9 thru 0x038b37 (0x156f bytes) 000121 1785775326.674221 mapread 0x02c075 thru 0x034df6 (0x8d82 bytes) 000122 1785775326.687392 trunc from 0x038b38 to 0x014e93 (0x23ca4 bytes) 000125 1785775326.722347 read 0x00aff0 thru 0x010268 (0x5279 bytes) 000127 1785775326.723651 write 0x03819a thru 0x03ffff (0x7e66 bytes) 000129 1785775326.733638 mapread 0x004de2 thru 0x0105e6 (0xb805 bytes) 000132 1785775326.743694 write 0x00a578 thru 0x010004 (0x5a8d bytes) 000135 1785775326.759756 MIRROR_EXTEND to 2 mirrors 000136 1785775328.413312 MIRROR_EXTEND to 3 mirrors 000137 1785775329.639907 mapwrite 0x005dd4 thru 0x00b811 (0x5a3e bytes) 000139 1785775329.838052 read 0x00cc21 thru 0x013f9d (0x737d bytes) 000140 1785775329.844958 trunc from 0x040000 to 0x003274 (0x3cd8b bytes) 000141 1785775329.868843 read 0x001a71 thru 0x003274 (0x1804 bytes) 000142 1785775329.874267 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3275): Mirror 3: 0x48f6e1e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3275): Mirror 3: 0x48f6e1e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3275: skipped 000143 1785775330.536209 trunc from 0x003275 to 0x00a17a (0x6f06 bytes) 000144 1785775330.564871 write 0x0089f1 thru 0x009d38 (0x1348 bytes) 000146 1785775330.584932 mapwrite 0x00eaf3 thru 0x01c2cc (0xd7da bytes) 000148 1785775330.869067 trunc from 0x01c2cd to 0x02a1db (0xdf0f bytes) 000149 1785775330.907440 read 0x028405 thru 0x02a1db (0x1dd7 bytes) 000150 1785775330.924428 mapwrite 0x01ec84 thru 0x023513 (0x4890 bytes) 000153 1785775331.083363 read 0x012e00 thru 0x01aa7a (0x7c7b bytes) 000155 1785775331.089066 write 0x017637 thru 0x01b0aa (0x3a74 bytes) 000156 1785775331.094512 write 0x01b738 thru 0x02a3a6 (0xec6f bytes) 000157 1785775331.098178 write 0x0061ff thru 0x012230 (0xc032 bytes) 000159 1785775331.128379 trunc from 0x02a3a7 to 0x020f61 (0x9445 bytes) 000161 1785775331.184019 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) 000163 1785775331.352372 trunc from 0x020f62 to 0x0012a0 (0x1fcc1 bytes) 000164 1785775331.385516 write 0x02eea0 thru 0x03c2b8 (0xd419 bytes) 000165 1785775331.393713 read 0x018b47 thru 0x02448f (0xb949 bytes) 000167 1785775331.417547 trunc from 0x03c2b9 to 0x0242c1 (0x17ff7 bytes) 000170 1785775331.444170 MIRROR_EXTEND to 2 mirrors 000171 1785775333.745860 write 0x0230ce thru 0x02973a (0x666d bytes) 000173 1785775334.015895 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2973b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2973b): Mirror 2: 0x2dc77bf1 (stale) CRC-32 checksum value for chunk [0, 0x2973b): Mirror 1: 0x36a28d58 Mirror 3: 0x36a28d58 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2973b: skipped 000174 1785775336.321589 mapwrite 0x027a66 thru 0x0294cf (0x1a6a bytes) 000177 1785775336.671017 mapwrite 0x01c9a6 thru 0x029340 (0xc99b bytes) 000179 1785775336.767299 mapwrite 0x00d4b7 thru 0x011727 (0x4271 bytes) 000180 1785775336.846389 mapwrite 0x018bc5 thru 0x025520 (0xc95c bytes) 000182 1785775336.938917 MIRROR_RESYNC 3 mirrors 000184 1785775338.125419 write 0x00dd54 thru 0x01abc0 (0xce6d bytes) truncating to largest ever: 0x3fb3a 000187 1785775338.375191 trunc from 0x02973b to 0x03fb39 (0x163ff bytes) 000188 1785775338.412704 mapread 0x00de03 thru 0x017aa1 (0x9c9f bytes) 000189 1785775338.417377 read 0x00b39c thru 0x012ca7 (0x790c bytes) 000190 1785775338.429239 trunc from 0x03fb3a to 0x031b2d (0xe00c bytes) 000191 1785775338.461358 read 0x02c0d4 thru 0x031b2d (0x5a5a bytes) 000192 1785775338.497706 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x31b2e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31b2e): Mirror 2: 0xc24f7e53 (stale) Mirror 3: 0xc24f7e53 (stale) CRC-32 checksum value for chunk [0, 0x31b2e): Mirror 1: 0x3cafe4fc Mirror 4: 0x3cafe4fc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31b2e: skipped 000194 1785775341.110268 write 0x0149c5 thru 0x0176c8 (0x2d04 bytes) 000195 1785775341.396131 mapread 0x013964 thru 0x018090 (0x472d bytes) 000196 1785775341.464127 write 0x00abe5 thru 0x00d571 (0x298d bytes) 000197 1785775341.494042 mapwrite 0x02185d thru 0x02e63d (0xcde1 bytes) 000200 1785775341.729613 write 0x021edb thru 0x02c856 (0xa97c bytes) 000201 1785775341.733677 mapread 0x02c129 thru 0x031b2d (0x5a05 bytes) 000202 1785775341.739676 write 0x027030 thru 0x030341 (0x9312 bytes) 000203 1785775341.747137 read 0x00c701 thru 0x00e069 (0x1969 bytes) 000204 1785775341.767029 read 0x005fea thru 0x00adf7 (0x4e0e bytes) 000206 1785775341.787697 trunc from 0x031b2e to 0x01c635 (0x154f8 bytes) 000207 1785775341.831913 write 0x01f4b2 thru 0x02817c (0x8ccb bytes) 000209 1785775341.838097 mapwrite 0x01b8a0 thru 0x01e6bd (0x2e1e bytes) 000211 1785775342.027930 write 0x0203d9 thru 0x022ece (0x2af6 bytes) 000212 1785775342.030161 write 0x00717e thru 0x016e29 (0xfcac bytes) 000213 1785775342.037513 read 0x00ca85 thru 0x00f83d (0x2db9 bytes) 000214 1785775342.041618 mapwrite 0x027d8c thru 0x02bb77 (0x3dec bytes) 000215 1785775342.291216 mapread 0x002677 thru 0x00b218 (0x8ba2 bytes) 000216 1785775342.295616 mapwrite 0x02b501 thru 0x02e9c4 (0x34c4 bytes) 000217 1785775342.502614 read 0x01415c thru 0x0155f9 (0x149e bytes) 000218 1785775342.504101 write 0x000461 thru 0x0064ef (0x608f bytes) 000219 1785775342.512365 trunc from 0x02e9c5 to 0x03f0eb (0x10727 bytes) 000220 1785775342.577457 mapread 0x01bc91 thru 0x01e39a (0x270a bytes) 000221 1785775342.580477 write 0x00af9d thru 0x016d03 (0xbd67 bytes) 000222 1785775342.589299 write 0x03c04f thru 0x03ffff (0x3fb1 bytes) 000224 1785775342.616971 MIRROR_RESYNC 4 mirrors 000225 1785775344.821542 MIRROR_RESYNC 4 mirrors 000231 1785775346.032444 trunc from 0x040000 to 0x035740 (0xa8bf bytes) 000233 1785775346.336606 mapread 0x025712 thru 0x03357d (0xde6c bytes) 000234 1785775346.396102 mapread 0x00c748 thru 0x0179df (0xb298 bytes) 000235 1785775346.430602 mapread 0x01c9e5 thru 0x01e59a (0x1bb6 bytes) 000240 1785775346.453195 read 0x029370 thru 0x035740 (0xc3d1 bytes) 000243 1785775346.467084 trunc from 0x035741 to 0x01be66 (0x198da bytes) 000247 1785775346.563500 mapwrite 0x00f83b thru 0x010f74 (0x173a bytes) 000249 1785775346.839245 write 0x0208a3 thru 0x02d99a (0xd0f8 bytes) 000252 1785775346.849990 read 0x00eb98 thru 0x014723 (0x5b8c bytes) 000253 1785775346.853113 trunc from 0x02d99b to 0x0134e1 (0x1a4b9 bytes) 000254 1785775346.892395 write 0x01dcdb thru 0x0278b5 (0x9bdb bytes) 000255 1785775346.893739 mapread 0x027613 thru 0x0278b5 (0x2a3 bytes) 000257 1785775346.897065 read 0x004dec thru 0x005d9f (0xfb4 bytes) 000261 1785775346.907279 write 0x00128b thru 0x00db64 (0xc8da bytes) 000263 1785775346.911152 mapread 0x017c77 thru 0x025fc4 (0xe34e bytes) 000264 1785775346.913271 read 0x008f13 thru 0x00a328 (0x1416 bytes) 000265 1785775346.914291 write 0x038627 thru 0x03d103 (0x4add bytes) 000266 1785775346.916254 mapread 0x024a91 thru 0x02c84f (0x7dbf bytes) 000267 1785775346.926465 read 0x0030e1 thru 0x00e914 (0xb834 bytes) 000268 1785775346.927373 trunc from 0x03d104 to 0x029b93 (0x13570 bytes) 000269 1785775346.961090 read 0x000945 thru 0x00edc3 (0xe47f bytes) 000271 1785775346.965898 trunc from 0x029b94 to 0x014528 (0x1566b bytes) 000273 1785775346.991436 write 0x01d0ec thru 0x0224c3 (0x53d8 bytes) 000274 1785775346.993883 mapwrite 0x014f5e thru 0x020bad (0xbc50 bytes) 000277 1785775347.106324 MIRROR_RESYNC 4 mirrors 000279 1785775348.472593 mapwrite 0x003be6 thru 0x00b6d3 (0x7aee bytes) 000282 1785775348.656199 read 0x00736d thru 0x008f58 (0x1bec bytes) 000284 1785775348.659126 mapwrite 0x0196d2 thru 0x028475 (0xeda4 bytes) 000285 1785775348.752845 MIRROR_RESYNC 4 mirrors 000288 1785775349.917584 MIRROR_RESYNC 4 mirrors 000290 1785775350.484145 read 0x000017 thru 0x000e2c (0xe16 bytes) 000296 1785775350.491278 read 0x0149fd thru 0x0158e3 (0xee7 bytes) 000297 1785775350.517244 write 0x0060d8 thru 0x01431f (0xe248 bytes) 000298 1785775350.676407 mapwrite 0x00687c thru 0x0090f6 (0x287b bytes) 000299 1785775350.782268 write 0x011710 thru 0x012040 (0x931 bytes) 000300 1785775350.784909 read 0x021d0c thru 0x025f08 (0x41fd bytes) 000304 1785775350.801596 mapwrite 0x008d2c thru 0x01819c (0xf471 bytes) 000305 1785775350.969889 trunc from 0x028476 to 0x039d56 (0x118e1 bytes) 000306 1785775351.023045 mapread 0x020405 thru 0x02373b (0x3337 bytes) 000307 1785775351.024119 mapwrite 0x034240 thru 0x03ffff (0xbdc0 bytes) 000308 1785775351.157563 write 0x03bf00 thru 0x03ffff (0x4100 bytes) 000310 1785775351.163552 write 0x01cc9d thru 0x0241ce (0x7532 bytes) 000313 1785775351.178014 MIRROR_RESYNC 4 mirrors 000314 1785775352.774808 MIRROR_RESYNC 4 mirrors 000315 1785775353.487727 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) 000317 1785775353.997104 trunc from 0x040000 to 0x00e105 (0x31efa bytes) 000320 1785775354.179898 mapread 0x00d6f1 thru 0x00e105 (0xa15 bytes) 000321 1785775354.205522 read 0x0099e2 thru 0x00dbf5 (0x4214 bytes) 000322 1785775354.220985 trunc from 0x00e106 to 0x00c725 (0x19e0 bytes) 000326 1785775354.267677 mapread 0x00388e thru 0x00c17d (0x88f0 bytes) 000327 1785775354.279226 write 0x03a2e3 thru 0x03ffff (0x5d1d bytes) 000328 1785775354.289299 read 0x0347fd thru 0x036732 (0x1f36 bytes) 000329 1785775354.311646 trunc from 0x040000 to 0x00f477 (0x30b88 bytes) 000330 1785775354.366203 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xf478): Mirror 4: 0x9269fc5f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf478): Mirror 4: 0x9269fc5f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf478: skipped 000332 1785775354.891062 mapread 0x00d325 thru 0x00f477 (0x2153 bytes) 000335 1785775354.941223 trunc from 0x00f478 to 0x03931e (0x29ea7 bytes) 000336 1785775354.962750 mapread 0x02a9a9 thru 0x030788 (0x5de0 bytes) 000337 1785775354.987876 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3931f): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3931f): Mirror 4: 0xa35969ab (stale) CRC-32 checksum value for chunk [0, 0x3931f): Mirror 1: 0x74e496cc Mirror 5: 0x74e496cc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3931f: skipped 000339 1785775357.087948 mapread 0x012b26 thru 0x020916 (0xddf1 bytes) 000342 1785775357.251443 mapread 0x01afc8 thru 0x0259d8 (0xaa11 bytes) 000344 1785775357.316959 mapread 0x0392a0 thru 0x03931e (0x7f bytes) 000345 1785775357.409272 read 0x0287d2 thru 0x02bde6 (0x3615 bytes) 000348 1785775357.484756 read 0x019304 thru 0x02568a (0xc387 bytes) 000352 1785775357.558645 write 0x030fb0 thru 0x0336b6 (0x2707 bytes) 000354 1785775357.829507 write 0x0388e3 thru 0x03ffff (0x771d bytes) 000357 1785775357.839541 MIRROR_RESYNC 3 mirrors 000360 1785775359.516917 trunc from 0x040000 to 0x02cd81 (0x1327e bytes) 000361 1785775359.635943 mapwrite 0x03ead0 thru 0x03ffff (0x1530 bytes) 000363 1785775359.835882 mapwrite 0x030992 thru 0x03f1f0 (0xe85f bytes) 000364 1785775360.002402 MIRROR_RESYNC 3 mirrors 000367 1785775361.358287 trunc from 0x040000 to 0x00a36a (0x35c95 bytes) 000368 1785775361.423382 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xa36b): Mirror 5: 0xfc9ecd40 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa36b): Mirror 5: 0xfc9ecd40 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa36b: skipped 000370 1785775361.657857 mapwrite 0x03c001 thru 0x03ffff (0x3fff bytes) 000373 1785775361.788644 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xb4ba5fb0 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb6b09d1f Mirror 6: 0xb6b09d1f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000374 1785775363.239298 trunc from 0x040000 to 0x01cd42 (0x232bd bytes) 000375 1785775363.378868 trunc from 0x01cd43 to 0x00eae0 (0xe262 bytes) 000376 1785775363.413829 read 0x0066ef thru 0x00eae0 (0x83f2 bytes) 000377 1785775363.424315 trunc from 0x00eae1 to 0x01455b (0x5a7b bytes) 000378 1785775363.445514 write 0x007c0a thru 0x016100 (0xe4f7 bytes) 000380 1785775363.456123 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x16101): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16101): Mirror 5: 0xf9ce4bf8 (stale) Mirror 6: 0x4a632dd0 (stale) CRC-32 checksum value for chunk [0, 0x16101): Mirror 1: 0x9818d0af Mirror 7: 0x9818d0af lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16101: skipped 000382 1785775364.619592 write 0x011395 thru 0x013e60 (0x2acc bytes) 000385 1785775364.862574 mapwrite 0x025501 thru 0x029521 (0x4021 bytes) 000388 1785775365.167910 mapread 0x00b607 thru 0x011d39 (0x6733 bytes) 000391 1785775365.219872 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x29522): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29522): Mirror 5: 0xf652b067 (stale) Mirror 6: 0x915d8812 (stale) Mirror 7: 0x1fa9dc37 (stale) CRC-32 checksum value for chunk [0, 0x29522): Mirror 1: 0xedc2a91b Mirror 8: 0xedc2a91b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29522: skipped 000394 1785775367.066418 trunc from 0x029522 to 0x02349c (0x6085 bytes) 000395 1785775367.358074 mapwrite 0x01bfa0 thru 0x02707c (0xb0dd bytes) 000396 1785775367.596068 write 0x039f31 thru 0x03c6be (0x278e bytes) 000397 1785775367.604908 mapread 0x02c2ef thru 0x03a968 (0xe67a bytes) 000401 1785775367.648488 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c6bf): Mirror 6: 0x80114c3a (stale) Mirror 7: 0x8600ba94 (stale) Mirror 8: 0x37fec051 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c6bf): Mirror 6: 0x80114c3a (stale) Mirror 7: 0x8600ba94 (stale) Mirror 8: 0x37fec051 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c6bf: skipped 000403 1785775368.313385 trunc from 0x03c6bf to 0x020b85 (0x1bb39 bytes) 000404 1785775368.354355 MIRROR_RESYNC 4 mirrors 000405 1785775370.351518 mapread 0x01d05d thru 0x020b85 (0x3b29 bytes) 000406 1785775370.424149 trunc from 0x020b86 to 0x005a90 (0x1b0f5 bytes) 000407 1785775370.615882 mapread 0x000fce thru 0x005a90 (0x4ac3 bytes) 000408 1785775370.636081 write 0x02c856 thru 0x0332a0 (0x6a4b bytes) 000409 1785775370.641827 mapread 0x02f272 thru 0x0327d9 (0x3568 bytes) 000411 1785775370.653853 mapread 0x027ffe thru 0x029317 (0x131a bytes) 000414 1785775370.694604 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x332a1): Mirror 7: 0xea2c2fa9 (stale) Mirror 8: 0xea2c2fa9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x332a1): Mirror 7: 0xea2c2fa9 (stale) Mirror 8: 0xea2c2fa9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x332a1: skipped 000415 1785775371.221701 MIRROR_RESYNC 3 mirrors 000417 1785775372.163549 mapread 0x01f7cc thru 0x022bf5 (0x342a bytes) 000418 1785775372.181329 mapread 0x019135 thru 0x01da7f (0x494b bytes) 000420 1785775372.190357 trunc from 0x0332a1 to 0x005188 (0x2e118 bytes) 000421 1785775372.244289 trunc from 0x005189 to 0x01828e (0x13106 bytes) 000423 1785775372.259738 read 0x004af3 thru 0x0107a5 (0xbcb3 bytes) 000424 1785775372.268089 mapread 0x0043f1 thru 0x00d03c (0x8c4c bytes) 000425 1785775372.269540 read 0x00f9c1 thru 0x01828e (0x88ce bytes) 000426 1785775372.277686 write 0x01a035 thru 0x02063e (0x660a bytes) 000428 1785775372.280145 write 0x027231 thru 0x032457 (0xb227 bytes) 000430 1785775372.282196 write 0x021547 thru 0x0220bf (0xb79 bytes) 000431 1785775372.288008 mapread 0x0017d2 thru 0x00c8b7 (0xb0e6 bytes) 000433 1785775372.290348 read 0x027810 thru 0x02dd42 (0x6533 bytes) 000434 1785775372.291055 mapread 0x02e6ed thru 0x02f75f (0x1073 bytes) 000437 1785775372.293447 mapread 0x02c706 thru 0x032457 (0x5d52 bytes) 000438 1785775372.298390 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x32458): Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32458): Mirror 7: 0x7f78884c (stale) Mirror 8: 0x7f78884c (stale) CRC-32 checksum value for chunk [0, 0x32458): Mirror 1: 0x663443b3 Mirror 9: 0x663443b3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32458: skipped 000442 1785775373.047467 trunc from 0x032458 to 0x0099ea (0x28a6d bytes) 000443 1785775373.162535 write 0x02850c thru 0x03064b (0x8140 bytes) 000449 1785775373.169681 mapwrite 0x03c0a8 thru 0x03ffff (0x3f58 bytes) 000450 1785775373.258761 mapwrite 0x01a374 thru 0x025b27 (0xb7b4 bytes) 000451 1785775373.409365 mapwrite 0x03a7af thru 0x03ffff (0x5851 bytes) 000454 1785775373.636648 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xdb5b7a01 (stale) Mirror 8: 0xdb5b7a01 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xdb5b7a01 (stale) Mirror 8: 0xdb5b7a01 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000462 1785775373.978623 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xdb5b7a01 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xdb5b7a01 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000467 1785775374.210694 trunc from 0x040000 to 0x03111f (0xeee0 bytes) 000469 1785775374.227553 write 0x0142d0 thru 0x01aed9 (0x6c0a bytes) 000473 1785775374.237907 mapread 0x01113d thru 0x01e5c4 (0xd488 bytes) 000474 1785775374.265513 MIRROR_RESYNC 2 mirrors 000477 1785775375.027537 mapwrite 0x02605c thru 0x027a1a (0x19bf bytes) 000478 1785775375.194967 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x31120): Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31120): Mirror 8: 0x89114637 (stale) CRC-32 checksum value for chunk [0, 0x31120): Mirror 1: 0x28e2410c Mirror 9: 0x28e2410c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31120: skipped 000480 1785775376.165383 trunc from 0x031120 to 0x004699 (0x2ca86 bytes) 000481 1785775376.275391 MIRROR_RESYNC 3 mirrors 000484 1785775377.675083 trunc from 0x00469a to 0x03d2cb (0x38c32 bytes) 000487 1785775377.886695 read 0x00c957 thru 0x00e7f5 (0x1e9f bytes) 000488 1785775377.908360 trunc from 0x03d2cc to 0x000cb6 (0x3c615 bytes) 000489 1785775377.963647 read 0x000b31 thru 0x000cb6 (0x186 bytes) 000490 1785775377.984321 mapread 0x000657 thru 0x000cb6 (0x660 bytes) 000491 1785775377.986991 read 0x0001fd thru 0x000cb6 (0xaba bytes) 000492 1785775377.995920 read 0x0006e8 thru 0x000cb6 (0x5cf bytes) 000493 1785775378.013919 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xcb7): Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xcb7): Mirror 8: 0xf99ebba4 (stale) Mirror 9: 0xf99ebba4 (stale) CRC-32 checksum value for chunk [0, 0xcb7): Mirror 1: 0xf99ebba4 Mirror 10: 0xf99ebba4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xcb7: skipped 000494 1785775379.707535 mapwrite 0x00ae6a thru 0x00bc2e (0xdc5 bytes) 000496 1785775380.099384 read 0x0064f5 thru 0x00a607 (0x4113 bytes) 000497 1785775380.118051 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xbc2f): Mirror 8: 0x7689f79b (stale) Mirror 9: 0x7689f79b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xbc2f): Mirror 8: 0x7689f79b (stale) Mirror 9: 0x7689f79b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xbc2f: skipped 000498 1785775380.836347 trunc from 0x00bc2f to 0x007bad (0x4081 bytes) 000499 1785775380.906333 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x7bae): Mirror 9: 0xaea62ed5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x7bae): Mirror 9: 0xaea62ed5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x7bae: skipped 000500 1785775381.667453 trunc from 0x007bae to 0x008a8b (0xede bytes) 000501 1785775381.746347 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x8a8c): Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8a8c): Mirror 9: 0xd3795484 (stale) CRC-32 checksum value for chunk [0, 0x8a8c): Mirror 1: 0x3d446178 Mirror 10: 0x3d446178 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8a8c: skipped 000502 1785775384.057328 mapwrite 0x02b397 thru 0x02dfef (0x2c59 bytes) 000503 1785775384.560739 MIRROR_RESYNC 3 mirrors 000504 1785775387.403715 write 0x01a973 thru 0x01ebbb (0x4249 bytes) 000505 1785775387.653863 read 0x0128f7 thru 0x01c291 (0x999b bytes) 000507 1785775387.699170 mapwrite 0x028ed9 thru 0x031316 (0x843e bytes) 000508 1785775388.562604 MIRROR_RESYNC 3 mirrors 000510 1785775391.010461 write 0x01dc7f thru 0x022975 (0x4cf7 bytes) 000513 1785775391.278862 mapread 0x022a6c thru 0x02c59b (0x9b30 bytes) 000514 1785775391.335920 write 0x01a2d7 thru 0x022d57 (0x8a81 bytes) 000515 1785775391.374971 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x31317): Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31317): Mirror 9: 0xf6ac3544 (stale) Mirror 10: 0xf6ac3544 (stale) CRC-32 checksum value for chunk [0, 0x31317): Mirror 1: 0xdd8c6c54 Mirror 11: 0xdd8c6c54 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31317: skipped 000516 1785775394.304935 mapread 0x01586d thru 0x01fd78 (0xa50c bytes) 000517 1785775394.426953 read 0x0068a4 thru 0x00a48b (0x3be8 bytes) 000519 1785775394.571490 MIRROR_RESYNC 4 mirrors 000520 1785775397.216728 read 0x01d4e7 thru 0x02ab97 (0xd6b1 bytes) 000521 1785775397.231454 write 0x019019 thru 0x020250 (0x7238 bytes) 000523 1785775397.354363 mapread 0x014190 thru 0x0193fc (0x526d bytes) 000524 1785775397.394595 MIRROR_RESYNC 4 mirrors 000525 1785775399.691207 MIRROR_RESYNC 4 mirrors 000527 1785775400.465597 MIRROR_EXTEND to 5 mirrors 000528 1785775401.890740 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) 000529 1785775402.492164 read 0x030155 thru 0x031316 (0x11c2 bytes) 000530 1785775402.545707 read 0x025816 thru 0x030bf4 (0xb3df bytes) 000531 1785775402.569609 mapread 0x0057f9 thru 0x00fc93 (0xa49b bytes) 000532 1785775402.587360 mapwrite 0x0201b1 thru 0x022739 (0x2589 bytes) 000533 1785775402.746333 mapread 0x0287bf thru 0x031316 (0x8b58 bytes) 000536 1785775402.843861 mapwrite 0x00ea0b thru 0x0124e5 (0x3adb bytes) 000537 1785775402.984420 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x31317): Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31317): Mirror 9: 0xcb36aa9f (stale) Mirror 11: 0xcb36aa9f (stale) Mirror 12: 0xcb36aa9f (stale) CRC-32 checksum value for chunk [0, 0x31317): Mirror 1: 0xbe7503ef Mirror 13: 0xbe7503ef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31317: skipped 000539 1785775404.144462 mapwrite 0x01446f thru 0x014f88 (0xb1a bytes) 000542 1785775404.508254 write 0x020a75 thru 0x026fd8 (0x6564 bytes) 000546 1785775404.539721 trunc from 0x031317 to 0x0115b6 (0x1fd60 bytes) 000548 1785775404.591349 mapread 0x00de92 thru 0x0115b6 (0x3725 bytes) 000549 1785775404.602024 write 0x016391 thru 0x01c1c8 (0x5e38 bytes) 000553 1785775404.606465 read 0x018297 thru 0x01c1c8 (0x3f32 bytes) 000554 1785775404.607246 mapread 0x00a33b thru 0x0178c8 (0xd58e bytes) 000555 1785775404.618106 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1c1c9): Mirror 11: 0xa0802569 (stale) Mirror 12: 0xa0802569 (stale) Mirror 13: 0x49ffd2a5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c1c9): Mirror 11: 0xa0802569 (stale) Mirror 12: 0xa0802569 (stale) Mirror 13: 0x49ffd2a5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c1c9: skipped 000556 1785775404.940270 write 0x017cee thru 0x01b4e5 (0x37f8 bytes) 000557 1785775404.950582 trunc from 0x01c1c9 to 0x01224c (0x9f7c bytes) 000559 1785775404.971031 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1224d): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1224d): Mirror 11: 0x5f20347a (stale) Mirror 12: 0x5f20347a (stale) Mirror 13: 0x81490a3f (stale) CRC-32 checksum value for chunk [0, 0x1224d): Mirror 1: 0x32e304b0 Mirror 14: 0x32e304b0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1224d: skipped 000560 1785775405.867046 mapread 0x007dc9 thru 0x00bc61 (0x3e99 bytes) 000565 1785775405.892459 MIRROR_RESYNC 5 mirrors 000566 1785775407.112881 MIRROR_EXTEND to 6 mirrors 000568 1785775407.721543 trunc from 0x01224d to 0x026abd (0x14871 bytes) 000571 1785775407.792948 read 0x0019fb thru 0x00ce48 (0xb44e bytes) 000573 1785775407.817237 trunc from 0x026abe to 0x03226f (0xb7b2 bytes) 000575 1785775407.846117 mapwrite 0x032e04 thru 0x0393f0 (0x65ed bytes) 000576 1785775407.919766 mapread 0x01d129 thru 0x026055 (0x8f2d bytes) 000577 1785775407.945077 mapwrite 0x035e87 thru 0x03ac34 (0x4dae bytes) 000579 1785775408.005087 trunc from 0x03ac35 to 0x014c5b (0x25fd9 bytes) 000580 1785775408.024477 mapread 0x00f5cd thru 0x014c5b (0x568f bytes) 000581 1785775408.032812 read 0x00c3ec thru 0x00e347 (0x1f5c bytes) 000583 1785775408.034839 trunc from 0x014c5c to 0x03c465 (0x2780a bytes) 000584 1785775408.058024 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3c466): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c466): Mirror 11: 0x8e92e275 (stale) Mirror 12: 0x8e92e275 (stale) Mirror 13: 0x8e92e275 (stale) Mirror 14: 0x8e92e275 (stale) Mirror 15: 0x8e92e275 (stale) CRC-32 checksum value for chunk [0, 0x3c466): Mirror 1: 0x8e92e275 Mirror 16: 0x8e92e275 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c466: skipped 000587 1785775410.987128 mapread 0x01b4fe thru 0x01f1a3 (0x3ca6 bytes) 000588 1785775411.050906 mapwrite 0x0202ef thru 0x0248fa (0x460c bytes) 000592 1785775411.463167 MIRROR_RESYNC 7 mirrors 000593 1785775414.617918 mapread 0x023038 thru 0x0299ac (0x6975 bytes) 000594 1785775414.650120 write 0x01c769 thru 0x01d3b8 (0xc50 bytes) 000596 1785775414.843035 write 0x025b6b thru 0x0350b0 (0xf546 bytes) 000598 1785775414.879704 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c466): Mirror 11: 0x91d602a8 (stale) Mirror 12: 0x91d602a8 (stale) Mirror 13: 0x91d602a8 (stale) Mirror 14: 0x91d602a8 (stale) Mirror 15: 0x91d602a8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c466): Mirror 11: 0x91d602a8 (stale) Mirror 12: 0x91d602a8 (stale) Mirror 13: 0x91d602a8 (stale) Mirror 14: 0x91d602a8 (stale) Mirror 15: 0x91d602a8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c466: skipped 000599 1785775415.824432 read 0x003600 thru 0x0066cc (0x30cd bytes) 000601 1785775415.837327 mapwrite 0x0065c6 thru 0x00ece5 (0x8720 bytes) 000602 1785775416.116512 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c466): Mirror 11: 0x91d602a8 (stale) Mirror 12: 0x91d602a8 (stale) Mirror 13: 0x91d602a8 (stale) Mirror 14: 0x91d602a8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c466): Mirror 11: 0x91d602a8 (stale) Mirror 12: 0x91d602a8 (stale) Mirror 13: 0x91d602a8 (stale) Mirror 14: 0x91d602a8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c466: skipped 000604 1785775416.749469 read 0x013a54 thru 0x014895 (0xe42 bytes) 000605 1785775416.754918 write 0x00618e thru 0x006f70 (0xde3 bytes) 000606 1785775416.765073 mapread 0x033598 thru 0x034389 (0xdf2 bytes) 000607 1785775416.778202 write 0x034a5c thru 0x037e99 (0x343e bytes) 000608 1785775416.798086 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3c466): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c466): Mirror 11: 0x91d602a8 (stale) Mirror 12: 0x91d602a8 (stale) Mirror 13: 0x91d602a8 (stale) Mirror 14: 0x91d602a8 (stale) CRC-32 checksum value for chunk [0, 0x3c466): Mirror 1: 0xf895600d Mirror 15: 0xf895600d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c466: skipped 000609 1785775417.632841 read 0x00059c thru 0x007cf2 (0x7757 bytes) 000610 1785775417.649880 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3c466): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c466): Mirror 11: 0x91d602a8 (stale) Mirror 12: 0x91d602a8 (stale) Mirror 13: 0x91d602a8 (stale) Mirror 14: 0x91d602a8 (stale) CRC-32 checksum value for chunk [0, 0x3c466): Mirror 1: 0xf895600d Mirror 15: 0xf895600d Mirror 16: 0xf895600d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c466: skipped 000614 1785775418.652362 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3c466): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c466): Mirror 11: 0x91d602a8 (stale) Mirror 12: 0x91d602a8 (stale) Mirror 13: 0x91d602a8 (stale) Mirror 14: 0x91d602a8 (stale) CRC-32 checksum value for chunk [0, 0x3c466): Mirror 1: 0xf895600d Mirror 15: 0xf895600d Mirror 16: 0xf895600d Mirror 17: 0xf895600d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c466: skipped 000616 1785775420.185250 write 0x0204c7 thru 0x0264d3 (0x600d bytes) 000618 1785775420.269642 write 0x0308a1 thru 0x03cb7a (0xc2da bytes) 000619 1785775420.279656 read 0x01c0c5 thru 0x028d01 (0xcc3d bytes) 000622 1785775420.295251 MIRROR_RESYNC 8 mirrors 000623 1785775422.440295 read 0x030391 thru 0x033954 (0x35c4 bytes) 000624 1785775422.448600 mapwrite 0x01ddd6 thru 0x020125 (0x2350 bytes) 000626 1785775422.915989 trunc from 0x03cb7b to 0x03135b (0xb81f bytes) 000630 1785775422.966305 write 0x022fb8 thru 0x030920 (0xd969 bytes) 000638 1785775422.989927 mapread 0x018867 thru 0x027102 (0xe89c bytes) 000639 1785775422.994909 mapread 0x026f68 thru 0x0293af (0x2448 bytes) 000640 1785775422.999317 read 0x00c84d thru 0x0114fb (0x4caf bytes) 000641 1785775423.015402 mapwrite 0x039a91 thru 0x03fce6 (0x6256 bytes) 000642 1785775423.325064 read 0x01e286 thru 0x02b176 (0xcef1 bytes) 000644 1785775423.326365 write 0x007550 thru 0x00cdda (0x588b bytes) 000647 1785775423.335457 write 0x02449d thru 0x0333f1 (0xef55 bytes) 000648 1785775423.341869 mapread 0x03b2bf thru 0x03fce6 (0x4a28 bytes) 000649 1785775423.345693 mapwrite 0x02c056 thru 0x03a704 (0xe6af bytes) 000651 1785775423.469527 mapwrite 0x038bac thru 0x03ffff (0x7454 bytes) 000652 1785775423.592874 mapwrite 0x029d9e thru 0x0380e6 (0xe349 bytes) 000655 1785775423.708075 write 0x001563 thru 0x00ccea (0xb788 bytes) 000656 1785775423.727686 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xe994a1c5 (stale) Mirror 12: 0xe994a1c5 (stale) Mirror 13: 0xe994a1c5 (stale) Mirror 14: 0xe994a1c5 (stale) Mirror 15: 0xe994a1c5 (stale) Mirror 16: 0xe994a1c5 (stale) Mirror 17: 0xe994a1c5 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc7e43701 Mirror 18: 0xc7e43701 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000657 1785775425.519183 read 0x005db4 thru 0x007045 (0x1292 bytes) 000658 1785775425.541895 trunc from 0x040000 to 0x037b83 (0x847c bytes) 000659 1785775425.727294 MIRROR_RESYNC 9 mirrors 000660 1785775427.978507 write 0x035866 thru 0x03ed7b (0x9516 bytes) 000661 1785775428.054851 mapread 0x00b679 thru 0x01a38c (0xed14 bytes) 000662 1785775428.107083 read 0x02f839 thru 0x03a755 (0xaf1d bytes) 000664 1785775428.116878 mapwrite 0x039eb0 thru 0x03ff5e (0x60af bytes) 000665 1785775428.191896 read 0x017b66 thru 0x01ffe8 (0x8483 bytes) 000666 1785775428.203128 MIRROR_RESYNC 9 mirrors 000668 1785775429.380588 mapread 0x02d1e1 thru 0x030a98 (0x38b8 bytes) 000675 1785775429.441272 write 0x012ad1 thru 0x012e7d (0x3ad bytes) 000677 1785775429.570502 trunc from 0x03ff5f to 0x039c1b (0x6343 bytes) 000678 1785775429.687157 mapread 0x025525 thru 0x02da85 (0x8561 bytes) 000679 1785775429.707471 mapwrite 0x0321b8 thru 0x03fda8 (0xdbf1 bytes) 000681 1785775429.857698 MIRROR_RESYNC 9 mirrors 000682 1785775431.842419 write 0x02226c thru 0x02d716 (0xb4ab bytes) 000684 1785775431.943506 trunc from 0x03fda9 to 0x021953 (0x1e455 bytes) 000687 1785775431.974154 read 0x015016 thru 0x01894b (0x3936 bytes) 000688 1785775431.983826 mapread 0x009058 thru 0x0136eb (0xa694 bytes) 000691 1785775432.016266 read 0x000616 thru 0x0094f5 (0x8ee0 bytes) 000692 1785775432.039764 trunc from 0x021954 to 0x03eab6 (0x1d163 bytes) 000693 1785775432.061515 write 0x026804 thru 0x0316ea (0xaee7 bytes) 000694 1785775432.072244 write 0x005131 thru 0x00c912 (0x77e2 bytes) 000695 1785775432.074160 write 0x00d7ec thru 0x0154c3 (0x7cd8 bytes) 000698 1785775432.076727 write 0x0133c0 thru 0x021bfb (0xe83c bytes) 000699 1785775432.092740 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3eab7): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eab7): Mirror 11: 0x8c9850dd (stale) Mirror 12: 0x8c9850dd (stale) Mirror 13: 0x8c9850dd (stale) Mirror 14: 0x8c9850dd (stale) Mirror 15: 0x8c9850dd (stale) Mirror 16: 0x8c9850dd (stale) Mirror 17: 0x8c9850dd (stale) Mirror 18: 0x8c9850dd (stale) CRC-32 checksum value for chunk [0, 0x3eab7): Mirror 1: 0x25e43aca Mirror 19: 0x25e43aca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eab7: skipped 000700 1785775434.090988 MIRROR_SPLIT mirror 4 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3eab7): Mirror 11: 0x8c9850dd (stale) Mirror 12: 0x8c9850dd (stale) Mirror 13: 0x8c9850dd (stale) Mirror 15: 0x8c9850dd (stale) Mirror 16: 0x8c9850dd (stale) Mirror 17: 0x8c9850dd (stale) Mirror 18: 0x8c9850dd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eab7): Mirror 11: 0x8c9850dd (stale) Mirror 12: 0x8c9850dd (stale) Mirror 13: 0x8c9850dd (stale) Mirror 15: 0x8c9850dd (stale) Mirror 16: 0x8c9850dd (stale) Mirror 17: 0x8c9850dd (stale) Mirror 18: 0x8c9850dd (stale) CRC-32 checksum value for chunk [0, 0x3eab7): Mirror 1: 0x25e43aca Mirror 19: 0x25e43aca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eab7: skipped 000702 1785775435.235932 read 0x00e3eb thru 0x01bd52 (0xd968 bytes) 000704 1785775435.256681 trunc from 0x03eab7 to 0x03be00 (0x2cb6 bytes) 000705 1785775435.355878 trunc from 0x03be01 to 0x02bb53 (0x102ad bytes) 000706 1785775435.372372 mapread 0x00afee thru 0x00b2ef (0x302 bytes) 000707 1785775435.383281 write 0x036bbf thru 0x03ffff (0x9441 bytes) 000709 1785775435.386169 write 0x021dad thru 0x02d63d (0xb891 bytes) 000710 1785775435.394686 trunc from 0x040000 to 0x034368 (0xbc97 bytes) 000712 1785775435.409395 mapwrite 0x005754 thru 0x014636 (0xeee3 bytes) 000713 1785775435.479462 mapread 0x0259ba thru 0x03188a (0xbed1 bytes) 000715 1785775435.489147 trunc from 0x034369 to 0x00893d (0x2ba2b bytes) 000717 1785775435.506042 mapwrite 0x0393ce thru 0x03ffff (0x6c32 bytes) 000720 1785775435.576602 mapread 0x001348 thru 0x002c92 (0x194b bytes) 000721 1785775435.578196 mapwrite 0x019561 thru 0x01df5e (0x49fe bytes) 000722 1785775435.626772 trunc from 0x040000 to 0x03dbd7 (0x2428 bytes) 000724 1785775435.640084 mapwrite 0x00f88b thru 0x013a88 (0x41fe bytes) 000725 1785775435.686714 trunc from 0x03dbd8 to 0x033315 (0xa8c2 bytes) 000728 1785775435.707068 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x33316): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33316): Mirror 11: 0x33783859 (stale) Mirror 12: 0x33783859 (stale) Mirror 13: 0x33783859 (stale) Mirror 15: 0x33783859 (stale) Mirror 16: 0x33783859 (stale) Mirror 17: 0x33783859 (stale) Mirror 18: 0x33783859 (stale) Mirror 19: 0x47cbfdea (stale) CRC-32 checksum value for chunk [0, 0x33316): Mirror 1: 0xf93a40c0 Mirror 20: 0xf93a40c0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33316: skipped 000730 1785775437.538019 write 0x00c59a thru 0x0125a5 (0x600c bytes) 000734 1785775437.777366 read 0x02ac5f thru 0x02adb7 (0x159 bytes) 000735 1785775437.786721 read 0x00442e thru 0x00c5c9 (0x819c bytes) 000737 1785775437.818307 read 0x02c7ba thru 0x033315 (0x6b5c bytes) 000738 1785775437.819072 write 0x03c5d9 thru 0x03fb54 (0x357c bytes) 000740 1785775437.820770 write 0x020505 thru 0x020efe (0x9fa bytes) 000741 1785775437.830761 write 0x02d494 thru 0x03d19c (0xfd09 bytes) 000742 1785775437.832608 read 0x0204d2 thru 0x02a9bd (0xa4ec bytes) 000743 1785775437.837013 trunc from 0x03fb55 to 0x030963 (0xf1f1 bytes) 000744 1785775437.868693 read 0x00b481 thru 0x00bf06 (0xa86 bytes) 000745 1785775437.869573 mapread 0x019854 thru 0x025712 (0xbebf bytes) 000746 1785775437.874678 trunc from 0x030964 to 0x01f88e (0x110d5 bytes) 000747 1785775437.909984 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f88f): Mirror 11: 0xfaab6a77 (stale) Mirror 12: 0xfaab6a77 (stale) Mirror 13: 0xfaab6a77 (stale) Mirror 15: 0xfaab6a77 (stale) Mirror 16: 0xfaab6a77 (stale) Mirror 17: 0xfaab6a77 (stale) Mirror 19: 0x4f01f92 (stale) Mirror 20: 0x43a8eb7d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f88f): Mirror 11: 0xfaab6a77 (stale) Mirror 12: 0xfaab6a77 (stale) Mirror 13: 0xfaab6a77 (stale) Mirror 15: 0xfaab6a77 (stale) Mirror 16: 0xfaab6a77 (stale) Mirror 17: 0xfaab6a77 (stale) Mirror 19: 0x4f01f92 (stale) Mirror 20: 0x43a8eb7d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f88f: skipped 000748 1785775438.650101 mapread 0x011685 thru 0x01ac23 (0x959f bytes) 000751 1785775438.709383 MIRROR_RESYNC 9 mirrors 000752 1785775441.873093 write 0x033065 thru 0x03ffff (0xcf9b bytes) 000754 1785775442.034574 write 0x01c609 thru 0x0250f5 (0x8aed bytes) 000756 1785775442.065825 write 0x01df4e thru 0x029040 (0xb0f3 bytes) 000759 1785775442.104849 mapread 0x015f89 thru 0x019df7 (0x3e6f bytes) 000760 1785775442.198387 mapread 0x00fe93 thru 0x019843 (0x99b1 bytes) 000762 1785775442.275921 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x1f116558 (stale) Mirror 12: 0x1f116558 (stale) Mirror 13: 0x1f116558 (stale) Mirror 15: 0x1f116558 (stale) Mirror 16: 0x1f116558 (stale) Mirror 17: 0x1f116558 (stale) Mirror 19: 0x1f116558 (stale) Mirror 20: 0x1f116558 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9cd369b6 Mirror 21: 0x9cd369b6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000764 1785775444.465909 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x1f116558 (stale) Mirror 12: 0x1f116558 (stale) Mirror 13: 0x1f116558 (stale) Mirror 15: 0x1f116558 (stale) Mirror 16: 0x1f116558 (stale) Mirror 19: 0x1f116558 (stale) Mirror 20: 0x1f116558 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x1f116558 (stale) Mirror 12: 0x1f116558 (stale) Mirror 13: 0x1f116558 (stale) Mirror 15: 0x1f116558 (stale) Mirror 16: 0x1f116558 (stale) Mirror 19: 0x1f116558 (stale) Mirror 20: 0x1f116558 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9cd369b6 Mirror 21: 0x9cd369b6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000766 1785775446.148091 mapwrite 0x008a99 thru 0x008d84 (0x2ec bytes) 000767 1785775446.424708 read 0x0196fa thru 0x02116d (0x7a74 bytes) 000768 1785775446.434465 write 0x0025b9 thru 0x00cf32 (0xa97a bytes) 000769 1785775446.455329 trunc from 0x040000 to 0x03d045 (0x2fba bytes) 000772 1785775446.484085 read 0x03832d thru 0x03d045 (0x4d19 bytes) 000773 1785775446.529609 mapwrite 0x0095c3 thru 0x017470 (0xdeae bytes) 000777 1785775446.618711 mapread 0x03bbd0 thru 0x03d045 (0x1476 bytes) 000779 1785775446.620575 mapread 0x027750 thru 0x033ec6 (0xc777 bytes) 000780 1785775446.628297 read 0x02b5b6 thru 0x03943a (0xde85 bytes) 000783 1785775446.633151 trunc from 0x03d046 to 0x0232c2 (0x19d83 bytes) 000784 1785775446.656363 write 0x01aaa2 thru 0x01fbb8 (0x5117 bytes) 000787 1785775446.658649 mapwrite 0x01e90f thru 0x023d20 (0x5412 bytes) 000788 1785775446.817642 mapread 0x01dd9d thru 0x01e585 (0x7e9 bytes) 000789 1785775446.820127 trunc from 0x023d21 to 0x01ceee (0x6e32 bytes) 000792 1785775446.845347 mapwrite 0x023445 thru 0x024a28 (0x15e4 bytes) 000793 1785775447.052145 read 0x021afd thru 0x024a28 (0x2f2c bytes) truncating to largest ever: 0x3fed1 000794 1785775447.056183 trunc from 0x024a29 to 0x03fed0 (0x1b4a8 bytes) 000796 1785775447.101074 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3fed1): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fed1): Mirror 11: 0xbf51b511 (stale) Mirror 12: 0xbf51b511 (stale) Mirror 13: 0xbf51b511 (stale) Mirror 15: 0xbf51b511 (stale) Mirror 16: 0xbf51b511 (stale) Mirror 19: 0xbf51b511 (stale) Mirror 20: 0xbf51b511 (stale) Mirror 21: 0x91b4b68f (stale) CRC-32 checksum value for chunk [0, 0x3fed1): Mirror 1: 0xfd17ba81 Mirror 22: 0xfd17ba81 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fed1: skipped 000797 1785775449.383671 trunc from 0x03fed1 to 0x033fab (0xbf25 bytes) 000799 1785775449.637093 trunc from 0x033fac to 0x00f270 (0x24d3b bytes) 000801 1785775449.684728 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xf271): Mirror 11: 0x2ffe1eaa (stale) Mirror 12: 0x2ffe1eaa (stale) Mirror 15: 0x2ffe1eaa (stale) Mirror 16: 0x2ffe1eaa (stale) Mirror 19: 0x2ffe1eaa (stale) Mirror 20: 0x2ffe1eaa (stale) Mirror 21: 0x2ffe1eaa (stale) Mirror 22: 0x8ccae4f4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf271): Mirror 11: 0x2ffe1eaa (stale) Mirror 12: 0x2ffe1eaa (stale) Mirror 15: 0x2ffe1eaa (stale) Mirror 16: 0x2ffe1eaa (stale) Mirror 19: 0x2ffe1eaa (stale) Mirror 20: 0x2ffe1eaa (stale) Mirror 21: 0x2ffe1eaa (stale) Mirror 22: 0x8ccae4f4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf271: skipped 000802 1785775450.475156 MIRROR_RESYNC 9 mirrors 000803 1785775453.065062 mapread 0x0059bc thru 0x0091aa (0x37ef bytes) 000804 1785775453.113195 read 0x00d2a8 thru 0x00f270 (0x1fc9 bytes) 000807 1785775453.115432 mapread 0x008d74 thru 0x00f270 (0x64fd bytes) 000811 1785775453.125197 write 0x0153ae thru 0x02407e (0xecd1 bytes) 000812 1785775453.280152 trunc from 0x02407f to 0x037945 (0x138c7 bytes) 000813 1785775453.328273 read 0x0057f5 thru 0x00f831 (0xa03d bytes) 000814 1785775453.339587 trunc from 0x037946 to 0x03a268 (0x2923 bytes) 000818 1785775453.378281 trunc from 0x03a269 to 0x00f2b8 (0x2afb0 bytes) 000820 1785775453.429950 mapwrite 0x033939 thru 0x03a801 (0x6ec9 bytes) 000823 1785775453.725910 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3a802): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a802): Mirror 11: 0xd3dd3ef3 (stale) Mirror 12: 0xd3dd3ef3 (stale) Mirror 15: 0xd3dd3ef3 (stale) Mirror 16: 0xd3dd3ef3 (stale) Mirror 19: 0xd3dd3ef3 (stale) Mirror 20: 0xd3dd3ef3 (stale) Mirror 21: 0xd3dd3ef3 (stale) Mirror 22: 0xd3dd3ef3 (stale) CRC-32 checksum value for chunk [0, 0x3a802): Mirror 1: 0xea0327b8 Mirror 23: 0xea0327b8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a802: skipped 000824 1785775455.208225 write 0x010da4 thru 0x01451b (0x3778 bytes) 000826 1785775455.505743 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3a802): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a802): Mirror 11: 0xd3dd3ef3 (stale) Mirror 12: 0xd3dd3ef3 (stale) Mirror 15: 0xd3dd3ef3 (stale) Mirror 16: 0xd3dd3ef3 (stale) Mirror 19: 0xd3dd3ef3 (stale) Mirror 20: 0xd3dd3ef3 (stale) Mirror 21: 0xd3dd3ef3 (stale) Mirror 22: 0xd3dd3ef3 (stale) Mirror 23: 0xea0327b8 (stale) CRC-32 checksum value for chunk [0, 0x3a802): Mirror 1: 0x769f0efa Mirror 24: 0x769f0efa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a802: skipped 000827 1785775457.759011 read 0x00a4af thru 0x01825d (0xddaf bytes) 000829 1785775457.797038 write 0x0207ef thru 0x02d442 (0xcc54 bytes) 000833 1785775458.013040 read 0x03148a thru 0x035d83 (0x48fa bytes) 000837 1785775458.042200 write 0x023470 thru 0x02c1ba (0x8d4b bytes) 000838 1785775458.049217 trunc from 0x03a802 to 0x01affa (0x1f807 bytes) 000839 1785775458.071006 mapread 0x00611a thru 0x014d3d (0xec24 bytes) 000840 1785775458.072572 read 0x00294f thru 0x007f40 (0x55f2 bytes) 000846 1785775458.085861 mapwrite 0x002496 thru 0x010e50 (0xe9bb bytes) 000847 1785775458.230763 mapwrite 0x007d39 thru 0x009c0f (0x1ed7 bytes) 000848 1785775458.376325 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1affb): Mirror 11: 0x9c53631f (stale) Mirror 12: 0x9c53631f (stale) Mirror 16: 0x9c53631f (stale) Mirror 19: 0x9c53631f (stale) Mirror 20: 0x9c53631f (stale) Mirror 21: 0x9c53631f (stale) Mirror 22: 0x9c53631f (stale) Mirror 23: 0x9c53631f (stale) Mirror 24: 0x7233a557 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1affb): Mirror 11: 0x9c53631f (stale) Mirror 12: 0x9c53631f (stale) Mirror 16: 0x9c53631f (stale) Mirror 19: 0x9c53631f (stale) Mirror 20: 0x9c53631f (stale) Mirror 21: 0x9c53631f (stale) Mirror 22: 0x9c53631f (stale) Mirror 23: 0x9c53631f (stale) Mirror 24: 0x7233a557 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1affb: skipped 000850 1785775459.367970 read 0x010a6e thru 0x012114 (0x16a7 bytes) 000851 1785775459.383286 write 0x03c8bf thru 0x03ffff (0x3741 bytes) 000853 1785775459.395355 MIRROR_RESYNC 10 mirrors 000854 1785775463.333508 read 0x02a558 thru 0x032112 (0x7bbb bytes) 000855 1785775463.341005 trunc from 0x040000 to 0x01d485 (0x22b7a bytes) 000856 1785775463.402947 trunc from 0x01d486 to 0x006582 (0x16f03 bytes) 000857 1785775463.421029 mapwrite 0x02d64e thru 0x02f772 (0x2125 bytes) 000859 1785775463.503228 mapread 0x005989 thru 0x008f96 (0x360e bytes) 000862 1785775463.519746 mapread 0x024952 thru 0x029679 (0x4d28 bytes) 000863 1785775463.528457 mapwrite 0x033257 thru 0x036226 (0x2fd0 bytes) 000864 1785775463.580921 mapwrite 0x004b72 thru 0x010e9c (0xc32b bytes) 000865 1785775463.616268 mapread 0x0290a7 thru 0x03251c (0x9476 bytes) 000866 1785775463.618519 read 0x02161f thru 0x02f2f9 (0xdcdb bytes) 000867 1785775463.619390 mapread 0x0254fd thru 0x03094d (0xb451 bytes) 000869 1785775463.622497 trunc from 0x036227 to 0x039095 (0x2e6f bytes) 000870 1785775463.637281 mapread 0x00d7bb thru 0x017862 (0xa0a8 bytes) 000871 1785775463.646915 write 0x00854c thru 0x010bdf (0x8694 bytes) 000877 1785775463.652944 mapwrite 0x03a2d5 thru 0x03ffff (0x5d2b bytes) 000879 1785775463.706859 write 0x02bc2d thru 0x031514 (0x58e8 bytes) 000882 1785775463.713842 MIRROR_RESYNC 10 mirrors 000885 1785775465.266871 mapwrite 0x031160 thru 0x0389c4 (0x7865 bytes) 000886 1785775465.458439 read 0x02a5a8 thru 0x02abaa (0x603 bytes) 000887 1785775465.465873 read 0x01abc0 thru 0x027378 (0xc7b9 bytes) 000888 1785775465.476531 write 0x02db00 thru 0x02f0ff (0x1600 bytes) 000889 1785775465.478557 mapwrite 0x00bbd3 thru 0x013705 (0x7b33 bytes) 000890 1785775465.533325 trunc from 0x040000 to 0x038445 (0x7bba bytes) 000891 1785775465.555855 mapread 0x0270bf thru 0x02b2ca (0x420c bytes) 000892 1785775465.558388 write 0x03e4df thru 0x03ffff (0x1b21 bytes) 000893 1785775465.560753 mapwrite 0x019cc0 thru 0x01a0fd (0x43e bytes) 000894 1785775465.603417 write 0x03a803 thru 0x03f2a3 (0x4aa1 bytes) 000895 1785775465.610759 mapread 0x009bb8 thru 0x0198c1 (0xfd0a bytes) 000898 1785775465.614927 trunc from 0x040000 to 0x015cb5 (0x2a34a bytes) 000899 1785775465.635526 MIRROR_RESYNC 10 mirrors 000900 1785775466.920461 mapwrite 0x02ac59 thru 0x02ec31 (0x3fd9 bytes) 000901 1785775467.047113 mapwrite 0x035474 thru 0x03e0db (0x8c68 bytes) 000904 1785775467.145388 trunc from 0x03e0dc to 0x01b4e9 (0x22bf2 bytes) 000907 1785775467.163611 mapwrite 0x008629 thru 0x011bba (0x9592 bytes) 000908 1785775467.227963 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b4ea): Mirror 11: 0x8942b9ed (stale) Mirror 12: 0x8942b9ed (stale) Mirror 16: 0x8942b9ed (stale) Mirror 19: 0x8942b9ed (stale) Mirror 20: 0x8942b9ed (stale) Mirror 21: 0x8942b9ed (stale) Mirror 22: 0x8942b9ed (stale) Mirror 24: 0x8942b9ed (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b4ea): Mirror 11: 0x8942b9ed (stale) Mirror 12: 0x8942b9ed (stale) Mirror 16: 0x8942b9ed (stale) Mirror 19: 0x8942b9ed (stale) Mirror 20: 0x8942b9ed (stale) Mirror 21: 0x8942b9ed (stale) Mirror 22: 0x8942b9ed (stale) Mirror 24: 0x8942b9ed (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b4ea: skipped 000909 1785775467.644456 mapwrite 0x002acc thru 0x01201c (0xf551 bytes) 000913 1785775467.721134 mapwrite 0x02f4ec thru 0x036a48 (0x755d bytes) 000915 1785775467.783623 trunc from 0x036a49 to 0x03e001 (0x75b9 bytes) 000916 1785775467.808446 MIRROR_RESYNC 9 mirrors 000918 1785775469.361532 trunc from 0x03e002 to 0x026712 (0x178ef bytes) 000919 1785775469.481135 read 0x014431 thru 0x0218cc (0xd49c bytes) 000920 1785775469.488946 trunc from 0x026713 to 0x03bc3f (0x1552d bytes) 000921 1785775469.517159 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3bc40): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bc40): Mirror 11: 0xd4b1d59 (stale) Mirror 12: 0xd4b1d59 (stale) Mirror 16: 0xd4b1d59 (stale) Mirror 19: 0xd4b1d59 (stale) Mirror 20: 0xd4b1d59 (stale) Mirror 21: 0xd4b1d59 (stale) Mirror 22: 0xd4b1d59 (stale) Mirror 24: 0xd4b1d59 (stale) CRC-32 checksum value for chunk [0, 0x3bc40): Mirror 1: 0xaba73cf7 Mirror 25: 0xaba73cf7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bc40: skipped 000922 1785775470.553466 mapwrite 0x01758b thru 0x01f30c (0x7d82 bytes) 000923 1785775470.910324 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3bc40): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bc40): Mirror 11: 0xd4b1d59 (stale) Mirror 12: 0xd4b1d59 (stale) Mirror 16: 0xd4b1d59 (stale) Mirror 19: 0xd4b1d59 (stale) Mirror 20: 0xd4b1d59 (stale) Mirror 21: 0xd4b1d59 (stale) Mirror 22: 0xd4b1d59 (stale) Mirror 24: 0xd4b1d59 (stale) Mirror 25: 0xaba73cf7 (stale) CRC-32 checksum value for chunk [0, 0x3bc40): Mirror 1: 0x1e0a458d Mirror 26: 0x1e0a458d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bc40: skipped 000925 1785775472.293383 read 0x009b7d thru 0x016038 (0xc4bc bytes) 000929 1785775472.393909 write 0x02e012 thru 0x030d2c (0x2d1b bytes) 000930 1785775472.608357 mapread 0x01a422 thru 0x01a491 (0x70 bytes) 000931 1785775472.613540 mapread 0x036b3e thru 0x03bc3f (0x5102 bytes) 000933 1785775472.635099 MIRROR_SPLIT mirror 8 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bc40): Mirror 11: 0xd4b1d59 (stale) Mirror 12: 0xd4b1d59 (stale) Mirror 16: 0xd4b1d59 (stale) Mirror 19: 0xd4b1d59 (stale) Mirror 20: 0xd4b1d59 (stale) Mirror 21: 0xd4b1d59 (stale) Mirror 22: 0xd4b1d59 (stale) Mirror 25: 0xaba73cf7 (stale) Mirror 26: 0x1e0a458d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bc40): Mirror 11: 0xd4b1d59 (stale) Mirror 12: 0xd4b1d59 (stale) Mirror 16: 0xd4b1d59 (stale) Mirror 19: 0xd4b1d59 (stale) Mirror 20: 0xd4b1d59 (stale) Mirror 21: 0xd4b1d59 (stale) Mirror 22: 0xd4b1d59 (stale) Mirror 25: 0xaba73cf7 (stale) Mirror 26: 0x1e0a458d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bc40: skipped 000935 1785775473.406282 read 0x0061d9 thru 0x013eb3 (0xdcdb bytes) 000936 1785775473.435370 mapread 0x02a542 thru 0x02defa (0x39b9 bytes) 000944 1785775473.462914 read 0x01e556 thru 0x022f93 (0x4a3e bytes) 000945 1785775473.479548 mapwrite 0x0113e5 thru 0x0148d7 (0x34f3 bytes) 000946 1785775473.716475 mapread 0x021f22 thru 0x02fbcf (0xdcae bytes) 000947 1785775473.721515 mapwrite 0x02ee58 thru 0x035b00 (0x6ca9 bytes) 000948 1785775473.876498 write 0x0360d8 thru 0x0364e2 (0x40b bytes) 000949 1785775473.880911 read 0x01ef66 thru 0x02209d (0x3138 bytes) 000951 1785775473.885705 trunc from 0x03bc40 to 0x00d55c (0x2e6e3 bytes) 000956 1785775473.953422 MIRROR_RESYNC 10 mirrors 000957 1785775477.201966 MIRROR_EXTEND to 11 mirrors 000958 1785775478.741993 mapwrite 0x00112d thru 0x00941d (0x82f1 bytes) 000961 1785775479.156230 mapwrite 0x0234b5 thru 0x02a817 (0x7363 bytes) 000964 1785775479.378231 mapread 0x00ddb9 thru 0x011ac0 (0x3d08 bytes) 000967 1785775479.403306 mapread 0x013be1 thru 0x01c2dc (0x86fc bytes) 000971 1785775479.439676 MIRROR_RESYNC 11 mirrors 000972 1785775483.363873 mapwrite 0x0051e2 thru 0x00b2ad (0x60cc bytes) 000973 1785775483.549891 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x2a818): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a818): Mirror 11: 0x422e67bc (stale) Mirror 12: 0x422e67bc (stale) Mirror 16: 0x422e67bc (stale) Mirror 19: 0x422e67bc (stale) Mirror 20: 0x422e67bc (stale) Mirror 21: 0x422e67bc (stale) Mirror 22: 0x422e67bc (stale) Mirror 25: 0x422e67bc (stale) Mirror 26: 0x422e67bc (stale) Mirror 27: 0x422e67bc (stale) CRC-32 checksum value for chunk [0, 0x2a818): Mirror 1: 0xab3bd29f Mirror 28: 0xab3bd29f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a818: skipped 000975 1785775485.541540 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x2a818): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a818): Mirror 11: 0x422e67bc (stale) Mirror 12: 0x422e67bc (stale) Mirror 16: 0x422e67bc (stale) Mirror 19: 0x422e67bc (stale) Mirror 20: 0x422e67bc (stale) Mirror 21: 0x422e67bc (stale) Mirror 22: 0x422e67bc (stale) Mirror 25: 0x422e67bc (stale) Mirror 26: 0x422e67bc (stale) Mirror 27: 0x422e67bc (stale) CRC-32 checksum value for chunk [0, 0x2a818): Mirror 1: 0xab3bd29f Mirror 28: 0xab3bd29f Mirror 29: 0xab3bd29f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a818: skipped 000976 1785775487.270660 mapwrite 0x039935 thru 0x039bc7 (0x293 bytes) 000977 1785775487.673484 mapread 0x034e18 thru 0x039bc7 (0x4db0 bytes) 000978 1785775487.696706 trunc from 0x039bc8 to 0x03e616 (0x4a4f bytes) 000982 1785775487.735818 trunc from 0x03e617 to 0x0026c9 (0x3bf4d bytes) 000983 1785775487.751681 read 0x000ec7 thru 0x0026c9 (0x1803 bytes) 000986 1785775487.763577 read 0x002279 thru 0x0026c9 (0x451 bytes) 000987 1785775487.767806 mapwrite 0x01db5c thru 0x0241ca (0x666f bytes) 000988 1785775487.938306 mapread 0x01b937 thru 0x0241ca (0x8894 bytes) 000989 1785775487.947175 write 0x038ad2 thru 0x03ffff (0x752e bytes) 000990 1785775487.974038 MIRROR_SPLIT mirror 12 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x12b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x5b89032b (stale) Mirror 12: 0x5b89032b (stale) Mirror 16: 0x5b89032b (stale) Mirror 19: 0x5b89032b (stale) Mirror 20: 0x5b89032b (stale) Mirror 21: 0x5b89032b (stale) Mirror 22: 0x5b89032b (stale) Mirror 25: 0x5b89032b (stale) Mirror 26: 0x5b89032b (stale) Mirror 27: 0x5b89032b (stale) Mirror 28: 0xeeff2254 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x5b89032b (stale) Mirror 12: 0x5b89032b (stale) Mirror 16: 0x5b89032b (stale) Mirror 19: 0x5b89032b (stale) Mirror 20: 0x5b89032b (stale) Mirror 21: 0x5b89032b (stale) Mirror 22: 0x5b89032b (stale) Mirror 25: 0x5b89032b (stale) Mirror 26: 0x5b89032b (stale) Mirror 27: 0x5b89032b (stale) Mirror 28: 0xeeff2254 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000991 1785775489.007471 mapwrite 0x0219a2 thru 0x02b069 (0x96c8 bytes) 000994 1785775489.151606 write 0x006799 thru 0x00dae9 (0x7351 bytes) 000997 1785775489.166026 mapread 0x01ecb7 thru 0x0214cc (0x2816 bytes) 000999 1785775489.172144 mapread 0x0311f4 thru 0x03afe1 (0x9dee bytes) All operations completed A-OK!