== sanity-flr test 70a: flr mode fsx test ================ 08:26:35 (1786191995) Seed set to 1996 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000003 1786191996.359631 mapwrite 0x03231f thru 0x033741 (0x1423 bytes) 000004 1786191996.453937 write 0x03d2cd thru 0x03ffff (0x2d33 bytes) truncating to largest ever: 0x15e26 000005 1786191996.461104 trunc from 0x040000 to 0x015e25 (0x2a1da bytes) 000006 1786191996.496669 write 0x035a96 thru 0x03dd22 (0x828d bytes) 000007 1786191996.499627 mapread 0x02a0fd thru 0x03a0d3 (0xffd7 bytes) 000008 1786191996.511251 mapread 0x01e8fd thru 0x026f38 (0x863c bytes) 000010 1786191996.518028 write 0x0385d3 thru 0x03eb21 (0x654f bytes) 000013 1786191996.520172 write 0x0280a3 thru 0x0322c9 (0xa227 bytes) truncating to largest ever: 0x1cd75 000017 1786191996.522817 trunc from 0x03eb22 to 0x01cd74 (0x21dad bytes) 000018 1786191996.533661 write 0x03480c thru 0x03a053 (0x5848 bytes) 000019 1786191996.534854 read 0x0299dd thru 0x02a22b (0x84f bytes) 000022 1786191996.539587 mapread 0x02c4ec thru 0x030b3b (0x4650 bytes) 000024 1786191996.547008 read 0x022ae4 thru 0x030d47 (0xe264 bytes) 000026 1786191996.555813 read 0x00eb98 thru 0x01de76 (0xf2df bytes) 000027 1786191996.556619 trunc from 0x03a054 to 0x0167fc (0x23857 bytes) 000028 1786191996.571275 mapread 0x000892 thru 0x00f3c4 (0xeb33 bytes) 000029 1786191996.572528 trunc from 0x0167fd to 0x01468a (0x2172 bytes) 000030 1786191996.583472 read 0x00d20c thru 0x01468a (0x747f bytes) 000031 1786191996.584031 read 0x0116eb thru 0x01362e (0x1f44 bytes) 000032 1786191996.584722 trunc from 0x01468b to 0x002340 (0x1234a bytes) 000033 1786191996.597452 trunc from 0x002341 to 0x0017b2 (0xb8e bytes) 000036 1786191996.607474 mapread 0x00009d thru 0x0017b2 (0x1716 bytes) 000038 1786191996.609816 write 0x024fc0 thru 0x02577a (0x7bb bytes) 000041 1786191996.611959 mapread 0x02539d thru 0x02577a (0x3de bytes) 000042 1786191996.613523 write 0x025dd8 thru 0x030953 (0xab7c bytes) 000043 1786191996.618057 mapread 0x01606f thru 0x021a5b (0xb9ed bytes) 000044 1786191996.624944 mapread 0x0097b3 thru 0x01555c (0xbdaa bytes) 000045 1786191996.626360 mapwrite 0x01d238 thru 0x028555 (0xb31e bytes) 000046 1786191996.658276 mapwrite 0x02f896 thru 0x03f49f (0xfc0a bytes) 000052 1786191996.715708 mapread 0x01aa74 thru 0x01fcb8 (0x5245 bytes) 000053 1786191996.716788 mapread 0x03bd7e thru 0x03f49f (0x3722 bytes) 000057 1786191996.720864 mapwrite 0x016528 thru 0x022c8e (0xc767 bytes) 000058 1786191996.791371 mapwrite 0x021074 thru 0x022493 (0x1420 bytes) 000060 1786191996.829978 mapread 0x012fc5 thru 0x01a0d6 (0x7112 bytes) 000061 1786191996.832048 mapwrite 0x0316c3 thru 0x033039 (0x1977 bytes) 000063 1786191996.871015 write 0x00f56c thru 0x016f0b (0x79a0 bytes) 000066 1786191996.873291 write 0x01ebb2 thru 0x02b07a (0xc4c9 bytes) 000071 1786191996.877880 mapwrite 0x031f34 thru 0x03ffff (0xe0cc bytes) 000073 1786191996.944033 trunc from 0x040000 to 0x00119e (0x3ee61 bytes) 000074 1786191996.963244 write 0x019f37 thru 0x01e61f (0x46e9 bytes) 000077 1786191996.966287 trunc from 0x01e620 to 0x003892 (0x1ad8d bytes) 000081 1786191996.981067 read 0x0013b5 thru 0x003892 (0x24de bytes) 000082 1786191996.989391 write 0x0226a8 thru 0x028751 (0x60aa bytes) 000083 1786191996.992676 mapread 0x0095ef thru 0x012cfe (0x9710 bytes) truncating to largest ever: 0x35c80 000084 1786191997.003295 trunc from 0x028752 to 0x035c7f (0xd52e bytes) 000086 1786191997.018843 mapread 0x00830e thru 0x014696 (0xc389 bytes) 000087 1786191997.020832 read 0x00b6c6 thru 0x01ae66 (0xf7a1 bytes) 000092 1786191997.024528 write 0x02d84d thru 0x03b65a (0xde0e bytes) 000093 1786191997.030619 mapread 0x015ad7 thru 0x01681b (0xd45 bytes) 000094 1786191997.031356 trunc from 0x03b65b to 0x0264d5 (0x15185 bytes) 000096 1786191997.049431 read 0x021e02 thru 0x0264d5 (0x46d4 bytes) 000098 1786191997.051709 trunc from 0x0264d6 to 0x007bbb (0x1e91a bytes) 000102 1786191997.066699 mapread 0x006fbe thru 0x007bbb (0xbfe bytes) 000105 1786191997.070979 mapwrite 0x01ec4d thru 0x02b2bb (0xc66f bytes) 000107 1786191997.131684 read 0x009abc thru 0x00e81e (0x4d63 bytes) 000109 1786191997.135415 mapwrite 0x0167bf thru 0x0199af (0x31f1 bytes) 000110 1786191997.177632 trunc from 0x02b2bc to 0x00ae47 (0x20474 bytes) 000111 1786191997.198656 trunc from 0x00ae48 to 0x034b23 (0x29cdc bytes) 000112 1786191997.211975 read 0x01f389 thru 0x0274af (0x8127 bytes) 000113 1786191997.226403 mapread 0x0222b5 thru 0x02b9ff (0x974b bytes) 000114 1786191997.228047 trunc from 0x034b24 to 0x0190dd (0x1ba46 bytes) 000115 1786191997.263695 read 0x001f5c thru 0x004abb (0x2b60 bytes) truncating to largest ever: 0x368f1 000121 1786191997.284243 trunc from 0x0190de to 0x0368f0 (0x1d813 bytes) 000125 1786191997.311609 write 0x0352e6 thru 0x03ffff (0xad1a bytes) 000128 1786191997.323777 write 0x0080d3 thru 0x00eb38 (0x6a66 bytes) 000129 1786191997.324631 read 0x02658a thru 0x02b8e8 (0x535f bytes) 000130 1786191997.328372 MIRROR_EXTEND to 2 mirrors 000131 1786191997.964375 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) 000132 1786191998.109312 mapwrite 0x004ca5 thru 0x013155 (0xe4b1 bytes) 000133 1786191998.190805 trunc from 0x040000 to 0x005ff2 (0x3a00d bytes) 000137 1786191998.221993 mapwrite 0x02d58e thru 0x0372ed (0x9d60 bytes) 000139 1786191998.290733 mapwrite 0x021fa9 thru 0x0226e2 (0x73a bytes) 000140 1786191998.319201 read 0x02b092 thru 0x02dbc9 (0x2b38 bytes) 000141 1786191998.320702 mapread 0x036d53 thru 0x0372ed (0x59b bytes) 000142 1786191998.321526 mapwrite 0x039be9 thru 0x03ffff (0x6417 bytes) 000143 1786191998.365390 read 0x02bf20 thru 0x032d58 (0x6e39 bytes) 000145 1786191998.366428 write 0x025a32 thru 0x032200 (0xc7cf bytes) 000146 1786191998.367697 read 0x007c53 thru 0x013ad4 (0xbe82 bytes) 000147 1786191998.373413 read 0x0167a5 thru 0x01f489 (0x8ce5 bytes) 000149 1786191998.374337 read 0x01540f thru 0x017b38 (0x272a bytes) 000150 1786191998.374775 trunc from 0x040000 to 0x018d98 (0x27267 bytes) 000154 1786191998.386810 trunc from 0x018d99 to 0x0221be (0x9426 bytes) 000155 1786191998.401712 write 0x036d46 thru 0x03ffff (0x92ba bytes) 000156 1786191998.402916 read 0x03cda1 thru 0x03ffff (0x325f bytes) 000161 1786191998.405766 mapread 0x01ca82 thru 0x028168 (0xb6e7 bytes) 000164 1786191998.412666 read 0x000e14 thru 0x00b1a6 (0xa393 bytes) 000165 1786191998.415517 MIRROR_EXTEND to 2 mirrors 000168 1786191999.069313 mapwrite 0x027a64 thru 0x0324ac (0xaa49 bytes) 000169 1786191999.270502 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x84186ec6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd856851d Mirror 3: 0xd856851d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000170 1786192000.063016 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x84186ec6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd856851d Mirror 3: 0xd856851d Mirror 4: 0xd856851d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000173 1786192000.942642 mapread 0x006d76 thru 0x0141b7 (0xd442 bytes) 000174 1786192000.978784 write 0x03ca7c thru 0x03ffff (0x3584 bytes) 000175 1786192001.035288 mapread 0x030aca thru 0x033c4d (0x3184 bytes) 000176 1786192001.048905 MIRROR_RESYNC 4 mirrors 000177 1786192002.374241 write 0x001ad6 thru 0x0116a3 (0xfbce bytes) 000179 1786192002.435891 write 0x022f77 thru 0x0299d5 (0x6a5f bytes) 000182 1786192002.444383 read 0x01b47f thru 0x01ffd7 (0x4b59 bytes) truncating to largest ever: 0x3b8b5 000183 1786192002.457719 trunc from 0x040000 to 0x03b8b4 (0x474b bytes) 000184 1786192002.472355 trunc from 0x03b8b5 to 0x0025fa (0x392ba bytes) 000185 1786192002.485339 write 0x01570a thru 0x0180a4 (0x299b bytes) 000187 1786192002.491456 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x180a5): Mirror 3: 0xb32e89f2 (stale) Mirror 4: 0xb32e89f2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x180a5): Mirror 3: 0xb32e89f2 (stale) Mirror 4: 0xb32e89f2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x180a5: skipped 000189 1786192002.717899 read 0x00be64 thru 0x00e4ee (0x268b bytes) 000190 1786192002.723508 mapread 0x003908 thru 0x010ded (0xd4e6 bytes) 000192 1786192002.752688 MIRROR_RESYNC 3 mirrors 000193 1786192003.664509 MIRROR_RESYNC 3 mirrors 000194 1786192003.987137 mapread 0x0147f8 thru 0x0180a4 (0x38ad bytes) 000197 1786192004.024949 trunc from 0x0180a5 to 0x011549 (0x6b5b bytes) 000199 1786192004.114651 write 0x03e1b8 thru 0x03ffff (0x1e48 bytes) 000200 1786192004.132728 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe0d7eebb (stale) Mirror 4: 0xe0d7eebb (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe735dace Mirror 5: 0xe735dace lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000201 1786192005.113381 mapread 0x00a5cb thru 0x010069 (0x5a9f bytes) 000202 1786192005.146330 write 0x0321fd thru 0x03f607 (0xd40b bytes) 000203 1786192005.227996 read 0x01460c thru 0x023a12 (0xf407 bytes) 000204 1786192005.239382 trunc from 0x040000 to 0x01a5ed (0x25a12 bytes) 000205 1786192005.266792 read 0x004c4e thru 0x00c0b0 (0x7463 bytes) 000208 1786192005.280284 read 0x00cfe9 thru 0x00f3c9 (0x23e1 bytes) 000210 1786192005.286666 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1a5ee): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a5ee): Mirror 3: 0xa27f1699 (stale) Mirror 4: 0xa27f1699 (stale) Mirror 5: 0x8a45cfdc (stale) CRC-32 checksum value for chunk [0, 0x1a5ee): Mirror 1: 0x8a45cfdc Mirror 6: 0x8a45cfdc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a5ee: skipped 000211 1786192005.980959 MIRROR_RESYNC 5 mirrors 000212 1786192006.729299 read 0x01215c thru 0x015a0c (0x38b1 bytes) 000213 1786192006.733155 write 0x00862b thru 0x015878 (0xd24e bytes) 000216 1786192006.790133 read 0x004733 thru 0x007952 (0x3220 bytes) 000218 1786192006.798003 mapread 0x014d04 thru 0x01a5ed (0x58ea bytes) 000219 1786192006.799026 write 0x03db16 thru 0x03ffff (0x24ea bytes) 000220 1786192006.800502 write 0x03928f thru 0x03e302 (0x5074 bytes) 000224 1786192006.812950 mapread 0x00cb01 thru 0x01065b (0x3b5b bytes) 000226 1786192006.818320 mapread 0x001b5e thru 0x003dbd (0x2260 bytes) 000227 1786192006.821390 read 0x01ff4a thru 0x026f0c (0x6fc3 bytes) 000228 1786192006.822562 mapread 0x0001be thru 0x00f889 (0xf6cc bytes) 000230 1786192006.828962 MIRROR_RESYNC 5 mirrors 000233 1786192008.119802 mapwrite 0x03d761 thru 0x03ffff (0x289f bytes) 000234 1786192008.239914 mapread 0x03cef6 thru 0x03fdcf (0x2eda bytes) 000235 1786192008.243434 mapread 0x0343e3 thru 0x036404 (0x2022 bytes) 000238 1786192008.262388 MIRROR_RESYNC 5 mirrors 000241 1786192009.562394 trunc from 0x040000 to 0x005772 (0x3a88d bytes) 000242 1786192009.608801 read 0x005449 thru 0x005772 (0x32a bytes) 000243 1786192009.616791 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x5773): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5773): Mirror 3: 0xb189ff70 (stale) Mirror 4: 0xb189ff70 (stale) Mirror 5: 0xb189ff70 (stale) Mirror 6: 0xb189ff70 (stale) CRC-32 checksum value for chunk [0, 0x5773): Mirror 1: 0xb189ff70 Mirror 7: 0xb189ff70 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5773: skipped 000244 1786192010.400951 read 0x003138 thru 0x005772 (0x263b bytes) 000245 1786192010.417493 MIRROR_RESYNC 6 mirrors 000246 1786192011.250027 mapread 0x00346e thru 0x005772 (0x2305 bytes) 000248 1786192011.267955 mapwrite 0x009ce9 thru 0x00cdc6 (0x30de bytes) 000250 1786192011.419707 trunc from 0x00cdc7 to 0x01b97c (0xebb6 bytes) 000252 1786192011.451451 write 0x0182da thru 0x018570 (0x297 bytes) 000253 1786192011.458566 read 0x00f46b thru 0x012306 (0x2e9c bytes) 000255 1786192011.469063 read 0x00343f thru 0x004515 (0x10d7 bytes) 000256 1786192011.470742 write 0x038bc8 thru 0x03ffff (0x7438 bytes) 000257 1786192011.472750 mapread 0x01e9c7 thru 0x029144 (0xa77e bytes) 000258 1786192011.482048 read 0x00e093 thru 0x0118fc (0x386a bytes) 000259 1786192011.482701 mapwrite 0x00317e thru 0x0054e9 (0x236c bytes) 000260 1786192011.525789 mapwrite 0x031c57 thru 0x03b480 (0x982a bytes) 000261 1786192011.578947 MIRROR_RESYNC 6 mirrors 000262 1786192013.427166 trunc from 0x040000 to 0x030dd4 (0xf22b bytes) 000265 1786192013.487379 mapread 0x00f654 thru 0x01608f (0x6a3c bytes) 000266 1786192013.503869 write 0x026f10 thru 0x02d913 (0x6a04 bytes) 000269 1786192013.513875 trunc from 0x030dd5 to 0x021fd8 (0xedfc bytes) 000270 1786192013.538983 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x21fd9): Mirror 4: 0xb9b6640e (stale) Mirror 5: 0xb9b6640e (stale) Mirror 6: 0xb9b6640e (stale) Mirror 7: 0xb9b6640e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21fd9): Mirror 4: 0xb9b6640e (stale) Mirror 5: 0xb9b6640e (stale) Mirror 6: 0xb9b6640e (stale) Mirror 7: 0xb9b6640e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21fd9: skipped 000271 1786192013.880494 trunc from 0x021fd9 to 0x01a28b (0x7d4d bytes) 000272 1786192013.899222 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1a28c): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a28c): Mirror 4: 0xb8fdb6e6 (stale) Mirror 5: 0xb8fdb6e6 (stale) Mirror 6: 0xb8fdb6e6 (stale) Mirror 7: 0xb8fdb6e6 (stale) CRC-32 checksum value for chunk [0, 0x1a28c): Mirror 1: 0xb8fdb6e6 Mirror 8: 0xb8fdb6e6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a28c: skipped 000274 1786192014.887626 trunc from 0x01a28c to 0x006d13 (0x13578 bytes) 000277 1786192014.972413 read 0x00519f thru 0x006a0e (0x1870 bytes) 000278 1786192014.977891 write 0x00d1e2 thru 0x01969f (0xc4be bytes) 000283 1786192014.984058 write 0x01ef22 thru 0x0218dc (0x29bb bytes) 000286 1786192014.987848 write 0x004c29 thru 0x005961 (0xd39 bytes) 000287 1786192014.992390 mapread 0x016aef thru 0x0218dc (0xadee bytes) 000288 1786192015.011037 MIRROR_RESYNC 6 mirrors 000290 1786192016.442960 mapwrite 0x030f26 thru 0x039960 (0x8a3b bytes) 000292 1786192016.666637 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39961): Mirror 4: 0xb74227a8 (stale) Mirror 5: 0xb74227a8 (stale) Mirror 7: 0xb74227a8 (stale) Mirror 8: 0xb74227a8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39961): Mirror 4: 0xb74227a8 (stale) Mirror 5: 0xb74227a8 (stale) Mirror 7: 0xb74227a8 (stale) Mirror 8: 0xb74227a8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39961: skipped 000294 1786192016.994783 trunc from 0x039961 to 0x002fb5 (0x369ab bytes) 000295 1786192017.009876 mapwrite 0x039d03 thru 0x03ffff (0x62fd bytes) 000296 1786192017.096213 read 0x023e71 thru 0x03212e (0xe2be bytes) 000298 1786192017.105120 read 0x02d7d1 thru 0x034e62 (0x7692 bytes) 000301 1786192017.125339 mapwrite 0x003874 thru 0x008319 (0x4aa6 bytes) 000304 1786192017.168835 trunc from 0x040000 to 0x01610c (0x29ef3 bytes) 000306 1786192017.190881 trunc from 0x01610d to 0x02ad92 (0x14c86 bytes) 000307 1786192017.211484 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2ad93): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ad93): Mirror 4: 0xfdedab26 (stale) Mirror 5: 0xfdedab26 (stale) Mirror 7: 0xfdedab26 (stale) Mirror 8: 0xfdedab26 (stale) CRC-32 checksum value for chunk [0, 0x2ad93): Mirror 1: 0xa159d9d1 Mirror 9: 0xa159d9d1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ad93: skipped 000310 1786192018.110610 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ad93): Mirror 4: 0xfdedab26 (stale) Mirror 5: 0xfdedab26 (stale) Mirror 7: 0xfdedab26 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ad93): Mirror 4: 0xfdedab26 (stale) Mirror 5: 0xfdedab26 (stale) Mirror 7: 0xfdedab26 (stale) CRC-32 checksum value for chunk [0, 0x2ad93): Mirror 1: 0xa159d9d1 Mirror 9: 0xa159d9d1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ad93: skipped 000316 1786192018.795034 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ad93): Mirror 5: 0xfdedab26 (stale) Mirror 7: 0xfdedab26 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ad93): Mirror 5: 0xfdedab26 (stale) Mirror 7: 0xfdedab26 (stale) CRC-32 checksum value for chunk [0, 0x2ad93): Mirror 1: 0xa159d9d1 Mirror 9: 0xa159d9d1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ad93: skipped 000317 1786192019.352877 trunc from 0x02ad93 to 0x020531 (0xa861 bytes) 000318 1786192019.437955 read 0x004ca0 thru 0x00eba8 (0x9f09 bytes) 000319 1786192019.443702 write 0x03d461 thru 0x03ffff (0x2b9f bytes) 000320 1786192019.444900 write 0x008dad thru 0x011ac3 (0x8d17 bytes) 000323 1786192019.451566 mapwrite 0x033416 thru 0x03979e (0x6389 bytes) 000326 1786192019.513519 mapread 0x000bb7 thru 0x00210f (0x1559 bytes) 000327 1786192019.525601 write 0x01de66 thru 0x020abf (0x2c5a bytes) 000328 1786192019.538737 mapread 0x032057 thru 0x034d6c (0x2d16 bytes) 000329 1786192019.539704 read 0x01fc71 thru 0x02f44b (0xf7db bytes) 000335 1786192019.549579 trunc from 0x040000 to 0x020d0d (0x1f2f2 bytes) 000338 1786192019.568653 mapread 0x015440 thru 0x019594 (0x4155 bytes) 000340 1786192019.574465 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x20d0e): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20d0e): Mirror 5: 0x212e9473 (stale) Mirror 7: 0x212e9473 (stale) Mirror 9: 0xf72ea2fe (stale) CRC-32 checksum value for chunk [0, 0x20d0e): Mirror 1: 0x8d06facf Mirror 10: 0x8d06facf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20d0e: skipped 000341 1786192020.438961 mapread 0x011c5f thru 0x016d33 (0x50d5 bytes) 000342 1786192020.467958 write 0x01e41b thru 0x024ec3 (0x6aa9 bytes) 000343 1786192020.540059 read 0x0162c1 thru 0x016676 (0x3b6 bytes) 000345 1786192020.547228 read 0x01cee3 thru 0x024ec3 (0x7fe1 bytes) 000346 1786192020.556520 write 0x0314d5 thru 0x03242d (0xf59 bytes) 000347 1786192020.561960 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3242e): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3242e): Mirror 5: 0x4d348b18 (stale) Mirror 7: 0x4d348b18 (stale) Mirror 9: 0x5875f01a (stale) Mirror 10: 0x3b6f1c28 (stale) CRC-32 checksum value for chunk [0, 0x3242e): Mirror 1: 0xb0244442 Mirror 11: 0xb0244442 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3242e: skipped 000348 1786192021.528442 trunc from 0x03242e to 0x037182 (0x4d55 bytes) 000350 1786192021.603028 write 0x00a096 thru 0x01754e (0xd4b9 bytes) 000352 1786192021.617821 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37183): Mirror 7: 0x4cc55c28 (stale) Mirror 9: 0xbd9372d8 (stale) Mirror 10: 0xf05b2971 (stale) Mirror 11: 0xbc915187 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37183): Mirror 7: 0x4cc55c28 (stale) Mirror 9: 0xbd9372d8 (stale) Mirror 10: 0xf05b2971 (stale) Mirror 11: 0xbc915187 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37183: skipped 000355 1786192021.867851 read 0x00eb68 thru 0x013db1 (0x524a bytes) 000358 1786192021.876470 write 0x038741 thru 0x03ffff (0x78bf bytes) 000359 1786192021.877752 mapread 0x01306f thru 0x01e605 (0xb597 bytes) 000362 1786192021.889786 trunc from 0x040000 to 0x031a03 (0xe5fc bytes) 000363 1786192021.902318 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31a04): Mirror 9: 0xf4c1ccce (stale) Mirror 10: 0xbbadabfc (stale) Mirror 11: 0x2637f3b2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31a04): Mirror 9: 0xf4c1ccce (stale) Mirror 10: 0xbbadabfc (stale) Mirror 11: 0x2637f3b2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31a04: skipped 000365 1786192022.194604 mapread 0x021a33 thru 0x030346 (0xe914 bytes) 000368 1786192022.234660 trunc from 0x031a04 to 0x008842 (0x291c1 bytes) 000370 1786192022.256966 trunc from 0x008843 to 0x003e8c (0x49b6 bytes) 000371 1786192022.279904 mapread 0x0025df thru 0x003e8c (0x18ae bytes) 000375 1786192022.294722 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e8d): Mirror 9: 0x47152f5a (stale) Mirror 10: 0x47152f5a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e8d): Mirror 9: 0x47152f5a (stale) Mirror 10: 0x47152f5a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e8d: skipped 000376 1786192022.474986 mapwrite 0x0235f0 thru 0x02a6a9 (0x70ba bytes) 000378 1786192022.540647 write 0x006c73 thru 0x013ba9 (0xcf37 bytes) 000379 1786192022.549484 write 0x0399e5 thru 0x03ffff (0x661b bytes) 000382 1786192022.552005 trunc from 0x040000 to 0x02ec67 (0x11398 bytes) 000383 1786192022.565618 mapread 0x02d693 thru 0x02ec67 (0x15d5 bytes) 000387 1786192022.576777 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2ec68): Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ec68): Mirror 9: 0x77d4321 (stale) Mirror 10: 0x446a001 (stale) CRC-32 checksum value for chunk [0, 0x2ec68): Mirror 1: 0x1be8679 Mirror 11: 0x1be8679 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ec68: skipped 000388 1786192023.525549 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2ec68): Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ec68): Mirror 9: 0x77d4321 (stale) Mirror 10: 0x446a001 (stale) CRC-32 checksum value for chunk [0, 0x2ec68): Mirror 1: 0x1be8679 Mirror 11: 0x1be8679 Mirror 12: 0x1be8679 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ec68: skipped 000389 1786192024.263530 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ec68): Mirror 10: 0x446a001 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ec68): Mirror 10: 0x446a001 (stale) CRC-32 checksum value for chunk [0, 0x2ec68): Mirror 1: 0x1be8679 Mirror 11: 0x1be8679 Mirror 12: 0x1be8679 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ec68: skipped 000390 1786192024.812991 write 0x01a997 thru 0x0265fc (0xbc66 bytes) 000393 1786192024.921980 trunc from 0x02ec68 to 0x01b040 (0x13c27 bytes) 000395 1786192024.953960 trunc from 0x01b041 to 0x003c99 (0x173a7 bytes) 000396 1786192024.976842 mapread 0x0025f1 thru 0x003c99 (0x16a9 bytes) 000397 1786192024.988874 mapwrite 0x01b419 thru 0x029d6f (0xe957 bytes) 000398 1786192025.097674 mapread 0x000c33 thru 0x008bef (0x7fbd bytes) 000399 1786192025.103169 mapread 0x010bb1 thru 0x016c43 (0x6093 bytes) 000400 1786192025.107907 mapwrite 0x005395 thru 0x0111a7 (0xbe13 bytes) 000401 1786192025.136692 MIRROR_RESYNC 4 mirrors 000402 1786192026.204174 mapread 0x016b9f thru 0x0176dd (0xb3f bytes) 000406 1786192026.218281 read 0x00ee77 thru 0x013cf3 (0x4e7d bytes) 000407 1786192026.229329 mapwrite 0x03ff5b thru 0x03ffff (0xa5 bytes) 000408 1786192026.388704 mapread 0x00980b thru 0x00b55f (0x1d55 bytes) 000410 1786192026.401616 mapread 0x007467 thru 0x00c196 (0x4d30 bytes) 000411 1786192026.403947 write 0x0051b4 thru 0x00d350 (0x819d bytes) 000412 1786192026.406699 mapwrite 0x0313a3 thru 0x037b86 (0x67e4 bytes) 000414 1786192026.468506 read 0x0364b3 thru 0x03ffff (0x9b4d bytes) 000415 1786192026.469575 trunc from 0x040000 to 0x02027d (0x1fd82 bytes) 000417 1786192026.494821 read 0x01ad20 thru 0x02027d (0x555e bytes) 000420 1786192026.506281 trunc from 0x02027e to 0x00724f (0x1902e bytes) 000422 1786192026.524006 read 0x005173 thru 0x00724f (0x20dd bytes) 000423 1786192026.525554 mapread 0x0027f5 thru 0x00724f (0x4a5b bytes) 000424 1786192026.527642 write 0x00971f thru 0x00cdec (0x36ce bytes) 000425 1786192026.529136 mapwrite 0x015957 thru 0x01d1ba (0x7864 bytes) 000426 1786192026.610676 write 0x0080d8 thru 0x015b8d (0xdab6 bytes) 000428 1786192026.613935 mapwrite 0x01b02d thru 0x01e19e (0x3172 bytes) 000430 1786192026.682733 trunc from 0x01e19f to 0x004add (0x196c1 bytes) 000432 1786192026.708019 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x4ade): Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4ade): Mirror 10: 0x8b8193b7 (stale) Mirror 11: 0x8b8193b7 (stale) Mirror 12: 0x8b8193b7 (stale) CRC-32 checksum value for chunk [0, 0x4ade): Mirror 1: 0x8b8193b7 Mirror 13: 0x8b8193b7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4ade: skipped 000433 1786192027.309444 mapwrite 0x016d02 thru 0x01cb98 (0x5e97 bytes) 000434 1786192027.456773 mapwrite 0x036754 thru 0x03ffff (0x98ac bytes) 000437 1786192027.522551 mapread 0x01cd0e thru 0x020b9b (0x3e8e bytes) 000438 1786192027.529976 trunc from 0x040000 to 0x028e37 (0x171c8 bytes) 000439 1786192027.544804 write 0x023e37 thru 0x0320dc (0xe2a6 bytes) 000440 1786192027.546114 read 0x00e367 thru 0x00efad (0xc47 bytes) 000444 1786192027.553305 write 0x00990a thru 0x015a39 (0xc130 bytes) 000447 1786192027.564842 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x320dd): Mirror 11: 0xe979206d (stale) Mirror 12: 0xe979206d (stale) Mirror 13: 0x4eafe21c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x320dd): Mirror 11: 0xe979206d (stale) Mirror 12: 0xe979206d (stale) Mirror 13: 0x4eafe21c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x320dd: skipped 000449 1786192027.792461 mapread 0x02c151 thru 0x0320dc (0x5f8c bytes) 000452 1786192027.814584 write 0x03cac8 thru 0x03ffff (0x3538 bytes) 000453 1786192027.819807 MIRROR_RESYNC 4 mirrors 000454 1786192029.068959 mapwrite 0x034f64 thru 0x035ae5 (0xb82 bytes) 000455 1786192029.185283 mapwrite 0x007dad thru 0x00dbf7 (0x5e4b bytes) 000457 1786192029.244001 mapwrite 0x039bff thru 0x03ffff (0x6401 bytes) 000458 1786192029.289794 write 0x02a2e2 thru 0x039a3f (0xf75e bytes) 000459 1786192029.300673 MIRROR_RESYNC 4 mirrors 000460 1786192030.060897 mapwrite 0x03d9af thru 0x03ffff (0x2651 bytes) 000461 1786192030.185327 write 0x03d20f thru 0x03ffff (0x2df1 bytes) 000462 1786192030.186504 write 0x01a7d9 thru 0x025943 (0xb16b bytes) 000464 1786192030.198678 read 0x009341 thru 0x01064d (0x730d bytes) 000467 1786192030.211571 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xf528e3f7 (stale) Mirror 12: 0xf528e3f7 (stale) Mirror 13: 0xf528e3f7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2a53a521 Mirror 14: 0x2a53a521 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000468 1786192030.894572 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0xf528e3f7 (stale) Mirror 12: 0xf528e3f7 (stale) Mirror 13: 0xf528e3f7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2a53a521 Mirror 14: 0x2a53a521 Mirror 15: 0x2a53a521 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000469 1786192031.529721 MIRROR_RESYNC 6 mirrors 000473 1786192032.186753 mapwrite 0x02c1fe thru 0x02f2b6 (0x30b9 bytes) 000474 1786192032.321452 mapread 0x03b313 thru 0x03e4eb (0x31d9 bytes) 000476 1786192032.335745 mapwrite 0x00a7ba thru 0x010765 (0x5fac bytes) 000477 1786192032.365724 write 0x01b9a9 thru 0x01f888 (0x3ee0 bytes) 000478 1786192032.373691 trunc from 0x040000 to 0x004ef2 (0x3b10d bytes) 000481 1786192032.403916 mapread 0x004484 thru 0x004ef2 (0xa6f bytes) 000484 1786192032.409615 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x4ef3): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4ef3): Mirror 11: 0x3182dd4d (stale) Mirror 12: 0x3182dd4d (stale) Mirror 13: 0x3182dd4d (stale) Mirror 14: 0x3182dd4d (stale) Mirror 15: 0x3182dd4d (stale) CRC-32 checksum value for chunk [0, 0x4ef3): Mirror 1: 0x3182dd4d Mirror 16: 0x3182dd4d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4ef3: skipped 000485 1786192033.045646 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x4ef3): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4ef3): Mirror 11: 0x3182dd4d (stale) Mirror 12: 0x3182dd4d (stale) Mirror 13: 0x3182dd4d (stale) Mirror 14: 0x3182dd4d (stale) Mirror 15: 0x3182dd4d (stale) CRC-32 checksum value for chunk [0, 0x4ef3): Mirror 1: 0x3182dd4d Mirror 16: 0x3182dd4d Mirror 17: 0x3182dd4d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4ef3: skipped 000486 1786192033.716517 trunc from 0x004ef3 to 0x03a53d (0x3564b bytes) 000489 1786192033.784396 trunc from 0x03a53e to 0x0133ae (0x2718f bytes) 000490 1786192033.794955 read 0x005893 thru 0x00b3f6 (0x5b64 bytes) 000492 1786192033.799832 mapread 0x00d964 thru 0x0133ae (0x5a4b bytes) 000493 1786192033.812893 read 0x00f0b5 thru 0x0133ae (0x42fa bytes) 000499 1786192033.816320 read 0x00127d thru 0x0040ab (0x2e2f bytes) 000501 1786192033.821932 write 0x000573 thru 0x0086bd (0x814b bytes) 000502 1786192033.822907 read 0x00091a thru 0x00b6e6 (0xadcd bytes) 000503 1786192033.825770 MIRROR_RESYNC 8 mirrors 000504 1786192034.825042 MIRROR_EXTEND to 9 mirrors 000508 1786192035.357490 mapwrite 0x00d144 thru 0x013b99 (0x6a56 bytes) 000511 1786192035.476722 mapread 0x000463 thru 0x00c121 (0xbcbf bytes) 000512 1786192035.484161 mapread 0x005af2 thru 0x00eaf3 (0x9002 bytes) 000513 1786192035.485630 read 0x000408 thru 0x00a980 (0xa579 bytes) 000514 1786192035.489406 MIRROR_RESYNC 9 mirrors 000518 1786192036.898504 read 0x00b7da thru 0x013b99 (0x83c0 bytes) 000519 1786192036.908026 MIRROR_EXTEND to 10 mirrors 000520 1786192037.625303 mapread 0x00e120 thru 0x013b99 (0x5a7a bytes) 000521 1786192037.648486 read 0x012008 thru 0x013b99 (0x1b92 bytes) 000522 1786192037.652351 mapread 0x00e400 thru 0x00fb0a (0x170b bytes) 000524 1786192037.664497 MIRROR_EXTEND to 11 mirrors 000525 1786192038.266705 MIRROR_EXTEND to 12 mirrors 000527 1786192038.958463 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) 000528 1786192039.321423 write 0x038089 thru 0x03ffff (0x7f77 bytes) 000529 1786192039.410328 trunc from 0x040000 to 0x012f4b (0x2d0b4 bytes) 000530 1786192039.442515 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x12f4c): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12f4c): Mirror 12: 0x8810fd16 (stale) Mirror 13: 0x8810fd16 (stale) Mirror 14: 0x8810fd16 (stale) Mirror 15: 0x8810fd16 (stale) Mirror 16: 0x8810fd16 (stale) Mirror 17: 0x8810fd16 (stale) Mirror 18: 0x8810fd16 (stale) Mirror 19: 0x8810fd16 (stale) Mirror 20: 0x8810fd16 (stale) Mirror 21: 0x8810fd16 (stale) CRC-32 checksum value for chunk [0, 0x12f4c): Mirror 1: 0x8810fd16 Mirror 22: 0x8810fd16 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12f4c: skipped 000533 1786192040.671454 read 0x004e83 thru 0x005b38 (0xcb6 bytes) 000534 1786192040.685029 mapwrite 0x0111a9 thru 0x01a577 (0x93cf bytes) 000535 1786192040.852577 mapread 0x005350 thru 0x013145 (0xddf6 bytes) 000536 1786192040.864743 mapwrite 0x02d7a1 thru 0x03559f (0x7dff bytes) 000537 1786192040.942273 mapread 0x032609 thru 0x03559f (0x2f97 bytes) 000538 1786192040.947195 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x355a0): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x355a0): Mirror 12: 0x9d76fef6 (stale) Mirror 13: 0x9d76fef6 (stale) Mirror 14: 0x9d76fef6 (stale) Mirror 15: 0x9d76fef6 (stale) Mirror 16: 0x9d76fef6 (stale) Mirror 17: 0x9d76fef6 (stale) Mirror 18: 0x9d76fef6 (stale) Mirror 19: 0x9d76fef6 (stale) Mirror 20: 0x9d76fef6 (stale) Mirror 21: 0x9d76fef6 (stale) Mirror 22: 0xd9977e (stale) CRC-32 checksum value for chunk [0, 0x355a0): Mirror 1: 0xd9d7c271 Mirror 23: 0xd9d7c271 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x355a0: skipped 000539 1786192041.826439 MIRROR_SPLIT mirror 4 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x355a0): Mirror 12: 0x9d76fef6 (stale) Mirror 13: 0x9d76fef6 (stale) Mirror 14: 0x9d76fef6 (stale) Mirror 16: 0x9d76fef6 (stale) Mirror 17: 0x9d76fef6 (stale) Mirror 18: 0x9d76fef6 (stale) Mirror 19: 0x9d76fef6 (stale) Mirror 20: 0x9d76fef6 (stale) Mirror 21: 0x9d76fef6 (stale) Mirror 22: 0xd9977e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x355a0): Mirror 12: 0x9d76fef6 (stale) Mirror 13: 0x9d76fef6 (stale) Mirror 14: 0x9d76fef6 (stale) Mirror 16: 0x9d76fef6 (stale) Mirror 17: 0x9d76fef6 (stale) Mirror 18: 0x9d76fef6 (stale) Mirror 19: 0x9d76fef6 (stale) Mirror 20: 0x9d76fef6 (stale) Mirror 21: 0x9d76fef6 (stale) Mirror 22: 0xd9977e (stale) CRC-32 checksum value for chunk [0, 0x355a0): Mirror 1: 0xd9d7c271 Mirror 23: 0xd9d7c271 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x355a0: skipped 000540 1786192042.548485 trunc from 0x0355a0 to 0x03a22c (0x4c8d bytes) 000541 1786192042.612948 read 0x03148a thru 0x0357d0 (0x4347 bytes) 000544 1786192042.618116 write 0x015d79 thru 0x021f63 (0xc1eb bytes) 000546 1786192042.624492 write 0x0264b8 thru 0x02a2bf (0x3e08 bytes) 000551 1786192042.634384 MIRROR_SPLIT mirror 7 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a22d): Mirror 12: 0x23950d24 (stale) Mirror 13: 0x23950d24 (stale) Mirror 14: 0x23950d24 (stale) Mirror 16: 0x23950d24 (stale) Mirror 17: 0x23950d24 (stale) Mirror 18: 0x23950d24 (stale) Mirror 20: 0x23950d24 (stale) Mirror 21: 0x23950d24 (stale) Mirror 22: 0x303e006d (stale) Mirror 23: 0x8974d8dc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a22d): Mirror 12: 0x23950d24 (stale) Mirror 13: 0x23950d24 (stale) Mirror 14: 0x23950d24 (stale) Mirror 16: 0x23950d24 (stale) Mirror 17: 0x23950d24 (stale) Mirror 18: 0x23950d24 (stale) Mirror 20: 0x23950d24 (stale) Mirror 21: 0x23950d24 (stale) Mirror 22: 0x303e006d (stale) Mirror 23: 0x8974d8dc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a22d: skipped 000553 1786192043.000068 trunc from 0x03a22d to 0x01e8f1 (0x1b93b bytes) 000554 1786192043.014219 read 0x00cd9f thru 0x0100a9 (0x330b bytes) 000555 1786192043.018784 read 0x000da0 thru 0x0106d5 (0xf936 bytes) 000557 1786192043.024858 read 0x009df0 thru 0x00b169 (0x137a bytes) 000559 1786192043.029203 MIRROR_RESYNC 11 mirrors 000560 1786192044.753638 read 0x019a8b thru 0x01e8f1 (0x4e67 bytes) 000561 1786192044.759034 mapwrite 0x03d3b5 thru 0x03ffff (0x2c4b bytes) 000563 1786192044.876914 MIRROR_RESYNC 11 mirrors 000564 1786192047.296452 mapread 0x02122a thru 0x02c2ba (0xb091 bytes) 000565 1786192047.318521 mapwrite 0x0335c4 thru 0x03af36 (0x7973 bytes) 000567 1786192047.445755 mapwrite 0x036592 thru 0x03ffff (0x9a6e bytes) 000568 1786192047.483433 read 0x0055f5 thru 0x011aad (0xc4b9 bytes) 000570 1786192047.496407 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x7b3e1f36 (stale) Mirror 13: 0x7b3e1f36 (stale) Mirror 14: 0x7b3e1f36 (stale) Mirror 16: 0x7b3e1f36 (stale) Mirror 17: 0x7b3e1f36 (stale) Mirror 18: 0x7b3e1f36 (stale) Mirror 20: 0x7b3e1f36 (stale) Mirror 21: 0x7b3e1f36 (stale) Mirror 22: 0x7b3e1f36 (stale) Mirror 23: 0x7b3e1f36 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc1f42d7f Mirror 24: 0xc1f42d7f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000571 1786192048.334552 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x7b3e1f36 (stale) Mirror 13: 0x7b3e1f36 (stale) Mirror 14: 0x7b3e1f36 (stale) Mirror 16: 0x7b3e1f36 (stale) Mirror 17: 0x7b3e1f36 (stale) Mirror 18: 0x7b3e1f36 (stale) Mirror 20: 0x7b3e1f36 (stale) Mirror 21: 0x7b3e1f36 (stale) Mirror 22: 0x7b3e1f36 (stale) Mirror 23: 0x7b3e1f36 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc1f42d7f Mirror 24: 0xc1f42d7f Mirror 25: 0xc1f42d7f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000572 1786192049.165509 mapread 0x01c7d3 thru 0x02272e (0x5f5c bytes) 000573 1786192049.181158 trunc from 0x040000 to 0x00844e (0x37bb1 bytes) 000574 1786192049.303372 read 0x008030 thru 0x00844e (0x41f bytes) 000575 1786192049.308923 mapread 0x004e1f thru 0x00844e (0x3630 bytes) 000576 1786192049.319220 mapwrite 0x014a73 thru 0x021612 (0xcba0 bytes) 000579 1786192049.423658 mapread 0x00a5dd thru 0x00dbbc (0x35e0 bytes) 000580 1786192049.435131 trunc from 0x021613 to 0x00de73 (0x1379f bytes) 000581 1786192049.464461 MIRROR_RESYNC 13 mirrors 000582 1786192051.271690 mapwrite 0x015ab7 thru 0x01b6cd (0x5c17 bytes) 000583 1786192051.372394 read 0x01aabb thru 0x01b6cd (0xc13 bytes) 000584 1786192051.373824 mapwrite 0x00ecd2 thru 0x00ef53 (0x282 bytes) 000586 1786192051.406489 write 0x00606d thru 0x00a8e4 (0x4878 bytes) 000587 1786192051.410426 mapread 0x01103e thru 0x01492d (0x38f0 bytes) 000589 1786192051.412395 mapread 0x0045ef thru 0x0066df (0x20f1 bytes) 000591 1786192051.423772 MIRROR_RESYNC 13 mirrors 000592 1786192054.305379 mapread 0x00288b thru 0x007973 (0x50e9 bytes) 000593 1786192054.323985 read 0x00df86 thru 0x013102 (0x517d bytes) 000594 1786192054.334017 MIRROR_RESYNC 13 mirrors 000597 1786192054.804920 mapwrite 0x00c101 thru 0x016c9a (0xab9a bytes) 000599 1786192054.939414 mapread 0x003518 thru 0x00d11e (0x9c07 bytes) 000600 1786192054.950378 read 0x01af19 thru 0x01b6cd (0x7b5 bytes) 000601 1786192054.957228 MIRROR_SPLIT mirror 5 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b6ce): Mirror 12: 0x9e05297b (stale) Mirror 13: 0x9e05297b (stale) Mirror 14: 0x9e05297b (stale) Mirror 16: 0x9e05297b (stale) Mirror 18: 0x9e05297b (stale) Mirror 20: 0x9e05297b (stale) Mirror 21: 0x9e05297b (stale) Mirror 22: 0x9e05297b (stale) Mirror 23: 0x9e05297b (stale) Mirror 24: 0x9e05297b (stale) Mirror 25: 0x9e05297b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b6ce): Mirror 12: 0x9e05297b (stale) Mirror 13: 0x9e05297b (stale) Mirror 14: 0x9e05297b (stale) Mirror 16: 0x9e05297b (stale) Mirror 18: 0x9e05297b (stale) Mirror 20: 0x9e05297b (stale) Mirror 21: 0x9e05297b (stale) Mirror 22: 0x9e05297b (stale) Mirror 23: 0x9e05297b (stale) Mirror 24: 0x9e05297b (stale) Mirror 25: 0x9e05297b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b6ce: skipped 000602 1786192055.419304 read 0x00d8a4 thru 0x00e6e5 (0xe42 bytes) 000606 1786192055.424715 read 0x009d94 thru 0x011c0d (0x7e7a bytes) 000607 1786192055.430130 trunc from 0x01b6ce to 0x016d9f (0x492e bytes) 000608 1786192055.440777 trunc from 0x016da0 to 0x016619 (0x786 bytes) 000609 1786192055.452818 mapwrite 0x018f56 thru 0x0241b1 (0xb25c bytes) 000610 1786192055.550598 trunc from 0x0241b2 to 0x02e458 (0xa2a7 bytes) 000612 1786192055.568175 mapread 0x026159 thru 0x026c0c (0xab4 bytes) 000614 1786192055.590464 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x2e459): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e459): Mirror 12: 0xfdbc69bc (stale) Mirror 13: 0xfdbc69bc (stale) Mirror 14: 0xfdbc69bc (stale) Mirror 16: 0xfdbc69bc (stale) Mirror 18: 0xfdbc69bc (stale) Mirror 20: 0xfdbc69bc (stale) Mirror 21: 0xfdbc69bc (stale) Mirror 22: 0xfdbc69bc (stale) Mirror 23: 0xfdbc69bc (stale) Mirror 24: 0xfdbc69bc (stale) Mirror 25: 0xfdbc69bc (stale) CRC-32 checksum value for chunk [0, 0x2e459): Mirror 1: 0xdc3731a6 Mirror 26: 0xdc3731a6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e459: skipped 000618 1786192056.736534 mapread 0x009c0d thru 0x018027 (0xe41b bytes) 000620 1786192056.782693 mapread 0x0298e9 thru 0x02e458 (0x4b70 bytes) 000621 1786192056.806899 mapwrite 0x031914 thru 0x031dd9 (0x4c6 bytes) 000622 1786192056.908676 mapread 0x019f75 thru 0x022518 (0x85a4 bytes) 000623 1786192056.930574 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31dda): Mirror 13: 0x2b7eac1c (stale) Mirror 14: 0x2b7eac1c (stale) Mirror 16: 0x2b7eac1c (stale) Mirror 18: 0x2b7eac1c (stale) Mirror 20: 0x2b7eac1c (stale) Mirror 21: 0x2b7eac1c (stale) Mirror 22: 0x2b7eac1c (stale) Mirror 23: 0x2b7eac1c (stale) Mirror 24: 0x2b7eac1c (stale) Mirror 25: 0x2b7eac1c (stale) Mirror 26: 0xf02c8d73 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31dda): Mirror 13: 0x2b7eac1c (stale) Mirror 14: 0x2b7eac1c (stale) Mirror 16: 0x2b7eac1c (stale) Mirror 18: 0x2b7eac1c (stale) Mirror 20: 0x2b7eac1c (stale) Mirror 21: 0x2b7eac1c (stale) Mirror 22: 0x2b7eac1c (stale) Mirror 23: 0x2b7eac1c (stale) Mirror 24: 0x2b7eac1c (stale) Mirror 25: 0x2b7eac1c (stale) Mirror 26: 0xf02c8d73 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31dda: skipped 000624 1786192057.385962 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x31dda): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31dda): Mirror 13: 0x2b7eac1c (stale) Mirror 14: 0x2b7eac1c (stale) Mirror 16: 0x2b7eac1c (stale) Mirror 18: 0x2b7eac1c (stale) Mirror 20: 0x2b7eac1c (stale) Mirror 21: 0x2b7eac1c (stale) Mirror 22: 0x2b7eac1c (stale) Mirror 23: 0x2b7eac1c (stale) Mirror 24: 0x2b7eac1c (stale) Mirror 25: 0x2b7eac1c (stale) Mirror 26: 0xf02c8d73 (stale) CRC-32 checksum value for chunk [0, 0x31dda): Mirror 1: 0x1ef01f0a Mirror 27: 0x1ef01f0a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31dda: skipped 000627 1786192058.299373 mapread 0x013bb4 thru 0x020ef9 (0xd346 bytes) 000628 1786192058.346291 mapwrite 0x034011 thru 0x03ffff (0xbfef bytes) 000629 1786192058.489802 mapread 0x0155d9 thru 0x021c2b (0xc653 bytes) 000630 1786192058.524649 mapwrite 0x005574 thru 0x00ce9d (0x792a bytes) 000632 1786192058.617800 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x732361cd (stale) Mirror 14: 0x732361cd (stale) Mirror 16: 0x732361cd (stale) Mirror 18: 0x732361cd (stale) Mirror 20: 0x732361cd (stale) Mirror 21: 0x732361cd (stale) Mirror 22: 0x732361cd (stale) Mirror 23: 0x732361cd (stale) Mirror 24: 0x732361cd (stale) Mirror 25: 0x732361cd (stale) Mirror 26: 0x7bb1add4 (stale) Mirror 27: 0x2433a733 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe47acdbe Mirror 28: 0xe47acdbe lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000634 1786192059.794728 read 0x0070d2 thru 0x00a9ea (0x3919 bytes) 000635 1786192059.810636 read 0x02b5be thru 0x035761 (0xa1a4 bytes) 000637 1786192059.837971 mapread 0x03af20 thru 0x03ffff (0x50e0 bytes) 000644 1786192059.894560 trunc from 0x040000 to 0x022439 (0x1dbc6 bytes) 000645 1786192059.974783 mapwrite 0x03509c thru 0x03d192 (0x80f7 bytes) 000646 1786192060.087236 mapread 0x02c4af thru 0x036d10 (0xa862 bytes) 000647 1786192060.131560 trunc from 0x03d193 to 0x01b409 (0x21d89 bytes) 000648 1786192060.156403 MIRROR_RESYNC 14 mirrors 000649 1786192061.748433 write 0x0247f5 thru 0x02aad9 (0x62e5 bytes) 000651 1786192061.813991 write 0x03a1ea thru 0x03ffff (0x5e16 bytes) 000653 1786192061.816403 write 0x029b05 thru 0x036f02 (0xd3fe bytes) 000654 1786192061.825747 MIRROR_SPLIT mirror 7 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x48f18928 (stale) Mirror 14: 0x48f18928 (stale) Mirror 16: 0x48f18928 (stale) Mirror 18: 0x48f18928 (stale) Mirror 20: 0x48f18928 (stale) Mirror 21: 0x48f18928 (stale) Mirror 23: 0x48f18928 (stale) Mirror 24: 0x48f18928 (stale) Mirror 25: 0x48f18928 (stale) Mirror 26: 0x48f18928 (stale) Mirror 27: 0x48f18928 (stale) Mirror 28: 0x48f18928 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x48f18928 (stale) Mirror 14: 0x48f18928 (stale) Mirror 16: 0x48f18928 (stale) Mirror 18: 0x48f18928 (stale) Mirror 20: 0x48f18928 (stale) Mirror 21: 0x48f18928 (stale) Mirror 23: 0x48f18928 (stale) Mirror 24: 0x48f18928 (stale) Mirror 25: 0x48f18928 (stale) Mirror 26: 0x48f18928 (stale) Mirror 27: 0x48f18928 (stale) Mirror 28: 0x48f18928 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000655 1786192062.321502 read 0x00e891 thru 0x0179b2 (0x9122 bytes) 000657 1786192062.329778 write 0x03b86b thru 0x03ffff (0x4795 bytes) 000658 1786192062.333254 read 0x00a3f9 thru 0x00e73d (0x4345 bytes) 000660 1786192062.339855 mapread 0x00b62c thru 0x018774 (0xd149 bytes) 000662 1786192062.344590 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x48f18928 (stale) Mirror 16: 0x48f18928 (stale) Mirror 18: 0x48f18928 (stale) Mirror 20: 0x48f18928 (stale) Mirror 21: 0x48f18928 (stale) Mirror 23: 0x48f18928 (stale) Mirror 24: 0x48f18928 (stale) Mirror 25: 0x48f18928 (stale) Mirror 26: 0x48f18928 (stale) Mirror 27: 0x48f18928 (stale) Mirror 28: 0x48f18928 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x48f18928 (stale) Mirror 16: 0x48f18928 (stale) Mirror 18: 0x48f18928 (stale) Mirror 20: 0x48f18928 (stale) Mirror 21: 0x48f18928 (stale) Mirror 23: 0x48f18928 (stale) Mirror 24: 0x48f18928 (stale) Mirror 25: 0x48f18928 (stale) Mirror 26: 0x48f18928 (stale) Mirror 27: 0x48f18928 (stale) Mirror 28: 0x48f18928 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000663 1786192062.813848 mapread 0x015b56 thru 0x0193c6 (0x3871 bytes) 000664 1786192062.836744 trunc from 0x040000 to 0x02c537 (0x13ac8 bytes) 000665 1786192062.858120 write 0x0189ea thru 0x01dcf3 (0x530a bytes) 000666 1786192062.859097 mapwrite 0x02199f thru 0x02bb00 (0xa162 bytes) 000667 1786192062.928468 write 0x01235d thru 0x015573 (0x3217 bytes) 000669 1786192062.929649 read 0x012762 thru 0x020f2f (0xe7ce bytes) 000671 1786192062.931126 trunc from 0x02c538 to 0x004b32 (0x27a05 bytes) 000672 1786192062.946546 mapread 0x002efa thru 0x004b32 (0x1c39 bytes) 000673 1786192062.955776 write 0x037a44 thru 0x03ffff (0x85bc bytes) 000675 1786192062.959798 read 0x016f2d thru 0x01e9b0 (0x7a84 bytes) 000676 1786192062.969578 mapread 0x023866 thru 0x02424d (0x9e8 bytes) 000679 1786192062.972707 write 0x03332d thru 0x03e23f (0xaf13 bytes) 000681 1786192062.975668 mapread 0x00b112 thru 0x01952e (0xe41d bytes) 000682 1786192062.977192 trunc from 0x040000 to 0x037e4e (0x81b1 bytes) 000684 1786192062.998383 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x37e4f): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37e4f): Mirror 14: 0x6f6d6a37 (stale) Mirror 16: 0x6f6d6a37 (stale) Mirror 18: 0x6f6d6a37 (stale) Mirror 20: 0x6f6d6a37 (stale) Mirror 21: 0x6f6d6a37 (stale) Mirror 23: 0x6f6d6a37 (stale) Mirror 24: 0x6f6d6a37 (stale) Mirror 25: 0x6f6d6a37 (stale) Mirror 26: 0x6f6d6a37 (stale) Mirror 27: 0x6f6d6a37 (stale) Mirror 28: 0x6f6d6a37 (stale) CRC-32 checksum value for chunk [0, 0x37e4f): Mirror 1: 0xa14f0c3c Mirror 29: 0xa14f0c3c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37e4f: skipped 000685 1786192064.104612 mapread 0x0326f2 thru 0x037e4e (0x575d bytes) 000687 1786192064.149369 write 0x035277 thru 0x03d755 (0x84df bytes) 000690 1786192064.246201 MIRROR_SPLIT mirror 4 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d756): Mirror 14: 0xc4cf4efd (stale) Mirror 16: 0xc4cf4efd (stale) Mirror 18: 0xc4cf4efd (stale) Mirror 21: 0xc4cf4efd (stale) Mirror 23: 0xc4cf4efd (stale) Mirror 24: 0xc4cf4efd (stale) Mirror 25: 0xc4cf4efd (stale) Mirror 26: 0xc4cf4efd (stale) Mirror 27: 0xc4cf4efd (stale) Mirror 28: 0xc4cf4efd (stale) Mirror 29: 0xb10624ba (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d756): Mirror 14: 0xc4cf4efd (stale) Mirror 16: 0xc4cf4efd (stale) Mirror 18: 0xc4cf4efd (stale) Mirror 21: 0xc4cf4efd (stale) Mirror 23: 0xc4cf4efd (stale) Mirror 24: 0xc4cf4efd (stale) Mirror 25: 0xc4cf4efd (stale) Mirror 26: 0xc4cf4efd (stale) Mirror 27: 0xc4cf4efd (stale) Mirror 28: 0xc4cf4efd (stale) Mirror 29: 0xb10624ba (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d756: skipped 000691 1786192064.679827 read 0x031ce8 thru 0x03bdab (0xa0c4 bytes) 000692 1786192064.689433 trunc from 0x03d756 to 0x0019c0 (0x3bd95 bytes) 000693 1786192064.709267 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x19c1): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19c1): Mirror 14: 0xf92a44ea (stale) Mirror 16: 0xf92a44ea (stale) Mirror 18: 0xf92a44ea (stale) Mirror 21: 0xf92a44ea (stale) Mirror 23: 0xf92a44ea (stale) Mirror 24: 0xf92a44ea (stale) Mirror 25: 0xf92a44ea (stale) Mirror 26: 0xf92a44ea (stale) Mirror 27: 0xf92a44ea (stale) Mirror 28: 0xf92a44ea (stale) Mirror 29: 0xf92a44ea (stale) CRC-32 checksum value for chunk [0, 0x19c1): Mirror 1: 0xf92a44ea Mirror 30: 0xf92a44ea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19c1: skipped 000694 1786192065.610178 mapread 0x0017ad thru 0x0019c0 (0x214 bytes) 000695 1786192065.641562 write 0x03d751 thru 0x03ffff (0x28af bytes) 000696 1786192065.710996 trunc from 0x040000 to 0x02a38c (0x15c73 bytes) 000698 1786192065.728270 trunc from 0x02a38d to 0x0074d1 (0x22ebb bytes) 000699 1786192065.738957 trunc from 0x0074d2 to 0x035c11 (0x2e740 bytes) 000712 1786192065.760801 write 0x00d6a6 thru 0x014c34 (0x758f bytes) 000714 1786192065.775885 MIRROR_SPLIT mirror 6 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35c12): Mirror 14: 0x923e65bb (stale) Mirror 16: 0x923e65bb (stale) Mirror 18: 0x923e65bb (stale) Mirror 21: 0x923e65bb (stale) Mirror 23: 0x923e65bb (stale) Mirror 25: 0x923e65bb (stale) Mirror 26: 0x923e65bb (stale) Mirror 27: 0x923e65bb (stale) Mirror 28: 0x923e65bb (stale) Mirror 29: 0xc8f208cb (stale) Mirror 30: 0xbd56825b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35c12): Mirror 14: 0x923e65bb (stale) Mirror 16: 0x923e65bb (stale) Mirror 18: 0x923e65bb (stale) Mirror 21: 0x923e65bb (stale) Mirror 23: 0x923e65bb (stale) Mirror 25: 0x923e65bb (stale) Mirror 26: 0x923e65bb (stale) Mirror 27: 0x923e65bb (stale) Mirror 28: 0x923e65bb (stale) Mirror 29: 0xc8f208cb (stale) Mirror 30: 0xbd56825b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35c12: skipped 000715 1786192066.313812 mapwrite 0x013c5a thru 0x01e0f3 (0xa49a bytes) 000716 1786192066.392170 mapread 0x0144d5 thru 0x01d02d (0x8b59 bytes) 000717 1786192066.393601 mapwrite 0x03ee3e thru 0x03ffff (0x11c2 bytes) 000719 1786192066.460701 mapwrite 0x02eec0 thru 0x03d0a7 (0xe1e8 bytes) 000722 1786192066.510290 mapwrite 0x02ce7b thru 0x02e861 (0x19e7 bytes) 000723 1786192066.552193 mapwrite 0x02b69e thru 0x03034e (0x4cb1 bytes) 000724 1786192066.597787 write 0x035b80 thru 0x03ffff (0xa480 bytes) 000725 1786192066.599891 mapread 0x004196 thru 0x0045b1 (0x41c bytes) 000727 1786192066.610503 read 0x025cf0 thru 0x031699 (0xb9aa bytes) 000729 1786192066.612184 read 0x03d9aa thru 0x03ffff (0x2656 bytes) 000730 1786192066.613821 mapwrite 0x008537 thru 0x017ee7 (0xf9b1 bytes) 000732 1786192066.661954 mapwrite 0x0187e4 thru 0x01b6eb (0x2f08 bytes) 000733 1786192066.696685 trunc from 0x040000 to 0x0163d2 (0x29c2d bytes) 000735 1786192066.718515 trunc from 0x0163d3 to 0x0283d8 (0x12006 bytes) 000736 1786192066.735928 read 0x0096d9 thru 0x011353 (0x7c7b bytes) 000737 1786192066.737476 mapwrite 0x00e95c thru 0x01abd5 (0xc27a bytes) 000739 1786192066.792653 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x283d9): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x283d9): Mirror 14: 0x524bfc01 (stale) Mirror 16: 0x524bfc01 (stale) Mirror 18: 0x524bfc01 (stale) Mirror 21: 0x524bfc01 (stale) Mirror 23: 0x524bfc01 (stale) Mirror 25: 0x524bfc01 (stale) Mirror 26: 0x524bfc01 (stale) Mirror 27: 0x524bfc01 (stale) Mirror 28: 0x524bfc01 (stale) Mirror 29: 0x29a7125d (stale) Mirror 30: 0x9f43b8ab (stale) CRC-32 checksum value for chunk [0, 0x283d9): Mirror 1: 0x6072fa28 Mirror 31: 0x6072fa28 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x283d9: skipped 000740 1786192067.912365 read 0x008ace thru 0x00d3c6 (0x48f9 bytes) 000741 1786192067.936660 read 0x027b95 thru 0x02817c (0x5e8 bytes) 000745 1786192068.039313 MIRROR_RESYNC 13 mirrors 000746 1786192070.720243 mapwrite 0x004620 thru 0x00b88c (0x726d bytes) 000753 1786192070.857518 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x283d9): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x283d9): Mirror 14: 0x6072fa28 (stale) Mirror 16: 0x6072fa28 (stale) Mirror 18: 0x6072fa28 (stale) Mirror 21: 0x6072fa28 (stale) Mirror 23: 0x6072fa28 (stale) Mirror 25: 0x6072fa28 (stale) Mirror 26: 0x6072fa28 (stale) Mirror 27: 0x6072fa28 (stale) Mirror 28: 0x6072fa28 (stale) Mirror 29: 0x6072fa28 (stale) Mirror 30: 0x6072fa28 (stale) Mirror 31: 0x6072fa28 (stale) CRC-32 checksum value for chunk [0, 0x283d9): Mirror 1: 0x6d603e21 Mirror 32: 0x6d603e21 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x283d9: skipped 000755 1786192071.983466 mapread 0x023817 thru 0x0283d8 (0x4bc2 bytes) 000756 1786192072.026474 read 0x0024e3 thru 0x006520 (0x403e bytes) 000757 1786192072.045541 mapread 0x016a56 thru 0x019397 (0x2942 bytes) 000761 1786192072.091542 trunc from 0x0283d9 to 0x01d957 (0xaa81 bytes) 000762 1786192072.186689 trunc from 0x01d958 to 0x0319d1 (0x1407a bytes) 000765 1786192072.218682 read 0x00fa55 thru 0x01c653 (0xcbff bytes) truncating to largest ever: 0x3ed84 000766 1786192072.227765 trunc from 0x0319d2 to 0x03ed83 (0xd3b2 bytes) 000768 1786192072.247196 mapread 0x0129f5 thru 0x019bab (0x71b7 bytes) 000769 1786192072.249021 mapread 0x036bc3 thru 0x03bf84 (0x53c2 bytes) 000770 1786192072.258778 write 0x001e31 thru 0x005cbe (0x3e8e bytes) 000771 1786192072.260737 mapwrite 0x01d59b thru 0x029c07 (0xc66d bytes) 000774 1786192072.306223 write 0x028885 thru 0x02c1de (0x395a bytes) 000775 1786192072.314368 MIRROR_SPLIT mirror 10 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ed84): Mirror 14: 0x6e63387e (stale) Mirror 16: 0x6e63387e (stale) Mirror 18: 0x6e63387e (stale) Mirror 21: 0x6e63387e (stale) Mirror 23: 0x6e63387e (stale) Mirror 25: 0x6e63387e (stale) Mirror 26: 0x6e63387e (stale) Mirror 27: 0x6e63387e (stale) Mirror 28: 0x6e63387e (stale) Mirror 30: 0x6e63387e (stale) Mirror 31: 0x6e63387e (stale) Mirror 32: 0xaa9f3b2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ed84): Mirror 14: 0x6e63387e (stale) Mirror 16: 0x6e63387e (stale) Mirror 18: 0x6e63387e (stale) Mirror 21: 0x6e63387e (stale) Mirror 23: 0x6e63387e (stale) Mirror 25: 0x6e63387e (stale) Mirror 26: 0x6e63387e (stale) Mirror 27: 0x6e63387e (stale) Mirror 28: 0x6e63387e (stale) Mirror 30: 0x6e63387e (stale) Mirror 31: 0x6e63387e (stale) Mirror 32: 0xaa9f3b2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ed84: skipped 000777 1786192072.819901 read 0x007348 thru 0x00a42c (0x30e5 bytes) 000778 1786192072.826506 MIRROR_RESYNC 13 mirrors 000780 1786192074.652806 mapwrite 0x033dc7 thru 0x03ffff (0xc239 bytes) 000781 1786192074.768367 write 0x01889f thru 0x01f071 (0x67d3 bytes) 000783 1786192074.774731 mapwrite 0x011c85 thru 0x0147ff (0x2b7b bytes) 000785 1786192074.810134 read 0x0092f1 thru 0x00d065 (0x3d75 bytes) 000786 1786192074.815143 trunc from 0x040000 to 0x022664 (0x1d99b bytes) 000789 1786192074.837243 trunc from 0x022665 to 0x02f915 (0xd2b1 bytes) 000791 1786192074.858189 mapread 0x02a425 thru 0x02d7ad (0x3389 bytes) 000792 1786192074.867955 MIRROR_RESYNC 13 mirrors 000793 1786192076.595724 read 0x0171b3 thru 0x01c240 (0x508e bytes) 000794 1786192076.603934 mapwrite 0x0284fd thru 0x02d863 (0x5367 bytes) 000795 1786192076.772205 read 0x016024 thru 0x01d54a (0x7527 bytes) 000796 1786192076.786144 trunc from 0x02f916 to 0x00adbf (0x24b56 bytes) 000797 1786192076.809987 read 0x00924b thru 0x00adbf (0x1b75 bytes) 000798 1786192076.811385 trunc from 0x00adc0 to 0x037c32 (0x2ce73 bytes) 000799 1786192076.825312 read 0x002af3 thru 0x0100e7 (0xd5f5 bytes) 000800 1786192076.834588 write 0x01cda0 thru 0x02a8b0 (0xdb11 bytes) 000801 1786192076.840517 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x37c33): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37c33): Mirror 14: 0xdd32c2a5 (stale) Mirror 16: 0xdd32c2a5 (stale) Mirror 18: 0xdd32c2a5 (stale) Mirror 21: 0xdd32c2a5 (stale) Mirror 23: 0xdd32c2a5 (stale) Mirror 25: 0xdd32c2a5 (stale) Mirror 26: 0xdd32c2a5 (stale) Mirror 27: 0xdd32c2a5 (stale) Mirror 28: 0xdd32c2a5 (stale) Mirror 30: 0xdd32c2a5 (stale) Mirror 31: 0xdd32c2a5 (stale) Mirror 32: 0xdd32c2a5 (stale) CRC-32 checksum value for chunk [0, 0x37c33): Mirror 1: 0x630ff739 Mirror 33: 0x630ff739 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37c33: skipped 000803 1786192077.882885 read 0x00484d thru 0x0145e9 (0xfd9d bytes) 000804 1786192077.906478 read 0x018449 thru 0x01bfcd (0x3b85 bytes) 000805 1786192077.921717 mapwrite 0x0337b8 thru 0x036c43 (0x348c bytes) 000808 1786192078.094508 read 0x022a26 thru 0x0244ea (0x1ac5 bytes) 000809 1786192078.118176 MIRROR_RESYNC 14 mirrors 000810 1786192081.202289 trunc from 0x037c33 to 0x03d41e (0x57ec bytes) 000811 1786192081.310181 mapwrite 0x034a83 thru 0x03ffff (0xb57d bytes) 000812 1786192081.425241 mapread 0x01f88e thru 0x02aae1 (0xb254 bytes) 000813 1786192081.439710 write 0x01eee2 thru 0x0227a1 (0x38c0 bytes) 000815 1786192081.441398 write 0x01ac4b thru 0x02016a (0x5520 bytes) 000816 1786192081.442687 mapwrite 0x00959d thru 0x010ef2 (0x7956 bytes) 000819 1786192081.479678 mapread 0x0212a1 thru 0x02baa4 (0xa804 bytes) 000821 1786192081.480813 trunc from 0x040000 to 0x006324 (0x39cdb bytes) 000822 1786192081.490134 mapread 0x0055e2 thru 0x006324 (0xd43 bytes) 000825 1786192081.491567 mapread 0x000316 thru 0x006324 (0x600f bytes) 000826 1786192081.495333 write 0x002388 thru 0x011ddd (0xfa56 bytes) 000827 1786192081.499374 MIRROR_SPLIT mirror 4 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x11dde): Mirror 14: 0x48672534 (stale) Mirror 16: 0x48672534 (stale) Mirror 18: 0x48672534 (stale) Mirror 23: 0x48672534 (stale) Mirror 25: 0x48672534 (stale) Mirror 26: 0x48672534 (stale) Mirror 27: 0x48672534 (stale) Mirror 28: 0x48672534 (stale) Mirror 30: 0x48672534 (stale) Mirror 31: 0x48672534 (stale) Mirror 32: 0x48672534 (stale) Mirror 33: 0x48672534 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11dde): Mirror 14: 0x48672534 (stale) Mirror 16: 0x48672534 (stale) Mirror 18: 0x48672534 (stale) Mirror 23: 0x48672534 (stale) Mirror 25: 0x48672534 (stale) Mirror 26: 0x48672534 (stale) Mirror 27: 0x48672534 (stale) Mirror 28: 0x48672534 (stale) Mirror 30: 0x48672534 (stale) Mirror 31: 0x48672534 (stale) Mirror 32: 0x48672534 (stale) Mirror 33: 0x48672534 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11dde: skipped 000828 1786192081.899015 mapread 0x00cfb6 thru 0x011093 (0x40de bytes) 000829 1786192081.929045 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x11dde): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11dde): Mirror 14: 0x48672534 (stale) Mirror 16: 0x48672534 (stale) Mirror 18: 0x48672534 (stale) Mirror 23: 0x48672534 (stale) Mirror 25: 0x48672534 (stale) Mirror 26: 0x48672534 (stale) Mirror 27: 0x48672534 (stale) Mirror 28: 0x48672534 (stale) Mirror 30: 0x48672534 (stale) Mirror 31: 0x48672534 (stale) Mirror 32: 0x48672534 (stale) Mirror 33: 0x48672534 (stale) CRC-32 checksum value for chunk [0, 0x11dde): Mirror 1: 0x7c28b227 Mirror 34: 0x7c28b227 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11dde: skipped 000831 1786192082.738646 write 0x02d1b2 thru 0x034b48 (0x7997 bytes) 000832 1786192082.805346 mapread 0x00134c thru 0x005d37 (0x49ec bytes) 000833 1786192082.822234 mapread 0x01a61e thru 0x025bd8 (0xb5bb bytes) 000834 1786192082.839885 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x34b49): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34b49): Mirror 14: 0xf477407f (stale) Mirror 16: 0xf477407f (stale) Mirror 18: 0xf477407f (stale) Mirror 23: 0xf477407f (stale) Mirror 25: 0xf477407f (stale) Mirror 26: 0xf477407f (stale) Mirror 27: 0xf477407f (stale) Mirror 28: 0xf477407f (stale) Mirror 30: 0xf477407f (stale) Mirror 31: 0xf477407f (stale) Mirror 32: 0xf477407f (stale) Mirror 33: 0xf477407f (stale) Mirror 34: 0x726eb3b7 (stale) CRC-32 checksum value for chunk [0, 0x34b49): Mirror 1: 0x96673aaa Mirror 35: 0x96673aaa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34b49: skipped 000836 1786192083.775273 mapwrite 0x008864 thru 0x015bf3 (0xd390 bytes) 000837 1786192083.933550 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x34b49): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34b49): Mirror 14: 0xf477407f (stale) Mirror 16: 0xf477407f (stale) Mirror 18: 0xf477407f (stale) Mirror 23: 0xf477407f (stale) Mirror 25: 0xf477407f (stale) Mirror 26: 0xf477407f (stale) Mirror 27: 0xf477407f (stale) Mirror 28: 0xf477407f (stale) Mirror 30: 0xf477407f (stale) Mirror 31: 0xf477407f (stale) Mirror 32: 0xf477407f (stale) Mirror 33: 0xf477407f (stale) Mirror 34: 0x726eb3b7 (stale) Mirror 35: 0x96673aaa (stale) CRC-32 checksum value for chunk [0, 0x34b49): Mirror 1: 0xc473a24d Mirror 36: 0xc473a24d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34b49: skipped 000839 1786192084.822695 read 0x002704 thru 0x009472 (0x6d6f bytes) 000840 1786192084.834632 write 0x00bd3d thru 0x012d1c (0x6fe0 bytes) 000841 1786192084.922515 trunc from 0x034b49 to 0x0356c3 (0xb7b bytes) 000843 1786192084.942521 MIRROR_SPLIT mirror 13 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x356c4): Mirror 14: 0x10ef03d7 (stale) Mirror 16: 0x10ef03d7 (stale) Mirror 18: 0x10ef03d7 (stale) Mirror 23: 0x10ef03d7 (stale) Mirror 25: 0x10ef03d7 (stale) Mirror 26: 0x10ef03d7 (stale) Mirror 27: 0x10ef03d7 (stale) Mirror 28: 0x10ef03d7 (stale) Mirror 30: 0x10ef03d7 (stale) Mirror 31: 0x10ef03d7 (stale) Mirror 32: 0x10ef03d7 (stale) Mirror 33: 0x10ef03d7 (stale) Mirror 35: 0xb348ffd2 (stale) Mirror 36: 0xecdb7626 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x356c4): Mirror 14: 0x10ef03d7 (stale) Mirror 16: 0x10ef03d7 (stale) Mirror 18: 0x10ef03d7 (stale) Mirror 23: 0x10ef03d7 (stale) Mirror 25: 0x10ef03d7 (stale) Mirror 26: 0x10ef03d7 (stale) Mirror 27: 0x10ef03d7 (stale) Mirror 28: 0x10ef03d7 (stale) Mirror 30: 0x10ef03d7 (stale) Mirror 31: 0x10ef03d7 (stale) Mirror 32: 0x10ef03d7 (stale) Mirror 33: 0x10ef03d7 (stale) Mirror 35: 0xb348ffd2 (stale) Mirror 36: 0xecdb7626 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x356c4: skipped 000844 1786192085.619434 MIRROR_SPLIT mirror 5 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x356c4): Mirror 14: 0x10ef03d7 (stale) Mirror 16: 0x10ef03d7 (stale) Mirror 18: 0x10ef03d7 (stale) Mirror 23: 0x10ef03d7 (stale) Mirror 26: 0x10ef03d7 (stale) Mirror 27: 0x10ef03d7 (stale) Mirror 28: 0x10ef03d7 (stale) Mirror 30: 0x10ef03d7 (stale) Mirror 31: 0x10ef03d7 (stale) Mirror 32: 0x10ef03d7 (stale) Mirror 33: 0x10ef03d7 (stale) Mirror 35: 0xb348ffd2 (stale) Mirror 36: 0xecdb7626 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x356c4): Mirror 14: 0x10ef03d7 (stale) Mirror 16: 0x10ef03d7 (stale) Mirror 18: 0x10ef03d7 (stale) Mirror 23: 0x10ef03d7 (stale) Mirror 26: 0x10ef03d7 (stale) Mirror 27: 0x10ef03d7 (stale) Mirror 28: 0x10ef03d7 (stale) Mirror 30: 0x10ef03d7 (stale) Mirror 31: 0x10ef03d7 (stale) Mirror 32: 0x10ef03d7 (stale) Mirror 33: 0x10ef03d7 (stale) Mirror 35: 0xb348ffd2 (stale) Mirror 36: 0xecdb7626 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x356c4: skipped 000847 1786192086.177525 read 0x00530b thru 0x007809 (0x24ff bytes) 000848 1786192086.184151 trunc from 0x0356c4 to 0x025eb7 (0xf80c bytes) 000851 1786192086.198551 read 0x00b170 thru 0x00b173 (0x4 bytes) 000852 1786192086.211583 MIRROR_RESYNC 14 mirrors 000853 1786192087.789193 write 0x0093b1 thru 0x00c0ae (0x2cfe bytes) 000854 1786192087.850394 mapwrite 0x03f34c thru 0x03ffff (0xcb4 bytes) 000856 1786192087.929456 mapwrite 0x01a8b4 thru 0x024f66 (0xa6b3 bytes) 000860 1786192087.999490 trunc from 0x040000 to 0x01fd9f (0x20260 bytes) 000862 1786192088.031594 mapwrite 0x029c2c thru 0x030111 (0x64e6 bytes) 000863 1786192088.095242 mapread 0x00678c thru 0x015e20 (0xf695 bytes) 000864 1786192088.108616 write 0x02f142 thru 0x03ddc2 (0xec81 bytes) 000865 1786192088.115648 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x3ddc3): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 23: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ddc3): Mirror 14: 0x8a1abbcc (stale) Mirror 16: 0x8a1abbcc (stale) Mirror 18: 0x8a1abbcc (stale) Mirror 23: 0x8a1abbcc (stale) Mirror 26: 0x8a1abbcc (stale) Mirror 27: 0x8a1abbcc (stale) Mirror 28: 0x8a1abbcc (stale) Mirror 30: 0x8a1abbcc (stale) Mirror 31: 0x8a1abbcc (stale) Mirror 32: 0x8a1abbcc (stale) Mirror 33: 0x8a1abbcc (stale) Mirror 35: 0x8a1abbcc (stale) Mirror 36: 0x8a1abbcc (stale) CRC-32 checksum value for chunk [0, 0x3ddc3): Mirror 1: 0xef1836dc Mirror 37: 0xef1836dc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ddc3: skipped 000867 1786192089.085941 mapwrite 0x021db9 thru 0x02d2e2 (0xb52a bytes) 000869 1786192089.230772 mapwrite 0x02ddbb thru 0x0390a2 (0xb2e8 bytes) 000870 1786192089.268993 MIRROR_SPLIT mirror 14 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ddc3): Mirror 14: 0x8a1abbcc (stale) Mirror 16: 0x8a1abbcc (stale) Mirror 18: 0x8a1abbcc (stale) Mirror 23: 0x8a1abbcc (stale) Mirror 26: 0x8a1abbcc (stale) Mirror 27: 0x8a1abbcc (stale) Mirror 28: 0x8a1abbcc (stale) Mirror 30: 0x8a1abbcc (stale) Mirror 31: 0x8a1abbcc (stale) Mirror 32: 0x8a1abbcc (stale) Mirror 33: 0x8a1abbcc (stale) Mirror 35: 0x8a1abbcc (stale) Mirror 36: 0x8a1abbcc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ddc3): Mirror 14: 0x8a1abbcc (stale) Mirror 16: 0x8a1abbcc (stale) Mirror 18: 0x8a1abbcc (stale) Mirror 23: 0x8a1abbcc (stale) Mirror 26: 0x8a1abbcc (stale) Mirror 27: 0x8a1abbcc (stale) Mirror 28: 0x8a1abbcc (stale) Mirror 30: 0x8a1abbcc (stale) Mirror 31: 0x8a1abbcc (stale) Mirror 32: 0x8a1abbcc (stale) Mirror 33: 0x8a1abbcc (stale) Mirror 35: 0x8a1abbcc (stale) Mirror 36: 0x8a1abbcc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ddc3: skipped 000871 1786192089.704430 write 0x01cfb6 thru 0x026308 (0x9353 bytes) 000872 1786192089.713297 read 0x024268 thru 0x02748e (0x3227 bytes) 000873 1786192089.718988 mapwrite 0x0256ab thru 0x0333a9 (0xdcff bytes) 000874 1786192089.787741 mapwrite 0x038446 thru 0x03a03c (0x1bf7 bytes) 000875 1786192089.814221 mapread 0x00439d thru 0x00cdb1 (0x8a15 bytes) 000876 1786192089.832829 MIRROR_RESYNC 14 mirrors 000877 1786192091.733602 trunc from 0x03ddc3 to 0x015f03 (0x27ebf bytes) 000878 1786192091.789354 read 0x00c91c thru 0x013003 (0x66e8 bytes) 000879 1786192091.805968 MIRROR_RESYNC 14 mirrors 000880 1786192093.249399 mapread 0x00d0cf thru 0x015f03 (0x8e35 bytes) 000881 1786192093.259226 mapwrite 0x039563 thru 0x03ffff (0x6a9d bytes) 000882 1786192093.330847 trunc from 0x040000 to 0x00397d (0x3c682 bytes) 000883 1786192093.343886 trunc from 0x00397e to 0x023721 (0x1fda4 bytes) 000884 1786192093.352730 mapread 0x018f42 thru 0x021f2f (0x8fee bytes) 000886 1786192093.366176 MIRROR_RESYNC 14 mirrors 000888 1786192094.817560 MIRROR_EXTEND to 15 mirrors 000891 1786192095.482500 MIRROR_SPLIT mirror 13 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) 000892 1786192095.901666 trunc from 0x023722 to 0x001388 (0x22399 bytes) 000894 1786192095.970515 mapread 0x00041c thru 0x001388 (0xf6d bytes) 000895 1786192095.979642 mapwrite 0x020613 thru 0x02ee53 (0xe841 bytes) 000898 1786192096.099982 mapwrite 0x026b1b thru 0x0335bb (0xcaa1 bytes) 000900 1786192096.181931 MIRROR_SPLIT mirror 7 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x335bc): Mirror 14: 0x332304b4 (stale) Mirror 16: 0x332304b4 (stale) Mirror 18: 0x332304b4 (stale) Mirror 23: 0x332304b4 (stale) Mirror 26: 0x332304b4 (stale) Mirror 27: 0x332304b4 (stale) Mirror 30: 0x332304b4 (stale) Mirror 31: 0x332304b4 (stale) Mirror 32: 0x332304b4 (stale) Mirror 33: 0x332304b4 (stale) Mirror 35: 0x332304b4 (stale) Mirror 37: 0x332304b4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x335bc): Mirror 14: 0x332304b4 (stale) Mirror 16: 0x332304b4 (stale) Mirror 18: 0x332304b4 (stale) Mirror 23: 0x332304b4 (stale) Mirror 26: 0x332304b4 (stale) Mirror 27: 0x332304b4 (stale) Mirror 30: 0x332304b4 (stale) Mirror 31: 0x332304b4 (stale) Mirror 32: 0x332304b4 (stale) Mirror 33: 0x332304b4 (stale) Mirror 35: 0x332304b4 (stale) Mirror 37: 0x332304b4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x335bc: skipped 000901 1786192096.798314 write 0x02d31b thru 0x02d42f (0x115 bytes) 000902 1786192096.804597 read 0x0318c6 thru 0x0335bb (0x1cf6 bytes) 000904 1786192096.810437 write 0x0140f5 thru 0x020d2d (0xcc39 bytes) 000906 1786192096.822823 trunc from 0x0335bc to 0x01b59f (0x1801c bytes) 000910 1786192096.847615 read 0x00112f thru 0x00c86a (0xb73c bytes) 000911 1786192096.856940 write 0x01aac5 thru 0x02346e (0x89aa bytes) 000913 1786192096.861497 MIRROR_RESYNC 13 mirrors 000914 1786192098.895322 MIRROR_RESYNC 13 mirrors 000915 1786192099.390163 mapwrite 0x01b7d0 thru 0x01d145 (0x1976 bytes) 000916 1786192099.537006 mapwrite 0x0373ef thru 0x03ffff (0x8c11 bytes) 000918 1786192099.586364 read 0x021d49 thru 0x031bda (0xfe92 bytes) 000920 1786192099.595446 read 0x0215c1 thru 0x022ab9 (0x14f9 bytes) 000921 1786192099.596270 read 0x000015 thru 0x00f648 (0xf634 bytes) 000923 1786192099.609061 mapread 0x01f822 thru 0x028f0f (0x96ee bytes) 000925 1786192099.622318 MIRROR_RESYNC 13 mirrors 000926 1786192102.068398 mapwrite 0x01c6e6 thru 0x01ea30 (0x234b bytes) 000927 1786192102.167141 mapread 0x0058e8 thru 0x011a5a (0xc173 bytes) 000929 1786192102.182976 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 23: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 35: (stale - read error) Mirror 37: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x44b2ae31 (stale) Mirror 16: 0x44b2ae31 (stale) Mirror 18: 0x44b2ae31 (stale) Mirror 23: 0x44b2ae31 (stale) Mirror 26: 0x44b2ae31 (stale) Mirror 27: 0x44b2ae31 (stale) Mirror 30: 0x44b2ae31 (stale) Mirror 31: 0x44b2ae31 (stale) Mirror 32: 0x44b2ae31 (stale) Mirror 33: 0x44b2ae31 (stale) Mirror 35: 0x44b2ae31 (stale) Mirror 37: 0x44b2ae31 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x251bc3e7 Mirror 38: 0x251bc3e7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000930 1786192103.010860 trunc from 0x040000 to 0x03d1f5 (0x2e0a bytes) 000931 1786192103.079013 write 0x01bd1b thru 0x026f7e (0xb264 bytes) 000933 1786192103.090045 read 0x036c90 thru 0x037eb7 (0x1228 bytes) 000934 1786192103.097645 trunc from 0x03d1f6 to 0x03879c (0x4a59 bytes) 000935 1786192103.110664 mapwrite 0x01d79b thru 0x02a0e8 (0xc94e bytes) 000936 1786192103.150864 mapread 0x01d2ae thru 0x02c770 (0xf4c3 bytes) 000940 1786192103.152983 read 0x02d111 thru 0x02e314 (0x1204 bytes) 000941 1786192103.153510 read 0x022c4a thru 0x02bdb4 (0x916b bytes) 000942 1786192103.153960 trunc from 0x03879d to 0x023c19 (0x14b83 bytes) 000947 1786192103.165251 write 0x00e4eb thru 0x0170ba (0x8bd0 bytes) 000948 1786192103.171444 trunc from 0x023c1a to 0x03ce38 (0x1921f bytes) 000949 1786192103.179751 mapwrite 0x008709 thru 0x00929b (0xb93 bytes) 000950 1786192103.204218 mapwrite 0x00311b thru 0x00f450 (0xc336 bytes) 000952 1786192103.245149 trunc from 0x03ce39 to 0x02c1db (0x10c5d bytes) 000953 1786192103.255039 read 0x000f88 thru 0x0022b6 (0x132f bytes) 000954 1786192103.255742 read 0x00b8ff thru 0x0195cf (0xdcd1 bytes) 000956 1786192103.257049 trunc from 0x02c1dc to 0x02f4c0 (0x32e5 bytes) 000957 1786192103.275679 mapread 0x02eead thru 0x02f4c0 (0x614 bytes) 000958 1786192103.283988 mapwrite 0x01a4c6 thru 0x02714c (0xcc87 bytes) 000962 1786192103.318008 read 0x00d3f3 thru 0x014b6b (0x7779 bytes) 000963 1786192103.318467 trunc from 0x02f4c1 to 0x030dc5 (0x1905 bytes) 000964 1786192103.341966 trunc from 0x030dc6 to 0x00e893 (0x22532 bytes) 000966 1786192103.358875 write 0x009a16 thru 0x00e77a (0x4d65 bytes) 000967 1786192103.360616 trunc from 0x00e894 to 0x020ed3 (0x12640 bytes) 000968 1786192103.373118 mapwrite 0x00e496 thru 0x012ecf (0x4a3a bytes) 000971 1786192103.458934 MIRROR_RESYNC 14 mirrors 000973 1786192105.350432 write 0x029a19 thru 0x03546a (0xba52 bytes) 000976 1786192105.430791 trunc from 0x03546b to 0x025669 (0xfe01 bytes) 000978 1786192105.457129 trunc from 0x02566a to 0x036e1c (0x117b3 bytes) 000979 1786192105.469472 mapread 0x02faa8 thru 0x035245 (0x579e bytes) 000980 1786192105.487940 read 0x0069d5 thru 0x008c09 (0x2235 bytes) 000981 1786192105.494296 read 0x021bee thru 0x022262 (0x675 bytes) 000987 1786192105.506328 mapwrite 0x01ee19 thru 0x02b7ca (0xc9b2 bytes) 000988 1786192105.617629 trunc from 0x036e1d to 0x03d0c7 (0x62ab bytes) 000989 1786192105.635327 read 0x03a51c thru 0x03b5c3 (0x10a8 bytes) 000990 1786192105.644357 write 0x025ed5 thru 0x034b65 (0xec91 bytes) 000991 1786192105.656238 MIRROR_SPLIT mirror 7 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d0c8): Mirror 14: 0x683eca52 (stale) Mirror 16: 0x683eca52 (stale) Mirror 18: 0x683eca52 (stale) Mirror 23: 0x683eca52 (stale) Mirror 26: 0x683eca52 (stale) Mirror 27: 0x683eca52 (stale) Mirror 31: 0x683eca52 (stale) Mirror 32: 0x683eca52 (stale) Mirror 33: 0x683eca52 (stale) Mirror 35: 0x683eca52 (stale) Mirror 37: 0x683eca52 (stale) Mirror 38: 0x683eca52 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d0c8): Mirror 14: 0x683eca52 (stale) Mirror 16: 0x683eca52 (stale) Mirror 18: 0x683eca52 (stale) Mirror 23: 0x683eca52 (stale) Mirror 26: 0x683eca52 (stale) Mirror 27: 0x683eca52 (stale) Mirror 31: 0x683eca52 (stale) Mirror 32: 0x683eca52 (stale) Mirror 33: 0x683eca52 (stale) Mirror 35: 0x683eca52 (stale) Mirror 37: 0x683eca52 (stale) Mirror 38: 0x683eca52 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d0c8: skipped 000992 1786192106.172868 read 0x02ff2b thru 0x03aa0a (0xaae0 bytes) 000997 1786192106.193016 MIRROR_SPLIT mirror 12 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x287:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d0c8): Mirror 14: 0x683eca52 (stale) Mirror 16: 0x683eca52 (stale) Mirror 18: 0x683eca52 (stale) Mirror 23: 0x683eca52 (stale) Mirror 26: 0x683eca52 (stale) Mirror 27: 0x683eca52 (stale) Mirror 31: 0x683eca52 (stale) Mirror 32: 0x683eca52 (stale) Mirror 33: 0x683eca52 (stale) Mirror 35: 0x683eca52 (stale) Mirror 37: 0x683eca52 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d0c8): Mirror 14: 0x683eca52 (stale) Mirror 16: 0x683eca52 (stale) Mirror 18: 0x683eca52 (stale) Mirror 23: 0x683eca52 (stale) Mirror 26: 0x683eca52 (stale) Mirror 27: 0x683eca52 (stale) Mirror 31: 0x683eca52 (stale) Mirror 32: 0x683eca52 (stale) Mirror 33: 0x683eca52 (stale) Mirror 35: 0x683eca52 (stale) Mirror 37: 0x683eca52 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d0c8: skipped 000998 1786192106.626573 read 0x016476 thru 0x016ff8 (0xb83 bytes) 000999 1786192106.631062 write 0x02033f thru 0x02fed7 (0xfb99 bytes) All operations completed A-OK!