== sanity-flr test 70a: flr mode fsx test ================ 20:27:39 (1789777659) Seed set to 7661 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000003 1789777662.067696 mapwrite 0x039b42 thru 0x03ffff (0x64be bytes) truncating to largest ever: 0x2a099 000004 1789777662.190383 trunc from 0x040000 to 0x02a098 (0x15f67 bytes) 000005 1789777662.210561 write 0x01d3ec thru 0x021b5f (0x4774 bytes) 000006 1789777662.221711 read 0x00b1c2 thru 0x01138c (0x61cb bytes) truncating to largest ever: 0x2f465 000007 1789777662.230497 trunc from 0x02a099 to 0x02f464 (0x53cc bytes) 000008 1789777662.252916 write 0x02b60b thru 0x03a84b (0xf241 bytes) 000009 1789777662.259487 punch from 0x038947 to 0x038d22 (0x3dc bytes) truncating to largest ever: 0x3a39e 000012 1789777662.274815 trunc from 0x03a84c to 0x03a39d (0x4ae bytes) 000015 1789777662.294881 mapwrite 0x00a476 thru 0x01762a (0xd1b5 bytes) 000017 1789777662.378575 read 0x02ba10 thru 0x02ca74 (0x1065 bytes) 000018 1789777662.380774 write 0x030b9f thru 0x03f689 (0xeaeb bytes) 000019 1789777662.382699 write 0x003d4d thru 0x011117 (0xd3cb bytes) 000020 1789777662.384905 write 0x023eea thru 0x02a8e8 (0x69ff bytes) 000021 1789777662.400930 read 0x017e57 thru 0x018072 (0x21c bytes) 000023 1789777662.402087 punch from 0x016f2a to 0x01aa39 (0x3b10 bytes) 000025 1789777662.416918 read 0x012327 thru 0x013ccf (0x19a9 bytes) 000026 1789777662.417597 mapwrite 0x03b28d thru 0x03ffff (0x4d73 bytes) 000030 1789777662.498983 punch from 0x03d932 to 0x03ffff (0x26ce bytes) 000034 1789777662.505602 mapwrite 0x03fcb2 thru 0x03ffff (0x34e bytes) 000035 1789777662.552423 write 0x006397 thru 0x00e1c1 (0x7e2b bytes) 000036 1789777662.554100 mapwrite 0x01b78e thru 0x01ba96 (0x309 bytes) 000037 1789777662.603795 trunc from 0x040000 to 0x038a4b (0x75b4 bytes) 000038 1789777662.646164 mapread 0x032f4e thru 0x038a4b (0x5afe bytes) 000039 1789777662.652917 write 0x033ec0 thru 0x03661d (0x275e bytes) 000041 1789777662.657200 write 0x015829 thru 0x01c111 (0x68e9 bytes) 000042 1789777662.659108 mapread 0x0133e3 thru 0x01c9f9 (0x9617 bytes) 000043 1789777662.662266 punch from 0x02e1a6 to 0x038a4b (0xa8a6 bytes) 000045 1789777662.678286 read 0x0389ca thru 0x038a4b (0x82 bytes) 000047 1789777662.697523 trunc from 0x038a4c to 0x00ee42 (0x29c09 bytes) 000048 1789777662.728631 write 0x038b47 thru 0x03ffff (0x74b9 bytes) 000049 1789777662.730293 trunc from 0x040000 to 0x028561 (0x17a9e bytes) 000050 1789777662.751701 punch from 0x028486 to 0x028561 (0xdc bytes) 000051 1789777662.757131 mapread 0x013328 thru 0x017d6c (0x4a45 bytes) 000053 1789777662.777591 punch from 0x007d22 to 0x00ab8e (0x2e6d bytes) 000058 1789777662.788606 punch from 0x0219e8 to 0x024b04 (0x311d bytes) 000059 1789777662.794209 mapread 0x00521c thru 0x0063a2 (0x1187 bytes) 000061 1789777662.796992 read 0x02766b thru 0x028561 (0xef7 bytes) 000062 1789777662.805120 read 0x005727 thru 0x00906e (0x3948 bytes) 000063 1789777662.805920 mapwrite 0x01c241 thru 0x027356 (0xb116 bytes) 000064 1789777662.868113 mapread 0x013cce thru 0x016871 (0x2ba4 bytes) 000065 1789777662.869071 trunc from 0x028562 to 0x025032 (0x352f bytes) 000067 1789777662.886624 trunc from 0x025033 to 0x0241f5 (0xe3d bytes) 000070 1789777662.908770 trunc from 0x0241f6 to 0x03794b (0x13756 bytes) 000071 1789777662.924424 mapread 0x02aa89 thru 0x03311b (0x8693 bytes) 000072 1789777662.935550 read 0x03056c thru 0x03794b (0x73e0 bytes) 000073 1789777662.936470 mapread 0x0135a8 thru 0x01f94a (0xc3a3 bytes) 000074 1789777662.943543 MIRROR_EXTEND to 2 mirrors 000075 1789777663.938517 punch from 0x00ec90 to 0x017479 (0x87ea bytes) 000076 1789777664.025023 mapwrite 0x03e776 thru 0x03ffff (0x188a bytes) 000077 1789777664.141237 mapwrite 0x035675 thru 0x037ac8 (0x2454 bytes) 000078 1789777664.208196 punch from 0x03278c to 0x036f3a (0x47af bytes) 000080 1789777664.214178 mapread 0x018f9e thru 0x0198d6 (0x939 bytes) 000081 1789777664.231145 punch from 0x02fc0a to 0x037372 (0x7769 bytes) 000082 1789777664.255748 mapwrite 0x002a80 thru 0x00e9dc (0xbf5d bytes) 000083 1789777664.339700 read 0x02d5b4 thru 0x02e8a6 (0x12f3 bytes) 000084 1789777664.351766 MIRROR_RESYNC 2 mirrors 000086 1789777665.239159 mapwrite 0x001f2f thru 0x0075a9 (0x567b bytes) 000089 1789777665.384155 trunc from 0x040000 to 0x0356d1 (0xa92e bytes) 000090 1789777665.432151 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) 000093 1789777665.584117 punch from 0x0304a9 to 0x0356d1 (0x5229 bytes) 000095 1789777665.589852 write 0x02343f thru 0x025e53 (0x2a15 bytes) 000096 1789777665.599492 mapwrite 0x0207e9 thru 0x02d8f2 (0xd10a bytes) 000098 1789777665.707240 read 0x019b39 thru 0x022999 (0x8e61 bytes) 000102 1789777665.718843 punch from 0x013acc to 0x016aba (0x2fef bytes) 000103 1789777665.728748 read 0x0114cf thru 0x012062 (0xb94 bytes) 000105 1789777665.743271 punch from 0x020e3e to 0x025e6e (0x5031 bytes) 000106 1789777665.750737 trunc from 0x0356d2 to 0x0014d7 (0x341fa bytes) 000107 1789777665.789744 punch from 0x000958 to 0x0014d7 (0xb80 bytes) 000108 1789777665.797760 read 0x00137c thru 0x0014d7 (0x15c bytes) 000109 1789777665.807166 mapwrite 0x023ca1 thru 0x02e40f (0xa76f bytes) 000110 1789777665.915525 punch from 0x01b63f to 0x0283bf (0xcd81 bytes) 000111 1789777665.922803 read 0x019a61 thru 0x01bbcc (0x216c bytes) 000112 1789777665.945793 punch from 0x00a3e4 to 0x0121d3 (0x7df0 bytes) 000113 1789777665.960054 punch from 0x02762a to 0x02b8a8 (0x427f bytes) 000118 1789777665.984523 trunc from 0x02e410 to 0x00e315 (0x200fa bytes) truncating to largest ever: 0x3a3f2 000119 1789777666.003567 trunc from 0x00e316 to 0x03a3f1 (0x2c0dc bytes) 000123 1789777666.036603 MIRROR_EXTEND to 2 mirrors 000126 1789777667.153476 mapwrite 0x0367b9 thru 0x03ffff (0x9847 bytes) 000127 1789777667.371892 read 0x03823a thru 0x038d9f (0xb66 bytes) 000128 1789777667.376793 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x57514e9e Mirror 3: 0x57514e9e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000129 1789777668.450013 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x57514e9e Mirror 3: 0x57514e9e Mirror 4: 0x57514e9e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000131 1789777669.991554 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x57514e9e Mirror 3: 0x57514e9e Mirror 4: 0x57514e9e Mirror 5: 0x57514e9e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000132 1789777671.221619 mapread 0x021f73 thru 0x028f59 (0x6fe7 bytes) 000134 1789777671.276794 mapread 0x024b83 thru 0x02cb5c (0x7fda bytes) 000135 1789777671.290694 mapwrite 0x01d9bc thru 0x02450e (0x6b53 bytes) 000136 1789777671.533764 MIRROR_RESYNC 5 mirrors 000138 1789777674.095969 trunc from 0x040000 to 0x00b53c (0x34ac3 bytes) 000139 1789777674.181974 punch from 0x007d45 to 0x00b53c (0x37f8 bytes) 000140 1789777674.186962 trunc from 0x00b53d to 0x01ac97 (0xf75b bytes) 000142 1789777674.211610 read 0x015265 thru 0x019e4b (0x4be7 bytes) 000143 1789777674.219579 mapread 0x015aff thru 0x0182f5 (0x27f7 bytes) 000144 1789777674.220724 trunc from 0x01ac98 to 0x00fb92 (0xb105 bytes) 000145 1789777674.238775 read 0x0044df thru 0x00fb92 (0xb6b4 bytes) 000146 1789777674.248258 mapwrite 0x00be66 thru 0x015530 (0x96cb bytes) 000148 1789777674.316971 write 0x02f3dd thru 0x032fe6 (0x3c0a bytes) 000149 1789777674.327532 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x32fe7): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32fe7): Mirror 2: 0xcd349d46 (stale) Mirror 3: 0xcd349d46 (stale) Mirror 4: 0xcd349d46 (stale) Mirror 5: 0xcd349d46 (stale) CRC-32 checksum value for chunk [0, 0x32fe7): Mirror 1: 0xfed086b2 Mirror 6: 0xfed086b2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32fe7: skipped 000150 1789777675.713945 write 0x01febe thru 0x02948e (0x95d1 bytes) 000151 1789777675.818700 trunc from 0x032fe7 to 0x0091c9 (0x29e1d bytes) 000152 1789777675.859506 mapread 0x004c51 thru 0x0091c9 (0x4579 bytes) 000156 1789777675.916801 mapwrite 0x020b2c thru 0x02c2db (0xb7b0 bytes) 000157 1789777676.101857 write 0x00f285 thru 0x01d26b (0xdfe7 bytes) 000159 1789777676.115639 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2c2dc): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c2dc): Mirror 2: 0xac38b2cc (stale) Mirror 3: 0xac38b2cc (stale) Mirror 4: 0xac38b2cc (stale) Mirror 5: 0xac38b2cc (stale) Mirror 6: 0x26bfc2ef (stale) CRC-32 checksum value for chunk [0, 0x2c2dc): Mirror 1: 0x4472ccdc Mirror 7: 0x4472ccdc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c2dc: skipped 000160 1789777677.360726 read 0x026276 thru 0x02c2db (0x6066 bytes) 000162 1789777677.389684 write 0x021069 thru 0x0301f6 (0xf18e bytes) 000163 1789777677.540063 mapread 0x0117d2 thru 0x01a02f (0x885e bytes) 000164 1789777677.569223 punch from 0x028ccf to 0x02dfb9 (0x52eb bytes) 000165 1789777677.589801 mapwrite 0x0071d1 thru 0x00a0de (0x2f0e bytes) 000169 1789777677.748740 MIRROR_RESYNC 7 mirrors 000170 1789777679.876901 read 0x00e7b9 thru 0x01e71c (0xff64 bytes) 000171 1789777679.890550 trunc from 0x0301f7 to 0x02907d (0x7179 bytes) 000172 1789777680.011927 trunc from 0x02907e to 0x00d0a3 (0x1bfda bytes) 000173 1789777680.067216 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xd0a4): Mirror 2: 0xf2695992 (stale) Mirror 3: 0xf2695992 (stale) Mirror 4: 0xf2695992 (stale) Mirror 5: 0xf2695992 (stale) Mirror 7: 0xf2695992 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd0a4): Mirror 2: 0xf2695992 (stale) Mirror 3: 0xf2695992 (stale) Mirror 4: 0xf2695992 (stale) Mirror 5: 0xf2695992 (stale) Mirror 7: 0xf2695992 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd0a4: skipped 000174 1789777680.826948 read 0x008ef4 thru 0x00d0a3 (0x41b0 bytes) 000175 1789777680.852273 punch from 0x008eec to 0x00a880 (0x1995 bytes) 000176 1789777680.865823 mapwrite 0x038efe thru 0x03edf2 (0x5ef5 bytes) 000177 1789777681.067311 punch from 0x0005ee to 0x006f50 (0x6963 bytes) 000183 1789777681.092610 mapwrite 0x00b44d thru 0x018d1a (0xd8ce bytes) 000184 1789777681.269200 mapwrite 0x02b6ba thru 0x03a35e (0xeca5 bytes) 000185 1789777681.330432 mapwrite 0x0302de thru 0x03f0e0 (0xee03 bytes) 000186 1789777681.387571 write 0x01e3b5 thru 0x020c9c (0x28e8 bytes) 000188 1789777681.399774 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f0e1): Mirror 2: 0x405a5db2 (stale) Mirror 3: 0x405a5db2 (stale) Mirror 5: 0x405a5db2 (stale) Mirror 7: 0x405a5db2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f0e1): Mirror 2: 0x405a5db2 (stale) Mirror 3: 0x405a5db2 (stale) Mirror 5: 0x405a5db2 (stale) Mirror 7: 0x405a5db2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f0e1: skipped 000189 1789777681.793775 mapwrite 0x029de8 thru 0x0364bc (0xc6d5 bytes) 000190 1789777681.895988 mapread 0x01dc7b thru 0x02afbb (0xd341 bytes) 000191 1789777681.913317 read 0x036c0c thru 0x03a8a6 (0x3c9b bytes) 000194 1789777681.924854 trunc from 0x03f0e1 to 0x00fd58 (0x2f388 bytes) 000195 1789777681.991106 MIRROR_RESYNC 5 mirrors 000198 1789777683.317392 MIRROR_EXTEND to 6 mirrors 000199 1789777684.231163 mapread 0x00fc06 thru 0x00fd58 (0x153 bytes) 000200 1789777684.238285 punch from 0x005c49 to 0x00fd58 (0xa110 bytes) 000204 1789777684.298150 punch from 0x00a218 to 0x00fd58 (0x5b41 bytes) 000206 1789777684.303898 read 0x009ed0 thru 0x00aaf1 (0xc22 bytes) 000207 1789777684.309021 mapwrite 0x00032a thru 0x0091a5 (0x8e7c bytes) 000208 1789777684.366114 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0xfd59): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xfd59): Mirror 2: 0x196919b1 (stale) Mirror 3: 0x196919b1 (stale) Mirror 5: 0x196919b1 (stale) Mirror 7: 0x196919b1 (stale) Mirror 8: 0x196919b1 (stale) CRC-32 checksum value for chunk [0, 0xfd59): Mirror 1: 0xc21053d1 Mirror 9: 0xc21053d1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xfd59: skipped 000209 1789777685.436864 write 0x005677 thru 0x007aec (0x2476 bytes) 000210 1789777685.532860 trunc from 0x00fd59 to 0x01c82d (0xcad5 bytes) 000211 1789777685.591150 MIRROR_RESYNC 7 mirrors 000212 1789777687.260961 punch from 0x00216d to 0x009431 (0x72c5 bytes) 000213 1789777687.344948 punch from 0x00d65a to 0x01bf24 (0xe8cb bytes) 000214 1789777687.350659 trunc from 0x01c82e to 0x0173c5 (0x5468 bytes) 000215 1789777687.376234 punch from 0x00b749 to 0x015c8d (0xa545 bytes) 000217 1789777687.400654 read 0x002acb thru 0x00c27b (0x97b1 bytes) 000218 1789777687.436896 mapread 0x00c9ba thru 0x00d59b (0xbe2 bytes) 000219 1789777687.448682 punch from 0x015b08 to 0x0173c5 (0x18be bytes) 000220 1789777687.462274 MIRROR_RESYNC 7 mirrors 000222 1789777689.409769 write 0x018ac7 thru 0x02768d (0xebc7 bytes) 000223 1789777689.482260 mapread 0x015886 thru 0x020b57 (0xb2d2 bytes) 000224 1789777689.502876 mapwrite 0x012b31 thru 0x01f348 (0xc818 bytes) 000225 1789777689.570220 mapread 0x00fb2a thru 0x01cf85 (0xd45c bytes) 000226 1789777689.582383 mapwrite 0x010c76 thru 0x0208d9 (0xfc64 bytes) 000227 1789777689.651856 mapwrite 0x03db70 thru 0x03ffff (0x2490 bytes) 000228 1789777689.737522 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc530a07d (stale) Mirror 5: 0xc530a07d (stale) Mirror 7: 0xc530a07d (stale) Mirror 8: 0xc530a07d (stale) Mirror 9: 0xc530a07d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc530a07d (stale) Mirror 5: 0xc530a07d (stale) Mirror 7: 0xc530a07d (stale) Mirror 8: 0xc530a07d (stale) Mirror 9: 0xc530a07d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000231 1789777690.290708 punch from 0x01c399 to 0x0297f6 (0xd45e bytes) 000232 1789777690.300191 trunc from 0x040000 to 0x004d1d (0x3b2e2 bytes) 000233 1789777690.330597 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x4d1e): Mirror 3: 0x68a07683 (stale) Mirror 7: 0x68a07683 (stale) Mirror 8: 0x68a07683 (stale) Mirror 9: 0x68a07683 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4d1e): Mirror 3: 0x68a07683 (stale) Mirror 7: 0x68a07683 (stale) Mirror 8: 0x68a07683 (stale) Mirror 9: 0x68a07683 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4d1e: skipped 000234 1789777690.836615 mapwrite 0x01d4dc thru 0x027c9a (0xa7bf bytes) 000235 1789777691.018626 punch from 0x012fd2 to 0x01ffb5 (0xcfe4 bytes) 000237 1789777691.038853 MIRROR_RESYNC 5 mirrors 000238 1789777692.895499 write 0x02af2f thru 0x035f27 (0xaff9 bytes) 000240 1789777693.067806 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x35f28): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35f28): Mirror 3: 0x59a7517b (stale) Mirror 7: 0x59a7517b (stale) Mirror 8: 0x59a7517b (stale) Mirror 9: 0x59a7517b (stale) CRC-32 checksum value for chunk [0, 0x35f28): Mirror 1: 0x64c265fc Mirror 10: 0x64c265fc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35f28: skipped 000241 1789777694.607668 mapwrite 0x027a9c thru 0x0362c8 (0xe82d bytes) 000242 1789777694.893324 read 0x032cba thru 0x0362c8 (0x360f bytes) 000243 1789777694.894007 read 0x033f81 thru 0x0362c8 (0x2348 bytes) 000244 1789777694.894567 mapread 0x00f2ba thru 0x015769 (0x64b0 bytes) 000245 1789777694.907683 punch from 0x02d13c to 0x031393 (0x4258 bytes) 000246 1789777694.913510 trunc from 0x0362c9 to 0x01dbc5 (0x18703 bytes) 000247 1789777694.938960 trunc from 0x01dbc6 to 0x01ce8c (0xd39 bytes) 000248 1789777694.963265 read 0x002237 thru 0x00cec2 (0xac8c bytes) 000249 1789777694.965608 punch from 0x00965d to 0x014eba (0xb85e bytes) 000250 1789777694.973539 read 0x00ac0e thru 0x00d247 (0x263a bytes) 000252 1789777694.993238 MIRROR_RESYNC 6 mirrors 000253 1789777697.054512 write 0x00d658 thru 0x0145e2 (0x6f8b bytes) 000255 1789777697.154966 read 0x0029fb thru 0x010423 (0xda29 bytes) 000256 1789777697.185727 mapread 0x0109ea thru 0x013a92 (0x30a9 bytes) 000257 1789777697.188543 read 0x00c276 thru 0x011a04 (0x578f bytes) 000258 1789777697.189968 punch from 0x00639e to 0x009a75 (0x36d8 bytes) 000261 1789777697.211035 write 0x004b89 thru 0x01236f (0xd7e7 bytes) 000262 1789777697.216975 punch from 0x004173 to 0x00fe6a (0xbcf8 bytes) 000266 1789777697.246554 write 0x0166d2 thru 0x017212 (0xb41 bytes) 000268 1789777697.273178 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1ce8d): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ce8d): Mirror 3: 0xe45e7f5e (stale) Mirror 7: 0xe45e7f5e (stale) Mirror 8: 0xe45e7f5e (stale) Mirror 9: 0xe45e7f5e (stale) Mirror 10: 0xe45e7f5e (stale) CRC-32 checksum value for chunk [0, 0x1ce8d): Mirror 1: 0xf7bf5619 Mirror 11: 0xf7bf5619 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ce8d: skipped 000269 1789777698.375367 read 0x01c947 thru 0x01cb6c (0x226 bytes) 000271 1789777698.409647 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ce8d): Mirror 3: 0xe45e7f5e (stale) Mirror 7: 0xe45e7f5e (stale) Mirror 9: 0xe45e7f5e (stale) Mirror 10: 0xe45e7f5e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ce8d): Mirror 3: 0xe45e7f5e (stale) Mirror 7: 0xe45e7f5e (stale) Mirror 9: 0xe45e7f5e (stale) Mirror 10: 0xe45e7f5e (stale) CRC-32 checksum value for chunk [0, 0x1ce8d): Mirror 1: 0xf7bf5619 Mirror 11: 0xf7bf5619 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ce8d: skipped 000272 1789777699.329147 mapwrite 0x005239 thru 0x00e4de (0x92a6 bytes) 000273 1789777699.563498 punch from 0x018bdd to 0x01ce8c (0x42b0 bytes) 000274 1789777699.577285 punch from 0x00a24c to 0x00dcc2 (0x3a77 bytes) 000275 1789777699.585150 punch from 0x00bd6f to 0x01a416 (0xe6a8 bytes) 000276 1789777699.602937 punch from 0x00dbce to 0x017a89 (0x9ebc bytes) 000277 1789777699.609214 punch from 0x00505d to 0x0098fb (0x489f bytes) 000278 1789777699.621031 read 0x016ea9 thru 0x01ce8c (0x5fe4 bytes) 000279 1789777699.635251 write 0x03baab thru 0x03ffff (0x4555 bytes) 000280 1789777699.642301 mapread 0x03e854 thru 0x03ffff (0x17ac bytes) 000282 1789777699.646269 mapwrite 0x006f32 thru 0x00d44e (0x651d bytes) 000283 1789777699.711617 read 0x030ab5 thru 0x030dd2 (0x31e bytes) 000284 1789777699.743744 write 0x0107db thru 0x01da76 (0xd29c bytes) 000285 1789777699.745157 punch from 0x00f7e2 to 0x01ca16 (0xd235 bytes) 000286 1789777699.757882 write 0x025a7b thru 0x029f75 (0x44fb bytes) 000287 1789777699.763899 MIRROR_RESYNC 6 mirrors 000289 1789777702.457728 read 0x03557e thru 0x038e6e (0x38f1 bytes) 000290 1789777702.464904 mapread 0x01be9a thru 0x01f12f (0x3296 bytes) 000291 1789777702.488453 punch from 0x016546 to 0x01eb5e (0x8619 bytes) 000292 1789777702.594168 punch from 0x01d0b6 to 0x022ba0 (0x5aeb bytes) 000293 1789777702.623867 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x4961e74a (stale) Mirror 7: 0x4961e74a (stale) Mirror 10: 0x4961e74a (stale) Mirror 11: 0x4961e74a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x4961e74a (stale) Mirror 7: 0x4961e74a (stale) Mirror 10: 0x4961e74a (stale) Mirror 11: 0x4961e74a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000295 1789777703.092224 mapread 0x0155cd thru 0x01591b (0x34f bytes) 000296 1789777703.102838 read 0x02df00 thru 0x0391b8 (0xb2b9 bytes) 000297 1789777703.122325 mapwrite 0x02826b thru 0x02af49 (0x2cdf bytes) 000298 1789777703.178079 trunc from 0x040000 to 0x01b0ef (0x24f10 bytes) 000299 1789777703.196119 punch from 0x003815 to 0x0102da (0xcac6 bytes) 000300 1789777703.202240 mapread 0x017dea thru 0x01b0ef (0x3306 bytes) 000302 1789777703.220738 mapwrite 0x00216d thru 0x00f4e6 (0xd37a bytes) 000303 1789777703.288293 mapwrite 0x032f94 thru 0x03bc3d (0x8caa bytes) 000304 1789777703.406647 mapread 0x016e09 thru 0x022d9a (0xbf92 bytes) 000305 1789777703.419068 write 0x0068da thru 0x009723 (0x2e4a bytes) 000306 1789777703.421217 write 0x0356f9 thru 0x03ffff (0xa907 bytes) 000307 1789777703.424534 read 0x00f498 thru 0x013f82 (0x4aeb bytes) 000310 1789777703.432106 MIRROR_RESYNC 5 mirrors 000311 1789777706.121295 mapwrite 0x00b78c thru 0x0108f3 (0x5168 bytes) 000318 1789777706.405729 trunc from 0x040000 to 0x036480 (0x9b7f bytes) 000319 1789777706.458269 mapwrite 0x02810d thru 0x0296b9 (0x15ad bytes) 000320 1789777706.583090 read 0x01a2f2 thru 0x022cc8 (0x89d7 bytes) 000321 1789777706.593905 punch from 0x005bb9 to 0x0068ca (0xd12 bytes) 000323 1789777706.606514 punch from 0x02310b to 0x02416c (0x1062 bytes) 000325 1789777706.626488 read 0x00de35 thru 0x01dbd4 (0xfda0 bytes) 000327 1789777706.655160 mapwrite 0x0335b7 thru 0x033946 (0x390 bytes) 000329 1789777706.747249 trunc from 0x036481 to 0x02495c (0x11b24 bytes) 000331 1789777706.768553 write 0x0200ba thru 0x029b56 (0x9a9d bytes) 000333 1789777706.772066 punch from 0x027738 to 0x029b56 (0x241f bytes) 000335 1789777706.798999 mapwrite 0x002bad thru 0x0049bc (0x1e10 bytes) 000336 1789777706.892002 read 0x024d16 thru 0x027fb6 (0x32a1 bytes) 000337 1789777706.912210 mapread 0x011fa7 thru 0x01ca9a (0xaaf4 bytes) 000338 1789777706.921588 read 0x020de8 thru 0x029b56 (0x8d6f bytes) 000339 1789777706.930088 mapwrite 0x03dc06 thru 0x03ffff (0x23fa bytes) 000342 1789777707.191564 read 0x00e751 thru 0x012d9e (0x464e bytes) 000343 1789777707.205313 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1fed400a (stale) Mirror 7: 0x1fed400a (stale) Mirror 10: 0x1fed400a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1fed400a (stale) Mirror 7: 0x1fed400a (stale) Mirror 10: 0x1fed400a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000344 1789777707.689121 mapread 0x004cce thru 0x011532 (0xc865 bytes) 000346 1789777707.737076 punch from 0x019482 to 0x01b88c (0x240b bytes) 000347 1789777707.744636 trunc from 0x040000 to 0x0340a4 (0xbf5b bytes) 000348 1789777707.762496 mapwrite 0x018101 thru 0x0280d1 (0xffd1 bytes) 000349 1789777707.840399 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x340a5): Mirror 3: 0xf9b56138 (stale) Mirror 7: 0xf9b56138 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x340a5): Mirror 3: 0xf9b56138 (stale) Mirror 7: 0xf9b56138 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x340a5: skipped 000351 1789777708.229466 punch from 0x023d65 to 0x030fff (0xd29b bytes) 000352 1789777708.234931 write 0x01c3bf thru 0x021e3d (0x5a7f bytes) 000353 1789777708.246550 mapwrite 0x01087d thru 0x018d9a (0x851e bytes) 000354 1789777708.317613 mapread 0x00188a thru 0x0117e2 (0xff59 bytes) 000355 1789777708.334575 MIRROR_RESYNC 3 mirrors truncating to largest ever: 0x3ccf8 000356 1789777709.234996 trunc from 0x0340a5 to 0x03ccf7 (0x8c53 bytes) 000357 1789777709.330312 write 0x029376 thru 0x036942 (0xd5cd bytes) 000359 1789777709.357105 mapwrite 0x006ce2 thru 0x01233e (0xb65d bytes) 000361 1789777709.489589 mapread 0x027662 thru 0x034e9c (0xd83b bytes) 000362 1789777709.500393 punch from 0x004b47 to 0x006573 (0x1a2d bytes) 000363 1789777709.505694 punch from 0x01c458 to 0x020f9b (0x4b44 bytes) 000364 1789777709.517013 MIRROR_RESYNC 3 mirrors 000365 1789777710.655800 trunc from 0x03ccf8 to 0x013512 (0x297e5 bytes) 000367 1789777710.716985 read 0x00c911 thru 0x013512 (0x6c02 bytes) 000369 1789777710.726709 mapread 0x010a1c thru 0x013512 (0x2af7 bytes) 000370 1789777710.732769 MIRROR_RESYNC 3 mirrors 000371 1789777711.693784 punch from 0x01021b to 0x013512 (0x32f8 bytes) 000372 1789777711.760007 write 0x03a1dc thru 0x03ffff (0x5e24 bytes) 000373 1789777711.761905 read 0x03e928 thru 0x03ffff (0x16d8 bytes) 000374 1789777711.764915 trunc from 0x040000 to 0x02a657 (0x159a8 bytes) 000375 1789777711.791474 trunc from 0x02a658 to 0x024e1e (0x5839 bytes) 000379 1789777711.815491 read 0x01689a thru 0x024e1e (0xe585 bytes) 000381 1789777711.853240 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x24e1f): Mirror 3: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24e1f): Mirror 3: 0xe69b2feb (stale) Mirror 7: 0xe69b2feb (stale) CRC-32 checksum value for chunk [0, 0x24e1f): Mirror 1: 0x3e436257 Mirror 8: 0x3e436257 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24e1f: skipped 000383 1789777713.064138 trunc from 0x024e1f to 0x00cbde (0x18240 bytes) 000384 1789777713.147467 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xcbdf): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xcbdf): Mirror 3: 0xefd74d24 (stale) Mirror 7: 0xefd74d24 (stale) Mirror 8: 0xefd74d24 (stale) CRC-32 checksum value for chunk [0, 0xcbdf): Mirror 1: 0xefd74d24 Mirror 9: 0xefd74d24 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xcbdf: skipped 000385 1789777714.013092 write 0x036a7a thru 0x036b5e (0xe5 bytes) truncating to largest ever: 0x3ff6d 000386 1789777714.094938 trunc from 0x036b5f to 0x03ff6c (0x940e bytes) 000387 1789777714.150534 read 0x03a4e2 thru 0x03ff6c (0x5a8b bytes) 000388 1789777714.179672 write 0x0077a4 thru 0x0160d7 (0xe934 bytes) 000392 1789777714.194384 punch from 0x035bb1 to 0x03ff6c (0xa3bc bytes) 000393 1789777714.221024 read 0x02924a thru 0x02d86f (0x4626 bytes) 000394 1789777714.244886 trunc from 0x03ff6d to 0x0251fd (0x1ad6f bytes) 000397 1789777714.288781 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x251fe): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x251fe): Mirror 3: 0x17d0482 (stale) Mirror 7: 0x17d0482 (stale) Mirror 8: 0xb74e8e57 (stale) Mirror 9: 0xc6b6c7b9 (stale) CRC-32 checksum value for chunk [0, 0x251fe): Mirror 1: 0x6ff01188 Mirror 10: 0x6ff01188 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x251fe: skipped 000398 1789777715.344536 write 0x01e3ef thru 0x02c14d (0xdd5f bytes) 000401 1789777715.431487 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2c14e): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c14e): Mirror 3: 0xd5ff89ba (stale) Mirror 7: 0xd5ff89ba (stale) Mirror 8: 0xe7481637 (stale) Mirror 9: 0x9ccaa947 (stale) Mirror 10: 0x3a6a53d9 (stale) CRC-32 checksum value for chunk [0, 0x2c14e): Mirror 1: 0x2871d9a7 Mirror 11: 0x2871d9a7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c14e: skipped 000404 1789777716.989521 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c14e): Mirror 3: 0xd5ff89ba (stale) Mirror 7: 0xd5ff89ba (stale) Mirror 8: 0xe7481637 (stale) Mirror 10: 0x3a6a53d9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c14e): Mirror 3: 0xd5ff89ba (stale) Mirror 7: 0xd5ff89ba (stale) Mirror 8: 0xe7481637 (stale) Mirror 10: 0x3a6a53d9 (stale) CRC-32 checksum value for chunk [0, 0x2c14e): Mirror 1: 0x2871d9a7 Mirror 11: 0x2871d9a7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c14e: skipped 000405 1789777718.422802 write 0x035847 thru 0x03ffff (0xa7b9 bytes) 000406 1789777718.561833 mapwrite 0x01b87d thru 0x02ab3f (0xf2c3 bytes) 000408 1789777718.721166 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc0b8fd65 (stale) Mirror 7: 0xc0b8fd65 (stale) Mirror 10: 0x52f98e3 (stale) Mirror 11: 0x1eacd299 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc0b8fd65 (stale) Mirror 7: 0xc0b8fd65 (stale) Mirror 10: 0x52f98e3 (stale) Mirror 11: 0x1eacd299 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000414 1789777719.297443 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xc0b8fd65 (stale) Mirror 7: 0xc0b8fd65 (stale) Mirror 10: 0x52f98e3 (stale) Mirror 11: 0x1eacd299 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3aa865a2 Mirror 12: 0x3aa865a2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000415 1789777720.870001 write 0x02eb67 thru 0x039a44 (0xaede bytes) 000416 1789777721.014878 mapwrite 0x028196 thru 0x02f522 (0x738d bytes) 000418 1789777721.113189 write 0x032ff1 thru 0x03395b (0x96b bytes) 000419 1789777721.118135 read 0x009655 thru 0x00ae01 (0x17ad bytes) 000420 1789777721.124631 mapwrite 0x01ed90 thru 0x02d4f6 (0xe767 bytes) 000422 1789777721.191179 mapwrite 0x017f77 thru 0x0243dd (0xc467 bytes) 000423 1789777721.267008 write 0x03bade thru 0x03bc28 (0x14b bytes) 000424 1789777721.275597 write 0x029c69 thru 0x02d0b1 (0x3449 bytes) 000425 1789777721.277957 read 0x01084f thru 0x013cb0 (0x3462 bytes) 000426 1789777721.299883 write 0x0348be thru 0x03d9ab (0x90ee bytes) 000427 1789777721.308605 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xc0b8fd65 (stale) Mirror 10: 0x52f98e3 (stale) Mirror 11: 0x1eacd299 (stale) Mirror 12: 0x3aa865a2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xc0b8fd65 (stale) Mirror 10: 0x52f98e3 (stale) Mirror 11: 0x1eacd299 (stale) Mirror 12: 0x3aa865a2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000428 1789777722.170069 punch from 0x002988 to 0x006f87 (0x4600 bytes) 000429 1789777722.181515 punch from 0x00efbc to 0x01e1de (0xf223 bytes) 000430 1789777722.203623 write 0x03d468 thru 0x03ffff (0x2b98 bytes) 000431 1789777722.218320 mapread 0x005ff8 thru 0x014086 (0xe08f bytes) 000432 1789777722.283812 trunc from 0x040000 to 0x021540 (0x1eabf bytes) 000434 1789777722.329836 punch from 0x015f0f to 0x01b7a4 (0x5896 bytes) 000436 1789777722.346512 write 0x03036b thru 0x03dc20 (0xd8b6 bytes) 000437 1789777722.351147 mapwrite 0x024a4f thru 0x034179 (0xf72b bytes) 000438 1789777722.507547 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dc21): Mirror 7: 0x864cb70b (stale) Mirror 11: 0x9cddfbed (stale) Mirror 12: 0x2270daed (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dc21): Mirror 7: 0x864cb70b (stale) Mirror 11: 0x9cddfbed (stale) Mirror 12: 0x2270daed (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dc21: skipped 000439 1789777723.273587 punch from 0x00bc04 to 0x010b81 (0x4f7e bytes) 000442 1789777723.316813 MIRROR_RESYNC 4 mirrors 000443 1789777725.437069 read 0x034827 thru 0x03dc20 (0x93fa bytes) 000448 1789777725.483672 punch from 0x018972 to 0x0273bd (0xea4c bytes) 000449 1789777725.730222 punch from 0x034ad4 to 0x03d055 (0x8582 bytes) 000450 1789777725.750604 mapwrite 0x021b6e thru 0x02fefd (0xe390 bytes) 000451 1789777726.046829 trunc from 0x03dc21 to 0x01b6af (0x22571 bytes) 000453 1789777726.135126 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1b6b0): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b6b0): Mirror 7: 0x194c6acc (stale) Mirror 11: 0x194c6acc (stale) Mirror 12: 0x194c6acc (stale) CRC-32 checksum value for chunk [0, 0x1b6b0): Mirror 1: 0x194c6acc Mirror 13: 0x194c6acc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b6b0: skipped 000454 1789777728.547707 mapwrite 0x035a72 thru 0x03ff74 (0xa503 bytes) 000459 1789777728.943925 mapread 0x029c16 thru 0x0353b4 (0xb79f bytes) 000460 1789777728.970929 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3ff75): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ff75): Mirror 7: 0x19f818e1 (stale) Mirror 11: 0x19f818e1 (stale) Mirror 12: 0x19f818e1 (stale) Mirror 13: 0x17ee190f (stale) CRC-32 checksum value for chunk [0, 0x3ff75): Mirror 1: 0xeedf1056 Mirror 14: 0xeedf1056 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ff75: skipped 000461 1789777731.253978 write 0x027ead thru 0x02eca9 (0x6dfd bytes) 000462 1789777731.454905 write 0x012294 thru 0x014dc7 (0x2b34 bytes) 000463 1789777731.489849 read 0x038fbd thru 0x03ff74 (0x6fb8 bytes) 000464 1789777731.503952 punch from 0x02f236 to 0x034006 (0x4dd1 bytes) 000465 1789777731.528023 mapwrite 0x01db63 thru 0x024639 (0x6ad7 bytes) 000470 1789777731.672121 mapwrite 0x004da5 thru 0x009161 (0x43bd bytes) 000471 1789777731.760284 read 0x01b11f thru 0x029f57 (0xee39 bytes) 000472 1789777731.776249 MIRROR_RESYNC 6 mirrors 000473 1789777733.611681 punch from 0x0137be to 0x01da37 (0xa27a bytes) 000474 1789777733.715762 write 0x00e773 thru 0x01050b (0x1d99 bytes) 000478 1789777733.737946 mapwrite 0x0394ae thru 0x03ffff (0x6b52 bytes) 000479 1789777733.878923 trunc from 0x040000 to 0x00dbbc (0x32443 bytes) 000480 1789777733.909100 punch from 0x00adaa to 0x00dbbc (0x2e13 bytes) 000481 1789777733.916159 mapread 0x00463c thru 0x00a3df (0x5da4 bytes) 000482 1789777733.932129 trunc from 0x00dbbd to 0x000a7a (0xd142 bytes) 000484 1789777733.974159 mapwrite 0x003a8a thru 0x00e470 (0xa9e7 bytes) 000485 1789777734.122110 read 0x00a3a5 thru 0x00e470 (0x40cc bytes) 000486 1789777734.125074 mapwrite 0x003801 thru 0x00ca14 (0x9214 bytes) 000487 1789777734.205483 punch from 0x003b26 to 0x004ad5 (0xfb0 bytes) 000488 1789777734.212958 punch from 0x001e9f to 0x00a4c9 (0x862b bytes) 000489 1789777734.220016 trunc from 0x00e471 to 0x00405e (0xa412 bytes) 000490 1789777734.246129 write 0x01ea03 thru 0x022217 (0x3815 bytes) 000491 1789777734.247245 mapread 0x001c93 thru 0x010dbf (0xf12d bytes) 000492 1789777734.269243 punch from 0x01c628 to 0x022217 (0x5bf0 bytes) 000495 1789777734.286780 punch from 0x01b24b to 0x01bbae (0x964 bytes) 000498 1789777734.291996 read 0x000c6a thru 0x00ed66 (0xe0fd bytes) 000501 1789777734.308989 mapread 0x0079dd thru 0x0160c7 (0xe6eb bytes) 000503 1789777734.313989 trunc from 0x022218 to 0x03f84c (0x1d635 bytes) 000505 1789777734.337524 trunc from 0x03f84d to 0x03c0ac (0x37a0 bytes) 000506 1789777734.358696 trunc from 0x03c0ad to 0x028e12 (0x1329a bytes) 000507 1789777734.377933 mapread 0x019972 thru 0x02282c (0x8ebb bytes) 000508 1789777734.379416 read 0x00ebad thru 0x01acc3 (0xc117 bytes) 000509 1789777734.380461 mapwrite 0x036d0d thru 0x03f8e6 (0x8bda bytes) 000511 1789777734.588174 trunc from 0x03f8e7 to 0x03beeb (0x39fb bytes) 000512 1789777734.662913 mapread 0x00cdcb thru 0x0150b4 (0x82ea bytes) 000513 1789777734.672039 write 0x034d2f thru 0x03ad03 (0x5fd5 bytes) 000514 1789777734.687212 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3beec): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3beec): Mirror 7: 0x1879db8d (stale) Mirror 11: 0x1879db8d (stale) Mirror 12: 0x1879db8d (stale) Mirror 13: 0x1879db8d (stale) Mirror 14: 0x1879db8d (stale) CRC-32 checksum value for chunk [0, 0x3beec): Mirror 1: 0x1d524657 Mirror 15: 0x1d524657 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3beec: skipped 000515 1789777736.543835 mapwrite 0x028b85 thru 0x033c19 (0xb095 bytes) 000517 1789777736.840012 mapwrite 0x01cd25 thru 0x02489d (0x7b79 bytes) 000518 1789777737.028097 trunc from 0x03beec to 0x03089b (0xb650 bytes) 000519 1789777737.078014 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3089c): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3089c): Mirror 7: 0xd3d9a269 (stale) Mirror 11: 0xd3d9a269 (stale) Mirror 12: 0xd3d9a269 (stale) Mirror 13: 0xd3d9a269 (stale) Mirror 14: 0xd3d9a269 (stale) Mirror 15: 0x93870730 (stale) CRC-32 checksum value for chunk [0, 0x3089c): Mirror 1: 0x1ab08b42 Mirror 16: 0x1ab08b42 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3089c: skipped 000525 1789777739.003683 read 0x020ffe thru 0x028ee1 (0x7ee4 bytes) 000526 1789777739.045821 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3089c): Mirror 7: 0xd3d9a269 (stale) Mirror 11: 0xd3d9a269 (stale) Mirror 12: 0xd3d9a269 (stale) Mirror 13: 0xd3d9a269 (stale) Mirror 15: 0x93870730 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3089c): Mirror 7: 0xd3d9a269 (stale) Mirror 11: 0xd3d9a269 (stale) Mirror 12: 0xd3d9a269 (stale) Mirror 13: 0xd3d9a269 (stale) Mirror 15: 0x93870730 (stale) CRC-32 checksum value for chunk [0, 0x3089c): Mirror 1: 0x1ab08b42 Mirror 16: 0x1ab08b42 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3089c: skipped 000528 1789777740.251954 punch from 0x01bd08 to 0x028944 (0xcc3d bytes) 000529 1789777740.392179 mapwrite 0x03706c thru 0x03ffff (0x8f94 bytes) 000530 1789777740.534013 MIRROR_RESYNC 7 mirrors 000532 1789777743.216272 trunc from 0x040000 to 0x00150e (0x3eaf1 bytes) 000533 1789777743.353259 write 0x025b18 thru 0x02d816 (0x7cff bytes) 000534 1789777743.356684 write 0x036810 thru 0x037b1c (0x130d bytes) 000535 1789777743.360317 read 0x01f089 thru 0x023387 (0x42ff bytes) 000536 1789777743.369310 trunc from 0x037b1d to 0x01641c (0x21700 bytes) 000537 1789777743.404664 write 0x0072e7 thru 0x00b0ba (0x3dd4 bytes) 000538 1789777743.415931 punch from 0x00c980 to 0x00df57 (0x15d8 bytes) 000539 1789777743.443836 MIRROR_RESYNC 7 mirrors 000540 1789777745.248494 write 0x01986f thru 0x01bd14 (0x24a6 bytes) 000542 1789777745.374432 read 0x00514c thru 0x00c8ef (0x77a4 bytes) 000543 1789777745.395880 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1bd15): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1bd15): Mirror 7: 0x7660538e (stale) Mirror 11: 0x7660538e (stale) Mirror 12: 0x7660538e (stale) Mirror 13: 0x7660538e (stale) Mirror 15: 0x7660538e (stale) Mirror 16: 0x7660538e (stale) CRC-32 checksum value for chunk [0, 0x1bd15): Mirror 1: 0x98b05621 Mirror 17: 0x98b05621 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1bd15: skipped 000544 1789777747.082586 read 0x01131c thru 0x018441 (0x7126 bytes) 000545 1789777747.107027 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x1bd15): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1bd15): Mirror 7: 0x7660538e (stale) Mirror 11: 0x7660538e (stale) Mirror 12: 0x7660538e (stale) Mirror 13: 0x7660538e (stale) Mirror 15: 0x7660538e (stale) Mirror 16: 0x7660538e (stale) CRC-32 checksum value for chunk [0, 0x1bd15): Mirror 1: 0x98b05621 Mirror 17: 0x98b05621 Mirror 18: 0x98b05621 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1bd15: skipped 000546 1789777748.192542 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1bd15): Mirror 7: 0x7660538e (stale) Mirror 11: 0x7660538e (stale) Mirror 12: 0x7660538e (stale) Mirror 13: 0x7660538e (stale) Mirror 15: 0x7660538e (stale) Mirror 16: 0x7660538e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1bd15): Mirror 7: 0x7660538e (stale) Mirror 11: 0x7660538e (stale) Mirror 12: 0x7660538e (stale) Mirror 13: 0x7660538e (stale) Mirror 15: 0x7660538e (stale) Mirror 16: 0x7660538e (stale) CRC-32 checksum value for chunk [0, 0x1bd15): Mirror 1: 0x98b05621 Mirror 18: 0x98b05621 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1bd15: skipped 000548 1789777749.094372 mapread 0x00243b thru 0x01043a (0xe000 bytes) 000549 1789777749.135023 mapread 0x00a630 thru 0x0144c8 (0x9e99 bytes) 000551 1789777749.184127 write 0x037997 thru 0x03a89d (0x2f07 bytes) 000552 1789777749.265103 punch from 0x0311b2 to 0x035eaf (0x4cfe bytes) 000553 1789777749.286919 write 0x00e7b5 thru 0x019262 (0xaaae bytes) 000554 1789777749.305019 mapwrite 0x01ffec thru 0x02758c (0x75a1 bytes) 000555 1789777749.363012 write 0x00f9c6 thru 0x01997e (0x9fb9 bytes) 000556 1789777749.364644 trunc from 0x03a89e to 0x03c564 (0x1cc7 bytes) 000557 1789777749.383133 write 0x03ea1f thru 0x03ffff (0x15e1 bytes) 000559 1789777749.385432 trunc from 0x040000 to 0x03c0e6 (0x3f19 bytes) 000562 1789777749.407073 write 0x00101d thru 0x001d2b (0xd0f bytes) 000563 1789777749.416805 punch from 0x034c50 to 0x03c0e6 (0x7497 bytes) 000566 1789777749.436085 mapwrite 0x023df3 thru 0x02ee36 (0xb044 bytes) 000568 1789777749.529118 mapread 0x039d95 thru 0x03c0e6 (0x2352 bytes) 000569 1789777749.542254 read 0x00b8d5 thru 0x0101a5 (0x48d1 bytes) 000571 1789777749.552184 punch from 0x002ef4 to 0x00b944 (0x8a51 bytes) 000572 1789777749.558636 mapread 0x02636a thru 0x02a18a (0x3e21 bytes) 000574 1789777749.560241 write 0x0052cd thru 0x006fe7 (0x1d1b bytes) 000575 1789777749.574325 write 0x02ff46 thru 0x03af73 (0xb02e bytes) 000576 1789777749.576854 mapread 0x006ba5 thru 0x00a485 (0x38e1 bytes) 000577 1789777749.593649 mapwrite 0x02a256 thru 0x02a528 (0x2d3 bytes) 000578 1789777749.667844 write 0x03547a thru 0x03e0f2 (0x8c79 bytes) 000579 1789777749.669127 mapwrite 0x028be0 thru 0x02ea58 (0x5e79 bytes) 000581 1789777749.717027 trunc from 0x03e0f3 to 0x00bef2 (0x32200 bytes) 000582 1789777749.745372 punch from 0x0013c8 to 0x00bef2 (0xab2b bytes) 000583 1789777749.759417 MIRROR_RESYNC 8 mirrors 000584 1789777751.770206 write 0x037827 thru 0x03ce4b (0x5625 bytes) 000585 1789777751.869263 mapwrite 0x000ea4 thru 0x00a763 (0x98c0 bytes) 000586 1789777751.992595 write 0x006df8 thru 0x00d280 (0x6489 bytes) 000587 1789777751.998676 mapread 0x01f805 thru 0x02dde1 (0xe5dd bytes) 000590 1789777752.039889 trunc from 0x03ce4c to 0x009e6a (0x32fe1 bytes) 000593 1789777752.075771 mapwrite 0x00daee thru 0x0188ad (0xadc0 bytes) 000595 1789777752.162869 write 0x022ed7 thru 0x0243ec (0x1516 bytes) 000597 1789777752.166645 punch from 0x01144d to 0x017a9f (0x6653 bytes) 000598 1789777752.180251 mapwrite 0x011ed5 thru 0x01b361 (0x948d bytes) 000600 1789777752.266070 mapread 0x020d56 thru 0x0238eb (0x2b96 bytes) 000601 1789777752.267023 punch from 0x00c378 to 0x01b17e (0xee07 bytes) 000604 1789777752.279002 mapwrite 0x01bf64 thru 0x01e335 (0x23d2 bytes) 000605 1789777752.364086 read 0x018848 thru 0x0243ec (0xbba5 bytes) 000606 1789777752.365392 mapread 0x00e80e thru 0x018ae0 (0xa2d3 bytes) 000607 1789777752.394260 read 0x007864 thru 0x00bf33 (0x46d0 bytes) 000608 1789777752.419021 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x243ed): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x243ed): Mirror 7: 0x98eea50b (stale) Mirror 11: 0x98eea50b (stale) Mirror 12: 0x98eea50b (stale) Mirror 13: 0x98eea50b (stale) Mirror 15: 0x98eea50b (stale) Mirror 16: 0x98eea50b (stale) Mirror 18: 0x98eea50b (stale) CRC-32 checksum value for chunk [0, 0x243ed): Mirror 1: 0xc43dfec4 Mirror 19: 0xc43dfec4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x243ed: skipped 000609 1789777753.890387 trunc from 0x0243ed to 0x013ee5 (0x10507 bytes) 000610 1789777754.045899 write 0x0247d4 thru 0x0279cb (0x31f8 bytes) 000611 1789777754.046936 mapread 0x00b41f thru 0x0155b6 (0xa198 bytes) 000614 1789777754.081937 mapread 0x00ca77 thru 0x01aa2f (0xdfb9 bytes) 000615 1789777754.104830 trunc from 0x0279cc to 0x0392e6 (0x1191b bytes) 000616 1789777754.165777 mapwrite 0x03efc8 thru 0x03ffff (0x1038 bytes) 000617 1789777754.265310 read 0x00aa9c thru 0x00d0f9 (0x265e bytes) 000618 1789777754.266263 write 0x035352 thru 0x0356e1 (0x390 bytes) 000619 1789777754.276953 mapwrite 0x02a5a2 thru 0x0346b3 (0xa112 bytes) 000620 1789777754.343092 mapread 0x00dd51 thru 0x0185af (0xa85f bytes) 000621 1789777754.345591 read 0x02c46b thru 0x031b51 (0x56e7 bytes) 000622 1789777754.351677 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x7f2990bb (stale) Mirror 11: 0x7f2990bb (stale) Mirror 12: 0x7f2990bb (stale) Mirror 13: 0x7f2990bb (stale) Mirror 15: 0x7f2990bb (stale) Mirror 16: 0x7f2990bb (stale) Mirror 19: 0xd2904267 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x7f2990bb (stale) Mirror 11: 0x7f2990bb (stale) Mirror 12: 0x7f2990bb (stale) Mirror 13: 0x7f2990bb (stale) Mirror 15: 0x7f2990bb (stale) Mirror 16: 0x7f2990bb (stale) Mirror 19: 0xd2904267 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000623 1789777755.115994 read 0x019f15 thru 0x028353 (0xe43f bytes) 000624 1789777755.133220 mapread 0x01962b thru 0x028732 (0xf108 bytes) 000630 1789777755.138807 read 0x025e74 thru 0x028ad9 (0x2c66 bytes) 000632 1789777755.144035 punch from 0x0177c5 to 0x0253cb (0xdc07 bytes) 000634 1789777755.150282 punch from 0x00ea9b to 0x017331 (0x8897 bytes) 000635 1789777755.162791 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x7f2990bb (stale) Mirror 11: 0x7f2990bb (stale) Mirror 12: 0x7f2990bb (stale) Mirror 13: 0x7f2990bb (stale) Mirror 15: 0x7f2990bb (stale) Mirror 16: 0x7f2990bb (stale) Mirror 19: 0xd2904267 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xeabf4c9f Mirror 20: 0xeabf4c9f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000636 1789777756.545839 mapwrite 0x036d9f thru 0x03c0b0 (0x5312 bytes) 000637 1789777756.788787 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x7f2990bb (stale) Mirror 12: 0x7f2990bb (stale) Mirror 13: 0x7f2990bb (stale) Mirror 15: 0x7f2990bb (stale) Mirror 16: 0x7f2990bb (stale) Mirror 19: 0xd2904267 (stale) Mirror 20: 0xeabf4c9f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x7f2990bb (stale) Mirror 12: 0x7f2990bb (stale) Mirror 13: 0x7f2990bb (stale) Mirror 15: 0x7f2990bb (stale) Mirror 16: 0x7f2990bb (stale) Mirror 19: 0xd2904267 (stale) Mirror 20: 0xeabf4c9f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000638 1789777757.491147 trunc from 0x040000 to 0x02b4fd (0x14b02 bytes) 000639 1789777757.515316 read 0x029329 thru 0x02b4fd (0x21d5 bytes) 000642 1789777757.524226 write 0x0136a6 thru 0x01b3b1 (0x7d0c bytes) 000643 1789777757.544590 write 0x01ae72 thru 0x01cb7a (0x1d09 bytes) 000644 1789777757.567142 mapread 0x008e5b thru 0x00bcb5 (0x2e5b bytes) 000649 1789777757.599608 trunc from 0x02b4fe to 0x0360b2 (0xabb5 bytes) 000652 1789777757.636942 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x360b3): Mirror 12: 0xeda1134a (stale) Mirror 13: 0xeda1134a (stale) Mirror 15: 0xeda1134a (stale) Mirror 16: 0xeda1134a (stale) Mirror 19: 0xd0aed051 (stale) Mirror 20: 0xc3e30eee (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x360b3): Mirror 12: 0xeda1134a (stale) Mirror 13: 0xeda1134a (stale) Mirror 15: 0xeda1134a (stale) Mirror 16: 0xeda1134a (stale) Mirror 19: 0xd0aed051 (stale) Mirror 20: 0xc3e30eee (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x360b3: skipped 000653 1789777758.151527 write 0x008c90 thru 0x00b614 (0x2985 bytes) 000654 1789777758.169268 trunc from 0x0360b3 to 0x03a9aa (0x48f8 bytes) 000655 1789777758.201261 read 0x012b94 thru 0x021403 (0xe870 bytes) 000658 1789777758.244001 punch from 0x01ca43 to 0x02c4c5 (0xfa83 bytes) 000660 1789777758.265886 trunc from 0x03a9ab to 0x019134 (0x21876 bytes) 000661 1789777758.296491 punch from 0x00b1d0 to 0x00f4cb (0x42fc bytes) 000662 1789777758.302704 mapread 0x00466f thru 0x00cc2a (0x85bc bytes) 000664 1789777758.323304 read 0x00aa8b thru 0x00ef34 (0x44aa bytes) 000665 1789777758.324221 punch from 0x00d3aa to 0x01222d (0x4e84 bytes) 000666 1789777758.336502 write 0x01e108 thru 0x0269bf (0x88b8 bytes) 000668 1789777758.340151 mapwrite 0x02db25 thru 0x039dfd (0xc2d9 bytes) 000671 1789777758.435861 punch from 0x019fdb to 0x01a63e (0x664 bytes) 000672 1789777758.447194 punch from 0x005f45 to 0x013a41 (0xdafd bytes) 000673 1789777758.464066 punch from 0x019849 to 0x025529 (0xbce1 bytes) 000674 1789777758.473827 mapread 0x0075ac thru 0x007d9f (0x7f4 bytes) 000675 1789777758.490529 write 0x03ede6 thru 0x03ffff (0x121a bytes) 000677 1789777758.503016 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x7f2990bb (stale) Mirror 13: 0x7f2990bb (stale) Mirror 15: 0x7f2990bb (stale) Mirror 16: 0x7f2990bb (stale) Mirror 19: 0xd2904267 (stale) Mirror 20: 0xeabf4c9f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xccf36102 Mirror 21: 0xccf36102 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000678 1789777759.946845 trunc from 0x040000 to 0x00b4d7 (0x34b28 bytes) 000679 1789777760.116944 mapread 0x000cad thru 0x0059b7 (0x4d0b bytes) 000680 1789777760.165677 mapwrite 0x00c048 thru 0x00ed63 (0x2d1c bytes) 000681 1789777760.270810 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xed64): Mirror 12: 0x6c8dcaf6 (stale) Mirror 13: 0x6c8dcaf6 (stale) Mirror 16: 0x6c8dcaf6 (stale) Mirror 19: 0xda326572 (stale) Mirror 20: 0xda326572 (stale) Mirror 21: 0x654683ed (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xed64): Mirror 12: 0x6c8dcaf6 (stale) Mirror 13: 0x6c8dcaf6 (stale) Mirror 16: 0x6c8dcaf6 (stale) Mirror 19: 0xda326572 (stale) Mirror 20: 0xda326572 (stale) Mirror 21: 0x654683ed (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xed64: skipped 000682 1789777760.792805 write 0x031686 thru 0x037e20 (0x679b bytes) 000683 1789777760.795626 write 0x0373ec thru 0x037cc6 (0x8db bytes) 000686 1789777760.798089 write 0x002277 thru 0x00c868 (0xa5f2 bytes) 000688 1789777760.816071 write 0x03bd51 thru 0x03ffff (0x42af bytes) 000689 1789777760.819439 read 0x03da76 thru 0x03ffff (0x258a bytes) 000690 1789777760.822315 mapwrite 0x019974 thru 0x0283b4 (0xea41 bytes) 000691 1789777760.910603 read 0x02a822 thru 0x037d04 (0xd4e3 bytes) 000692 1789777760.921633 trunc from 0x040000 to 0x013140 (0x2cebf bytes) 000693 1789777760.942085 MIRROR_RESYNC 7 mirrors 000694 1789777762.741783 write 0x0010d3 thru 0x0020cb (0xff9 bytes) 000697 1789777762.807877 trunc from 0x013141 to 0x03a395 (0x27255 bytes) 000698 1789777762.827789 punch from 0x031d37 to 0x03a395 (0x865f bytes) 000700 1789777762.837733 mapwrite 0x022282 thru 0x0261c1 (0x3f40 bytes) 000701 1789777762.904828 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3a396): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a396): Mirror 12: 0x7cb03a78 (stale) Mirror 13: 0x7cb03a78 (stale) Mirror 16: 0x7cb03a78 (stale) Mirror 19: 0x7cb03a78 (stale) Mirror 20: 0x7cb03a78 (stale) Mirror 21: 0x7cb03a78 (stale) CRC-32 checksum value for chunk [0, 0x3a396): Mirror 1: 0x20c3737c Mirror 22: 0x20c3737c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a396: skipped 000703 1789777764.334893 write 0x012e35 thru 0x01c283 (0x944f bytes) 000705 1789777764.412861 punch from 0x006b5a to 0x0139cd (0xce74 bytes) 000706 1789777764.434764 punch from 0x032add to 0x036883 (0x3da7 bytes) 000707 1789777764.442659 trunc from 0x03a396 to 0x03fed7 (0x5b42 bytes) 000708 1789777764.472819 mapread 0x00d00e thru 0x01b361 (0xe354 bytes) 000711 1789777764.517639 mapread 0x018144 thru 0x01ece3 (0x6ba0 bytes) 000712 1789777764.538126 write 0x0067f0 thru 0x00d4e7 (0x6cf8 bytes) 000713 1789777764.548588 trunc from 0x03fed8 to 0x0230b5 (0x1ce22 bytes) 000715 1789777764.568910 mapwrite 0x03d962 thru 0x03ffff (0x269e bytes) 000716 1789777764.645986 read 0x00fe91 thru 0x013135 (0x32a5 bytes) 000718 1789777764.647273 write 0x0001e0 thru 0x005f7e (0x5d9f bytes) 000719 1789777764.656407 mapwrite 0x019bc6 thru 0x0236dc (0x9b17 bytes) 000720 1789777764.700799 write 0x004520 thru 0x00f0ab (0xab8c bytes) 000721 1789777764.703130 write 0x02ae09 thru 0x02e44d (0x3645 bytes) 000722 1789777764.712178 mapwrite 0x01d94e thru 0x01f3ea (0x1a9d bytes) 000723 1789777764.761916 punch from 0x02191e to 0x02f2fe (0xd9e1 bytes) 000727 1789777764.777426 MIRROR_RESYNC 8 mirrors 000728 1789777767.132621 read 0x033a22 thru 0x0395a9 (0x5b88 bytes) 000731 1789777767.144831 MIRROR_EXTEND to 9 mirrors 000732 1789777767.973629 punch from 0x0241bc to 0x030349 (0xc18e bytes) 000733 1789777768.061837 write 0x028345 thru 0x030e6e (0x8b2a bytes) 000735 1789777768.075792 trunc from 0x040000 to 0x02e284 (0x11d7b bytes) 000738 1789777768.126858 trunc from 0x02e285 to 0x010a6e (0x1d816 bytes) 000739 1789777768.158807 mapwrite 0x006b71 thru 0x00b531 (0x49c1 bytes) 000740 1789777768.249770 write 0x01a299 thru 0x01ba50 (0x17b8 bytes) 000741 1789777768.257795 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x1ba51): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ba51): Mirror 12: 0xbf1bd549 (stale) Mirror 13: 0xbf1bd549 (stale) Mirror 16: 0xbf1bd549 (stale) Mirror 19: 0xbf1bd549 (stale) Mirror 20: 0xbf1bd549 (stale) Mirror 21: 0xbf1bd549 (stale) Mirror 22: 0xbf1bd549 (stale) Mirror 23: 0xbf1bd549 (stale) CRC-32 checksum value for chunk [0, 0x1ba51): Mirror 1: 0xf148284b Mirror 24: 0xf148284b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ba51: skipped 000743 1789777769.334718 read 0x000bfa thru 0x00cf48 (0xc34f bytes) 000744 1789777769.352196 read 0x002ded thru 0x006660 (0x3874 bytes) 000745 1789777769.353552 trunc from 0x01ba51 to 0x034e02 (0x193b2 bytes) 000746 1789777769.577879 punch from 0x025466 to 0x030f31 (0xbacc bytes) 000747 1789777769.589402 mapread 0x000711 thru 0x006509 (0x5df9 bytes) 000748 1789777769.612167 mapread 0x00bc7f thru 0x01083a (0x4bbc bytes) 000749 1789777769.613121 punch from 0x013511 to 0x015504 (0x1ff4 bytes) 000752 1789777769.622851 mapread 0x00bfee thru 0x00e350 (0x2363 bytes) 000755 1789777769.634083 mapwrite 0x01476e thru 0x015289 (0xb1c bytes) 000756 1789777769.753799 trunc from 0x034e03 to 0x01a35f (0x1aaa3 bytes) 000757 1789777769.788972 mapread 0x013733 thru 0x0149d9 (0x12a7 bytes) 000758 1789777769.796874 read 0x00392a thru 0x00f803 (0xbeda bytes) 000760 1789777769.798909 trunc from 0x01a360 to 0x01dc8f (0x3930 bytes) 000761 1789777769.816266 read 0x005a3f thru 0x014efe (0xf4c0 bytes) 000763 1789777769.825770 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1dc90): Mirror 12: 0x1236e9fb (stale) Mirror 13: 0x1236e9fb (stale) Mirror 16: 0x1236e9fb (stale) Mirror 19: 0x1236e9fb (stale) Mirror 20: 0x1236e9fb (stale) Mirror 21: 0x1236e9fb (stale) Mirror 22: 0x1236e9fb (stale) Mirror 24: 0xce7d333d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1dc90): Mirror 12: 0x1236e9fb (stale) Mirror 13: 0x1236e9fb (stale) Mirror 16: 0x1236e9fb (stale) Mirror 19: 0x1236e9fb (stale) Mirror 20: 0x1236e9fb (stale) Mirror 21: 0x1236e9fb (stale) Mirror 22: 0x1236e9fb (stale) Mirror 24: 0xce7d333d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1dc90: skipped 000764 1789777770.446742 mapread 0x01c35d thru 0x01dc8f (0x1933 bytes) 000765 1789777770.460835 punch from 0x01d53b to 0x01dc8f (0x755 bytes) 000766 1789777770.465952 mapread 0x013866 thru 0x01dc8f (0xa42a bytes) 000767 1789777770.481883 read 0x01d3a4 thru 0x01dc8f (0x8ec bytes) 000768 1789777770.482976 mapread 0x00d821 thru 0x011b23 (0x4303 bytes) 000769 1789777770.485049 mapread 0x012378 thru 0x0177c8 (0x5451 bytes) 000772 1789777770.487131 read 0x00def9 thru 0x01ace3 (0xcdeb bytes) 000773 1789777770.493915 MIRROR_RESYNC 9 mirrors 000777 1789777772.039141 mapread 0x00d895 thru 0x01ce78 (0xf5e4 bytes) 000778 1789777772.078219 read 0x0096fe thru 0x00af79 (0x187c bytes) 000779 1789777772.078628 mapwrite 0x0223cd thru 0x02bc3d (0x9871 bytes) 000780 1789777772.291792 write 0x03a552 thru 0x03ae83 (0x932 bytes) 000783 1789777772.294970 read 0x01fee6 thru 0x024989 (0x4aa4 bytes) 000784 1789777772.295741 write 0x02eda5 thru 0x03d93a (0xeb96 bytes) 000786 1789777772.306768 mapread 0x032101 thru 0x03d93a (0xb83a bytes) 000787 1789777772.307918 write 0x02cddf thru 0x03b832 (0xea54 bytes) 000789 1789777772.311138 write 0x01542d thru 0x01a03b (0x4c0f bytes) 000790 1789777772.312668 read 0x02dbe3 thru 0x03384a (0x5c68 bytes) 000791 1789777772.313733 mapread 0x036717 thru 0x03d241 (0x6b2b bytes) 000793 1789777772.316224 read 0x00c00c thru 0x00cb4b (0xb40 bytes) 000794 1789777772.317962 write 0x00fa88 thru 0x0177c2 (0x7d3b bytes) 000795 1789777772.319527 write 0x02b734 thru 0x03a70b (0xefd8 bytes) 000796 1789777772.321596 punch from 0x02d68b to 0x037ab0 (0xa426 bytes) 000797 1789777772.335757 read 0x00c7b8 thru 0x00ec80 (0x24c9 bytes) 000798 1789777772.336590 trunc from 0x03d93b to 0x00505b (0x388df bytes) 000799 1789777772.355845 mapread 0x002c63 thru 0x00505b (0x23f9 bytes) 000801 1789777772.358032 punch from 0x002691 to 0x00505b (0x29cb bytes) 000802 1789777772.362619 punch from 0x00319d to 0x00505b (0x1ebf bytes) 000803 1789777772.368949 mapread 0x004de8 thru 0x00505b (0x274 bytes) 000804 1789777772.376150 punch from 0x0044a7 to 0x00505b (0xbb5 bytes) 000805 1789777772.380940 write 0x01dd93 thru 0x025cdf (0x7f4d bytes) 000807 1789777772.383398 mapread 0x0208fd thru 0x021b8e (0x1292 bytes) 000808 1789777772.384867 mapwrite 0x003411 thru 0x006393 (0x2f83 bytes) 000809 1789777772.471593 mapwrite 0x013dc7 thru 0x01d823 (0x9a5d bytes) 000810 1789777772.552709 read 0x008944 thru 0x0127bf (0x9e7c bytes) 000811 1789777772.554007 write 0x01e7c2 thru 0x024a7e (0x62bd bytes) 000812 1789777772.556657 mapread 0x01c094 thru 0x0222ee (0x625b bytes) 000813 1789777772.558015 mapread 0x01eb67 thru 0x023429 (0x48c3 bytes) 000814 1789777772.559938 punch from 0x01389f to 0x014655 (0xdb7 bytes) 000816 1789777772.577787 mapread 0x021bd5 thru 0x025cdf (0x410b bytes) 000818 1789777772.580010 punch from 0x025c00 to 0x025cdf (0xe0 bytes) 000819 1789777772.586693 write 0x00bced thru 0x01bcb1 (0xffc5 bytes) 000820 1789777772.594606 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x25ce0): Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25ce0): Mirror 12: 0x3ab06a1e (stale) Mirror 13: 0x3ab06a1e (stale) Mirror 16: 0x3ab06a1e (stale) Mirror 19: 0x3ab06a1e (stale) Mirror 20: 0x3ab06a1e (stale) Mirror 21: 0x3ab06a1e (stale) Mirror 22: 0x3ab06a1e (stale) Mirror 24: 0x3ab06a1e (stale) CRC-32 checksum value for chunk [0, 0x25ce0): Mirror 1: 0xecd46e09 Mirror 25: 0xecd46e09 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25ce0: skipped 000822 1789777773.873275 mapwrite 0x017835 thru 0x018f51 (0x171d bytes) 000823 1789777774.084561 mapwrite 0x03e299 thru 0x03ed82 (0xaea bytes) 000824 1789777774.238892 read 0x0182b6 thru 0x02256a (0xa2b5 bytes) 000825 1789777774.250268 read 0x033ccb thru 0x03ed82 (0xb0b8 bytes) 000826 1789777774.266437 write 0x01862d thru 0x01ae52 (0x2826 bytes) 000827 1789777774.270106 punch from 0x020219 to 0x02429a (0x4082 bytes) 000828 1789777774.285118 read 0x03498d thru 0x03ed82 (0xa3f6 bytes) 000830 1789777774.287431 mapread 0x031f26 thru 0x038a3f (0x6b1a bytes) 000832 1789777774.289889 write 0x016e42 thru 0x01e76e (0x792d bytes) 000833 1789777774.292118 trunc from 0x03ed83 to 0x00197d (0x3d405 bytes) 000834 1789777774.315741 punch from 0x00141e to 0x00197d (0x560 bytes) 000835 1789777774.320296 trunc from 0x00197e to 0x006a82 (0x5105 bytes) 000839 1789777774.356678 write 0x02d2b0 thru 0x037199 (0x9eea bytes) 000842 1789777774.362657 mapread 0x007fc1 thru 0x00b70f (0x374f bytes) 000843 1789777774.385873 trunc from 0x03719a to 0x026ae1 (0x106b8 bytes) 000844 1789777774.429838 mapread 0x005f15 thru 0x00fee0 (0x9fcc bytes) 000845 1789777774.434239 mapread 0x016994 thru 0x019477 (0x2ae4 bytes) 000847 1789777774.437805 mapwrite 0x03137e thru 0x03bff2 (0xac75 bytes) 000850 1789777774.646442 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bff3): Mirror 12: 0x8e38cb9d (stale) Mirror 16: 0x8e38cb9d (stale) Mirror 19: 0x8e38cb9d (stale) Mirror 20: 0x8e38cb9d (stale) Mirror 21: 0x8e38cb9d (stale) Mirror 22: 0x8e38cb9d (stale) Mirror 24: 0x8e38cb9d (stale) Mirror 25: 0xad39b84 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bff3): Mirror 12: 0x8e38cb9d (stale) Mirror 16: 0x8e38cb9d (stale) Mirror 19: 0x8e38cb9d (stale) Mirror 20: 0x8e38cb9d (stale) Mirror 21: 0x8e38cb9d (stale) Mirror 22: 0x8e38cb9d (stale) Mirror 24: 0x8e38cb9d (stale) Mirror 25: 0xad39b84 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bff3: skipped 000851 1789777775.299826 write 0x026774 thru 0x02ed6a (0x85f7 bytes) 000852 1789777775.316686 read 0x01900f thru 0x023142 (0xa134 bytes) 000853 1789777775.332301 trunc from 0x03bff3 to 0x0065ac (0x35a46 bytes) 000855 1789777775.359946 read 0x0022f8 thru 0x0065ac (0x42b5 bytes) 000856 1789777775.369144 punch from 0x0051f0 to 0x0065ac (0x13bd bytes) 000858 1789777775.374305 trunc from 0x0065ad to 0x02d11b (0x26b6f bytes) 000860 1789777775.390534 trunc from 0x02d11c to 0x015ecf (0x1724c bytes) 000861 1789777775.407628 trunc from 0x015ed0 to 0x00d761 (0x876e bytes) 000862 1789777775.424136 mapread 0x00c91b thru 0x00d761 (0xe47 bytes) 000863 1789777775.434202 mapread 0x00cbd3 thru 0x00d761 (0xb8f bytes) 000864 1789777775.438782 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0xd762): Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd762): Mirror 12: 0xc7fa41d1 (stale) Mirror 16: 0xc7fa41d1 (stale) Mirror 19: 0xc7fa41d1 (stale) Mirror 20: 0xc7fa41d1 (stale) Mirror 21: 0xc7fa41d1 (stale) Mirror 22: 0xc7fa41d1 (stale) Mirror 24: 0xc7fa41d1 (stale) Mirror 25: 0x133e6b1f (stale) CRC-32 checksum value for chunk [0, 0xd762): Mirror 1: 0x6ab29a4c Mirror 26: 0x6ab29a4c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd762: skipped 000866 1789777776.999634 punch from 0x00bd20 to 0x00d761 (0x1a42 bytes) 000867 1789777777.098606 punch from 0x00a013 to 0x00d761 (0x374f bytes) 000868 1789777777.104318 read 0x006743 thru 0x00d761 (0x701f bytes) 000870 1789777777.114663 mapread 0x000e63 thru 0x008f47 (0x80e5 bytes) 000871 1789777777.135843 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0xd762): Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd762): Mirror 12: 0xc7fa41d1 (stale) Mirror 16: 0xc7fa41d1 (stale) Mirror 19: 0xc7fa41d1 (stale) Mirror 20: 0xc7fa41d1 (stale) Mirror 21: 0xc7fa41d1 (stale) Mirror 22: 0xc7fa41d1 (stale) Mirror 24: 0xc7fa41d1 (stale) Mirror 25: 0x133e6b1f (stale) Mirror 26: 0x6ab29a4c (stale) CRC-32 checksum value for chunk [0, 0xd762): Mirror 1: 0x6ab29a4c Mirror 27: 0x6ab29a4c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd762: skipped 000873 1789777778.457854 trunc from 0x00d762 to 0x039409 (0x2bca8 bytes) 000874 1789777778.615272 mapwrite 0x02236f thru 0x030e74 (0xeb06 bytes) 000875 1789777778.770817 trunc from 0x03940a to 0x02e23f (0xb1ca bytes) 000876 1789777778.802525 mapwrite 0x00c398 thru 0x00db18 (0x1781 bytes) 000877 1789777778.900494 mapwrite 0x012afa thru 0x01b80c (0x8d13 bytes) 000878 1789777779.000193 punch from 0x020f0d to 0x024537 (0x362b bytes) 000880 1789777779.006555 punch from 0x022072 to 0x02a4a6 (0x8435 bytes) 000881 1789777779.012822 read 0x019a90 thru 0x0226a5 (0x8c16 bytes) 000883 1789777779.024052 mapread 0x01a56f thru 0x01dd1b (0x37ad bytes) 000884 1789777779.025429 mapwrite 0x03144f thru 0x03c9c2 (0xb574 bytes) 000887 1789777779.146694 trunc from 0x03c9c3 to 0x00bfbc (0x30a06 bytes) 000888 1789777779.180914 mapread 0x00a398 thru 0x00bfbc (0x1c25 bytes) 000889 1789777779.182060 mapwrite 0x03a1f1 thru 0x03ffff (0x5e0f bytes) 000893 1789777779.309752 read 0x03f857 thru 0x03ffff (0x7a9 bytes) 000895 1789777779.311589 mapread 0x01f03e thru 0x02eebf (0xfe82 bytes) 000896 1789777779.330442 write 0x036f08 thru 0x03ffff (0x90f8 bytes) 000898 1789777779.338954 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x19c6df0c (stale) Mirror 16: 0x19c6df0c (stale) Mirror 19: 0x19c6df0c (stale) Mirror 20: 0x19c6df0c (stale) Mirror 21: 0x19c6df0c (stale) Mirror 22: 0x19c6df0c (stale) Mirror 24: 0x19c6df0c (stale) Mirror 25: 0x7813b074 (stale) Mirror 26: 0xf0d5d078 (stale) Mirror 27: 0xf0d5d078 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb0f93261 Mirror 28: 0xb0f93261 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000899 1789777780.957441 read 0x014433 thru 0x01cc9c (0x886a bytes) 000900 1789777780.980048 mapread 0x013a2c thru 0x01fb84 (0xc159 bytes) 000901 1789777781.027971 read 0x018f00 thru 0x01a1b6 (0x12b7 bytes) 000904 1789777781.071479 punch from 0x03a73f to 0x03f0a6 (0x4968 bytes) 000905 1789777781.179801 MIRROR_SPLIT mirror 11 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x19c6df0c (stale) Mirror 16: 0x19c6df0c (stale) Mirror 19: 0x19c6df0c (stale) Mirror 20: 0x19c6df0c (stale) Mirror 21: 0x19c6df0c (stale) Mirror 22: 0x19c6df0c (stale) Mirror 24: 0x19c6df0c (stale) Mirror 25: 0x7813b074 (stale) Mirror 26: 0xf0d5d078 (stale) Mirror 27: 0xf0d5d078 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x19c6df0c (stale) Mirror 16: 0x19c6df0c (stale) Mirror 19: 0x19c6df0c (stale) Mirror 20: 0x19c6df0c (stale) Mirror 21: 0x19c6df0c (stale) Mirror 22: 0x19c6df0c (stale) Mirror 24: 0x19c6df0c (stale) Mirror 25: 0x7813b074 (stale) Mirror 26: 0xf0d5d078 (stale) Mirror 27: 0xf0d5d078 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000906 1789777782.062142 MIRROR_SPLIT mirror 8 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x19c6df0c (stale) Mirror 16: 0x19c6df0c (stale) Mirror 19: 0x19c6df0c (stale) Mirror 20: 0x19c6df0c (stale) Mirror 21: 0x19c6df0c (stale) Mirror 22: 0x19c6df0c (stale) Mirror 24: 0x19c6df0c (stale) Mirror 26: 0xf0d5d078 (stale) Mirror 27: 0xf0d5d078 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x19c6df0c (stale) Mirror 16: 0x19c6df0c (stale) Mirror 19: 0x19c6df0c (stale) Mirror 20: 0x19c6df0c (stale) Mirror 21: 0x19c6df0c (stale) Mirror 22: 0x19c6df0c (stale) Mirror 24: 0x19c6df0c (stale) Mirror 26: 0xf0d5d078 (stale) Mirror 27: 0xf0d5d078 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000908 1789777782.756512 write 0x02d33e thru 0x030eff (0x3bc2 bytes) 000909 1789777782.768896 mapread 0x00c175 thru 0x0149f1 (0x887d bytes) 000910 1789777782.816241 write 0x03d065 thru 0x03ffff (0x2f9b bytes) 000911 1789777782.824814 read 0x00c9a2 thru 0x014e03 (0x8462 bytes) 000912 1789777782.834996 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x19c6df0c (stale) Mirror 16: 0x19c6df0c (stale) Mirror 19: 0x19c6df0c (stale) Mirror 20: 0x19c6df0c (stale) Mirror 21: 0x19c6df0c (stale) Mirror 22: 0x19c6df0c (stale) Mirror 24: 0x19c6df0c (stale) Mirror 26: 0xf0d5d078 (stale) Mirror 27: 0xf0d5d078 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa5fed712 Mirror 28: 0xa5fed712 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000915 1789777784.072253 trunc from 0x040000 to 0x01ce22 (0x231dd bytes) 000916 1789777784.240678 punch from 0x00ec7f to 0x01ce22 (0xe1a4 bytes) 000920 1789777784.258608 MIRROR_SPLIT mirror 4 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ce23): Mirror 12: 0xaf61486b (stale) Mirror 16: 0xaf61486b (stale) Mirror 19: 0xaf61486b (stale) Mirror 21: 0xaf61486b (stale) Mirror 22: 0xaf61486b (stale) Mirror 24: 0xaf61486b (stale) Mirror 26: 0x410de73d (stale) Mirror 27: 0x410de73d (stale) Mirror 28: 0x410de73d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ce23): Mirror 12: 0xaf61486b (stale) Mirror 16: 0xaf61486b (stale) Mirror 19: 0xaf61486b (stale) Mirror 21: 0xaf61486b (stale) Mirror 22: 0xaf61486b (stale) Mirror 24: 0xaf61486b (stale) Mirror 26: 0x410de73d (stale) Mirror 27: 0x410de73d (stale) Mirror 28: 0x410de73d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ce23: skipped 000921 1789777785.030008 mapwrite 0x004b40 thru 0x00e6a7 (0x9b68 bytes) 000922 1789777785.181818 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1aa:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ce23): Mirror 12: 0xaf61486b (stale) Mirror 16: 0xaf61486b (stale) Mirror 21: 0xaf61486b (stale) Mirror 22: 0xaf61486b (stale) Mirror 24: 0xaf61486b (stale) Mirror 26: 0x410de73d (stale) Mirror 27: 0x410de73d (stale) Mirror 28: 0x410de73d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ce23): Mirror 12: 0xaf61486b (stale) Mirror 16: 0xaf61486b (stale) Mirror 21: 0xaf61486b (stale) Mirror 22: 0xaf61486b (stale) Mirror 24: 0xaf61486b (stale) Mirror 26: 0x410de73d (stale) Mirror 27: 0x410de73d (stale) Mirror 28: 0x410de73d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ce23: skipped 000923 1789777785.677721 mapread 0x012092 thru 0x01741e (0x538d bytes) 000926 1789777785.698783 mapread 0x008ff4 thru 0x012488 (0x9495 bytes) 000928 1789777785.709076 read 0x00fef3 thru 0x0119b5 (0x1ac3 bytes) 000931 1789777785.711690 mapread 0x0037fc thru 0x00a325 (0x6b2a bytes) 000933 1789777785.713534 read 0x00a239 thru 0x0148e0 (0xa6a8 bytes) 000934 1789777785.715022 punch from 0x019926 to 0x01ce22 (0x34fd bytes) 000935 1789777785.720746 write 0x032ad6 thru 0x037662 (0x4b8d bytes) 000937 1789777785.722957 trunc from 0x037663 to 0x03872a (0x10c8 bytes) 000941 1789777785.742668 punch from 0x028d7b to 0x02dfc4 (0x524a bytes) 000943 1789777785.760275 read 0x035783 thru 0x03872a (0x2fa8 bytes) 000945 1789777785.769997 write 0x03637d thru 0x038f26 (0x2baa bytes) 000946 1789777785.771399 mapread 0x007cf1 thru 0x015c8f (0xdf9f bytes) 000947 1789777785.772851 trunc from 0x038f27 to 0x02d5f6 (0xb930 bytes) 000950 1789777785.800076 read 0x016480 thru 0x01c082 (0x5c03 bytes) 000951 1789777785.801234 read 0x00d619 thru 0x00e92d (0x1315 bytes) 000953 1789777785.803995 punch from 0x012317 to 0x020671 (0xe35b bytes) 000954 1789777785.819250 MIRROR_RESYNC 9 mirrors 000955 1789777788.025829 mapread 0x014559 thru 0x017405 (0x2ead bytes) 000956 1789777788.044865 mapread 0x00ab48 thru 0x00c0fc (0x15b5 bytes) 000957 1789777788.054609 mapwrite 0x000578 thru 0x001dcb (0x1854 bytes) 000958 1789777788.208879 trunc from 0x02d5f7 to 0x038af0 (0xb4fa bytes) 000960 1789777788.241674 trunc from 0x038af1 to 0x016979 (0x22177 bytes) 000961 1789777788.266699 write 0x021a94 thru 0x021cf9 (0x266 bytes) 000962 1789777788.268772 trunc from 0x021cfa to 0x02c2f4 (0xa5fb bytes) 000963 1789777788.290898 mapwrite 0x0198d8 thru 0x026379 (0xcaa2 bytes) 000964 1789777788.358975 mapread 0x01f96d thru 0x02aa64 (0xb0f8 bytes) 000965 1789777788.360084 mapwrite 0x0043b9 thru 0x007489 (0x30d1 bytes) 000966 1789777788.402701 mapread 0x016cef thru 0x01d761 (0x6a73 bytes) 000967 1789777788.404878 read 0x0029bf thru 0x00c224 (0x9866 bytes) 000968 1789777788.405856 punch from 0x01feb9 to 0x0283a3 (0x84eb bytes) 000969 1789777788.411395 read 0x01f30c thru 0x026f10 (0x7c05 bytes) 000971 1789777788.426657 read 0x007953 thru 0x0088a6 (0xf54 bytes) 000972 1789777788.427556 punch from 0x01be81 to 0x0259c0 (0x9b40 bytes) 000973 1789777788.435740 mapread 0x02a1d0 thru 0x02c2f4 (0x2125 bytes) 000974 1789777788.437393 write 0x027b0a thru 0x02fdfc (0x82f3 bytes) 000975 1789777788.439516 punch from 0x02f071 to 0x02fdfc (0xd8c bytes) 000976 1789777788.458525 write 0x014b79 thru 0x01e2fd (0x9785 bytes) 000977 1789777788.471000 punch from 0x01a670 to 0x0299f7 (0xf388 bytes) 000978 1789777788.503300 punch from 0x020335 to 0x025841 (0x550d bytes) 000979 1789777788.512063 read 0x00c60f thru 0x010a0c (0x43fe bytes) 000980 1789777788.513655 punch from 0x029b02 to 0x02e3bb (0x48ba bytes) 000981 1789777788.519649 punch from 0x01f879 to 0x02b4ae (0xbc36 bytes) 000982 1789777788.530690 read 0x029c0e thru 0x02d5b4 (0x39a7 bytes) 000983 1789777788.545851 punch from 0x02dd10 to 0x02dfae (0x29f bytes) 000984 1789777788.550948 punch from 0x006ed5 to 0x00df48 (0x7074 bytes) 000986 1789777788.559626 read 0x01a5dd thru 0x01ec1a (0x463e bytes) 000987 1789777788.560837 trunc from 0x02fdfd to 0x0364bc (0x66c0 bytes) 000989 1789777788.586480 read 0x0018bd thru 0x004d00 (0x3444 bytes) 000990 1789777788.587723 mapwrite 0x02269a thru 0x02964e (0x6fb5 bytes) 000991 1789777788.632752 write 0x021c50 thru 0x02abbc (0x8f6d bytes) 000992 1789777788.634041 read 0x016d63 thru 0x01972b (0x29c9 bytes) 000993 1789777788.634626 read 0x02093b thru 0x021bf6 (0x12bc bytes) 000994 1789777788.635965 punch from 0x01992f to 0x020a70 (0x7142 bytes) 000997 1789777788.652945 mapread 0x026ec6 thru 0x02a571 (0x36ac bytes) 000998 1789777788.657878 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x364bd): Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x364bd): Mirror 12: 0x8d469ab0 (stale) Mirror 16: 0x8d469ab0 (stale) Mirror 21: 0x8d469ab0 (stale) Mirror 22: 0x8d469ab0 (stale) Mirror 24: 0x8d469ab0 (stale) Mirror 26: 0x8d469ab0 (stale) Mirror 27: 0x8d469ab0 (stale) Mirror 28: 0x8d469ab0 (stale) CRC-32 checksum value for chunk [0, 0x364bd): Mirror 1: 0x9eda2a89 Mirror 29: 0x9eda2a89 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x364bd: skipped 000999 1789777789.829938 read 0x018a95 thru 0x02065b (0x7bc7 bytes) 001000 1789777789.844626 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x364bd): Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x364bd): Mirror 12: 0x8d469ab0 (stale) Mirror 16: 0x8d469ab0 (stale) Mirror 21: 0x8d469ab0 (stale) Mirror 22: 0x8d469ab0 (stale) Mirror 24: 0x8d469ab0 (stale) Mirror 26: 0x8d469ab0 (stale) Mirror 27: 0x8d469ab0 (stale) Mirror 28: 0x8d469ab0 (stale) CRC-32 checksum value for chunk [0, 0x364bd): Mirror 1: 0x9eda2a89 Mirror 29: 0x9eda2a89 Mirror 30: 0x9eda2a89 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x364bd: skipped All operations completed A-OK!