== sanity-flr test 70a: flr mode fsx test ================ 19:32:42 (1788564762) Seed set to 4764 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero length punch hole truncating to largest ever: 0x18e25 000003 1788564764.447504 trunc from 00000000 to 0x018e24 (0x18e25 bytes) truncating to largest ever: 0x2cc64 000004 1788564764.485288 trunc from 0x018e25 to 0x02cc63 (0x13e3f bytes) 000007 1788564764.515232 punch from 0x026a16 to 0x02cc63 (0x624e bytes) 000008 1788564764.532136 read 0x02887e thru 0x02cc63 (0x43e6 bytes) 000012 1788564764.550184 mapwrite 0x0218d8 thru 0x0310bc (0xf7e5 bytes) 000013 1788564764.813004 mapread 0x00bd22 thru 0x010aaf (0x4d8e bytes) 000015 1788564764.832399 trunc from 0x0310bd to 0x01cd1a (0x143a2 bytes) 000016 1788564764.852234 write 0x0192a0 thru 0x027e16 (0xeb77 bytes) 000017 1788564764.862902 mapread 0x009495 thru 0x011eb9 (0x8a25 bytes) 000018 1788564764.864753 punch from 0x00472a to 0x0114a5 (0xcd7c bytes) 000022 1788564764.885949 mapread 0x021be7 thru 0x027e16 (0x6230 bytes) 000023 1788564764.887148 mapwrite 0x0254ca thru 0x032053 (0xcb8a bytes) 000024 1788564764.984500 punch from 0x001614 to 0x00b472 (0x9e5f bytes) 000025 1788564764.989914 mapwrite 0x03a34b thru 0x03ffff (0x5cb5 bytes) 000026 1788564765.078692 mapwrite 0x03d362 thru 0x03ffff (0x2c9e bytes) 000027 1788564765.121733 write 0x00c5d5 thru 0x01a5fe (0xe02a bytes) 000030 1788564765.132825 punch from 0x01dcab to 0x027740 (0x9a96 bytes) 000035 1788564765.158621 mapwrite 0x007c0b thru 0x00b8f1 (0x3ce7 bytes) 000036 1788564765.253479 punch from 0x002a4b to 0x00bdb0 (0x9366 bytes) 000038 1788564765.261407 mapread 0x036d67 thru 0x03a6a4 (0x393e bytes) 000040 1788564765.268169 punch from 0x027940 to 0x02aa8f (0x3150 bytes) 000042 1788564765.281271 mapwrite 0x00c9df thru 0x00d7b0 (0xdd2 bytes) 000043 1788564765.423197 write 0x02850a thru 0x035b99 (0xd690 bytes) 000045 1788564765.431326 punch from 0x001b0d to 0x00b142 (0x9636 bytes) 000046 1788564765.461977 mapwrite 0x00aebd thru 0x0126af (0x77f3 bytes) truncating to largest ever: 0x2fbe7 000048 1788564765.607929 trunc from 0x040000 to 0x02fbe6 (0x10419 bytes) 000049 1788564765.626793 read 0x023c98 thru 0x02fbe6 (0xbf4f bytes) 000050 1788564765.639094 mapread 0x02404c thru 0x02bedc (0x7e91 bytes) 000052 1788564765.641792 write 0x01d453 thru 0x022671 (0x521f bytes) 000053 1788564765.643458 punch from 0x001ebc to 0x00e82f (0xc974 bytes) 000054 1788564765.657491 mapread 0x004cf3 thru 0x00921e (0x452c bytes) truncating to largest ever: 0x3c35b 000055 1788564765.690180 trunc from 0x02fbe7 to 0x03c35a (0xc774 bytes) 000057 1788564765.733266 trunc from 0x03c35b to 0x0147ec (0x27b6e bytes) 000058 1788564765.766062 write 0x022012 thru 0x02ad7b (0x8d6a bytes) 000059 1788564765.768321 trunc from 0x02ad7c to 0x017bee (0x1318d bytes) 000061 1788564765.802611 mapread 0x01006c thru 0x017bee (0x7b83 bytes) 000063 1788564765.827216 mapread 0x004311 thru 0x005a11 (0x1701 bytes) 000064 1788564765.830065 mapread 0x00f862 thru 0x0115c8 (0x1d67 bytes) 000065 1788564765.831075 punch from 0x01348d to 0x017bee (0x4762 bytes) 000066 1788564765.835212 mapread 0x00328f thru 0x00f3f3 (0xc165 bytes) 000069 1788564765.871401 mapread 0x002c07 thru 0x0033f9 (0x7f3 bytes) 000070 1788564765.877093 mapwrite 0x02ace6 thru 0x02f7a3 (0x4abe bytes) 000073 1788564766.067829 write 0x01aa6b thru 0x020043 (0x55d9 bytes) 000074 1788564766.087432 read 0x0190db thru 0x01c789 (0x36af bytes) 000075 1788564766.126828 MIRROR_EXTEND to 2 mirrors 000076 1788564767.235953 mapread 0x0167dd thru 0x01efe3 (0x8807 bytes) 000077 1788564767.295854 mapread 0x02af9e thru 0x02b006 (0x69 bytes) 000079 1788564767.364805 MIRROR_EXTEND to 3 mirrors 000080 1788564768.414103 read 0x023dd6 thru 0x026f64 (0x318f bytes) 000082 1788564768.420178 mapread 0x00657c thru 0x00f4ba (0x8f3f bytes) 000083 1788564768.445996 MIRROR_EXTEND to 4 mirrors 000084 1788564769.525275 mapread 0x00190e thru 0x00ae4b (0x953e bytes) 000086 1788564769.602234 read 0x02504e thru 0x02927b (0x422e bytes) 000087 1788564769.626910 read 0x00bbc4 thru 0x0116e1 (0x5b1e bytes) 000088 1788564769.657955 trunc from 0x02f7a4 to 0x027098 (0x870b bytes) 000089 1788564769.916134 trunc from 0x027099 to 0x03715e (0x100c6 bytes) 000090 1788564769.970929 mapread 0x01ab3e thru 0x025439 (0xa8fc bytes) 000092 1788564770.092327 write 0x005d52 thru 0x011441 (0xb6f0 bytes) 000093 1788564770.115544 trunc from 0x03715f to 0x021be7 (0x15577 bytes) 000095 1788564770.157459 punch from 0x00d3d4 to 0x018e40 (0xba6d bytes) 000096 1788564770.186602 write 0x002dd7 thru 0x011e4e (0xf078 bytes) 000097 1788564770.209640 write 0x014808 thru 0x0157b2 (0xfab bytes) 000099 1788564770.225090 read 0x01a062 thru 0x01ed4f (0x4cee bytes) 000100 1788564770.225639 mapread 0x012cde thru 0x01f64a (0xc96d bytes) 000101 1788564770.246884 mapread 0x01489b thru 0x01970e (0x4e74 bytes) 000103 1788564770.253934 write 0x0135aa thru 0x01c5e4 (0x903b bytes) 000105 1788564770.257684 trunc from 0x021be8 to 0x031150 (0xf569 bytes) 000107 1788564770.291428 mapwrite 0x035d87 thru 0x038b6c (0x2de6 bytes) 000108 1788564770.438866 punch from 0x00af99 to 0x00f888 (0x48f0 bytes) 000109 1788564770.449524 trunc from 0x038b6d to 0x02a583 (0xe5e9 bytes) 000111 1788564770.475988 punch from 0x025689 to 0x02a583 (0x4efb bytes) truncating to largest ever: 0x3e35c 000112 1788564770.483003 trunc from 0x02a584 to 0x03e35b (0x13dd8 bytes) 000115 1788564770.557480 MIRROR_RESYNC 4 mirrors 000116 1788564772.399563 write 0x003096 thru 0x006ea4 (0x3e0f bytes) 000117 1788564772.474527 mapread 0x00b3a6 thru 0x01ae1e (0xfa79 bytes) 000118 1788564772.535727 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e35c): Mirror 2: 0xf0490a2b (stale) Mirror 3: 0xf0490a2b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e35c): Mirror 2: 0xf0490a2b (stale) Mirror 3: 0xf0490a2b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e35c: skipped 000119 1788564773.188816 write 0x002aff thru 0x00f88b (0xcd8d bytes) 000120 1788564773.205718 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3e35c): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e35c): Mirror 2: 0xf0490a2b (stale) Mirror 3: 0xf0490a2b (stale) CRC-32 checksum value for chunk [0, 0x3e35c): Mirror 1: 0x9881005c Mirror 4: 0x9881005c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e35c: skipped 000121 1788564774.599228 MIRROR_RESYNC 4 mirrors 000122 1788564775.899427 write 0x036cd5 thru 0x03ffff (0x932b bytes) 000123 1788564776.007275 mapread 0x03d1bd thru 0x03ffff (0x2e43 bytes) 000124 1788564776.012574 read 0x032a0b thru 0x03ff83 (0xd579 bytes) 000125 1788564776.024522 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x3d4c3fd6 (stale) Mirror 4: 0x3d4c3fd6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x3d4c3fd6 (stale) Mirror 4: 0x3d4c3fd6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000126 1788564776.419903 read 0x01b37d thru 0x027714 (0xc398 bytes) 000127 1788564776.431536 read 0x00434b thru 0x0065de (0x2294 bytes) 000128 1788564776.443842 write 0x03ae80 thru 0x03ffff (0x5180 bytes) 000129 1788564776.445063 mapread 0x00111e thru 0x00fbbc (0xea9f bytes) 000132 1788564776.448446 punch from 0x01eccb to 0x02a29f (0xb5d5 bytes) 000133 1788564776.469805 MIRROR_RESYNC 3 mirrors 000135 1788564777.813891 mapread 0x01b95c thru 0x01d174 (0x1819 bytes) 000137 1788564777.845907 MIRROR_EXTEND to 4 mirrors 000138 1788564779.368052 read 0x00375d thru 0x0043f9 (0xc9d bytes) 000141 1788564779.476969 MIRROR_EXTEND to 5 mirrors 000143 1788564780.596229 write 0x02f077 thru 0x03a52f (0xb4b9 bytes) 000144 1788564780.732220 mapwrite 0x0141cf thru 0x01a7d9 (0x660b bytes) 000145 1788564780.799890 write 0x0005b4 thru 0x007fb5 (0x7a02 bytes) 000147 1788564780.810489 punch from 0x0342b7 to 0x03f527 (0xb271 bytes) 000148 1788564780.825778 read 0x00859a thru 0x00ac0a (0x2671 bytes) 000150 1788564780.832112 trunc from 0x040000 to 0x02933e (0x16cc1 bytes) 000151 1788564780.857859 mapread 0x0057ae thru 0x00fbb1 (0xa404 bytes) 000152 1788564780.865190 trunc from 0x02933f to 0x00745e (0x21ee0 bytes) 000154 1788564780.887098 trunc from 0x00745f to 0x001dd4 (0x568a bytes) 000156 1788564780.904221 mapwrite 0x017d5e thru 0x01a53e (0x27e1 bytes) 000159 1788564780.999631 mapread 0x004d52 thru 0x011f8f (0xd23e bytes) 000160 1788564781.009265 mapread 0x013d99 thru 0x01a53e (0x67a6 bytes) 000161 1788564781.011230 mapwrite 0x02a62d thru 0x02ca88 (0x245c bytes) 000162 1788564781.106103 mapread 0x014316 thru 0x0210ec (0xcdd7 bytes) 000164 1788564781.119629 mapread 0x01d9fd thru 0x027fb6 (0xa5ba bytes) 000165 1788564781.158311 punch from 0x008111 to 0x012be2 (0xaad2 bytes) 000166 1788564781.194581 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ca89): Mirror 4: 0x65923ec4 (stale) Mirror 5: 0x65923ec4 (stale) Mirror 6: 0x65923ec4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ca89): Mirror 4: 0x65923ec4 (stale) Mirror 5: 0x65923ec4 (stale) Mirror 6: 0x65923ec4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ca89: skipped 000167 1788564781.659405 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2ca89): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ca89): Mirror 4: 0x65923ec4 (stale) Mirror 5: 0x65923ec4 (stale) Mirror 6: 0x65923ec4 (stale) CRC-32 checksum value for chunk [0, 0x2ca89): Mirror 1: 0xe35d420f Mirror 7: 0xe35d420f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ca89: skipped 000169 1788564782.755029 write 0x02db3c thru 0x02ed8a (0x124f bytes) 000173 1788564782.870745 read 0x0038eb thru 0x0061e1 (0x28f7 bytes) 000175 1788564782.880671 mapread 0x000521 thru 0x00bc5e (0xb73e bytes) 000178 1788564782.904197 trunc from 0x02ed8b to 0x02257a (0xc810 bytes) 000179 1788564782.927120 mapread 0x018c4c thru 0x01de70 (0x5225 bytes) 000182 1788564782.939038 read 0x00cecd thru 0x016a8a (0x9bbe bytes) 000184 1788564782.940077 mapread 0x016ea5 thru 0x01fb79 (0x8cd5 bytes) 000185 1788564782.942125 write 0x01088b thru 0x016be2 (0x6358 bytes) 000190 1788564782.946608 punch from 0x0096db to 0x0110a7 (0x79cd bytes) 000191 1788564782.962190 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2257b): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2257b): Mirror 4: 0x17421480 (stale) Mirror 5: 0x17421480 (stale) Mirror 6: 0x17421480 (stale) Mirror 7: 0xf012a830 (stale) CRC-32 checksum value for chunk [0, 0x2257b): Mirror 1: 0x9482c79b Mirror 8: 0x9482c79b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2257b: skipped 000193 1788564784.653678 write 0x02166f thru 0x0219f6 (0x388 bytes) 000194 1788564784.777924 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2257b): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2257b): Mirror 4: 0x17421480 (stale) Mirror 5: 0x17421480 (stale) Mirror 6: 0x17421480 (stale) Mirror 7: 0xf012a830 (stale) Mirror 8: 0x9482c79b (stale) CRC-32 checksum value for chunk [0, 0x2257b): Mirror 1: 0x7dbb3b06 Mirror 9: 0x7dbb3b06 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2257b: skipped 000195 1788564786.334540 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2257b): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2257b): Mirror 4: 0x17421480 (stale) Mirror 5: 0x17421480 (stale) Mirror 6: 0x17421480 (stale) Mirror 7: 0xf012a830 (stale) Mirror 8: 0x9482c79b (stale) CRC-32 checksum value for chunk [0, 0x2257b): Mirror 1: 0x7dbb3b06 Mirror 9: 0x7dbb3b06 Mirror 10: 0x7dbb3b06 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2257b: skipped 000196 1788564787.524148 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2257b): Mirror 4: 0x17421480 (stale) Mirror 5: 0x17421480 (stale) Mirror 6: 0x17421480 (stale) Mirror 7: 0xf012a830 (stale) Mirror 8: 0x9482c79b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2257b): Mirror 4: 0x17421480 (stale) Mirror 5: 0x17421480 (stale) Mirror 6: 0x17421480 (stale) Mirror 7: 0xf012a830 (stale) Mirror 8: 0x9482c79b (stale) CRC-32 checksum value for chunk [0, 0x2257b): Mirror 1: 0x7dbb3b06 Mirror 9: 0x7dbb3b06 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2257b: skipped 000199 1788564788.215265 punch from 0x01414d to 0x016374 (0x2228 bytes) 000203 1788564788.320254 trunc from 0x02257b to 0x02c35b (0x9de1 bytes) 000204 1788564788.337034 punch from 0x013a55 to 0x014280 (0x82c bytes) 000206 1788564788.346788 mapwrite 0x01c190 thru 0x020ea0 (0x4d11 bytes) 000207 1788564788.418545 punch from 0x003189 to 0x010804 (0xd67c bytes) 000209 1788564788.426260 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2c35c): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c35c): Mirror 4: 0x5379ea8c (stale) Mirror 5: 0x5379ea8c (stale) Mirror 6: 0x5379ea8c (stale) Mirror 7: 0x7aea55a6 (stale) Mirror 8: 0x29bd6169 (stale) Mirror 9: 0xc5f4e782 (stale) CRC-32 checksum value for chunk [0, 0x2c35c): Mirror 1: 0x29b6c04a Mirror 10: 0x29b6c04a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c35c: skipped 000212 1788564789.940831 MIRROR_RESYNC 8 mirrors 000215 1788564792.942534 punch from 0x00d11d to 0x00dc52 (0xb36 bytes) 000217 1788564793.006643 read 0x018728 thru 0x019ff5 (0x18ce bytes) 000218 1788564793.012586 punch from 0x015f11 to 0x01cd88 (0x6e78 bytes) 000219 1788564793.017075 mapwrite 0x0376f1 thru 0x03ffff (0x890f bytes) 000221 1788564793.119014 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x3fad841d (stale) Mirror 5: 0x3fad841d (stale) Mirror 6: 0x3fad841d (stale) Mirror 7: 0x3fad841d (stale) Mirror 8: 0x3fad841d (stale) Mirror 9: 0x3fad841d (stale) Mirror 10: 0x3fad841d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x9258ef2b Mirror 11: 0x9258ef2b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000222 1788564794.378032 trunc from 0x040000 to 0x032aba (0xd545 bytes) 000223 1788564794.560815 mapwrite 0x01f0b9 thru 0x027e6a (0x8db2 bytes) 000224 1788564794.710273 trunc from 0x032abb to 0x03319b (0x6e1 bytes) 000225 1788564794.753380 write 0x033d54 thru 0x03ce77 (0x9124 bytes) 000226 1788564794.776517 punch from 0x015cba to 0x0168ef (0xc36 bytes) 000228 1788564794.801663 mapread 0x007639 thru 0x016995 (0xf35d bytes) 000230 1788564794.829851 MIRROR_RESYNC 9 mirrors 000232 1788564799.460996 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) 000233 1788564799.882563 read 0x02b060 thru 0x0352ee (0xa28f bytes) 000234 1788564799.892568 trunc from 0x03ce78 to 0x01b831 (0x21646 bytes) 000235 1788564800.025872 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x1b832): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b832): Mirror 5: 0x15269375 (stale) Mirror 6: 0x15269375 (stale) Mirror 7: 0x15269375 (stale) Mirror 8: 0x15269375 (stale) Mirror 9: 0x15269375 (stale) Mirror 10: 0x15269375 (stale) Mirror 11: 0x15269375 (stale) CRC-32 checksum value for chunk [0, 0x1b832): Mirror 1: 0x15269375 Mirror 12: 0x15269375 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b832: skipped 000236 1788564801.539717 punch from 0x006e66 to 0x00f844 (0x89df bytes) 000238 1788564801.668323 trunc from 0x01b832 to 0x00d487 (0xe3aa bytes) 000239 1788564801.694705 trunc from 0x00d488 to 0x0301f4 (0x22d6d bytes) 000240 1788564801.719832 read 0x0073db thru 0x015e5d (0xea83 bytes) 000242 1788564801.730867 mapwrite 0x02fc86 thru 0x03e692 (0xea0d bytes) 000243 1788564801.933267 punch from 0x019397 to 0x023c72 (0xa8dc bytes) 000244 1788564801.947612 mapwrite 0x0027d3 thru 0x008eba (0x66e8 bytes) 000247 1788564802.128769 write 0x02b19c thru 0x0398d1 (0xe736 bytes) 000249 1788564802.134548 read 0x005c82 thru 0x010682 (0xaa01 bytes) 000251 1788564802.135857 punch from 0x032397 to 0x03b554 (0x91be bytes) 000252 1788564802.172333 punch from 0x018acf to 0x0273e1 (0xe913 bytes) 000253 1788564802.181175 write 0x0230c7 thru 0x029b7a (0x6ab4 bytes) 000254 1788564802.209148 trunc from 0x03e693 to 0x0303f1 (0xe2a1 bytes) 000255 1788564802.239199 punch from 0x029f85 to 0x0303f1 (0x646d bytes) 000256 1788564802.261481 read 0x01678e thru 0x01817c (0x19ef bytes) 000258 1788564802.262566 write 0x03f915 thru 0x03ffff (0x6eb bytes) 000260 1788564802.263895 mapread 0x031afd thru 0x03e1d8 (0xc6dc bytes) 000261 1788564802.300874 read 0x00d86c thru 0x01d79e (0xff33 bytes) 000262 1788564802.301529 mapread 0x016c82 thru 0x01f57c (0x88fb bytes) 000263 1788564802.302366 read 0x03b045 thru 0x03ffff (0x4fbb bytes) 000265 1788564802.311475 mapwrite 0x00fe77 thru 0x01c689 (0xc813 bytes) 000267 1788564802.433786 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x4ebd7cab (stale) Mirror 6: 0x4ebd7cab (stale) Mirror 7: 0x4ebd7cab (stale) Mirror 8: 0x4ebd7cab (stale) Mirror 9: 0x4ebd7cab (stale) Mirror 10: 0x4ebd7cab (stale) Mirror 11: 0x4ebd7cab (stale) Mirror 12: 0xe8566e18 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5a3ac584 Mirror 13: 0x5a3ac584 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000268 1788564804.898640 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x4ebd7cab (stale) Mirror 6: 0x4ebd7cab (stale) Mirror 7: 0x4ebd7cab (stale) Mirror 8: 0x4ebd7cab (stale) Mirror 9: 0x4ebd7cab (stale) Mirror 10: 0x4ebd7cab (stale) Mirror 11: 0x4ebd7cab (stale) Mirror 12: 0xe8566e18 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x4ebd7cab (stale) Mirror 6: 0x4ebd7cab (stale) Mirror 7: 0x4ebd7cab (stale) Mirror 8: 0x4ebd7cab (stale) Mirror 9: 0x4ebd7cab (stale) Mirror 10: 0x4ebd7cab (stale) Mirror 11: 0x4ebd7cab (stale) Mirror 12: 0xe8566e18 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000271 1788564806.136873 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x4ebd7cab (stale) Mirror 6: 0x4ebd7cab (stale) Mirror 7: 0x4ebd7cab (stale) Mirror 8: 0x4ebd7cab (stale) Mirror 9: 0x4ebd7cab (stale) Mirror 10: 0x4ebd7cab (stale) Mirror 11: 0x4ebd7cab (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x4ebd7cab (stale) Mirror 6: 0x4ebd7cab (stale) Mirror 7: 0x4ebd7cab (stale) Mirror 8: 0x4ebd7cab (stale) Mirror 9: 0x4ebd7cab (stale) Mirror 10: 0x4ebd7cab (stale) Mirror 11: 0x4ebd7cab (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000273 1788564807.025496 punch from 0x032164 to 0x036eb3 (0x4d50 bytes) 000274 1788564807.049578 punch from 0x0177f8 to 0x019401 (0x1c0a bytes) 000275 1788564807.068913 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x4ebd7cab (stale) Mirror 6: 0x4ebd7cab (stale) Mirror 7: 0x4ebd7cab (stale) Mirror 8: 0x4ebd7cab (stale) Mirror 9: 0x4ebd7cab (stale) Mirror 10: 0x4ebd7cab (stale) Mirror 11: 0x4ebd7cab (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x90b2dd86 Mirror 12: 0x90b2dd86 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000276 1788564810.080147 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x4ebd7cab (stale) Mirror 6: 0x4ebd7cab (stale) Mirror 7: 0x4ebd7cab (stale) Mirror 8: 0x4ebd7cab (stale) Mirror 9: 0x4ebd7cab (stale) Mirror 10: 0x4ebd7cab (stale) Mirror 11: 0x4ebd7cab (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x90b2dd86 Mirror 12: 0x90b2dd86 Mirror 13: 0x90b2dd86 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000277 1788564811.757981 trunc from 0x040000 to 0x035bbb (0xa444 bytes) 000280 1788564811.967405 mapread 0x01b33d thru 0x02a782 (0xf446 bytes) 000281 1788564812.033578 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35bbc): Mirror 5: 0x25409f27 (stale) Mirror 6: 0x25409f27 (stale) Mirror 7: 0x25409f27 (stale) Mirror 8: 0x25409f27 (stale) Mirror 9: 0x25409f27 (stale) Mirror 11: 0x25409f27 (stale) Mirror 12: 0x45b8cdd (stale) Mirror 13: 0x45b8cdd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35bbc): Mirror 5: 0x25409f27 (stale) Mirror 6: 0x25409f27 (stale) Mirror 7: 0x25409f27 (stale) Mirror 8: 0x25409f27 (stale) Mirror 9: 0x25409f27 (stale) Mirror 11: 0x25409f27 (stale) Mirror 12: 0x45b8cdd (stale) Mirror 13: 0x45b8cdd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35bbc: skipped 000282 1788564812.908095 trunc from 0x035bbc to 0x01b20b (0x1a9b0 bytes) 000283 1788564812.983695 write 0x039da5 thru 0x03c7aa (0x2a06 bytes) 000284 1788564812.984907 punch from 0x014d44 to 0x01ffd4 (0xb291 bytes) 000285 1788564813.005285 write 0x01e8af thru 0x021582 (0x2cd4 bytes) 000287 1788564813.036543 mapwrite 0x02fc7f thru 0x03d77c (0xdafe bytes) 000288 1788564813.390100 mapread 0x033b2a thru 0x03bc1d (0x80f4 bytes) 000289 1788564813.391217 write 0x029d73 thru 0x02cb79 (0x2e07 bytes) truncating to largest ever: 0x3e6cc 000292 1788564813.405784 trunc from 0x03d77d to 0x03e6cb (0xf4f bytes) 000293 1788564813.447769 read 0x00f8c3 thru 0x01b330 (0xba6e bytes) 000294 1788564813.473587 MIRROR_RESYNC 9 mirrors 000295 1788564823.458235 mapwrite 0x01a8ee thru 0x02168e (0x6da1 bytes) 000300 1788564823.774644 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e6cc): Mirror 5: 0x1b6e5e55 (stale) Mirror 6: 0x1b6e5e55 (stale) Mirror 7: 0x1b6e5e55 (stale) Mirror 8: 0x1b6e5e55 (stale) Mirror 11: 0x1b6e5e55 (stale) Mirror 12: 0x1b6e5e55 (stale) Mirror 13: 0x1b6e5e55 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e6cc): Mirror 5: 0x1b6e5e55 (stale) Mirror 6: 0x1b6e5e55 (stale) Mirror 7: 0x1b6e5e55 (stale) Mirror 8: 0x1b6e5e55 (stale) Mirror 11: 0x1b6e5e55 (stale) Mirror 12: 0x1b6e5e55 (stale) Mirror 13: 0x1b6e5e55 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e6cc: skipped 000301 1788564824.410091 write 0x0356dc thru 0x038bde (0x3503 bytes) 000302 1788564824.426240 mapwrite 0x01f123 thru 0x020414 (0x12f2 bytes) 000303 1788564824.514196 punch from 0x00ac5f to 0x0113ac (0x674e bytes) 000304 1788564824.523197 punch from 0x00b168 to 0x010f0e (0x5da7 bytes) 000305 1788564824.531136 read 0x00df16 thru 0x017fff (0xa0ea bytes) 000307 1788564824.561442 read 0x0378bf thru 0x03b723 (0x3e65 bytes) 000308 1788564824.582866 write 0x02ab53 thru 0x02b3f7 (0x8a5 bytes) 000309 1788564824.586460 punch from 0x01341e to 0x01bf32 (0x8b15 bytes) 000310 1788564824.605106 read 0x018f51 thru 0x019077 (0x127 bytes) 000312 1788564824.615679 write 0x01a791 thru 0x020084 (0x58f4 bytes) 000314 1788564824.617523 mapread 0x03265d thru 0x03cf9e (0xa942 bytes) 000315 1788564824.618889 trunc from 0x03e6cc to 0x00c560 (0x3216b bytes) 000316 1788564824.636326 write 0x00de8d thru 0x01b31a (0xd48e bytes) 000317 1788564824.638013 trunc from 0x01b31b to 0x001649 (0x19cd1 bytes) 000319 1788564824.666766 write 0x00e9fd thru 0x018eea (0xa4ee bytes) 000320 1788564824.668812 mapread 0x0061ce thru 0x00d9fc (0x782f bytes) 000321 1788564824.717692 mapwrite 0x03269a thru 0x038109 (0x5a70 bytes) 000322 1788564824.890253 punch from 0x025447 to 0x026bb8 (0x1772 bytes) 000324 1788564824.905689 read 0x025276 thru 0x02c542 (0x72cd bytes) 000325 1788564824.925749 read 0x02a17c thru 0x02a1ea (0x6f bytes) 000326 1788564824.936937 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3810a): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3810a): Mirror 5: 0x3f1b9645 (stale) Mirror 6: 0x3f1b9645 (stale) Mirror 7: 0x3f1b9645 (stale) Mirror 8: 0x3f1b9645 (stale) Mirror 11: 0x3f1b9645 (stale) Mirror 12: 0x3f1b9645 (stale) Mirror 13: 0x3f1b9645 (stale) CRC-32 checksum value for chunk [0, 0x3810a): Mirror 1: 0x667132e5 Mirror 14: 0x667132e5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3810a: skipped 000327 1788564826.563545 read 0x01cf9d thru 0x02aef9 (0xdf5d bytes) 000328 1788564826.587968 trunc from 0x03810a to 0x023689 (0x14a80 bytes) 000329 1788564826.697790 read 0x00cd56 thru 0x013e5f (0x710a bytes) 000330 1788564826.717981 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2368a): Mirror 5: 0x281ff243 (stale) Mirror 6: 0x281ff243 (stale) Mirror 7: 0x281ff243 (stale) Mirror 8: 0x281ff243 (stale) Mirror 11: 0x281ff243 (stale) Mirror 12: 0x281ff243 (stale) Mirror 14: 0xdf1bb75c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2368a): Mirror 5: 0x281ff243 (stale) Mirror 6: 0x281ff243 (stale) Mirror 7: 0x281ff243 (stale) Mirror 8: 0x281ff243 (stale) Mirror 11: 0x281ff243 (stale) Mirror 12: 0x281ff243 (stale) Mirror 14: 0xdf1bb75c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2368a: skipped 000331 1788564827.244955 punch from 0x0019ef to 0x00a44f (0x8a61 bytes) 000332 1788564827.253462 write 0x004a56 thru 0x00b108 (0x66b3 bytes) 000333 1788564827.269141 mapwrite 0x034df1 thru 0x035123 (0x333 bytes) 000334 1788564827.401602 mapread 0x022f08 thru 0x02d3a1 (0xa49a bytes) 000335 1788564827.436454 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x35124): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35124): Mirror 5: 0x60c86d64 (stale) Mirror 6: 0x60c86d64 (stale) Mirror 7: 0x60c86d64 (stale) Mirror 8: 0x60c86d64 (stale) Mirror 11: 0x60c86d64 (stale) Mirror 12: 0x60c86d64 (stale) Mirror 14: 0xb761aa3c (stale) CRC-32 checksum value for chunk [0, 0x35124): Mirror 1: 0x41c2cd62 Mirror 15: 0x41c2cd62 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35124: skipped 000336 1788564828.772693 punch from 0x03479c to 0x035123 (0x988 bytes) 000337 1788564828.891148 mapread 0x016a39 thru 0x02423f (0xd807 bytes) 000338 1788564828.954012 mapwrite 0x007973 thru 0x00d469 (0x5af7 bytes) 000339 1788564829.071331 mapread 0x01c1fa thru 0x01d16e (0xf75 bytes) 000340 1788564829.073242 punch from 0x024537 to 0x031ea3 (0xd96d bytes) 000341 1788564829.084224 mapread 0x003409 thru 0x009dd4 (0x69cc bytes) 000343 1788564829.091219 write 0x022096 thru 0x025d27 (0x3c92 bytes) 000345 1788564829.121951 read 0x02b390 thru 0x02ff1a (0x4b8b bytes) 000346 1788564829.138621 mapwrite 0x008d3f thru 0x00df3b (0x51fd bytes) 000347 1788564829.232801 mapwrite 0x034b98 thru 0x03bac6 (0x6f2f bytes) 000350 1788564829.392849 read 0x03a148 thru 0x03bac6 (0x197f bytes) 000351 1788564829.394994 write 0x031622 thru 0x0394f3 (0x7ed2 bytes) 000352 1788564829.400648 read 0x00ff88 thru 0x01fd46 (0xfdbf bytes) 000353 1788564829.402256 punch from 0x0027ff to 0x00c9bb (0xa1bd bytes) 000354 1788564829.418780 punch from 0x024daa to 0x02ffa8 (0xb1ff bytes) 000355 1788564829.430277 MIRROR_RESYNC 9 mirrors 000356 1788564833.065880 mapread 0x027215 thru 0x031c4a (0xaa36 bytes) 000357 1788564833.100501 mapwrite 0x0076a5 thru 0x016850 (0xf1ac bytes) 000358 1788564833.364780 write 0x020b13 thru 0x02e56f (0xda5d bytes) 000359 1788564833.377498 punch from 0x02e8c7 to 0x03bac6 (0xd200 bytes) 000360 1788564833.392402 trunc from 0x03bac7 to 0x027c84 (0x13e42 bytes) 000361 1788564833.418654 write 0x012668 thru 0x018e99 (0x6832 bytes) 000362 1788564833.421261 write 0x01c5a8 thru 0x024484 (0x7edd bytes) 000363 1788564833.432749 write 0x0118d1 thru 0x0122f4 (0xa24 bytes) 000364 1788564833.435769 write 0x0224f2 thru 0x029ad8 (0x75e7 bytes) 000365 1788564833.445614 MIRROR_RESYNC 9 mirrors 000367 1788564837.883667 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) 000368 1788564838.277993 write 0x027ff0 thru 0x031473 (0x9484 bytes) 000369 1788564838.383040 punch from 0x012be8 to 0x018188 (0x55a1 bytes) 000371 1788564838.409234 mapwrite 0x030c96 thru 0x03232c (0x1697 bytes) 000372 1788564838.505039 write 0x00eace thru 0x01d0b5 (0xe5e8 bytes) 000373 1788564838.514641 read 0x0287ad thru 0x0309df (0x8233 bytes) 000374 1788564838.515370 write 0x0013d5 thru 0x00997e (0x85aa bytes) 000375 1788564838.524965 mapwrite 0x0340af thru 0x03c367 (0x82b9 bytes) 000376 1788564838.658549 write 0x02fcb0 thru 0x03943a (0x978b bytes) 000378 1788564838.661201 mapwrite 0x018474 thru 0x0270e9 (0xec76 bytes) 000379 1788564838.760473 read 0x01a648 thru 0x02972e (0xf0e7 bytes) 000380 1788564838.761083 read 0x00dbc4 thru 0x01c5f7 (0xea34 bytes) 000382 1788564838.770517 trunc from 0x03c368 to 0x02fa73 (0xc8f4 bytes) 000384 1788564838.796621 punch from 0x00b594 to 0x00d9ca (0x2437 bytes) 000385 1788564838.801740 read 0x0254ec thru 0x027a0b (0x2520 bytes) 000388 1788564838.803914 mapwrite 0x02bd86 thru 0x03541a (0x9695 bytes) 000390 1788564838.897542 punch from 0x01f5f0 to 0x029b4e (0xa55f bytes) 000391 1788564838.904426 trunc from 0x03541b to 0x02c4e1 (0x8f39 bytes) 000392 1788564838.933994 mapwrite 0x03d012 thru 0x03ffff (0x2fee bytes) 000394 1788564839.059235 mapwrite 0x030656 thru 0x03f836 (0xf1e1 bytes) 000396 1788564839.232248 mapread 0x03dfdf thru 0x03ffff (0x2021 bytes) 000397 1788564839.237262 read 0x02ba81 thru 0x02e885 (0x2e05 bytes) 000399 1788564839.263248 write 0x009eb9 thru 0x010e6d (0x6fb5 bytes) 000400 1788564839.266905 write 0x03f72f thru 0x03ffff (0x8d1 bytes) 000401 1788564839.267779 read 0x0002f3 thru 0x00999b (0x96a9 bytes) 000402 1788564839.268312 mapwrite 0x0351c7 thru 0x03988c (0x46c6 bytes) 000405 1788564839.414945 punch from 0x02bbb9 to 0x03a8eb (0xed33 bytes) 000406 1788564839.431576 mapwrite 0x007728 thru 0x014aaf (0xd388 bytes) 000407 1788564839.613788 mapread 0x01ea38 thru 0x02117a (0x2743 bytes) 000408 1788564839.617529 write 0x0159b4 thru 0x01a48d (0x4ada bytes) 000409 1788564839.630905 write 0x0371e8 thru 0x03ffff (0x8e18 bytes) 000411 1788564839.665408 trunc from 0x040000 to 0x00a1f2 (0x35e0d bytes) 000413 1788564839.700832 punch from 0x000209 to 0x006866 (0x665e bytes) 000414 1788564839.719628 mapwrite 0x007250 thru 0x016a22 (0xf7d3 bytes) 000415 1788564839.934875 punch from 0x003bfe to 0x01047a (0xc87d bytes) 000416 1788564839.965416 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x16a23): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16a23): Mirror 5: 0x3ae20934 (stale) Mirror 6: 0x3ae20934 (stale) Mirror 7: 0x3ae20934 (stale) Mirror 8: 0x3ae20934 (stale) Mirror 12: 0x3ae20934 (stale) Mirror 14: 0x3ae20934 (stale) Mirror 15: 0x3ae20934 (stale) CRC-32 checksum value for chunk [0, 0x16a23): Mirror 1: 0xc0c3f075 Mirror 16: 0xc0c3f075 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16a23: skipped 000417 1788564841.321764 punch from 0x013d24 to 0x016a22 (0x2cff bytes) 000418 1788564841.416875 punch from 0x009ff7 to 0x00e5de (0x45e8 bytes) 000419 1788564841.428640 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16a23): Mirror 5: 0x3ae20934 (stale) Mirror 6: 0x3ae20934 (stale) Mirror 7: 0x3ae20934 (stale) Mirror 12: 0x3ae20934 (stale) Mirror 14: 0x3ae20934 (stale) Mirror 15: 0x3ae20934 (stale) Mirror 16: 0xc0c3f075 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16a23): Mirror 5: 0x3ae20934 (stale) Mirror 6: 0x3ae20934 (stale) Mirror 7: 0x3ae20934 (stale) Mirror 12: 0x3ae20934 (stale) Mirror 14: 0x3ae20934 (stale) Mirror 15: 0x3ae20934 (stale) Mirror 16: 0xc0c3f075 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16a23: skipped 000420 1788564841.882777 punch from 0x001ae4 to 0x0064db (0x49f8 bytes) 000421 1788564841.886928 write 0x03d802 thru 0x03ffff (0x27fe bytes) 000422 1788564841.893707 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x65cca7b3 (stale) Mirror 7: 0x65cca7b3 (stale) Mirror 12: 0x65cca7b3 (stale) Mirror 14: 0x65cca7b3 (stale) Mirror 15: 0x65cca7b3 (stale) Mirror 16: 0xe9740156 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x65cca7b3 (stale) Mirror 7: 0x65cca7b3 (stale) Mirror 12: 0x65cca7b3 (stale) Mirror 14: 0x65cca7b3 (stale) Mirror 15: 0x65cca7b3 (stale) Mirror 16: 0xe9740156 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000423 1788564842.480681 trunc from 0x040000 to 0x02b66f (0x14990 bytes) 000424 1788564842.507313 write 0x00ceda thru 0x0180a8 (0xb1cf bytes) 000425 1788564842.517502 read 0x00e9c2 thru 0x0157f8 (0x6e37 bytes) 000427 1788564842.518365 mapread 0x0202e5 thru 0x02b66f (0xb38b bytes) 000428 1788564842.532085 mapwrite 0x036aaf thru 0x03d201 (0x6753 bytes) 000429 1788564842.645882 read 0x03a447 thru 0x03d201 (0x2dbb bytes) 000430 1788564842.646828 read 0x0196dd thru 0x026126 (0xca4a bytes) 000431 1788564842.661258 mapwrite 0x006dfe thru 0x00c7df (0x59e2 bytes) 000433 1788564842.701332 mapread 0x02851c thru 0x02d6c5 (0x51aa bytes) 000434 1788564842.702067 trunc from 0x03d202 to 0x02316f (0x1a092 bytes) 000435 1788564842.725660 trunc from 0x023170 to 0x03a96b (0x177fc bytes) 000436 1788564842.749064 trunc from 0x03a96c to 0x007905 (0x33066 bytes) 000441 1788564842.771589 mapwrite 0x013ac8 thru 0x020d3d (0xd276 bytes) 000442 1788564843.089402 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x20d3e): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20d3e): Mirror 6: 0x7934747d (stale) Mirror 7: 0x7934747d (stale) Mirror 12: 0x7934747d (stale) Mirror 14: 0x7934747d (stale) Mirror 15: 0x7934747d (stale) Mirror 16: 0x891637a6 (stale) CRC-32 checksum value for chunk [0, 0x20d3e): Mirror 1: 0xe9161661 Mirror 17: 0xe9161661 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20d3e: skipped 000443 1788564844.620718 mapread 0x01bc18 thru 0x020d3d (0x5126 bytes) 000444 1788564844.667086 mapread 0x011924 thru 0x013b1d (0x21fa bytes) 000445 1788564844.696713 trunc from 0x020d3e to 0x03a8a4 (0x19b67 bytes) 000447 1788564844.936335 read 0x035932 thru 0x039c1a (0x42e9 bytes) 000448 1788564844.950506 write 0x010771 thru 0x0108c0 (0x150 bytes) 000449 1788564844.963501 trunc from 0x03a8a5 to 0x01e9c5 (0x1bedf bytes) 000451 1788564845.003258 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x1e9c6): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e9c6): Mirror 6: 0xb4e08deb (stale) Mirror 7: 0xb4e08deb (stale) Mirror 12: 0xb4e08deb (stale) Mirror 14: 0xb4e08deb (stale) Mirror 15: 0xb4e08deb (stale) Mirror 16: 0x20020758 (stale) Mirror 17: 0x60bcbc23 (stale) CRC-32 checksum value for chunk [0, 0x1e9c6): Mirror 1: 0xd65501eb Mirror 18: 0xd65501eb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e9c6: skipped 000452 1788564847.072480 punch from 0x0117c4 to 0x014a31 (0x326e bytes) 000453 1788564847.385610 mapwrite 0x0119ca thru 0x013554 (0x1b8b bytes) 000454 1788564847.536742 trunc from 0x01e9c6 to 0x02d09f (0xe6da bytes) 000455 1788564847.561285 read 0x01288a thru 0x01298b (0x102 bytes) 000456 1788564847.563481 mapwrite 0x03cf3e thru 0x03ffff (0x30c2 bytes) 000458 1788564847.697981 read 0x02822b thru 0x0314d0 (0x92a6 bytes) 000459 1788564847.717325 punch from 0x0368ed to 0x03753b (0xc4f bytes) 000460 1788564847.725863 punch from 0x00a0b9 to 0x012cd1 (0x8c19 bytes) 000461 1788564847.741103 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x65cca7b3 (stale) Mirror 12: 0x65cca7b3 (stale) Mirror 14: 0x65cca7b3 (stale) Mirror 15: 0x65cca7b3 (stale) Mirror 16: 0xe9740156 (stale) Mirror 17: 0xa51fb59a (stale) Mirror 18: 0xb19a4e25 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x65cca7b3 (stale) Mirror 12: 0x65cca7b3 (stale) Mirror 14: 0x65cca7b3 (stale) Mirror 15: 0x65cca7b3 (stale) Mirror 16: 0xe9740156 (stale) Mirror 17: 0xa51fb59a (stale) Mirror 18: 0xb19a4e25 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000463 1788564848.458033 mapwrite 0x034a6d thru 0x038f29 (0x44bd bytes) 000464 1788564848.585332 read 0x034161 thru 0x03ffff (0xbe9f bytes) 000465 1788564848.610440 MIRROR_RESYNC 8 mirrors 000468 1788564854.291472 mapread 0x01a6b9 thru 0x02337b (0x8cc3 bytes) 000472 1788564854.315785 MIRROR_SPLIT mirror 6 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) 000473 1788564854.640729 trunc from 0x040000 to 0x032f3a (0xd0c5 bytes) 000474 1788564854.760473 mapwrite 0x032c02 thru 0x034ace (0x1ecd bytes) 000475 1788564854.960038 write 0x03be33 thru 0x03ffff (0x41cd bytes) 000476 1788564854.961925 write 0x003877 thru 0x009cfb (0x6485 bytes) 000478 1788564854.986613 trunc from 0x040000 to 0x0219ba (0x1e645 bytes) 000479 1788564855.011781 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x219bb): Mirror 7: 0x95af93b (stale) Mirror 12: 0x95af93b (stale) Mirror 14: 0x95af93b (stale) Mirror 15: 0x95af93b (stale) Mirror 16: 0x95af93b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x219bb): Mirror 7: 0x95af93b (stale) Mirror 12: 0x95af93b (stale) Mirror 14: 0x95af93b (stale) Mirror 15: 0x95af93b (stale) Mirror 16: 0x95af93b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x219bb: skipped 000480 1788564855.589455 trunc from 0x0219bb to 0x02ba90 (0xa0d6 bytes) 000482 1788564855.605726 mapwrite 0x009170 thru 0x015eb5 (0xcd46 bytes) 000483 1788564855.687133 mapread 0x00fbd7 thru 0x014ead (0x52d7 bytes) 000484 1788564855.688073 mapread 0x01346d thru 0x017f40 (0x4ad4 bytes) 000485 1788564855.688866 trunc from 0x02ba91 to 0x013a15 (0x1807b bytes) 000486 1788564855.709420 mapread 0x00cdb8 thru 0x01021e (0x3467 bytes) 000487 1788564855.710262 mapread 0x0106cb thru 0x0136b0 (0x2fe6 bytes) 000488 1788564855.711033 punch from 0x002118 to 0x00968f (0x7578 bytes) 000490 1788564855.719890 write 0x03d418 thru 0x03e2e8 (0xed1 bytes) 000491 1788564855.726114 MIRROR_RESYNC 6 mirrors 000492 1788564858.084270 read 0x02d088 thru 0x0337bb (0x6734 bytes) 000493 1788564858.091533 trunc from 0x03e2e9 to 0x01fa27 (0x1e8c1 bytes) 000497 1788564858.149843 mapread 0x004403 thru 0x00a772 (0x6370 bytes) 000498 1788564858.164305 mapwrite 0x01d212 thru 0x01d62d (0x41c bytes) 000499 1788564858.202874 read 0x007dce thru 0x01313c (0xb36f bytes) 000500 1788564858.208692 trunc from 0x01fa28 to 0x00c57a (0x134ad bytes) 000502 1788564858.223329 trunc from 0x00c57b to 0x02641a (0x19ea0 bytes) 000505 1788564858.241087 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2641b): Mirror 7: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2641b): Mirror 7: 0x935f6899 (stale) Mirror 12: 0x935f6899 (stale) Mirror 14: 0x935f6899 (stale) Mirror 15: 0x935f6899 (stale) Mirror 16: 0x935f6899 (stale) CRC-32 checksum value for chunk [0, 0x2641b): Mirror 1: 0x50103a30 Mirror 17: 0x50103a30 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2641b: skipped 000507 1788564859.086718 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2641b): Mirror 7: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2641b): Mirror 7: 0x935f6899 (stale) Mirror 12: 0x935f6899 (stale) Mirror 14: 0x935f6899 (stale) Mirror 15: 0x935f6899 (stale) Mirror 16: 0x935f6899 (stale) CRC-32 checksum value for chunk [0, 0x2641b): Mirror 1: 0x50103a30 Mirror 17: 0x50103a30 Mirror 18: 0x50103a30 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2641b: skipped 000508 1788564859.881668 trunc from 0x02641b to 0x021750 (0x4cca bytes) 000509 1788564859.994157 mapwrite 0x0357bb thru 0x03c5c6 (0x6e0c bytes) 000511 1788564860.071035 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c5c7): Mirror 7: 0x71e7b4a0 (stale) Mirror 12: 0x71e7b4a0 (stale) Mirror 14: 0x71e7b4a0 (stale) Mirror 15: 0x71e7b4a0 (stale) Mirror 16: 0x71e7b4a0 (stale) Mirror 17: 0xfb79c9a6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c5c7): Mirror 7: 0x71e7b4a0 (stale) Mirror 12: 0x71e7b4a0 (stale) Mirror 14: 0x71e7b4a0 (stale) Mirror 15: 0x71e7b4a0 (stale) Mirror 16: 0x71e7b4a0 (stale) Mirror 17: 0xfb79c9a6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c5c7: skipped 000514 1788564860.429295 mapwrite 0x02d50d thru 0x039b5f (0xc653 bytes) 000515 1788564860.538023 read 0x028f44 thru 0x02ffe8 (0x70a5 bytes) 000516 1788564860.538730 write 0x00adcc thru 0x014bb1 (0x9de6 bytes) 000517 1788564860.551539 punch from 0x03bfaf to 0x03c5c6 (0x618 bytes) 000518 1788564860.584546 mapwrite 0x0311fc thru 0x03cc91 (0xba96 bytes) 000519 1788564860.738026 punch from 0x02add5 to 0x032f74 (0x81a0 bytes) 000522 1788564860.746271 mapwrite 0x01cf98 thru 0x023fd3 (0x703c bytes) 000523 1788564860.840655 mapwrite 0x02a385 thru 0x030ebb (0x6b37 bytes) 000527 1788564860.964290 MIRROR_RESYNC 7 mirrors 000529 1788564865.338703 punch from 0x01d5fd to 0x0201f0 (0x2bf4 bytes) 000530 1788564865.422846 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cc92): Mirror 12: 0xec0c50ca (stale) Mirror 14: 0xec0c50ca (stale) Mirror 15: 0xec0c50ca (stale) Mirror 16: 0xec0c50ca (stale) Mirror 17: 0xec0c50ca (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cc92): Mirror 12: 0xec0c50ca (stale) Mirror 14: 0xec0c50ca (stale) Mirror 15: 0xec0c50ca (stale) Mirror 16: 0xec0c50ca (stale) Mirror 17: 0xec0c50ca (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cc92: skipped 000532 1788564865.871743 mapwrite 0x0181f6 thru 0x0260ee (0xdef9 bytes) 000533 1788564865.980735 write 0x02e2e0 thru 0x02f96f (0x1690 bytes) 000534 1788564865.992007 mapwrite 0x02d0bc thru 0x030a23 (0x3968 bytes) 000536 1788564866.049079 trunc from 0x03cc92 to 0x02751f (0x15772 bytes) 000537 1788564866.069394 read 0x00ff3b thru 0x01ec79 (0xed3f bytes) 000538 1788564866.077398 mapwrite 0x027c9a thru 0x036c48 (0xefaf bytes) 000540 1788564866.165844 punch from 0x000135 to 0x00f55f (0xf42b bytes) 000541 1788564866.172056 mapread 0x00e1a3 thru 0x01916d (0xafcb bytes) 000542 1788564866.180893 mapwrite 0x02558e thru 0x030add (0xb550 bytes) 000543 1788564866.231008 punch from 0x01a0a0 to 0x01fb33 (0x5a94 bytes) 000544 1788564866.236447 trunc from 0x036c49 to 0x00f264 (0x279e4 bytes) 000546 1788564866.254246 mapwrite 0x024ccc thru 0x029d54 (0x5089 bytes) 000547 1788564866.324177 mapread 0x011e82 thru 0x014820 (0x299f bytes) 000548 1788564866.333319 mapread 0x022c01 thru 0x029d54 (0x7154 bytes) 000550 1788564866.336282 punch from 0x00036a to 0x0098d4 (0x956b bytes) 000552 1788564866.341484 mapwrite 0x035f3a thru 0x03e859 (0x8920 bytes) 000553 1788564866.415463 punch from 0x03988b to 0x03e859 (0x4fcf bytes) 000554 1788564866.422275 write 0x0028e2 thru 0x00af86 (0x86a5 bytes) 000555 1788564866.431284 trunc from 0x03e85a to 0x008823 (0x36036 bytes) 000556 1788564866.448029 read 0x00189d thru 0x008823 (0x6f87 bytes) 000558 1788564866.460319 trunc from 0x008824 to 0x01ba46 (0x13223 bytes) 000559 1788564866.476883 write 0x021f7d thru 0x029855 (0x78d9 bytes) 000561 1788564866.480229 punch from 0x01d63a to 0x01d958 (0x31f bytes) 000562 1788564866.492079 trunc from 0x029856 to 0x022a9c (0x6db9 bytes) 000563 1788564866.507226 trunc from 0x022a9d to 0x00660b (0x1c491 bytes) 000564 1788564866.522849 read 0x000fc1 thru 0x00660b (0x564b bytes) 000567 1788564866.524654 punch from 0x0026a3 to 0x00660b (0x3f69 bytes) 000568 1788564866.530001 mapwrite 0x01b8be thru 0x01d454 (0x1b97 bytes) 000569 1788564866.626626 write 0x03ef92 thru 0x03ffff (0x106e bytes) 000570 1788564866.627643 write 0x020ff8 thru 0x0237d9 (0x27e2 bytes) 000571 1788564866.649593 MIRROR_RESYNC 6 mirrors 000572 1788564869.780020 mapread 0x0156f8 thru 0x017a58 (0x2361 bytes) 000573 1788564869.807597 write 0x029fae thru 0x031fa4 (0x7ff7 bytes) 000574 1788564869.926860 read 0x006ffa thru 0x0134ea (0xc4f1 bytes) 000575 1788564869.941706 trunc from 0x040000 to 0x000f24 (0x3f0db bytes) 000577 1788564869.982582 read 0x00046f thru 0x000f24 (0xab6 bytes) 000578 1788564869.990272 write 0x0310de thru 0x034c75 (0x3b98 bytes) 000579 1788564869.991634 mapread 0x011800 thru 0x01230e (0xb0f bytes) 000580 1788564870.001298 mapwrite 0x03edcf thru 0x03ffff (0x1231 bytes) 000581 1788564870.099274 mapwrite 0x03c0ec thru 0x03ffff (0x3f14 bytes) 000582 1788564870.173237 punch from 0x01ae99 to 0x02389b (0x8a03 bytes) 000583 1788564870.187578 mapwrite 0x010894 thru 0x01d60f (0xcd7c bytes) 000584 1788564870.285921 mapread 0x0180c5 thru 0x01d10c (0x5048 bytes) 000585 1788564870.294104 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x93b2c59c (stale) Mirror 15: 0x93b2c59c (stale) Mirror 16: 0x93b2c59c (stale) Mirror 17: 0x93b2c59c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x93b2c59c (stale) Mirror 15: 0x93b2c59c (stale) Mirror 16: 0x93b2c59c (stale) Mirror 17: 0x93b2c59c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000586 1788564871.026113 read 0x01e909 thru 0x02e779 (0xfe71 bytes) 000587 1788564871.041872 mapwrite 0x03ca4f thru 0x03e98b (0x1f3d bytes) 000588 1788564871.151917 mapread 0x02c057 thru 0x02de4c (0x1df6 bytes) 000590 1788564871.153333 write 0x023bf5 thru 0x030779 (0xcb85 bytes) 000591 1788564871.161824 trunc from 0x040000 to 0x02f294 (0x10d6b bytes) 000593 1788564871.179316 punch from 0x015d54 to 0x01886e (0x2b1b bytes) 000594 1788564871.198299 punch from 0x0162f6 to 0x024e78 (0xeb83 bytes) 000595 1788564871.204869 mapwrite 0x03831b thru 0x03d348 (0x502e bytes) 000596 1788564871.305095 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3d349): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d349): Mirror 12: 0xae90f2aa (stale) Mirror 15: 0xae90f2aa (stale) Mirror 16: 0xae90f2aa (stale) Mirror 17: 0xae90f2aa (stale) CRC-32 checksum value for chunk [0, 0x3d349): Mirror 1: 0xf9979b0d Mirror 18: 0xf9979b0d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d349: skipped 000597 1788564872.991179 trunc from 0x03d349 to 0x0369a4 (0x69a4 bytes) 000598 1788564873.096751 write 0x00f285 thru 0x0112b0 (0x202c bytes) 000599 1788564873.111163 MIRROR_RESYNC 6 mirrors 000600 1788564875.610577 mapwrite 0x01c04d thru 0x01fd98 (0x3d4c bytes) 000601 1788564875.797558 read 0x031f5d thru 0x0369a4 (0x4a48 bytes) 000602 1788564875.807912 write 0x00e162 thru 0x01a562 (0xc401 bytes) 000603 1788564875.815063 punch from 0x01e684 to 0x02d1af (0xeb2c bytes) 000605 1788564875.833270 write 0x035d6d thru 0x03ffff (0xa293 bytes) 000606 1788564875.838162 write 0x00831b thru 0x015c4f (0xd935 bytes) 000607 1788564875.856085 read 0x036f60 thru 0x03d7b2 (0x6853 bytes) 000608 1788564875.856842 trunc from 0x040000 to 0x02e9b0 (0x1164f bytes) 000609 1788564875.928198 read 0x013f14 thru 0x01d191 (0x927e bytes) 000610 1788564875.933721 punch from 0x00701b to 0x00e8f1 (0x78d7 bytes) 000611 1788564875.980199 read 0x01f03e thru 0x0222fc (0x32bf bytes) 000612 1788564876.003192 punch from 0x021882 to 0x02e374 (0xcaf3 bytes) 000613 1788564876.016810 trunc from 0x02e9b1 to 0x0148c5 (0x1a0eb bytes) 000615 1788564876.066006 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x148c6): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x148c6): Mirror 12: 0x52625523 (stale) Mirror 15: 0x52625523 (stale) Mirror 16: 0x52625523 (stale) Mirror 17: 0x52625523 (stale) Mirror 18: 0x52625523 (stale) CRC-32 checksum value for chunk [0, 0x148c6): Mirror 1: 0x95a0b9a Mirror 19: 0x95a0b9a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x148c6: skipped 000617 1788564877.712020 trunc from 0x0148c6 to 0x0093a9 (0xb51c bytes) 000618 1788564877.821604 mapread 0x006e79 thru 0x0093a9 (0x2531 bytes) 000619 1788564877.839998 write 0x0184bd thru 0x01eb17 (0x665b bytes) 000621 1788564877.842845 mapread 0x00adfc thru 0x017153 (0xc358 bytes) 000623 1788564877.862881 mapread 0x018b26 thru 0x019f98 (0x1473 bytes) 000624 1788564877.882645 MIRROR_RESYNC 7 mirrors 000625 1788564880.076725 trunc from 0x01eb18 to 0x033b1e (0x15007 bytes) 000628 1788564880.192243 read 0x01feb8 thru 0x02f420 (0xf569 bytes) 000629 1788564880.201014 mapwrite 0x031929 thru 0x037d11 (0x63e9 bytes) 000630 1788564880.309764 punch from 0x0321ca to 0x037d11 (0x5b48 bytes) 000631 1788564880.316080 mapwrite 0x03425b thru 0x03ffff (0xbda5 bytes) 000632 1788564880.511303 mapwrite 0x03e1a1 thru 0x03ffff (0x1e5f bytes) 000633 1788564880.542823 trunc from 0x040000 to 0x0339bc (0xc643 bytes) 000635 1788564880.580769 punch from 0x012023 to 0x01430d (0x22eb bytes) 000638 1788564880.596457 mapwrite 0x03c598 thru 0x03d6f3 (0x115c bytes) 000640 1788564880.690720 mapread 0x02ec17 thru 0x03bf2a (0xd314 bytes) 000641 1788564880.711158 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d6f4): Mirror 12: 0x54e51a0e (stale) Mirror 15: 0x54e51a0e (stale) Mirror 17: 0x54e51a0e (stale) Mirror 18: 0x54e51a0e (stale) Mirror 19: 0x54e51a0e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d6f4): Mirror 12: 0x54e51a0e (stale) Mirror 15: 0x54e51a0e (stale) Mirror 17: 0x54e51a0e (stale) Mirror 18: 0x54e51a0e (stale) Mirror 19: 0x54e51a0e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d6f4: skipped 000642 1788564881.475218 read 0x0346f6 thru 0x03d6f3 (0x8ffe bytes) 000644 1788564881.485260 punch from 0x013ef5 to 0x02355a (0xf666 bytes) 000645 1788564881.498918 MIRROR_RESYNC 6 mirrors 000647 1788564883.659275 punch from 0x034cf7 to 0x035859 (0xb63 bytes) 000648 1788564883.766922 punch from 0x00b3f2 to 0x00feab (0x4aba bytes) 000650 1788564883.778140 trunc from 0x03d6f4 to 0x01620d (0x274e6 bytes) 000652 1788564883.846900 mapwrite 0x0338c7 thru 0x03bd04 (0x843e bytes) 000653 1788564883.997495 write 0x0231e2 thru 0x024254 (0x1073 bytes) 000654 1788564884.024129 mapwrite 0x02bdb1 thru 0x03797c (0xbbcc bytes) 000655 1788564884.177710 write 0x035dec thru 0x03df3c (0x8151 bytes) 000656 1788564884.179140 mapread 0x000e11 thru 0x00d2b6 (0xc4a6 bytes) 000658 1788564884.190686 write 0x01cfdd thru 0x0263d3 (0x93f7 bytes) 000659 1788564884.205697 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3df3d): Mirror 12: 0xc0f4cafe (stale) Mirror 15: 0xc0f4cafe (stale) Mirror 17: 0xc0f4cafe (stale) Mirror 18: 0xc0f4cafe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3df3d): Mirror 12: 0xc0f4cafe (stale) Mirror 15: 0xc0f4cafe (stale) Mirror 17: 0xc0f4cafe (stale) Mirror 18: 0xc0f4cafe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3df3d: skipped 000660 1788564884.646374 punch from 0x036dc5 to 0x038cc8 (0x1f04 bytes) 000661 1788564884.652182 read 0x0099bd thru 0x00a9e8 (0x102c bytes) 000663 1788564884.663893 punch from 0x00eae0 to 0x016664 (0x7b85 bytes) 000665 1788564884.678854 write 0x03f572 thru 0x03ffff (0xa8e bytes) 000666 1788564884.681149 punch from 0x03a8fe to 0x03f44b (0x4b4e bytes) 000667 1788564884.694309 trunc from 0x040000 to 0x003563 (0x3ca9c bytes) 000669 1788564884.725928 mapread 0x001849 thru 0x002c12 (0x13ca bytes) 000671 1788564884.749257 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3564): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3564): Mirror 12: 0xf5721e12 (stale) Mirror 15: 0xf5721e12 (stale) Mirror 17: 0xf5721e12 (stale) Mirror 18: 0xf5721e12 (stale) CRC-32 checksum value for chunk [0, 0x3564): Mirror 1: 0xf5721e12 Mirror 19: 0xf5721e12 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3564: skipped 000672 1788564886.122756 trunc from 0x003564 to 0x03e54f (0x3afec bytes) 000673 1788564886.235831 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3e550): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e550): Mirror 12: 0xbcc01cc2 (stale) Mirror 15: 0xbcc01cc2 (stale) Mirror 17: 0xbcc01cc2 (stale) Mirror 18: 0xbcc01cc2 (stale) Mirror 19: 0x9fe17df (stale) CRC-32 checksum value for chunk [0, 0x3e550): Mirror 1: 0x9fe17df Mirror 20: 0x9fe17df lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e550: skipped 000674 1788564887.433296 mapread 0x02c118 thru 0x035731 (0x961a bytes) 000675 1788564887.465664 punch from 0x0346da to 0x03e54f (0x9e76 bytes) 000676 1788564887.551251 mapread 0x008a92 thru 0x01500d (0xc57c bytes) 000679 1788564887.594061 punch from 0x020bbb to 0x02f364 (0xe7aa bytes) 000680 1788564887.606420 mapread 0x039eac thru 0x03e54f (0x46a4 bytes) 000681 1788564887.638208 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3e550): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e550): Mirror 12: 0xbcc01cc2 (stale) Mirror 15: 0xbcc01cc2 (stale) Mirror 17: 0xbcc01cc2 (stale) Mirror 18: 0xbcc01cc2 (stale) Mirror 19: 0x9fe17df (stale) Mirror 20: 0x9fe17df (stale) CRC-32 checksum value for chunk [0, 0x3e550): Mirror 1: 0x9fe17df Mirror 21: 0x9fe17df lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e550: skipped 000683 1788564889.089064 mapwrite 0x03797c thru 0x0398bd (0x1f42 bytes) 000685 1788564889.288275 mapread 0x01919f thru 0x0229be (0x9820 bytes) 000688 1788564889.322001 mapread 0x0130d1 thru 0x016f22 (0x3e52 bytes) 000690 1788564889.324271 read 0x031d11 thru 0x03e54f (0xc83f bytes) 000691 1788564889.325313 punch from 0x000bd8 to 0x0108e5 (0xfd0e bytes) 000692 1788564889.333550 read 0x036dc7 thru 0x037c7b (0xeb5 bytes) 000694 1788564889.334826 write 0x0311da thru 0x03d7a9 (0xc5d0 bytes) 000695 1788564889.337388 punch from 0x028733 to 0x0362b5 (0xdb83 bytes) 000696 1788564889.348950 mapwrite 0x03d718 thru 0x03ffff (0x28e8 bytes) 000697 1788564889.459061 mapread 0x0025b1 thru 0x00bed9 (0x9929 bytes) 000698 1788564889.460679 trunc from 0x040000 to 0x03a647 (0x59b8 bytes) 000699 1788564889.478950 mapread 0x010b7a thru 0x0128c0 (0x1d47 bytes) 000702 1788564889.482215 mapread 0x0291ce thru 0x036028 (0xce5b bytes) 000703 1788564889.483920 trunc from 0x03a648 to 0x024a59 (0x15bee bytes) 000704 1788564889.520671 MIRROR_RESYNC 8 mirrors 000705 1788564891.546256 mapwrite 0x03bfa6 thru 0x03ffff (0x405a bytes) 000708 1788564891.805244 read 0x0003ed thru 0x001ba0 (0x17b4 bytes) 000709 1788564891.813031 punch from 0x034534 to 0x03ffff (0xbacc bytes) 000712 1788564891.821737 mapwrite 0x02155c thru 0x023fd6 (0x2a7b bytes) 000714 1788564891.930422 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xe20eea22 (stale) Mirror 15: 0xe20eea22 (stale) Mirror 17: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) Mirror 20: 0xe20eea22 (stale) Mirror 21: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xe20eea22 (stale) Mirror 15: 0xe20eea22 (stale) Mirror 17: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) Mirror 20: 0xe20eea22 (stale) Mirror 21: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000715 1788564892.523741 write 0x03f061 thru 0x03ffff (0xf9f bytes) 000716 1788564892.533236 mapwrite 0x020a90 thru 0x0237ca (0x2d3b bytes) 000718 1788564892.605140 read 0x02f1b6 thru 0x02fc33 (0xa7e bytes) 000720 1788564892.613749 read 0x02dad4 thru 0x02ea84 (0xfb1 bytes) 000721 1788564892.628518 punch from 0x0056d5 to 0x014216 (0xeb42 bytes) 000722 1788564892.634181 punch from 0x0164d8 to 0x01dcbc (0x77e5 bytes) 000724 1788564892.645840 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xe20eea22 (stale) Mirror 15: 0xe20eea22 (stale) Mirror 17: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) Mirror 20: 0xe20eea22 (stale) Mirror 21: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1f735466 Mirror 22: 0x1f735466 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000727 1788564894.091388 read 0x032feb thru 0x03b5d2 (0x85e8 bytes) 000728 1788564894.147581 read 0x01d85e thru 0x0294e6 (0xbc89 bytes) 000729 1788564894.177575 mapwrite 0x0306b5 thru 0x030f60 (0x8ac bytes) 000731 1788564894.385543 mapread 0x00ceb8 thru 0x019c87 (0xcdd0 bytes) 000732 1788564894.483551 punch from 0x019030 to 0x023879 (0xa84a bytes) 000733 1788564894.493261 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xe20eea22 (stale) Mirror 15: 0xe20eea22 (stale) Mirror 17: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) Mirror 20: 0xe20eea22 (stale) Mirror 21: 0xe20eea22 (stale) Mirror 22: 0x1f735466 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x67d9c261 Mirror 23: 0x67d9c261 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000735 1788564896.164267 trunc from 0x040000 to 0x012724 (0x2d8db bytes) 000736 1788564896.282257 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x12725): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12725): Mirror 12: 0xf987dc6f (stale) Mirror 15: 0xf987dc6f (stale) Mirror 17: 0xf987dc6f (stale) Mirror 19: 0xf987dc6f (stale) Mirror 20: 0xf987dc6f (stale) Mirror 21: 0xf987dc6f (stale) Mirror 22: 0xf987dc6f (stale) Mirror 23: 0xf987dc6f (stale) CRC-32 checksum value for chunk [0, 0x12725): Mirror 1: 0xf987dc6f Mirror 24: 0xf987dc6f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12725: skipped 000738 1788564897.521785 punch from 0x009ddf to 0x012724 (0x8946 bytes) 000739 1788564897.636280 mapread 0x00c19a thru 0x00e726 (0x258d bytes) 000740 1788564897.657098 mapread 0x0112b0 thru 0x012724 (0x1475 bytes) 000741 1788564897.659060 read 0x011498 thru 0x012724 (0x128d bytes) 000744 1788564897.660730 punch from 0x00bb0f to 0x012724 (0x6c16 bytes) 000745 1788564897.666919 mapwrite 0x004c06 thru 0x00eb2d (0x9f28 bytes) 000746 1788564897.752084 mapwrite 0x032892 thru 0x035ce9 (0x3458 bytes) 000747 1788564897.889279 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x35cea): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35cea): Mirror 12: 0x1685e585 (stale) Mirror 15: 0x1685e585 (stale) Mirror 17: 0x1685e585 (stale) Mirror 19: 0x1685e585 (stale) Mirror 20: 0x1685e585 (stale) Mirror 21: 0x1685e585 (stale) Mirror 22: 0xfc32fa1b (stale) Mirror 23: 0x43c56483 (stale) Mirror 24: 0x1685e585 (stale) CRC-32 checksum value for chunk [0, 0x35cea): Mirror 1: 0xe681395a Mirror 25: 0xe681395a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35cea: skipped 000748 1788564899.292190 write 0x01d314 thru 0x0235db (0x62c8 bytes) 000749 1788564899.405240 mapwrite 0x00ff7b thru 0x0131ea (0x3270 bytes) 000750 1788564899.558751 mapwrite 0x016212 thru 0x021d98 (0xbb87 bytes) 000751 1788564899.633664 mapwrite 0x0209aa thru 0x026eca (0x6521 bytes) 000752 1788564899.742309 trunc from 0x035cea to 0x025244 (0x10aa5 bytes) 000753 1788564899.767935 read 0x023394 thru 0x02471a (0x1387 bytes) 000754 1788564899.768653 mapread 0x00c819 thru 0x00d710 (0xef8 bytes) 000756 1788564899.771282 punch from 0x006379 to 0x007675 (0x12fd bytes) 000757 1788564899.782442 mapread 0x01867b thru 0x020d5a (0x86e0 bytes) 000759 1788564899.790973 write 0x03148f thru 0x0321c9 (0xd3b bytes) 000760 1788564899.793894 mapwrite 0x03cba1 thru 0x03d0b4 (0x514 bytes) 000761 1788564899.920181 read 0x02c889 thru 0x034a1b (0x8193 bytes) 000762 1788564899.960247 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d0b5): Mirror 15: 0xd42a682e (stale) Mirror 17: 0xd42a682e (stale) Mirror 19: 0xd42a682e (stale) Mirror 20: 0xd42a682e (stale) Mirror 21: 0xd42a682e (stale) Mirror 22: 0x73f06c92 (stale) Mirror 23: 0xc6a2de41 (stale) Mirror 24: 0xd42a682e (stale) Mirror 25: 0x5f998979 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d0b5): Mirror 15: 0xd42a682e (stale) Mirror 17: 0xd42a682e (stale) Mirror 19: 0xd42a682e (stale) Mirror 20: 0xd42a682e (stale) Mirror 21: 0xd42a682e (stale) Mirror 22: 0x73f06c92 (stale) Mirror 23: 0xc6a2de41 (stale) Mirror 24: 0xd42a682e (stale) Mirror 25: 0x5f998979 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d0b5: skipped 000768 1788564900.609445 punch from 0x00031f to 0x008614 (0x82f6 bytes) 000769 1788564900.616138 write 0x0090ee thru 0x013083 (0x9f96 bytes) 000770 1788564900.627640 mapwrite 0x036344 thru 0x0372fa (0xfb7 bytes) 000771 1788564900.677943 trunc from 0x03d0b5 to 0x0103d7 (0x2ccdd bytes) 000775 1788564900.701389 mapwrite 0x01ca61 thru 0x024fa1 (0x8541 bytes) 000777 1788564900.775562 punch from 0x001fa4 to 0x00c4cd (0xa52a bytes) 000778 1788564900.791163 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x24fa2): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24fa2): Mirror 15: 0xf5273078 (stale) Mirror 17: 0xf5273078 (stale) Mirror 19: 0xf5273078 (stale) Mirror 20: 0xf5273078 (stale) Mirror 21: 0xf5273078 (stale) Mirror 22: 0x41a9b43d (stale) Mirror 23: 0x48baf388 (stale) Mirror 24: 0xf5273078 (stale) Mirror 25: 0x95200b14 (stale) CRC-32 checksum value for chunk [0, 0x24fa2): Mirror 1: 0x15868ec7 Mirror 26: 0x15868ec7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24fa2: skipped 000780 1788564902.055067 read 0x00f45c thru 0x01d26b (0xde10 bytes) 000783 1788564902.094066 mapwrite 0x03c863 thru 0x03ffff (0x379d bytes) 000784 1788564902.278480 write 0x01e446 thru 0x02d073 (0xec2e bytes) 000786 1788564902.300682 punch from 0x010903 to 0x0137a4 (0x2ea2 bytes) 000788 1788564902.322642 trunc from 0x040000 to 0x02de09 (0x121f6 bytes) 000789 1788564902.353072 punch from 0x004e28 to 0x00d0d7 (0x82b0 bytes) 000790 1788564902.359594 trunc from 0x02de0a to 0x0228ea (0xb51f bytes) 000792 1788564902.383815 mapread 0x00bdc8 thru 0x00f44e (0x3687 bytes) 000793 1788564902.403027 mapwrite 0x03d070 thru 0x03ffff (0x2f90 bytes) 000794 1788564902.534945 write 0x00ce54 thru 0x01c850 (0xf9fd bytes) 000795 1788564902.553624 write 0x02e8ec thru 0x037e3d (0x9552 bytes) 000796 1788564902.563179 write 0x026f94 thru 0x02ddbb (0x6e28 bytes) 000798 1788564902.589809 write 0x01ee30 thru 0x02a4b5 (0xb686 bytes) 000800 1788564902.593039 read 0x008ef8 thru 0x017276 (0xe37f bytes) 000801 1788564902.594070 write 0x03f59c thru 0x03ffff (0xa64 bytes) 000803 1788564902.612628 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xe20eea22 (stale) Mirror 17: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) Mirror 20: 0xe20eea22 (stale) Mirror 21: 0xe20eea22 (stale) Mirror 22: 0x1f735466 (stale) Mirror 23: 0x67d9c261 (stale) Mirror 24: 0xe20eea22 (stale) Mirror 25: 0x62ae3082 (stale) Mirror 26: 0x48378d47 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1f25fcd3 Mirror 27: 0x1f25fcd3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000804 1788564904.431586 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xe20eea22 (stale) Mirror 17: 0xe20eea22 (stale) Mirror 19: 0xe20eea22 (stale) Mirror 20: 0xe20eea22 (stale) Mirror 21: 0xe20eea22 (stale) Mirror 22: 0x1f735466 (stale) Mirror 23: 0x67d9c261 (stale) Mirror 24: 0xe20eea22 (stale) Mirror 25: 0x62ae3082 (stale) Mirror 26: 0x48378d47 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1f25fcd3 Mirror 27: 0x1f25fcd3 Mirror 28: 0x1f25fcd3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000805 1788564905.893765 write 0x027779 thru 0x02bfe1 (0x4869 bytes) 000806 1788564906.048058 trunc from 0x040000 to 0x01622c (0x29dd3 bytes) 000807 1788564906.068905 mapread 0x0031fe thru 0x00facd (0xc8d0 bytes) 000809 1788564906.089952 write 0x0304d8 thru 0x03e903 (0xe42c bytes) 000810 1788564906.096822 MIRROR_RESYNC 13 mirrors 000812 1788564910.202160 mapread 0x031da6 thru 0x03a8d0 (0x8b2b bytes) 000813 1788564910.222143 mapwrite 0x02b281 thru 0x0373df (0xc15f bytes) 000814 1788564910.381597 read 0x02ea52 thru 0x03167c (0x2c2b bytes) 000816 1788564910.389969 MIRROR_RESYNC 13 mirrors 000817 1788564914.125424 read 0x02cab2 thru 0x034723 (0x7c72 bytes) 000818 1788564914.134425 read 0x017233 thru 0x01b658 (0x4426 bytes) 000820 1788564914.145269 trunc from 0x03e904 to 0x020b15 (0x1ddee bytes) 000821 1788564914.226667 mapread 0x018ff5 thru 0x01a30e (0x131a bytes) 000823 1788564914.249499 MIRROR_RESYNC 13 mirrors 000824 1788564917.757925 read 0x00f716 thru 0x016d0d (0x75f8 bytes) 000825 1788564917.767904 punch from 0x0019de to 0x00cd6c (0xb38f bytes) 000826 1788564917.846398 punch from 0x014c59 to 0x0184c7 (0x386f bytes) 000827 1788564917.853131 mapwrite 0x02809b thru 0x02b3a4 (0x330a bytes) 000832 1788564917.948684 write 0x03913d thru 0x03e251 (0x5115 bytes) 000833 1788564917.951376 punch from 0x010fbd to 0x01157f (0x5c3 bytes) 000834 1788564917.965326 punch from 0x01f9ec to 0x0287a9 (0x8dbe bytes) 000836 1788564917.970790 mapread 0x02e010 thru 0x03be54 (0xde45 bytes) 000838 1788564917.985431 trunc from 0x03e252 to 0x01740d (0x26e44 bytes) 000839 1788564918.007456 punch from 0x00868f to 0x00a1a5 (0x1b17 bytes) 000840 1788564918.012614 punch from 0x01549d to 0x01740d (0x1f71 bytes) 000842 1788564918.019429 trunc from 0x01740e to 0x02e5ad (0x171a0 bytes) 000843 1788564918.043209 MIRROR_RESYNC 13 mirrors 000845 1788564921.042997 punch from 0x00315e to 0x0112c2 (0xe165 bytes) 000846 1788564921.149159 trunc from 0x02e5ae to 0x024cb1 (0x98fc bytes) 000847 1788564921.192040 mapwrite 0x001c1e thru 0x0100e7 (0xe4ca bytes) 000848 1788564921.362727 trunc from 0x024cb2 to 0x03bf56 (0x172a5 bytes) 000849 1788564921.424271 read 0x005b08 thru 0x012643 (0xcb3c bytes) 000850 1788564921.439255 mapread 0x01e68c thru 0x023835 (0x51aa bytes) 000851 1788564921.480283 MIRROR_RESYNC 13 mirrors 000852 1788564924.898634 mapwrite 0x025389 thru 0x028442 (0x30ba bytes) 000853 1788564925.180249 trunc from 0x03bf57 to 0x0308fd (0xb659 bytes) 000854 1788564925.216136 trunc from 0x0308fe to 0x01add7 (0x15b26 bytes) 000856 1788564925.257035 mapwrite 0x00055b thru 0x00572a (0x51d0 bytes) 000859 1788564925.390207 read 0x00da7b thru 0x0103c1 (0x2947 bytes) 000860 1788564925.395219 punch from 0x01ac60 to 0x01add7 (0x178 bytes) 000861 1788564925.400213 mapwrite 0x02b6cb thru 0x02ed0a (0x3640 bytes) 000862 1788564925.458005 mapread 0x008469 thru 0x01511d (0xccb5 bytes) 000865 1788564925.474260 mapread 0x0052e2 thru 0x00cb98 (0x78b7 bytes) 000866 1788564925.480203 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x2ed0b): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ed0b): Mirror 15: 0xa0beabca (stale) Mirror 17: 0xa0beabca (stale) Mirror 19: 0xa0beabca (stale) Mirror 20: 0xa0beabca (stale) Mirror 21: 0xa0beabca (stale) Mirror 22: 0xa0beabca (stale) Mirror 23: 0xa0beabca (stale) Mirror 24: 0xa0beabca (stale) Mirror 25: 0xa0beabca (stale) Mirror 26: 0xa0beabca (stale) Mirror 27: 0xa0beabca (stale) Mirror 28: 0xa0beabca (stale) CRC-32 checksum value for chunk [0, 0x2ed0b): Mirror 1: 0x92e0631b Mirror 29: 0x92e0631b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ed0b: skipped 000867 1788564926.539465 mapwrite 0x03e501 thru 0x03f4da (0xfda bytes) 000868 1788564927.040527 punch from 0x019ff5 to 0x020735 (0x6741 bytes) 000869 1788564927.049330 mapwrite 0x01626d thru 0x01da00 (0x7794 bytes) 000870 1788564927.235051 write 0x0137cb thru 0x01a3a9 (0x6bdf bytes) 000872 1788564927.250132 MIRROR_RESYNC 14 mirrors 000873 1788564934.025554 punch from 0x0370a6 to 0x03acdb (0x3c36 bytes) 000874 1788564934.099953 read 0x02fd97 thru 0x0396c9 (0x9933 bytes) 000875 1788564934.107091 mapread 0x00ef60 thru 0x01e984 (0xfa25 bytes) 000876 1788564934.130507 punch from 0x01aa97 to 0x02a6c9 (0xfc33 bytes) 000879 1788564934.136447 mapwrite 0x00b2f9 thru 0x0152d3 (0x9fdb bytes) 000881 1788564934.309182 read 0x005bff thru 0x012377 (0xc779 bytes) 000882 1788564934.348903 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x3f4db): Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f4db): Mirror 15: 0x7d25a316 (stale) Mirror 17: 0x7d25a316 (stale) Mirror 19: 0x7d25a316 (stale) Mirror 20: 0x7d25a316 (stale) Mirror 21: 0x7d25a316 (stale) Mirror 22: 0x7d25a316 (stale) Mirror 23: 0x7d25a316 (stale) Mirror 24: 0x7d25a316 (stale) Mirror 25: 0x7d25a316 (stale) Mirror 26: 0x7d25a316 (stale) Mirror 27: 0x7d25a316 (stale) Mirror 28: 0x7d25a316 (stale) Mirror 29: 0x7d25a316 (stale) CRC-32 checksum value for chunk [0, 0x3f4db): Mirror 1: 0xa6e02749 Mirror 30: 0xa6e02749 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f4db: skipped 000885 1788564935.909328 punch from 0x01e0ca to 0x01e349 (0x280 bytes) 000886 1788564935.968733 mapwrite 0x038eaa thru 0x03ffff (0x7156 bytes) 000888 1788564936.053800 mapread 0x0072f9 thru 0x01529a (0xdfa2 bytes) 000889 1788564936.066170 write 0x0018b2 thru 0x001c57 (0x3a6 bytes) 000890 1788564936.066980 read 0x021f78 thru 0x02294b (0x9d4 bytes) 000891 1788564936.070782 mapread 0x00f4db thru 0x01119d (0x1cc3 bytes) 000892 1788564936.071561 trunc from 0x040000 to 0x01e16e (0x21e91 bytes) 000893 1788564936.097514 read 0x0082f0 thru 0x017ef6 (0xfc07 bytes) 000894 1788564936.101099 read 0x004970 thru 0x012a79 (0xe10a bytes) 000897 1788564936.104939 mapread 0x009aee thru 0x00de4c (0x435f bytes) 000898 1788564936.106060 read 0x01123a thru 0x015d92 (0x4b59 bytes) 000901 1788564936.108144 trunc from 0x01e16f to 0x0002c6 (0x1dea8 bytes) 000902 1788564936.134124 read 0x00008e thru 0x0002c6 (0x239 bytes) 000903 1788564936.146155 write 0x03d9fe thru 0x03ffff (0x2602 bytes) 000904 1788564936.148174 mapread 0x01cff9 thru 0x01dd71 (0xd79 bytes) 000905 1788564936.161313 trunc from 0x040000 to 0x03c990 (0x366f bytes) 000907 1788564936.180093 write 0x005e3d thru 0x00e0bb (0x827f bytes) 000908 1788564936.181502 trunc from 0x03c991 to 0x0395a8 (0x33e8 bytes) 000910 1788564936.202663 mapread 0x0001f1 thru 0x0047d0 (0x45e0 bytes) 000912 1788564936.204051 mapread 0x01c36e thru 0x0221fe (0x5e91 bytes) 000913 1788564936.204664 punch from 0x0147fa to 0x019ec1 (0x56c8 bytes) 000914 1788564936.214135 trunc from 0x0395a9 to 0x02a367 (0xf241 bytes) 000915 1788564936.228234 trunc from 0x02a368 to 0x01012b (0x1a23c bytes) 000918 1788564936.251068 trunc from 0x01012c to 0x002846 (0xd8e5 bytes) 000920 1788564936.270678 read 0x001a4f thru 0x002550 (0xb02 bytes) 000921 1788564936.271586 read 0x0024b8 thru 0x002846 (0x38f bytes) 000924 1788564936.273886 read 0x00126f thru 0x002846 (0x15d8 bytes) 000925 1788564936.274781 mapread 0x0012cc thru 0x002846 (0x157b bytes) 000930 1788564936.278902 write 0x03e507 thru 0x03ffff (0x1af9 bytes) 000931 1788564936.280213 trunc from 0x040000 to 0x002f90 (0x3d06f bytes) 000932 1788564936.304856 MIRROR_RESYNC 15 mirrors 000933 1788564939.613024 MIRROR_EXTEND to 16 mirrors 000934 1788564940.571043 read 0x000938 thru 0x002f90 (0x2659 bytes) 000936 1788564940.629113 MIRROR_RESYNC 16 mirrors 000937 1788564941.235307 punch from 0x000fcf to 0x002f90 (0x1fc2 bytes) 000938 1788564941.354688 MIRROR_SPLIT mirror 1 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f91): Mirror 17: 0x9901cb11 (stale) Mirror 19: 0x9901cb11 (stale) Mirror 20: 0x9901cb11 (stale) Mirror 21: 0x9901cb11 (stale) Mirror 22: 0x9901cb11 (stale) Mirror 23: 0x9901cb11 (stale) Mirror 24: 0x9901cb11 (stale) Mirror 25: 0x9901cb11 (stale) Mirror 26: 0x9901cb11 (stale) Mirror 27: 0x9901cb11 (stale) Mirror 28: 0x9901cb11 (stale) Mirror 29: 0x9901cb11 (stale) Mirror 30: 0x9901cb11 (stale) Mirror 31: 0x9901cb11 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f91): Mirror 17: 0x9901cb11 (stale) Mirror 19: 0x9901cb11 (stale) Mirror 20: 0x9901cb11 (stale) Mirror 21: 0x9901cb11 (stale) Mirror 22: 0x9901cb11 (stale) Mirror 23: 0x9901cb11 (stale) Mirror 24: 0x9901cb11 (stale) Mirror 25: 0x9901cb11 (stale) Mirror 26: 0x9901cb11 (stale) Mirror 27: 0x9901cb11 (stale) Mirror 28: 0x9901cb11 (stale) Mirror 29: 0x9901cb11 (stale) Mirror 30: 0x9901cb11 (stale) Mirror 31: 0x9901cb11 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f91: skipped 000939 1788564941.874994 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x2f91): Mirror 17: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f91): Mirror 17: 0x9901cb11 (stale) Mirror 19: 0x9901cb11 (stale) Mirror 20: 0x9901cb11 (stale) Mirror 21: 0x9901cb11 (stale) Mirror 22: 0x9901cb11 (stale) Mirror 23: 0x9901cb11 (stale) Mirror 24: 0x9901cb11 (stale) Mirror 25: 0x9901cb11 (stale) Mirror 26: 0x9901cb11 (stale) Mirror 27: 0x9901cb11 (stale) Mirror 28: 0x9901cb11 (stale) Mirror 29: 0x9901cb11 (stale) Mirror 30: 0x9901cb11 (stale) Mirror 31: 0x9901cb11 (stale) CRC-32 checksum value for chunk [0, 0x2f91): Mirror 1: 0x9901cb11 Mirror 32: 0x9901cb11 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f91: skipped 000940 1788564942.950844 mapwrite 0x011cdb thru 0x01e129 (0xc44f bytes) 000941 1788564943.231610 write 0x0229da thru 0x0283c7 (0x59ee bytes) 000945 1788564943.236053 write 0x00e6b1 thru 0x013e5b (0x57ab bytes) 000946 1788564943.237816 mapread 0x01385d thru 0x020ea3 (0xd647 bytes) 000948 1788564943.246695 mapwrite 0x032ae8 thru 0x03ccd5 (0xa1ee bytes) 000949 1788564943.349471 MIRROR_SPLIT mirror 13 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x169:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ccd6): Mirror 17: 0x55d6ed48 (stale) Mirror 19: 0x55d6ed48 (stale) Mirror 20: 0x55d6ed48 (stale) Mirror 21: 0x55d6ed48 (stale) Mirror 22: 0x55d6ed48 (stale) Mirror 23: 0x55d6ed48 (stale) Mirror 24: 0x55d6ed48 (stale) Mirror 25: 0x55d6ed48 (stale) Mirror 26: 0x55d6ed48 (stale) Mirror 27: 0x55d6ed48 (stale) Mirror 28: 0x55d6ed48 (stale) Mirror 29: 0x55d6ed48 (stale) Mirror 31: 0x55d6ed48 (stale) Mirror 32: 0x55d6ed48 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ccd6): Mirror 17: 0x55d6ed48 (stale) Mirror 19: 0x55d6ed48 (stale) Mirror 20: 0x55d6ed48 (stale) Mirror 21: 0x55d6ed48 (stale) Mirror 22: 0x55d6ed48 (stale) Mirror 23: 0x55d6ed48 (stale) Mirror 24: 0x55d6ed48 (stale) Mirror 25: 0x55d6ed48 (stale) Mirror 26: 0x55d6ed48 (stale) Mirror 27: 0x55d6ed48 (stale) Mirror 28: 0x55d6ed48 (stale) Mirror 29: 0x55d6ed48 (stale) Mirror 31: 0x55d6ed48 (stale) Mirror 32: 0x55d6ed48 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ccd6: skipped 000950 1788564944.061883 punch from 0x038e21 to 0x03ccd5 (0x3eb5 bytes) 000951 1788564944.076711 trunc from 0x03ccd6 to 0x0066c4 (0x36611 bytes) 000952 1788564944.113746 write 0x015349 thru 0x02091a (0xb5d2 bytes) 000953 1788564944.115239 mapwrite 0x029ff3 thru 0x02e4c6 (0x44d4 bytes) 000954 1788564944.332363 mapread 0x02e083 thru 0x02e4c6 (0x444 bytes) 000955 1788564944.334928 mapread 0x00233f thru 0x004b17 (0x27d9 bytes) 000956 1788564944.357010 trunc from 0x02e4c7 to 0x026698 (0x7e2e bytes) 000959 1788564944.383077 write 0x0194ce thru 0x01ea70 (0x55a3 bytes) 000960 1788564944.385654 mapwrite 0x014a48 thru 0x017b2a (0x30e3 bytes) 000961 1788564944.461605 trunc from 0x026699 to 0x02af5e (0x48c6 bytes) 000962 1788564944.483238 mapread 0x020bbb thru 0x02af5e (0xa3a4 bytes) 000963 1788564944.500855 mapwrite 0x0165f5 thru 0x019a08 (0x3414 bytes) 000964 1788564944.576797 trunc from 0x02af5f to 0x000fdb (0x29f83 bytes) 000965 1788564944.604401 read 0x000edb thru 0x000fdb (0x101 bytes) 000966 1788564944.615319 punch from 0x0000a3 to 0x000fdb (0xf39 bytes) 000967 1788564944.621989 mapread 0x000293 thru 0x000fdb (0xd49 bytes) 000969 1788564944.628810 trunc from 0x000fdc to 0x0107ea (0xf80f bytes) 000970 1788564944.648198 write 0x018258 thru 0x01e400 (0x61a9 bytes) 000972 1788564944.654628 read 0x003665 thru 0x0049c7 (0x1363 bytes) 000975 1788564944.669979 trunc from 0x01e401 to 0x03c234 (0x1de34 bytes) 000976 1788564944.697624 mapread 0x00fd5c thru 0x018006 (0x82ab bytes) 000977 1788564944.699928 write 0x00fe44 thru 0x01035a (0x517 bytes) 000979 1788564944.703838 read 0x02b336 thru 0x02c416 (0x10e1 bytes) 000980 1788564944.726400 MIRROR_RESYNC 15 mirrors 000981 1788564950.325554 punch from 0x022ff4 to 0x032e37 (0xfe44 bytes) 000983 1788564950.423744 read 0x02cfcf thru 0x032005 (0x5037 bytes) 000984 1788564950.432631 mapread 0x025750 thru 0x028e94 (0x3745 bytes) 000987 1788564950.460151 punch from 0x022887 to 0x02c2af (0x9a29 bytes) 000988 1788564950.469099 punch from 0x0361fb to 0x03c234 (0x603a bytes) 000990 1788564950.474913 trunc from 0x03c235 to 0x008f21 (0x33313 bytes) 000991 1788564950.510987 mapwrite 0x03f31e thru 0x03ffff (0xce2 bytes) 000993 1788564950.624808 write 0x00302a thru 0x01089b (0xd872 bytes) 000994 1788564950.652857 read 0x00239a thru 0x00e984 (0xc5eb bytes) 000995 1788564950.665800 trunc from 0x040000 to 0x020833 (0x1f7cc bytes) truncating to largest ever: 0x3e746 000996 1788564950.720199 trunc from 0x020834 to 0x03e745 (0x1df12 bytes) 000997 1788564950.742598 punch from 0x0127be to 0x016e86 (0x46c9 bytes) 000999 1788564950.763765 read 0x006605 thru 0x00d404 (0x6e00 bytes) All operations completed A-OK!