== sanity-flr test 70a: flr mode fsx test ================ 08:29:34 (1788179374) Seed set to 9376 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x1885c 000001 1788179376.443027 trunc from 00000000 to 0x01885b (0x1885c bytes) 000002 1788179376.463916 trunc from 0x01885c to 0x014806 (0x4055 bytes) 000007 1788179376.507265 mapread 0x00e1ee thru 0x014806 (0x6619 bytes) 000010 1788179376.540898 mapread 0x008b64 thru 0x014806 (0xbca3 bytes) 000012 1788179376.553126 mapread 0x003692 thru 0x011b80 (0xe4ef bytes) truncating to largest ever: 0x2173f 000015 1788179376.570052 trunc from 0x014807 to 0x02173e (0xcf38 bytes) 000020 1788179376.617645 trunc from 0x02173f to 0x01cff6 (0x4748 bytes) 000022 1788179376.649796 mapread 0x00fd37 thru 0x017221 (0x74eb bytes) 000023 1788179376.675770 mapwrite 0x0190dc thru 0x020905 (0x782a bytes) 000024 1788179376.765635 mapwrite 0x015b31 thru 0x01a87f (0x4d4f bytes) 000026 1788179376.817778 write 0x009277 thru 0x0140fe (0xae88 bytes) 000032 1788179376.825928 trunc from 0x020906 to 0x00640f (0x1a4f6 bytes) 000033 1788179376.844661 write 0x0116b0 thru 0x0170c7 (0x5a18 bytes) 000035 1788179376.849092 mapread 0x00288b thru 0x00bfc6 (0x973c bytes) 000037 1788179376.859749 trunc from 0x0170c8 to 0x0096af (0xda18 bytes) truncating to largest ever: 0x27d36 000039 1788179376.888933 trunc from 0x0096b0 to 0x027d35 (0x1e686 bytes) 000040 1788179376.925304 trunc from 0x027d36 to 0x00bd13 (0x1c022 bytes) 000042 1788179376.950942 mapwrite 0x0326da thru 0x0363ca (0x3cf1 bytes) 000043 1788179377.115944 read 0x020b3f thru 0x0212c7 (0x789 bytes) 000044 1788179377.123053 write 0x020a1f thru 0x02eb49 (0xe12b bytes) 000046 1788179377.131489 read 0x0071e6 thru 0x012391 (0xb1ac bytes) 000047 1788179377.146732 trunc from 0x0363cb to 0x0054e0 (0x30eea bytes) 000048 1788179377.169418 mapwrite 0x034dbf thru 0x03dc5b (0x8e9d bytes) 000049 1788179377.342111 trunc from 0x03dc5c to 0x021793 (0x1c4c8 bytes) 000050 1788179377.400575 MIRROR_EXTEND to 2 mirrors truncating to largest ever: 0x37491 000054 1788179378.347879 trunc from 0x021794 to 0x037490 (0x15cfd bytes) 000057 1788179378.460456 write 0x03a307 thru 0x03ffff (0x5cf9 bytes) 000059 1788179378.462540 mapwrite 0x0379e9 thru 0x03ffff (0x8617 bytes) 000061 1788179378.539740 mapread 0x02b03b thru 0x038365 (0xd32b bytes) 000062 1788179378.551761 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7643ae46 Mirror 3: 0x7643ae46 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000063 1788179379.522121 read 0x0232a5 thru 0x023ed1 (0xc2d bytes) 000064 1788179379.538715 trunc from 0x040000 to 0x02d497 (0x12b68 bytes) 000065 1788179379.627837 read 0x009511 thru 0x017c48 (0xe738 bytes) 000066 1788179379.651076 mapread 0x003790 thru 0x005a84 (0x22f5 bytes) 000067 1788179379.658371 MIRROR_RESYNC 3 mirrors 000069 1788179380.573582 mapwrite 0x03a185 thru 0x03ffff (0x5e7b bytes) 000070 1788179380.863961 mapread 0x02e8dc thru 0x03ba16 (0xd13b bytes) 000074 1788179380.899931 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000075 1788179381.501319 mapwrite 0x03f348 thru 0x03ffff (0xcb8 bytes) 000077 1788179381.625532 write 0x031df5 thru 0x03e2e6 (0xc4f2 bytes) 000078 1788179381.651495 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x849e0ccc Mirror 4: 0x849e0ccc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000080 1788179382.915686 trunc from 0x040000 to 0x0280dd (0x17f22 bytes) 000081 1788179383.046259 trunc from 0x0280de to 0x02d7f6 (0x5719 bytes) 000083 1788179383.085505 write 0x0002af thru 0x0092d7 (0x9029 bytes) 000084 1788179383.113665 read 0x01a1c0 thru 0x01cd5d (0x2b9e bytes) 000085 1788179383.134997 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2d7f7): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d7f7): Mirror 3: 0x4c452276 (stale) Mirror 4: 0x4c452276 (stale) CRC-32 checksum value for chunk [0, 0x2d7f7): Mirror 1: 0x4834e4c5 Mirror 5: 0x4834e4c5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d7f7: skipped 000087 1788179384.605430 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2d7f7): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d7f7): Mirror 3: 0x4c452276 (stale) Mirror 4: 0x4c452276 (stale) CRC-32 checksum value for chunk [0, 0x2d7f7): Mirror 1: 0x4834e4c5 Mirror 5: 0x4834e4c5 Mirror 6: 0x4834e4c5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d7f7: skipped 000088 1788179385.876833 read 0x001190 thru 0x008fda (0x7e4b bytes) 000089 1788179385.901860 mapwrite 0x00f056 thru 0x012c5d (0x3c08 bytes) 000090 1788179386.159898 trunc from 0x02d7f7 to 0x000753 (0x2d0a3 bytes) 000091 1788179386.190403 write 0x03a695 thru 0x03ffff (0x596b bytes) 000092 1788179386.191817 mapwrite 0x01c1cc thru 0x027a3e (0xb873 bytes) 000095 1788179386.338670 mapread 0x0062f9 thru 0x009cd2 (0x39da bytes) 000096 1788179386.379018 read 0x008652 thru 0x00baac (0x345b bytes) 000097 1788179386.388106 read 0x00bef3 thru 0x01ba52 (0xfb60 bytes) 000099 1788179386.408981 write 0x01b6fd thru 0x028e0d (0xd711 bytes) 000101 1788179386.413927 trunc from 0x040000 to 0x02509e (0x1af61 bytes) 000105 1788179386.472656 trunc from 0x02509f to 0x023586 (0x1b18 bytes) 000106 1788179386.517809 trunc from 0x023587 to 0x027235 (0x3caf bytes) 000108 1788179386.560106 read 0x00c379 thru 0x00d944 (0x15cc bytes) 000109 1788179386.586796 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27236): Mirror 4: 0xbd692bf3 (stale) Mirror 5: 0xf0922ea5 (stale) Mirror 6: 0xf0922ea5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27236): Mirror 4: 0xbd692bf3 (stale) Mirror 5: 0xf0922ea5 (stale) Mirror 6: 0xf0922ea5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27236: skipped 000113 1788179387.191799 MIRROR_RESYNC 4 mirrors 000114 1788179388.640727 write 0x03fb16 thru 0x03ffff (0x4ea bytes) 000116 1788179388.729073 write 0x036d1c thru 0x03ffff (0x92e4 bytes) 000117 1788179388.734605 read 0x038a5d thru 0x03ffff (0x75a3 bytes) 000120 1788179388.737203 read 0x00aac2 thru 0x013960 (0x8e9f bytes) 000121 1788179388.753857 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x14100420 (stale) Mirror 6: 0x14100420 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x14100420 (stale) Mirror 6: 0x14100420 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000122 1788179389.202967 trunc from 0x040000 to 0x02b046 (0x14fb9 bytes) 000123 1788179389.222983 mapread 0x00d5e4 thru 0x01d4ff (0xff1c bytes) 000124 1788179389.255810 mapread 0x003097 thru 0x00e5f9 (0xb563 bytes) 000125 1788179389.264974 read 0x011f41 thru 0x01df0a (0xbfca bytes) 000126 1788179389.269643 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b047): Mirror 6: 0xdfbad406 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b047): Mirror 6: 0xdfbad406 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b047: skipped 000127 1788179389.574330 trunc from 0x02b047 to 0x0115e3 (0x19a63 bytes) 000129 1788179389.592684 mapwrite 0x008bfa thru 0x00cdfe (0x4205 bytes) 000130 1788179389.689457 trunc from 0x0115e4 to 0x02bad8 (0x1a4f5 bytes) 000132 1788179389.739789 trunc from 0x02bad9 to 0x000a75 (0x2b063 bytes) truncating to largest ever: 0x3a6a0 000134 1788179389.762525 trunc from 0x000a76 to 0x03a69f (0x39c2a bytes) 000136 1788179389.787799 read 0x0225c1 thru 0x02a002 (0x7a42 bytes) 000137 1788179389.802967 read 0x02df24 thru 0x02ed72 (0xe4f bytes) 000138 1788179389.814768 trunc from 0x03a6a0 to 0x029e97 (0x10808 bytes) 000140 1788179389.833499 mapread 0x027852 thru 0x029e97 (0x2646 bytes) 000143 1788179389.836135 mapread 0x00a57b thru 0x00abc5 (0x64b bytes) 000144 1788179389.837546 mapwrite 0x03a51e thru 0x03ffff (0x5ae2 bytes) 000145 1788179389.936585 write 0x0304d9 thru 0x03085f (0x387 bytes) 000146 1788179389.944061 trunc from 0x040000 to 0x019fa0 (0x2605f bytes) 000147 1788179389.960846 write 0x02ffeb thru 0x035763 (0x5779 bytes) 000148 1788179389.962999 trunc from 0x035764 to 0x02bd13 (0x9a50 bytes) 000149 1788179389.980507 trunc from 0x02bd14 to 0x029bba (0x2159 bytes) 000150 1788179390.003118 trunc from 0x029bbb to 0x02c091 (0x24d7 bytes) 000151 1788179390.028343 write 0x034735 thru 0x0395c4 (0x4e90 bytes) 000152 1788179390.029625 mapread 0x034fef thru 0x0395c4 (0x45d6 bytes) 000155 1788179390.039108 read 0x02fb57 thru 0x034d08 (0x51b2 bytes) 000157 1788179390.058446 mapwrite 0x00be47 thru 0x018126 (0xc2e0 bytes) 000158 1788179390.158925 mapwrite 0x022685 thru 0x028492 (0x5e0e bytes) 000159 1788179390.267917 trunc from 0x0395c5 to 0x018be9 (0x209db bytes) 000163 1788179390.320373 trunc from 0x018bea to 0x035f50 (0x1d367 bytes) 000167 1788179390.371613 read 0x02fe08 thru 0x035f50 (0x6149 bytes) 000168 1788179390.390977 read 0x01e2b6 thru 0x02aff5 (0xcd40 bytes) 000169 1788179390.393691 trunc from 0x035f51 to 0x00b67f (0x2a8d1 bytes) 000170 1788179390.428786 mapwrite 0x00fc80 thru 0x019d66 (0xa0e7 bytes) 000171 1788179390.595369 read 0x00f554 thru 0x013873 (0x4320 bytes) 000173 1788179390.602856 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x19d67): Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19d67): Mirror 6: 0xf3c129ef (stale) CRC-32 checksum value for chunk [0, 0x19d67): Mirror 1: 0x2daef90e Mirror 7: 0x2daef90e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19d67: skipped 000174 1788179391.399563 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x19d67): Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19d67): Mirror 6: 0xf3c129ef (stale) CRC-32 checksum value for chunk [0, 0x19d67): Mirror 1: 0x2daef90e Mirror 7: 0x2daef90e Mirror 8: 0x2daef90e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19d67: skipped 000178 1788179392.460035 mapwrite 0x028041 thru 0x034719 (0xc6d9 bytes) 000179 1788179392.829456 read 0x00c13d thru 0x00e63e (0x2502 bytes) 000180 1788179392.837591 mapwrite 0x0104da thru 0x016338 (0x5e5f bytes) 000181 1788179392.909755 write 0x02cb0a thru 0x039b09 (0xd000 bytes) 000183 1788179392.921352 mapread 0x01c3e0 thru 0x025b65 (0x9786 bytes) 000185 1788179392.939392 mapwrite 0x00d325 thru 0x01746f (0xa14b bytes) 000188 1788179393.031322 read 0x024a17 thru 0x03173f (0xcd29 bytes) 000189 1788179393.032650 read 0x013ebf thru 0x01cb98 (0x8cda bytes) 000190 1788179393.034310 write 0x009579 thru 0x00c744 (0x31cc bytes) 000191 1788179393.036040 mapwrite 0x0043f3 thru 0x008f51 (0x4b5f bytes) 000192 1788179393.118216 read 0x02a84f thru 0x031aa1 (0x7253 bytes) 000194 1788179393.121578 mapwrite 0x00e556 thru 0x018e42 (0xa8ed bytes) 000195 1788179393.217526 read 0x0177cc thru 0x017912 (0x147 bytes) 000196 1788179393.218441 trunc from 0x039b0a to 0x027cca (0x11e3f bytes) 000197 1788179393.242556 read 0x01cb46 thru 0x02536f (0x882a bytes) 000198 1788179393.245266 mapwrite 0x02914e thru 0x02e279 (0x512c bytes) 000201 1788179393.321111 mapwrite 0x012773 thru 0x01d37a (0xac08 bytes) 000205 1788179393.462567 mapread 0x024278 thru 0x02e279 (0xa002 bytes) 000206 1788179393.468764 mapread 0x0054b2 thru 0x00d668 (0x81b7 bytes) 000207 1788179393.476725 read 0x00296e thru 0x0120e1 (0xf774 bytes) 000208 1788179393.487600 read 0x00e100 thru 0x0131ed (0x50ee bytes) 000209 1788179393.488279 mapwrite 0x027cf5 thru 0x02a8d6 (0x2be2 bytes) 000210 1788179393.607734 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2e27a): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e27a): Mirror 6: 0xaefb6806 (stale) Mirror 7: 0x521bbb1c (stale) Mirror 8: 0x521bbb1c (stale) CRC-32 checksum value for chunk [0, 0x2e27a): Mirror 1: 0x8a2a14d9 Mirror 9: 0x8a2a14d9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e27a: skipped 000213 1788179394.741869 mapwrite 0x02f89c thru 0x037ef3 (0x8658 bytes) 000214 1788179394.958422 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37ef4): Mirror 6: 0xe99852ac (stale) Mirror 7: 0x74087628 (stale) Mirror 8: 0x74087628 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37ef4): Mirror 6: 0xe99852ac (stale) Mirror 7: 0x74087628 (stale) Mirror 8: 0x74087628 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37ef4: skipped 000215 1788179395.370977 mapwrite 0x013864 thru 0x018bb3 (0x5350 bytes) 000216 1788179395.445687 write 0x039026 thru 0x03ffff (0x6fda bytes) 000217 1788179395.447035 mapread 0x0267bb thru 0x027f1d (0x1763 bytes) 000219 1788179395.459036 mapwrite 0x02be12 thru 0x03ac0f (0xedfe bytes) 000220 1788179395.552323 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x14100420 (stale) Mirror 7: 0x10e62517 (stale) Mirror 8: 0x10e62517 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x190ea6e Mirror 9: 0x190ea6e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000229 1788179396.745964 trunc from 0x040000 to 0x029990 (0x1666f bytes) 000230 1788179396.835744 mapwrite 0x03b135 thru 0x03c909 (0x17d5 bytes) 000231 1788179396.989287 read 0x01e6ec thru 0x02be82 (0xd797 bytes) 000232 1788179397.012734 write 0x03c2ee thru 0x03f7aa (0x34bd bytes) 000234 1788179397.029761 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f7ab): Mirror 7: 0x4b690286 (stale) Mirror 8: 0x4b690286 (stale) Mirror 9: 0x2dff6c35 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f7ab): Mirror 7: 0x4b690286 (stale) Mirror 8: 0x4b690286 (stale) Mirror 9: 0x2dff6c35 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f7ab: skipped 000235 1788179397.609560 trunc from 0x03f7ab to 0x01204d (0x2d75d bytes) 000236 1788179397.636583 trunc from 0x01204e to 0x012e6a (0xe1d bytes) 000238 1788179397.660050 write 0x0237c9 thru 0x029cf0 (0x6528 bytes) 000239 1788179397.662982 mapwrite 0x0027fc thru 0x005303 (0x2b08 bytes) 000240 1788179397.752585 mapwrite 0x037460 thru 0x03ffff (0x8ba0 bytes) 000243 1788179397.890547 MIRROR_RESYNC 4 mirrors 000244 1788179399.668670 trunc from 0x040000 to 0x02652f (0x19ad0 bytes) 000245 1788179399.805916 write 0x03a851 thru 0x03e5f3 (0x3da3 bytes) 000247 1788179399.810879 read 0x006801 thru 0x00884c (0x204c bytes) 000248 1788179399.819629 trunc from 0x03e5f4 to 0x019d0d (0x248e6 bytes) 000249 1788179399.851700 trunc from 0x019d0e to 0x030626 (0x16919 bytes) 000250 1788179399.905474 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x30627): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30627): Mirror 7: 0xb3a4eb08 (stale) Mirror 8: 0xb3a4eb08 (stale) Mirror 9: 0xb3a4eb08 (stale) CRC-32 checksum value for chunk [0, 0x30627): Mirror 1: 0x3d6d6d37 Mirror 10: 0x3d6d6d37 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30627: skipped 000251 1788179401.740580 MIRROR_RESYNC 5 mirrors 000252 1788179403.381332 MIRROR_RESYNC 5 mirrors 000253 1788179403.901577 mapwrite 0x002775 thru 0x00cc98 (0xa524 bytes) 000254 1788179404.197259 write 0x02052b thru 0x0229e1 (0x24b7 bytes) 000256 1788179404.235375 read 0x0089af thru 0x014648 (0xbc9a bytes) 000260 1788179404.257327 read 0x00aa10 thru 0x0152b2 (0xa8a3 bytes) 000262 1788179404.286950 mapread 0x02396d thru 0x02dc61 (0xa2f5 bytes) 000264 1788179404.291033 trunc from 0x030627 to 0x02ee5e (0x17c8 bytes) 000265 1788179404.350364 read 0x011bba thru 0x01d745 (0xbb8c bytes) 000268 1788179404.369541 MIRROR_RESYNC 5 mirrors 000269 1788179406.698494 write 0x01f666 thru 0x02cddb (0xd776 bytes) 000271 1788179406.804962 mapwrite 0x03eb4f thru 0x03ffff (0x14b1 bytes) 000272 1788179406.931723 trunc from 0x040000 to 0x024ba5 (0x1b45a bytes) 000275 1788179407.006020 write 0x039c0b thru 0x03ffff (0x63f5 bytes) 000278 1788179407.018610 trunc from 0x040000 to 0x03a573 (0x5a8c bytes) 000281 1788179407.052620 read 0x03465f thru 0x03a573 (0x5f15 bytes) 000282 1788179407.081489 read 0x02dfca thru 0x03a573 (0xc5aa bytes) 000283 1788179407.105983 mapread 0x01352a thru 0x01e08e (0xab65 bytes) 000287 1788179407.117551 trunc from 0x03a574 to 0x002525 (0x3804e bytes) 000288 1788179407.163321 trunc from 0x002526 to 0x01d750 (0x1b22b bytes) 000290 1788179407.204694 trunc from 0x01d751 to 0x00b0c0 (0x12690 bytes) 000292 1788179407.229891 write 0x033991 thru 0x03ffff (0xc66f bytes) 000294 1788179407.234106 write 0x012ca6 thru 0x01cf9f (0xa2fa bytes) 000297 1788179407.246373 read 0x01a719 thru 0x027cb8 (0xd5a0 bytes) 000299 1788179407.257629 trunc from 0x040000 to 0x00edbe (0x31241 bytes) 000301 1788179407.279896 trunc from 0x00edbf to 0x027b05 (0x18d47 bytes) 000302 1788179407.308899 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x27b06): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27b06): Mirror 7: 0x74874b75 (stale) Mirror 8: 0x74874b75 (stale) Mirror 9: 0x74874b75 (stale) Mirror 10: 0x74874b75 (stale) CRC-32 checksum value for chunk [0, 0x27b06): Mirror 1: 0x9975b0 Mirror 11: 0x9975b0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27b06: skipped 000304 1788179408.999127 read 0x01794b thru 0x01a3f2 (0x2aa8 bytes) 000305 1788179409.020258 MIRROR_RESYNC 6 mirrors 000309 1788179411.044802 trunc from 0x027b06 to 0x0016e8 (0x2641d bytes) 000310 1788179411.128551 mapwrite 0x002809 thru 0x011866 (0xf05e bytes) 000312 1788179411.258388 write 0x01e9c1 thru 0x024539 (0x5b79 bytes) 000314 1788179411.271481 write 0x00d804 thru 0x00f289 (0x1a86 bytes) 000315 1788179411.273657 read 0x003b81 thru 0x005e15 (0x2295 bytes) 000317 1788179411.276948 mapread 0x01c59f thru 0x01c634 (0x96 bytes) 000320 1788179411.317583 trunc from 0x02453a to 0x0331a6 (0xec6d bytes) 000321 1788179411.362064 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x331a7): Mirror 7: 0x7c0b970c (stale) Mirror 8: 0x7c0b970c (stale) Mirror 10: 0x7c0b970c (stale) Mirror 11: 0x7c0b970c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x331a7): Mirror 7: 0x7c0b970c (stale) Mirror 8: 0x7c0b970c (stale) Mirror 10: 0x7c0b970c (stale) Mirror 11: 0x7c0b970c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x331a7: skipped 000325 1788179412.611791 trunc from 0x0331a7 to 0x01219b (0x2100b bytes) 000326 1788179412.641027 trunc from 0x01219c to 0x009e9c (0x82ff bytes) 000329 1788179412.680044 write 0x0115a2 thru 0x012a0f (0x146e bytes) 000333 1788179412.690509 mapread 0x0121c3 thru 0x012a0f (0x84d bytes) truncating to largest ever: 0x3f21b 000334 1788179412.709782 trunc from 0x012a10 to 0x03f21a (0x2c80b bytes) 000335 1788179412.790140 MIRROR_RESYNC 5 mirrors 000336 1788179415.084736 mapread 0x012c5f thru 0x014814 (0x1bb6 bytes) 000338 1788179415.114429 write 0x01a431 thru 0x023c9e (0x986e bytes) 000344 1788179415.377279 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f21b): Mirror 7: 0x77e1e9cd (stale) Mirror 8: 0x77e1e9cd (stale) Mirror 10: 0x77e1e9cd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f21b): Mirror 7: 0x77e1e9cd (stale) Mirror 8: 0x77e1e9cd (stale) Mirror 10: 0x77e1e9cd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f21b: skipped 000345 1788179415.953452 trunc from 0x03f21b to 0x036d2a (0x84f0 bytes) 000346 1788179415.976730 read 0x02031b thru 0x0300e0 (0xfdc6 bytes) 000347 1788179416.005931 mapwrite 0x018dec thru 0x01abc3 (0x1dd8 bytes) 000348 1788179416.207718 trunc from 0x036d2b to 0x014bd3 (0x22157 bytes) 000350 1788179416.279920 mapwrite 0x01be3a thru 0x0245f9 (0x87c0 bytes) 000352 1788179416.523461 mapwrite 0x020702 thru 0x022028 (0x1927 bytes) 000354 1788179416.654426 read 0x01117b thru 0x01869f (0x7525 bytes) 000355 1788179416.701212 read 0x005044 thru 0x00d7f9 (0x87b6 bytes) 000356 1788179416.702222 mapwrite 0x013a54 thru 0x01b94d (0x7efa bytes) 000358 1788179416.792569 mapwrite 0x027931 thru 0x031cf8 (0xa3c8 bytes) 000360 1788179416.913439 read 0x006846 thru 0x008683 (0x1e3e bytes) 000361 1788179416.917550 write 0x0068b3 thru 0x006ad7 (0x225 bytes) 000362 1788179416.920243 trunc from 0x031cf9 to 0x0118c1 (0x20437 bytes) 000365 1788179416.946550 mapwrite 0x03b705 thru 0x03ffff (0x48fb bytes) 000367 1788179417.048359 read 0x027103 thru 0x035897 (0xe795 bytes) 000369 1788179417.055786 read 0x016f87 thru 0x025ffb (0xf075 bytes) 000371 1788179417.060645 trunc from 0x040000 to 0x035c7b (0xa384 bytes) 000373 1788179417.085474 mapwrite 0x0194f0 thru 0x01a9b7 (0x14c8 bytes) 000375 1788179417.143187 read 0x01295b thru 0x020596 (0xdc3c bytes) 000377 1788179417.146422 write 0x01508f thru 0x019448 (0x43ba bytes) 000379 1788179417.151459 mapwrite 0x013293 thru 0x017588 (0x42f6 bytes) 000380 1788179417.259726 mapwrite 0x00d1bf thru 0x015508 (0x834a bytes) 000381 1788179417.382844 write 0x00ddb6 thru 0x01aad7 (0xcd22 bytes) 000382 1788179417.385667 trunc from 0x035c7c to 0x00f576 (0x26705 bytes) 000383 1788179417.410256 mapwrite 0x01f617 thru 0x025952 (0x633c bytes) 000386 1788179417.521915 mapread 0x00d952 thru 0x011567 (0x3c16 bytes) 000387 1788179417.523880 read 0x0134d3 thru 0x021f57 (0xea85 bytes) 000388 1788179417.525822 trunc from 0x025953 to 0x01c200 (0x9752 bytes) 000389 1788179417.547142 write 0x03553a thru 0x038415 (0x2edc bytes) 000390 1788179417.548599 read 0x025faf thru 0x02cad2 (0x6b24 bytes) 000391 1788179417.565206 mapread 0x02d795 thru 0x03587a (0x80e6 bytes) 000392 1788179417.567361 mapwrite 0x029f4b thru 0x0385e6 (0xe69c bytes) 000393 1788179417.787004 trunc from 0x0385e7 to 0x03d03f (0x4a59 bytes) 000394 1788179417.817051 read 0x0053ca thru 0x0087c5 (0x33fc bytes) 000395 1788179417.817853 trunc from 0x03d040 to 0x00cbda (0x30465 bytes) 000397 1788179417.848123 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xcbdb): Mirror 8: 0xfae5e6d8 (stale) Mirror 10: 0xfae5e6d8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xcbdb): Mirror 8: 0xfae5e6d8 (stale) Mirror 10: 0xfae5e6d8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xcbdb: skipped 000398 1788179418.196283 MIRROR_RESYNC 3 mirrors 000399 1788179419.052718 MIRROR_RESYNC 3 mirrors 000400 1788179419.460412 mapwrite 0x0215f7 thru 0x02e6f1 (0xd0fb bytes) 000402 1788179419.729093 read 0x01512e thru 0x01ee0b (0x9cde bytes) 000406 1788179419.744478 mapwrite 0x02443f thru 0x02698c (0x254e bytes) 000407 1788179419.781656 write 0x029d2e thru 0x039309 (0xf5dc bytes) 000409 1788179419.784754 mapwrite 0x003e29 thru 0x00e759 (0xa931 bytes) 000410 1788179419.925789 write 0x01965f thru 0x029446 (0xfde8 bytes) 000411 1788179419.936517 mapwrite 0x02a148 thru 0x02dfdd (0x3e96 bytes) 000412 1788179420.054812 mapread 0x002b54 thru 0x012930 (0xfddd bytes) 000413 1788179420.087615 MIRROR_RESYNC 3 mirrors 000414 1788179422.141793 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) 000415 1788179422.701121 mapread 0x022863 thru 0x0317da (0xef78 bytes) 000418 1788179422.785717 mapwrite 0x008a26 thru 0x01593f (0xcf1a bytes) 000419 1788179423.160020 mapwrite 0x038fdf thru 0x03ffff (0x7021 bytes) 000428 1788179423.305566 read 0x016052 thru 0x018429 (0x23d8 bytes) 000429 1788179423.316881 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) 000432 1788179423.560699 mapwrite 0x02e287 thru 0x032b9e (0x4918 bytes) 000433 1788179423.723841 read 0x026daf thru 0x031114 (0xa366 bytes) 000437 1788179423.766795 mapwrite 0x00244f thru 0x00db98 (0xb74a bytes) 000438 1788179423.981298 trunc from 0x040000 to 0x01dd44 (0x222bb bytes) 000444 1788179424.037241 read 0x01c7ec thru 0x01dd44 (0x1559 bytes) 000445 1788179424.058703 mapwrite 0x008d1f thru 0x00a06d (0x134f bytes) 000447 1788179424.277610 mapwrite 0x036b78 thru 0x038a21 (0x1eaa bytes) 000448 1788179424.415509 write 0x000d5e thru 0x00fc9a (0xef3d bytes) 000449 1788179424.420753 write 0x006f9a thru 0x00c6d7 (0x573e bytes) 000450 1788179424.423700 trunc from 0x038a22 to 0x0035f9 (0x35428 bytes) 000451 1788179424.452419 mapread 0x001322 thru 0x0035f9 (0x22d8 bytes) 000452 1788179424.453700 trunc from 0x0035fa to 0x018b44 (0x1554b bytes) 000454 1788179424.478751 read 0x0093e7 thru 0x011408 (0x8022 bytes) 000456 1788179424.506006 read 0x006af7 thru 0x016a70 (0xff7a bytes) 000457 1788179424.507737 mapwrite 0x012bf7 thru 0x01796f (0x4d79 bytes) 000458 1788179424.764700 read 0x015abf thru 0x018b44 (0x3086 bytes) 000459 1788179424.765393 trunc from 0x018b45 to 0x0141c8 (0x497c bytes) 000460 1788179424.794140 trunc from 0x0141c9 to 0x03833e (0x24176 bytes) 000461 1788179424.837675 read 0x013a37 thru 0x02074e (0xcd18 bytes) 000463 1788179424.865767 mapwrite 0x02dbb5 thru 0x03212c (0x4578 bytes) 000464 1788179425.024255 read 0x02809d thru 0x02f184 (0x70e8 bytes) 000465 1788179425.026667 trunc from 0x03833f to 0x00e5c8 (0x29d76 bytes) 000468 1788179425.077896 mapwrite 0x00b2a4 thru 0x00dc54 (0x29b1 bytes) 000472 1788179425.190784 mapread 0x00d672 thru 0x00e5c8 (0xf57 bytes) 000473 1788179425.194493 mapwrite 0x03df6f thru 0x03ffff (0x2091 bytes) 000475 1788179425.355628 mapwrite 0x0043a6 thru 0x009ec4 (0x5b1f bytes) 000476 1788179425.481858 read 0x03c329 thru 0x03ffff (0x3cd7 bytes) 000477 1788179425.482616 mapread 0x01c0cd thru 0x027c42 (0xbb76 bytes) 000478 1788179425.488172 read 0x025a06 thru 0x0357b7 (0xfdb2 bytes) 000479 1788179425.489115 read 0x012736 thru 0x01fa0f (0xd2da bytes) 000480 1788179425.489772 read 0x035aa5 thru 0x037031 (0x158d bytes) 000481 1788179425.490539 write 0x01b4a7 thru 0x023c04 (0x875e bytes) 000482 1788179425.491981 write 0x03d7ab thru 0x03e829 (0x107f bytes) 000483 1788179425.493215 read 0x02ab3b thru 0x0306cc (0x5b92 bytes) 000484 1788179425.494046 trunc from 0x040000 to 0x01d99c (0x22663 bytes) 000486 1788179425.518314 trunc from 0x01d99d to 0x02a784 (0xcde8 bytes) 000487 1788179425.563585 mapread 0x023a98 thru 0x028d5b (0x52c4 bytes) 000490 1788179425.583772 write 0x015820 thru 0x020680 (0xae61 bytes) 000492 1788179425.597403 trunc from 0x02a785 to 0x00326a (0x2751a bytes) 000493 1788179425.621705 mapread 0x0021e4 thru 0x00326a (0x1087 bytes) 000499 1788179425.636936 write 0x03a501 thru 0x03ffff (0x5aff bytes) 000502 1788179425.645390 write 0x039283 thru 0x03a96e (0x16ec bytes) 000504 1788179425.663381 mapwrite 0x004a00 thru 0x010248 (0xb849 bytes) 000505 1788179425.929850 write 0x013860 thru 0x02063f (0xcde0 bytes) 000507 1788179425.941965 read 0x009ca8 thru 0x015776 (0xbacf bytes) 000508 1788179425.951063 trunc from 0x040000 to 0x037cbc (0x8343 bytes) 000510 1788179425.973688 trunc from 0x037cbd to 0x009ea4 (0x2de18 bytes) 000514 1788179426.046879 trunc from 0x009ea5 to 0x01248a (0x85e6 bytes) 000515 1788179426.075430 trunc from 0x01248b to 0x009c83 (0x8807 bytes) 000516 1788179426.119769 read 0x0077e0 thru 0x009c83 (0x24a4 bytes) 000517 1788179426.121715 mapwrite 0x01d265 thru 0x02c891 (0xf62d bytes) 000521 1788179426.313413 trunc from 0x02c892 to 0x02bbff (0xc92 bytes) 000522 1788179426.338689 write 0x017326 thru 0x0250f5 (0xddd0 bytes) 000524 1788179426.353093 write 0x02df5b thru 0x037bbe (0x9c64 bytes) 000525 1788179426.357769 trunc from 0x037bbf to 0x035a37 (0x2187 bytes) 000528 1788179426.398385 mapwrite 0x02cf71 thru 0x035d95 (0x8e25 bytes) 000529 1788179426.661269 mapwrite 0x018003 thru 0x026863 (0xe861 bytes) 000530 1788179426.789184 read 0x001f31 thru 0x00fd0f (0xdddf bytes) 000531 1788179426.789909 write 0x0392d2 thru 0x03ffff (0x6d2e bytes) 000533 1788179426.804503 MIRROR_EXTEND to 2 mirrors 000535 1788179428.000291 MIRROR_RESYNC 2 mirrors 000536 1788179428.362831 read 0x036179 thru 0x03652d (0x3b5 bytes) 000542 1788179428.370862 read 0x026eec thru 0x03661e (0xf733 bytes) 000543 1788179428.380655 trunc from 0x040000 to 0x00b8a2 (0x3475d bytes) 000546 1788179428.624831 read 0x008bc5 thru 0x00b8a2 (0x2cde bytes) 000547 1788179428.649323 mapwrite 0x01fdab thru 0x0291d7 (0x942d bytes) 000550 1788179428.859049 write 0x012dc0 thru 0x0136e8 (0x929 bytes) 000552 1788179428.865585 mapwrite 0x0235a7 thru 0x0235d5 (0x2f bytes) 000553 1788179428.927088 mapread 0x022f0d thru 0x023bb5 (0xca9 bytes) 000554 1788179428.929714 trunc from 0x0291d8 to 0x011139 (0x1809e bytes) 000556 1788179428.959697 mapwrite 0x02a1c3 thru 0x034f51 (0xad8f bytes) 000558 1788179429.054790 mapread 0x026009 thru 0x02fe82 (0x9e7a bytes) 000559 1788179429.078318 write 0x014c58 thru 0x01cd34 (0x80dd bytes) 000560 1788179429.116850 write 0x02e27d thru 0x03a749 (0xc4cd bytes) 000563 1788179429.124515 read 0x038b15 thru 0x03a749 (0x1c35 bytes) 000564 1788179429.125782 trunc from 0x03a74a to 0x0359cd (0x4d7c bytes) 000565 1788179429.159126 trunc from 0x0359ce to 0x01fa41 (0x15f8c bytes) 000566 1788179429.218114 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1fa42): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fa42): Mirror 2: 0xbc84bb2c (stale) CRC-32 checksum value for chunk [0, 0x1fa42): Mirror 1: 0x244af0f Mirror 3: 0x244af0f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fa42: skipped 000568 1788179430.846428 trunc from 0x01fa42 to 0x014808 (0xb239 bytes) 000569 1788179431.033100 MIRROR_RESYNC 3 mirrors 000570 1788179432.339815 mapwrite 0x000005 thru 0x007655 (0x7651 bytes) 000571 1788179432.745378 write 0x02880e thru 0x02e0fc (0x58ef bytes) 000573 1788179432.753387 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2e0fd): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e0fd): Mirror 2: 0xe3c69bfa (stale) Mirror 3: 0xe3c69bfa (stale) CRC-32 checksum value for chunk [0, 0x2e0fd): Mirror 1: 0x16f9c575 Mirror 4: 0x16f9c575 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e0fd: skipped 000575 1788179434.692029 trunc from 0x02e0fd to 0x029da6 (0x4356 bytes) truncating to largest ever: 0x3fbb2 000577 1788179434.858689 trunc from 0x029da7 to 0x03fbb1 (0x15e0b bytes) 000578 1788179434.917820 trunc from 0x03fbb2 to 0x00d6f4 (0x324bd bytes) 000580 1788179434.954899 mapwrite 0x03677b thru 0x036b66 (0x3ec bytes) 000581 1788179435.106404 trunc from 0x036b67 to 0x03bca5 (0x513f bytes) 000583 1788179435.142922 mapwrite 0x01d614 thru 0x01e061 (0xa4e bytes) 000584 1788179435.314743 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bca6): Mirror 3: 0xd2a0ae60 (stale) Mirror 4: 0x1416dab4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bca6): Mirror 3: 0xd2a0ae60 (stale) Mirror 4: 0x1416dab4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bca6: skipped 000586 1788179435.945403 trunc from 0x03bca6 to 0x02cdfb (0xeeaa bytes) 000587 1788179435.963169 write 0x0052f8 thru 0x00add1 (0x5ada bytes) 000589 1788179435.980330 mapwrite 0x00315c thru 0x007854 (0x46f9 bytes) 000590 1788179436.079880 read 0x01d728 thru 0x02c640 (0xef19 bytes) 000591 1788179436.095483 read 0x01a153 thru 0x01e634 (0x44e2 bytes) 000593 1788179436.113378 write 0x004fec thru 0x0103ad (0xb3c2 bytes) 000597 1788179436.127179 MIRROR_RESYNC 3 mirrors 000599 1788179437.488215 trunc from 0x02cdfc to 0x029f96 (0x2e65 bytes) 000600 1788179437.579625 write 0x036935 thru 0x03a45a (0x3b26 bytes) 000603 1788179437.595479 mapwrite 0x02f648 thru 0x03db41 (0xe4fa bytes) 000606 1788179437.694069 mapread 0x00783e thru 0x00ff3a (0x86fd bytes) 000607 1788179437.707647 mapwrite 0x0013ff thru 0x007399 (0x5f9b bytes) 000609 1788179437.766089 trunc from 0x03db42 to 0x02ade4 (0x12d5d bytes) 000610 1788179437.792578 write 0x000700 thru 0x002ea7 (0x27a8 bytes) 000611 1788179437.828620 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ade5): Mirror 3: 0x2bbac10e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ade5): Mirror 3: 0x2bbac10e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ade5: skipped 000612 1788179438.195399 mapread 0x0021b5 thru 0x00f91b (0xd767 bytes) 000614 1788179438.220671 read 0x0138f1 thru 0x021a71 (0xe181 bytes) 000617 1788179438.237836 MIRROR_RESYNC 2 mirrors 000618 1788179439.260447 write 0x000be5 thru 0x00b6c6 (0xaae2 bytes) 000624 1788179439.385468 read 0x01d5bf thru 0x02944c (0xbe8e bytes) 000625 1788179439.408244 MIRROR_RESYNC 2 mirrors 000626 1788179440.711136 write 0x0228a2 thru 0x0304c5 (0xdc24 bytes) 000628 1788179440.814070 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) 000629 1788179441.121367 write 0x0244dd thru 0x026f6c (0x2a90 bytes) 000636 1788179441.175734 mapwrite 0x039eb2 thru 0x03ffff (0x614e bytes) 000637 1788179441.326442 write 0x037ce2 thru 0x03b2db (0x35fa bytes) 000638 1788179441.328442 trunc from 0x040000 to 0x00664b (0x399b4 bytes) 000642 1788179441.347607 mapwrite 0x00ba5c thru 0x01af23 (0xf4c8 bytes) 000646 1788179441.502701 mapread 0x004c9a thru 0x012a63 (0xddca bytes) 000647 1788179441.509337 write 0x01ae78 thru 0x022ec5 (0x804e bytes) 000648 1788179441.513393 trunc from 0x022ec6 to 0x00b0af (0x17e16 bytes) 000649 1788179441.565189 mapread 0x0062ab thru 0x00b0af (0x4e05 bytes) 000650 1788179441.572189 mapwrite 0x02c78c thru 0x02eda5 (0x261a bytes) 000655 1788179441.665438 write 0x02bf19 thru 0x02c2ed (0x3d5 bytes) 000659 1788179441.670424 write 0x020760 thru 0x028425 (0x7cc6 bytes) 000661 1788179441.683418 MIRROR_EXTEND to 2 mirrors 000662 1788179442.742494 MIRROR_RESYNC 2 mirrors 000663 1788179443.284569 mapwrite 0x023271 thru 0x02e76b (0xb4fb bytes) 000664 1788179443.496089 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2eda6): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2eda6): Mirror 2: 0xa9af46ab (stale) CRC-32 checksum value for chunk [0, 0x2eda6): Mirror 1: 0xe59e78ad Mirror 3: 0xe59e78ad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2eda6: skipped 000667 1788179444.906354 read 0x01ce09 thru 0x0234ae (0x66a6 bytes) 000670 1788179444.936422 mapwrite 0x020cbd thru 0x027d09 (0x704d bytes) 000671 1788179445.117693 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2eda6): Mirror 3: 0xe59e78ad (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2eda6): Mirror 3: 0xe59e78ad (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2eda6: skipped 000672 1788179445.496772 mapread 0x009311 thru 0x009b8f (0x87f bytes) 000674 1788179445.509185 write 0x006c78 thru 0x0085fd (0x1986 bytes) 000676 1788179445.532719 mapwrite 0x01c696 thru 0x0269cc (0xa337 bytes) 000678 1788179445.677369 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2eda6): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2eda6): Mirror 3: 0xe59e78ad (stale) CRC-32 checksum value for chunk [0, 0x2eda6): Mirror 1: 0xa8e7fb7e Mirror 4: 0xa8e7fb7e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2eda6: skipped 000681 1788179447.049291 mapread 0x00ec89 thru 0x01246f (0x37e7 bytes) 000682 1788179447.090684 mapread 0x002b5a thru 0x006570 (0x3a17 bytes) 000683 1788179447.122315 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2eda6): Mirror 3: 0xe59e78ad (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2eda6): Mirror 3: 0xe59e78ad (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2eda6: skipped 000685 1788179447.527703 trunc from 0x02eda6 to 0x03cddf (0xe03a bytes) 000687 1788179447.555070 mapwrite 0x00dc3f thru 0x01128f (0x3651 bytes) 000688 1788179447.616716 write 0x029480 thru 0x03595b (0xc4dc bytes) 000689 1788179447.626278 mapwrite 0x02663a thru 0x02d6e3 (0x70aa bytes) 000690 1788179447.676021 mapwrite 0x012208 thru 0x0152f1 (0x30ea bytes) 000691 1788179447.711344 trunc from 0x03cde0 to 0x03c4d9 (0x906 bytes) 000692 1788179447.737142 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) 000694 1788179447.927765 write 0x0379bb thru 0x03dc1d (0x6263 bytes) 000695 1788179447.935523 write 0x007c05 thru 0x00fa94 (0x7e90 bytes) 000698 1788179447.950042 mapread 0x024a53 thru 0x02db3d (0x90eb bytes) 000699 1788179447.970616 mapwrite 0x001f52 thru 0x00cfcb (0xb07a bytes) 000700 1788179448.056032 mapwrite 0x00cb96 thru 0x00f4b9 (0x2924 bytes) 000701 1788179448.095254 write 0x0273bd thru 0x030fe6 (0x9c2a bytes) 000702 1788179448.108075 mapwrite 0x032ab8 thru 0x03ffff (0xd548 bytes) 000704 1788179448.225275 read 0x030bdc thru 0x03aa6d (0x9e92 bytes) 000705 1788179448.230912 mapwrite 0x03b3e9 thru 0x03ffff (0x4c17 bytes) 000706 1788179448.297584 write 0x01f13c thru 0x02528d (0x6152 bytes) 000707 1788179448.299081 trunc from 0x040000 to 0x03bc40 (0x43bf bytes) 000708 1788179448.318338 mapread 0x031ec7 thru 0x03b803 (0x993d bytes) 000710 1788179448.328237 trunc from 0x03bc41 to 0x034d15 (0x6f2b bytes) 000717 1788179448.373657 trunc from 0x034d16 to 0x031d97 (0x2f7e bytes) 000721 1788179448.400329 mapwrite 0x022b39 thru 0x027040 (0x4508 bytes) 000722 1788179448.466604 write 0x028280 thru 0x033acf (0xb850 bytes) 000723 1788179448.468275 mapread 0x0055d2 thru 0x01236c (0xcd9b bytes) 000724 1788179448.479869 read 0x01d8dc thru 0x02bb70 (0xe295 bytes) 000727 1788179448.492185 read 0x01f9f0 thru 0x026bed (0x71fe bytes) 000728 1788179448.493018 read 0x01621c thru 0x01ea01 (0x87e6 bytes) 000729 1788179448.493744 mapwrite 0x006dd9 thru 0x01266b (0xb893 bytes) 000730 1788179448.534690 mapread 0x0265b9 thru 0x031b1f (0xb567 bytes) 000731 1788179448.536429 read 0x012c63 thru 0x01b099 (0x8437 bytes) 000733 1788179448.538330 mapread 0x022101 thru 0x0255e7 (0x34e7 bytes) 000734 1788179448.540339 mapwrite 0x00972e thru 0x00bd70 (0x2643 bytes) 000736 1788179448.600757 write 0x03eb9d thru 0x03ffff (0x1463 bytes) 000737 1788179448.608258 mapread 0x008d58 thru 0x00ff03 (0x71ac bytes) 000739 1788179448.624661 MIRROR_EXTEND to 2 mirrors 000741 1788179449.316061 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) 000742 1788179449.490563 MIRROR_EXTEND to 2 mirrors 000743 1788179450.179768 mapwrite 0x03ea09 thru 0x03ffff (0x15f7 bytes) 000744 1788179450.347782 write 0x02a6e7 thru 0x037992 (0xd2ac bytes) 000746 1788179450.374707 read 0x01e1ce thru 0x01eccd (0xb00 bytes) 000748 1788179450.382395 mapwrite 0x00a01e thru 0x00ce4a (0x2e2d bytes) 000749 1788179450.511038 write 0x030bb3 thru 0x03947f (0x88cd bytes) 000751 1788179450.516269 mapread 0x037010 thru 0x03ca34 (0x5a25 bytes) 000753 1788179450.519754 mapwrite 0x016f5d thru 0x01ad86 (0x3e2a bytes) 000754 1788179450.681240 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) 000755 1788179450.836988 write 0x024b03 thru 0x02956a (0x4a68 bytes) 000758 1788179450.854361 mapread 0x02f9e3 thru 0x03589a (0x5eb8 bytes) 000759 1788179450.879257 mapwrite 0x01415a thru 0x01f8b1 (0xb758 bytes) 000760 1788179450.963669 mapwrite 0x00eeb5 thru 0x01e1df (0xf32b bytes) 000762 1788179451.045763 trunc from 0x040000 to 0x02f9ba (0x10645 bytes) 000763 1788179451.084964 read 0x00dc70 thru 0x01a512 (0xc8a3 bytes) 000764 1788179451.086475 mapread 0x013092 thru 0x01fa97 (0xca06 bytes) 000765 1788179451.088473 trunc from 0x02f9bb to 0x028617 (0x73a3 bytes) 000766 1788179451.124538 mapread 0x01abf9 thru 0x01ed8f (0x4197 bytes) 000767 1788179451.126133 mapread 0x00b07a thru 0x00c80a (0x1791 bytes) 000769 1788179451.140413 trunc from 0x028618 to 0x00529a (0x2337d bytes) 000772 1788179451.168977 write 0x033f20 thru 0x03f52e (0xb60f bytes) 000774 1788179451.172355 trunc from 0x03f52f to 0x02f890 (0xfc9e bytes) 000775 1788179451.188085 read 0x009cc3 thru 0x00d151 (0x348f bytes) 000776 1788179451.228112 write 0x01bdc4 thru 0x02087f (0x4abc bytes) 000778 1788179451.229813 read 0x002844 thru 0x0062a6 (0x3a63 bytes) 000779 1788179451.231419 mapwrite 0x03475b thru 0x03ffff (0xb8a5 bytes) 000780 1788179451.345775 mapwrite 0x02b353 thru 0x033fce (0x8c7c bytes) 000784 1788179451.431076 read 0x03bc17 thru 0x03ffff (0x43e9 bytes) 000785 1788179451.433412 trunc from 0x040000 to 0x03a5a3 (0x5a5c bytes) 000786 1788179451.466926 write 0x01d815 thru 0x023ac6 (0x62b2 bytes) 000787 1788179451.469190 write 0x036a06 thru 0x03ffff (0x95fa bytes) 000788 1788179451.471619 read 0x022105 thru 0x022db0 (0xcac bytes) 000789 1788179451.475134 mapwrite 0x03da4d thru 0x03ffff (0x25b3 bytes) 000790 1788179451.538316 trunc from 0x040000 to 0x0160e8 (0x29f17 bytes) 000791 1788179451.555323 trunc from 0x0160e9 to 0x0074aa (0xec3e bytes) 000792 1788179451.577325 mapwrite 0x02a16e thru 0x0319d8 (0x786b bytes) 000796 1788179451.673959 read 0x022594 thru 0x028540 (0x5fad bytes) 000800 1788179451.677766 mapread 0x0031e9 thru 0x011fe5 (0xedfd bytes) 000801 1788179451.679493 write 0x0055d5 thru 0x00eea8 (0x98d4 bytes) 000803 1788179451.682603 mapread 0x00a249 thru 0x019c95 (0xfa4d bytes) 000806 1788179451.686252 mapread 0x012972 thru 0x013738 (0xdc7 bytes) 000807 1788179451.688063 read 0x005018 thru 0x00949c (0x4485 bytes) 000808 1788179451.688796 mapread 0x01527f thru 0x020b6b (0xb8ed bytes) 000810 1788179451.691212 trunc from 0x0319d9 to 0x020a0a (0x10fce bytes) 000811 1788179451.707863 mapread 0x00dc5c thru 0x012b81 (0x4f26 bytes) 000812 1788179451.714505 MIRROR_EXTEND to 2 mirrors 000814 1788179452.824086 mapwrite 0x0298d9 thru 0x030b8d (0x72b5 bytes) 000815 1788179453.060298 write 0x012df2 thru 0x021b84 (0xed93 bytes) 000816 1788179453.072506 mapread 0x02b3c6 thru 0x02fbf2 (0x482d bytes) 000820 1788179453.077248 mapwrite 0x01a60c thru 0x024203 (0x9bf8 bytes) 000823 1788179453.170584 trunc from 0x030b8e to 0x001227 (0x2f966 bytes) 000827 1788179453.222108 write 0x02aa75 thru 0x039d4c (0xf2d8 bytes) 000829 1788179453.226947 write 0x0135cb thru 0x015fdb (0x2a11 bytes) 000831 1788179453.241561 mapwrite 0x034c89 thru 0x0365b4 (0x192c bytes) 000832 1788179453.327122 read 0x01e431 thru 0x02c4dd (0xe0ad bytes) 000833 1788179453.351956 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x39d4d): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39d4d): Mirror 2: 0xa8f7699a (stale) CRC-32 checksum value for chunk [0, 0x39d4d): Mirror 1: 0xff40e39 Mirror 3: 0xff40e39 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39d4d: skipped 000835 1788179454.732844 read 0x034147 thru 0x034804 (0x6be bytes) 000836 1788179454.762426 mapread 0x006457 thru 0x008b1a (0x26c4 bytes) 000838 1788179454.835025 trunc from 0x039d4d to 0x01a76f (0x1f5dd bytes) 000839 1788179454.928104 mapread 0x00eafc thru 0x01a76f (0xbc74 bytes) 000840 1788179454.954019 write 0x024a09 thru 0x033c47 (0xf23f bytes) 000842 1788179454.959560 read 0x001d07 thru 0x00d892 (0xbb8c bytes) 000843 1788179454.979512 trunc from 0x033c48 to 0x02135b (0x128ec bytes) 000844 1788179455.024711 MIRROR_RESYNC 3 mirrors 000846 1788179456.433750 MIRROR_RESYNC 3 mirrors 000847 1788179457.000441 read 0x01f330 thru 0x02135b (0x202c bytes) 000848 1788179457.011840 mapwrite 0x03f16b thru 0x03ffff (0xe95 bytes) 000849 1788179457.182385 write 0x02bc78 thru 0x02c37c (0x705 bytes) 000854 1788179457.207842 trunc from 0x040000 to 0x033399 (0xcc66 bytes) 000856 1788179457.255784 write 0x031ae6 thru 0x035756 (0x3c71 bytes) 000857 1788179457.283695 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35757): Mirror 3: 0xa2555512 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35757): Mirror 3: 0xa2555512 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35757: skipped 000859 1788179457.700281 write 0x01fb18 thru 0x020eb8 (0x13a1 bytes) 000861 1788179457.713464 read 0x01daa2 thru 0x02801a (0xa579 bytes) 000864 1788179457.731112 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x35757): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35757): Mirror 3: 0xa2555512 (stale) CRC-32 checksum value for chunk [0, 0x35757): Mirror 1: 0xddda71e0 Mirror 4: 0xddda71e0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35757: skipped 000866 1788179459.409899 read 0x01bf01 thru 0x020cb3 (0x4db3 bytes) 000870 1788179459.484283 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) 000871 1788179459.878734 read 0x01a303 thru 0x02191b (0x7619 bytes) 000872 1788179459.894499 mapwrite 0x00b8f4 thru 0x012b36 (0x7243 bytes) 000873 1788179460.110924 read 0x033ebd thru 0x035756 (0x189a bytes) 000874 1788179460.154045 MIRROR_RESYNC 2 mirrors 000875 1788179460.928953 read 0x009ee2 thru 0x00b732 (0x1851 bytes) 000877 1788179460.949636 MIRROR_EXTEND to 3 mirrors 000878 1788179461.719944 write 0x026600 thru 0x02b78b (0x518c bytes) 000880 1788179461.836669 mapwrite 0x015363 thru 0x0227ee (0xd48c bytes) 000881 1788179462.028132 mapwrite 0x01fe5f thru 0x024783 (0x4925 bytes) 000883 1788179462.078030 write 0x018898 thru 0x02664c (0xddb5 bytes) 000886 1788179462.081678 write 0x02368a thru 0x02919f (0x5b16 bytes) 000887 1788179462.083625 mapwrite 0x01ba6e thru 0x01d250 (0x17e3 bytes) 000888 1788179462.168566 write 0x00c5bf thru 0x01018d (0x3bcf bytes) 000889 1788179462.184893 mapread 0x02a69a thru 0x035756 (0xb0bd bytes) 000890 1788179462.205974 write 0x009d62 thru 0x0196a6 (0xf945 bytes) 000893 1788179462.222118 mapwrite 0x0151d1 thru 0x01f299 (0xa0c9 bytes) 000894 1788179462.302566 write 0x02e395 thru 0x03dfdf (0xfc4b bytes) 000897 1788179462.316980 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dfe0): Mirror 5: 0xe4fd20c0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dfe0): Mirror 5: 0xe4fd20c0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dfe0: skipped 000899 1788179462.696345 MIRROR_RESYNC 2 mirrors 000900 1788179463.568665 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) 000901 1788179463.760523 mapwrite 0x02dceb thru 0x0351c3 (0x74d9 bytes) 000903 1788179463.842921 trunc from 0x03dfe0 to 0x010b73 (0x2d46c bytes) 000905 1788179463.860662 mapread 0x00fe0d thru 0x010b73 (0xd67 bytes) 000911 1788179463.880492 MIRROR_EXTEND to 2 mirrors 000913 1788179464.619580 mapread 0x0006c3 thru 0x0009b4 (0x2f2 bytes) 000914 1788179464.625472 write 0x017822 thru 0x022feb (0xb7ca bytes) 000915 1788179464.705792 mapread 0x0135d1 thru 0x01fe19 (0xc849 bytes) 000916 1788179464.744218 MIRROR_RESYNC 2 mirrors 000917 1788179465.563241 mapwrite 0x0243f8 thru 0x03260d (0xe216 bytes) 000918 1788179465.736926 trunc from 0x03260e to 0x02ea24 (0x3be9 bytes) 000919 1788179465.763522 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) 000920 1788179465.949256 write 0x017779 thru 0x01e78c (0x7014 bytes) 000922 1788179465.962002 write 0x02bdac thru 0x03b636 (0xf88b bytes) 000923 1788179465.969905 read 0x01a778 thru 0x028eb0 (0xe739 bytes) 000925 1788179465.984808 write 0x030a8a thru 0x038809 (0x7d80 bytes) 000927 1788179465.987716 write 0x024740 thru 0x032eab (0xe76c bytes) 000929 1788179465.995552 trunc from 0x03b637 to 0x0217be (0x19e78 bytes) 000932 1788179466.013760 read 0x006a7c thru 0x010c1a (0xa19f bytes) 000935 1788179466.029945 read 0x019bbf thru 0x01f812 (0x5c54 bytes) 000939 1788179466.036871 trunc from 0x0217bf to 0x00fcd9 (0x11ae5 bytes) 000941 1788179466.084845 read 0x00c256 thru 0x00fcd9 (0x3a84 bytes) 000942 1788179466.085580 write 0x01191a thru 0x013150 (0x1837 bytes) 000945 1788179466.092757 write 0x02a2c1 thru 0x02ace6 (0xa26 bytes) 000946 1788179466.106386 MIRROR_EXTEND to 2 mirrors 000947 1788179466.990690 MIRROR_EXTEND to 3 mirrors 000948 1788179467.879770 trunc from 0x02ace7 to 0x02b368 (0x682 bytes) 000949 1788179468.018987 trunc from 0x02b369 to 0x03286a (0x7502 bytes) 000951 1788179468.051500 read 0x0116e0 thru 0x01b719 (0xa03a bytes) 000952 1788179468.091944 mapwrite 0x0136e8 thru 0x01a70f (0x7028 bytes) 000953 1788179468.159050 mapwrite 0x01fb82 thru 0x02e83f (0xecbe bytes) 000954 1788179468.277905 mapwrite 0x004115 thru 0x00b21e (0x710a bytes) 000955 1788179468.335467 mapwrite 0x010d2f thru 0x01a829 (0x9afb bytes) 000956 1788179468.382404 read 0x0091e5 thru 0x016a8e (0xd8aa bytes) 000958 1788179468.385284 mapwrite 0x02d6c0 thru 0x02e9a5 (0x12e6 bytes) 000959 1788179468.432401 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3286b): Mirror 3: 0xfac3e14f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3286b): Mirror 3: 0xfac3e14f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3286b: skipped 000961 1788179468.813134 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18e:0x0]: Invalid argument (22) 000962 1788179469.027043 trunc from 0x03286b to 0x007d5f (0x2ab0b bytes) 000963 1788179469.049588 mapwrite 0x02b859 thru 0x02d82c (0x1fd4 bytes) 000965 1788179469.169630 mapwrite 0x007902 thru 0x00fa1f (0x811e bytes) 000966 1788179469.269510 write 0x01260e thru 0x021a84 (0xf477 bytes) 000967 1788179469.285233 mapread 0x0014fe thru 0x00c075 (0xab78 bytes) 000972 1788179469.292143 write 0x02e2e4 thru 0x038cd1 (0xa9ee bytes) 000973 1788179469.295597 read 0x00adcd thru 0x014112 (0x9346 bytes) 000975 1788179469.306264 mapwrite 0x004685 thru 0x0097d3 (0x514f bytes) 000979 1788179469.394073 write 0x00eeb3 thru 0x01caa7 (0xdbf5 bytes) 000980 1788179469.396516 trunc from 0x038cd2 to 0x03bcc4 (0x2ff3 bytes) 000983 1788179469.439396 trunc from 0x03bcc5 to 0x036a5c (0x5268 bytes) 000986 1788179469.465785 write 0x0296d1 thru 0x035d25 (0xc655 bytes) 000987 1788179469.468876 mapwrite 0x0184fb thru 0x01f787 (0x728d bytes) 000989 1788179469.521375 mapwrite 0x01232b thru 0x016bd4 (0x48aa bytes) 000990 1788179469.576007 mapwrite 0x0341fd thru 0x039805 (0x5609 bytes) 000991 1788179469.740594 read 0x033518 thru 0x038266 (0x4d4f bytes) 000994 1788179469.745909 write 0x0028b1 thru 0x008555 (0x5ca5 bytes) 000999 1788179469.764717 read 0x019a91 thru 0x01d6e2 (0x3c52 bytes) All operations completed A-OK!