== sanity-flr test 70a: flr mode fsx test ================ 06:25:53 (1788776753) Seed set to 6756 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x281c2 000004 1788776756.498779 trunc from 00000000 to 0x0281c1 (0x281c2 bytes) 000005 1788776756.521525 mapread 0x007955 thru 0x011d68 (0xa414 bytes) 000006 1788776756.568067 mapwrite 0x019786 thru 0x028d30 (0xf5ab bytes) truncating to largest ever: 0x2f5af 000008 1788776756.891470 trunc from 0x028d31 to 0x02f5ae (0x687e bytes) 000011 1788776756.934275 mapwrite 0x00ac24 thru 0x018896 (0xdc73 bytes) 000012 1788776757.019177 trunc from 0x02f5af to 0x028b68 (0x6a46 bytes) 000013 1788776757.070118 mapwrite 0x03163d thru 0x035395 (0x3d59 bytes) 000015 1788776757.315742 mapwrite 0x03ea64 thru 0x03ffff (0x159c bytes) 000016 1788776757.492192 write 0x018022 thru 0x0261c1 (0xe1a0 bytes) 000017 1788776757.498374 mapwrite 0x001ada thru 0x0105ab (0xead2 bytes) 000018 1788776757.814373 punch from 0x008af2 to 0x013015 (0xa524 bytes) 000019 1788776757.856027 MIRROR_EXTEND to 2 mirrors 000020 1788776759.277593 MIRROR_EXTEND to 3 mirrors 000021 1788776760.191244 MIRROR_RESYNC 3 mirrors 000022 1788776760.812614 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17e:0x0]: Invalid argument (22) 000024 1788776761.233364 read 0x032a74 thru 0x0375b1 (0x4b3e bytes) 000025 1788776761.280080 MIRROR_EXTEND to 3 mirrors 000026 1788776762.163372 write 0x0057dd thru 0x00e308 (0x8b2c bytes) 000027 1788776762.257896 punch from 0x037722 to 0x03dd46 (0x6625 bytes) 000028 1788776762.275718 mapread 0x03d361 thru 0x03ffff (0x2c9f bytes) 000029 1788776762.300256 write 0x024d2b thru 0x0330c4 (0xe39a bytes) 000031 1788776762.353087 trunc from 0x040000 to 0x00742a (0x38bd5 bytes) 000032 1788776762.418942 mapread 0x007013 thru 0x00742a (0x418 bytes) 000034 1788776762.424960 punch from 0x001cc1 to 0x00742a (0x576a bytes) 000035 1788776762.449454 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x742b): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x742b): Mirror 3: 0xd764b5d (stale) Mirror 4: 0xd764b5d (stale) CRC-32 checksum value for chunk [0, 0x742b): Mirror 1: 0x3c1540ad Mirror 5: 0x3c1540ad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x742b: skipped 000036 1788776763.769164 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x742b): Mirror 3: 0xd764b5d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x742b): Mirror 3: 0xd764b5d (stale) CRC-32 checksum value for chunk [0, 0x742b): Mirror 1: 0x3c1540ad Mirror 5: 0x3c1540ad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x742b: skipped 000037 1788776764.500380 mapwrite 0x01e947 thru 0x029e18 (0xb4d2 bytes) 000039 1788776764.684892 mapread 0x01ad6d thru 0x01b5b4 (0x848 bytes) 000040 1788776764.686002 mapread 0x0275e8 thru 0x029e18 (0x2831 bytes) 000042 1788776764.688863 read 0x01f476 thru 0x029836 (0xa3c1 bytes) 000043 1788776764.690395 trunc from 0x029e19 to 0x021966 (0x84b2 bytes) 000044 1788776764.718816 write 0x033be5 thru 0x03bef9 (0x8315 bytes) 000046 1788776764.723074 mapread 0x02c878 thru 0x0391c0 (0xc949 bytes) 000048 1788776764.731414 punch from 0x034357 to 0x037122 (0x2dcc bytes) 000049 1788776764.749549 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3befa): Mirror 3: 0xe0c04b00 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3befa): Mirror 3: 0xe0c04b00 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3befa: skipped truncating to largest ever: 0x3864b 000050 1788776765.097223 trunc from 0x03befa to 0x03864a (0x38af bytes) 000051 1788776765.116275 write 0x02999f thru 0x031ebf (0x8521 bytes) 000052 1788776765.146249 MIRROR_RESYNC 2 mirrors 000053 1788776766.123158 punch from 0x01c6f1 to 0x01f3af (0x2cbf bytes) 000054 1788776766.260123 MIRROR_RESYNC 2 mirrors 000057 1788776767.096187 mapread 0x000442 thru 0x008bba (0x8779 bytes) 000059 1788776767.154365 punch from 0x02557d to 0x027842 (0x22c6 bytes) 000060 1788776767.244998 MIRROR_RESYNC 2 mirrors 000061 1788776768.100171 trunc from 0x03864b to 0x010f1e (0x2772c bytes) 000062 1788776768.215903 punch from 0x005172 to 0x007da5 (0x2c34 bytes) 000064 1788776768.223105 read 0x003ba4 thru 0x00baa3 (0x7f00 bytes) 000065 1788776768.234484 mapwrite 0x02a2a4 thru 0x02a7b9 (0x516 bytes) 000069 1788776768.318670 punch from 0x025172 to 0x02a7b9 (0x5648 bytes) 000070 1788776768.324859 read 0x024b47 thru 0x02a7b9 (0x5c73 bytes) 000071 1788776768.338579 mapread 0x0163c6 thru 0x025fd9 (0xfc14 bytes) 000073 1788776768.341255 trunc from 0x02a7ba to 0x01b7a1 (0xf018 bytes) 000074 1788776768.364106 write 0x037fa7 thru 0x03b607 (0x3661 bytes) 000076 1788776768.372695 MIRROR_RESYNC 2 mirrors 000077 1788776769.522790 punch from 0x024eb7 to 0x02ce5a (0x7fa4 bytes) 000078 1788776769.626148 mapread 0x02e157 thru 0x036e0a (0x8cb4 bytes) 000079 1788776769.655959 write 0x001df1 thru 0x00aa34 (0x8c44 bytes) 000080 1788776769.675040 read 0x034792 thru 0x038a37 (0x42a6 bytes) 000081 1788776769.676011 write 0x005964 thru 0x005fbe (0x65b bytes) 000082 1788776769.676820 mapwrite 0x02b135 thru 0x0399f3 (0xe8bf bytes) 000083 1788776769.771088 MIRROR_RESYNC 2 mirrors 000084 1788776770.914340 trunc from 0x03b608 to 0x0007d3 (0x3ae34 bytes) 000085 1788776771.071764 trunc from 0x0007d4 to 0x01c4fa (0x1bd27 bytes) 000086 1788776771.136393 write 0x03a168 thru 0x03c46e (0x2307 bytes) 000087 1788776771.137766 trunc from 0x03c46f to 0x0261ea (0x16284 bytes) 000088 1788776771.159990 write 0x006154 thru 0x00bda3 (0x5c50 bytes) 000090 1788776771.170402 mapwrite 0x034872 thru 0x03e60b (0x9d9a bytes) 000091 1788776771.258586 trunc from 0x03e60c to 0x00d131 (0x314da bytes) 000095 1788776771.277702 mapread 0x001fa0 thru 0x00d131 (0xb192 bytes) 000096 1788776771.287478 trunc from 0x00d132 to 0x035a52 (0x28921 bytes) truncating to largest ever: 0x3dcb3 000097 1788776771.301853 trunc from 0x035a53 to 0x03dcb2 (0x8260 bytes) 000098 1788776771.321638 punch from 0x00ecb1 to 0x0115da (0x292a bytes) 000099 1788776771.327170 read 0x026925 thru 0x03266d (0xbd49 bytes) 000100 1788776771.336821 read 0x0027b4 thru 0x00c725 (0x9f72 bytes) 000101 1788776771.342934 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17e:0x0]: Invalid argument (22) 000103 1788776771.551060 mapread 0x0305b2 thru 0x033561 (0x2fb0 bytes) 000104 1788776771.602817 write 0x01ad3a thru 0x020327 (0x55ee bytes) 000105 1788776771.626873 mapread 0x00f7ad thru 0x01e6d7 (0xef2b bytes) 000106 1788776771.657964 write 0x0180cf thru 0x0209e6 (0x8918 bytes) 000107 1788776771.659278 trunc from 0x03dcb3 to 0x00b05f (0x32c53 bytes) 000108 1788776771.729546 read 0x004ac0 thru 0x00ab77 (0x60b8 bytes) 000110 1788776771.762546 trunc from 0x00b060 to 0x02882f (0x1d7d0 bytes) 000111 1788776771.797437 mapwrite 0x03a1b0 thru 0x03ffff (0x5e50 bytes) 000112 1788776771.960651 write 0x00f643 thru 0x014678 (0x5036 bytes) 000113 1788776771.974372 mapread 0x0330d6 thru 0x03b34c (0x8277 bytes) 000114 1788776771.975707 read 0x00fd59 thru 0x016d92 (0x703a bytes) 000115 1788776772.004847 trunc from 0x040000 to 0x02528e (0x1ad71 bytes) 000116 1788776772.022038 read 0x00e9a2 thru 0x01e888 (0xfee7 bytes) 000117 1788776772.028883 MIRROR_EXTEND to 2 mirrors 000118 1788776773.440024 read 0x020e62 thru 0x02528e (0x442d bytes) 000119 1788776773.461048 punch from 0x0235ab to 0x02528e (0x1ce4 bytes) 000121 1788776773.594553 mapwrite 0x034013 thru 0x03ffff (0xbfed bytes) 000123 1788776773.777963 write 0x00dda0 thru 0x01488b (0x6aec bytes) 000124 1788776773.804039 write 0x02fa8b thru 0x032fda (0x3550 bytes) 000125 1788776773.808699 mapread 0x007a50 thru 0x012911 (0xaec2 bytes) 000126 1788776773.847168 write 0x03a28d thru 0x03a84a (0x5be bytes) 000128 1788776773.850183 trunc from 0x040000 to 0x00779b (0x38864 bytes) 000129 1788776773.891329 punch from 0x001451 to 0x00779b (0x634b bytes) 000130 1788776773.909452 MIRROR_RESYNC 2 mirrors 000131 1788776774.815812 mapread 0x006d80 thru 0x00779b (0xa1c bytes) 000132 1788776774.828288 write 0x00b41b thru 0x017045 (0xbc2b bytes) 000133 1788776774.892970 mapwrite 0x01ba3e thru 0x020788 (0x4d4b bytes) 000134 1788776775.032098 mapread 0x01f502 thru 0x020788 (0x1287 bytes) 000135 1788776775.033125 trunc from 0x020789 to 0x005875 (0x1af13 bytes) 000137 1788776775.066301 mapread 0x00334a thru 0x0056e8 (0x239f bytes) 000138 1788776775.079553 write 0x00ed71 thru 0x00f597 (0x827 bytes) 000139 1788776775.082230 mapread 0x007d70 thru 0x00f597 (0x7828 bytes) 000140 1788776775.098129 punch from 0x00b3b8 to 0x00f597 (0x41e0 bytes) 000141 1788776775.123810 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17e:0x0]: Invalid argument (22) 000143 1788776775.392891 mapread 0x00c59b thru 0x00f597 (0x2ffd bytes) 000146 1788776775.414201 mapwrite 0x031532 thru 0x03c027 (0xaaf6 bytes) 000147 1788776775.512421 MIRROR_EXTEND to 2 mirrors 000150 1788776776.490919 read 0x022daa thru 0x029d87 (0x6fde bytes) 000151 1788776776.528951 mapwrite 0x01504e thru 0x024865 (0xf818 bytes) 000152 1788776776.906638 mapread 0x02ddbd thru 0x035a6f (0x7cb3 bytes) 000153 1788776776.927475 punch from 0x009876 to 0x0166dc (0xce67 bytes) 000154 1788776776.941981 punch from 0x00373d to 0x0095d3 (0x5e97 bytes) 000155 1788776776.952377 read 0x00cf8e thru 0x013441 (0x64b4 bytes) 000157 1788776776.980627 punch from 0x02f9db to 0x034594 (0x4bba bytes) 000158 1788776776.990730 mapread 0x00cd62 thru 0x01697d (0x9c1c bytes) 000159 1788776776.991716 mapwrite 0x00b1c9 thru 0x01773e (0xc576 bytes) 000160 1788776777.115071 mapwrite 0x02658d thru 0x02df39 (0x79ad bytes) 000161 1788776777.165838 read 0x00c2d0 thru 0x01a4ca (0xe1fb bytes) 000162 1788776777.167971 read 0x01c2f9 thru 0x01f9c8 (0x36d0 bytes) 000163 1788776777.168978 read 0x038b7b thru 0x03c027 (0x34ad bytes) 000164 1788776777.170127 write 0x0092da thru 0x01761e (0xe345 bytes) 000165 1788776777.171765 punch from 0x017d20 to 0x01fbb1 (0x7e92 bytes) 000166 1788776777.190613 mapread 0x014df2 thru 0x01cfdd (0x81ec bytes) 000167 1788776777.208718 MIRROR_RESYNC 2 mirrors 000168 1788776777.909854 read 0x03104e thru 0x03c027 (0xafda bytes) 000169 1788776777.935036 mapread 0x00bba8 thru 0x013271 (0x76ca bytes) 000171 1788776777.974368 write 0x038b86 thru 0x03a5f0 (0x1a6b bytes) 000172 1788776778.126402 write 0x01ddf4 thru 0x024487 (0x6694 bytes) 000175 1788776778.164606 read 0x02c665 thru 0x036e96 (0xa832 bytes) 000177 1788776778.200519 punch from 0x03a940 to 0x03c027 (0x16e8 bytes) 000178 1788776778.239083 read 0x000d0b thru 0x00b5b9 (0xa8af bytes) 000179 1788776778.249930 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17e:0x0]: Invalid argument (22) 000180 1788776778.490203 mapread 0x01cb13 thru 0x020dfb (0x42e9 bytes) 000181 1788776778.532253 mapwrite 0x00fcd2 thru 0x01e745 (0xea74 bytes) 000182 1788776778.660322 read 0x018128 thru 0x026796 (0xe66f bytes) 000183 1788776778.660936 read 0x02d1bd thru 0x03260f (0x5453 bytes) 000184 1788776778.680943 MIRROR_EXTEND to 2 mirrors 000185 1788776779.492886 trunc from 0x03c028 to 0x01050c (0x2bb1b bytes) 000187 1788776779.577368 MIRROR_RESYNC 2 mirrors 000188 1788776780.153099 mapwrite 0x0038cb thru 0x00cc75 (0x93ab bytes) 000189 1788776780.349157 punch from 0x002773 to 0x00d9c8 (0xb256 bytes) 000191 1788776780.356025 mapwrite 0x006c42 thru 0x013e6e (0xd22d bytes) 000192 1788776780.445122 punch from 0x00a596 to 0x013e6e (0x98d9 bytes) 000193 1788776780.451019 read 0x012b72 thru 0x013e6e (0x12fd bytes) 000194 1788776780.457646 write 0x011e42 thru 0x017715 (0x58d4 bytes) 000195 1788776780.467735 MIRROR_RESYNC 2 mirrors 000196 1788776781.100656 MIRROR_EXTEND to 3 mirrors 000197 1788776781.724989 write 0x016070 thru 0x01f962 (0x98f3 bytes) 000199 1788776781.818479 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f963): Mirror 3: 0x233abc9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f963): Mirror 3: 0x233abc9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f963: skipped 000200 1788776782.134600 mapread 0x00d10d thru 0x00e767 (0x165b bytes) 000202 1788776782.165168 mapwrite 0x012a7d thru 0x01f351 (0xc8d5 bytes) truncating to largest ever: 0x3e63d 000205 1788776782.256291 trunc from 0x01f963 to 0x03e63c (0x1ecda bytes) 000208 1788776782.343655 trunc from 0x03e63d to 0x03a8c9 (0x3d73 bytes) 000210 1788776782.369088 read 0x029a3c thru 0x02a5fa (0xbbf bytes) 000211 1788776782.376333 mapwrite 0x0236e1 thru 0x032305 (0xec25 bytes) 000212 1788776782.486701 mapread 0x01623d thru 0x018752 (0x2516 bytes) 000213 1788776782.487571 mapwrite 0x01dafd thru 0x01dd1b (0x21f bytes) 000214 1788776782.532331 trunc from 0x03a8ca to 0x0009e6 (0x39ee3 bytes) 000215 1788776782.554675 read 0x000111 thru 0x000965 (0x855 bytes) 000216 1788776782.559337 mapwrite 0x033f49 thru 0x038c1d (0x4cd5 bytes) 000218 1788776782.651190 trunc from 0x038c1e to 0x01a8a1 (0x1e37c bytes) 000219 1788776782.675693 mapread 0x001148 thru 0x009a81 (0x893a bytes) 000221 1788776782.678714 read 0x005217 thru 0x011702 (0xc4ec bytes) 000222 1788776782.679969 write 0x005ed7 thru 0x007c23 (0x1d4d bytes) 000223 1788776782.681092 trunc from 0x01a8a2 to 0x001edf (0x189c2 bytes) 000225 1788776782.703946 read 0x000909 thru 0x001edf (0x15d7 bytes) 000226 1788776782.704719 trunc from 0x001ee0 to 0x025f88 (0x240a9 bytes) 000227 1788776782.724093 mapwrite 0x03a48d thru 0x03ffff (0x5b73 bytes) 000228 1788776782.818383 read 0x03148c thru 0x033580 (0x20f5 bytes) 000230 1788776782.819622 write 0x01f6c4 thru 0x02d840 (0xe17d bytes) 000231 1788776782.821469 mapwrite 0x015b65 thru 0x0185d0 (0x2a6c bytes) 000232 1788776782.892828 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x8dcac346 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1938e2ac Mirror 4: 0x1938e2ac lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000233 1788776783.842344 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17e:0x0]: Invalid argument (22) 000234 1788776784.176754 mapwrite 0x015fa9 thru 0x01d00d (0x7065 bytes) 000236 1788776784.379891 read 0x03fa9e thru 0x03ffff (0x562 bytes) 000237 1788776784.391023 MIRROR_RESYNC 2 mirrors 000246 1788776785.370348 MIRROR_RESYNC 2 mirrors 000248 1788776785.763497 mapread 0x01ad86 thru 0x01ed81 (0x3ffc bytes) 000249 1788776785.786590 write 0x028d56 thru 0x02d33b (0x45e6 bytes) 000252 1788776785.860758 read 0x027315 thru 0x035449 (0xe135 bytes) 000253 1788776785.869188 mapread 0x004b0c thru 0x00e933 (0x9e28 bytes) 000254 1788776785.878281 trunc from 0x040000 to 0x0152b8 (0x2ad47 bytes) 000255 1788776785.921571 mapwrite 0x01d732 thru 0x01fe19 (0x26e8 bytes) 000256 1788776785.984041 punch from 0x00fa24 to 0x01f3f3 (0xf9d0 bytes) 000259 1788776785.997869 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1fe1a): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fe1a): Mirror 4: 0xad14c746 (stale) CRC-32 checksum value for chunk [0, 0x1fe1a): Mirror 1: 0x642f59a6 Mirror 5: 0x642f59a6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fe1a: skipped 000261 1788776787.066743 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1fe1a): Mirror 4: 0xad14c746 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fe1a): Mirror 4: 0xad14c746 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fe1a: skipped 000262 1788776787.380282 punch from 0x0022ee to 0x00f460 (0xd173 bytes) 000263 1788776787.421985 read 0x016274 thru 0x01fe19 (0x9ba6 bytes) 000264 1788776787.444041 write 0x0008e3 thru 0x00c911 (0xc02f bytes) 000266 1788776787.454328 mapread 0x007d28 thru 0x014f77 (0xd250 bytes) 000267 1788776787.471139 punch from 0x014370 to 0x01fe19 (0xbaaa bytes) 000268 1788776787.486265 mapread 0x009bc1 thru 0x016dc5 (0xd205 bytes) 000269 1788776787.502224 mapread 0x00e29a thru 0x014acc (0x6833 bytes) 000270 1788776787.503649 trunc from 0x01fe1a to 0x02d4a8 (0xd68f bytes) 000271 1788776787.523328 trunc from 0x02d4a9 to 0x009222 (0x24286 bytes) 000273 1788776787.556357 MIRROR_RESYNC 2 mirrors 000274 1788776788.242321 read 0x005333 thru 0x009222 (0x3ef0 bytes) 000275 1788776788.248779 mapwrite 0x003a2c thru 0x008dae (0x5383 bytes) 000277 1788776788.499338 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x9223): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9223): Mirror 4: 0xef724bf7 (stale) CRC-32 checksum value for chunk [0, 0x9223): Mirror 1: 0x9aa7375d Mirror 5: 0x9aa7375d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9223: skipped 000279 1788776789.602960 read 0x0011e1 thru 0x009222 (0x8042 bytes) 000280 1788776789.626271 mapwrite 0x00610e thru 0x014c83 (0xeb76 bytes) 000281 1788776789.938726 read 0x0085cf thru 0x00e8dd (0x630f bytes) 000282 1788776789.939362 read 0x009803 thru 0x00c7f6 (0x2ff4 bytes) 000283 1788776789.939943 write 0x028a75 thru 0x02cb7d (0x4109 bytes) 000284 1788776789.942809 mapwrite 0x0090aa thru 0x017bdb (0xeb32 bytes) 000286 1788776790.084698 trunc from 0x02cb7e to 0x001337 (0x2b846 bytes) 000287 1788776790.115193 read 0x000eef thru 0x001337 (0x449 bytes) 000288 1788776790.115927 mapread 0x0001a8 thru 0x001337 (0x1190 bytes) 000289 1788776790.120323 mapwrite 0x00b2b5 thru 0x018c53 (0xd99f bytes) 000290 1788776790.334237 write 0x007efd thru 0x009b7b (0x1c7f bytes) 000291 1788776790.335399 mapwrite 0x006719 thru 0x014c7c (0xe564 bytes) 000292 1788776790.419540 mapread 0x01894b thru 0x018c53 (0x309 bytes) 000294 1788776790.422413 mapwrite 0x0232ea thru 0x0326b1 (0xf3c8 bytes) 000295 1788776790.504844 mapwrite 0x036771 thru 0x03affe (0x488e bytes) 000296 1788776790.570117 punch from 0x034282 to 0x03affe (0x6d7d bytes) 000297 1788776790.577104 mapread 0x018cd4 thru 0x0210b9 (0x83e6 bytes) 000298 1788776790.578985 read 0x0377db thru 0x03affe (0x3824 bytes) 000299 1788776790.590461 write 0x0051ed thru 0x013e96 (0xecaa bytes) 000301 1788776790.594460 mapread 0x031571 thru 0x03affe (0x9a8e bytes) 000302 1788776790.596443 mapread 0x02c69f thru 0x030c6a (0x45cc bytes) 000304 1788776790.603894 mapread 0x039b2d thru 0x03affe (0x14d2 bytes) 000305 1788776790.605137 write 0x02e15a thru 0x03946a (0xb311 bytes) 000307 1788776790.614407 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3afff): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3afff): Mirror 4: 0xa1ee42c8 (stale) Mirror 5: 0xa711f1f1 (stale) CRC-32 checksum value for chunk [0, 0x3afff): Mirror 1: 0x7aa06bf2 Mirror 6: 0x7aa06bf2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3afff: skipped 000308 1788776791.614433 punch from 0x02978d to 0x0325ab (0x8e1f bytes) 000309 1788776791.717484 punch from 0x02c0fd to 0x02dc27 (0x1b2b bytes) 000310 1788776791.728934 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3afff): Mirror 5: 0xa711f1f1 (stale) Mirror 6: 0x7aa06bf2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3afff): Mirror 5: 0xa711f1f1 (stale) Mirror 6: 0x7aa06bf2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3afff: skipped 000311 1788776792.282640 mapread 0x005fc2 thru 0x014a0c (0xea4b bytes) 000312 1788776792.342182 read 0x01e574 thru 0x028f3d (0xa9ca bytes) 000313 1788776792.357590 write 0x01f6e7 thru 0x025da2 (0x66bc bytes) 000314 1788776792.359079 punch from 0x020ed2 to 0x0225e4 (0x1713 bytes) 000315 1788776792.389278 trunc from 0x03afff to 0x002757 (0x388a7 bytes) 000316 1788776792.420850 mapwrite 0x008a44 thru 0x00eedd (0x649a bytes) 000317 1788776792.594228 write 0x01e8cc thru 0x025ea5 (0x75da bytes) 000318 1788776792.603493 mapread 0x01438a thru 0x01b585 (0x71fc bytes) 000320 1788776792.638770 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x25ea6): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25ea6): Mirror 5: 0x44d65a65 (stale) Mirror 6: 0x4fbcf0a2 (stale) CRC-32 checksum value for chunk [0, 0x25ea6): Mirror 1: 0xefea80bf Mirror 7: 0xefea80bf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25ea6: skipped 000324 1788776793.807702 write 0x001328 thru 0x009413 (0x80ec bytes) 000325 1788776793.903910 mapwrite 0x030c87 thru 0x035738 (0x4ab2 bytes) 000326 1788776794.137417 mapread 0x00ca1d thru 0x00e3bb (0x199f bytes) 000327 1788776794.148675 punch from 0x009863 to 0x015a86 (0xc224 bytes) 000330 1788776794.159018 punch from 0x02a86a to 0x035738 (0xaecf bytes) 000331 1788776794.164376 write 0x011ab3 thru 0x014252 (0x27a0 bytes) 000332 1788776794.179403 punch from 0x02de53 to 0x035738 (0x78e6 bytes) 000333 1788776794.193342 punch from 0x0124c8 to 0x01fe38 (0xd971 bytes) 000334 1788776794.200627 write 0x0299de thru 0x02de2c (0x444f bytes) 000335 1788776794.219291 mapwrite 0x028bf2 thru 0x031c58 (0x9067 bytes) 000341 1788776794.329372 trunc from 0x035739 to 0x036287 (0xb4f bytes) 000342 1788776794.353872 trunc from 0x036288 to 0x0020ea (0x3419d bytes) 000345 1788776794.379131 write 0x01b8da thru 0x0255bb (0x9ce2 bytes) 000346 1788776794.382442 trunc from 0x0255bc to 0x033e4c (0xe891 bytes) 000347 1788776794.407724 mapwrite 0x00c0af thru 0x013b58 (0x7aaa bytes) 000348 1788776794.476945 mapwrite 0x02eb8e thru 0x035aa0 (0x6f13 bytes) 000350 1788776794.576990 mapread 0x00077b thru 0x006a47 (0x62cd bytes) 000351 1788776794.589292 read 0x02ea82 thru 0x035aa0 (0x701f bytes) 000352 1788776794.590031 read 0x015678 thru 0x019529 (0x3eb2 bytes) 000353 1788776794.601851 write 0x03844a thru 0x03d9bd (0x5574 bytes) 000356 1788776794.606038 trunc from 0x03d9be to 0x01023d (0x2d780 bytes) 000357 1788776794.625691 trunc from 0x01023e to 0x019906 (0x96c9 bytes) 000359 1788776794.648950 trunc from 0x019907 to 0x00b5c0 (0xe346 bytes) 000361 1788776794.686148 mapwrite 0x01b40d thru 0x01e6b9 (0x32ad bytes) 000365 1788776794.826764 write 0x012d03 thru 0x01bfd3 (0x92d1 bytes) 000366 1788776794.833421 write 0x0210f4 thru 0x023703 (0x2610 bytes) 000367 1788776794.834458 mapwrite 0x016d46 thru 0x017b67 (0xe22 bytes) 000370 1788776794.893204 trunc from 0x023704 to 0x0383ca (0x14cc7 bytes) 000371 1788776794.918126 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x383cb): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x383cb): Mirror 5: 0xfad736a (stale) Mirror 6: 0xaf053f95 (stale) Mirror 7: 0x8b3abdea (stale) CRC-32 checksum value for chunk [0, 0x383cb): Mirror 1: 0xc7be954c Mirror 8: 0xc7be954c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x383cb: skipped 000374 1788776796.281906 mapread 0x030673 thru 0x0383ca (0x7d58 bytes) 000376 1788776796.326283 punch from 0x025611 to 0x027e70 (0x2860 bytes) 000377 1788776796.412455 punch from 0x01532c to 0x01f8ce (0xa5a3 bytes) 000381 1788776796.419219 mapread 0x026aa1 thru 0x03478d (0xdced bytes) 000382 1788776796.465317 write 0x03fb93 thru 0x03ffff (0x46d bytes) 000383 1788776796.466637 mapread 0x004975 thru 0x005260 (0x8ec bytes) 000384 1788776796.486730 trunc from 0x040000 to 0x0362e8 (0x9d17 bytes) 000385 1788776796.512454 punch from 0x0101e7 to 0x017c4f (0x7a69 bytes) 000386 1788776796.518229 trunc from 0x0362e9 to 0x00b31f (0x2afc9 bytes) 000387 1788776796.535144 read 0x00501d thru 0x00593d (0x921 bytes) 000388 1788776796.536689 write 0x005ca4 thru 0x00f077 (0x93d4 bytes) 000391 1788776796.540454 mapread 0x00b989 thru 0x00f077 (0x36ef bytes) 000395 1788776796.547404 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xf078): Mirror 6: 0x6ec2951f (stale) Mirror 7: 0x94fa0228 (stale) Mirror 8: 0x823a0aaf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf078): Mirror 6: 0x6ec2951f (stale) Mirror 7: 0x94fa0228 (stale) Mirror 8: 0x823a0aaf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf078: skipped 000397 1788776796.912997 trunc from 0x00f078 to 0x0208cb (0x11854 bytes) 000398 1788776796.934964 mapwrite 0x0339f5 thru 0x03f0b0 (0xb6bc bytes) 000399 1788776797.032207 MIRROR_RESYNC 4 mirrors 000400 1788776798.977566 read 0x002e93 thru 0x0128e6 (0xfa54 bytes) 000401 1788776799.009011 punch from 0x000ea8 to 0x0076ac (0x6805 bytes) 000402 1788776799.084789 mapwrite 0x028156 thru 0x0344fd (0xc3a8 bytes) 000404 1788776799.180439 write 0x0257ce thru 0x028f25 (0x3758 bytes) 000405 1788776799.182482 read 0x01567a thru 0x018a07 (0x338e bytes) 000406 1788776799.204070 write 0x00f664 thru 0x01c05b (0xc9f8 bytes) 000407 1788776799.205583 mapread 0x03e362 thru 0x03f0b0 (0xd4f bytes) 000411 1788776799.208156 write 0x03829e thru 0x03ffff (0x7d62 bytes) 000412 1788776799.209434 write 0x0278a2 thru 0x0374a5 (0xfc04 bytes) 000414 1788776799.212483 read 0x0360a6 thru 0x03ffff (0x9f5a bytes) 000415 1788776799.213303 mapwrite 0x004082 thru 0x0121c8 (0xe147 bytes) 000416 1788776799.276235 MIRROR_RESYNC 4 mirrors 000417 1788776800.027703 read 0x033cc3 thru 0x034f06 (0x1244 bytes) 000421 1788776800.035957 punch from 0x012277 to 0x015c93 (0x3a1d bytes) 000423 1788776800.109150 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xb8b2b461 (stale) Mirror 7: 0xb8b2b461 (stale) Mirror 8: 0xb8b2b461 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2eb873b4 Mirror 9: 0x2eb873b4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000424 1788776801.215472 MIRROR_RESYNC 5 mirrors 000425 1788776802.380651 mapread 0x02a5de thru 0x03680f (0xc232 bytes) 000426 1788776802.454420 trunc from 0x040000 to 0x01ac91 (0x2536e bytes) 000427 1788776802.575083 read 0x003de1 thru 0x00e9fa (0xac1a bytes) 000428 1788776802.596030 trunc from 0x01ac92 to 0x00282b (0x18466 bytes) 000429 1788776802.657992 trunc from 0x00282c to 0x0263ac (0x23b81 bytes) 000430 1788776802.715015 read 0x013c40 thru 0x022460 (0xe821 bytes) 000431 1788776802.755714 write 0x033d07 thru 0x03b0ea (0x73e4 bytes) 000432 1788776802.757776 read 0x0391d5 thru 0x03b0ea (0x1f16 bytes) 000433 1788776802.758618 read 0x033f8d thru 0x03b0ea (0x715e bytes) 000434 1788776802.759719 mapread 0x01d2d4 thru 0x02049f (0x31cc bytes) 000435 1788776802.760994 write 0x023bbd thru 0x02a56e (0x69b2 bytes) 000436 1788776802.768781 trunc from 0x03b0eb to 0x02adb5 (0x10335 bytes) 000438 1788776802.796595 punch from 0x01482a to 0x021e36 (0xd60d bytes) 000441 1788776802.817284 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2adb6): Mirror 6: 0xf3590391 (stale) Mirror 7: 0xf3590391 (stale) Mirror 8: 0xf3590391 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2adb6): Mirror 6: 0xf3590391 (stale) Mirror 7: 0xf3590391 (stale) Mirror 8: 0xf3590391 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2adb6: skipped 000443 1788776803.469761 mapwrite 0x0014d8 thru 0x005d41 (0x486a bytes) 000444 1788776803.555619 mapwrite 0x001c71 thru 0x00af10 (0x92a0 bytes) 000445 1788776803.623609 read 0x025588 thru 0x028ece (0x3947 bytes) 000446 1788776803.631238 mapwrite 0x0073ef thru 0x00b496 (0x40a8 bytes) 000447 1788776803.677126 write 0x009dd4 thru 0x0162c2 (0xc4ef bytes) 000448 1788776803.684500 mapwrite 0x025976 thru 0x026080 (0x70b bytes) 000449 1788776803.732990 mapread 0x022c7f thru 0x02599b (0x2d1d bytes) 000450 1788776803.743549 punch from 0x01ee1f to 0x029ea4 (0xb086 bytes) 000451 1788776803.749271 mapwrite 0x00d0f3 thru 0x00fc2c (0x2b3a bytes) 000452 1788776803.797344 write 0x03e76b thru 0x03f7d8 (0x106e bytes) 000453 1788776803.800454 write 0x02e663 thru 0x0361e0 (0x7b7e bytes) 000454 1788776803.812859 trunc from 0x03f7d9 to 0x03ac61 (0x4b77 bytes) 000457 1788776803.872955 MIRROR_RESYNC 4 mirrors 000458 1788776805.549271 write 0x00239b thru 0x00ef07 (0xcb6d bytes) 000459 1788776805.657937 MIRROR_RESYNC 4 mirrors 000462 1788776806.985478 trunc from 0x03ac62 to 0x00cb58 (0x2e109 bytes) 000463 1788776807.113393 mapwrite 0x013658 thru 0x0169bc (0x3365 bytes) 000464 1788776807.257900 read 0x005b37 thru 0x013e5f (0xe329 bytes) 000465 1788776807.302449 read 0x008094 thru 0x011a6f (0x99dc bytes) 000466 1788776807.303132 write 0x028800 thru 0x02e8cb (0x60cc bytes) 000467 1788776807.304434 punch from 0x011936 to 0x01f977 (0xe042 bytes) 000468 1788776807.331171 trunc from 0x02e8cc to 0x0186e1 (0x161ea bytes) 000469 1788776807.357121 trunc from 0x0186e2 to 0x0088df (0xfe02 bytes) 000470 1788776807.385970 mapwrite 0x02edbe thru 0x034c82 (0x5ec5 bytes) 000471 1788776807.518677 mapwrite 0x02c420 thru 0x03b0df (0xecc0 bytes) 000472 1788776807.645133 trunc from 0x03b0e0 to 0x00312c (0x37fb3 bytes) 000473 1788776807.673189 mapwrite 0x0363ad thru 0x03ffff (0x9c53 bytes) 000474 1788776807.888809 mapwrite 0x026534 thru 0x0280a5 (0x1b72 bytes) 000475 1788776808.067113 read 0x01b05d thru 0x0284f2 (0xd496 bytes) 000477 1788776808.099015 punch from 0x030e23 to 0x03ffff (0xf1dd bytes) 000478 1788776808.115274 mapread 0x01e49a thru 0x024b9a (0x6701 bytes) 000479 1788776808.131303 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x1bc6cb6f (stale) Mirror 7: 0x1bc6cb6f (stale) Mirror 8: 0x1bc6cb6f (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x89cd1c6 Mirror 9: 0x89cd1c6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000480 1788776809.702474 trunc from 0x040000 to 0x0057a4 (0x3a85b bytes) 000481 1788776809.820042 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x57a5): Mirror 7: 0x8c56ad9b (stale) Mirror 8: 0x8c56ad9b (stale) Mirror 9: 0x622ed074 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x57a5): Mirror 7: 0x8c56ad9b (stale) Mirror 8: 0x8c56ad9b (stale) Mirror 9: 0x622ed074 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x57a5: skipped 000482 1788776810.356421 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x57a5): Mirror 8: 0x8c56ad9b (stale) Mirror 9: 0x622ed074 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x57a5): Mirror 8: 0x8c56ad9b (stale) Mirror 9: 0x622ed074 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x57a5: skipped 000483 1788776810.686804 punch from 0x0016c7 to 0x0057a4 (0x40de bytes) 000485 1788776810.694358 write 0x031fb9 thru 0x03501f (0x3067 bytes) 000487 1788776810.707194 write 0x004b27 thru 0x010dfa (0xc2d4 bytes) 000489 1788776810.743101 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x35020): Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35020): Mirror 8: 0x47e8abac (stale) Mirror 9: 0xa5d5da74 (stale) CRC-32 checksum value for chunk [0, 0x35020): Mirror 1: 0xcf759b89 Mirror 10: 0xcf759b89 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35020: skipped 000490 1788776812.311086 mapread 0x005ad8 thru 0x00c051 (0x657a bytes) 000491 1788776812.345071 mapread 0x024e05 thru 0x02f3a2 (0xa59e bytes) 000492 1788776812.378499 read 0x0081df thru 0x0146d9 (0xc4fb bytes) 000493 1788776812.396585 trunc from 0x035020 to 0x015130 (0x1feef bytes) 000497 1788776812.549771 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x15131): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15131): Mirror 8: 0x5fc55841 (stale) Mirror 9: 0xae7d5231 (stale) Mirror 10: 0x6c73e927 (stale) CRC-32 checksum value for chunk [0, 0x15131): Mirror 1: 0x6c73e927 Mirror 11: 0x6c73e927 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15131: skipped 000498 1788776813.861213 write 0x02bb0b thru 0x02d3d9 (0x18cf bytes) 000499 1788776813.947448 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2d3da): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d3da): Mirror 8: 0x32609ba9 (stale) Mirror 9: 0xb71e00d6 (stale) Mirror 10: 0x498246eb (stale) Mirror 11: 0x498246eb (stale) CRC-32 checksum value for chunk [0, 0x2d3da): Mirror 1: 0x43b0542 Mirror 12: 0x43b0542 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d3da: skipped 000500 1788776814.918782 read 0x002cbe thru 0x0084ee (0x5831 bytes) 000503 1788776814.956121 read 0x0123ab thru 0x01d9a0 (0xb5f6 bytes) 000504 1788776814.968112 mapread 0x00171b thru 0x00b1ae (0x9a94 bytes) 000505 1788776814.981912 punch from 0x02c665 to 0x02d3d9 (0xd75 bytes) 000507 1788776815.090342 punch from 0x028281 to 0x02d3d9 (0x5159 bytes) 000509 1788776815.129360 mapwrite 0x027467 thru 0x032dfd (0xb997 bytes) 000510 1788776815.391116 write 0x00e91f thru 0x018337 (0x9a19 bytes) 000513 1788776815.409192 punch from 0x00356d to 0x00aa8e (0x7522 bytes) 000515 1788776815.471907 punch from 0x0047bd to 0x013acf (0xf313 bytes) 000516 1788776815.496183 MIRROR_RESYNC 6 mirrors 000517 1788776817.419814 MIRROR_EXTEND to 7 mirrors 000518 1788776818.812444 mapwrite 0x02bf06 thru 0x038190 (0xc28b bytes) 000519 1788776819.173544 punch from 0x00d272 to 0x016614 (0x93a3 bytes) 000520 1788776819.182175 trunc from 0x038191 to 0x006cf0 (0x314a0 bytes) 000523 1788776819.215232 mapwrite 0x03272c thru 0x03ffff (0xd8d4 bytes) 000524 1788776819.329022 read 0x0078c6 thru 0x00e41e (0x6b59 bytes) 000525 1788776819.345958 mapread 0x021672 thru 0x02858a (0x6f19 bytes) 000526 1788776819.374482 read 0x02a802 thru 0x036ac7 (0xc2c6 bytes) 000529 1788776819.396174 mapwrite 0x02bcf8 thru 0x032a13 (0x6d1c bytes) 000531 1788776819.501622 MIRROR_RESYNC 7 mirrors 000533 1788776821.814877 mapwrite 0x02c1fd thru 0x039c85 (0xda89 bytes) 000534 1788776822.067548 mapwrite 0x03a666 thru 0x03ffff (0x599a bytes) 000536 1788776822.114398 write 0x0092f7 thru 0x009839 (0x543 bytes) 000537 1788776822.124591 write 0x008733 thru 0x01638a (0xdc58 bytes) 000540 1788776822.141095 trunc from 0x040000 to 0x01d62c (0x229d3 bytes) 000543 1788776822.183325 write 0x009263 thru 0x00d5aa (0x4348 bytes) 000545 1788776822.187340 trunc from 0x01d62d to 0x02c695 (0xf069 bytes) 000546 1788776822.229926 trunc from 0x02c696 to 0x015c71 (0x16a24 bytes) 000548 1788776822.265468 punch from 0x00e380 to 0x0117d6 (0x3457 bytes) 000549 1788776822.284566 mapwrite 0x03dc0b thru 0x03ee75 (0x126b bytes) 000551 1788776822.402591 punch from 0x01a4f4 to 0x01cc94 (0x27a1 bytes) 000552 1788776822.410813 read 0x004df4 thru 0x0139e0 (0xebed bytes) 000553 1788776822.424681 mapwrite 0x021460 thru 0x029f0e (0x8aaf bytes) 000555 1788776822.499868 punch from 0x025eb9 to 0x0272b0 (0x13f8 bytes) 000556 1788776822.507673 read 0x0096e3 thru 0x013595 (0x9eb3 bytes) 000557 1788776822.523158 MIRROR_RESYNC 7 mirrors 000559 1788776824.690309 punch from 0x02581b to 0x0356af (0xfe95 bytes) 000560 1788776824.779138 read 0x018327 thru 0x025f7e (0xdc58 bytes) 000561 1788776824.795775 write 0x0129ec thru 0x018094 (0x56a9 bytes) 000562 1788776824.801817 mapread 0x029ae3 thru 0x02c640 (0x2b5e bytes) 000564 1788776824.837017 MIRROR_RESYNC 7 mirrors 000565 1788776826.551566 mapread 0x02b681 thru 0x0345b3 (0x8f33 bytes) 000566 1788776826.613821 write 0x00c743 thru 0x013434 (0x6cf2 bytes) 000568 1788776826.755761 trunc from 0x03ee76 to 0x0034e3 (0x3b992 bytes) 000569 1788776826.829238 mapwrite 0x033db2 thru 0x0369d3 (0x2c22 bytes) 000570 1788776826.946105 mapwrite 0x0011cd thru 0x00ec25 (0xda59 bytes) 000571 1788776827.037167 mapwrite 0x028007 thru 0x030184 (0x817e bytes) 000573 1788776827.179041 trunc from 0x0369d4 to 0x01a56e (0x1c465 bytes) 000574 1788776827.201446 mapwrite 0x00d2fb thru 0x013e14 (0x6b1a bytes) 000575 1788776827.282256 punch from 0x009322 to 0x00987a (0x559 bytes) 000576 1788776827.288220 mapread 0x011e19 thru 0x01a56e (0x8756 bytes) 000577 1788776827.295970 trunc from 0x01a56f to 0x01d4b5 (0x2f47 bytes) 000579 1788776827.322928 mapread 0x0150cf thru 0x01d4b5 (0x83e7 bytes) 000580 1788776827.332876 trunc from 0x01d4b6 to 0x011a89 (0xba2c bytes) 000581 1788776827.350984 read 0x005748 thru 0x00d16e (0x7a27 bytes) 000584 1788776827.362216 write 0x0168a6 thru 0x019293 (0x29ee bytes) 000585 1788776827.365992 mapread 0x0023f0 thru 0x01049c (0xe0ad bytes) 000586 1788776827.372259 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x19294): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19294): Mirror 8: 0x6636d95f (stale) Mirror 9: 0x6636d95f (stale) Mirror 10: 0x6636d95f (stale) Mirror 11: 0x6636d95f (stale) Mirror 12: 0x6636d95f (stale) Mirror 13: 0x6636d95f (stale) CRC-32 checksum value for chunk [0, 0x19294): Mirror 1: 0xac7487df Mirror 14: 0xac7487df lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19294: skipped 000587 1788776828.928229 write 0x00a138 thru 0x019a47 (0xf910 bytes) 000589 1788776829.166396 write 0x023dbb thru 0x02f772 (0xb9b8 bytes) 000590 1788776829.173853 punch from 0x02f744 to 0x02f772 (0x2f bytes) 000591 1788776829.200746 write 0x00ffa1 thru 0x0185a0 (0x8600 bytes) 000595 1788776829.208196 mapread 0x001a50 thru 0x00e65e (0xcc0f bytes) 000597 1788776829.271274 mapread 0x013275 thru 0x01baa3 (0x882f bytes) 000598 1788776829.325949 mapwrite 0x02e672 thru 0x03e46b (0xfdfa bytes) 000600 1788776829.619393 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3e46c): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e46c): Mirror 8: 0x137cc27c (stale) Mirror 9: 0x137cc27c (stale) Mirror 10: 0x137cc27c (stale) Mirror 11: 0x137cc27c (stale) Mirror 12: 0x137cc27c (stale) Mirror 13: 0x137cc27c (stale) Mirror 14: 0xbbffde72 (stale) CRC-32 checksum value for chunk [0, 0x3e46c): Mirror 1: 0x8483c7d1 Mirror 15: 0x8483c7d1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e46c: skipped 000601 1788776831.368397 read 0x022efe thru 0x0256d9 (0x27dc bytes) 000607 1788776831.432126 write 0x026f70 thru 0x0362af (0xf340 bytes) 000608 1788776831.550860 mapread 0x02a7f3 thru 0x0396c4 (0xeed2 bytes) 000609 1788776831.573409 write 0x01c45e thru 0x0251e4 (0x8d87 bytes) 000610 1788776831.588004 trunc from 0x03e46c to 0x01309d (0x2b3ce bytes) 000611 1788776831.623717 mapread 0x00eaf5 thru 0x01309d (0x45a9 bytes) 000612 1788776831.641022 punch from 0x0072d3 to 0x00b747 (0x4475 bytes) 000613 1788776831.649330 mapwrite 0x020a4a thru 0x03052b (0xfae2 bytes) 000614 1788776831.778488 trunc from 0x03052c to 0x0134f3 (0x1d038 bytes) 000615 1788776831.807192 punch from 0x00e924 to 0x0134f3 (0x4bd0 bytes) 000617 1788776831.813413 punch from 0x0054b0 to 0x010790 (0xb2e1 bytes) 000618 1788776831.819071 punch from 0x01150e to 0x0121bd (0xcb0 bytes) 000620 1788776831.827820 punch from 0x0075ac to 0x011542 (0x9f97 bytes) 000621 1788776831.835332 mapwrite 0x0023af thru 0x00f44a (0xd09c bytes) 000623 1788776831.952332 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x134f4): Mirror 8: 0x2e582dc5 (stale) Mirror 10: 0x2e582dc5 (stale) Mirror 11: 0x2e582dc5 (stale) Mirror 12: 0x2e582dc5 (stale) Mirror 13: 0x2e582dc5 (stale) Mirror 14: 0x43914e12 (stale) Mirror 15: 0x779b0aae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x134f4): Mirror 8: 0x2e582dc5 (stale) Mirror 10: 0x2e582dc5 (stale) Mirror 11: 0x2e582dc5 (stale) Mirror 12: 0x2e582dc5 (stale) Mirror 13: 0x2e582dc5 (stale) Mirror 14: 0x43914e12 (stale) Mirror 15: 0x779b0aae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x134f4: skipped 000624 1788776832.810483 read 0x002cec thru 0x0105db (0xd8f0 bytes) 000626 1788776832.836683 write 0x03641d thru 0x038474 (0x2058 bytes) 000627 1788776832.851106 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x38475): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38475): Mirror 8: 0xdcc02190 (stale) Mirror 10: 0xdcc02190 (stale) Mirror 11: 0xdcc02190 (stale) Mirror 12: 0xdcc02190 (stale) Mirror 13: 0xdcc02190 (stale) Mirror 14: 0x7044cb5a (stale) Mirror 15: 0x74833f7d (stale) CRC-32 checksum value for chunk [0, 0x38475): Mirror 1: 0xa339f434 Mirror 16: 0xa339f434 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38475: skipped 000629 1788776834.835550 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x38475): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38475): Mirror 8: 0xdcc02190 (stale) Mirror 10: 0xdcc02190 (stale) Mirror 11: 0xdcc02190 (stale) Mirror 12: 0xdcc02190 (stale) Mirror 13: 0xdcc02190 (stale) Mirror 14: 0x7044cb5a (stale) Mirror 15: 0x74833f7d (stale) CRC-32 checksum value for chunk [0, 0x38475): Mirror 1: 0xa339f434 Mirror 16: 0xa339f434 Mirror 17: 0xa339f434 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38475: skipped 000630 1788776836.679632 mapread 0x0175e4 thru 0x01adb6 (0x37d3 bytes) 000632 1788776836.741824 MIRROR_RESYNC 10 mirrors 000633 1788776839.096218 read 0x026eb4 thru 0x02dc00 (0x6d4d bytes) 000634 1788776839.105926 read 0x035bf1 thru 0x038474 (0x2884 bytes) 000635 1788776839.116345 mapread 0x00b64c thru 0x01a0ca (0xea7f bytes) 000637 1788776839.117973 write 0x039ee3 thru 0x03ffff (0x611d bytes) 000639 1788776839.193951 trunc from 0x040000 to 0x00ed43 (0x312bc bytes) 000640 1788776839.243721 write 0x021ff4 thru 0x02f652 (0xd65f bytes) 000641 1788776839.251358 trunc from 0x02f653 to 0x00c812 (0x22e40 bytes) 000643 1788776839.310909 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0xc813): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc813): Mirror 8: 0x6da0eee6 (stale) Mirror 10: 0x6da0eee6 (stale) Mirror 11: 0x6da0eee6 (stale) Mirror 12: 0x6da0eee6 (stale) Mirror 13: 0x6da0eee6 (stale) Mirror 14: 0x6da0eee6 (stale) Mirror 15: 0x6da0eee6 (stale) Mirror 16: 0x6da0eee6 (stale) Mirror 17: 0x6da0eee6 (stale) CRC-32 checksum value for chunk [0, 0xc813): Mirror 1: 0x6da0eee6 Mirror 18: 0x6da0eee6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc813: skipped 000644 1788776840.977023 mapread 0x004f3a thru 0x00c33e (0x7405 bytes) 000645 1788776841.009828 mapread 0x009ecf thru 0x00c812 (0x2944 bytes) 000648 1788776841.045032 mapwrite 0x025cef thru 0x034b05 (0xee17 bytes) 000649 1788776841.208236 mapread 0x005e4c thru 0x011a8c (0xbc41 bytes) 000650 1788776841.231114 punch from 0x007d3d to 0x009118 (0x13dc bytes) 000651 1788776841.236821 mapread 0x003541 thru 0x0077d4 (0x4294 bytes) 000654 1788776841.245591 trunc from 0x034b06 to 0x002d3e (0x31dc7 bytes) 000655 1788776841.269183 mapwrite 0x03d921 thru 0x03ffff (0x26df bytes) 000656 1788776841.335305 mapwrite 0x03c7a3 thru 0x03ffff (0x385d bytes) 000658 1788776841.382036 read 0x013a27 thru 0x016d0f (0x32e9 bytes) 000659 1788776841.397047 MIRROR_RESYNC 11 mirrors 000660 1788776843.674142 mapwrite 0x03e4db thru 0x03ffff (0x1b25 bytes) 000662 1788776843.933437 read 0x01d529 thru 0x021784 (0x425c bytes) 000663 1788776843.958934 read 0x0377e0 thru 0x03ffff (0x8820 bytes) 000667 1788776843.986652 read 0x02d9c1 thru 0x030384 (0x29c4 bytes) 000668 1788776843.987658 punch from 0x02383d to 0x02b200 (0x79c4 bytes) 000669 1788776844.005607 mapwrite 0x0361ff thru 0x038831 (0x2633 bytes) 000672 1788776844.100743 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x6799789f (stale) Mirror 10: 0x6799789f (stale) Mirror 12: 0x6799789f (stale) Mirror 13: 0x6799789f (stale) Mirror 14: 0x6799789f (stale) Mirror 15: 0x6799789f (stale) Mirror 16: 0x6799789f (stale) Mirror 17: 0x6799789f (stale) Mirror 18: 0x6799789f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x6799789f (stale) Mirror 10: 0x6799789f (stale) Mirror 12: 0x6799789f (stale) Mirror 13: 0x6799789f (stale) Mirror 14: 0x6799789f (stale) Mirror 15: 0x6799789f (stale) Mirror 16: 0x6799789f (stale) Mirror 17: 0x6799789f (stale) Mirror 18: 0x6799789f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000673 1788776845.032959 mapwrite 0x024eef thru 0x0263a3 (0x14b5 bytes) 000674 1788776845.113944 trunc from 0x040000 to 0x025d6b (0x1a294 bytes) 000675 1788776845.144451 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x25d6c): Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25d6c): Mirror 8: 0xce875153 (stale) Mirror 10: 0xce875153 (stale) Mirror 12: 0xce875153 (stale) Mirror 13: 0xce875153 (stale) Mirror 14: 0xce875153 (stale) Mirror 15: 0xce875153 (stale) Mirror 16: 0xce875153 (stale) Mirror 17: 0xce875153 (stale) Mirror 18: 0xce875153 (stale) CRC-32 checksum value for chunk [0, 0x25d6c): Mirror 1: 0x3300a2de Mirror 19: 0x3300a2de lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25d6c: skipped 000676 1788776846.647310 mapread 0x021569 thru 0x025d6b (0x4803 bytes) 000679 1788776846.729227 write 0x000189 thru 0x00813f (0x7fb7 bytes) 000680 1788776846.809866 mapwrite 0x02c2c9 thru 0x034472 (0x81aa bytes) 000681 1788776846.970440 mapread 0x02b5da thru 0x034472 (0x8e99 bytes) 000682 1788776846.971324 read 0x00e1b5 thru 0x01a897 (0xc6e3 bytes) 000683 1788776846.979978 punch from 0x005d47 to 0x007c4b (0x1f05 bytes) 000686 1788776846.992963 mapread 0x02d307 thru 0x02d6d7 (0x3d1 bytes) 000688 1788776846.997179 read 0x000f1f thru 0x00ecb3 (0xdd95 bytes) 000690 1788776847.022032 read 0x02797e thru 0x0322a5 (0xa928 bytes) 000691 1788776847.036820 MIRROR_RESYNC 11 mirrors 000692 1788776849.163757 punch from 0x033ae0 to 0x034472 (0x993 bytes) 000693 1788776849.244065 MIRROR_RESYNC 11 mirrors 000694 1788776851.700834 punch from 0x02c95a to 0x034472 (0x7b19 bytes) 000696 1788776851.867130 mapread 0x00e3ff thru 0x014692 (0x6294 bytes) 000697 1788776851.913329 trunc from 0x034473 to 0x02d8aa (0x6bc8 bytes) 000701 1788776851.942717 punch from 0x007cfd to 0x0151f6 (0xd4fa bytes) 000704 1788776851.951388 mapread 0x00af7f thru 0x010341 (0x53c3 bytes) 000705 1788776851.962569 trunc from 0x02d8ab to 0x01fc17 (0xdc93 bytes) 000707 1788776851.978304 read 0x018aaf thru 0x01b377 (0x28c9 bytes) 000710 1788776851.997272 MIRROR_RESYNC 11 mirrors 000713 1788776854.763026 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17e:0x0]: Invalid argument (22) 000714 1788776855.486200 write 0x01275f thru 0x022580 (0xfe22 bytes) 000715 1788776855.713495 mapread 0x01998e thru 0x01fbdc (0x624f bytes) 000716 1788776855.715932 mapwrite 0x006ddf thru 0x0143e6 (0xd608 bytes) 000719 1788776855.914383 read 0x01b7aa thru 0x01ff91 (0x47e8 bytes) 000721 1788776855.915452 write 0x007f9e thru 0x00f132 (0x7195 bytes) 000722 1788776855.922090 mapwrite 0x01d0be thru 0x01d3c1 (0x304 bytes) 000723 1788776856.088279 read 0x00fe34 thru 0x019e90 (0xa05d bytes) 000726 1788776856.098481 write 0x02ed7f thru 0x03d090 (0xe312 bytes) 000727 1788776856.123395 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d091): Mirror 8: 0x8004d82d (stale) Mirror 13: 0x8004d82d (stale) Mirror 14: 0x8004d82d (stale) Mirror 15: 0x8004d82d (stale) Mirror 16: 0x8004d82d (stale) Mirror 17: 0x8004d82d (stale) Mirror 18: 0x8004d82d (stale) Mirror 19: 0x8004d82d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d091): Mirror 8: 0x8004d82d (stale) Mirror 13: 0x8004d82d (stale) Mirror 14: 0x8004d82d (stale) Mirror 15: 0x8004d82d (stale) Mirror 16: 0x8004d82d (stale) Mirror 17: 0x8004d82d (stale) Mirror 18: 0x8004d82d (stale) Mirror 19: 0x8004d82d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d091: skipped 000728 1788776857.005704 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d091): Mirror 8: 0x8004d82d (stale) Mirror 13: 0x8004d82d (stale) Mirror 14: 0x8004d82d (stale) Mirror 16: 0x8004d82d (stale) Mirror 17: 0x8004d82d (stale) Mirror 18: 0x8004d82d (stale) Mirror 19: 0x8004d82d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d091): Mirror 8: 0x8004d82d (stale) Mirror 13: 0x8004d82d (stale) Mirror 14: 0x8004d82d (stale) Mirror 16: 0x8004d82d (stale) Mirror 17: 0x8004d82d (stale) Mirror 18: 0x8004d82d (stale) Mirror 19: 0x8004d82d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d091: skipped 000729 1788776857.787051 mapread 0x021cd7 thru 0x02ed09 (0xd033 bytes) 000730 1788776857.816460 mapread 0x0163ec thru 0x0210d1 (0xace6 bytes) 000731 1788776857.826402 read 0x008536 thru 0x0127c8 (0xa293 bytes) 000733 1788776857.840554 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3d091): Mirror 8: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d091): Mirror 8: 0x8004d82d (stale) Mirror 13: 0x8004d82d (stale) Mirror 14: 0x8004d82d (stale) Mirror 16: 0x8004d82d (stale) Mirror 17: 0x8004d82d (stale) Mirror 18: 0x8004d82d (stale) Mirror 19: 0x8004d82d (stale) CRC-32 checksum value for chunk [0, 0x3d091): Mirror 1: 0x8d7dd1d6 Mirror 20: 0x8d7dd1d6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d091: skipped 000734 1788776859.419441 read 0x022c42 thru 0x02409a (0x1459 bytes) 000735 1788776859.440077 trunc from 0x03d091 to 0x0298bc (0x137d4 bytes) 000738 1788776859.589151 mapwrite 0x00b6df thru 0x01989d (0xe1bf bytes) 000739 1788776859.767992 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x298bd): Mirror 8: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x298bd): Mirror 8: 0x553f3a54 (stale) Mirror 13: 0x553f3a54 (stale) Mirror 14: 0x553f3a54 (stale) Mirror 16: 0x553f3a54 (stale) Mirror 17: 0x553f3a54 (stale) Mirror 18: 0x553f3a54 (stale) Mirror 19: 0x553f3a54 (stale) Mirror 20: 0xa3c49e6 (stale) CRC-32 checksum value for chunk [0, 0x298bd): Mirror 1: 0x1c7ecbcb Mirror 21: 0x1c7ecbcb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x298bd: skipped 000740 1788776861.245211 trunc from 0x0298bd to 0x03da70 (0x141b4 bytes) 000741 1788776861.467084 trunc from 0x03da71 to 0x027110 (0x16960 bytes) 000742 1788776861.513993 read 0x00d49a thru 0x01c9fd (0xf564 bytes) 000743 1788776861.529010 mapread 0x01d868 thru 0x02064a (0x2de3 bytes) 000744 1788776861.548362 write 0x01331a thru 0x018b23 (0x580a bytes) 000745 1788776861.550104 read 0x00c05d thru 0x011f78 (0x5f1c bytes) 000747 1788776861.568489 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x27111): Mirror 8: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27111): Mirror 8: 0x2f0e7e4 (stale) Mirror 13: 0x2f0e7e4 (stale) Mirror 14: 0x2f0e7e4 (stale) Mirror 16: 0x2f0e7e4 (stale) Mirror 17: 0x2f0e7e4 (stale) Mirror 18: 0x2f0e7e4 (stale) Mirror 19: 0x2f0e7e4 (stale) Mirror 20: 0xcee6c974 (stale) Mirror 21: 0x369145c2 (stale) CRC-32 checksum value for chunk [0, 0x27111): Mirror 1: 0xf4207e74 Mirror 22: 0xf4207e74 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27111: skipped 000748 1788776862.899834 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x27111): Mirror 8: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27111): Mirror 8: 0x2f0e7e4 (stale) Mirror 13: 0x2f0e7e4 (stale) Mirror 14: 0x2f0e7e4 (stale) Mirror 16: 0x2f0e7e4 (stale) Mirror 17: 0x2f0e7e4 (stale) Mirror 18: 0x2f0e7e4 (stale) Mirror 19: 0x2f0e7e4 (stale) Mirror 20: 0xcee6c974 (stale) Mirror 21: 0x369145c2 (stale) CRC-32 checksum value for chunk [0, 0x27111): Mirror 1: 0xf4207e74 Mirror 22: 0xf4207e74 Mirror 23: 0xf4207e74 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27111: skipped 000749 1788776864.070223 mapread 0x001d64 thru 0x0115a0 (0xf83d bytes) 000751 1788776864.106747 trunc from 0x027111 to 0x03b12d (0x1401d bytes) 000752 1788776864.218759 trunc from 0x03b12e to 0x01523c (0x25ef1 bytes) 000754 1788776864.250976 write 0x01c8b7 thru 0x01ed4c (0x2496 bytes) 000755 1788776864.253188 trunc from 0x01ed4d to 0x0141b2 (0xab9a bytes) 000756 1788776864.296966 mapread 0x013454 thru 0x0141b2 (0xd5f bytes) 000757 1788776864.339615 read 0x0095ed thru 0x0141b2 (0xabc6 bytes) 000758 1788776864.355281 punch from 0x004e14 to 0x013512 (0xe6ff bytes) 000761 1788776864.392923 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x141b3): Mirror 8: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x141b3): Mirror 8: 0x9c3c16f7 (stale) Mirror 13: 0x9c3c16f7 (stale) Mirror 14: 0x9c3c16f7 (stale) Mirror 16: 0x9c3c16f7 (stale) Mirror 17: 0x9c3c16f7 (stale) Mirror 18: 0x9c3c16f7 (stale) Mirror 19: 0x9c3c16f7 (stale) Mirror 20: 0x165dc9b6 (stale) Mirror 21: 0x12dc7159 (stale) Mirror 22: 0xaedadc78 (stale) Mirror 23: 0xaedadc78 (stale) CRC-32 checksum value for chunk [0, 0x141b3): Mirror 1: 0xdaa52667 Mirror 24: 0xdaa52667 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x141b3: skipped 000762 1788776865.658421 mapread 0x003582 thru 0x00e8ed (0xb36c bytes) 000763 1788776865.687281 mapwrite 0x02722f thru 0x034175 (0xcf47 bytes) 000765 1788776865.946122 write 0x023c59 thru 0x0281c1 (0x4569 bytes) 000766 1788776865.949918 mapread 0x014423 thru 0x01f36d (0xaf4b bytes) 000768 1788776865.969096 punch from 0x003bae to 0x00ec2d (0xb080 bytes) 000769 1788776865.989138 MIRROR_RESYNC 13 mirrors 000770 1788776868.546708 write 0x006f29 thru 0x00fbd7 (0x8caf bytes) 000771 1788776868.757338 mapwrite 0x016e55 thru 0x0170dc (0x288 bytes) 000774 1788776868.923492 mapwrite 0x00e46e thru 0x00e794 (0x327 bytes) 000775 1788776869.035248 mapwrite 0x034a99 thru 0x03f458 (0xa9c0 bytes) 000777 1788776869.260251 mapread 0x0335e2 thru 0x03750c (0x3f2b bytes) 000778 1788776869.262771 punch from 0x02ea57 to 0x031eca (0x3474 bytes) 000780 1788776869.268159 mapwrite 0x036342 thru 0x0386e5 (0x23a4 bytes) 000781 1788776869.341888 trunc from 0x03f459 to 0x001f81 (0x3d4d7 bytes) 000782 1788776869.377230 punch from 0x000d7e to 0x001f81 (0x1204 bytes) 000785 1788776869.387096 read 0x000ead thru 0x001f81 (0x10d5 bytes) 000786 1788776869.408155 punch from 0x0009fa to 0x001f81 (0x1588 bytes) 000788 1788776869.419494 punch from 0x001a53 to 0x001f81 (0x52f bytes) 000789 1788776869.431448 mapwrite 0x037c86 thru 0x03a250 (0x25cb bytes) 000790 1788776869.573789 write 0x0160dd thru 0x01b0a0 (0x4fc4 bytes) 000791 1788776869.605973 mapwrite 0x00ba24 thru 0x00f9e8 (0x3fc5 bytes) 000793 1788776869.687802 mapwrite 0x032dc9 thru 0x037eb9 (0x50f1 bytes) 000795 1788776869.805546 MIRROR_RESYNC 13 mirrors 000796 1788776874.248723 MIRROR_EXTEND to 14 mirrors 000797 1788776875.709722 write 0x018d09 thru 0x0215df (0x88d7 bytes) 000799 1788776875.871368 mapread 0x02ffd8 thru 0x03a250 (0xa279 bytes) 000800 1788776875.929456 mapread 0x00e989 thru 0x012fbe (0x4636 bytes) 000801 1788776875.964099 punch from 0x011900 to 0x019bbb (0x82bc bytes) 000802 1788776875.989532 mapread 0x018b1a thru 0x0206d8 (0x7bbf bytes) 000803 1788776876.024993 punch from 0x009d3c to 0x00a735 (0x9fa bytes) 000804 1788776876.045242 write 0x00decf thru 0x01dc14 (0xfd46 bytes) 000805 1788776876.048157 mapwrite 0x007ed5 thru 0x012761 (0xa88d bytes) 000806 1788776876.208116 mapread 0x035fbe thru 0x03a250 (0x4293 bytes) 000809 1788776876.210152 write 0x02ebca thru 0x032130 (0x3567 bytes) 000813 1788776876.213878 read 0x0190c9 thru 0x01ed5f (0x5c97 bytes) 000815 1788776876.217343 trunc from 0x03a251 to 0x019d54 (0x204fc bytes) 000818 1788776876.248647 punch from 0x0073e7 to 0x016bc3 (0xf7dd bytes) 000819 1788776876.260358 mapwrite 0x038b6e thru 0x03e2a7 (0x573a bytes) 000820 1788776876.419109 mapread 0x006c13 thru 0x012966 (0xbd54 bytes) 000821 1788776876.456943 mapread 0x03b0f0 thru 0x03e2a7 (0x31b8 bytes) 000822 1788776876.458223 read 0x003a20 thru 0x00be40 (0x8421 bytes) 000823 1788776876.458870 punch from 0x005ef4 to 0x00dbd7 (0x7ce4 bytes) 000825 1788776876.468015 write 0x02b96e thru 0x02f41a (0x3aad bytes) 000826 1788776876.499346 write 0x00b4a2 thru 0x01142d (0x5f8c bytes) 000827 1788776876.500604 read 0x003a66 thru 0x00c4ec (0x8a87 bytes) 000828 1788776876.501203 read 0x0155ef thru 0x0203ce (0xade0 bytes) 000829 1788776876.505821 mapread 0x028c58 thru 0x02a3bb (0x1764 bytes) 000831 1788776876.510225 read 0x002f8e thru 0x00ba5b (0x8ace bytes) 000833 1788776876.513316 trunc from 0x03e2a8 to 0x00583b (0x38a6c bytes) 000835 1788776876.554240 punch from 0x0033a7 to 0x00583b (0x2495 bytes) 000836 1788776876.565251 trunc from 0x00583c to 0x025eed (0x206b2 bytes) 000837 1788776876.588036 read 0x00874f thru 0x01229b (0x9b4d bytes) 000838 1788776876.614421 read 0x00611a thru 0x015e46 (0xfd2d bytes) 000840 1788776876.615749 punch from 0x01db2c to 0x0239c1 (0x5e96 bytes) 000841 1788776876.630847 write 0x02818d thru 0x02a377 (0x21eb bytes) 000842 1788776876.632299 write 0x0112d5 thru 0x018947 (0x7673 bytes) 000843 1788776876.650737 MIRROR_RESYNC 14 mirrors 000844 1788776879.744713 write 0x00c68c thru 0x00fc17 (0x358c bytes) 000845 1788776879.852474 write 0x03cdd6 thru 0x03ffff (0x322a bytes) 000846 1788776879.858988 write 0x037e82 thru 0x03f340 (0x74bf bytes) 000848 1788776879.877567 write 0x018750 thru 0x018e1a (0x6cb bytes) 000849 1788776879.888444 mapwrite 0x027f7f thru 0x033c1f (0xbca1 bytes) 000850 1788776880.030081 read 0x027c5b thru 0x02a216 (0x25bc bytes) 000851 1788776880.032154 punch from 0x032f12 to 0x03ffff (0xd0ee bytes) 000852 1788776880.044728 read 0x01f089 thru 0x022415 (0x338d bytes) 000853 1788776880.060072 mapwrite 0x01b888 thru 0x01fd7e (0x44f7 bytes) 000855 1788776880.113399 write 0x0391d0 thru 0x03dd07 (0x4b38 bytes) 000858 1788776880.118223 trunc from 0x040000 to 0x032c40 (0xd3bf bytes) 000859 1788776880.144152 mapwrite 0x039bce thru 0x03d7fb (0x3c2e bytes) 000864 1788776880.230973 trunc from 0x03d7fc to 0x0050da (0x38721 bytes) 000865 1788776880.260115 mapread 0x003cf5 thru 0x0050da (0x13e6 bytes) 000866 1788776880.273072 MIRROR_SPLIT mirror 1 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x50db): Mirror 13: 0xf00e81a1 (stale) Mirror 14: 0xf00e81a1 (stale) Mirror 16: 0xf00e81a1 (stale) Mirror 17: 0xf00e81a1 (stale) Mirror 18: 0xf00e81a1 (stale) Mirror 19: 0xf00e81a1 (stale) Mirror 20: 0xf00e81a1 (stale) Mirror 21: 0xf00e81a1 (stale) Mirror 22: 0xf00e81a1 (stale) Mirror 23: 0xf00e81a1 (stale) Mirror 24: 0xf00e81a1 (stale) Mirror 25: 0xf00e81a1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x50db): Mirror 13: 0xf00e81a1 (stale) Mirror 14: 0xf00e81a1 (stale) Mirror 16: 0xf00e81a1 (stale) Mirror 17: 0xf00e81a1 (stale) Mirror 18: 0xf00e81a1 (stale) Mirror 19: 0xf00e81a1 (stale) Mirror 20: 0xf00e81a1 (stale) Mirror 21: 0xf00e81a1 (stale) Mirror 22: 0xf00e81a1 (stale) Mirror 23: 0xf00e81a1 (stale) Mirror 24: 0xf00e81a1 (stale) Mirror 25: 0xf00e81a1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x50db: skipped 000867 1788776881.230431 read 0x000386 thru 0x00376c (0x33e7 bytes) 000868 1788776881.241460 punch from 0x00077f to 0x0048a8 (0x412a bytes) 000869 1788776881.248198 read 0x000051 thru 0x0050da (0x508a bytes) 000870 1788776881.258053 write 0x037d47 thru 0x03ffff (0x82b9 bytes) 000871 1788776881.261057 trunc from 0x040000 to 0x02b8ee (0x14711 bytes) 000872 1788776881.279461 read 0x003398 thru 0x003d88 (0x9f1 bytes) 000875 1788776881.281135 write 0x034c23 thru 0x03ffff (0xb3dd bytes) 000879 1788776881.297822 read 0x02981b thru 0x02e90e (0x50f4 bytes) 000880 1788776881.313048 write 0x031c2c thru 0x03f94d (0xdd22 bytes) 000881 1788776881.315043 read 0x01c7aa thru 0x02786d (0xb0c4 bytes) 000883 1788776881.318627 read 0x018395 thru 0x01e4db (0x6147 bytes) 000884 1788776881.319929 read 0x005e63 thru 0x009add (0x3c7b bytes) 000887 1788776881.327965 mapwrite 0x015851 thru 0x018912 (0x30c2 bytes) 000888 1788776881.419171 read 0x015738 thru 0x0163fc (0xcc5 bytes) 000889 1788776881.420188 read 0x02852d thru 0x02cd1e (0x47f2 bytes) 000890 1788776881.421330 punch from 0x0270be to 0x02e689 (0x75cc bytes) 000892 1788776881.430583 punch from 0x00f31c to 0x015158 (0x5e3d bytes) 000894 1788776881.447897 mapread 0x019bba thru 0x01f0f9 (0x5540 bytes) 000896 1788776881.451985 read 0x039b3c thru 0x03bf07 (0x23cc bytes) 000897 1788776881.453084 punch from 0x03893d to 0x03abbc (0x2280 bytes) 000898 1788776881.470071 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x9b48ac32 (stale) Mirror 14: 0x9b48ac32 (stale) Mirror 16: 0x9b48ac32 (stale) Mirror 17: 0x9b48ac32 (stale) Mirror 18: 0x9b48ac32 (stale) Mirror 19: 0x9b48ac32 (stale) Mirror 20: 0x9b48ac32 (stale) Mirror 21: 0x9b48ac32 (stale) Mirror 22: 0x9b48ac32 (stale) Mirror 23: 0x9b48ac32 (stale) Mirror 24: 0x9b48ac32 (stale) Mirror 25: 0x9b48ac32 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x375be79 Mirror 26: 0x375be79 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000899 1788776883.584949 write 0x00ec17 thru 0x01b021 (0xc40b bytes) 000901 1788776883.786188 punch from 0x01f975 to 0x02af1b (0xb5a7 bytes) 000903 1788776883.840598 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x9b48ac32 (stale) Mirror 14: 0x9b48ac32 (stale) Mirror 16: 0x9b48ac32 (stale) Mirror 17: 0x9b48ac32 (stale) Mirror 18: 0x9b48ac32 (stale) Mirror 19: 0x9b48ac32 (stale) Mirror 20: 0x9b48ac32 (stale) Mirror 21: 0x9b48ac32 (stale) Mirror 22: 0x9b48ac32 (stale) Mirror 23: 0x9b48ac32 (stale) Mirror 24: 0x9b48ac32 (stale) Mirror 25: 0x9b48ac32 (stale) Mirror 26: 0x375be79 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3ae91ca3 Mirror 27: 0x3ae91ca3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000904 1788776885.780154 write 0x00f88d thru 0x01f819 (0xff8d bytes) 000905 1788776885.921583 read 0x01845d thru 0x026457 (0xdffb bytes) 000906 1788776885.935283 write 0x03c8d7 thru 0x03ffff (0x3729 bytes) 000908 1788776886.001734 MIRROR_RESYNC 15 mirrors 000909 1788776891.307893 write 0x036d14 thru 0x03ffff (0x92ec bytes) 000910 1788776891.522763 mapread 0x032bfe thru 0x03cb10 (0x9f13 bytes) 000911 1788776891.585299 write 0x03f6d2 thru 0x03ffff (0x92e bytes) 000912 1788776891.586014 punch from 0x03294e to 0x039765 (0x6e18 bytes) 000913 1788776891.632678 mapwrite 0x00692b thru 0x00ad4f (0x4425 bytes) 000914 1788776891.778970 mapread 0x02e0b2 thru 0x03ade9 (0xcd38 bytes) 000915 1788776891.825796 mapwrite 0x016424 thru 0x019437 (0x3014 bytes) 000916 1788776891.995156 write 0x034e6f thru 0x03ffff (0xb191 bytes) 000917 1788776891.996723 mapwrite 0x0035e7 thru 0x00b44d (0x7e67 bytes) 000918 1788776892.161137 MIRROR_SPLIT mirror 6 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x46dbcfd3 (stale) Mirror 14: 0x46dbcfd3 (stale) Mirror 16: 0x46dbcfd3 (stale) Mirror 17: 0x46dbcfd3 (stale) Mirror 18: 0x46dbcfd3 (stale) Mirror 20: 0x46dbcfd3 (stale) Mirror 21: 0x46dbcfd3 (stale) Mirror 22: 0x46dbcfd3 (stale) Mirror 23: 0x46dbcfd3 (stale) Mirror 24: 0x46dbcfd3 (stale) Mirror 25: 0x46dbcfd3 (stale) Mirror 26: 0x46dbcfd3 (stale) Mirror 27: 0x46dbcfd3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x46dbcfd3 (stale) Mirror 14: 0x46dbcfd3 (stale) Mirror 16: 0x46dbcfd3 (stale) Mirror 17: 0x46dbcfd3 (stale) Mirror 18: 0x46dbcfd3 (stale) Mirror 20: 0x46dbcfd3 (stale) Mirror 21: 0x46dbcfd3 (stale) Mirror 22: 0x46dbcfd3 (stale) Mirror 23: 0x46dbcfd3 (stale) Mirror 24: 0x46dbcfd3 (stale) Mirror 25: 0x46dbcfd3 (stale) Mirror 26: 0x46dbcfd3 (stale) Mirror 27: 0x46dbcfd3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000921 1788776893.237669 read 0x03f2a7 thru 0x03ffff (0xd59 bytes) 000922 1788776893.245987 punch from 0x02cd8f to 0x0342d6 (0x7548 bytes) 000923 1788776893.251627 trunc from 0x040000 to 0x03ca93 (0x356c bytes) 000924 1788776893.277209 punch from 0x0368bf to 0x037339 (0xa7b bytes) 000925 1788776893.290561 trunc from 0x03ca94 to 0x024be3 (0x17eb0 bytes) 000926 1788776893.321046 mapwrite 0x02eadc thru 0x034540 (0x5a65 bytes) 000927 1788776893.515017 mapread 0x00990a thru 0x015ec2 (0xc5b9 bytes) 000928 1788776893.559409 mapread 0x00edc3 thru 0x01216d (0x33ab bytes) 000929 1788776893.560459 mapwrite 0x00fd73 thru 0x018c10 (0x8e9e bytes) 000930 1788776893.680478 mapwrite 0x01b588 thru 0x023be3 (0x865c bytes) 000931 1788776893.806598 write 0x01aacd thru 0x027db4 (0xd2e8 bytes) 000932 1788776893.831534 punch from 0x029ba2 to 0x034540 (0xa99f bytes) 000933 1788776893.868254 mapread 0x01226a thru 0x0134d4 (0x126b bytes) 000934 1788776893.871057 mapread 0x02d439 thru 0x034540 (0x7108 bytes) 000935 1788776893.907872 mapwrite 0x028514 thru 0x02b088 (0x2b75 bytes) 000937 1788776893.979741 trunc from 0x034541 to 0x01b6b1 (0x18e8f bytes) 000938 1788776894.014488 write 0x02065a thru 0x020b5b (0x502 bytes) 000940 1788776894.016190 read 0x0078f6 thru 0x0084bd (0xbc8 bytes) 000941 1788776894.016872 write 0x002751 thru 0x01063c (0xdeec bytes) 000942 1788776894.024818 mapread 0x0027b3 thru 0x00c332 (0x9b80 bytes) 000944 1788776894.029068 mapwrite 0x003abd thru 0x01150b (0xda4f bytes) 000945 1788776894.158341 write 0x0019b3 thru 0x00825a (0x68a8 bytes) 000946 1788776894.205363 MIRROR_SPLIT mirror 6 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20b5c): Mirror 13: 0x19c3ac20 (stale) Mirror 14: 0x19c3ac20 (stale) Mirror 16: 0x19c3ac20 (stale) Mirror 17: 0x19c3ac20 (stale) Mirror 18: 0x19c3ac20 (stale) Mirror 21: 0x19c3ac20 (stale) Mirror 22: 0x19c3ac20 (stale) Mirror 23: 0x19c3ac20 (stale) Mirror 24: 0x19c3ac20 (stale) Mirror 25: 0x19c3ac20 (stale) Mirror 26: 0x19c3ac20 (stale) Mirror 27: 0x19c3ac20 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20b5c): Mirror 13: 0x19c3ac20 (stale) Mirror 14: 0x19c3ac20 (stale) Mirror 16: 0x19c3ac20 (stale) Mirror 17: 0x19c3ac20 (stale) Mirror 18: 0x19c3ac20 (stale) Mirror 21: 0x19c3ac20 (stale) Mirror 22: 0x19c3ac20 (stale) Mirror 23: 0x19c3ac20 (stale) Mirror 24: 0x19c3ac20 (stale) Mirror 25: 0x19c3ac20 (stale) Mirror 26: 0x19c3ac20 (stale) Mirror 27: 0x19c3ac20 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20b5c: skipped 000947 1788776895.035107 mapread 0x00598b thru 0x0096bd (0x3d33 bytes) 000948 1788776895.108127 read 0x01f359 thru 0x020b5b (0x1803 bytes) 000949 1788776895.131728 punch from 0x005b4f to 0x013665 (0xdb17 bytes) 000950 1788776895.184655 write 0x02de6b thru 0x034eb6 (0x704c bytes) 000951 1788776895.186150 write 0x03d109 thru 0x03ffff (0x2ef7 bytes) 000952 1788776895.193582 mapread 0x009bff thru 0x012859 (0x8c5b bytes) 000953 1788776895.244205 mapwrite 0x00d6b2 thru 0x010831 (0x3180 bytes) 000954 1788776895.408052 MIRROR_SPLIT mirror 2 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x46dbcfd3 (stale) Mirror 16: 0x46dbcfd3 (stale) Mirror 17: 0x46dbcfd3 (stale) Mirror 18: 0x46dbcfd3 (stale) Mirror 21: 0x46dbcfd3 (stale) Mirror 22: 0x46dbcfd3 (stale) Mirror 23: 0x46dbcfd3 (stale) Mirror 24: 0x46dbcfd3 (stale) Mirror 25: 0x46dbcfd3 (stale) Mirror 26: 0x46dbcfd3 (stale) Mirror 27: 0x46dbcfd3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x46dbcfd3 (stale) Mirror 16: 0x46dbcfd3 (stale) Mirror 17: 0x46dbcfd3 (stale) Mirror 18: 0x46dbcfd3 (stale) Mirror 21: 0x46dbcfd3 (stale) Mirror 22: 0x46dbcfd3 (stale) Mirror 23: 0x46dbcfd3 (stale) Mirror 24: 0x46dbcfd3 (stale) Mirror 25: 0x46dbcfd3 (stale) Mirror 26: 0x46dbcfd3 (stale) Mirror 27: 0x46dbcfd3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000955 1788776896.504633 read 0x034e49 thru 0x03df1c (0x90d4 bytes) 000957 1788776896.524766 punch from 0x0190ec to 0x01d752 (0x4667 bytes) 000958 1788776896.533059 write 0x0129d1 thru 0x01dee7 (0xb517 bytes) 000959 1788776896.552113 read 0x025d2a thru 0x033923 (0xdbfa bytes) 000961 1788776896.564916 punch from 0x001eb4 to 0x006603 (0x4750 bytes) 000963 1788776896.588276 MIRROR_SPLIT mirror 3 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x17e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x46dbcfd3 (stale) Mirror 16: 0x46dbcfd3 (stale) Mirror 18: 0x46dbcfd3 (stale) Mirror 21: 0x46dbcfd3 (stale) Mirror 22: 0x46dbcfd3 (stale) Mirror 23: 0x46dbcfd3 (stale) Mirror 24: 0x46dbcfd3 (stale) Mirror 25: 0x46dbcfd3 (stale) Mirror 26: 0x46dbcfd3 (stale) Mirror 27: 0x46dbcfd3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0x46dbcfd3 (stale) Mirror 16: 0x46dbcfd3 (stale) Mirror 18: 0x46dbcfd3 (stale) Mirror 21: 0x46dbcfd3 (stale) Mirror 22: 0x46dbcfd3 (stale) Mirror 23: 0x46dbcfd3 (stale) Mirror 24: 0x46dbcfd3 (stale) Mirror 25: 0x46dbcfd3 (stale) Mirror 26: 0x46dbcfd3 (stale) Mirror 27: 0x46dbcfd3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000964 1788776897.785600 read 0x020d99 thru 0x02a240 (0x94a8 bytes) 000967 1788776897.807982 trunc from 0x040000 to 0x021f7c (0x1e083 bytes) 000968 1788776897.835826 mapread 0x01fae1 thru 0x021f7c (0x249c bytes) 000969 1788776897.843777 mapwrite 0x0338f8 thru 0x03ffff (0xc708 bytes) 000970 1788776898.042815 write 0x02c488 thru 0x032926 (0x649f bytes) 000972 1788776898.050992 punch from 0x033459 to 0x03f368 (0xbf10 bytes) 000973 1788776898.095086 punch from 0x03f622 to 0x03ffff (0x9de bytes) 000974 1788776898.116481 MIRROR_RESYNC 11 mirrors 000975 1788776901.141026 MIRROR_RESYNC 11 mirrors 000977 1788776902.378670 mapread 0x02d2b4 thru 0x038be9 (0xb936 bytes) 000978 1788776902.449480 punch from 0x028e50 to 0x032b3d (0x9cee bytes) 000979 1788776902.554782 mapread 0x035205 thru 0x03ffff (0xadfb bytes) 000980 1788776902.598429 mapread 0x003e87 thru 0x004339 (0x4b3 bytes) 000981 1788776902.639671 punch from 0x00cb53 to 0x010de4 (0x4292 bytes) 000982 1788776902.651824 trunc from 0x040000 to 0x008edc (0x37123 bytes) 000983 1788776902.716687 mapread 0x007483 thru 0x008edc (0x1a5a bytes) 000984 1788776902.725688 punch from 0x008056 to 0x008edc (0xe87 bytes) 000985 1788776902.748692 read 0x004bb1 thru 0x008edc (0x432c bytes) 000986 1788776902.759750 mapwrite 0x034815 thru 0x03ffff (0xb7eb bytes) 000990 1788776903.060689 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 13: 0xac1977ef (stale) Mirror 16: 0xac1977ef (stale) Mirror 18: 0xac1977ef (stale) Mirror 21: 0xac1977ef (stale) Mirror 22: 0xac1977ef (stale) Mirror 23: 0xac1977ef (stale) Mirror 24: 0xac1977ef (stale) Mirror 25: 0xac1977ef (stale) Mirror 26: 0xac1977ef (stale) Mirror 27: 0xac1977ef (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa27bf655 Mirror 28: 0xa27bf655 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000991 1788776905.523007 mapwrite 0x005225 thru 0x00ea8a (0x9866 bytes) 000992 1788776905.770149 read 0x031e8d thru 0x038689 (0x67fd bytes) 000994 1788776905.785728 write 0x025460 thru 0x02c4ab (0x704c bytes) 000995 1788776905.808477 write 0x01fc8f thru 0x020289 (0x5fb bytes) 000996 1788776905.816956 punch from 0x02f0d1 to 0x0355b0 (0x64e0 bytes) 000997 1788776905.843090 MIRROR_RESYNC 12 mirrors 000998 1788776908.205742 MIRROR_RESYNC 12 mirrors 000999 1788776909.755253 read 0x0071a1 thru 0x00bd8a (0x4bea bytes) 001000 1788776909.769145 mapread 0x0226a6 thru 0x02ec25 (0xc580 bytes) All operations completed A-OK!