== sanity-flr test 70a: flr mode fsx test ================ 02:37:14 (1788331034) Seed set to 1037 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x2e87d 000003 1788331038.003609 trunc from 00000000 to 0x02e87c (0x2e87d bytes) 000004 1788331038.042349 trunc from 0x02e87d to 0x010e61 (0x1da1b bytes) 000009 1788331038.083802 punch from 0x00c604 to 0x010e61 (0x485e bytes) 000010 1788331038.094822 mapwrite 0x00f89a thru 0x015f4c (0x66b3 bytes) 000011 1788331038.343888 write 0x027d7a thru 0x0373ce (0xf655 bytes) 000012 1788331038.347656 mapread 0x03371a thru 0x0373ce (0x3cb5 bytes) 000013 1788331038.349548 mapread 0x00fe4b thru 0x013bec (0x3da2 bytes) 000015 1788331038.356212 mapread 0x0072c0 thru 0x00d59d (0x62de bytes) 000016 1788331038.392831 punch from 0x019922 to 0x0226ec (0x8dcb bytes) truncating to largest ever: 0x39e5f 000017 1788331038.409913 trunc from 0x0373cf to 0x039e5e (0x2a90 bytes) 000018 1788331038.450052 trunc from 0x039e5f to 0x02102a (0x18e34 bytes) 000019 1788331038.471890 mapread 0x00a6e2 thru 0x00ff29 (0x5848 bytes) 000021 1788331038.473262 mapwrite 0x02409a thru 0x02aca3 (0x6c0a bytes) 000022 1788331038.565484 punch from 0x0236c5 to 0x026057 (0x2993 bytes) 000023 1788331038.570406 read 0x028bb2 thru 0x029899 (0xce8 bytes) 000024 1788331038.570922 mapread 0x022850 thru 0x023f73 (0x1724 bytes) 000026 1788331038.583345 read 0x00d005 thru 0x012cd0 (0x5ccc bytes) 000027 1788331038.584353 read 0x01ef16 thru 0x0206c0 (0x17ab bytes) 000029 1788331038.587191 write 0x0167a9 thru 0x017be8 (0x1440 bytes) 000032 1788331038.605214 write 0x01081b thru 0x018c88 (0x846e bytes) 000033 1788331038.607111 read 0x01f5b8 thru 0x029dda (0xa823 bytes) 000034 1788331038.608094 read 0x00a03c thru 0x00a63a (0x5ff bytes) 000035 1788331038.609320 punch from 0x00cf14 to 0x0109e0 (0x3acd bytes) 000038 1788331038.626695 trunc from 0x02aca4 to 0x0320a5 (0x7402 bytes) 000039 1788331038.648456 read 0x026aa7 thru 0x02814c (0x16a6 bytes) 000040 1788331038.649051 mapwrite 0x038aa7 thru 0x03ffff (0x7559 bytes) 000042 1788331038.726871 mapwrite 0x037409 thru 0x03ffff (0x8bf7 bytes) 000043 1788331038.774182 mapwrite 0x00685a thru 0x010f60 (0xa707 bytes) 000044 1788331038.815008 punch from 0x014203 to 0x01448d (0x28b bytes) 000045 1788331038.818753 read 0x0191ef thru 0x0254f1 (0xc303 bytes) 000046 1788331038.819854 mapwrite 0x03499b thru 0x03ffff (0xb665 bytes) 000048 1788331038.864102 read 0x016b5f thru 0x01ef93 (0x8435 bytes) 000050 1788331038.865398 mapwrite 0x02c8c2 thru 0x034e48 (0x8587 bytes) 000051 1788331038.894775 punch from 0x031935 to 0x03cc14 (0xb2e0 bytes) 000052 1788331038.898494 trunc from 0x040000 to 0x013c0b (0x2c3f4 bytes) 000053 1788331038.911108 punch from 0x011677 to 0x013c0b (0x2595 bytes) 000054 1788331038.914519 mapread 0x00c20e thru 0x013c0b (0x79fe bytes) 000056 1788331038.920785 write 0x02ae36 thru 0x034591 (0x975c bytes) 000058 1788331038.923093 write 0x02dd81 thru 0x03a42b (0xc6ab bytes) 000059 1788331038.925509 punch from 0x027494 to 0x02e60e (0x717b bytes) 000060 1788331038.938168 read 0x02d219 thru 0x031328 (0x4110 bytes) 000062 1788331038.951321 punch from 0x038bcf to 0x03a42b (0x185d bytes) 000063 1788331038.956160 mapread 0x029117 thru 0x036c62 (0xdb4c bytes) 000064 1788331038.957502 mapread 0x00b39a thru 0x00dc4f (0x28b6 bytes) 000066 1788331038.959634 write 0x0025ae thru 0x0036e7 (0x113a bytes) 000067 1788331038.960805 punch from 0x02057c to 0x026743 (0x61c8 bytes) 000069 1788331038.972318 mapwrite 0x00560c thru 0x009b56 (0x454b bytes) 000070 1788331039.018118 read 0x00ff50 thru 0x01358a (0x363b bytes) 000071 1788331039.019188 mapwrite 0x01f1c2 thru 0x02b3d9 (0xc218 bytes) 000074 1788331039.099132 mapwrite 0x02539b thru 0x02f5d2 (0xa238 bytes) 000075 1788331039.151215 read 0x023721 thru 0x02d6bd (0x9f9d bytes) 000077 1788331039.152755 write 0x03e691 thru 0x03ffff (0x196f bytes) 000078 1788331039.154393 mapread 0x00103d thru 0x00ad35 (0x9cf9 bytes) 000079 1788331039.156433 punch from 0x01b68e to 0x01f355 (0x3cc8 bytes) 000081 1788331039.168167 trunc from 0x040000 to 0x033cd0 (0xc32f bytes) 000082 1788331039.187809 punch from 0x01306d to 0x02234d (0xf2e1 bytes) 000085 1788331039.192288 write 0x022cc2 thru 0x025aa0 (0x2ddf bytes) 000087 1788331039.204851 trunc from 0x033cd1 to 0x00d2da (0x269f6 bytes) 000089 1788331039.241379 mapread 0x005898 thru 0x006597 (0xd00 bytes) 000092 1788331039.245341 mapwrite 0x001ac2 thru 0x00fee2 (0xe421 bytes) 000095 1788331039.503742 mapread 0x005e25 thru 0x00ca29 (0x6c05 bytes) 000099 1788331039.508345 read 0x0074a5 thru 0x00fee2 (0x8a3e bytes) 000100 1788331039.509033 mapread 0x006fa3 thru 0x00fee2 (0x8f40 bytes) 000101 1788331039.522633 mapread 0x00de61 thru 0x00fee2 (0x2082 bytes) 000103 1788331039.531031 mapread 0x002a62 thru 0x003098 (0x637 bytes) 000104 1788331039.532180 write 0x00c5d1 thru 0x01a4bc (0xdeec bytes) 000105 1788331039.542308 trunc from 0x01a4bd to 0x006ffc (0x134c0 bytes) 000106 1788331039.577917 read 0x00448f thru 0x00627a (0x1dec bytes) 000109 1788331039.585555 read 0x0063d9 thru 0x006ffc (0xc24 bytes) 000110 1788331039.591968 write 0x027c9a thru 0x032d8b (0xb0f2 bytes) 000112 1788331039.615419 punch from 0x029b54 to 0x02ae82 (0x132f bytes) 000113 1788331039.654143 mapread 0x0247b4 thru 0x02556c (0xdb9 bytes) 000114 1788331039.662965 mapread 0x02842b thru 0x0323bd (0x9f93 bytes) 000115 1788331039.663864 write 0x0381e1 thru 0x03ffff (0x7e1f bytes) 000116 1788331039.668719 MIRROR_EXTEND to 2 mirrors 000117 1788331040.488426 mapwrite 0x015732 thru 0x017984 (0x2253 bytes) 000118 1788331040.711016 punch from 0x01135f to 0x01e15c (0xcdfe bytes) truncating to largest ever: 0x3ad4a 000120 1788331040.715965 trunc from 0x040000 to 0x03ad49 (0x52b6 bytes) 000121 1788331040.743385 trunc from 0x03ad4a to 0x037b1b (0x322e bytes) 000122 1788331040.764625 write 0x0200d5 thru 0x024c2e (0x4b5a bytes) 000123 1788331040.775153 read 0x009449 thru 0x01926a (0xfe22 bytes) 000124 1788331040.791879 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x37b1c): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37b1c): Mirror 2: 0xc510b1e4 (stale) CRC-32 checksum value for chunk [0, 0x37b1c): Mirror 1: 0xaf67adba Mirror 3: 0xaf67adba lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37b1c: skipped 000125 1788331042.141790 read 0x029c48 thru 0x030bc3 (0x6f7c bytes) 000126 1788331042.152849 mapwrite 0x02ddab thru 0x0353f0 (0x7646 bytes) 000127 1788331042.373443 MIRROR_RESYNC 3 mirrors 000128 1788331043.799303 mapread 0x02bb8f thru 0x02e719 (0x2b8b bytes) 000129 1788331043.815861 read 0x017e79 thru 0x025ae6 (0xdc6e bytes) 000130 1788331043.824237 read 0x018c62 thru 0x01c009 (0x33a8 bytes) 000131 1788331043.824833 punch from 0x02e4ff to 0x037b1b (0x961d bytes) 000133 1788331043.890229 mapwrite 0x034aad thru 0x036f24 (0x2478 bytes) 000134 1788331043.951181 write 0x0043ad thru 0x00896b (0x45bf bytes) 000137 1788331043.953154 read 0x003591 thru 0x00f26b (0xbcdb bytes) 000139 1788331043.954144 mapwrite 0x00f8ad thru 0x011304 (0x1a58 bytes) 000141 1788331044.010192 mapread 0x0108d4 thru 0x017e6a (0x7597 bytes) 000144 1788331044.014053 write 0x03388e thru 0x037058 (0x37cb bytes) 000145 1788331044.019728 mapwrite 0x004668 thru 0x00f798 (0xb131 bytes) 000146 1788331044.080287 write 0x03dfa4 thru 0x03e8b3 (0x910 bytes) 000147 1788331044.081222 write 0x0224df thru 0x0232dc (0xdfe bytes) 000149 1788331044.082435 punch from 0x022937 to 0x02b220 (0x88ea bytes) 000151 1788331044.094293 punch from 0x034fd6 to 0x03e8b3 (0x98de bytes) 000153 1788331044.098422 punch from 0x01ed8c to 0x024e91 (0x6106 bytes) 000154 1788331044.102208 trunc from 0x03e8b4 to 0x02936d (0x15546 bytes) 000155 1788331044.136995 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2936e): Mirror 3: 0x81b11f1f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2936e): Mirror 3: 0x81b11f1f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2936e: skipped 000156 1788331044.442044 mapread 0x015739 thru 0x01d627 (0x7eef bytes) 000157 1788331044.476698 punch from 0x017bcd to 0x0195da (0x1a0e bytes) 000158 1788331044.480710 mapread 0x0135da thru 0x014fa0 (0x19c7 bytes) 000161 1788331044.482824 write 0x00af85 thru 0x01024b (0x52c7 bytes) 000162 1788331044.487781 mapread 0x004929 thru 0x006a8c (0x2164 bytes) 000163 1788331044.497646 punch from 0x017bcf to 0x02287c (0xacae bytes) 000164 1788331044.525102 write 0x0097dc thru 0x01407e (0xa8a3 bytes) 000165 1788331044.526916 mapwrite 0x0035af thru 0x00528a (0x1cdc bytes) 000167 1788331044.613889 write 0x020a04 thru 0x02da18 (0xd015 bytes) 000171 1788331044.625370 mapwrite 0x002344 thru 0x011feb (0xfca8 bytes) 000172 1788331044.681750 read 0x00bded thru 0x017a75 (0xbc89 bytes) 000176 1788331044.685841 read 0x028ae7 thru 0x02da18 (0x4f32 bytes) 000177 1788331044.686313 mapwrite 0x03c208 thru 0x03ffff (0x3df8 bytes) 000178 1788331044.764637 mapwrite 0x01551a thru 0x022b54 (0xd63b bytes) 000179 1788331044.810773 write 0x0058e1 thru 0x00dcd0 (0x83f0 bytes) 000180 1788331044.812697 mapread 0x014829 thru 0x01792d (0x3105 bytes) 000183 1788331044.819374 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d2:0x0]: Invalid argument (22) 000186 1788331044.944696 mapwrite 0x02354e thru 0x0268e3 (0x3396 bytes) 000188 1788331045.005914 mapwrite 0x02af14 thru 0x0376a1 (0xc78e bytes) 000191 1788331045.068252 mapwrite 0x03f4f2 thru 0x03ffff (0xb0e bytes) 000192 1788331045.104971 write 0x00531c thru 0x011d14 (0xc9f9 bytes) 000194 1788331045.117871 trunc from 0x040000 to 0x0376b9 (0x8946 bytes) 000195 1788331045.133130 read 0x026174 thru 0x02ad99 (0x4c26 bytes) 000196 1788331045.133744 mapread 0x022575 thru 0x02f170 (0xcbfc bytes) 000199 1788331045.136209 read 0x02b707 thru 0x0376b9 (0xbfb3 bytes) 000200 1788331045.136907 mapread 0x019c66 thru 0x01cdfe (0x3199 bytes) 000202 1788331045.154229 trunc from 0x0376ba to 0x01c53d (0x1b17c bytes) 000203 1788331045.171340 write 0x014021 thru 0x01a5b8 (0x6598 bytes) 000204 1788331045.172862 read 0x011e5c thru 0x01a124 (0x82c9 bytes) 000206 1788331045.174050 trunc from 0x01c53e to 0x020719 (0x41dc bytes) 000208 1788331045.190598 punch from 0x009c65 to 0x00bb98 (0x1f34 bytes) 000209 1788331045.202365 read 0x00f4ad thru 0x017d18 (0x886c bytes) 000210 1788331045.203186 mapwrite 0x01c1be thru 0x023761 (0x75a4 bytes) 000212 1788331045.299428 write 0x01f83a thru 0x029164 (0x992b bytes) 000213 1788331045.301118 write 0x0028d6 thru 0x0076f2 (0x4e1d bytes) 000214 1788331045.303001 mapwrite 0x0369b4 thru 0x03d397 (0x69e4 bytes) 000215 1788331045.420269 read 0x009f35 thru 0x019caf (0xfd7b bytes) 000218 1788331045.423314 read 0x02dcf7 thru 0x033d30 (0x603a bytes) 000221 1788331045.425842 read 0x037a59 thru 0x03a6c0 (0x2c68 bytes) 000222 1788331045.427077 read 0x009bfc thru 0x011a07 (0x7e0c bytes) truncating to largest ever: 0x3ffe6 000223 1788331045.428346 trunc from 0x03d398 to 0x03ffe5 (0x2c4e bytes) 000224 1788331045.445277 punch from 0x004cb3 to 0x0067d0 (0x1b1e bytes) 000226 1788331045.450732 mapread 0x015334 thru 0x015967 (0x634 bytes) 000227 1788331045.451635 punch from 0x01ff32 to 0x0266b4 (0x6783 bytes) 000228 1788331045.462728 mapwrite 0x028e29 thru 0x029b85 (0xd5d bytes) 000229 1788331045.532654 read 0x0393ee thru 0x03ffe5 (0x6bf8 bytes) 000232 1788331045.540990 mapread 0x03b5fd thru 0x03ffe5 (0x49e9 bytes) 000233 1788331045.543051 mapread 0x03eb23 thru 0x03ffe5 (0x14c3 bytes) 000235 1788331045.555512 MIRROR_EXTEND to 2 mirrors 000236 1788331046.046987 write 0x002345 thru 0x00c142 (0x9dfe bytes) 000238 1788331046.116964 mapwrite 0x024eb4 thru 0x02ba77 (0x6bc4 bytes) 000240 1788331046.192467 write 0x031a43 thru 0x038430 (0x69ee bytes) 000241 1788331046.202259 read 0x01c946 thru 0x026585 (0x9c40 bytes) 000243 1788331046.207586 write 0x00536d thru 0x009b59 (0x47ed bytes) 000247 1788331046.212295 mapwrite 0x032687 thru 0x038e7d (0x67f7 bytes) 000248 1788331046.259329 write 0x039129 thru 0x03f12e (0x6006 bytes) 000249 1788331046.274383 MIRROR_RESYNC 2 mirrors 000253 1788331046.858918 punch from 0x002aeb to 0x006e33 (0x4349 bytes) 000257 1788331046.911732 mapread 0x02d264 thru 0x034fac (0x7d49 bytes) 000258 1788331046.927241 punch from 0x003585 to 0x00b379 (0x7df5 bytes) 000259 1788331046.931337 trunc from 0x03ffe6 to 0x00021b (0x3fdca bytes) 000260 1788331046.965901 read 0x000098 thru 0x00021b (0x184 bytes) 000262 1788331046.971623 write 0x00e37f thru 0x0184ed (0xa16f bytes) 000264 1788331046.973870 write 0x020e72 thru 0x022050 (0x11df bytes) 000265 1788331046.974817 mapread 0x01d86b thru 0x022050 (0x47e6 bytes) 000266 1788331046.981604 mapwrite 0x03160d thru 0x0317a8 (0x19c bytes) 000267 1788331047.056551 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d2:0x0]: Invalid argument (22) 000269 1788331047.169886 punch from 0x011798 to 0x018c24 (0x748d bytes) 000270 1788331047.175585 trunc from 0x0317a9 to 0x0034a2 (0x2e306 bytes) 000273 1788331047.192799 write 0x00bbb8 thru 0x016063 (0xa4ac bytes) 000274 1788331047.194926 trunc from 0x016064 to 0x022df1 (0xcd8e bytes) 000275 1788331047.212305 mapwrite 0x02b7f2 thru 0x037538 (0xbd47 bytes) 000277 1788331047.332218 trunc from 0x037539 to 0x0392c6 (0x1d8e bytes) 000280 1788331047.344345 read 0x0038ba thru 0x00528f (0x19d6 bytes) 000281 1788331047.348760 mapread 0x01d1e6 thru 0x024ab3 (0x78ce bytes) 000282 1788331047.357400 trunc from 0x0392c7 to 0x01d546 (0x1bd80 bytes) 000283 1788331047.369853 mapread 0x004f6e thru 0x013a19 (0xeaac bytes) 000284 1788331047.377508 punch from 0x0065e7 to 0x00ca65 (0x647f bytes) 000285 1788331047.382970 read 0x002af4 thru 0x002d70 (0x27d bytes) 000286 1788331047.383821 punch from 0x01d2ca to 0x01d546 (0x27d bytes) 000287 1788331047.389173 read 0x01028a thru 0x01c5cc (0xc343 bytes) 000288 1788331047.390564 mapread 0x01c3e3 thru 0x01d546 (0x1164 bytes) 000290 1788331047.399505 write 0x003c29 thru 0x0089a8 (0x4d80 bytes) 000292 1788331047.401800 write 0x031557 thru 0x037264 (0x5d0e bytes) 000293 1788331047.408972 MIRROR_EXTEND to 2 mirrors 000294 1788331048.136733 mapwrite 0x02228a thru 0x026dc2 (0x4b39 bytes) 000295 1788331048.255849 punch from 0x03266b to 0x037264 (0x4bfa bytes) 000296 1788331048.258583 write 0x01b999 thru 0x01d500 (0x1b68 bytes) 000297 1788331048.261558 trunc from 0x037265 to 0x01956a (0x1dcfa bytes) 000299 1788331048.282523 mapread 0x010583 thru 0x01956a (0x8fe8 bytes) 000301 1788331048.289806 mapread 0x006fee thru 0x00b3fe (0x4411 bytes) 000304 1788331048.304253 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d2:0x0]: Invalid argument (22) 000305 1788331048.455289 punch from 0x008a32 to 0x00dedf (0x54ae bytes) 000306 1788331048.461758 MIRROR_EXTEND to 2 mirrors 000307 1788331049.118590 mapwrite 0x00de61 thru 0x014201 (0x63a1 bytes) 000308 1788331049.301240 read 0x015b22 thru 0x01956a (0x3a49 bytes) 000309 1788331049.311510 punch from 0x011fab to 0x01956a (0x75c0 bytes) 000312 1788331049.323722 mapwrite 0x01119a thru 0x01887a (0x76e1 bytes) 000313 1788331049.468709 trunc from 0x01956b to 0x02f1ca (0x15c60 bytes) 000315 1788331049.487496 trunc from 0x02f1cb to 0x03291c (0x3752 bytes) 000317 1788331049.507706 mapwrite 0x02d194 thru 0x034f85 (0x7df2 bytes) 000319 1788331049.580537 read 0x00eb7f thru 0x00f60c (0xa8e bytes) 000321 1788331049.582876 write 0x00b430 thru 0x0191c4 (0xdd95 bytes) 000322 1788331049.584490 punch from 0x01a951 to 0x025c22 (0xb2d2 bytes) 000323 1788331049.598628 write 0x03b58c thru 0x03ffff (0x4a74 bytes) 000326 1788331049.603903 mapwrite 0x02c41e thru 0x02f4b4 (0x3097 bytes) 000327 1788331049.707198 punch from 0x0173b3 to 0x0196c4 (0x2312 bytes) 000328 1788331049.712982 write 0x023bb9 thru 0x029a54 (0x5e9c bytes) 000330 1788331049.730526 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d2:0x0]: Invalid argument (22) 000331 1788331049.867830 write 0x023763 thru 0x027e44 (0x46e2 bytes) 000334 1788331049.874690 mapread 0x001235 thru 0x00ec3c (0xda08 bytes) 000336 1788331049.891634 write 0x021b42 thru 0x02f88c (0xdd4b bytes) 000338 1788331049.898082 mapread 0x03a4a6 thru 0x03ffff (0x5b5a bytes) 000339 1788331049.906684 trunc from 0x040000 to 0x02ca59 (0x135a6 bytes) 000340 1788331049.921522 mapread 0x02833c thru 0x02c0ed (0x3db2 bytes) 000341 1788331049.922468 mapwrite 0x00a3d5 thru 0x010ece (0x6afa bytes) 000342 1788331050.005657 punch from 0x01d74a to 0x02c4dc (0xed93 bytes) 000343 1788331050.011264 read 0x010a02 thru 0x01668b (0x5c8a bytes) 000346 1788331050.030299 write 0x00db7b thru 0x01d13c (0xf5c2 bytes) 000347 1788331050.052148 trunc from 0x02ca5a to 0x02b666 (0x13f3 bytes) 000351 1788331050.068447 read 0x00dff8 thru 0x01d238 (0xf241 bytes) 000353 1788331050.072192 write 0x00af81 thru 0x015f11 (0xaf91 bytes) 000354 1788331050.073457 punch from 0x0199ef to 0x01a547 (0xb59 bytes) 000357 1788331050.090676 trunc from 0x02b667 to 0x027bc0 (0x3aa6 bytes) 000359 1788331050.119323 mapwrite 0x021e45 thru 0x02fb5b (0xdd17 bytes) 000362 1788331050.234272 trunc from 0x02fb5c to 0x0177f9 (0x18362 bytes) 000363 1788331050.283014 read 0x004f4c thru 0x013072 (0xe127 bytes) 000367 1788331050.308538 mapread 0x013164 thru 0x0177f9 (0x4696 bytes) 000369 1788331050.317851 mapwrite 0x0096ef thru 0x016e8c (0xd79e bytes) 000370 1788331050.423831 write 0x023b17 thru 0x02da05 (0x9eef bytes) 000371 1788331050.425147 mapread 0x01be73 thru 0x020f75 (0x5103 bytes) 000372 1788331050.431780 mapread 0x016108 thru 0x019998 (0x3891 bytes) 000375 1788331050.433736 mapread 0x026cc0 thru 0x02da05 (0x6d46 bytes) 000378 1788331050.436853 punch from 0x011c9d to 0x01fd8b (0xe0ef bytes) 000379 1788331050.455437 MIRROR_EXTEND to 2 mirrors 000380 1788331051.107339 write 0x037064 thru 0x03ffff (0x8f9c bytes) 000381 1788331051.165960 write 0x00f8c9 thru 0x01f3ec (0xfb24 bytes) 000382 1788331051.176001 read 0x022513 thru 0x02d52f (0xb01d bytes) 000384 1788331051.184113 write 0x03a1ad thru 0x03ffff (0x5e53 bytes) 000385 1788331051.185214 mapwrite 0x02a302 thru 0x039b71 (0xf870 bytes) 000387 1788331051.247179 mapread 0x0005fb thru 0x006dd0 (0x67d6 bytes) 000388 1788331051.257885 mapwrite 0x00b01a thru 0x00e785 (0x376c bytes) 000390 1788331051.322365 punch from 0x035a60 to 0x039db6 (0x4357 bytes) 000391 1788331051.329703 punch from 0x03aa8a to 0x03d0e0 (0x2657 bytes) 000392 1788331051.339842 mapread 0x0020ce thru 0x00d344 (0xb277 bytes) 000393 1788331051.353580 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d2:0x0]: Invalid argument (22) 000396 1788331051.538368 mapread 0x0153c3 thru 0x01d87d (0x84bb bytes) 000397 1788331051.558760 mapwrite 0x01adec thru 0x0263bd (0xb5d2 bytes) 000398 1788331051.690679 read 0x01e46b thru 0x02b306 (0xce9c bytes) 000401 1788331051.707442 write 0x030e32 thru 0x03ed31 (0xdf00 bytes) 000403 1788331051.743277 write 0x02021a thru 0x020d41 (0xb28 bytes) 000404 1788331051.744752 mapwrite 0x009e89 thru 0x00c6f6 (0x286e bytes) 000405 1788331051.857873 punch from 0x005583 to 0x00fa25 (0xa4a3 bytes) 000406 1788331051.865995 mapwrite 0x00ed92 thru 0x01396e (0x4bdd bytes) 000407 1788331051.962676 write 0x0253eb thru 0x02a356 (0x4f6c bytes) 000409 1788331051.963878 write 0x02352b thru 0x02d3c8 (0x9e9e bytes) 000410 1788331051.968701 read 0x031010 thru 0x0332af (0x22a0 bytes) 000412 1788331051.970023 trunc from 0x040000 to 0x02ad14 (0x152eb bytes) 000414 1788331052.062562 mapread 0x02a2c5 thru 0x02ad14 (0xa50 bytes) 000417 1788331052.095448 MIRROR_EXTEND to 2 mirrors 000418 1788331052.847763 mapwrite 0x03a4d5 thru 0x03ffff (0x5b2b bytes) 000420 1788331053.108995 trunc from 0x040000 to 0x013cf1 (0x2c30e bytes) 000421 1788331053.178967 trunc from 0x013cf2 to 0x031e3b (0x1e14a bytes) 000422 1788331053.227917 punch from 0x0110e6 to 0x01f40f (0xe32a bytes) 000423 1788331053.251664 mapread 0x009d3f thru 0x010119 (0x63db bytes) 000424 1788331053.269103 trunc from 0x031e3c to 0x004a79 (0x2d3c2 bytes) 000425 1788331053.351802 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x4a7a): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4a7a): Mirror 2: 0x1865ff50 (stale) CRC-32 checksum value for chunk [0, 0x4a7a): Mirror 1: 0x1865ff50 Mirror 3: 0x1865ff50 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4a7a: skipped 000427 1788331054.450602 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x4a7a): Mirror 2: 0x1865ff50 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4a7a): Mirror 2: 0x1865ff50 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4a7a: skipped 000429 1788331054.734173 write 0x02a445 thru 0x039845 (0xf401 bytes) 000430 1788331054.748659 trunc from 0x039846 to 0x036df5 (0x2a50 bytes) 000431 1788331054.762904 mapwrite 0x023269 thru 0x0331b9 (0xff51 bytes) 000433 1788331054.824073 mapread 0x002986 thru 0x0035dd (0xc58 bytes) 000434 1788331054.838766 trunc from 0x036df6 to 0x014b78 (0x2227d bytes) 000435 1788331054.859273 punch from 0x0106d0 to 0x014b78 (0x44a9 bytes) 000436 1788331054.865155 trunc from 0x014b79 to 0x027a12 (0x12e9a bytes) 000437 1788331054.879045 mapread 0x00a5ef thru 0x00f437 (0x4e49 bytes) 000438 1788331054.879901 mapwrite 0x0379bc thru 0x03f1a2 (0x77e7 bytes) 000439 1788331054.968816 trunc from 0x03f1a3 to 0x03d8ec (0x18b6 bytes) 000441 1788331054.988721 mapwrite 0x019b75 thru 0x021595 (0x7a21 bytes) 000442 1788331055.036902 mapwrite 0x033c71 thru 0x03ffff (0xc38f bytes) 000443 1788331055.106045 punch from 0x00b498 to 0x015d5b (0xa8c4 bytes) 000445 1788331055.117490 mapwrite 0x03eb3c thru 0x03ffff (0x14c4 bytes) 000448 1788331055.194605 trunc from 0x040000 to 0x038ee7 (0x7118 bytes) 000449 1788331055.219484 read 0x02c767 thru 0x03316b (0x6a05 bytes) 000450 1788331055.229326 punch from 0x018044 to 0x0277c4 (0xf781 bytes) 000452 1788331055.245328 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d2:0x0]: Invalid argument (22) 000453 1788331055.423312 read 0x0187c4 thru 0x02473f (0xbf7c bytes) 000456 1788331055.440637 punch from 0x020bdc to 0x02deb0 (0xd2d5 bytes) 000457 1788331055.457901 write 0x01cbab thru 0x02af91 (0xe3e7 bytes) 000459 1788331055.492702 MIRROR_EXTEND to 2 mirrors 000460 1788331056.296157 mapread 0x030127 thru 0x0348af (0x4789 bytes) 000461 1788331056.366610 mapwrite 0x000582 thru 0x003fa0 (0x3a1f bytes) 000462 1788331056.704134 mapwrite 0x017b3e thru 0x018ded (0x12b0 bytes) 000463 1788331056.788494 MIRROR_RESYNC 2 mirrors 000464 1788331057.746642 read 0x02840e thru 0x03571a (0xd30d bytes) 000465 1788331057.766842 trunc from 0x038ee8 to 0x0353d0 (0x3b17 bytes) 000466 1788331057.850549 mapwrite 0x03592f thru 0x03d8bf (0x7f91 bytes) 000469 1788331057.974862 mapread 0x00a364 thru 0x01069b (0x6338 bytes) 000470 1788331057.991850 write 0x03ae89 thru 0x03ffff (0x5177 bytes) 000472 1788331057.997071 mapwrite 0x03f0e1 thru 0x03ffff (0xf1f bytes) 000474 1788331058.064653 write 0x016ae2 thru 0x02012b (0x964a bytes) 000475 1788331058.078482 trunc from 0x040000 to 0x03ce97 (0x3168 bytes) 000476 1788331058.097638 trunc from 0x03ce98 to 0x0395ea (0x38ad bytes) 000477 1788331058.119802 punch from 0x02cdb0 to 0x02f67b (0x28cc bytes) 000478 1788331058.140589 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d2:0x0]: Invalid argument (22) 000479 1788331058.304858 trunc from 0x0395eb to 0x0340a7 (0x5543 bytes) 000480 1788331058.320897 write 0x03a2b2 thru 0x03ffff (0x5d4e bytes) 000481 1788331058.322162 read 0x014c79 thru 0x024895 (0xfc1d bytes) 000487 1788331058.330616 punch from 0x00ddf7 to 0x018860 (0xaa6a bytes) 000489 1788331058.337798 trunc from 0x040000 to 0x037b41 (0x84be bytes) 000490 1788331058.347264 punch from 0x03079b to 0x033e9a (0x3700 bytes) 000491 1788331058.349896 trunc from 0x037b42 to 0x01ef41 (0x18c00 bytes) 000492 1788331058.359767 trunc from 0x01ef42 to 0x03d922 (0x1e9e1 bytes) 000493 1788331058.376503 punch from 0x003671 to 0x01355c (0xfeec bytes) 000496 1788331058.385478 write 0x008e4f thru 0x00fca1 (0x6e53 bytes) 000499 1788331058.398011 read 0x03bcfc thru 0x03d922 (0x1c27 bytes) 000500 1788331058.418622 write 0x018ecd thru 0x022f49 (0xa07d bytes) 000502 1788331058.422809 trunc from 0x03d923 to 0x0167b5 (0x2716d bytes) 000503 1788331058.445702 trunc from 0x0167b6 to 0x02b274 (0x14abf bytes) 000504 1788331058.468140 mapread 0x029309 thru 0x02b274 (0x1f6c bytes) 000506 1788331058.507789 mapread 0x0223b0 thru 0x02b274 (0x8ec5 bytes) 000507 1788331058.562551 punch from 0x01ab4b to 0x02a7b3 (0xfc69 bytes) 000508 1788331058.577297 trunc from 0x02b275 to 0x01d675 (0xdbff bytes) 000510 1788331058.615777 punch from 0x002d86 to 0x0121d4 (0xf44f bytes) 000511 1788331058.626392 trunc from 0x01d676 to 0x025960 (0x82eb bytes) 000512 1788331058.656912 write 0x03c5e7 thru 0x03ffff (0x3a19 bytes) 000513 1788331058.659417 mapread 0x031ea8 thru 0x039f1a (0x8073 bytes) 000514 1788331058.749407 read 0x03c105 thru 0x03ffff (0x3efb bytes) 000516 1788331058.750807 read 0x028f81 thru 0x02e4db (0x555b bytes) 000517 1788331058.769680 punch from 0x019160 to 0x01bd95 (0x2c36 bytes) 000519 1788331058.781460 trunc from 0x040000 to 0x0093d5 (0x36c2a bytes) 000520 1788331058.808727 punch from 0x00165a to 0x0093d5 (0x7d7c bytes) 000521 1788331058.828744 write 0x01d473 thru 0x0203ea (0x2f78 bytes) 000523 1788331058.830304 trunc from 0x0203eb to 0x031c5d (0x11873 bytes) 000524 1788331058.857301 read 0x02ee3e thru 0x031c5d (0x2e20 bytes) 000525 1788331058.888833 write 0x0319e8 thru 0x031ce6 (0x2ff bytes) 000526 1788331058.890532 write 0x00db71 thru 0x01b05b (0xd4eb bytes) 000527 1788331058.893899 punch from 0x02acfb to 0x02d601 (0x2907 bytes) 000530 1788331058.937611 MIRROR_EXTEND to 2 mirrors 000531 1788331059.574332 mapread 0x02ac04 thru 0x02e369 (0x3766 bytes) 000533 1788331059.617815 mapread 0x025d1a thru 0x02e143 (0x842a bytes) 000534 1788331059.638735 mapread 0x00b309 thru 0x00ec03 (0x38fb bytes) 000537 1788331059.677516 write 0x01279c thru 0x01379c (0x1001 bytes) 000538 1788331059.737672 trunc from 0x031ce7 to 0x01ffed (0x11cf9 bytes) 000539 1788331059.754740 read 0x0115bd thru 0x01ffed (0xea31 bytes) 000540 1788331059.764181 punch from 0x00cc24 to 0x0102c3 (0x36a0 bytes) 000542 1788331059.772682 write 0x02353c thru 0x024441 (0xf06 bytes) 000545 1788331059.775497 read 0x00d70f thru 0x01cf08 (0xf7fa bytes) 000547 1788331059.784823 trunc from 0x024442 to 0x019a80 (0xa9c1 bytes) 000548 1788331059.797384 trunc from 0x019a81 to 0x0242c9 (0xa849 bytes) 000551 1788331059.811270 read 0x011945 thru 0x01f7a0 (0xde5c bytes) 000552 1788331059.816297 punch from 0x00cb93 to 0x013784 (0x6bf2 bytes) 000553 1788331059.818790 read 0x001d28 thru 0x00b8dd (0x9bb6 bytes) 000555 1788331059.819617 mapwrite 0x039b3c thru 0x03cc79 (0x313e bytes) 000556 1788331059.869542 trunc from 0x03cc7a to 0x022804 (0x1a475 bytes) 000558 1788331059.888746 read 0x014989 thru 0x022804 (0xde7c bytes) 000559 1788331059.889763 punch from 0x012eb5 to 0x015540 (0x268c bytes) 000561 1788331059.895536 write 0x019004 thru 0x01af9b (0x1f98 bytes) 000562 1788331059.901026 MIRROR_RESYNC 2 mirrors 000563 1788331061.134113 write 0x00393c thru 0x006df6 (0x34bb bytes) 000564 1788331061.196453 read 0x008a5c thru 0x00ee33 (0x63d8 bytes) 000566 1788331061.205654 mapwrite 0x01b900 thru 0x01dfb9 (0x26ba bytes) 000568 1788331061.315900 MIRROR_RESYNC 2 mirrors 000569 1788331061.913460 mapwrite 0x025600 thru 0x02e970 (0x9371 bytes) 000570 1788331062.077070 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d2:0x0]: Invalid argument (22) 000573 1788331062.227674 mapwrite 0x00e629 thru 0x014d57 (0x672f bytes) 000574 1788331062.325771 read 0x00cf0e thru 0x00ed8b (0x1e7e bytes) 000575 1788331062.328555 write 0x01ceea thru 0x024504 (0x761b bytes) 000576 1788331062.337728 punch from 0x02aa6c to 0x02e970 (0x3f05 bytes) 000577 1788331062.347638 write 0x03dd67 thru 0x03ee91 (0x112b bytes) 000578 1788331062.348471 read 0x01223a thru 0x01adb5 (0x8b7c bytes) 000579 1788331062.356520 write 0x035aa5 thru 0x036975 (0xed1 bytes) 000580 1788331062.357309 trunc from 0x03ee92 to 0x011b79 (0x2d318 bytes) 000581 1788331062.371461 punch from 0x001fab to 0x00a8de (0x8934 bytes) 000582 1788331062.376621 write 0x01a0c3 thru 0x023ef0 (0x9e2e bytes) 000583 1788331062.377716 trunc from 0x023ef1 to 0x002b4d (0x213a3 bytes) 000584 1788331062.401050 punch from 0x000dec to 0x002b4d (0x1d62 bytes) 000585 1788331062.415858 mapwrite 0x000d64 thru 0x007836 (0x6ad3 bytes) 000587 1788331062.577776 write 0x03389b thru 0x03b525 (0x7c8b bytes) 000589 1788331062.580630 read 0x01fd3e thru 0x027dd7 (0x809a bytes) 000590 1788331062.594737 mapread 0x037c35 thru 0x038c31 (0xffd bytes) 000591 1788331062.600605 read 0x026e05 thru 0x036b07 (0xfd03 bytes) 000593 1788331062.604621 write 0x002280 thru 0x00cf03 (0xac84 bytes) 000594 1788331062.617583 MIRROR_EXTEND to 2 mirrors 000595 1788331063.662546 read 0x00c654 thru 0x01356e (0x6f1b bytes) 000596 1788331063.673673 mapwrite 0x01fabb thru 0x028691 (0x8bd7 bytes) 000598 1788331063.878393 punch from 0x030296 to 0x0313cf (0x113a bytes) 000599 1788331063.884763 mapwrite 0x00c1a5 thru 0x01b3ca (0xf226 bytes) 000600 1788331063.986632 mapwrite 0x022fa1 thru 0x0329c1 (0xfa21 bytes) 000601 1788331064.063807 write 0x013580 thru 0x01c0ba (0x8b3b bytes) 000602 1788331064.071516 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3b526): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b526): Mirror 2: 0x10481d8e (stale) CRC-32 checksum value for chunk [0, 0x3b526): Mirror 1: 0x715046ef Mirror 3: 0x715046ef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b526: skipped 000603 1788331064.832380 mapwrite 0x016d04 thru 0x01db6c (0x6e69 bytes) 000606 1788331064.934107 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3b526): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b526): Mirror 2: 0x10481d8e (stale) Mirror 3: 0x715046ef (stale) CRC-32 checksum value for chunk [0, 0x3b526): Mirror 1: 0xb73ac22d Mirror 4: 0xb73ac22d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b526: skipped 000607 1788331065.762324 read 0x0192a5 thru 0x01d972 (0x46ce bytes) 000610 1788331065.804404 mapread 0x028be5 thru 0x02a148 (0x1564 bytes) 000611 1788331065.839907 mapread 0x01edd3 thru 0x020533 (0x1761 bytes) 000613 1788331065.867817 trunc from 0x03b526 to 0x02795a (0x13bcb bytes) 000616 1788331065.946532 write 0x00be5d thru 0x00eec3 (0x3067 bytes) 000617 1788331065.955248 trunc from 0x02795b to 0x039fc9 (0x1266f bytes) 000618 1788331065.976240 punch from 0x006ec0 to 0x0100ff (0x9240 bytes) 000619 1788331065.984440 mapwrite 0x012682 thru 0x01aad4 (0x8453 bytes) 000621 1788331066.031468 mapwrite 0x02307d thru 0x02899b (0x591f bytes) 000622 1788331066.079414 mapread 0x00c29a thru 0x01221b (0x5f82 bytes) 000623 1788331066.083431 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x39fca): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39fca): Mirror 2: 0x15afdc7c (stale) Mirror 3: 0x3df97f60 (stale) Mirror 4: 0xe913b6b2 (stale) CRC-32 checksum value for chunk [0, 0x39fca): Mirror 1: 0x60025829 Mirror 5: 0x60025829 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39fca: skipped 000624 1788331066.939513 trunc from 0x039fca to 0x012b85 (0x27444 bytes) 000629 1788331067.071431 trunc from 0x012b86 to 0x00baf2 (0x7093 bytes) 000630 1788331067.097064 MIRROR_RESYNC 5 mirrors 000631 1788331068.104044 punch from 0x00b1b8 to 0x00baf2 (0x93b bytes) 000632 1788331068.166478 read 0x009189 thru 0x00baf2 (0x296a bytes) 000633 1788331068.171636 mapread 0x00a7b4 thru 0x00baf2 (0x133f bytes) 000634 1788331068.178655 MIRROR_RESYNC 5 mirrors 000635 1788331069.244353 mapwrite 0x036c9c thru 0x03ffff (0x9364 bytes) 000636 1788331069.366209 mapread 0x03ffd9 thru 0x03ffff (0x27 bytes) 000637 1788331069.366916 write 0x03949f thru 0x03ffff (0x6b61 bytes) 000638 1788331069.370304 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd2877c78 (stale) Mirror 4: 0xd2877c78 (stale) Mirror 5: 0xd2877c78 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd2877c78 (stale) Mirror 4: 0xd2877c78 (stale) Mirror 5: 0xd2877c78 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000641 1788331069.652678 mapwrite 0x009413 thru 0x010206 (0x6df4 bytes) 000642 1788331069.705902 trunc from 0x040000 to 0x03bc1c (0x43e3 bytes) 000643 1788331069.717253 read 0x00c705 thru 0x00fc4e (0x354a bytes) 000644 1788331069.718002 mapread 0x0065dd thru 0x01305a (0xca7e bytes) 000645 1788331069.719250 punch from 0x02fb44 to 0x03bc1c (0xc0d9 bytes) 000646 1788331069.723351 punch from 0x024b40 to 0x0266d2 (0x1b93 bytes) 000647 1788331069.726396 trunc from 0x03bc1d to 0x0220ea (0x19b32 bytes) 000650 1788331069.738465 read 0x000817 thru 0x00724f (0x6a39 bytes) 000651 1788331069.744221 trunc from 0x0220eb to 0x013005 (0xf0e5 bytes) 000652 1788331069.758480 mapwrite 0x0243c2 thru 0x029939 (0x5578 bytes) 000653 1788331069.799811 write 0x007e8d thru 0x00c4e7 (0x465b bytes) 000654 1788331069.800913 punch from 0x02188f to 0x029939 (0x80ab bytes) 000655 1788331069.812280 write 0x00e629 thru 0x01b46b (0xce43 bytes) 000657 1788331069.816259 trunc from 0x02993a to 0x00bc3a (0x1dcff bytes) 000658 1788331069.826787 mapread 0x009e45 thru 0x00bc3a (0x1df6 bytes) 000659 1788331069.827511 write 0x00b504 thru 0x00d4f7 (0x1ff4 bytes) 000664 1788331069.833364 MIRROR_RESYNC 4 mirrors 000665 1788331070.684446 trunc from 0x00d4f8 to 0x00a3f5 (0x3102 bytes) 000666 1788331070.738370 mapread 0x003001 thru 0x00a3f5 (0x73f5 bytes) 000667 1788331070.753604 trunc from 0x00a3f6 to 0x00cffa (0x2c05 bytes) 000670 1788331070.770167 mapwrite 0x014fe4 thru 0x0152b2 (0x2cf bytes) 000671 1788331070.916582 trunc from 0x0152b3 to 0x018750 (0x349e bytes) 000672 1788331070.953477 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18751): Mirror 4: 0xcb40067c (stale) Mirror 5: 0xcb40067c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18751): Mirror 4: 0xcb40067c (stale) Mirror 5: 0xcb40067c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18751: skipped 000673 1788331071.225572 write 0x02bffe thru 0x02d159 (0x115c bytes) 000674 1788331071.228629 read 0x01c307 thru 0x02292a (0x6624 bytes) 000675 1788331071.238878 trunc from 0x02d15a to 0x03510c (0x7fb3 bytes) 000678 1788331071.254464 mapread 0x00c59c thru 0x011002 (0x4a67 bytes) 000679 1788331071.288624 write 0x0134e3 thru 0x021fb5 (0xead3 bytes) 000680 1788331071.291475 mapwrite 0x0185b1 thru 0x01a793 (0x21e3 bytes) 000682 1788331071.364542 write 0x00f844 thru 0x011f71 (0x272e bytes) 000683 1788331071.373540 read 0x0187d3 thru 0x025da8 (0xd5d6 bytes) 000684 1788331071.395366 punch from 0x01451d to 0x016c05 (0x26e9 bytes) 000685 1788331071.410410 write 0x0330dd thru 0x03e407 (0xb32b bytes) 000686 1788331071.417531 mapread 0x01a6d9 thru 0x028a5b (0xe383 bytes) 000687 1788331071.421467 mapwrite 0x011524 thru 0x013203 (0x1ce0 bytes) 000688 1788331071.486873 mapread 0x00ff3a thru 0x01004d (0x114 bytes) 000689 1788331071.488990 read 0x0273a4 thru 0x03688e (0xf4eb bytes) 000690 1788331071.490390 read 0x01cfc8 thru 0x029295 (0xc2ce bytes) 000691 1788331071.496894 MIRROR_RESYNC 3 mirrors 000693 1788331072.942464 mapwrite 0x0340d6 thru 0x03ffff (0xbf2a bytes) 000694 1788331073.227747 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x832df4ed (stale) Mirror 5: 0x832df4ed (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x885a6943 Mirror 6: 0x885a6943 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000696 1788331074.243463 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x832df4ed (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x832df4ed (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x885a6943 Mirror 6: 0x885a6943 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000697 1788331075.189768 trunc from 0x040000 to 0x028dc0 (0x1723f bytes) 000698 1788331075.453923 trunc from 0x028dc1 to 0x032d3d (0x9f7d bytes) 000700 1788331075.492989 mapwrite 0x005df0 thru 0x00b86c (0x5a7d bytes) 000701 1788331075.746161 trunc from 0x032d3e to 0x01c6f7 (0x16646 bytes) 000704 1788331075.786345 MIRROR_RESYNC 3 mirrors 000705 1788331077.033775 write 0x039f9b thru 0x03e2dd (0x4343 bytes) 000706 1788331077.217012 mapread 0x016023 thru 0x01906f (0x304d bytes) 000708 1788331077.277259 trunc from 0x03e2de to 0x028f86 (0x15357 bytes) 000710 1788331077.324448 trunc from 0x028f87 to 0x02a522 (0x159c bytes) 000712 1788331077.359165 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a523): Mirror 6: 0x9a372ec5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a523): Mirror 6: 0x9a372ec5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a523: skipped 000718 1788331077.593870 punch from 0x02743d to 0x02a522 (0x30e6 bytes) 000719 1788331077.616618 mapread 0x01d4bf thru 0x01ffc4 (0x2b06 bytes) 000720 1788331077.663547 mapwrite 0x009ee0 thru 0x018cf9 (0xee1a bytes) 000722 1788331077.778677 write 0x02dfa7 thru 0x03336a (0x53c4 bytes) 000728 1788331077.787869 mapread 0x017bba thru 0x01a4c5 (0x290c bytes) 000730 1788331077.793467 write 0x03c3db thru 0x03ffff (0x3c25 bytes) 000731 1788331077.800341 write 0x026b40 thru 0x027ad2 (0xf93 bytes) 000733 1788331077.803235 mapwrite 0x009cc8 thru 0x011a9d (0x7dd6 bytes) 000734 1788331077.893307 mapwrite 0x00167c thru 0x003622 (0x1fa7 bytes) 000735 1788331077.991514 trunc from 0x040000 to 0x011675 (0x2e98a bytes) 000737 1788331078.014206 write 0x03d088 thru 0x03ffff (0x2f78 bytes) 000738 1788331078.015695 read 0x009715 thru 0x00f4d2 (0x5dbe bytes) 000742 1788331078.017865 read 0x025231 thru 0x0265fc (0x13cc bytes) 000743 1788331078.025101 read 0x0384db thru 0x03fc60 (0x7786 bytes) 000744 1788331078.026093 punch from 0x02a592 to 0x039685 (0xf0f4 bytes) 000745 1788331078.034397 mapread 0x00c66a thru 0x0129c0 (0x6357 bytes) 000747 1788331078.036029 trunc from 0x040000 to 0x029e73 (0x1618c bytes) 000748 1788331078.053701 trunc from 0x029e74 to 0x039913 (0xfaa0 bytes) 000749 1788331078.070133 punch from 0x028f54 to 0x034cd2 (0xbd7f bytes) 000750 1788331078.075503 trunc from 0x039914 to 0x0008ae (0x39065 bytes) 000751 1788331078.093689 mapwrite 0x010050 thru 0x0160bd (0x606e bytes) 000752 1788331078.168976 read 0x0049d9 thru 0x0115ff (0xcc27 bytes) 000754 1788331078.170031 write 0x00efed thru 0x01a8ba (0xb8ce bytes) 000755 1788331078.171221 mapread 0x0163b2 thru 0x01a8ba (0x4509 bytes) 000756 1788331078.173136 write 0x00d35b thru 0x018fcd (0xbc73 bytes) 000757 1788331078.178634 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1a8bb): Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a8bb): Mirror 6: 0x1464ff6f (stale) CRC-32 checksum value for chunk [0, 0x1a8bb): Mirror 1: 0xed0b48e2 Mirror 7: 0xed0b48e2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a8bb: skipped 000758 1788331078.926120 punch from 0x0110bc to 0x0140e3 (0x3028 bytes) 000759 1788331078.999123 write 0x00455a thru 0x006e61 (0x2908 bytes) 000760 1788331079.009146 write 0x014457 thru 0x020ae2 (0xc68c bytes) 000762 1788331079.023365 mapwrite 0x0340d8 thru 0x037da0 (0x3cc9 bytes) 000765 1788331079.146293 punch from 0x0117f3 to 0x0137bd (0x1fcb bytes) 000766 1788331079.151736 mapwrite 0x025f82 thru 0x02c9dc (0x6a5b bytes) 000769 1788331079.222254 mapread 0x00ed42 thru 0x01e5a3 (0xf862 bytes) 000770 1788331079.235040 read 0x017bc6 thru 0x01d56e (0x59a9 bytes) 000771 1788331079.235736 punch from 0x008b3d to 0x011c4d (0x9111 bytes) 000773 1788331079.245527 trunc from 0x037da1 to 0x021f6f (0x15e31 bytes) 000775 1788331079.268118 write 0x03d0ed thru 0x03ffff (0x2f13 bytes) 000776 1788331079.269152 trunc from 0x040000 to 0x012f17 (0x2d0e8 bytes) 000777 1788331079.287068 trunc from 0x012f18 to 0x034454 (0x2153d bytes) 000779 1788331079.304536 write 0x01f05c thru 0x0217a9 (0x274e bytes) 000780 1788331079.313241 mapwrite 0x01167c thru 0x01ad26 (0x96ab bytes) 000781 1788331079.391138 mapread 0x000c3b thru 0x00d945 (0xcd0b bytes) 000783 1788331079.400306 read 0x008795 thru 0x016d59 (0xe5c5 bytes) 000784 1788331079.400911 write 0x03055d thru 0x031de3 (0x1887 bytes) 000785 1788331079.409328 read 0x03216c thru 0x034454 (0x22e9 bytes) 000786 1788331079.410246 trunc from 0x034455 to 0x00aa5e (0x299f6 bytes) 000787 1788331079.428418 punch from 0x001c08 to 0x00aa5e (0x8e57 bytes) 000788 1788331079.438143 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xaa5f): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xaa5f): Mirror 6: 0xd4277997 (stale) Mirror 7: 0x61d5f98b (stale) CRC-32 checksum value for chunk [0, 0xaa5f): Mirror 1: 0x61d5f98b Mirror 8: 0x61d5f98b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xaa5f: skipped 000789 1788331080.750576 trunc from 0x00aa5f to 0x007be5 (0x2e79 bytes) 000790 1788331080.828753 mapread 0x006964 thru 0x007be5 (0x1282 bytes) 000791 1788331080.839220 read 0x0074b9 thru 0x007be5 (0x72d bytes) 000792 1788331080.840240 trunc from 0x007be6 to 0x020fea (0x19405 bytes) 000793 1788331080.864655 trunc from 0x020feb to 0x01e725 (0x28c5 bytes) 000794 1788331080.878814 read 0x01766e thru 0x01a218 (0x2bab bytes) 000795 1788331080.889623 read 0x006eae thru 0x010b90 (0x9ce3 bytes) 000796 1788331080.890326 mapwrite 0x020bc1 thru 0x025fd6 (0x5416 bytes) 000797 1788331080.982322 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x25fd7): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25fd7): Mirror 6: 0x1e5b9e1a (stale) Mirror 7: 0xf4e1ba0c (stale) Mirror 8: 0xb66ab750 (stale) CRC-32 checksum value for chunk [0, 0x25fd7): Mirror 1: 0x1ccba64 Mirror 9: 0x1ccba64 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25fd7: skipped 000798 1788331081.792418 mapread 0x0136dc thru 0x01cffb (0x9920 bytes) 000799 1788331081.806110 read 0x0163cc thru 0x01903a (0x2c6f bytes) 000800 1788331081.806488 mapwrite 0x01a641 thru 0x023ef2 (0x98b2 bytes) 000801 1788331081.910728 mapread 0x02412d thru 0x025fd6 (0x1eaa bytes) 000808 1788331081.915663 read 0x000d56 thru 0x007447 (0x66f2 bytes) 000811 1788331081.928814 punch from 0x01f8cb to 0x022876 (0x2fac bytes) 000813 1788331081.933172 mapwrite 0x009fab thru 0x00cc69 (0x2cbf bytes) 000815 1788331081.975210 mapwrite 0x027569 thru 0x02b2ed (0x3d85 bytes) 000816 1788331082.114075 mapread 0x01c6b9 thru 0x02b2ed (0xec35 bytes) 000817 1788331082.130285 mapwrite 0x02dfd5 thru 0x032b37 (0x4b63 bytes) 000818 1788331082.172412 mapread 0x0057c2 thru 0x00cd3b (0x757a bytes) 000819 1788331082.176176 MIRROR_RESYNC 5 mirrors 000820 1788331084.192631 write 0x00a242 thru 0x0138bf (0x967e bytes) 000821 1788331084.244275 punch from 0x00a869 to 0x00d6a3 (0x2e3b bytes) 000824 1788331084.254164 mapread 0x015aa7 thru 0x01f89d (0x9df7 bytes) 000825 1788331084.266400 read 0x00dadb thru 0x00f3b4 (0x18da bytes) 000826 1788331084.272024 write 0x028d93 thru 0x0343b7 (0xb625 bytes) 000827 1788331084.276379 punch from 0x033cbe to 0x0343b7 (0x6fa bytes) 000828 1788331084.285512 mapwrite 0x028537 thru 0x02e7cf (0x6299 bytes) 000830 1788331084.324169 punch from 0x02fd02 to 0x0343b7 (0x46b6 bytes) 000831 1788331084.327994 read 0x013a4a thru 0x0191ec (0x57a3 bytes) 000832 1788331084.328650 mapread 0x000046 thru 0x00bc8b (0xbc46 bytes) 000833 1788331084.340789 write 0x001923 thru 0x01013d (0xe81b bytes) 000834 1788331084.347297 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x343b8): Mirror 6: 0xfcaedcd7 (stale) Mirror 7: 0xfcaedcd7 (stale) Mirror 8: 0xfcaedcd7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x343b8): Mirror 6: 0xfcaedcd7 (stale) Mirror 7: 0xfcaedcd7 (stale) Mirror 8: 0xfcaedcd7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x343b8: skipped 000835 1788331084.836672 trunc from 0x0343b8 to 0x029224 (0xb193 bytes) 000836 1788331084.857677 mapread 0x024b06 thru 0x0264e8 (0x19e3 bytes) 000838 1788331084.873859 trunc from 0x029225 to 0x01c006 (0xd21e bytes) 000839 1788331084.889764 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1c007): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c007): Mirror 6: 0xab284455 (stale) Mirror 7: 0xab284455 (stale) Mirror 8: 0xab284455 (stale) CRC-32 checksum value for chunk [0, 0x1c007): Mirror 1: 0xd03fb22d Mirror 9: 0xd03fb22d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c007: skipped 000840 1788331085.815221 punch from 0x00f561 to 0x01c006 (0xcaa6 bytes) 000842 1788331085.891062 mapwrite 0x0187d6 thru 0x02693f (0xe16a bytes) 000843 1788331085.989302 read 0x00efc2 thru 0x013d5b (0x4d9a bytes) 000844 1788331085.997289 mapwrite 0x01bb99 thru 0x01db15 (0x1f7d bytes) 000846 1788331086.056314 read 0x005563 thru 0x009de7 (0x4885 bytes) 000847 1788331086.073346 mapwrite 0x01441e thru 0x020694 (0xc277 bytes) 000848 1788331086.134609 mapwrite 0x025ec6 thru 0x027090 (0x11cb bytes) 000849 1788331086.247530 write 0x02c4e5 thru 0x035e0b (0x9927 bytes) 000850 1788331086.256555 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35e0c): Mirror 7: 0x911b1b7b (stale) Mirror 8: 0x911b1b7b (stale) Mirror 9: 0x164c7e81 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35e0c): Mirror 7: 0x911b1b7b (stale) Mirror 8: 0x911b1b7b (stale) Mirror 9: 0x164c7e81 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35e0c: skipped 000853 1788331086.695769 mapwrite 0x018b40 thru 0x01bd2f (0x31f0 bytes) 000854 1788331086.747178 mapwrite 0x0274f7 thru 0x027eac (0x9b6 bytes) 000858 1788331086.796027 read 0x0316a6 thru 0x035e0b (0x4766 bytes) 000859 1788331086.804493 punch from 0x019877 to 0x0291f8 (0xf982 bytes) 000860 1788331086.808409 write 0x03604b thru 0x03ffff (0x9fb5 bytes) 000862 1788331086.811335 mapread 0x0205ff thru 0x02535d (0x4d5f bytes) 000863 1788331086.819902 read 0x013c6e thru 0x01e43c (0xa7cf bytes) 000864 1788331086.821559 mapwrite 0x031c46 thru 0x039384 (0x773f bytes) 000866 1788331086.876605 punch from 0x011312 to 0x017002 (0x5cf1 bytes) 000867 1788331086.880591 mapwrite 0x0091e6 thru 0x015db5 (0xcbd0 bytes) 000868 1788331086.970992 mapwrite 0x020e5a thru 0x0229a2 (0x1b49 bytes) 000869 1788331087.042607 mapread 0x0353d7 thru 0x03ffff (0xac29 bytes) 000871 1788331087.050117 trunc from 0x040000 to 0x00906b (0x36f94 bytes) 000872 1788331087.087259 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x906c): Mirror 8: 0xcb997b0a (stale) Mirror 9: 0x1a66588a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x906c): Mirror 8: 0xcb997b0a (stale) Mirror 9: 0x1a66588a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x906c: skipped 000873 1788331087.526223 mapread 0x0020a2 thru 0x00906b (0x6fca bytes) 000874 1788331087.549577 write 0x005736 thru 0x00cd22 (0x75ed bytes) 000875 1788331087.553726 punch from 0x006d56 to 0x009475 (0x2720 bytes) 000876 1788331087.582311 punch from 0x00bd0a to 0x00cd22 (0x1019 bytes) 000877 1788331087.603030 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xcd23): Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xcd23): Mirror 8: 0x6669bbfa (stale) Mirror 9: 0x3e3f711a (stale) CRC-32 checksum value for chunk [0, 0xcd23): Mirror 1: 0x72f7dfaa Mirror 10: 0x72f7dfaa lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xcd23: skipped 000881 1788331088.870856 mapwrite 0x011282 thru 0x018398 (0x7117 bytes) 000882 1788331089.030285 mapread 0x013625 thru 0x018398 (0x4d74 bytes) 000885 1788331089.032339 mapwrite 0x01c983 thru 0x01facd (0x314b bytes) 000888 1788331089.124846 mapwrite 0x0168b4 thru 0x025cb6 (0xf403 bytes) 000889 1788331089.200675 mapwrite 0x0173a9 thru 0x01b2c1 (0x3f19 bytes) 000890 1788331089.239307 write 0x033189 thru 0x03ffff (0xce77 bytes) 000891 1788331089.242292 read 0x029f07 thru 0x036833 (0xc92d bytes) 000892 1788331089.249275 punch from 0x039c5f to 0x03ffff (0x63a1 bytes) 000893 1788331089.261213 punch from 0x00e3d5 to 0x0184db (0xa107 bytes) 000894 1788331089.268251 trunc from 0x040000 to 0x012a6e (0x2d591 bytes) 000895 1788331089.282774 trunc from 0x012a6f to 0x03d786 (0x2ad18 bytes) 000896 1788331089.297891 write 0x00ad1c thru 0x018d01 (0xdfe6 bytes) 000897 1788331089.318449 mapwrite 0x007bb9 thru 0x012e87 (0xb2cf bytes) 000898 1788331089.379313 write 0x014084 thru 0x015069 (0xfe6 bytes) 000900 1788331089.381909 read 0x01ad31 thru 0x01e55a (0x382a bytes) 000902 1788331089.406399 MIRROR_RESYNC 4 mirrors 000903 1788331090.519502 trunc from 0x03d787 to 0x00bcb7 (0x31acf bytes) 000904 1788331090.642579 write 0x00cba9 thru 0x01c26e (0xf6c6 bytes) 000905 1788331090.650572 trunc from 0x01c26f to 0x014f04 (0x736a bytes) 000907 1788331090.683069 mapwrite 0x00e37b thru 0x010df3 (0x2a79 bytes) 000908 1788331090.746296 mapread 0x00a1d8 thru 0x014f04 (0xad2d bytes) 000909 1788331090.762312 mapread 0x00d53c thru 0x0120b5 (0x4b7a bytes) 000911 1788331090.763842 write 0x03fc71 thru 0x03ffff (0x38f bytes) 000912 1788331090.774230 mapwrite 0x03e37f thru 0x03ffff (0x1c81 bytes) 000914 1788331090.853201 read 0x0384e7 thru 0x03ffff (0x7b19 bytes) 000915 1788331090.854327 mapread 0x00ed75 thru 0x016f38 (0x81c4 bytes) 000916 1788331090.890299 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xb0e744e9 (stale) Mirror 9: 0xb0e744e9 (stale) Mirror 10: 0xb0e744e9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa94757f6 Mirror 11: 0xa94757f6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000917 1788331091.890634 read 0x03c698 thru 0x03ffff (0x3968 bytes) 000918 1788331091.904433 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xb0e744e9 (stale) Mirror 10: 0xb0e744e9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 9: 0xb0e744e9 (stale) Mirror 10: 0xb0e744e9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xa94757f6 Mirror 11: 0xa94757f6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000921 1788331092.515249 mapwrite 0x00855e thru 0x00fbca (0x766d bytes) 000922 1788331092.708422 read 0x02a90d thru 0x02e5f5 (0x3ce9 bytes) 000924 1788331092.721059 mapread 0x03a2cc thru 0x03ffff (0x5d34 bytes) 000925 1788331092.735531 punch from 0x01a4b9 to 0x022560 (0x80a8 bytes) 000927 1788331092.741705 trunc from 0x040000 to 0x013b0c (0x2c4f3 bytes) 000930 1788331092.772193 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x13b0d): Mirror 9: 0x83ad0c1c (stale) Mirror 10: 0x83ad0c1c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13b0d): Mirror 9: 0x83ad0c1c (stale) Mirror 10: 0x83ad0c1c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13b0d: skipped 000931 1788331093.063064 punch from 0x01392b to 0x013b0c (0x1e2 bytes) 000932 1788331093.066072 punch from 0x011fa1 to 0x013b0c (0x1b6c bytes) 000933 1788331093.069896 read 0x00391d thru 0x003e96 (0x57a bytes) 000934 1788331093.075477 write 0x031c86 thru 0x03dbad (0xbf28 bytes) 000935 1788331093.078701 read 0x0367f8 thru 0x03a395 (0x3b9e bytes) 000936 1788331093.081659 mapwrite 0x0180f3 thru 0x024b91 (0xca9f bytes) 000937 1788331093.114198 mapread 0x031ea5 thru 0x03b258 (0x93b4 bytes) 000939 1788331093.115339 read 0x005b6e thru 0x009093 (0x3526 bytes) 000940 1788331093.117616 write 0x016e97 thru 0x024a1b (0xdb85 bytes) 000943 1788331093.119870 write 0x0162f2 thru 0x022012 (0xbd21 bytes) 000944 1788331093.121417 mapwrite 0x00dc45 thru 0x01573d (0x7af9 bytes) 000946 1788331093.160751 mapread 0x001b3e thru 0x007096 (0x5559 bytes) 000947 1788331093.162664 mapread 0x01a9fb thru 0x01ff9b (0x55a1 bytes) 000949 1788331093.163679 write 0x0373bc thru 0x03ffff (0x8c44 bytes) 000950 1788331093.164407 trunc from 0x040000 to 0x027977 (0x18688 bytes) 000951 1788331093.177123 write 0x02296f thru 0x02e8f5 (0xbf87 bytes) 000952 1788331093.178457 write 0x019945 thru 0x01e23e (0x48fa bytes) 000953 1788331093.179571 write 0x00ac96 thru 0x01946f (0xe7da bytes) 000955 1788331093.182745 trunc from 0x02e8f6 to 0x0098d7 (0x2501e bytes) 000957 1788331093.198904 write 0x01abb0 thru 0x025a57 (0xaea8 bytes) 000959 1788331093.206348 write 0x003c0d thru 0x0094d1 (0x58c5 bytes) 000964 1788331093.221232 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x25a58): Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25a58): Mirror 9: 0x8762728 (stale) Mirror 10: 0x8762728 (stale) CRC-32 checksum value for chunk [0, 0x25a58): Mirror 1: 0xd592c37b Mirror 11: 0xd592c37b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25a58: skipped 000965 1788331094.118697 write 0x007c39 thru 0x0173b3 (0xf77b bytes) 000966 1788331094.210081 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25a58): Mirror 10: 0x8762728 (stale) Mirror 11: 0xd592c37b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25a58): Mirror 10: 0x8762728 (stale) Mirror 11: 0xd592c37b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25a58: skipped 000967 1788331094.524733 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d2:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25a58): Mirror 11: 0xd592c37b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25a58): Mirror 11: 0xd592c37b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25a58: skipped 000969 1788331094.749817 mapwrite 0x01feef thru 0x0269e5 (0x6af7 bytes) 000970 1788331094.858461 trunc from 0x0269e6 to 0x023ec1 (0x2b24 bytes) 000971 1788331094.876221 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x23ec2): Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23ec2): Mirror 11: 0x43d9d085 (stale) CRC-32 checksum value for chunk [0, 0x23ec2): Mirror 1: 0x4109ae56 Mirror 12: 0x4109ae56 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23ec2: skipped 000972 1788331095.738520 mapread 0x01378e thru 0x021cc9 (0xe53c bytes) 000973 1788331095.763077 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d2:0x0]: Invalid argument (22) 000974 1788331096.107478 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x1d2:0x0]: Invalid argument (22) 000975 1788331096.267184 punch from 0x007f72 to 0x00f5a8 (0x7637 bytes) 000976 1788331096.290124 trunc from 0x023ec2 to 0x02cdb6 (0x8ef5 bytes) 000977 1788331096.315323 write 0x000393 thru 0x00728a (0x6ef8 bytes) 000978 1788331096.327451 mapwrite 0x02b5b0 thru 0x036256 (0xaca7 bytes) 000979 1788331096.424665 read 0x00790e thru 0x00db79 (0x626c bytes) 000980 1788331096.434463 write 0x00b491 thru 0x01327d (0x7ded bytes) 000981 1788331096.440650 mapread 0x022087 thru 0x02b28a (0x9204 bytes) 000983 1788331096.451211 read 0x0084d0 thru 0x009fc5 (0x1af6 bytes) 000984 1788331096.452126 trunc from 0x036257 to 0x03cfa5 (0x6d4f bytes) 000986 1788331096.471330 mapread 0x001dc9 thru 0x00bdf4 (0xa02c bytes) 000987 1788331096.472621 mapread 0x02be23 thru 0x034007 (0x81e5 bytes) 000990 1788331096.475883 trunc from 0x03cfa6 to 0x00c8c5 (0x306e0 bytes) 000993 1788331096.495078 mapread 0x0030fd thru 0x00c8c5 (0x97c9 bytes) 000994 1788331096.496545 punch from 0x004f1d to 0x00c8c5 (0x79a9 bytes) 000996 1788331096.508410 write 0x021193 thru 0x02eaa4 (0xd912 bytes) 000997 1788331096.510853 punch from 0x02e7e9 to 0x02eaa4 (0x2bc bytes) 000998 1788331096.525380 write 0x01edcc thru 0x0233dc (0x4611 bytes) 000999 1788331096.541015 punch from 0x011c01 to 0x013c0b (0x200b bytes) All operations completed A-OK!