== sanity-flr test 70a: flr mode fsx test ================ 09:37:27 (1784122647) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 2648 000002 1784122648.108437 mapwrite 0x014d96 thru 0x01d3db (0x8646 bytes) 000003 1784122648.144462 read 0x004f6e thru 0x012823 (0xd8b6 bytes) 000004 1784122648.152863 write 0x027799 thru 0x03614f (0xe9b7 bytes) fallocating to largest ever: 0x28011 000005 1784122648.154824 fallocate 0x018710 thru 0x028010 (0xf901 bytes) 000006 1784122648.159387 fallocate 0x01a6e8 thru 0x022dc1 (0x86da bytes) 000008 1784122648.163763 trunc from 0x036150 to 0x00ca7e (0x296d1 bytes) 000009 1784122648.172371 mapwrite 0x005cb7 thru 0x01228c (0xc5d6 bytes) 000010 1784122648.200515 mapwrite 0x0121ab thru 0x01d465 (0xb2bb bytes) 000011 1784122648.227388 punch from 0x00ee43 to 0x01d465 (0xe623 bytes) fallocating to largest ever: 0x40000 000012 1784122648.232466 fallocate 0x03b429 thru 0x03ffff (0x4bd7 bytes) 000013 1784122648.236197 trunc from 0x040000 to 0x01b241 (0x24dbe bytes) 000014 1784122648.245984 read 0x010a6c thru 0x01b241 (0xa7d6 bytes) 000015 1784122648.251378 punch from 0x0119ef to 0x01b241 (0x9853 bytes) 000016 1784122648.257370 write 0x03afa2 thru 0x03bca3 (0xd02 bytes) 000018 1784122648.259062 mapread 0x022558 thru 0x02c75f (0xa208 bytes) 000019 1784122648.265083 fallocate 0x01ca42 thru 0x02a486 (0xda45 bytes) 000020 1784122648.270621 mapread 0x002d2b thru 0x0124f7 (0xf7cd bytes) 000021 1784122648.279878 trunc from 0x033b4b to 0x03b0b7 (0x756d bytes) 000024 1784122648.291473 read 0x032b01 thru 0x0355ae (0x2aae bytes) 000026 1784122648.298957 read 0x00059c thru 0x009e5c (0x98c1 bytes) 000027 1784122648.299602 mapwrite 0x00ceeb thru 0x012d8f (0x5ea5 bytes) 000028 1784122648.315709 write 0x005bda thru 0x00b7ae (0x5bd5 bytes) 000029 1784122648.317944 mapwrite 0x039b4c thru 0x03ffff (0x64b4 bytes) 000030 1784122648.347590 write 0x02fd05 thru 0x034076 (0x4372 bytes) 000031 1784122648.348804 fallocate 0x018d48 thru 0x0191cf (0x488 bytes) 000032 1784122648.352975 read 0x03fbce thru 0x03ffff (0x432 bytes) 000033 1784122648.353596 trunc from 0x040000 to 0x0156af (0x2a950 bytes) 000034 1784122648.364754 trunc from 0x0156b0 to 0x00ee82 (0x682d bytes) 000037 1784122648.377161 mapread 0x00ec4a thru 0x00ee82 (0x239 bytes) 000038 1784122648.378126 mapread 0x001025 thru 0x00dbf8 (0xcbd4 bytes) 000039 1784122648.379066 trunc from 0x00ee83 to 0x00429e (0xabe4 bytes) 000040 1784122648.390961 mapwrite 0x027807 thru 0x02b7d1 (0x3fcb bytes) 000041 1784122648.424647 mapwrite 0x013893 thru 0x018aab (0x5219 bytes) 000042 1784122648.436772 trunc from 0x02b7d2 to 0x02d6c7 (0x1ef6 bytes) 000043 1784122648.448367 trunc from 0x02d6c8 to 0x0242bc (0x940b bytes) 000044 1784122648.455304 fallocate 0x005157 thru 0x0130a8 (0xdf52 bytes) 000045 1784122648.458426 trunc from 0x0145c6 to 0x01a8e4 (0x631f bytes) 000046 1784122648.461197 write 0x003955 thru 0x00f4dc (0xbb88 bytes) 000047 1784122648.462580 trunc from 0x0242bd to 0x020422 (0x3e9a bytes) 000048 1784122648.472186 read 0x01bfd5 thru 0x02011e (0x414a bytes) 000049 1784122648.472924 write 0x015b86 thru 0x017186 (0x1601 bytes) 000050 1784122648.478124 mapwrite 0x0357d7 thru 0x03ffff (0xa829 bytes) 000051 1784122648.504784 trunc from 0x03b8b4 to 0x03ffff (0x474c bytes) 000052 1784122648.509371 mapwrite 0x023065 thru 0x0300e6 (0xd082 bytes) 000053 1784122648.521081 trunc from 0x03a8bc to 0x03ffff (0x5744 bytes) 000054 1784122648.524306 write 0x009e93 thru 0x017111 (0xd27f bytes) 000056 1784122648.526774 punch from 0x02a6e4 to 0x037fdd (0xd8fa bytes) 000059 1784122648.532529 write 0x003f9f thru 0x00eebe (0xaf20 bytes) 000061 1784122648.535127 punch from 0x03e529 to 0x03ffff (0x1ad7 bytes) 000062 1784122648.540235 trunc from 0x030a12 to 0x03589b (0x4e8a bytes) 000063 1784122648.545153 write 0x012da8 thru 0x0161d4 (0x342d bytes) 000064 1784122648.546297 fallocate 0x034e3c thru 0x039e64 (0x5029 bytes) 000065 1784122648.550380 mapread 0x009588 thru 0x011892 (0x830b bytes) 000067 1784122648.551859 mapwrite 0x00cbaf thru 0x00ffd3 (0x3425 bytes) 000068 1784122648.563380 mapwrite 0x0138cb thru 0x015564 (0x1c9a bytes) 000069 1784122648.572893 mapread 0x032e99 thru 0x03ffff (0xd167 bytes) 000071 1784122648.608245 punch from 0x03afaa to 0x03ffff (0x5056 bytes) 000073 1784122648.615058 MIRROR_EXTEND to 2 mirrors 000074 1784122648.926720 mapwrite 0x000b7c thru 0x006ff1 (0x6476 bytes) 000075 1784122649.007361 write 0x02fd69 thru 0x03d3a8 (0xd640 bytes) 000076 1784122649.018374 write 0x02fa6f thru 0x0384e9 (0x8a7b bytes) 000077 1784122649.019711 mapwrite 0x017237 thru 0x02357f (0xc349 bytes) 000078 1784122649.044514 fallocate 0x000aae thru 0x00db37 (0xd08a bytes) 000079 1784122649.047500 trunc from 0x00b841 to 0x010688 (0x4e48 bytes) 000081 1784122649.050971 trunc from 0x040000 to 0x016f5a (0x290a5 bytes) 000083 1784122649.067925 fallocate 0x013ecf thru 0x022fa5 (0xf0d7 bytes) 000084 1784122649.070531 write 0x03acf4 thru 0x03cc12 (0x1f1f bytes) 000085 1784122649.071687 mapread 0x01ef42 thru 0x026663 (0x7722 bytes) 000086 1784122649.075439 read 0x038746 thru 0x03cc12 (0x44cd bytes) 000087 1784122649.077838 trunc from 0x031c03 to 0x03cc12 (0xb010 bytes) 000088 1784122649.084285 trunc from 0x021735 to 0x02c9e3 (0xb2af bytes) 000089 1784122649.087411 read 0x014aa6 thru 0x01e97e (0x9ed9 bytes) 000090 1784122649.088104 punch from 0x034fd1 to 0x03cc12 (0x7c42 bytes) 000091 1784122649.093953 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3cc13): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cc13): Mirror 2: 0x2c72687a (stale) CRC-32 checksum value for chunk [0, 0x3cc13): Mirror 1: 0x1024ce8a Mirror 3: 0x1024ce8a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cc13: skipped 000092 1784122649.478044 read 0x0133ec thru 0x01af6d (0x7b82 bytes) 000093 1784122649.491309 mapwrite 0x02029d thru 0x020504 (0x268 bytes) 000095 1784122649.551981 trunc from 0x002c99 to 0x00909b (0x6403 bytes) 000096 1784122649.557899 mapwrite 0x014464 thru 0x02258d (0xe12a bytes) 000097 1784122649.583448 read 0x009c7e thru 0x00a089 (0x40c bytes) 000099 1784122649.590946 write 0x00ad95 thru 0x00ade0 (0x4c bytes) 000100 1784122649.594083 punch from 0x008225 to 0x009d20 (0x1afc bytes) 000101 1784122649.598113 trunc from 0x03cc13 to 0x004d5f (0x37eb3 bytes) 000102 1784122649.617111 write 0x037cc2 thru 0x03f2fe (0x763d bytes) 000103 1784122649.618648 trunc from 0x03911a to 0x03f2fe (0x61e5 bytes) 000104 1784122649.626169 trunc from 0x024e2e to 0x02b3de (0x65b1 bytes) 000106 1784122649.629530 write 0x03d46e thru 0x03ffff (0x2b92 bytes) 000107 1784122649.632852 trunc from 0x008ecf to 0x00e0ff (0x5231 bytes) 000108 1784122649.635205 write 0x027052 thru 0x027d9a (0xd49 bytes) 000109 1784122649.637697 trunc from 0x040000 to 0x024d87 (0x1b278 bytes) 000110 1784122649.644332 mapwrite 0x00dea1 thru 0x00ef86 (0x10e6 bytes) 000111 1784122649.658106 read 0x01a16c thru 0x024d87 (0xac1c bytes) 000112 1784122649.663218 read 0x017f47 thru 0x024d87 (0xce41 bytes) 000113 1784122649.663954 read 0x00d388 thru 0x00e220 (0xe99 bytes) 000114 1784122649.664519 fallocate 0x001b17 thru 0x00755c (0x5a46 bytes) 000115 1784122649.668180 fallocate 0x007f45 thru 0x013f6b (0xc027 bytes) 000116 1784122649.671652 trunc from 0x024d88 to 0x0190cc (0xbcbb bytes) 000117 1784122649.678409 mapread 0x012edb thru 0x016a4d (0x3b73 bytes) 000118 1784122649.679342 mapwrite 0x01fb43 thru 0x027cb0 (0x816e bytes) 000120 1784122649.705415 mapwrite 0x001143 thru 0x00ebbf (0xda7d bytes) 000121 1784122649.720882 read 0x00e17f thru 0x0188b7 (0xa739 bytes) 000122 1784122649.721565 write 0x03146e thru 0x03ffff (0xeb92 bytes) 000123 1784122649.723180 fallocate 0x02757d thru 0x0276f3 (0x177 bytes) 000124 1784122649.728195 mapread 0x000f56 thru 0x00ac5a (0x9d05 bytes) 000125 1784122649.733335 MIRROR_RESYNC 3 mirrors 000126 1784122650.071507 mapread 0x00f5b6 thru 0x01374f (0x419a bytes) 000127 1784122650.083355 write 0x010b04 thru 0x0192b3 (0x87b0 bytes) 000128 1784122650.109461 read 0x014340 thru 0x01c03b (0x7cfc bytes) 000129 1784122650.114949 mapread 0x018e75 thru 0x01f5dc (0x6768 bytes) 000131 1784122650.121738 trunc from 0x02e137 to 0x03672b (0x85f5 bytes) 000132 1784122650.125463 trunc from 0x040000 to 0x03d3b4 (0x2c4b bytes) 000134 1784122650.146780 mapread 0x01b082 thru 0x01e921 (0x38a0 bytes) 000135 1784122650.147793 fallocate 0x0302df thru 0x0377ca (0x74ec bytes) 000136 1784122650.151003 trunc from 0x01ec09 to 0x02e5f8 (0xf9f0 bytes) 000137 1784122650.154295 fallocate 0x013f32 thru 0x01d7cc (0x989b bytes) 000138 1784122650.157514 read 0x03cd6f thru 0x03d3b4 (0x646 bytes) 000139 1784122650.163415 trunc from 0x03d3b5 to 0x00ce51 (0x30563 bytes) 000140 1784122650.179726 mapwrite 0x0274ea thru 0x02bb91 (0x46a8 bytes) 000141 1784122650.216092 punch from 0x002551 to 0x00a7f9 (0x82a9 bytes) 000142 1784122650.222132 punch from 0x00b9d2 to 0x00f0f0 (0x371f bytes) 000145 1784122650.227152 mapwrite 0x036f09 thru 0x03ffff (0x90f7 bytes) 000146 1784122650.275508 fallocate 0x03c875 thru 0x03ffff (0x378b bytes) 000147 1784122650.278603 write 0x03117e thru 0x0389ae (0x7831 bytes) 000148 1784122650.282103 mapread 0x01e14a thru 0x0221ac (0x4063 bytes) 000149 1784122650.296581 read 0x01c364 thru 0x0258b1 (0x954e bytes) 000150 1784122650.304394 mapread 0x0069a7 thru 0x00933a (0x2994 bytes) 000151 1784122650.305689 mapread 0x005ebd thru 0x009ed5 (0x4019 bytes) 000152 1784122650.306790 fallocate 0x014bef thru 0x014d31 (0x143 bytes) 000154 1784122650.313006 trunc from 0x040000 to 0x01597f (0x2a680 bytes) 000155 1784122650.323595 fallocate 0x02d926 thru 0x03870d (0xade8 bytes) 000157 1784122650.327422 mapwrite 0x01870f thru 0x0234ad (0xad9f bytes) 000158 1784122650.362719 read 0x032648 thru 0x034853 (0x220c bytes) 000159 1784122650.369204 mapwrite 0x01a861 thru 0x01dcb6 (0x3456 bytes) 000160 1784122650.378601 trunc from 0x00b144 to 0x014644 (0x9501 bytes) 000162 1784122650.382506 read 0x000481 thru 0x006e4c (0x69cc bytes) 000164 1784122650.383557 write 0x01b124 thru 0x027a11 (0xc8ee bytes) 000165 1784122650.384881 punch from 0x01df17 to 0x026b74 (0x8c5e bytes) 000167 1784122650.391748 trunc from 0x00e3c8 to 0x013fed (0x5c26 bytes) 000168 1784122650.394317 write 0x00c899 thru 0x011078 (0x47e0 bytes) 000169 1784122650.402062 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3870e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3870e): Mirror 2: 0x898daf37 (stale) Mirror 3: 0x898daf37 (stale) CRC-32 checksum value for chunk [0, 0x3870e): Mirror 1: 0x8179e38e Mirror 4: 0x8179e38e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3870e: skipped 000170 1784122650.816190 punch from 0x03159f to 0x03870d (0x716f bytes) 000171 1784122650.838006 trunc from 0x019cd7 to 0x02301f (0x9349 bytes) 000173 1784122650.841326 fallocate 0x013583 thru 0x01d034 (0x9ab2 bytes) 000174 1784122650.848415 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3870e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3870e): Mirror 2: 0x898daf37 (stale) Mirror 3: 0x898daf37 (stale) Mirror 4: 0x8179e38e (stale) CRC-32 checksum value for chunk [0, 0x3870e): Mirror 1: 0x2c7d2208 Mirror 5: 0x2c7d2208 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3870e: skipped 000175 1784122651.268430 punch from 0x031886 to 0x03870d (0x6e88 bytes) 000176 1784122651.288688 mapread 0x00405b thru 0x00f2f9 (0xb29f bytes) 000177 1784122651.301255 punch from 0x01cf9d to 0x0223b1 (0x5415 bytes) 000178 1784122651.305509 write 0x03f5e3 thru 0x03ffff (0xa1d bytes) 000180 1784122651.311765 mapwrite 0x038aff thru 0x03ffff (0x7501 bytes) 000181 1784122651.333859 punch from 0x0143b5 to 0x018da6 (0x49f2 bytes) 000182 1784122651.338243 read 0x03960c thru 0x03ffff (0x69f4 bytes) 000183 1784122651.341186 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x75e25aab (stale) Mirror 3: 0x75e25aab (stale) Mirror 4: 0xfa80bb0c (stale) Mirror 5: 0x3bc6a2a3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x657ba6a5 Mirror 6: 0x657ba6a5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000184 1784122651.796106 punch from 0x024e76 to 0x03383b (0xe9c6 bytes) 000185 1784122651.819319 fallocate 0x03ac45 thru 0x03ffff (0x53bb bytes) 000186 1784122651.822184 trunc from 0x040000 to 0x0237c7 (0x1c838 bytes) 000187 1784122651.851231 mapwrite 0x018c5f thru 0x020b52 (0x7ef4 bytes) 000188 1784122651.875417 mapwrite 0x02c586 thru 0x034676 (0x80f1 bytes) 000189 1784122651.906427 write 0x02524a thru 0x034cc7 (0xfa7e bytes) 000190 1784122651.907934 mapread 0x00d749 thru 0x012bd2 (0x548a bytes) 000192 1784122651.913877 trunc from 0x034097 to 0x03427b (0x1e5 bytes) 000193 1784122651.922018 punch from 0x018e83 to 0x022445 (0x95c3 bytes) 000194 1784122651.926523 mapread 0x0327d2 thru 0x034cc7 (0x24f6 bytes) 000195 1784122651.933808 write 0x01b021 thru 0x0273d3 (0xc3b3 bytes) 000196 1784122651.940571 fallocate 0x020ea7 thru 0x022458 (0x15b2 bytes) 000197 1784122651.944328 write 0x023b81 thru 0x0264d6 (0x2956 bytes) 000198 1784122651.945600 trunc from 0x00469e to 0x009904 (0x5267 bytes) 000199 1784122651.949854 mapread 0x034922 thru 0x034cc7 (0x3a6 bytes) 000200 1784122651.951168 punch from 0x0089b3 to 0x0167ff (0xde4d bytes) 000201 1784122651.954437 fallocate 0x000ab2 thru 0x009ba4 (0x90f3 bytes) 000202 1784122651.957579 punch from 0x029f0f to 0x034cc7 (0xadb9 bytes) 000203 1784122651.961531 trunc from 0x034cc8 to 0x02344b (0x1187c bytes) 000204 1784122651.970361 punch from 0x01a869 to 0x02344b (0x8be3 bytes) 000205 1784122651.982518 trunc from 0x02344c to 0x005c50 (0x1d7fb bytes) 000206 1784122651.991045 write 0x00e912 thru 0x015106 (0x67f5 bytes) 000207 1784122651.992305 punch from 0x01212e to 0x01363c (0x150f bytes) 000208 1784122651.999849 trunc from 0x015107 to 0x02c76e (0x17668 bytes) 000209 1784122652.009696 read 0x01c2ee thru 0x027a3e (0xb751 bytes) 000210 1784122652.014789 read 0x0084c3 thru 0x00938c (0xeca bytes) 000211 1784122652.022265 mapwrite 0x03283d thru 0x03ffff (0xd7c3 bytes) 000212 1784122652.053534 mapread 0x022172 thru 0x026230 (0x40bf bytes) 000213 1784122652.054865 trunc from 0x014b14 to 0x01b2e2 (0x67cf bytes) 000214 1784122652.059209 mapwrite 0x01fdbc thru 0x02dcbd (0xdf02 bytes) 000215 1784122652.071879 trunc from 0x00838d to 0x013b4c (0xb7c0 bytes) 000217 1784122652.076511 read 0x0158e4 thru 0x01e8ff (0x901c bytes) 000218 1784122652.083982 read 0x025e36 thru 0x026569 (0x734 bytes) 000219 1784122652.084507 fallocate 0x00a296 thru 0x0171dc (0xcf47 bytes) 000220 1784122652.087776 mapwrite 0x036fd3 thru 0x03a2ca (0x32f8 bytes) 000221 1784122652.099860 mapread 0x0205dd thru 0x02331d (0x2d41 bytes) 000222 1784122652.100959 read 0x00b7ce thru 0x011dc6 (0x65f9 bytes) 000223 1784122652.101616 trunc from 0x040000 to 0x027e7b (0x18184 bytes) 000226 1784122652.113186 fallocate 0x03e6a5 thru 0x03ffff (0x195b bytes) 000227 1784122652.117148 trunc from 0x0194bd to 0x01d6a4 (0x41e8 bytes) 000228 1784122652.122973 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27e7c): Mirror 2: 0xf95edd3b (stale) Mirror 3: 0xf95edd3b (stale) Mirror 4: 0x3f9860bb (stale) Mirror 5: 0x5a409695 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27e7c): Mirror 2: 0xf95edd3b (stale) Mirror 3: 0xf95edd3b (stale) Mirror 4: 0x3f9860bb (stale) Mirror 5: 0x5a409695 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27e7c: skipped 000229 1784122652.301070 trunc from 0x026506 to 0x027e7b (0x1976 bytes) 000230 1784122652.304213 trunc from 0x027e7c to 0x0197bd (0xe6be bytes) 000231 1784122652.315112 punch from 0x007d37 to 0x00c6d9 (0x49a3 bytes) 000232 1784122652.319166 trunc from 0x00f3fe to 0x01858c (0x918f bytes) 000233 1784122652.323017 trunc from 0x00da95 to 0x0197bd (0xbd29 bytes) 000234 1784122652.327538 read 0x0088cc thru 0x00c19a (0x38cf bytes) 000235 1784122652.332385 read 0x005850 thru 0x0123cd (0xcb7e bytes) 000236 1784122652.338027 trunc from 0x0093c8 to 0x00ea94 (0x56cd bytes) 000237 1784122652.340816 fallocate 0x0333eb thru 0x037977 (0x458d bytes) 000238 1784122652.343660 write 0x0253ff thru 0x0336d7 (0xe2d9 bytes) 000239 1784122652.345279 read 0x02a343 thru 0x0336d7 (0x9395 bytes) 000240 1784122652.345736 mapwrite 0x02c341 thru 0x02d57e (0x123e bytes) 000241 1784122652.356610 mapread 0x00edd2 thru 0x011a5a (0x2c89 bytes) 000242 1784122652.363396 mapread 0x010662 thru 0x01b254 (0xabf3 bytes) 000243 1784122652.364371 fallocate 0x02d3b5 thru 0x035982 (0x85ce bytes) 000244 1784122652.367410 write 0x026a42 thru 0x02f33e (0x88fd bytes) 000245 1784122652.368512 trunc from 0x029b21 to 0x0336d7 (0x9bb7 bytes) 000246 1784122652.376497 mapwrite 0x029544 thru 0x02cb1e (0x35db bytes) 000247 1784122652.396216 trunc from 0x008644 to 0x00c882 (0x423f bytes) 000248 1784122652.399203 fallocate 0x0073e3 thru 0x00a32e (0x2f4c bytes) 000249 1784122652.401650 mapwrite 0x018bd9 thru 0x023883 (0xacab bytes) 000250 1784122652.411515 trunc from 0x001d8c to 0x00e2a5 (0xc51a bytes) 000252 1784122652.414809 mapread 0x03242a thru 0x0336d7 (0x12ae bytes) 000253 1784122652.420213 mapread 0x0209b2 thru 0x0306db (0xfd2a bytes) 000254 1784122652.429893 fallocate 0x0301c6 thru 0x035d89 (0x5bc4 bytes) 000255 1784122652.433150 read 0x01104e thru 0x011bde (0xb91 bytes) 000257 1784122652.434825 mapwrite 0x00fc18 thru 0x0121f2 (0x25db bytes) 000258 1784122652.444193 mapwrite 0x037318 thru 0x03c942 (0x562b bytes) 000259 1784122652.469659 trunc from 0x03c943 to 0x029f3b (0x12a07 bytes) 000260 1784122652.476887 fallocate 0x018e7a thru 0x01e8af (0x5a36 bytes) 000261 1784122652.479607 fallocate 0x033314 thru 0x03ffff (0xccec bytes) 000262 1784122652.484746 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29f3c): Mirror 2: 0x8a6dbb36 (stale) Mirror 3: 0x8a6dbb36 (stale) Mirror 4: 0x178632e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29f3c): Mirror 2: 0x8a6dbb36 (stale) Mirror 3: 0x8a6dbb36 (stale) Mirror 4: 0x178632e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29f3c: skipped 000263 1784122652.644921 fallocate 0x016432 thru 0x01f1b0 (0x8d7f bytes) 000264 1784122652.647942 punch from 0x0059ce to 0x00884f (0x2e82 bytes) 000265 1784122652.651101 read 0x0283b3 thru 0x029f3b (0x1b89 bytes) 000266 1784122652.657361 read 0x01710e thru 0x01d89b (0x678e bytes) 000267 1784122652.665566 trunc from 0x029f3c to 0x0323d2 (0x8497 bytes) 000268 1784122652.676137 read 0x017b0f thru 0x01e935 (0x6e27 bytes) 000269 1784122652.682960 MIRROR_RESYNC 4 mirrors 000270 1784122653.201608 mapwrite 0x02e99f thru 0x032b5d (0x41bf bytes) 000271 1784122653.239918 write 0x006fb3 thru 0x01500b (0xe059 bytes) 000272 1784122653.246432 mapwrite 0x01cdb3 thru 0x020fe7 (0x4235 bytes) 000274 1784122653.267074 mapread 0x0236a4 thru 0x024904 (0x1261 bytes) 000275 1784122653.268183 mapread 0x0185b5 thru 0x018c16 (0x662 bytes) 000277 1784122653.269722 write 0x0316c5 thru 0x035997 (0x42d3 bytes) 000278 1784122653.270987 trunc from 0x00530a to 0x00b890 (0x6587 bytes) 000279 1784122653.275023 mapwrite 0x022c0d thru 0x0264f9 (0x38ed bytes) 000280 1784122653.290268 mapwrite 0x00ba66 thru 0x00bd68 (0x303 bytes) 000281 1784122653.304144 fallocate 0x034593 thru 0x037778 (0x31e6 bytes) 000282 1784122653.308886 punch from 0x01a7d7 to 0x01cde3 (0x260d bytes) 000283 1784122653.313045 punch from 0x02314c to 0x02435a (0x120f bytes) 000284 1784122653.316538 punch from 0x017faa to 0x018946 (0x99d bytes) 000285 1784122653.319987 mapread 0x02c31f thru 0x0348f7 (0x85d9 bytes) 000286 1784122653.325391 MIRROR_RESYNC 4 mirrors 000287 1784122653.814624 read 0x004989 thru 0x0135de (0xec56 bytes) 000288 1784122653.818786 trunc from 0x035998 to 0x029350 (0xc647 bytes) 000289 1784122653.845379 trunc from 0x012a8c to 0x016906 (0x3e7b bytes) 000290 1784122653.848985 trunc from 0x029351 to 0x03f6f0 (0x163a0 bytes) 000293 1784122653.858890 write 0x038477 thru 0x03ffff (0x7b89 bytes) 000294 1784122653.864028 fallocate 0x019838 thru 0x0239c0 (0xa189 bytes) 000295 1784122653.867062 mapread 0x03a150 thru 0x03ffff (0x5eb0 bytes) 000296 1784122653.868074 mapread 0x03a8e1 thru 0x03ffff (0x571f bytes) 000297 1784122653.869082 mapwrite 0x036712 thru 0x03dd6f (0x765e bytes) 000299 1784122653.887501 MIRROR_RESYNC 4 mirrors 000300 1784122654.366759 trunc from 0x040000 to 0x00ff6b (0x30094 bytes) 000301 1784122654.382829 fallocate 0x005b1d thru 0x008bd1 (0x30b5 bytes) 000302 1784122654.385284 fallocate 0x005a3b thru 0x0152ed (0xf8b3 bytes) 000303 1784122654.389763 MIRROR_RESYNC 4 mirrors 000304 1784122654.675720 punch from 0x0019f3 to 0x003b98 (0x21a6 bytes) 000305 1784122654.707557 fallocate 0x00977b thru 0x0130ea (0x9970 bytes) 000306 1784122654.710550 write 0x02ae87 thru 0x0378e7 (0xca61 bytes) 000307 1784122654.712831 punch from 0x01e4c8 to 0x02b06e (0xcba7 bytes) 000308 1784122654.724883 mapread 0x009f8f thru 0x01646e (0xc4e0 bytes) 000309 1784122654.740797 read 0x00eb60 thru 0x013f39 (0x53da bytes) 000310 1784122654.741462 trunc from 0x0378e8 to 0x017a87 (0x1fe60 bytes) 000311 1784122654.756318 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17a88): Mirror 2: 0xc994e602 (stale) Mirror 4: 0xc994e602 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17a88): Mirror 2: 0xc994e602 (stale) Mirror 4: 0xc994e602 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17a88: skipped 000312 1784122654.884199 punch from 0x016a01 to 0x017a87 (0x1087 bytes) 000313 1784122654.886893 punch from 0x01660e to 0x017a87 (0x147a bytes) 000315 1784122654.890079 fallocate 0x021de9 thru 0x02ec65 (0xce7d bytes) 000316 1784122654.893390 trunc from 0x02ec66 to 0x02f325 (0x6c0 bytes) 000317 1784122654.900962 read 0x0299c2 thru 0x02f325 (0x5964 bytes) 000318 1784122654.905052 mapwrite 0x0075b2 thru 0x008116 (0xb65 bytes) 000319 1784122654.917936 read 0x012d83 thru 0x013de0 (0x105e bytes) 000320 1784122654.922762 fallocate 0x0308f2 thru 0x03ffff (0xf70e bytes) 000321 1784122654.925629 read 0x027623 thru 0x02aa0f (0x33ed bytes) 000322 1784122654.926242 fallocate 0x029328 thru 0x03450f (0xb1e8 bytes) 000324 1784122654.929708 trunc from 0x018685 to 0x01b89c (0x3218 bytes) 000325 1784122654.932103 mapwrite 0x024655 thru 0x030a7f (0xc42b bytes) 000326 1784122654.952477 fallocate 0x0014f3 thru 0x00fd7b (0xe889 bytes) 000327 1784122654.955182 mapread 0x02cd6a thru 0x030965 (0x3bfc bytes) 000328 1784122654.955957 trunc from 0x030a80 to 0x0047b8 (0x2c2c7 bytes) 000329 1784122654.962451 trunc from 0x0047b9 to 0x0215e7 (0x1ce2f bytes) 000330 1784122654.968444 read 0x0164ac thru 0x01b15f (0x4cb4 bytes) 000331 1784122654.972338 write 0x008a6e thru 0x0109db (0x7f6e bytes) 000332 1784122654.973606 punch from 0x019086 to 0x0215e7 (0x8562 bytes) 000333 1784122654.975751 mapread 0x01ee23 thru 0x021541 (0x271f bytes) 000334 1784122654.984867 mapwrite 0x0078c2 thru 0x014f03 (0xd642 bytes) 000335 1784122654.994866 read 0x001055 thru 0x00f1b8 (0xe164 bytes) 000336 1784122654.997221 MIRROR_RESYNC 3 mirrors 000338 1784122655.273355 write 0x009a63 thru 0x00ffb2 (0x6550 bytes) 000339 1784122655.287045 trunc from 0x0215e8 to 0x00019f (0x21448 bytes) 000340 1784122655.299038 MIRROR_RESYNC 3 mirrors 000341 1784122655.481324 mapread 0x0000b5 thru 0x00019f (0xeb bytes) 000343 1784122655.483897 trunc from 0x00012c to 0x00019f (0x74 bytes) 000344 1784122655.495705 trunc from 0x0001a0 to 0x00c575 (0xc3d6 bytes) 000345 1784122655.502303 mapread 0x002726 thru 0x00c575 (0x9e50 bytes) 000347 1784122655.510043 write 0x03f2d8 thru 0x03ffff (0xd28 bytes) 000348 1784122655.510862 mapwrite 0x031e9a thru 0x03502f (0x3196 bytes) 000349 1784122655.522516 write 0x03cba9 thru 0x03ffff (0x3457 bytes) 000350 1784122655.525150 fallocate 0x033523 thru 0x03eeac (0xb98a bytes) 000351 1784122655.527815 fallocate 0x019e4b thru 0x01aa9a (0xc50 bytes) 000352 1784122655.530617 punch from 0x01b715 to 0x026f1c (0xb808 bytes) 000353 1784122655.533437 write 0x03aa11 thru 0x03e5d0 (0x3bc0 bytes) 000354 1784122655.536823 read 0x035dc9 thru 0x03cd96 (0x6fce bytes) 000355 1784122655.537496 write 0x0124a5 thru 0x0182d9 (0x5e35 bytes) 000356 1784122655.541600 write 0x039531 thru 0x03ba1a (0x24ea bytes) 000357 1784122655.544605 MIRROR_RESYNC 3 mirrors 000358 1784122655.848506 punch from 0x006463 to 0x009c49 (0x37e7 bytes) 000359 1784122655.866153 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x4cfb601 (stale) Mirror 4: 0x4cfb601 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4cfb601 Mirror 5: 0x4cfb601 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000360 1784122656.170956 mapread 0x01b5b7 thru 0x021baa (0x65f4 bytes) 000361 1784122656.181818 mapread 0x020849 thru 0x028bc0 (0x8378 bytes) 000362 1784122656.190659 fallocate 0x002a07 thru 0x00b488 (0x8a82 bytes) 000363 1784122656.205409 fallocate 0x03d0ba thru 0x03ffff (0x2f46 bytes) 000364 1784122656.208453 fallocate 0x03722f thru 0x03b533 (0x4305 bytes) 000365 1784122656.211164 trunc from 0x040000 to 0x0239ad (0x1c652 bytes) 000366 1784122656.219688 write 0x00fcc1 thru 0x01b314 (0xb654 bytes) 000367 1784122656.224756 fallocate 0x0133ea thru 0x021f99 (0xebb0 bytes) 000368 1784122656.227255 trunc from 0x00b036 to 0x011442 (0x640d bytes) 000369 1784122656.233830 mapread 0x007d9a thru 0x0093f1 (0x1658 bytes) 000370 1784122656.239097 punch from 0x009ce0 to 0x015d3f (0xc060 bytes) 000371 1784122656.242237 write 0x017d18 thru 0x023fa0 (0xc289 bytes) 000372 1784122656.245467 mapread 0x01019c thru 0x0118d3 (0x1738 bytes) 000373 1784122656.249808 punch from 0x007f2c to 0x015eaa (0xdf7f bytes) 000374 1784122656.252554 punch from 0x01a843 to 0x01fb2d (0x52eb bytes) 000375 1784122656.259425 mapread 0x00357e thru 0x00bd9b (0x881e bytes) 000377 1784122656.264291 mapread 0x01881c thru 0x022461 (0x9c46 bytes) 000378 1784122656.269557 trunc from 0x023fa1 to 0x01eb6b (0x5435 bytes) 000379 1784122656.276496 fallocate 0x025d85 thru 0x02d743 (0x79bf bytes) 000380 1784122656.281698 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1eb6c): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1eb6c): Mirror 2: 0xa3d55e07 (stale) Mirror 4: 0xa3d55e07 (stale) Mirror 5: 0xa3d55e07 (stale) CRC-32 checksum value for chunk [0, 0x1eb6c): Mirror 1: 0x398b72e3 Mirror 6: 0x398b72e3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1eb6c: skipped 000381 1784122656.607476 mapwrite 0x018540 thru 0x026645 (0xe106 bytes) 000382 1784122656.666023 fallocate 0x031dea thru 0x034a48 (0x2c5f bytes) 000383 1784122656.670889 fallocate 0x00b790 thru 0x00c75e (0xfcf bytes) 000384 1784122656.674869 punch from 0x00923a to 0x018775 (0xf53c bytes) 000385 1784122656.679586 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x26646): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26646): Mirror 2: 0xd7a25fb9 (stale) Mirror 4: 0xd7a25fb9 (stale) Mirror 5: 0xd7a25fb9 (stale) Mirror 6: 0x1aa95c91 (stale) CRC-32 checksum value for chunk [0, 0x26646): Mirror 1: 0xca02be69 Mirror 7: 0xca02be69 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26646: skipped 000386 1784122656.974828 mapread 0x00a6e4 thru 0x013a20 (0x933d bytes) 000387 1784122656.991772 mapread 0x00d849 thru 0x011719 (0x3ed1 bytes) 000388 1784122657.002928 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26646): Mirror 2: 0xd7a25fb9 (stale) Mirror 5: 0xd7a25fb9 (stale) Mirror 6: 0x1aa95c91 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26646): Mirror 2: 0xd7a25fb9 (stale) Mirror 5: 0xd7a25fb9 (stale) Mirror 6: 0x1aa95c91 (stale) CRC-32 checksum value for chunk [0, 0x26646): Mirror 1: 0xca02be69 Mirror 7: 0xca02be69 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26646: skipped 000390 1784122657.265239 trunc from 0x026646 to 0x02b15b (0x4b16 bytes) 000391 1784122657.285816 trunc from 0x02b15c to 0x03d990 (0x12835 bytes) 000392 1784122657.295312 trunc from 0x03d991 to 0x015eee (0x27aa2 bytes) 000393 1784122657.303942 punch from 0x0010bd to 0x00ebda (0xdb1e bytes) 000394 1784122657.307116 write 0x02dac9 thru 0x03a4d7 (0xca0f bytes) 000395 1784122657.308759 fallocate 0x014848 thru 0x01e10b (0x98c4 bytes) 000396 1784122657.312580 fallocate 0x03a545 thru 0x03ffff (0x5abb bytes) 000398 1784122657.316256 punch from 0x02b40e to 0x0392aa (0xde9d bytes) 000399 1784122657.324592 write 0x0032ec thru 0x00e7a1 (0xb4b6 bytes) 000400 1784122657.331052 punch from 0x009834 to 0x00f659 (0x5e26 bytes) 000401 1784122657.339751 punch from 0x039645 to 0x03e2b5 (0x4c71 bytes) 000402 1784122657.343941 trunc from 0x01ba0d to 0x01f495 (0x3a89 bytes) 000404 1784122657.347705 punch from 0x03e2cc to 0x03ffff (0x1d34 bytes) 000406 1784122657.351485 punch from 0x016135 to 0x026114 (0xffe0 bytes) 000407 1784122657.355071 trunc from 0x040000 to 0x037460 (0x8b9f bytes) 000408 1784122657.363941 mapread 0x017f53 thru 0x01f130 (0x71de bytes) 000409 1784122657.377507 write 0x004ea5 thru 0x0145df (0xf73b bytes) 000411 1784122657.379788 punch from 0x02b541 to 0x0346a6 (0x9166 bytes) 000412 1784122657.383010 fallocate 0x00dd46 thru 0x01c09e (0xe359 bytes) 000413 1784122657.387656 read 0x036c78 thru 0x037460 (0x7e9 bytes) 000414 1784122657.391914 mapread 0x025d48 thru 0x0276c7 (0x1980 bytes) 000415 1784122657.397182 mapread 0x00677e thru 0x00cfa9 (0x682c bytes) 000416 1784122657.400877 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x37461): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37461): Mirror 2: 0xc26a45bf (stale) Mirror 5: 0xc26a45bf (stale) Mirror 6: 0x82b24ace (stale) Mirror 7: 0x1d473000 (stale) CRC-32 checksum value for chunk [0, 0x37461): Mirror 1: 0x9b78ab7 Mirror 8: 0x9b78ab7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37461: skipped 000417 1784122657.763711 write 0x001248 thru 0x00c298 (0xb051 bytes) 000418 1784122657.791145 fallocate 0x00eb59 thru 0x01491b (0x5dc3 bytes) 000419 1784122657.794952 read 0x017602 thru 0x02086a (0x9269 bytes) 000420 1784122657.802112 write 0x021eda thru 0x02ab1b (0x8c42 bytes) 000421 1784122657.809291 trunc from 0x037461 to 0x03e6bf (0x725f bytes) 000422 1784122657.830799 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e6c0): Mirror 2: 0xe2bea05f (stale) Mirror 5: 0xe2bea05f (stale) Mirror 6: 0x745a7ec7 (stale) Mirror 8: 0x20ed8b1b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e6c0): Mirror 2: 0xe2bea05f (stale) Mirror 5: 0xe2bea05f (stale) Mirror 6: 0x745a7ec7 (stale) Mirror 8: 0x20ed8b1b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e6c0: skipped 000423 1784122658.000507 punch from 0x004cb9 to 0x00c4c1 (0x7809 bytes) 000424 1784122658.004158 mapwrite 0x01c680 thru 0x0299e3 (0xd364 bytes) 000425 1784122658.037118 fallocate 0x01df77 thru 0x02c8ce (0xe958 bytes) 000426 1784122658.041702 mapread 0x00ac97 thru 0x00d20a (0x2574 bytes) 000427 1784122658.048137 mapwrite 0x03fa48 thru 0x03ffff (0x5b8 bytes) 000428 1784122658.069362 mapread 0x0203fa thru 0x02ea04 (0xe60b bytes) 000429 1784122658.070655 read 0x0004dd thru 0x00610c (0x5c30 bytes) 000430 1784122658.073744 mapwrite 0x03ff29 thru 0x03ffff (0xd7 bytes) 000431 1784122658.079810 fallocate 0x0282ca thru 0x032677 (0xa3ae bytes) 000432 1784122658.082661 mapread 0x00f7c1 thru 0x01e757 (0xef97 bytes) 000433 1784122658.086568 mapwrite 0x02d2f6 thru 0x031354 (0x405f bytes) 000434 1784122658.097688 trunc from 0x00a8c2 to 0x01859c (0xdcdb bytes) 000435 1784122658.100108 mapread 0x02aba0 thru 0x033579 (0x89da bytes) 000437 1784122658.101429 read 0x003200 thru 0x012f17 (0xfd18 bytes) 000438 1784122658.105487 fallocate 0x015ff9 thru 0x025fe9 (0xfff1 bytes) 000439 1784122658.107843 punch from 0x0039b3 to 0x00dec4 (0xa512 bytes) 000440 1784122658.111887 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x4cfb601 (stale) Mirror 5: 0x4cfb601 (stale) Mirror 6: 0xad333f3a (stale) Mirror 8: 0xf96a57ec (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3cbf93e7 Mirror 9: 0x3cbf93e7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000441 1784122658.525020 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x4cfb601 (stale) Mirror 5: 0x4cfb601 (stale) Mirror 6: 0xad333f3a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x4cfb601 (stale) Mirror 5: 0x4cfb601 (stale) Mirror 6: 0xad333f3a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3cbf93e7 Mirror 9: 0x3cbf93e7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000442 1784122658.863599 fallocate 0x036ce4 thru 0x03961f (0x293c bytes) 000443 1784122658.892846 trunc from 0x040000 to 0x011e0a (0x2e1f5 bytes) 000444 1784122658.914411 read 0x008e97 thru 0x00ca3f (0x3ba9 bytes) 000445 1784122658.919030 trunc from 0x0075e1 to 0x00f808 (0x8228 bytes) 000447 1784122658.922191 read 0x011924 thru 0x011e0a (0x4e7 bytes) 000448 1784122658.931370 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x11e0b): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11e0b): Mirror 2: 0x7e9ef845 (stale) Mirror 5: 0x7e9ef845 (stale) Mirror 6: 0x7e9ef845 (stale) Mirror 9: 0xb628213e (stale) CRC-32 checksum value for chunk [0, 0x11e0b): Mirror 1: 0xb628213e Mirror 10: 0xb628213e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11e0b: skipped 000449 1784122659.350762 mapwrite 0x02045c thru 0x0303e2 (0xff87 bytes) 000450 1784122659.416941 write 0x018885 thru 0x0244c6 (0xbc42 bytes) 000451 1784122659.422063 fallocate 0x02f370 thru 0x03f2c8 (0xff59 bytes) 000452 1784122659.427954 mapread 0x03272e thru 0x03f2c8 (0xcb9b bytes) 000453 1784122659.448815 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3f2c9): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f2c9): Mirror 2: 0xb725cf1a (stale) Mirror 5: 0xb725cf1a (stale) Mirror 6: 0x17337784 (stale) Mirror 9: 0xf4fcbbce (stale) Mirror 10: 0xf15223e8 (stale) CRC-32 checksum value for chunk [0, 0x3f2c9): Mirror 1: 0xdd63bee2 Mirror 11: 0xdd63bee2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f2c9: skipped 000454 1784122659.895916 mapwrite 0x0093e6 thru 0x015c61 (0xc87c bytes) 000455 1784122659.964544 trunc from 0x032402 to 0x039877 (0x7476 bytes) 000456 1784122659.969451 fallocate 0x027aad thru 0x030d36 (0x928a bytes) 000457 1784122659.972350 fallocate 0x02479d thru 0x02f344 (0xaba8 bytes) 000458 1784122659.978208 trunc from 0x03f2c9 to 0x020ff3 (0x1e2d5 bytes) 000459 1784122660.011898 punch from 0x008967 to 0x009a33 (0x10cd bytes) 000460 1784122660.017306 trunc from 0x016802 to 0x01894a (0x2149 bytes) 000461 1784122660.021851 mapwrite 0x0362a6 thru 0x03b732 (0x548d bytes) 000463 1784122660.051240 MIRROR_SPLIT mirror 6 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b733): Mirror 2: 0x32acb5e8 (stale) Mirror 5: 0x32acb5e8 (stale) Mirror 6: 0x7f69516a (stale) Mirror 9: 0x8fc76f12 (stale) Mirror 10: 0xe6a9c8c0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b733): Mirror 2: 0x32acb5e8 (stale) Mirror 5: 0x32acb5e8 (stale) Mirror 6: 0x7f69516a (stale) Mirror 9: 0x8fc76f12 (stale) Mirror 10: 0xe6a9c8c0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b733: skipped 000464 1784122660.255933 write 0x01db0b thru 0x02719b (0x9691 bytes) 000466 1784122660.266135 read 0x01a798 thru 0x0292e3 (0xeb4c bytes) 000467 1784122660.270395 trunc from 0x0098fa to 0x009e81 (0x588 bytes) 000468 1784122660.273041 fallocate 0x014b29 thru 0x018642 (0x3b1a bytes) 000469 1784122660.276221 mapwrite 0x03028b thru 0x03ef52 (0xecc8 bytes) 000470 1784122660.305219 write 0x032446 thru 0x0364d7 (0x4092 bytes) 000471 1784122660.306897 punch from 0x01103b to 0x01af41 (0x9f07 bytes) 000472 1784122660.312265 MIRROR_RESYNC 6 mirrors 000473 1784122661.006762 write 0x02d3da thru 0x03698e (0x95b5 bytes) 000474 1784122661.033295 trunc from 0x019565 to 0x0271fb (0xdc97 bytes) 000476 1784122661.036421 mapwrite 0x011fe5 thru 0x014312 (0x232e bytes) 000477 1784122661.056954 punch from 0x01f8b1 to 0x0269d2 (0x7122 bytes) 000478 1784122661.060965 punch from 0x028a45 to 0x02a5d5 (0x1b91 bytes) 000479 1784122661.064195 trunc from 0x03ef53 to 0x039fdb (0x4f77 bytes) 000480 1784122661.084879 mapwrite 0x038334 thru 0x03ffff (0x7ccc bytes) 000481 1784122661.120234 write 0x021321 thru 0x02ea3b (0xd71b bytes) 000482 1784122661.127002 trunc from 0x024d6d to 0x0311e3 (0xc477 bytes) 000483 1784122661.138858 punch from 0x02c25d to 0x03bff5 (0xfd99 bytes) 000484 1784122661.143731 fallocate 0x02b06c thru 0x02cd6c (0x1d01 bytes) 000485 1784122661.147005 trunc from 0x00e7e3 to 0x01e03e (0xf85c bytes) 000486 1784122661.153110 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x2e799c12 (stale) Mirror 5: 0x2e799c12 (stale) Mirror 6: 0x2e799c12 (stale) Mirror 9: 0x2e799c12 (stale) Mirror 10: 0x2e799c12 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc8a0edbb Mirror 11: 0xc8a0edbb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000488 1784122661.639024 read 0x028950 thru 0x02b882 (0x2f33 bytes) 000489 1784122661.645829 fallocate 0x013b70 thru 0x01e078 (0xa509 bytes) 000490 1784122661.674016 mapread 0x021f7a thru 0x02b1b2 (0x9239 bytes) 000493 1784122661.689465 mapwrite 0x01d230 thru 0x01d72f (0x500 bytes) 000494 1784122661.701526 trunc from 0x040000 to 0x029a45 (0x165ba bytes) 000495 1784122661.738119 mapread 0x01fbef thru 0x024bda (0x4fec bytes) 000496 1784122661.739387 read 0x015461 thru 0x01fb13 (0xa6b3 bytes) 000497 1784122661.752210 trunc from 0x0030a7 to 0x00d349 (0xa2a3 bytes) 000498 1784122661.757421 write 0x010ced thru 0x020045 (0xf359 bytes) 000499 1784122661.759306 mapwrite 0x029625 thru 0x03893d (0xf319 bytes) 000500 1784122661.801721 MIRROR_RESYNC 7 mirrors 000501 1784122662.657389 MIRROR_RESYNC 7 mirrors 000503 1784122662.927957 fallocate 0x03c379 thru 0x03ffff (0x3c87 bytes) 000505 1784122662.968121 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3893e): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3893e): Mirror 2: 0x69e36cee (stale) Mirror 5: 0x69e36cee (stale) Mirror 6: 0x69e36cee (stale) Mirror 9: 0x69e36cee (stale) Mirror 10: 0x69e36cee (stale) Mirror 11: 0x69e36cee (stale) CRC-32 checksum value for chunk [0, 0x3893e): Mirror 1: 0x69e36cee Mirror 12: 0x69e36cee lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3893e: skipped 000506 1784122663.517151 punch from 0x0213eb to 0x024180 (0x2d96 bytes) 000507 1784122663.534444 trunc from 0x03893e to 0x020907 (0x18036 bytes) 000508 1784122663.547752 punch from 0x008985 to 0x012518 (0x9b94 bytes) 000509 1784122663.552060 mapwrite 0x01e539 thru 0x01fff0 (0x1ab8 bytes) 000510 1784122663.571721 read 0x01b68d thru 0x01eb2e (0x34a2 bytes) 000511 1784122663.575644 mapread 0x01a11a thru 0x020907 (0x67ee bytes) 000512 1784122663.581161 write 0x00724f thru 0x0074f5 (0x2a7 bytes) 000513 1784122663.585322 mapwrite 0x0341df thru 0x03d222 (0x9044 bytes) 000514 1784122663.639146 write 0x027fc9 thru 0x03521f (0xd257 bytes) 000515 1784122663.652483 mapread 0x03424e thru 0x03d222 (0x8fd5 bytes) 000517 1784122663.655751 mapwrite 0x004aac thru 0x005f10 (0x1465 bytes) 000518 1784122663.679557 read 0x00c9bd thru 0x013a4e (0x7092 bytes) 000519 1784122663.687439 mapwrite 0x01a3fb thru 0x0270d5 (0xccdb bytes) 000520 1784122663.707956 write 0x00e2ba thru 0x012145 (0x3e8c bytes) 000521 1784122663.714337 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3d223): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d223): Mirror 2: 0x7a345a42 (stale) Mirror 5: 0x7a345a42 (stale) Mirror 6: 0x7a345a42 (stale) Mirror 9: 0x7a345a42 (stale) Mirror 10: 0x7a345a42 (stale) Mirror 11: 0x7a345a42 (stale) Mirror 12: 0x7a345a42 (stale) CRC-32 checksum value for chunk [0, 0x3d223): Mirror 1: 0xcdf97a5b Mirror 13: 0xcdf97a5b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d223: skipped 000522 1784122664.176171 write 0x0292fb thru 0x0311c8 (0x7ece bytes) 000523 1784122664.207692 read 0x035c92 thru 0x03896f (0x2cde bytes) 000524 1784122664.212550 read 0x016824 thru 0x01b615 (0x4df2 bytes) 000525 1784122664.227222 mapread 0x02fe4f thru 0x0306db (0x88d bytes) 000526 1784122664.229312 read 0x031787 thru 0x03d222 (0xba9c bytes) 000527 1784122664.230778 trunc from 0x03d223 to 0x022506 (0x1ad1c bytes) 000528 1784122664.262986 write 0x0238f4 thru 0x0308fc (0xd009 bytes) 000529 1784122664.264772 punch from 0x019242 to 0x02684c (0xd60b bytes) 000530 1784122664.277806 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x308fd): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x308fd): Mirror 2: 0x18dcdcf3 (stale) Mirror 5: 0x18dcdcf3 (stale) Mirror 6: 0x18dcdcf3 (stale) Mirror 9: 0x18dcdcf3 (stale) Mirror 10: 0x18dcdcf3 (stale) Mirror 11: 0x18dcdcf3 (stale) Mirror 12: 0x18dcdcf3 (stale) Mirror 13: 0x6ea60d80 (stale) CRC-32 checksum value for chunk [0, 0x308fd): Mirror 1: 0x7f5fa2dc Mirror 14: 0x7f5fa2dc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x308fd: skipped 000531 1784122664.842721 mapread 0x007cb9 thru 0x0150ca (0xd412 bytes) 000533 1784122664.887548 mapwrite 0x01fa34 thru 0x02a8c2 (0xae8f bytes) 000534 1784122664.974355 trunc from 0x005667 to 0x015176 (0xfb10 bytes) 000535 1784122664.979556 MIRROR_SPLIT mirror 2 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x308fd): Mirror 2: 0x18dcdcf3 (stale) Mirror 6: 0x18dcdcf3 (stale) Mirror 9: 0x18dcdcf3 (stale) Mirror 10: 0x18dcdcf3 (stale) Mirror 11: 0x18dcdcf3 (stale) Mirror 12: 0x18dcdcf3 (stale) Mirror 13: 0x6ea60d80 (stale) Mirror 14: 0x7f5fa2dc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x308fd): Mirror 2: 0x18dcdcf3 (stale) Mirror 6: 0x18dcdcf3 (stale) Mirror 9: 0x18dcdcf3 (stale) Mirror 10: 0x18dcdcf3 (stale) Mirror 11: 0x18dcdcf3 (stale) Mirror 12: 0x18dcdcf3 (stale) Mirror 13: 0x6ea60d80 (stale) Mirror 14: 0x7f5fa2dc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x308fd: skipped 000536 1784122665.238085 punch from 0x00e218 to 0x00e511 (0x2fa bytes) 000537 1784122665.241554 write 0x026b10 thru 0x0319bb (0xaeac bytes) 000538 1784122665.248430 write 0x012f38 thru 0x01fb1d (0xcbe6 bytes) 000540 1784122665.254856 write 0x030ed4 thru 0x038007 (0x7134 bytes) 000541 1784122665.256018 fallocate 0x018952 thru 0x027fec (0xf69b bytes) 000542 1784122665.259631 fallocate 0x02c3e7 thru 0x02da0c (0x1626 bytes) 000543 1784122665.262837 mapwrite 0x018cc2 thru 0x01c99e (0x3cdd bytes) 000544 1784122665.280744 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38008): Mirror 2: 0x26ffa46 (stale) Mirror 6: 0x26ffa46 (stale) Mirror 10: 0x26ffa46 (stale) Mirror 11: 0x26ffa46 (stale) Mirror 12: 0x26ffa46 (stale) Mirror 13: 0x48bd2c9b (stale) Mirror 14: 0xfb04f8f1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38008): Mirror 2: 0x26ffa46 (stale) Mirror 6: 0x26ffa46 (stale) Mirror 10: 0x26ffa46 (stale) Mirror 11: 0x26ffa46 (stale) Mirror 12: 0x26ffa46 (stale) Mirror 13: 0x48bd2c9b (stale) Mirror 14: 0xfb04f8f1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38008: skipped 000545 1784122665.498968 write 0x02c094 thru 0x02d2fe (0x126b bytes) 000546 1784122665.509079 fallocate 0x026b1a thru 0x029e3b (0x3322 bytes) 000547 1784122665.512190 read 0x01011c thru 0x01dda2 (0xdc87 bytes) 000548 1784122665.522564 MIRROR_RESYNC 8 mirrors 000549 1784122666.228948 mapread 0x00ebcd thru 0x01d01f (0xe453 bytes) 000550 1784122666.246703 fallocate 0x00b847 thru 0x00c35f (0xb19 bytes) 000551 1784122666.273104 mapwrite 0x030f27 thru 0x033710 (0x27ea bytes) 000552 1784122666.286855 trunc from 0x027678 to 0x028961 (0x12ea bytes) 000553 1784122666.289953 read 0x0128b5 thru 0x01d060 (0xa7ac bytes) 000554 1784122666.298959 read 0x023a92 thru 0x02ca29 (0x8f98 bytes) 000555 1784122666.303726 mapwrite 0x011f26 thru 0x017a89 (0x5b64 bytes) 000556 1784122666.315364 mapread 0x008751 thru 0x00a2bf (0x1b6f bytes) 000558 1784122666.316865 write 0x001738 thru 0x00e65a (0xcf23 bytes) 000560 1784122666.319209 mapread 0x0114e9 thru 0x017d4d (0x6865 bytes) 000561 1784122666.320294 mapwrite 0x00dfcb thru 0x019573 (0xb5a9 bytes) 000562 1784122666.341529 write 0x011592 thru 0x01f370 (0xdddf bytes) 000563 1784122666.343186 read 0x01ccb7 thru 0x02a741 (0xda8b bytes) 000564 1784122666.344686 write 0x0168c0 thru 0x021773 (0xaeb4 bytes) 000565 1784122666.347425 write 0x00dc2d thru 0x00e9a5 (0xd79 bytes) 000566 1784122666.348406 trunc from 0x038008 to 0x00dfe5 (0x2a022 bytes) 000567 1784122666.360964 trunc from 0x00dfe6 to 0x01924a (0xb265 bytes) 000568 1784122666.369064 trunc from 0x0005ce to 0x009f96 (0x99c9 bytes) 000569 1784122666.377596 MIRROR_RESYNC 8 mirrors 000571 1784122667.206981 mapwrite 0x02dc22 thru 0x02f1d6 (0x15b5 bytes) 000572 1784122667.255408 trunc from 0x021099 to 0x0237df (0x2747 bytes) 000573 1784122667.259571 mapwrite 0x02bda8 thru 0x02ff6e (0x41c7 bytes) 000574 1784122667.296492 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ff6f): Mirror 6: 0xcbcd3565 (stale) Mirror 10: 0xcbcd3565 (stale) Mirror 11: 0xcbcd3565 (stale) Mirror 12: 0xcbcd3565 (stale) Mirror 13: 0xcbcd3565 (stale) Mirror 14: 0xcbcd3565 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ff6f): Mirror 6: 0xcbcd3565 (stale) Mirror 10: 0xcbcd3565 (stale) Mirror 11: 0xcbcd3565 (stale) Mirror 12: 0xcbcd3565 (stale) Mirror 13: 0xcbcd3565 (stale) Mirror 14: 0xcbcd3565 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ff6f: skipped 000575 1784122667.524906 punch from 0x0186bb to 0x020c8f (0x85d5 bytes) 000578 1784122667.528772 write 0x013bfb thru 0x018fa0 (0x53a6 bytes) 000579 1784122667.536612 trunc from 0x02ff6f to 0x0288dd (0x7691 bytes) 000580 1784122667.548059 mapread 0x01ab4a thru 0x02555b (0xaa12 bytes) 000581 1784122667.558499 punch from 0x01b414 to 0x0287ed (0xd3da bytes) 000582 1784122667.561285 read 0x00fafb thru 0x01ed38 (0xf23e bytes) 000583 1784122667.567547 punch from 0x005230 to 0x007e8d (0x2c5e bytes) 000584 1784122667.570365 write 0x024651 thru 0x024872 (0x222 bytes) 000585 1784122667.573715 write 0x0146e1 thru 0x016faa (0x28ca bytes) 000586 1784122667.574743 mapread 0x01ac97 thru 0x0288dd (0xdc47 bytes) 000587 1784122667.583358 write 0x00384e thru 0x00da5d (0xa210 bytes) 000588 1784122667.590542 trunc from 0x0288de to 0x03d127 (0x1484a bytes) 000589 1784122667.598508 trunc from 0x03d128 to 0x02d3a2 (0xfd85 bytes) 000591 1784122667.608296 trunc from 0x029d69 to 0x02d3a2 (0x363a bytes) 000592 1784122667.611225 punch from 0x01be67 to 0x02acbc (0xee56 bytes) 000594 1784122667.620335 trunc from 0x008cd2 to 0x00f807 (0x6b36 bytes) 000595 1784122667.627367 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2d3a3): Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d3a3): Mirror 6: 0xb9c7c21e (stale) Mirror 10: 0xb9c7c21e (stale) Mirror 11: 0xb9c7c21e (stale) Mirror 12: 0xb9c7c21e (stale) Mirror 13: 0xb9c7c21e (stale) Mirror 14: 0xb9c7c21e (stale) CRC-32 checksum value for chunk [0, 0x2d3a3): Mirror 1: 0x3ce46f2a Mirror 15: 0x3ce46f2a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d3a3: skipped 000596 1784122668.090891 punch from 0x00cfed to 0x00f641 (0x2655 bytes) 000597 1784122668.114077 mapread 0x028a19 thru 0x02b5a4 (0x2b8c bytes) 000599 1784122668.128328 mapwrite 0x0189cc thru 0x027c17 (0xf24c bytes) 000600 1784122668.149912 mapread 0x01f001 thru 0x027ca4 (0x8ca4 bytes) 000601 1784122668.151638 trunc from 0x02d3a3 to 0x02baf1 (0x18b1 bytes) 000602 1784122668.178954 fallocate 0x038ffd thru 0x03c5bb (0x35bf bytes) 000604 1784122668.183657 mapwrite 0x008f17 thru 0x00df1f (0x5009 bytes) 000605 1784122668.206691 punch from 0x0282e5 to 0x02baf1 (0x380d bytes) 000606 1784122668.210618 trunc from 0x004389 to 0x00b65f (0x72d7 bytes) 000607 1784122668.214138 punch from 0x0099fb to 0x00b85c (0x1e62 bytes) 000608 1784122668.217574 read 0x00164d thru 0x00ba5c (0xa410 bytes) 000609 1784122668.222319 trunc from 0x02baf2 to 0x026880 (0x5271 bytes) 000610 1784122668.233180 mapwrite 0x003c4a thru 0x012983 (0xed3a bytes) 000611 1784122668.256872 read 0x00f61e thru 0x018a02 (0x93e5 bytes) 000612 1784122668.257522 punch from 0x024712 to 0x026327 (0x1c16 bytes) 000613 1784122668.263140 trunc from 0x026881 to 0x00c439 (0x1a447 bytes) 000614 1784122668.281817 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0xc43a): Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc43a): Mirror 6: 0x8e60268c (stale) Mirror 10: 0x8e60268c (stale) Mirror 11: 0x8e60268c (stale) Mirror 12: 0x8e60268c (stale) Mirror 13: 0x8e60268c (stale) Mirror 14: 0x8e60268c (stale) Mirror 15: 0x4cb09dcf (stale) CRC-32 checksum value for chunk [0, 0xc43a): Mirror 1: 0x614e2fb5 Mirror 16: 0x614e2fb5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc43a: skipped 000615 1784122668.694827 trunc from 0x00c43a to 0x0184e0 (0xc0a7 bytes) 000616 1784122668.743970 read 0x009a77 thru 0x011db8 (0x8342 bytes) 000617 1784122668.754381 read 0x003d78 thru 0x00e8fa (0xab83 bytes) 000618 1784122668.768297 read 0x00d84d thru 0x017bb0 (0xa364 bytes) 000619 1784122668.772999 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x184e1): Mirror 6: 0x6b04c64c (stale) Mirror 10: 0x6b04c64c (stale) Mirror 11: 0x6b04c64c (stale) Mirror 12: 0x6b04c64c (stale) Mirror 14: 0x6b04c64c (stale) Mirror 15: 0x73856167 (stale) Mirror 16: 0x579f9a59 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x184e1): Mirror 6: 0x6b04c64c (stale) Mirror 10: 0x6b04c64c (stale) Mirror 11: 0x6b04c64c (stale) Mirror 12: 0x6b04c64c (stale) Mirror 14: 0x6b04c64c (stale) Mirror 15: 0x73856167 (stale) Mirror 16: 0x579f9a59 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x184e1: skipped 000620 1784122669.027874 fallocate 0x000c76 thru 0x006939 (0x5cc4 bytes) 000621 1784122669.032408 read 0x016c4d thru 0x0184e0 (0x1894 bytes) 000622 1784122669.036903 write 0x03353b thru 0x039afd (0x65c3 bytes) 000624 1784122669.044174 trunc from 0x039afe to 0x0139a6 (0x26157 bytes) 000625 1784122669.058462 read 0x006e48 thru 0x0139a6 (0xcb5f bytes) 000626 1784122669.064847 mapwrite 0x0168de thru 0x017a51 (0x1174 bytes) 000627 1784122669.084587 write 0x02b09d thru 0x035cd7 (0xac3b bytes) 000628 1784122669.089281 MIRROR_RESYNC 8 mirrors 000629 1784122670.112080 mapwrite 0x0141d5 thru 0x021371 (0xd19d bytes) 000630 1784122670.191745 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x35cd8): Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35cd8): Mirror 6: 0x61fac44b (stale) Mirror 10: 0x61fac44b (stale) Mirror 11: 0x61fac44b (stale) Mirror 12: 0x61fac44b (stale) Mirror 14: 0x61fac44b (stale) Mirror 15: 0x61fac44b (stale) Mirror 16: 0x61fac44b (stale) CRC-32 checksum value for chunk [0, 0x35cd8): Mirror 1: 0x9fb2ceee Mirror 17: 0x9fb2ceee lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35cd8: skipped 000631 1784122670.704121 trunc from 0x034ce2 to 0x035cd7 (0xff6 bytes) 000632 1784122670.727069 mapwrite 0x01fd70 thru 0x0278c5 (0x7b56 bytes) 000633 1784122670.755259 mapwrite 0x003dd8 thru 0x0099c6 (0x5bef bytes) 000634 1784122670.777132 write 0x00a1d6 thru 0x0162a1 (0xc0cc bytes) 000635 1784122670.783575 read 0x012724 thru 0x01c73f (0xa01c bytes) 000636 1784122670.789857 trunc from 0x03414d to 0x035cd7 (0x1b8b bytes) 000637 1784122670.795305 write 0x016272 thru 0x019034 (0x2dc3 bytes) 000638 1784122670.796932 read 0x0340d1 thru 0x035cd7 (0x1c07 bytes) 000639 1784122670.806919 fallocate 0x00e2c3 thru 0x013d0c (0x5a4a bytes) 000640 1784122670.817982 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x35cd8): Mirror 6: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35cd8): Mirror 6: 0x61fac44b (stale) Mirror 10: 0x61fac44b (stale) Mirror 11: 0x61fac44b (stale) Mirror 12: 0x61fac44b (stale) Mirror 14: 0x61fac44b (stale) Mirror 15: 0x61fac44b (stale) Mirror 16: 0x61fac44b (stale) Mirror 17: 0x9fb2ceee (stale) CRC-32 checksum value for chunk [0, 0x35cd8): Mirror 1: 0xcd0a8aa8 Mirror 18: 0xcd0a8aa8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35cd8: skipped 000641 1784122671.358935 write 0x02c770 thru 0x03aabd (0xe34e bytes) 000643 1784122671.399714 mapwrite 0x02f897 thru 0x03cd79 (0xd4e3 bytes) 000644 1784122671.429633 fallocate 0x028c48 thru 0x02b146 (0x24ff bytes) 000645 1784122671.441014 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cd7a): Mirror 6: 0x99150beb (stale) Mirror 10: 0x99150beb (stale) Mirror 11: 0x99150beb (stale) Mirror 12: 0x99150beb (stale) Mirror 14: 0x99150beb (stale) Mirror 15: 0x99150beb (stale) Mirror 17: 0xeaa5bdff (stale) Mirror 18: 0x8fae3313 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cd7a): Mirror 6: 0x99150beb (stale) Mirror 10: 0x99150beb (stale) Mirror 11: 0x99150beb (stale) Mirror 12: 0x99150beb (stale) Mirror 14: 0x99150beb (stale) Mirror 15: 0x99150beb (stale) Mirror 17: 0xeaa5bdff (stale) Mirror 18: 0x8fae3313 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cd7a: skipped 000647 1784122671.778254 mapread 0x036644 thru 0x03cd79 (0x6736 bytes) 000648 1784122671.797606 fallocate 0x02daa1 thru 0x031d26 (0x4286 bytes) 000649 1784122671.803107 trunc from 0x0135c0 to 0x014ea1 (0x18e2 bytes) 000651 1784122671.812146 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cd7a): Mirror 6: 0x99150beb (stale) Mirror 11: 0x99150beb (stale) Mirror 12: 0x99150beb (stale) Mirror 14: 0x99150beb (stale) Mirror 15: 0x99150beb (stale) Mirror 17: 0xeaa5bdff (stale) Mirror 18: 0x8fae3313 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cd7a): Mirror 6: 0x99150beb (stale) Mirror 11: 0x99150beb (stale) Mirror 12: 0x99150beb (stale) Mirror 14: 0x99150beb (stale) Mirror 15: 0x99150beb (stale) Mirror 17: 0xeaa5bdff (stale) Mirror 18: 0x8fae3313 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cd7a: skipped 000652 1784122672.130418 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cd7a): Mirror 11: 0x99150beb (stale) Mirror 12: 0x99150beb (stale) Mirror 14: 0x99150beb (stale) Mirror 15: 0x99150beb (stale) Mirror 17: 0xeaa5bdff (stale) Mirror 18: 0x8fae3313 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cd7a): Mirror 11: 0x99150beb (stale) Mirror 12: 0x99150beb (stale) Mirror 14: 0x99150beb (stale) Mirror 15: 0x99150beb (stale) Mirror 17: 0xeaa5bdff (stale) Mirror 18: 0x8fae3313 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cd7a: skipped 000653 1784122672.390232 read 0x037310 thru 0x03cd79 (0x5a6a bytes) 000654 1784122672.402602 read 0x03aaaf thru 0x03cd79 (0x22cb bytes) 000655 1784122672.403305 fallocate 0x02ddf4 thru 0x039005 (0xb212 bytes) 000656 1784122672.409411 mapread 0x00e8bd thru 0x015f74 (0x76b8 bytes) 000660 1784122672.423555 read 0x01796e thru 0x01f0b9 (0x774c bytes) 000661 1784122672.424369 mapread 0x013a85 thru 0x017dc3 (0x433f bytes) 000662 1784122672.425593 punch from 0x01b414 to 0x0284b0 (0xd09d bytes) 000663 1784122672.429343 mapwrite 0x027583 thru 0x029f20 (0x299e bytes) 000664 1784122672.456756 trunc from 0x000d59 to 0x0034c8 (0x2770 bytes) 000665 1784122672.461290 mapwrite 0x01dfe7 thru 0x0200d9 (0x20f3 bytes) 000666 1784122672.478068 write 0x005ce6 thru 0x007d85 (0x20a0 bytes) 000667 1784122672.485219 punch from 0x024909 to 0x02de46 (0x953e bytes) 000668 1784122672.496390 mapwrite 0x012fbb thru 0x018087 (0x50cd bytes) 000669 1784122672.531570 trunc from 0x039697 to 0x03cd79 (0x36e3 bytes) 000670 1784122672.537427 read 0x010bfc thru 0x02083e (0xfc43 bytes) 000671 1784122672.539237 trunc from 0x03cd7a to 0x0162c6 (0x26ab3 bytes) 000672 1784122672.562008 read 0x00eea3 thru 0x00f7e3 (0x941 bytes) 000673 1784122672.563274 mapread 0x00d99c thru 0x0162c6 (0x892b bytes) 000675 1784122672.564949 trunc from 0x0093c7 to 0x0162c6 (0xcf00 bytes) 000677 1784122672.575942 punch from 0x00fb0d to 0x0162c6 (0x67ba bytes) 000678 1784122672.580595 fallocate 0x0145c9 thru 0x0157a7 (0x11df bytes) 000679 1784122672.586110 punch from 0x004050 to 0x005591 (0x1542 bytes) 000680 1784122672.592991 read 0x0087e0 thru 0x00c5c7 (0x3de8 bytes) 000681 1784122672.602068 punch from 0x0096c7 to 0x00e983 (0x52bd bytes) 000682 1784122672.612851 write 0x00b978 thru 0x019015 (0xd69e bytes) 000683 1784122672.621711 MIRROR_RESYNC 7 mirrors 000684 1784122673.586377 write 0x039baa thru 0x03e5b6 (0x4a0d bytes) 000685 1784122673.617398 mapwrite 0x008910 thru 0x00fe86 (0x7577 bytes) 000686 1784122673.652909 punch from 0x014921 to 0x01985b (0x4f3b bytes) 000687 1784122673.660901 mapread 0x036fcb thru 0x03e5b6 (0x75ec bytes) 000688 1784122673.668346 mapread 0x004c09 thru 0x009c03 (0x4ffb bytes) 000689 1784122673.670869 fallocate 0x010dc7 thru 0x016d2a (0x5f64 bytes) 000692 1784122673.676243 mapread 0x01016c thru 0x015298 (0x512d bytes) 000693 1784122673.683858 fallocate 0x015e74 thru 0x01a388 (0x4515 bytes) 000694 1784122673.687765 punch from 0x018395 to 0x01dc76 (0x58e2 bytes) 000695 1784122673.691228 trunc from 0x036406 to 0x03659d (0x198 bytes) 000696 1784122673.695403 write 0x03b8bb thru 0x03ffff (0x4745 bytes) 000697 1784122673.696612 fallocate 0x03d087 thru 0x03ffff (0x2f79 bytes) 000698 1784122673.700992 write 0x014bb9 thru 0x01d0b3 (0x84fb bytes) 000699 1784122673.706970 mapwrite 0x024b47 thru 0x032cd9 (0xe193 bytes) 000700 1784122673.739165 mapread 0x00bfa8 thru 0x0177b9 (0xb812 bytes) 000701 1784122673.740425 read 0x016ba4 thru 0x018df1 (0x224e bytes) 000702 1784122673.742262 trunc from 0x040000 to 0x02e37a (0x11c85 bytes) 000703 1784122673.762201 read 0x01bc87 thru 0x01c2be (0x638 bytes) 000705 1784122673.769013 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e37b): Mirror 11: 0xcfa277ae (stale) Mirror 12: 0xcfa277ae (stale) Mirror 15: 0xcfa277ae (stale) Mirror 17: 0xcfa277ae (stale) Mirror 18: 0xcfa277ae (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e37b): Mirror 11: 0xcfa277ae (stale) Mirror 12: 0xcfa277ae (stale) Mirror 15: 0xcfa277ae (stale) Mirror 17: 0xcfa277ae (stale) Mirror 18: 0xcfa277ae (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e37b: skipped 000707 1784122674.021642 trunc from 0x02e37b to 0x0182e6 (0x16094 bytes) 000708 1784122674.033590 read 0x001012 thru 0x00446f (0x345e bytes) 000709 1784122674.040241 mapwrite 0x0232fc thru 0x028e6d (0x5b72 bytes) 000710 1784122674.075619 punch from 0x018792 to 0x024c54 (0xc4c3 bytes) 000711 1784122674.081494 write 0x0302d0 thru 0x03dd03 (0xda34 bytes) 000712 1784122674.083378 mapread 0x036a1b thru 0x038f08 (0x24ee bytes) 000713 1784122674.084877 punch from 0x026e18 to 0x02df90 (0x7179 bytes) 000714 1784122674.090736 fallocate 0x023869 thru 0x02ca9b (0x9233 bytes) 000715 1784122674.094306 write 0x02607a thru 0x030c28 (0xabaf bytes) 000716 1784122674.099811 read 0x00a281 thru 0x010a86 (0x6806 bytes) 000717 1784122674.105093 read 0x01b3a3 thru 0x023811 (0x846f bytes) 000718 1784122674.105846 fallocate 0x013c72 thru 0x0186df (0x4a6e bytes) 000719 1784122674.109966 mapread 0x01e6a9 thru 0x028ad4 (0xa42c bytes) 000720 1784122674.111260 trunc from 0x03dd04 to 0x038348 (0x59bb bytes) 000721 1784122674.122907 punch from 0x0170b1 to 0x021dcd (0xad1d bytes) 000722 1784122674.127084 read 0x02a73d thru 0x030057 (0x591b bytes) 000723 1784122674.127763 fallocate 0x023959 thru 0x02b784 (0x7e2c bytes) 000724 1784122674.131576 mapwrite 0x00ae00 thru 0x00ec1a (0x3e1b bytes) 000725 1784122674.144018 write 0x023338 thru 0x02a777 (0x7440 bytes) 000726 1784122674.145275 fallocate 0x010cdb thru 0x01e0e1 (0xd407 bytes) 000728 1784122674.150258 fallocate 0x031ce9 thru 0x03ffff (0xe317 bytes) 000729 1784122674.153949 write 0x01eecf thru 0x029aa7 (0xabd9 bytes) 000730 1784122674.160808 trunc from 0x014097 to 0x023c00 (0xfb6a bytes) 000731 1784122674.169791 write 0x00f7f9 thru 0x012630 (0x2e38 bytes) 000732 1784122674.171603 trunc from 0x040000 to 0x02423f (0x1bdc0 bytes) 000733 1784122674.184558 MIRROR_RESYNC 6 mirrors 000734 1784122674.877512 trunc from 0x01c519 to 0x02423f (0x7d27 bytes) 000735 1784122674.901539 trunc from 0x004c46 to 0x014623 (0xf9de bytes) 000737 1784122674.905882 punch from 0x01e331 to 0x02423f (0x5f0f bytes) 000738 1784122674.912310 write 0x02566d thru 0x02db0d (0x84a1 bytes) 000739 1784122674.913968 read 0x0117eb thru 0x013277 (0x1a8d bytes) 000740 1784122674.917542 write 0x01c1fc thru 0x027890 (0xb695 bytes) 000741 1784122674.921397 fallocate 0x02dc09 thru 0x0379ba (0x9db2 bytes) 000742 1784122674.925746 trunc from 0x0379bb to 0x03444d (0x356d bytes) 000743 1784122674.952232 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3444e): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3444e): Mirror 11: 0x6bf6860a (stale) Mirror 12: 0x6bf6860a (stale) Mirror 15: 0x6bf6860a (stale) Mirror 17: 0x6bf6860a (stale) Mirror 18: 0x6bf6860a (stale) CRC-32 checksum value for chunk [0, 0x3444e): Mirror 1: 0x24a2dc13 Mirror 19: 0x24a2dc13 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3444e: skipped 000744 1784122675.476387 mapread 0x00753e thru 0x00b2a8 (0x3d6b bytes) 000745 1784122675.498433 trunc from 0x03444e to 0x027ed6 (0xc577 bytes) 000746 1784122675.519243 punch from 0x0203c2 to 0x027ed6 (0x7b15 bytes) 000747 1784122675.522014 fallocate 0x00880f thru 0x00d0cd (0x48bf bytes) 000748 1784122675.525361 mapwrite 0x013fd7 thru 0x0225bd (0xe5e7 bytes) 000749 1784122675.549476 write 0x03bb29 thru 0x03ffff (0x44d7 bytes) 000750 1784122675.550703 write 0x027405 thru 0x02bbfa (0x47f6 bytes) 000751 1784122675.557311 write 0x009f42 thru 0x014922 (0xa9e1 bytes) 000752 1784122675.562091 punch from 0x023bb2 to 0x024303 (0x752 bytes) 000753 1784122675.565461 trunc from 0x040000 to 0x036e28 (0x91d7 bytes) 000754 1784122675.578409 trunc from 0x036e29 to 0x02a829 (0xc5ff bytes) 000755 1784122675.586023 mapread 0x010b6e thru 0x017ae0 (0x6f73 bytes) 000756 1784122675.587024 trunc from 0x02a82a to 0x00f8fa (0x1af2f bytes) 000757 1784122675.602919 write 0x01877f thru 0x026252 (0xdad4 bytes) 000758 1784122675.604505 read 0x010897 thru 0x012952 (0x20bc bytes) 000759 1784122675.609138 punch from 0x0235b4 to 0x026252 (0x2c9f bytes) 000760 1784122675.623456 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x26253): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26253): Mirror 11: 0xc0e4e643 (stale) Mirror 12: 0xc0e4e643 (stale) Mirror 15: 0xc0e4e643 (stale) Mirror 17: 0xc0e4e643 (stale) Mirror 18: 0xc0e4e643 (stale) Mirror 19: 0x29f5c90e (stale) CRC-32 checksum value for chunk [0, 0x26253): Mirror 1: 0x7c873413 Mirror 20: 0x7c873413 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26253: skipped 000762 1784122676.082818 fallocate 0x02aaae thru 0x032cb5 (0x8208 bytes) 000763 1784122676.101612 write 0x03f80d thru 0x03ffff (0x7f3 bytes) 000765 1784122676.105460 trunc from 0x040000 to 0x00ab9f (0x35460 bytes) 000766 1784122676.136211 write 0x03a5a8 thru 0x03ffff (0x5a58 bytes) 000767 1784122676.137657 fallocate 0x038596 thru 0x03a35e (0x1dc9 bytes) 000768 1784122676.141806 write 0x004fb8 thru 0x013f1b (0xef64 bytes) 000769 1784122676.154853 MIRROR_RESYNC 8 mirrors 000770 1784122676.953685 trunc from 0x027d91 to 0x030743 (0x89b3 bytes) 000771 1784122676.970011 trunc from 0x040000 to 0x01881f (0x277e0 bytes) 000772 1784122676.983425 read 0x018127 thru 0x01881f (0x6f9 bytes) 000773 1784122676.987063 trunc from 0x018820 to 0x022251 (0x9a32 bytes) 000774 1784122676.995567 trunc from 0x022252 to 0x02bc5d (0x9a0c bytes) 000775 1784122677.004829 fallocate 0x01c276 thru 0x027a26 (0xb7b1 bytes) 000776 1784122677.008781 mapread 0x00dafa thru 0x013d21 (0x6228 bytes) 000777 1784122677.029451 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2bc5e): Mirror 12: 0x3ff86672 (stale) Mirror 15: 0x3ff86672 (stale) Mirror 17: 0x3ff86672 (stale) Mirror 18: 0x3ff86672 (stale) Mirror 19: 0x3ff86672 (stale) Mirror 20: 0x3ff86672 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bc5e): Mirror 12: 0x3ff86672 (stale) Mirror 15: 0x3ff86672 (stale) Mirror 17: 0x3ff86672 (stale) Mirror 18: 0x3ff86672 (stale) Mirror 19: 0x3ff86672 (stale) Mirror 20: 0x3ff86672 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bc5e: skipped 000778 1784122677.260029 mapwrite 0x0010ff thru 0x00ef7c (0xde7e bytes) 000779 1784122677.285435 punch from 0x0103fd to 0x011d2d (0x1931 bytes) 000780 1784122677.288123 mapwrite 0x00e8d2 thru 0x014d84 (0x64b3 bytes) 000781 1784122677.303050 trunc from 0x02bc5e to 0x039c08 (0xdfab bytes) 000782 1784122677.314454 write 0x00e7a5 thru 0x01e04f (0xf8ab bytes) 000783 1784122677.318700 write 0x0204f9 thru 0x0225c9 (0x20d1 bytes) 000784 1784122677.325889 punch from 0x010f31 to 0x011746 (0x816 bytes) 000785 1784122677.332992 mapread 0x02189e thru 0x02c8e9 (0xb04c bytes) 000786 1784122677.345372 mapwrite 0x011733 thru 0x0183c8 (0x6c96 bytes) 000787 1784122677.361968 mapread 0x00a336 thru 0x00ba16 (0x16e1 bytes) 000788 1784122677.362908 trunc from 0x039c09 to 0x001004 (0x38c04 bytes) 000789 1784122677.374596 write 0x00ca44 thru 0x0156d2 (0x8c8f bytes) 000790 1784122677.378761 punch from 0x0023a2 to 0x00d512 (0xb171 bytes) 000791 1784122677.392425 punch from 0x00d854 to 0x0137eb (0x5f98 bytes) 000792 1784122677.397174 mapread 0x009b0f thru 0x00a223 (0x715 bytes) 000793 1784122677.405690 write 0x0214a3 thru 0x02d655 (0xc1b3 bytes) 000794 1784122677.407544 punch from 0x011471 to 0x01a4a5 (0x9035 bytes) 000795 1784122677.411337 read 0x00c30d thru 0x01221d (0x5f11 bytes) 000796 1784122677.415740 punch from 0x025624 to 0x026b58 (0x1535 bytes) 000797 1784122677.423746 mapwrite 0x0323ec thru 0x03c9d9 (0xa5ee bytes) 000798 1784122677.458759 MIRROR_SPLIT mirror 3 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c9da): Mirror 12: 0x356c5ce5 (stale) Mirror 15: 0x356c5ce5 (stale) Mirror 18: 0x356c5ce5 (stale) Mirror 19: 0x356c5ce5 (stale) Mirror 20: 0x356c5ce5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c9da): Mirror 12: 0x356c5ce5 (stale) Mirror 15: 0x356c5ce5 (stale) Mirror 18: 0x356c5ce5 (stale) Mirror 19: 0x356c5ce5 (stale) Mirror 20: 0x356c5ce5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c9da: skipped 000799 1784122677.646943 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c9da): Mirror 12: 0x356c5ce5 (stale) Mirror 15: 0x356c5ce5 (stale) Mirror 19: 0x356c5ce5 (stale) Mirror 20: 0x356c5ce5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c9da): Mirror 12: 0x356c5ce5 (stale) Mirror 15: 0x356c5ce5 (stale) Mirror 19: 0x356c5ce5 (stale) Mirror 20: 0x356c5ce5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c9da: skipped 000800 1784122677.798724 punch from 0x02703d to 0x031af9 (0xaabd bytes) 000802 1784122677.806076 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3c9da): Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c9da): Mirror 12: 0x356c5ce5 (stale) Mirror 15: 0x356c5ce5 (stale) Mirror 19: 0x356c5ce5 (stale) Mirror 20: 0x356c5ce5 (stale) CRC-32 checksum value for chunk [0, 0x3c9da): Mirror 1: 0x91ee9e7e Mirror 21: 0x91ee9e7e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c9da: skipped 000803 1784122678.202596 mapwrite 0x02e4fc thru 0x0327f6 (0x42fb bytes) 000804 1784122678.256393 mapwrite 0x01dedc thru 0x026fdd (0x9102 bytes) 000806 1784122678.272292 trunc from 0x03c9da to 0x01931f (0x236ba bytes) 000808 1784122678.294728 write 0x02e41b thru 0x03816d (0x9d53 bytes) 000809 1784122678.296267 mapread 0x019f98 thru 0x027a0f (0xda78 bytes) 000810 1784122678.315175 MIRROR_RESYNC 6 mirrors 000811 1784122678.966099 fallocate 0x026b8a thru 0x035fda (0xf451 bytes) 000812 1784122678.989861 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3816e): Mirror 15: 0xd3be4fa (stale) Mirror 19: 0xd3be4fa (stale) Mirror 20: 0xd3be4fa (stale) Mirror 21: 0xd3be4fa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3816e): Mirror 15: 0xd3be4fa (stale) Mirror 19: 0xd3be4fa (stale) Mirror 20: 0xd3be4fa (stale) Mirror 21: 0xd3be4fa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3816e: skipped 000813 1784122679.190878 mapwrite 0x0176f7 thru 0x02647c (0xed86 bytes) 000814 1784122679.247402 mapwrite 0x0004f1 thru 0x005223 (0x4d33 bytes) 000815 1784122679.274755 fallocate 0x0303d4 thru 0x03c570 (0xc19d bytes) 000816 1784122679.279771 punch from 0x014680 to 0x017aa0 (0x3421 bytes) 000817 1784122679.284361 mapread 0x00d9b5 thru 0x0165ad (0x8bf9 bytes) 000818 1784122679.293375 trunc from 0x00442f to 0x00f899 (0xb46b bytes) 000819 1784122679.299930 mapwrite 0x015b3a thru 0x0247d2 (0xec99 bytes) 000820 1784122679.319439 punch from 0x02f2af to 0x02f4c8 (0x21a bytes) 000821 1784122679.323240 fallocate 0x029c18 thru 0x0385e9 (0xe9d2 bytes) 000822 1784122679.328987 mapwrite 0x02ee4c thru 0x03b9a7 (0xcb5c bytes) 000823 1784122679.387071 fallocate 0x02e009 thru 0x033259 (0x5251 bytes) 000824 1784122679.390110 mapwrite 0x034a8d thru 0x03dfcf (0x9543 bytes) 000825 1784122679.415261 trunc from 0x03dfd0 to 0x003307 (0x3acc8 bytes) 000826 1784122679.422540 mapread 0x0031db thru 0x003307 (0x12d bytes) 000827 1784122679.423476 write 0x0063b1 thru 0x0085ec (0x223c bytes) 000828 1784122679.424554 write 0x035838 thru 0x03b1d7 (0x59a0 bytes) 000830 1784122679.426346 trunc from 0x03b1d8 to 0x01ad26 (0x204b1 bytes) 000831 1784122679.435560 mapwrite 0x039e7d thru 0x03ffff (0x6183 bytes) 000832 1784122679.466725 trunc from 0x040000 to 0x03b628 (0x49d7 bytes) 000834 1784122679.477950 fallocate 0x02b4d8 thru 0x0321b0 (0x6cd9 bytes) 000835 1784122679.483029 mapread 0x01695d thru 0x016c7b (0x31f bytes) 000836 1784122679.489846 fallocate 0x021703 thru 0x02566d (0x3f6b bytes) 000837 1784122679.493989 trunc from 0x03b629 to 0x018805 (0x22e23 bytes) 000838 1784122679.502065 mapread 0x008362 thru 0x0151ff (0xce9e bytes) 000839 1784122679.507916 punch from 0x00141d to 0x00691d (0x5501 bytes) 000840 1784122679.511230 mapread 0x016d9c thru 0x018805 (0x1a6a bytes) 000841 1784122679.512201 fallocate 0x0147c0 thru 0x01a558 (0x5d99 bytes) 000842 1784122679.515801 read 0x00f99b thru 0x018b2e (0x9194 bytes) 000843 1784122679.516461 trunc from 0x01a559 to 0x029b1d (0xf5c5 bytes) 000844 1784122679.527090 mapread 0x023b35 thru 0x026bee (0x30ba bytes) 000846 1784122679.532957 read 0x01bdbc thru 0x01eb0e (0x2d53 bytes) 000847 1784122679.540383 read 0x0246a8 thru 0x02995f (0x52b8 bytes) 000848 1784122679.541075 write 0x0357ba thru 0x03ffff (0xa846 bytes) 000849 1784122679.542593 read 0x00b1f8 thru 0x00e765 (0x356e bytes) 000850 1784122679.545616 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 15: 0xd7df9879 (stale) Mirror 19: 0xd7df9879 (stale) Mirror 20: 0xd7df9879 (stale) Mirror 21: 0xd7df9879 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3e5057da Mirror 22: 0x3e5057da lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000852 1784122680.014217 read 0x037907 thru 0x03ffff (0x86f9 bytes) 000853 1784122680.022053 read 0x0213aa thru 0x02236b (0xfc2 bytes) 000855 1784122680.033137 mapwrite 0x024169 thru 0x024a34 (0x8cc bytes) 000856 1784122680.079091 read 0x028db2 thru 0x0380a4 (0xf2f3 bytes) 000857 1784122680.087885 write 0x01cbea thru 0x02088e (0x3ca5 bytes) 000859 1784122680.094621 read 0x0170b1 thru 0x0218bd (0xa80d bytes) 000860 1784122680.095335 read 0x00b126 thru 0x00c6c4 (0x159f bytes) 000861 1784122680.098530 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0xd7df9879 (stale) Mirror 20: 0xd7df9879 (stale) Mirror 21: 0xd7df9879 (stale) Mirror 22: 0x3e5057da (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 19: 0xd7df9879 (stale) Mirror 20: 0xd7df9879 (stale) Mirror 21: 0xd7df9879 (stale) Mirror 22: 0x3e5057da (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000863 1784122680.281053 write 0x028ed5 thru 0x034ef7 (0xc023 bytes) 000865 1784122680.290244 punch from 0x020312 to 0x028d95 (0x8a84 bytes) 000866 1784122680.298763 trunc from 0x040000 to 0x03e25e (0x1da1 bytes) 000867 1784122680.316049 fallocate 0x01b3c7 thru 0x02a9f8 (0xf632 bytes) 000868 1784122680.320139 trunc from 0x03e25f to 0x01109e (0x2d1c0 bytes) 000869 1784122680.329889 trunc from 0x01109f to 0x0386eb (0x2764d bytes) 000870 1784122680.338215 read 0x02a96c thru 0x0339c5 (0x905a bytes) 000871 1784122680.344128 write 0x024212 thru 0x02579d (0x158c bytes) 000872 1784122680.357724 mapread 0x01f0d9 thru 0x02baf2 (0xca1a bytes) 000873 1784122680.371989 trunc from 0x032af1 to 0x0386eb (0x5bfb bytes) 000874 1784122680.383855 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x386ec): Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x386ec): Mirror 19: 0xb6012b3a (stale) Mirror 20: 0xb6012b3a (stale) Mirror 21: 0xb6012b3a (stale) Mirror 22: 0xfa39412b (stale) CRC-32 checksum value for chunk [0, 0x386ec): Mirror 1: 0x4c35f1ad Mirror 23: 0x4c35f1ad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x386ec: skipped 000875 1784122680.816917 read 0x000a23 thru 0x00b7cb (0xada9 bytes) 000876 1784122680.830971 read 0x006030 thru 0x01240f (0xc3e0 bytes) 000877 1784122680.843859 write 0x034427 thru 0x03cb4a (0x8724 bytes) 000878 1784122680.875027 trunc from 0x03cb4b to 0x024593 (0x185b7 bytes) 000879 1784122680.900331 trunc from 0x022f46 to 0x024593 (0x164e bytes) 000880 1784122680.903917 write 0x010da3 thru 0x0136a8 (0x2906 bytes) 000881 1784122680.917114 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24594): Mirror 20: 0x635d56dc (stale) Mirror 21: 0x635d56dc (stale) Mirror 22: 0x1993a6c3 (stale) Mirror 23: 0x32656e6b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24594): Mirror 20: 0x635d56dc (stale) Mirror 21: 0x635d56dc (stale) Mirror 22: 0x1993a6c3 (stale) Mirror 23: 0x32656e6b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24594: skipped 000882 1784122681.092420 write 0x03f273 thru 0x03ffff (0xd8d bytes) 000883 1784122681.096085 mapwrite 0x006702 thru 0x00ed7f (0x867e bytes) 000884 1784122681.122516 fallocate 0x01e4e4 thru 0x025649 (0x7166 bytes) 000885 1784122681.133596 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: 0xd7df9879 (stale) Mirror 21: 0xd7df9879 (stale) Mirror 22: 0x3e5057da (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 20: 0xd7df9879 (stale) Mirror 21: 0xd7df9879 (stale) Mirror 22: 0x3e5057da (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000886 1784122681.309336 mapwrite 0x03b63c thru 0x03ffff (0x49c4 bytes) 000887 1784122681.334746 read 0x025e32 thru 0x031f3f (0xc10e bytes) 000888 1784122681.345593 mapwrite 0x0295ef thru 0x02c05d (0x2a6f bytes) 000889 1784122681.356552 write 0x027525 thru 0x02bfbb (0x4a97 bytes) 000890 1784122681.361543 punch from 0x03cab1 to 0x03ffff (0x354f bytes) 000891 1784122681.367192 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 21: 0xd7df9879 (stale) Mirror 22: 0x3e5057da (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 21: 0xd7df9879 (stale) Mirror 22: 0x3e5057da (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000892 1784122681.513535 mapread 0x01d874 thru 0x01f1fb (0x1988 bytes) 000893 1784122681.525392 trunc from 0x022afb to 0x024a83 (0x1f89 bytes) 000894 1784122681.530524 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 21: 0xd7df9879 (stale) Mirror 22: 0x3e5057da (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc8904d03 Mirror 23: 0xc8904d03 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000895 1784122681.962016 read 0x02c64e thru 0x036ad6 (0xa489 bytes) 000896 1784122681.970223 trunc from 0x006b02 to 0x00a79f (0x3c9e bytes) 000897 1784122681.986462 punch from 0x022aa3 to 0x0249f9 (0x1f57 bytes) 000898 1784122681.989409 write 0x013953 thru 0x01ccb6 (0x9364 bytes) 000899 1784122681.996499 mapwrite 0x031238 thru 0x038f89 (0x7d52 bytes) 000900 1784122682.017021 punch from 0x01b449 to 0x01fa2f (0x45e7 bytes) 000901 1784122682.021133 trunc from 0x0282a9 to 0x0328c5 (0xa61d bytes) 000902 1784122682.024054 trunc from 0x002ca3 to 0x01106c (0xe3ca bytes) 000903 1784122682.026885 mapwrite 0x01f14c thru 0x0273cb (0x8280 bytes) 000904 1784122682.041810 read 0x00b44c thru 0x01022e (0x4de3 bytes) 000905 1784122682.047822 mapread 0x00930b thru 0x00b10d (0x1e03 bytes) 000906 1784122682.048921 mapread 0x008071 thru 0x00aa70 (0x2a00 bytes) 000907 1784122682.049738 mapread 0x007c18 thru 0x00ac92 (0x307b bytes) 000908 1784122682.050693 punch from 0x01c589 to 0x0257aa (0x9222 bytes) 000909 1784122682.054442 read 0x01b4fa thru 0x01b7f5 (0x2fc bytes) 000910 1784122682.058059 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 21: 0xd7df9879 (stale) Mirror 23: 0xc8904d03 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 21: 0xd7df9879 (stale) Mirror 23: 0xc8904d03 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000911 1784122682.222865 punch from 0x037098 to 0x03adf8 (0x3d61 bytes) 000912 1784122682.227219 trunc from 0x040000 to 0x039787 (0x6878 bytes) 000914 1784122682.256196 fallocate 0x0297b5 thru 0x02dbe4 (0x4430 bytes) 000915 1784122682.263403 write 0x00ae0f thru 0x0179cd (0xcbbf bytes) 000916 1784122682.273574 write 0x035c88 thru 0x03ffff (0xa378 bytes) 000917 1784122682.283731 fallocate 0x00ba96 thru 0x00db0b (0x2076 bytes) 000918 1784122682.292224 trunc from 0x040000 to 0x01fba6 (0x20459 bytes) 000919 1784122682.309813 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1fba7): Mirror 21: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fba7): Mirror 21: 0xb88aa39b (stale) Mirror 23: 0x34e8f4ef (stale) CRC-32 checksum value for chunk [0, 0x1fba7): Mirror 1: 0x282de65f Mirror 24: 0x282de65f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fba7: skipped 000920 1784122682.753513 punch from 0x0056ad to 0x013cfa (0xe64e bytes) 000921 1784122682.774704 trunc from 0x01fba7 to 0x00ef1a (0x10c8c bytes) 000922 1784122682.804976 fallocate 0x007adf thru 0x008a08 (0xf2a bytes) 000924 1784122682.809824 fallocate 0x03852a thru 0x03ffff (0x7ad6 bytes) 000925 1784122682.814738 read 0x003e9d thru 0x009b8a (0x5cee bytes) 000926 1784122682.825550 fallocate 0x011a20 thru 0x01e7ca (0xcdab bytes) 000927 1784122682.829531 trunc from 0x00944a to 0x00dc63 (0x481a bytes) 000928 1784122682.832961 trunc from 0x036fd1 to 0x03c5ab (0x55db bytes) 000929 1784122682.836330 fallocate 0x03e90a thru 0x03ffff (0x16f6 bytes) 000930 1784122682.842867 trunc from 0x02a5d5 to 0x033007 (0x8a33 bytes) 000931 1784122682.848396 read 0x00f7b1 thru 0x0128c4 (0x3114 bytes) 000932 1784122682.856489 trunc from 0x03cc8e to 0x03ffff (0x3372 bytes) 000933 1784122682.860357 mapread 0x001d20 thru 0x00eecc (0xd1ad bytes) 000934 1784122682.861805 punch from 0x01410f to 0x0197f6 (0x56e8 bytes) 000935 1784122682.869946 trunc from 0x040000 to 0x01767b (0x28984 bytes) 000936 1784122682.883158 write 0x031487 thru 0x03be47 (0xa9c1 bytes) 000937 1784122682.884541 trunc from 0x03be48 to 0x02f04e (0xcdf9 bytes) 000938 1784122682.893700 read 0x004f6f thru 0x005e13 (0xea5 bytes) 000939 1784122682.894374 mapread 0x01d5c0 thru 0x02cc60 (0xf6a1 bytes) 000940 1784122682.908734 mapwrite 0x03d3fc thru 0x03ffff (0x2c04 bytes) 000941 1784122682.935709 trunc from 0x040000 to 0x0390b4 (0x6f4b bytes) 000942 1784122682.947065 fallocate 0x03172a thru 0x03e25c (0xcb33 bytes) 000943 1784122682.952937 punch from 0x027653 to 0x02e9d5 (0x7383 bytes) 000944 1784122682.958050 write 0x007494 thru 0x01378b (0xc2f8 bytes) 000945 1784122682.962438 MIRROR_RESYNC 4 mirrors 000946 1784122683.509097 read 0x034af8 thru 0x0390b4 (0x45bd bytes) 000947 1784122683.518897 MIRROR_RESYNC 4 mirrors 000948 1784122683.755996 punch from 0x02267f to 0x031b74 (0xf4f6 bytes) 000949 1784122683.780627 read 0x032e32 thru 0x0390b4 (0x6283 bytes) 000951 1784122683.789186 fallocate 0x034050 thru 0x03e9cc (0xa97d bytes) 000952 1784122683.793079 write 0x00b1f0 thru 0x00b713 (0x524 bytes) 000954 1784122683.797314 fallocate 0x0036d3 thru 0x0070dc (0x3a0a bytes) 000955 1784122683.802281 fallocate 0x03fe0d thru 0x03ffff (0x1f3 bytes) 000956 1784122683.805787 punch from 0x01fb2f to 0x02048c (0x95e bytes) 000957 1784122683.812337 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 21: 0xc1bc64ea (stale) Mirror 23: 0xc1bc64ea (stale) Mirror 24: 0xc1bc64ea (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6c8e52d9 Mirror 25: 0x6c8e52d9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000958 1784122684.187284 fallocate 0x01b3f4 thru 0x0232ef (0x7efc bytes) 000959 1784122684.214328 trunc from 0x01fde6 to 0x0222ce (0x24e9 bytes) 000960 1784122684.217836 read 0x0047a2 thru 0x007d0d (0x356c bytes) 000961 1784122684.221723 trunc from 0x0224b2 to 0x025c42 (0x3791 bytes) 000962 1784122684.228960 read 0x0216db thru 0x02f7eb (0xe111 bytes) 000963 1784122684.236196 punch from 0x034cbd to 0x03ffff (0xb343 bytes) 000965 1784122684.240378 trunc from 0x0041eb to 0x0045b0 (0x3c6 bytes) 000966 1784122684.243441 mapwrite 0x031865 thru 0x035559 (0x3cf5 bytes) 000967 1784122684.262512 read 0x034b7c thru 0x03b7c5 (0x6c4a bytes) 000968 1784122684.268756 mapwrite 0x014c19 thru 0x01dca3 (0x908b bytes) 000969 1784122684.282926 write 0x017cf6 thru 0x022bc3 (0xaece bytes) 000970 1784122684.289888 MIRROR_RESYNC 5 mirrors 000971 1784122684.985415 write 0x032c71 thru 0x034193 (0x1523 bytes) 000972 1784122685.010439 mapread 0x00d5a7 thru 0x00dff7 (0xa51 bytes) 000973 1784122685.013535 mapwrite 0x03d93c thru 0x03ffff (0x26c4 bytes) 000974 1784122685.026562 trunc from 0x030b9a to 0x033727 (0x2b8e bytes) 000975 1784122685.029382 punch from 0x01583f to 0x01e265 (0x8a27 bytes) 000977 1784122685.034900 punch from 0x00dfb6 to 0x011372 (0x33bd bytes) 000979 1784122685.043952 MIRROR_RESYNC 5 mirrors 000980 1784122685.826789 punch from 0x00e0bb to 0x018249 (0xa18f bytes) 000981 1784122685.865416 mapwrite 0x0089ce thru 0x014bc1 (0xc1f4 bytes) 000982 1784122685.904146 mapread 0x0159d5 thru 0x022493 (0xcabf bytes) 000983 1784122685.914828 trunc from 0x040000 to 0x01f768 (0x20897 bytes) 000984 1784122685.944885 fallocate 0x01157c thru 0x0120dd (0xb62 bytes) 000985 1784122685.948887 punch from 0x01b89c to 0x01f768 (0x3ecd bytes) 000986 1784122685.951999 read 0x0122d2 thru 0x01f406 (0xd135 bytes) 000987 1784122685.956792 read 0x005aaf thru 0x007708 (0x1c5a bytes) 000988 1784122685.957457 write 0x02f890 thru 0x036709 (0x6e7a bytes) 000990 1784122685.959139 read 0x00790f thru 0x0139d8 (0xc0ca bytes) 000992 1784122685.960188 write 0x01eb85 thru 0x0232af (0x472b bytes) 000993 1784122685.966629 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3670a): Mirror 23: 0x91ae6a3a (stale) Mirror 24: 0x91ae6a3a (stale) Mirror 25: 0x91ae6a3a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3670a): Mirror 23: 0x91ae6a3a (stale) Mirror 24: 0x91ae6a3a (stale) Mirror 25: 0x91ae6a3a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3670a: skipped 000994 1784122686.173973 read 0x021e84 thru 0x02aaa4 (0x8c21 bytes) 000995 1784122686.183881 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3670a): Mirror 23: 0x91ae6a3a (stale) Mirror 24: 0x91ae6a3a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3670a): Mirror 23: 0x91ae6a3a (stale) Mirror 24: 0x91ae6a3a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3670a: skipped 000996 1784122686.348609 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x55:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3670a): Mirror 24: 0x91ae6a3a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3670a): Mirror 24: 0x91ae6a3a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3670a: skipped 000997 1784122686.512554 trunc from 0x03670a to 0x034273 (0x2496 bytes) 000999 1784122686.525533 write 0x02ecab thru 0x03e5c6 (0xf91c bytes) 001000 1784122686.531467 punch from 0x021013 to 0x02f513 (0xe501 bytes) All operations completed A-OK!