== sanity-flr test 70a: flr mode fsx test ================ 19:19:34 (1788909574) Seed set to 9575 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x36867 000002 1788909575.224723 trunc from 00000000 to 0x036866 (0x36867 bytes) 000003 1788909575.236580 trunc from 0x036867 to 0x01365e (0x23208 bytes) 000005 1788909575.246543 read 0x010d6c thru 0x01365e (0x28f3 bytes) 000006 1788909575.250019 mapwrite 0x013470 thru 0x01e648 (0xb1d9 bytes) 000007 1788909575.299269 read 0x0026b3 thru 0x00a38a (0x7cd8 bytes) 000008 1788909575.307117 mapwrite 0x017cc6 thru 0x022eb8 (0xb1f3 bytes) 000009 1788909575.379015 write 0x03ded9 thru 0x03ffff (0x2127 bytes) 000010 1788909575.380078 mapwrite 0x0116af thru 0x014a30 (0x3382 bytes) 000014 1788909575.413555 mapread 0x0282e6 thru 0x02d7ef (0x550a bytes) 000017 1788909575.425182 trunc from 0x040000 to 0x010813 (0x2f7ec bytes) 000019 1788909575.439740 write 0x01eb5f thru 0x02d3c4 (0xe866 bytes) 000021 1788909575.442010 mapwrite 0x01e9c4 thru 0x01fc6e (0x12ab bytes) 000023 1788909575.488786 trunc from 0x02d3c5 to 0x0053cf (0x27ff5 bytes) 000024 1788909575.523300 read 0x004102 thru 0x0053cf (0x12ce bytes) 000025 1788909575.523935 read 0x001ce0 thru 0x003426 (0x1747 bytes) 000026 1788909575.528483 MIRROR_EXTEND to 2 mirrors 000027 1788909575.916204 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x303:0x0]: Invalid argument (22) 000029 1788909576.003658 read 0x004da9 thru 0x0053cf (0x627 bytes) 000030 1788909576.007769 mapwrite 0x03f2b3 thru 0x03ffff (0xd4d bytes) 000031 1788909576.088281 mapwrite 0x0345e5 thru 0x03fcca (0xb6e6 bytes) 000032 1788909576.152404 write 0x009861 thru 0x00e56a (0x4d0a bytes) 000034 1788909576.162499 trunc from 0x040000 to 0x022a42 (0x1d5bd bytes) 000036 1788909576.182349 trunc from 0x022a43 to 0x0327ba (0xfd78 bytes) 000039 1788909576.193938 trunc from 0x0327bb to 0x015b00 (0x1ccba bytes) 000040 1788909576.202532 write 0x032e8d thru 0x0398ad (0x6a21 bytes) 000043 1788909576.204808 mapwrite 0x025df4 thru 0x026363 (0x570 bytes) 000045 1788909576.250670 read 0x018b24 thru 0x01eebf (0x639c bytes) 000046 1788909576.259365 mapwrite 0x02e41b thru 0x03141a (0x3000 bytes) 000047 1788909576.300703 mapwrite 0x0383f1 thru 0x03f178 (0x6d88 bytes) 000049 1788909576.352485 write 0x033267 thru 0x03ffff (0xcd99 bytes) truncating to largest ever: 0x3ddc3 000050 1788909576.354450 trunc from 0x040000 to 0x03ddc2 (0x223d bytes) 000052 1788909576.369980 read 0x00d2b6 thru 0x015bbe (0x8909 bytes) 000053 1788909576.370558 mapread 0x008617 thru 0x009bf4 (0x15de bytes) 000056 1788909576.372063 write 0x03867c thru 0x03af1b (0x28a0 bytes) 000060 1788909576.376987 mapread 0x02b509 thru 0x0303a3 (0x4e9b bytes) 000062 1788909576.380970 trunc from 0x03ddc3 to 0x00ec59 (0x2f169 bytes) 000064 1788909576.393600 mapread 0x001c41 thru 0x006672 (0x4a32 bytes) 000065 1788909576.394941 read 0x00b8a6 thru 0x00ec59 (0x33b4 bytes) 000067 1788909576.395636 write 0x03486b thru 0x036568 (0x1cfe bytes) 000071 1788909576.398024 read 0x017148 thru 0x019332 (0x21eb bytes) 000072 1788909576.403412 mapread 0x032779 thru 0x036568 (0x3df0 bytes) 000073 1788909576.404062 read 0x0236dd thru 0x02403d (0x961 bytes) 000074 1788909576.407122 MIRROR_EXTEND to 2 mirrors 000075 1788909576.889529 mapwrite 0x01540c thru 0x01d14a (0x7d3f bytes) 000076 1788909576.981554 trunc from 0x036569 to 0x026db6 (0xf7b2 bytes) 000077 1788909577.009171 read 0x011ca5 thru 0x01993b (0x7c97 bytes) 000078 1788909577.009955 mapwrite 0x037817 thru 0x03ffff (0x87e9 bytes) 000079 1788909577.056178 read 0x01cca1 thru 0x021a65 (0x4dc5 bytes) 000080 1788909577.067586 mapwrite 0x02f7de thru 0x031bb8 (0x23db bytes) 000082 1788909577.114068 mapread 0x0218f5 thru 0x025266 (0x3972 bytes) 000083 1788909577.114964 trunc from 0x040000 to 0x020718 (0x1f8e7 bytes) 000086 1788909577.129808 mapwrite 0x03996a thru 0x03ffff (0x6696 bytes) 000088 1788909577.229201 trunc from 0x040000 to 0x006137 (0x39ec8 bytes) 000089 1788909577.240074 write 0x03bb95 thru 0x03db2d (0x1f99 bytes) 000090 1788909577.241169 mapwrite 0x00fc5a thru 0x00feb4 (0x25b bytes) 000091 1788909577.287856 MIRROR_RESYNC 2 mirrors 000092 1788909577.719467 read 0x0057dc thru 0x00b3f2 (0x5c17 bytes) 000093 1788909577.725383 mapwrite 0x03321a thru 0x035c1b (0x2a02 bytes) 000094 1788909577.817087 MIRROR_RESYNC 2 mirrors 000096 1788909578.255840 write 0x007048 thru 0x0147b1 (0xd76a bytes) 000097 1788909578.337563 write 0x00a05e thru 0x00d9f1 (0x3994 bytes) 000098 1788909578.338442 mapwrite 0x013393 thru 0x018172 (0x4de0 bytes) 000101 1788909578.415630 read 0x039e0a thru 0x03ba30 (0x1c27 bytes) 000102 1788909578.422332 mapread 0x01b7f6 thru 0x01d5df (0x1dea bytes) 000103 1788909578.424428 trunc from 0x03db2e to 0x00030b (0x3d822 bytes) 000105 1788909578.450156 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x30c): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30c): Mirror 2: 0xa34dc469 (stale) CRC-32 checksum value for chunk [0, 0x30c): Mirror 1: 0xa34dc469 Mirror 3: 0xa34dc469 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30c: skipped 000106 1788909578.926193 trunc from 0x00030c to 0x039d16 (0x39a0b bytes) 000108 1788909579.003691 read 0x02a28c thru 0x032a2b (0x87a0 bytes) 000109 1788909579.011741 mapwrite 0x00f05e thru 0x01814d (0x90f0 bytes) 000110 1788909579.059452 read 0x011b3d thru 0x012f4f (0x1413 bytes) 000111 1788909579.063400 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x303:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39d17): Mirror 3: 0x4d1dd1f5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39d17): Mirror 3: 0x4d1dd1f5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39d17: skipped 000115 1788909579.286882 trunc from 0x039d17 to 0x00b1bb (0x2eb5b bytes) 000117 1788909579.302872 mapread 0x0026c3 thru 0x00b1bb (0x8af9 bytes) 000118 1788909579.315792 mapread 0x005761 thru 0x00b1bb (0x5a5b bytes) 000125 1788909579.319442 read 0x006eaa thru 0x00b1bb (0x4312 bytes) 000126 1788909579.324178 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0xb1bc): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb1bc): Mirror 3: 0x22108f8 (stale) CRC-32 checksum value for chunk [0, 0xb1bc): Mirror 1: 0x22108f8 Mirror 4: 0x22108f8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb1bc: skipped 000127 1788909579.831905 write 0x000173 thru 0x002e6d (0x2cfb bytes) 000128 1788909579.876654 read 0x00a776 thru 0x00b1bb (0xa46 bytes) 000129 1788909579.882512 trunc from 0x00b1bc to 0x0090c8 (0x20f3 bytes) 000133 1788909579.925183 mapread 0x006e13 thru 0x008466 (0x1654 bytes) 000134 1788909579.947177 mapread 0x00206d thru 0x007a6a (0x59fe bytes) 000135 1788909579.948430 read 0x001bd7 thru 0x0057dd (0x3c07 bytes) 000136 1788909579.948987 write 0x00ac9e thru 0x01a364 (0xf6c7 bytes) 000137 1788909579.950871 write 0x0331a9 thru 0x0366c8 (0x3520 bytes) 000138 1788909579.951871 trunc from 0x0366c9 to 0x0169c5 (0x1fd03 bytes) 000139 1788909579.966193 read 0x0013b7 thru 0x00ded1 (0xcb1b bytes) 000140 1788909579.969290 MIRROR_RESYNC 3 mirrors 000141 1788909580.484493 trunc from 0x0169c6 to 0x03c699 (0x25cd4 bytes) 000143 1788909580.542774 trunc from 0x03c69a to 0x03595b (0x6d3e bytes) 000144 1788909580.556137 trunc from 0x03595c to 0x0331f9 (0x2762 bytes) 000145 1788909580.568830 read 0x03000b thru 0x0331f9 (0x31ef bytes) 000146 1788909580.573995 write 0x017952 thru 0x0234c5 (0xbb74 bytes) 000149 1788909580.583684 trunc from 0x0331fa to 0x031359 (0x1ea0 bytes) 000152 1788909580.602009 MIRROR_RESYNC 3 mirrors 000153 1788909581.091860 mapwrite 0x022543 thru 0x027e49 (0x5907 bytes) 000155 1788909581.213866 trunc from 0x03135a to 0x03bb7b (0xa822 bytes) 000156 1788909581.240279 mapread 0x007718 thru 0x00ee21 (0x770a bytes) 000159 1788909581.246815 write 0x030ea6 thru 0x03d85e (0xc9b9 bytes) 000160 1788909581.255502 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x303:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d85f): Mirror 4: 0xe4c5b212 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d85f): Mirror 4: 0xe4c5b212 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d85f: skipped 000161 1788909581.505625 trunc from 0x03d85f to 0x01f5ce (0x1e290 bytes) 000162 1788909581.516182 mapwrite 0x024f3b thru 0x029f82 (0x5048 bytes) 000163 1788909581.583569 read 0x0249ba thru 0x025098 (0x6df bytes) 000168 1788909581.594095 MIRROR_RESYNC 2 mirrors 000169 1788909581.979140 mapwrite 0x01623c thru 0x017ecb (0x1c90 bytes) 000172 1788909582.093655 mapwrite 0x033453 thru 0x03ffff (0xcbad bytes) 000173 1788909582.219278 read 0x01c5b8 thru 0x025880 (0x92c9 bytes) 000174 1788909582.232538 write 0x02fb34 thru 0x0378cd (0x7d9a bytes) 000176 1788909582.235308 mapwrite 0x01ab06 thru 0x026ad8 (0xbfd3 bytes) 000177 1788909582.292979 read 0x03e89c thru 0x03ffff (0x1764 bytes) 000179 1788909582.301037 mapread 0x02bf1c thru 0x02e0b1 (0x2196 bytes) 000183 1788909582.304044 trunc from 0x040000 to 0x02bfc4 (0x1403b bytes) 000184 1788909582.315384 write 0x0046b9 thru 0x00e154 (0x9a9c bytes) 000186 1788909582.324742 trunc from 0x02bfc5 to 0x02f420 (0x345c bytes) 000187 1788909582.340120 mapread 0x026eec thru 0x02b82b (0x4940 bytes) 000188 1788909582.341197 trunc from 0x02f421 to 0x02629d (0x9183 bytes) 000190 1788909582.353605 read 0x00972a thru 0x018fe8 (0xf8bf bytes) 000191 1788909582.354405 trunc from 0x02629e to 0x0352ea (0xf04d bytes) 000193 1788909582.365287 write 0x007839 thru 0x0113eb (0x9bb3 bytes) 000195 1788909582.372792 MIRROR_RESYNC 2 mirrors 000196 1788909582.757324 read 0x009116 thru 0x010c2e (0x7b19 bytes) 000197 1788909582.764008 write 0x0379ae thru 0x03cba9 (0x51fc bytes) 000198 1788909582.811420 read 0x02ba87 thru 0x030f26 (0x54a0 bytes) 000199 1788909582.820117 mapread 0x0025f0 thru 0x00a6fc (0x810d bytes) 000200 1788909582.821880 trunc from 0x03cbaa to 0x01f280 (0x1d929 bytes) 000201 1788909582.862621 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x303:0x0]: Invalid argument (22) 000202 1788909582.996821 mapread 0x01d503 thru 0x01f280 (0x1d7e bytes) 000203 1788909583.014254 write 0x00d347 thru 0x0110cd (0x3d87 bytes) 000205 1788909583.030299 write 0x00982e thru 0x00fa8a (0x625d bytes) 000207 1788909583.037450 write 0x000be7 thru 0x00ee86 (0xe2a0 bytes) 000208 1788909583.041937 write 0x00b6ed thru 0x0178f2 (0xc206 bytes) 000209 1788909583.043268 write 0x002251 thru 0x01023b (0xdfeb bytes) 000210 1788909583.044589 write 0x033881 thru 0x0395e8 (0x5d68 bytes) 000214 1788909583.050278 read 0x01f27b thru 0x02413a (0x4ec0 bytes) 000216 1788909583.055994 mapread 0x02b8fa thru 0x0362af (0xa9b6 bytes) 000218 1788909583.066415 MIRROR_EXTEND to 2 mirrors 000219 1788909583.642063 MIRROR_EXTEND to 3 mirrors 000220 1788909584.179946 write 0x00760e thru 0x009dbe (0x27b1 bytes) 000222 1788909584.247750 write 0x020793 thru 0x02ac41 (0xa4af bytes) 000223 1788909584.259434 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x395e9): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x395e9): Mirror 2: 0xda74be51 (stale) Mirror 3: 0xda74be51 (stale) CRC-32 checksum value for chunk [0, 0x395e9): Mirror 1: 0x95283f1f Mirror 4: 0x95283f1f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x395e9: skipped 000226 1788909584.912513 write 0x001bda thru 0x00d4e2 (0xb909 bytes) 000227 1788909584.976818 mapread 0x02cfcf thru 0x037b04 (0xab36 bytes) 000228 1788909585.003409 trunc from 0x0395e9 to 0x021a03 (0x17be5 bytes) 000230 1788909585.029707 read 0x01c6c5 thru 0x01fe6f (0x37ab bytes) 000231 1788909585.038352 mapwrite 0x0306eb thru 0x03e7e1 (0xe0f7 bytes) 000232 1788909585.153204 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3e7e2): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e7e2): Mirror 2: 0xa787c837 (stale) Mirror 3: 0xa787c837 (stale) Mirror 4: 0x1790e147 (stale) CRC-32 checksum value for chunk [0, 0x3e7e2): Mirror 1: 0x638a0bf5 Mirror 5: 0x638a0bf5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e7e2: skipped 000235 1788909585.800091 read 0x02e17a thru 0x03b48a (0xd311 bytes) 000236 1788909585.811100 read 0x010818 thru 0x0114ba (0xca3 bytes) 000238 1788909585.831485 write 0x017e6e thru 0x020b2a (0x8cbd bytes) 000242 1788909585.899389 read 0x014bfd thru 0x01e02b (0x942f bytes) 000243 1788909585.914745 write 0x007144 thru 0x00dccb (0x6b88 bytes) 000244 1788909585.915647 trunc from 0x03e7e2 to 0x02ff1c (0xe8c5 bytes) 000247 1788909585.957826 write 0x03e7c6 thru 0x03ffff (0x183a bytes) 000248 1788909585.959206 mapread 0x0371cc thru 0x03a37d (0x31b2 bytes) 000249 1788909585.991836 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x14d0a93e (stale) Mirror 3: 0x14d0a93e (stale) Mirror 4: 0x7da58a8e (stale) Mirror 5: 0x763c1904 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xfd9ba40e Mirror 6: 0xfd9ba40e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000250 1788909586.718772 write 0x0003ce thru 0x00377a (0x33ad bytes) 000253 1788909586.761591 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x14d0a93e (stale) Mirror 3: 0x14d0a93e (stale) Mirror 4: 0x7da58a8e (stale) Mirror 5: 0x763c1904 (stale) Mirror 6: 0xfd9ba40e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x5d98c391 Mirror 7: 0x5d98c391 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000256 1788909587.435682 mapread 0x026878 thru 0x034b10 (0xe299 bytes) 000257 1788909587.467004 write 0x034a43 thru 0x03eb68 (0xa126 bytes) 000259 1788909587.539210 write 0x03b483 thru 0x03b544 (0xc2 bytes) 000260 1788909587.539876 mapwrite 0x0284d1 thru 0x02d726 (0x5256 bytes) 000261 1788909587.580441 mapread 0x032fc1 thru 0x03e3f8 (0xb438 bytes) 000262 1788909587.587923 mapwrite 0x027d48 thru 0x033980 (0xbc39 bytes) 000264 1788909587.639078 MIRROR_RESYNC 7 mirrors 000265 1788909588.444847 trunc from 0x040000 to 0x01d8d6 (0x22729 bytes) 000266 1788909588.498057 write 0x01f995 thru 0x025f30 (0x659c bytes) 000269 1788909588.500701 trunc from 0x025f31 to 0x02e7cb (0x889b bytes) 000271 1788909588.521529 mapwrite 0x014de4 thru 0x02399d (0xebba bytes) 000272 1788909588.583937 mapread 0x01bd69 thru 0x02af8e (0xf226 bytes) 000273 1788909588.592355 trunc from 0x02e7cc to 0x03a845 (0xc07a bytes) 000274 1788909588.606313 write 0x01c3de thru 0x022143 (0x5d66 bytes) 000277 1788909588.608476 write 0x019ceb thru 0x028931 (0xec47 bytes) 000278 1788909588.611187 write 0x004e21 thru 0x0138aa (0xea8a bytes) 000279 1788909588.622493 mapwrite 0x02eaf9 thru 0x02f494 (0x99c bytes) 000282 1788909588.669754 mapread 0x00de25 thru 0x01a9b3 (0xcb8f bytes) 000283 1788909588.671090 write 0x024d58 thru 0x0297f5 (0x4a9e bytes) 000286 1788909588.676293 trunc from 0x03a846 to 0x03024a (0xa5fb bytes) 000288 1788909588.692073 read 0x02ca95 thru 0x02eba4 (0x2110 bytes) 000289 1788909588.692701 trunc from 0x03024b to 0x01fecc (0x1037e bytes) 000291 1788909588.710657 write 0x00553f thru 0x00fbd6 (0xa698 bytes) 000292 1788909588.711980 mapread 0x003a26 thru 0x00d270 (0x984b bytes) 000298 1788909588.730890 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x303:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1fecd): Mirror 2: 0x65217562 (stale) Mirror 4: 0x65217562 (stale) Mirror 5: 0x65217562 (stale) Mirror 6: 0x65217562 (stale) Mirror 7: 0x65217562 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fecd): Mirror 2: 0x65217562 (stale) Mirror 4: 0x65217562 (stale) Mirror 5: 0x65217562 (stale) Mirror 6: 0x65217562 (stale) Mirror 7: 0x65217562 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fecd: skipped 000300 1788909589.041772 trunc from 0x01fecd to 0x0190e4 (0x6de8 bytes) 000301 1788909589.062744 write 0x00e009 thru 0x01d4bf (0xf4b7 bytes) 000302 1788909589.069488 write 0x0252dd thru 0x02939d (0x40c1 bytes) 000304 1788909589.072662 mapwrite 0x0026d3 thru 0x010fc0 (0xe8ee bytes) 000305 1788909589.134736 write 0x033b6b thru 0x03a398 (0x682e bytes) 000306 1788909589.135891 trunc from 0x03a399 to 0x0079c2 (0x329d6 bytes) 000307 1788909589.151155 trunc from 0x0079c3 to 0x01df8b (0x165c9 bytes) 000311 1788909589.170901 mapread 0x0015f1 thru 0x007e31 (0x6841 bytes) 000312 1788909589.171715 mapread 0x0039cf thru 0x009a1d (0x604f bytes) 000315 1788909589.179751 trunc from 0x01df8c to 0x03d881 (0x1f8f6 bytes) 000318 1788909589.190307 write 0x016385 thru 0x01a816 (0x4492 bytes) 000320 1788909589.198536 mapread 0x01947a thru 0x025aa9 (0xc630 bytes) 000321 1788909589.216528 read 0x02fb1f thru 0x0385c8 (0x8aaa bytes) 000322 1788909589.228423 write 0x021262 thru 0x02a92a (0x96c9 bytes) 000323 1788909589.231533 mapwrite 0x037c99 thru 0x03fcb5 (0x801d bytes) 000325 1788909589.303872 write 0x03f7b0 thru 0x03ffff (0x850 bytes) 000326 1788909589.305073 write 0x00faff thru 0x017462 (0x7964 bytes) 000327 1788909589.308207 mapread 0x035e98 thru 0x03d281 (0x73ea bytes) 000329 1788909589.310527 mapwrite 0x019828 thru 0x01ca9e (0x3277 bytes) 000330 1788909589.357771 mapwrite 0x01bd25 thru 0x02aa21 (0xecfd bytes) 000332 1788909589.403138 write 0x00d663 thru 0x012208 (0x4ba6 bytes) 000334 1788909589.404941 mapread 0x02f3a1 thru 0x033d4d (0x49ad bytes) 000335 1788909589.407450 mapread 0x029e93 thru 0x02e683 (0x47f1 bytes) 000336 1788909589.412737 trunc from 0x040000 to 0x0093f6 (0x36c09 bytes) 000338 1788909589.431941 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x93f7): Mirror 2: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x93f7): Mirror 2: 0x3ec17392 (stale) Mirror 4: 0x3ec17392 (stale) Mirror 5: 0x3ec17392 (stale) Mirror 6: 0x3ec17392 (stale) Mirror 7: 0x3ec17392 (stale) CRC-32 checksum value for chunk [0, 0x93f7): Mirror 1: 0x6ad11aca Mirror 8: 0x6ad11aca lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x93f7: skipped 000342 1788909590.045268 mapwrite 0x009c7c thru 0x00cf30 (0x32b5 bytes) 000343 1788909590.208170 mapread 0x00bd25 thru 0x00cf30 (0x120c bytes) 000345 1788909590.209612 read 0x0014b4 thru 0x008ecd (0x7a1a bytes) 000346 1788909590.219570 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x303:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xcf31): Mirror 4: 0xc321fa61 (stale) Mirror 5: 0xc321fa61 (stale) Mirror 6: 0xc321fa61 (stale) Mirror 7: 0xc321fa61 (stale) Mirror 8: 0xaa6b8c73 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xcf31): Mirror 4: 0xc321fa61 (stale) Mirror 5: 0xc321fa61 (stale) Mirror 6: 0xc321fa61 (stale) Mirror 7: 0xc321fa61 (stale) Mirror 8: 0xaa6b8c73 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xcf31: skipped 000347 1788909590.485254 mapwrite 0x014f7e thru 0x01a166 (0x51e9 bytes) 000348 1788909590.531600 mapread 0x00b65d thru 0x00e485 (0x2e29 bytes) 000349 1788909590.545431 MIRROR_RESYNC 6 mirrors 000350 1788909591.198031 trunc from 0x01a167 to 0x011f0c (0x825a bytes) 000352 1788909591.264860 mapread 0x002a29 thru 0x00f2ec (0xc8c4 bytes) 000353 1788909591.283317 trunc from 0x011f0d to 0x034bec (0x22ce0 bytes) 000356 1788909591.307266 trunc from 0x034bed to 0x01e9c2 (0x1622a bytes) 000361 1788909591.325854 trunc from 0x01e9c3 to 0x037533 (0x18b71 bytes) 000364 1788909591.350821 MIRROR_RESYNC 6 mirrors 000366 1788909592.281815 read 0x012728 thru 0x019806 (0x70df bytes) 000369 1788909592.291563 write 0x0091a5 thru 0x00a3a0 (0x11fc bytes) 000371 1788909592.353178 write 0x03d944 thru 0x03ffff (0x26bc bytes) 000372 1788909592.354208 trunc from 0x040000 to 0x031fcc (0xe033 bytes) 000373 1788909592.374845 trunc from 0x031fcd to 0x001899 (0x30733 bytes) 000375 1788909592.389121 mapwrite 0x022257 thru 0x02d6d0 (0xb47a bytes) 000377 1788909592.472727 read 0x02ce30 thru 0x02d6d0 (0x8a1 bytes) 000378 1788909592.473247 trunc from 0x02d6d1 to 0x01520b (0x184c5 bytes) 000379 1788909592.488940 write 0x02d06e thru 0x036851 (0x97e4 bytes) 000381 1788909592.493501 MIRROR_RESYNC 6 mirrors 000382 1788909593.545142 write 0x022e21 thru 0x02a650 (0x7830 bytes) 000383 1788909593.610334 read 0x02f720 thru 0x030284 (0xb65 bytes) 000385 1788909593.617436 mapread 0x017251 thru 0x01f86c (0x861c bytes) 000387 1788909593.641854 MIRROR_RESYNC 6 mirrors 000389 1788909594.687443 MIRROR_EXTEND to 7 mirrors 000391 1788909595.199173 mapread 0x000eae thru 0x00e771 (0xd8c4 bytes) 000394 1788909595.251287 MIRROR_RESYNC 7 mirrors 000397 1788909595.580098 MIRROR_RESYNC 7 mirrors 000399 1788909595.892875 MIRROR_RESYNC 7 mirrors 000400 1788909596.206947 trunc from 0x036852 to 0x025b8b (0x10cc6 bytes) 000401 1788909596.287557 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x25b8c): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25b8c): Mirror 4: 0x7f5ed65c (stale) Mirror 5: 0x7f5ed65c (stale) Mirror 6: 0x7f5ed65c (stale) Mirror 7: 0x7f5ed65c (stale) Mirror 8: 0x7f5ed65c (stale) Mirror 9: 0x7f5ed65c (stale) CRC-32 checksum value for chunk [0, 0x25b8c): Mirror 1: 0x7f5ed65c Mirror 10: 0x7f5ed65c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25b8c: skipped 000405 1788909597.108710 mapwrite 0x012630 thru 0x0183da (0x5dab bytes) 000409 1788909597.262032 mapread 0x003a60 thru 0x003f11 (0x4b2 bytes) 000411 1788909597.273847 write 0x0027b1 thru 0x00362e (0xe7e bytes) 000414 1788909597.278351 trunc from 0x025b8c to 0x000a36 (0x25155 bytes) 000415 1788909597.296210 trunc from 0x000a37 to 0x003d7f (0x3349 bytes) 000416 1788909597.307392 mapwrite 0x009f4e thru 0x00da50 (0x3b03 bytes) 000419 1788909597.356892 trunc from 0x00da51 to 0x0227af (0x14d5f bytes) 000424 1788909597.377483 trunc from 0x0227b0 to 0x01215b (0x10654 bytes) 000425 1788909597.389456 mapread 0x00078c thru 0x006db8 (0x662d bytes) 000428 1788909597.403820 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x1215c): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1215c): Mirror 4: 0x180fc9c4 (stale) Mirror 5: 0x180fc9c4 (stale) Mirror 6: 0x180fc9c4 (stale) Mirror 7: 0x180fc9c4 (stale) Mirror 8: 0x180fc9c4 (stale) Mirror 9: 0x180fc9c4 (stale) Mirror 10: 0x180fc9c4 (stale) CRC-32 checksum value for chunk [0, 0x1215c): Mirror 1: 0x1c66adf8 Mirror 11: 0x1c66adf8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1215c: skipped 000432 1788909598.182524 trunc from 0x01215c to 0x01de94 (0xbd39 bytes) 000434 1788909598.300349 write 0x01fe53 thru 0x02c506 (0xc6b4 bytes) 000435 1788909598.301872 mapread 0x00ba28 thru 0x016b1c (0xb0f5 bytes) 000437 1788909598.326076 write 0x01b25c thru 0x01d62b (0x23d0 bytes) 000438 1788909598.326784 read 0x00e2c2 thru 0x013b68 (0x58a7 bytes) 000439 1788909598.327283 read 0x02a28f thru 0x02c506 (0x2278 bytes) 000440 1788909598.330707 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x303:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c507): Mirror 4: 0x661399bb (stale) Mirror 5: 0x661399bb (stale) Mirror 6: 0x661399bb (stale) Mirror 7: 0x661399bb (stale) Mirror 8: 0x661399bb (stale) Mirror 9: 0x661399bb (stale) Mirror 10: 0x6cfd4565 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c507): Mirror 4: 0x661399bb (stale) Mirror 5: 0x661399bb (stale) Mirror 6: 0x661399bb (stale) Mirror 7: 0x661399bb (stale) Mirror 8: 0x661399bb (stale) Mirror 9: 0x661399bb (stale) Mirror 10: 0x6cfd4565 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c507: skipped 000442 1788909598.685908 mapwrite 0x0223b5 thru 0x02e651 (0xc29d bytes) 000443 1788909598.761117 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2e652): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e652): Mirror 4: 0xcfc8f977 (stale) Mirror 5: 0xcfc8f977 (stale) Mirror 6: 0xcfc8f977 (stale) Mirror 7: 0xcfc8f977 (stale) Mirror 8: 0xcfc8f977 (stale) Mirror 9: 0xcfc8f977 (stale) Mirror 10: 0xebccc7d2 (stale) CRC-32 checksum value for chunk [0, 0x2e652): Mirror 1: 0xa11e3d41 Mirror 11: 0xa11e3d41 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e652: skipped 000444 1788909599.449254 write 0x0091b5 thru 0x013fd6 (0xae22 bytes) 000445 1788909599.488094 write 0x0036b8 thru 0x00a8dd (0x7226 bytes) 000447 1788909599.496176 mapwrite 0x00b4ae thru 0x011166 (0x5cb9 bytes) 000448 1788909599.522469 MIRROR_RESYNC 9 mirrors 000450 1788909600.433764 trunc from 0x02e652 to 0x006b6d (0x27ae4 bytes) 000451 1788909600.479489 read 0x0028df thru 0x006b6d (0x428f bytes) 000452 1788909600.485853 read 0x004c1b thru 0x006b6d (0x1f53 bytes) 000453 1788909600.486934 mapwrite 0x01dd32 thru 0x029837 (0xbb06 bytes) 000454 1788909600.549985 mapread 0x01405e thru 0x018b11 (0x4ab4 bytes) 000455 1788909600.550874 mapread 0x022510 thru 0x029837 (0x7328 bytes) 000456 1788909600.551551 trunc from 0x029838 to 0x014f08 (0x1492f bytes) 000457 1788909600.559136 read 0x013891 thru 0x014f08 (0x1678 bytes) 000458 1788909600.559727 read 0x010892 thru 0x014f08 (0x4677 bytes) 000461 1788909600.561205 trunc from 0x014f09 to 0x00fdfc (0x510c bytes) 000462 1788909600.572577 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0xfdfd): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xfdfd): Mirror 4: 0x5bd804f9 (stale) Mirror 5: 0x5bd804f9 (stale) Mirror 6: 0x5bd804f9 (stale) Mirror 7: 0x5bd804f9 (stale) Mirror 8: 0x5bd804f9 (stale) Mirror 9: 0x5bd804f9 (stale) Mirror 10: 0x5bd804f9 (stale) Mirror 11: 0x5bd804f9 (stale) CRC-32 checksum value for chunk [0, 0xfdfd): Mirror 1: 0x761001cc Mirror 12: 0x761001cc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xfdfd: skipped 000463 1788909601.199587 write 0x0098c2 thru 0x018205 (0xe944 bytes) 000464 1788909601.279281 read 0x01617f thru 0x018205 (0x2087 bytes) 000465 1788909601.279910 read 0x011d2a thru 0x018205 (0x64dc bytes) 000467 1788909601.281170 mapread 0x005487 thru 0x00bccf (0x6849 bytes) 000469 1788909601.291177 mapwrite 0x00f1d2 thru 0x0176ab (0x84da bytes) 000471 1788909601.337432 read 0x00f337 thru 0x00ffbd (0xc87 bytes) 000472 1788909601.340785 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x303:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18206): Mirror 4: 0x16d621e6 (stale) Mirror 5: 0x16d621e6 (stale) Mirror 6: 0x16d621e6 (stale) Mirror 7: 0x16d621e6 (stale) Mirror 8: 0x16d621e6 (stale) Mirror 9: 0x16d621e6 (stale) Mirror 10: 0x16d621e6 (stale) Mirror 11: 0x16d621e6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18206): Mirror 4: 0x16d621e6 (stale) Mirror 5: 0x16d621e6 (stale) Mirror 6: 0x16d621e6 (stale) Mirror 7: 0x16d621e6 (stale) Mirror 8: 0x16d621e6 (stale) Mirror 9: 0x16d621e6 (stale) Mirror 10: 0x16d621e6 (stale) Mirror 11: 0x16d621e6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18206: skipped 000473 1788909601.667780 mapwrite 0x01181b thru 0x016d7e (0x5564 bytes) 000474 1788909601.713339 mapread 0x005cb3 thru 0x00af48 (0x5296 bytes) 000478 1788909601.722136 write 0x009653 thru 0x009d0e (0x6bc bytes) 000479 1788909601.724914 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x303:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18206): Mirror 5: 0x16d621e6 (stale) Mirror 6: 0x16d621e6 (stale) Mirror 7: 0x16d621e6 (stale) Mirror 8: 0x16d621e6 (stale) Mirror 9: 0x16d621e6 (stale) Mirror 10: 0x16d621e6 (stale) Mirror 11: 0x16d621e6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18206): Mirror 5: 0x16d621e6 (stale) Mirror 6: 0x16d621e6 (stale) Mirror 7: 0x16d621e6 (stale) Mirror 8: 0x16d621e6 (stale) Mirror 9: 0x16d621e6 (stale) Mirror 10: 0x16d621e6 (stale) Mirror 11: 0x16d621e6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18206: skipped 000480 1788909601.998899 mapwrite 0x01a196 thru 0x0205a3 (0x640e bytes) 000481 1788909602.079133 mapwrite 0x026201 thru 0x02e99e (0x879e bytes) 000482 1788909602.150507 write 0x03d23c thru 0x03ffff (0x2dc4 bytes) 000483 1788909602.151471 mapread 0x03e410 thru 0x03ffff (0x1bf0 bytes) 000487 1788909602.154390 read 0x030db3 thru 0x039c6b (0x8eb9 bytes) 000490 1788909602.161291 trunc from 0x040000 to 0x033d0f (0xc2f0 bytes) 000491 1788909602.176294 write 0x00149f thru 0x003976 (0x24d8 bytes) 000492 1788909602.191212 trunc from 0x033d10 to 0x00eeb9 (0x24e56 bytes) 000493 1788909602.203506 write 0x035dff thru 0x037cb5 (0x1eb7 bytes) 000494 1788909602.204906 trunc from 0x037cb6 to 0x00ecf3 (0x28fc2 bytes) 000496 1788909602.219345 trunc from 0x00ecf4 to 0x005360 (0x9993 bytes) 000498 1788909602.232781 mapread 0x0030ee thru 0x005360 (0x2273 bytes) 000499 1788909602.237082 mapwrite 0x00cacc thru 0x00ef8f (0x24c4 bytes) 000500 1788909602.282052 mapread 0x0024da thru 0x002bc8 (0x6ef bytes) 000502 1788909602.283948 write 0x03059f thru 0x035a7c (0x54de bytes) 000505 1788909602.286550 mapwrite 0x01e372 thru 0x01e51e (0x1ad bytes) 000509 1788909602.328666 write 0x001b82 thru 0x0116dd (0xfb5c bytes) 000511 1788909602.333174 read 0x02cde2 thru 0x035a7c (0x8c9b bytes) 000514 1788909602.342008 trunc from 0x035a7d to 0x025b9d (0xfedf bytes) 000515 1788909602.364274 mapread 0x000ce1 thru 0x00474c (0x3a6c bytes) 000516 1788909602.365199 mapwrite 0x028cd5 thru 0x02a13c (0x1468 bytes) 000518 1788909602.436563 MIRROR_RESYNC 8 mirrors 000521 1788909603.213667 mapwrite 0x034ba7 thru 0x03c422 (0x787c bytes) 000522 1788909603.324740 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3c423): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c423): Mirror 5: 0x400964c6 (stale) Mirror 6: 0x400964c6 (stale) Mirror 7: 0x400964c6 (stale) Mirror 8: 0x400964c6 (stale) Mirror 9: 0x400964c6 (stale) Mirror 10: 0x400964c6 (stale) Mirror 11: 0x400964c6 (stale) CRC-32 checksum value for chunk [0, 0x3c423): Mirror 1: 0x94834865 Mirror 12: 0x94834865 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c423: skipped 000523 1788909603.802458 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3c423): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c423): Mirror 5: 0x400964c6 (stale) Mirror 6: 0x400964c6 (stale) Mirror 7: 0x400964c6 (stale) Mirror 8: 0x400964c6 (stale) Mirror 9: 0x400964c6 (stale) Mirror 10: 0x400964c6 (stale) Mirror 11: 0x400964c6 (stale) CRC-32 checksum value for chunk [0, 0x3c423): Mirror 1: 0x94834865 Mirror 12: 0x94834865 Mirror 13: 0x94834865 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c423: skipped 000524 1788909604.437611 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x303:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c423): Mirror 5: 0x400964c6 (stale) Mirror 6: 0x400964c6 (stale) Mirror 7: 0x400964c6 (stale) Mirror 8: 0x400964c6 (stale) Mirror 9: 0x400964c6 (stale) Mirror 10: 0x400964c6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c423): Mirror 5: 0x400964c6 (stale) Mirror 6: 0x400964c6 (stale) Mirror 7: 0x400964c6 (stale) Mirror 8: 0x400964c6 (stale) Mirror 9: 0x400964c6 (stale) Mirror 10: 0x400964c6 (stale) CRC-32 checksum value for chunk [0, 0x3c423): Mirror 1: 0x94834865 Mirror 12: 0x94834865 Mirror 13: 0x94834865 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c423: skipped 000525 1788909604.831568 trunc from 0x03c423 to 0x01e62e (0x1ddf4 bytes) 000526 1788909604.895847 write 0x02ebc6 thru 0x02f1a7 (0x5e2 bytes) 000527 1788909604.898320 mapread 0x029a92 thru 0x02f1a7 (0x5716 bytes) 000530 1788909604.910568 read 0x015378 thru 0x01f35e (0x9fe7 bytes) 000532 1788909604.917591 write 0x014f65 thru 0x022a07 (0xdaa3 bytes) 000533 1788909604.927047 trunc from 0x02f1a8 to 0x037c26 (0x8a7f bytes) 000534 1788909604.961833 mapwrite 0x02f6af thru 0x03f68d (0xffdf bytes) 000535 1788909605.035793 write 0x002789 thru 0x008a60 (0x62d8 bytes) 000536 1788909605.041376 mapwrite 0x00fd9c thru 0x015da8 (0x600d bytes) 000537 1788909605.076065 read 0x03a64d thru 0x03bf5d (0x1911 bytes) 000538 1788909605.076913 trunc from 0x03f68e to 0x00f151 (0x3053c bytes) 000539 1788909605.085053 mapread 0x00ca11 thru 0x00f151 (0x2741 bytes) 000541 1788909605.086252 write 0x023218 thru 0x026944 (0x372d bytes) 000543 1788909605.087638 trunc from 0x026945 to 0x001656 (0x252ee bytes) 000545 1788909605.096510 write 0x026564 thru 0x027fca (0x1a67 bytes) 000546 1788909605.099713 MIRROR_RESYNC 9 mirrors 000547 1788909606.394915 mapwrite 0x03e267 thru 0x03ffff (0x1d99 bytes) 000548 1788909606.497707 MIRROR_RESYNC 9 mirrors 000549 1788909607.888735 write 0x00b9c8 thru 0x013341 (0x797a bytes) 000550 1788909607.942820 trunc from 0x040000 to 0x035c56 (0xa3a9 bytes) 000551 1788909607.956917 mapread 0x00e213 thru 0x017c52 (0x9a40 bytes) 000552 1788909607.974006 write 0x0061f7 thru 0x00d62a (0x7434 bytes) 000553 1788909607.981822 trunc from 0x035c57 to 0x018a68 (0x1d1ee bytes) 000555 1788909607.992891 mapread 0x00af58 thru 0x00eed1 (0x3f7a bytes) 000556 1788909608.001452 MIRROR_SPLIT mirror 5 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x303:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18a69): Mirror 5: 0x7d4c5c48 (stale) Mirror 6: 0x7d4c5c48 (stale) Mirror 7: 0x7d4c5c48 (stale) Mirror 8: 0x7d4c5c48 (stale) Mirror 10: 0x7d4c5c48 (stale) Mirror 12: 0x7d4c5c48 (stale) Mirror 13: 0x7d4c5c48 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18a69): Mirror 5: 0x7d4c5c48 (stale) Mirror 6: 0x7d4c5c48 (stale) Mirror 7: 0x7d4c5c48 (stale) Mirror 8: 0x7d4c5c48 (stale) Mirror 10: 0x7d4c5c48 (stale) Mirror 12: 0x7d4c5c48 (stale) Mirror 13: 0x7d4c5c48 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18a69: skipped 000557 1788909608.406792 trunc from 0x018a69 to 0x00045f (0x18609 bytes) 000560 1788909608.425829 mapwrite 0x0177fb thru 0x01fa91 (0x8297 bytes) 000561 1788909608.494836 read 0x01c499 thru 0x01e47a (0x1fe2 bytes) 000564 1788909608.498005 write 0x005598 thru 0x00f12f (0x9b98 bytes) 000565 1788909608.507021 mapwrite 0x03c6ec thru 0x03ffff (0x3914 bytes) 000566 1788909608.566539 mapread 0x0138b8 thru 0x01d496 (0x9bdf bytes) 000567 1788909608.567657 mapwrite 0x00a7d0 thru 0x019e2f (0xf660 bytes) 000568 1788909608.614806 trunc from 0x040000 to 0x00f3eb (0x30c14 bytes) 000569 1788909608.630672 read 0x00c466 thru 0x00f3eb (0x2f86 bytes) 000570 1788909608.631273 mapread 0x00b7c6 thru 0x00f3eb (0x3c26 bytes) 000571 1788909608.632040 mapwrite 0x030642 thru 0x03f014 (0xe9d3 bytes) 000573 1788909608.702242 write 0x01a918 thru 0x021b27 (0x7210 bytes) 000574 1788909608.703411 mapread 0x0329a9 thru 0x03f014 (0xc66c bytes) 000578 1788909608.709566 read 0x01e9b4 thru 0x028b24 (0xa171 bytes) 000581 1788909608.713666 trunc from 0x03f015 to 0x030fcf (0xe045 bytes) 000582 1788909608.733200 write 0x00ca72 thru 0x0190c5 (0xc654 bytes) 000583 1788909608.735643 mapread 0x027be3 thru 0x02a998 (0x2db6 bytes) 000584 1788909608.737124 mapwrite 0x03e9fe thru 0x03ffff (0x1602 bytes) 000585 1788909608.811172 mapread 0x01f997 thru 0x02b898 (0xbf02 bytes) 000586 1788909608.812617 mapread 0x032445 thru 0x034d11 (0x28cd bytes) 000589 1788909608.814674 write 0x0195b5 thru 0x01a34a (0xd96 bytes) 000590 1788909608.816391 write 0x0162cc thru 0x0219aa (0xb6df bytes) 000591 1788909608.817425 write 0x022b61 thru 0x028ac8 (0x5f68 bytes) 000592 1788909608.818327 mapread 0x01161e thru 0x01ff81 (0xe964 bytes) 000593 1788909608.819104 read 0x03bf1b thru 0x03ffff (0x40e5 bytes) 000594 1788909608.819541 mapwrite 0x034eb0 thru 0x039564 (0x46b5 bytes) 000595 1788909608.852187 mapread 0x0214b4 thru 0x02e16e (0xccbb bytes) 000598 1788909608.854007 write 0x039967 thru 0x03ffff (0x6699 bytes) 000600 1788909608.856810 mapread 0x03d604 thru 0x03ffff (0x29fc bytes) 000601 1788909608.857715 mapwrite 0x028fad thru 0x02b515 (0x2569 bytes) 000603 1788909608.915773 read 0x0108a2 thru 0x01cb8a (0xc2e9 bytes) 000604 1788909608.926317 MIRROR_RESYNC 8 mirrors 000611 1788909609.906356 trunc from 0x040000 to 0x03321f (0xcde0 bytes) 000612 1788909609.945010 write 0x0387a7 thru 0x03ee7b (0x66d5 bytes) 000613 1788909609.946181 write 0x02d507 thru 0x035e32 (0x892c bytes) 000614 1788909609.951692 mapwrite 0x03f8d0 thru 0x03ffff (0x730 bytes) 000615 1788909609.997092 trunc from 0x040000 to 0x00e3a0 (0x31c5f bytes) 000616 1788909610.008550 read 0x006534 thru 0x00b758 (0x5225 bytes) 000618 1788909610.013936 write 0x00cd4a thru 0x01633b (0x95f2 bytes) 000620 1788909610.021640 write 0x017fe1 thru 0x01fd31 (0x7d51 bytes) 000621 1788909610.022495 trunc from 0x01fd32 to 0x031f10 (0x121df bytes) 000622 1788909610.039282 trunc from 0x031f11 to 0x009ebc (0x28054 bytes) 000623 1788909610.050464 mapwrite 0x0194a6 thru 0x021078 (0x7bd3 bytes) 000624 1788909610.132641 mapwrite 0x02846f thru 0x0326c3 (0xa255 bytes) 000626 1788909610.192575 MIRROR_RESYNC 8 mirrors 000627 1788909610.877691 MIRROR_EXTEND to 9 mirrors 000628 1788909611.337149 mapwrite 0x031aa9 thru 0x036e84 (0x53dc bytes) 000629 1788909611.471528 trunc from 0x036e85 to 0x004fd2 (0x31eb2 bytes) 000630 1788909611.497403 MIRROR_RESYNC 9 mirrors 000633 1788909612.279972 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x303:0x0]: Invalid argument (22) 000635 1788909612.588301 mapwrite 0x00c76a thru 0x016646 (0x9edd bytes) 000636 1788909612.713989 write 0x037b4b thru 0x03ffff (0x84b5 bytes) 000637 1788909612.723997 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xcb8bd481 (stale) Mirror 6: 0xcb8bd481 (stale) Mirror 7: 0xcb8bd481 (stale) Mirror 10: 0xcb8bd481 (stale) Mirror 12: 0xcb8bd481 (stale) Mirror 13: 0xcb8bd481 (stale) Mirror 14: 0xcb8bd481 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xca4eb83d Mirror 15: 0xca4eb83d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000638 1788909613.333364 write 0x02a921 thru 0x037ca8 (0xd388 bytes) 000639 1788909613.408005 read 0x03b647 thru 0x03e6b9 (0x3073 bytes) 000640 1788909613.417654 MIRROR_RESYNC 9 mirrors 000641 1788909614.300018 trunc from 0x040000 to 0x01dee4 (0x2211b bytes) 000642 1788909614.356582 trunc from 0x01dee5 to 0x008aea (0x153fa bytes) 000643 1788909614.377495 read 0x00017e thru 0x008aea (0x896d bytes) 000644 1788909614.387477 write 0x03d7d1 thru 0x03ffff (0x282f bytes) 000645 1788909614.391915 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x644ef01d (stale) Mirror 6: 0x644ef01d (stale) Mirror 7: 0x644ef01d (stale) Mirror 10: 0x644ef01d (stale) Mirror 12: 0x644ef01d (stale) Mirror 13: 0x644ef01d (stale) Mirror 14: 0x644ef01d (stale) Mirror 15: 0x644ef01d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4d13b64e Mirror 16: 0x4d13b64e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000647 1788909615.203720 read 0x012077 thru 0x01278e (0x718 bytes) 000649 1788909615.225363 mapwrite 0x005010 thru 0x0129d7 (0xd9c8 bytes) 000650 1788909615.376440 trunc from 0x040000 to 0x005254 (0x3adab bytes) 000653 1788909615.413876 trunc from 0x005255 to 0x026e3c (0x21be8 bytes) 000654 1788909615.431990 write 0x03f2a8 thru 0x03ffff (0xd58 bytes) 000655 1788909615.433148 write 0x01fdf0 thru 0x021484 (0x1695 bytes) 000657 1788909615.441435 write 0x021476 thru 0x02f185 (0xdd10 bytes) 000658 1788909615.450586 mapread 0x012f62 thru 0x018949 (0x59e8 bytes) 000660 1788909615.464381 mapwrite 0x01ea1e thru 0x01ebc5 (0x1a8 bytes) 000661 1788909615.512838 read 0x0262c5 thru 0x02c709 (0x6445 bytes) 000662 1788909615.514311 trunc from 0x040000 to 0x01200a (0x2dff5 bytes) 000663 1788909615.529029 trunc from 0x01200b to 0x022fca (0x10fc0 bytes) 000664 1788909615.567126 write 0x01b4fa thru 0x029ca6 (0xe7ad bytes) 000665 1788909615.581973 mapread 0x002d45 thru 0x004d28 (0x1fe4 bytes) 000666 1788909615.582861 mapwrite 0x004365 thru 0x00a16c (0x5e08 bytes) 000667 1788909615.638773 mapread 0x003c0f thru 0x01169b (0xda8d bytes) 000668 1788909615.640284 trunc from 0x029ca7 to 0x0152e5 (0x149c1 bytes) 000669 1788909615.660689 mapread 0x002ae0 thru 0x00d1d8 (0xa6f9 bytes) 000671 1788909615.662432 mapwrite 0x01f707 thru 0x028579 (0x8e73 bytes) 000673 1788909615.735332 write 0x009178 thru 0x0132a2 (0xa12b bytes) 000675 1788909615.737414 read 0x00a079 thru 0x00edd6 (0x4d5e bytes) 000677 1788909615.738604 read 0x009aee thru 0x00d999 (0x3eac bytes) 000678 1788909615.739468 write 0x002c51 thru 0x00cffe (0xa3ae bytes) 000679 1788909615.742743 read 0x02854d thru 0x028579 (0x2d bytes) 000680 1788909615.745276 mapwrite 0x004947 thru 0x008ddd (0x4497 bytes) 000681 1788909615.791203 write 0x039c99 thru 0x03ffff (0x6367 bytes) 000682 1788909615.796447 MIRROR_RESYNC 10 mirrors 000686 1788909616.942107 write 0x03c00f thru 0x03ffff (0x3ff1 bytes) 000688 1788909617.003747 write 0x0048a5 thru 0x0122be (0xda1a bytes) 000693 1788909617.015743 trunc from 0x040000 to 0x0044b9 (0x3bb46 bytes) 000694 1788909617.029119 trunc from 0x0044ba to 0x0003e7 (0x40d2 bytes) 000697 1788909617.042533 trunc from 0x0003e8 to 0x034f3c (0x34b55 bytes) 000698 1788909617.054599 read 0x01a78f thru 0x01c458 (0x1cca bytes) 000702 1788909617.060558 trunc from 0x034f3d to 0x01c497 (0x18aa5 bytes) 000703 1788909617.077415 mapread 0x011246 thru 0x0179e6 (0x67a1 bytes) 000705 1788909617.102482 read 0x00f006 thru 0x011b23 (0x2b1e bytes) 000707 1788909617.103810 mapwrite 0x021cfa thru 0x02a17d (0x8484 bytes) 000711 1788909617.159520 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x2a17e): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a17e): Mirror 5: 0x8e4c245b (stale) Mirror 6: 0x8e4c245b (stale) Mirror 7: 0x8e4c245b (stale) Mirror 10: 0x8e4c245b (stale) Mirror 12: 0x8e4c245b (stale) Mirror 13: 0x8e4c245b (stale) Mirror 14: 0x8e4c245b (stale) Mirror 15: 0x8e4c245b (stale) Mirror 16: 0x8e4c245b (stale) CRC-32 checksum value for chunk [0, 0x2a17e): Mirror 1: 0xef25dcb3 Mirror 17: 0xef25dcb3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a17e: skipped 000717 1788909617.834586 mapwrite 0x00be77 thru 0x00cdc6 (0xf50 bytes) 000720 1788909617.995426 MIRROR_RESYNC 11 mirrors 000721 1788909619.110329 read 0x003fac thru 0x006a8f (0x2ae4 bytes) 000722 1788909619.115095 mapwrite 0x001fde thru 0x00cb17 (0xab3a bytes) 000723 1788909619.222756 trunc from 0x02a17e to 0x019a5e (0x1071f bytes) 000724 1788909619.233006 mapread 0x0007e1 thru 0x006d15 (0x6535 bytes) 000725 1788909619.236355 mapread 0x008919 thru 0x00a31b (0x1a03 bytes) 000727 1788909619.237330 mapread 0x002b70 thru 0x003411 (0x8a2 bytes) 000730 1788909619.238924 mapread 0x016049 thru 0x019a5e (0x3a16 bytes) 000731 1788909619.243706 trunc from 0x019a5f to 0x035210 (0x1b7b2 bytes) 000737 1788909619.258259 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x35211): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35211): Mirror 5: 0x32b7c41c (stale) Mirror 6: 0x32b7c41c (stale) Mirror 7: 0x32b7c41c (stale) Mirror 10: 0x32b7c41c (stale) Mirror 12: 0x32b7c41c (stale) Mirror 13: 0x32b7c41c (stale) Mirror 14: 0x32b7c41c (stale) Mirror 15: 0x32b7c41c (stale) Mirror 16: 0x32b7c41c (stale) Mirror 17: 0x32b7c41c (stale) CRC-32 checksum value for chunk [0, 0x35211): Mirror 1: 0xb5b69e0e Mirror 18: 0xb5b69e0e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35211: skipped 000740 1788909620.004271 mapwrite 0x00fff7 thru 0x01f777 (0xf781 bytes) 000741 1788909620.149955 MIRROR_RESYNC 12 mirrors 000742 1788909621.471882 read 0x034a5c thru 0x035210 (0x7b5 bytes) 000743 1788909621.476046 mapread 0x028388 thru 0x03105d (0x8cd6 bytes) 000744 1788909621.488364 trunc from 0x035211 to 0x004ba4 (0x3066c bytes) 000746 1788909621.563341 trunc from 0x004ba5 to 0x0035ee (0x15b6 bytes) 000748 1788909621.577886 mapwrite 0x030e5e thru 0x038195 (0x7338 bytes) 000749 1788909621.638561 trunc from 0x038196 to 0x03cc90 (0x4afb bytes) 000750 1788909621.652757 mapwrite 0x00356c thru 0x007f86 (0x4a1b bytes) 000754 1788909621.690812 mapwrite 0x01f6f5 thru 0x025008 (0x5914 bytes) 000755 1788909621.728964 mapwrite 0x00330f thru 0x011def (0xeae1 bytes) 000760 1788909621.778209 read 0x02b295 thru 0x02f458 (0x41c4 bytes) 000762 1788909621.780662 write 0x004de0 thru 0x00c6e4 (0x7905 bytes) 000764 1788909621.783853 write 0x02d9cb thru 0x03b6ba (0xdcf0 bytes) 000765 1788909621.793651 mapread 0x00a75a thru 0x00fa50 (0x52f7 bytes) 000766 1788909621.794740 mapread 0x028695 thru 0x0385d6 (0xff42 bytes) 000769 1788909621.800440 write 0x001f71 thru 0x00f6fc (0xd78c bytes) 000771 1788909621.803652 write 0x01d179 thru 0x02562a (0x84b2 bytes) 000772 1788909621.810419 MIRROR_SPLIT mirror 4 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x303:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cc91): Mirror 5: 0x4dd1e27e (stale) Mirror 6: 0x4dd1e27e (stale) Mirror 7: 0x4dd1e27e (stale) Mirror 12: 0x4dd1e27e (stale) Mirror 13: 0x4dd1e27e (stale) Mirror 14: 0x4dd1e27e (stale) Mirror 15: 0x4dd1e27e (stale) Mirror 16: 0x4dd1e27e (stale) Mirror 17: 0x4dd1e27e (stale) Mirror 18: 0x4dd1e27e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cc91): Mirror 5: 0x4dd1e27e (stale) Mirror 6: 0x4dd1e27e (stale) Mirror 7: 0x4dd1e27e (stale) Mirror 12: 0x4dd1e27e (stale) Mirror 13: 0x4dd1e27e (stale) Mirror 14: 0x4dd1e27e (stale) Mirror 15: 0x4dd1e27e (stale) Mirror 16: 0x4dd1e27e (stale) Mirror 17: 0x4dd1e27e (stale) Mirror 18: 0x4dd1e27e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cc91: skipped 000773 1788909622.364315 mapwrite 0x021e05 thru 0x028143 (0x633f bytes) 000776 1788909622.420960 mapwrite 0x032626 thru 0x0329c7 (0x3a2 bytes) 000778 1788909622.460036 mapwrite 0x03e215 thru 0x03ffff (0x1deb bytes) 000779 1788909622.509663 trunc from 0x040000 to 0x00ffe4 (0x3001b bytes) 000780 1788909622.530428 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x303:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xffe5): Mirror 6: 0xf3650b96 (stale) Mirror 7: 0xf3650b96 (stale) Mirror 12: 0xf3650b96 (stale) Mirror 13: 0xf3650b96 (stale) Mirror 14: 0xf3650b96 (stale) Mirror 15: 0xf3650b96 (stale) Mirror 16: 0xf3650b96 (stale) Mirror 17: 0xf3650b96 (stale) Mirror 18: 0xf3650b96 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xffe5): Mirror 6: 0xf3650b96 (stale) Mirror 7: 0xf3650b96 (stale) Mirror 12: 0xf3650b96 (stale) Mirror 13: 0xf3650b96 (stale) Mirror 14: 0xf3650b96 (stale) Mirror 15: 0xf3650b96 (stale) Mirror 16: 0xf3650b96 (stale) Mirror 17: 0xf3650b96 (stale) Mirror 18: 0xf3650b96 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xffe5: skipped 000781 1788909622.896013 write 0x009fda thru 0x0115a4 (0x75cb bytes) 000782 1788909622.906055 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x303:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x115a5): Mirror 6: 0xbf5e5064 (stale) Mirror 7: 0xbf5e5064 (stale) Mirror 13: 0xbf5e5064 (stale) Mirror 14: 0xbf5e5064 (stale) Mirror 15: 0xbf5e5064 (stale) Mirror 16: 0xbf5e5064 (stale) Mirror 17: 0xbf5e5064 (stale) Mirror 18: 0xbf5e5064 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x115a5): Mirror 6: 0xbf5e5064 (stale) Mirror 7: 0xbf5e5064 (stale) Mirror 13: 0xbf5e5064 (stale) Mirror 14: 0xbf5e5064 (stale) Mirror 15: 0xbf5e5064 (stale) Mirror 16: 0xbf5e5064 (stale) Mirror 17: 0xbf5e5064 (stale) Mirror 18: 0xbf5e5064 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x115a5: skipped 000783 1788909623.241384 trunc from 0x0115a5 to 0x010c1c (0x988 bytes) 000784 1788909623.258658 write 0x008d7d thru 0x013db7 (0xb03b bytes) 000785 1788909623.270425 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x13db8): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13db8): Mirror 6: 0xdff8a316 (stale) Mirror 7: 0xdff8a316 (stale) Mirror 13: 0xdff8a316 (stale) Mirror 14: 0xdff8a316 (stale) Mirror 15: 0xdff8a316 (stale) Mirror 16: 0xdff8a316 (stale) Mirror 17: 0xdff8a316 (stale) Mirror 18: 0xdff8a316 (stale) CRC-32 checksum value for chunk [0, 0x13db8): Mirror 1: 0x36cc778a Mirror 19: 0x36cc778a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13db8: skipped 000786 1788909623.993589 trunc from 0x013db8 to 0x001f8f (0x11e28 bytes) 000788 1788909624.057719 mapread 0x001310 thru 0x001f8f (0xc80 bytes) 000790 1788909624.065343 mapread 0x000d37 thru 0x001f8f (0x1259 bytes) 000793 1788909624.074783 mapwrite 0x00e9a1 thru 0x013a33 (0x5093 bytes) 000795 1788909624.155355 mapwrite 0x00aaa4 thru 0x01158a (0x6ae7 bytes) 000796 1788909624.196524 MIRROR_RESYNC 10 mirrors 000797 1788909625.026609 mapwrite 0x020c26 thru 0x02cd45 (0xc120 bytes) 000799 1788909625.198654 mapwrite 0x030b1f thru 0x037163 (0x6645 bytes) 000800 1788909625.273973 mapread 0x032786 thru 0x037163 (0x49de bytes) 000801 1788909625.274937 mapread 0x0037b7 thru 0x0082ac (0x4af6 bytes) 000803 1788909625.290438 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x37164): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37164): Mirror 6: 0x914a0d33 (stale) Mirror 7: 0x914a0d33 (stale) Mirror 13: 0x914a0d33 (stale) Mirror 14: 0x914a0d33 (stale) Mirror 15: 0x914a0d33 (stale) Mirror 16: 0x914a0d33 (stale) Mirror 17: 0x914a0d33 (stale) Mirror 18: 0x914a0d33 (stale) Mirror 19: 0x914a0d33 (stale) CRC-32 checksum value for chunk [0, 0x37164): Mirror 1: 0xa95c59f5 Mirror 20: 0xa95c59f5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37164: skipped 000805 1788909625.896444 mapwrite 0x01244e thru 0x012944 (0x4f7 bytes) 000806 1788909626.042951 write 0x023bdb thru 0x02e762 (0xab88 bytes) 000812 1788909626.075733 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x303:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37164): Mirror 6: 0x914a0d33 (stale) Mirror 7: 0x914a0d33 (stale) Mirror 13: 0x914a0d33 (stale) Mirror 14: 0x914a0d33 (stale) Mirror 15: 0x914a0d33 (stale) Mirror 17: 0x914a0d33 (stale) Mirror 18: 0x914a0d33 (stale) Mirror 19: 0x914a0d33 (stale) Mirror 20: 0xa95c59f5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37164): Mirror 6: 0x914a0d33 (stale) Mirror 7: 0x914a0d33 (stale) Mirror 13: 0x914a0d33 (stale) Mirror 14: 0x914a0d33 (stale) Mirror 15: 0x914a0d33 (stale) Mirror 17: 0x914a0d33 (stale) Mirror 18: 0x914a0d33 (stale) Mirror 19: 0x914a0d33 (stale) Mirror 20: 0xa95c59f5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37164: skipped 000813 1788909626.475466 mapread 0x0340c5 thru 0x034611 (0x54d bytes) 000814 1788909626.484703 MIRROR_RESYNC 10 mirrors 000818 1788909627.411190 mapwrite 0x0023cc thru 0x008a0b (0x6640 bytes) 000819 1788909627.556856 mapread 0x02b957 thru 0x032d61 (0x740b bytes) 000821 1788909627.566649 mapwrite 0x0250d6 thru 0x02e43d (0x9368 bytes) 000822 1788909627.611528 mapwrite 0x000b9e thru 0x0061be (0x5621 bytes) 000825 1788909627.651832 mapread 0x02bc2d thru 0x035206 (0x95da bytes) 000826 1788909627.659629 write 0x0179f4 thru 0x0250aa (0xd6b7 bytes) 000827 1788909627.665278 read 0x00eded thru 0x01694d (0x7b61 bytes) 000829 1788909627.674093 mapread 0x033df1 thru 0x037163 (0x3373 bytes) 000830 1788909627.674946 trunc from 0x037164 to 0x01e3b5 (0x18dae bytes) 000831 1788909627.690529 trunc from 0x01e3b6 to 0x015a8a (0x892b bytes) 000832 1788909627.700138 read 0x01228e thru 0x015a8a (0x37fd bytes) 000833 1788909627.700647 mapwrite 0x015e6a thru 0x01fe18 (0x9faf bytes) 000834 1788909627.742063 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x1fe19): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fe19): Mirror 6: 0x20b9b3d5 (stale) Mirror 7: 0x20b9b3d5 (stale) Mirror 13: 0x20b9b3d5 (stale) Mirror 14: 0x20b9b3d5 (stale) Mirror 15: 0x20b9b3d5 (stale) Mirror 17: 0x20b9b3d5 (stale) Mirror 18: 0x20b9b3d5 (stale) Mirror 19: 0x20b9b3d5 (stale) Mirror 20: 0x20b9b3d5 (stale) CRC-32 checksum value for chunk [0, 0x1fe19): Mirror 1: 0x5e288be6 Mirror 21: 0x5e288be6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fe19: skipped 000836 1788909628.430139 mapread 0x018507 thru 0x01fe18 (0x7912 bytes) 000837 1788909628.450645 read 0x0182e1 thru 0x01fe18 (0x7b38 bytes) 000838 1788909628.453948 mapwrite 0x02d767 thru 0x02fadf (0x2379 bytes) 000839 1788909628.577331 mapwrite 0x00bcf5 thru 0x012e23 (0x712f bytes) 000840 1788909628.618172 trunc from 0x02fae0 to 0x009ad0 (0x2600f bytes) 000841 1788909628.633857 read 0x00058d thru 0x003dfd (0x3871 bytes) 000843 1788909628.647012 read 0x008d4c thru 0x009ad0 (0xd85 bytes) 000844 1788909628.648044 trunc from 0x009ad1 to 0x030bb3 (0x270e3 bytes) 000845 1788909628.666793 read 0x002337 thru 0x0073e1 (0x50ab bytes) 000847 1788909628.668076 trunc from 0x030bb4 to 0x03c863 (0xbcb0 bytes) 000848 1788909628.684645 read 0x034f25 thru 0x03c863 (0x793f bytes) 000850 1788909628.696205 trunc from 0x03c864 to 0x024e8b (0x179d8 bytes) 000851 1788909628.707536 mapwrite 0x010d51 thru 0x018e92 (0x8142 bytes) 000852 1788909628.741518 write 0x009ea4 thru 0x0127fd (0x895a bytes) 000853 1788909628.742740 write 0x032166 thru 0x03bff9 (0x9e94 bytes) 000856 1788909628.745675 read 0x00769d thru 0x00bcd5 (0x4639 bytes) 000858 1788909628.750702 MIRROR_SPLIT mirror 10 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x303:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bffa): Mirror 6: 0x53c3bc6b (stale) Mirror 7: 0x53c3bc6b (stale) Mirror 13: 0x53c3bc6b (stale) Mirror 14: 0x53c3bc6b (stale) Mirror 15: 0x53c3bc6b (stale) Mirror 17: 0x53c3bc6b (stale) Mirror 18: 0x53c3bc6b (stale) Mirror 19: 0x53c3bc6b (stale) Mirror 20: 0x53c3bc6b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bffa): Mirror 6: 0x53c3bc6b (stale) Mirror 7: 0x53c3bc6b (stale) Mirror 13: 0x53c3bc6b (stale) Mirror 14: 0x53c3bc6b (stale) Mirror 15: 0x53c3bc6b (stale) Mirror 17: 0x53c3bc6b (stale) Mirror 18: 0x53c3bc6b (stale) Mirror 19: 0x53c3bc6b (stale) Mirror 20: 0x53c3bc6b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bffa: skipped 000860 1788909629.129661 mapwrite 0x0356ff thru 0x03ffff (0xa901 bytes) 000864 1788909629.212796 read 0x0316d7 thru 0x03d095 (0xb9bf bytes) 000865 1788909629.217193 MIRROR_RESYNC 10 mirrors 000867 1788909630.296452 write 0x024045 thru 0x02a374 (0x6330 bytes) 000871 1788909630.349757 read 0x03249d thru 0x03ffff (0xdb63 bytes) 000872 1788909630.357749 mapread 0x00a6a8 thru 0x010ca8 (0x6601 bytes) 000873 1788909630.379120 read 0x01a018 thru 0x01db8a (0x3b73 bytes) 000875 1788909630.388760 write 0x019e14 thru 0x027bb2 (0xdd9f bytes) 000876 1788909630.393535 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x303:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x9fcd36cb (stale) Mirror 13: 0x9fcd36cb (stale) Mirror 14: 0x9fcd36cb (stale) Mirror 15: 0x9fcd36cb (stale) Mirror 17: 0x9fcd36cb (stale) Mirror 18: 0x9fcd36cb (stale) Mirror 19: 0x9fcd36cb (stale) Mirror 20: 0x9fcd36cb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x9fcd36cb (stale) Mirror 13: 0x9fcd36cb (stale) Mirror 14: 0x9fcd36cb (stale) Mirror 15: 0x9fcd36cb (stale) Mirror 17: 0x9fcd36cb (stale) Mirror 18: 0x9fcd36cb (stale) Mirror 19: 0x9fcd36cb (stale) Mirror 20: 0x9fcd36cb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000878 1788909630.818500 write 0x00333c thru 0x0050c9 (0x1d8e bytes) 000879 1788909630.826201 write 0x005bc3 thru 0x0081fb (0x2639 bytes) 000880 1788909630.830041 mapwrite 0x03eea0 thru 0x03ffff (0x1160 bytes) 000882 1788909630.871297 mapread 0x024fd0 thru 0x0285ef (0x3620 bytes) 000887 1788909630.880010 write 0x0380b0 thru 0x03ffff (0x7f50 bytes) 000889 1788909630.886049 trunc from 0x040000 to 0x00f2e8 (0x30d17 bytes) 000890 1788909630.914167 mapwrite 0x00d547 thru 0x00dcfe (0x7b8 bytes) 000891 1788909630.944326 write 0x007f65 thru 0x00fc18 (0x7cb4 bytes) 000892 1788909630.949316 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0xfc19): Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xfc19): Mirror 7: 0x5017053d (stale) Mirror 13: 0x5017053d (stale) Mirror 14: 0x5017053d (stale) Mirror 15: 0x5017053d (stale) Mirror 17: 0x5017053d (stale) Mirror 18: 0x5017053d (stale) Mirror 19: 0x5017053d (stale) Mirror 20: 0x5017053d (stale) CRC-32 checksum value for chunk [0, 0xfc19): Mirror 1: 0x2ec7607f Mirror 21: 0x2ec7607f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xfc19: skipped 000894 1788909631.670128 write 0x028337 thru 0x02c366 (0x4030 bytes) 000895 1788909631.724996 mapread 0x022c46 thru 0x02c366 (0x9721 bytes) 000897 1788909631.736575 mapread 0x027249 thru 0x029408 (0x21c0 bytes) 000898 1788909631.737210 write 0x01372e thru 0x022d4b (0xf61e bytes) 000899 1788909631.745118 mapwrite 0x0337a5 thru 0x036a69 (0x32c5 bytes) 000900 1788909631.803957 read 0x023d57 thru 0x03234a (0xe5f4 bytes) 000901 1788909631.804504 mapwrite 0x02b8f2 thru 0x034cbd (0x93cc bytes) 000903 1788909631.842086 write 0x0077b1 thru 0x011263 (0x9ab3 bytes) 000904 1788909631.856054 read 0x01bfb9 thru 0x025f47 (0x9f8f bytes) 000906 1788909631.857066 mapread 0x00e13b thru 0x01462e (0x64f4 bytes) 000907 1788909631.868491 read 0x016461 thru 0x016a6a (0x60a bytes) 000908 1788909631.869053 mapread 0x009b8c thru 0x01583e (0xbcb3 bytes) 000910 1788909631.871774 mapread 0x00782f thru 0x00f2e5 (0x7ab7 bytes) 000911 1788909631.872952 mapwrite 0x01f012 thru 0x021b48 (0x2b37 bytes) 000913 1788909631.909024 mapread 0x01016f thru 0x01da0e (0xd8a0 bytes) 000914 1788909631.909828 trunc from 0x036a6a to 0x001a7d (0x34fec bytes) 000915 1788909631.926667 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x1a7e): Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a7e): Mirror 7: 0x31c8b73e (stale) Mirror 13: 0x31c8b73e (stale) Mirror 14: 0x31c8b73e (stale) Mirror 15: 0x31c8b73e (stale) Mirror 17: 0x31c8b73e (stale) Mirror 18: 0x31c8b73e (stale) Mirror 19: 0x31c8b73e (stale) Mirror 20: 0x31c8b73e (stale) Mirror 21: 0x31c8b73e (stale) CRC-32 checksum value for chunk [0, 0x1a7e): Mirror 1: 0x31c8b73e Mirror 22: 0x31c8b73e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a7e: skipped 000916 1788909632.582032 mapwrite 0x026624 thru 0x032ab0 (0xc48d bytes) 000917 1788909632.753488 read 0x02281c thru 0x023215 (0x9fa bytes) 000918 1788909632.754574 read 0x01ffc7 thru 0x028689 (0x86c3 bytes) 000919 1788909632.767371 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x32ab1): Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32ab1): Mirror 7: 0x6a31f962 (stale) Mirror 13: 0x6a31f962 (stale) Mirror 14: 0x6a31f962 (stale) Mirror 15: 0x6a31f962 (stale) Mirror 17: 0x6a31f962 (stale) Mirror 18: 0x6a31f962 (stale) Mirror 19: 0x6a31f962 (stale) Mirror 20: 0x6a31f962 (stale) Mirror 21: 0x83053106 (stale) Mirror 22: 0x2334238 (stale) CRC-32 checksum value for chunk [0, 0x32ab1): Mirror 1: 0xcdb3753f Mirror 23: 0xcdb3753f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32ab1: skipped 000920 1788909633.587719 read 0x023d7f thru 0x030858 (0xcada bytes) 000922 1788909633.616037 mapread 0x00bedf thru 0x010e8a (0x4fac bytes) 000923 1788909633.643058 mapwrite 0x035ba4 thru 0x03ffff (0xa45c bytes) 000924 1788909633.797260 mapwrite 0x0191eb thru 0x025103 (0xbf19 bytes) 000925 1788909633.852462 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0x9fcd36cb (stale) Mirror 13: 0x9fcd36cb (stale) Mirror 14: 0x9fcd36cb (stale) Mirror 15: 0x9fcd36cb (stale) Mirror 17: 0x9fcd36cb (stale) Mirror 18: 0x9fcd36cb (stale) Mirror 19: 0x9fcd36cb (stale) Mirror 20: 0x9fcd36cb (stale) Mirror 21: 0x79afb052 (stale) Mirror 22: 0xe1bf10a7 (stale) Mirror 23: 0x6405e9f2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x38ff093b Mirror 24: 0x38ff093b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000929 1788909634.533708 mapwrite 0x00a4bb thru 0x0107b9 (0x62ff bytes) 000930 1788909634.724726 read 0x03cc84 thru 0x03ffff (0x337c bytes) 000931 1788909634.730702 read 0x03b408 thru 0x03da43 (0x263c bytes) 000934 1788909634.746100 mapwrite 0x033a7a thru 0x03ffff (0xc586 bytes) 000935 1788909634.784971 read 0x034a12 thru 0x03ffff (0xb5ee bytes) 000936 1788909634.785483 trunc from 0x040000 to 0x0238c0 (0x1c73f bytes) 000938 1788909634.806855 write 0x03ea9b thru 0x03ffff (0x1565 bytes) 000939 1788909634.809128 mapread 0x034397 thru 0x035bba (0x1824 bytes) 000942 1788909634.819499 trunc from 0x040000 to 0x010e92 (0x2f16d bytes) 000944 1788909634.838197 mapread 0x00679e thru 0x007c54 (0x14b7 bytes) 000945 1788909634.844499 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x10e93): Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10e93): Mirror 7: 0xd039e1e6 (stale) Mirror 13: 0xd039e1e6 (stale) Mirror 14: 0xd039e1e6 (stale) Mirror 15: 0xd039e1e6 (stale) Mirror 17: 0xd039e1e6 (stale) Mirror 18: 0xd039e1e6 (stale) Mirror 19: 0xd039e1e6 (stale) Mirror 20: 0xd039e1e6 (stale) Mirror 21: 0xea786af (stale) Mirror 22: 0x911fdc5e (stale) Mirror 23: 0x911fdc5e (stale) Mirror 24: 0x911fdc5e (stale) CRC-32 checksum value for chunk [0, 0x10e93): Mirror 1: 0x4a598c23 Mirror 25: 0x4a598c23 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10e93: skipped 000948 1788909635.599240 write 0x0173a4 thru 0x02498f (0xd5ec bytes) 000950 1788909635.666333 mapwrite 0x016f73 thru 0x01e50a (0x7598 bytes) 000951 1788909635.718691 mapwrite 0x0005c5 thru 0x004021 (0x3a5d bytes) 000953 1788909635.804429 MIRROR_RESYNC 14 mirrors 000956 1788909637.125424 mapwrite 0x023b27 thru 0x0290c6 (0x55a0 bytes) 000957 1788909637.229543 mapread 0x00afbf thru 0x01850c (0xd54e bytes) 000958 1788909637.243639 MIRROR_SPLIT mirror 5 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x303:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x290c7): Mirror 7: 0x843532f1 (stale) Mirror 13: 0x843532f1 (stale) Mirror 14: 0x843532f1 (stale) Mirror 15: 0x843532f1 (stale) Mirror 18: 0x843532f1 (stale) Mirror 19: 0x843532f1 (stale) Mirror 20: 0x843532f1 (stale) Mirror 21: 0x843532f1 (stale) Mirror 22: 0x843532f1 (stale) Mirror 23: 0x843532f1 (stale) Mirror 24: 0x843532f1 (stale) Mirror 25: 0x843532f1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x290c7): Mirror 7: 0x843532f1 (stale) Mirror 13: 0x843532f1 (stale) Mirror 14: 0x843532f1 (stale) Mirror 15: 0x843532f1 (stale) Mirror 18: 0x843532f1 (stale) Mirror 19: 0x843532f1 (stale) Mirror 20: 0x843532f1 (stale) Mirror 21: 0x843532f1 (stale) Mirror 22: 0x843532f1 (stale) Mirror 23: 0x843532f1 (stale) Mirror 24: 0x843532f1 (stale) Mirror 25: 0x843532f1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x290c7: skipped 000959 1788909637.570579 mapread 0x0166e6 thru 0x01dfb7 (0x78d2 bytes) 000960 1788909637.590101 mapwrite 0x030552 thru 0x034a5d (0x450c bytes) 000962 1788909637.660307 write 0x02b418 thru 0x03050c (0x50f5 bytes) 000963 1788909637.661089 mapread 0x00e022 thru 0x015622 (0x7601 bytes) 000964 1788909637.675512 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x34a5e): Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34a5e): Mirror 7: 0xa0440718 (stale) Mirror 13: 0xa0440718 (stale) Mirror 14: 0xa0440718 (stale) Mirror 15: 0xa0440718 (stale) Mirror 18: 0xa0440718 (stale) Mirror 19: 0xa0440718 (stale) Mirror 20: 0xa0440718 (stale) Mirror 21: 0xa0440718 (stale) Mirror 22: 0xa0440718 (stale) Mirror 23: 0xa0440718 (stale) Mirror 24: 0xa0440718 (stale) Mirror 25: 0xa0440718 (stale) CRC-32 checksum value for chunk [0, 0x34a5e): Mirror 1: 0x3688b525 Mirror 26: 0x3688b525 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34a5e: skipped 000965 1788909638.386589 mapwrite 0x0259ef thru 0x02ab52 (0x5164 bytes) 000967 1788909638.526555 MIRROR_RESYNC 14 mirrors 000970 1788909639.810083 read 0x0209d7 thru 0x02dee5 (0xd50f bytes) 000974 1788909639.826544 read 0x024b09 thru 0x02bed0 (0x73c8 bytes) 000975 1788909639.827906 trunc from 0x034a5e to 0x020a42 (0x1401b bytes) 000978 1788909639.883102 mapwrite 0x0221b7 thru 0x02bf1d (0x9d67 bytes) 000980 1788909639.976942 MIRROR_SPLIT mirror 3 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x303:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2bf1e): Mirror 7: 0xb3da504a (stale) Mirror 13: 0xb3da504a (stale) Mirror 15: 0xb3da504a (stale) Mirror 18: 0xb3da504a (stale) Mirror 19: 0xb3da504a (stale) Mirror 20: 0xb3da504a (stale) Mirror 21: 0xb3da504a (stale) Mirror 22: 0xb3da504a (stale) Mirror 23: 0xb3da504a (stale) Mirror 24: 0xb3da504a (stale) Mirror 25: 0xb3da504a (stale) Mirror 26: 0xb3da504a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bf1e): Mirror 7: 0xb3da504a (stale) Mirror 13: 0xb3da504a (stale) Mirror 15: 0xb3da504a (stale) Mirror 18: 0xb3da504a (stale) Mirror 19: 0xb3da504a (stale) Mirror 20: 0xb3da504a (stale) Mirror 21: 0xb3da504a (stale) Mirror 22: 0xb3da504a (stale) Mirror 23: 0xb3da504a (stale) Mirror 24: 0xb3da504a (stale) Mirror 25: 0xb3da504a (stale) Mirror 26: 0xb3da504a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bf1e: skipped 000982 1788909640.564473 write 0x0176a3 thru 0x023727 (0xc085 bytes) 000983 1788909640.584055 read 0x01636b thru 0x0245e6 (0xe27c bytes) 000985 1788909640.597065 MIRROR_RESYNC 13 mirrors 000988 1788909641.889515 mapwrite 0x000e74 thru 0x009812 (0x899f bytes) 000989 1788909642.059700 write 0x03813e thru 0x039e65 (0x1d28 bytes) 000991 1788909642.069972 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x39e66): Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39e66): Mirror 7: 0xee0552d2 (stale) Mirror 13: 0xee0552d2 (stale) Mirror 15: 0xee0552d2 (stale) Mirror 18: 0xee0552d2 (stale) Mirror 19: 0xee0552d2 (stale) Mirror 20: 0xee0552d2 (stale) Mirror 21: 0xee0552d2 (stale) Mirror 22: 0xee0552d2 (stale) Mirror 23: 0xee0552d2 (stale) Mirror 24: 0xee0552d2 (stale) Mirror 25: 0xee0552d2 (stale) Mirror 26: 0xee0552d2 (stale) CRC-32 checksum value for chunk [0, 0x39e66): Mirror 1: 0xdda238b1 Mirror 27: 0xdda238b1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39e66: skipped 000992 1788909642.999956 trunc from 0x039e66 to 0x01ab02 (0x1f363 bytes) 000994 1788909643.182014 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x1ab03): Mirror 7: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ab03): Mirror 7: 0x58575eea (stale) Mirror 13: 0x58575eea (stale) Mirror 15: 0x58575eea (stale) Mirror 18: 0x58575eea (stale) Mirror 19: 0x58575eea (stale) Mirror 20: 0x58575eea (stale) Mirror 21: 0x58575eea (stale) Mirror 22: 0x58575eea (stale) Mirror 23: 0x58575eea (stale) Mirror 24: 0x58575eea (stale) Mirror 25: 0x58575eea (stale) Mirror 26: 0x58575eea (stale) Mirror 27: 0x75bae006 (stale) CRC-32 checksum value for chunk [0, 0x1ab03): Mirror 1: 0x75bae006 Mirror 28: 0x75bae006 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ab03: skipped 000999 1788909644.067975 read 0x00cf08 thru 0x016e7a (0x9f73 bytes) 001000 1788909644.085580 mapwrite 0x015860 thru 0x0224ba (0xcc5b bytes) All operations completed A-OK!