== sanity-flr test 70a: flr mode fsx test ================ 04:12:56 (1788941576) Seed set to 1579 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000004 1788941579.285304 write 0x028c8f thru 0x0327eb (0x9b5d bytes) 000005 1788941579.298989 punch from 0x0174fb to 0x01d5bb (0x60c1 bytes) 000006 1788941579.361881 write 0x02d571 thru 0x02dbea (0x67a bytes) 000007 1788941579.363965 write 0x011120 thru 0x01cbed (0xbace bytes) 000008 1788941579.400399 punch from 0x00cb72 to 0x01b7de (0xec6d bytes) 000010 1788941579.414987 write 0x02626a thru 0x02e40e (0x81a5 bytes) 000011 1788941579.420729 mapwrite 0x007e8c thru 0x00e56c (0x66e1 bytes) 000012 1788941579.486998 read 0x02626d thru 0x02c51f (0x62b3 bytes) 000014 1788941579.488748 punch from 0x01b5f2 to 0x020249 (0x4c58 bytes) 000015 1788941579.496417 mapwrite 0x038758 thru 0x03ffff (0x78a8 bytes) 000018 1788941579.578675 punch from 0x01fb2f to 0x024e32 (0x5304 bytes) 000020 1788941579.586030 write 0x0127b2 thru 0x01e442 (0xbc91 bytes) 000021 1788941579.606042 MIRROR_EXTEND to 2 mirrors 000022 1788941580.275720 MIRROR_RESYNC 2 mirrors 000023 1788941580.807593 read 0x029678 thru 0x02c9d0 (0x3359 bytes) truncating to largest ever: 0x99da 000025 1788941580.821279 trunc from 0x040000 to 0x0099d9 (0x36626 bytes) 000026 1788941581.047809 mapwrite 0x026fda thru 0x02d667 (0x668e bytes) truncating to largest ever: 0x1996c 000028 1788941581.180933 trunc from 0x02d668 to 0x01996b (0x13cfc bytes) 000029 1788941581.199507 mapread 0x0191fd thru 0x01996b (0x76f bytes) 000030 1788941581.213245 mapwrite 0x03b2e2 thru 0x03ffff (0x4d1e bytes) 000031 1788941581.291473 punch from 0x022639 to 0x024f1e (0x28e6 bytes) 000033 1788941581.299684 mapread 0x02cca6 thru 0x033ce2 (0x703d bytes) 000034 1788941581.314812 mapread 0x038ac2 thru 0x03ffff (0x753e bytes) 000036 1788941581.317339 trunc from 0x040000 to 0x009522 (0x36add bytes) 000037 1788941581.339678 punch from 0x005c2f to 0x005ed4 (0x2a6 bytes) 000038 1788941581.346603 read 0x0029e7 thru 0x009522 (0x6b3c bytes) 000039 1788941581.364910 mapread 0x0043d9 thru 0x009522 (0x514a bytes) 000040 1788941581.365832 punch from 0x008535 to 0x009522 (0xfee bytes) 000043 1788941581.372926 read 0x001871 thru 0x009522 (0x7cb2 bytes) 000044 1788941581.379408 punch from 0x005a3b to 0x007880 (0x1e46 bytes) 000046 1788941581.390659 mapread 0x00510e thru 0x009522 (0x4415 bytes) 000048 1788941581.412184 read 0x0094c7 thru 0x009522 (0x5c bytes) 000049 1788941581.420642 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x9523): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9523): Mirror 2: 0xa3b76d84 (stale) CRC-32 checksum value for chunk [0, 0x9523): Mirror 1: 0xdf5c2ac3 Mirror 3: 0xdf5c2ac3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9523: skipped 000051 1788941582.454011 read 0x007323 thru 0x009522 (0x2200 bytes) 000052 1788941582.470938 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x9523): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9523): Mirror 2: 0xa3b76d84 (stale) CRC-32 checksum value for chunk [0, 0x9523): Mirror 1: 0xdf5c2ac3 Mirror 3: 0xdf5c2ac3 Mirror 4: 0xdf5c2ac3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9523: skipped 000053 1788941583.521226 trunc from 0x009523 to 0x0102d0 (0x6dae bytes) 000054 1788941583.605648 read 0x009378 thru 0x00dfad (0x4c36 bytes) 000055 1788941583.615145 mapwrite 0x032884 thru 0x03ffff (0xd77c bytes) 000056 1788941583.747939 mapread 0x0207cc thru 0x027e50 (0x7685 bytes) 000058 1788941583.773604 mapwrite 0x0066dc thru 0x00c14d (0x5a72 bytes) 000059 1788941583.856233 trunc from 0x040000 to 0x00ea58 (0x315a7 bytes) 000061 1788941583.901113 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xea59): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xea59): Mirror 2: 0xcf9ceb53 (stale) Mirror 3: 0x7a13310c (stale) Mirror 4: 0x7a13310c (stale) CRC-32 checksum value for chunk [0, 0xea59): Mirror 1: 0x9233d3b0 Mirror 5: 0x9233d3b0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xea59: skipped 000065 1788941585.080877 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xea59): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xea59): Mirror 2: 0xcf9ceb53 (stale) Mirror 3: 0x7a13310c (stale) Mirror 4: 0x7a13310c (stale) CRC-32 checksum value for chunk [0, 0xea59): Mirror 1: 0x9233d3b0 Mirror 5: 0x9233d3b0 Mirror 6: 0x9233d3b0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xea59: skipped 000066 1788941586.276141 punch from 0x00c130 to 0x00ea58 (0x2929 bytes) 000068 1788941586.395466 MIRROR_RESYNC 6 mirrors 000069 1788941587.924671 write 0x009aed thru 0x0196b2 (0xfbc6 bytes) 000071 1788941588.070683 mapwrite 0x00021d thru 0x00861b (0x83ff bytes) 000075 1788941588.187079 trunc from 0x0196b3 to 0x002803 (0x16eaf bytes) 000078 1788941588.244996 punch from 0x0005d2 to 0x002803 (0x2232 bytes) 000079 1788941588.256366 write 0x003a7a thru 0x00b1bc (0x7743 bytes) 000080 1788941588.258135 mapread 0x003925 thru 0x00b1bc (0x7898 bytes) 000082 1788941588.262736 mapread 0x002531 thru 0x00389f (0x136f bytes) 000085 1788941588.277635 write 0x00fe59 thru 0x01be36 (0xbfde bytes) 000087 1788941588.279958 write 0x0307b8 thru 0x03c1d3 (0xba1c bytes) 000088 1788941588.282311 mapwrite 0x02c2ea thru 0x0344c8 (0x81df bytes) 000089 1788941588.389307 read 0x026813 thru 0x0343a0 (0xdb8e bytes) truncating to largest ever: 0x2f84b 000090 1788941588.394597 trunc from 0x03c1d4 to 0x02f84a (0xc989 bytes) 000091 1788941588.452203 mapwrite 0x022076 thru 0x02277e (0x709 bytes) 000093 1788941588.577606 mapwrite 0x01b8e7 thru 0x02780c (0xbf26 bytes) 000095 1788941588.718040 trunc from 0x02f84b to 0x02b567 (0x42e3 bytes) truncating to largest ever: 0x3ff26 000096 1788941588.764469 trunc from 0x02b568 to 0x03ff25 (0x149be bytes) 000097 1788941588.846993 read 0x03c67c thru 0x03ff25 (0x38aa bytes) 000099 1788941588.916863 write 0x01bc6d thru 0x01e5b6 (0x294a bytes) 000101 1788941588.925940 read 0x01e342 thru 0x02112d (0x2dec bytes) 000102 1788941588.927567 write 0x007448 thru 0x00e20f (0x6dc8 bytes) 000103 1788941588.938452 punch from 0x00ef0b to 0x0170be (0x81b4 bytes) 000104 1788941588.994178 write 0x0022ef thru 0x00aacc (0x87de bytes) 000105 1788941588.997115 write 0x02211a thru 0x030dc7 (0xecae bytes) 000107 1788941589.000698 read 0x03ae98 thru 0x03ff25 (0x508e bytes) 000108 1788941589.002102 read 0x00000f thru 0x0022c7 (0x22b9 bytes) 000109 1788941589.004427 trunc from 0x03ff26 to 0x01ba7c (0x244a9 bytes) 000110 1788941589.038605 mapread 0x0115a9 thru 0x012804 (0x125c bytes) 000111 1788941589.064413 trunc from 0x01ba7d to 0x027106 (0xb68a bytes) 000113 1788941589.102588 punch from 0x021890 to 0x025fef (0x4760 bytes) 000114 1788941589.125188 write 0x018407 thru 0x022045 (0x9c3f bytes) 000115 1788941589.136557 punch from 0x0222e7 to 0x023871 (0x158b bytes) 000117 1788941589.167636 write 0x035471 thru 0x03dc91 (0x8821 bytes) 000118 1788941589.170356 trunc from 0x03dc92 to 0x038d1d (0x4f74 bytes) 000122 1788941589.198041 trunc from 0x038d1e to 0x01b4e5 (0x1d838 bytes) 000123 1788941589.234984 read 0x0028cf thru 0x00adee (0x8520 bytes) 000124 1788941589.238399 mapread 0x00c1c4 thru 0x012378 (0x61b5 bytes) 000125 1788941589.243930 read 0x003ad8 thru 0x009656 (0x5b7f bytes) 000126 1788941589.261143 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b4e6): Mirror 2: 0xe0e2b994 (stale) Mirror 4: 0xe0e2b994 (stale) Mirror 5: 0xe0e2b994 (stale) Mirror 6: 0xe0e2b994 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b4e6): Mirror 2: 0xe0e2b994 (stale) Mirror 4: 0xe0e2b994 (stale) Mirror 5: 0xe0e2b994 (stale) Mirror 6: 0xe0e2b994 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b4e6: skipped 000127 1788941590.073756 mapread 0x0175f1 thru 0x01b4e5 (0x3ef5 bytes) 000128 1788941590.127268 punch from 0x008710 to 0x00ef91 (0x6882 bytes) 000129 1788941590.132838 punch from 0x0164d8 to 0x019909 (0x3432 bytes) 000130 1788941590.142219 read 0x007bb2 thru 0x00d844 (0x5c93 bytes) 000131 1788941590.165435 mapread 0x003e13 thru 0x00591b (0x1b09 bytes) 000132 1788941590.207401 trunc from 0x01b4e6 to 0x03761e (0x1c139 bytes) 000137 1788941590.266234 punch from 0x00d360 to 0x01a8ff (0xd5a0 bytes) 000138 1788941590.298286 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3761f): Mirror 2: 0x7bb1aca2 (stale) Mirror 5: 0x7bb1aca2 (stale) Mirror 6: 0x7bb1aca2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3761f): Mirror 2: 0x7bb1aca2 (stale) Mirror 5: 0x7bb1aca2 (stale) Mirror 6: 0x7bb1aca2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3761f: skipped 000139 1788941591.036052 mapread 0x00214a thru 0x0033da (0x1291 bytes) 000140 1788941591.050418 mapread 0x013222 thru 0x016b86 (0x3965 bytes) 000141 1788941591.062678 mapwrite 0x00ab1e thru 0x00f019 (0x44fc bytes) 000143 1788941591.195812 punch from 0x0347b8 to 0x03761e (0x2e67 bytes) 000145 1788941591.206655 mapread 0x0067db thru 0x00f0c1 (0x88e7 bytes) 000147 1788941591.208523 mapread 0x0318c5 thru 0x03761e (0x5d5a bytes) 000148 1788941591.221144 read 0x02b348 thru 0x02c66f (0x1328 bytes) 000149 1788941591.222050 write 0x0242e9 thru 0x02edae (0xaac6 bytes) 000150 1788941591.229307 trunc from 0x03761f to 0x026de9 (0x10835 bytes) 000153 1788941591.255315 mapread 0x01da65 thru 0x026de9 (0x9385 bytes) 000154 1788941591.265424 mapread 0x01a0fc thru 0x026de9 (0xccee bytes) 000155 1788941591.270317 MIRROR_RESYNC 4 mirrors 000158 1788941592.383033 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) 000160 1788941592.753407 punch from 0x0065b5 to 0x00d8a3 (0x72ef bytes) 000161 1788941592.862366 mapwrite 0x02f507 thru 0x03c720 (0xd21a bytes) 000163 1788941593.071118 punch from 0x014092 to 0x022655 (0xe5c4 bytes) 000164 1788941593.083110 mapwrite 0x00d0f7 thru 0x013505 (0x640f bytes) 000165 1788941593.193139 mapwrite 0x02bd13 thru 0x0372b6 (0xb5a4 bytes) 000167 1788941593.292016 write 0x02d799 thru 0x030ce5 (0x354d bytes) 000170 1788941593.302175 punch from 0x02f30f to 0x037b82 (0x8874 bytes) 000172 1788941593.344258 trunc from 0x03c721 to 0x02ca79 (0xfca7 bytes) 000173 1788941593.378150 write 0x0265d6 thru 0x02bfec (0x5a17 bytes) 000174 1788941593.399630 write 0x00be3a thru 0x00d184 (0x134b bytes) 000176 1788941593.410010 write 0x00c552 thru 0x013650 (0x70ff bytes) 000177 1788941593.420269 punch from 0x01c7cf to 0x02bc36 (0xf468 bytes) 000179 1788941593.456189 mapwrite 0x021fca thru 0x0232c1 (0x12f8 bytes) 000185 1788941593.550337 read 0x00b4ec thru 0x0150ac (0x9bc1 bytes) 000187 1788941593.557360 trunc from 0x02ca7a to 0x03f2de (0x12865 bytes) 000189 1788941593.599742 mapread 0x03279d thru 0x039b26 (0x738a bytes) 000193 1788941593.623179 mapwrite 0x01be04 thru 0x029e0e (0xe00b bytes) 000194 1788941593.667731 punch from 0x025be2 to 0x0322d0 (0xc6ef bytes) 000195 1788941593.672940 punch from 0x01f293 to 0x022246 (0x2fb4 bytes) 000196 1788941593.677435 write 0x00a87c thru 0x013ced (0x9472 bytes) 000198 1788941593.679104 mapread 0x00fdf0 thru 0x01ba2b (0xbc3c bytes) 000199 1788941593.687582 trunc from 0x03f2df to 0x024156 (0x1b188 bytes) 000200 1788941593.705063 mapwrite 0x023a17 thru 0x026002 (0x25ec bytes) 000201 1788941593.827360 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x26003): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26003): Mirror 5: 0x606c2365 (stale) Mirror 6: 0x606c2365 (stale) CRC-32 checksum value for chunk [0, 0x26003): Mirror 1: 0xff955cdb Mirror 7: 0xff955cdb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26003: skipped 000202 1788941595.358714 trunc from 0x026003 to 0x01a2ad (0xbd55 bytes) 000203 1788941595.503280 mapread 0x01597a thru 0x01a2ad (0x4934 bytes) 000204 1788941595.576074 mapwrite 0x009486 thru 0x0130db (0x9c56 bytes) 000205 1788941595.703084 write 0x008ad9 thru 0x018356 (0xf87e bytes) 000208 1788941595.705289 read 0x00b074 thru 0x00b2b3 (0x240 bytes) 000211 1788941595.721223 write 0x03bd4e thru 0x03ffff (0x42b2 bytes) 000214 1788941595.732557 read 0x0317df thru 0x03ec39 (0xd45b bytes) 000215 1788941595.753748 read 0x00e35e thru 0x01aeef (0xcb92 bytes) 000216 1788941595.755172 write 0x00f0fd thru 0x01bb4e (0xca52 bytes) 000217 1788941595.775294 MIRROR_RESYNC 4 mirrors 000219 1788941597.604207 MIRROR_RESYNC 4 mirrors 000220 1788941598.310557 read 0x0224d4 thru 0x02f6a3 (0xd1d0 bytes) 000221 1788941598.329191 read 0x01d698 thru 0x028642 (0xafab bytes) 000223 1788941598.353368 mapwrite 0x00f36f thru 0x01e377 (0xf009 bytes) 000224 1788941598.919943 punch from 0x01dd95 to 0x023e79 (0x60e5 bytes) 000225 1788941598.939543 punch from 0x03c52f to 0x03ecda (0x27ac bytes) 000226 1788941598.952550 punch from 0x005a7d to 0x00c1f0 (0x6774 bytes) 000229 1788941598.983548 MIRROR_RESYNC 4 mirrors 000231 1788941600.779903 mapwrite 0x012063 thru 0x012689 (0x627 bytes) 000232 1788941601.073007 punch from 0x03840a to 0x03ffff (0x7bf6 bytes) 000233 1788941601.105431 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x8d20397 (stale) Mirror 7: 0x8d20397 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x8d20397 (stale) Mirror 7: 0x8d20397 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000234 1788941601.746679 mapread 0x027e70 thru 0x029302 (0x1493 bytes) 000235 1788941601.815248 trunc from 0x040000 to 0x00bec5 (0x3413a bytes) 000236 1788941601.845986 mapwrite 0x0369e8 thru 0x03ffff (0x9618 bytes) 000237 1788941602.015908 mapread 0x03e096 thru 0x03ffff (0x1f6a bytes) 000238 1788941602.016920 trunc from 0x040000 to 0x03dce6 (0x2319 bytes) 000239 1788941602.051332 trunc from 0x03dce7 to 0x02d44d (0x10899 bytes) 000240 1788941602.075110 read 0x00271e thru 0x00cce9 (0xa5cc bytes) 000241 1788941602.086573 trunc from 0x02d44e to 0x032a6b (0x561e bytes) 000242 1788941602.115712 read 0x0108ab thru 0x01aa73 (0xa1c9 bytes) 000243 1788941602.129066 write 0x000601 thru 0x00116c (0xb6c bytes) 000244 1788941602.130441 punch from 0x0273c2 to 0x030b95 (0x97d4 bytes) 000247 1788941602.152047 MIRROR_RESYNC 3 mirrors 000248 1788941603.614205 MIRROR_RESYNC 3 mirrors 000249 1788941604.134518 read 0x02f61b thru 0x032a6b (0x3451 bytes) 000252 1788941604.179838 write 0x025ec6 thru 0x0303da (0xa515 bytes) 000253 1788941604.384743 read 0x016ede thru 0x022b79 (0xbc9c bytes) 000254 1788941604.408259 trunc from 0x032a6c to 0x010454 (0x22617 bytes) 000255 1788941604.468330 mapread 0x000434 thru 0x007993 (0x7560 bytes) 000257 1788941604.478254 punch from 0x006248 to 0x00b4ed (0x52a6 bytes) 000258 1788941604.498968 write 0x02a6c4 thru 0x030303 (0x5c40 bytes) 000260 1788941604.500897 mapwrite 0x031ccc thru 0x03919c (0x74d1 bytes) 000261 1788941604.640987 punch from 0x030dc0 to 0x03919c (0x83dd bytes) 000263 1788941604.652170 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3919d): Mirror 5: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3919d): Mirror 5: 0xb036ee86 (stale) Mirror 7: 0xb036ee86 (stale) CRC-32 checksum value for chunk [0, 0x3919d): Mirror 1: 0x1a326b03 Mirror 8: 0x1a326b03 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3919d: skipped 000264 1788941605.978972 write 0x028c0b thru 0x02ca03 (0x3df9 bytes) 000265 1788941606.061723 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3919d): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3919d): Mirror 5: 0xb036ee86 (stale) Mirror 7: 0xb036ee86 (stale) Mirror 8: 0x1a326b03 (stale) CRC-32 checksum value for chunk [0, 0x3919d): Mirror 1: 0x8b70c276 Mirror 9: 0x8b70c276 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3919d: skipped 000268 1788941607.298043 write 0x0240d5 thru 0x03001a (0xbf46 bytes) 000271 1788941607.528641 mapread 0x02908e thru 0x029a54 (0x9c7 bytes) 000273 1788941607.546872 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3919d): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3919d): Mirror 5: 0xb036ee86 (stale) Mirror 7: 0xb036ee86 (stale) Mirror 8: 0x1a326b03 (stale) Mirror 9: 0x8b70c276 (stale) CRC-32 checksum value for chunk [0, 0x3919d): Mirror 1: 0xcf86d4d2 Mirror 10: 0xcf86d4d2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3919d: skipped 000274 1788941609.398109 mapread 0x014b33 thru 0x01902b (0x44f9 bytes) 000275 1788941609.428244 write 0x02873a thru 0x028819 (0xe0 bytes) 000276 1788941609.510939 read 0x029dee thru 0x03412a (0xa33d bytes) 000277 1788941609.526307 write 0x00818b thru 0x0128f7 (0xa76d bytes) 000278 1788941609.543124 write 0x0034c7 thru 0x00c90d (0x9447 bytes) 000279 1788941609.551097 mapread 0x01ac2d thru 0x01bc37 (0x100b bytes) 000280 1788941609.563594 write 0x008c5f thru 0x017813 (0xebb5 bytes) 000281 1788941609.567130 read 0x00352e thru 0x0043e8 (0xebb bytes) 000282 1788941609.568338 mapread 0x017c70 thru 0x01cde5 (0x5176 bytes) 000283 1788941609.569414 trunc from 0x03919d to 0x009ead (0x2f2ef bytes) 000284 1788941609.608528 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x9eae): Mirror 5: 0x94e6fa92 (stale) Mirror 8: 0x94e6fa92 (stale) Mirror 9: 0x94e6fa92 (stale) Mirror 10: 0x94e6fa92 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9eae): Mirror 5: 0x94e6fa92 (stale) Mirror 8: 0x94e6fa92 (stale) Mirror 9: 0x94e6fa92 (stale) Mirror 10: 0x94e6fa92 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9eae: skipped 000285 1788941610.311228 trunc from 0x009eae to 0x00d5ba (0x370d bytes) 000286 1788941610.337498 mapwrite 0x030576 thru 0x0368f5 (0x6380 bytes) 000287 1788941610.428669 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x368f6): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x368f6): Mirror 5: 0xef8bbab (stale) Mirror 8: 0x64771c9f (stale) Mirror 9: 0xb199579d (stale) Mirror 10: 0x26f7fc32 (stale) CRC-32 checksum value for chunk [0, 0x368f6): Mirror 1: 0x27e3687a Mirror 11: 0x27e3687a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x368f6: skipped 000288 1788941611.720662 trunc from 0x0368f6 to 0x00a3ef (0x2c506 bytes) 000290 1788941611.892004 trunc from 0x00a3f0 to 0x001054 (0x939b bytes) 000291 1788941611.922055 read 0x000dd4 thru 0x001054 (0x281 bytes) 000292 1788941611.930021 read 0x000766 thru 0x001054 (0x8ef bytes) 000293 1788941611.931310 mapread 0x000b61 thru 0x001054 (0x4f4 bytes) 000295 1788941611.934555 trunc from 0x001055 to 0x005a4f (0x49fb bytes) 000297 1788941611.969176 write 0x02be7f thru 0x034271 (0x83f3 bytes) 000298 1788941611.973174 write 0x03838e thru 0x03ffff (0x7c72 bytes) 000299 1788941611.975372 punch from 0x00d62a to 0x01d2f4 (0xfccb bytes) 000300 1788941611.994528 punch from 0x00491a to 0x00c51b (0x7c02 bytes) 000301 1788941612.002556 mapwrite 0x01d2b5 thru 0x02ad64 (0xdab0 bytes) 000303 1788941612.107289 write 0x00def1 thru 0x01479a (0x68aa bytes) 000305 1788941612.111553 mapread 0x014a21 thru 0x014f46 (0x526 bytes) 000306 1788941612.119282 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x70296946 (stale) Mirror 8: 0x958ca642 (stale) Mirror 9: 0xbb8250df (stale) Mirror 10: 0xff00f5ee (stale) Mirror 11: 0x3df9193 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6b5bbd08 Mirror 12: 0x6b5bbd08 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000307 1788941613.528052 write 0x028d84 thru 0x0386b9 (0xf936 bytes) 000308 1788941613.646619 read 0x01d40e thru 0x023a6e (0x6661 bytes) 000309 1788941613.660684 punch from 0x02344a to 0x02734b (0x3f02 bytes) 000310 1788941613.708122 mapwrite 0x0272d0 thru 0x0364ee (0xf21f bytes) 000311 1788941613.790559 mapwrite 0x02c39d thru 0x03b03d (0xeca1 bytes) 000312 1788941613.872812 write 0x01dc8d thru 0x028be9 (0xaf5d bytes) 000313 1788941613.878955 MIRROR_RESYNC 7 mirrors 000317 1788941615.325161 punch from 0x01584b to 0x024fa6 (0xf75c bytes) 000319 1788941615.456106 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xbbf66b17 (stale) Mirror 8: 0xbbf66b17 (stale) Mirror 9: 0xbbf66b17 (stale) Mirror 10: 0xbbf66b17 (stale) Mirror 11: 0xbbf66b17 (stale) Mirror 12: 0xbbf66b17 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x62ac8b98 Mirror 13: 0x62ac8b98 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000320 1788941617.061534 mapread 0x003a99 thru 0x00b883 (0x7deb bytes) 000321 1788941617.108608 punch from 0x00bb31 to 0x01498c (0x8e5c bytes) 000322 1788941617.225956 punch from 0x01ec6a to 0x02cea0 (0xe237 bytes) 000323 1788941617.253426 mapread 0x0050ab thru 0x0110b3 (0xc009 bytes) 000324 1788941617.331148 write 0x025a17 thru 0x030494 (0xaa7e bytes) 000325 1788941617.355606 read 0x02b699 thru 0x036c91 (0xb5f9 bytes) 000326 1788941617.359257 MIRROR_RESYNC 8 mirrors 000327 1788941619.102253 trunc from 0x040000 to 0x02d6c9 (0x12936 bytes) 000328 1788941619.197982 trunc from 0x02d6ca to 0x01a3f5 (0x132d4 bytes) 000329 1788941619.227370 mapwrite 0x003448 thru 0x006091 (0x2c4a bytes) 000330 1788941619.327229 punch from 0x002e92 to 0x0032de (0x44d bytes) 000331 1788941619.340515 trunc from 0x01a3f6 to 0x02e318 (0x13f23 bytes) 000332 1788941619.365458 read 0x02a1cf thru 0x02bce7 (0x1b19 bytes) 000333 1788941619.373604 trunc from 0x02e319 to 0x030a04 (0x26ec bytes) 000334 1788941619.393447 read 0x027dba thru 0x029f50 (0x2197 bytes) 000335 1788941619.413656 write 0x025bb9 thru 0x02959a (0x39e2 bytes) 000336 1788941619.414896 write 0x03878b thru 0x03d4cd (0x4d43 bytes) 000337 1788941619.417434 mapwrite 0x017873 thru 0x026426 (0xebb4 bytes) 000339 1788941619.468411 mapread 0x012c1c thru 0x013d7e (0x1163 bytes) 000340 1788941619.471157 mapread 0x001d30 thru 0x00ab8a (0x8e5b bytes) 000341 1788941619.472620 mapwrite 0x02e8b5 thru 0x03baa3 (0xd1ef bytes) 000342 1788941619.527015 trunc from 0x03d4ce to 0x03d4cd (0x0 bytes) 000343 1788941619.553661 trunc from 0x03d4ce to 0x005a52 (0x37a7b bytes) 000345 1788941619.573753 punch from 0x001647 to 0x004e8c (0x3846 bytes) 000346 1788941619.595493 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x5a53): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5a53): Mirror 5: 0xf7865c9c (stale) Mirror 8: 0xf7865c9c (stale) Mirror 9: 0xf7865c9c (stale) Mirror 10: 0xf7865c9c (stale) Mirror 11: 0xf7865c9c (stale) Mirror 12: 0xf7865c9c (stale) Mirror 13: 0xf7865c9c (stale) CRC-32 checksum value for chunk [0, 0x5a53): Mirror 1: 0x19766c46 Mirror 14: 0x19766c46 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5a53: skipped 000347 1788941620.858946 read 0x000b52 thru 0x005a52 (0x4f01 bytes) 000348 1788941620.900184 trunc from 0x005a53 to 0x010161 (0xa70f bytes) 000349 1788941621.085316 read 0x00f052 thru 0x010161 (0x1110 bytes) 000350 1788941621.114387 trunc from 0x010162 to 0x00a9c3 (0x579e bytes) 000351 1788941621.141232 write 0x004ae3 thru 0x00a73a (0x5c58 bytes) 000353 1788941621.142969 mapwrite 0x03245d thru 0x03f330 (0xced4 bytes) 000354 1788941621.266403 punch from 0x02ebf5 to 0x031677 (0x2a83 bytes) 000355 1788941621.284394 mapwrite 0x03549d thru 0x03cbc2 (0x7726 bytes) 000356 1788941621.357301 trunc from 0x03f331 to 0x026766 (0x18bca bytes) 000357 1788941621.391855 trunc from 0x026767 to 0x02e9f4 (0x828e bytes) 000358 1788941621.423422 mapwrite 0x0363a3 thru 0x03c95b (0x65b9 bytes) 000365 1788941621.623136 read 0x002189 thru 0x0042b7 (0x212f bytes) 000366 1788941621.624392 mapwrite 0x003291 thru 0x012fd4 (0xfd44 bytes) 000367 1788941621.821649 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c95c): Mirror 5: 0xa91114dc (stale) Mirror 8: 0xa91114dc (stale) Mirror 9: 0xa91114dc (stale) Mirror 10: 0xa91114dc (stale) Mirror 11: 0xa91114dc (stale) Mirror 12: 0xa91114dc (stale) Mirror 14: 0xf34e9677 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c95c): Mirror 5: 0xa91114dc (stale) Mirror 8: 0xa91114dc (stale) Mirror 9: 0xa91114dc (stale) Mirror 10: 0xa91114dc (stale) Mirror 11: 0xa91114dc (stale) Mirror 12: 0xa91114dc (stale) Mirror 14: 0xf34e9677 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c95c: skipped 000368 1788941622.342007 write 0x03d3ed thru 0x03ffff (0x2c13 bytes) 000369 1788941622.343156 punch from 0x031d9a to 0x03ffff (0xe266 bytes) 000370 1788941622.354611 read 0x009749 thru 0x00fdd9 (0x6691 bytes) 000371 1788941622.369173 mapwrite 0x018109 thru 0x0196de (0x15d6 bytes) 000372 1788941622.419126 write 0x02c26a thru 0x0365db (0xa372 bytes) 000373 1788941622.430442 write 0x00d5b0 thru 0x019536 (0xbf87 bytes) 000374 1788941622.432040 write 0x0280b3 thru 0x02c0e8 (0x4036 bytes) 000375 1788941622.439633 mapread 0x01d6d6 thru 0x01f3d5 (0x1d00 bytes) 000377 1788941622.456993 mapwrite 0x007268 thru 0x013b8a (0xc923 bytes) 000378 1788941622.544413 trunc from 0x040000 to 0x012bc5 (0x2d43a bytes) 000379 1788941622.564381 read 0x00aacb thru 0x012bc5 (0x80fb bytes) 000380 1788941622.572057 MIRROR_RESYNC 8 mirrors 000384 1788941624.494555 mapwrite 0x03b0ae thru 0x03ffff (0x4f52 bytes) 000385 1788941624.708233 write 0x03e2fc thru 0x03ffff (0x1d04 bytes) 000386 1788941624.709104 mapread 0x012588 thru 0x01a788 (0x8201 bytes) 000388 1788941624.716966 write 0x01f8ec thru 0x0274b0 (0x7bc5 bytes) 000389 1788941624.725991 read 0x020c54 thru 0x02b9ed (0xad9a bytes) 000390 1788941624.730520 mapwrite 0x033e4b thru 0x03fa5f (0xbc15 bytes) 000391 1788941624.784096 mapread 0x03acb4 thru 0x03ffff (0x534c bytes) 000392 1788941624.785098 punch from 0x0144d1 to 0x020b68 (0xc698 bytes) 000394 1788941624.791264 mapwrite 0x0299d0 thru 0x029fe2 (0x613 bytes) 000395 1788941624.836113 MIRROR_RESYNC 8 mirrors 000396 1788941626.371889 punch from 0x01f237 to 0x02a795 (0xb55f bytes) 000397 1788941626.528403 write 0x019b8f thru 0x022ca2 (0x9114 bytes) 000398 1788941626.553927 trunc from 0x040000 to 0x01b519 (0x24ae6 bytes) 000399 1788941626.601093 mapread 0x0033cf thru 0x006b12 (0x3744 bytes) 000401 1788941626.659945 trunc from 0x01b51a to 0x03956e (0x1e055 bytes) 000402 1788941626.704442 mapread 0x01a722 thru 0x026a19 (0xc2f8 bytes) 000403 1788941626.756352 write 0x035f97 thru 0x03e8f1 (0x895b bytes) 000404 1788941626.770988 write 0x032261 thru 0x034db9 (0x2b59 bytes) 000405 1788941626.794736 mapwrite 0x00aa98 thru 0x00d3d5 (0x293e bytes) 000407 1788941626.907576 punch from 0x037c51 to 0x03e8f1 (0x6ca1 bytes) 000408 1788941626.918816 write 0x0305c4 thru 0x039331 (0x8d6e bytes) 000409 1788941626.928595 read 0x02a324 thru 0x0387e9 (0xe4c6 bytes) 000410 1788941626.934594 write 0x03af0c thru 0x03ffff (0x50f4 bytes) 000411 1788941626.941015 write 0x00cd07 thru 0x016995 (0x9c8f bytes) 000412 1788941626.942332 punch from 0x01cbe6 to 0x0275b1 (0xa9cc bytes) 000413 1788941626.956691 mapread 0x0288fc thru 0x03408f (0xb794 bytes) 000414 1788941626.957986 trunc from 0x040000 to 0x004012 (0x3bfed bytes) 000415 1788941626.980592 read 0x0018ab thru 0x004012 (0x2768 bytes) 000416 1788941626.986286 trunc from 0x004013 to 0x00d810 (0x97fe bytes) 000419 1788941627.021566 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0xd811): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd811): Mirror 5: 0xf55c616b (stale) Mirror 8: 0xf55c616b (stale) Mirror 9: 0xf55c616b (stale) Mirror 10: 0xf55c616b (stale) Mirror 11: 0xf55c616b (stale) Mirror 12: 0xf55c616b (stale) Mirror 14: 0xf55c616b (stale) CRC-32 checksum value for chunk [0, 0xd811): Mirror 1: 0x98da0e91 Mirror 15: 0x98da0e91 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd811: skipped 000420 1788941628.637967 punch from 0x00219f to 0x009efa (0x7d5c bytes) 000421 1788941628.928241 write 0x012cb9 thru 0x01bef8 (0x9240 bytes) 000422 1788941628.931538 read 0x012b2e thru 0x01bef8 (0x93cb bytes) 000423 1788941628.937866 read 0x0198b7 thru 0x01bef8 (0x2642 bytes) 000424 1788941628.938535 trunc from 0x01bef9 to 0x016b34 (0x53c4 bytes) 000425 1788941628.970195 mapwrite 0x017527 thru 0x020fd6 (0x9ab0 bytes) 000427 1788941629.153183 mapread 0x01cfca thru 0x01f4e6 (0x251d bytes) 000428 1788941629.154292 mapread 0x00346d thru 0x00fac6 (0xc65a bytes) 000429 1788941629.168823 mapread 0x0058b3 thru 0x00c505 (0x6c53 bytes) 000430 1788941629.179201 mapwrite 0x01b376 thru 0x0228e5 (0x7570 bytes) 000431 1788941629.382870 mapwrite 0x019b96 thru 0x027c86 (0xe0f1 bytes) 000432 1788941629.532440 punch from 0x013a69 to 0x013c2d (0x1c5 bytes) 000434 1788941629.543687 trunc from 0x027c87 to 0x001d64 (0x25f22 bytes) 000435 1788941629.576184 punch from 0x000ed8 to 0x001d64 (0xe8d bytes) 000438 1788941629.590045 mapread 0x001493 thru 0x001d64 (0x8d2 bytes) 000439 1788941629.596942 punch from 0x0013c7 to 0x001d64 (0x99e bytes) 000440 1788941629.602751 read 0x000b6e thru 0x001d64 (0x11f7 bytes) 000441 1788941629.613206 write 0x01a63e thru 0x01fb83 (0x5546 bytes) 000442 1788941629.615166 punch from 0x01103d to 0x01be6b (0xae2f bytes) 000443 1788941629.628253 mapread 0x01f2fe thru 0x01fb83 (0x886 bytes) 000444 1788941629.638686 MIRROR_RESYNC 9 mirrors 000445 1788941631.921490 write 0x031d2b thru 0x036670 (0x4946 bytes) 000446 1788941631.999178 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x36671): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36671): Mirror 5: 0xfda19bce (stale) Mirror 8: 0xfda19bce (stale) Mirror 9: 0xfda19bce (stale) Mirror 10: 0xfda19bce (stale) Mirror 11: 0xfda19bce (stale) Mirror 12: 0xfda19bce (stale) Mirror 14: 0xfda19bce (stale) Mirror 15: 0xfda19bce (stale) CRC-32 checksum value for chunk [0, 0x36671): Mirror 1: 0xf3912c0 Mirror 16: 0xf3912c0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36671: skipped 000447 1788941633.636622 trunc from 0x036671 to 0x0143b9 (0x222b7 bytes) 000448 1788941633.815970 read 0x0073ce thru 0x007fa3 (0xbd6 bytes) 000449 1788941633.827847 read 0x011eeb thru 0x0143b9 (0x24cf bytes) 000450 1788941633.843967 write 0x017ffb thru 0x019646 (0x164c bytes) 000453 1788941633.849740 write 0x002cf3 thru 0x009a32 (0x6d40 bytes) 000454 1788941633.852959 mapwrite 0x009379 thru 0x0108d2 (0x755a bytes) 000455 1788941633.953878 write 0x037764 thru 0x03ffff (0x889c bytes) 000458 1788941633.966286 mapread 0x001fea thru 0x00a1c9 (0x81e0 bytes) 000460 1788941633.971865 mapread 0x0078ec thru 0x01739b (0xfab0 bytes) 000461 1788941633.991638 mapread 0x011454 thru 0x0180d4 (0x6c81 bytes) 000462 1788941633.996147 write 0x012a02 thru 0x01dabd (0xb0bc bytes) 000463 1788941633.999909 punch from 0x03a67d to 0x03ffff (0x5983 bytes) 000465 1788941634.028164 trunc from 0x040000 to 0x03e93e (0x16c1 bytes) 000466 1788941634.057007 trunc from 0x03e93f to 0x00a8c5 (0x34079 bytes) 000467 1788941634.080320 punch from 0x0019e8 to 0x00a8c5 (0x8ede bytes) 000469 1788941634.086676 mapwrite 0x028e07 thru 0x02b98a (0x2b84 bytes) 000470 1788941634.182360 trunc from 0x02b98b to 0x039da1 (0xe417 bytes) 000471 1788941634.196650 write 0x033912 thru 0x03ff8a (0xc679 bytes) 000472 1788941634.204974 read 0x018f82 thru 0x01f533 (0x65b2 bytes) 000473 1788941634.237059 mapread 0x007172 thru 0x00b145 (0x3fd4 bytes) 000474 1788941634.238909 punch from 0x00b55c to 0x00d720 (0x21c5 bytes) 000475 1788941634.257504 MIRROR_RESYNC 10 mirrors 000476 1788941636.633513 mapread 0x01265a thru 0x020969 (0xe310 bytes) 000478 1788941636.682490 punch from 0x024acc to 0x033c50 (0xf185 bytes) 000479 1788941636.812614 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3ff8b): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ff8b): Mirror 5: 0x17addc92 (stale) Mirror 8: 0x17addc92 (stale) Mirror 9: 0x17addc92 (stale) Mirror 10: 0x17addc92 (stale) Mirror 11: 0x17addc92 (stale) Mirror 12: 0x17addc92 (stale) Mirror 14: 0x17addc92 (stale) Mirror 15: 0x17addc92 (stale) Mirror 16: 0x17addc92 (stale) CRC-32 checksum value for chunk [0, 0x3ff8b): Mirror 1: 0xe49ef349 Mirror 17: 0xe49ef349 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ff8b: skipped 000480 1788941638.219065 mapread 0x039ca1 thru 0x03a58f (0x8ef bytes) 000482 1788941638.250682 trunc from 0x03ff8b to 0x00ba9d (0x344ed bytes) 000484 1788941638.333882 mapread 0x005b4e thru 0x00ba9d (0x5f50 bytes) 000485 1788941638.350743 read 0x002856 thru 0x00a42d (0x7bd8 bytes) 000487 1788941638.351943 mapwrite 0x01230e thru 0x019538 (0x722b bytes) 000488 1788941638.443506 trunc from 0x019539 to 0x032472 (0x18f3a bytes) 000489 1788941638.461920 trunc from 0x032473 to 0x0246b5 (0xddbd bytes) 000490 1788941638.478928 trunc from 0x0246b6 to 0x037e1f (0x1376a bytes) 000491 1788941638.505135 MIRROR_RESYNC 11 mirrors 000494 1788941640.615752 mapwrite 0x01fe7a thru 0x02b40e (0xb595 bytes) 000496 1788941640.816634 punch from 0x0020fe to 0x00f4a3 (0xd3a6 bytes) 000498 1788941640.823147 mapwrite 0x00c40a thru 0x0133bd (0x6fb4 bytes) 000499 1788941640.901380 read 0x012176 thru 0x0135ef (0x147a bytes) 000501 1788941640.902526 mapread 0x0186c0 thru 0x024a13 (0xc354 bytes) 000502 1788941640.912235 trunc from 0x037e20 to 0x010828 (0x275f7 bytes) 000503 1788941640.965753 write 0x005051 thru 0x00da29 (0x89d9 bytes) 000504 1788941640.974542 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x10829): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x10829): Mirror 5: 0x54887aa1 (stale) Mirror 8: 0x54887aa1 (stale) Mirror 9: 0x54887aa1 (stale) Mirror 10: 0x54887aa1 (stale) Mirror 11: 0x54887aa1 (stale) Mirror 12: 0x54887aa1 (stale) Mirror 14: 0x54887aa1 (stale) Mirror 15: 0x54887aa1 (stale) Mirror 16: 0x54887aa1 (stale) Mirror 17: 0x54887aa1 (stale) CRC-32 checksum value for chunk [0, 0x10829): Mirror 1: 0x3bbb3dd1 Mirror 18: 0x3bbb3dd1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x10829: skipped 000505 1788941642.276928 trunc from 0x010829 to 0x0127b4 (0x1f8c bytes) 000506 1788941642.371745 read 0x00ad90 thru 0x00af47 (0x1b8 bytes) 000509 1788941642.378097 mapwrite 0x016cff thru 0x02107e (0xa380 bytes) 000510 1788941642.490156 write 0x00a0ed thru 0x01058c (0x64a0 bytes) 000511 1788941642.498465 punch from 0x0026f5 to 0x00b667 (0x8f73 bytes) 000512 1788941642.521012 MIRROR_RESYNC 12 mirrors 000513 1788941644.709434 write 0x034641 thru 0x03d6b2 (0x9072 bytes) 000516 1788941644.879342 write 0x00c087 thru 0x016ca8 (0xac22 bytes) 000517 1788941644.893194 read 0x01ac7c thru 0x01fb4c (0x4ed1 bytes) 000519 1788941644.916588 MIRROR_SPLIT mirror 4 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d6b3): Mirror 5: 0xb9ccb9bd (stale) Mirror 8: 0xb9ccb9bd (stale) Mirror 9: 0xb9ccb9bd (stale) Mirror 11: 0xb9ccb9bd (stale) Mirror 12: 0xb9ccb9bd (stale) Mirror 14: 0xb9ccb9bd (stale) Mirror 15: 0xb9ccb9bd (stale) Mirror 16: 0xb9ccb9bd (stale) Mirror 17: 0xb9ccb9bd (stale) Mirror 18: 0xb9ccb9bd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d6b3): Mirror 5: 0xb9ccb9bd (stale) Mirror 8: 0xb9ccb9bd (stale) Mirror 9: 0xb9ccb9bd (stale) Mirror 11: 0xb9ccb9bd (stale) Mirror 12: 0xb9ccb9bd (stale) Mirror 14: 0xb9ccb9bd (stale) Mirror 15: 0xb9ccb9bd (stale) Mirror 16: 0xb9ccb9bd (stale) Mirror 17: 0xb9ccb9bd (stale) Mirror 18: 0xb9ccb9bd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d6b3: skipped 000520 1788941645.498779 trunc from 0x03d6b3 to 0x01eda4 (0x1e90e bytes) 000522 1788941645.543267 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1eda5): Mirror 5: 0xf25a147f (stale) Mirror 8: 0xf25a147f (stale) Mirror 9: 0xf25a147f (stale) Mirror 11: 0xf25a147f (stale) Mirror 12: 0xf25a147f (stale) Mirror 14: 0xf25a147f (stale) Mirror 16: 0xf25a147f (stale) Mirror 17: 0xf25a147f (stale) Mirror 18: 0xf25a147f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1eda5): Mirror 5: 0xf25a147f (stale) Mirror 8: 0xf25a147f (stale) Mirror 9: 0xf25a147f (stale) Mirror 11: 0xf25a147f (stale) Mirror 12: 0xf25a147f (stale) Mirror 14: 0xf25a147f (stale) Mirror 16: 0xf25a147f (stale) Mirror 17: 0xf25a147f (stale) Mirror 18: 0xf25a147f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1eda5: skipped 000524 1788941646.183849 punch from 0x015fe2 to 0x01d374 (0x7393 bytes) 000526 1788941646.195843 trunc from 0x01eda5 to 0x025ce5 (0x6f41 bytes) 000527 1788941646.224563 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x25ce6): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25ce6): Mirror 5: 0xb583ecea (stale) Mirror 8: 0xb583ecea (stale) Mirror 9: 0xb583ecea (stale) Mirror 11: 0xb583ecea (stale) Mirror 12: 0xb583ecea (stale) Mirror 14: 0xb583ecea (stale) Mirror 16: 0xb583ecea (stale) Mirror 17: 0xb583ecea (stale) Mirror 18: 0xb583ecea (stale) CRC-32 checksum value for chunk [0, 0x25ce6): Mirror 1: 0xebe496ee Mirror 19: 0xebe496ee lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25ce6: skipped 000529 1788941647.639645 mapread 0x01eae1 thru 0x025ce5 (0x7205 bytes) 000532 1788941647.698496 mapwrite 0x014ca8 thru 0x017337 (0x2690 bytes) 000533 1788941647.886819 mapwrite 0x00eb42 thru 0x0101dd (0x169c bytes) 000534 1788941647.923760 mapwrite 0x02f7de thru 0x0376bf (0x7ee2 bytes) 000535 1788941648.005974 mapwrite 0x035b89 thru 0x03ffff (0xa477 bytes) 000536 1788941648.088613 mapwrite 0x02c954 thru 0x03c2bf (0xf96c bytes) 000537 1788941648.147667 mapwrite 0x01dbf8 thru 0x020dba (0x31c3 bytes) 000538 1788941648.193487 read 0x02c473 thru 0x02cb17 (0x6a5 bytes) 000539 1788941648.194144 read 0x006c38 thru 0x011576 (0xa93f bytes) 000540 1788941648.205740 mapread 0x00fa23 thru 0x01519b (0x5779 bytes) 000541 1788941648.207150 write 0x0327e7 thru 0x039686 (0x6ea0 bytes) 000543 1788941648.213364 MIRROR_SPLIT mirror 7 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x80c195af (stale) Mirror 8: 0x80c195af (stale) Mirror 9: 0x80c195af (stale) Mirror 11: 0x80c195af (stale) Mirror 12: 0x80c195af (stale) Mirror 14: 0x80c195af (stale) Mirror 17: 0x80c195af (stale) Mirror 18: 0x80c195af (stale) Mirror 19: 0x8a1e177c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x80c195af (stale) Mirror 8: 0x80c195af (stale) Mirror 9: 0x80c195af (stale) Mirror 11: 0x80c195af (stale) Mirror 12: 0x80c195af (stale) Mirror 14: 0x80c195af (stale) Mirror 17: 0x80c195af (stale) Mirror 18: 0x80c195af (stale) Mirror 19: 0x8a1e177c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000545 1788941648.842193 read 0x00c7ba thru 0x01b04d (0xe894 bytes) 000546 1788941648.881673 write 0x0075d6 thru 0x014414 (0xce3f bytes) 000548 1788941648.894581 trunc from 0x040000 to 0x0078f5 (0x3870a bytes) 000550 1788941648.920345 write 0x03be46 thru 0x03ce43 (0xffe bytes) 000551 1788941648.924266 write 0x01be13 thru 0x020123 (0x4311 bytes) 000552 1788941648.936827 mapwrite 0x02507f thru 0x02eb0c (0x9a8e bytes) 000554 1788941649.037705 read 0x014be2 thru 0x01c9ee (0x7e0d bytes) 000555 1788941649.066301 read 0x01bf7b thru 0x0249d4 (0x8a5a bytes) 000556 1788941649.067929 mapread 0x01f15a thru 0x02a4b2 (0xb359 bytes) 000557 1788941649.070152 write 0x01478b thru 0x01e927 (0xa19d bytes) 000558 1788941649.078904 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3ce44): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ce44): Mirror 5: 0x1abc89b5 (stale) Mirror 8: 0x1abc89b5 (stale) Mirror 9: 0x1abc89b5 (stale) Mirror 11: 0x1abc89b5 (stale) Mirror 12: 0x1abc89b5 (stale) Mirror 14: 0x1abc89b5 (stale) Mirror 17: 0x1abc89b5 (stale) Mirror 18: 0x1abc89b5 (stale) Mirror 19: 0xc104623b (stale) CRC-32 checksum value for chunk [0, 0x3ce44): Mirror 1: 0x41142253 Mirror 20: 0x41142253 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ce44: skipped 000559 1788941650.221883 read 0x03cb1b thru 0x03ce43 (0x329 bytes) 000560 1788941650.233859 mapread 0x028784 thru 0x036eb3 (0xe730 bytes) 000562 1788941650.271203 trunc from 0x03ce44 to 0x01819e (0x24ca5 bytes) 000563 1788941650.374336 mapwrite 0x016e7a thru 0x01f62b (0x87b2 bytes) 000564 1788941650.472564 write 0x03c815 thru 0x03ffff (0x37eb bytes) 000565 1788941650.473664 write 0x0230d7 thru 0x02827b (0x51a5 bytes) 000566 1788941650.482467 write 0x02ab63 thru 0x02f2d9 (0x4777 bytes) 000568 1788941650.483667 mapwrite 0x00cfde thru 0x012756 (0x5779 bytes) 000569 1788941650.568727 trunc from 0x040000 to 0x039979 (0x6686 bytes) 000570 1788941650.596114 write 0x029fcb thru 0x033a59 (0x9a8f bytes) 000571 1788941650.607935 read 0x01b6a9 thru 0x024568 (0x8ec0 bytes) 000572 1788941650.625691 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3997a): Mirror 8: 0x734167cc (stale) Mirror 9: 0x734167cc (stale) Mirror 11: 0x734167cc (stale) Mirror 12: 0x734167cc (stale) Mirror 14: 0x734167cc (stale) Mirror 17: 0x734167cc (stale) Mirror 18: 0x734167cc (stale) Mirror 19: 0xde37ae32 (stale) Mirror 20: 0x82451acb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3997a): Mirror 8: 0x734167cc (stale) Mirror 9: 0x734167cc (stale) Mirror 11: 0x734167cc (stale) Mirror 12: 0x734167cc (stale) Mirror 14: 0x734167cc (stale) Mirror 17: 0x734167cc (stale) Mirror 18: 0x734167cc (stale) Mirror 19: 0xde37ae32 (stale) Mirror 20: 0x82451acb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3997a: skipped 000573 1788941651.228299 trunc from 0x03997a to 0x0200a8 (0x198d1 bytes) 000574 1788941651.256142 mapwrite 0x0043a6 thru 0x011771 (0xd3cc bytes) 000575 1788941651.396828 trunc from 0x0200a9 to 0x00417d (0x1bf2b bytes) 000576 1788941651.432249 trunc from 0x00417e to 0x03e662 (0x3a4e5 bytes) 000578 1788941651.470342 write 0x012e6c thru 0x01c320 (0x94b5 bytes) 000579 1788941651.487082 write 0x00c71f thru 0x01a050 (0xd932 bytes) 000580 1788941651.498451 punch from 0x02b6ee to 0x032101 (0x6a14 bytes) 000582 1788941651.517030 trunc from 0x03e663 to 0x021ae2 (0x1cb80 bytes) 000583 1788941651.536152 read 0x012902 thru 0x01afa3 (0x86a2 bytes) 000586 1788941651.539747 mapread 0x013ab4 thru 0x01d459 (0x99a6 bytes) 000587 1788941651.545730 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x21ae3): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21ae3): Mirror 8: 0xaf19167b (stale) Mirror 9: 0xaf19167b (stale) Mirror 11: 0xaf19167b (stale) Mirror 12: 0xaf19167b (stale) Mirror 14: 0xaf19167b (stale) Mirror 17: 0xaf19167b (stale) Mirror 18: 0xaf19167b (stale) Mirror 19: 0x2598fdd9 (stale) Mirror 20: 0x5bb01708 (stale) CRC-32 checksum value for chunk [0, 0x21ae3): Mirror 1: 0x903da2f4 Mirror 21: 0x903da2f4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21ae3: skipped 000588 1788941653.076902 mapwrite 0x0385d5 thru 0x03ffff (0x7a2b bytes) 000590 1788941653.219152 write 0x01c8d9 thru 0x022612 (0x5d3a bytes) 000593 1788941653.231476 mapwrite 0x03061a thru 0x037d40 (0x7727 bytes) 000594 1788941653.292123 mapwrite 0x000bf8 thru 0x006ee1 (0x62ea bytes) 000597 1788941653.347594 trunc from 0x040000 to 0x00c6d5 (0x3392a bytes) 000598 1788941653.375354 read 0x005e58 thru 0x0061b1 (0x35a bytes) 000599 1788941653.376143 punch from 0x00b0b7 to 0x00c6d5 (0x161f bytes) 000600 1788941653.382118 read 0x0026e7 thru 0x009938 (0x7252 bytes) 000601 1788941653.388334 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xc6d6): Mirror 8: 0x23370b53 (stale) Mirror 9: 0x23370b53 (stale) Mirror 12: 0x23370b53 (stale) Mirror 14: 0x23370b53 (stale) Mirror 17: 0x23370b53 (stale) Mirror 18: 0x23370b53 (stale) Mirror 19: 0xc6f7c784 (stale) Mirror 20: 0xe1cacb8e (stale) Mirror 21: 0x68cabdfa (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc6d6): Mirror 8: 0x23370b53 (stale) Mirror 9: 0x23370b53 (stale) Mirror 12: 0x23370b53 (stale) Mirror 14: 0x23370b53 (stale) Mirror 17: 0x23370b53 (stale) Mirror 18: 0x23370b53 (stale) Mirror 19: 0xc6f7c784 (stale) Mirror 20: 0xe1cacb8e (stale) Mirror 21: 0x68cabdfa (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc6d6: skipped 000602 1788941654.194159 mapwrite 0x0032c2 thru 0x012ff7 (0xfd36 bytes) 000604 1788941654.374098 trunc from 0x012ff8 to 0x027faf (0x14fb8 bytes) 000606 1788941654.399517 mapwrite 0x038598 thru 0x03ffff (0x7a68 bytes) 000607 1788941654.510718 read 0x01a3b5 thru 0x02023b (0x5e87 bytes) 000608 1788941654.531704 read 0x037d40 thru 0x038b5d (0xe1e bytes) 000609 1788941654.532617 read 0x009761 thru 0x0145d8 (0xae78 bytes) 000611 1788941654.549952 mapread 0x003346 thru 0x00d270 (0x9f2b bytes) 000612 1788941654.551174 punch from 0x03611b to 0x0391b6 (0x309c bytes) 000614 1788941654.558861 mapread 0x015552 thru 0x017f8b (0x2a3a bytes) 000615 1788941654.560423 read 0x0131fd thru 0x01f8f2 (0xc6f6 bytes) 000617 1788941654.562096 write 0x0317eb thru 0x03e8f0 (0xd106 bytes) 000621 1788941654.566896 read 0x02d763 thru 0x03902f (0xb8cd bytes) 000622 1788941654.568043 write 0x015f31 thru 0x01c39d (0x646d bytes) 000625 1788941654.570912 trunc from 0x040000 to 0x03ab82 (0x547d bytes) 000626 1788941654.599533 trunc from 0x03ab83 to 0x0069e4 (0x3419e bytes) 000627 1788941654.623638 MIRROR_RESYNC 10 mirrors 000628 1788941656.149300 mapwrite 0x002429 thru 0x00bcb7 (0x988f bytes) 000631 1788941656.314868 mapread 0x005120 thru 0x00bcb7 (0x6b98 bytes) 000632 1788941656.320535 MIRROR_RESYNC 10 mirrors 000633 1788941657.647955 punch from 0x0009e0 to 0x009489 (0x8aaa bytes) 000634 1788941657.766859 write 0x00dba5 thru 0x0120c4 (0x4520 bytes) 000635 1788941657.768099 mapwrite 0x01faa7 thru 0x023897 (0x3df1 bytes) 000636 1788941658.011885 trunc from 0x023898 to 0x025e63 (0x25cc bytes) 000637 1788941658.042508 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x25e64): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25e64): Mirror 8: 0x71a15a8f (stale) Mirror 9: 0x71a15a8f (stale) Mirror 12: 0x71a15a8f (stale) Mirror 14: 0x71a15a8f (stale) Mirror 17: 0x71a15a8f (stale) Mirror 18: 0x71a15a8f (stale) Mirror 19: 0x71a15a8f (stale) Mirror 20: 0x71a15a8f (stale) Mirror 21: 0x71a15a8f (stale) CRC-32 checksum value for chunk [0, 0x25e64): Mirror 1: 0xa14b0d19 Mirror 22: 0xa14b0d19 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25e64: skipped 000638 1788941659.777931 write 0x005611 thru 0x0057f3 (0x1e3 bytes) 000639 1788941659.941105 trunc from 0x025e64 to 0x01099e (0x154c5 bytes) 000641 1788941659.985500 mapwrite 0x03dcce thru 0x03ffff (0x2332 bytes) 000644 1788941660.173948 read 0x03d838 thru 0x03ffff (0x27c8 bytes) 000645 1788941660.186604 mapwrite 0x00e441 thru 0x018ee9 (0xaaa9 bytes) 000647 1788941660.325129 mapwrite 0x019c7a thru 0x01c9fe (0x2d85 bytes) 000648 1788941660.376106 read 0x03101c thru 0x031a7f (0xa64 bytes) 000650 1788941660.396229 punch from 0x0133d0 to 0x021b73 (0xe7a4 bytes) 000651 1788941660.405108 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x7671f0e (stale) Mirror 9: 0x7671f0e (stale) Mirror 12: 0x7671f0e (stale) Mirror 14: 0x7671f0e (stale) Mirror 17: 0x7671f0e (stale) Mirror 18: 0x7671f0e (stale) Mirror 19: 0x7671f0e (stale) Mirror 20: 0x7671f0e (stale) Mirror 21: 0x7671f0e (stale) Mirror 22: 0xdd342c3b (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1eb295e Mirror 23: 0x1eb295e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000652 1788941662.913076 read 0x034912 thru 0x03ffff (0xb6ee bytes) 000654 1788941662.939704 write 0x009d95 thru 0x00e3fd (0x4669 bytes) 000656 1788941663.194635 write 0x00caee thru 0x01af1d (0xe430 bytes) 000657 1788941663.210713 mapread 0x03f7c5 thru 0x03fe2c (0x668 bytes) 000658 1788941663.233173 punch from 0x027345 to 0x02d6c0 (0x637c bytes) 000659 1788941663.265091 mapread 0x02c808 thru 0x03653b (0x9d34 bytes) 000660 1788941663.340466 mapwrite 0x015382 thru 0x01672d (0x13ac bytes) 000661 1788941663.437801 read 0x02d54b thru 0x02fdaf (0x2865 bytes) 000662 1788941663.441914 read 0x029e77 thru 0x031429 (0x75b3 bytes) 000663 1788941663.447703 mapread 0x021fb0 thru 0x0307ee (0xe83f bytes) 000665 1788941663.497439 punch from 0x02e087 to 0x037de1 (0x9d5b bytes) 000667 1788941663.505587 read 0x013efd thru 0x021782 (0xd886 bytes) 000671 1788941663.511273 mapwrite 0x004950 thru 0x005c0b (0x12bc bytes) 000672 1788941663.606912 read 0x02592f thru 0x02dca1 (0x8373 bytes) 000674 1788941663.626844 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x7671f0e (stale) Mirror 9: 0x7671f0e (stale) Mirror 12: 0x7671f0e (stale) Mirror 14: 0x7671f0e (stale) Mirror 17: 0x7671f0e (stale) Mirror 18: 0x7671f0e (stale) Mirror 19: 0x7671f0e (stale) Mirror 20: 0x7671f0e (stale) Mirror 21: 0x7671f0e (stale) Mirror 22: 0xdd342c3b (stale) Mirror 23: 0x1eb295e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x722c6c98 Mirror 24: 0x722c6c98 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000675 1788941665.613610 mapread 0x039914 thru 0x03ffff (0x66ec bytes) 000676 1788941665.687190 trunc from 0x040000 to 0x031ca9 (0xe356 bytes) 000677 1788941665.941720 punch from 0x008218 to 0x00d4b1 (0x529a bytes) 000679 1788941665.966998 read 0x027aa1 thru 0x028da3 (0x1303 bytes) 000682 1788941665.985332 write 0x01fbcc thru 0x028cea (0x911f bytes) 000683 1788941665.997492 trunc from 0x031caa to 0x008478 (0x29831 bytes) 000684 1788941666.078961 mapwrite 0x01cc7a thru 0x02166a (0x49f1 bytes) 000685 1788941666.274040 mapwrite 0x038e62 thru 0x03ffff (0x719e bytes) 000687 1788941666.387873 mapwrite 0x0111e6 thru 0x015a57 (0x4872 bytes) 000688 1788941666.535534 punch from 0x006d99 to 0x00fc3e (0x8ea6 bytes) 000689 1788941666.547256 trunc from 0x040000 to 0x010a3c (0x2f5c3 bytes) 000690 1788941666.571477 trunc from 0x010a3d to 0x00786c (0x91d0 bytes) 000691 1788941666.608174 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x786d): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x786d): Mirror 8: 0x44968fc0 (stale) Mirror 9: 0x44968fc0 (stale) Mirror 12: 0x44968fc0 (stale) Mirror 14: 0x44968fc0 (stale) Mirror 17: 0x44968fc0 (stale) Mirror 18: 0x44968fc0 (stale) Mirror 19: 0x44968fc0 (stale) Mirror 20: 0x44968fc0 (stale) Mirror 21: 0x44968fc0 (stale) Mirror 22: 0xd157b502 (stale) Mirror 23: 0xd95d32e4 (stale) Mirror 24: 0xaff6aa38 (stale) CRC-32 checksum value for chunk [0, 0x786d): Mirror 1: 0xaff6aa38 Mirror 25: 0xaff6aa38 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x786d: skipped 000692 1788941667.934895 punch from 0x001b97 to 0x0060ef (0x4559 bytes) 000693 1788941668.045120 punch from 0x0005fe to 0x00786c (0x726f bytes) 000694 1788941668.052033 mapread 0x005da2 thru 0x00786c (0x1acb bytes) 000695 1788941668.084218 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x786d): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x786d): Mirror 8: 0x44968fc0 (stale) Mirror 9: 0x44968fc0 (stale) Mirror 12: 0x44968fc0 (stale) Mirror 14: 0x44968fc0 (stale) Mirror 17: 0x44968fc0 (stale) Mirror 18: 0x44968fc0 (stale) Mirror 19: 0x44968fc0 (stale) Mirror 20: 0x44968fc0 (stale) Mirror 21: 0x44968fc0 (stale) Mirror 22: 0xd157b502 (stale) Mirror 23: 0xd95d32e4 (stale) Mirror 24: 0xaff6aa38 (stale) Mirror 25: 0xaff6aa38 (stale) CRC-32 checksum value for chunk [0, 0x786d): Mirror 1: 0x10462c30 Mirror 26: 0x10462c30 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x786d: skipped 000697 1788941669.511482 read 0x001cd2 thru 0x00786c (0x5b9b bytes) 000699 1788941669.519160 trunc from 0x00786d to 0x014c19 (0xd3ad bytes) 000701 1788941669.717811 mapread 0x00be98 thru 0x00ff24 (0x408d bytes) 000702 1788941669.755180 write 0x00cf1c thru 0x01bddd (0xeec2 bytes) 000703 1788941669.760151 write 0x028a37 thru 0x02b343 (0x290d bytes) 000704 1788941669.765495 mapwrite 0x02559a thru 0x032925 (0xd38c bytes) 000706 1788941669.919505 punch from 0x003ef4 to 0x00494f (0xa5c bytes) 000709 1788941669.930989 mapwrite 0x03bb2e thru 0x03ffff (0x44d2 bytes) 000715 1788941670.076514 read 0x0210ba thru 0x0288f8 (0x783f bytes) 000716 1788941670.077210 punch from 0x023fb1 to 0x02ac84 (0x6cd4 bytes) 000718 1788941670.102554 write 0x01e5e0 thru 0x028060 (0x9a81 bytes) 000720 1788941670.143922 trunc from 0x040000 to 0x022f3a (0x1d0c5 bytes) 000721 1788941670.222745 mapwrite 0x002167 thru 0x0097ee (0x7688 bytes) 000722 1788941670.312480 mapwrite 0x01c7c9 thru 0x01f5aa (0x2de2 bytes) 000723 1788941670.351625 punch from 0x00db76 to 0x013dda (0x6265 bytes) 000726 1788941670.360441 trunc from 0x022f3b to 0x007609 (0x1b931 bytes) 000728 1788941670.402004 mapread 0x002000 thru 0x007609 (0x560a bytes) 000729 1788941670.408424 mapwrite 0x014bb0 thru 0x0240b9 (0xf50a bytes) 000730 1788941670.600196 mapwrite 0x02ab5c thru 0x034664 (0x9b09 bytes) 000731 1788941670.714178 punch from 0x009f3a to 0x0143e7 (0xa4ae bytes) 000732 1788941670.726515 mapwrite 0x008350 thru 0x01169b (0x934c bytes) 000734 1788941670.841624 read 0x03120e thru 0x034664 (0x3457 bytes) 000738 1788941670.854286 punch from 0x02a4b0 to 0x02b24d (0xd9e bytes) 000739 1788941670.871752 mapwrite 0x00feee thru 0x0104c8 (0x5db bytes) 000740 1788941671.010877 trunc from 0x034665 to 0x03e8e3 (0xa27f bytes) 000743 1788941671.065381 write 0x0293f1 thru 0x037656 (0xe266 bytes) 000745 1788941671.129954 MIRROR_RESYNC 15 mirrors 000746 1788941675.362363 MIRROR_SPLIT mirror 10 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) 000747 1788941676.237020 mapread 0x0274f3 thru 0x02e995 (0x74a3 bytes) 000748 1788941676.262076 MIRROR_RESYNC 14 mirrors 000751 1788941677.426395 write 0x039d06 thru 0x03ffff (0x62fa bytes) 000752 1788941677.655954 mapwrite 0x03bfe4 thru 0x03ffff (0x401c bytes) 000753 1788941677.878830 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xe1b19b40 (stale) Mirror 9: 0xe1b19b40 (stale) Mirror 12: 0xe1b19b40 (stale) Mirror 14: 0xe1b19b40 (stale) Mirror 17: 0xe1b19b40 (stale) Mirror 18: 0xe1b19b40 (stale) Mirror 19: 0xe1b19b40 (stale) Mirror 20: 0xe1b19b40 (stale) Mirror 21: 0xe1b19b40 (stale) Mirror 23: 0xe1b19b40 (stale) Mirror 24: 0xe1b19b40 (stale) Mirror 25: 0xe1b19b40 (stale) Mirror 26: 0xe1b19b40 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x12a2007d Mirror 27: 0x12a2007d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000754 1788941679.760927 punch from 0x02ded0 to 0x036b65 (0x8c96 bytes) 000755 1788941679.983101 punch from 0x01b6ae to 0x01e231 (0x2b84 bytes) 000756 1788941679.998569 read 0x01d629 thru 0x01e480 (0xe58 bytes) 000759 1788941680.022911 mapread 0x038dc1 thru 0x03f004 (0x6244 bytes) 000760 1788941680.077914 trunc from 0x040000 to 0x0092c8 (0x36d37 bytes) 000761 1788941680.138682 mapwrite 0x00d399 thru 0x00d5f8 (0x260 bytes) 000762 1788941680.263008 trunc from 0x00d5f9 to 0x02e896 (0x2129e bytes) 000763 1788941680.280836 mapread 0x0005e4 thru 0x00cbe6 (0xc603 bytes) 000764 1788941680.289246 mapwrite 0x0011ae thru 0x00bf0f (0xad62 bytes) 000765 1788941680.347437 punch from 0x007c6a to 0x016201 (0xe598 bytes) 000767 1788941680.353978 mapwrite 0x010e0c thru 0x014f85 (0x417a bytes) 000768 1788941680.454646 punch from 0x008e32 to 0x0171af (0xe37e bytes) 000769 1788941680.464560 mapwrite 0x01a18c thru 0x029f6e (0xfde3 bytes) 000770 1788941680.617885 MIRROR_SPLIT mirror 7 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e897): Mirror 8: 0xa440c1e9 (stale) Mirror 9: 0xa440c1e9 (stale) Mirror 12: 0xa440c1e9 (stale) Mirror 14: 0xa440c1e9 (stale) Mirror 17: 0xa440c1e9 (stale) Mirror 18: 0xa440c1e9 (stale) Mirror 20: 0xa440c1e9 (stale) Mirror 21: 0xa440c1e9 (stale) Mirror 23: 0xa440c1e9 (stale) Mirror 24: 0xa440c1e9 (stale) Mirror 25: 0xa440c1e9 (stale) Mirror 26: 0xa440c1e9 (stale) Mirror 27: 0xa440c1e9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e897): Mirror 8: 0xa440c1e9 (stale) Mirror 9: 0xa440c1e9 (stale) Mirror 12: 0xa440c1e9 (stale) Mirror 14: 0xa440c1e9 (stale) Mirror 17: 0xa440c1e9 (stale) Mirror 18: 0xa440c1e9 (stale) Mirror 20: 0xa440c1e9 (stale) Mirror 21: 0xa440c1e9 (stale) Mirror 23: 0xa440c1e9 (stale) Mirror 24: 0xa440c1e9 (stale) Mirror 25: 0xa440c1e9 (stale) Mirror 26: 0xa440c1e9 (stale) Mirror 27: 0xa440c1e9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e897: skipped 000773 1788941681.729227 trunc from 0x02e897 to 0x03919c (0xa906 bytes) 000775 1788941681.781659 punch from 0x009513 to 0x00a528 (0x1016 bytes) 000776 1788941681.790406 punch from 0x0194bd to 0x02273d (0x9281 bytes) 000777 1788941681.797744 trunc from 0x03919d to 0x03dba8 (0x4a0c bytes) 000778 1788941681.827513 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x3dba9): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dba9): Mirror 8: 0xd6c7becb (stale) Mirror 9: 0xd6c7becb (stale) Mirror 12: 0xd6c7becb (stale) Mirror 14: 0xd6c7becb (stale) Mirror 17: 0xd6c7becb (stale) Mirror 18: 0xd6c7becb (stale) Mirror 20: 0xd6c7becb (stale) Mirror 21: 0xd6c7becb (stale) Mirror 23: 0xd6c7becb (stale) Mirror 24: 0xd6c7becb (stale) Mirror 25: 0xd6c7becb (stale) Mirror 26: 0xd6c7becb (stale) Mirror 27: 0x5e4eedc1 (stale) CRC-32 checksum value for chunk [0, 0x3dba9): Mirror 1: 0x659dadf6 Mirror 28: 0x659dadf6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dba9: skipped 000779 1788941683.709413 read 0x034cac thru 0x039c20 (0x4f75 bytes) 000782 1788941683.738869 MIRROR_SPLIT mirror 3 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dba9): Mirror 8: 0xd6c7becb (stale) Mirror 9: 0xd6c7becb (stale) Mirror 14: 0xd6c7becb (stale) Mirror 17: 0xd6c7becb (stale) Mirror 18: 0xd6c7becb (stale) Mirror 20: 0xd6c7becb (stale) Mirror 21: 0xd6c7becb (stale) Mirror 23: 0xd6c7becb (stale) Mirror 24: 0xd6c7becb (stale) Mirror 25: 0xd6c7becb (stale) Mirror 26: 0xd6c7becb (stale) Mirror 27: 0x5e4eedc1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dba9): Mirror 8: 0xd6c7becb (stale) Mirror 9: 0xd6c7becb (stale) Mirror 14: 0xd6c7becb (stale) Mirror 17: 0xd6c7becb (stale) Mirror 18: 0xd6c7becb (stale) Mirror 20: 0xd6c7becb (stale) Mirror 21: 0xd6c7becb (stale) Mirror 23: 0xd6c7becb (stale) Mirror 24: 0xd6c7becb (stale) Mirror 25: 0xd6c7becb (stale) Mirror 26: 0xd6c7becb (stale) Mirror 27: 0x5e4eedc1 (stale) CRC-32 checksum value for chunk [0, 0x3dba9): Mirror 1: 0x659dadf6 Mirror 28: 0x659dadf6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dba9: skipped 000783 1788941685.398933 punch from 0x01dedb to 0x02de43 (0xff69 bytes) 000785 1788941685.526270 mapwrite 0x033cab thru 0x039453 (0x57a9 bytes) 000786 1788941685.667550 punch from 0x022b20 to 0x02472c (0x1c0d bytes) 000787 1788941685.672313 write 0x0217d7 thru 0x025364 (0x3b8e bytes) 000788 1788941685.686343 write 0x01a7d7 thru 0x01f813 (0x503d bytes) 000790 1788941685.696606 trunc from 0x03dba9 to 0x014407 (0x297a1 bytes) 000791 1788941685.722616 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x14408): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14408): Mirror 8: 0xfa12bef6 (stale) Mirror 9: 0xfa12bef6 (stale) Mirror 14: 0xfa12bef6 (stale) Mirror 17: 0xfa12bef6 (stale) Mirror 18: 0xfa12bef6 (stale) Mirror 20: 0xfa12bef6 (stale) Mirror 21: 0xfa12bef6 (stale) Mirror 23: 0xfa12bef6 (stale) Mirror 24: 0xfa12bef6 (stale) Mirror 25: 0xfa12bef6 (stale) Mirror 26: 0xfa12bef6 (stale) Mirror 27: 0xfa12bef6 (stale) Mirror 28: 0xad2c5b01 (stale) CRC-32 checksum value for chunk [0, 0x14408): Mirror 1: 0xad2c5b01 Mirror 29: 0xad2c5b01 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14408: skipped 000792 1788941687.597547 trunc from 0x014408 to 0x012812 (0x1bf5 bytes) 000793 1788941687.866336 trunc from 0x012813 to 0x032a7d (0x2026b bytes) 000794 1788941687.903433 trunc from 0x032a7e to 0x00cef1 (0x25b8c bytes) 000795 1788941687.943659 trunc from 0x00cef2 to 0x01e95b (0x11a6a bytes) 000796 1788941687.997216 mapread 0x012e1c thru 0x0158ad (0x2a92 bytes) 000797 1788941688.051952 punch from 0x004ad0 to 0x00b40a (0x693b bytes) 000798 1788941688.063524 read 0x006bce thru 0x00ba86 (0x4eb9 bytes) 000800 1788941688.116269 mapwrite 0x00abb2 thru 0x013d2d (0x917c bytes) 000801 1788941688.296694 write 0x036207 thru 0x03ffff (0x9df9 bytes) 000802 1788941688.297924 punch from 0x01f49c to 0x020f11 (0x1a76 bytes) 000803 1788941688.345724 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xe1b19b40 (stale) Mirror 9: 0xe1b19b40 (stale) Mirror 14: 0xe1b19b40 (stale) Mirror 17: 0xe1b19b40 (stale) Mirror 18: 0xe1b19b40 (stale) Mirror 20: 0xe1b19b40 (stale) Mirror 21: 0xe1b19b40 (stale) Mirror 23: 0xe1b19b40 (stale) Mirror 24: 0xe1b19b40 (stale) Mirror 25: 0xe1b19b40 (stale) Mirror 26: 0xe1b19b40 (stale) Mirror 27: 0x12a2007d (stale) Mirror 28: 0xa2a08649 (stale) Mirror 29: 0xb8f345a1 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x28fbff0f Mirror 30: 0x28fbff0f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000804 1788941690.591449 read 0x0325de thru 0x03cb09 (0xa52c bytes) 000805 1788941690.680315 write 0x0262a4 thru 0x0277ad (0x150a bytes) 000807 1788941690.959834 read 0x027ae9 thru 0x02cf08 (0x5420 bytes) 000808 1788941690.984429 write 0x00f816 thru 0x015fb8 (0x67a3 bytes) 000809 1788941690.987794 punch from 0x02e434 to 0x03cbe8 (0xe7b5 bytes) 000810 1788941691.031405 mapread 0x017147 thru 0x021ab4 (0xa96e bytes) 000811 1788941691.034754 mapwrite 0x03b935 thru 0x03ffff (0x46cb bytes) 000812 1788941691.154356 read 0x02a2db thru 0x034cfb (0xaa21 bytes) 000813 1788941691.164335 read 0x00371b thru 0x005de4 (0x26ca bytes) 000815 1788941691.166440 trunc from 0x040000 to 0x01f7f4 (0x2080b bytes) 000818 1788941691.207087 mapread 0x00f3c1 thru 0x01c07d (0xccbd bytes) 000819 1788941691.208393 mapwrite 0x02f59b thru 0x0326e1 (0x3147 bytes) 000820 1788941691.346342 read 0x01b494 thru 0x01f7d6 (0x4343 bytes) 000821 1788941691.351286 read 0x012d7b thru 0x021c0f (0xee95 bytes) 000822 1788941691.356119 read 0x02e168 thru 0x0326e1 (0x457a bytes) 000823 1788941691.358204 mapwrite 0x01cd32 thru 0x027a9b (0xad6a bytes) 000824 1788941691.496593 punch from 0x01da72 to 0x028981 (0xaf10 bytes) 000825 1788941691.507242 read 0x000faf thru 0x0067d6 (0x5828 bytes) 000827 1788941691.508570 write 0x012a2b thru 0x015b4c (0x3122 bytes) 000828 1788941691.510540 trunc from 0x0326e2 to 0x025bcc (0xcb15 bytes) 000829 1788941691.533760 write 0x03ec8f thru 0x03ffff (0x1371 bytes) 000830 1788941691.535569 mapwrite 0x026cdf thru 0x032875 (0xbb97 bytes) 000831 1788941691.723690 mapread 0x023a45 thru 0x02406a (0x626 bytes) 000833 1788941691.731149 write 0x01ab94 thru 0x023e1d (0x928a bytes) 000835 1788941691.749708 MIRROR_RESYNC 16 mirrors 000837 1788941695.222336 mapread 0x039c6b thru 0x03ffff (0x6395 bytes) 000838 1788941695.249453 trunc from 0x040000 to 0x03e130 (0x1ecf bytes) 000839 1788941695.417875 trunc from 0x03e131 to 0x02a589 (0x13ba7 bytes) 000840 1788941695.461692 read 0x01f9a9 thru 0x02029b (0x8f3 bytes) 000842 1788941695.472794 punch from 0x003944 to 0x00c65d (0x8d1a bytes) 000844 1788941695.478074 mapread 0x01cad3 thru 0x0280c8 (0xb5f6 bytes) 000847 1788941695.493033 mapread 0x01dce3 thru 0x028e5e (0xb17c bytes) 000849 1788941695.495052 mapread 0x00578d thru 0x005cd9 (0x54d bytes) 000850 1788941695.502140 read 0x01ae55 thru 0x02446b (0x9617 bytes) 000851 1788941695.503407 punch from 0x026153 to 0x02a589 (0x4437 bytes) 000852 1788941695.507274 mapwrite 0x0385a5 thru 0x03d75f (0x51bb bytes) 000853 1788941695.585026 MIRROR_RESYNC 16 mirrors 000857 1788941699.069633 read 0x038ea9 thru 0x03d75f (0x48b7 bytes) 000858 1788941699.078740 trunc from 0x03d760 to 0x001c1e (0x3bb41 bytes) 000860 1788941699.198160 read 0x00036e thru 0x001c1e (0x18b1 bytes) 000861 1788941699.204626 mapread 0x0007f7 thru 0x001c1e (0x1428 bytes) 000862 1788941699.208214 punch from 0x000ca9 to 0x001c1e (0xf76 bytes) 000863 1788941699.214269 read 0x000c92 thru 0x001c1e (0xf8d bytes) 000866 1788941699.221577 mapread 0x0017fb thru 0x001c1e (0x424 bytes) 000867 1788941699.222611 mapread 0x00022a thru 0x001c1e (0x19f5 bytes) 000868 1788941699.224089 trunc from 0x001c1f to 0x0027f8 (0xbda bytes) 000869 1788941699.250102 read 0x002366 thru 0x0027f8 (0x493 bytes) 000870 1788941699.256691 trunc from 0x0027f9 to 0x01ca4c (0x1a254 bytes) 000873 1788941699.276562 write 0x018c2c thru 0x01b797 (0x2b6c bytes) 000874 1788941699.291016 read 0x007b09 thru 0x00e4e9 (0x69e1 bytes) 000875 1788941699.291639 read 0x017981 thru 0x01ca4c (0x50cc bytes) 000877 1788941699.292601 mapwrite 0x010d86 thru 0x01bb24 (0xad9f bytes) 000879 1788941699.362509 mapread 0x011b53 thru 0x01ca4c (0xaefa bytes) 000880 1788941699.363606 mapread 0x0128b2 thru 0x014a2f (0x217e bytes) 000881 1788941699.365061 mapwrite 0x0235a9 thru 0x02ebad (0xb605 bytes) 000883 1788941699.498174 mapwrite 0x000c2b thru 0x00c2eb (0xb6c1 bytes) 000884 1788941699.558178 write 0x012ee1 thru 0x0194f6 (0x6616 bytes) 000885 1788941699.559863 mapread 0x017a46 thru 0x01c7c3 (0x4d7e bytes) 000886 1788941699.560664 write 0x019993 thru 0x0267ec (0xce5a bytes) 000887 1788941699.561668 trunc from 0x02ebae to 0x0371d4 (0x8627 bytes) 000888 1788941699.602853 punch from 0x001772 to 0x00410e (0x299d bytes) 000889 1788941699.642563 write 0x011c88 thru 0x015f86 (0x42ff bytes) 000890 1788941699.652452 mapwrite 0x036793 thru 0x037727 (0xf95 bytes) 000891 1788941699.798710 read 0x0080c7 thru 0x014dae (0xcce8 bytes) 000892 1788941699.799746 mapread 0x021413 thru 0x02de42 (0xca30 bytes) 000893 1788941699.809496 MIRROR_RESYNC 16 mirrors 000894 1788941702.776972 mapwrite 0x02bc9f thru 0x030997 (0x4cf9 bytes) 000895 1788941703.142503 punch from 0x015747 to 0x020539 (0xadf3 bytes) 000896 1788941703.151381 trunc from 0x037728 to 0x01057c (0x271ab bytes) 000897 1788941703.190408 read 0x00e8b6 thru 0x01057c (0x1cc7 bytes) 000898 1788941703.209347 mapread 0x010549 thru 0x01057c (0x34 bytes) 000902 1788941703.220879 write 0x00cbae thru 0x01104d (0x44a0 bytes) 000903 1788941703.231546 trunc from 0x01104e to 0x03d475 (0x2c428 bytes) 000904 1788941703.296125 mapread 0x028599 thru 0x036529 (0xdf91 bytes) 000905 1788941703.374582 read 0x0301ab thru 0x03d475 (0xd2cb bytes) 000906 1788941703.395966 mapread 0x02720c thru 0x02ce77 (0x5c6c bytes) 000907 1788941703.397029 read 0x01704d thru 0x022964 (0xb918 bytes) 000908 1788941703.397623 mapwrite 0x020f6c thru 0x025cc6 (0x4d5b bytes) 000910 1788941703.496553 read 0x015adb thru 0x02371c (0xdc42 bytes) 000911 1788941703.501329 write 0x00fc69 thru 0x01e3e2 (0xe77a bytes) 000912 1788941703.510473 MIRROR_RESYNC 16 mirrors 000913 1788941706.972256 MIRROR_SPLIT mirror 14 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) 000914 1788941707.520020 mapread 0x0243e8 thru 0x028591 (0x41aa bytes) 000915 1788941707.540006 mapwrite 0x02367e thru 0x027e54 (0x47d7 bytes) 000916 1788941707.779433 read 0x008480 thru 0x00fce9 (0x786a bytes) 000917 1788941707.799271 punch from 0x01d1b0 to 0x01e490 (0x12e1 bytes) 000918 1788941707.817195 read 0x02102b thru 0x02f9c3 (0xe999 bytes) 000920 1788941707.841089 trunc from 0x03d476 to 0x02522b (0x1824a bytes) 000921 1788941707.887082 write 0x015058 thru 0x01a4fa (0x54a3 bytes) 000923 1788941707.892469 read 0x013f20 thru 0x01eeac (0xaf8d bytes) 000924 1788941707.893200 mapread 0x00cc1c thru 0x00ffb7 (0x339c bytes) 000925 1788941707.894037 mapwrite 0x010b6f thru 0x01eeb8 (0xe34a bytes) 000926 1788941707.992046 read 0x01256c thru 0x0172d5 (0x4d6a bytes) 000927 1788941707.997656 MIRROR_RESYNC 15 mirrors 000929 1788941710.213701 punch from 0x006b4c to 0x015bf0 (0xf0a5 bytes) 000930 1788941710.469547 MIRROR_SPLIT mirror 11 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2522c): Mirror 8: 0x84746974 (stale) Mirror 9: 0x84746974 (stale) Mirror 14: 0x84746974 (stale) Mirror 17: 0x84746974 (stale) Mirror 18: 0x84746974 (stale) Mirror 20: 0x84746974 (stale) Mirror 21: 0x84746974 (stale) Mirror 23: 0x84746974 (stale) Mirror 24: 0x84746974 (stale) Mirror 25: 0x84746974 (stale) Mirror 27: 0x84746974 (stale) Mirror 28: 0x84746974 (stale) Mirror 30: 0x84746974 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2522c): Mirror 8: 0x84746974 (stale) Mirror 9: 0x84746974 (stale) Mirror 14: 0x84746974 (stale) Mirror 17: 0x84746974 (stale) Mirror 18: 0x84746974 (stale) Mirror 20: 0x84746974 (stale) Mirror 21: 0x84746974 (stale) Mirror 23: 0x84746974 (stale) Mirror 24: 0x84746974 (stale) Mirror 25: 0x84746974 (stale) Mirror 27: 0x84746974 (stale) Mirror 28: 0x84746974 (stale) Mirror 30: 0x84746974 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2522c: skipped 000932 1788941711.626074 MIRROR_SPLIT mirror 2 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2522c): Mirror 8: 0x84746974 (stale) Mirror 14: 0x84746974 (stale) Mirror 17: 0x84746974 (stale) Mirror 18: 0x84746974 (stale) Mirror 20: 0x84746974 (stale) Mirror 21: 0x84746974 (stale) Mirror 23: 0x84746974 (stale) Mirror 24: 0x84746974 (stale) Mirror 25: 0x84746974 (stale) Mirror 27: 0x84746974 (stale) Mirror 28: 0x84746974 (stale) Mirror 30: 0x84746974 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2522c): Mirror 8: 0x84746974 (stale) Mirror 14: 0x84746974 (stale) Mirror 17: 0x84746974 (stale) Mirror 18: 0x84746974 (stale) Mirror 20: 0x84746974 (stale) Mirror 21: 0x84746974 (stale) Mirror 23: 0x84746974 (stale) Mirror 24: 0x84746974 (stale) Mirror 25: 0x84746974 (stale) Mirror 27: 0x84746974 (stale) Mirror 28: 0x84746974 (stale) Mirror 30: 0x84746974 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2522c: skipped 000934 1788941712.260115 mapwrite 0x01cb51 thru 0x01d8fa (0xdaa bytes) 000935 1788941712.361354 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2522c): Mirror 14: 0x84746974 (stale) Mirror 17: 0x84746974 (stale) Mirror 18: 0x84746974 (stale) Mirror 20: 0x84746974 (stale) Mirror 21: 0x84746974 (stale) Mirror 23: 0x84746974 (stale) Mirror 24: 0x84746974 (stale) Mirror 25: 0x84746974 (stale) Mirror 27: 0x84746974 (stale) Mirror 28: 0x84746974 (stale) Mirror 30: 0x84746974 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2522c): Mirror 14: 0x84746974 (stale) Mirror 17: 0x84746974 (stale) Mirror 18: 0x84746974 (stale) Mirror 20: 0x84746974 (stale) Mirror 21: 0x84746974 (stale) Mirror 23: 0x84746974 (stale) Mirror 24: 0x84746974 (stale) Mirror 25: 0x84746974 (stale) Mirror 27: 0x84746974 (stale) Mirror 28: 0x84746974 (stale) Mirror 30: 0x84746974 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2522c: skipped 000937 1788941713.526627 write 0x00821e thru 0x0106bc (0x849f bytes) 000938 1788941713.548061 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x2522c): Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2522c): Mirror 14: 0x84746974 (stale) Mirror 17: 0x84746974 (stale) Mirror 18: 0x84746974 (stale) Mirror 20: 0x84746974 (stale) Mirror 21: 0x84746974 (stale) Mirror 23: 0x84746974 (stale) Mirror 24: 0x84746974 (stale) Mirror 25: 0x84746974 (stale) Mirror 27: 0x84746974 (stale) Mirror 28: 0x84746974 (stale) Mirror 30: 0x84746974 (stale) CRC-32 checksum value for chunk [0, 0x2522c): Mirror 1: 0x9b45ec6e Mirror 31: 0x9b45ec6e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2522c: skipped 000940 1788941714.964261 MIRROR_RESYNC 13 mirrors 000941 1788941717.637096 write 0x0074f5 thru 0x00984d (0x2359 bytes) 000943 1788941717.756189 read 0x008ced thru 0x015a33 (0xcd47 bytes) 000944 1788941717.764871 write 0x0384e3 thru 0x03ffff (0x7b1d bytes) 000946 1788941717.766709 mapwrite 0x012966 thru 0x0132c3 (0x95e bytes) 000947 1788941717.832576 punch from 0x031d70 to 0x03e4bd (0xc74e bytes) 000948 1788941717.842130 MIRROR_RESYNC 13 mirrors 000950 1788941720.234132 mapwrite 0x00426f thru 0x00e8a7 (0xa639 bytes) 000951 1788941720.544712 read 0x007031 thru 0x008427 (0x13f7 bytes) 000952 1788941720.545705 mapread 0x005991 thru 0x007f65 (0x25d5 bytes) 000953 1788941720.547544 read 0x03e205 thru 0x03ffff (0x1dfb bytes) 000954 1788941720.557384 mapwrite 0x02b063 thru 0x036db2 (0xbd50 bytes) 000955 1788941720.601332 read 0x01a121 thru 0x0283f0 (0xe2d0 bytes) 000957 1788941720.602640 mapread 0x030d62 thru 0x03e5f3 (0xd892 bytes) 000958 1788941720.603689 trunc from 0x040000 to 0x02d71e (0x128e1 bytes) 000960 1788941720.633334 trunc from 0x02d71f to 0x031db2 (0x4694 bytes) 000961 1788941720.655447 mapread 0x010058 thru 0x01e494 (0xe43d bytes) 000962 1788941720.658171 write 0x00b28c thru 0x00d6fd (0x2472 bytes) 000963 1788941720.664477 write 0x000840 thru 0x00ae86 (0xa647 bytes) 000965 1788941720.667538 trunc from 0x031db3 to 0x03b683 (0x98d1 bytes) 000966 1788941720.691696 punch from 0x02969b to 0x02b806 (0x216c bytes) 000968 1788941720.711072 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3b684): Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b684): Mirror 14: 0xf3a1bc10 (stale) Mirror 17: 0xf3a1bc10 (stale) Mirror 18: 0xf3a1bc10 (stale) Mirror 20: 0xf3a1bc10 (stale) Mirror 21: 0xf3a1bc10 (stale) Mirror 23: 0xf3a1bc10 (stale) Mirror 24: 0xf3a1bc10 (stale) Mirror 25: 0xf3a1bc10 (stale) Mirror 27: 0xf3a1bc10 (stale) Mirror 28: 0xf3a1bc10 (stale) Mirror 30: 0xf3a1bc10 (stale) Mirror 31: 0xf3a1bc10 (stale) CRC-32 checksum value for chunk [0, 0x3b684): Mirror 1: 0x49c45a04 Mirror 32: 0x49c45a04 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b684: skipped 000970 1788941722.077310 MIRROR_SPLIT mirror 3 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b684): Mirror 14: 0xf3a1bc10 (stale) Mirror 17: 0xf3a1bc10 (stale) Mirror 20: 0xf3a1bc10 (stale) Mirror 21: 0xf3a1bc10 (stale) Mirror 23: 0xf3a1bc10 (stale) Mirror 24: 0xf3a1bc10 (stale) Mirror 25: 0xf3a1bc10 (stale) Mirror 27: 0xf3a1bc10 (stale) Mirror 28: 0xf3a1bc10 (stale) Mirror 30: 0xf3a1bc10 (stale) Mirror 31: 0xf3a1bc10 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b684): Mirror 14: 0xf3a1bc10 (stale) Mirror 17: 0xf3a1bc10 (stale) Mirror 20: 0xf3a1bc10 (stale) Mirror 21: 0xf3a1bc10 (stale) Mirror 23: 0xf3a1bc10 (stale) Mirror 24: 0xf3a1bc10 (stale) Mirror 25: 0xf3a1bc10 (stale) Mirror 27: 0xf3a1bc10 (stale) Mirror 28: 0xf3a1bc10 (stale) Mirror 30: 0xf3a1bc10 (stale) Mirror 31: 0xf3a1bc10 (stale) CRC-32 checksum value for chunk [0, 0x3b684): Mirror 1: 0x49c45a04 Mirror 32: 0x49c45a04 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b684: skipped 000972 1788941723.678462 mapread 0x01a2ad thru 0x01f235 (0x4f89 bytes) 000974 1788941723.746522 punch from 0x033619 to 0x03b683 (0x806b bytes) 000975 1788941723.854133 read 0x029105 thru 0x033aba (0xa9b6 bytes) 000976 1788941723.868961 read 0x02dc1d thru 0x02e0e8 (0x4cc bytes) 000978 1788941723.870147 mapwrite 0x0390f1 thru 0x03ffff (0x6f0f bytes) 000979 1788941723.961204 trunc from 0x040000 to 0x0074e5 (0x38b1a bytes) 000980 1788941723.993723 mapwrite 0x01f4c2 thru 0x029cdd (0xa81c bytes) 000981 1788941724.228976 write 0x039b90 thru 0x03c25c (0x26cd bytes) 000982 1788941724.230027 mapread 0x01cc0d thru 0x025f4f (0x9343 bytes) 000983 1788941724.267270 write 0x001e1b thru 0x00f640 (0xd826 bytes) 000984 1788941724.295236 MIRROR_RESYNC 13 mirrors 000986 1788941726.798452 trunc from 0x03c25d to 0x0281d5 (0x14087 bytes) 000987 1788941726.880478 punch from 0x00b693 to 0x0191f4 (0xdb62 bytes) 000988 1788941726.886327 trunc from 0x0281d6 to 0x002e73 (0x25362 bytes) 000990 1788941726.916485 write 0x0162e0 thru 0x0253db (0xf0fc bytes) 000992 1788941726.923331 read 0x00fd55 thru 0x00ff84 (0x230 bytes) 000993 1788941726.935843 MIRROR_SPLIT mirror 2 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x184:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x253dc): Mirror 14: 0x4f3b4957 (stale) Mirror 20: 0x4f3b4957 (stale) Mirror 21: 0x4f3b4957 (stale) Mirror 23: 0x4f3b4957 (stale) Mirror 24: 0x4f3b4957 (stale) Mirror 25: 0x4f3b4957 (stale) Mirror 27: 0x4f3b4957 (stale) Mirror 28: 0x4f3b4957 (stale) Mirror 30: 0x4f3b4957 (stale) Mirror 31: 0x4f3b4957 (stale) Mirror 32: 0x4f3b4957 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x253dc): Mirror 14: 0x4f3b4957 (stale) Mirror 20: 0x4f3b4957 (stale) Mirror 21: 0x4f3b4957 (stale) Mirror 23: 0x4f3b4957 (stale) Mirror 24: 0x4f3b4957 (stale) Mirror 25: 0x4f3b4957 (stale) Mirror 27: 0x4f3b4957 (stale) Mirror 28: 0x4f3b4957 (stale) Mirror 30: 0x4f3b4957 (stale) Mirror 31: 0x4f3b4957 (stale) Mirror 32: 0x4f3b4957 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x253dc: skipped 000995 1788941727.839496 mapwrite 0x00bbbe thru 0x01898f (0xcdd2 bytes) 000996 1788941728.037187 write 0x004e0c thru 0x00cb38 (0x7d2d bytes) 000997 1788941728.056088 trunc from 0x0253dc to 0x00fb17 (0x158c4 bytes) 000998 1788941728.099357 mapread 0x0099f1 thru 0x00fb17 (0x6127 bytes) 000999 1788941728.109864 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0xfb18): Mirror 14: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xfb18): Mirror 14: 0xb0db0106 (stale) Mirror 20: 0xb0db0106 (stale) Mirror 21: 0xb0db0106 (stale) Mirror 23: 0xb0db0106 (stale) Mirror 24: 0xb0db0106 (stale) Mirror 25: 0xb0db0106 (stale) Mirror 27: 0xb0db0106 (stale) Mirror 28: 0xb0db0106 (stale) Mirror 30: 0xb0db0106 (stale) Mirror 31: 0xb0db0106 (stale) Mirror 32: 0xb0db0106 (stale) CRC-32 checksum value for chunk [0, 0xfb18): Mirror 1: 0xe922730a Mirror 33: 0xe922730a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xfb18: skipped All operations completed A-OK!