== sanity-flr test 70a: flr mode fsx test ================ 19:41:35 (1787614895) Seed set to 4897 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1787614898.271634 mapwrite 0x03b7e6 thru 0x03ffff (0x481a bytes) 000006 1787614898.510652 mapwrite 0x00870a thru 0x00b911 (0x3208 bytes) 000008 1787614898.686270 MIRROR_EXTEND to 2 mirrors 000009 1787614900.634647 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) 000014 1787614900.873945 read 0x02347f thru 0x02e9c1 (0xb543 bytes) 000015 1787614900.897043 mapwrite 0x0094d5 thru 0x00fa97 (0x65c3 bytes) truncating to largest ever: 0x2380c 000017 1787614901.062416 trunc from 0x040000 to 0x02380b (0x1c7f4 bytes) 000018 1787614901.095761 MIRROR_EXTEND to 2 mirrors 000019 1787614901.961899 MIRROR_RESYNC 2 mirrors 000022 1787614902.405567 write 0x002ac2 thru 0x00e72a (0xbc69 bytes) 000025 1787614902.517559 write 0x03ee81 thru 0x03ffff (0x117f bytes) 000026 1787614902.518729 write 0x01964a thru 0x01d142 (0x3af9 bytes) 000027 1787614902.533722 mapread 0x02c840 thru 0x039ab5 (0xd276 bytes) 000029 1787614902.585323 MIRROR_RESYNC 2 mirrors 000030 1787614903.694143 trunc from 0x040000 to 0x0065be (0x39a41 bytes) 000031 1787614903.782198 mapread 0x00363d thru 0x0065be (0x2f82 bytes) 000032 1787614903.810137 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x65bf): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x65bf): Mirror 2: 0xbe54b968 (stale) CRC-32 checksum value for chunk [0, 0x65bf): Mirror 1: 0xbe54b968 Mirror 3: 0xbe54b968 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x65bf: skipped 000034 1787614904.815753 mapread 0x00586e thru 0x0065be (0xd51 bytes) 000036 1787614904.837150 read 0x003f51 thru 0x0065be (0x266e bytes) 000037 1787614904.842469 mapwrite 0x004cc8 thru 0x0085fa (0x3933 bytes) 000038 1787614905.116825 read 0x000951 thru 0x0085fa (0x7caa bytes) 000040 1787614905.125894 write 0x01e451 thru 0x02438b (0x5f3b bytes) truncating to largest ever: 0x240d7 000041 1787614905.127545 trunc from 0x02438c to 0x0240d6 (0x2b5 bytes) 000042 1787614905.158172 trunc from 0x0240d7 to 0x0041df (0x1fef7 bytes) truncating to largest ever: 0x2b75f 000043 1787614905.188698 trunc from 0x0041e0 to 0x02b75e (0x2757f bytes) 000044 1787614905.208006 read 0x00dda5 thru 0x0135ab (0x5807 bytes) 000045 1787614905.226475 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2b75f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b75f): Mirror 2: 0x1e9bbdfa (stale) Mirror 3: 0x1200465e (stale) CRC-32 checksum value for chunk [0, 0x2b75f): Mirror 1: 0x34ff9ccb Mirror 4: 0x34ff9ccb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b75f: skipped 000048 1787614906.937087 mapwrite 0x00dc73 thru 0x014bb3 (0x6f41 bytes) 000050 1787614907.185248 trunc from 0x02b75f to 0x0163c4 (0x1539a bytes) 000051 1787614907.217230 read 0x00d833 thru 0x01100a (0x37d8 bytes) 000053 1787614907.220171 write 0x004054 thru 0x004b40 (0xaed bytes) 000056 1787614907.229947 mapread 0x0075e4 thru 0x012e6a (0xb887 bytes) 000057 1787614907.231912 mapread 0x010396 thru 0x0163c4 (0x602f bytes) 000058 1787614907.233462 trunc from 0x0163c5 to 0x01654b (0x187 bytes) 000059 1787614907.251663 trunc from 0x01654c to 0x00c694 (0x9eb7 bytes) 000062 1787614907.270499 mapread 0x0024a6 thru 0x00c694 (0xa1ef bytes) 000063 1787614907.280725 write 0x02ecff thru 0x03c993 (0xdc95 bytes) 000065 1787614907.283536 mapwrite 0x004dae thru 0x00e426 (0x9679 bytes) 000068 1787614907.355556 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c994): Mirror 3: 0x41d17eb8 (stale) Mirror 4: 0x67f57c3d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c994): Mirror 3: 0x41d17eb8 (stale) Mirror 4: 0x67f57c3d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c994: skipped 000070 1787614907.914811 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3c994): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c994): Mirror 3: 0x41d17eb8 (stale) Mirror 4: 0x67f57c3d (stale) CRC-32 checksum value for chunk [0, 0x3c994): Mirror 1: 0xa29bb9c4 Mirror 5: 0xa29bb9c4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c994: skipped 000071 1787614909.620572 mapwrite 0x00e5b1 thru 0x0148ef (0x633f bytes) 000072 1787614909.985721 read 0x00e143 thru 0x010aa0 (0x295e bytes) 000074 1787614909.989813 mapread 0x0050de thru 0x010423 (0xb346 bytes) 000075 1787614910.007847 trunc from 0x03c994 to 0x01ac35 (0x21d5e bytes) 000076 1787614910.042263 read 0x00ea08 thru 0x01255f (0x3b58 bytes) 000077 1787614910.058987 MIRROR_RESYNC 4 mirrors 000079 1787614911.603549 write 0x02b7dc thru 0x034868 (0x908d bytes) 000080 1787614911.742112 mapwrite 0x01755c thru 0x01db35 (0x65da bytes) 000081 1787614912.004209 read 0x0284c8 thru 0x02fbe6 (0x771f bytes) 000082 1787614912.019529 mapwrite 0x0246bf thru 0x031590 (0xced2 bytes) 000083 1787614912.113165 write 0x0158c0 thru 0x01591e (0x5f bytes) 000084 1787614912.115289 write 0x00ddc1 thru 0x01c23f (0xe47f bytes) 000085 1787614912.135135 mapwrite 0x00f28b thru 0x00f6ac (0x422 bytes) 000086 1787614912.303992 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34869): Mirror 4: 0x551903a2 (stale) Mirror 5: 0x551903a2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34869): Mirror 4: 0x551903a2 (stale) Mirror 5: 0x551903a2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34869: skipped 000090 1787614913.100920 read 0x0333a7 thru 0x034868 (0x14c2 bytes) 000093 1787614913.115088 read 0x0047ce thru 0x00ce51 (0x8684 bytes) 000094 1787614913.158324 mapwrite 0x010450 thru 0x019479 (0x902a bytes) truncating to largest ever: 0x37804 000095 1787614913.377561 trunc from 0x034869 to 0x037803 (0x2f9b bytes) 000097 1787614913.482424 write 0x034c49 thru 0x03ffff (0xb3b7 bytes) 000099 1787614913.489654 read 0x00d0c7 thru 0x019e65 (0xcd9f bytes) 000101 1787614913.490869 read 0x0050dc thru 0x0083e9 (0x330e bytes) 000102 1787614913.493818 trunc from 0x040000 to 0x000649 (0x3f9b6 bytes) 000103 1787614913.529860 write 0x0172c2 thru 0x01e481 (0x71c0 bytes) 000104 1787614913.547620 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1e482): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e482): Mirror 4: 0xbacddf8a (stale) Mirror 5: 0xbacddf8a (stale) CRC-32 checksum value for chunk [0, 0x1e482): Mirror 1: 0xffb376c2 Mirror 6: 0xffb376c2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e482: skipped 000106 1787614915.779932 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e482): Mirror 4: 0xbacddf8a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e482): Mirror 4: 0xbacddf8a (stale) CRC-32 checksum value for chunk [0, 0x1e482): Mirror 1: 0xffb376c2 Mirror 6: 0xffb376c2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e482: skipped 000107 1787614916.471669 mapwrite 0x02d80e thru 0x033704 (0x5ef7 bytes) 000108 1787614916.766033 write 0x039c50 thru 0x03e837 (0x4be8 bytes) 000109 1787614916.771246 write 0x00d46d thru 0x01cd9e (0xf932 bytes) 000112 1787614916.791114 read 0x000319 thru 0x006592 (0x627a bytes) 000113 1787614916.805294 read 0x013bd2 thru 0x01efd8 (0xb407 bytes) 000114 1787614916.818714 read 0x016ee4 thru 0x01fca4 (0x8dc1 bytes) 000117 1787614916.821051 trunc from 0x03e838 to 0x00cd7f (0x31ab8 bytes) 000118 1787614916.848527 trunc from 0x00cd80 to 0x018c9b (0xbf1c bytes) 000119 1787614916.871445 read 0x005ecc thru 0x01594f (0xfa84 bytes) 000120 1787614916.892915 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18c9c): Mirror 4: 0xfb64dc17 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18c9c): Mirror 4: 0xfb64dc17 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18c9c: skipped 000121 1787614917.261970 read 0x006567 thru 0x00ae0b (0x48a5 bytes) 000124 1787614917.281506 read 0x00628f thru 0x006578 (0x2ea bytes) 000125 1787614917.282128 read 0x002ee9 thru 0x005232 (0x234a bytes) 000126 1787614917.313589 trunc from 0x018c9c to 0x015903 (0x3398 bytes) 000130 1787614917.344182 mapwrite 0x01de23 thru 0x028c33 (0xae11 bytes) 000132 1787614917.462100 trunc from 0x028c34 to 0x036042 (0xd40f bytes) 000134 1787614917.495633 mapread 0x029db1 thru 0x03543e (0xb68e bytes) 000135 1787614917.510618 write 0x01d215 thru 0x01d9ea (0x7d6 bytes) 000136 1787614917.512141 mapread 0x01d02c thru 0x0211cd (0x41a2 bytes) 000138 1787614917.513870 read 0x011353 thru 0x01369c (0x234a bytes) 000142 1787614917.516154 read 0x015fb5 thru 0x023be5 (0xdc31 bytes) 000144 1787614917.523389 read 0x01e4b5 thru 0x02340f (0x4f5b bytes) 000145 1787614917.524050 write 0x02c1f1 thru 0x0314da (0x52ea bytes) 000149 1787614917.527523 mapwrite 0x01abad thru 0x01c206 (0x165a bytes) 000150 1787614917.656249 read 0x02ad07 thru 0x036042 (0xb33c bytes) 000152 1787614917.659955 mapread 0x01e5a8 thru 0x024b3d (0x6596 bytes) 000153 1787614917.663845 trunc from 0x036043 to 0x011948 (0x246fa bytes) 000155 1787614917.697178 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x11949): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11949): Mirror 4: 0xc20fb496 (stale) CRC-32 checksum value for chunk [0, 0x11949): Mirror 1: 0x106593e1 Mirror 5: 0x106593e1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11949: skipped 000156 1787614919.151123 trunc from 0x011949 to 0x008361 (0x95e7 bytes) 000160 1787614919.332545 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x8362): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8362): Mirror 4: 0x66acb7e5 (stale) Mirror 5: 0x263ae47c (stale) CRC-32 checksum value for chunk [0, 0x8362): Mirror 1: 0x263ae47c Mirror 6: 0x263ae47c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8362: skipped 000161 1787614920.563163 mapread 0x001344 thru 0x00217d (0xe3a bytes) 000165 1787614920.606625 write 0x0152ef thru 0x01a718 (0x542a bytes) 000167 1787614920.743844 write 0x026998 thru 0x02b477 (0x4ae0 bytes) 000168 1787614920.748694 mapread 0x01e425 thru 0x0217f1 (0x33cd bytes) 000169 1787614920.768515 read 0x001e23 thru 0x00214f (0x32d bytes) 000171 1787614920.778826 mapwrite 0x0017b1 thru 0x00a803 (0x9053 bytes) 000172 1787614920.892439 mapread 0x01e912 thru 0x021323 (0x2a12 bytes) 000173 1787614920.894283 trunc from 0x02b478 to 0x03584c (0xa3d5 bytes) 000174 1787614920.947548 trunc from 0x03584d to 0x0187fc (0x1d050 bytes) 000175 1787614920.981559 trunc from 0x0187fd to 0x01644c (0x23b0 bytes) 000176 1787614921.032982 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1644d): Mirror 5: 0xc42af503 (stale) Mirror 6: 0xc42af503 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1644d): Mirror 5: 0xc42af503 (stale) Mirror 6: 0xc42af503 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1644d: skipped 000177 1787614921.872298 write 0x0285a2 thru 0x02cbc7 (0x4626 bytes) 000179 1787614921.873990 mapread 0x01477e thru 0x01ed7d (0xa600 bytes) 000181 1787614921.917757 mapwrite 0x03abeb thru 0x03ffff (0x5415 bytes) 000183 1787614922.214717 trunc from 0x040000 to 0x012119 (0x2dee6 bytes) 000184 1787614922.299439 MIRROR_RESYNC 3 mirrors 000185 1787614923.619101 read 0x011357 thru 0x012119 (0xdc3 bytes) 000186 1787614923.629961 trunc from 0x01211a to 0x00d904 (0x4815 bytes) 000188 1787614923.879877 read 0x003a1b thru 0x00d904 (0x9eea bytes) 000190 1787614923.916759 mapwrite 0x02d7b1 thru 0x02e3ec (0xc3c bytes) 000193 1787614924.171404 read 0x021bc6 thru 0x027cd8 (0x6113 bytes) 000195 1787614924.183855 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e3ed): Mirror 6: 0x5250f5a6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e3ed): Mirror 6: 0x5250f5a6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e3ed: skipped 000197 1787614924.615510 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) 000202 1787614924.930248 trunc from 0x02e3ed to 0x010bc0 (0x1d82c bytes) 000206 1787614924.963782 write 0x03931d thru 0x03ffff (0x6ce3 bytes) 000207 1787614924.965284 trunc from 0x040000 to 0x001b9c (0x3e463 bytes) 000208 1787614924.989918 write 0x02b756 thru 0x02ea44 (0x32ef bytes) 000210 1787614925.002883 mapread 0x008aea thru 0x00bbed (0x3104 bytes) 000211 1787614925.021248 write 0x031bbb thru 0x03fc4c (0xe092 bytes) 000212 1787614925.023542 read 0x00c999 thru 0x0115a3 (0x4c0b bytes) 000213 1787614925.024048 mapwrite 0x03d3dd thru 0x03ffff (0x2c23 bytes) 000214 1787614925.132998 MIRROR_EXTEND to 2 mirrors 000216 1787614926.580745 mapwrite 0x03fa68 thru 0x03ffff (0x598 bytes) 000217 1787614926.924247 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) 000218 1787614927.189899 mapwrite 0x01c044 thru 0x025813 (0x97d0 bytes) 000220 1787614927.316503 write 0x031b4a thru 0x0369cf (0x4e86 bytes) 000222 1787614927.346546 trunc from 0x040000 to 0x001932 (0x3e6cd bytes) 000225 1787614927.412364 read 0x00173f thru 0x001932 (0x1f4 bytes) 000226 1787614927.419841 trunc from 0x001933 to 0x030338 (0x2ea06 bytes) 000227 1787614927.443401 read 0x00d2ea thru 0x01696e (0x9685 bytes) 000228 1787614927.460797 write 0x021c95 thru 0x02fb38 (0xdea4 bytes) 000229 1787614927.468508 read 0x00435e thru 0x008374 (0x4017 bytes) 000230 1787614927.469981 read 0x001256 thru 0x00b405 (0xa1b0 bytes) 000231 1787614927.471613 mapread 0x02fa14 thru 0x030338 (0x925 bytes) 000233 1787614927.474848 read 0x01600a thru 0x022f82 (0xcf79 bytes) 000236 1787614927.478592 read 0x00eef6 thru 0x019c96 (0xada1 bytes) 000237 1787614927.479606 mapread 0x00f025 thru 0x010e65 (0x1e41 bytes) 000238 1787614927.481532 write 0x0358f5 thru 0x03ffff (0xa70b bytes) 000239 1787614927.484577 trunc from 0x040000 to 0x021804 (0x1e7fb bytes) 000241 1787614927.515889 trunc from 0x021805 to 0x02c61b (0xae17 bytes) 000242 1787614927.534994 mapwrite 0x037e58 thru 0x0382b3 (0x45c bytes) truncating to largest ever: 0x3dfee 000243 1787614927.618077 trunc from 0x0382b4 to 0x03dfed (0x5d3a bytes) 000245 1787614927.648640 write 0x030e71 thru 0x03c2d6 (0xb466 bytes) 000247 1787614927.667543 mapread 0x0228ea thru 0x02d142 (0xa859 bytes) 000248 1787614927.674026 mapwrite 0x031341 thru 0x03ccda (0xb99a bytes) 000250 1787614927.765722 mapread 0x038d19 thru 0x03dfed (0x52d5 bytes) 000252 1787614927.787120 trunc from 0x03dfee to 0x007333 (0x36cba bytes) 000253 1787614927.829613 mapwrite 0x018c08 thru 0x021660 (0x8a59 bytes) 000254 1787614927.987859 write 0x035e7b thru 0x03ffff (0xa185 bytes) 000256 1787614927.989946 trunc from 0x040000 to 0x0192f9 (0x26d06 bytes) 000257 1787614928.057411 mapwrite 0x02bf0c thru 0x035a40 (0x9b35 bytes) 000258 1787614928.213990 mapread 0x02c80c thru 0x0347dc (0x7fd1 bytes) 000259 1787614928.215956 read 0x007107 thru 0x012a82 (0xb97c bytes) 000264 1787614928.229440 read 0x01f53e thru 0x029da0 (0xa863 bytes) 000266 1787614928.232425 read 0x01fb00 thru 0x022519 (0x2a1a bytes) 000268 1787614928.234766 mapread 0x010e86 thru 0x01a12b (0x92a6 bytes) 000273 1787614928.240087 write 0x00bec0 thru 0x00f0a8 (0x31e9 bytes) 000274 1787614928.242719 trunc from 0x035a41 to 0x01d50a (0x18536 bytes) 000275 1787614928.266707 write 0x027c05 thru 0x028ccf (0x10cb bytes) 000276 1787614928.269534 trunc from 0x028cd0 to 0x00b0c7 (0x1dc08 bytes) 000281 1787614928.296072 mapwrite 0x026b87 thru 0x035257 (0xe6d1 bytes) 000282 1787614928.381792 trunc from 0x035258 to 0x01ecd3 (0x16584 bytes) 000285 1787614928.415831 read 0x00bc0e thru 0x014863 (0x8c56 bytes) 000286 1787614928.419352 mapread 0x000541 thru 0x00fe37 (0xf8f7 bytes) 000287 1787614928.420977 mapwrite 0x0059e4 thru 0x008956 (0x2f73 bytes) 000288 1787614928.471704 read 0x00176f thru 0x008de2 (0x7674 bytes) 000289 1787614928.473808 write 0x01b4b5 thru 0x026ec0 (0xba0c bytes) 000290 1787614928.477653 mapread 0x01453d thru 0x01fe68 (0xb92c bytes) 000291 1787614928.479204 trunc from 0x026ec1 to 0x0194c4 (0xd9fc bytes) 000293 1787614928.500203 mapwrite 0x034d6a thru 0x036de9 (0x2080 bytes) 000294 1787614928.569662 write 0x01475b thru 0x01f643 (0xaee9 bytes) 000295 1787614928.573313 read 0x021e48 thru 0x0257e5 (0x399e bytes) 000297 1787614928.574750 mapread 0x0360ae thru 0x036de9 (0xd3c bytes) 000298 1787614928.577202 read 0x029ef3 thru 0x02a021 (0x12f bytes) 000303 1787614928.584509 read 0x0361e3 thru 0x036de9 (0xc07 bytes) 000309 1787614928.590023 mapread 0x0241eb thru 0x02cb77 (0x898d bytes) 000310 1787614928.592613 mapwrite 0x0312e8 thru 0x03ffff (0xed18 bytes) 000311 1787614928.797211 MIRROR_EXTEND to 2 mirrors 000312 1787614930.599662 mapwrite 0x01efed thru 0x0288d1 (0x98e5 bytes) 000313 1787614931.065201 write 0x00c11b thru 0x01607c (0x9f62 bytes) 000314 1787614931.082568 mapread 0x0333c4 thru 0x0396e2 (0x631f bytes) 000315 1787614931.097654 mapread 0x0041f3 thru 0x008698 (0x44a6 bytes) 000316 1787614931.126553 mapwrite 0x0354ff thru 0x03f5b4 (0xa0b6 bytes) 000317 1787614931.216552 read 0x0102e4 thru 0x016c62 (0x697f bytes) 000319 1787614931.228094 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) 000325 1787614931.422946 MIRROR_EXTEND to 2 mirrors 000327 1787614932.443521 mapread 0x022165 thru 0x022d1d (0xbb9 bytes) 000328 1787614932.451597 mapread 0x0195fc thru 0x01c0ef (0x2af4 bytes) 000329 1787614932.477770 MIRROR_RESYNC 2 mirrors 000330 1787614933.184040 write 0x0350dd thru 0x03ffff (0xaf23 bytes) 000336 1787614933.369006 read 0x02d215 thru 0x03839e (0xb18a bytes) 000337 1787614933.386879 mapread 0x021730 thru 0x0253bf (0x3c90 bytes) 000339 1787614933.418101 mapwrite 0x03d58a thru 0x03ffff (0x2a76 bytes) 000340 1787614933.582680 trunc from 0x040000 to 0x0006a9 (0x3f956 bytes) 000341 1787614933.621377 read 0x0001f6 thru 0x0006a9 (0x4b4 bytes) 000343 1787614933.638051 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x6aa): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x6aa): Mirror 2: 0xb3c704a (stale) CRC-32 checksum value for chunk [0, 0x6aa): Mirror 1: 0xb3c704a Mirror 3: 0xb3c704a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x6aa: skipped 000344 1787614934.771635 write 0x002c39 thru 0x00f51e (0xc8e6 bytes) 000345 1787614934.894138 mapread 0x009420 thru 0x00f42d (0x600e bytes) 000346 1787614934.895143 write 0x024d37 thru 0x029ba9 (0x4e73 bytes) 000347 1787614934.897689 read 0x021a0d thru 0x024dcd (0x33c1 bytes) 000348 1787614934.908452 trunc from 0x029baa to 0x00b628 (0x1e581 bytes) 000350 1787614934.938784 trunc from 0x00b629 to 0x029eef (0x1e8c7 bytes) 000351 1787614934.977308 write 0x02b06f thru 0x02f2c1 (0x4253 bytes) 000353 1787614934.994259 trunc from 0x02f2c2 to 0x02b4c8 (0x3df9 bytes) 000354 1787614935.072918 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x2b4c9): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b4c9): Mirror 2: 0x5fd79649 (stale) Mirror 3: 0x40f8cb95 (stale) CRC-32 checksum value for chunk [0, 0x2b4c9): Mirror 1: 0x512e767f Mirror 4: 0x512e767f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b4c9: skipped 000355 1787614936.856853 trunc from 0x02b4c9 to 0x0052f0 (0x261d8 bytes) 000357 1787614937.081762 write 0x034ec4 thru 0x0385dd (0x371a bytes) 000360 1787614937.093314 read 0x004160 thru 0x0137d0 (0xf671 bytes) 000361 1787614937.123294 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x385de): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x385de): Mirror 2: 0x66a0e2fa (stale) Mirror 3: 0xb2001731 (stale) Mirror 4: 0xe4a7551 (stale) CRC-32 checksum value for chunk [0, 0x385de): Mirror 1: 0xd67f919 Mirror 5: 0xd67f919 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x385de: skipped 000363 1787614938.533845 write 0x02743c thru 0x028fc6 (0x1b8b bytes) 000364 1787614938.607079 read 0x00f6c8 thru 0x016e82 (0x77bb bytes) 000365 1787614938.616555 mapread 0x032e85 thru 0x0385dd (0x5759 bytes) 000366 1787614938.636243 read 0x02ef35 thru 0x0385dd (0x96a9 bytes) 000367 1787614938.637262 write 0x0104f5 thru 0x01259e (0x20aa bytes) 000370 1787614938.640892 mapwrite 0x01733f thru 0x017dd7 (0xa99 bytes) 000371 1787614938.715303 mapread 0x017d36 thru 0x023f22 (0xc1ed bytes) 000372 1787614938.722232 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x385de): Mirror 3: 0xb2001731 (stale) Mirror 4: 0xe4a7551 (stale) Mirror 5: 0xd67f919 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x385de): Mirror 3: 0xb2001731 (stale) Mirror 4: 0xe4a7551 (stale) Mirror 5: 0xd67f919 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x385de: skipped 000373 1787614939.186203 mapwrite 0x021a1a thru 0x026510 (0x4af7 bytes) 000376 1787614939.258974 read 0x01e13a thru 0x02d893 (0xf75a bytes) 000377 1787614939.269838 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x385de): Mirror 4: 0xe4a7551 (stale) Mirror 5: 0xd67f919 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x385de): Mirror 4: 0xe4a7551 (stale) Mirror 5: 0xd67f919 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x385de: skipped 000381 1787614939.564828 mapwrite 0x0028a5 thru 0x00e616 (0xbd72 bytes) 000382 1787614939.707797 write 0x00d34d thru 0x01a42e (0xd0e2 bytes) 000384 1787614939.717761 write 0x038512 thru 0x03ffff (0x7aee bytes) 000387 1787614939.733639 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x8e6bd42d (stale) Mirror 5: 0x669c9a0d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbef1dad0 Mirror 6: 0xbef1dad0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000391 1787614940.630918 write 0x005054 thru 0x0059b4 (0x961 bytes) 000393 1787614940.717427 read 0x03f88e thru 0x03ffff (0x772 bytes) 000394 1787614940.720971 mapwrite 0x00c3a1 thru 0x01078f (0x43ef bytes) 000395 1787614940.822949 read 0x01afe8 thru 0x01c910 (0x1929 bytes) 000396 1787614940.836287 trunc from 0x040000 to 0x0133ca (0x2cc35 bytes) 000401 1787614940.879887 trunc from 0x0133cb to 0x01c9b5 (0x95eb bytes) 000402 1787614940.896198 write 0x02665c thru 0x02844a (0x1def bytes) 000403 1787614940.899175 mapread 0x014f71 thru 0x016dda (0x1e6a bytes) 000408 1787614940.934017 read 0x01a908 thru 0x026b31 (0xc22a bytes) 000409 1787614940.953552 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2844b): Mirror 4: 0x3cfcc21c (stale) Mirror 5: 0xde9e80b1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2844b): Mirror 4: 0x3cfcc21c (stale) Mirror 5: 0xde9e80b1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2844b: skipped 000410 1787614941.354224 trunc from 0x02844b to 0x00f767 (0x18ce3 bytes) 000411 1787614941.376636 mapwrite 0x036510 thru 0x038abf (0x25b0 bytes) 000412 1787614941.464016 write 0x015bb7 thru 0x019bd6 (0x4020 bytes) 000413 1787614941.491119 read 0x0193f0 thru 0x01f7b1 (0x63c2 bytes) 000416 1787614941.498137 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x38ac0): Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38ac0): Mirror 4: 0x575c9c20 (stale) Mirror 5: 0xd9f66142 (stale) CRC-32 checksum value for chunk [0, 0x38ac0): Mirror 1: 0x2b6829f8 Mirror 6: 0x2b6829f8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38ac0: skipped 000417 1787614942.979575 mapwrite 0x00ff3e thru 0x01f5ff (0xf6c2 bytes) 000419 1787614943.378520 MIRROR_RESYNC 4 mirrors 000420 1787614944.929258 trunc from 0x038ac0 to 0x01efa5 (0x19b1a bytes) 000421 1787614944.987038 write 0x01e912 thru 0x020e84 (0x2573 bytes) 000426 1787614944.995582 mapread 0x000142 thru 0x000169 (0x28 bytes) 000427 1787614945.002747 write 0x0226ad thru 0x03008d (0xd9e1 bytes) 000428 1787614945.004510 trunc from 0x03008e to 0x01d438 (0x12c55 bytes) 000429 1787614945.026249 write 0x00a67d thru 0x00df9c (0x3920 bytes) 000430 1787614945.033877 write 0x0336ba thru 0x03ffff (0xc946 bytes) 000431 1787614945.035162 mapwrite 0x031fb8 thru 0x037190 (0x51d9 bytes) 000432 1787614945.074661 mapread 0x014cf7 thru 0x022a27 (0xdd31 bytes) 000435 1787614945.090103 trunc from 0x040000 to 0x021378 (0x1ec87 bytes) 000436 1787614945.107515 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x21379): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21379): Mirror 4: 0x18640c0b (stale) Mirror 5: 0x18640c0b (stale) Mirror 6: 0x18640c0b (stale) CRC-32 checksum value for chunk [0, 0x21379): Mirror 1: 0x3c753c7 Mirror 7: 0x3c753c7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21379: skipped 000438 1787614946.264464 trunc from 0x021379 to 0x02487e (0x3506 bytes) 000440 1787614946.444936 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2487f): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2487f): Mirror 4: 0x5ac7b12e (stale) Mirror 5: 0x5ac7b12e (stale) Mirror 6: 0x5ac7b12e (stale) Mirror 7: 0x5a4c1231 (stale) CRC-32 checksum value for chunk [0, 0x2487f): Mirror 1: 0x5a4c1231 Mirror 8: 0x5a4c1231 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2487f: skipped 000441 1787614947.942950 write 0x026ab6 thru 0x0318ed (0xae38 bytes) 000442 1787614948.010373 read 0x022977 thru 0x029271 (0x68fb bytes) 000446 1787614948.017745 mapread 0x02cec6 thru 0x030574 (0x36af bytes) 000447 1787614948.020087 mapread 0x00a42c thru 0x012c1c (0x87f1 bytes) 000449 1787614948.041197 mapread 0x00a187 thru 0x019334 (0xf1ae bytes) 000450 1787614948.053252 trunc from 0x0318ee to 0x0164a6 (0x1b447 bytes) 000452 1787614948.073125 write 0x00136b thru 0x001e49 (0xadf bytes) 000454 1787614948.080906 read 0x0042cd thru 0x0056a7 (0x13db bytes) 000455 1787614948.087969 trunc from 0x0164a7 to 0x00f19a (0x730c bytes) 000456 1787614948.112023 read 0x00d7e5 thru 0x00f19a (0x19b6 bytes) 000457 1787614948.113181 trunc from 0x00f19b to 0x012203 (0x3069 bytes) 000459 1787614948.136966 trunc from 0x012204 to 0x005400 (0xce03 bytes) 000460 1787614948.169933 read 0x001226 thru 0x002463 (0x123e bytes) 000461 1787614948.174793 MIRROR_RESYNC 6 mirrors 000462 1787614949.678144 MIRROR_RESYNC 6 mirrors 000463 1787614950.432021 mapread 0x001033 thru 0x005400 (0x43ce bytes) 000466 1787614950.459590 trunc from 0x005401 to 0x008d84 (0x3984 bytes) 000471 1787614950.600009 mapwrite 0x016395 thru 0x01fe7f (0x9aeb bytes) 000472 1787614950.803134 mapwrite 0x019dab thru 0x022a85 (0x8cdb bytes) 000473 1787614950.869929 mapread 0x0120d9 thru 0x017f03 (0x5e2b bytes) 000474 1787614950.871760 read 0x00bfe4 thru 0x013fdd (0x7ffa bytes) truncating to largest ever: 0x3fb91 000475 1787614950.882207 trunc from 0x022a86 to 0x03fb90 (0x1d10b bytes) 000476 1787614950.897876 mapwrite 0x02d5d5 thru 0x035282 (0x7cae bytes) 000477 1787614950.963884 write 0x015f79 thru 0x023bbe (0xdc46 bytes) 000478 1787614950.976474 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fb91): Mirror 4: 0xdf5f440d (stale) Mirror 5: 0xdf5f440d (stale) Mirror 6: 0xdf5f440d (stale) Mirror 8: 0xdf5f440d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fb91): Mirror 4: 0xdf5f440d (stale) Mirror 5: 0xdf5f440d (stale) Mirror 6: 0xdf5f440d (stale) Mirror 8: 0xdf5f440d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fb91: skipped 000480 1787614951.396771 trunc from 0x03fb91 to 0x01fa82 (0x2010e bytes) 000481 1787614951.441743 mapread 0x017716 thru 0x01fa82 (0x836d bytes) 000482 1787614951.475298 read 0x01ada5 thru 0x01f044 (0x42a0 bytes) 000484 1787614951.482809 read 0x01aa75 thru 0x01e54a (0x3ad6 bytes) 000485 1787614951.487784 write 0x028cc9 thru 0x032d81 (0xa0b9 bytes) 000489 1787614951.498637 write 0x006880 thru 0x012597 (0xbd18 bytes) 000490 1787614951.521716 write 0x01da07 thru 0x0288d8 (0xaed2 bytes) 000491 1787614951.525320 mapwrite 0x00407f thru 0x00544b (0x13cd bytes) 000492 1787614951.613143 trunc from 0x032d82 to 0x010f4c (0x21e35 bytes) 000493 1787614951.650788 trunc from 0x010f4d to 0x00eed6 (0x2076 bytes) 000494 1787614951.678966 MIRROR_RESYNC 5 mirrors 000495 1787614952.881301 mapwrite 0x002514 thru 0x01016d (0xdc5a bytes) 000496 1787614953.101751 read 0x00e348 thru 0x00f5d2 (0x128b bytes) 000497 1787614953.102363 write 0x005ef1 thru 0x010cc7 (0xadd7 bytes) 000498 1787614953.103499 trunc from 0x010cc8 to 0x00687d (0xa44a bytes) 000500 1787614953.137188 read 0x006291 thru 0x00687d (0x5ed bytes) 000504 1787614953.139077 trunc from 0x00687e to 0x007b71 (0x12f4 bytes) 000505 1787614953.161903 read 0x001494 thru 0x004518 (0x3085 bytes) 000506 1787614953.162490 mapread 0x0069c3 thru 0x007b71 (0x11af bytes) 000507 1787614953.170788 mapwrite 0x02fad7 thru 0x030155 (0x67f bytes) 000509 1787614953.230079 write 0x03af48 thru 0x03ffff (0x50b8 bytes) 000510 1787614953.231716 write 0x014145 thru 0x01823b (0x40f7 bytes) 000512 1787614953.234087 mapread 0x00e3ff thru 0x0101bc (0x1dbe bytes) 000513 1787614953.234888 mapread 0x0268f4 thru 0x02b214 (0x4921 bytes) 000516 1787614953.236525 write 0x032cdc thru 0x03a556 (0x787b bytes) 000520 1787614953.242146 mapwrite 0x03e6dd thru 0x03ffff (0x1923 bytes) 000521 1787614953.281599 read 0x029975 thru 0x02a2fe (0x98a bytes) 000523 1787614953.283316 trunc from 0x040000 to 0x02f632 (0x109cd bytes) 000524 1787614953.306539 read 0x028026 thru 0x02f632 (0x760d bytes) 000525 1787614953.307317 trunc from 0x02f633 to 0x02f2c2 (0x370 bytes) 000529 1787614953.326313 write 0x03b9dc thru 0x03ffff (0x4624 bytes) 000530 1787614953.328297 write 0x01a5f2 thru 0x021482 (0x6e91 bytes) 000531 1787614953.329712 trunc from 0x040000 to 0x00d82d (0x327d2 bytes) 000533 1787614953.372527 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xd82e): Mirror 4: 0x9bd6fa27 (stale) Mirror 5: 0x9bd6fa27 (stale) Mirror 8: 0x9bd6fa27 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xd82e): Mirror 4: 0x9bd6fa27 (stale) Mirror 5: 0x9bd6fa27 (stale) Mirror 8: 0x9bd6fa27 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xd82e: skipped 000534 1787614953.641134 read 0x0020c4 thru 0x00d82d (0xb76a bytes) 000536 1787614953.652858 write 0x002aef thru 0x010452 (0xd964 bytes) 000538 1787614953.655184 read 0x009548 thru 0x010452 (0x6f0b bytes) 000539 1787614953.655868 write 0x03bfec thru 0x03ffff (0x4014 bytes) 000540 1787614953.662785 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x4d5be0f7 (stale) Mirror 8: 0x4d5be0f7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x4d5be0f7 (stale) Mirror 8: 0x4d5be0f7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000541 1787614954.003366 write 0x01a2da thru 0x02348f (0x91b6 bytes) 000542 1787614954.018851 mapwrite 0x031c5b thru 0x03bc5f (0xa005 bytes) 000543 1787614954.094002 trunc from 0x040000 to 0x01b07b (0x24f84 bytes) 000545 1787614954.109494 write 0x01fe69 thru 0x02d7bb (0xd953 bytes) 000546 1787614954.111102 write 0x0221f1 thru 0x031e84 (0xfc94 bytes) 000548 1787614954.113205 trunc from 0x031e85 to 0x00bb18 (0x2636c bytes) 000549 1787614954.130421 mapwrite 0x014843 thru 0x019674 (0x4e32 bytes) 000550 1787614954.290987 read 0x0138df thru 0x019674 (0x5d96 bytes) 000552 1787614954.307255 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x19675): Mirror 5: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19675): Mirror 5: 0x716c6d22 (stale) Mirror 8: 0x716c6d22 (stale) CRC-32 checksum value for chunk [0, 0x19675): Mirror 1: 0xb8008874 Mirror 9: 0xb8008874 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19675: skipped 000553 1787614954.972168 mapwrite 0x02bcd8 thru 0x036e64 (0xb18d bytes) 000555 1787614955.293831 mapwrite 0x01f195 thru 0x02d6e3 (0xe54f bytes) 000556 1787614955.329578 mapwrite 0x00d96a thru 0x019127 (0xb7be bytes) 000557 1787614955.383607 write 0x016e25 thru 0x021325 (0xa501 bytes) 000558 1787614955.384848 mapread 0x0227bc thru 0x028cce (0x6513 bytes) 000559 1787614955.388146 trunc from 0x036e65 to 0x0372f6 (0x492 bytes) 000560 1787614955.404957 read 0x0054c9 thru 0x01298c (0xd4c4 bytes) 000561 1787614955.410768 trunc from 0x0372f7 to 0x02b31a (0xbfdc bytes) 000562 1787614955.434122 write 0x01a1ac thru 0x01d4fe (0x3353 bytes) 000565 1787614955.448962 write 0x022e6f thru 0x0321d0 (0xf362 bytes) 000566 1787614955.453949 mapwrite 0x038f1b thru 0x03ffff (0x70e5 bytes) 000567 1787614955.629083 read 0x006a51 thru 0x014047 (0xd5f7 bytes) 000568 1787614955.629984 write 0x01381f thru 0x01e495 (0xac77 bytes) 000570 1787614955.635794 read 0x0267c9 thru 0x028771 (0x1fa9 bytes) 000571 1787614955.636832 trunc from 0x040000 to 0x00c6e3 (0x3391c bytes) 000572 1787614955.670786 mapwrite 0x00548f thru 0x01543e (0xffb0 bytes) 000573 1787614955.828805 mapwrite 0x03c4ad thru 0x03ffff (0x3b53 bytes) 000574 1787614955.930095 trunc from 0x040000 to 0x00b2b3 (0x34d4c bytes) 000575 1787614955.993611 MIRROR_RESYNC 4 mirrors 000579 1787614957.635885 MIRROR_RESYNC 4 mirrors 000580 1787614958.106715 mapread 0x0013de thru 0x0039fe (0x2621 bytes) 000582 1787614958.139076 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) 000584 1787614958.428626 mapwrite 0x01ba76 thru 0x0254bf (0x9a4a bytes) 000585 1787614958.678404 mapread 0x005523 thru 0x0116a9 (0xc187 bytes) 000586 1787614958.733220 read 0x00db97 thru 0x01bbba (0xe024 bytes) 000587 1787614958.741646 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x254c0): Mirror 9: 0x67364d0f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x254c0): Mirror 9: 0x67364d0f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x254c0: skipped 000588 1787614959.276575 trunc from 0x0254c0 to 0x010238 (0x15287 bytes) 000590 1787614959.298105 read 0x008b5b thru 0x0093d9 (0x87f bytes) 000591 1787614959.307490 read 0x00d803 thru 0x010238 (0x2a36 bytes) 000592 1787614959.318655 write 0x021f64 thru 0x024131 (0x21ce bytes) 000593 1787614959.319984 read 0x007fd4 thru 0x01044e (0x847b bytes) 000594 1787614959.321056 mapwrite 0x015512 thru 0x0217f3 (0xc2e2 bytes) 000595 1787614959.387050 read 0x004f03 thru 0x00a555 (0x5653 bytes) 000596 1787614959.387663 trunc from 0x024132 to 0x03f150 (0x1b01f bytes) 000597 1787614959.404485 mapwrite 0x012eee thru 0x019d8f (0x6ea2 bytes) 000598 1787614959.454048 mapwrite 0x00dcb2 thru 0x012e7a (0x51c9 bytes) 000599 1787614959.503477 write 0x01f2d0 thru 0x0277a6 (0x84d7 bytes) 000600 1787614959.513993 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3f151): Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f151): Mirror 9: 0x1097788 (stale) CRC-32 checksum value for chunk [0, 0x3f151): Mirror 1: 0x36fb5683 Mirror 10: 0x36fb5683 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f151: skipped 000602 1787614960.615163 mapwrite 0x01cf5d thru 0x01ff32 (0x2fd6 bytes) 000603 1787614960.861251 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f151): Mirror 10: 0x36fb5683 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f151): Mirror 10: 0x36fb5683 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f151: skipped 000604 1787614961.164417 read 0x010438 thru 0x015b3b (0x5704 bytes) 000605 1787614961.179692 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) 000606 1787614961.317167 mapread 0x01b239 thru 0x02aaee (0xf8b6 bytes) 000610 1787614961.349818 trunc from 0x03f151 to 0x035a1e (0x9732 bytes) 000612 1787614961.368194 mapread 0x00557f thru 0x011143 (0xbbc5 bytes) 000614 1787614961.388168 trunc from 0x035a1f to 0x0371a5 (0x1787 bytes) 000617 1787614961.414552 mapwrite 0x02bfed thru 0x03ac9a (0xecae bytes) 000618 1787614961.543132 mapwrite 0x01a5e0 thru 0x02890f (0xe330 bytes) 000620 1787614961.622306 mapread 0x00b75c thru 0x01afbc (0xf861 bytes) 000622 1787614961.626356 read 0x0055d9 thru 0x006a42 (0x146a bytes) 000623 1787614961.627398 write 0x014956 thru 0x01c2e3 (0x798e bytes) 000627 1787614961.636870 read 0x00f32c thru 0x00f613 (0x2e8 bytes) 000632 1787614961.639767 mapread 0x021abb thru 0x02fbac (0xe0f2 bytes) 000633 1787614961.640644 write 0x03c700 thru 0x03ffff (0x3900 bytes) 000636 1787614961.644378 trunc from 0x040000 to 0x03ac04 (0x53fb bytes) 000639 1787614961.671535 write 0x03498b thru 0x03d1ce (0x8844 bytes) 000641 1787614961.674810 write 0x032336 thru 0x0344de (0x21a9 bytes) 000645 1787614961.682735 write 0x0105cc thru 0x01ec06 (0xe63b bytes) 000646 1787614961.684961 read 0x011e1e thru 0x01f70f (0xd8f2 bytes) 000650 1787614961.689190 write 0x00251a thru 0x011966 (0xf44d bytes) 000652 1787614961.693087 mapwrite 0x032d1d thru 0x03a8d3 (0x7bb7 bytes) 000658 1787614961.762486 mapread 0x0212bd thru 0x02a115 (0x8e59 bytes) 000659 1787614961.763663 read 0x03ce56 thru 0x03d1ce (0x379 bytes) 000661 1787614961.765023 write 0x01dc88 thru 0x0225ef (0x4968 bytes) 000664 1787614961.768118 write 0x01bdc1 thru 0x021046 (0x5286 bytes) 000665 1787614961.769735 mapread 0x03454a thru 0x03d1ce (0x8c85 bytes) 000667 1787614961.771987 mapread 0x032237 thru 0x03a4f1 (0x82bb bytes) 000668 1787614961.773695 trunc from 0x03d1cf to 0x03ace9 (0x24e5 bytes) 000673 1787614961.795790 mapwrite 0x00d92e thru 0x00daec (0x1bf bytes) 000674 1787614961.860863 trunc from 0x03acea to 0x01b538 (0x1f7b1 bytes) 000675 1787614961.888266 mapread 0x0027f0 thru 0x0097ce (0x6fdf bytes) 000679 1787614961.890618 mapwrite 0x00952c thru 0x00e6f7 (0x51cc bytes) 000680 1787614961.949670 mapwrite 0x01c238 thru 0x022e40 (0x6c09 bytes) 000681 1787614962.042482 trunc from 0x022e41 to 0x002bd5 (0x2026b bytes) 000683 1787614962.073780 MIRROR_EXTEND to 2 mirrors 000685 1787614963.278801 write 0x009be9 thru 0x016fff (0xd417 bytes) 000686 1787614963.470055 read 0x016fd6 thru 0x016fff (0x2a bytes) 000687 1787614963.470701 read 0x00b8d7 thru 0x016fff (0xb729 bytes) 000688 1787614963.471226 read 0x00386e thru 0x0097d2 (0x5f65 bytes) 000691 1787614963.492848 mapwrite 0x03fb75 thru 0x03ffff (0x48b bytes) 000694 1787614963.700819 write 0x01bf05 thru 0x02576b (0x9867 bytes) 000696 1787614963.703873 read 0x017362 thru 0x021b8c (0xa82b bytes) 000697 1787614963.709835 trunc from 0x040000 to 0x0279c6 (0x18639 bytes) 000698 1787614963.759979 read 0x007e38 thru 0x016abb (0xec84 bytes) 000699 1787614963.760653 mapread 0x0152ed thru 0x016b56 (0x186a bytes) 000701 1787614963.761912 read 0x024101 thru 0x0279c6 (0x38c6 bytes) 000702 1787614963.765319 mapwrite 0x01b0d3 thru 0x02abbb (0xfae9 bytes) 000704 1787614963.934446 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2abbc): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2abbc): Mirror 2: 0xc668736b (stale) CRC-32 checksum value for chunk [0, 0x2abbc): Mirror 1: 0xa3f3f9b6 Mirror 3: 0xa3f3f9b6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2abbc: skipped 000705 1787614964.928922 read 0x00c038 thru 0x015bfa (0x9bc3 bytes) 000706 1787614964.945132 mapread 0x0158ea thru 0x01c85b (0x6f72 bytes) 000707 1787614964.963359 mapwrite 0x0100e8 thru 0x012614 (0x252d bytes) 000708 1787614965.115740 write 0x01cc8a thru 0x029d84 (0xd0fb bytes) 000710 1787614965.128467 read 0x0246fc thru 0x02abbb (0x64c0 bytes) 000711 1787614965.140893 write 0x0338fe thru 0x03f2c6 (0xb9c9 bytes) 000714 1787614965.144714 trunc from 0x03f2c7 to 0x03b47e (0x3e48 bytes) 000716 1787614965.174826 trunc from 0x03b47f to 0x02d2bc (0xe1c2 bytes) 000718 1787614965.215745 write 0x02e0ca thru 0x034c6d (0x6ba4 bytes) 000719 1787614965.216835 read 0x02d69f thru 0x034c6d (0x75cf bytes) 000720 1787614965.229085 write 0x00977f thru 0x00afd5 (0x1857 bytes) 000722 1787614965.235209 read 0x029ea7 thru 0x034c6d (0xadc7 bytes) 000724 1787614965.246181 MIRROR_RESYNC 3 mirrors 000725 1787614966.174929 write 0x01f997 thru 0x029322 (0x998c bytes) 000726 1787614966.273405 read 0x00ab18 thru 0x00d844 (0x2d2d bytes) 000727 1787614966.283984 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34c6e): Mirror 3: 0x7e2ea7dc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34c6e): Mirror 3: 0x7e2ea7dc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34c6e: skipped 000728 1787614966.557682 mapread 0x02adec thru 0x0309e0 (0x5bf5 bytes) 000729 1787614966.579835 trunc from 0x034c6e to 0x0036b1 (0x315bc bytes) 000731 1787614966.624714 MIRROR_RESYNC 2 mirrors 000736 1787614967.173014 mapread 0x001182 thru 0x0036b1 (0x2530 bytes) 000738 1787614967.188351 read 0x0024c2 thru 0x0036b1 (0x11f0 bytes) 000741 1787614967.190985 mapwrite 0x02d517 thru 0x02e9b1 (0x149b bytes) 000742 1787614967.365000 write 0x035df1 thru 0x03e005 (0x8215 bytes) 000746 1787614967.374941 MIRROR_RESYNC 2 mirrors 000747 1787614968.315020 mapwrite 0x02c376 thru 0x02ef9d (0x2c28 bytes) 000750 1787614968.465975 mapread 0x0090a4 thru 0x018ef3 (0xfe50 bytes) 000753 1787614968.488812 write 0x036ead thru 0x03986a (0x29be bytes) 000754 1787614968.499736 trunc from 0x03e006 to 0x021298 (0x1cd6d bytes) 000755 1787614968.529295 write 0x02d936 thru 0x02fd60 (0x242b bytes) 000756 1787614968.531171 read 0x014ac2 thru 0x020a01 (0xbf40 bytes) 000757 1787614968.542908 mapwrite 0x036533 thru 0x038b96 (0x2664 bytes) 000759 1787614968.630044 write 0x0041b8 thru 0x0131a4 (0xefed bytes) 000760 1787614968.631385 trunc from 0x038b97 to 0x023834 (0x15362 bytes) 000761 1787614968.650096 trunc from 0x023835 to 0x01df7c (0x58b8 bytes) 000762 1787614968.668049 mapwrite 0x00230a thru 0x0099c0 (0x76b7 bytes) 000763 1787614968.725984 write 0x02ef3c thru 0x0351e7 (0x62ac bytes) 000766 1787614968.734266 MIRROR_RESYNC 2 mirrors 000767 1787614969.459960 write 0x033745 thru 0x03579c (0x2058 bytes) 000768 1787614969.537116 mapwrite 0x0065d3 thru 0x0116e4 (0xb112 bytes) 000769 1787614969.609081 mapread 0x020579 thru 0x027a9e (0x7526 bytes) 000770 1787614969.621109 mapwrite 0x0239c6 thru 0x02e3a1 (0xa9dc bytes) 000774 1787614969.689476 write 0x037617 thru 0x039f0a (0x28f4 bytes) 000775 1787614969.690510 read 0x0219da thru 0x0264c3 (0x4aea bytes) 000776 1787614969.692011 write 0x005783 thru 0x009c30 (0x44ae bytes) 000778 1787614969.698958 MIRROR_RESYNC 2 mirrors 000782 1787614970.612785 trunc from 0x039f0b to 0x03f30c (0x5402 bytes) 000786 1787614970.725790 write 0x03c8fa thru 0x03ffff (0x3706 bytes) 000787 1787614970.744159 write 0x0395eb thru 0x03facc (0x64e2 bytes) 000789 1787614970.761605 read 0x01de38 thru 0x020c12 (0x2ddb bytes) 000792 1787614970.776035 write 0x00e105 thru 0x00ebd7 (0xad3 bytes) 000793 1787614970.789921 mapwrite 0x024acd thru 0x027aa4 (0x2fd8 bytes) 000796 1787614970.933577 trunc from 0x040000 to 0x02b73a (0x148c5 bytes) 000797 1787614970.978494 mapwrite 0x022583 thru 0x02b1cb (0x8c49 bytes) 000798 1787614971.099083 MIRROR_RESYNC 2 mirrors 000799 1787614972.405262 mapwrite 0x033799 thru 0x03ffff (0xc867 bytes) 000800 1787614972.710117 read 0x02871d thru 0x02906c (0x950 bytes) 000802 1787614972.723243 read 0x029c03 thru 0x033c5e (0xa05c bytes) 000805 1787614972.757943 mapwrite 0x016dd1 thru 0x02113a (0xa36a bytes) 000806 1787614972.884841 trunc from 0x040000 to 0x036f91 (0x906e bytes) 000808 1787614972.917706 write 0x031d13 thru 0x035ccf (0x3fbd bytes) 000809 1787614972.918913 read 0x00a4ef thru 0x0195cb (0xf0dd bytes) 000811 1787614972.923080 mapread 0x01ddf4 thru 0x02511c (0x7329 bytes) 000812 1787614972.931135 MIRROR_RESYNC 2 mirrors 000813 1787614973.709909 trunc from 0x036f92 to 0x027941 (0xf650 bytes) 000814 1787614973.814945 write 0x03e200 thru 0x03ffff (0x1e00 bytes) 000815 1787614973.818017 read 0x00b70e thru 0x0166bb (0xafae bytes) 000819 1787614973.830939 read 0x02f497 thru 0x03be3c (0xc9a6 bytes) 000820 1787614973.844673 mapwrite 0x009b02 thru 0x010f6b (0x746a bytes) 000822 1787614973.913994 write 0x020974 thru 0x02a2d1 (0x995e bytes) 000824 1787614973.918092 trunc from 0x040000 to 0x01be79 (0x24186 bytes) 000825 1787614973.958926 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1be7a): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1be7a): Mirror 3: 0xdb1824e0 (stale) CRC-32 checksum value for chunk [0, 0x1be7a): Mirror 1: 0xe28c041a Mirror 4: 0xe28c041a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1be7a: skipped 000828 1787614974.908984 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) 000829 1787614975.459980 read 0x013bb6 thru 0x01be79 (0x82c4 bytes) 000831 1787614975.471294 mapwrite 0x02b0bb thru 0x03702c (0xbf72 bytes) 000833 1787614975.684727 mapread 0x034c5f thru 0x03702c (0x23ce bytes) 000835 1787614975.687066 mapwrite 0x004d29 thru 0x013f4e (0xf226 bytes) 000836 1787614975.810991 read 0x03675e thru 0x03702c (0x8cf bytes) 000837 1787614975.814859 read 0x02ea0c thru 0x03702c (0x8621 bytes) 000838 1787614975.816908 mapwrite 0x019022 thru 0x028501 (0xf4e0 bytes) 000839 1787614975.904798 read 0x01a7e5 thru 0x01b6c0 (0xedc bytes) 000840 1787614975.906055 mapread 0x02e758 thru 0x032ac4 (0x436d bytes) 000841 1787614975.907128 write 0x03e4e8 thru 0x03ffff (0x1b18 bytes) 000842 1787614975.909895 mapwrite 0x0245bb thru 0x02da03 (0x9449 bytes) 000848 1787614975.970379 trunc from 0x040000 to 0x028a62 (0x1759d bytes) 000850 1787614975.996979 mapwrite 0x036135 thru 0x03a7a3 (0x466f bytes) 000851 1787614976.091078 read 0x008956 thru 0x012372 (0x9a1d bytes) 000852 1787614976.102631 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3a7a4): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a7a4): Mirror 4: 0x3c8665f9 (stale) CRC-32 checksum value for chunk [0, 0x3a7a4): Mirror 1: 0x2e5ab930 Mirror 5: 0x2e5ab930 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a7a4: skipped 000854 1787614977.001017 read 0x01bf57 thru 0x020f57 (0x5001 bytes) 000855 1787614977.020486 mapread 0x0380c3 thru 0x038c3d (0xb7b bytes) 000859 1787614977.027718 read 0x0126e2 thru 0x018abe (0x63dd bytes) 000860 1787614977.050278 read 0x039fe4 thru 0x03a7a3 (0x7c0 bytes) 000861 1787614977.051035 read 0x01e07d thru 0x029bbe (0xbb42 bytes) 000863 1787614977.056050 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3a7a4): Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a7a4): Mirror 4: 0x3c8665f9 (stale) CRC-32 checksum value for chunk [0, 0x3a7a4): Mirror 1: 0x2e5ab930 Mirror 5: 0x2e5ab930 Mirror 6: 0x2e5ab930 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a7a4: skipped 000864 1787614977.983988 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) 000865 1787614978.553370 trunc from 0x03a7a4 to 0x028e1f (0x11984 bytes) 000866 1787614978.647569 read 0x025b79 thru 0x0268a8 (0xd30 bytes) 000867 1787614978.655837 write 0x02f4c1 thru 0x03b4c1 (0xc001 bytes) 000870 1787614978.663632 MIRROR_RESYNC 3 mirrors 000871 1787614979.502270 trunc from 0x03b4c2 to 0x016597 (0x24f2a bytes) 000876 1787614979.687094 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x16598): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16598): Mirror 5: 0x2c74a079 (stale) Mirror 6: 0x2c74a079 (stale) CRC-32 checksum value for chunk [0, 0x16598): Mirror 1: 0x2c74a079 Mirror 7: 0x2c74a079 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16598: skipped 000877 1787614980.640253 write 0x0203cf thru 0x02c794 (0xc3c6 bytes) 000878 1787614980.761114 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2c795): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c795): Mirror 5: 0x7f07fd10 (stale) Mirror 6: 0x7f07fd10 (stale) Mirror 7: 0x2d6cdbc9 (stale) CRC-32 checksum value for chunk [0, 0x2c795): Mirror 1: 0x634094f6 Mirror 8: 0x634094f6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c795: skipped 000880 1787614982.090660 mapwrite 0x0039ce thru 0x00d7c6 (0x9df9 bytes) 000881 1787614982.331573 read 0x029f4b thru 0x02adbc (0xe72 bytes) 000882 1787614982.341929 mapread 0x00f9a5 thru 0x01df7b (0xe5d7 bytes) 000884 1787614982.386215 mapread 0x01a4a9 thru 0x026075 (0xbbcd bytes) 000886 1787614982.416892 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c795): Mirror 5: 0x7f07fd10 (stale) Mirror 6: 0x7f07fd10 (stale) Mirror 7: 0x2d6cdbc9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c795): Mirror 5: 0x7f07fd10 (stale) Mirror 6: 0x7f07fd10 (stale) Mirror 7: 0x2d6cdbc9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c795: skipped 000887 1787614982.873979 trunc from 0x02c795 to 0x016f4e (0x15846 bytes) 000888 1787614982.900169 mapwrite 0x035d84 thru 0x03de29 (0x80a6 bytes) 000889 1787614983.082162 trunc from 0x03de2a to 0x011dff (0x2c02a bytes) 000890 1787614983.130900 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x11e00): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11e00): Mirror 5: 0x6caca254 (stale) Mirror 6: 0x6caca254 (stale) Mirror 7: 0x6caca254 (stale) CRC-32 checksum value for chunk [0, 0x11e00): Mirror 1: 0x9b9076db Mirror 8: 0x9b9076db lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11e00: skipped 000892 1787614984.545640 trunc from 0x011e00 to 0x00dbdc (0x4223 bytes) 000893 1787614984.707147 read 0x0046d6 thru 0x00c1b8 (0x7ae3 bytes) 000894 1787614984.776910 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xdbdd): Mirror 5: 0x3f31a65f (stale) Mirror 7: 0x3f31a65f (stale) Mirror 8: 0xc26bcbb4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xdbdd): Mirror 5: 0x3f31a65f (stale) Mirror 7: 0x3f31a65f (stale) Mirror 8: 0xc26bcbb4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xdbdd: skipped 000896 1787614985.168875 mapwrite 0x01a219 thru 0x01e3f6 (0x41de bytes) 000898 1787614985.319629 mapread 0x01881a thru 0x01aaa4 (0x228b bytes) 000900 1787614985.321244 write 0x017a71 thru 0x018a2d (0xfbd bytes) 000901 1787614985.323639 trunc from 0x01e3f7 to 0x014746 (0x9cb0 bytes) 000902 1787614985.343844 mapwrite 0x02e024 thru 0x02e214 (0x1f1 bytes) 000903 1787614985.448425 read 0x0152c6 thru 0x01f5fc (0xa337 bytes) 000904 1787614985.464781 write 0x024a2d thru 0x02b994 (0x6f68 bytes) 000905 1787614985.479018 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2e215): Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e215): Mirror 5: 0x51e3db0d (stale) Mirror 7: 0x5a66adb1 (stale) Mirror 8: 0xdcf41848 (stale) CRC-32 checksum value for chunk [0, 0x2e215): Mirror 1: 0x9d754912 Mirror 9: 0x9d754912 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e215: skipped 000906 1787614987.040233 mapread 0x00326d thru 0x00ecd5 (0xba69 bytes) 000907 1787614987.073725 write 0x03b91e thru 0x03c1c5 (0x8a8 bytes) 000908 1787614987.161477 write 0x0257dd thru 0x02c18a (0x69ae bytes) 000910 1787614987.172986 trunc from 0x03c1c6 to 0x018758 (0x23a6d bytes) 000912 1787614987.197796 trunc from 0x018759 to 0x0255ae (0xce56 bytes) 000914 1787614987.221648 MIRROR_RESYNC 5 mirrors 000916 1787614989.213888 write 0x030ef5 thru 0x03e4f0 (0xd5fc bytes) 000917 1787614989.319939 read 0x02be74 thru 0x03298a (0x6b17 bytes) 000918 1787614989.333173 mapread 0x01e2ee thru 0x021521 (0x3234 bytes) 000919 1787614989.350305 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e4f1): Mirror 5: 0x53fc0ee2 (stale) Mirror 8: 0x53fc0ee2 (stale) Mirror 9: 0x53fc0ee2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e4f1): Mirror 5: 0x53fc0ee2 (stale) Mirror 8: 0x53fc0ee2 (stale) Mirror 9: 0x53fc0ee2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e4f1: skipped 000921 1787614989.810860 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e4f1): Mirror 8: 0x53fc0ee2 (stale) Mirror 9: 0x53fc0ee2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e4f1): Mirror 8: 0x53fc0ee2 (stale) Mirror 9: 0x53fc0ee2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e4f1: skipped 000922 1787614990.268213 mapread 0x013c96 thru 0x01b339 (0x76a4 bytes) 000923 1787614990.289663 trunc from 0x03e4f1 to 0x0056ea (0x38e06 bytes) 000924 1787614990.312530 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x56eb): Mirror 9: 0x104734d5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x56eb): Mirror 9: 0x104734d5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x56eb: skipped 000925 1787614990.638023 write 0x0084b6 thru 0x011e23 (0x996e bytes) 000926 1787614990.641123 mapread 0x00f085 thru 0x011e23 (0x2d9f bytes) 000927 1787614990.646025 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x18d:0x0]: Invalid argument (22) 000929 1787614990.862424 mapread 0x011006 thru 0x011c6c (0xc67 bytes) 000930 1787614990.874300 mapwrite 0x008563 thru 0x015c07 (0xd6a5 bytes) 000942 1787614991.023449 trunc from 0x015c08 to 0x0138bd (0x234a bytes) 000943 1787614991.040920 trunc from 0x0138be to 0x0350e9 (0x2182c bytes) 000944 1787614991.067822 read 0x031a2c thru 0x0350e9 (0x36be bytes) 000946 1787614991.083253 mapread 0x02d434 thru 0x02f992 (0x255f bytes) 000948 1787614991.096597 write 0x022af9 thru 0x02451b (0x1a23 bytes) 000950 1787614991.111100 trunc from 0x0350ea to 0x0003d7 (0x34d12 bytes) 000951 1787614991.132610 trunc from 0x0003d8 to 0x01645d (0x16086 bytes) 000952 1787614991.154302 read 0x00e143 thru 0x011257 (0x3115 bytes) 000959 1787614991.209873 mapwrite 0x02126b thru 0x030755 (0xf4eb bytes) 000960 1787614991.286897 trunc from 0x030756 to 0x009c2e (0x26b27 bytes) 000962 1787614991.303472 read 0x0015ec thru 0x004c66 (0x367b bytes) 000965 1787614991.305174 mapwrite 0x02e3b4 thru 0x03b80d (0xd45a bytes) 000966 1787614991.392240 read 0x00e4a5 thru 0x00fea9 (0x1a05 bytes) 000967 1787614991.393235 mapwrite 0x03885d thru 0x03ffff (0x77a3 bytes) 000968 1787614991.485254 write 0x01d172 thru 0x0226d5 (0x5564 bytes) 000970 1787614991.490583 mapwrite 0x03014c thru 0x03d0a5 (0xcf5a bytes) 000972 1787614991.547870 mapwrite 0x033629 thru 0x0385a3 (0x4f7b bytes) 000976 1787614991.604178 MIRROR_EXTEND to 2 mirrors 000979 1787614992.747575 write 0x011f6c thru 0x0182ed (0x6382 bytes) 000981 1787614992.837918 MIRROR_RESYNC 2 mirrors 000982 1787614993.776837 trunc from 0x040000 to 0x004615 (0x3b9ea bytes) 000984 1787614993.936964 write 0x018bd1 thru 0x01a5ed (0x1a1d bytes) 000985 1787614993.938220 write 0x01da80 thru 0x02c084 (0xe605 bytes) 000986 1787614993.953129 mapwrite 0x01d8d6 thru 0x02c83c (0xef67 bytes) 000987 1787614994.122695 write 0x03183d thru 0x03dc47 (0xc40b bytes) 000988 1787614994.128529 write 0x00850c thru 0x00aeb9 (0x29ae bytes) 000989 1787614994.159785 MIRROR_RESYNC 2 mirrors 000990 1787614995.388489 trunc from 0x03dc48 to 0x01986a (0x243dd bytes) 000992 1787614995.481581 mapread 0x005250 thru 0x00c5ba (0x736b bytes) 000993 1787614995.515193 read 0x00d8d6 thru 0x0156bb (0x7de6 bytes) 000995 1787614995.528368 mapread 0x010426 thru 0x01565f (0x523a bytes) 000997 1787614995.531259 mapread 0x011e3f thru 0x015283 (0x3445 bytes) 000998 1787614995.533565 read 0x003a03 thru 0x00ff2a (0xc528 bytes) 001000 1787614995.534900 trunc from 0x01986b to 0x036d75 (0x1d50b bytes) All operations completed A-OK!