== sanity-flr test 70a: flr mode fsx test ================ 17:53:44 (1787781224) Seed set to 1226 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1787781226.885134 mapwrite 0x0371b6 thru 0x039544 (0x238f bytes) truncating to largest ever: 0xaf7f 000007 1787781227.019441 trunc from 0x039545 to 0x00af7e (0x2e5c6 bytes) 000009 1787781227.057806 write 0x03a12d thru 0x03ffff (0x5ed3 bytes) 000012 1787781227.061188 write 0x011289 thru 0x01838d (0x7105 bytes) truncating to largest ever: 0x1a7fd 000013 1787781227.076493 trunc from 0x040000 to 0x01a7fc (0x25803 bytes) 000016 1787781227.103663 write 0x003f1c thru 0x007bcc (0x3cb1 bytes) 000019 1787781227.122800 mapwrite 0x00ee67 thru 0x01b1b6 (0xc350 bytes) 000020 1787781227.251312 read 0x011b90 thru 0x01b1b6 (0x9627 bytes) 000021 1787781227.252266 mapread 0x009cd8 thru 0x012f40 (0x9269 bytes) 000022 1787781227.253397 write 0x010a68 thru 0x020836 (0xfdcf bytes) 000023 1787781227.255316 write 0x00c0b8 thru 0x01ac92 (0xebdb bytes) 000024 1787781227.262793 write 0x03ed89 thru 0x03ffff (0x1277 bytes) 000026 1787781227.268560 read 0x00a05f thru 0x00c506 (0x24a8 bytes) 000027 1787781227.269583 write 0x00aead thru 0x00b3a8 (0x4fc bytes) 000028 1787781227.270760 read 0x0188b4 thru 0x01a765 (0x1eb2 bytes) 000029 1787781227.274099 write 0x009267 thru 0x0099ad (0x747 bytes) 000030 1787781227.277108 mapwrite 0x0299bf thru 0x03354a (0x9b8c bytes) 000031 1787781227.398671 mapwrite 0x01ff30 thru 0x02b888 (0xb959 bytes) 000036 1787781227.474440 mapwrite 0x0000b7 thru 0x00a103 (0xa04d bytes) 000039 1787781227.507737 write 0x008332 thru 0x01177a (0x9449 bytes) 000040 1787781227.515825 MIRROR_EXTEND to 2 mirrors 000042 1787781228.520348 mapwrite 0x01426e thru 0x0150bd (0xe50 bytes) 000043 1787781228.684485 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) 000046 1787781228.850837 write 0x0026c8 thru 0x0096ed (0x7026 bytes) 000048 1787781228.868881 write 0x00c938 thru 0x00cefd (0x5c6 bytes) 000049 1787781228.877393 write 0x0326b8 thru 0x039559 (0x6ea2 bytes) 000050 1787781228.889675 mapwrite 0x03de82 thru 0x03ffff (0x217e bytes) 000052 1787781228.989418 MIRROR_EXTEND to 2 mirrors 000053 1787781230.287298 read 0x01a482 thru 0x01ee4e (0x49cd bytes) 000054 1787781230.301659 MIRROR_EXTEND to 3 mirrors truncating to largest ever: 0x28cce 000056 1787781231.207586 trunc from 0x040000 to 0x028ccd (0x17332 bytes) 000058 1787781231.309140 write 0x02281f thru 0x02a3b3 (0x7b95 bytes) truncating to largest ever: 0x30153 000059 1787781231.316137 trunc from 0x02a3b4 to 0x030152 (0x5d9f bytes) 000060 1787781231.367724 trunc from 0x030153 to 0x027753 (0x89ff bytes) 000061 1787781231.404017 write 0x022dce thru 0x024d5b (0x1f8e bytes) 000062 1787781231.407725 trunc from 0x027754 to 0x01f73d (0x8016 bytes) 000063 1787781231.458399 MIRROR_RESYNC 3 mirrors 000064 1787781232.965087 read 0x00490a thru 0x01195c (0xd053 bytes) 000067 1787781232.982881 MIRROR_RESYNC 3 mirrors 000068 1787781233.585085 mapread 0x001add thru 0x00a46b (0x898f bytes) 000069 1787781233.616317 MIRROR_EXTEND to 4 mirrors 000072 1787781234.936498 trunc from 0x01f73e to 0x021337 (0x1bfa bytes) 000073 1787781235.060191 read 0x013fa4 thru 0x020aeb (0xcb48 bytes) 000074 1787781235.073647 mapwrite 0x015ce9 thru 0x01962d (0x3945 bytes) 000076 1787781235.151388 mapwrite 0x026a98 thru 0x03115a (0xa6c3 bytes) 000078 1787781235.281101 trunc from 0x03115b to 0x0073cc (0x29d8e bytes) 000080 1787781235.312661 mapread 0x005e35 thru 0x0073cc (0x1598 bytes) 000082 1787781235.325254 trunc from 0x0073cd to 0x012605 (0xb239 bytes) 000086 1787781235.353851 mapwrite 0x0336fc thru 0x034d76 (0x167b bytes) 000089 1787781235.443287 trunc from 0x034d77 to 0x002701 (0x32675 bytes) 000090 1787781235.487534 read 0x00151f thru 0x002701 (0x11e3 bytes) 000091 1787781235.489129 mapread 0x0017df thru 0x002701 (0xf23 bytes) 000092 1787781235.502405 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2702): Mirror 2: 0xe55defcc (stale) Mirror 3: 0xe55defcc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2702): Mirror 2: 0xe55defcc (stale) Mirror 3: 0xe55defcc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2702: skipped 000095 1787781235.948685 mapwrite 0x01bc49 thru 0x02653e (0xa8f6 bytes) 000097 1787781236.034697 mapwrite 0x014793 thru 0x017e5d (0x36cb bytes) 000100 1787781236.117843 write 0x03666f thru 0x03996d (0x32ff bytes) 000101 1787781236.119452 mapread 0x038ad6 thru 0x03996d (0xe98 bytes) 000104 1787781236.120991 mapwrite 0x03b8ff thru 0x03c213 (0x915 bytes) 000106 1787781236.240156 write 0x00b990 thru 0x01825e (0xc8cf bytes) 000112 1787781236.248676 write 0x039ffa thru 0x03ffff (0x6006 bytes) 000113 1787781236.258093 MIRROR_RESYNC 3 mirrors 000114 1787781238.175092 mapwrite 0x028432 thru 0x031e28 (0x99f7 bytes) 000115 1787781238.403224 mapread 0x0014b0 thru 0x011113 (0xfc64 bytes) 000116 1787781238.443652 mapread 0x023de2 thru 0x032f81 (0xf1a0 bytes) 000117 1787781238.468276 trunc from 0x040000 to 0x02a723 (0x158dc bytes) 000118 1787781238.520776 mapwrite 0x014691 thru 0x022ed9 (0xe849 bytes) 000119 1787781238.738390 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2a724): Mirror 3: 0x4d1dcac0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a724): Mirror 3: 0x4d1dcac0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a724: skipped 000120 1787781239.193634 mapwrite 0x03e02f thru 0x03ffff (0x1fd1 bytes) 000121 1787781239.361291 read 0x03d3ec thru 0x03ffff (0x2c14 bytes) truncating to largest ever: 0x3be96 000122 1787781239.370717 trunc from 0x040000 to 0x03be95 (0x416a bytes) 000125 1787781239.393407 mapwrite 0x006618 thru 0x013e6b (0xd854 bytes) 000126 1787781239.521359 write 0x017265 thru 0x01d47d (0x6219 bytes) 000127 1787781239.533186 read 0x01b7c8 thru 0x01d870 (0x20a9 bytes) 000128 1787781239.535199 mapread 0x01a34d thru 0x01a49b (0x14f bytes) 000129 1787781239.536319 read 0x0362c2 thru 0x03be95 (0x5bd4 bytes) 000130 1787781239.564774 mapwrite 0x0245fd thru 0x03073a (0xc13e bytes) 000131 1787781239.713922 mapwrite 0x015064 thru 0x020fd5 (0xbf72 bytes) 000132 1787781239.835056 trunc from 0x03be96 to 0x0259db (0x164ba bytes) 000133 1787781239.858118 write 0x0260fc thru 0x033479 (0xd37e bytes) 000135 1787781239.868940 write 0x02790c thru 0x02f5a9 (0x7c9e bytes) 000136 1787781239.881626 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) 000138 1787781240.105597 mapwrite 0x00baaf thru 0x013c10 (0x8162 bytes) 000141 1787781240.234683 trunc from 0x03347a to 0x0337e2 (0x369 bytes) 000142 1787781240.266376 mapread 0x012552 thru 0x01d813 (0xb2c2 bytes) 000144 1787781240.286323 mapwrite 0x03676b thru 0x03ffff (0x9895 bytes) 000146 1787781240.450011 mapread 0x03dd95 thru 0x03ffff (0x226b bytes) 000149 1787781240.458320 mapwrite 0x03bad2 thru 0x03ffff (0x452e bytes) 000150 1787781240.549047 mapwrite 0x002117 thru 0x00cc93 (0xab7d bytes) 000152 1787781240.633191 write 0x01a050 thru 0x02851c (0xe4cd bytes) 000156 1787781240.653061 read 0x0340b8 thru 0x03ffff (0xbf48 bytes) 000158 1787781240.658794 read 0x006c4d thru 0x015bb3 (0xef67 bytes) 000159 1787781240.661288 mapwrite 0x01c1b5 thru 0x02b581 (0xf3cd bytes) 000162 1787781240.749360 mapwrite 0x0216dd thru 0x028bbb (0x74df bytes) 000164 1787781240.806085 mapread 0x03614b thru 0x03cd0e (0x6bc4 bytes) 000165 1787781240.807578 write 0x03c4b0 thru 0x03e585 (0x20d6 bytes) 000169 1787781240.815099 trunc from 0x040000 to 0x014bfe (0x2b401 bytes) 000171 1787781240.850563 mapread 0x012b70 thru 0x014bfe (0x208f bytes) 000173 1787781240.856514 write 0x035982 thru 0x0366da (0xd59 bytes) 000174 1787781240.861844 mapread 0x02e7d8 thru 0x0366da (0x7f03 bytes) 000175 1787781240.912310 trunc from 0x0366db to 0x00fd05 (0x269d5 bytes) 000176 1787781240.944053 read 0x006678 thru 0x0071ac (0xb35 bytes) 000177 1787781240.947660 trunc from 0x00fd06 to 0x00faa1 (0x264 bytes) 000178 1787781240.970180 mapwrite 0x03d0ab thru 0x03ffff (0x2f55 bytes) 000180 1787781241.156035 write 0x01ecbc thru 0x02eb34 (0xfe79 bytes) 000184 1787781241.179566 read 0x015ab8 thru 0x0193ac (0x38f5 bytes) 000185 1787781241.181593 write 0x01c871 thru 0x020508 (0x3c98 bytes) 000186 1787781241.198491 read 0x00ccc3 thru 0x0182b5 (0xb5f3 bytes) 000187 1787781241.203709 trunc from 0x040000 to 0x01a524 (0x25adb bytes) 000193 1787781241.251075 MIRROR_EXTEND to 2 mirrors 000196 1787781242.406564 trunc from 0x01a525 to 0x0002a9 (0x1a27b bytes) 000197 1787781242.502879 read 0x00006a thru 0x0002a9 (0x240 bytes) 000198 1787781242.510371 read 0x000174 thru 0x0002a9 (0x136 bytes) 000199 1787781242.515395 MIRROR_RESYNC 2 mirrors 000201 1787781243.141152 write 0x011e5c thru 0x0140b1 (0x2256 bytes) 000202 1787781243.212844 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x140b2): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x140b2): Mirror 2: 0x1ef88008 (stale) CRC-32 checksum value for chunk [0, 0x140b2): Mirror 1: 0xda31eded Mirror 3: 0xda31eded lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x140b2: skipped 000203 1787781244.288035 read 0x0002e6 thru 0x00fff2 (0xfd0d bytes) 000207 1787781244.319169 mapread 0x005bfb thru 0x008bd8 (0x2fde bytes) 000210 1787781244.341504 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x140b2): Mirror 2: 0x1ef88008 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x140b2): Mirror 2: 0x1ef88008 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x140b2: skipped 000211 1787781244.726636 mapwrite 0x032d88 thru 0x0392b9 (0x6532 bytes) 000213 1787781244.833105 mapread 0x023417 thru 0x031d45 (0xe92f bytes) 000214 1787781244.853591 read 0x004915 thru 0x008352 (0x3a3e bytes) 000217 1787781244.864498 trunc from 0x0392ba to 0x02f2f3 (0x9fc6 bytes) 000218 1787781244.893372 MIRROR_RESYNC 2 mirrors 000220 1787781245.735995 MIRROR_RESYNC 2 mirrors 000221 1787781246.065627 trunc from 0x02f2f4 to 0x02fc23 (0x930 bytes) 000222 1787781246.147569 mapread 0x01756a thru 0x025c9b (0xe732 bytes) 000223 1787781246.173755 mapwrite 0x039470 thru 0x03ffff (0x6b90 bytes) 000224 1787781246.254525 write 0x02d129 thru 0x02d2b6 (0x18e bytes) 000225 1787781246.261244 trunc from 0x040000 to 0x00090e (0x3f6f1 bytes) 000228 1787781246.285167 mapread 0x0000e2 thru 0x00090e (0x82d bytes) 000230 1787781246.295175 mapwrite 0x024bfe thru 0x02b5a6 (0x69a9 bytes) 000231 1787781246.366759 mapwrite 0x033b30 thru 0x039a07 (0x5ed8 bytes) 000232 1787781246.453522 MIRROR_RESYNC 2 mirrors 000233 1787781247.339143 trunc from 0x039a08 to 0x02357a (0x1648d bytes) 000236 1787781247.502446 trunc from 0x02357b to 0x00b10a (0x18470 bytes) 000239 1787781247.532195 mapwrite 0x02446f thru 0x02a7cf (0x6361 bytes) 000240 1787781247.648558 write 0x0166f1 thru 0x01c281 (0x5b91 bytes) 000242 1787781247.661444 read 0x000bc3 thru 0x00b52f (0xa96d bytes) 000243 1787781247.673825 mapread 0x003575 thru 0x009e91 (0x691d bytes) 000244 1787781247.676216 mapwrite 0x02e513 thru 0x0308ca (0x23b8 bytes) 000248 1787781247.786866 write 0x0125ae thru 0x016f5c (0x49af bytes) 000250 1787781247.794947 trunc from 0x0308cb to 0x0175b7 (0x19313 bytes) 000255 1787781247.823867 mapwrite 0x02fb79 thru 0x032d9a (0x3222 bytes) 000256 1787781247.890665 mapwrite 0x03edcf thru 0x03ffff (0x1231 bytes) 000258 1787781247.933851 write 0x03b81d thru 0x03da41 (0x2225 bytes) 000262 1787781247.936171 trunc from 0x040000 to 0x038c40 (0x73bf bytes) 000265 1787781247.962915 trunc from 0x038c41 to 0x00d193 (0x2baad bytes) 000267 1787781247.979356 mapwrite 0x030c8a thru 0x03e880 (0xdbf7 bytes) 000270 1787781248.069711 mapread 0x008429 thru 0x011b0f (0x96e7 bytes) 000271 1787781248.084611 MIRROR_RESYNC 2 mirrors 000272 1787781248.861180 write 0x001856 thru 0x0034e3 (0x1c8e bytes) 000273 1787781249.022087 mapread 0x00fd97 thru 0x0145fb (0x4865 bytes) 000274 1787781249.077767 trunc from 0x03e881 to 0x017640 (0x27240 bytes) 000276 1787781249.164393 mapread 0x00b9e0 thru 0x012cae (0x72cf bytes) 000277 1787781249.171148 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x17641): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17641): Mirror 2: 0x796fba35 (stale) CRC-32 checksum value for chunk [0, 0x17641): Mirror 1: 0x4e61ce32 Mirror 3: 0x4e61ce32 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17641: skipped 000278 1787781250.254792 mapread 0x011fcc thru 0x017640 (0x5675 bytes) 000279 1787781250.278032 write 0x00481d thru 0x01302c (0xe810 bytes) 000281 1787781250.413075 mapwrite 0x027ddd thru 0x0370de (0xf302 bytes) 000282 1787781250.556153 write 0x01f6dc thru 0x02193f (0x2264 bytes) 000285 1787781250.572388 MIRROR_RESYNC 3 mirrors 000286 1787781252.127651 read 0x02699a thru 0x0335f1 (0xcc58 bytes) 000287 1787781252.139580 read 0x033f47 thru 0x033f83 (0x3d bytes) 000289 1787781252.140452 mapwrite 0x01ac02 thru 0x02091e (0x5d1d bytes) 000291 1787781252.492040 trunc from 0x0370df to 0x01805e (0x1f080 bytes) 000293 1787781252.543288 mapwrite 0x008488 thru 0x0167df (0xe358 bytes) 000295 1787781252.830151 MIRROR_RESYNC 3 mirrors 000296 1787781254.025237 read 0x01210d thru 0x01805e (0x5f52 bytes) 000297 1787781254.051029 MIRROR_RESYNC 3 mirrors 000298 1787781254.844594 mapread 0x014065 thru 0x01805e (0x3ffa bytes) 000299 1787781254.845771 trunc from 0x01805f to 0x02f5c8 (0x1756a bytes) 000305 1787781254.979877 write 0x034864 thru 0x03ffff (0xb79c bytes) 000306 1787781254.981846 mapwrite 0x01b493 thru 0x023722 (0x8290 bytes) 000307 1787781255.065716 trunc from 0x040000 to 0x020dc6 (0x1f239 bytes) 000309 1787781255.082401 trunc from 0x020dc7 to 0x027dcf (0x7009 bytes) 000311 1787781255.094091 mapwrite 0x03f06e thru 0x03ffff (0xf92 bytes) 000313 1787781255.148165 read 0x030ebe thru 0x0377e4 (0x6927 bytes) 000315 1787781255.155144 trunc from 0x040000 to 0x03ba45 (0x45ba bytes) 000316 1787781255.166236 mapread 0x007218 thru 0x00d658 (0x6441 bytes) 000318 1787781255.173983 trunc from 0x03ba46 to 0x01ac56 (0x20def bytes) 000320 1787781255.188511 read 0x00a3b5 thru 0x01a24c (0xfe98 bytes) 000322 1787781255.197682 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1ac57): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ac57): Mirror 2: 0xec5e89ad (stale) Mirror 3: 0xec5e89ad (stale) CRC-32 checksum value for chunk [0, 0x1ac57): Mirror 1: 0xec5e89ad Mirror 4: 0xec5e89ad lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ac57: skipped 000323 1787781255.824818 mapread 0x0107d3 thru 0x01131c (0xb4a bytes) 000324 1787781255.846605 mapread 0x010b9e thru 0x0195ff (0x8a62 bytes) 000325 1787781255.864589 mapread 0x006cdc thru 0x01136b (0xa690 bytes) 000326 1787781255.877006 write 0x03c6af thru 0x03ffff (0x3951 bytes) 000327 1787781256.004583 mapwrite 0x004770 thru 0x0084c0 (0x3d51 bytes) 000328 1787781256.216144 mapread 0x0073f2 thru 0x01129e (0x9ead bytes) 000329 1787781256.254797 trunc from 0x040000 to 0x006677 (0x39988 bytes) 000331 1787781256.344838 mapwrite 0x039e87 thru 0x03ffff (0x6179 bytes) 000332 1787781256.560046 MIRROR_RESYNC 4 mirrors 000334 1787781258.389833 mapwrite 0x02df33 thru 0x036080 (0x814e bytes) 000336 1787781258.722647 mapread 0x032e8c thru 0x03b478 (0x85ed bytes) 000342 1787781258.743355 mapread 0x0354ad thru 0x03a198 (0x4cec bytes) 000346 1787781258.748715 trunc from 0x040000 to 0x01ec24 (0x213db bytes) 000347 1787781258.783649 mapread 0x00864b thru 0x011399 (0x8d4f bytes) 000349 1787781258.818753 mapread 0x007749 thru 0x007a19 (0x2d1 bytes) 000350 1787781258.830635 MIRROR_RESYNC 4 mirrors 000351 1787781259.963578 read 0x0096bf thru 0x01079c (0x70de bytes) 000352 1787781259.991340 MIRROR_EXTEND to 5 mirrors 000353 1787781261.495272 write 0x0157f8 thru 0x01946c (0x3c75 bytes) 000355 1787781261.692093 write 0x036ffb thru 0x03865f (0x1665 bytes) 000356 1787781261.693274 mapwrite 0x01446b thru 0x016144 (0x1cda bytes) 000357 1787781261.987179 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38660): Mirror 3: 0x82bf2efe (stale) Mirror 4: 0x82bf2efe (stale) Mirror 5: 0x82bf2efe (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38660): Mirror 3: 0x82bf2efe (stale) Mirror 4: 0x82bf2efe (stale) Mirror 5: 0x82bf2efe (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38660: skipped 000358 1787781262.719847 write 0x01b155 thru 0x01f2e8 (0x4194 bytes) 000359 1787781262.745633 read 0x01a2e3 thru 0x022b8a (0x88a8 bytes) 000360 1787781262.774808 MIRROR_RESYNC 4 mirrors 000361 1787781265.398118 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) 000362 1787781266.013522 mapwrite 0x0008d1 thru 0x00f931 (0xf061 bytes) 000363 1787781266.460283 write 0x02e023 thru 0x033593 (0x5571 bytes) 000364 1787781266.482598 mapread 0x02e752 thru 0x03865f (0x9f0e bytes) 000365 1787781266.512134 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38660): Mirror 5: 0x8a38b3ce (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38660): Mirror 5: 0x8a38b3ce (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38660: skipped 000366 1787781267.080218 read 0x01880f thru 0x0201b1 (0x79a3 bytes) 000368 1787781267.110765 write 0x03fabb thru 0x03ffff (0x545 bytes) 000369 1787781267.120774 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xb105b201 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4466aef8 Mirror 6: 0x4466aef8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000371 1787781269.331853 write 0x01f31c thru 0x020a28 (0x170d bytes) 000372 1787781269.427778 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xb105b201 (stale) Mirror 6: 0x4466aef8 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdf90ca57 Mirror 7: 0xdf90ca57 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000373 1787781271.425730 read 0x021793 thru 0x023c00 (0x246e bytes) 000374 1787781271.448137 mapwrite 0x01f006 thru 0x02ecc4 (0xfcbf bytes) truncating to largest ever: 0x3c0d6 000375 1787781271.747543 trunc from 0x040000 to 0x03c0d5 (0x3f2a bytes) 000376 1787781271.852732 mapread 0x005809 thru 0x00de7b (0x8673 bytes) 000377 1787781271.921255 write 0x018174 thru 0x025923 (0xd7b0 bytes) 000380 1787781271.944009 write 0x032647 thru 0x03bbe8 (0x95a2 bytes) 000381 1787781271.980734 write 0x0023b2 thru 0x00eb6d (0xc7bc bytes) 000382 1787781271.982617 trunc from 0x03c0d6 to 0x01b7bc (0x20919 bytes) 000384 1787781272.049919 mapwrite 0x03af14 thru 0x03ffff (0x50ec bytes) 000385 1787781272.390033 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0xb105b201 (stale) Mirror 6: 0x4466aef8 (stale) Mirror 7: 0xdf90ca57 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4b1f3cc4 Mirror 8: 0x4b1f3cc4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000386 1787781274.871795 trunc from 0x040000 to 0x03873a (0x78c5 bytes) 000388 1787781275.183353 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3873b): Mirror 5: 0x949bc7ce (stale) Mirror 6: 0x3ff2327b (stale) Mirror 8: 0x24541078 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3873b): Mirror 5: 0x949bc7ce (stale) Mirror 6: 0x3ff2327b (stale) Mirror 8: 0x24541078 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3873b: skipped 000389 1787781275.863058 mapread 0x003e8e thru 0x00f12c (0xb29f bytes) 000390 1787781275.922982 write 0x031369 thru 0x03ddb9 (0xca51 bytes) 000393 1787781275.937913 read 0x0006c3 thru 0x001b31 (0x146f bytes) 000394 1787781275.951292 write 0x0078fc thru 0x014bfe (0xd303 bytes) 000396 1787781275.960055 read 0x01b44c thru 0x023473 (0x8028 bytes) 000397 1787781275.972037 write 0x0046b9 thru 0x00997d (0x52c5 bytes) 000400 1787781275.975888 write 0x02d5a8 thru 0x038aef (0xb548 bytes) 000402 1787781275.986531 MIRROR_RESYNC 4 mirrors 000403 1787781278.176417 write 0x023e7d thru 0x02bea8 (0x802c bytes) 000404 1787781278.266016 write 0x01df03 thru 0x020ce2 (0x2de0 bytes) 000406 1787781278.281435 mapwrite 0x023f45 thru 0x02abbf (0x6c7b bytes) 000407 1787781278.391283 write 0x02112d thru 0x02d027 (0xbefb bytes) 000408 1787781278.412318 mapwrite 0x03d73a thru 0x03ffff (0x28c6 bytes) 000409 1787781278.564016 trunc from 0x040000 to 0x020ca3 (0x1f35c bytes) 000410 1787781278.586272 mapwrite 0x03aa32 thru 0x03ffff (0x55ce bytes) 000411 1787781278.722002 mapread 0x02176f thru 0x028897 (0x7129 bytes) 000412 1787781278.735307 write 0x02548e thru 0x025c7c (0x7ef bytes) 000413 1787781278.737396 write 0x025044 thru 0x031687 (0xc644 bytes) 000414 1787781278.744286 write 0x02cf88 thru 0x03a9ee (0xda67 bytes) 000415 1787781278.745821 read 0x010621 thru 0x01290e (0x22ee bytes) 000418 1787781278.757224 mapwrite 0x00c083 thru 0x01374f (0x76cd bytes) 000419 1787781278.813251 trunc from 0x040000 to 0x003d48 (0x3c2b7 bytes) 000420 1787781278.830627 mapread 0x00176f thru 0x001c9a (0x52c bytes) 000422 1787781278.838780 mapread 0x000835 thru 0x003d48 (0x3514 bytes) 000425 1787781278.847433 mapwrite 0x03b156 thru 0x03ed68 (0x3c13 bytes) 000428 1787781278.926370 trunc from 0x03ed69 to 0x005dfc (0x38f6c bytes) 000429 1787781278.968726 write 0x039a2a thru 0x03ffff (0x65d6 bytes) 000430 1787781278.970727 read 0x02f2a9 thru 0x0348f1 (0x5649 bytes) 000432 1787781278.987481 trunc from 0x040000 to 0x021149 (0x1eeb6 bytes) 000434 1787781279.014664 read 0x002128 thru 0x005e4a (0x3d23 bytes) 000435 1787781279.028438 MIRROR_RESYNC 4 mirrors 000436 1787781279.977863 write 0x037292 thru 0x03ffff (0x8d6e bytes) 000438 1787781280.074996 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x34d4cc8d (stale) Mirror 6: 0x34d4cc8d (stale) Mirror 8: 0x34d4cc8d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdc19596d Mirror 9: 0xdc19596d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000439 1787781281.910188 mapread 0x00ac53 thru 0x0191d8 (0xe586 bytes) 000440 1787781281.962159 trunc from 0x040000 to 0x0078a9 (0x38756 bytes) 000441 1787781282.152591 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x78aa): Mirror 6: 0xaa8651c9 (stale) Mirror 8: 0xaa8651c9 (stale) Mirror 9: 0xaa8651c9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x78aa): Mirror 6: 0xaa8651c9 (stale) Mirror 8: 0xaa8651c9 (stale) Mirror 9: 0xaa8651c9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x78aa: skipped 000442 1787781282.871297 mapwrite 0x0262e7 thru 0x0283be (0x20d8 bytes) 000444 1787781282.935240 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x283bf): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x283bf): Mirror 6: 0xa5874bb9 (stale) Mirror 8: 0xa5874bb9 (stale) Mirror 9: 0xa5874bb9 (stale) CRC-32 checksum value for chunk [0, 0x283bf): Mirror 1: 0x933ebe4d Mirror 10: 0x933ebe4d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x283bf: skipped 000447 1787781283.869284 mapread 0x022649 thru 0x0283be (0x5d76 bytes) 000448 1787781283.905990 trunc from 0x0283bf to 0x0271b9 (0x1205 bytes) 000450 1787781283.982991 mapwrite 0x03caa9 thru 0x03fb3b (0x3093 bytes) 000451 1787781284.154926 mapread 0x027678 thru 0x032318 (0xaca1 bytes) truncating to largest ever: 0x3c642 000453 1787781284.186458 trunc from 0x03fb3c to 0x03c641 (0x34fa bytes) 000454 1787781284.215552 mapwrite 0x01db7e thru 0x021ab3 (0x3f36 bytes) 000455 1787781284.247493 read 0x007fd4 thru 0x00a44b (0x2478 bytes) 000456 1787781284.252114 read 0x01e210 thru 0x02b357 (0xd148 bytes) 000457 1787781284.256289 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3c642): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c642): Mirror 6: 0x44a5e053 (stale) Mirror 8: 0x44a5e053 (stale) Mirror 9: 0x2cf8f6ed (stale) Mirror 10: 0x918165db (stale) CRC-32 checksum value for chunk [0, 0x3c642): Mirror 1: 0x243d6d53 Mirror 11: 0x243d6d53 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c642: skipped 000458 1787781285.964385 read 0x02854d thru 0x031d47 (0x97fb bytes) 000459 1787781285.975075 mapread 0x03703d thru 0x0373a4 (0x368 bytes) 000460 1787781285.980348 mapread 0x00d84b thru 0x019459 (0xbc0f bytes) 000461 1787781286.002296 read 0x01dc3d thru 0x020c7c (0x3040 bytes) 000464 1787781286.013473 trunc from 0x03c642 to 0x037935 (0x4d0c bytes) 000465 1787781286.113146 mapread 0x016e1f thru 0x01edeb (0x7fcd bytes) 000466 1787781286.194225 read 0x011738 thru 0x01fd3b (0xe604 bytes) 000473 1787781286.223816 trunc from 0x037936 to 0x02b12d (0xc808 bytes) 000474 1787781286.288447 mapwrite 0x032af3 thru 0x03a349 (0x7857 bytes) 000475 1787781286.644323 MIRROR_RESYNC 6 mirrors 000480 1787781289.582096 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) 000481 1787781290.452106 write 0x02e0d9 thru 0x039900 (0xb828 bytes) 000482 1787781290.652687 mapwrite 0x0181d8 thru 0x022c30 (0xaa59 bytes) 000486 1787781290.761019 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3a34a): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a34a): Mirror 6: 0x6b1fce26 (stale) Mirror 8: 0x6b1fce26 (stale) Mirror 9: 0x6b1fce26 (stale) Mirror 11: 0x6b1fce26 (stale) CRC-32 checksum value for chunk [0, 0x3a34a): Mirror 1: 0x3f49fc1a Mirror 12: 0x3f49fc1a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a34a: skipped 000487 1787781292.501996 trunc from 0x03a34a to 0x035bd4 (0x4775 bytes) 000488 1787781292.641468 write 0x01984e thru 0x01e275 (0x4a28 bytes) 000490 1787781292.659124 mapread 0x030a8e thru 0x035bd4 (0x5147 bytes) 000493 1787781292.681156 mapread 0x033a87 thru 0x035bd4 (0x214e bytes) 000496 1787781292.685157 mapread 0x01a327 thru 0x01bed7 (0x1bb1 bytes) 000497 1787781292.686406 trunc from 0x035bd5 to 0x032e8f (0x2d45 bytes) 000499 1787781292.715115 mapwrite 0x02db96 thru 0x035018 (0x7483 bytes) 000500 1787781292.793351 mapread 0x020aeb thru 0x023175 (0x268b bytes) 000501 1787781292.809161 mapread 0x0153a2 thru 0x01715e (0x1dbd bytes) 000503 1787781292.821500 mapread 0x023d78 thru 0x0293dd (0x5666 bytes) 000504 1787781292.842187 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35019): Mirror 6: 0xbeb59165 (stale) Mirror 9: 0xbeb59165 (stale) Mirror 11: 0xbeb59165 (stale) Mirror 12: 0x18f7d678 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35019): Mirror 6: 0xbeb59165 (stale) Mirror 9: 0xbeb59165 (stale) Mirror 11: 0xbeb59165 (stale) Mirror 12: 0x18f7d678 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35019: skipped 000505 1787781293.321455 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35019): Mirror 6: 0xbeb59165 (stale) Mirror 9: 0xbeb59165 (stale) Mirror 12: 0x18f7d678 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35019): Mirror 6: 0xbeb59165 (stale) Mirror 9: 0xbeb59165 (stale) Mirror 12: 0x18f7d678 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35019: skipped 000508 1787781293.799404 write 0x01e2a3 thru 0x021355 (0x30b3 bytes) 000510 1787781293.827130 mapwrite 0x01917b thru 0x022077 (0x8efd bytes) 000511 1787781294.026249 mapread 0x028183 thru 0x02c831 (0x46af bytes) 000514 1787781294.049607 mapread 0x0149d8 thru 0x01f4aa (0xaad3 bytes) 000515 1787781294.063403 MIRROR_RESYNC 4 mirrors 000516 1787781296.067940 read 0x00c573 thru 0x00e151 (0x1bdf bytes) 000518 1787781296.085833 write 0x021786 thru 0x02ac8e (0x9509 bytes) 000519 1787781296.283224 mapread 0x02721e thru 0x035018 (0xddfb bytes) 000520 1787781296.306812 mapread 0x00b66f thru 0x019dad (0xe73f bytes) 000521 1787781296.330214 trunc from 0x035019 to 0x014504 (0x20b14 bytes) 000522 1787781296.388099 write 0x021e25 thru 0x025c89 (0x3e65 bytes) 000525 1787781296.400218 mapwrite 0x024845 thru 0x02c02c (0x77e8 bytes) 000527 1787781296.591053 read 0x005b5c thru 0x00d6a2 (0x7b47 bytes) 000528 1787781296.591733 mapwrite 0x02ea78 thru 0x038492 (0x9a1b bytes) 000530 1787781296.671776 mapwrite 0x00dbdb thru 0x010bf2 (0x3018 bytes) 000531 1787781296.722675 write 0x01f423 thru 0x0241a3 (0x4d81 bytes) 000532 1787781296.725545 mapread 0x02dafe thru 0x0354bc (0x79bf bytes) 000536 1787781296.728820 trunc from 0x038493 to 0x022582 (0x15f10 bytes) 000537 1787781296.752169 write 0x00799c thru 0x007f19 (0x57e bytes) 000539 1787781296.761633 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22583): Mirror 6: 0x90ab360e (stale) Mirror 12: 0x90ab360e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22583): Mirror 6: 0x90ab360e (stale) Mirror 12: 0x90ab360e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22583: skipped 000541 1787781297.303171 trunc from 0x022583 to 0x0304cf (0xdf4d bytes) 000542 1787781297.317025 trunc from 0x0304d0 to 0x02f691 (0xe3e bytes) 000543 1787781297.343036 write 0x01aaf2 thru 0x0260d4 (0xb5e3 bytes) 000549 1787781297.359126 read 0x0163a3 thru 0x01d2ce (0x6f2c bytes) 000550 1787781297.377000 write 0x027a6e thru 0x02c89b (0x4e2e bytes) 000551 1787781297.394172 mapread 0x02f257 thru 0x02f691 (0x43b bytes) 000558 1787781297.413504 mapwrite 0x01ac8d thru 0x024ee0 (0xa254 bytes) 000559 1787781297.539578 mapwrite 0x0160c6 thru 0x01bfc6 (0x5f01 bytes) 000560 1787781297.619137 write 0x017e14 thru 0x01dbeb (0x5dd8 bytes) 000562 1787781297.622556 mapwrite 0x03dec6 thru 0x03ffff (0x213a bytes) 000563 1787781297.706781 write 0x03a602 thru 0x03ffff (0x59fe bytes) 000564 1787781297.716002 mapwrite 0x02ce88 thru 0x03302b (0x61a4 bytes) 000565 1787781297.766326 mapread 0x02aa9e thru 0x036117 (0xb67a bytes) 000567 1787781297.773291 mapwrite 0x01d4bf thru 0x028cf3 (0xb835 bytes) 000568 1787781297.817991 mapwrite 0x0229cf thru 0x032261 (0xf893 bytes) 000569 1787781297.862274 mapwrite 0x0193bd thru 0x01a109 (0xd4d bytes) 000572 1787781297.908012 read 0x011a0f thru 0x015537 (0x3b29 bytes) 000573 1787781297.925785 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x46aa1b7a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x46aa1b7a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000574 1787781298.198438 mapwrite 0x01b328 thru 0x0297c3 (0xe49c bytes) 000575 1787781298.330730 write 0x01b53f thru 0x01e3b7 (0x2e79 bytes) 000577 1787781298.332366 trunc from 0x040000 to 0x00ca14 (0x335eb bytes) 000580 1787781298.376831 mapread 0x009686 thru 0x00ca14 (0x338f bytes) 000583 1787781298.393563 trunc from 0x00ca15 to 0x03a7e1 (0x2ddcd bytes) 000584 1787781298.413841 mapread 0x037210 thru 0x03a7e1 (0x35d2 bytes) 000585 1787781298.428625 read 0x018001 thru 0x02148b (0x948b bytes) 000587 1787781298.441103 read 0x0243cd thru 0x029dcf (0x5a03 bytes) 000590 1787781298.451798 write 0x03c258 thru 0x03f0d4 (0x2e7d bytes) 000591 1787781298.454255 mapwrite 0x014a95 thru 0x023366 (0xe8d2 bytes) 000592 1787781298.499841 mapwrite 0x005bc9 thru 0x006fd3 (0x140b bytes) 000593 1787781298.535633 mapread 0x012a27 thru 0x015518 (0x2af2 bytes) 000594 1787781298.537251 mapread 0x004d3e thru 0x004ef1 (0x1b4 bytes) 000595 1787781298.539153 mapread 0x003c03 thru 0x007904 (0x3d02 bytes) 000597 1787781298.541597 mapread 0x00994a thru 0x0194a2 (0xfb59 bytes) 000598 1787781298.546083 trunc from 0x03f0d5 to 0x01af65 (0x2416f bytes) 000600 1787781298.564691 trunc from 0x01af66 to 0x011a06 (0x955f bytes) 000601 1787781298.581722 mapwrite 0x023afb thru 0x02e69b (0xaba1 bytes) 000602 1787781298.722194 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) 000603 1787781298.854854 mapread 0x002f18 thru 0x009218 (0x6301 bytes) 000605 1787781298.884192 mapwrite 0x039314 thru 0x03ffff (0x6cec bytes) 000606 1787781298.966266 mapread 0x03bacf thru 0x03ffff (0x4531 bytes) 000607 1787781298.968516 mapread 0x01ae15 thru 0x02a25d (0xf449 bytes) 000609 1787781298.989610 mapread 0x034641 thru 0x039192 (0x4b52 bytes) 000610 1787781298.990623 mapwrite 0x01b044 thru 0x01e564 (0x3521 bytes) 000611 1787781299.036369 mapwrite 0x01a7cf thru 0x024740 (0x9f72 bytes) 000613 1787781299.083009 read 0x0142cd thru 0x017488 (0x31bc bytes) 000615 1787781299.084147 read 0x033ffd thru 0x0361b1 (0x21b5 bytes) 000616 1787781299.084674 write 0x03b140 thru 0x03b9b4 (0x875 bytes) 000617 1787781299.087881 trunc from 0x040000 to 0x01451f (0x2bae0 bytes) 000622 1787781299.117230 mapread 0x00b911 thru 0x00c876 (0xf66 bytes) 000623 1787781299.118482 write 0x018b95 thru 0x0273d4 (0xe840 bytes) 000625 1787781299.122646 mapread 0x020114 thru 0x0273d4 (0x72c1 bytes) 000626 1787781299.124417 mapwrite 0x01a2f2 thru 0x0299b0 (0xf6bf bytes) 000628 1787781299.207328 read 0x026da1 thru 0x0299b0 (0x2c10 bytes) 000631 1787781299.210030 trunc from 0x0299b1 to 0x00ffda (0x199d6 bytes) 000632 1787781299.240126 trunc from 0x00ffdb to 0x025f54 (0x15f7a bytes) 000633 1787781299.267021 MIRROR_EXTEND to 2 mirrors 000635 1787781300.294486 write 0x03e511 thru 0x03ffff (0x1aef bytes) 000636 1787781300.376801 write 0x01abf3 thru 0x01f1f0 (0x45fe bytes) 000640 1787781300.394213 mapread 0x00d372 thru 0x0130a9 (0x5d38 bytes) 000644 1787781300.414607 write 0x025744 thru 0x02897e (0x323b bytes) 000645 1787781300.424510 read 0x010534 thru 0x01a22b (0x9cf8 bytes) 000646 1787781300.431542 trunc from 0x040000 to 0x02f7c5 (0x1083a bytes) 000647 1787781300.470548 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2f7c6): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f7c6): Mirror 2: 0x2514498a (stale) CRC-32 checksum value for chunk [0, 0x2f7c6): Mirror 1: 0xe93aa21f Mirror 3: 0xe93aa21f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f7c6: skipped 000649 1787781302.441243 read 0x00f1b5 thru 0x0180f2 (0x8f3e bytes) 000653 1787781302.474014 write 0x0100b6 thru 0x016379 (0x62c4 bytes) 000655 1787781302.616321 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f7c6): Mirror 2: 0x2514498a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f7c6): Mirror 2: 0x2514498a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f7c6: skipped 000656 1787781302.947779 write 0x000843 thru 0x00eb04 (0xe2c2 bytes) 000657 1787781302.962089 write 0x00841a thru 0x00d775 (0x535c bytes) 000660 1787781302.965072 read 0x02ddd3 thru 0x02f7c5 (0x19f3 bytes) 000661 1787781302.975973 mapread 0x013ce1 thru 0x014dda (0x10fa bytes) 000662 1787781302.989531 write 0x020115 thru 0x029972 (0x985e bytes) 000664 1787781303.004380 read 0x01751c thru 0x01c81d (0x5302 bytes) 000665 1787781303.021322 MIRROR_RESYNC 2 mirrors 000666 1787781304.042075 trunc from 0x02f7c6 to 0x005de1 (0x299e4 bytes) 000667 1787781304.200090 write 0x03ee91 thru 0x03ffff (0x116f bytes) 000668 1787781304.205857 mapread 0x01e91e thru 0x01f06c (0x74f bytes) 000670 1787781304.237210 write 0x0049ae thru 0x0079e2 (0x3035 bytes) 000671 1787781304.271430 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) 000674 1787781304.486996 mapwrite 0x00bcff thru 0x00f09c (0x339e bytes) 000675 1787781304.547724 read 0x03057b thru 0x0381dc (0x7c62 bytes) 000676 1787781304.557652 write 0x010d2a thru 0x01cf2d (0xc204 bytes) 000677 1787781304.564648 read 0x03e818 thru 0x03ffff (0x17e8 bytes) 000678 1787781304.577485 mapwrite 0x01006b thru 0x01d588 (0xd51e bytes) 000679 1787781304.661247 MIRROR_EXTEND to 2 mirrors 000682 1787781305.578845 read 0x00c0dc thru 0x010b30 (0x4a55 bytes) 000683 1787781305.587125 mapread 0x014f0f thru 0x022ce4 (0xddd6 bytes) 000687 1787781305.643958 mapread 0x0286a4 thru 0x02a55f (0x1ebc bytes) 000688 1787781305.676662 mapwrite 0x02737b thru 0x031da7 (0xaa2d bytes) 000690 1787781305.958602 trunc from 0x040000 to 0x0219d7 (0x1e628 bytes) 000692 1787781306.023837 mapwrite 0x02d0a0 thru 0x03c2d0 (0xf231 bytes) 000693 1787781306.210106 MIRROR_RESYNC 2 mirrors 000694 1787781307.101612 MIRROR_EXTEND to 3 mirrors 000696 1787781308.107704 read 0x00ec34 thru 0x01daed (0xeeba bytes) 000699 1787781308.120096 write 0x021881 thru 0x026b95 (0x5315 bytes) 000700 1787781308.197077 mapread 0x001fcf thru 0x00eb7a (0xcbac bytes) 000702 1787781308.215767 mapwrite 0x02fe5b thru 0x032147 (0x22ed bytes) 000703 1787781308.273303 trunc from 0x03c2d1 to 0x017dfc (0x244d4 bytes) 000704 1787781308.294762 mapwrite 0x01ee8a thru 0x023126 (0x429d bytes) 000706 1787781308.367134 trunc from 0x023127 to 0x0039cd (0x1f759 bytes) 000707 1787781308.389738 mapwrite 0x033f5a thru 0x03cd99 (0x8e40 bytes) 000708 1787781308.464454 write 0x018e8b thru 0x01e615 (0x578b bytes) 000712 1787781308.475870 read 0x02be80 thru 0x02caf4 (0xc75 bytes) 000713 1787781308.486080 mapread 0x019ec8 thru 0x01fefd (0x6036 bytes) 000716 1787781308.503441 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3cd9a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cd9a): Mirror 2: 0xd2e1af42 (stale) Mirror 3: 0xd2e1af42 (stale) CRC-32 checksum value for chunk [0, 0x3cd9a): Mirror 1: 0x8ba121da Mirror 4: 0x8ba121da lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cd9a: skipped 000717 1787781309.854348 mapwrite 0x0123bf thru 0x013c28 (0x186a bytes) 000718 1787781310.014267 read 0x011da6 thru 0x013490 (0x16eb bytes) 000720 1787781310.016122 trunc from 0x03cd9a to 0x0208ca (0x1c4cf bytes) 000721 1787781310.039076 write 0x028506 thru 0x030476 (0x7f71 bytes) 000722 1787781310.040881 read 0x01e2b6 thru 0x024120 (0x5e6b bytes) 000725 1787781310.052963 write 0x020892 thru 0x024d6c (0x44db bytes) 000726 1787781310.054618 write 0x0397ed thru 0x03d513 (0x3d27 bytes) 000727 1787781310.056938 read 0x02c7ab thru 0x02f17c (0x29d2 bytes) 000730 1787781310.059299 mapread 0x00d46b thru 0x013ba7 (0x673d bytes) 000733 1787781310.067729 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3d514): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d514): Mirror 2: 0xf4afebf5 (stale) Mirror 3: 0xf4afebf5 (stale) Mirror 4: 0xa8897114 (stale) CRC-32 checksum value for chunk [0, 0x3d514): Mirror 1: 0x62fde520 Mirror 5: 0x62fde520 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d514: skipped 000734 1787781311.191013 trunc from 0x03d514 to 0x024b63 (0x189b0 bytes) 000735 1787781311.360426 mapwrite 0x03d0a1 thru 0x03ed8e (0x1cee bytes) 000736 1787781311.472836 write 0x01ee1a thru 0x0290b4 (0xa29b bytes) 000738 1787781311.493467 MIRROR_RESYNC 5 mirrors 000739 1787781314.605855 write 0x0107e1 thru 0x01a0fd (0x991d bytes) 000740 1787781314.727538 mapwrite 0x01223b thru 0x02099a (0xe760 bytes) 000741 1787781314.804677 write 0x019145 thru 0x019c9c (0xb58 bytes) 000744 1787781314.806788 mapread 0x000c98 thru 0x008dee (0x8157 bytes) 000745 1787781314.817737 write 0x025389 thru 0x032312 (0xcf8a bytes) 000747 1787781314.828836 trunc from 0x03ed8f to 0x00d92b (0x31463 bytes) 000748 1787781314.870544 read 0x00a030 thru 0x00d92b (0x38fc bytes) 000749 1787781314.872745 mapread 0x001d8c thru 0x00b13e (0x93b3 bytes) 000750 1787781314.877666 trunc from 0x00d92c to 0x02000f (0x126e4 bytes) 000751 1787781314.901786 write 0x01dbf4 thru 0x0251cd (0x75da bytes) 000755 1787781314.913766 mapread 0x01b165 thru 0x023ffd (0x8e99 bytes) 000757 1787781314.925345 write 0x020933 thru 0x02d9e5 (0xd0b3 bytes) 000758 1787781314.932540 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2d9e6): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d9e6): Mirror 2: 0xe36b5a28 (stale) Mirror 3: 0xe36b5a28 (stale) Mirror 4: 0xe36b5a28 (stale) Mirror 5: 0xe36b5a28 (stale) CRC-32 checksum value for chunk [0, 0x2d9e6): Mirror 1: 0x3cad0664 Mirror 6: 0x3cad0664 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d9e6: skipped 000761 1787781316.313229 MIRROR_RESYNC 6 mirrors 000762 1787781318.053287 trunc from 0x02d9e6 to 0x038633 (0xac4e bytes) 000763 1787781318.156365 mapwrite 0x038609 thru 0x03ffff (0x79f7 bytes) 000764 1787781318.263836 write 0x025696 thru 0x02f8dd (0xa248 bytes) 000765 1787781318.277933 mapread 0x035162 thru 0x038af1 (0x3990 bytes) 000768 1787781318.291955 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xfbd2357f (stale) Mirror 3: 0xfbd2357f (stale) Mirror 4: 0xfbd2357f (stale) Mirror 5: 0xfbd2357f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xfbd2357f (stale) Mirror 3: 0xfbd2357f (stale) Mirror 4: 0xfbd2357f (stale) Mirror 5: 0xfbd2357f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000769 1787781318.979694 mapwrite 0x033cfc thru 0x03a77d (0x6a82 bytes) 000776 1787781319.089203 read 0x0169c0 thru 0x018ea7 (0x24e8 bytes) 000777 1787781319.099969 mapread 0x00a30d thru 0x00c265 (0x1f59 bytes) 000778 1787781319.108854 mapwrite 0x01aefc thru 0x020b31 (0x5c36 bytes) 000780 1787781319.170572 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xfbd2357f (stale) Mirror 3: 0xfbd2357f (stale) Mirror 4: 0xfbd2357f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xfbd2357f (stale) Mirror 3: 0xfbd2357f (stale) Mirror 4: 0xfbd2357f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000781 1787781319.612251 mapwrite 0x023725 thru 0x02e64b (0xaf27 bytes) 000783 1787781319.702479 trunc from 0x040000 to 0x01e391 (0x21c6e bytes) 000784 1787781319.719712 read 0x0147de thru 0x016d91 (0x25b4 bytes) 000785 1787781319.730471 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1e392): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e392): Mirror 2: 0x90d6221 (stale) Mirror 3: 0x90d6221 (stale) Mirror 4: 0x90d6221 (stale) CRC-32 checksum value for chunk [0, 0x1e392): Mirror 1: 0x956d45db Mirror 5: 0x956d45db lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e392: skipped 000786 1787781321.308736 MIRROR_RESYNC 5 mirrors 000787 1787781322.595628 mapwrite 0x0300ad thru 0x039b04 (0x9a58 bytes) 000788 1787781322.979621 read 0x00fe6f thru 0x01515d (0x52ef bytes) 000790 1787781323.006169 read 0x00e8ad thru 0x016681 (0x7dd5 bytes) 000793 1787781323.055689 mapread 0x033ad7 thru 0x0366d5 (0x2bff bytes) 000795 1787781323.058765 mapread 0x024b7f thru 0x031e44 (0xd2c6 bytes) 000798 1787781323.062243 write 0x01b568 thru 0x025232 (0x9ccb bytes) 000799 1787781323.064693 trunc from 0x039b05 to 0x0211f7 (0x1890d bytes) 000800 1787781323.118698 trunc from 0x0211f8 to 0x02152b (0x334 bytes) 000801 1787781323.140226 write 0x00c770 thru 0x01a31b (0xdbac bytes) 000802 1787781323.145627 write 0x034c4d thru 0x03a7c6 (0x5b7a bytes) 000803 1787781323.165522 MIRROR_RESYNC 5 mirrors 000804 1787781325.460317 mapwrite 0x00d124 thru 0x014fd0 (0x7ead bytes) 000805 1787781325.644531 mapread 0x030a60 thru 0x038deb (0x838c bytes) 000806 1787781325.656320 write 0x010f17 thru 0x012dd6 (0x1ec0 bytes) 000807 1787781325.662617 MIRROR_RESYNC 5 mirrors 000808 1787781327.639052 trunc from 0x03a7c7 to 0x02d1db (0xd5eb bytes) 000809 1787781327.698016 mapread 0x020a0b thru 0x029224 (0x881a bytes) 000810 1787781327.731291 mapread 0x017d25 thru 0x01e413 (0x66ef bytes) 000813 1787781327.749533 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x2d1dc): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d1dc): Mirror 2: 0x91fd20a7 (stale) Mirror 3: 0x91fd20a7 (stale) Mirror 4: 0x91fd20a7 (stale) Mirror 5: 0x91fd20a7 (stale) CRC-32 checksum value for chunk [0, 0x2d1dc): Mirror 1: 0x91fd20a7 Mirror 6: 0x91fd20a7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d1dc: skipped 000814 1787781329.405675 read 0x007160 thru 0x012dbe (0xbc5f bytes) 000815 1787781329.421139 write 0x011c25 thru 0x019d5d (0x8139 bytes) 000816 1787781329.544042 trunc from 0x02d1dc to 0x02f6d0 (0x24f5 bytes) 000818 1787781329.580578 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f6d1): Mirror 2: 0x24c05e6a (stale) Mirror 3: 0x24c05e6a (stale) Mirror 4: 0x24c05e6a (stale) Mirror 5: 0x24c05e6a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f6d1): Mirror 2: 0x24c05e6a (stale) Mirror 3: 0x24c05e6a (stale) Mirror 4: 0x24c05e6a (stale) Mirror 5: 0x24c05e6a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f6d1: skipped 000819 1787781330.087327 mapread 0x02e10d thru 0x02f6d0 (0x15c4 bytes) 000820 1787781330.110324 read 0x015a7a thru 0x02565b (0xfbe2 bytes) 000821 1787781330.141870 trunc from 0x02f6d1 to 0x00cbca (0x22b06 bytes) 000823 1787781330.171797 mapread 0x00a349 thru 0x00cbca (0x2882 bytes) 000824 1787781330.205020 mapread 0x008e90 thru 0x00cbca (0x3d3b bytes) 000825 1787781330.213572 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xcbcb): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xcbcb): Mirror 2: 0x416168f0 (stale) Mirror 3: 0x416168f0 (stale) Mirror 4: 0x416168f0 (stale) Mirror 5: 0x416168f0 (stale) CRC-32 checksum value for chunk [0, 0xcbcb): Mirror 1: 0x416168f0 Mirror 6: 0x416168f0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xcbcb: skipped 000826 1787781331.401742 mapwrite 0x02a1b2 thru 0x02a327 (0x176 bytes) 000834 1787781331.600501 mapread 0x01dc6b thru 0x02a327 (0xc6bd bytes) 000835 1787781331.620657 mapwrite 0x012bc3 thru 0x01a7b5 (0x7bf3 bytes) 000838 1787781331.679448 mapwrite 0x011695 thru 0x01ce9e (0xb80a bytes) 000839 1787781331.729266 write 0x00d8b3 thru 0x00f5a1 (0x1cef bytes) 000841 1787781331.730843 read 0x022dea thru 0x02a327 (0x753e bytes) 000846 1787781331.735521 trunc from 0x02a328 to 0x014ccc (0x1565b bytes) 000847 1787781331.759577 write 0x000b96 thru 0x00fc90 (0xf0fb bytes) 000850 1787781331.768392 trunc from 0x014ccd to 0x03850d (0x23841 bytes) 000851 1787781331.791433 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3850e): Mirror 2: 0x8874f9e1 (stale) Mirror 3: 0x8874f9e1 (stale) Mirror 4: 0x8874f9e1 (stale) Mirror 6: 0x25204667 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3850e): Mirror 2: 0x8874f9e1 (stale) Mirror 3: 0x8874f9e1 (stale) Mirror 4: 0x8874f9e1 (stale) Mirror 6: 0x25204667 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3850e: skipped 000855 1787781332.181748 write 0x00a318 thru 0x015293 (0xaf7c bytes) 000858 1787781332.197061 read 0x02541f thru 0x02e226 (0x8e08 bytes) 000859 1787781332.208829 trunc from 0x03850e to 0x020790 (0x17d7d bytes) 000860 1787781332.226518 read 0x007e00 thru 0x01094b (0x8b4c bytes) 000861 1787781332.238252 mapwrite 0x0075ce thru 0x00dabc (0x64ef bytes) 000862 1787781332.304768 read 0x01067f thru 0x0110e5 (0xa67 bytes) 000863 1787781332.305453 trunc from 0x020791 to 0x02a68a (0x9efa bytes) 000864 1787781332.326170 write 0x00e1ab thru 0x0129e9 (0x483f bytes) 000867 1787781332.331354 mapread 0x022368 thru 0x02a68a (0x8323 bytes) 000869 1787781332.343431 mapread 0x0061ab thru 0x007b63 (0x19b9 bytes) 000871 1787781332.346488 write 0x00edf6 thru 0x00f927 (0xb32 bytes) 000873 1787781332.349016 mapwrite 0x0147c7 thru 0x022b45 (0xe37f bytes) 000874 1787781332.415928 trunc from 0x02a68b to 0x00af9d (0x1f6ed bytes) 000875 1787781332.440933 mapwrite 0x033229 thru 0x0350c5 (0x1e9d bytes) 000878 1787781332.536606 mapread 0x01931f thru 0x022c48 (0x992a bytes) 000880 1787781332.597971 write 0x034339 thru 0x0376ae (0x3376 bytes) 000881 1787781332.601017 write 0x0325b1 thru 0x0353b0 (0x2e00 bytes) 000882 1787781332.602947 mapread 0x01fbae thru 0x02522d (0x5680 bytes) 000884 1787781332.633505 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x376af): Mirror 3: 0x32a664af (stale) Mirror 4: 0x32a664af (stale) Mirror 6: 0xeb53efb4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x376af): Mirror 3: 0x32a664af (stale) Mirror 4: 0x32a664af (stale) Mirror 6: 0xeb53efb4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x376af: skipped 000885 1787781333.132095 mapread 0x028358 thru 0x02ef27 (0x6bd0 bytes) 000887 1787781333.170420 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x376af): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x376af): Mirror 3: 0x32a664af (stale) Mirror 4: 0x32a664af (stale) Mirror 6: 0xeb53efb4 (stale) CRC-32 checksum value for chunk [0, 0x376af): Mirror 1: 0x281b8942 Mirror 7: 0x281b8942 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x376af: skipped 000889 1787781334.459801 mapwrite 0x00914b thru 0x013230 (0xa0e6 bytes) 000890 1787781334.730303 mapread 0x026fe7 thru 0x02c1a6 (0x51c0 bytes) 000891 1787781334.743317 write 0x03024e thru 0x0321c1 (0x1f74 bytes) 000892 1787781334.767074 MIRROR_RESYNC 5 mirrors 000894 1787781336.631583 MIRROR_EXTEND to 6 mirrors 000895 1787781337.750033 MIRROR_EXTEND to 7 mirrors 000896 1787781338.807885 trunc from 0x0376af to 0x00f249 (0x28465 bytes) 000899 1787781338.927426 trunc from 0x00f24a to 0x0371e0 (0x27f97 bytes) 000900 1787781338.970429 write 0x03243f thru 0x03ffff (0xdbc1 bytes) 000902 1787781338.978840 mapread 0x02ec9f thru 0x02f4ba (0x81c bytes) 000903 1787781338.999534 mapread 0x01cc07 thru 0x022bc7 (0x5fc1 bytes) 000904 1787781339.016815 write 0x0280d1 thru 0x028e7e (0xdae bytes) 000905 1787781339.038448 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x580d146d (stale) Mirror 4: 0x580d146d (stale) Mirror 6: 0x580d146d (stale) Mirror 7: 0x580d146d (stale) Mirror 8: 0x580d146d (stale) Mirror 9: 0x580d146d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x4959b1c0 Mirror 10: 0x4959b1c0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000907 1787781340.706819 write 0x01c3f1 thru 0x027a02 (0xb612 bytes) 000909 1787781340.842422 trunc from 0x040000 to 0x028c78 (0x17387 bytes) 000911 1787781340.870048 write 0x009554 thru 0x00e827 (0x52d4 bytes) 000912 1787781340.882650 trunc from 0x028c79 to 0x00005f (0x28c19 bytes) 000913 1787781340.909306 write 0x0296df thru 0x02c882 (0x31a4 bytes) 000914 1787781340.912762 write 0x028952 thru 0x037efc (0xf5ab bytes) 000915 1787781340.930219 mapwrite 0x0016f4 thru 0x007413 (0x5d20 bytes) 000916 1787781341.054750 trunc from 0x037efd to 0x0163c2 (0x21b3a bytes) 000917 1787781341.079192 read 0x0162b8 thru 0x0163c2 (0x10b bytes) 000919 1787781341.086083 write 0x037646 thru 0x03a462 (0x2e1d bytes) 000921 1787781341.088009 read 0x000419 thru 0x00e8bf (0xe4a7 bytes) 000924 1787781341.108408 write 0x036653 thru 0x03ffff (0x99ad bytes) 000925 1787781341.110867 mapwrite 0x00da2c thru 0x013db9 (0x638e bytes) 000926 1787781341.170603 read 0x02d834 thru 0x034fd5 (0x77a2 bytes) 000928 1787781341.172301 mapread 0x0244a5 thru 0x02d622 (0x917e bytes) 000929 1787781341.173544 write 0x00ab71 thru 0x0102f6 (0x5786 bytes) 000930 1787781341.175958 read 0x03d7b5 thru 0x03ffff (0x284b bytes) 000932 1787781341.177845 mapread 0x023c38 thru 0x02aa8d (0x6e56 bytes) 000934 1787781341.181783 trunc from 0x040000 to 0x0201e1 (0x1fe1e bytes) 000935 1787781341.197281 mapread 0x01909b thru 0x01ccff (0x3c65 bytes) 000937 1787781341.204755 MIRROR_RESYNC 8 mirrors 000938 1787781343.063791 mapwrite 0x010049 thru 0x01e7fb (0xe7b3 bytes) 000939 1787781343.387470 mapwrite 0x02128e thru 0x0230a8 (0x1e1b bytes) 000942 1787781343.471987 write 0x02e9aa thru 0x03aa9d (0xc0f4 bytes) 000946 1787781343.476807 write 0x02c43d thru 0x0327ec (0x63b0 bytes) 000949 1787781343.484837 write 0x03ed85 thru 0x03ffff (0x127b bytes) 000951 1787781343.487519 write 0x027ed3 thru 0x030336 (0x8464 bytes) 000952 1787781343.494093 trunc from 0x040000 to 0x005559 (0x3aaa6 bytes) 000953 1787781343.512354 read 0x0000f4 thru 0x005559 (0x5466 bytes) 000955 1787781343.523725 trunc from 0x00555a to 0x013610 (0xe0b7 bytes) 000958 1787781343.552709 trunc from 0x013611 to 0x006d2e (0xc8e2 bytes) 000959 1787781343.576315 trunc from 0x006d2f to 0x022336 (0x1b608 bytes) 000960 1787781343.595354 trunc from 0x022337 to 0x0134aa (0xee8c bytes) 000961 1787781343.621282 MIRROR_RESYNC 8 mirrors 000962 1787781345.594446 mapwrite 0x032cc9 thru 0x033938 (0xc70 bytes) 000963 1787781345.764315 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33939): Mirror 3: 0xd45b3743 (stale) Mirror 4: 0xd45b3743 (stale) Mirror 7: 0xd45b3743 (stale) Mirror 8: 0xd45b3743 (stale) Mirror 9: 0xd45b3743 (stale) Mirror 10: 0xd45b3743 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33939): Mirror 3: 0xd45b3743 (stale) Mirror 4: 0xd45b3743 (stale) Mirror 7: 0xd45b3743 (stale) Mirror 8: 0xd45b3743 (stale) Mirror 9: 0xd45b3743 (stale) Mirror 10: 0xd45b3743 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33939: skipped 000964 1787781346.312449 read 0x02377d thru 0x0255e3 (0x1e67 bytes) 000965 1787781346.320623 mapread 0x01a96f thru 0x02809f (0xd731 bytes) 000967 1787781346.345666 read 0x0142bd thru 0x01eb91 (0xa8d5 bytes) 000968 1787781346.355649 mapread 0x0233d9 thru 0x029127 (0x5d4f bytes) 000972 1787781346.363220 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x33939): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33939): Mirror 3: 0xd45b3743 (stale) Mirror 4: 0xd45b3743 (stale) Mirror 7: 0xd45b3743 (stale) Mirror 8: 0xd45b3743 (stale) Mirror 9: 0xd45b3743 (stale) Mirror 10: 0xd45b3743 (stale) CRC-32 checksum value for chunk [0, 0x33939): Mirror 1: 0x350100f1 Mirror 11: 0x350100f1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33939: skipped 000975 1787781347.564453 read 0x007baa thru 0x01391f (0xbd76 bytes) 000977 1787781347.576719 trunc from 0x033939 to 0x01f296 (0x146a2 bytes) 000978 1787781347.669754 trunc from 0x01f297 to 0x029209 (0x9f73 bytes) 000979 1787781347.690787 mapread 0x01f5f3 thru 0x025f8f (0x699d bytes) 000980 1787781347.711360 mapread 0x01db09 thru 0x02883f (0xad37 bytes) 000981 1787781347.713226 read 0x00e9fc thru 0x0108e2 (0x1ee7 bytes) 000983 1787781347.725392 read 0x00952e thru 0x00b084 (0x1b57 bytes) 000984 1787781347.726412 write 0x01b08d thru 0x029c77 (0xebeb bytes) 000986 1787781347.730156 read 0x028800 thru 0x029c77 (0x1478 bytes) 000987 1787781347.731076 read 0x025bf5 thru 0x02742d (0x1839 bytes) 000988 1787781347.732077 trunc from 0x029c78 to 0x01d6e6 (0xc591 bytes) 000989 1787781347.749748 mapread 0x005d94 thru 0x013581 (0xd7ee bytes) 000990 1787781347.752406 trunc from 0x01d6e7 to 0x0237f0 (0x610a bytes) 000991 1787781347.772607 read 0x003c24 thru 0x003c34 (0x11 bytes) 000992 1787781347.773425 write 0x01d92f thru 0x01fba9 (0x227b bytes) 000993 1787781347.782660 write 0x03815e thru 0x03ffff (0x7ea2 bytes) 000994 1787781347.788427 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x6f18d289 (stale) Mirror 7: 0x6f18d289 (stale) Mirror 8: 0x6f18d289 (stale) Mirror 9: 0x6f18d289 (stale) Mirror 10: 0x6f18d289 (stale) Mirror 11: 0xa61a0e8d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x6f18d289 (stale) Mirror 7: 0x6f18d289 (stale) Mirror 8: 0x6f18d289 (stale) Mirror 9: 0x6f18d289 (stale) Mirror 10: 0x6f18d289 (stale) Mirror 11: 0xa61a0e8d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000996 1787781348.262561 write 0x025c6c thru 0x0318d5 (0xbc6a bytes) 000997 1787781348.278091 MIRROR_RESYNC 7 mirrors 000998 1787781353.221364 trunc from 0x040000 to 0x02e696 (0x11969 bytes) All operations completed A-OK!