== sanity-flr test 70a: flr mode fsx test ================ 22:14:16 (1790734456) striped dir -i0 -c2 -H crush2 /mnt/lustre/d70a.sanity-flr Seed set to 4458 skipping zero size read skipping zero size read skipping zero length zero range skipping zero size read skipping zero size read truncating to largest ever: 0x445c 000006 1790734459.248624 trunc from 00000000 to 0x00445b (0x445c bytes) 000007 1790734459.282969 mapwrite 0x01a6ba thru 0x01a802 (0x149 bytes) fallocating to largest ever: 0x360ca 000010 1790734459.366368 fallocate 0x027756 thru 0x0360c9 (0xe974 bytes) 000011 1790734459.382532 fallocate 0x01d7c7 thru 0x01fe19 (0x2653 bytes) 000012 1790734459.401485 read 0x014551 thru 0x017fb6 (0x3a66 bytes) 000013 1790734459.419870 punch from 0x02e3ec to 0x0316cf (0x32e4 bytes) 000014 1790734459.427927 mapread 0x0215b1 thru 0x02799c (0x63ec bytes) 000016 1790734459.453843 mapread 0x03198b thru 0x0360c9 (0x473f bytes) 000017 1790734459.480000 punch from 0x02202e to 0x02e7e3 (0xc7b6 bytes) 000018 1790734459.494785 mapread 0x031e8d thru 0x0360c9 (0x423d bytes) 000019 1790734459.499844 mapwrite 0x024c46 thru 0x02c756 (0x7b11 bytes) 000020 1790734459.569484 read 0x02a72d thru 0x02bc7f (0x1553 bytes) 000021 1790734459.570092 mapread 0x02be93 thru 0x02c8f5 (0xa63 bytes) 000022 1790734459.570848 fallocate 0x0159b9 thru 0x024d32 (0xf37a bytes) 000023 1790734459.576012 trunc from 0x0360ca to 0x01d100 (0x18fc9 bytes) 000024 1790734459.608718 mapwrite 0x014ea5 thru 0x023f65 (0xf0c1 bytes) 000025 1790734459.737474 mapread 0x01ce1b thru 0x023f65 (0x714b bytes) 000026 1790734459.740734 mapread 0x01df3c thru 0x023d44 (0x5e09 bytes) 000027 1790734459.745132 punch from 0x014a31 to 0x021979 (0xcf49 bytes) 000028 1790734459.752098 write 0x019c1b thru 0x02878f (0xeb75 bytes) 000029 1790734459.776500 mapread 0x016cef thru 0x01c84f (0x5b61 bytes) 000030 1790734459.813904 MIRROR_EXTEND to 2 mirrors fallocating to largest ever: 0x3ad37 000031 1790734460.576942 fallocate 0x02dd7b thru 0x03ad36 (0xcfbc bytes) 000034 1790734460.630018 read 0x00e73b thru 0x0101e2 (0x1aa8 bytes) 000035 1790734460.645382 mapread 0x0104e2 thru 0x019fbd (0x9adc bytes) 000036 1790734460.692611 read 0x01fbc3 thru 0x02878f (0x8bcd bytes) 000037 1790734460.719006 mapwrite 0x033b17 thru 0x03ffff (0xc4e9 bytes) 000038 1790734460.914878 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x21fed0ec (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb9704d88 Mirror 3: 0xb9704d88 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000039 1790734461.852854 fallocate 0x002cff thru 0x010a8c (0xdd8e bytes) 000040 1790734461.884866 mapwrite 0x03ac3e thru 0x03ffff (0x53c2 bytes) 000041 1790734461.915398 trunc from 0x040000 to 0x02f2d4 (0x10d2b bytes) 000042 1790734461.950728 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f2d5): Mirror 3: 0x2347db88 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f2d5): Mirror 3: 0x2347db88 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f2d5: skipped 000043 1790734462.254153 fallocate 0x00cbb7 thru 0x014e0a (0x8254 bytes) 000044 1790734462.272306 mapread 0x017ad2 thru 0x01e798 (0x6cc7 bytes) 000045 1790734462.325292 mapwrite 0x016977 thru 0x025f3b (0xf5c5 bytes) 000046 1790734462.449921 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) 000047 1790734462.658265 mapread 0x003533 thru 0x0105a9 (0xd077 bytes) 000048 1790734462.676583 trunc from 0x02f2d5 to 0x02979c (0x5b38 bytes) 000049 1790734462.694971 trunc from 0x02979d to 0x0301e1 (0x6a45 bytes) 000051 1790734462.711406 mapwrite 0x024d5f thru 0x02a1dd (0x547f bytes) 000052 1790734462.769856 mapwrite 0x018fd2 thru 0x022f7b (0x9faa bytes) 000053 1790734462.857000 trunc from 0x024128 to 0x02adb4 (0x6c8d bytes) 000054 1790734462.868397 write 0x016034 thru 0x01a40f (0x43dc bytes) 000056 1790734462.873936 trunc from 0x013206 to 0x013b1f (0x91a bytes) 000057 1790734462.882892 mapread 0x00101f thru 0x0103bb (0xf39d bytes) 000058 1790734462.884022 mapread 0x02bf46 thru 0x02dfc3 (0x207e bytes) 000059 1790734462.897928 trunc from 0x0301e2 to 0x035668 (0x5487 bytes) 000060 1790734462.929554 punch from 0x01589a to 0x024300 (0xea67 bytes) 000061 1790734462.954115 MIRROR_EXTEND to 2 mirrors 000062 1790734463.721154 trunc from 0x035669 to 0x02f1e5 (0x6483 bytes) 000063 1790734463.781066 mapwrite 0x005205 thru 0x009fd5 (0x4dd1 bytes) 000064 1790734463.821955 write 0x002a51 thru 0x011c4d (0xf1fd bytes) 000065 1790734463.838714 mapwrite 0x01f60d thru 0x027b12 (0x8506 bytes) 000066 1790734463.885324 mapwrite 0x030e15 thru 0x0333f6 (0x25e2 bytes) 000067 1790734463.996403 punch from 0x01a360 to 0x020bb7 (0x6858 bytes) 000069 1790734464.011187 write 0x006b05 thru 0x0105aa (0x9aa6 bytes) 000071 1790734464.013000 trunc from 0x0333f7 to 0x0376dd (0x42e7 bytes) 000072 1790734464.029170 trunc from 0x0376de to 0x01215c (0x25581 bytes) 000073 1790734464.061781 trunc from 0x01215d to 0x01c13d (0x9fe1 bytes) 000074 1790734464.079961 punch from 0x015836 to 0x01b7c5 (0x5f90 bytes) 000075 1790734464.088310 mapread 0x01b17c thru 0x01c13d (0xfc2 bytes) 000076 1790734464.105224 MIRROR_RESYNC 2 mirrors 000077 1790734464.602860 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) 000078 1790734464.707785 punch from 0x018675 to 0x01c13d (0x3ac9 bytes) 000079 1790734464.722979 mapread 0x01820b thru 0x01b330 (0x3126 bytes) 000081 1790734464.743765 read 0x005195 thru 0x009082 (0x3eee bytes) 000082 1790734464.752361 trunc from 0x01c13e to 0x02f1cc (0x1308f bytes) 000084 1790734464.793396 read 0x015603 thru 0x01e924 (0x9322 bytes) 000086 1790734464.802637 mapread 0x021c2e thru 0x0223a6 (0x779 bytes) 000087 1790734464.803481 mapread 0x02a2b7 thru 0x02f1cc (0x4f16 bytes) 000088 1790734464.804228 read 0x01d9a5 thru 0x01eb7a (0x11d6 bytes) 000089 1790734464.806136 trunc from 0x02f1cd to 0x037eb8 (0x8cec bytes) 000090 1790734464.818467 trunc from 0x0131ed to 0x021ca6 (0xeaba bytes) 000091 1790734464.823608 write 0x03a391 thru 0x03ffff (0x5c6f bytes) 000092 1790734464.825673 mapread 0x007e46 thru 0x00a05c (0x2217 bytes) 000093 1790734464.826918 mapwrite 0x00bcd0 thru 0x00dce5 (0x2016 bytes) 000094 1790734464.843170 read 0x001125 thru 0x0069bf (0x589b bytes) 000095 1790734464.843778 trunc from 0x040000 to 0x0377de (0x8821 bytes) 000096 1790734464.855548 trunc from 0x0377df to 0x025976 (0x11e68 bytes) 000097 1790734464.876655 mapread 0x01e18d thru 0x025976 (0x77ea bytes) 000098 1790734464.886185 trunc from 0x012b95 to 0x018297 (0x5703 bytes) 000099 1790734464.896890 trunc from 0x025977 to 0x033820 (0xdeaa bytes) fallocating to largest ever: 0x3c414 000100 1790734464.916661 fallocate 0x02c7c1 thru 0x03c413 (0xfc53 bytes) 000101 1790734464.921394 punch from 0x026356 to 0x02b406 (0x50b1 bytes) 000102 1790734464.928424 punch from 0x01f6d5 to 0x02a1e9 (0xab15 bytes) 000104 1790734464.934563 write 0x024fca thru 0x025842 (0x879 bytes) 000105 1790734464.950566 punch from 0x005a68 to 0x00fca1 (0xa23a bytes) 000106 1790734464.960492 write 0x0133b7 thru 0x016bf1 (0x383b bytes) 000107 1790734464.969854 trunc from 0x033821 to 0x01f61b (0x14205 bytes) 000108 1790734464.990259 trunc from 0x007304 to 0x01145e (0xa15b bytes) fallocating to largest ever: 0x3f0ff 000109 1790734465.007178 fallocate 0x033aea thru 0x03f0fe (0xb615 bytes) 000110 1790734465.018981 punch from 0x01004c to 0x0158d6 (0x588b bytes) 000111 1790734465.036765 trunc from 0x03f0ff to 0x00b2b7 (0x33e47 bytes) 000112 1790734465.063098 fallocate 0x0292a2 thru 0x02ffc2 (0x6d21 bytes) 000113 1790734465.075360 read 0x017f4c thru 0x02621f (0xe2d4 bytes) 000114 1790734465.092295 read 0x010c63 thru 0x01d246 (0xc5e4 bytes) 000115 1790734465.092859 mapread 0x0055f7 thru 0x009b26 (0x4530 bytes) 000116 1790734465.094127 punch from 0x02da32 to 0x02ffc2 (0x2591 bytes) 000117 1790734465.097713 mapread 0x00effe thru 0x017823 (0x8826 bytes) 000118 1790734465.098906 punch from 0x017c4e to 0x01aa14 (0x2dc7 bytes) 000119 1790734465.102699 punch from 0x02b776 to 0x02ffc2 (0x484d bytes) 000121 1790734465.107612 mapwrite 0x0227c5 thru 0x02e2e4 (0xbb20 bytes) 000122 1790734465.134325 MIRROR_EXTEND to 2 mirrors 000123 1790734465.707446 read 0x02302c thru 0x02ffc2 (0xcf97 bytes) 000124 1790734465.724833 mapread 0x001fa2 thru 0x00c0be (0xa11d bytes) 000126 1790734465.775083 trunc from 0x02f390 to 0x02ffc2 (0xc33 bytes) 000127 1790734465.816304 mapread 0x0250fd thru 0x02ffc2 (0xaec6 bytes) 000128 1790734465.841789 mapwrite 0x00204c thru 0x002f8e (0xf43 bytes) 000129 1790734465.862773 fallocate 0x03d89b thru 0x03da1f (0x185 bytes) 000130 1790734465.867185 read 0x025930 thru 0x03458a (0xec5b bytes) 000131 1790734465.878726 write 0x00b953 thru 0x00cdc9 (0x1477 bytes) 000132 1790734465.882983 punch from 0x02f633 to 0x03bebf (0xc88d bytes) 000133 1790734465.887739 mapwrite 0x020cd9 thru 0x0214de (0x806 bytes) 000134 1790734465.898842 mapread 0x01b8c6 thru 0x021114 (0x584f bytes) 000136 1790734465.900528 mapread 0x014d04 thru 0x021095 (0xc392 bytes) 000137 1790734465.901485 mapread 0x00bc7f thru 0x01194c (0x5cce bytes) 000138 1790734465.905303 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3da20): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3da20): Mirror 2: 0xf7be0421 (stale) CRC-32 checksum value for chunk [0, 0x3da20): Mirror 1: 0xed93a85a Mirror 3: 0xed93a85a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3da20: skipped 000139 1790734466.905659 punch from 0x0227e0 to 0x0315e7 (0xee08 bytes) 000140 1790734466.944724 trunc from 0x03da20 to 0x01b4f9 (0x22526 bytes) 000142 1790734466.959291 trunc from 0x01b4fa to 0x0278e3 (0xc3ea bytes) 000143 1790734466.969815 punch from 0x013812 to 0x021d3e (0xe52d bytes) 000144 1790734466.976800 mapread 0x021a91 thru 0x0278e3 (0x5e53 bytes) 000145 1790734466.994754 trunc from 0x0100aa to 0x01dda3 (0xdcfa bytes) 000146 1790734466.999479 punch from 0x011a57 to 0x0163f7 (0x49a1 bytes) 000147 1790734467.007674 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x278e4): Mirror 3: 0xff29f5e3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x278e4): Mirror 3: 0xff29f5e3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x278e4: skipped 000148 1790734467.316135 read 0x001a4a thru 0x00fd08 (0xe2bf bytes) 000149 1790734467.327641 read 0x013cb5 thru 0x021e71 (0xe1bd bytes) 000150 1790734467.342323 mapwrite 0x030a28 thru 0x0348a8 (0x3e81 bytes) 000151 1790734467.394306 fallocate 0x005a5e thru 0x00ae57 (0x53fa bytes) 000152 1790734467.400517 trunc from 0x0348a9 to 0x02c81f (0x8089 bytes) 000153 1790734467.413732 write 0x02dc8b thru 0x038a80 (0xadf6 bytes) 000154 1790734467.415254 trunc from 0x02068f to 0x02a3ed (0x9d5f bytes) 000155 1790734467.422340 mapread 0x01e36b thru 0x01e47a (0x110 bytes) 000156 1790734467.429760 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x38a81): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38a81): Mirror 3: 0xd91efef4 (stale) CRC-32 checksum value for chunk [0, 0x38a81): Mirror 1: 0xbd48d54d Mirror 4: 0xbd48d54d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38a81: skipped 000157 1790734468.260921 trunc from 0x038a81 to 0x0325e0 (0x64a0 bytes) 000158 1790734468.340633 punch from 0x013ec6 to 0x01a973 (0x6aae bytes) 000159 1790734468.345512 mapwrite 0x022bb5 thru 0x029ffd (0x7449 bytes) 000160 1790734468.384982 read 0x025619 thru 0x02bdc3 (0x67ab bytes) 000161 1790734468.385849 mapread 0x006a77 thru 0x00bba5 (0x512f bytes) 000162 1790734468.398717 fallocate 0x00ec53 thru 0x01d9f7 (0xeda5 bytes) 000163 1790734468.404425 punch from 0x028c47 to 0x02a2e5 (0x169f bytes) 000164 1790734468.409580 mapwrite 0x0378c6 thru 0x03ffff (0x873a bytes) 000165 1790734468.452307 write 0x023454 thru 0x02bcb5 (0x8862 bytes) 000166 1790734468.454830 fallocate 0x006926 thru 0x00e3bf (0x7a9a bytes) 000167 1790734468.473253 trunc from 0x040000 to 0x031c5f (0xe3a0 bytes) 000169 1790734468.513751 trunc from 0x002b9d to 0x00621f (0x3683 bytes) 000170 1790734468.518863 trunc from 0x031c60 to 0x039af3 (0x7e94 bytes) 000171 1790734468.541764 mapwrite 0x00dafc thru 0x01191f (0x3e24 bytes) 000172 1790734468.576502 trunc from 0x039af4 to 0x02cd0b (0xcde8 bytes) 000173 1790734468.593327 punch from 0x00a478 to 0x014a8f (0xa618 bytes) 000174 1790734468.602837 trunc from 0x02cd0c to 0x018a84 (0x14287 bytes) 000175 1790734468.644412 fallocate 0x02e6b5 thru 0x03064e (0x1f9a bytes) 000176 1790734468.656301 mapread 0x00f06d thru 0x018a84 (0x9a18 bytes) 000177 1790734468.678932 trunc from 0x017f31 to 0x018a84 (0xb54 bytes) 000178 1790734468.684974 mapwrite 0x0077e3 thru 0x014b24 (0xd342 bytes) 000179 1790734468.740223 read 0x015c8e thru 0x016397 (0x70a bytes) 000180 1790734468.747242 trunc from 0x008519 to 0x016cc4 (0xe7ac bytes) 000181 1790734468.756320 write 0x020790 thru 0x02bf85 (0xb7f6 bytes) 000182 1790734468.757844 trunc from 0x02bf86 to 0x01d295 (0xecf0 bytes) 000183 1790734468.799555 mapread 0x00099d thru 0x010899 (0xfefd bytes) 000184 1790734468.851550 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1d296): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d296): Mirror 3: 0x4976bb5 (stale) Mirror 4: 0x4976bb5 (stale) CRC-32 checksum value for chunk [0, 0x1d296): Mirror 1: 0xe0aadcf3 Mirror 5: 0xe0aadcf3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d296: skipped 000185 1790734469.909464 fallocate 0x029418 thru 0x033c02 (0xa7eb bytes) 000186 1790734469.962802 trunc from 0x033c03 to 0x00b928 (0x282da bytes) 000187 1790734469.997848 mapwrite 0x02b264 thru 0x033800 (0x859d bytes) 000188 1790734470.051652 mapread 0x01d8c7 thru 0x021056 (0x3790 bytes) 000189 1790734470.063102 mapread 0x005be6 thru 0x014034 (0xe44f bytes) 000191 1790734470.079540 read 0x012a7d thru 0x02228f (0xf813 bytes) 000192 1790734470.080460 trunc from 0x02316b to 0x02c915 (0x97ab bytes) 000194 1790734470.086682 trunc from 0x0011e2 to 0x006fec (0x5e0b bytes) 000195 1790734470.095496 mapread 0x01f355 thru 0x021a1b (0x26c7 bytes) 000196 1790734470.096804 read 0x02a3fb thru 0x033800 (0x9406 bytes) 000197 1790734470.109997 trunc from 0x033801 to 0x025d3e (0xdac2 bytes) 000198 1790734470.131864 mapread 0x006601 thru 0x008e23 (0x2823 bytes) 000199 1790734470.133797 punch from 0x016344 to 0x021772 (0xb42f bytes) 000200 1790734470.139452 mapwrite 0x00198e thru 0x008e1d (0x7490 bytes) 000201 1790734470.157737 mapread 0x01be31 thru 0x02495e (0x8b2e bytes) 000202 1790734470.199878 mapwrite 0x015881 thru 0x019340 (0x3ac0 bytes) 000203 1790734470.247950 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x25d3f): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25d3f): Mirror 3: 0x15641d7 (stale) Mirror 4: 0xaa7e084 (stale) Mirror 5: 0xbd343721 (stale) CRC-32 checksum value for chunk [0, 0x25d3f): Mirror 1: 0xb3c81505 Mirror 6: 0xb3c81505 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25d3f: skipped 000204 1790734471.445764 fallocate 0x0230ed thru 0x02bc5e (0x8b72 bytes) 000205 1790734471.487635 punch from 0x014dbc to 0x021d42 (0xcf87 bytes) 000206 1790734471.494588 write 0x01dcf0 thru 0x023d2f (0x6040 bytes) 000207 1790734471.508710 punch from 0x01cec2 to 0x0202cd (0x340c bytes) 000208 1790734471.528745 mapwrite 0x037bea thru 0x03ffff (0x8416 bytes) 000210 1790734471.604720 fallocate 0x013f56 thru 0x01f86c (0xb917 bytes) fallocating to largest ever: 0x40000 000212 1790734471.611570 fallocate 0x03e1b9 thru 0x03ffff (0x1e47 bytes) 000213 1790734471.616859 write 0x00bed0 thru 0x00c64d (0x77e bytes) 000214 1790734471.631848 mapread 0x01fa60 thru 0x029b06 (0xa0a7 bytes) 000215 1790734471.657942 read 0x027aa8 thru 0x03046c (0x89c5 bytes) 000217 1790734471.659817 punch from 0x0273d5 to 0x033447 (0xc073 bytes) 000218 1790734471.670653 MIRROR_RESYNC 5 mirrors 000219 1790734473.465251 mapwrite 0x03c965 thru 0x03ffff (0x369b bytes) 000220 1790734473.572934 write 0x031da5 thru 0x03eec8 (0xd124 bytes) 000221 1790734473.582074 trunc from 0x03fbfc to 0x03ffff (0x404 bytes) 000224 1790734473.587729 trunc from 0x025d8b to 0x035ba4 (0xfe1a bytes) 000225 1790734473.603345 mapwrite 0x009508 thru 0x00ee4a (0x5943 bytes) 000226 1790734473.631610 trunc from 0x016578 to 0x0258c3 (0xf34c bytes) 000228 1790734473.638206 mapwrite 0x0087c0 thru 0x017bf5 (0xf436 bytes) 000229 1790734473.670492 write 0x024d8d thru 0x033c86 (0xeefa bytes) 000230 1790734473.681700 write 0x00af5b thru 0x01336f (0x8415 bytes) 000231 1790734473.684381 mapwrite 0x0004ca thru 0x00d549 (0xd080 bytes) 000233 1790734473.712974 write 0x01c87e thru 0x021bee (0x5371 bytes) 000234 1790734473.721608 fallocate 0x031961 thru 0x0339af (0x204f bytes) 000235 1790734473.732351 read 0x03e3d1 thru 0x03ffff (0x1c2f bytes) 000236 1790734473.738719 trunc from 0x040000 to 0x00df92 (0x3206d bytes) 000237 1790734473.770508 punch from 0x004ffa to 0x00df92 (0x8f99 bytes) 000238 1790734473.787517 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xdf93): Mirror 3: 0xa2e6819 (stale) Mirror 4: 0xa2e6819 (stale) Mirror 5: 0xa2e6819 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xdf93): Mirror 3: 0xa2e6819 (stale) Mirror 4: 0xa2e6819 (stale) Mirror 5: 0xa2e6819 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xdf93: skipped 000239 1790734474.173486 MIRROR_RESYNC 4 mirrors 000241 1790734474.928456 read 0x00056e thru 0x00bc86 (0xb719 bytes) 000242 1790734474.936508 punch from 0x00a446 to 0x00df92 (0x3b4d bytes) 000243 1790734474.974419 read 0x008f7c thru 0x00b4c1 (0x2546 bytes) 000244 1790734474.990731 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xdf93): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xdf93): Mirror 3: 0x8d5fb657 (stale) Mirror 4: 0x8d5fb657 (stale) Mirror 5: 0x8d5fb657 (stale) CRC-32 checksum value for chunk [0, 0xdf93): Mirror 1: 0x8d5fb657 Mirror 6: 0x8d5fb657 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xdf93: skipped 000245 1790734475.855884 trunc from 0x00df93 to 0x029c58 (0x1bcc6 bytes) 000246 1790734475.921444 MIRROR_RESYNC 5 mirrors 000247 1790734476.848162 trunc from 0x029c59 to 0x01295e (0x172fa bytes) 000248 1790734476.880169 read 0x009334 thru 0x00e06e (0x4d3b bytes) 000249 1790734476.887971 trunc from 0x01295f to 0x01fa27 (0xd0c9 bytes) 000251 1790734476.909811 write 0x036b15 thru 0x03edc6 (0x82b2 bytes) 000252 1790734476.917211 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3edc7): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3edc7): Mirror 3: 0xc9ea504e (stale) Mirror 4: 0xc9ea504e (stale) Mirror 5: 0xc9ea504e (stale) Mirror 6: 0xc9ea504e (stale) CRC-32 checksum value for chunk [0, 0x3edc7): Mirror 1: 0xc9602d47 Mirror 7: 0xc9602d47 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3edc7: skipped 000253 1790734477.808632 mapwrite 0x02f2da thru 0x0314e0 (0x2207 bytes) 000254 1790734477.904985 trunc from 0x00729c to 0x007e3e (0xba3 bytes) 000255 1790734477.910654 fallocate 0x03b0e3 thru 0x03ffff (0x4f1d bytes) 000256 1790734477.915684 mapwrite 0x01fdfe thru 0x02aea9 (0xb0ac bytes) 000257 1790734477.949210 mapwrite 0x0269be thru 0x03070a (0x9d4d bytes) 000258 1790734477.966743 write 0x0226ed thru 0x028e3c (0x6750 bytes) 000260 1790734477.973432 mapwrite 0x0276e1 thru 0x035bf5 (0xe515 bytes) 000262 1790734477.994384 trunc from 0x03edc7 to 0x03cc10 (0x21b6 bytes) 000263 1790734478.012626 write 0x00e626 thru 0x01d4f5 (0xeed0 bytes) 000264 1790734478.018893 punch from 0x0146d3 to 0x01bdbb (0x76e9 bytes) 000265 1790734478.035491 write 0x031523 thru 0x032965 (0x1443 bytes) 000266 1790734478.036437 fallocate 0x026bf4 thru 0x028132 (0x153f bytes) 000267 1790734478.041615 read 0x039721 thru 0x03cc10 (0x34f0 bytes) 000268 1790734478.049321 mapread 0x021df3 thru 0x031a6a (0xfc78 bytes) 000269 1790734478.050700 mapwrite 0x02037e thru 0x0290fb (0x8d7e bytes) 000270 1790734478.069710 mapread 0x012c7d thru 0x01f456 (0xc7da bytes) 000271 1790734478.084531 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3cc11): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cc11): Mirror 3: 0x20871622 (stale) Mirror 4: 0x20871622 (stale) Mirror 5: 0x20871622 (stale) Mirror 6: 0x20871622 (stale) Mirror 7: 0x853bebc7 (stale) CRC-32 checksum value for chunk [0, 0x3cc11): Mirror 1: 0x84ce7f1f Mirror 8: 0x84ce7f1f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cc11: skipped 000273 1790734479.000173 trunc from 0x02f093 to 0x031e69 (0x2dd7 bytes) 000274 1790734479.081701 punch from 0x034ff9 to 0x03a2bb (0x52c3 bytes) 000275 1790734479.099418 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cc11): Mirror 4: 0x20871622 (stale) Mirror 5: 0x20871622 (stale) Mirror 6: 0x20871622 (stale) Mirror 7: 0x853bebc7 (stale) Mirror 8: 0x84ce7f1f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cc11): Mirror 4: 0x20871622 (stale) Mirror 5: 0x20871622 (stale) Mirror 6: 0x20871622 (stale) Mirror 7: 0x853bebc7 (stale) Mirror 8: 0x84ce7f1f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cc11: skipped 000276 1790734479.824545 mapwrite 0x014215 thru 0x014f1d (0xd09 bytes) 000277 1790734479.842457 write 0x02a934 thru 0x02f8b0 (0x4f7d bytes) 000278 1790734479.879264 write 0x01d6ef thru 0x02b574 (0xde86 bytes) 000279 1790734479.895606 write 0x00ced0 thru 0x00d28b (0x3bc bytes) 000281 1790734479.927095 fallocate 0x032f27 thru 0x03ec86 (0xbd60 bytes) 000282 1790734479.936567 trunc from 0x03ec87 to 0x014a96 (0x2a1f0 bytes) 000283 1790734479.999223 read 0x0017dc thru 0x0021cd (0x9f2 bytes) 000284 1790734480.011665 MIRROR_RESYNC 6 mirrors 000285 1790734481.137156 write 0x03c46f thru 0x03ffff (0x3b91 bytes) 000286 1790734481.166420 read 0x01f352 thru 0x02f295 (0xff44 bytes) 000287 1790734481.175555 fallocate 0x036a72 thru 0x03f0a6 (0x8635 bytes) 000288 1790734481.188493 mapwrite 0x032b0b thru 0x03cdc2 (0xa2b8 bytes) 000289 1790734481.228098 fallocate 0x024fca thru 0x032b04 (0xdb3b bytes) 000291 1790734481.238664 punch from 0x00e81d to 0x01d497 (0xec7b bytes) 000292 1790734481.250011 mapwrite 0x01b9c0 thru 0x02a9f4 (0xf035 bytes) 000293 1790734481.289123 write 0x028fec thru 0x02ffe2 (0x6ff7 bytes) 000294 1790734481.291517 trunc from 0x040000 to 0x024770 (0x1b88f bytes) 000295 1790734481.324545 trunc from 0x024771 to 0x020ae0 (0x3c90 bytes) 000296 1790734481.343244 trunc from 0x0067d9 to 0x0139b4 (0xd1dc bytes) 000297 1790734481.347889 trunc from 0x020ae1 to 0x031168 (0x10688 bytes) 000299 1790734481.361770 fallocate 0x018e4b thru 0x01e3ff (0x55b5 bytes) 000300 1790734481.368435 write 0x01ae41 thru 0x01bc52 (0xe12 bytes) 000302 1790734481.375467 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x31169): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31169): Mirror 4: 0x27c3a9f9 (stale) Mirror 5: 0x27c3a9f9 (stale) Mirror 6: 0x27c3a9f9 (stale) Mirror 7: 0x27c3a9f9 (stale) Mirror 8: 0x27c3a9f9 (stale) CRC-32 checksum value for chunk [0, 0x31169): Mirror 1: 0xd7952d86 Mirror 9: 0xd7952d86 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31169: skipped 000303 1790734482.277751 write 0x00d986 thru 0x010daa (0x3425 bytes) 000304 1790734482.332454 write 0x02a8dd thru 0x0335c7 (0x8ceb bytes) 000305 1790734482.341990 write 0x00ee57 thru 0x01ddfc (0xefa6 bytes) 000306 1790734482.361601 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x335c8): Mirror 4: 0x301809f3 (stale) Mirror 5: 0x301809f3 (stale) Mirror 6: 0x301809f3 (stale) Mirror 8: 0x301809f3 (stale) Mirror 9: 0x9409b8ce (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x335c8): Mirror 4: 0x301809f3 (stale) Mirror 5: 0x301809f3 (stale) Mirror 6: 0x301809f3 (stale) Mirror 8: 0x301809f3 (stale) Mirror 9: 0x9409b8ce (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x335c8: skipped 000307 1790734482.870841 punch from 0x01b67a to 0x029fb4 (0xe93b bytes) 000308 1790734482.883645 read 0x026b06 thru 0x02c9fb (0x5ef6 bytes) 000310 1790734482.902177 mapwrite 0x0336fc thru 0x03ffff (0xc904 bytes) 000311 1790734482.997185 trunc from 0x040000 to 0x01550b (0x2aaf4 bytes) 000312 1790734483.014654 trunc from 0x004d12 to 0x004e89 (0x178 bytes) 000313 1790734483.021430 mapread 0x013f18 thru 0x01550b (0x15f4 bytes) 000314 1790734483.036906 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1550c): Mirror 4: 0x8011c595 (stale) Mirror 6: 0x8011c595 (stale) Mirror 8: 0x8011c595 (stale) Mirror 9: 0x798dd229 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1550c): Mirror 4: 0x8011c595 (stale) Mirror 6: 0x8011c595 (stale) Mirror 8: 0x8011c595 (stale) Mirror 9: 0x798dd229 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1550c: skipped 000315 1790734483.510184 read 0x01339d thru 0x01550b (0x216f bytes) 000316 1790734483.520977 mapread 0x012792 thru 0x01550b (0x2d7a bytes) 000317 1790734483.529151 write 0x00ec9a thru 0x013b5c (0x4ec3 bytes) 000319 1790734483.547620 fallocate 0x032c59 thru 0x03b3a3 (0x874b bytes) 000320 1790734483.558197 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3b3a4): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b3a4): Mirror 4: 0x69cccd9f (stale) Mirror 6: 0x69cccd9f (stale) Mirror 8: 0x69cccd9f (stale) Mirror 9: 0xd8688323 (stale) CRC-32 checksum value for chunk [0, 0x3b3a4): Mirror 1: 0x59a7bf18 Mirror 10: 0x59a7bf18 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b3a4: skipped 000321 1790734485.000735 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3b3a4): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b3a4): Mirror 4: 0x69cccd9f (stale) Mirror 6: 0x69cccd9f (stale) Mirror 8: 0x69cccd9f (stale) Mirror 9: 0xd8688323 (stale) CRC-32 checksum value for chunk [0, 0x3b3a4): Mirror 1: 0x59a7bf18 Mirror 10: 0x59a7bf18 Mirror 11: 0x59a7bf18 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b3a4: skipped 000322 1790734486.011156 trunc from 0x03b3a4 to 0x01ff46 (0x1b45d bytes) 000323 1790734486.084611 read 0x002dae thru 0x01251c (0xf76f bytes) 000324 1790734486.100708 fallocate 0x0049a0 thru 0x00ba43 (0x70a4 bytes) 000325 1790734486.120845 write 0x0358b3 thru 0x0387c9 (0x2f17 bytes) 000326 1790734486.123326 trunc from 0x0387ca to 0x0377f4 (0xfd5 bytes) 000327 1790734486.160331 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x377f5): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x377f5): Mirror 4: 0x999712bd (stale) Mirror 6: 0x999712bd (stale) Mirror 8: 0x999712bd (stale) Mirror 9: 0x5b8099fe (stale) Mirror 10: 0x8d49ed2 (stale) Mirror 11: 0x8d49ed2 (stale) CRC-32 checksum value for chunk [0, 0x377f5): Mirror 1: 0x4d845c90 Mirror 12: 0x4d845c90 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x377f5: skipped 000328 1790734487.572167 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x377f5): Mirror 4: 0x999712bd (stale) Mirror 6: 0x999712bd (stale) Mirror 8: 0x999712bd (stale) Mirror 10: 0x8d49ed2 (stale) Mirror 11: 0x8d49ed2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x377f5): Mirror 4: 0x999712bd (stale) Mirror 6: 0x999712bd (stale) Mirror 8: 0x999712bd (stale) Mirror 10: 0x8d49ed2 (stale) Mirror 11: 0x8d49ed2 (stale) CRC-32 checksum value for chunk [0, 0x377f5): Mirror 1: 0x4d845c90 Mirror 12: 0x4d845c90 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x377f5: skipped 000329 1790734488.666887 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x377f5): Mirror 4: 0x999712bd (stale) Mirror 6: 0x999712bd (stale) Mirror 8: 0x999712bd (stale) Mirror 11: 0x8d49ed2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x377f5): Mirror 4: 0x999712bd (stale) Mirror 6: 0x999712bd (stale) Mirror 8: 0x999712bd (stale) Mirror 11: 0x8d49ed2 (stale) CRC-32 checksum value for chunk [0, 0x377f5): Mirror 1: 0x4d845c90 Mirror 12: 0x4d845c90 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x377f5: skipped 000330 1790734489.506757 punch from 0x017a1f to 0x01e22f (0x6811 bytes) 000331 1790734489.593071 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x377f5): Mirror 4: 0x999712bd (stale) Mirror 6: 0x999712bd (stale) Mirror 8: 0x999712bd (stale) Mirror 11: 0x8d49ed2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x377f5): Mirror 4: 0x999712bd (stale) Mirror 6: 0x999712bd (stale) Mirror 8: 0x999712bd (stale) Mirror 11: 0x8d49ed2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x377f5: skipped 000332 1790734490.080534 read 0x00588f thru 0x0084c8 (0x2c3a bytes) 000333 1790734490.093830 read 0x016e41 thru 0x022188 (0xb348 bytes) 000334 1790734490.104542 mapwrite 0x002134 thru 0x00fe24 (0xdcf1 bytes) 000335 1790734490.138649 trunc from 0x037129 to 0x0377f4 (0x6cc bytes) 000336 1790734490.145349 mapwrite 0x0305dd thru 0x030b47 (0x56b bytes) 000338 1790734490.171474 MIRROR_RESYNC 5 mirrors 000339 1790734491.124541 MIRROR_RESYNC 5 mirrors 000340 1790734491.530922 read 0x01fdd7 thru 0x02b8e6 (0xbb10 bytes) 000341 1790734491.541282 trunc from 0x0377f5 to 0x01b6eb (0x1c109 bytes) 000342 1790734491.623392 trunc from 0x01b6ec to 0x021a3a (0x634f bytes) 000343 1790734491.648004 fallocate 0x02e52e thru 0x03c71f (0xe1f2 bytes) 000344 1790734491.653555 mapwrite 0x012f1d thru 0x01bcdb (0x8dbf bytes) 000345 1790734491.706855 write 0x036a19 thru 0x03ffdb (0x95c3 bytes) 000346 1790734491.713200 fallocate 0x02179f thru 0x029872 (0x80d4 bytes) 000347 1790734491.719220 mapread 0x031f6e thru 0x0386c3 (0x6756 bytes) 000348 1790734491.728640 mapwrite 0x005042 thru 0x01043c (0xb3fb bytes) 000349 1790734491.759181 write 0x0289c0 thru 0x0362d5 (0xd916 bytes) 000351 1790734491.770277 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3ffdc): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ffdc): Mirror 4: 0xb8eec197 (stale) Mirror 6: 0xb8eec197 (stale) Mirror 8: 0xb8eec197 (stale) Mirror 11: 0xb8eec197 (stale) CRC-32 checksum value for chunk [0, 0x3ffdc): Mirror 1: 0xd3d3a6ea Mirror 12: 0xd3d3a6ea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ffdc: skipped 000354 1790734493.105361 mapread 0x03c31e thru 0x03ffdb (0x3cbe bytes) 000355 1790734493.149355 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3ffdc): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ffdc): Mirror 4: 0xb8eec197 (stale) Mirror 6: 0xb8eec197 (stale) Mirror 8: 0xb8eec197 (stale) Mirror 11: 0xb8eec197 (stale) CRC-32 checksum value for chunk [0, 0x3ffdc): Mirror 1: 0xd3d3a6ea Mirror 12: 0xd3d3a6ea Mirror 13: 0xd3d3a6ea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ffdc: skipped 000356 1790734493.958555 trunc from 0x0225a1 to 0x029948 (0x73a8 bytes) 000357 1790734494.022128 trunc from 0x03ffdc to 0x003182 (0x3ce59 bytes) 000358 1790734494.065218 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3183): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3183): Mirror 4: 0x88f2ea0 (stale) Mirror 6: 0x88f2ea0 (stale) Mirror 8: 0x88f2ea0 (stale) Mirror 11: 0x88f2ea0 (stale) Mirror 12: 0x88f2ea0 (stale) Mirror 13: 0x88f2ea0 (stale) CRC-32 checksum value for chunk [0, 0x3183): Mirror 1: 0x88f2ea0 Mirror 14: 0x88f2ea0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3183: skipped 000359 1790734495.320201 trunc from 0x001745 to 0x003182 (0x1a3e bytes) 000360 1790734495.397063 mapwrite 0x03258c thru 0x03ffff (0xda74 bytes) 000361 1790734495.544722 write 0x03724d thru 0x0388b9 (0x166d bytes) 000362 1790734495.546797 mapread 0x01aa32 thru 0x01e7a6 (0x3d75 bytes) 000363 1790734495.557315 trunc from 0x006e87 to 0x012452 (0xb5cc bytes) 000364 1790734495.563627 fallocate 0x035c6e thru 0x038e8d (0x3220 bytes) 000365 1790734495.572911 mapread 0x0053a6 thru 0x011d46 (0xc9a1 bytes) 000366 1790734495.585283 punch from 0x002c33 to 0x009eb3 (0x7281 bytes) 000367 1790734495.590132 write 0x023766 thru 0x028e97 (0x5732 bytes) 000368 1790734495.601330 trunc from 0x00bfa3 to 0x00f32a (0x3388 bytes) 000370 1790734495.608385 fallocate 0x00acef thru 0x00cb7e (0x1e90 bytes) 000371 1790734495.615538 write 0x01a71b thru 0x022d0a (0x85f0 bytes) 000372 1790734495.618339 mapwrite 0x004cb1 thru 0x01182a (0xcb7a bytes) 000373 1790734495.695875 fallocate 0x009dc7 thru 0x013295 (0x94cf bytes) 000374 1790734495.711233 trunc from 0x040000 to 0x00b1b9 (0x34e46 bytes) 000375 1790734495.740317 write 0x01ef1c thru 0x026ae2 (0x7bc7 bytes) 000376 1790734495.765117 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x26ae3): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26ae3): Mirror 4: 0xdcdcda53 (stale) Mirror 6: 0xdcdcda53 (stale) Mirror 8: 0xdcdcda53 (stale) Mirror 11: 0xdcdcda53 (stale) Mirror 12: 0xedc4b2af (stale) Mirror 13: 0xedc4b2af (stale) Mirror 14: 0xff29cd7f (stale) CRC-32 checksum value for chunk [0, 0x26ae3): Mirror 1: 0xc4328e19 Mirror 15: 0xc4328e19 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26ae3: skipped 000377 1790734496.791553 fallocate 0x009494 thru 0x0102d4 (0x6e41 bytes) 000378 1790734496.833269 fallocate 0x023d42 thru 0x028d86 (0x5045 bytes) 000380 1790734496.839161 read 0x006ea1 thru 0x016782 (0xf8e2 bytes) 000381 1790734496.853693 punch from 0x00a432 to 0x00ccdd (0x28ac bytes) 000383 1790734496.859113 read 0x0106ba thru 0x01c132 (0xba79 bytes) 000384 1790734496.874760 trunc from 0x028d87 to 0x00ba6a (0x1d31c bytes) 000385 1790734496.896162 mapread 0x004644 thru 0x00ba6a (0x7427 bytes) 000386 1790734496.898067 trunc from 0x00187d to 0x00ba6a (0xa1ee bytes) 000387 1790734496.903494 mapread 0x006d57 thru 0x00ba6a (0x4d14 bytes) 000388 1790734496.927526 read 0x0038a5 thru 0x00902b (0x5787 bytes) 000391 1790734496.935773 mapwrite 0x003da5 thru 0x00dd8b (0x9fe7 bytes) 000392 1790734496.973495 read 0x0008dc thru 0x00c4d8 (0xbbfd bytes) 000393 1790734496.978845 MIRROR_RESYNC 9 mirrors 000394 1790734498.285817 fallocate 0x0356c4 thru 0x03ffff (0xa93c bytes) 000395 1790734498.333240 mapread 0x005875 thru 0x00dd8b (0x8517 bytes) 000396 1790734498.354680 mapwrite 0x027bb3 thru 0x0364e8 (0xe936 bytes) 000397 1790734498.409669 trunc from 0x0364e9 to 0x006be5 (0x2f903 bytes) 000398 1790734498.427120 mapread 0x000daa thru 0x006be5 (0x5e3c bytes) 000399 1790734498.442760 MIRROR_RESYNC 9 mirrors 000400 1790734499.822244 mapread 0x0005ec thru 0x004352 (0x3d67 bytes) 000401 1790734499.846344 mapwrite 0x03de17 thru 0x03ffff (0x21e9 bytes) 000402 1790734499.908014 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe3e57927 (stale) Mirror 6: 0xe3e57927 (stale) Mirror 8: 0xe3e57927 (stale) Mirror 11: 0xe3e57927 (stale) Mirror 12: 0xe3e57927 (stale) Mirror 13: 0xe3e57927 (stale) Mirror 14: 0xe3e57927 (stale) Mirror 15: 0xe3e57927 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x41b377d0 Mirror 16: 0x41b377d0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000403 1790734500.715128 mapwrite 0x031dd8 thru 0x03cee3 (0xb10c bytes) 000404 1790734500.845662 read 0x03f1f1 thru 0x03ffff (0xe0f bytes) 000406 1790734500.847757 trunc from 0x040000 to 0x02f30c (0x10cf3 bytes) 000407 1790734500.884897 write 0x00c303 thru 0x00ca2f (0x72d bytes) 000409 1790734500.896788 fallocate 0x039660 thru 0x03c76f (0x3110 bytes) 000410 1790734500.909406 MIRROR_RESYNC 10 mirrors 000411 1790734503.058646 mapwrite 0x03ae35 thru 0x03ffff (0x51cb bytes) 000412 1790734503.216940 punch from 0x035fd2 to 0x03d04b (0x707a bytes) 000413 1790734503.255480 mapread 0x035a94 thru 0x03b120 (0x568d bytes) 000414 1790734503.279630 mapwrite 0x02716f thru 0x0299ab (0x283d bytes) 000415 1790734503.338774 mapread 0x00da3b thru 0x017b52 (0xa118 bytes) 000416 1790734503.395313 trunc from 0x040000 to 0x033f28 (0xc0d7 bytes) 000417 1790734503.423770 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33f29): Mirror 4: 0xa3ec52a (stale) Mirror 6: 0xa3ec52a (stale) Mirror 8: 0xa3ec52a (stale) Mirror 11: 0xa3ec52a (stale) Mirror 12: 0xa3ec52a (stale) Mirror 14: 0xa3ec52a (stale) Mirror 15: 0xa3ec52a (stale) Mirror 16: 0xa3ec52a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33f29): Mirror 4: 0xa3ec52a (stale) Mirror 6: 0xa3ec52a (stale) Mirror 8: 0xa3ec52a (stale) Mirror 11: 0xa3ec52a (stale) Mirror 12: 0xa3ec52a (stale) Mirror 14: 0xa3ec52a (stale) Mirror 15: 0xa3ec52a (stale) Mirror 16: 0xa3ec52a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33f29: skipped 000418 1790734503.993083 trunc from 0x033f29 to 0x03011a (0x3e0e bytes) 000419 1790734504.011479 trunc from 0x03011b to 0x0183a4 (0x17d76 bytes) 000420 1790734504.032240 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x183a5): Mirror 4: 0x64a966e1 (stale) Mirror 6: 0x64a966e1 (stale) Mirror 11: 0x64a966e1 (stale) Mirror 12: 0x64a966e1 (stale) Mirror 14: 0x64a966e1 (stale) Mirror 15: 0x64a966e1 (stale) Mirror 16: 0x64a966e1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x183a5): Mirror 4: 0x64a966e1 (stale) Mirror 6: 0x64a966e1 (stale) Mirror 11: 0x64a966e1 (stale) Mirror 12: 0x64a966e1 (stale) Mirror 14: 0x64a966e1 (stale) Mirror 15: 0x64a966e1 (stale) Mirror 16: 0x64a966e1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x183a5: skipped 000421 1790734504.458405 punch from 0x004147 to 0x00b523 (0x73dd bytes) 000422 1790734504.486495 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x183a5): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x183a5): Mirror 4: 0x64a966e1 (stale) Mirror 6: 0x64a966e1 (stale) Mirror 11: 0x64a966e1 (stale) Mirror 12: 0x64a966e1 (stale) Mirror 14: 0x64a966e1 (stale) Mirror 15: 0x64a966e1 (stale) Mirror 16: 0x64a966e1 (stale) CRC-32 checksum value for chunk [0, 0x183a5): Mirror 1: 0x8f7b5268 Mirror 17: 0x8f7b5268 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x183a5: skipped 000425 1790734505.514178 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x183a5): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x183a5): Mirror 4: 0x64a966e1 (stale) Mirror 6: 0x64a966e1 (stale) Mirror 11: 0x64a966e1 (stale) Mirror 12: 0x64a966e1 (stale) Mirror 14: 0x64a966e1 (stale) Mirror 15: 0x64a966e1 (stale) Mirror 16: 0x64a966e1 (stale) CRC-32 checksum value for chunk [0, 0x183a5): Mirror 1: 0x8f7b5268 Mirror 17: 0x8f7b5268 Mirror 18: 0x8f7b5268 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x183a5: skipped 000426 1790734506.508817 mapread 0x004af2 thru 0x00b0bf (0x65ce bytes) 000427 1790734506.527566 read 0x0132c6 thru 0x01500f (0x1d4a bytes) 000428 1790734506.543599 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x183a5): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x183a5): Mirror 4: 0x64a966e1 (stale) Mirror 6: 0x64a966e1 (stale) Mirror 11: 0x64a966e1 (stale) Mirror 12: 0x64a966e1 (stale) Mirror 14: 0x64a966e1 (stale) Mirror 15: 0x64a966e1 (stale) Mirror 16: 0x64a966e1 (stale) CRC-32 checksum value for chunk [0, 0x183a5): Mirror 1: 0x8f7b5268 Mirror 17: 0x8f7b5268 Mirror 18: 0x8f7b5268 Mirror 19: 0x8f7b5268 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x183a5: skipped 000429 1790734507.808673 punch from 0x002125 to 0x00e48d (0xc369 bytes) 000430 1790734507.891773 mapwrite 0x01ec0b thru 0x02dc06 (0xeffc bytes) 000431 1790734508.001656 mapwrite 0x0012dc thru 0x002f57 (0x1c7c bytes) 000432 1790734508.037157 MIRROR_RESYNC 11 mirrors 000433 1790734509.684766 punch from 0x010e30 to 0x01541a (0x45eb bytes) 000434 1790734509.743986 MIRROR_RESYNC 11 mirrors 000435 1790734511.108010 trunc from 0x025e43 to 0x02dc06 (0x7dc4 bytes) 000437 1790734511.139233 write 0x014ea6 thru 0x020e09 (0xbf64 bytes) 000438 1790734511.149923 trunc from 0x02c77e to 0x02dc06 (0x1489 bytes) 000439 1790734511.154578 mapread 0x01695c thru 0x01d3fe (0x6aa3 bytes) 000440 1790734511.155847 fallocate 0x02d178 thru 0x02dc03 (0xa8c bytes) 000441 1790734511.160324 punch from 0x00a8f3 to 0x00b56f (0xc7d bytes) 000442 1790734511.164353 trunc from 0x02b4d6 to 0x02dc06 (0x2731 bytes) 000443 1790734511.168451 trunc from 0x0281ab to 0x02dc06 (0x5a5c bytes) 000444 1790734511.172758 trunc from 0x02dc07 to 0x0384d1 (0xa8cb bytes) 000445 1790734511.187463 read 0x01f75e thru 0x02a818 (0xb0bb bytes) 000446 1790734511.194368 mapread 0x00bd12 thru 0x010647 (0x4936 bytes) 000447 1790734511.212622 mapwrite 0x03e3ac thru 0x03ffff (0x1c54 bytes) 000448 1790734511.256741 write 0x008d4e thru 0x00cc78 (0x3f2b bytes) 000449 1790734511.258079 punch from 0x01e87f to 0x026c58 (0x83da bytes) 000450 1790734511.264206 fallocate 0x019b36 thru 0x023e0f (0xa2da bytes) 000451 1790734511.269113 mapwrite 0x003e3c thru 0x00e42a (0xa5ef bytes) 000452 1790734511.296592 trunc from 0x040000 to 0x004cf4 (0x3b30b bytes) 000453 1790734511.318063 punch from 0x001cfb to 0x004cf4 (0x2ffa bytes) 000454 1790734511.323981 punch from 0x0018f0 to 0x004cf4 (0x3405 bytes) 000456 1790734511.331773 read 0x000fbc thru 0x004cf4 (0x3d39 bytes) 000457 1790734511.342832 punch from 0x0034df to 0x004cf4 (0x1816 bytes) 000458 1790734511.347746 punch from 0x0048e8 to 0x004cf4 (0x40d bytes) 000459 1790734511.352797 punch from 0x003e94 to 0x004cf4 (0xe61 bytes) 000460 1790734511.357280 punch from 0x002f81 to 0x004cf4 (0x1d74 bytes) 000461 1790734511.361929 fallocate 0x010714 thru 0x011df9 (0x16e6 bytes) 000462 1790734511.366087 fallocate 0x00a635 thru 0x00a800 (0x1cc bytes) 000463 1790734511.370718 mapread 0x0050d9 thru 0x00a531 (0x5459 bytes) 000464 1790734511.378608 write 0x014d01 thru 0x021789 (0xca89 bytes) 000466 1790734511.381619 read 0x00b6f2 thru 0x00fe54 (0x4763 bytes) 000467 1790734511.382569 read 0x00c930 thru 0x019701 (0xcdd2 bytes) 000468 1790734511.390115 fallocate 0x014352 thru 0x019088 (0x4d37 bytes) 000469 1790734511.394525 mapwrite 0x023d60 thru 0x02ea77 (0xad18 bytes) 000470 1790734511.434113 write 0x01edb6 thru 0x023225 (0x4470 bytes) 000471 1790734511.437664 write 0x01a6c0 thru 0x022797 (0x80d8 bytes) 000473 1790734511.439990 fallocate 0x02f3ac thru 0x03640f (0x7064 bytes) 000474 1790734511.448679 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x36410): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36410): Mirror 4: 0x8fc7b0f6 (stale) Mirror 6: 0x8fc7b0f6 (stale) Mirror 11: 0x8fc7b0f6 (stale) Mirror 12: 0x8fc7b0f6 (stale) Mirror 14: 0x8fc7b0f6 (stale) Mirror 15: 0x8fc7b0f6 (stale) Mirror 16: 0x8fc7b0f6 (stale) Mirror 17: 0x8fc7b0f6 (stale) Mirror 18: 0x8fc7b0f6 (stale) Mirror 19: 0x8fc7b0f6 (stale) CRC-32 checksum value for chunk [0, 0x36410): Mirror 1: 0xcd085921 Mirror 20: 0xcd085921 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36410: skipped 000475 1790734512.567841 read 0x02738d thru 0x0309dd (0x9651 bytes) 000476 1790734512.594993 mapwrite 0x008624 thru 0x009631 (0x100e bytes) 000477 1790734512.783975 trunc from 0x016862 to 0x023fd7 (0xd776 bytes) 000478 1790734512.790589 punch from 0x027c2d to 0x03103c (0x9410 bytes) 000479 1790734512.797909 trunc from 0x02f013 to 0x03640f (0x73fd bytes) 000480 1790734512.805958 punch from 0x00188b to 0x0026d7 (0xe4d bytes) 000481 1790734512.813004 trunc from 0x0319cc to 0x032ac5 (0x10fa bytes) 000482 1790734512.827691 MIRROR_RESYNC 12 mirrors 000484 1790734516.765833 MIRROR_RESYNC 12 mirrors 000486 1790734517.828774 read 0x00b4e4 thru 0x01a38d (0xeeaa bytes) 000487 1790734517.855727 MIRROR_RESYNC 12 mirrors 000488 1790734518.616648 MIRROR_EXTEND to 13 mirrors 000489 1790734519.755180 write 0x009eb5 thru 0x018062 (0xe1ae bytes) 000490 1790734519.837983 mapread 0x01731d thru 0x0241cc (0xceb0 bytes) 000491 1790734519.880915 MIRROR_SPLIT mirror 7 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36410): Mirror 4: 0xba2e3eb4 (stale) Mirror 6: 0xba2e3eb4 (stale) Mirror 11: 0xba2e3eb4 (stale) Mirror 12: 0xba2e3eb4 (stale) Mirror 14: 0xba2e3eb4 (stale) Mirror 15: 0xba2e3eb4 (stale) Mirror 17: 0xba2e3eb4 (stale) Mirror 18: 0xba2e3eb4 (stale) Mirror 19: 0xba2e3eb4 (stale) Mirror 20: 0xba2e3eb4 (stale) Mirror 21: 0xba2e3eb4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36410): Mirror 4: 0xba2e3eb4 (stale) Mirror 6: 0xba2e3eb4 (stale) Mirror 11: 0xba2e3eb4 (stale) Mirror 12: 0xba2e3eb4 (stale) Mirror 14: 0xba2e3eb4 (stale) Mirror 15: 0xba2e3eb4 (stale) Mirror 17: 0xba2e3eb4 (stale) Mirror 18: 0xba2e3eb4 (stale) Mirror 19: 0xba2e3eb4 (stale) Mirror 20: 0xba2e3eb4 (stale) Mirror 21: 0xba2e3eb4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36410: skipped 000492 1790734520.630957 read 0x009fcd thru 0x00bee4 (0x1f18 bytes) 000493 1790734520.640948 trunc from 0x01c0e6 to 0x025c6b (0x9b86 bytes) 000494 1790734520.647686 mapwrite 0x01ec84 thru 0x02ca8f (0xde0c bytes) 000496 1790734520.704985 write 0x03e2d0 thru 0x03ffff (0x1d30 bytes) 000497 1790734520.715862 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x784ef82a (stale) Mirror 6: 0x784ef82a (stale) Mirror 11: 0x784ef82a (stale) Mirror 12: 0x784ef82a (stale) Mirror 14: 0x784ef82a (stale) Mirror 15: 0x784ef82a (stale) Mirror 17: 0x784ef82a (stale) Mirror 18: 0x784ef82a (stale) Mirror 19: 0x784ef82a (stale) Mirror 20: 0x784ef82a (stale) Mirror 21: 0x784ef82a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x17d02a2e Mirror 22: 0x17d02a2e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000498 1790734522.061624 read 0x03d8f1 thru 0x03ecab (0x13bb bytes) 000499 1790734522.073883 read 0x01780c thru 0x01f0b8 (0x78ad bytes) 000500 1790734522.092828 mapread 0x034e09 thru 0x03ffff (0xb1f7 bytes) 000501 1790734522.109737 fallocate 0x011b78 thru 0x0151d1 (0x365a bytes) 000502 1790734522.171671 trunc from 0x040000 to 0x012011 (0x2dfee bytes) 000503 1790734522.193134 mapwrite 0x01f88f thru 0x02016c (0x8de bytes) 000504 1790734522.226633 fallocate 0x02a409 thru 0x03130f (0x6f07 bytes) 000505 1790734522.233499 mapwrite 0x021eed thru 0x02a665 (0x8779 bytes) 000506 1790734522.363925 mapwrite 0x03f68e thru 0x03ffff (0x972 bytes) 000507 1790734522.407972 write 0x02141d thru 0x03094e (0xf532 bytes) 000508 1790734522.416097 mapread 0x030c72 thru 0x03557d (0x490c bytes) 000509 1790734522.440829 trunc from 0x03a36f to 0x03ffff (0x5c91 bytes) 000510 1790734522.445954 fallocate 0x0348d5 thru 0x03ffff (0xb72b bytes) 000511 1790734522.450909 mapwrite 0x0038ae thru 0x006e44 (0x3597 bytes) 000512 1790734522.488088 mapread 0x02d7a4 thru 0x03409e (0x68fb bytes) 000513 1790734522.494032 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x784ef82a (stale) Mirror 6: 0x784ef82a (stale) Mirror 11: 0x784ef82a (stale) Mirror 12: 0x784ef82a (stale) Mirror 14: 0x784ef82a (stale) Mirror 15: 0x784ef82a (stale) Mirror 17: 0x784ef82a (stale) Mirror 18: 0x784ef82a (stale) Mirror 19: 0x784ef82a (stale) Mirror 20: 0x784ef82a (stale) Mirror 21: 0x784ef82a (stale) Mirror 22: 0x17d02a2e (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb67eab03 Mirror 23: 0xb67eab03 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000514 1790734523.683273 trunc from 0x034829 to 0x03ffff (0xb7d7 bytes) 000515 1790734523.766949 MIRROR_SPLIT mirror 3 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x784ef82a (stale) Mirror 6: 0x784ef82a (stale) Mirror 12: 0x784ef82a (stale) Mirror 14: 0x784ef82a (stale) Mirror 15: 0x784ef82a (stale) Mirror 17: 0x784ef82a (stale) Mirror 18: 0x784ef82a (stale) Mirror 19: 0x784ef82a (stale) Mirror 20: 0x784ef82a (stale) Mirror 21: 0x784ef82a (stale) Mirror 22: 0x17d02a2e (stale) Mirror 23: 0xb67eab03 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x784ef82a (stale) Mirror 6: 0x784ef82a (stale) Mirror 12: 0x784ef82a (stale) Mirror 14: 0x784ef82a (stale) Mirror 15: 0x784ef82a (stale) Mirror 17: 0x784ef82a (stale) Mirror 18: 0x784ef82a (stale) Mirror 19: 0x784ef82a (stale) Mirror 20: 0x784ef82a (stale) Mirror 21: 0x784ef82a (stale) Mirror 22: 0x17d02a2e (stale) Mirror 23: 0xb67eab03 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000516 1790734524.573925 mapread 0x03b3b7 thru 0x03ffff (0x4c49 bytes) 000518 1790734524.601493 write 0x006b5e thru 0x0131a3 (0xc646 bytes) 000519 1790734524.618836 write 0x0357d3 thru 0x03a928 (0x5156 bytes) 000520 1790734524.625485 mapread 0x025ace thru 0x02a03a (0x456d bytes) 000522 1790734524.635369 trunc from 0x03f43d to 0x03fe8b (0xa4f bytes) 000523 1790734524.639582 mapwrite 0x02cb77 thru 0x02da7a (0xf04 bytes) 000524 1790734524.675411 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x784ef82a (stale) Mirror 12: 0x784ef82a (stale) Mirror 14: 0x784ef82a (stale) Mirror 15: 0x784ef82a (stale) Mirror 17: 0x784ef82a (stale) Mirror 18: 0x784ef82a (stale) Mirror 19: 0x784ef82a (stale) Mirror 20: 0x784ef82a (stale) Mirror 21: 0x784ef82a (stale) Mirror 22: 0x17d02a2e (stale) Mirror 23: 0xb67eab03 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x784ef82a (stale) Mirror 12: 0x784ef82a (stale) Mirror 14: 0x784ef82a (stale) Mirror 15: 0x784ef82a (stale) Mirror 17: 0x784ef82a (stale) Mirror 18: 0x784ef82a (stale) Mirror 19: 0x784ef82a (stale) Mirror 20: 0x784ef82a (stale) Mirror 21: 0x784ef82a (stale) Mirror 22: 0x17d02a2e (stale) Mirror 23: 0xb67eab03 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000525 1790734525.343626 write 0x00b976 thru 0x017edc (0xc567 bytes) 000527 1790734525.367429 trunc from 0x040000 to 0x02a2d9 (0x15d26 bytes) 000528 1790734525.422886 mapwrite 0x039128 thru 0x03bb3b (0x2a14 bytes) 000529 1790734525.499731 trunc from 0x03bb3c to 0x001b43 (0x39ff8 bytes) 000530 1790734525.524732 trunc from 0x001b44 to 0x02faae (0x2df6b bytes) 000531 1790734525.551233 punch from 0x009430 to 0x01508e (0xbc5f bytes) 000532 1790734525.559092 trunc from 0x017f88 to 0x01d467 (0x54e0 bytes) 000534 1790734525.570836 mapread 0x017659 thru 0x018801 (0x11a9 bytes) 000535 1790734525.597713 mapwrite 0x03dcaf thru 0x03e035 (0x387 bytes) 000536 1790734525.648798 punch from 0x02fbf9 to 0x034c17 (0x501f bytes) 000537 1790734525.656578 trunc from 0x03e036 to 0x00d715 (0x30920 bytes) 000538 1790734525.686790 trunc from 0x00d716 to 0x012d73 (0x565e bytes) 000539 1790734525.712513 read 0x007603 thru 0x00f061 (0x7a5f bytes) 000540 1790734525.728710 mapwrite 0x033106 thru 0x0367f7 (0x36f2 bytes) 000541 1790734525.798684 trunc from 0x0367f8 to 0x03e957 (0x8160 bytes) 000542 1790734525.825983 mapwrite 0x02ef1a thru 0x02f74f (0x836 bytes) 000543 1790734525.846894 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3e958): Mirror 6: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e958): Mirror 6: 0x9b7d6561 (stale) Mirror 12: 0x9b7d6561 (stale) Mirror 14: 0x9b7d6561 (stale) Mirror 15: 0x9b7d6561 (stale) Mirror 17: 0x9b7d6561 (stale) Mirror 18: 0x9b7d6561 (stale) Mirror 19: 0x9b7d6561 (stale) Mirror 20: 0x9b7d6561 (stale) Mirror 21: 0x9b7d6561 (stale) Mirror 22: 0x1d88671a (stale) Mirror 23: 0x3cba2f7c (stale) CRC-32 checksum value for chunk [0, 0x3e958): Mirror 1: 0xe1dbb3f5 Mirror 24: 0xe1dbb3f5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e958: skipped 000544 1790734527.018865 mapread 0x02741b thru 0x0327a4 (0xb38a bytes) 000546 1790734527.071095 mapwrite 0x0017ef thru 0x00219d (0x9af bytes) 000547 1790734527.197963 MIRROR_SPLIT mirror 4 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e958): Mirror 6: 0x9b7d6561 (stale) Mirror 12: 0x9b7d6561 (stale) Mirror 14: 0x9b7d6561 (stale) Mirror 17: 0x9b7d6561 (stale) Mirror 18: 0x9b7d6561 (stale) Mirror 19: 0x9b7d6561 (stale) Mirror 20: 0x9b7d6561 (stale) Mirror 21: 0x9b7d6561 (stale) Mirror 22: 0x1d88671a (stale) Mirror 23: 0x3cba2f7c (stale) Mirror 24: 0xe1dbb3f5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e958): Mirror 6: 0x9b7d6561 (stale) Mirror 12: 0x9b7d6561 (stale) Mirror 14: 0x9b7d6561 (stale) Mirror 17: 0x9b7d6561 (stale) Mirror 18: 0x9b7d6561 (stale) Mirror 19: 0x9b7d6561 (stale) Mirror 20: 0x9b7d6561 (stale) Mirror 21: 0x9b7d6561 (stale) Mirror 22: 0x1d88671a (stale) Mirror 23: 0x3cba2f7c (stale) Mirror 24: 0xe1dbb3f5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e958: skipped 000548 1790734527.900812 trunc from 0x03e958 to 0x033562 (0xb3f5 bytes) 000550 1790734527.926831 trunc from 0x033563 to 0x003c30 (0x2f932 bytes) 000551 1790734527.944928 fallocate 0x02ebfd thru 0x03a3f3 (0xb7f7 bytes) 000552 1790734527.951095 mapwrite 0x03c73a thru 0x03ffff (0x38c6 bytes) 000553 1790734528.003359 write 0x03e990 thru 0x03ffff (0x1670 bytes) 000554 1790734528.009864 MIRROR_SPLIT mirror 9 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x784ef82a (stale) Mirror 12: 0x784ef82a (stale) Mirror 14: 0x784ef82a (stale) Mirror 17: 0x784ef82a (stale) Mirror 18: 0x784ef82a (stale) Mirror 19: 0x784ef82a (stale) Mirror 20: 0x784ef82a (stale) Mirror 21: 0x784ef82a (stale) Mirror 23: 0xb67eab03 (stale) Mirror 24: 0xe059f0ee (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x784ef82a (stale) Mirror 12: 0x784ef82a (stale) Mirror 14: 0x784ef82a (stale) Mirror 17: 0x784ef82a (stale) Mirror 18: 0x784ef82a (stale) Mirror 19: 0x784ef82a (stale) Mirror 20: 0x784ef82a (stale) Mirror 21: 0x784ef82a (stale) Mirror 23: 0xb67eab03 (stale) Mirror 24: 0xe059f0ee (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000556 1790734528.594759 mapwrite 0x009752 thru 0x010ecf (0x777e bytes) 000557 1790734528.636470 trunc from 0x006f66 to 0x0115fb (0xa696 bytes) 000558 1790734528.651590 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x784ef82a (stale) Mirror 14: 0x784ef82a (stale) Mirror 17: 0x784ef82a (stale) Mirror 18: 0x784ef82a (stale) Mirror 19: 0x784ef82a (stale) Mirror 20: 0x784ef82a (stale) Mirror 21: 0x784ef82a (stale) Mirror 23: 0xb67eab03 (stale) Mirror 24: 0xe059f0ee (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x784ef82a (stale) Mirror 14: 0x784ef82a (stale) Mirror 17: 0x784ef82a (stale) Mirror 18: 0x784ef82a (stale) Mirror 19: 0x784ef82a (stale) Mirror 20: 0x784ef82a (stale) Mirror 21: 0x784ef82a (stale) Mirror 23: 0xb67eab03 (stale) Mirror 24: 0xe059f0ee (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000559 1790734529.184117 trunc from 0x040000 to 0x002c48 (0x3d3b7 bytes) 000561 1790734529.210209 MIRROR_RESYNC 10 mirrors 000562 1790734530.181931 punch from 0x000005 to 0x000009 (0x5 bytes) 000563 1790734530.229727 trunc from 0x000a27 to 0x002c48 (0x2222 bytes) 000564 1790734530.236447 trunc from 0x001726 to 0x002c48 (0x1523 bytes) 000566 1790734530.243422 write 0x014129 thru 0x01720a (0x30e2 bytes) 000567 1790734530.245818 read 0x0064d0 thru 0x008d3c (0x286d bytes) 000569 1790734530.252971 trunc from 0x01720b to 0x01ac95 (0x3a8b bytes) 000570 1790734530.280462 fallocate 0x038403 thru 0x03a473 (0x2071 bytes) 000571 1790734530.288801 fallocate 0x01d7f2 thru 0x022990 (0x519f bytes) 000572 1790734530.295858 punch from 0x0009a1 to 0x006733 (0x5d93 bytes) 000573 1790734530.301687 write 0x024dfc thru 0x026494 (0x1699 bytes) 000574 1790734530.311813 trunc from 0x03a474 to 0x01c28c (0x1e1e7 bytes) 000575 1790734530.330390 trunc from 0x01c28d to 0x021ca4 (0x5a18 bytes) 000576 1790734530.353534 trunc from 0x021ca5 to 0x03aaa7 (0x18e03 bytes) 000577 1790734530.374428 mapread 0x038c6e thru 0x03aaa7 (0x1e3a bytes) 000579 1790734530.394712 read 0x001320 thru 0x0077c1 (0x64a2 bytes) 000580 1790734530.412857 read 0x039ec2 thru 0x03aaa7 (0xbe6 bytes) 000581 1790734530.413770 mapwrite 0x039370 thru 0x03ffff (0x6c90 bytes) 000582 1790734530.458677 mapwrite 0x000063 thru 0x000d13 (0xcb1 bytes) 000583 1790734530.471436 mapread 0x01eec3 thru 0x02c23d (0xd37b bytes) 000584 1790734530.474962 mapread 0x02f27b thru 0x03a6ab (0xb431 bytes) 000586 1790734530.480698 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xa23bbbfa (stale) Mirror 14: 0xa23bbbfa (stale) Mirror 17: 0xa23bbbfa (stale) Mirror 18: 0xa23bbbfa (stale) Mirror 19: 0xa23bbbfa (stale) Mirror 20: 0xa23bbbfa (stale) Mirror 21: 0xa23bbbfa (stale) Mirror 23: 0xa23bbbfa (stale) Mirror 24: 0xa23bbbfa (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf48c92d3 Mirror 25: 0xf48c92d3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000587 1790734531.450320 MIRROR_RESYNC 11 mirrors 000588 1790734533.298385 trunc from 0x040000 to 0x00f6d9 (0x30926 bytes) 000589 1790734533.360227 mapread 0x004811 thru 0x008710 (0x3f00 bytes) 000590 1790734533.374825 punch from 0x00dcbc to 0x00e0b4 (0x3f9 bytes) 000591 1790734533.379357 read 0x004c24 thru 0x0053e5 (0x7c2 bytes) 000592 1790734533.384191 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0xf6da): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf6da): Mirror 12: 0xac2ff956 (stale) Mirror 14: 0xac2ff956 (stale) Mirror 17: 0xac2ff956 (stale) Mirror 18: 0xac2ff956 (stale) Mirror 19: 0xac2ff956 (stale) Mirror 20: 0xac2ff956 (stale) Mirror 21: 0xac2ff956 (stale) Mirror 23: 0xac2ff956 (stale) Mirror 24: 0xac2ff956 (stale) Mirror 25: 0xac2ff956 (stale) CRC-32 checksum value for chunk [0, 0xf6da): Mirror 1: 0xac2ff956 Mirror 26: 0xac2ff956 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf6da: skipped 000593 1790734534.243201 fallocate 0x005746 thru 0x0117cb (0xc086 bytes) 000594 1790734534.300557 fallocate 0x03f9cf thru 0x03ffff (0x631 bytes) 000595 1790734534.306283 mapwrite 0x02a917 thru 0x02dd37 (0x3421 bytes) 000596 1790734534.335288 fallocate 0x02ebc3 thru 0x03596b (0x6da9 bytes) 000597 1790734534.345015 mapread 0x022129 thru 0x031021 (0xeef9 bytes) 000600 1790734534.355465 trunc from 0x040000 to 0x0100ff (0x2ff00 bytes) 000601 1790734534.397930 mapread 0x00c0dd thru 0x0100ff (0x4023 bytes) 000603 1790734534.407937 mapread 0x002ea2 thru 0x0100ff (0xd25e bytes) 000604 1790734534.419884 mapwrite 0x005b3a thru 0x0124ff (0xc9c6 bytes) 000605 1790734534.472615 fallocate 0x00481b thru 0x00700a (0x27f0 bytes) 000606 1790734534.479577 punch from 0x00b6bf to 0x0124ff (0x6e41 bytes) 000607 1790734534.485151 mapwrite 0x012b0d thru 0x01df52 (0xb446 bytes) 000608 1790734534.534594 read 0x005e41 thru 0x01472b (0xe8eb bytes) 000609 1790734534.535653 mapwrite 0x01dbb5 thru 0x02664d (0x8a99 bytes) 000610 1790734534.577795 trunc from 0x0029c7 to 0x008718 (0x5d52 bytes) 000611 1790734534.584622 trunc from 0x00f7ae to 0x011ace (0x2321 bytes) 000612 1790734534.590940 trunc from 0x02664e to 0x0399ac (0x1335f bytes) 000613 1790734534.602539 trunc from 0x0399ad to 0x001217 (0x38795 bytes) 000614 1790734534.615599 trunc from 0x000b1e to 0x001217 (0x6fa bytes) 000615 1790734534.621617 write 0x025c33 thru 0x02dd46 (0x8114 bytes) 000617 1790734534.624601 write 0x0339bd thru 0x03ffff (0xc643 bytes) 000618 1790734534.627702 mapread 0x037a5c thru 0x038b3a (0x10df bytes) 000619 1790734534.628529 mapread 0x021f06 thru 0x0231f8 (0x12f3 bytes) 000620 1790734534.635514 mapwrite 0x035b92 thru 0x0368c8 (0xd37 bytes) 000621 1790734534.650361 trunc from 0x01a87e to 0x029bf1 (0xf374 bytes) 000622 1790734534.656809 mapwrite 0x029ebb thru 0x02c38e (0x24d4 bytes) 000623 1790734534.687529 trunc from 0x040000 to 0x03b4d0 (0x4b2f bytes) 000624 1790734534.705883 fallocate 0x02e126 thru 0x03246d (0x4348 bytes) 000625 1790734534.712368 mapread 0x012cc7 thru 0x015621 (0x295b bytes) 000626 1790734534.724502 trunc from 0x03b4d1 to 0x031169 (0xa367 bytes) 000627 1790734534.741689 fallocate 0x02b4da thru 0x03078d (0x52b4 bytes) 000628 1790734534.746704 punch from 0x00f946 to 0x01c3a0 (0xca5b bytes) 000629 1790734534.750968 punch from 0x012e3a to 0x01362d (0x7f4 bytes) 000630 1790734534.755114 trunc from 0x03116a to 0x022116 (0xf053 bytes) 000631 1790734534.770439 write 0x014e41 thru 0x020eb4 (0xc074 bytes) 000632 1790734534.788078 MIRROR_SPLIT mirror 3 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22117): Mirror 12: 0x46c518d4 (stale) Mirror 14: 0x46c518d4 (stale) Mirror 18: 0x46c518d4 (stale) Mirror 19: 0x46c518d4 (stale) Mirror 20: 0x46c518d4 (stale) Mirror 21: 0x46c518d4 (stale) Mirror 23: 0x46c518d4 (stale) Mirror 24: 0x46c518d4 (stale) Mirror 25: 0x46c518d4 (stale) Mirror 26: 0x74440e03 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22117): Mirror 12: 0x46c518d4 (stale) Mirror 14: 0x46c518d4 (stale) Mirror 18: 0x46c518d4 (stale) Mirror 19: 0x46c518d4 (stale) Mirror 20: 0x46c518d4 (stale) Mirror 21: 0x46c518d4 (stale) Mirror 23: 0x46c518d4 (stale) Mirror 24: 0x46c518d4 (stale) Mirror 25: 0x46c518d4 (stale) Mirror 26: 0x74440e03 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22117: skipped 000633 1790734535.479194 MIRROR_SPLIT mirror 2 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22117): Mirror 12: 0x46c518d4 (stale) Mirror 18: 0x46c518d4 (stale) Mirror 19: 0x46c518d4 (stale) Mirror 20: 0x46c518d4 (stale) Mirror 21: 0x46c518d4 (stale) Mirror 23: 0x46c518d4 (stale) Mirror 24: 0x46c518d4 (stale) Mirror 25: 0x46c518d4 (stale) Mirror 26: 0x74440e03 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22117): Mirror 12: 0x46c518d4 (stale) Mirror 18: 0x46c518d4 (stale) Mirror 19: 0x46c518d4 (stale) Mirror 20: 0x46c518d4 (stale) Mirror 21: 0x46c518d4 (stale) Mirror 23: 0x46c518d4 (stale) Mirror 24: 0x46c518d4 (stale) Mirror 25: 0x46c518d4 (stale) Mirror 26: 0x74440e03 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22117: skipped 000635 1790734536.008301 punch from 0x008c77 to 0x0109c0 (0x7d4a bytes) 000636 1790734536.023614 MIRROR_RESYNC 10 mirrors 000637 1790734537.931105 trunc from 0x0129ad to 0x0182d3 (0x5927 bytes) 000638 1790734537.978534 mapwrite 0x039abf thru 0x03ffff (0x6541 bytes) 000639 1790734538.050132 mapread 0x036119 thru 0x03f897 (0x977f bytes) 000640 1790734538.052126 read 0x03419a thru 0x03ffff (0xbe66 bytes) 000641 1790734538.052771 write 0x017136 thru 0x025181 (0xe04c bytes) 000642 1790734538.065583 read 0x028864 thru 0x0367c0 (0xdf5d bytes) 000643 1790734538.095550 punch from 0x00c23c to 0x01b37a (0xf13f bytes) 000645 1790734538.117176 punch from 0x004274 to 0x00f6c3 (0xb450 bytes) 000646 1790734538.121586 punch from 0x02d157 to 0x032a13 (0x58bd bytes) 000647 1790734538.125261 fallocate 0x037dae thru 0x03ffff (0x8252 bytes) 000648 1790734538.129750 read 0x01abfb thru 0x020f18 (0x631e bytes) 000649 1790734538.149319 fallocate 0x032dfa thru 0x03f5b4 (0xc7bb bytes) 000650 1790734538.155698 write 0x033b3c thru 0x03ffff (0xc4c4 bytes) 000651 1790734538.159824 punch from 0x001aee to 0x00e3bc (0xc8cf bytes) 000652 1790734538.165929 punch from 0x0377b5 to 0x03ffff (0x884b bytes) 000654 1790734538.196742 mapread 0x03d0b2 thru 0x03ffff (0x2f4e bytes) 000655 1790734538.211989 mapread 0x000709 thru 0x0025d8 (0x1ed0 bytes) 000656 1790734538.228727 mapwrite 0x01172f thru 0x01cb06 (0xb3d8 bytes) 000657 1790734538.274385 trunc from 0x03b4cf to 0x03e7fc (0x332e bytes) 000658 1790734538.288223 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0x723c55d3 (stale) Mirror 18: 0x723c55d3 (stale) Mirror 19: 0x723c55d3 (stale) Mirror 20: 0x723c55d3 (stale) Mirror 21: 0x723c55d3 (stale) Mirror 23: 0x723c55d3 (stale) Mirror 24: 0x723c55d3 (stale) Mirror 25: 0x723c55d3 (stale) Mirror 26: 0x723c55d3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7bd15666 Mirror 27: 0x7bd15666 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000659 1790734539.390748 punch from 0x01a64f to 0x024f56 (0xa908 bytes) 000660 1790734539.447067 trunc from 0x040000 to 0x02d84e (0x127b1 bytes) 000661 1790734539.504503 fallocate 0x0075ed thru 0x014650 (0xd064 bytes) 000663 1790734539.511570 punch from 0x00af3b to 0x01732d (0xc3f3 bytes) 000664 1790734539.516960 fallocate 0x00bcb5 thru 0x014be1 (0x8f2d bytes) 000665 1790734539.522628 trunc from 0x023ca0 to 0x02d84e (0x9baf bytes) 000666 1790734539.527981 punch from 0x00afb2 to 0x00cb91 (0x1be0 bytes) 000667 1790734539.536655 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2d84f): Mirror 18: 0x1508ea95 (stale) Mirror 19: 0x1508ea95 (stale) Mirror 20: 0x1508ea95 (stale) Mirror 21: 0x1508ea95 (stale) Mirror 23: 0x1508ea95 (stale) Mirror 24: 0x1508ea95 (stale) Mirror 25: 0x1508ea95 (stale) Mirror 26: 0x1508ea95 (stale) Mirror 27: 0x580136e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2d84f): Mirror 18: 0x1508ea95 (stale) Mirror 19: 0x1508ea95 (stale) Mirror 20: 0x1508ea95 (stale) Mirror 21: 0x1508ea95 (stale) Mirror 23: 0x1508ea95 (stale) Mirror 24: 0x1508ea95 (stale) Mirror 25: 0x1508ea95 (stale) Mirror 26: 0x1508ea95 (stale) Mirror 27: 0x580136e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2d84f: skipped 000668 1790734539.997939 trunc from 0x002217 to 0x004513 (0x22fd bytes) 000669 1790734540.008258 read 0x023681 thru 0x026171 (0x2af1 bytes) 000670 1790734540.023016 write 0x002a72 thru 0x00fcbc (0xd24b bytes) 000671 1790734540.060500 punch from 0x00cb24 to 0x018244 (0xb721 bytes) 000672 1790734540.080992 MIRROR_RESYNC 10 mirrors 000673 1790734542.503720 MIRROR_EXTEND to 11 mirrors 000674 1790734543.386907 fallocate 0x020b0a thru 0x02b251 (0xa748 bytes) 000675 1790734543.429460 write 0x031b36 thru 0x038928 (0x6df3 bytes) 000676 1790734543.443116 write 0x01460e thru 0x01cefe (0x88f1 bytes) 000677 1790734543.463369 punch from 0x00ffd2 to 0x01ea8d (0xeabc bytes) 000678 1790734543.502706 mapwrite 0x031912 thru 0x03f9d1 (0xe0c0 bytes) 000679 1790734543.647596 write 0x029dda thru 0x02fb38 (0x5d5f bytes) 000680 1790734543.672396 mapread 0x0167f9 thru 0x02675a (0xff62 bytes) 000681 1790734543.705210 trunc from 0x03f9d2 to 0x03dafe (0x1ed3 bytes) 000683 1790734543.739721 trunc from 0x03daff to 0x02f264 (0xe89a bytes) 000684 1790734543.773916 mapwrite 0x0164bb thru 0x016de0 (0x926 bytes) 000685 1790734543.865302 trunc from 0x02f265 to 0x02085d (0xea07 bytes) 000686 1790734543.952289 fallocate 0x02f5ef thru 0x03ac61 (0xb673 bytes) 000687 1790734543.969330 read 0x02893d thru 0x036a60 (0xe124 bytes) 000688 1790734543.989363 write 0x03882a thru 0x038835 (0xc bytes) 000690 1790734544.009018 trunc from 0x03ac62 to 0x014e73 (0x25dee bytes) 000691 1790734544.052357 punch from 0x00d870 to 0x014e73 (0x7604 bytes) 000692 1790734544.061525 read 0x0028c2 thru 0x008d7c (0x64bb bytes) 000694 1790734544.084031 trunc from 0x005530 to 0x011b6b (0xc63c bytes) 000695 1790734544.110223 MIRROR_RESYNC 11 mirrors 000696 1790734546.125434 mapread 0x00b6f8 thru 0x00d47f (0x1d88 bytes) 000697 1790734546.178540 fallocate 0x023160 thru 0x025170 (0x2011 bytes) 000698 1790734546.220462 punch from 0x0211f4 to 0x025170 (0x3f7d bytes) 000700 1790734546.225889 mapwrite 0x00f66a thru 0x01c2b4 (0xcc4b bytes) 000701 1790734546.318016 fallocate 0x03239b thru 0x0330c3 (0xd29 bytes) 000702 1790734546.348112 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x330c4): Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x330c4): Mirror 18: 0x65c4b4af (stale) Mirror 19: 0x65c4b4af (stale) Mirror 20: 0x65c4b4af (stale) Mirror 21: 0x65c4b4af (stale) Mirror 23: 0x65c4b4af (stale) Mirror 24: 0x65c4b4af (stale) Mirror 25: 0x65c4b4af (stale) Mirror 26: 0x65c4b4af (stale) Mirror 27: 0x65c4b4af (stale) Mirror 28: 0x65c4b4af (stale) CRC-32 checksum value for chunk [0, 0x330c4): Mirror 1: 0xab8b52db Mirror 29: 0xab8b52db lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x330c4: skipped 000703 1790734547.698547 mapwrite 0x02d671 thru 0x02e68f (0x101f bytes) 000704 1790734547.866414 trunc from 0x01fbca to 0x027fdd (0x8414 bytes) 000706 1790734547.874350 mapwrite 0x03c81b thru 0x03ffff (0x37e5 bytes) 000707 1790734548.017207 write 0x00b365 thru 0x018f3f (0xdbdb bytes) 000708 1790734548.039489 fallocate 0x03604f thru 0x0362ac (0x25e bytes) 000709 1790734548.064519 read 0x0300a1 thru 0x03cc72 (0xcbd2 bytes) 000710 1790734548.094763 punch from 0x01aa58 to 0x020adc (0x6085 bytes) 000711 1790734548.111931 trunc from 0x040000 to 0x01a21a (0x25de5 bytes) 000713 1790734548.165486 trunc from 0x003f6e to 0x004cb0 (0xd43 bytes) 000714 1790734548.202014 MIRROR_SPLIT mirror 2 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1a21b): Mirror 18: 0x7c225c99 (stale) Mirror 20: 0x7c225c99 (stale) Mirror 21: 0x7c225c99 (stale) Mirror 23: 0x7c225c99 (stale) Mirror 24: 0x7c225c99 (stale) Mirror 25: 0x7c225c99 (stale) Mirror 26: 0x7c225c99 (stale) Mirror 27: 0x7c225c99 (stale) Mirror 28: 0x7c225c99 (stale) Mirror 29: 0x116f77c8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a21b): Mirror 18: 0x7c225c99 (stale) Mirror 20: 0x7c225c99 (stale) Mirror 21: 0x7c225c99 (stale) Mirror 23: 0x7c225c99 (stale) Mirror 24: 0x7c225c99 (stale) Mirror 25: 0x7c225c99 (stale) Mirror 26: 0x7c225c99 (stale) Mirror 27: 0x7c225c99 (stale) Mirror 28: 0x7c225c99 (stale) Mirror 29: 0x116f77c8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a21b: skipped 000715 1790734548.783162 trunc from 0x000d1f to 0x00289f (0x1b81 bytes) 000716 1790734548.788953 mapwrite 0x011008 thru 0x01f462 (0xe45b bytes) 000717 1790734548.854709 punch from 0x019391 to 0x01f462 (0x60d2 bytes) 000718 1790734548.860840 trunc from 0x01f463 to 0x00c141 (0x13321 bytes) 000719 1790734548.880315 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0xc142): Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc142): Mirror 18: 0xe2ef8316 (stale) Mirror 20: 0xe2ef8316 (stale) Mirror 21: 0xe2ef8316 (stale) Mirror 23: 0xe2ef8316 (stale) Mirror 24: 0xe2ef8316 (stale) Mirror 25: 0xe2ef8316 (stale) Mirror 26: 0xe2ef8316 (stale) Mirror 27: 0xe2ef8316 (stale) Mirror 28: 0xe2ef8316 (stale) Mirror 29: 0xe2ef8316 (stale) CRC-32 checksum value for chunk [0, 0xc142): Mirror 1: 0xbbcf9338 Mirror 30: 0xbbcf9338 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc142: skipped 000720 1790734550.025678 write 0x00df1d thru 0x01abfb (0xccdf bytes) 000721 1790734550.105867 write 0x034a4c thru 0x03cb47 (0x80fc bytes) 000722 1790734550.116106 fallocate 0x008311 thru 0x013b59 (0xb849 bytes) 000723 1790734550.127597 mapread 0x01a6d6 thru 0x024843 (0xa16e bytes) 000724 1790734550.214141 MIRROR_SPLIT mirror 3 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cb48): Mirror 18: 0x61d8a443 (stale) Mirror 20: 0x61d8a443 (stale) Mirror 23: 0x61d8a443 (stale) Mirror 24: 0x61d8a443 (stale) Mirror 25: 0x61d8a443 (stale) Mirror 26: 0x61d8a443 (stale) Mirror 27: 0x61d8a443 (stale) Mirror 28: 0x61d8a443 (stale) Mirror 29: 0x2a737d01 (stale) Mirror 30: 0xfa8bc81e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cb48): Mirror 18: 0x61d8a443 (stale) Mirror 20: 0x61d8a443 (stale) Mirror 23: 0x61d8a443 (stale) Mirror 24: 0x61d8a443 (stale) Mirror 25: 0x61d8a443 (stale) Mirror 26: 0x61d8a443 (stale) Mirror 27: 0x61d8a443 (stale) Mirror 28: 0x61d8a443 (stale) Mirror 29: 0x2a737d01 (stale) Mirror 30: 0xfa8bc81e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cb48: skipped 000725 1790734551.066631 punch from 0x035a46 to 0x03cb47 (0x7102 bytes) 000726 1790734551.088488 write 0x0038d5 thru 0x00cebc (0x95e8 bytes) 000727 1790734551.116782 read 0x026c8e thru 0x029762 (0x2ad5 bytes) 000728 1790734551.124822 read 0x019444 thru 0x01ff6d (0x6b2a bytes) 000729 1790734551.137835 trunc from 0x03cb48 to 0x03528d (0x78ba bytes) 000730 1790734551.158598 fallocate 0x01e401 thru 0x02c6e1 (0xe2e1 bytes) 000731 1790734551.167557 read 0x00c6c4 thru 0x01b1d9 (0xeb16 bytes) 000733 1790734551.174102 read 0x02e0a3 thru 0x03528d (0x71eb bytes) 000734 1790734551.176148 trunc from 0x03528e to 0x01f498 (0x15df5 bytes) 000735 1790734551.208189 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x1f499): Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f499): Mirror 18: 0xe1ea47d9 (stale) Mirror 20: 0xe1ea47d9 (stale) Mirror 23: 0xe1ea47d9 (stale) Mirror 24: 0xe1ea47d9 (stale) Mirror 25: 0xe1ea47d9 (stale) Mirror 26: 0xe1ea47d9 (stale) Mirror 27: 0xe1ea47d9 (stale) Mirror 28: 0xe1ea47d9 (stale) Mirror 29: 0xf813a0f7 (stale) Mirror 30: 0x76f1321b (stale) CRC-32 checksum value for chunk [0, 0x1f499): Mirror 1: 0x8d70b192 Mirror 31: 0x8d70b192 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f499: skipped 000736 1790734552.144909 fallocate 0x017d90 thru 0x023db9 (0xc02a bytes) 000737 1790734552.220349 mapwrite 0x00a914 thru 0x017a5f (0xd14c bytes) 000740 1790734552.295922 MIRROR_RESYNC 12 mirrors 000741 1790734555.214317 fallocate 0x02b57b thru 0x0376c7 (0xc14d bytes) 000742 1790734555.252407 mapwrite 0x03a3b5 thru 0x03de6b (0x3ab7 bytes) 000743 1790734555.342779 punch from 0x01f667 to 0x01fd86 (0x720 bytes) 000744 1790734555.348474 read 0x02cb91 thru 0x035429 (0x8899 bytes) 000745 1790734555.360437 mapread 0x00c2c5 thru 0x017803 (0xb53f bytes) 000746 1790734555.382002 trunc from 0x03de6c to 0x02c37d (0x11aee bytes) 000747 1790734555.404410 trunc from 0x00fb56 to 0x019ae6 (0x9f91 bytes) 000748 1790734555.411976 fallocate 0x02075d thru 0x028523 (0x7dc7 bytes) 000749 1790734555.424778 mapread 0x01d6e8 thru 0x02b473 (0xdd8c bytes) 000750 1790734555.450540 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x2c37e): Mirror 18: (stale - read error) Mirror 20: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c37e): Mirror 18: 0x5d35e9d0 (stale) Mirror 20: 0x5d35e9d0 (stale) Mirror 23: 0x5d35e9d0 (stale) Mirror 24: 0x5d35e9d0 (stale) Mirror 25: 0x5d35e9d0 (stale) Mirror 26: 0x5d35e9d0 (stale) Mirror 27: 0x5d35e9d0 (stale) Mirror 28: 0x5d35e9d0 (stale) Mirror 29: 0x5d35e9d0 (stale) Mirror 30: 0x5d35e9d0 (stale) Mirror 31: 0x5d35e9d0 (stale) CRC-32 checksum value for chunk [0, 0x2c37e): Mirror 1: 0x2241523 Mirror 32: 0x2241523 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c37e: skipped 000751 1790734556.898680 trunc from 0x02c37e to 0x030143 (0x3dc6 bytes) 000752 1790734556.965885 write 0x032056 thru 0x03d198 (0xb143 bytes) 000753 1790734556.967372 mapread 0x019ff3 thru 0x027c99 (0xdca7 bytes) 000754 1790734556.998974 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d199): Mirror 20: 0xef8737c0 (stale) Mirror 23: 0xef8737c0 (stale) Mirror 24: 0xef8737c0 (stale) Mirror 25: 0xef8737c0 (stale) Mirror 26: 0xef8737c0 (stale) Mirror 27: 0xef8737c0 (stale) Mirror 28: 0xef8737c0 (stale) Mirror 29: 0xef8737c0 (stale) Mirror 30: 0xef8737c0 (stale) Mirror 31: 0xef8737c0 (stale) Mirror 32: 0x59c66ada (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d199): Mirror 20: 0xef8737c0 (stale) Mirror 23: 0xef8737c0 (stale) Mirror 24: 0xef8737c0 (stale) Mirror 25: 0xef8737c0 (stale) Mirror 26: 0xef8737c0 (stale) Mirror 27: 0xef8737c0 (stale) Mirror 28: 0xef8737c0 (stale) Mirror 29: 0xef8737c0 (stale) Mirror 30: 0xef8737c0 (stale) Mirror 31: 0xef8737c0 (stale) Mirror 32: 0x59c66ada (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d199: skipped 000755 1790734557.666999 fallocate 0x02cc17 thru 0x02ddb2 (0x119c bytes) 000756 1790734557.673678 punch from 0x00bbbb to 0x00e34e (0x2794 bytes) 000757 1790734557.689685 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d199): Mirror 23: 0xef8737c0 (stale) Mirror 24: 0xef8737c0 (stale) Mirror 25: 0xef8737c0 (stale) Mirror 26: 0xef8737c0 (stale) Mirror 27: 0xef8737c0 (stale) Mirror 28: 0xef8737c0 (stale) Mirror 29: 0xef8737c0 (stale) Mirror 30: 0xef8737c0 (stale) Mirror 31: 0xef8737c0 (stale) Mirror 32: 0x59c66ada (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d199): Mirror 23: 0xef8737c0 (stale) Mirror 24: 0xef8737c0 (stale) Mirror 25: 0xef8737c0 (stale) Mirror 26: 0xef8737c0 (stale) Mirror 27: 0xef8737c0 (stale) Mirror 28: 0xef8737c0 (stale) Mirror 29: 0xef8737c0 (stale) Mirror 30: 0xef8737c0 (stale) Mirror 31: 0xef8737c0 (stale) Mirror 32: 0x59c66ada (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d199: skipped 000758 1790734558.203320 trunc from 0x03d199 to 0x0316f1 (0xbaa7 bytes) 000759 1790734558.223790 mapread 0x0304d7 thru 0x0316f1 (0x121b bytes) 000760 1790734558.238011 mapwrite 0x005b0d thru 0x00cb5d (0x7051 bytes) 000761 1790734558.266883 write 0x03952b thru 0x03969c (0x172 bytes) 000762 1790734558.272729 MIRROR_RESYNC 11 mirrors 000763 1790734561.682239 MIRROR_RESYNC 11 mirrors 000764 1790734562.549902 MIRROR_EXTEND to 12 mirrors 000765 1790734563.444531 read 0x02f71d thru 0x034fdb (0x58bf bytes) 000766 1790734563.466159 punch from 0x01ab8e to 0x027d60 (0xd1d3 bytes) 000767 1790734563.524798 mapread 0x01d2de thru 0x023515 (0x6238 bytes) 000768 1790734563.555856 punch from 0x006f62 to 0x00fa9c (0x8b3b bytes) 000769 1790734563.567169 MIRROR_SPLIT mirror 5 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3969d): Mirror 23: 0x2ce08e07 (stale) Mirror 24: 0x2ce08e07 (stale) Mirror 25: 0x2ce08e07 (stale) Mirror 26: 0x2ce08e07 (stale) Mirror 28: 0x2ce08e07 (stale) Mirror 29: 0x2ce08e07 (stale) Mirror 30: 0x2ce08e07 (stale) Mirror 31: 0x2ce08e07 (stale) Mirror 32: 0x2ce08e07 (stale) Mirror 33: 0x2ce08e07 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3969d): Mirror 23: 0x2ce08e07 (stale) Mirror 24: 0x2ce08e07 (stale) Mirror 25: 0x2ce08e07 (stale) Mirror 26: 0x2ce08e07 (stale) Mirror 28: 0x2ce08e07 (stale) Mirror 29: 0x2ce08e07 (stale) Mirror 30: 0x2ce08e07 (stale) Mirror 31: 0x2ce08e07 (stale) Mirror 32: 0x2ce08e07 (stale) Mirror 33: 0x2ce08e07 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3969d: skipped 000770 1790734564.198888 trunc from 0x03969d to 0x01ae8e (0x1e80e bytes) 000771 1790734564.227855 read 0x014b2b thru 0x01ae8e (0x6364 bytes) 000772 1790734564.242878 MIRROR_SPLIT mirror 10 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ae8f): Mirror 23: 0x68dd80dd (stale) Mirror 24: 0x68dd80dd (stale) Mirror 25: 0x68dd80dd (stale) Mirror 26: 0x68dd80dd (stale) Mirror 28: 0x68dd80dd (stale) Mirror 29: 0x68dd80dd (stale) Mirror 30: 0x68dd80dd (stale) Mirror 31: 0x68dd80dd (stale) Mirror 32: 0x68dd80dd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ae8f): Mirror 23: 0x68dd80dd (stale) Mirror 24: 0x68dd80dd (stale) Mirror 25: 0x68dd80dd (stale) Mirror 26: 0x68dd80dd (stale) Mirror 28: 0x68dd80dd (stale) Mirror 29: 0x68dd80dd (stale) Mirror 30: 0x68dd80dd (stale) Mirror 31: 0x68dd80dd (stale) Mirror 32: 0x68dd80dd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ae8f: skipped 000773 1790734565.142415 trunc from 0x01ae8f to 0x00d8fe (0xd590 bytes) 000774 1790734565.166856 read 0x008af9 thru 0x00ccbf (0x41c7 bytes) 000775 1790734565.179139 mapread 0x0079d6 thru 0x00c779 (0x4da4 bytes) 000776 1790734565.185757 trunc from 0x00d8ff to 0x0373a7 (0x29aa9 bytes) 000777 1790734565.209151 trunc from 0x0162df to 0x01ee67 (0x8b89 bytes) 000778 1790734565.219086 mapwrite 0x03c63a thru 0x03ffff (0x39c6 bytes) 000779 1790734565.309705 trunc from 0x02c9ad to 0x03c452 (0xfaa6 bytes) 000780 1790734565.334657 mapread 0x037369 thru 0x03ffff (0x8c97 bytes) 000781 1790734565.348605 trunc from 0x00e58d to 0x01b61b (0xd08f bytes) 000783 1790734565.357236 trunc from 0x01b5f5 to 0x02ab66 (0xf572 bytes) 000784 1790734565.369621 trunc from 0x040000 to 0x020862 (0x1f79d bytes) 000785 1790734565.400666 mapwrite 0x024f48 thru 0x0255e4 (0x69d bytes) 000786 1790734565.498897 write 0x030750 thru 0x036a91 (0x6342 bytes) 000787 1790734565.506195 mapread 0x01c0f7 thru 0x024188 (0x8092 bytes) 000788 1790734565.525766 write 0x0298ee thru 0x02d48a (0x3b9d bytes) 000789 1790734565.538681 write 0x01a8de thru 0x0292c4 (0xe9e7 bytes) 000790 1790734565.544742 mapread 0x013955 thru 0x023330 (0xf9dc bytes) 000791 1790734565.560935 fallocate 0x028cbb thru 0x031977 (0x8cbd bytes) 000792 1790734565.567967 trunc from 0x036a92 to 0x01fa3f (0x17052 bytes) 000793 1790734565.582583 mapwrite 0x0149da thru 0x021178 (0xc79f bytes) 000794 1790734565.688154 punch from 0x0193c0 to 0x021178 (0x7db9 bytes) 000795 1790734565.709918 punch from 0x014196 to 0x021178 (0xcfe3 bytes) 000796 1790734565.728701 punch from 0x001d91 to 0x00210a (0x37a bytes) 000798 1790734565.743506 mapread 0x00a0bd thru 0x0135c4 (0x9508 bytes) 000799 1790734565.768374 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x21179): Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21179): Mirror 23: 0x648630f0 (stale) Mirror 24: 0x648630f0 (stale) Mirror 25: 0x648630f0 (stale) Mirror 26: 0x648630f0 (stale) Mirror 28: 0x648630f0 (stale) Mirror 29: 0x648630f0 (stale) Mirror 30: 0x648630f0 (stale) Mirror 31: 0x648630f0 (stale) Mirror 32: 0x648630f0 (stale) CRC-32 checksum value for chunk [0, 0x21179): Mirror 1: 0xbab67a00 Mirror 33: 0xbab67a00 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21179: skipped 000800 1790734566.935317 fallocate 0x00e7f4 thru 0x01b72d (0xcf3a bytes) 000801 1790734567.005078 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x21179): Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21179): Mirror 23: 0x648630f0 (stale) Mirror 24: 0x648630f0 (stale) Mirror 25: 0x648630f0 (stale) Mirror 26: 0x648630f0 (stale) Mirror 28: 0x648630f0 (stale) Mirror 29: 0x648630f0 (stale) Mirror 30: 0x648630f0 (stale) Mirror 31: 0x648630f0 (stale) Mirror 32: 0x648630f0 (stale) Mirror 33: 0xbab67a00 (stale) CRC-32 checksum value for chunk [0, 0x21179): Mirror 1: 0xbab67a00 Mirror 34: 0xbab67a00 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21179: skipped 000802 1790734568.406887 mapwrite 0x03fba8 thru 0x03ffff (0x458 bytes) 000803 1790734568.561968 fallocate 0x000213 thru 0x008013 (0x7e01 bytes) 000804 1790734568.595689 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0xa6d96f50 (stale) Mirror 24: 0xa6d96f50 (stale) Mirror 25: 0xa6d96f50 (stale) Mirror 26: 0xa6d96f50 (stale) Mirror 28: 0xa6d96f50 (stale) Mirror 29: 0xa6d96f50 (stale) Mirror 30: 0xa6d96f50 (stale) Mirror 31: 0xa6d96f50 (stale) Mirror 32: 0xa6d96f50 (stale) Mirror 33: 0x19bb2a38 (stale) Mirror 34: 0x19bb2a38 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe722db2a Mirror 35: 0xe722db2a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000805 1790734570.085926 fallocate 0x002732 thru 0x012132 (0xfa01 bytes) 000806 1790734570.134194 trunc from 0x01e544 to 0x021532 (0x2fef bytes) 000807 1790734570.139674 punch from 0x03997e to 0x03ffff (0x6682 bytes) 000808 1790734570.145922 write 0x029f66 thru 0x0328fc (0x8997 bytes) 000809 1790734570.161987 trunc from 0x02d3fe to 0x03307d (0x5c80 bytes) 000810 1790734570.182332 mapwrite 0x032d28 thru 0x03ffff (0xd2d8 bytes) 000811 1790734570.234575 write 0x02a292 thru 0x034aba (0xa829 bytes) 000812 1790734570.242945 MIRROR_SPLIT mirror 2 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0xa6d96f50 (stale) Mirror 25: 0xa6d96f50 (stale) Mirror 26: 0xa6d96f50 (stale) Mirror 28: 0xa6d96f50 (stale) Mirror 29: 0xa6d96f50 (stale) Mirror 30: 0xa6d96f50 (stale) Mirror 31: 0xa6d96f50 (stale) Mirror 32: 0xa6d96f50 (stale) Mirror 33: 0x19bb2a38 (stale) Mirror 34: 0x19bb2a38 (stale) Mirror 35: 0xe722db2a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0xa6d96f50 (stale) Mirror 25: 0xa6d96f50 (stale) Mirror 26: 0xa6d96f50 (stale) Mirror 28: 0xa6d96f50 (stale) Mirror 29: 0xa6d96f50 (stale) Mirror 30: 0xa6d96f50 (stale) Mirror 31: 0xa6d96f50 (stale) Mirror 32: 0xa6d96f50 (stale) Mirror 33: 0x19bb2a38 (stale) Mirror 34: 0x19bb2a38 (stale) Mirror 35: 0xe722db2a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000813 1790734570.915944 mapread 0x0158d5 thru 0x017eb3 (0x25df bytes) 000814 1790734570.935186 trunc from 0x040000 to 0x016d5e (0x292a1 bytes) 000815 1790734570.954671 read 0x00a668 thru 0x014636 (0x9fcf bytes) 000816 1790734570.963253 punch from 0x010d57 to 0x016d5e (0x6008 bytes) 000817 1790734570.970662 trunc from 0x011328 to 0x016d5e (0x5a37 bytes) 000818 1790734570.974914 punch from 0x00b3da to 0x01123d (0x5e64 bytes) 000819 1790734570.979991 fallocate 0x018fff thru 0x01bf20 (0x2f22 bytes) 000820 1790734570.984307 trunc from 0x001741 to 0x00609b (0x495b bytes) 000821 1790734570.990420 read 0x00a4b6 thru 0x011c5f (0x77aa bytes) 000822 1790734571.006848 trunc from 0x01bf21 to 0x03f2e5 (0x233c5 bytes) 000824 1790734571.030457 mapwrite 0x038d74 thru 0x03ffff (0x728c bytes) 000825 1790734571.073367 fallocate 0x02c1f7 thru 0x0313c9 (0x51d3 bytes) 000826 1790734571.085733 MIRROR_SPLIT mirror 6 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0xa6d96f50 (stale) Mirror 25: 0xa6d96f50 (stale) Mirror 26: 0xa6d96f50 (stale) Mirror 28: 0xa6d96f50 (stale) Mirror 29: 0xa6d96f50 (stale) Mirror 31: 0xa6d96f50 (stale) Mirror 32: 0xa6d96f50 (stale) Mirror 33: 0x19bb2a38 (stale) Mirror 34: 0x19bb2a38 (stale) Mirror 35: 0xe722db2a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0xa6d96f50 (stale) Mirror 25: 0xa6d96f50 (stale) Mirror 26: 0xa6d96f50 (stale) Mirror 28: 0xa6d96f50 (stale) Mirror 29: 0xa6d96f50 (stale) Mirror 31: 0xa6d96f50 (stale) Mirror 32: 0xa6d96f50 (stale) Mirror 33: 0x19bb2a38 (stale) Mirror 34: 0x19bb2a38 (stale) Mirror 35: 0xe722db2a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000827 1790734571.719229 MIRROR_SPLIT mirror 4 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0xa6d96f50 (stale) Mirror 25: 0xa6d96f50 (stale) Mirror 26: 0xa6d96f50 (stale) Mirror 29: 0xa6d96f50 (stale) Mirror 31: 0xa6d96f50 (stale) Mirror 32: 0xa6d96f50 (stale) Mirror 33: 0x19bb2a38 (stale) Mirror 34: 0x19bb2a38 (stale) Mirror 35: 0xe722db2a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0xa6d96f50 (stale) Mirror 25: 0xa6d96f50 (stale) Mirror 26: 0xa6d96f50 (stale) Mirror 29: 0xa6d96f50 (stale) Mirror 31: 0xa6d96f50 (stale) Mirror 32: 0xa6d96f50 (stale) Mirror 33: 0x19bb2a38 (stale) Mirror 34: 0x19bb2a38 (stale) Mirror 35: 0xe722db2a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000828 1790734572.236325 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0xa6d96f50 (stale) Mirror 25: 0xa6d96f50 (stale) Mirror 26: 0xa6d96f50 (stale) Mirror 29: 0xa6d96f50 (stale) Mirror 31: 0xa6d96f50 (stale) Mirror 32: 0xa6d96f50 (stale) Mirror 33: 0x19bb2a38 (stale) Mirror 34: 0x19bb2a38 (stale) Mirror 35: 0xe722db2a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7e6d2639 Mirror 36: 0x7e6d2639 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000829 1790734573.383315 write 0x018a51 thru 0x022447 (0x99f7 bytes) 000830 1790734573.497227 fallocate 0x00fcad thru 0x0133d8 (0x372c bytes) 000831 1790734573.516268 punch from 0x01428b to 0x01c6f1 (0x8467 bytes) 000833 1790734573.554543 mapread 0x03ca77 thru 0x03ffff (0x3589 bytes) 000834 1790734573.600904 trunc from 0x03cea4 to 0x03ffff (0x315c bytes) 000835 1790734573.615921 read 0x00d0c6 thru 0x018203 (0xb13e bytes) 000836 1790734573.658876 MIRROR_SPLIT mirror 10 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0xa6d96f50 (stale) Mirror 25: 0xa6d96f50 (stale) Mirror 26: 0xa6d96f50 (stale) Mirror 29: 0xa6d96f50 (stale) Mirror 31: 0xa6d96f50 (stale) Mirror 32: 0xa6d96f50 (stale) Mirror 33: 0x19bb2a38 (stale) Mirror 34: 0x19bb2a38 (stale) Mirror 35: 0xe722db2a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0xa6d96f50 (stale) Mirror 25: 0xa6d96f50 (stale) Mirror 26: 0xa6d96f50 (stale) Mirror 29: 0xa6d96f50 (stale) Mirror 31: 0xa6d96f50 (stale) Mirror 32: 0xa6d96f50 (stale) Mirror 33: 0x19bb2a38 (stale) Mirror 34: 0x19bb2a38 (stale) Mirror 35: 0xe722db2a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000837 1790734574.514549 mapread 0x0170da thru 0x02584d (0xe774 bytes) 000838 1790734574.561725 punch from 0x0036e4 to 0x010e10 (0xd72d bytes) 000839 1790734574.567470 mapread 0x020ba8 thru 0x0238d2 (0x2d2b bytes) 000840 1790734574.572499 trunc from 0x01dc26 to 0x02ba12 (0xdded bytes) 000841 1790734574.581881 write 0x03a102 thru 0x03ffff (0x5efe bytes) 000842 1790734574.598663 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0xa6d96f50 (stale) Mirror 25: 0xa6d96f50 (stale) Mirror 26: 0xa6d96f50 (stale) Mirror 29: 0xa6d96f50 (stale) Mirror 31: 0xa6d96f50 (stale) Mirror 32: 0xa6d96f50 (stale) Mirror 33: 0x19bb2a38 (stale) Mirror 34: 0x19bb2a38 (stale) Mirror 35: 0xe722db2a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdac847e3 Mirror 36: 0xdac847e3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000843 1790734576.054849 punch from 0x0036e4 to 0x00be42 (0x875f bytes) 000846 1790734576.183952 read 0x00b6d8 thru 0x016e34 (0xb75d bytes) 000847 1790734576.210066 mapread 0x02ae3c thru 0x02c031 (0x11f6 bytes) 000848 1790734576.272984 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0xa6d96f50 (stale) Mirror 25: 0xa6d96f50 (stale) Mirror 26: 0xa6d96f50 (stale) Mirror 29: 0xa6d96f50 (stale) Mirror 31: 0xa6d96f50 (stale) Mirror 32: 0xa6d96f50 (stale) Mirror 33: 0x19bb2a38 (stale) Mirror 34: 0x19bb2a38 (stale) Mirror 35: 0xe722db2a (stale) Mirror 36: 0xdac847e3 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdac847e3 Mirror 37: 0xdac847e3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000849 1790734578.006127 fallocate 0x02b84d thru 0x02c9a5 (0x1159 bytes) 000850 1790734578.079529 read 0x01a525 thru 0x020d54 (0x6830 bytes) 000851 1790734578.098664 read 0x037740 thru 0x03c016 (0x48d7 bytes) 000852 1790734578.134320 read 0x001363 thru 0x00a0a8 (0x8d46 bytes) 000853 1790734578.135925 trunc from 0x040000 to 0x034833 (0xb7cc bytes) 000854 1790734578.200779 trunc from 0x034834 to 0x035e34 (0x1601 bytes) 000855 1790734578.262396 mapwrite 0x02d070 thru 0x02f5ac (0x253d bytes) 000856 1790734578.278010 read 0x01c2cf thru 0x0275c3 (0xb2f5 bytes) 000857 1790734578.280904 punch from 0x029bde to 0x035e34 (0xc257 bytes) 000858 1790734578.303988 mapwrite 0x03d1e1 thru 0x03ffff (0x2e1f bytes) 000859 1790734578.408766 write 0x013d77 thru 0x022d06 (0xef90 bytes) 000860 1790734578.413952 trunc from 0x03873c to 0x03ffff (0x78c4 bytes) 000861 1790734578.444976 mapread 0x019c47 thru 0x01ab36 (0xef0 bytes) 000862 1790734578.449626 trunc from 0x040000 to 0x00d6a7 (0x32958 bytes) 000864 1790734578.504353 read 0x0004ae thru 0x0020e9 (0x1c3c bytes) 000865 1790734578.506835 trunc from 0x00473f to 0x00aa5f (0x6321 bytes) 000866 1790734578.517393 fallocate 0x008a0d thru 0x0112f3 (0x88e7 bytes) 000867 1790734578.523522 trunc from 0x00f057 to 0x0112f3 (0x229d bytes) 000868 1790734578.553800 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x112f4): Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x112f4): Mirror 23: 0xb8a9d705 (stale) Mirror 25: 0xb8a9d705 (stale) Mirror 26: 0xb8a9d705 (stale) Mirror 29: 0xb8a9d705 (stale) Mirror 31: 0xb8a9d705 (stale) Mirror 32: 0xb8a9d705 (stale) Mirror 33: 0xdb05cb3d (stale) Mirror 34: 0xdb05cb3d (stale) Mirror 35: 0xdb05cb3d (stale) Mirror 36: 0xc9785d73 (stale) Mirror 37: 0xc9785d73 (stale) CRC-32 checksum value for chunk [0, 0x112f4): Mirror 1: 0xc9785d73 Mirror 38: 0xc9785d73 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x112f4: skipped 000869 1790734580.387435 mapread 0x00afcf thru 0x00e4db (0x350d bytes) 000870 1790734580.460782 trunc from 0x0112f4 to 0x03adf4 (0x29b01 bytes) 000871 1790734580.606537 punch from 0x00e878 to 0x012696 (0x3e1f bytes) 000872 1790734580.615721 trunc from 0x03adf5 to 0x01a9c1 (0x20433 bytes) 000873 1790734580.665810 read 0x00e74d thru 0x01a4d4 (0xbd88 bytes) 000874 1790734580.683721 trunc from 0x01a9c2 to 0x02e262 (0x138a1 bytes) 000875 1790734580.727916 fallocate 0x013727 thru 0x01418d (0xa67 bytes) 000876 1790734580.744718 punch from 0x00958f to 0x017b1d (0xe58f bytes) 000877 1790734580.752765 fallocate 0x035eef thru 0x03ffff (0xa111 bytes) 000878 1790734580.764874 punch from 0x01f387 to 0x026af5 (0x776f bytes) 000879 1790734580.777946 write 0x018a55 thru 0x028065 (0xf611 bytes) 000881 1790734580.793212 trunc from 0x018ec6 to 0x01d503 (0x463e bytes) 000882 1790734580.840699 mapread 0x018f93 thru 0x01d771 (0x47df bytes) 000883 1790734580.861942 trunc from 0x01ff81 to 0x022440 (0x24c0 bytes) 000884 1790734580.875444 write 0x02034f thru 0x0246b7 (0x4369 bytes) 000885 1790734580.884855 read 0x01d5e3 thru 0x022180 (0x4b9e bytes) 000886 1790734580.919869 punch from 0x004388 to 0x005cdd (0x1956 bytes) 000889 1790734580.938022 mapwrite 0x012a22 thru 0x01eeb1 (0xc490 bytes) 000890 1790734580.995281 punch from 0x030c9e to 0x034283 (0x35e6 bytes) 000891 1790734581.011538 mapread 0x018d05 thru 0x01cfed (0x42e9 bytes) 000892 1790734581.013421 punch from 0x0000a8 to 0x00f67e (0xf5d7 bytes) 000893 1790734581.029888 read 0x02146f thru 0x02babb (0xa64d bytes) 000894 1790734581.039746 read 0x00a099 thru 0x01004a (0x5fb2 bytes) 000895 1790734581.070288 fallocate 0x004557 thru 0x009313 (0x4dbd bytes) 000896 1790734581.089002 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) Mirror 38: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0xa6d96f50 (stale) Mirror 25: 0xa6d96f50 (stale) Mirror 26: 0xa6d96f50 (stale) Mirror 29: 0xa6d96f50 (stale) Mirror 31: 0xa6d96f50 (stale) Mirror 32: 0xa6d96f50 (stale) Mirror 33: 0x19bb2a38 (stale) Mirror 34: 0x19bb2a38 (stale) Mirror 35: 0xe722db2a (stale) Mirror 36: 0xdac847e3 (stale) Mirror 37: 0xdac847e3 (stale) Mirror 38: 0xbaa72cb6 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xe72a6a6b Mirror 39: 0xe72a6a6b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000897 1790734582.796518 write 0x000277 thru 0x002c40 (0x29ca bytes) 000898 1790734582.874589 mapwrite 0x01172b thru 0x0118cc (0x1a2 bytes) 000899 1790734582.913643 read 0x02df0d thru 0x0393cc (0xb4c0 bytes) 000900 1790734582.932281 mapread 0x012696 thru 0x012ec6 (0x831 bytes) 000901 1790734582.960686 MIRROR_SPLIT mirror 12 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x1a5:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0xa6d96f50 (stale) Mirror 25: 0xa6d96f50 (stale) Mirror 26: 0xa6d96f50 (stale) Mirror 29: 0xa6d96f50 (stale) Mirror 31: 0xa6d96f50 (stale) Mirror 32: 0xa6d96f50 (stale) Mirror 33: 0x19bb2a38 (stale) Mirror 34: 0x19bb2a38 (stale) Mirror 35: 0xe722db2a (stale) Mirror 36: 0xdac847e3 (stale) Mirror 37: 0xdac847e3 (stale) Mirror 39: 0xe72a6a6b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 23: 0xa6d96f50 (stale) Mirror 25: 0xa6d96f50 (stale) Mirror 26: 0xa6d96f50 (stale) Mirror 29: 0xa6d96f50 (stale) Mirror 31: 0xa6d96f50 (stale) Mirror 32: 0xa6d96f50 (stale) Mirror 33: 0x19bb2a38 (stale) Mirror 34: 0x19bb2a38 (stale) Mirror 35: 0xe722db2a (stale) Mirror 36: 0xdac847e3 (stale) Mirror 37: 0xdac847e3 (stale) Mirror 39: 0xe72a6a6b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000902 1790734583.870331 mapread 0x001443 thru 0x00e2d5 (0xce93 bytes) 000904 1790734583.904723 trunc from 0x0026cf to 0x006931 (0x4263 bytes) 000905 1790734583.912749 mapread 0x0240c1 thru 0x029e97 (0x5dd7 bytes) 000906 1790734583.933638 fallocate 0x03c951 thru 0x03ffff (0x36af bytes) 000907 1790734583.940852 read 0x014638 thru 0x020741 (0xc10a bytes) 000908 1790734583.958256 fallocate 0x006108 thru 0x0092d2 (0x31cb bytes) 000909 1790734583.967635 mapread 0x01ca5d thru 0x027365 (0xa909 bytes) 000911 1790734583.974884 mapwrite 0x03f105 thru 0x03ffff (0xefb bytes) 000913 1790734584.021858 mapread 0x0395da thru 0x03b744 (0x216b bytes) 000914 1790734584.024387 write 0x022c18 thru 0x02e2c3 (0xb6ac bytes) 000915 1790734584.038586 mapwrite 0x02074e thru 0x024c32 (0x44e5 bytes) 000916 1790734584.061947 trunc from 0x037758 to 0x03c4ab (0x4d54 bytes) 000917 1790734584.068751 mapread 0x01c315 thru 0x023e1a (0x7b06 bytes) 000918 1790734584.070783 mapwrite 0x029c11 thru 0x02ec9a (0x508a bytes) 000919 1790734584.089578 mapread 0x02cb7b thru 0x032f44 (0x63ca bytes) 000920 1790734584.128897 trunc from 0x040000 to 0x03d8b5 (0x274a bytes) 000921 1790734584.161628 fallocate 0x03d511 thru 0x03ffff (0x2aef bytes) 000922 1790734584.177776 fallocate 0x0111b4 thru 0x01adef (0x9c3c bytes) 000923 1790734584.184193 punch from 0x01907c to 0x020b0b (0x7a90 bytes) 000924 1790734584.190220 trunc from 0x028d50 to 0x02f982 (0x6c33 bytes) 000925 1790734584.197667 fallocate 0x02866f thru 0x0348f2 (0xc284 bytes) 000926 1790734584.203168 write 0x00757b thru 0x00bc58 (0x46de bytes) 000927 1790734584.204246 trunc from 0x0069c9 to 0x011016 (0xa64e bytes) 000928 1790734584.221681 mapread 0x03abe0 thru 0x03d8b5 (0x2cd6 bytes) 000929 1790734584.234775 mapwrite 0x03e826 thru 0x03ffff (0x17da bytes) 000930 1790734584.272217 trunc from 0x040000 to 0x004ce9 (0x3b316 bytes) 000931 1790734584.285279 mapwrite 0x01b42d thru 0x027f07 (0xcadb bytes) 000932 1790734584.379993 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x27f08): Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) Mirror 39: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27f08): Mirror 23: 0xf7d4171c (stale) Mirror 25: 0xf7d4171c (stale) Mirror 26: 0xf7d4171c (stale) Mirror 29: 0xf7d4171c (stale) Mirror 31: 0xf7d4171c (stale) Mirror 32: 0xf7d4171c (stale) Mirror 33: 0x583342f1 (stale) Mirror 34: 0x583342f1 (stale) Mirror 35: 0x583342f1 (stale) Mirror 36: 0xde47d624 (stale) Mirror 37: 0xde47d624 (stale) Mirror 39: 0x2a8d6547 (stale) CRC-32 checksum value for chunk [0, 0x27f08): Mirror 1: 0x3d0dcfc3 Mirror 40: 0x3d0dcfc3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27f08: skipped 000933 1790734585.568490 punch from 0x01d167 to 0x023f24 (0x6dbe bytes) 000934 1790734585.631545 fallocate 0x02e38f thru 0x02f72f (0x13a1 bytes) 000935 1790734585.642104 trunc from 0x02f730 to 0x039d5b (0xa62c bytes) 000936 1790734585.750252 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x39d5c): Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) Mirror 39: (stale - read error) Mirror 40: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39d5c): Mirror 23: 0x5b0caee1 (stale) Mirror 25: 0x5b0caee1 (stale) Mirror 26: 0x5b0caee1 (stale) Mirror 29: 0x5b0caee1 (stale) Mirror 31: 0x5b0caee1 (stale) Mirror 32: 0x5b0caee1 (stale) Mirror 33: 0x8193cff7 (stale) Mirror 34: 0x8193cff7 (stale) Mirror 35: 0x8193cff7 (stale) Mirror 36: 0x2d961186 (stale) Mirror 37: 0x2d961186 (stale) Mirror 39: 0xd9e8c893 (stale) Mirror 40: 0x74320464 (stale) CRC-32 checksum value for chunk [0, 0x39d5c): Mirror 1: 0x8bcb0efb Mirror 41: 0x8bcb0efb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39d5c: skipped 000937 1790734587.247837 MIRROR_RESYNC 15 mirrors 000938 1790734591.244626 read 0x0107ab thru 0x01cdd2 (0xc628 bytes) 000939 1790734591.262703 read 0x01efbf thru 0x022ab0 (0x3af2 bytes) 000940 1790734591.299426 trunc from 0x03369f to 0x039d5b (0x66bd bytes) 000941 1790734591.422608 fallocate 0x0215f0 thru 0x029307 (0x7d18 bytes) 000942 1790734591.447899 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x39d5c): Mirror 23: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) Mirror 39: (stale - read error) Mirror 40: (stale - read error) Mirror 41: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39d5c): Mirror 23: 0x8bcb0efb (stale) Mirror 25: 0x8bcb0efb (stale) Mirror 26: 0x8bcb0efb (stale) Mirror 29: 0x8bcb0efb (stale) Mirror 31: 0x8bcb0efb (stale) Mirror 32: 0x8bcb0efb (stale) Mirror 33: 0x8bcb0efb (stale) Mirror 34: 0x8bcb0efb (stale) Mirror 35: 0x8bcb0efb (stale) Mirror 36: 0x8bcb0efb (stale) Mirror 37: 0x8bcb0efb (stale) Mirror 39: 0x8bcb0efb (stale) Mirror 40: 0x8bcb0efb (stale) Mirror 41: 0x8bcb0efb (stale) CRC-32 checksum value for chunk [0, 0x39d5c): Mirror 1: 0x8bcb0efb Mirror 42: 0x8bcb0efb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39d5c: skipped 000943 1790734593.304391 read 0x015ddd thru 0x02518c (0xf3b0 bytes) 000944 1790734593.328979 fallocate 0x033fa6 thru 0x03ffff (0xc05a bytes) 000945 1790734593.427690 trunc from 0x0169a5 to 0x018a59 (0x20b5 bytes) 000947 1790734593.436127 punch from 0x03e99f to 0x03ffff (0x1661 bytes) 000948 1790734593.448232 fallocate 0x03d684 thru 0x03ffff (0x297c bytes) 000949 1790734593.479978 MIRROR_RESYNC 16 mirrors 000950 1790734598.101445 write 0x0068a0 thru 0x00f7c4 (0x8f25 bytes) 000951 1790734598.208907 trunc from 0x040000 to 0x02d25d (0x12da2 bytes) 000952 1790734598.253331 read 0x021bd4 thru 0x023f70 (0x239d bytes) 000953 1790734598.267707 mapwrite 0x01ce63 thru 0x02619b (0x9339 bytes) 000955 1790734598.346321 punch from 0x01d38a to 0x02acd5 (0xd94c bytes) 000956 1790734598.352530 mapwrite 0x00c579 thru 0x01c043 (0xfacb bytes) 000957 1790734598.389453 read 0x01f682 thru 0x01f6a5 (0x24 bytes) 000958 1790734598.401856 mapread 0x006709 thru 0x015412 (0xed0a bytes) 000959 1790734598.403319 mapwrite 0x022584 thru 0x029a54 (0x74d1 bytes) 000960 1790734598.442103 write 0x027298 thru 0x02b839 (0x45a2 bytes) 000961 1790734598.445775 punch from 0x02aa90 to 0x02baa1 (0x1012 bytes) 000962 1790734598.460177 mapread 0x00b296 thru 0x016158 (0xaec3 bytes) 000963 1790734598.461400 write 0x01b35d thru 0x02799f (0xc643 bytes) 000964 1790734598.463889 fallocate 0x00d3ab thru 0x01c853 (0xf4a9 bytes) 000965 1790734598.469121 fallocate 0x00d3fd thru 0x010cfb (0x38ff bytes) 000966 1790734598.473521 write 0x028d4b thru 0x02ca86 (0x3d3c bytes) 000967 1790734598.474919 trunc from 0x01fdbd to 0x025f16 (0x615a bytes) 000968 1790734598.494030 read 0x013af1 thru 0x02249f (0xe9af bytes) 000969 1790734598.506378 trunc from 0x02d25e to 0x023bc5 (0x9698 bytes) 000970 1790734598.523625 fallocate 0x030375 thru 0x0353e5 (0x5071 bytes) 000971 1790734598.539426 punch from 0x009756 to 0x00f497 (0x5d42 bytes) 000972 1790734598.545609 trunc from 0x013b84 to 0x02070d (0xcb8a bytes) 000973 1790734598.549951 mapread 0x016a3c thru 0x02431c (0xd8e1 bytes) 000975 1790734598.663989 mapread 0x00e359 thru 0x012e6f (0x4b17 bytes) 000976 1790734598.685226 read 0x00f430 thru 0x0128e5 (0x34b6 bytes) 000977 1790734598.687369 punch from 0x027bf2 to 0x02deb8 (0x62c7 bytes) 000978 1790734598.718660 write 0x010bb7 thru 0x016fb5 (0x63ff bytes) 000979 1790734598.733947 mapwrite 0x02938e thru 0x033473 (0xa0e6 bytes) 000980 1790734598.784518 trunc from 0x0353e6 to 0x017d07 (0x1d6de bytes) 000981 1790734598.820420 mapwrite 0x03fa3e thru 0x03ffff (0x5c2 bytes) 000982 1790734598.897383 MIRROR_RESYNC 16 mirrors 000983 1790734603.164162 trunc from 0x040000 to 0x011b8f (0x2e470 bytes) 000984 1790734603.214233 write 0x01a317 thru 0x0216e0 (0x73ca bytes) 000985 1790734603.216919 read 0x010263 thru 0x01d0c1 (0xce5f bytes) 000986 1790734603.223004 write 0x019bd6 thru 0x0237ae (0x9bd9 bytes) 000987 1790734603.224733 punch from 0x003fff to 0x00a34c (0x634e bytes) 000988 1790734603.229549 trunc from 0x0237af to 0x00d76f (0x1603f bytes) 000989 1790734603.245436 mapwrite 0x00b923 thru 0x018ada (0xd1b8 bytes) 000990 1790734603.349464 punch from 0x000aa3 to 0x01030b (0xf869 bytes) 000992 1790734603.367201 mapwrite 0x02a540 thru 0x02f09b (0x4b5c bytes) 000993 1790734603.472531 fallocate 0x027332 thru 0x02871f (0x13ee bytes) 000994 1790734603.480180 trunc from 0x01442f to 0x01d6d0 (0x92a2 bytes) 000996 1790734603.498550 fallocate 0x03d01b thru 0x03eb70 (0x1b56 bytes) 000997 1790734603.508586 punch from 0x0258e1 to 0x02f09b (0x97bb bytes) 000998 1790734603.517453 read 0x01c0ef thru 0x01f2f3 (0x3205 bytes) 000999 1790734603.546545 read 0x00dde2 thru 0x00f4b8 (0x16d7 bytes) 001000 1790734603.549315 trunc from 0x0044fa to 0x00718f (0x2c96 bytes) All operations completed A-OK!