== sanity-flr test 70a: flr mode fsx test ================ 12:08:55 (1784045335) striped dir -i0 -c2 -H crush /mnt/lustre/d70a.sanity-flr Seed set to 5337 skipping zero size read 000002 1784045337.668049 write 0x02fc58 thru 0x033fac (0x4355 bytes) fallocating to largest ever: 0x1ac3d 000003 1784045337.683437 fallocate 0x018ebc thru 0x01ac3c (0x1d81 bytes) 000004 1784045337.703654 mapwrite 0x01f9c7 thru 0x02cc09 (0xd243 bytes) zero_range to largest ever: 0x33fad 000005 1784045337.811378 trunc from 0x030ccb to 0x033fac (0x32e2 bytes) 000006 1784045337.825821 mapread 0x012466 thru 0x019062 (0x6bfd bytes) 000007 1784045337.859110 punch from 0x02fe38 to 0x033fac (0x4175 bytes) 000008 1784045337.871274 read 0x022530 thru 0x031597 (0xf068 bytes) 000009 1784045337.887144 trunc from 0x02f50e to 0x033fac (0x4a9f bytes) 000010 1784045337.896476 mapwrite 0x01923a thru 0x01d1f1 (0x3fb8 bytes) 000012 1784045337.956502 read 0x01ac78 thru 0x024c65 (0x9fee bytes) 000013 1784045337.963865 read 0x00dc9c thru 0x014aee (0x6e53 bytes) 000014 1784045337.980868 MIRROR_EXTEND to 2 mirrors 000015 1784045339.400837 write 0x03bb6e thru 0x03ffff (0x4492 bytes) 000016 1784045339.470002 fallocate 0x000770 thru 0x00b59f (0xae30 bytes) 000017 1784045339.477850 trunc from 0x040000 to 0x01d984 (0x2267b bytes) 000018 1784045339.527844 mapwrite 0x01e5e8 thru 0x022f18 (0x4931 bytes) 000019 1784045339.594808 punch from 0x01a049 to 0x022f03 (0x8ebb bytes) 000020 1784045339.606233 read 0x02193c thru 0x022927 (0xfec bytes) 000021 1784045339.617839 mapwrite 0x02c52d thru 0x03a407 (0xdedb bytes) 000022 1784045339.730220 mapwrite 0x010cbb thru 0x01f2b3 (0xe5f9 bytes) 000023 1784045339.804392 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3a408): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a408): Mirror 2: 0x3bcaab92 (stale) CRC-32 checksum value for chunk [0, 0x3a408): Mirror 1: 0x24d8a9f3 Mirror 3: 0x24d8a9f3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a408: skipped 000024 1784045340.663310 punch from 0x024115 to 0x02a0ac (0x5f98 bytes) 000025 1784045340.727323 write 0x006d68 thru 0x009dfb (0x3094 bytes) 000026 1784045340.746230 mapwrite 0x01d7f7 thru 0x02a751 (0xcf5b bytes) 000028 1784045340.807562 mapwrite 0x0116e3 thru 0x0155e9 (0x3f07 bytes) 000029 1784045340.840212 mapwrite 0x01ec01 thru 0x021444 (0x2844 bytes) 000030 1784045340.858735 fallocate 0x01578a thru 0x0163b8 (0xc2f bytes) 000031 1784045340.867924 trunc from 0x015821 to 0x0210b5 (0xb895 bytes) 000032 1784045340.874892 mapread 0x019611 thru 0x01dc4d (0x463d bytes) 000033 1784045340.884353 mapread 0x00fe01 thru 0x0190fd (0x92fd bytes) 000034 1784045340.886546 mapread 0x0360c0 thru 0x03a407 (0x4348 bytes) 000035 1784045340.905495 punch from 0x02ac89 to 0x034b54 (0x9ecc bytes) 000036 1784045340.915611 mapwrite 0x023ff1 thru 0x02a47b (0x648b bytes) 000037 1784045340.955849 mapread 0x0247e5 thru 0x027dc2 (0x35de bytes) 000038 1784045340.956943 write 0x038d83 thru 0x03ffff (0x727d bytes) 000040 1784045340.963034 write 0x02bf76 thru 0x0373ed (0xb478 bytes) 000041 1784045340.965194 write 0x00a8d4 thru 0x012e16 (0x8543 bytes) 000042 1784045340.966844 read 0x033785 thru 0x0353ca (0x1c46 bytes) 000043 1784045340.967967 mapread 0x0149fb thru 0x018d0b (0x4311 bytes) truncating to largest ever: 0x3e9e3 000044 1784045340.969918 trunc from 0x040000 to 0x03e9e2 (0x161d bytes) 000045 1784045340.994401 fallocate 0x021dfb thru 0x031b95 (0xfd9b bytes) 000046 1784045341.000449 trunc from 0x03e9e3 to 0x014e98 (0x29b4a bytes) 000047 1784045341.020293 fallocate 0x024ff7 thru 0x027381 (0x238b bytes) 000048 1784045341.026779 mapwrite 0x01a6d8 thru 0x02a1a2 (0xfacb bytes) 000049 1784045341.090783 punch from 0x02a0f6 to 0x02a1a2 (0xad bytes) 000050 1784045341.096971 mapwrite 0x008332 thru 0x015417 (0xd0e6 bytes) 000053 1784045341.118648 write 0x03ed83 thru 0x03ffff (0x127d bytes) 000054 1784045341.121221 write 0x03bb4a thru 0x03f7ef (0x3ca6 bytes) 000055 1784045341.131227 MIRROR_RESYNC 3 mirrors 000056 1784045342.157511 fallocate 0x0025fb thru 0x010248 (0xdc4e bytes) 000057 1784045342.241024 fallocate 0x00b308 thru 0x00f89f (0x4598 bytes) 000058 1784045342.253019 mapwrite 0x00d3fe thru 0x0187c6 (0xb3c9 bytes) 000059 1784045342.375689 MIRROR_RESYNC 3 mirrors 000060 1784045343.705641 punch from 0x01c68c to 0x02501c (0x8991 bytes) 000061 1784045343.753135 read 0x018ae9 thru 0x02277e (0x9c96 bytes) 000062 1784045343.777619 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x2b20bfc5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x2b20bfc5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000063 1784045344.292788 write 0x013664 thru 0x01a5b0 (0x6f4d bytes) 000064 1784045344.314655 trunc from 0x00ca3e to 0x014e73 (0x8436 bytes) 000065 1784045344.351509 trunc from 0x0084f2 to 0x010d60 (0x886f bytes) 000066 1784045344.362820 write 0x03ab76 thru 0x03d096 (0x2521 bytes) 000067 1784045344.382217 mapread 0x00c886 thru 0x00e6fa (0x1e75 bytes) zero_range to largest ever: 0x40000 000068 1784045344.422614 trunc from 0x0371b8 to 0x03ffff (0x8e48 bytes) 000069 1784045344.448287 write 0x005b97 thru 0x01553c (0xf9a6 bytes) 000070 1784045344.465557 punch from 0x033351 to 0x03ffff (0xccaf bytes) 000071 1784045344.486197 trunc from 0x036fca to 0x03ffff (0x9036 bytes) 000072 1784045344.507686 MIRROR_RESYNC 2 mirrors 000073 1784045345.749945 fallocate 0x0084e1 thru 0x00a01c (0x1b3c bytes) 000075 1784045345.820877 punch from 0x01a299 to 0x022c0b (0x8973 bytes) 000076 1784045345.870498 MIRROR_RESYNC 2 mirrors 000077 1784045347.276669 MIRROR_EXTEND to 3 mirrors 000078 1784045348.105917 read 0x0209a4 thru 0x023b2f (0x318c bytes) 000079 1784045348.119952 write 0x02aaac thru 0x037d30 (0xd285 bytes) 000080 1784045348.163559 mapread 0x01feeb thru 0x022054 (0x216a bytes) 000081 1784045348.190585 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xda127665 (stale) Mirror 4: 0xda127665 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x163775b4 Mirror 5: 0x163775b4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000082 1784045349.303420 write 0x02d5df thru 0x03d031 (0xfa53 bytes) 000083 1784045349.375035 write 0x020c5a thru 0x02317f (0x2526 bytes) 000085 1784045349.395479 mapread 0x00905e thru 0x01901f (0xffc2 bytes) 000086 1784045349.434175 trunc from 0x00417c to 0x00a8ca (0x674f bytes) 000087 1784045349.441550 trunc from 0x040000 to 0x025dc8 (0x1a237 bytes) 000088 1784045349.502648 read 0x012b80 thru 0x013832 (0xcb3 bytes) 000089 1784045349.503845 write 0x0057e0 thru 0x010fa2 (0xb7c3 bytes) 000090 1784045349.516237 fallocate 0x037678 thru 0x037f03 (0x88c bytes) 000091 1784045349.532400 MIRROR_RESYNC 4 mirrors 000092 1784045351.236957 MIRROR_RESYNC 4 mirrors 000093 1784045351.653398 mapwrite 0x0170fb thru 0x0246f4 (0xd5fa bytes) 000094 1784045351.788039 punch from 0x0163c0 to 0x016a31 (0x672 bytes) 000095 1784045351.795384 trunc from 0x037f04 to 0x029399 (0xeb6a bytes) 000096 1784045351.825368 mapread 0x025eb2 thru 0x0273f5 (0x1544 bytes) 000097 1784045351.828453 mapread 0x026d2d thru 0x029399 (0x266d bytes) 000098 1784045351.831040 trunc from 0x02939a to 0x015da8 (0x135f1 bytes) 000100 1784045351.863847 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x15da9): Mirror 3: 0x4e920cde (stale) Mirror 5: 0x4e920cde (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15da9): Mirror 3: 0x4e920cde (stale) Mirror 5: 0x4e920cde (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15da9: skipped 000101 1784045352.209382 trunc from 0x00ddce to 0x01223f (0x4472 bytes) 000102 1784045352.219366 mapread 0x00e37a thru 0x0151dc (0x6e63 bytes) 000103 1784045352.237596 mapread 0x015011 thru 0x015da8 (0xd98 bytes) 000104 1784045352.238628 write 0x02ff2a thru 0x03ea09 (0xeae0 bytes) 000105 1784045352.246152 trunc from 0x03ea0a to 0x00250e (0x3c4fb bytes) 000106 1784045352.266677 trunc from 0x0001ee to 0x00250e (0x2321 bytes) 000107 1784045352.272994 punch from 0x000902 to 0x001826 (0xf25 bytes) 000108 1784045352.278032 punch from 0x0002f2 to 0x00250e (0x221d bytes) 000109 1784045352.282902 write 0x018f91 thru 0x028ba1 (0xfc11 bytes) 000110 1784045352.284515 trunc from 0x028ba2 to 0x0094e3 (0x1f6be bytes) 000111 1784045352.303362 write 0x01434a thru 0x017db1 (0x3a68 bytes) 000115 1784045352.308309 fallocate 0x03a0c3 thru 0x03ffff (0x5f3d bytes) 000116 1784045352.316546 fallocate 0x033404 thru 0x039ff3 (0x6bf0 bytes) 000118 1784045352.322754 trunc from 0x00013b to 0x0050e9 (0x4faf bytes) 000119 1784045352.332171 write 0x01c5bf thru 0x022a44 (0x6486 bytes) 000120 1784045352.334229 trunc from 0x022a45 to 0x008f17 (0x19b2d bytes) 000121 1784045352.361377 trunc from 0x008f18 to 0x03b1a3 (0x3228c bytes) 000122 1784045352.396355 fallocate 0x03dffb thru 0x03ffff (0x2005 bytes) 000124 1784045352.401279 read 0x031f2f thru 0x0375d6 (0x56a8 bytes) 000125 1784045352.407340 trunc from 0x002dab to 0x00e330 (0xb586 bytes) 000126 1784045352.414684 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b1a4): Mirror 5: 0x9cfb6a31 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b1a4): Mirror 5: 0x9cfb6a31 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b1a4: skipped 000127 1784045352.677795 fallocate 0x036654 thru 0x03e5fe (0x7fab bytes) 000128 1784045352.681314 trunc from 0x03e5ff to 0x00e244 (0x303ba bytes) 000129 1784045352.694660 fallocate 0x015e65 thru 0x0172a4 (0x1440 bytes) 000130 1784045352.701232 trunc from 0x00e245 to 0x03822c (0x29fe8 bytes) 000132 1784045352.718216 trunc from 0x02131f to 0x027af4 (0x67d6 bytes) 000133 1784045352.749715 punch from 0x02897a to 0x037ec1 (0xf548 bytes) 000134 1784045352.754261 mapwrite 0x01d042 thru 0x028a3e (0xb9fd bytes) 000135 1784045352.862889 fallocate 0x013b40 thru 0x01ae45 (0x7306 bytes) 000136 1784045352.872922 trunc from 0x014ee6 to 0x015a43 (0xb5e bytes) 000138 1784045352.890553 write 0x03928b thru 0x03ffff (0x6d75 bytes) 000139 1784045352.898843 mapread 0x0277be thru 0x02c580 (0x4dc3 bytes) 000140 1784045352.906503 read 0x014e28 thru 0x01aa61 (0x5c3a bytes) 000141 1784045352.925684 mapwrite 0x01178a thru 0x01fc6c (0xe4e3 bytes) 000142 1784045352.987856 trunc from 0x01dde8 to 0x02d375 (0xf58e bytes) 000143 1784045353.000962 punch from 0x03ce60 to 0x03ffff (0x31a0 bytes) 000146 1784045353.018899 write 0x030d9f thru 0x033183 (0x23e5 bytes) 000147 1784045353.026642 trunc from 0x03c1fb to 0x03ffff (0x3e05 bytes) 000148 1784045353.050333 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) 000149 1784045353.361046 punch from 0x034315 to 0x03ff22 (0xbc0e bytes) 000150 1784045353.372010 trunc from 0x040000 to 0x006d9c (0x39263 bytes) 000151 1784045353.412681 write 0x031b01 thru 0x039a5b (0x7f5b bytes) 000152 1784045353.417663 fallocate 0x01d448 thru 0x01d86e (0x427 bytes) 000153 1784045353.425351 fallocate 0x029288 thru 0x034e60 (0xbbd9 bytes) 000155 1784045353.433580 write 0x017011 thru 0x019db9 (0x2da9 bytes) 000156 1784045353.450735 write 0x035350 thru 0x037b63 (0x2814 bytes) 000157 1784045353.458002 MIRROR_EXTEND to 2 mirrors 000158 1784045354.534066 mapwrite 0x03ff59 thru 0x03ffff (0xa7 bytes) 000159 1784045354.660605 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) 000160 1784045354.862289 fallocate 0x02f3e9 thru 0x03d49f (0xe0b7 bytes) 000161 1784045354.872685 trunc from 0x040000 to 0x03201f (0xdfe0 bytes) 000162 1784045354.901828 mapwrite 0x026387 thru 0x028131 (0x1dab bytes) 000163 1784045354.944933 trunc from 0x0120bc to 0x019f0d (0x7e52 bytes) 000164 1784045354.952844 mapread 0x017c16 thru 0x01bfa0 (0x438b bytes) 000165 1784045354.969036 trunc from 0x032020 to 0x018a80 (0x1959f bytes) 000166 1784045354.989690 punch from 0x011835 to 0x01197f (0x14b bytes) 000167 1784045354.996189 fallocate 0x00c3ae thru 0x019685 (0xd2d8 bytes) 000169 1784045355.008649 MIRROR_EXTEND to 2 mirrors 000170 1784045356.021221 fallocate 0x026a93 thru 0x031b15 (0xb083 bytes) 000171 1784045356.068756 trunc from 0x031b16 to 0x00449f (0x2d676 bytes) 000172 1784045356.148382 trunc from 0x0044a0 to 0x015817 (0x11378 bytes) 000173 1784045356.193261 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) 000174 1784045356.381770 fallocate 0x018b14 thru 0x01f7c4 (0x6cb1 bytes) 000175 1784045356.389279 fallocate 0x0317c6 thru 0x03ffff (0xe83a bytes) 000176 1784045356.394495 trunc from 0x0006a8 to 0x008706 (0x805f bytes) 000178 1784045356.400287 write 0x0319f1 thru 0x03299b (0xfab bytes) 000179 1784045356.407015 trunc from 0x03299c to 0x0117b1 (0x211ea bytes) 000180 1784045356.421841 trunc from 0x00d921 to 0x00d999 (0x79 bytes) 000181 1784045356.426488 read 0x005fba thru 0x007f65 (0x1fac bytes) 000182 1784045356.433420 fallocate 0x01a94f thru 0x01abbd (0x26f bytes) 000183 1784045356.442721 mapwrite 0x000618 thru 0x00cca1 (0xc68a bytes) 000185 1784045356.542689 punch from 0x005e2c to 0x00e60b (0x87e0 bytes) 000186 1784045356.552022 mapwrite 0x012a57 thru 0x01ede2 (0xc38c bytes) 000188 1784045356.644915 read 0x01e057 thru 0x01ede2 (0xd8c bytes) 000189 1784045356.647894 mapread 0x00e5ec thru 0x018e1c (0xa831 bytes) 000190 1784045356.652681 trunc from 0x01a175 to 0x01ede2 (0x4c6e bytes) 000191 1784045356.661863 write 0x03d390 thru 0x03ffff (0x2c70 bytes) 000192 1784045356.665692 read 0x03adb7 thru 0x03ffff (0x5249 bytes) 000193 1784045356.681937 fallocate 0x0185d3 thru 0x01a309 (0x1d37 bytes) 000194 1784045356.702604 mapread 0x02bc9f thru 0x02f3c1 (0x3723 bytes) 000195 1784045356.718934 read 0x00fc80 thru 0x011ec6 (0x2247 bytes) 000196 1784045356.720717 write 0x03d7d7 thru 0x03ffff (0x2829 bytes) 000197 1784045356.728925 punch from 0x02d6d7 to 0x034b7a (0x74a4 bytes) 000199 1784045356.752437 trunc from 0x040000 to 0x03f631 (0x9ce bytes) 000200 1784045356.774059 mapread 0x01e570 thru 0x01f5b0 (0x1041 bytes) 000201 1784045356.777603 write 0x02a6b8 thru 0x037b8b (0xd4d4 bytes) 000202 1784045356.782174 fallocate 0x0294fa thru 0x035afa (0xc601 bytes) 000203 1784045356.786037 write 0x00d073 thru 0x017367 (0xa2f5 bytes) 000204 1784045356.787831 read 0x016852 thru 0x0258d5 (0xf084 bytes) 000205 1784045356.788948 trunc from 0x00f71c to 0x015fb2 (0x6897 bytes) 000206 1784045356.815824 trunc from 0x03f632 to 0x035755 (0x9edc bytes) 000207 1784045356.847855 read 0x018645 thru 0x01b4e6 (0x2ea2 bytes) 000208 1784045356.848597 trunc from 0x035756 to 0x01df03 (0x17852 bytes) 000209 1784045356.865844 punch from 0x006e89 to 0x009cd5 (0x2e4d bytes) 000210 1784045356.871586 trunc from 0x006075 to 0x015691 (0xf61d bytes) 000211 1784045356.877947 mapread 0x00b543 thru 0x015e51 (0xa90f bytes) 000212 1784045356.890320 read 0x01b1c4 thru 0x01cb30 (0x196d bytes) 000213 1784045356.891185 mapwrite 0x0076fc thru 0x010ab2 (0x93b7 bytes) 000214 1784045356.939145 write 0x026067 thru 0x02bba6 (0x5b40 bytes) 000217 1784045356.943231 trunc from 0x02bba7 to 0x0184c0 (0x136e6 bytes) 000218 1784045356.958721 mapread 0x01456a thru 0x0184c0 (0x3f57 bytes) 000219 1784045356.959715 read 0x016066 thru 0x0184c0 (0x245b bytes) 000220 1784045356.960632 mapread 0x01169a thru 0x0184c0 (0x6e27 bytes) 000221 1784045356.961789 write 0x038c55 thru 0x03bd06 (0x30b2 bytes) 000222 1784045356.963104 mapread 0x03953f thru 0x039dd9 (0x89b bytes) 000225 1784045356.964995 write 0x01846e thru 0x02551a (0xd0ad bytes) 000226 1784045356.970007 mapread 0x008179 thru 0x0115b8 (0x9440 bytes) 000227 1784045356.971651 trunc from 0x03bd07 to 0x019cb5 (0x22051 bytes) 000228 1784045356.984551 read 0x014ea1 thru 0x0188f3 (0x3a53 bytes) 000229 1784045356.985254 mapread 0x00e955 thru 0x013bdb (0x5287 bytes) 000230 1784045356.986188 mapwrite 0x00e98d thru 0x01a0c5 (0xb739 bytes) 000231 1784045357.033012 trunc from 0x01a0c6 to 0x039ec7 (0x1fe02 bytes) 000232 1784045357.056041 read 0x017d0c thru 0x018b58 (0xe4d bytes) 000233 1784045357.056813 mapread 0x02ca75 thru 0x02e5c2 (0x1b4e bytes) 000234 1784045357.067669 trunc from 0x019d93 to 0x01f424 (0x5692 bytes) 000235 1784045357.077923 MIRROR_EXTEND to 2 mirrors 000236 1784045357.971997 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) 000237 1784045358.137594 trunc from 0x0324e2 to 0x0345cf (0x20ee bytes) 000238 1784045358.159818 MIRROR_EXTEND to 2 mirrors 000239 1784045358.935951 write 0x018296 thru 0x025a58 (0xd7c3 bytes) 000240 1784045358.971566 punch from 0x00533b to 0x00ffd2 (0xac98 bytes) 000241 1784045358.982785 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x39ec8): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39ec8): Mirror 2: 0x7cd48ff8 (stale) CRC-32 checksum value for chunk [0, 0x39ec8): Mirror 1: 0x1616cf7d Mirror 3: 0x1616cf7d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39ec8: skipped 000242 1784045360.139781 trunc from 0x016b94 to 0x0249af (0xde1c bytes) 000243 1784045360.226673 fallocate 0x0103c9 thru 0x01d586 (0xd1be bytes) 000244 1784045360.258275 trunc from 0x039ec8 to 0x013e9c (0x2602b bytes) 000245 1784045360.305632 fallocate 0x02f658 thru 0x03b4e4 (0xbe8d bytes) 000246 1784045360.312227 trunc from 0x021549 to 0x0232aa (0x1d62 bytes) 000247 1784045360.325647 trunc from 0x03b4e5 to 0x03614d (0x5397 bytes) 000248 1784045360.357697 mapread 0x01d68f thru 0x01f5a0 (0x1f12 bytes) 000249 1784045360.401007 mapread 0x012682 thru 0x01279b (0x11a bytes) 000250 1784045360.436849 write 0x026fed thru 0x036536 (0xf54a bytes) 000253 1784045360.473522 trunc from 0x036537 to 0x000f13 (0x35623 bytes) 000254 1784045360.525713 read 0x00062a thru 0x000f13 (0x8ea bytes) 000255 1784045360.544309 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xf14): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf14): Mirror 2: 0x47366d61 (stale) Mirror 3: 0x47366d61 (stale) CRC-32 checksum value for chunk [0, 0xf14): Mirror 1: 0x47366d61 Mirror 4: 0x47366d61 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf14: skipped 000256 1784045361.262608 write 0x0117e6 thru 0x01c4e5 (0xad00 bytes) 000257 1784045361.340136 trunc from 0x01c4e6 to 0x0304ae (0x13fc9 bytes) 000258 1784045361.468427 read 0x017fab thru 0x01eec8 (0x6f1e bytes) 000259 1784045361.476600 fallocate 0x029ccd thru 0x034c15 (0xaf49 bytes) 000260 1784045361.522297 MIRROR_RESYNC 4 mirrors 000261 1784045363.016930 punch from 0x02f844 to 0x0304ae (0xc6b bytes) 000262 1784045363.096306 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x304af): Mirror 2: 0x748baf05 (stale) Mirror 3: 0x748baf05 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x304af): Mirror 2: 0x748baf05 (stale) Mirror 3: 0x748baf05 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x304af: skipped 000263 1784045363.525236 trunc from 0x028cfe to 0x0304ae (0x77b1 bytes) 000264 1784045363.535657 read 0x02e33b thru 0x02e600 (0x2c6 bytes) 000265 1784045363.545710 punch from 0x00805d to 0x00dadf (0x5a83 bytes) 000266 1784045363.572359 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x304af): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x304af): Mirror 2: 0x748baf05 (stale) Mirror 3: 0x748baf05 (stale) CRC-32 checksum value for chunk [0, 0x304af): Mirror 1: 0x748baf05 Mirror 4: 0x748baf05 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x304af: skipped 000267 1784045364.983029 read 0x022897 thru 0x0304ae (0xdc18 bytes) 000268 1784045365.004915 mapread 0x0203a2 thru 0x02467e (0x42dd bytes) 000269 1784045365.049329 punch from 0x01cde9 to 0x02547f (0x8697 bytes) 000270 1784045365.113852 write 0x0187fc thru 0x023f5a (0xb75f bytes) 000271 1784045365.146814 mapread 0x02522c thru 0x026e9c (0x1c71 bytes) 000273 1784045365.160472 punch from 0x023c14 to 0x024269 (0x656 bytes) 000275 1784045365.181470 mapwrite 0x024670 thru 0x033528 (0xeeb9 bytes) 000276 1784045365.260584 mapread 0x01daa7 thru 0x02b3e2 (0xd93c bytes) 000277 1784045365.268405 write 0x02a556 thru 0x0334ef (0x8f9a bytes) 000278 1784045365.282979 read 0x01277d thru 0x013672 (0xef6 bytes) 000279 1784045365.300529 mapwrite 0x022fa0 thru 0x0311c4 (0xe225 bytes) 000280 1784045365.330249 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x33529): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33529): Mirror 2: 0xf9fd999 (stale) Mirror 3: 0xf9fd999 (stale) Mirror 4: 0xf9fd999 (stale) CRC-32 checksum value for chunk [0, 0x33529): Mirror 1: 0x4f8b3ec8 Mirror 5: 0x4f8b3ec8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33529: skipped 000281 1784045366.182619 mapread 0x011140 thru 0x0134b0 (0x2371 bytes) 000282 1784045366.217214 mapread 0x026103 thru 0x02aae6 (0x49e4 bytes) 000283 1784045366.240781 write 0x022d62 thru 0x02b817 (0x8ab6 bytes) 000284 1784045366.309535 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x33529): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33529): Mirror 2: 0xf9fd999 (stale) Mirror 3: 0xf9fd999 (stale) Mirror 4: 0xf9fd999 (stale) Mirror 5: 0x4f8b3ec8 (stale) CRC-32 checksum value for chunk [0, 0x33529): Mirror 1: 0x427faba6 Mirror 6: 0x427faba6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33529: skipped 000285 1784045367.459598 punch from 0x0225f0 to 0x0315f4 (0xf005 bytes) 000286 1784045367.544114 mapwrite 0x01b2a6 thru 0x02219e (0x6ef9 bytes) 000287 1784045367.626407 trunc from 0x00491d to 0x00e3c6 (0x9aaa bytes) 000288 1784045367.643561 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x33529): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33529): Mirror 2: 0xf9fd999 (stale) Mirror 3: 0xf9fd999 (stale) Mirror 4: 0xf9fd999 (stale) Mirror 5: 0x4f8b3ec8 (stale) Mirror 6: 0x427faba6 (stale) CRC-32 checksum value for chunk [0, 0x33529): Mirror 1: 0x1b2e2b6 Mirror 7: 0x1b2e2b6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33529: skipped 000289 1784045368.955670 trunc from 0x033529 to 0x01e195 (0x15393 bytes) 000291 1784045369.020018 fallocate 0x0328ff thru 0x03f814 (0xcf16 bytes) 000293 1784045369.028946 read 0x00f5b1 thru 0x014aa5 (0x54f5 bytes) 000294 1784045369.040353 mapread 0x02e362 thru 0x02e7c2 (0x461 bytes) 000295 1784045369.050337 trunc from 0x03f815 to 0x0086e6 (0x3712e bytes) 000296 1784045369.082350 fallocate 0x02be2e thru 0x03af36 (0xf109 bytes) 000298 1784045369.091599 trunc from 0x03584b to 0x038313 (0x2ac9 bytes) 000299 1784045369.097745 write 0x02341d thru 0x0266c0 (0x32a4 bytes) 000300 1784045369.109805 write 0x00bb2b thru 0x01b128 (0xf5fe bytes) 000301 1784045369.122390 trunc from 0x03af37 to 0x03af05 (0x31 bytes) 000302 1784045369.145442 mapwrite 0x00f6d0 thru 0x011f23 (0x2854 bytes) 000303 1784045369.181266 punch from 0x017dda to 0x01e469 (0x6690 bytes) 000304 1784045369.198460 MIRROR_RESYNC 7 mirrors 000305 1784045371.273017 write 0x031988 thru 0x03ea66 (0xd0df bytes) 000306 1784045371.340406 trunc from 0x03ea67 to 0x03dae7 (0xf7f bytes) 000307 1784045371.357911 trunc from 0x00b12b to 0x012deb (0x7cc1 bytes) 000308 1784045371.364825 trunc from 0x01aef7 to 0x0294e7 (0xe5f1 bytes) 000309 1784045371.370112 trunc from 0x03dae8 to 0x021955 (0x1c192 bytes) 000311 1784045371.391503 punch from 0x02067b to 0x021955 (0x12db bytes) 000312 1784045371.406175 trunc from 0x00f581 to 0x018361 (0x8de1 bytes) 000313 1784045371.414055 read 0x01e8b2 thru 0x021955 (0x30a4 bytes) 000314 1784045371.422472 read 0x001a23 thru 0x00781c (0x5dfa bytes) 000315 1784045371.433285 mapread 0x00efb0 thru 0x011862 (0x28b3 bytes) 000316 1784045371.435693 write 0x03e0e8 thru 0x03ffff (0x1f18 bytes) 000317 1784045371.437758 write 0x022949 thru 0x024662 (0x1d1a bytes) 000318 1784045371.451495 trunc from 0x040000 to 0x0292bb (0x16d44 bytes) 000320 1784045371.477790 fallocate 0x007265 thru 0x00acbd (0x3a59 bytes) 000321 1784045371.484619 fallocate 0x01b5fd thru 0x023d26 (0x872a bytes) 000322 1784045371.490777 mapread 0x00d273 thru 0x01b779 (0xe507 bytes) 000323 1784045371.493062 mapread 0x001a0b thru 0x0030f3 (0x16e9 bytes) 000324 1784045371.494875 read 0x0003fc thru 0x00d70e (0xd313 bytes) 000325 1784045371.496274 fallocate 0x025c09 thru 0x0261fe (0x5f6 bytes) 000326 1784045371.502320 read 0x025d7f thru 0x025ecd (0x14f bytes) 000327 1784045371.503244 write 0x02e9bc thru 0x03a257 (0xb89c bytes) 000328 1784045371.505973 trunc from 0x03a258 to 0x0387a6 (0x1ab1 bytes) 000329 1784045371.527545 punch from 0x00604c to 0x00f6ba (0x966f bytes) 000330 1784045371.533238 trunc from 0x0387a7 to 0x00570a (0x3309c bytes) 000332 1784045371.552115 trunc from 0x000796 to 0x00570a (0x4f75 bytes) 000333 1784045371.560339 mapwrite 0x0228a1 thru 0x027ee3 (0x5643 bytes) 000334 1784045371.634225 punch from 0x009666 to 0x00c61c (0x2fb7 bytes) 000335 1784045371.639653 trunc from 0x00fdbd to 0x01b33a (0xb57e bytes) 000336 1784045371.645993 trunc from 0x006d2d to 0x0073c5 (0x699 bytes) 000337 1784045371.652315 trunc from 0x0157ab to 0x016cd9 (0x152f bytes) 000338 1784045371.662471 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x27ee4): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27ee4): Mirror 2: 0xb21e83a2 (stale) Mirror 3: 0xb21e83a2 (stale) Mirror 4: 0xb21e83a2 (stale) Mirror 5: 0xb21e83a2 (stale) Mirror 6: 0xb21e83a2 (stale) Mirror 7: 0xb21e83a2 (stale) CRC-32 checksum value for chunk [0, 0x27ee4): Mirror 1: 0x51536e2 Mirror 8: 0x51536e2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27ee4: skipped 000340 1784045372.632455 read 0x0056ca thru 0x015675 (0xffac bytes) 000341 1784045372.652922 mapwrite 0x02bdab thru 0x03649f (0xa6f5 bytes) 000342 1784045372.806109 fallocate 0x00052f thru 0x00e2d3 (0xdda5 bytes) 000344 1784045372.813134 trunc from 0x0364a0 to 0x015868 (0x20c37 bytes) 000346 1784045372.837177 fallocate 0x02b30b thru 0x03885c (0xd552 bytes) 000347 1784045372.843461 trunc from 0x03885d to 0x014429 (0x24433 bytes) 000348 1784045372.869512 MIRROR_RESYNC 8 mirrors 000349 1784045374.167183 fallocate 0x02c560 thru 0x0339a2 (0x7443 bytes) 000350 1784045374.206211 mapread 0x030db8 thru 0x0339a2 (0x2beb bytes) 000351 1784045374.229023 read 0x027fbe thru 0x0339a2 (0xb9e5 bytes) 000352 1784045374.238765 trunc from 0x0339a3 to 0x032745 (0x125d bytes) 000353 1784045374.266014 fallocate 0x0138a1 thru 0x01e0df (0xa83f bytes) 000355 1784045374.274809 write 0x009c08 thru 0x00b045 (0x143e bytes) 000356 1784045374.288988 punch from 0x01c4f7 to 0x025e68 (0x9972 bytes) 000357 1784045374.294025 read 0x0158f7 thru 0x019751 (0x3e5b bytes) 000358 1784045374.326901 write 0x023293 thru 0x02733e (0x40ac bytes) 000359 1784045374.328399 write 0x033d9f thru 0x03ffff (0xc261 bytes) 000360 1784045374.332599 fallocate 0x00c3b2 thru 0x01396f (0x75be bytes) 000362 1784045374.351883 punch from 0x02f496 to 0x03dd0e (0xe879 bytes) 000363 1784045374.391884 read 0x01f493 thru 0x02d72e (0xe29c bytes) 000364 1784045374.393965 punch from 0x02103d to 0x021564 (0x528 bytes) 000365 1784045374.400235 trunc from 0x040000 to 0x026633 (0x199cc bytes) 000366 1784045374.431037 trunc from 0x00c19f to 0x011692 (0x54f4 bytes) 000367 1784045374.441923 read 0x01d72c thru 0x02308f (0x5964 bytes) 000368 1784045374.468046 write 0x02375b thru 0x02f533 (0xbdd9 bytes) 000369 1784045374.481954 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2f534): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f534): Mirror 2: 0xa8cf7f97 (stale) Mirror 3: 0xa8cf7f97 (stale) Mirror 4: 0xa8cf7f97 (stale) Mirror 5: 0xa8cf7f97 (stale) Mirror 6: 0xa8cf7f97 (stale) Mirror 7: 0xa8cf7f97 (stale) Mirror 8: 0xa8cf7f97 (stale) CRC-32 checksum value for chunk [0, 0x2f534): Mirror 1: 0x5f0e871f Mirror 9: 0x5f0e871f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f534: skipped 000370 1784045375.677261 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x2f534): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f534): Mirror 2: 0xa8cf7f97 (stale) Mirror 3: 0xa8cf7f97 (stale) Mirror 4: 0xa8cf7f97 (stale) Mirror 5: 0xa8cf7f97 (stale) Mirror 6: 0xa8cf7f97 (stale) Mirror 7: 0xa8cf7f97 (stale) Mirror 8: 0xa8cf7f97 (stale) CRC-32 checksum value for chunk [0, 0x2f534): Mirror 1: 0x5f0e871f Mirror 9: 0x5f0e871f Mirror 10: 0x5f0e871f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f534: skipped 000371 1784045376.978794 trunc from 0x02f534 to 0x00526a (0x2a2c9 bytes) 000372 1784045377.079699 MIRROR_RESYNC 10 mirrors 000373 1784045378.641475 read 0x004a74 thru 0x00526a (0x7f7 bytes) 000374 1784045378.657920 MIRROR_SPLIT mirror 5 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) 000375 1784045379.108118 punch from 0x0004fa to 0x00526a (0x4d71 bytes) 000376 1784045379.136541 mapwrite 0x031fb6 thru 0x039df4 (0x7e3f bytes) 000378 1784045379.213742 read 0x00f044 thru 0x01173d (0x26fa bytes) 000379 1784045379.220958 mapwrite 0x0340b9 thru 0x03fa88 (0xb9d0 bytes) 000381 1784045379.264997 trunc from 0x03fa89 to 0x03ac9f (0x4de9 bytes) 000383 1784045379.290867 fallocate 0x00a033 thru 0x00c53b (0x2509 bytes) 000384 1784045379.296993 mapwrite 0x015e08 thru 0x0220de (0xc2d7 bytes) 000385 1784045379.383862 MIRROR_RESYNC 9 mirrors 000386 1784045382.092152 trunc from 0x03aca0 to 0x038821 (0x247e bytes) 000387 1784045382.188335 mapread 0x01ca9f thru 0x01f6f7 (0x2c59 bytes) 000388 1784045382.219299 trunc from 0x038822 to 0x0058e5 (0x32f3c bytes) 000390 1784045382.260057 write 0x0239d0 thru 0x026daf (0x33e0 bytes) 000392 1784045382.264347 write 0x03d8d4 thru 0x03ffff (0x272c bytes) 000393 1784045382.266568 trunc from 0x008566 to 0x017662 (0xf0fd bytes) 000394 1784045382.281335 read 0x02c88f thru 0x038bb2 (0xc324 bytes) 000395 1784045382.292452 punch from 0x03ead4 to 0x03ffff (0x152c bytes) 000396 1784045382.342514 write 0x019e34 thru 0x01b35f (0x152c bytes) 000397 1784045382.370926 trunc from 0x040000 to 0x0112b0 (0x2ed4f bytes) 000398 1784045382.426558 read 0x00ca4a thru 0x010d2e (0x42e5 bytes) 000399 1784045382.459640 punch from 0x008a75 to 0x0112b0 (0x883c bytes) 000400 1784045382.479777 fallocate 0x014043 thru 0x0213d5 (0xd393 bytes) 000401 1784045382.499117 read 0x005367 thru 0x009255 (0x3eef bytes) 000402 1784045382.548988 write 0x02afc8 thru 0x032060 (0x7099 bytes) 000403 1784045382.550569 trunc from 0x005664 to 0x010749 (0xb0e6 bytes) 000404 1784045382.570488 MIRROR_RESYNC 9 mirrors 000405 1784045384.129699 MIRROR_RESYNC 9 mirrors 000406 1784045384.609065 trunc from 0x032061 to 0x01085d (0x21803 bytes) 000407 1784045384.662532 mapread 0x005a12 thru 0x006555 (0xb44 bytes) 000408 1784045384.676774 read 0x008e6d thru 0x00c539 (0x36cd bytes) 000409 1784045384.686674 read 0x00146e thru 0x00f741 (0xe2d4 bytes) 000410 1784045384.698751 read 0x00e5a7 thru 0x01085d (0x22b7 bytes) 000411 1784045384.709420 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1085e): Mirror 2: 0x18b6e7d4 (stale) Mirror 3: 0x18b6e7d4 (stale) Mirror 5: 0x18b6e7d4 (stale) Mirror 7: 0x18b6e7d4 (stale) Mirror 8: 0x18b6e7d4 (stale) Mirror 9: 0x18b6e7d4 (stale) Mirror 10: 0x18b6e7d4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1085e): Mirror 2: 0x18b6e7d4 (stale) Mirror 3: 0x18b6e7d4 (stale) Mirror 5: 0x18b6e7d4 (stale) Mirror 7: 0x18b6e7d4 (stale) Mirror 8: 0x18b6e7d4 (stale) Mirror 9: 0x18b6e7d4 (stale) Mirror 10: 0x18b6e7d4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1085e: skipped 000412 1784045385.277959 punch from 0x000a68 to 0x00b51b (0xaab4 bytes) 000413 1784045385.283879 mapwrite 0x015cc9 thru 0x0258b5 (0xfbed bytes) 000415 1784045385.376012 trunc from 0x0150e3 to 0x024cd9 (0xfbf7 bytes) 000416 1784045385.387017 mapwrite 0x009c39 thru 0x017807 (0xdbcf bytes) 000417 1784045385.452168 trunc from 0x0258b6 to 0x029d9f (0x44ea bytes) 000418 1784045385.480247 trunc from 0x029da0 to 0x0156c4 (0x146db bytes) 000419 1784045385.506117 mapwrite 0x034a8a thru 0x03a8f7 (0x5e6e bytes) 000421 1784045385.624154 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a8f8): Mirror 2: 0xa78a4ee7 (stale) Mirror 3: 0xa78a4ee7 (stale) Mirror 5: 0xa78a4ee7 (stale) Mirror 7: 0xa78a4ee7 (stale) Mirror 8: 0xa78a4ee7 (stale) Mirror 9: 0xa78a4ee7 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a8f8): Mirror 2: 0xa78a4ee7 (stale) Mirror 3: 0xa78a4ee7 (stale) Mirror 5: 0xa78a4ee7 (stale) Mirror 7: 0xa78a4ee7 (stale) Mirror 8: 0xa78a4ee7 (stale) Mirror 9: 0xa78a4ee7 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a8f8: skipped 000422 1784045386.214657 read 0x01a760 thru 0x01bf7f (0x1820 bytes) 000423 1784045386.225951 mapread 0x01faac thru 0x0256ca (0x5c1f bytes) 000424 1784045386.253406 punch from 0x01ee5a to 0x01fd2d (0xed4 bytes) 000425 1784045386.259654 trunc from 0x03a8f8 to 0x00957d (0x3137a bytes) 000426 1784045386.282880 trunc from 0x000f6d to 0x004cb1 (0x3d45 bytes) 000427 1784045386.287809 punch from 0x0039c0 to 0x00957d (0x5bbe bytes) 000428 1784045386.292444 read 0x00184a thru 0x00957d (0x7d34 bytes) 000429 1784045386.299597 punch from 0x0026db to 0x00957d (0x6ea3 bytes) 000430 1784045386.305129 mapread 0x0049c3 thru 0x00957d (0x4bbb bytes) 000432 1784045386.343328 trunc from 0x00957e to 0x0015dc (0x7fa1 bytes) 000433 1784045386.356591 fallocate 0x020d86 thru 0x02c2d8 (0xb553 bytes) 000434 1784045386.363636 mapwrite 0x0081ae thru 0x016b78 (0xe9cb bytes) 000435 1784045386.496885 fallocate 0x011178 thru 0x0173a1 (0x622a bytes) 000436 1784045386.505834 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x173a2): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x173a2): Mirror 2: 0x1cdd3125 (stale) Mirror 3: 0x1cdd3125 (stale) Mirror 5: 0x1cdd3125 (stale) Mirror 7: 0x1cdd3125 (stale) Mirror 8: 0x1cdd3125 (stale) Mirror 9: 0x1cdd3125 (stale) CRC-32 checksum value for chunk [0, 0x173a2): Mirror 1: 0xd30b9434 Mirror 10: 0xd30b9434 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x173a2: skipped 000437 1784045387.786956 mapread 0x00d693 thru 0x015449 (0x7db7 bytes) 000438 1784045387.815915 read 0x00a4c4 thru 0x00c92b (0x2468 bytes) 000439 1784045387.826769 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x173a2): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x173a2): Mirror 2: 0x1cdd3125 (stale) Mirror 3: 0x1cdd3125 (stale) Mirror 5: 0x1cdd3125 (stale) Mirror 7: 0x1cdd3125 (stale) Mirror 8: 0x1cdd3125 (stale) Mirror 9: 0x1cdd3125 (stale) CRC-32 checksum value for chunk [0, 0x173a2): Mirror 1: 0xd30b9434 Mirror 10: 0xd30b9434 Mirror 11: 0xd30b9434 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x173a2: skipped 000440 1784045388.791947 mapwrite 0x0021ec thru 0x005103 (0x2f18 bytes) 000441 1784045388.958624 mapwrite 0x0270e0 thru 0x02e763 (0x7684 bytes) 000442 1784045389.047021 write 0x023450 thru 0x02b5bd (0x816e bytes) 000443 1784045389.059698 MIRROR_RESYNC 9 mirrors 000444 1784045392.042587 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) 000445 1784045392.690330 MIRROR_RESYNC 8 mirrors 000446 1784045393.704664 trunc from 0x02e764 to 0x01925a (0x15509 bytes) 000447 1784045393.818732 trunc from 0x008ad9 to 0x011ce9 (0x9211 bytes) 000448 1784045393.830454 mapwrite 0x02f2c7 thru 0x02fa19 (0x753 bytes) 000449 1784045393.904701 punch from 0x0291c0 to 0x02fa19 (0x685a bytes) 000450 1784045393.910911 trunc from 0x02fa1a to 0x020741 (0xf2d8 bytes) 000451 1784045393.930831 mapwrite 0x03c522 thru 0x03ffff (0x3ade bytes) 000452 1784045393.985426 mapwrite 0x019d97 thru 0x02123c (0x74a6 bytes) 000453 1784045394.040658 punch from 0x014b67 to 0x02086c (0xbd06 bytes) 000454 1784045394.046864 write 0x0378e8 thru 0x03de48 (0x6561 bytes) 000455 1784045394.049845 punch from 0x010558 to 0x01065f (0x108 bytes) 000456 1784045394.061782 write 0x029f91 thru 0x02ac7a (0xcea bytes) 000458 1784045394.091375 mapread 0x03dc5e thru 0x03ffff (0x23a2 bytes) 000459 1784045394.098922 punch from 0x00d6e4 to 0x00e648 (0xf65 bytes) 000460 1784045394.113318 punch from 0x0031ff to 0x00a881 (0x7683 bytes) 000461 1784045394.135116 write 0x011787 thru 0x011d5b (0x5d5 bytes) 000462 1784045394.154010 mapwrite 0x00b9e0 thru 0x01b123 (0xf744 bytes) 000463 1784045394.239145 punch from 0x00ab8c to 0x0168c4 (0xbd39 bytes) 000464 1784045394.247721 fallocate 0x01f967 thru 0x029a88 (0xa122 bytes) 000465 1784045394.256935 read 0x01d5fb thru 0x02d093 (0xfa99 bytes) 000466 1784045394.277790 mapwrite 0x005b54 thru 0x011002 (0xb4af bytes) 000467 1784045394.315016 fallocate 0x030e8b thru 0x039b88 (0x8cfe bytes) 000468 1784045394.320701 trunc from 0x03859f to 0x03fc05 (0x7667 bytes) 000469 1784045394.327098 trunc from 0x01b323 to 0x029313 (0xdff1 bytes) 000470 1784045394.335578 fallocate 0x02b4f4 thru 0x02d4bb (0x1fc8 bytes) 000471 1784045394.341767 trunc from 0x01ba29 to 0x01bec9 (0x4a1 bytes) 000472 1784045394.357447 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x8f6c6851 (stale) Mirror 5: 0x8f6c6851 (stale) Mirror 7: 0x8f6c6851 (stale) Mirror 8: 0x8f6c6851 (stale) Mirror 9: 0x8f6c6851 (stale) Mirror 10: 0x8f6c6851 (stale) Mirror 11: 0x8f6c6851 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2fb3d96 Mirror 12: 0x2fb3d96 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000473 1784045395.817679 mapwrite 0x018b4a thru 0x02649f (0xd956 bytes) 000474 1784045395.964696 punch from 0x02bfb2 to 0x033b9c (0x7beb bytes) 000475 1784045395.976346 MIRROR_RESYNC 9 mirrors 000476 1784045399.935020 trunc from 0x003956 to 0x01260e (0xecb9 bytes) 000477 1784045399.989999 mapwrite 0x01c40c thru 0x02a0a3 (0xdc98 bytes) 000478 1784045400.046916 fallocate 0x009e1e thru 0x00b5ea (0x17cd bytes) 000479 1784045400.055962 write 0x032db0 thru 0x03ffff (0xd250 bytes) 000480 1784045400.065877 read 0x023725 thru 0x023e04 (0x6e0 bytes) 000481 1784045400.067666 trunc from 0x040000 to 0x030e90 (0xf16f bytes) 000482 1784045400.100040 mapwrite 0x029e1c thru 0x035924 (0xbb09 bytes) 000483 1784045400.176887 read 0x011bc5 thru 0x01a10f (0x854b bytes) 000484 1784045400.188780 mapwrite 0x034e07 thru 0x03bf07 (0x7101 bytes) 000486 1784045400.246418 write 0x000956 thru 0x00e29f (0xd94a bytes) 000488 1784045400.252753 read 0x039687 thru 0x03bf07 (0x2881 bytes) 000489 1784045400.253706 trunc from 0x00947a to 0x018899 (0xf420 bytes) 000490 1784045400.274217 trunc from 0x02641d to 0x02bc06 (0x57ea bytes) 000491 1784045400.282921 write 0x03ac0b thru 0x03ffff (0x53f5 bytes) 000492 1784045400.287638 read 0x0116f0 thru 0x016b4b (0x545c bytes) 000493 1784045400.302662 trunc from 0x03802b to 0x03c9c0 (0x4996 bytes) 000494 1784045400.320986 mapread 0x02b2cf thru 0x0399b1 (0xe6e3 bytes) 000495 1784045400.339461 trunc from 0x040000 to 0x034769 (0xb896 bytes) 000496 1784045400.366607 MIRROR_RESYNC 9 mirrors 000497 1784045402.784638 write 0x036be8 thru 0x03ffff (0x9418 bytes) 000498 1784045402.847162 fallocate 0x01031f thru 0x012599 (0x227b bytes) 000500 1784045402.858712 fallocate 0x02fbe8 thru 0x03945f (0x9878 bytes) 000501 1784045402.873554 trunc from 0x00980a to 0x00cc21 (0x3418 bytes) 000502 1784045402.881060 trunc from 0x040000 to 0x037195 (0x8e6a bytes) 000503 1784045402.950533 trunc from 0x037196 to 0x027ade (0xf6b7 bytes) 000504 1784045403.000772 mapread 0x00011e thru 0x004d2a (0x4c0d bytes) 000505 1784045403.062680 mapread 0x00ea37 thru 0x013e6b (0x5435 bytes) 000506 1784045403.088659 write 0x025988 thru 0x032c02 (0xd27b bytes) 000507 1784045403.106519 punch from 0x015db9 to 0x0242b7 (0xe4ff bytes) 000508 1784045403.116676 trunc from 0x0086e1 to 0x00fc6f (0x758f bytes) 000509 1784045403.132619 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x32c03): Mirror 2: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32c03): Mirror 2: 0xde09b2e9 (stale) Mirror 5: 0xde09b2e9 (stale) Mirror 7: 0xde09b2e9 (stale) Mirror 8: 0xde09b2e9 (stale) Mirror 9: 0xde09b2e9 (stale) Mirror 10: 0xde09b2e9 (stale) Mirror 11: 0xde09b2e9 (stale) Mirror 12: 0xde09b2e9 (stale) CRC-32 checksum value for chunk [0, 0x32c03): Mirror 1: 0x82f48417 Mirror 13: 0x82f48417 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32c03: skipped 000510 1784045404.124270 MIRROR_RESYNC 10 mirrors 000511 1784045405.825877 mapwrite 0x007eb4 thru 0x0171e2 (0xf32f bytes) 000512 1784045405.946262 fallocate 0x03ce30 thru 0x03ffff (0x31d0 bytes) 000513 1784045405.951978 mapread 0x02bfcd thru 0x02e6c6 (0x26fa bytes) 000514 1784045405.961678 trunc from 0x01da75 to 0x023167 (0x56f3 bytes) 000515 1784045405.967222 fallocate 0x03e2d9 thru 0x03ffff (0x1d27 bytes) 000516 1784045405.972800 fallocate 0x0181f4 thru 0x019fd8 (0x1de5 bytes) 000517 1784045405.977761 punch from 0x02fcbd to 0x03d95c (0xdca0 bytes) 000518 1784045405.983301 write 0x01cf18 thru 0x02b93b (0xea24 bytes) 000519 1784045405.992776 fallocate 0x016d31 thru 0x016e32 (0x102 bytes) 000520 1784045405.999590 mapwrite 0x020c2f thru 0x0256f2 (0x4ac4 bytes) 000521 1784045406.019937 mapwrite 0x01e213 thru 0x024a1e (0x680c bytes) 000523 1784045406.042440 mapread 0x0366c1 thru 0x03ab84 (0x44c4 bytes) 000526 1784045406.064470 MIRROR_RESYNC 10 mirrors 000527 1784045408.120406 MIRROR_RESYNC 10 mirrors 000529 1784045408.722432 trunc from 0x01df6b to 0x0258f1 (0x7987 bytes) 000530 1784045408.771744 trunc from 0x040000 to 0x01d5a4 (0x22a5b bytes) 000531 1784045408.805198 trunc from 0x01d5a5 to 0x017b3f (0x5a65 bytes) 000532 1784045408.835236 mapwrite 0x001949 thru 0x004de0 (0x3498 bytes) 000533 1784045408.899613 MIRROR_RESYNC 10 mirrors 000534 1784045410.004926 MIRROR_SPLIT mirror 4 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) 000535 1784045410.553491 mapread 0x014d0f thru 0x017b3f (0x2e31 bytes) 000536 1784045410.583365 read 0x0106ac thru 0x010ca8 (0x5fd bytes) 000537 1784045410.584259 mapwrite 0x004ec2 thru 0x007131 (0x2270 bytes) 000538 1784045410.710215 write 0x004794 thru 0x011d1d (0xd58a bytes) 000540 1784045410.735754 write 0x03bcbc thru 0x03d843 (0x1b88 bytes) 000541 1784045410.743096 trunc from 0x03d844 to 0x033fb5 (0x988e bytes) 000543 1784045410.767959 fallocate 0x00e279 thru 0x01042a (0x21b2 bytes) 000544 1784045410.776210 write 0x00dfae thru 0x01996b (0xb9be bytes) 000546 1784045410.796444 MIRROR_RESYNC 9 mirrors 000548 1784045412.545495 mapread 0x008ada thru 0x009f5b (0x1482 bytes) 000549 1784045412.589315 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) 000550 1784045413.174486 read 0x012121 thru 0x018a68 (0x6948 bytes) 000551 1784045413.186477 write 0x026ca4 thru 0x028568 (0x18c5 bytes) 000552 1784045413.251117 MIRROR_RESYNC 8 mirrors 000553 1784045415.622993 read 0x029612 thru 0x02b2db (0x1cca bytes) 000555 1784045415.629889 mapwrite 0x012707 thru 0x021cea (0xf5e4 bytes) 000556 1784045415.863971 write 0x0067b4 thru 0x011b1f (0xb36c bytes) 000558 1784045415.872740 mapwrite 0x03ed42 thru 0x03ffff (0x12be bytes) 000560 1784045415.988593 mapwrite 0x02626f thru 0x030a57 (0xa7e9 bytes) 000561 1784045416.056724 write 0x039c79 thru 0x03ffff (0x6387 bytes) 000562 1784045416.066501 write 0x00699a thru 0x013854 (0xcebb bytes) 000563 1784045416.069379 mapread 0x00d48f thru 0x010704 (0x3276 bytes) 000564 1784045416.070750 punch from 0x031b2b to 0x03ffff (0xe4d5 bytes) 000565 1784045416.097739 mapwrite 0x02df94 thru 0x033257 (0x52c4 bytes) 000566 1784045416.139142 mapread 0x02879f thru 0x035030 (0xc892 bytes) 000567 1784045416.143611 read 0x00d0a9 thru 0x01b361 (0xe2b9 bytes) 000568 1784045416.144748 trunc from 0x040000 to 0x02305a (0x1cfa5 bytes) 000569 1784045416.172399 MIRROR_RESYNC 8 mirrors 000570 1784045417.696820 punch from 0x0192ba to 0x01932e (0x75 bytes) 000571 1784045417.751771 mapread 0x0195b9 thru 0x01f37f (0x5dc7 bytes) 000572 1784045417.777346 trunc from 0x0058c5 to 0x011fc3 (0xc6ff bytes) 000573 1784045417.784421 mapwrite 0x0223b7 thru 0x022dea (0xa34 bytes) 000574 1784045417.800979 read 0x0147b6 thru 0x0208a1 (0xc0ec bytes) 000575 1784045417.802158 punch from 0x01f5b3 to 0x02305a (0x3aa8 bytes) 000576 1784045417.811125 fallocate 0x023aab thru 0x02695f (0x2eb5 bytes) 000577 1784045417.824872 punch from 0x002650 to 0x00c93f (0xa2f0 bytes) 000578 1784045417.837777 read 0x022e91 thru 0x02305a (0x1ca bytes) 000579 1784045417.863932 read 0x003a30 thru 0x00d8f8 (0x9ec9 bytes) 000580 1784045417.870878 read 0x010020 thru 0x01db64 (0xdb45 bytes) 000581 1784045417.873651 mapwrite 0x00f1e3 thru 0x01a9d2 (0xb7f0 bytes) 000582 1784045417.974048 punch from 0x009f87 to 0x00c931 (0x29ab bytes) 000583 1784045418.004453 MIRROR_RESYNC 8 mirrors 000584 1784045419.721341 mapwrite 0x00ccee thru 0x01261d (0x5930 bytes) 000585 1784045419.815627 write 0x02bf9f thru 0x03913c (0xd19e bytes) 000586 1784045419.817781 read 0x021e2c thru 0x02bf47 (0xa11c bytes) 000587 1784045419.829467 punch from 0x00521a to 0x0068fd (0x16e4 bytes) 000588 1784045419.835010 write 0x03f15a thru 0x03ffff (0xea6 bytes) 000590 1784045419.838577 trunc from 0x040000 to 0x001b4e (0x3e4b1 bytes) 000592 1784045419.884583 punch from 0x000c74 to 0x001b4e (0xedb bytes) 000593 1784045419.909860 punch from 0x0011d6 to 0x001b4e (0x979 bytes) 000595 1784045419.921204 fallocate 0x00367c thru 0x00ff2c (0xc8b1 bytes) 000596 1784045419.926930 write 0x003cc8 thru 0x007ddd (0x4116 bytes) 000597 1784045419.945327 trunc from 0x00ff2d to 0x02b81f (0x1b8f3 bytes) 000598 1784045419.972137 write 0x022695 thru 0x029aa9 (0x7415 bytes) 000599 1784045419.989785 write 0x02ff10 thru 0x03fb53 (0xfc44 bytes) 000600 1784045419.998593 MIRROR_RESYNC 8 mirrors 000601 1784045422.037899 mapread 0x00f2ef thru 0x0123e6 (0x30f8 bytes) 000602 1784045422.058126 mapread 0x016443 thru 0x01be04 (0x59c2 bytes) 000603 1784045422.070869 mapwrite 0x032713 thru 0x036b48 (0x4436 bytes) 000604 1784045422.171696 trunc from 0x016280 to 0x01e5b9 (0x833a bytes) 000605 1784045422.179033 mapwrite 0x0038f1 thru 0x007554 (0x3c64 bytes) 000606 1784045422.211945 trunc from 0x03fb54 to 0x032393 (0xd7c0 bytes) 000607 1784045422.239396 trunc from 0x028ba2 to 0x029ec8 (0x1327 bytes) 000608 1784045422.250027 fallocate 0x0043f9 thru 0x00612b (0x1d33 bytes) 000609 1784045422.257006 punch from 0x02cf1f to 0x032393 (0x5475 bytes) 000610 1784045422.263742 trunc from 0x00a088 to 0x018d59 (0xecd2 bytes) 000611 1784045422.269443 trunc from 0x032394 to 0x012d15 (0x1f67e bytes) 000612 1784045422.293656 MIRROR_RESYNC 8 mirrors 000613 1784045423.983064 punch from 0x0092e8 to 0x0122e9 (0x9002 bytes) 000614 1784045424.020458 trunc from 0x012d16 to 0x03fcc2 (0x2cfad bytes) 000615 1784045424.040950 read 0x006aba thru 0x00cc0a (0x6151 bytes) 000616 1784045424.056625 fallocate 0x00ddeb thru 0x01969d (0xb8b3 bytes) 000617 1784045424.062821 read 0x010383 thru 0x01dca9 (0xd927 bytes) 000618 1784045424.073438 trunc from 0x03fcc3 to 0x0287d2 (0x174f0 bytes) 000619 1784045424.088044 mapread 0x01b49e thru 0x02257a (0x70dd bytes) 000620 1784045424.089315 mapwrite 0x033b15 thru 0x0368aa (0x2d96 bytes) 000621 1784045424.131058 trunc from 0x0368ab to 0x001e70 (0x34a3a bytes) 000622 1784045424.146036 write 0x02b487 thru 0x02f856 (0x43d0 bytes) 000623 1784045424.148046 read 0x017ea5 thru 0x01f254 (0x73b0 bytes) 000624 1784045424.156711 trunc from 0x02f857 to 0x009824 (0x26032 bytes) 000625 1784045424.175618 write 0x00f2c5 thru 0x012d37 (0x3a73 bytes) 000626 1784045424.181441 fallocate 0x037f92 thru 0x03ffff (0x806e bytes) 000627 1784045424.192598 trunc from 0x040000 to 0x037b84 (0x847b bytes) 000628 1784045424.213698 fallocate 0x02ea9f thru 0x03acf9 (0xc25b bytes) 000629 1784045424.221330 trunc from 0x037b85 to 0x035a01 (0x2183 bytes) 000631 1784045424.249784 trunc from 0x035a02 to 0x032d36 (0x2ccb bytes) 000632 1784045424.277423 trunc from 0x011f70 to 0x01a56b (0x85fc bytes) 000633 1784045424.310617 fallocate 0x03aed5 thru 0x03cec1 (0x1fed bytes) 000634 1784045424.329067 mapwrite 0x01da59 thru 0x021310 (0x38b8 bytes) 000635 1784045424.426456 read 0x030672 thru 0x03a5e0 (0x9f6f bytes) 000636 1784045424.427944 mapwrite 0x02d3c2 thru 0x03cc1f (0xf85e bytes) 000637 1784045424.478125 punch from 0x02987b to 0x037d31 (0xe4b7 bytes) 000639 1784045424.488583 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3cec2): Mirror 7: 0xfcc97234 (stale) Mirror 9: 0xfcc97234 (stale) Mirror 10: 0xfcc97234 (stale) Mirror 11: 0xfcc97234 (stale) Mirror 12: 0xfcc97234 (stale) Mirror 13: 0xfcc97234 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cec2): Mirror 7: 0xfcc97234 (stale) Mirror 9: 0xfcc97234 (stale) Mirror 10: 0xfcc97234 (stale) Mirror 11: 0xfcc97234 (stale) Mirror 12: 0xfcc97234 (stale) Mirror 13: 0xfcc97234 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cec2: skipped 000640 1784045425.421624 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3cec2): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cec2): Mirror 7: 0xfcc97234 (stale) Mirror 9: 0xfcc97234 (stale) Mirror 10: 0xfcc97234 (stale) Mirror 11: 0xfcc97234 (stale) Mirror 12: 0xfcc97234 (stale) Mirror 13: 0xfcc97234 (stale) CRC-32 checksum value for chunk [0, 0x3cec2): Mirror 1: 0x1e7eb4c6 Mirror 14: 0x1e7eb4c6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cec2: skipped 000641 1784045426.784941 punch from 0x02a236 to 0x02e5cf (0x439a bytes) 000642 1784045426.867904 trunc from 0x03cec2 to 0x01434b (0x28b76 bytes) 000644 1784045426.903421 trunc from 0x01434c to 0x02f6f6 (0x1b3ab bytes) 000645 1784045426.932304 fallocate 0x01f9a6 thru 0x0252ad (0x5908 bytes) 000646 1784045426.938912 read 0x00f8e1 thru 0x01e48d (0xebad bytes) 000647 1784045426.955089 read 0x00c310 thru 0x01003a (0x3d2b bytes) 000648 1784045426.962793 fallocate 0x0278e3 thru 0x02a012 (0x2730 bytes) 000649 1784045426.970821 punch from 0x00d871 to 0x01610f (0x889f bytes) 000650 1784045426.975500 fallocate 0x002b2b thru 0x011951 (0xee27 bytes) 000651 1784045426.980415 fallocate 0x009f55 thru 0x016ea6 (0xcf52 bytes) 000652 1784045426.985845 fallocate 0x00386c thru 0x009bef (0x6384 bytes) 000653 1784045426.991277 trunc from 0x010696 to 0x013528 (0x2e93 bytes) 000654 1784045426.995460 fallocate 0x005d62 thru 0x00e09c (0x833b bytes) 000655 1784045427.002067 read 0x025879 thru 0x02f6f6 (0x9e7e bytes) 000656 1784045427.008004 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f6f7): Mirror 9: 0x9dbf1a7 (stale) Mirror 10: 0x9dbf1a7 (stale) Mirror 11: 0x9dbf1a7 (stale) Mirror 12: 0x9dbf1a7 (stale) Mirror 13: 0x9dbf1a7 (stale) Mirror 14: 0x1202acce (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f6f7): Mirror 9: 0x9dbf1a7 (stale) Mirror 10: 0x9dbf1a7 (stale) Mirror 11: 0x9dbf1a7 (stale) Mirror 12: 0x9dbf1a7 (stale) Mirror 13: 0x9dbf1a7 (stale) Mirror 14: 0x1202acce (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f6f7: skipped 000657 1784045427.551627 read 0x02f2e1 thru 0x02f6f6 (0x416 bytes) 000658 1784045427.558686 mapread 0x0126dd thru 0x01ef8d (0xc8b1 bytes) 000659 1784045427.610658 trunc from 0x02f6f7 to 0x003f33 (0x2b7c3 bytes) 000660 1784045427.651824 trunc from 0x000aa5 to 0x003f33 (0x348f bytes) 000661 1784045427.657556 write 0x035cde thru 0x03f376 (0x9699 bytes) 000662 1784045427.659235 trunc from 0x03f377 to 0x02fb86 (0xf7f0 bytes) 000664 1784045427.673040 mapwrite 0x0148f7 thru 0x0194c0 (0x4bca bytes) 000665 1784045427.705867 write 0x037ecc thru 0x03ffff (0x8134 bytes) 000666 1784045427.707357 trunc from 0x007b08 to 0x01284b (0xad44 bytes) 000667 1784045427.713513 fallocate 0x03ea17 thru 0x03ffff (0x15e9 bytes) 000668 1784045427.719589 mapwrite 0x000ca0 thru 0x00416c (0x34cd bytes) 000669 1784045427.757438 write 0x01fb0b thru 0x02041c (0x912 bytes) 000670 1784045427.771713 MIRROR_RESYNC 7 mirrors 000671 1784045429.958110 write 0x00e640 thru 0x01c5d5 (0xdf96 bytes) 000672 1784045430.009612 fallocate 0x0135ef thru 0x0159e2 (0x23f4 bytes) 000673 1784045430.014124 fallocate 0x0003d1 thru 0x00df1b (0xdb4b bytes) 000674 1784045430.022849 fallocate 0x0386c5 thru 0x03ffff (0x793b bytes) 000676 1784045430.034502 punch from 0x02389e to 0x024289 (0x9ec bytes) 000677 1784045430.039313 punch from 0x0231f4 to 0x02d95f (0xa76c bytes) 000678 1784045430.046361 trunc from 0x040000 to 0x0205e6 (0x1fa19 bytes) 000679 1784045430.068179 read 0x01449f thru 0x0205e6 (0xc148 bytes) 000680 1784045430.074047 mapread 0x018918 thru 0x01f4e1 (0x6bca bytes) 000681 1784045430.075399 mapread 0x0009f9 thru 0x0033e7 (0x29ef bytes) 000682 1784045430.101935 fallocate 0x038a5f thru 0x03d190 (0x4732 bytes) 000683 1784045430.108039 mapwrite 0x00c5e2 thru 0x01b360 (0xed7f bytes) 000684 1784045430.136272 write 0x017146 thru 0x020c33 (0x9aee bytes) 000685 1784045430.138771 mapwrite 0x02a52d thru 0x039517 (0xefeb bytes) 000686 1784045430.247661 write 0x004618 thru 0x009ba8 (0x5591 bytes) 000687 1784045430.254348 read 0x009080 thru 0x00c76b (0x36ec bytes) 000688 1784045430.271372 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39518): Mirror 9: 0x52d0fabb (stale) Mirror 10: 0x52d0fabb (stale) Mirror 11: 0x52d0fabb (stale) Mirror 12: 0x52d0fabb (stale) Mirror 14: 0x52d0fabb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39518): Mirror 9: 0x52d0fabb (stale) Mirror 10: 0x52d0fabb (stale) Mirror 11: 0x52d0fabb (stale) Mirror 12: 0x52d0fabb (stale) Mirror 14: 0x52d0fabb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39518: skipped 000690 1784045431.123359 write 0x03847e thru 0x03dcf8 (0x587b bytes) 000692 1784045431.139888 MIRROR_RESYNC 6 mirrors 000693 1784045432.612462 punch from 0x01cba8 to 0x02bff5 (0xf44e bytes) 000694 1784045432.638774 punch from 0x02ff5d to 0x03b692 (0xb736 bytes) 000695 1784045432.642949 mapread 0x02d798 thru 0x037bf0 (0xa459 bytes) 000698 1784045432.661557 trunc from 0x01011c to 0x01bdb0 (0xbc95 bytes) 000699 1784045432.667892 trunc from 0x03c26d to 0x03dcf8 (0x1a8c bytes) 000700 1784045432.674247 trunc from 0x03dcf9 to 0x00e67e (0x2f67a bytes) 000701 1784045432.693645 read 0x007936 thru 0x00a708 (0x2dd3 bytes) 000703 1784045432.707886 MIRROR_RESYNC 6 mirrors 000704 1784045433.761953 write 0x0115ca thru 0x01ecf8 (0xd72f bytes) 000705 1784045433.802304 fallocate 0x03f2a6 thru 0x03ffff (0xd5a bytes) 000706 1784045433.816422 MIRROR_RESYNC 6 mirrors 000707 1784045435.184979 mapwrite 0x005e73 thru 0x00d573 (0x7701 bytes) 000708 1784045435.273675 mapread 0x003ea5 thru 0x012854 (0xe9b0 bytes) 000709 1784045435.298815 trunc from 0x01ecf9 to 0x0095c6 (0x15732 bytes) 000710 1784045435.327730 mapwrite 0x016053 thru 0x023adf (0xda8d bytes) 000711 1784045435.422706 fallocate 0x0396b5 thru 0x03ffff (0x694b bytes) 000712 1784045435.443967 fallocate 0x0294ed thru 0x031901 (0x8415 bytes) 000713 1784045435.449541 mapwrite 0x01bdfd thru 0x02152d (0x5731 bytes) 000714 1784045435.467738 mapread 0x00adff thru 0x00bf53 (0x1155 bytes) 000715 1784045435.476555 write 0x018437 thru 0x019a5d (0x1627 bytes) 000716 1784045435.477958 mapread 0x02f353 thru 0x03d35f (0xe00d bytes) 000717 1784045435.525206 trunc from 0x040000 to 0x008915 (0x376ea bytes) 000718 1784045435.557475 punch from 0x004681 to 0x008915 (0x4295 bytes) 000719 1784045435.575647 read 0x0017b3 thru 0x0037a6 (0x1ff4 bytes) 000720 1784045435.590686 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x8916): Mirror 10: 0x70c7c74e (stale) Mirror 11: 0x70c7c74e (stale) Mirror 12: 0x70c7c74e (stale) Mirror 14: 0x70c7c74e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x8916): Mirror 10: 0x70c7c74e (stale) Mirror 11: 0x70c7c74e (stale) Mirror 12: 0x70c7c74e (stale) Mirror 14: 0x70c7c74e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x8916: skipped 000721 1784045436.106969 punch from 0x000990 to 0x0048c8 (0x3f39 bytes) 000722 1784045436.112274 write 0x01966d thru 0x01ecb5 (0x5649 bytes) 000723 1784045436.120420 read 0x0019ba thru 0x0084d4 (0x6b1b bytes) 000724 1784045436.138450 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1ecb6): Mirror 11: 0x261e64cb (stale) Mirror 12: 0x261e64cb (stale) Mirror 14: 0x261e64cb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ecb6): Mirror 11: 0x261e64cb (stale) Mirror 12: 0x261e64cb (stale) Mirror 14: 0x261e64cb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ecb6: skipped 000726 1784045436.781578 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1ecb6): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ecb6): Mirror 11: 0x261e64cb (stale) Mirror 12: 0x261e64cb (stale) Mirror 14: 0x261e64cb (stale) CRC-32 checksum value for chunk [0, 0x1ecb6): Mirror 1: 0x7da9b80f Mirror 15: 0x7da9b80f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ecb6: skipped 000727 1784045438.150098 trunc from 0x01ecb6 to 0x01aa6d (0x4248 bytes) 000728 1784045438.264623 punch from 0x01684d to 0x01aa6d (0x4221 bytes) 000729 1784045438.284603 punch from 0x015521 to 0x01aa6d (0x554d bytes) 000730 1784045438.290781 trunc from 0x00cf60 to 0x01a06f (0xd110 bytes) 000731 1784045438.305809 read 0x002055 thru 0x00b354 (0x9300 bytes) 000732 1784045438.318971 trunc from 0x0049d3 to 0x010366 (0xb994 bytes) 000733 1784045438.337269 trunc from 0x017aa3 to 0x01aa6d (0x2fcb bytes) 000734 1784045438.350128 mapread 0x0019d7 thru 0x003753 (0x1d7d bytes) 000736 1784045438.372189 mapread 0x01a919 thru 0x01aa6d (0x155 bytes) 000737 1784045438.388558 mapwrite 0x022176 thru 0x031e4b (0xfcd6 bytes) 000738 1784045438.525059 trunc from 0x003314 to 0x010f3f (0xdc2c bytes) 000739 1784045438.542879 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x31e4c): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31e4c): Mirror 11: 0x2aa27b0 (stale) Mirror 12: 0x2aa27b0 (stale) Mirror 14: 0x2aa27b0 (stale) Mirror 15: 0x72b053ff (stale) CRC-32 checksum value for chunk [0, 0x31e4c): Mirror 1: 0x8c69b609 Mirror 16: 0x8c69b609 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31e4c: skipped 000741 1784045439.840298 read 0x0318e2 thru 0x031e4b (0x56a bytes) 000742 1784045439.876132 punch from 0x029830 to 0x02d13f (0x3910 bytes) 000743 1784045439.945530 mapread 0x001cf1 thru 0x00f526 (0xd836 bytes) 000744 1784045440.027327 MIRROR_RESYNC 6 mirrors 000745 1784045442.268210 read 0x001bf4 thru 0x00d521 (0xb92e bytes) 000746 1784045442.276265 mapwrite 0x0260b2 thru 0x0265d1 (0x520 bytes) 000747 1784045442.454625 read 0x009b5b thru 0x015b47 (0xbfed bytes) 000749 1784045442.498928 mapread 0x022727 thru 0x02aa2f (0x8309 bytes) 000750 1784045442.509440 MIRROR_RESYNC 6 mirrors 000751 1784045444.394138 MIRROR_RESYNC 6 mirrors 000752 1784045444.999627 punch from 0x01a531 to 0x01bdf6 (0x18c6 bytes) 000753 1784045445.033377 trunc from 0x031e4c to 0x03fb4e (0xdd03 bytes) 000754 1784045445.061512 mapwrite 0x039c03 thru 0x03ffff (0x63fd bytes) 000755 1784045445.124577 punch from 0x00f5b1 to 0x018a52 (0x94a2 bytes) 000756 1784045445.133873 MIRROR_RESYNC 6 mirrors 000757 1784045447.409687 trunc from 0x037751 to 0x03ffff (0x88af bytes) 000758 1784045447.453975 trunc from 0x036d09 to 0x03ffff (0x92f7 bytes) 000759 1784045447.461464 mapread 0x026b40 thru 0x035b62 (0xf023 bytes) 000760 1784045447.497696 write 0x00ee66 thru 0x016286 (0x7421 bytes) 000761 1784045447.511290 trunc from 0x040000 to 0x00c822 (0x337dd bytes) 000762 1784045447.542748 write 0x01b080 thru 0x022d2c (0x7cad bytes) 000763 1784045447.545262 fallocate 0x0042d7 thru 0x012d06 (0xea30 bytes) 000764 1784045447.553978 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x22d2d): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22d2d): Mirror 11: 0xbc592c9c (stale) Mirror 12: 0xbc592c9c (stale) Mirror 14: 0xbc592c9c (stale) Mirror 15: 0xbc592c9c (stale) Mirror 16: 0xbc592c9c (stale) CRC-32 checksum value for chunk [0, 0x22d2d): Mirror 1: 0x4c816c34 Mirror 17: 0x4c816c34 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22d2d: skipped 000765 1784045448.463008 write 0x01d581 thru 0x026874 (0x92f4 bytes) 000766 1784045448.582818 punch from 0x00de0f to 0x017486 (0x9678 bytes) 000767 1784045448.595178 mapwrite 0x019812 thru 0x028a8f (0xf27e bytes) 000769 1784045448.763555 mapwrite 0x014956 thru 0x021c9b (0xd346 bytes) 000770 1784045448.803430 fallocate 0x007542 thru 0x00f6e1 (0x81a0 bytes) 000771 1784045448.818711 MIRROR_RESYNC 7 mirrors 000772 1784045450.284437 mapread 0x007031 thru 0x00e409 (0x73d9 bytes) 000774 1784045450.307236 punch from 0x004ec3 to 0x00a26e (0x53ac bytes) 000775 1784045450.347031 punch from 0x009d07 to 0x01746e (0xd768 bytes) 000776 1784045450.355938 write 0x01760a thru 0x024968 (0xd35f bytes) 000777 1784045450.378013 MIRROR_RESYNC 7 mirrors 000778 1784045451.640639 punch from 0x01a480 to 0x024787 (0xa308 bytes) 000779 1784045451.671027 fallocate 0x00053b thru 0x00641f (0x5ee5 bytes) 000780 1784045451.678178 mapread 0x01553a thru 0x015639 (0x100 bytes) 000782 1784045451.687464 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x28a90): Mirror 11: 0xafbdb5d9 (stale) Mirror 12: 0xafbdb5d9 (stale) Mirror 14: 0xafbdb5d9 (stale) Mirror 15: 0xafbdb5d9 (stale) Mirror 17: 0xafbdb5d9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28a90): Mirror 11: 0xafbdb5d9 (stale) Mirror 12: 0xafbdb5d9 (stale) Mirror 14: 0xafbdb5d9 (stale) Mirror 15: 0xafbdb5d9 (stale) Mirror 17: 0xafbdb5d9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28a90: skipped 000783 1784045452.061718 read 0x027877 thru 0x028a8f (0x1219 bytes) 000784 1784045452.069792 write 0x03fadc thru 0x03ffff (0x524 bytes) 000785 1784045452.075969 trunc from 0x040000 to 0x0163cf (0x29c30 bytes) 000786 1784045452.088769 mapwrite 0x01566a thru 0x0164d3 (0xe6a bytes) 000787 1784045452.136865 trunc from 0x015cbe to 0x0164d3 (0x816 bytes) 000788 1784045452.147263 trunc from 0x00f92d to 0x0164d3 (0x6ba7 bytes) 000789 1784045452.169601 trunc from 0x0082ca to 0x0152ab (0xcfe2 bytes) 000791 1784045452.193675 fallocate 0x028827 thru 0x038148 (0xf922 bytes) 000792 1784045452.206751 mapread 0x02e3d2 thru 0x031595 (0x31c4 bytes) 000793 1784045452.231326 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38149): Mirror 11: 0x10aaed2f (stale) Mirror 12: 0x10aaed2f (stale) Mirror 14: 0x10aaed2f (stale) Mirror 17: 0x10aaed2f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38149): Mirror 11: 0x10aaed2f (stale) Mirror 12: 0x10aaed2f (stale) Mirror 14: 0x10aaed2f (stale) Mirror 17: 0x10aaed2f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38149: skipped 000796 1784045452.742931 mapread 0x01a58b thru 0x02015e (0x5bd4 bytes) 000798 1784045452.763926 mapread 0x037c16 thru 0x038148 (0x533 bytes) 000799 1784045452.773531 mapread 0x009259 thru 0x009b3e (0x8e6 bytes) 000800 1784045452.784355 write 0x01d1fd thru 0x020107 (0x2f0b bytes) 000801 1784045452.788424 trunc from 0x003886 to 0x01190d (0xe088 bytes) 000802 1784045452.800268 trunc from 0x02ae0e to 0x032a9a (0x7c8d bytes) 000803 1784045452.809254 MIRROR_RESYNC 5 mirrors 000804 1784045454.460013 write 0x01c3be thru 0x023cc0 (0x7903 bytes) 000806 1784045454.518050 mapread 0x003afb thru 0x00cb16 (0x901c bytes) 000807 1784045454.562033 punch from 0x0079a9 to 0x012270 (0xa8c8 bytes) 000808 1784045454.567021 read 0x0110d4 thru 0x0141c2 (0x30ef bytes) 000811 1784045454.574784 mapwrite 0x002371 thru 0x010336 (0xdfc6 bytes) 000812 1784045454.684061 read 0x016c55 thru 0x01c077 (0x5423 bytes) 000813 1784045454.700100 read 0x02a3c2 thru 0x03557d (0xb1bc bytes) 000815 1784045454.701482 mapread 0x0359eb thru 0x038148 (0x275e bytes) 000816 1784045454.704680 mapwrite 0x0146a4 thru 0x01ecb3 (0xa610 bytes) 000817 1784045454.774810 mapwrite 0x028505 thru 0x034f80 (0xca7c bytes) 000818 1784045454.847391 punch from 0x0088e2 to 0x00b04a (0x2769 bytes) 000819 1784045454.903738 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x38149): Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38149): Mirror 11: 0xc43505bb (stale) Mirror 12: 0xc43505bb (stale) Mirror 14: 0xc43505bb (stale) Mirror 17: 0xc43505bb (stale) CRC-32 checksum value for chunk [0, 0x38149): Mirror 1: 0x63ecefbb Mirror 18: 0x63ecefbb lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38149: skipped 000820 1784045456.368893 trunc from 0x038149 to 0x02f133 (0x9015 bytes) 000821 1784045456.462986 punch from 0x00afcb to 0x0192b9 (0xe2ef bytes) 000822 1784045456.477137 mapread 0x02c197 thru 0x02f133 (0x2f9d bytes) 000823 1784045456.521455 trunc from 0x00a532 to 0x011581 (0x7050 bytes) 000824 1784045456.537621 read 0x02d620 thru 0x02f133 (0x1b14 bytes) 000825 1784045456.550215 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2f134): Mirror 11: 0x346c914a (stale) Mirror 12: 0x346c914a (stale) Mirror 14: 0x346c914a (stale) Mirror 18: 0xcf6a8e1a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f134): Mirror 11: 0x346c914a (stale) Mirror 12: 0x346c914a (stale) Mirror 14: 0x346c914a (stale) Mirror 18: 0xcf6a8e1a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f134: skipped 000826 1784045456.969990 punch from 0x00a0d6 to 0x013c0a (0x9b35 bytes) 000827 1784045456.977649 punch from 0x022430 to 0x02df03 (0xbad4 bytes) 000828 1784045456.984106 mapwrite 0x01d16f thru 0x024ed9 (0x7d6b bytes) 000829 1784045457.027390 fallocate 0x0223e1 thru 0x027bbc (0x57dc bytes) 000830 1784045457.033718 trunc from 0x02f134 to 0x03858d (0x945a bytes) 000831 1784045457.052430 write 0x01346f thru 0x01ac8b (0x781d bytes) 000833 1784045457.064486 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3858e): Mirror 12: 0x32bd41f3 (stale) Mirror 14: 0x32bd41f3 (stale) Mirror 18: 0xe8f85198 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3858e): Mirror 12: 0x32bd41f3 (stale) Mirror 14: 0x32bd41f3 (stale) Mirror 18: 0xe8f85198 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3858e: skipped 000834 1784045457.625248 write 0x0219e7 thru 0x02ce2f (0xb449 bytes) 000835 1784045457.655933 trunc from 0x003dcc to 0x00bb59 (0x7d8e bytes) 000837 1784045457.664562 mapread 0x001abd thru 0x003f0b (0x244f bytes) 000838 1784045457.684783 read 0x0244c1 thru 0x025c31 (0x1771 bytes) 000839 1784045457.685729 fallocate 0x0311bd thru 0x03c74a (0xb58e bytes) 000840 1784045457.691191 write 0x038a32 thru 0x03b5b3 (0x2b82 bytes) 000843 1784045457.731010 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3c74b): Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c74b): Mirror 12: 0x97a5586c (stale) Mirror 14: 0x97a5586c (stale) Mirror 18: 0xf681a557 (stale) CRC-32 checksum value for chunk [0, 0x3c74b): Mirror 1: 0x6d717eda Mirror 19: 0x6d717eda lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c74b: skipped 000844 1784045459.147878 fallocate 0x03888b thru 0x03ffff (0x7775 bytes) 000845 1784045459.234633 trunc from 0x031925 to 0x03a2b2 (0x898e bytes) 000846 1784045459.243423 trunc from 0x040000 to 0x01b4e6 (0x24b19 bytes) 000847 1784045459.293485 write 0x017a7a thru 0x020eb6 (0x943d bytes) 000849 1784045459.300152 trunc from 0x020eb7 to 0x01d336 (0x3b80 bytes) 000850 1784045459.337862 fallocate 0x002c36 thru 0x0086d5 (0x5aa0 bytes) 000851 1784045459.347915 mapwrite 0x030582 thru 0x03e48f (0xdf0e bytes) 000852 1784045459.458618 trunc from 0x0074de to 0x013f1c (0xca3f bytes) 000853 1784045459.464742 trunc from 0x03e490 to 0x01696b (0x27b24 bytes) 000854 1784045459.498658 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1696c): Mirror 12: 0xd18863a9 (stale) Mirror 18: 0x300d6da9 (stale) Mirror 19: 0xffc3f6b9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1696c): Mirror 12: 0xd18863a9 (stale) Mirror 18: 0x300d6da9 (stale) Mirror 19: 0xffc3f6b9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1696c: skipped 000855 1784045459.879335 write 0x02b30d thru 0x038ba6 (0xd89a bytes) 000856 1784045459.885434 punch from 0x005df2 to 0x00bebd (0x60cc bytes) 000857 1784045459.891598 fallocate 0x01cc72 thru 0x02693b (0x9cca bytes) 000858 1784045459.897006 read 0x01eb80 thru 0x02a18b (0xb60c bytes) 000859 1784045459.906433 write 0x00ef78 thru 0x016e6c (0x7ef5 bytes) 000860 1784045459.918261 read 0x017290 thru 0x018b64 (0x18d5 bytes) 000862 1784045459.935453 read 0x01aed9 thru 0x0297d8 (0xe900 bytes) 000863 1784045459.936351 trunc from 0x002516 to 0x0037d2 (0x12bd bytes) 000864 1784045459.942670 mapwrite 0x03c155 thru 0x03ffff (0x3eab bytes) 000865 1784045459.996276 read 0x01d5b3 thru 0x02c401 (0xee4f bytes) 000866 1784045459.997295 read 0x024fe0 thru 0x029088 (0x40a9 bytes) 000867 1784045459.999257 mapread 0x00740c thru 0x007cda (0x8cf bytes) 000868 1784045460.000998 mapwrite 0x0118fa thru 0x019736 (0x7e3d bytes) 000869 1784045460.020410 mapread 0x034ebe thru 0x03f44e (0xa591 bytes) 000870 1784045460.023150 trunc from 0x040000 to 0x022971 (0x1d68e bytes) 000871 1784045460.041437 mapread 0x01d56e thru 0x022971 (0x5404 bytes) 000872 1784045460.043438 mapwrite 0x0121bb thru 0x014a7d (0x28c3 bytes) 000874 1784045460.057353 mapwrite 0x0237e1 thru 0x031a77 (0xe297 bytes) 000875 1784045460.106985 read 0x003768 thru 0x00ee1f (0xb6b8 bytes) 000876 1784045460.109255 read 0x02ce9a thru 0x031a77 (0x4bde bytes) 000878 1784045460.118355 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31a78): Mirror 12: 0x16552f67 (stale) Mirror 19: 0xf4a1b29e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31a78): Mirror 12: 0x16552f67 (stale) Mirror 19: 0xf4a1b29e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31a78: skipped 000880 1784045460.477815 write 0x01d691 thru 0x02ac32 (0xd5a2 bytes) 000881 1784045460.501355 fallocate 0x038e15 thru 0x03ffff (0x71eb bytes) 000882 1784045460.508131 fallocate 0x02acda thru 0x02c185 (0x14ac bytes) 000883 1784045460.513159 trunc from 0x01bdb8 to 0x026cf9 (0xaf42 bytes) 000884 1784045460.525950 fallocate 0x001236 thru 0x010f2f (0xfcfa bytes) 000885 1784045460.531375 trunc from 0x031a78 to 0x038e5f (0x73e8 bytes) 000886 1784045460.548020 mapread 0x00c733 thru 0x00e636 (0x1f04 bytes) 000887 1784045460.569707 trunc from 0x038e60 to 0x031789 (0x76d6 bytes) 000888 1784045460.584347 punch from 0x01bcc1 to 0x02552d (0x986d bytes) 000889 1784045460.590193 punch from 0x01d7ce to 0x025839 (0x806c bytes) 000890 1784045460.594942 punch from 0x02f8cb to 0x031789 (0x1ebf bytes) 000891 1784045460.599931 read 0x02f591 thru 0x031789 (0x21f9 bytes) 000892 1784045460.605481 mapread 0x01474b thru 0x01d84b (0x9101 bytes) 000893 1784045460.616475 trunc from 0x03178a to 0x004226 (0x2d563 bytes) 000894 1784045460.633722 mapwrite 0x01ae9d thru 0x01e806 (0x396a bytes) 000895 1784045460.678412 fallocate 0x00d7fd thru 0x015d56 (0x855a bytes) 000896 1784045460.685429 write 0x02fcd4 thru 0x03f651 (0xf97e bytes) 000897 1784045460.688125 punch from 0x00849e to 0x012595 (0xa0f8 bytes) 000898 1784045460.693840 trunc from 0x0370c0 to 0x03f651 (0x8592 bytes) 000899 1784045460.720623 MIRROR_RESYNC 3 mirrors 000900 1784045461.752347 mapwrite 0x013a17 thru 0x016148 (0x2732 bytes) 000901 1784045461.835340 read 0x02e9cd thru 0x03bcb2 (0xd2e6 bytes) 000902 1784045461.845887 write 0x007027 thru 0x00bfce (0x4fa8 bytes) 000903 1784045461.860493 mapwrite 0x022145 thru 0x027c13 (0x5acf bytes) 000904 1784045461.887867 fallocate 0x034b72 thru 0x03ffff (0xb48e bytes) 000905 1784045461.893245 punch from 0x02dc09 to 0x03c2fb (0xe6f3 bytes) 000907 1784045461.899017 write 0x032a96 thru 0x038c87 (0x61f2 bytes) 000908 1784045461.910338 fallocate 0x034841 thru 0x035533 (0xcf3 bytes) 000909 1784045461.916419 trunc from 0x03ba16 to 0x03e1c5 (0x27b0 bytes) 000910 1784045461.922261 trunc from 0x040000 to 0x03a84f (0x57b0 bytes) 000911 1784045461.942363 write 0x00c01f thru 0x01578a (0x976c bytes) 000912 1784045461.949945 read 0x005627 thru 0x011b11 (0xc4eb bytes) 000914 1784045461.964938 MIRROR_RESYNC 3 mirrors 000915 1784045463.157482 fallocate 0x02a856 thru 0x034402 (0x9bad bytes) 000916 1784045463.196172 punch from 0x010d89 to 0x017914 (0x6b8c bytes) 000917 1784045463.203245 punch from 0x0326f0 to 0x03a84f (0x8160 bytes) 000919 1784045463.227588 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3a850): Mirror 12: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a850): Mirror 12: 0xe2b5160b (stale) Mirror 19: 0xe2b5160b (stale) CRC-32 checksum value for chunk [0, 0x3a850): Mirror 1: 0x24077c0d Mirror 20: 0x24077c0d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a850: skipped 000921 1784045464.693710 punch from 0x027052 to 0x02f0d7 (0x8086 bytes) 000922 1784045464.783269 punch from 0x02448f to 0x031d9a (0xd90c bytes) 000923 1784045464.788949 fallocate 0x039e91 thru 0x03f022 (0x5192 bytes) 000924 1784045464.798567 mapread 0x018f7c thru 0x01bbaf (0x2c34 bytes) 000926 1784045464.828833 write 0x036392 thru 0x03caaf (0x671e bytes) 000927 1784045464.842256 trunc from 0x03b4b7 to 0x03caaf (0x15f9 bytes) 000928 1784045464.864266 mapwrite 0x005c32 thru 0x0066a0 (0xa6f bytes) 000929 1784045464.922550 trunc from 0x02fdeb to 0x03caaf (0xccc5 bytes) 000930 1784045464.930031 trunc from 0x00571c to 0x0094ee (0x3dd3 bytes) 000932 1784045464.936050 write 0x038ead thru 0x03ea4c (0x5ba0 bytes) 000934 1784045464.949265 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3ea4d): Mirror 12: 0xd0dad49 (stale) Mirror 19: 0xd0dad49 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ea4d): Mirror 12: 0xd0dad49 (stale) Mirror 19: 0xd0dad49 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ea4d: skipped 000935 1784045465.321708 read 0x01bb15 thru 0x028ceb (0xd1d7 bytes) 000936 1784045465.335656 mapwrite 0x03a1e9 thru 0x03ffff (0x5e17 bytes) 000937 1784045465.412030 mapread 0x017f16 thru 0x01db7e (0x5c69 bytes) 000938 1784045465.433688 trunc from 0x017d7c to 0x0236ea (0xb96f bytes) 000939 1784045465.440927 fallocate 0x00d6a5 thru 0x011360 (0x3cbc bytes) 000940 1784045465.447832 trunc from 0x029bcc to 0x038db0 (0xf1e5 bytes) 000941 1784045465.454900 mapread 0x020351 thru 0x022646 (0x22f6 bytes) 000942 1784045465.468333 mapread 0x0321ed thru 0x032713 (0x527 bytes) 000943 1784045465.480032 trunc from 0x040000 to 0x00a326 (0x35cd9 bytes) 000944 1784045465.503225 punch from 0x002fdb to 0x00a326 (0x734c bytes) 000945 1784045465.511204 trunc from 0x00a327 to 0x0030f4 (0x7232 bytes) 000946 1784045465.533752 fallocate 0x009f25 thru 0x01843c (0xe518 bytes) 000947 1784045465.541252 punch from 0x002137 to 0x0030f4 (0xfbe bytes) 000948 1784045465.548830 write 0x01a4cb thru 0x021420 (0x6f56 bytes) 000950 1784045465.553981 mapwrite 0x02aa7e thru 0x0369d3 (0xbf56 bytes) 000951 1784045465.621371 trunc from 0x02df87 to 0x03523a (0x72b4 bytes) 000953 1784045465.629259 fallocate 0x032470 thru 0x03ffff (0xdb90 bytes) 000954 1784045465.636304 fallocate 0x020a96 thru 0x024737 (0x3ca2 bytes) 000955 1784045465.643915 read 0x01fa3c thru 0x01ff5e (0x523 bytes) 000956 1784045465.645956 write 0x02d0db thru 0x03af76 (0xde9c bytes) 000957 1784045465.661844 punch from 0x01902f to 0x01a78d (0x175f bytes) 000959 1784045465.668449 punch from 0x00ba3d to 0x0144d5 (0x8a99 bytes) 000960 1784045465.674702 punch from 0x024e43 to 0x031be1 (0xcd9f bytes) 000961 1784045465.701245 trunc from 0x00f430 to 0x014031 (0x4c02 bytes) 000962 1784045465.713204 mapread 0x02779c thru 0x034160 (0xc9c5 bytes) 000963 1784045465.784982 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x14e:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xa2c8d2f4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xa2c8d2f4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000964 1784045466.102405 read 0x001a07 thru 0x004298 (0x2892 bytes) 000965 1784045466.113972 write 0x0204db thru 0x02dae9 (0xd60f bytes) 000966 1784045466.130546 write 0x034127 thru 0x03ffff (0xbed9 bytes) 000967 1784045466.138844 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xa2c8d2f4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x57b3269d Mirror 13: 0x57b3269d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000968 1784045467.176579 trunc from 0x022bed to 0x025f8f (0x33a3 bytes) 000969 1784045467.267018 trunc from 0x040000 to 0x0084e0 (0x37b1f bytes) 000970 1784045467.329383 punch from 0x0037ec to 0x0084e0 (0x4cf5 bytes) 000971 1784045467.334489 mapwrite 0x017202 thru 0x02027b (0x907a bytes) 000972 1784045467.388803 trunc from 0x002f0f to 0x011753 (0xe845 bytes) 000973 1784045467.395053 mapwrite 0x037088 thru 0x03ffff (0x8f78 bytes) 000974 1784045467.441885 mapwrite 0x026a32 thru 0x031e17 (0xb3e6 bytes) 000975 1784045467.483127 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 12: 0xa2c8d2f4 (stale) Mirror 13: 0x57b3269d (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x72f7112f Mirror 14: 0x72f7112f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000976 1784045468.727503 trunc from 0x031655 to 0x0334ad (0x1e59 bytes) 000978 1784045468.820557 write 0x010455 thru 0x019ebf (0x9a6b bytes) 000979 1784045468.869866 trunc from 0x040000 to 0x03ebfd (0x1402 bytes) 000982 1784045468.921467 fallocate 0x006caf thru 0x00a24b (0x359d bytes) 000983 1784045468.929904 mapwrite 0x01c8e2 thru 0x025490 (0x8baf bytes) 000984 1784045468.981848 read 0x027d2f thru 0x031289 (0x955b bytes) 000985 1784045468.991905 mapwrite 0x02efa0 thru 0x032a85 (0x3ae6 bytes) 000986 1784045469.038303 write 0x033de0 thru 0x037e27 (0x4048 bytes) 000987 1784045469.044362 fallocate 0x02fd19 thru 0x03dbaa (0xde92 bytes) 000988 1784045469.063417 write 0x029f42 thru 0x03786e (0xd92d bytes) 000989 1784045469.072297 mapwrite 0x013d7b thru 0x021058 (0xd2de bytes) 000990 1784045469.124556 trunc from 0x03ebfe to 0x020f2f (0x1dcce bytes) 000991 1784045469.166439 mapwrite 0x001a6a thru 0x01066c (0xec03 bytes) 000992 1784045469.221237 trunc from 0x020f30 to 0x039d8a (0x18e5b bytes) 000993 1784045469.244842 mapread 0x0076a7 thru 0x0157af (0xe109 bytes) 000994 1784045469.247665 read 0x00e30f thru 0x01ce41 (0xeb33 bytes) 000995 1784045469.249408 trunc from 0x039d8b to 0x03455a (0x5830 bytes) 000996 1784045469.269120 fallocate 0x0394f9 thru 0x03ffff (0x6b07 bytes) 000997 1784045469.274232 mapwrite 0x00a320 thru 0x00f33b (0x501c bytes) 000998 1784045469.298599 fallocate 0x001217 thru 0x00d884 (0xc66e bytes) 000999 1784045469.305353 mapwrite 0x00dcb3 thru 0x00df8b (0x2d9 bytes) 001000 1784045469.332313 fallocate 0x02ad3a thru 0x03872c (0xd9f3 bytes) All operations completed A-OK!