== sanity-flr test 70a: flr mode fsx test ================ 12:22:40 (1788798160) striped dir -i0 -c2 -H fnv_1a_64 /mnt/lustre/d70a.sanity-flr Seed set to 8162 fallocating to largest ever: 0x3e1dc 000001 1788798163.101088 fallocate 0x03a3a1 thru 0x03e1db (0x3e3b bytes) 000002 1788798163.112998 fallocate 0x03340b thru 0x033fd1 (0xbc7 bytes) 000003 1788798163.118849 read 0x013718 thru 0x01cc02 (0x94eb bytes) 000004 1788798163.134698 trunc from 0x02cce2 to 0x02e81f (0x1b3e bytes) 000005 1788798163.140139 trunc from 0x03e1dc to 0x026b5f (0x1767c bytes) 000006 1788798163.161449 trunc from 0x026b60 to 0x037247 (0x106e8 bytes) 000008 1788798163.188166 fallocate 0x01f4c2 thru 0x02e655 (0xf194 bytes) 000010 1788798163.194364 read 0x0266e4 thru 0x034004 (0xd921 bytes) 000012 1788798163.212926 punch from 0x020669 to 0x02d397 (0xcd2f bytes) 000013 1788798163.218190 trunc from 0x010d5e to 0x014168 (0x340b bytes) 000014 1788798163.224156 trunc from 0x037248 to 0x02d939 (0x990e bytes) 000015 1788798163.242591 read 0x006c9a thru 0x00efe5 (0x834c bytes) 000016 1788798163.251138 MIRROR_EXTEND to 2 mirrors 000017 1788798163.984170 mapread 0x00748c thru 0x009120 (0x1c95 bytes) 000018 1788798164.021258 punch from 0x017f45 to 0x01e1c1 (0x627d bytes) 000019 1788798164.071430 mapwrite 0x02d607 thru 0x02e18c (0xb86 bytes) 000020 1788798164.177866 write 0x03aa81 thru 0x03e5f4 (0x3b74 bytes) 000021 1788798164.184535 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e5f5): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e5f5): Mirror 2: 0xdacfe12c (stale) CRC-32 checksum value for chunk [0, 0x3e5f5): Mirror 1: 0x5793f729 Mirror 3: 0x5793f729 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e5f5: skipped 000022 1788798164.972690 mapwrite 0x03e2dc thru 0x03ffff (0x1d24 bytes) 000023 1788798165.109593 punch from 0x00e80e to 0x01b901 (0xd0f4 bytes) 000024 1788798165.120158 MIRROR_RESYNC 3 mirrors 000026 1788798166.160023 read 0x02f814 thru 0x033a17 (0x4204 bytes) 000027 1788798166.176528 punch from 0x03a9f7 to 0x03df9b (0x35a5 bytes) 000029 1788798166.239636 read 0x03b49b thru 0x03ffff (0x4b65 bytes) 000031 1788798166.260664 write 0x00fc17 thru 0x012a57 (0x2e41 bytes) 000032 1788798166.281968 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xd44f2591 (stale) Mirror 3: 0xd44f2591 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x90ba12b2 Mirror 4: 0x90ba12b2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000033 1788798167.435228 mapread 0x0203b4 thru 0x02f5c0 (0xf20d bytes) 000034 1788798167.474965 trunc from 0x040000 to 0x00442d (0x3bbd2 bytes) 000035 1788798167.561578 trunc from 0x003cf4 to 0x00442d (0x73a bytes) 000036 1788798167.574850 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x442e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x442e): Mirror 2: 0x9875dc8a (stale) Mirror 3: 0x9875dc8a (stale) Mirror 4: 0x9875dc8a (stale) CRC-32 checksum value for chunk [0, 0x442e): Mirror 1: 0x9875dc8a Mirror 5: 0x9875dc8a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x442e: skipped 000037 1788798168.445005 trunc from 0x003991 to 0x00442d (0xa9d bytes) 000038 1788798168.487098 mapwrite 0x03732c thru 0x03e9ae (0x7683 bytes) 000039 1788798168.581110 trunc from 0x03e9af to 0x03aba8 (0x3e06 bytes) 000040 1788798168.634961 trunc from 0x039463 to 0x03a7e2 (0x1380 bytes) 000041 1788798168.657858 read 0x022901 thru 0x02a761 (0x7e61 bytes) 000042 1788798168.680005 mapread 0x015df3 thru 0x02551e (0xf72c bytes) 000043 1788798168.721280 mapread 0x00e0be thru 0x01c8a1 (0xe7e4 bytes) 000044 1788798168.724030 trunc from 0x013573 to 0x01c3a6 (0x8e34 bytes) 000045 1788798168.741273 trunc from 0x03aba9 to 0x029b16 (0x11092 bytes) 000046 1788798168.791198 punch from 0x0157c8 to 0x01b66f (0x5ea8 bytes) 000047 1788798168.806159 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x29b17): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29b17): Mirror 2: 0x55b32799 (stale) Mirror 3: 0x55b32799 (stale) Mirror 4: 0x7ad2725 (stale) Mirror 5: 0x55b32799 (stale) CRC-32 checksum value for chunk [0, 0x29b17): Mirror 1: 0x55b32799 Mirror 6: 0x55b32799 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29b17: skipped 000048 1788798169.959076 fallocate 0x031c23 thru 0x03319c (0x157a bytes) 000049 1788798170.001022 punch from 0x013e70 to 0x02101d (0xd1ae bytes) 000051 1788798170.005938 mapwrite 0x035b83 thru 0x038c26 (0x30a4 bytes) 000052 1788798170.063546 mapread 0x004119 thru 0x00e20d (0xa0f5 bytes) 000053 1788798170.072904 mapread 0x00f227 thru 0x00ffb1 (0xd8b bytes) 000054 1788798170.073698 fallocate 0x025bdd thru 0x02ba2c (0x5e50 bytes) 000055 1788798170.080437 mapread 0x025bd2 thru 0x02e6d7 (0x8b06 bytes) 000056 1788798170.109430 punch from 0x0204ab to 0x026d1e (0x6874 bytes) 000057 1788798170.117597 trunc from 0x038c27 to 0x019737 (0x1f4ef bytes) 000058 1788798170.149373 punch from 0x00ded8 to 0x012d7d (0x4ea6 bytes) 000060 1788798170.160060 mapread 0x00d487 thru 0x00ef53 (0x1acd bytes) 000061 1788798170.175446 punch from 0x00dee1 to 0x019737 (0xb857 bytes) 000063 1788798170.189574 fallocate 0x013086 thru 0x021bc6 (0xeb41 bytes) 000064 1788798170.203919 MIRROR_RESYNC 6 mirrors fallocating to largest ever: 0x40000 000065 1788798171.250249 fallocate 0x037971 thru 0x03ffff (0x868f bytes) 000066 1788798171.334867 MIRROR_RESYNC 6 mirrors 000067 1788798172.287796 read 0x015b00 thru 0x019737 (0x3c38 bytes) 000068 1788798172.299966 trunc from 0x019738 to 0x00457d (0x151ba bytes) 000069 1788798172.365056 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x457e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x457e): Mirror 2: 0x3bfe628e (stale) Mirror 3: 0x3bfe628e (stale) Mirror 4: 0x3bfe628e (stale) Mirror 5: 0x3bfe628e (stale) Mirror 6: 0x3bfe628e (stale) CRC-32 checksum value for chunk [0, 0x457e): Mirror 1: 0x3bfe628e Mirror 7: 0x3bfe628e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x457e: skipped 000071 1788798173.361834 trunc from 0x00457e to 0x038bf0 (0x34673 bytes) 000072 1788798173.449493 mapread 0x0130a2 thru 0x019601 (0x6560 bytes) 000073 1788798173.477576 fallocate 0x01af26 thru 0x01e29d (0x3378 bytes) 000074 1788798173.491974 write 0x02878c thru 0x02a755 (0x1fca bytes) 000075 1788798173.517168 trunc from 0x0252f2 to 0x031f9a (0xcca9 bytes) 000076 1788798173.535077 read 0x007181 thru 0x00f8d4 (0x8754 bytes) 000078 1788798173.544702 punch from 0x035f59 to 0x038bf0 (0x2c98 bytes) 000079 1788798173.549687 write 0x03a17a thru 0x03a8be (0x745 bytes) 000080 1788798173.550930 fallocate 0x00f84f thru 0x013478 (0x3c2a bytes) 000081 1788798173.556051 trunc from 0x03a8bf to 0x01d028 (0x1d896 bytes) 000082 1788798173.579592 fallocate 0x01cde8 thru 0x027b8b (0xada4 bytes) 000083 1788798173.584869 mapread 0x00a740 thru 0x00e3d6 (0x3c97 bytes) 000084 1788798173.589892 mapread 0x001423 thru 0x00669b (0x5279 bytes) 000085 1788798173.600269 trunc from 0x00976f to 0x00e903 (0x5195 bytes) 000086 1788798173.605638 mapread 0x00afcc thru 0x014d68 (0x9d9d bytes) 000087 1788798173.614665 mapwrite 0x025a22 thru 0x02ed70 (0x934f bytes) 000088 1788798173.669931 write 0x016d74 thru 0x024c86 (0xdf13 bytes) 000089 1788798173.671649 write 0x012262 thru 0x013073 (0xe12 bytes) 000090 1788798173.674159 punch from 0x026529 to 0x027bc5 (0x169d bytes) 000091 1788798173.679070 punch from 0x008fed to 0x00e8cc (0x58e0 bytes) 000092 1788798173.682570 trunc from 0x00c1ac to 0x0105b6 (0x440b bytes) 000093 1788798173.687723 mapread 0x028930 thru 0x02ed0b (0x63dc bytes) 000094 1788798173.694635 MIRROR_RESYNC 7 mirrors 000095 1788798175.143536 MIRROR_RESYNC 7 mirrors 000096 1788798175.931856 MIRROR_RESYNC 7 mirrors 000097 1788798176.699264 trunc from 0x004f97 to 0x012d06 (0xdd70 bytes) 000098 1788798176.755862 mapwrite 0x022752 thru 0x0281bc (0x5a6b bytes) 000099 1788798176.794541 punch from 0x01f03e to 0x021b24 (0x2ae7 bytes) 000100 1788798176.801788 punch from 0x009fbf to 0x00ca27 (0x2a69 bytes) 000101 1788798176.811375 MIRROR_RESYNC 7 mirrors 000102 1788798178.692905 MIRROR_EXTEND to 8 mirrors 000103 1788798179.493035 mapwrite 0x02c684 thru 0x0312c1 (0x4c3e bytes) 000104 1788798179.580183 trunc from 0x025b23 to 0x031177 (0xb655 bytes) 000105 1788798179.592699 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x312c2): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x312c2): Mirror 2: 0xa984dcb4 (stale) Mirror 3: 0xa984dcb4 (stale) Mirror 4: 0xa984dcb4 (stale) Mirror 5: 0xa984dcb4 (stale) Mirror 6: 0xa984dcb4 (stale) Mirror 7: 0xa984dcb4 (stale) Mirror 8: 0xa984dcb4 (stale) CRC-32 checksum value for chunk [0, 0x312c2): Mirror 1: 0x2c4aabef Mirror 9: 0x2c4aabef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x312c2: skipped 000106 1788798180.606420 write 0x027054 thru 0x02d41f (0x63cc bytes) 000107 1788798180.655966 trunc from 0x0312c2 to 0x03a3df (0x911e bytes) 000108 1788798180.694375 read 0x0010fa thru 0x00c896 (0xb79d bytes) 000109 1788798180.707163 write 0x01fe45 thru 0x028c2b (0x8de7 bytes) 000110 1788798180.715641 read 0x012d6e thru 0x019279 (0x650c bytes) 000111 1788798180.725632 read 0x01737d thru 0x018d32 (0x19b6 bytes) 000112 1788798180.726608 mapwrite 0x015288 thru 0x023b85 (0xe8fe bytes) 000113 1788798180.759913 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3a3e0): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a3e0): Mirror 2: 0xf3bbc069 (stale) Mirror 3: 0xf3bbc069 (stale) Mirror 4: 0xf3bbc069 (stale) Mirror 5: 0xf3bbc069 (stale) Mirror 6: 0xf3bbc069 (stale) Mirror 7: 0xf3bbc069 (stale) Mirror 8: 0xf3bbc069 (stale) Mirror 9: 0x88d76250 (stale) CRC-32 checksum value for chunk [0, 0x3a3e0): Mirror 1: 0xc0efa212 Mirror 10: 0xc0efa212 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a3e0: skipped 000114 1788798181.889528 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a3e0): Mirror 2: 0xf3bbc069 (stale) Mirror 3: 0xf3bbc069 (stale) Mirror 4: 0xf3bbc069 (stale) Mirror 5: 0xf3bbc069 (stale) Mirror 6: 0xf3bbc069 (stale) Mirror 8: 0xf3bbc069 (stale) Mirror 9: 0x88d76250 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a3e0): Mirror 2: 0xf3bbc069 (stale) Mirror 3: 0xf3bbc069 (stale) Mirror 4: 0xf3bbc069 (stale) Mirror 5: 0xf3bbc069 (stale) Mirror 6: 0xf3bbc069 (stale) Mirror 8: 0xf3bbc069 (stale) Mirror 9: 0x88d76250 (stale) CRC-32 checksum value for chunk [0, 0x3a3e0): Mirror 1: 0xc0efa212 Mirror 10: 0xc0efa212 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a3e0: skipped 000115 1788798182.959313 mapwrite 0x002687 thru 0x005e64 (0x37de bytes) 000116 1788798183.224878 mapwrite 0x02026e thru 0x02ac3a (0xa9cd bytes) 000117 1788798183.275861 punch from 0x0064a3 to 0x00a5dd (0x413b bytes) 000118 1788798183.283833 mapwrite 0x019c0d thru 0x0239db (0x9dcf bytes) 000119 1788798183.324033 mapwrite 0x01a220 thru 0x022f92 (0x8d73 bytes) 000120 1788798183.351136 mapread 0x03298d thru 0x03a3df (0x7a53 bytes) 000123 1788798183.365559 fallocate 0x01796b thru 0x024c39 (0xd2cf bytes) 000124 1788798183.372681 trunc from 0x03a3e0 to 0x001f09 (0x384d6 bytes) 000125 1788798183.415330 read 0x000094 thru 0x001f09 (0x1e76 bytes) 000126 1788798183.435549 mapwrite 0x02cbc2 thru 0x032791 (0x5bd0 bytes) 000127 1788798183.494766 mapread 0x014aa0 thru 0x01cfa4 (0x8505 bytes) 000128 1788798183.508791 trunc from 0x032792 to 0x03a539 (0x7da8 bytes) 000129 1788798183.530856 trunc from 0x00b0a3 to 0x01904b (0xdfa9 bytes) 000130 1788798183.538590 trunc from 0x012fb7 to 0x019d5f (0x6da9 bytes) 000131 1788798183.544220 fallocate 0x014fac thru 0x01bc3b (0x6c90 bytes) 000132 1788798183.550869 write 0x02b6a2 thru 0x02bc43 (0x5a2 bytes) 000133 1788798183.551977 trunc from 0x03a53a to 0x022edf (0x1765a bytes) 000134 1788798183.570691 punch from 0x000479 to 0x00760e (0x7196 bytes) 000135 1788798183.577658 mapread 0x001eb3 thru 0x0049d7 (0x2b25 bytes) 000136 1788798183.590981 mapread 0x021c1c thru 0x022edf (0x12c4 bytes) 000137 1788798183.602617 fallocate 0x002d2e thru 0x0057b2 (0x2a85 bytes) 000138 1788798183.614090 fallocate 0x019433 thru 0x02016d (0x6d3b bytes) 000139 1788798183.619824 read 0x0119ba thru 0x019044 (0x768b bytes) 000140 1788798183.633800 punch from 0x009606 to 0x0163d5 (0xcdd0 bytes) 000141 1788798183.642277 trunc from 0x022ee0 to 0x03d482 (0x1a5a3 bytes) 000142 1788798183.662800 punch from 0x01e2dd to 0x0225e1 (0x4305 bytes) 000143 1788798183.678548 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x3d483): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d483): Mirror 2: 0x51fa71d5 (stale) Mirror 3: 0x51fa71d5 (stale) Mirror 4: 0x51fa71d5 (stale) Mirror 5: 0x51fa71d5 (stale) Mirror 6: 0x51fa71d5 (stale) Mirror 8: 0x51fa71d5 (stale) Mirror 9: 0xf80efe61 (stale) Mirror 10: 0x6a8561f5 (stale) CRC-32 checksum value for chunk [0, 0x3d483): Mirror 1: 0x90598f1b Mirror 11: 0x90598f1b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d483: skipped 000145 1788798185.355537 mapread 0x022a03 thru 0x030b58 (0xe156 bytes) 000146 1788798185.395503 trunc from 0x03d483 to 0x031a59 (0xba29 bytes) 000147 1788798185.471623 MIRROR_SPLIT mirror 6 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31a5a): Mirror 2: 0x18dd1c1c (stale) Mirror 3: 0x18dd1c1c (stale) Mirror 4: 0x18dd1c1c (stale) Mirror 5: 0x18dd1c1c (stale) Mirror 6: 0x18dd1c1c (stale) Mirror 9: 0x27b6554c (stale) Mirror 10: 0x88e0767 (stale) Mirror 11: 0x1d14f4ef (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31a5a): Mirror 2: 0x18dd1c1c (stale) Mirror 3: 0x18dd1c1c (stale) Mirror 4: 0x18dd1c1c (stale) Mirror 5: 0x18dd1c1c (stale) Mirror 6: 0x18dd1c1c (stale) Mirror 9: 0x27b6554c (stale) Mirror 10: 0x88e0767 (stale) Mirror 11: 0x1d14f4ef (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31a5a: skipped 000148 1788798186.281798 read 0x0129d3 thru 0x01d0c6 (0xa6f4 bytes) 000149 1788798186.307044 trunc from 0x011790 to 0x01b0aa (0x991b bytes) 000150 1788798186.322449 trunc from 0x005339 to 0x007bf5 (0x28bd bytes) 000151 1788798186.332880 punch from 0x00fb61 to 0x0107ff (0xc9f bytes) 000152 1788798186.345974 mapread 0x00de95 thru 0x014ef3 (0x705f bytes) 000153 1788798186.403718 punch from 0x029597 to 0x031a59 (0x84c3 bytes) 000154 1788798186.410417 trunc from 0x0033c0 to 0x012a5f (0xf6a0 bytes) 000155 1788798186.415184 mapread 0x02d3f2 thru 0x02da6b (0x67a bytes) 000156 1788798186.437030 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x31a5a): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31a5a): Mirror 2: 0x18dd1c1c (stale) Mirror 3: 0x18dd1c1c (stale) Mirror 4: 0x18dd1c1c (stale) Mirror 5: 0x18dd1c1c (stale) Mirror 6: 0x18dd1c1c (stale) Mirror 9: 0x27b6554c (stale) Mirror 10: 0x88e0767 (stale) Mirror 11: 0x1d14f4ef (stale) CRC-32 checksum value for chunk [0, 0x31a5a): Mirror 1: 0x1d14f4ef Mirror 12: 0x1d14f4ef lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31a5a: skipped 000157 1788798187.595658 trunc from 0x031a5a to 0x0069e8 (0x2b071 bytes) 000158 1788798187.651948 mapread 0x000532 thru 0x0069e8 (0x64b7 bytes) 000159 1788798187.676802 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x69e9): Mirror 3: 0x67f23ad2 (stale) Mirror 4: 0x67f23ad2 (stale) Mirror 5: 0x67f23ad2 (stale) Mirror 6: 0x67f23ad2 (stale) Mirror 9: 0x67f23ad2 (stale) Mirror 10: 0x67f23ad2 (stale) Mirror 11: 0x67f23ad2 (stale) Mirror 12: 0x67f23ad2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x69e9): Mirror 3: 0x67f23ad2 (stale) Mirror 4: 0x67f23ad2 (stale) Mirror 5: 0x67f23ad2 (stale) Mirror 6: 0x67f23ad2 (stale) Mirror 9: 0x67f23ad2 (stale) Mirror 10: 0x67f23ad2 (stale) Mirror 11: 0x67f23ad2 (stale) Mirror 12: 0x67f23ad2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x69e9: skipped 000160 1788798188.126379 trunc from 0x0069e9 to 0x001e7e (0x4b6a bytes) 000161 1788798188.148871 trunc from 0x0000e7 to 0x001e7e (0x1d98 bytes) 000162 1788798188.159422 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e7f): Mirror 3: 0x3964bf1f (stale) Mirror 4: 0x3964bf1f (stale) Mirror 6: 0x3964bf1f (stale) Mirror 9: 0x3964bf1f (stale) Mirror 10: 0x3964bf1f (stale) Mirror 11: 0x3964bf1f (stale) Mirror 12: 0x3964bf1f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e7f): Mirror 3: 0x3964bf1f (stale) Mirror 4: 0x3964bf1f (stale) Mirror 6: 0x3964bf1f (stale) Mirror 9: 0x3964bf1f (stale) Mirror 10: 0x3964bf1f (stale) Mirror 11: 0x3964bf1f (stale) Mirror 12: 0x3964bf1f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e7f: skipped 000163 1788798188.589258 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1e7f): Mirror 3: 0x3964bf1f (stale) Mirror 4: 0x3964bf1f (stale) Mirror 9: 0x3964bf1f (stale) Mirror 10: 0x3964bf1f (stale) Mirror 11: 0x3964bf1f (stale) Mirror 12: 0x3964bf1f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e7f): Mirror 3: 0x3964bf1f (stale) Mirror 4: 0x3964bf1f (stale) Mirror 9: 0x3964bf1f (stale) Mirror 10: 0x3964bf1f (stale) Mirror 11: 0x3964bf1f (stale) Mirror 12: 0x3964bf1f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e7f: skipped 000164 1788798188.984943 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1e7f): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1e7f): Mirror 3: 0x3964bf1f (stale) Mirror 4: 0x3964bf1f (stale) Mirror 9: 0x3964bf1f (stale) Mirror 10: 0x3964bf1f (stale) Mirror 11: 0x3964bf1f (stale) Mirror 12: 0x3964bf1f (stale) CRC-32 checksum value for chunk [0, 0x1e7f): Mirror 1: 0x3964bf1f Mirror 13: 0x3964bf1f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1e7f: skipped 000165 1788798189.741724 punch from 0x000555 to 0x001e7e (0x192a bytes) 000166 1788798189.788544 mapread 0x00109d thru 0x001e7e (0xde2 bytes) 000167 1788798189.793542 read 0x001e64 thru 0x001e7e (0x1b bytes) 000168 1788798189.794012 punch from 0x00126f to 0x001e7e (0xc10 bytes) 000169 1788798189.800104 mapread 0x0016e2 thru 0x001e7e (0x79d bytes) 000171 1788798189.813968 read 0x000203 thru 0x001e7e (0x1c7c bytes) 000173 1788798189.826018 punch from 0x0003a3 to 0x001e7e (0x1adc bytes) 000174 1788798189.843287 MIRROR_RESYNC 8 mirrors 000175 1788798190.848067 MIRROR_RESYNC 8 mirrors 000176 1788798191.156051 MIRROR_EXTEND to 9 mirrors 000177 1788798191.684030 trunc from 0x001e7f to 0x0141a3 (0x12325 bytes) 000179 1788798191.733606 punch from 0x0084aa to 0x00e445 (0x5f9c bytes) 000180 1788798191.745656 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x141a4): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x141a4): Mirror 3: 0x77f3b2f3 (stale) Mirror 4: 0x77f3b2f3 (stale) Mirror 9: 0x77f3b2f3 (stale) Mirror 10: 0x77f3b2f3 (stale) Mirror 11: 0x77f3b2f3 (stale) Mirror 12: 0x77f3b2f3 (stale) Mirror 13: 0x77f3b2f3 (stale) Mirror 14: 0x77f3b2f3 (stale) CRC-32 checksum value for chunk [0, 0x141a4): Mirror 1: 0x77f3b2f3 Mirror 15: 0x77f3b2f3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x141a4: skipped 000181 1788798192.687996 read 0x004cb7 thru 0x0141a3 (0xf4ed bytes) 000182 1788798192.699444 trunc from 0x0141a4 to 0x030a07 (0x1c864 bytes) 000183 1788798192.766934 mapread 0x01d75d thru 0x026d18 (0x95bc bytes) 000184 1788798192.792258 trunc from 0x030a08 to 0x00897e (0x28089 bytes) 000185 1788798192.825229 read 0x00309d thru 0x00897e (0x58e2 bytes) 000186 1788798192.841454 trunc from 0x00897f to 0x01d5fc (0x14c7e bytes) 000187 1788798192.855703 mapwrite 0x0299ff thru 0x031824 (0x7e26 bytes) 000188 1788798192.906393 trunc from 0x031825 to 0x033641 (0x1e1d bytes) 000189 1788798192.922026 mapread 0x026ea8 thru 0x033641 (0xc79a bytes) 000190 1788798192.929381 write 0x02330c thru 0x023f68 (0xc5d bytes) 000191 1788798192.935966 MIRROR_RESYNC 10 mirrors 000192 1788798195.080440 write 0x03509c thru 0x03ffff (0xaf64 bytes) 000193 1788798195.185445 fallocate 0x02fee3 thru 0x032cbc (0x2dda bytes) 000195 1788798195.207768 MIRROR_RESYNC 10 mirrors 000196 1788798197.117924 write 0x00a3e1 thru 0x00d3b0 (0x2fd0 bytes) 000197 1788798197.166561 punch from 0x02ce66 to 0x038ad2 (0xbc6d bytes) 000198 1788798197.172794 trunc from 0x01ea3a to 0x02decb (0xf492 bytes) 000199 1788798197.177713 write 0x038461 thru 0x03f567 (0x7107 bytes) 000200 1788798197.187321 punch from 0x02c65c to 0x0334da (0x6e7f bytes) 000201 1788798197.192778 read 0x0311c4 thru 0x03de01 (0xcc3e bytes) 000202 1788798197.201473 read 0x01a30c thru 0x02576d (0xb462 bytes) 000203 1788798197.229957 mapwrite 0x033955 thru 0x03947d (0x5b29 bytes) 000204 1788798197.248156 mapread 0x03e741 thru 0x03ffff (0x18bf bytes) 000205 1788798197.248976 read 0x030dcc thru 0x0326d2 (0x1907 bytes) 000206 1788798197.249707 mapread 0x03c27d thru 0x03dd52 (0x1ad6 bytes) 000207 1788798197.250513 trunc from 0x021a43 to 0x02bd85 (0xa343 bytes) 000208 1788798197.255420 punch from 0x038aba to 0x03ffff (0x7546 bytes) 000209 1788798197.260867 trunc from 0x040000 to 0x01e257 (0x21da8 bytes) 000210 1788798197.279921 mapwrite 0x021e19 thru 0x025e68 (0x4050 bytes) 000211 1788798197.325380 write 0x028ee0 thru 0x03354a (0xa66b bytes) 000212 1788798197.326888 mapread 0x00d805 thru 0x013366 (0x5b62 bytes) 000213 1788798197.328833 write 0x031ffa thru 0x03ffff (0xe006 bytes) 000214 1788798197.331555 mapread 0x00ae8e thru 0x00b152 (0x2c5 bytes) 000215 1788798197.332618 trunc from 0x00fe11 to 0x017bce (0x7dbe bytes) 000217 1788798197.338438 mapwrite 0x00b7c3 thru 0x00da4d (0x228b bytes) 000218 1788798197.370340 MIRROR_RESYNC 10 mirrors 000219 1788798199.346448 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) 000220 1788798199.704437 MIRROR_EXTEND to 10 mirrors 000221 1788798200.375442 mapread 0x014336 thru 0x01c0df (0x7daa bytes) 000222 1788798200.397633 MIRROR_EXTEND to 11 mirrors 000223 1788798201.129826 punch from 0x00f35a to 0x01aab9 (0xb760 bytes) 000224 1788798201.177471 mapread 0x02c84b thru 0x033ef8 (0x76ae bytes) 000225 1788798201.207576 trunc from 0x022cae to 0x02f923 (0xcc76 bytes) 000226 1788798201.212709 read 0x035889 thru 0x03e4d1 (0x8c49 bytes) 000227 1788798201.222272 punch from 0x0279b6 to 0x0304d8 (0x8b23 bytes) 000228 1788798201.229438 write 0x037601 thru 0x03ffff (0x89ff bytes) 000229 1788798201.239254 mapwrite 0x03b119 thru 0x03ffff (0x4ee7 bytes) 000230 1788798201.261353 punch from 0x03be9e to 0x03ffff (0x4162 bytes) 000231 1788798201.267655 punch from 0x03d8c1 to 0x03ffff (0x273f bytes) 000232 1788798201.274094 read 0x03dda3 thru 0x03ffff (0x225d bytes) 000233 1788798201.291257 trunc from 0x03c380 to 0x03ffff (0x3c80 bytes) 000234 1788798201.297260 fallocate 0x00e28a thru 0x01d021 (0xed98 bytes) 000235 1788798201.305724 trunc from 0x02223c to 0x02cc50 (0xaa15 bytes) 000236 1788798201.312370 mapwrite 0x033c4c thru 0x03ffff (0xc3b4 bytes) 000237 1788798201.357487 MIRROR_RESYNC 11 mirrors 000238 1788798204.376870 punch from 0x02be11 to 0x0309e6 (0x4bd6 bytes) 000240 1788798204.414590 mapread 0x005fc6 thru 0x00d666 (0x76a1 bytes) 000241 1788798204.436452 MIRROR_RESYNC 11 mirrors 000242 1788798206.921695 punch from 0x020680 to 0x02a9b1 (0xa332 bytes) 000243 1788798206.960409 mapread 0x0149ad thru 0x01f37a (0xa9ce bytes) 000244 1788798206.989855 mapread 0x02e868 thru 0x039aae (0xb247 bytes) 000245 1788798207.006437 write 0x0010d2 thru 0x01009a (0xefc9 bytes) 000246 1788798207.012237 punch from 0x01c2c6 to 0x01e5bd (0x22f8 bytes) 000247 1788798207.017073 trunc from 0x040000 to 0x0239cf (0x1c630 bytes) 000248 1788798207.036367 write 0x020f82 thru 0x0305dd (0xf65c bytes) 000249 1788798207.039328 trunc from 0x0305de to 0x012e89 (0x1d754 bytes) 000250 1788798207.055230 mapread 0x0103e4 thru 0x012e89 (0x2aa6 bytes) 000251 1788798207.056198 punch from 0x011ddd to 0x012e89 (0x10ad bytes) 000253 1788798207.063173 trunc from 0x006eca to 0x0096ec (0x2823 bytes) 000255 1788798207.089905 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x12e8a): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x12e8a): Mirror 3: 0xe575dede (stale) Mirror 4: 0xe575dede (stale) Mirror 9: 0xe575dede (stale) Mirror 10: 0xe575dede (stale) Mirror 11: 0xe575dede (stale) Mirror 12: 0xe575dede (stale) Mirror 14: 0xe575dede (stale) Mirror 15: 0xe575dede (stale) Mirror 16: 0xe575dede (stale) Mirror 17: 0xe575dede (stale) CRC-32 checksum value for chunk [0, 0x12e8a): Mirror 1: 0x4df48d0b Mirror 18: 0x4df48d0b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x12e8a: skipped 000256 1788798207.846004 trunc from 0x012e8a to 0x0047ef (0xe69a bytes) 000257 1788798207.920051 write 0x03cb7e thru 0x03de92 (0x1315 bytes) 000258 1788798207.925722 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3de93): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3de93): Mirror 3: 0x5a38e44c (stale) Mirror 4: 0x5a38e44c (stale) Mirror 9: 0x5a38e44c (stale) Mirror 10: 0x5a38e44c (stale) Mirror 11: 0x5a38e44c (stale) Mirror 12: 0x5a38e44c (stale) Mirror 14: 0x5a38e44c (stale) Mirror 15: 0x5a38e44c (stale) Mirror 16: 0x5a38e44c (stale) Mirror 17: 0x5a38e44c (stale) Mirror 18: 0xd3da149c (stale) CRC-32 checksum value for chunk [0, 0x3de93): Mirror 1: 0xc3bc4f0f Mirror 19: 0xc3bc4f0f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3de93: skipped 000259 1788798208.789081 trunc from 0x01fe64 to 0x0289cb (0x8b68 bytes) 000260 1788798208.829928 trunc from 0x03b9dd to 0x03de92 (0x24b6 bytes) 000261 1788798208.840898 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x3de93): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3de93): Mirror 3: 0x5a38e44c (stale) Mirror 4: 0x5a38e44c (stale) Mirror 9: 0x5a38e44c (stale) Mirror 10: 0x5a38e44c (stale) Mirror 11: 0x5a38e44c (stale) Mirror 12: 0x5a38e44c (stale) Mirror 14: 0x5a38e44c (stale) Mirror 15: 0x5a38e44c (stale) Mirror 16: 0x5a38e44c (stale) Mirror 17: 0x5a38e44c (stale) Mirror 18: 0xd3da149c (stale) Mirror 19: 0xc3bc4f0f (stale) CRC-32 checksum value for chunk [0, 0x3de93): Mirror 1: 0x883d20c7 Mirror 20: 0x883d20c7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3de93: skipped 000262 1788798209.728210 punch from 0x006553 to 0x00fcfc (0x97aa bytes) 000263 1788798209.779613 fallocate 0x038c23 thru 0x03ffff (0x73dd bytes) 000264 1788798209.783591 mapwrite 0x034160 thru 0x038bd3 (0x4a74 bytes) 000265 1788798209.826602 fallocate 0x035ba5 thru 0x039ec8 (0x4324 bytes) 000266 1788798209.831842 trunc from 0x019cda to 0x01d1cf (0x34f6 bytes) 000267 1788798209.837630 trunc from 0x02c25f to 0x02fb03 (0x38a5 bytes) 000268 1788798209.847791 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x3de93): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3de93): Mirror 3: 0x5a38e44c (stale) Mirror 4: 0x5a38e44c (stale) Mirror 9: 0x5a38e44c (stale) Mirror 10: 0x5a38e44c (stale) Mirror 11: 0x5a38e44c (stale) Mirror 12: 0x5a38e44c (stale) Mirror 14: 0x5a38e44c (stale) Mirror 15: 0x5a38e44c (stale) Mirror 16: 0x5a38e44c (stale) Mirror 17: 0x5a38e44c (stale) Mirror 18: 0xd3da149c (stale) Mirror 19: 0xc3bc4f0f (stale) Mirror 20: 0x883d20c7 (stale) CRC-32 checksum value for chunk [0, 0x3de93): Mirror 1: 0xb6746f99 Mirror 21: 0xb6746f99 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3de93: skipped 000269 1788798210.937129 trunc from 0x03de93 to 0x024891 (0x19601 bytes) 000270 1788798211.021495 punch from 0x00e941 to 0x010933 (0x1ff3 bytes) 000271 1788798211.026454 trunc from 0x024892 to 0x00f810 (0x15081 bytes) 000272 1788798211.048484 trunc from 0x007d01 to 0x00accc (0x2fcc bytes) 000273 1788798211.055705 mapwrite 0x004699 thru 0x00ac16 (0x657e bytes) 000274 1788798211.099185 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0xf811): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf811): Mirror 3: 0x3a63d01b (stale) Mirror 4: 0x3a63d01b (stale) Mirror 9: 0x3a63d01b (stale) Mirror 10: 0x3a63d01b (stale) Mirror 11: 0x3a63d01b (stale) Mirror 12: 0x3a63d01b (stale) Mirror 14: 0x3a63d01b (stale) Mirror 15: 0x3a63d01b (stale) Mirror 16: 0x3a63d01b (stale) Mirror 17: 0x3a63d01b (stale) Mirror 18: 0xdfab354b (stale) Mirror 19: 0x55dc837c (stale) Mirror 20: 0x55dc837c (stale) Mirror 21: 0x55dc837c (stale) CRC-32 checksum value for chunk [0, 0xf811): Mirror 1: 0x2130dcce Mirror 22: 0x2130dcce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf811: skipped 000275 1788798211.940305 mapread 0x00b925 thru 0x00ce1b (0x14f7 bytes) 000276 1788798211.963033 trunc from 0x00f811 to 0x033da8 (0x24598 bytes) 000278 1788798212.055262 trunc from 0x033da9 to 0x027f5f (0xbe49 bytes) 000279 1788798212.071806 mapwrite 0x03c0f5 thru 0x03ffff (0x3f0b bytes) 000280 1788798212.108299 mapread 0x0239c1 thru 0x02fc00 (0xc240 bytes) 000281 1788798212.128992 MIRROR_RESYNC 16 mirrors 000283 1788798214.668086 fallocate 0x02bc17 thru 0x030eba (0x52a4 bytes) 000284 1788798214.718311 punch from 0x00643b to 0x00f88e (0x9454 bytes) 000285 1788798214.725199 fallocate 0x01280b thru 0x01871d (0x5f13 bytes) 000286 1788798214.731637 mapwrite 0x0027b5 thru 0x00f206 (0xca52 bytes) 000287 1788798214.775421 mapwrite 0x001856 thru 0x00ac3a (0x93e5 bytes) 000288 1788798214.793448 read 0x03d498 thru 0x03ffff (0x2b68 bytes) 000289 1788798214.803524 MIRROR_SPLIT mirror 14 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa7f74ee2 (stale) Mirror 4: 0xa7f74ee2 (stale) Mirror 9: 0xa7f74ee2 (stale) Mirror 10: 0xa7f74ee2 (stale) Mirror 11: 0xa7f74ee2 (stale) Mirror 12: 0xa7f74ee2 (stale) Mirror 14: 0xa7f74ee2 (stale) Mirror 15: 0xa7f74ee2 (stale) Mirror 16: 0xa7f74ee2 (stale) Mirror 17: 0xa7f74ee2 (stale) Mirror 18: 0xa7f74ee2 (stale) Mirror 19: 0xa7f74ee2 (stale) Mirror 20: 0xa7f74ee2 (stale) Mirror 22: 0xa7f74ee2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xa7f74ee2 (stale) Mirror 4: 0xa7f74ee2 (stale) Mirror 9: 0xa7f74ee2 (stale) Mirror 10: 0xa7f74ee2 (stale) Mirror 11: 0xa7f74ee2 (stale) Mirror 12: 0xa7f74ee2 (stale) Mirror 14: 0xa7f74ee2 (stale) Mirror 15: 0xa7f74ee2 (stale) Mirror 16: 0xa7f74ee2 (stale) Mirror 17: 0xa7f74ee2 (stale) Mirror 18: 0xa7f74ee2 (stale) Mirror 19: 0xa7f74ee2 (stale) Mirror 20: 0xa7f74ee2 (stale) Mirror 22: 0xa7f74ee2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000290 1788798215.661322 trunc from 0x002459 to 0x0062b2 (0x3e5a bytes) 000291 1788798215.668440 trunc from 0x03aebb to 0x03d56f (0x26b5 bytes) 000292 1788798215.675983 trunc from 0x013208 to 0x018ed5 (0x5cce bytes) 000293 1788798215.685384 mapwrite 0x02eba8 thru 0x03661f (0x7a78 bytes) 000294 1788798215.730460 trunc from 0x000c8d to 0x0016f3 (0xa67 bytes) 000296 1788798215.736151 trunc from 0x040000 to 0x022bd6 (0x1d429 bytes) 000297 1788798215.795546 trunc from 0x00eff8 to 0x00f0fc (0x105 bytes) 000298 1788798215.803973 trunc from 0x01588a to 0x02274a (0xcec1 bytes) 000299 1788798215.817481 MIRROR_RESYNC 15 mirrors 000300 1788798218.372062 mapwrite 0x018ef3 thru 0x028b64 (0xfc72 bytes) 000301 1788798218.482349 trunc from 0x0150fd to 0x01925d (0x4161 bytes) 000302 1788798218.492294 mapread 0x00395a thru 0x00c26f (0x8916 bytes) 000303 1788798218.517473 trunc from 0x028b65 to 0x001cf6 (0x26e6e bytes) 000304 1788798218.556568 read 0x000ab0 thru 0x001cf6 (0x1247 bytes) 000305 1788798218.562411 read 0x000cfc thru 0x001cf6 (0xffb bytes) 000306 1788798218.563535 trunc from 0x001cf7 to 0x027399 (0x256a3 bytes) 000308 1788798218.609678 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0x2739a): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2739a): Mirror 3: 0x42e9e7c7 (stale) Mirror 4: 0x42e9e7c7 (stale) Mirror 9: 0x42e9e7c7 (stale) Mirror 10: 0x42e9e7c7 (stale) Mirror 11: 0x42e9e7c7 (stale) Mirror 12: 0x42e9e7c7 (stale) Mirror 14: 0x42e9e7c7 (stale) Mirror 15: 0x42e9e7c7 (stale) Mirror 16: 0x42e9e7c7 (stale) Mirror 17: 0x42e9e7c7 (stale) Mirror 18: 0x42e9e7c7 (stale) Mirror 19: 0x42e9e7c7 (stale) Mirror 20: 0x42e9e7c7 (stale) Mirror 22: 0x42e9e7c7 (stale) CRC-32 checksum value for chunk [0, 0x2739a): Mirror 1: 0x44060d80 Mirror 23: 0x44060d80 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2739a: skipped 000309 1788798219.997859 trunc from 0x018b11 to 0x0225ee (0x9ade bytes) 000312 1788798220.053898 write 0x01afe6 thru 0x022488 (0x74a3 bytes) 000313 1788798220.077225 fallocate 0x0138fa thru 0x01fa3a (0xc141 bytes) 000314 1788798220.084405 punch from 0x005300 to 0x008134 (0x2e35 bytes) 000316 1788798220.089852 trunc from 0x00441c to 0x013e26 (0xfa0b bytes) 000317 1788798220.095420 read 0x003266 thru 0x00b390 (0x812b bytes) 000318 1788798220.104395 mapwrite 0x0076f6 thru 0x007bbc (0x4c7 bytes) 000319 1788798220.123606 fallocate 0x02c55e thru 0x03a8d8 (0xe37b bytes) 000320 1788798220.131094 trunc from 0x01fded to 0x02c608 (0xc81c bytes) 000321 1788798220.135789 punch from 0x005f36 to 0x007269 (0x1334 bytes) 000322 1788798220.141144 read 0x0208f4 thru 0x02991e (0x902b bytes) 000323 1788798220.167032 mapread 0x0128b4 thru 0x013fe4 (0x1731 bytes) 000324 1788798220.169002 read 0x00d18d thru 0x016e6a (0x9cde bytes) 000326 1788798220.173464 trunc from 0x03a8d9 to 0x01298c (0x27f4c bytes) 000327 1788798220.196575 read 0x00ee57 thru 0x012706 (0x38b0 bytes) 000328 1788798220.197457 punch from 0x0118b7 to 0x01298c (0x10d6 bytes) 000330 1788798220.206005 trunc from 0x01298d to 0x03603b (0x236af bytes) 000331 1788798220.225974 trunc from 0x03603c to 0x013c56 (0x223e5 bytes) 000332 1788798220.247365 MIRROR_SPLIT mirror 7 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x13c57): Mirror 3: 0x6a374d8e (stale) Mirror 4: 0x6a374d8e (stale) Mirror 9: 0x6a374d8e (stale) Mirror 10: 0x6a374d8e (stale) Mirror 11: 0x6a374d8e (stale) Mirror 12: 0x6a374d8e (stale) Mirror 15: 0x6a374d8e (stale) Mirror 16: 0x6a374d8e (stale) Mirror 17: 0x6a374d8e (stale) Mirror 18: 0x6a374d8e (stale) Mirror 19: 0x6a374d8e (stale) Mirror 20: 0x6a374d8e (stale) Mirror 22: 0x6a374d8e (stale) Mirror 23: 0xbcfb32 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x13c57): Mirror 3: 0x6a374d8e (stale) Mirror 4: 0x6a374d8e (stale) Mirror 9: 0x6a374d8e (stale) Mirror 10: 0x6a374d8e (stale) Mirror 11: 0x6a374d8e (stale) Mirror 12: 0x6a374d8e (stale) Mirror 15: 0x6a374d8e (stale) Mirror 16: 0x6a374d8e (stale) Mirror 17: 0x6a374d8e (stale) Mirror 18: 0x6a374d8e (stale) Mirror 19: 0x6a374d8e (stale) Mirror 20: 0x6a374d8e (stale) Mirror 22: 0x6a374d8e (stale) Mirror 23: 0xbcfb32 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x13c57: skipped 000333 1788798220.876371 trunc from 0x00bf12 to 0x013c56 (0x7d45 bytes) 000334 1788798220.881335 write 0x002b3c thru 0x007d8d (0x5252 bytes) 000336 1788798220.894302 trunc from 0x00a7e0 to 0x01101b (0x683c bytes) 000337 1788798220.898198 write 0x00ebcf thru 0x01420f (0x5641 bytes) 000338 1788798220.902915 punch from 0x00cb9b to 0x01029d (0x3703 bytes) 000339 1788798220.922224 write 0x000a77 thru 0x00381f (0x2da9 bytes) 000340 1788798220.931285 mapwrite 0x02bf25 thru 0x03bc93 (0xfd6f bytes) 000341 1788798221.057580 write 0x00761f thru 0x00a391 (0x2d73 bytes) 000342 1788798221.064929 fallocate 0x03ff5d thru 0x03ffff (0xa3 bytes) 000343 1788798221.069574 trunc from 0x031fc8 to 0x033cdd (0x1d16 bytes) 000344 1788798221.078543 MIRROR_RESYNC 15 mirrors 000345 1788798225.608554 punch from 0x020303 to 0x0226d0 (0x23ce bytes) 000346 1788798225.650529 trunc from 0x026266 to 0x02ff5b (0x9cf6 bytes) 000347 1788798225.659669 read 0x009591 thru 0x00b6d0 (0x2140 bytes) 000348 1788798225.665248 mapread 0x01c9b1 thru 0x020578 (0x3bc8 bytes) 000349 1788798225.687717 read 0x00a323 thru 0x0156b9 (0xb397 bytes) 000350 1788798225.695554 trunc from 0x037eca to 0x03bc93 (0x3dca bytes) 000351 1788798225.705461 MIRROR_SPLIT mirror 9 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bc94): Mirror 3: 0x7e6d5c6b (stale) Mirror 4: 0x7e6d5c6b (stale) Mirror 9: 0x7e6d5c6b (stale) Mirror 10: 0x7e6d5c6b (stale) Mirror 11: 0x7e6d5c6b (stale) Mirror 12: 0x7e6d5c6b (stale) Mirror 15: 0x7e6d5c6b (stale) Mirror 16: 0x7e6d5c6b (stale) Mirror 18: 0x7e6d5c6b (stale) Mirror 19: 0x7e6d5c6b (stale) Mirror 20: 0x7e6d5c6b (stale) Mirror 22: 0x7e6d5c6b (stale) Mirror 23: 0x7e6d5c6b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bc94): Mirror 3: 0x7e6d5c6b (stale) Mirror 4: 0x7e6d5c6b (stale) Mirror 9: 0x7e6d5c6b (stale) Mirror 10: 0x7e6d5c6b (stale) Mirror 11: 0x7e6d5c6b (stale) Mirror 12: 0x7e6d5c6b (stale) Mirror 15: 0x7e6d5c6b (stale) Mirror 16: 0x7e6d5c6b (stale) Mirror 18: 0x7e6d5c6b (stale) Mirror 19: 0x7e6d5c6b (stale) Mirror 20: 0x7e6d5c6b (stale) Mirror 22: 0x7e6d5c6b (stale) Mirror 23: 0x7e6d5c6b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bc94: skipped 000352 1788798226.598630 trunc from 0x03bc94 to 0x00f80e (0x2c485 bytes) 000353 1788798226.621544 trunc from 0x000671 to 0x00c754 (0xc0e4 bytes) 000354 1788798226.633331 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0xf80f): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf80f): Mirror 3: 0xd6129d9b (stale) Mirror 4: 0xd6129d9b (stale) Mirror 9: 0xd6129d9b (stale) Mirror 10: 0xd6129d9b (stale) Mirror 11: 0xd6129d9b (stale) Mirror 12: 0xd6129d9b (stale) Mirror 15: 0xd6129d9b (stale) Mirror 16: 0xd6129d9b (stale) Mirror 18: 0xd6129d9b (stale) Mirror 19: 0xd6129d9b (stale) Mirror 20: 0xd6129d9b (stale) Mirror 22: 0xd6129d9b (stale) Mirror 23: 0xd6129d9b (stale) CRC-32 checksum value for chunk [0, 0xf80f): Mirror 1: 0x7c5bb04 Mirror 24: 0x7c5bb04 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf80f: skipped 000355 1788798227.845537 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0xf80f): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xf80f): Mirror 3: 0xd6129d9b (stale) Mirror 4: 0xd6129d9b (stale) Mirror 9: 0xd6129d9b (stale) Mirror 10: 0xd6129d9b (stale) Mirror 11: 0xd6129d9b (stale) Mirror 12: 0xd6129d9b (stale) Mirror 15: 0xd6129d9b (stale) Mirror 16: 0xd6129d9b (stale) Mirror 18: 0xd6129d9b (stale) Mirror 19: 0xd6129d9b (stale) Mirror 20: 0xd6129d9b (stale) Mirror 22: 0xd6129d9b (stale) Mirror 23: 0xd6129d9b (stale) CRC-32 checksum value for chunk [0, 0xf80f): Mirror 1: 0x7c5bb04 Mirror 24: 0x7c5bb04 Mirror 25: 0x7c5bb04 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xf80f: skipped 000356 1788798228.949709 punch from 0x0079f2 to 0x00f80e (0x7e1d bytes) 000357 1788798229.007000 trunc from 0x002f9d to 0x00f80e (0xc872 bytes) 000358 1788798229.011513 read 0x00b3f1 thru 0x00f80e (0x441e bytes) 000359 1788798229.021511 fallocate 0x012170 thru 0x019c82 (0x7b13 bytes) 000361 1788798229.028255 mapwrite 0x029b63 thru 0x02ac4c (0x10ea bytes) 000362 1788798229.075958 mapwrite 0x02702b thru 0x0276a9 (0x67f bytes) 000363 1788798229.108203 read 0x01a6a8 thru 0x01b36c (0xcc5 bytes) 000364 1788798229.139677 read 0x00b44e thru 0x018c04 (0xd7b7 bytes) 000366 1788798229.142394 trunc from 0x02ac4d to 0x0055d9 (0x25673 bytes) 000367 1788798229.165898 mapwrite 0x00a3cd thru 0x014995 (0xa5c9 bytes) 000368 1788798229.223197 MIRROR_SPLIT mirror 13 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x14996): Mirror 3: 0xda6674e4 (stale) Mirror 4: 0xda6674e4 (stale) Mirror 9: 0xda6674e4 (stale) Mirror 10: 0xda6674e4 (stale) Mirror 11: 0xda6674e4 (stale) Mirror 12: 0xda6674e4 (stale) Mirror 15: 0xda6674e4 (stale) Mirror 16: 0xda6674e4 (stale) Mirror 18: 0xda6674e4 (stale) Mirror 19: 0xda6674e4 (stale) Mirror 20: 0xda6674e4 (stale) Mirror 22: 0xda6674e4 (stale) Mirror 24: 0x5225365d (stale) Mirror 25: 0x5225365d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14996): Mirror 3: 0xda6674e4 (stale) Mirror 4: 0xda6674e4 (stale) Mirror 9: 0xda6674e4 (stale) Mirror 10: 0xda6674e4 (stale) Mirror 11: 0xda6674e4 (stale) Mirror 12: 0xda6674e4 (stale) Mirror 15: 0xda6674e4 (stale) Mirror 16: 0xda6674e4 (stale) Mirror 18: 0xda6674e4 (stale) Mirror 19: 0xda6674e4 (stale) Mirror 20: 0xda6674e4 (stale) Mirror 22: 0xda6674e4 (stale) Mirror 24: 0x5225365d (stale) Mirror 25: 0x5225365d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14996: skipped 000369 1788798230.055768 MIRROR_SPLIT mirror 4 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x14996): Mirror 3: 0xda6674e4 (stale) Mirror 4: 0xda6674e4 (stale) Mirror 9: 0xda6674e4 (stale) Mirror 11: 0xda6674e4 (stale) Mirror 12: 0xda6674e4 (stale) Mirror 15: 0xda6674e4 (stale) Mirror 16: 0xda6674e4 (stale) Mirror 18: 0xda6674e4 (stale) Mirror 19: 0xda6674e4 (stale) Mirror 20: 0xda6674e4 (stale) Mirror 22: 0xda6674e4 (stale) Mirror 24: 0x5225365d (stale) Mirror 25: 0x5225365d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14996): Mirror 3: 0xda6674e4 (stale) Mirror 4: 0xda6674e4 (stale) Mirror 9: 0xda6674e4 (stale) Mirror 11: 0xda6674e4 (stale) Mirror 12: 0xda6674e4 (stale) Mirror 15: 0xda6674e4 (stale) Mirror 16: 0xda6674e4 (stale) Mirror 18: 0xda6674e4 (stale) Mirror 19: 0xda6674e4 (stale) Mirror 20: 0xda6674e4 (stale) Mirror 22: 0xda6674e4 (stale) Mirror 24: 0x5225365d (stale) Mirror 25: 0x5225365d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14996: skipped 000371 1788798230.855342 fallocate 0x03274e thru 0x037dfe (0x56b1 bytes) 000372 1788798230.862045 write 0x027384 thru 0x02d703 (0x6380 bytes) 000373 1788798230.882830 MIRROR_SPLIT mirror 3 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37dff): Mirror 3: 0xbde2b683 (stale) Mirror 4: 0xbde2b683 (stale) Mirror 11: 0xbde2b683 (stale) Mirror 12: 0xbde2b683 (stale) Mirror 15: 0xbde2b683 (stale) Mirror 16: 0xbde2b683 (stale) Mirror 18: 0xbde2b683 (stale) Mirror 19: 0xbde2b683 (stale) Mirror 20: 0xbde2b683 (stale) Mirror 22: 0xbde2b683 (stale) Mirror 24: 0xec0affc5 (stale) Mirror 25: 0xec0affc5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37dff): Mirror 3: 0xbde2b683 (stale) Mirror 4: 0xbde2b683 (stale) Mirror 11: 0xbde2b683 (stale) Mirror 12: 0xbde2b683 (stale) Mirror 15: 0xbde2b683 (stale) Mirror 16: 0xbde2b683 (stale) Mirror 18: 0xbde2b683 (stale) Mirror 19: 0xbde2b683 (stale) Mirror 20: 0xbde2b683 (stale) Mirror 22: 0xbde2b683 (stale) Mirror 24: 0xec0affc5 (stale) Mirror 25: 0xec0affc5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37dff: skipped 000374 1788798231.625944 trunc from 0x037dff to 0x00a0f9 (0x2dd05 bytes) 000375 1788798231.654957 trunc from 0x00a0fa to 0x0364f3 (0x2c3fa bytes) 000376 1788798231.676353 read 0x014c0b thru 0x020693 (0xba89 bytes) 000377 1788798231.687089 mapwrite 0x023788 thru 0x025ee8 (0x2761 bytes) 000378 1788798231.721648 mapwrite 0x034c92 thru 0x038c7c (0x3feb bytes) 000379 1788798231.807682 MIRROR_RESYNC 13 mirrors 000380 1788798236.357910 MIRROR_RESYNC 13 mirrors 000381 1788798237.603582 mapwrite 0x03a93d thru 0x03ffff (0x56c3 bytes) 000382 1788798237.727497 write 0x027070 thru 0x02e5dc (0x756d bytes) 000383 1788798237.752052 punch from 0x01a7bd to 0x0235c1 (0x8e05 bytes) 000384 1788798237.778104 trunc from 0x0160d2 to 0x0257d8 (0xf707 bytes) 000385 1788798237.790962 trunc from 0x0084b7 to 0x0137b0 (0xb2fa bytes) 000386 1788798237.797011 punch from 0x02f3c0 to 0x031c38 (0x2879 bytes) 000387 1788798237.815936 read 0x0253bb thru 0x02785e (0x24a4 bytes) 000388 1788798237.840485 trunc from 0x040000 to 0x015625 (0x2a9da bytes) 000389 1788798237.888291 punch from 0x0035e6 to 0x00d935 (0xa350 bytes) 000390 1788798237.904717 MIRROR_RESYNC 13 mirrors 000391 1788798240.217951 punch from 0x00be7a to 0x00d40a (0x1591 bytes) 000392 1788798240.263222 read 0x00513d thru 0x00d519 (0x83dd bytes) 000393 1788798240.271452 write 0x018e05 thru 0x026281 (0xd47d bytes) 000394 1788798240.278024 MIRROR_RESYNC 13 mirrors 000395 1788798242.610618 write 0x032477 thru 0x039e51 (0x79db bytes) 000396 1788798242.665189 mapwrite 0x01e168 thru 0x02da4b (0xf8e4 bytes) 000397 1788798242.743190 mapread 0x0382f0 thru 0x039e51 (0x1b62 bytes) 000398 1788798242.744046 trunc from 0x039e52 to 0x02a8a5 (0xf5ac bytes) 000400 1788798242.780522 MIRROR_RESYNC 13 mirrors 000401 1788798245.025991 read 0x007c76 thru 0x0120a3 (0xa42e bytes) 000402 1788798245.050090 punch from 0x02158f to 0x02902f (0x7aa1 bytes) 000403 1788798245.103231 punch from 0x011da2 to 0x012d2b (0xf8a bytes) 000406 1788798245.116250 write 0x02083b thru 0x023821 (0x2fe7 bytes) 000407 1788798245.136723 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x2a8a6): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2a8a6): Mirror 3: 0x4a8f75e8 (stale) Mirror 4: 0x4a8f75e8 (stale) Mirror 11: 0x4a8f75e8 (stale) Mirror 12: 0x4a8f75e8 (stale) Mirror 15: 0x4a8f75e8 (stale) Mirror 16: 0x4a8f75e8 (stale) Mirror 18: 0x4a8f75e8 (stale) Mirror 19: 0x4a8f75e8 (stale) Mirror 20: 0x4a8f75e8 (stale) Mirror 22: 0x4a8f75e8 (stale) Mirror 24: 0x4a8f75e8 (stale) Mirror 25: 0x4a8f75e8 (stale) CRC-32 checksum value for chunk [0, 0x2a8a6): Mirror 1: 0x390fc780 Mirror 26: 0x390fc780 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2a8a6: skipped 000408 1788798246.353288 write 0x0006e9 thru 0x00c13b (0xba53 bytes) 000409 1788798246.424340 trunc from 0x02a8a6 to 0x009d89 (0x20b1c bytes) 000410 1788798246.451524 MIRROR_SPLIT mirror 5 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x9d8a): Mirror 3: 0x6527759 (stale) Mirror 4: 0x6527759 (stale) Mirror 11: 0x6527759 (stale) Mirror 12: 0x6527759 (stale) Mirror 16: 0x6527759 (stale) Mirror 18: 0x6527759 (stale) Mirror 19: 0x6527759 (stale) Mirror 20: 0x6527759 (stale) Mirror 22: 0x6527759 (stale) Mirror 24: 0x6527759 (stale) Mirror 25: 0x6527759 (stale) Mirror 26: 0x6527759 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x9d8a): Mirror 3: 0x6527759 (stale) Mirror 4: 0x6527759 (stale) Mirror 11: 0x6527759 (stale) Mirror 12: 0x6527759 (stale) Mirror 16: 0x6527759 (stale) Mirror 18: 0x6527759 (stale) Mirror 19: 0x6527759 (stale) Mirror 20: 0x6527759 (stale) Mirror 22: 0x6527759 (stale) Mirror 24: 0x6527759 (stale) Mirror 25: 0x6527759 (stale) Mirror 26: 0x6527759 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x9d8a: skipped 000411 1788798247.220109 mapread 0x002353 thru 0x009d89 (0x7a37 bytes) 000412 1788798247.270541 punch from 0x006fb0 to 0x009d89 (0x2dda bytes) 000413 1788798247.278477 fallocate 0x015855 thru 0x0251ff (0xf9ab bytes) 000414 1788798247.287534 read 0x005377 thru 0x009d89 (0x4a13 bytes) 000415 1788798247.297314 mapread 0x007305 thru 0x009d89 (0x2a85 bytes) 000416 1788798247.298340 trunc from 0x0097be to 0x009d89 (0x5cc bytes) 000417 1788798247.304657 punch from 0x0086c6 to 0x009d89 (0x16c4 bytes) 000418 1788798247.320725 mapread 0x0034a6 thru 0x007566 (0x40c1 bytes) 000419 1788798247.321528 fallocate 0x035a35 thru 0x03f3c3 (0x998f bytes) 000420 1788798247.326519 read 0x00fb49 thru 0x013780 (0x3c38 bytes) 000421 1788798247.341249 punch from 0x031ede to 0x038d50 (0x6e73 bytes) 000422 1788798247.350587 write 0x03f994 thru 0x03ffff (0x66c bytes) 000423 1788798247.363842 mapread 0x0317d9 thru 0x03b46e (0x9c96 bytes) 000424 1788798247.414890 trunc from 0x040000 to 0x0199fd (0x26602 bytes) 000425 1788798247.441805 fallocate 0x008e9e thru 0x010310 (0x7473 bytes) 000426 1788798247.449955 punch from 0x004421 to 0x00606b (0x1c4b bytes) 000427 1788798247.457893 trunc from 0x0199fe to 0x037bc0 (0x1e1c3 bytes) 000428 1788798247.478284 write 0x02066a thru 0x02a5f2 (0x9f89 bytes) 000429 1788798247.501927 trunc from 0x01da30 to 0x02012c (0x26fd bytes) 000430 1788798247.522108 write 0x0220e9 thru 0x0274b1 (0x53c9 bytes) 000431 1788798247.531423 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x37bc1): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37bc1): Mirror 3: 0xf02ea35a (stale) Mirror 4: 0xf02ea35a (stale) Mirror 11: 0xf02ea35a (stale) Mirror 12: 0xf02ea35a (stale) Mirror 16: 0xf02ea35a (stale) Mirror 18: 0xf02ea35a (stale) Mirror 19: 0xf02ea35a (stale) Mirror 20: 0xf02ea35a (stale) Mirror 22: 0xf02ea35a (stale) Mirror 24: 0xf02ea35a (stale) Mirror 25: 0xf02ea35a (stale) Mirror 26: 0x95308ae5 (stale) CRC-32 checksum value for chunk [0, 0x37bc1): Mirror 1: 0x4e99c106 Mirror 27: 0x4e99c106 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37bc1: skipped 000432 1788798248.728036 fallocate 0x00e270 thru 0x01636c (0x80fd bytes) 000434 1788798248.799312 MIRROR_RESYNC 14 mirrors 000435 1788798253.460061 trunc from 0x037bc1 to 0x0104a8 (0x27718 bytes) 000436 1788798253.535654 read 0x0021a6 thru 0x00f446 (0xd2a1 bytes) 000437 1788798253.557145 trunc from 0x0104a9 to 0x00a178 (0x6330 bytes) 000438 1788798253.594534 fallocate 0x00670e thru 0x00f567 (0x8e5a bytes) 000439 1788798253.609987 mapwrite 0x025082 thru 0x031958 (0xc8d7 bytes) 000440 1788798253.749391 MIRROR_RESYNC 14 mirrors 000441 1788798258.356610 trunc from 0x031959 to 0x015e8a (0x1bace bytes) 000442 1788798258.415948 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x15e8b): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x15e8b): Mirror 3: 0x353f7f74 (stale) Mirror 4: 0x353f7f74 (stale) Mirror 11: 0x353f7f74 (stale) Mirror 12: 0x353f7f74 (stale) Mirror 16: 0x353f7f74 (stale) Mirror 18: 0x353f7f74 (stale) Mirror 19: 0x353f7f74 (stale) Mirror 20: 0x353f7f74 (stale) Mirror 22: 0x353f7f74 (stale) Mirror 24: 0x353f7f74 (stale) Mirror 25: 0x353f7f74 (stale) Mirror 26: 0x353f7f74 (stale) Mirror 27: 0x353f7f74 (stale) CRC-32 checksum value for chunk [0, 0x15e8b): Mirror 1: 0x353f7f74 Mirror 28: 0x353f7f74 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x15e8b: skipped 000443 1788798259.917210 punch from 0x00d30a to 0x014c40 (0x7937 bytes) 000444 1788798260.002504 MIRROR_RESYNC 15 mirrors 000445 1788798263.675190 write 0x03178d thru 0x0334a6 (0x1d1a bytes) 000446 1788798263.719280 fallocate 0x0063d0 thru 0x0102ed (0x9f1e bytes) 000447 1788798263.725498 trunc from 0x02ebfb to 0x0334a6 (0x48ac bytes) 000448 1788798263.743488 MIRROR_RESYNC 15 mirrors 000449 1788798268.371767 mapwrite 0x035a9f thru 0x03ffff (0xa561 bytes) 000450 1788798268.469181 mapread 0x007d1e thru 0x01294c (0xac2f bytes) 000452 1788798268.489328 read 0x033666 thru 0x03bb23 (0x84be bytes) 000453 1788798268.490007 fallocate 0x036314 thru 0x03aa6d (0x475a bytes) 000454 1788798268.497067 read 0x007509 thru 0x01081c (0x9314 bytes) 000455 1788798268.497785 trunc from 0x024532 to 0x02bd5a (0x7829 bytes) 000456 1788798268.505498 trunc from 0x007640 to 0x011927 (0xa2e8 bytes) 000457 1788798268.510668 trunc from 0x031b84 to 0x0321aa (0x627 bytes) 000458 1788798268.515654 trunc from 0x040000 to 0x00b846 (0x347b9 bytes) 000459 1788798268.537511 fallocate 0x03e39a thru 0x03ffff (0x1c66 bytes) 000460 1788798268.542383 read 0x005e01 thru 0x00b846 (0x5a46 bytes) 000461 1788798268.556462 MIRROR_EXTEND to 16 mirrors CRC-32 checksum value for chunk [0, 0xb847): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb847): Mirror 3: 0xfb6adab1 (stale) Mirror 4: 0xfb6adab1 (stale) Mirror 11: 0xfb6adab1 (stale) Mirror 12: 0xfb6adab1 (stale) Mirror 16: 0xfb6adab1 (stale) Mirror 18: 0xfb6adab1 (stale) Mirror 19: 0xfb6adab1 (stale) Mirror 20: 0xfb6adab1 (stale) Mirror 22: 0xfb6adab1 (stale) Mirror 24: 0xfb6adab1 (stale) Mirror 25: 0xfb6adab1 (stale) Mirror 26: 0xfb6adab1 (stale) Mirror 27: 0xfb6adab1 (stale) Mirror 28: 0xfb6adab1 (stale) CRC-32 checksum value for chunk [0, 0xb847): Mirror 1: 0xfb6adab1 Mirror 29: 0xfb6adab1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb847: skipped 000462 1788798269.555577 fallocate 0x018130 thru 0x01a21c (0x20ed bytes) 000463 1788798269.597662 trunc from 0x01a21d to 0x01b73e (0x1522 bytes) 000465 1788798269.646864 read 0x0118fd thru 0x016d7b (0x547f bytes) 000466 1788798269.659446 mapread 0x014262 thru 0x01b73e (0x74dd bytes) 000467 1788798269.673695 punch from 0x005ceb to 0x00f7e5 (0x9afb bytes) 000468 1788798269.678681 fallocate 0x002729 thru 0x0047fc (0x20d4 bytes) 000469 1788798269.683061 trunc from 0x00e75c to 0x016570 (0x7e15 bytes) 000470 1788798269.687952 read 0x006c41 thru 0x00a68a (0x3a4a bytes) 000471 1788798269.697123 read 0x013528 thru 0x01b73e (0x8217 bytes) 000472 1788798269.698119 mapwrite 0x01912f thru 0x01b064 (0x1f36 bytes) 000473 1788798269.710445 punch from 0x000722 to 0x00f8f8 (0xf1d7 bytes) 000474 1788798269.715798 punch from 0x00464c to 0x00858f (0x3f44 bytes) 000475 1788798269.720666 punch from 0x01b6ce to 0x01b73e (0x71 bytes) 000476 1788798269.726039 mapread 0x010b8b thru 0x013d69 (0x31df bytes) 000477 1788798269.727073 punch from 0x00f887 to 0x010f23 (0x169d bytes) 000478 1788798269.733343 read 0x00da23 thru 0x019fb4 (0xc592 bytes) 000479 1788798269.749447 trunc from 0x01b73f to 0x026a7b (0xb33d bytes) 000480 1788798269.762538 trunc from 0x002144 to 0x00363c (0x14f9 bytes) 000481 1788798269.767505 mapread 0x001de8 thru 0x004111 (0x232a bytes) 000482 1788798269.790760 trunc from 0x026a7c to 0x0154cb (0x115b0 bytes) 000483 1788798269.805721 fallocate 0x03a4ab thru 0x03ffff (0x5b55 bytes) 000484 1788798269.811930 mapread 0x000004 thru 0x00a236 (0xa233 bytes) 000486 1788798269.813327 write 0x035bed thru 0x037835 (0x1c49 bytes) 000487 1788798269.830072 MIRROR_RESYNC 16 mirrors 000488 1788798273.725270 fallocate 0x003b5c thru 0x00ea6c (0xaf11 bytes) 000489 1788798273.781418 trunc from 0x01661b to 0x01c1fa (0x5be0 bytes) 000490 1788798273.788368 read 0x036c7d thru 0x03ffff (0x9383 bytes) 000491 1788798273.797361 write 0x02de85 thru 0x030988 (0x2b04 bytes) 000494 1788798273.811896 mapwrite 0x024d2d thru 0x02b563 (0x6837 bytes) 000495 1788798273.888051 mapread 0x03c106 thru 0x03ffff (0x3efa bytes) 000496 1788798273.889075 write 0x011467 thru 0x01c11d (0xacb7 bytes) 000497 1788798273.904781 mapwrite 0x0157e9 thru 0x0172c4 (0x1adc bytes) 000498 1788798273.955147 mapread 0x02e4ea thru 0x03b49c (0xcfb3 bytes) 000500 1788798273.998822 fallocate 0x014753 thru 0x023a8e (0xf33c bytes) 000502 1788798274.018519 punch from 0x01edde to 0x02b56d (0xc790 bytes) 000503 1788798274.032917 punch from 0x036c1f to 0x03ffff (0x93e1 bytes) 000506 1788798274.050966 MIRROR_SPLIT mirror 6 to 15 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xcb80918c (stale) Mirror 4: 0xcb80918c (stale) Mirror 11: 0xcb80918c (stale) Mirror 12: 0xcb80918c (stale) Mirror 16: 0xcb80918c (stale) Mirror 19: 0xcb80918c (stale) Mirror 20: 0xcb80918c (stale) Mirror 22: 0xcb80918c (stale) Mirror 24: 0xcb80918c (stale) Mirror 25: 0xcb80918c (stale) Mirror 26: 0xcb80918c (stale) Mirror 27: 0xcb80918c (stale) Mirror 28: 0xcb80918c (stale) Mirror 29: 0xcb80918c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xcb80918c (stale) Mirror 4: 0xcb80918c (stale) Mirror 11: 0xcb80918c (stale) Mirror 12: 0xcb80918c (stale) Mirror 16: 0xcb80918c (stale) Mirror 19: 0xcb80918c (stale) Mirror 20: 0xcb80918c (stale) Mirror 22: 0xcb80918c (stale) Mirror 24: 0xcb80918c (stale) Mirror 25: 0xcb80918c (stale) Mirror 26: 0xcb80918c (stale) Mirror 27: 0xcb80918c (stale) Mirror 28: 0xcb80918c (stale) Mirror 29: 0xcb80918c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000507 1788798275.697935 mapread 0x024021 thru 0x0302d7 (0xc2b7 bytes) 000508 1788798275.731343 trunc from 0x040000 to 0x00f2e4 (0x30d1b bytes) 000509 1788798275.772828 trunc from 0x007212 to 0x00f2e4 (0x80d3 bytes) 000510 1788798275.781335 read 0x008bb6 thru 0x00f2e4 (0x672f bytes) 000511 1788798275.820681 read 0x00ea6b thru 0x00f2e4 (0x87a bytes) 000512 1788798275.822817 read 0x00430c thru 0x004c18 (0x90d bytes) 000513 1788798275.846094 trunc from 0x00f2e5 to 0x014009 (0x4d25 bytes) 000514 1788798275.904125 trunc from 0x01400a to 0x03ad8e (0x26d85 bytes) 000515 1788798275.963645 fallocate 0x037319 thru 0x03ffff (0x8ce7 bytes) 000516 1788798275.971695 mapread 0x025ba8 thru 0x027487 (0x18e0 bytes) 000517 1788798276.040905 mapwrite 0x03ff04 thru 0x03ffff (0xfc bytes) 000518 1788798276.088724 fallocate 0x032268 thru 0x034cfa (0x2a93 bytes) 000519 1788798276.113865 write 0x0248fd thru 0x02996e (0x5072 bytes) 000520 1788798276.126013 read 0x01fcfd thru 0x026dd8 (0x70dc bytes) 000521 1788798276.130667 mapwrite 0x02230b thru 0x028c9f (0x6995 bytes) 000522 1788798276.175898 fallocate 0x02a759 thru 0x0385e0 (0xde88 bytes) 000523 1788798276.197528 write 0x03af99 thru 0x03ffff (0x5067 bytes) 000524 1788798276.198710 read 0x01f5b1 thru 0x029714 (0xa164 bytes) 000525 1788798276.199337 punch from 0x00aa6e to 0x017166 (0xc6f9 bytes) 000526 1788798276.247095 MIRROR_SPLIT mirror 10 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xcb80918c (stale) Mirror 4: 0xcb80918c (stale) Mirror 11: 0xcb80918c (stale) Mirror 12: 0xcb80918c (stale) Mirror 16: 0xcb80918c (stale) Mirror 19: 0xcb80918c (stale) Mirror 20: 0xcb80918c (stale) Mirror 22: 0xcb80918c (stale) Mirror 24: 0xcb80918c (stale) Mirror 26: 0xcb80918c (stale) Mirror 27: 0xcb80918c (stale) Mirror 28: 0xcb80918c (stale) Mirror 29: 0xcb80918c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xcb80918c (stale) Mirror 4: 0xcb80918c (stale) Mirror 11: 0xcb80918c (stale) Mirror 12: 0xcb80918c (stale) Mirror 16: 0xcb80918c (stale) Mirror 19: 0xcb80918c (stale) Mirror 20: 0xcb80918c (stale) Mirror 22: 0xcb80918c (stale) Mirror 24: 0xcb80918c (stale) Mirror 26: 0xcb80918c (stale) Mirror 27: 0xcb80918c (stale) Mirror 28: 0xcb80918c (stale) Mirror 29: 0xcb80918c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000527 1788798277.471098 mapread 0x03ff7a thru 0x03ffff (0x86 bytes) 000528 1788798277.480245 write 0x0098d8 thru 0x015434 (0xbb5d bytes) 000529 1788798277.497865 mapwrite 0x019825 thru 0x02410b (0xa8e7 bytes) 000530 1788798277.576021 mapread 0x0149a0 thru 0x016abb (0x211c bytes) 000531 1788798277.579277 trunc from 0x040000 to 0x0156f9 (0x2a906 bytes) 000533 1788798277.643757 write 0x03f3b0 thru 0x03ffff (0xc50 bytes) 000534 1788798277.644717 mapwrite 0x00c12c thru 0x00f76c (0x3641 bytes) 000535 1788798277.689634 write 0x03ff3d thru 0x03ffff (0xc3 bytes) 000536 1788798277.690384 mapwrite 0x02ef98 thru 0x037045 (0x80ae bytes) 000538 1788798277.753869 mapwrite 0x021bf3 thru 0x0273d7 (0x57e5 bytes) 000539 1788798277.819073 mapread 0x024bb8 thru 0x0257fd (0xc46 bytes) 000540 1788798277.826969 write 0x002d6c thru 0x00b83a (0x8acf bytes) 000541 1788798277.837390 write 0x029693 thru 0x038053 (0xe9c1 bytes) 000542 1788798277.839016 read 0x033d9d thru 0x03ffff (0xc263 bytes) 000543 1788798277.847122 mapwrite 0x0218e0 thru 0x02241c (0xb3d bytes) 000544 1788798277.888617 fallocate 0x03b2d4 thru 0x03ffff (0x4d2c bytes) 000545 1788798277.899692 read 0x0195de thru 0x023d51 (0xa774 bytes) 000546 1788798277.931883 MIRROR_RESYNC 14 mirrors 000547 1788798284.410977 mapwrite 0x0009eb thru 0x00914d (0x8763 bytes) 000548 1788798284.588943 mapwrite 0x01612d thru 0x022ff9 (0xcecd bytes) 000549 1788798284.684121 read 0x013c16 thru 0x01e469 (0xa854 bytes) 000550 1788798284.684882 fallocate 0x034407 thru 0x03ffff (0xbbf9 bytes) 000552 1788798284.694628 trunc from 0x0178b1 to 0x0195ff (0x1d4f bytes) 000553 1788798284.715907 MIRROR_SPLIT mirror 10 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x295e57c (stale) Mirror 4: 0x295e57c (stale) Mirror 11: 0x295e57c (stale) Mirror 12: 0x295e57c (stale) Mirror 16: 0x295e57c (stale) Mirror 19: 0x295e57c (stale) Mirror 20: 0x295e57c (stale) Mirror 22: 0x295e57c (stale) Mirror 24: 0x295e57c (stale) Mirror 27: 0x295e57c (stale) Mirror 28: 0x295e57c (stale) Mirror 29: 0x295e57c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x295e57c (stale) Mirror 4: 0x295e57c (stale) Mirror 11: 0x295e57c (stale) Mirror 12: 0x295e57c (stale) Mirror 16: 0x295e57c (stale) Mirror 19: 0x295e57c (stale) Mirror 20: 0x295e57c (stale) Mirror 22: 0x295e57c (stale) Mirror 24: 0x295e57c (stale) Mirror 27: 0x295e57c (stale) Mirror 28: 0x295e57c (stale) Mirror 29: 0x295e57c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000554 1788798285.640625 MIRROR_SPLIT mirror 10 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x295e57c (stale) Mirror 4: 0x295e57c (stale) Mirror 11: 0x295e57c (stale) Mirror 12: 0x295e57c (stale) Mirror 16: 0x295e57c (stale) Mirror 19: 0x295e57c (stale) Mirror 20: 0x295e57c (stale) Mirror 22: 0x295e57c (stale) Mirror 24: 0x295e57c (stale) Mirror 28: 0x295e57c (stale) Mirror 29: 0x295e57c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x295e57c (stale) Mirror 4: 0x295e57c (stale) Mirror 11: 0x295e57c (stale) Mirror 12: 0x295e57c (stale) Mirror 16: 0x295e57c (stale) Mirror 19: 0x295e57c (stale) Mirror 20: 0x295e57c (stale) Mirror 22: 0x295e57c (stale) Mirror 24: 0x295e57c (stale) Mirror 28: 0x295e57c (stale) Mirror 29: 0x295e57c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000555 1788798286.678211 mapwrite 0x0004d5 thru 0x00cf19 (0xca45 bytes) 000556 1788798286.741950 fallocate 0x00b19c thru 0x01439d (0x9202 bytes) 000557 1788798286.746996 mapwrite 0x0030eb thru 0x007d40 (0x4c56 bytes) 000558 1788798286.762862 mapwrite 0x02e67e thru 0x03718f (0x8b12 bytes) 000560 1788798286.800251 trunc from 0x040000 to 0x024ada (0x1b525 bytes) 000561 1788798286.819017 trunc from 0x004a3a to 0x008676 (0x3c3d bytes) 000562 1788798286.825588 write 0x0043c9 thru 0x00dbf6 (0x982e bytes) 000563 1788798286.836114 trunc from 0x016922 to 0x01ba5f (0x513e bytes) 000564 1788798286.842992 write 0x009488 thru 0x00b6fc (0x2275 bytes) 000565 1788798286.844883 read 0x021dbe thru 0x024ada (0x2d1d bytes) 000566 1788798286.856897 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x24adb): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24adb): Mirror 3: 0x72c00995 (stale) Mirror 4: 0x72c00995 (stale) Mirror 11: 0x72c00995 (stale) Mirror 12: 0x72c00995 (stale) Mirror 16: 0x72c00995 (stale) Mirror 19: 0x72c00995 (stale) Mirror 20: 0x72c00995 (stale) Mirror 22: 0x72c00995 (stale) Mirror 24: 0x72c00995 (stale) Mirror 28: 0x72c00995 (stale) Mirror 29: 0x72c00995 (stale) CRC-32 checksum value for chunk [0, 0x24adb): Mirror 1: 0x6cb1c279 Mirror 30: 0x6cb1c279 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24adb: skipped 000567 1788798288.119445 punch from 0x0132f1 to 0x019edd (0x6bed bytes) 000568 1788798288.196949 MIRROR_SPLIT mirror 12 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x24adb): Mirror 3: 0x72c00995 (stale) Mirror 4: 0x72c00995 (stale) Mirror 11: 0x72c00995 (stale) Mirror 12: 0x72c00995 (stale) Mirror 16: 0x72c00995 (stale) Mirror 19: 0x72c00995 (stale) Mirror 20: 0x72c00995 (stale) Mirror 22: 0x72c00995 (stale) Mirror 24: 0x72c00995 (stale) Mirror 28: 0x72c00995 (stale) Mirror 29: 0x72c00995 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x24adb): Mirror 3: 0x72c00995 (stale) Mirror 4: 0x72c00995 (stale) Mirror 11: 0x72c00995 (stale) Mirror 12: 0x72c00995 (stale) Mirror 16: 0x72c00995 (stale) Mirror 19: 0x72c00995 (stale) Mirror 20: 0x72c00995 (stale) Mirror 22: 0x72c00995 (stale) Mirror 24: 0x72c00995 (stale) Mirror 28: 0x72c00995 (stale) Mirror 29: 0x72c00995 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x24adb: skipped 000569 1788798289.163979 write 0x012dfe thru 0x01a181 (0x7384 bytes) 000570 1788798289.186620 trunc from 0x024adb to 0x0067da (0x1e300 bytes) 000571 1788798289.216174 read 0x003752 thru 0x0067da (0x3089 bytes) 000572 1788798289.236372 mapread 0x004267 thru 0x005d40 (0x1ada bytes) 000573 1788798289.251071 MIRROR_RESYNC 12 mirrors 000574 1788798291.652920 trunc from 0x0067db to 0x017a11 (0x11237 bytes) 000575 1788798291.721076 mapwrite 0x039031 thru 0x03ffff (0x6fcf bytes) 000576 1788798291.829565 punch from 0x03a640 to 0x03ec32 (0x45f3 bytes) 000578 1788798291.846560 trunc from 0x021cbd to 0x02d964 (0xbca8 bytes) 000579 1788798291.862254 MIRROR_SPLIT mirror 9 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x4dbb235b (stale) Mirror 4: 0x4dbb235b (stale) Mirror 11: 0x4dbb235b (stale) Mirror 12: 0x4dbb235b (stale) Mirror 16: 0x4dbb235b (stale) Mirror 19: 0x4dbb235b (stale) Mirror 20: 0x4dbb235b (stale) Mirror 22: 0x4dbb235b (stale) Mirror 28: 0x4dbb235b (stale) Mirror 29: 0x4dbb235b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x4dbb235b (stale) Mirror 4: 0x4dbb235b (stale) Mirror 11: 0x4dbb235b (stale) Mirror 12: 0x4dbb235b (stale) Mirror 16: 0x4dbb235b (stale) Mirror 19: 0x4dbb235b (stale) Mirror 20: 0x4dbb235b (stale) Mirror 22: 0x4dbb235b (stale) Mirror 28: 0x4dbb235b (stale) Mirror 29: 0x4dbb235b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000580 1788798292.725058 mapwrite 0x012c8a thru 0x019781 (0x6af8 bytes) 000581 1788798292.819695 mapread 0x003bc2 thru 0x01356f (0xf9ae bytes) 000582 1788798292.830258 punch from 0x0072dc to 0x00744f (0x174 bytes) 000583 1788798292.844066 mapwrite 0x00f60b thru 0x017fab (0x89a1 bytes) 000584 1788798292.882788 MIRROR_RESYNC 11 mirrors 000585 1788798296.817033 punch from 0x01d640 to 0x01f7da (0x219b bytes) 000586 1788798296.861907 write 0x02243e thru 0x025d00 (0x38c3 bytes) 000587 1788798296.895119 trunc from 0x024001 to 0x02c321 (0x8321 bytes) 000588 1788798296.929551 read 0x03af78 thru 0x03e9da (0x3a63 bytes) 000589 1788798296.967662 mapread 0x02a6d1 thru 0x037ea3 (0xd7d3 bytes) 000590 1788798297.023052 punch from 0x00af0a to 0x012464 (0x755b bytes) 000591 1788798297.028852 punch from 0x030051 to 0x034bc3 (0x4b73 bytes) 000592 1788798297.040123 punch from 0x02a0eb to 0x0389c1 (0xe8d7 bytes) 000593 1788798297.057424 punch from 0x027e7f to 0x02e862 (0x69e4 bytes) 000594 1788798297.065390 read 0x039d06 thru 0x03ffff (0x62fa bytes) 000595 1788798297.081174 read 0x01f3aa thru 0x023427 (0x407e bytes) 000596 1788798297.081870 mapwrite 0x034e67 thru 0x03ffff (0xb199 bytes) 000597 1788798297.116357 write 0x00897c thru 0x00ddeb (0x5470 bytes) 000598 1788798297.119710 mapwrite 0x00edb8 thru 0x0118b5 (0x2afe bytes) 000599 1788798297.146347 write 0x008e4f thru 0x0155d2 (0xc784 bytes) 000600 1788798297.156159 MIRROR_RESYNC 11 mirrors 000601 1788798300.393641 mapwrite 0x008cfd thru 0x01486e (0xbb72 bytes) 000602 1788798300.658795 write 0x034f7d thru 0x03a8eb (0x596f bytes) 000604 1788798300.685597 punch from 0x016921 to 0x01ca3c (0x611c bytes) 000605 1788798300.704977 trunc from 0x03bf3b to 0x03ffff (0x40c5 bytes) 000607 1788798300.721797 read 0x02f4f0 thru 0x03b325 (0xbe36 bytes) 000608 1788798300.746594 fallocate 0x00a60d thru 0x0194ae (0xeea2 bytes) 000610 1788798300.764136 read 0x036f56 thru 0x037a6a (0xb15 bytes) 000611 1788798300.773639 mapwrite 0x011f9c thru 0x0177f5 (0x585a bytes) 000612 1788798300.882586 punch from 0x023413 to 0x0285c9 (0x51b7 bytes) 000613 1788798300.889774 mapwrite 0x01fa51 thru 0x029e9b (0xa44b bytes) 000614 1788798300.968086 read 0x0098c6 thru 0x00f6a3 (0x5dde bytes) 000615 1788798300.969640 trunc from 0x02ed8f to 0x035c84 (0x6ef6 bytes) 000616 1788798300.978570 mapwrite 0x03db89 thru 0x03ec0a (0x1082 bytes) 000617 1788798301.016003 punch from 0x017012 to 0x018265 (0x1254 bytes) 000618 1788798301.033427 read 0x009cf5 thru 0x00fa35 (0x5d41 bytes) 000619 1788798301.034568 mapread 0x0256c5 thru 0x02f241 (0x9b7d bytes) 000621 1788798301.063518 mapread 0x01ddf0 thru 0x026e0b (0x901c bytes) 000622 1788798301.064519 write 0x03085b thru 0x0342d9 (0x3a7f bytes) 000623 1788798301.067471 punch from 0x0097d2 to 0x00cebc (0x36eb bytes) 000624 1788798301.080956 fallocate 0x00770a thru 0x016ac7 (0xf3be bytes) 000625 1788798301.089258 write 0x03e791 thru 0x03ffff (0x186f bytes) 000626 1788798301.104572 trunc from 0x040000 to 0x019847 (0x267b8 bytes) 000627 1788798301.153401 mapread 0x00d266 thru 0x014af5 (0x7890 bytes) 000628 1788798301.155313 punch from 0x00b843 to 0x019847 (0xe005 bytes) 000629 1788798301.166689 punch from 0x007276 to 0x00b57c (0x4307 bytes) 000633 1788798301.188627 read 0x0177f9 thru 0x019847 (0x204f bytes) 000634 1788798301.238968 read 0x018b9e thru 0x019847 (0xcaa bytes) 000635 1788798301.239599 mapread 0x0136f0 thru 0x014348 (0xc59 bytes) 000636 1788798301.240393 read 0x0089d5 thru 0x01001f (0x764b bytes) 000637 1788798301.240937 punch from 0x0107c2 to 0x019847 (0x9086 bytes) 000638 1788798301.255157 trunc from 0x000b79 to 0x009fa7 (0x942f bytes) 000639 1788798301.280724 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x19848): Mirror 4: 0x79010f7e (stale) Mirror 11: 0x79010f7e (stale) Mirror 12: 0x79010f7e (stale) Mirror 16: 0x79010f7e (stale) Mirror 19: 0x79010f7e (stale) Mirror 20: 0x79010f7e (stale) Mirror 22: 0x79010f7e (stale) Mirror 28: 0x79010f7e (stale) Mirror 29: 0x79010f7e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x19848): Mirror 4: 0x79010f7e (stale) Mirror 11: 0x79010f7e (stale) Mirror 12: 0x79010f7e (stale) Mirror 16: 0x79010f7e (stale) Mirror 19: 0x79010f7e (stale) Mirror 20: 0x79010f7e (stale) Mirror 22: 0x79010f7e (stale) Mirror 28: 0x79010f7e (stale) Mirror 29: 0x79010f7e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x19848: skipped 000640 1788798301.879159 punch from 0x01050c to 0x01169b (0x1190 bytes) 000641 1788798301.885187 mapwrite 0x011d36 thru 0x012906 (0xbd1 bytes) 000642 1788798301.908018 trunc from 0x016b8a to 0x019847 (0x2cbe bytes) 000643 1788798301.913159 mapread 0x016082 thru 0x019847 (0x37c6 bytes) 000644 1788798301.924452 MIRROR_RESYNC 10 mirrors 000645 1788798304.116337 write 0x017670 thru 0x026c83 (0xf614 bytes) 000646 1788798304.177491 write 0x007f49 thru 0x0160eb (0xe1a3 bytes) 000647 1788798304.189722 trunc from 0x00ba0c to 0x00bcc6 (0x2bb bytes) 000648 1788798304.206157 mapwrite 0x01352b thru 0x01e62f (0xb105 bytes) 000649 1788798304.225710 mapwrite 0x0114ec thru 0x01dcf8 (0xc80d bytes) 000650 1788798304.247300 trunc from 0x026c84 to 0x036647 (0xf9c4 bytes) 000651 1788798304.272644 fallocate 0x0352b4 thru 0x03ffff (0xad4c bytes) 000652 1788798304.278585 fallocate 0x026b66 thru 0x02a3ca (0x3865 bytes) 000653 1788798304.286450 mapread 0x032720 thru 0x036647 (0x3f28 bytes) 000654 1788798304.303163 mapwrite 0x0014c4 thru 0x002776 (0x12b3 bytes) 000655 1788798304.331022 punch from 0x036246 to 0x036647 (0x402 bytes) 000656 1788798304.335337 mapread 0x032ddf thru 0x036647 (0x3869 bytes) 000657 1788798304.348542 mapwrite 0x0303b6 thru 0x0327ff (0x244a bytes) 000658 1788798304.359919 trunc from 0x02af1f to 0x036647 (0xb729 bytes) 000659 1788798304.363978 mapread 0x024104 thru 0x031a7b (0xd978 bytes) 000660 1788798304.393499 punch from 0x006435 to 0x013a8f (0xd65b bytes) 000661 1788798304.400403 write 0x01a753 thru 0x028175 (0xda23 bytes) 000662 1788798304.403005 read 0x00b8ac thru 0x01ad57 (0xf4ac bytes) 000664 1788798304.418047 read 0x01f1a5 thru 0x0236a4 (0x4500 bytes) 000665 1788798304.419371 mapwrite 0x000980 thru 0x0022fd (0x197e bytes) 000666 1788798304.458621 read 0x02b533 thru 0x0341aa (0x8c78 bytes) 000667 1788798304.459395 write 0x0322da thru 0x034c14 (0x293b bytes) 000668 1788798304.461147 read 0x020a1b thru 0x02ce2f (0xc415 bytes) 000669 1788798304.461906 write 0x013fa9 thru 0x019a71 (0x5ac9 bytes) 000670 1788798304.463153 mapread 0x014de4 thru 0x01d6fd (0x891a bytes) 000671 1788798304.464257 trunc from 0x010c95 to 0x015281 (0x45ed bytes) 000672 1788798304.486599 read 0x033df2 thru 0x036647 (0x2856 bytes) 000673 1788798304.488082 mapread 0x02f107 thru 0x031e92 (0x2d8c bytes) 000674 1788798304.489183 trunc from 0x036648 to 0x0338ae (0x2d99 bytes) 000675 1788798304.514771 fallocate 0x025f32 thru 0x035455 (0xf524 bytes) 000676 1788798304.521577 fallocate 0x038599 thru 0x03ffff (0x7a67 bytes) 000677 1788798304.538202 write 0x02d676 thru 0x0310f8 (0x3a83 bytes) 000678 1788798304.539637 write 0x00412a thru 0x004a93 (0x96a bytes) 000679 1788798304.541944 write 0x032aec thru 0x0349d1 (0x1ee6 bytes) 000680 1788798304.556185 punch from 0x009783 to 0x00eca0 (0x551e bytes) 000681 1788798304.562251 mapwrite 0x023117 thru 0x027480 (0x436a bytes) 000682 1788798304.637633 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0x877046d1 (stale) Mirror 11: 0x877046d1 (stale) Mirror 12: 0x877046d1 (stale) Mirror 16: 0x877046d1 (stale) Mirror 19: 0x877046d1 (stale) Mirror 20: 0x877046d1 (stale) Mirror 22: 0x877046d1 (stale) Mirror 28: 0x877046d1 (stale) Mirror 29: 0x877046d1 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xca9c600d Mirror 30: 0xca9c600d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000683 1788798305.938925 write 0x009a1f thru 0x015e9a (0xc47c bytes) 000684 1788798306.053364 read 0x02b669 thru 0x0313d7 (0x5d6f bytes) 000685 1788798306.064197 write 0x01c83d thru 0x020f9a (0x475e bytes) 000686 1788798306.075368 trunc from 0x040000 to 0x02f083 (0x10f7c bytes) 000688 1788798306.106377 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x2f084): Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2f084): Mirror 4: 0xcec2586c (stale) Mirror 11: 0xcec2586c (stale) Mirror 12: 0xcec2586c (stale) Mirror 16: 0xcec2586c (stale) Mirror 19: 0xcec2586c (stale) Mirror 20: 0xcec2586c (stale) Mirror 22: 0xcec2586c (stale) Mirror 28: 0xcec2586c (stale) Mirror 29: 0xcec2586c (stale) Mirror 30: 0xc3a888bc (stale) CRC-32 checksum value for chunk [0, 0x2f084): Mirror 1: 0x85de1183 Mirror 31: 0x85de1183 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2f084: skipped 000689 1788798307.247929 read 0x00656a thru 0x009b28 (0x35bf bytes) 000690 1788798307.264988 mapwrite 0x017326 thru 0x017d2e (0xa09 bytes) 000691 1788798307.373283 write 0x0118ab thru 0x02069c (0xedf2 bytes) 000692 1788798307.395356 punch from 0x017253 to 0x026606 (0xf3b4 bytes) 000693 1788798307.449984 mapwrite 0x0210c2 thru 0x02a088 (0x8fc7 bytes) 000694 1788798307.557340 mapwrite 0x017863 thru 0x022e14 (0xb5b2 bytes) 000695 1788798307.607786 read 0x018cf6 thru 0x02158f (0x889a bytes) 000696 1788798307.609672 trunc from 0x005264 to 0x00f11c (0x9eb9 bytes) 000697 1788798307.630643 trunc from 0x02f084 to 0x017d90 (0x172f3 bytes) 000698 1788798307.740131 write 0x02fd32 thru 0x03c687 (0xc956 bytes) 000699 1788798307.753361 trunc from 0x0358fd to 0x03c687 (0x6d8b bytes) 000700 1788798307.789105 write 0x03c9be thru 0x03f621 (0x2c64 bytes) 000701 1788798307.816513 trunc from 0x022804 to 0x027427 (0x4c24 bytes) 000702 1788798307.843317 write 0x0371e6 thru 0x03ffff (0x8e1a bytes) 000703 1788798307.847429 trunc from 0x040000 to 0x03b139 (0x4ec6 bytes) 000704 1788798307.869604 punch from 0x024759 to 0x027131 (0x29d9 bytes) 000705 1788798307.889371 MIRROR_SPLIT mirror 7 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b13a): Mirror 4: 0x2e5ead1b (stale) Mirror 11: 0x2e5ead1b (stale) Mirror 12: 0x2e5ead1b (stale) Mirror 16: 0x2e5ead1b (stale) Mirror 19: 0x2e5ead1b (stale) Mirror 20: 0x2e5ead1b (stale) Mirror 28: 0x2e5ead1b (stale) Mirror 29: 0x2e5ead1b (stale) Mirror 30: 0xcafa8051 (stale) Mirror 31: 0xc6ebff78 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b13a): Mirror 4: 0x2e5ead1b (stale) Mirror 11: 0x2e5ead1b (stale) Mirror 12: 0x2e5ead1b (stale) Mirror 16: 0x2e5ead1b (stale) Mirror 19: 0x2e5ead1b (stale) Mirror 20: 0x2e5ead1b (stale) Mirror 28: 0x2e5ead1b (stale) Mirror 29: 0x2e5ead1b (stale) Mirror 30: 0xcafa8051 (stale) Mirror 31: 0xc6ebff78 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b13a: skipped 000706 1788798308.770194 mapwrite 0x030eee thru 0x0380df (0x71f2 bytes) 000707 1788798308.812515 write 0x022c57 thru 0x02b1e9 (0x8593 bytes) 000708 1788798308.827090 trunc from 0x02d273 to 0x038f77 (0xbd05 bytes) 000709 1788798308.843401 MIRROR_SPLIT mirror 5 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b13a): Mirror 4: 0x2e5ead1b (stale) Mirror 11: 0x2e5ead1b (stale) Mirror 12: 0x2e5ead1b (stale) Mirror 16: 0x2e5ead1b (stale) Mirror 20: 0x2e5ead1b (stale) Mirror 28: 0x2e5ead1b (stale) Mirror 29: 0x2e5ead1b (stale) Mirror 30: 0xcafa8051 (stale) Mirror 31: 0xc6ebff78 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b13a): Mirror 4: 0x2e5ead1b (stale) Mirror 11: 0x2e5ead1b (stale) Mirror 12: 0x2e5ead1b (stale) Mirror 16: 0x2e5ead1b (stale) Mirror 20: 0x2e5ead1b (stale) Mirror 28: 0x2e5ead1b (stale) Mirror 29: 0x2e5ead1b (stale) Mirror 30: 0xcafa8051 (stale) Mirror 31: 0xc6ebff78 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b13a: skipped 000710 1788798309.633360 read 0x027fbc thru 0x029cf5 (0x1d3a bytes) 000711 1788798309.641042 punch from 0x03363e to 0x03b139 (0x7afc bytes) 000713 1788798309.650276 punch from 0x02b87a to 0x02c9fe (0x1185 bytes) 000715 1788798309.656224 read 0x02135f thru 0x0279af (0x6651 bytes) 000716 1788798309.666802 write 0x01043e thru 0x01eaaf (0xe672 bytes) 000718 1788798309.672420 fallocate 0x030fa0 thru 0x034d0a (0x3d6b bytes) 000719 1788798309.678255 trunc from 0x012f24 to 0x0162f9 (0x33d6 bytes) 000720 1788798309.693170 trunc from 0x03b13a to 0x020fbc (0x1a17d bytes) 000721 1788798309.706472 punch from 0x019cc1 to 0x020fbc (0x72fc bytes) 000722 1788798309.712398 mapwrite 0x003dc9 thru 0x00a65d (0x6895 bytes) 000723 1788798309.734304 mapwrite 0x01ef38 thru 0x0284f7 (0x95c0 bytes) 000724 1788798309.858336 mapread 0x01188b thru 0x021039 (0xf7af bytes) 000725 1788798309.924331 fallocate 0x0204ef thru 0x027cf5 (0x7807 bytes) 000726 1788798309.931327 punch from 0x00beb4 to 0x00dc9b (0x1de8 bytes) 000727 1788798309.936470 mapread 0x0172fe thru 0x020ddf (0x9ae2 bytes) 000729 1788798309.938605 mapwrite 0x027dde thru 0x036362 (0xe585 bytes) 000730 1788798310.044794 MIRROR_RESYNC 10 mirrors 000731 1788798312.562314 read 0x013e10 thru 0x01740a (0x35fb bytes) 000733 1788798312.572693 trunc from 0x031bc7 to 0x033985 (0x1dbf bytes) 000734 1788798312.613648 fallocate 0x02f6ef thru 0x0350e3 (0x59f5 bytes) 000736 1788798312.625043 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x36363): Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36363): Mirror 4: 0xbb345592 (stale) Mirror 11: 0xbb345592 (stale) Mirror 12: 0xbb345592 (stale) Mirror 16: 0xbb345592 (stale) Mirror 20: 0xbb345592 (stale) Mirror 28: 0xbb345592 (stale) Mirror 29: 0xbb345592 (stale) Mirror 30: 0xbb345592 (stale) Mirror 31: 0xbb345592 (stale) CRC-32 checksum value for chunk [0, 0x36363): Mirror 1: 0x32a436af Mirror 32: 0x32a436af lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36363: skipped 000737 1788798313.923398 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x36363): Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36363): Mirror 4: 0xbb345592 (stale) Mirror 11: 0xbb345592 (stale) Mirror 12: 0xbb345592 (stale) Mirror 16: 0xbb345592 (stale) Mirror 20: 0xbb345592 (stale) Mirror 28: 0xbb345592 (stale) Mirror 29: 0xbb345592 (stale) Mirror 30: 0xbb345592 (stale) Mirror 31: 0xbb345592 (stale) CRC-32 checksum value for chunk [0, 0x36363): Mirror 1: 0x32a436af Mirror 32: 0x32a436af Mirror 33: 0x32a436af lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36363: skipped 000738 1788798314.974168 MIRROR_RESYNC 12 mirrors 000739 1788798318.479268 trunc from 0x01082f to 0x01f4e9 (0xecbb bytes) 000740 1788798318.533093 write 0x038740 thru 0x03ffff (0x78c0 bytes) 000741 1788798318.534840 trunc from 0x035d42 to 0x03a3b7 (0x4676 bytes) 000742 1788798318.555512 punch from 0x01868f to 0x024b9f (0xc511 bytes) 000743 1788798318.563620 trunc from 0x02cc27 to 0x02e2cd (0x16a7 bytes) 000745 1788798318.576509 read 0x03a1b6 thru 0x03ffff (0x5e4a bytes) 000747 1788798318.584567 fallocate 0x01cc75 thru 0x028c91 (0xc01d bytes) 000748 1788798318.593722 mapwrite 0x0276b4 thru 0x036116 (0xea63 bytes) 000749 1788798318.656300 read 0x021875 thru 0x02542e (0x3bba bytes) 000750 1788798318.676383 MIRROR_RESYNC 12 mirrors 000752 1788798322.197604 MIRROR_EXTEND to 13 mirrors 000753 1788798323.466130 write 0x01095f thru 0x0193e1 (0x8a83 bytes) 000754 1788798323.552218 mapwrite 0x03f7ad thru 0x03ffff (0x853 bytes) 000755 1788798323.591432 punch from 0x013205 to 0x016d95 (0x3b91 bytes) 000756 1788798323.606536 MIRROR_RESYNC 13 mirrors 000758 1788798328.066401 mapwrite 0x0181b6 thru 0x026472 (0xe2bd bytes) 000759 1788798328.237482 mapread 0x037bbe thru 0x03b9dd (0x3e20 bytes) 000760 1788798328.297891 trunc from 0x040000 to 0x0289d0 (0x1762f bytes) 000761 1788798328.371295 MIRROR_SPLIT mirror 6 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x289d1): Mirror 4: 0xfc160b01 (stale) Mirror 11: 0xfc160b01 (stale) Mirror 12: 0xfc160b01 (stale) Mirror 16: 0xfc160b01 (stale) Mirror 20: 0xfc160b01 (stale) Mirror 29: 0xfc160b01 (stale) Mirror 30: 0xfc160b01 (stale) Mirror 31: 0xfc160b01 (stale) Mirror 32: 0xfc160b01 (stale) Mirror 33: 0xfc160b01 (stale) Mirror 34: 0xfc160b01 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x289d1): Mirror 4: 0xfc160b01 (stale) Mirror 11: 0xfc160b01 (stale) Mirror 12: 0xfc160b01 (stale) Mirror 16: 0xfc160b01 (stale) Mirror 20: 0xfc160b01 (stale) Mirror 29: 0xfc160b01 (stale) Mirror 30: 0xfc160b01 (stale) Mirror 31: 0xfc160b01 (stale) Mirror 32: 0xfc160b01 (stale) Mirror 33: 0xfc160b01 (stale) Mirror 34: 0xfc160b01 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x289d1: skipped 000763 1788798329.412373 trunc from 0x01ed09 to 0x0289d0 (0x9cc8 bytes) 000764 1788798329.436810 mapwrite 0x030159 thru 0x031e1d (0x1cc5 bytes) 000765 1788798329.512140 trunc from 0x016e7c to 0x026905 (0xfa8a bytes) 000766 1788798329.524279 write 0x00669e thru 0x012ab1 (0xc414 bytes) 000767 1788798329.558675 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x31e1e): Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31e1e): Mirror 4: 0x71b227d (stale) Mirror 11: 0x71b227d (stale) Mirror 12: 0x71b227d (stale) Mirror 16: 0x71b227d (stale) Mirror 20: 0x71b227d (stale) Mirror 29: 0x71b227d (stale) Mirror 30: 0x71b227d (stale) Mirror 31: 0x71b227d (stale) Mirror 32: 0x71b227d (stale) Mirror 33: 0x71b227d (stale) Mirror 34: 0x71b227d (stale) CRC-32 checksum value for chunk [0, 0x31e1e): Mirror 1: 0x879ae8c4 Mirror 35: 0x879ae8c4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31e1e: skipped 000768 1788798331.043505 read 0x017c74 thru 0x024e1b (0xd1a8 bytes) 000769 1788798331.076816 trunc from 0x031e1e to 0x018877 (0x195a6 bytes) 000770 1788798331.160573 trunc from 0x007501 to 0x01667a (0xf17a bytes) 000771 1788798331.166890 read 0x000ac1 thru 0x006e3b (0x637b bytes) 000772 1788798331.177405 fallocate 0x0349d7 thru 0x0363cf (0x19f9 bytes) 000773 1788798331.182903 mapread 0x008250 thru 0x01377a (0xb52b bytes) 000774 1788798331.188307 MIRROR_RESYNC 13 mirrors 000775 1788798333.823109 trunc from 0x028296 to 0x02af7e (0x2ce9 bytes) 000776 1788798333.858475 trunc from 0x02a577 to 0x02f3dd (0x4e67 bytes) 000777 1788798333.864526 trunc from 0x0363d0 to 0x01fe6a (0x16565 bytes) 000778 1788798333.887247 trunc from 0x008dd4 to 0x016bb3 (0xdde0 bytes) 000779 1788798333.892630 fallocate 0x00b8c7 thru 0x00c5e7 (0xd21 bytes) 000780 1788798333.898232 trunc from 0x0040aa to 0x004424 (0x37b bytes) 000781 1788798333.904298 punch from 0x015a84 to 0x016a93 (0x1010 bytes) 000782 1788798333.909834 punch from 0x004619 to 0x00aa54 (0x643c bytes) 000783 1788798333.914318 trunc from 0x00b6e9 to 0x00d22f (0x1b47 bytes) 000784 1788798333.923449 trunc from 0x01fe6b to 0x0364e2 (0x16678 bytes) 000785 1788798333.941382 trunc from 0x0364e3 to 0x00ea81 (0x27a61 bytes) 000786 1788798333.964643 mapwrite 0x036f35 thru 0x03fcc1 (0x8d8d bytes) 000787 1788798334.023304 mapread 0x00dc57 thru 0x01985b (0xbc05 bytes) 000789 1788798334.050695 punch from 0x00aac6 to 0x010dee (0x6329 bytes) 000790 1788798334.056198 mapwrite 0x02b55d thru 0x032749 (0x71ed bytes) 000791 1788798334.088236 trunc from 0x03fcc2 to 0x03e82b (0x1496 bytes) 000793 1788798334.105940 read 0x003573 thru 0x00e296 (0xad24 bytes) 000794 1788798334.116846 mapread 0x01b315 thru 0x022f10 (0x7bfc bytes) 000795 1788798334.127287 punch from 0x017114 to 0x01b255 (0x4142 bytes) 000796 1788798334.132586 mapwrite 0x030b2c thru 0x03eb1f (0xdff4 bytes) 000797 1788798334.176497 trunc from 0x0376f4 to 0x03eb1f (0x742c bytes) 000798 1788798334.182526 punch from 0x0147b0 to 0x014c81 (0x4d2 bytes) 000799 1788798334.187399 punch from 0x023166 to 0x02b2a0 (0x813b bytes) 000800 1788798334.193035 write 0x02e7d5 thru 0x0331ba (0x49e6 bytes) 000801 1788798334.197859 MIRROR_SPLIT mirror 9 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3eb20): Mirror 4: 0x6204163 (stale) Mirror 11: 0x6204163 (stale) Mirror 12: 0x6204163 (stale) Mirror 16: 0x6204163 (stale) Mirror 20: 0x6204163 (stale) Mirror 29: 0x6204163 (stale) Mirror 30: 0x6204163 (stale) Mirror 31: 0x6204163 (stale) Mirror 33: 0x6204163 (stale) Mirror 34: 0x6204163 (stale) Mirror 35: 0x6204163 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3eb20): Mirror 4: 0x6204163 (stale) Mirror 11: 0x6204163 (stale) Mirror 12: 0x6204163 (stale) Mirror 16: 0x6204163 (stale) Mirror 20: 0x6204163 (stale) Mirror 29: 0x6204163 (stale) Mirror 30: 0x6204163 (stale) Mirror 31: 0x6204163 (stale) Mirror 33: 0x6204163 (stale) Mirror 34: 0x6204163 (stale) Mirror 35: 0x6204163 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3eb20: skipped 000802 1788798334.850247 mapread 0x01797d thru 0x01e8a8 (0x6f2c bytes) 000804 1788798334.893709 write 0x03e89b thru 0x03ffff (0x1765 bytes) 000805 1788798334.914020 fallocate 0x031420 thru 0x039788 (0x8369 bytes) 000806 1788798334.925186 trunc from 0x040000 to 0x02b588 (0x14a77 bytes) 000807 1788798334.957897 punch from 0x01ce19 to 0x02582b (0x8a13 bytes) 000808 1788798334.965030 read 0x0086ff thru 0x00b519 (0x2e1b bytes) 000810 1788798334.979496 fallocate 0x02d7f0 thru 0x02f700 (0x1f11 bytes) 000811 1788798334.985653 fallocate 0x00a52c thru 0x011da2 (0x7877 bytes) 000812 1788798334.994164 mapwrite 0x02f1d7 thru 0x02f363 (0x18d bytes) 000813 1788798335.040523 trunc from 0x02acdd to 0x02f363 (0x4687 bytes) 000814 1788798335.048060 trunc from 0x0054c4 to 0x011e38 (0xc975 bytes) 000816 1788798335.054335 write 0x032983 thru 0x03a86f (0x7eed bytes) 000818 1788798335.058220 fallocate 0x0172e2 thru 0x01b82c (0x454b bytes) 000819 1788798335.064225 punch from 0x01def5 to 0x01f93a (0x1a46 bytes) 000820 1788798335.069565 write 0x009fb8 thru 0x00b0b0 (0x10f9 bytes) 000821 1788798335.090195 MIRROR_RESYNC 12 mirrors 000822 1788798339.705590 punch from 0x026d61 to 0x02c5d8 (0x5878 bytes) 000823 1788798339.742019 fallocate 0x0036a5 thru 0x00474e (0x10aa bytes) 000824 1788798339.750225 mapread 0x0009aa thru 0x00ceb8 (0xc50f bytes) 000825 1788798339.782991 MIRROR_SPLIT mirror 9 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a870): Mirror 4: 0xd03404b2 (stale) Mirror 11: 0xd03404b2 (stale) Mirror 12: 0xd03404b2 (stale) Mirror 16: 0xd03404b2 (stale) Mirror 20: 0xd03404b2 (stale) Mirror 29: 0xd03404b2 (stale) Mirror 30: 0xd03404b2 (stale) Mirror 31: 0xd03404b2 (stale) Mirror 34: 0xd03404b2 (stale) Mirror 35: 0xd03404b2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a870): Mirror 4: 0xd03404b2 (stale) Mirror 11: 0xd03404b2 (stale) Mirror 12: 0xd03404b2 (stale) Mirror 16: 0xd03404b2 (stale) Mirror 20: 0xd03404b2 (stale) Mirror 29: 0xd03404b2 (stale) Mirror 30: 0xd03404b2 (stale) Mirror 31: 0xd03404b2 (stale) Mirror 34: 0xd03404b2 (stale) Mirror 35: 0xd03404b2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a870: skipped 000826 1788798340.840141 fallocate 0x01143f thru 0x016e17 (0x59d9 bytes) 000827 1788798340.848337 write 0x027a84 thru 0x035e2d (0xe3aa bytes) 000828 1788798340.893781 read 0x02067b thru 0x029530 (0x8eb6 bytes) 000829 1788798340.913034 punch from 0x022282 to 0x02fe81 (0xdc00 bytes) 000830 1788798340.948422 punch from 0x002c78 to 0x009382 (0x670b bytes) 000831 1788798340.956034 read 0x003457 thru 0x00f730 (0xc2da bytes) 000832 1788798340.970038 trunc from 0x028641 to 0x0374fd (0xeebd bytes) 000833 1788798340.981548 punch from 0x026d59 to 0x02c3b9 (0x5661 bytes) 000834 1788798340.992595 trunc from 0x01afdc to 0x01c9b7 (0x19dc bytes) 000835 1788798341.004479 write 0x003d1f thru 0x0107cd (0xcaaf bytes) 000836 1788798341.010386 trunc from 0x02aa36 to 0x03761a (0xcbe5 bytes) 000837 1788798341.019051 punch from 0x002e02 to 0x00c462 (0x9661 bytes) 000838 1788798341.057828 fallocate 0x0211d3 thru 0x026ad3 (0x5901 bytes) 000839 1788798341.083503 MIRROR_SPLIT mirror 8 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a870): Mirror 4: 0xd03404b2 (stale) Mirror 11: 0xd03404b2 (stale) Mirror 12: 0xd03404b2 (stale) Mirror 16: 0xd03404b2 (stale) Mirror 20: 0xd03404b2 (stale) Mirror 29: 0xd03404b2 (stale) Mirror 30: 0xd03404b2 (stale) Mirror 34: 0xd03404b2 (stale) Mirror 35: 0xd03404b2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a870): Mirror 4: 0xd03404b2 (stale) Mirror 11: 0xd03404b2 (stale) Mirror 12: 0xd03404b2 (stale) Mirror 16: 0xd03404b2 (stale) Mirror 20: 0xd03404b2 (stale) Mirror 29: 0xd03404b2 (stale) Mirror 30: 0xd03404b2 (stale) Mirror 34: 0xd03404b2 (stale) Mirror 35: 0xd03404b2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a870: skipped 000840 1788798342.014329 MIRROR_SPLIT mirror 9 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3a870): Mirror 4: 0xd03404b2 (stale) Mirror 11: 0xd03404b2 (stale) Mirror 12: 0xd03404b2 (stale) Mirror 16: 0xd03404b2 (stale) Mirror 20: 0xd03404b2 (stale) Mirror 29: 0xd03404b2 (stale) Mirror 30: 0xd03404b2 (stale) Mirror 34: 0xd03404b2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a870): Mirror 4: 0xd03404b2 (stale) Mirror 11: 0xd03404b2 (stale) Mirror 12: 0xd03404b2 (stale) Mirror 16: 0xd03404b2 (stale) Mirror 20: 0xd03404b2 (stale) Mirror 29: 0xd03404b2 (stale) Mirror 30: 0xd03404b2 (stale) Mirror 34: 0xd03404b2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a870: skipped 000841 1788798342.745063 write 0x01d4cb thru 0x02a7b8 (0xd2ee bytes) 000842 1788798342.788078 trunc from 0x00bcfc to 0x019601 (0xd906 bytes) 000843 1788798342.797662 read 0x00428f thru 0x013642 (0xf3b4 bytes) 000844 1788798342.809200 fallocate 0x03b77d thru 0x03ffff (0x4883 bytes) 000845 1788798342.814631 mapwrite 0x00fd95 thru 0x01abd4 (0xae40 bytes) 000846 1788798342.933316 trunc from 0x03a870 to 0x01570b (0x25164 bytes) 000847 1788798342.966387 trunc from 0x00de33 to 0x013091 (0x525f bytes) 000848 1788798342.975817 fallocate 0x029c1e thru 0x0318b2 (0x7c95 bytes) 000849 1788798342.981928 mapread 0x01211b thru 0x013b73 (0x1a59 bytes) 000850 1788798342.996946 trunc from 0x02de29 to 0x0318b2 (0x3a8a bytes) 000851 1788798343.003271 read 0x002af2 thru 0x0105fd (0xdb0c bytes) 000852 1788798343.014938 punch from 0x0106ce to 0x01a856 (0xa189 bytes) 000853 1788798343.021452 punch from 0x02dd40 to 0x0318b2 (0x3b73 bytes) 000854 1788798343.027481 write 0x01f15d thru 0x028a60 (0x9904 bytes) 000855 1788798343.029932 mapwrite 0x01aa10 thru 0x0246ab (0x9c9c bytes) 000857 1788798343.079945 mapwrite 0x03ce7d thru 0x03ffff (0x3183 bytes) 000858 1788798343.130922 punch from 0x014e17 to 0x0151c3 (0x3ad bytes) 000859 1788798343.139036 fallocate 0x03fad3 thru 0x03ffff (0x52d bytes) 000860 1788798343.146040 write 0x004387 thru 0x008b00 (0x477a bytes) 000861 1788798343.148343 read 0x02da64 thru 0x038e57 (0xb3f4 bytes) 000862 1788798343.161789 punch from 0x00bff9 to 0x015b01 (0x9b09 bytes) 000863 1788798343.167363 mapwrite 0x03f40b thru 0x03ffff (0xbf5 bytes) 000864 1788798343.188619 mapwrite 0x027b17 thru 0x02f183 (0x766d bytes) 000865 1788798343.211969 fallocate 0x030ead thru 0x03ecb4 (0xde08 bytes) 000866 1788798343.230954 trunc from 0x02463c to 0x029d6a (0x572f bytes) 000868 1788798343.239170 trunc from 0x0182c3 to 0x01b61f (0x335d bytes) 000869 1788798343.250374 write 0x0319e0 thru 0x03ffff (0xe620 bytes) 000870 1788798343.255469 mapwrite 0x006cb7 thru 0x00999c (0x2ce6 bytes) 000871 1788798343.304141 mapread 0x009603 thru 0x0152f5 (0xbcf3 bytes) 000872 1788798343.447114 mapread 0x012a9a thru 0x0214ca (0xea31 bytes) 000873 1788798343.511698 write 0x037d59 thru 0x03ffff (0x82a7 bytes) 000874 1788798343.519472 trunc from 0x040000 to 0x03f668 (0x997 bytes) 000875 1788798343.562367 trunc from 0x03b7b5 to 0x03f668 (0x3eb4 bytes) 000876 1788798343.579396 mapread 0x002cb7 thru 0x007db4 (0x50fe bytes) 000877 1788798343.580334 punch from 0x007f3e to 0x013ed8 (0xbf9b bytes) 000878 1788798343.588389 fallocate 0x0286c6 thru 0x02a1b8 (0x1af3 bytes) 000879 1788798343.597378 write 0x02f356 thru 0x02fcc2 (0x96d bytes) 000880 1788798343.600398 read 0x013a80 thru 0x021686 (0xdc07 bytes) 000882 1788798343.661911 mapwrite 0x01a3ea thru 0x027718 (0xd32f bytes) 000883 1788798343.728010 punch from 0x031e3e to 0x0385a6 (0x6769 bytes) 000884 1788798343.750004 trunc from 0x03f669 to 0x000161 (0x3f507 bytes) 000885 1788798343.796229 trunc from 0x0000b6 to 0x000161 (0xac bytes) 000886 1788798343.809482 trunc from 0x000120 to 0x000161 (0x42 bytes) 000887 1788798343.818918 mapread 0x0000d2 thru 0x000161 (0x90 bytes) 000888 1788798343.826248 fallocate 0x00c20d thru 0x012413 (0x6207 bytes) 000889 1788798343.839451 punch from 0x011614 to 0x012413 (0xe00 bytes) 000890 1788798343.852979 fallocate 0x017044 thru 0x01935a (0x2317 bytes) 000891 1788798343.867595 MIRROR_SPLIT mirror 3 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1935b): Mirror 4: 0x6db0696c (stale) Mirror 11: 0x6db0696c (stale) Mirror 16: 0x6db0696c (stale) Mirror 20: 0x6db0696c (stale) Mirror 29: 0x6db0696c (stale) Mirror 30: 0x6db0696c (stale) Mirror 34: 0x6db0696c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1935b): Mirror 4: 0x6db0696c (stale) Mirror 11: 0x6db0696c (stale) Mirror 16: 0x6db0696c (stale) Mirror 20: 0x6db0696c (stale) Mirror 29: 0x6db0696c (stale) Mirror 30: 0x6db0696c (stale) Mirror 34: 0x6db0696c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1935b: skipped 000892 1788798344.550906 fallocate 0x01a5e6 thru 0x01f56f (0x4f8a bytes) 000894 1788798344.557220 read 0x01c4a1 thru 0x01f56f (0x30cf bytes) 000895 1788798344.563710 trunc from 0x01e42c to 0x01f56f (0x1144 bytes) 000896 1788798344.573232 mapwrite 0x029328 thru 0x035011 (0xbcea bytes) 000900 1788798344.682507 trunc from 0x00306a to 0x009810 (0x67a7 bytes) 000901 1788798344.689343 trunc from 0x016d7c to 0x021a67 (0xacec bytes) 000902 1788798344.713326 punch from 0x02cfe6 to 0x034ff4 (0x800f bytes) 000903 1788798344.724936 fallocate 0x01cb0b thru 0x028f91 (0xc487 bytes) 000904 1788798344.730130 write 0x020139 thru 0x020233 (0xfb bytes) 000905 1788798344.735205 mapread 0x018572 thru 0x01b3cb (0x2e5a bytes) 000906 1788798344.748256 mapread 0x01dbd8 thru 0x020504 (0x292d bytes) 000907 1788798344.749239 mapread 0x00b6ca thru 0x01424d (0x8b84 bytes) 000908 1788798344.776389 trunc from 0x035012 to 0x01a6bc (0x1a955 bytes) 000909 1788798344.794832 punch from 0x00879c to 0x015e38 (0xd69d bytes) 000910 1788798344.805475 punch from 0x005386 to 0x0060c3 (0xd3e bytes) 000911 1788798344.835910 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1a6bd): Mirror 4: 0x6499ccee (stale) Mirror 11: 0x6499ccee (stale) Mirror 16: 0x6499ccee (stale) Mirror 20: 0x6499ccee (stale) Mirror 29: 0x6499ccee (stale) Mirror 30: 0x6499ccee (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a6bd): Mirror 4: 0x6499ccee (stale) Mirror 11: 0x6499ccee (stale) Mirror 16: 0x6499ccee (stale) Mirror 20: 0x6499ccee (stale) Mirror 29: 0x6499ccee (stale) Mirror 30: 0x6499ccee (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a6bd: skipped 000912 1788798345.554593 trunc from 0x01a6bd to 0x03b94f (0x21293 bytes) 000913 1788798345.579406 fallocate 0x032fc1 thru 0x0393d2 (0x6412 bytes) 000914 1788798345.585374 read 0x031bec thru 0x036d98 (0x51ad bytes) 000915 1788798345.599685 mapwrite 0x0294d2 thru 0x038417 (0xef46 bytes) 000917 1788798345.702929 mapwrite 0x02dfd5 thru 0x0379d0 (0x99fc bytes) 000918 1788798345.739116 trunc from 0x0315b2 to 0x03b94f (0xa39e bytes) 000919 1788798345.753713 trunc from 0x0364fa to 0x039757 (0x325e bytes) 000920 1788798345.763750 mapread 0x0216c0 thru 0x02e21f (0xcb60 bytes) 000923 1788798345.788157 read 0x019de2 thru 0x02489e (0xaabd bytes) 000924 1788798345.829326 MIRROR_RESYNC 7 mirrors 000925 1788798348.083391 trunc from 0x03b950 to 0x03b517 (0x438 bytes) 000926 1788798348.168220 punch from 0x007547 to 0x01234c (0xae06 bytes) 000928 1788798348.178759 trunc from 0x03b518 to 0x01262a (0x28eed bytes) 000929 1788798348.207952 trunc from 0x01262b to 0x015d8c (0x3762 bytes) 000930 1788798348.252438 trunc from 0x015d8d to 0x0327e2 (0x1ca56 bytes) 000931 1788798348.271486 fallocate 0x01396d thru 0x019c76 (0x630a bytes) 000932 1788798348.287707 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x327e3): Mirror 4: (stale - read error) Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x327e3): Mirror 4: 0xacd6cd25 (stale) Mirror 11: 0xacd6cd25 (stale) Mirror 16: 0xacd6cd25 (stale) Mirror 20: 0xacd6cd25 (stale) Mirror 29: 0xacd6cd25 (stale) Mirror 30: 0xacd6cd25 (stale) CRC-32 checksum value for chunk [0, 0x327e3): Mirror 1: 0xb711d099 Mirror 31: 0xb711d099 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x327e3: skipped 000933 1788798349.796965 MIRROR_SPLIT mirror 7 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x327e3): Mirror 4: 0xacd6cd25 (stale) Mirror 11: 0xacd6cd25 (stale) Mirror 16: 0xacd6cd25 (stale) Mirror 20: 0xacd6cd25 (stale) Mirror 29: 0xacd6cd25 (stale) Mirror 30: 0xacd6cd25 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x327e3): Mirror 4: 0xacd6cd25 (stale) Mirror 11: 0xacd6cd25 (stale) Mirror 16: 0xacd6cd25 (stale) Mirror 20: 0xacd6cd25 (stale) Mirror 29: 0xacd6cd25 (stale) Mirror 30: 0xacd6cd25 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x327e3: skipped 000934 1788798350.567277 mapwrite 0x010f16 thru 0x01c1fd (0xb2e8 bytes) 000935 1788798350.655382 punch from 0x02ce28 to 0x0327e2 (0x59bb bytes) 000938 1788798350.669611 fallocate 0x01b3c1 thru 0x026e3c (0xba7c bytes) 000939 1788798350.688586 trunc from 0x00ac15 to 0x00da13 (0x2dff bytes) 000940 1788798350.702696 mapread 0x007900 thru 0x015382 (0xda83 bytes) 000941 1788798350.734790 mapread 0x025b62 thru 0x02f728 (0x9bc7 bytes) 000942 1788798350.791990 mapwrite 0x00d27e thru 0x010b85 (0x3908 bytes) 000943 1788798350.814166 trunc from 0x009f29 to 0x00cd7f (0x2e57 bytes) 000944 1788798350.824231 mapread 0x02559c thru 0x0327e2 (0xd247 bytes) 000945 1788798350.825551 trunc from 0x01c579 to 0x0230c4 (0x6b4c bytes) 000947 1788798350.835450 fallocate 0x00b75b thru 0x015ad1 (0xa377 bytes) 000948 1788798350.861221 MIRROR_RESYNC 7 mirrors 000949 1788798353.304630 trunc from 0x0327e3 to 0x000773 (0x3206f bytes) 000950 1788798353.383318 read 0x0005bb thru 0x000773 (0x1b9 bytes) 000951 1788798353.397082 fallocate 0x03c174 thru 0x03ffff (0x3e8c bytes) 000952 1788798353.409287 fallocate 0x03d724 thru 0x03ffff (0x28dc bytes) 000953 1788798353.424514 trunc from 0x025584 to 0x032b52 (0xd5cf bytes) 000954 1788798353.435119 write 0x02a758 thru 0x030ff4 (0x689d bytes) 000955 1788798353.465218 mapwrite 0x01916e thru 0x02876c (0xf5ff bytes) 000956 1788798353.574777 read 0x038648 thru 0x03ffff (0x79b8 bytes) 000957 1788798353.587180 trunc from 0x040000 to 0x033f01 (0xc0fe bytes) 000958 1788798353.619200 trunc from 0x033f02 to 0x0095cc (0x2a935 bytes) 000959 1788798353.639380 write 0x032614 thru 0x03a25d (0x7c4a bytes) 000960 1788798353.641910 mapread 0x0304db thru 0x03a156 (0x9c7c bytes) 000961 1788798353.655384 punch from 0x02a84d to 0x0347cb (0x9f7f bytes) 000963 1788798353.727220 mapwrite 0x00dead thru 0x00f918 (0x1a6c bytes) 000964 1788798353.774419 punch from 0x0094ac to 0x0127bd (0x9312 bytes) 000965 1788798353.793267 write 0x031683 thru 0x038b01 (0x747f bytes) 000966 1788798353.801280 mapwrite 0x030403 thru 0x03c94c (0xc54a bytes) 000967 1788798353.903905 trunc from 0x03c94d to 0x039d74 (0x2bd8 bytes) 000968 1788798353.924304 trunc from 0x02654d to 0x032a54 (0xc508 bytes) 000969 1788798353.937505 read 0x038880 thru 0x039d74 (0x14f5 bytes) 000970 1788798353.946615 fallocate 0x004d60 thru 0x00f7aa (0xaa4b bytes) 000971 1788798353.978170 read 0x0158e8 thru 0x019e7a (0x4593 bytes) 000973 1788798354.007489 trunc from 0x039d75 to 0x03a64d (0x8d9 bytes) 000974 1788798354.031247 mapread 0x013fb0 thru 0x019feb (0x603c bytes) 000975 1788798354.032164 trunc from 0x014e48 to 0x01d8b0 (0x8a69 bytes) 000976 1788798354.049101 fallocate 0x02d26a thru 0x03ac94 (0xda2b bytes) 000977 1788798354.061762 read 0x01a4ee thru 0x024fa8 (0xaabb bytes) 000979 1788798354.091839 mapwrite 0x009ee2 thru 0x00ed9b (0x4eba bytes) 000980 1788798354.140930 trunc from 0x01b8c0 to 0x01c6d1 (0xe12 bytes) 000981 1788798354.146894 mapread 0x0156f8 thru 0x01771f (0x2028 bytes) 000982 1788798354.148343 mapread 0x002af2 thru 0x007844 (0x4d53 bytes) 000983 1788798354.149463 write 0x03fe3d thru 0x03ffff (0x1c3 bytes) 000984 1788798354.151885 fallocate 0x005ee4 thru 0x0157f5 (0xf912 bytes) 000985 1788798354.159550 trunc from 0x00b993 to 0x017bf8 (0xc266 bytes) 000986 1788798354.169640 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000405:0x56:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x5699cf38 (stale) Mirror 16: 0x5699cf38 (stale) Mirror 20: 0x5699cf38 (stale) Mirror 29: 0x5699cf38 (stale) Mirror 30: 0x5699cf38 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x5699cf38 (stale) Mirror 16: 0x5699cf38 (stale) Mirror 20: 0x5699cf38 (stale) Mirror 29: 0x5699cf38 (stale) Mirror 30: 0x5699cf38 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000987 1788798354.842698 trunc from 0x01a7d5 to 0x028222 (0xda4e bytes) 000988 1788798354.849830 punch from 0x02e415 to 0x03647f (0x806b bytes) 000989 1788798354.855780 mapwrite 0x03b828 thru 0x03ea03 (0x31dc bytes) 000990 1788798354.888206 write 0x001471 thru 0x00d034 (0xbbc4 bytes) 000991 1788798354.904325 read 0x00c2f4 thru 0x013859 (0x7566 bytes) 000992 1788798354.917314 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x5699cf38 (stale) Mirror 16: 0x5699cf38 (stale) Mirror 20: 0x5699cf38 (stale) Mirror 29: 0x5699cf38 (stale) Mirror 30: 0x5699cf38 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd1e2f9be Mirror 31: 0xd1e2f9be lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000993 1788798356.080845 MIRROR_RESYNC 7 mirrors 000994 1788798358.773626 MIRROR_EXTEND to 8 mirrors 000995 1788798359.834519 trunc from 0x040000 to 0x02ea7e (0x11581 bytes) 000996 1788798359.904556 MIRROR_RESYNC 8 mirrors 000997 1788798361.691760 trunc from 0x02ea7f to 0x029e9f (0x4bdf bytes) 000998 1788798361.804621 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x29ea0): Mirror 11: (stale - read error) Mirror 16: (stale - read error) Mirror 20: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29ea0): Mirror 11: 0x6cd222b7 (stale) Mirror 16: 0x6cd222b7 (stale) Mirror 20: 0x6cd222b7 (stale) Mirror 29: 0x6cd222b7 (stale) Mirror 30: 0x6cd222b7 (stale) Mirror 31: 0x6cd222b7 (stale) Mirror 32: 0x6cd222b7 (stale) CRC-32 checksum value for chunk [0, 0x29ea0): Mirror 1: 0x6cd222b7 Mirror 33: 0x6cd222b7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29ea0: skipped 000999 1788798363.410884 write 0x021a6d thru 0x029336 (0x78ca bytes) 001000 1788798363.497038 read 0x00a253 thru 0x018052 (0xde00 bytes) All operations completed A-OK!