== sanity-flr test 70a: flr mode fsx test ================ 00:09:50 (1790741390) Seed set to 1392 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001 1790741392.969218 mapwrite 0x02f371 thru 0x02f3a3 (0x33 bytes) 000004 1790741393.113662 mapread 0x02b1e1 thru 0x02f3a3 (0x41c3 bytes) 000006 1790741393.158959 read 0x02c2aa thru 0x02f3a3 (0x30fa bytes) 000007 1790741393.159548 mapread 0x02750f thru 0x02b219 (0x3d0b bytes) truncating to largest ever: 0x32f81 000009 1790741393.168632 trunc from 0x02f3a4 to 0x032f80 (0x3bdd bytes) 000010 1790741393.206166 trunc from 0x032f81 to 0x005c0b (0x2d375 bytes) 000011 1790741393.255676 MIRROR_EXTEND to 2 mirrors 000013 1790741394.863997 read 0x00017c thru 0x005c0b (0x5a90 bytes) 000015 1790741394.887939 punch from 0x0031ba to 0x005c0b (0x2a52 bytes) 000017 1790741394.957966 mapwrite 0x0391f8 thru 0x03a38e (0x1197 bytes) 000019 1790741395.041656 mapread 0x036891 thru 0x03a38e (0x3afe bytes) 000020 1790741395.061398 write 0x011500 thru 0x01e75e (0xd25f bytes) 000021 1790741395.091191 write 0x0304ac thru 0x033eb2 (0x3a07 bytes) 000022 1790741395.092174 mapwrite 0x01f6bb thru 0x028101 (0x8a47 bytes) 000024 1790741395.242608 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3a38f): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a38f): Mirror 2: 0x34534419 (stale) CRC-32 checksum value for chunk [0, 0x3a38f): Mirror 1: 0x7b18213a Mirror 3: 0x7b18213a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a38f: skipped 000025 1790741397.263231 mapread 0x00212f thru 0x00b1ec (0x90be bytes) 000026 1790741397.308325 MIRROR_RESYNC 3 mirrors 000027 1790741399.020752 punch from 0x002248 to 0x005131 (0x2eea bytes) 000030 1790741399.102507 MIRROR_RESYNC 3 mirrors 000032 1790741400.342987 mapwrite 0x004ce4 thru 0x00f51e (0xa83b bytes) 000033 1790741400.513489 read 0x03029a thru 0x03a38e (0xa0f5 bytes) 000034 1790741400.521402 write 0x021c09 thru 0x0239b1 (0x1da9 bytes) 000035 1790741400.535172 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3a38f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a38f): Mirror 2: 0x7b18213a (stale) Mirror 3: 0x7b18213a (stale) CRC-32 checksum value for chunk [0, 0x3a38f): Mirror 1: 0x29c04642 Mirror 4: 0x29c04642 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a38f: skipped 000036 1790741402.174904 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3a38f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a38f): Mirror 2: 0x7b18213a (stale) Mirror 3: 0x7b18213a (stale) CRC-32 checksum value for chunk [0, 0x3a38f): Mirror 1: 0x29c04642 Mirror 4: 0x29c04642 Mirror 5: 0x29c04642 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a38f: skipped 000037 1790741403.681509 mapwrite 0x02bed0 thru 0x0322a0 (0x63d1 bytes) 000038 1790741403.881261 punch from 0x01e384 to 0x01f643 (0x12c0 bytes) 000040 1790741403.893832 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3a38f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a38f): Mirror 2: 0x7b18213a (stale) Mirror 3: 0x7b18213a (stale) Mirror 4: 0x29c04642 (stale) Mirror 5: 0x29c04642 (stale) CRC-32 checksum value for chunk [0, 0x3a38f): Mirror 1: 0xf1d6d5f4 Mirror 6: 0xf1d6d5f4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a38f: skipped 000041 1790741405.688659 punch from 0x0117fc to 0x021058 (0xf85d bytes) 000043 1790741405.804230 mapread 0x028391 thru 0x02e347 (0x5fb7 bytes) 000044 1790741405.839231 punch from 0x00c01f to 0x016d2d (0xad0f bytes) 000046 1790741405.851796 write 0x03cc7a thru 0x03ffff (0x3386 bytes) 000047 1790741405.854286 punch from 0x028b8b to 0x03203f (0x94b5 bytes) 000048 1790741405.875911 punch from 0x01a30c to 0x028606 (0xe2fb bytes) 000049 1790741405.902332 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xce7c8c88 (stale) Mirror 3: 0xce7c8c88 (stale) Mirror 4: 0x4d70b9b2 (stale) Mirror 5: 0x4d70b9b2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xce7c8c88 (stale) Mirror 3: 0xce7c8c88 (stale) Mirror 4: 0x4d70b9b2 (stale) Mirror 5: 0x4d70b9b2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000050 1790741406.610785 mapwrite 0x00602f thru 0x00b4d8 (0x54aa bytes) 000051 1790741406.771518 read 0x034eec thru 0x03c948 (0x7a5d bytes) 000052 1790741406.794852 punch from 0x02692e to 0x02d5f5 (0x6cc8 bytes) 000053 1790741406.803296 write 0x0171c8 thru 0x01a251 (0x308a bytes) 000054 1790741406.823250 mapread 0x00f8d9 thru 0x0139d7 (0x40ff bytes) 000056 1790741406.849114 read 0x028c62 thru 0x035154 (0xc4f3 bytes) 000058 1790741406.899402 MIRROR_SPLIT mirror 3 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xce7c8c88 (stale) Mirror 3: 0xce7c8c88 (stale) Mirror 5: 0x4d70b9b2 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xce7c8c88 (stale) Mirror 3: 0xce7c8c88 (stale) Mirror 5: 0x4d70b9b2 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000059 1790741407.362530 write 0x030a9c thru 0x0311ca (0x72f bytes) 000060 1790741407.373438 punch from 0x03f22f to 0x03ffff (0xdd1 bytes) 000062 1790741407.387334 trunc from 0x040000 to 0x02182b (0x1e7d4 bytes) 000064 1790741407.428131 read 0x001c02 thru 0x00cc8b (0xb08a bytes) 000065 1790741407.455513 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2182c): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2182c): Mirror 2: 0x3cb88784 (stale) Mirror 3: 0x3cb88784 (stale) Mirror 5: 0xb52ef72d (stale) CRC-32 checksum value for chunk [0, 0x2182c): Mirror 1: 0xbdcc8cae Mirror 6: 0xbdcc8cae lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2182c: skipped 000066 1790741408.848153 mapwrite 0x01da31 thru 0x0268c4 (0x8e94 bytes) 000067 1790741409.096207 mapwrite 0x00fef2 thru 0x010cf0 (0xdff bytes) 000068 1790741409.169180 mapwrite 0x00d52b thru 0x01374f (0x6225 bytes) 000069 1790741409.267535 trunc from 0x0268c5 to 0x01acae (0xbc16 bytes) 000070 1790741409.323646 mapread 0x011c18 thru 0x0130bf (0x14a8 bytes) 000071 1790741409.328746 punch from 0x015346 to 0x01acae (0x5969 bytes) 000072 1790741409.340902 read 0x016bb4 thru 0x019b3c (0x2f89 bytes) 000073 1790741409.352888 punch from 0x018a63 to 0x01acae (0x224c bytes) 000076 1790741409.360200 trunc from 0x01acaf to 0x01e9d4 (0x3d26 bytes) 000077 1790741409.387142 punch from 0x00f1e3 to 0x01ce6c (0xdc8a bytes) 000078 1790741409.393389 trunc from 0x01e9d5 to 0x018e48 (0x5b8c bytes) 000079 1790741409.408676 mapwrite 0x02135e thru 0x02d88d (0xc530 bytes) 000080 1790741409.489647 punch from 0x01d264 to 0x024e4b (0x7be8 bytes) 000081 1790741409.494521 mapwrite 0x02b39b thru 0x02d24a (0x1eb0 bytes) 000082 1790741409.537933 write 0x007407 thru 0x00a035 (0x2c2f bytes) 000083 1790741409.544105 trunc from 0x02d88e to 0x011ee6 (0x1b9a7 bytes) 000084 1790741409.575144 read 0x001b72 thru 0x00ac41 (0x90d0 bytes) 000087 1790741409.600634 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x11ee7): Mirror 2: 0x9911960e (stale) Mirror 3: 0x9911960e (stale) Mirror 5: 0x54ae1187 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11ee7): Mirror 2: 0x9911960e (stale) Mirror 3: 0x9911960e (stale) Mirror 5: 0x54ae1187 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11ee7: skipped 000088 1790741409.951724 mapwrite 0x03358a thru 0x033953 (0x3ca bytes) 000089 1790741410.051004 read 0x01eb5a thru 0x0228f4 (0x3d9b bytes) 000091 1790741410.073775 read 0x031195 thru 0x033953 (0x27bf bytes) 000092 1790741410.093179 write 0x02aedb thru 0x03aa12 (0xfb38 bytes) 000093 1790741410.097184 punch from 0x022211 to 0x02ec13 (0xca03 bytes) 000094 1790741410.115947 read 0x021c1a thru 0x02ad45 (0x912c bytes) 000095 1790741410.126223 mapwrite 0x0277b3 thru 0x027c03 (0x451 bytes) 000096 1790741410.182926 punch from 0x00d57a to 0x01345a (0x5ee1 bytes) 000098 1790741410.197094 mapread 0x0339e3 thru 0x038ea5 (0x54c3 bytes) 000099 1790741410.198946 mapwrite 0x01a163 thru 0x01da5b (0x38f9 bytes) 000100 1790741410.297106 read 0x02698c thru 0x027910 (0xf85 bytes) 000103 1790741410.311426 read 0x02ab24 thru 0x02ba40 (0xf1d bytes) 000105 1790741410.336905 MIRROR_RESYNC 4 mirrors 000107 1790741413.111362 write 0x029cfa thru 0x037472 (0xd779 bytes) 000109 1790741413.332863 mapread 0x039288 thru 0x03aa12 (0x178b bytes) 000111 1790741413.371602 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3aa13): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3aa13): Mirror 2: 0x9d905cc5 (stale) Mirror 3: 0x9d905cc5 (stale) Mirror 5: 0x9d905cc5 (stale) CRC-32 checksum value for chunk [0, 0x3aa13): Mirror 1: 0x61a189b4 Mirror 6: 0x61a189b4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3aa13: skipped 000112 1790741415.047767 mapread 0x01e0f7 thru 0x026eae (0x8db8 bytes) 000114 1790741415.068333 write 0x0030ad thru 0x00fe77 (0xcdcb bytes) 000115 1790741415.157243 punch from 0x0333f3 to 0x03aa12 (0x7620 bytes) truncating to largest ever: 0x3e3cd 000116 1790741415.170853 trunc from 0x03aa13 to 0x03e3cc (0x39ba bytes) 000117 1790741415.195257 punch from 0x02bf92 to 0x02d708 (0x1777 bytes) 000118 1790741415.200745 mapread 0x0343c5 thru 0x03e3cc (0xa008 bytes) 000119 1790741415.214670 punch from 0x0334e0 to 0x03b3b8 (0x7ed9 bytes) 000121 1790741415.220799 write 0x015ad0 thru 0x023bea (0xe11b bytes) 000122 1790741415.231469 trunc from 0x03e3cd to 0x00fc1d (0x2e7af bytes) 000123 1790741415.252860 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0xfc1e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xfc1e): Mirror 2: 0x58e925cd (stale) Mirror 3: 0x58e925cd (stale) Mirror 5: 0x58e925cd (stale) Mirror 6: 0x58e925cd (stale) CRC-32 checksum value for chunk [0, 0xfc1e): Mirror 1: 0x76ba4ada Mirror 7: 0x76ba4ada lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xfc1e: skipped 000124 1790741416.712385 read 0x00e7b1 thru 0x00fc1d (0x146d bytes) 000125 1790741416.735633 read 0x003069 thru 0x00fc1d (0xcbb5 bytes) 000126 1790741416.770090 mapwrite 0x01dd33 thru 0x029f1e (0xc1ec bytes) 000127 1790741416.936256 punch from 0x02550a to 0x0284ca (0x2fc1 bytes) 000128 1790741416.941586 mapread 0x006a09 thru 0x00e8d8 (0x7ed0 bytes) 000129 1790741416.977912 mapread 0x013977 thru 0x01e41e (0xaaa8 bytes) 000133 1790741416.985173 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x29f1f): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29f1f): Mirror 2: 0xf6793909 (stale) Mirror 3: 0xf6793909 (stale) Mirror 5: 0xf6793909 (stale) Mirror 6: 0x6a11b88c (stale) Mirror 7: 0xbc8ef86d (stale) CRC-32 checksum value for chunk [0, 0x29f1f): Mirror 1: 0x3885e428 Mirror 8: 0x3885e428 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29f1f: skipped 000134 1790741417.997168 mapwrite 0x00824f thru 0x0118f0 (0x96a2 bytes) 000136 1790741418.175599 punch from 0x0032e7 to 0x007af5 (0x480f bytes) 000138 1790741418.190373 mapread 0x018ef1 thru 0x024c10 (0xbd20 bytes) 000140 1790741418.207237 write 0x03b46e thru 0x03ffff (0x4b92 bytes) 000141 1790741418.208270 mapread 0x01e6a4 thru 0x02b26c (0xcbc9 bytes) 000142 1790741418.216394 trunc from 0x040000 to 0x03da83 (0x257c bytes) 000146 1790741418.255944 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3da84): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3da84): Mirror 2: 0x4f58099e (stale) Mirror 3: 0x4f58099e (stale) Mirror 5: 0x4f58099e (stale) Mirror 6: 0x4623a44a (stale) Mirror 7: 0x3e69be81 (stale) Mirror 8: 0x7d9a51fe (stale) CRC-32 checksum value for chunk [0, 0x3da84): Mirror 1: 0xc7d00f8a Mirror 9: 0xc7d00f8a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3da84: skipped 000147 1790741419.520869 trunc from 0x03da84 to 0x004d76 (0x38d0d bytes) 000148 1790741419.603856 MIRROR_RESYNC 8 mirrors 000149 1790741421.547341 mapread 0x0027bc thru 0x004d76 (0x25bb bytes) 000150 1790741421.601689 write 0x010da0 thru 0x01b849 (0xaaaa bytes) 000151 1790741421.686990 mapwrite 0x002fbb thru 0x008a1f (0x5a65 bytes) 000153 1790741421.782576 write 0x0122d8 thru 0x01a757 (0x8480 bytes) 000154 1790741421.784865 write 0x0146e1 thru 0x021bb0 (0xd4d0 bytes) 000156 1790741421.787690 trunc from 0x021bb1 to 0x02fbd9 (0xe029 bytes) 000157 1790741421.840607 mapread 0x005859 thru 0x014ee4 (0xf68c bytes) 000158 1790741421.847502 mapwrite 0x03cd2c thru 0x03ffff (0x32d4 bytes) 000159 1790741421.985824 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x97f70459 (stale) Mirror 3: 0x97f70459 (stale) Mirror 5: 0x97f70459 (stale) Mirror 6: 0x97f70459 (stale) Mirror 7: 0x97f70459 (stale) Mirror 8: 0x97f70459 (stale) Mirror 9: 0x97f70459 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbec26f0c Mirror 10: 0xbec26f0c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000160 1790741423.209547 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x97f70459 (stale) Mirror 5: 0x97f70459 (stale) Mirror 6: 0x97f70459 (stale) Mirror 7: 0x97f70459 (stale) Mirror 8: 0x97f70459 (stale) Mirror 9: 0x97f70459 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x97f70459 (stale) Mirror 5: 0x97f70459 (stale) Mirror 6: 0x97f70459 (stale) Mirror 7: 0x97f70459 (stale) Mirror 8: 0x97f70459 (stale) Mirror 9: 0x97f70459 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xbec26f0c Mirror 10: 0xbec26f0c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000162 1790741423.888390 write 0x033dd9 thru 0x03ffff (0xc227 bytes) 000165 1790741423.992151 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x97f70459 (stale) Mirror 5: 0x97f70459 (stale) Mirror 6: 0x97f70459 (stale) Mirror 7: 0x97f70459 (stale) Mirror 8: 0x97f70459 (stale) Mirror 9: 0x97f70459 (stale) Mirror 10: 0xbec26f0c (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb0167655 Mirror 11: 0xb0167655 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000166 1790741425.116586 mapread 0x01771f thru 0x01e9e4 (0x72c6 bytes) 000168 1790741425.180776 punch from 0x02b710 to 0x034c39 (0x952a bytes) 000170 1790741425.273118 write 0x015f73 thru 0x0198c3 (0x3951 bytes) 000172 1790741425.282361 punch from 0x003e39 to 0x008ed4 (0x509c bytes) 000173 1790741425.293154 write 0x013fbc thru 0x01a3ce (0x6413 bytes) 000174 1790741425.305877 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x97f70459 (stale) Mirror 5: 0x97f70459 (stale) Mirror 6: 0x97f70459 (stale) Mirror 7: 0x97f70459 (stale) Mirror 8: 0x97f70459 (stale) Mirror 9: 0x97f70459 (stale) Mirror 10: 0xbec26f0c (stale) Mirror 11: 0xb0167655 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7e0ceca2 Mirror 12: 0x7e0ceca2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000175 1790741426.924633 punch from 0x02b8d5 to 0x038d92 (0xd4be bytes) 000176 1790741427.035114 read 0x03ed03 thru 0x03ffff (0x12fd bytes) 000178 1790741427.061520 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x97f70459 (stale) Mirror 5: 0x97f70459 (stale) Mirror 6: 0x97f70459 (stale) Mirror 7: 0x97f70459 (stale) Mirror 8: 0x97f70459 (stale) Mirror 9: 0x97f70459 (stale) Mirror 10: 0xbec26f0c (stale) Mirror 11: 0xb0167655 (stale) Mirror 12: 0x7e0ceca2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6da0743a Mirror 13: 0x6da0743a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000180 1790741429.507536 punch from 0x03fa5d to 0x03ffff (0x5a3 bytes) 000181 1790741429.682437 mapwrite 0x039982 thru 0x03ffff (0x667e bytes) 000184 1790741429.863913 punch from 0x03a16e to 0x03ffff (0x5e92 bytes) 000186 1790741429.890689 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x97f70459 (stale) Mirror 5: 0x97f70459 (stale) Mirror 6: 0x97f70459 (stale) Mirror 7: 0x97f70459 (stale) Mirror 8: 0x97f70459 (stale) Mirror 9: 0x97f70459 (stale) Mirror 10: 0xbec26f0c (stale) Mirror 11: 0xb0167655 (stale) Mirror 12: 0x7e0ceca2 (stale) Mirror 13: 0x6da0743a (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x7fbabbce Mirror 14: 0x7fbabbce lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000190 1790741432.058263 punch from 0x01f933 to 0x026380 (0x6a4e bytes) 000192 1790741432.236374 write 0x030c7c thru 0x032a6d (0x1df2 bytes) 000193 1790741432.253761 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x97f70459 (stale) Mirror 5: 0x97f70459 (stale) Mirror 6: 0x97f70459 (stale) Mirror 7: 0x97f70459 (stale) Mirror 8: 0x97f70459 (stale) Mirror 9: 0x97f70459 (stale) Mirror 10: 0xbec26f0c (stale) Mirror 11: 0xb0167655 (stale) Mirror 12: 0x7e0ceca2 (stale) Mirror 13: 0x6da0743a (stale) Mirror 14: 0x7fbabbce (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc872944c Mirror 15: 0xc872944c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000194 1790741434.379728 trunc from 0x040000 to 0x028485 (0x17b7a bytes) 000195 1790741434.574759 write 0x027c02 thru 0x02db55 (0x5f54 bytes) 000197 1790741434.586778 punch from 0x010307 to 0x0125e6 (0x22e0 bytes) 000198 1790741434.605486 read 0x02ba7b thru 0x02d817 (0x1d9d bytes) 000199 1790741434.611927 MIRROR_SPLIT mirror 7 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2db56): Mirror 3: 0xf5c19856 (stale) Mirror 5: 0xf5c19856 (stale) Mirror 6: 0xf5c19856 (stale) Mirror 7: 0xf5c19856 (stale) Mirror 8: 0xf5c19856 (stale) Mirror 9: 0xf5c19856 (stale) Mirror 11: 0x347640e (stale) Mirror 12: 0x21063897 (stale) Mirror 13: 0x21063897 (stale) Mirror 14: 0x21063897 (stale) Mirror 15: 0x583ccaf (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2db56): Mirror 3: 0xf5c19856 (stale) Mirror 5: 0xf5c19856 (stale) Mirror 6: 0xf5c19856 (stale) Mirror 7: 0xf5c19856 (stale) Mirror 8: 0xf5c19856 (stale) Mirror 9: 0xf5c19856 (stale) Mirror 11: 0x347640e (stale) Mirror 12: 0x21063897 (stale) Mirror 13: 0x21063897 (stale) Mirror 14: 0x21063897 (stale) Mirror 15: 0x583ccaf (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2db56: skipped 000200 1790741435.230174 mapread 0x02093a thru 0x02248b (0x1b52 bytes) 000201 1790741435.250408 MIRROR_RESYNC 12 mirrors 000202 1790741441.720592 MIRROR_EXTEND to 13 mirrors 000203 1790741442.711628 punch from 0x01310b to 0x020ae2 (0xd9d8 bytes) 000204 1790741442.805263 read 0x005efd thru 0x00da2a (0x7b2e bytes) 000205 1790741442.813904 mapwrite 0x0369dd thru 0x038bdf (0x2203 bytes) 000206 1790741442.891096 trunc from 0x038be0 to 0x038c69 (0x8a bytes) 000207 1790741442.904820 write 0x008e2c thru 0x0097bd (0x992 bytes) 000208 1790741442.906326 mapread 0x01d254 thru 0x021cbd (0x4a6a bytes) 000209 1790741442.919623 MIRROR_RESYNC 13 mirrors 000211 1790741451.524440 mapwrite 0x008c00 thru 0x00b5ef (0x29f0 bytes) 000212 1790741451.906149 mapwrite 0x014715 thru 0x0163b6 (0x1ca2 bytes) 000214 1790741452.028876 trunc from 0x038c6a to 0x005871 (0x333f8 bytes) 000215 1790741452.066787 trunc from 0x005872 to 0x0263c1 (0x20b50 bytes) 000219 1790741452.099380 read 0x01c4ec thru 0x024349 (0x7e5e bytes) 000220 1790741452.112408 mapread 0x023938 thru 0x0263c1 (0x2a8a bytes) 000221 1790741452.121507 mapwrite 0x0090fc thru 0x00c592 (0x3497 bytes) 000222 1790741452.219971 read 0x01917c thru 0x022591 (0x9416 bytes) 000224 1790741452.237872 mapwrite 0x02f403 thru 0x03c9a6 (0xd5a4 bytes) 000226 1790741452.388096 trunc from 0x03c9a7 to 0x019064 (0x23942 bytes) 000227 1790741452.402200 punch from 0x016a0c to 0x019064 (0x2659 bytes) 000228 1790741452.407185 punch from 0x00ac3f to 0x00d35d (0x271f bytes) 000229 1790741452.412551 write 0x010081 thru 0x01fb00 (0xfa80 bytes) 000230 1790741452.414582 trunc from 0x01fb01 to 0x027c11 (0x8111 bytes) 000231 1790741452.437772 MIRROR_RESYNC 13 mirrors 000232 1790741456.852641 trunc from 0x027c12 to 0x00eae2 (0x1912f bytes) 000234 1790741457.023613 mapwrite 0x0275f3 thru 0x031bde (0xa5ec bytes) 000235 1790741457.188691 mapwrite 0x03177f thru 0x03ffff (0xe881 bytes) 000236 1790741457.290499 mapread 0x00d480 thru 0x00f9da (0x255b bytes) 000237 1790741457.301706 punch from 0x0242ba to 0x02bee9 (0x7c30 bytes) 000238 1790741457.307675 write 0x0264b5 thru 0x02faac (0x95f8 bytes) 000239 1790741457.313493 read 0x0373ff thru 0x03fb38 (0x873a bytes) 000240 1790741457.314991 read 0x009172 thru 0x0091e5 (0x74 bytes) 000242 1790741457.316300 read 0x011ba2 thru 0x01dba1 (0xc000 bytes) 000244 1790741457.326036 write 0x003e3f thru 0x00ca87 (0x8c49 bytes) 000245 1790741457.327490 trunc from 0x040000 to 0x025374 (0x1ac8b bytes) 000246 1790741457.349963 write 0x02c8c7 thru 0x039b07 (0xd241 bytes) 000247 1790741457.352698 mapread 0x01d128 thru 0x0235ce (0x64a7 bytes) 000248 1790741457.354612 read 0x02383c thru 0x02fc8b (0xc450 bytes) 000249 1790741457.363455 punch from 0x02cb29 to 0x0324f0 (0x59c8 bytes) 000250 1790741457.398686 mapwrite 0x00eeea thru 0x00f997 (0xaae bytes) 000251 1790741457.468298 read 0x01618c thru 0x01ede4 (0x8c59 bytes) 000253 1790741457.469674 read 0x033ab9 thru 0x039b07 (0x604f bytes) 000254 1790741457.471091 mapwrite 0x007996 thru 0x013d66 (0xc3d1 bytes) 000256 1790741457.524144 mapread 0x0386f4 thru 0x039b07 (0x1414 bytes) 000257 1790741457.531135 punch from 0x00eef9 to 0x0114a1 (0x25a9 bytes) 000258 1790741457.541466 punch from 0x02f471 to 0x039b07 (0xa697 bytes) 000260 1790741457.555614 punch from 0x02fa40 to 0x039b07 (0xa0c8 bytes) 000261 1790741457.571204 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x39b08): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39b08): Mirror 3: 0x2330edfd (stale) Mirror 5: 0x2330edfd (stale) Mirror 6: 0x2330edfd (stale) Mirror 7: 0x2330edfd (stale) Mirror 8: 0x2330edfd (stale) Mirror 9: 0x2330edfd (stale) Mirror 11: 0x2330edfd (stale) Mirror 12: 0x2330edfd (stale) Mirror 13: 0x2330edfd (stale) Mirror 14: 0x2330edfd (stale) Mirror 15: 0x2330edfd (stale) Mirror 16: 0x2330edfd (stale) CRC-32 checksum value for chunk [0, 0x39b08): Mirror 1: 0xb4c0fa19 Mirror 17: 0xb4c0fa19 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39b08: skipped 000262 1790741459.159107 read 0x0326d0 thru 0x0391b9 (0x6aea bytes) 000263 1790741459.176127 trunc from 0x039b08 to 0x031814 (0x82f3 bytes) 000264 1790741459.271315 read 0x00be52 thru 0x00d15b (0x130a bytes) 000265 1790741459.283975 MIRROR_SPLIT mirror 8 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31815): Mirror 3: 0x12d60664 (stale) Mirror 5: 0x12d60664 (stale) Mirror 6: 0x12d60664 (stale) Mirror 7: 0x12d60664 (stale) Mirror 8: 0x12d60664 (stale) Mirror 9: 0x12d60664 (stale) Mirror 11: 0x12d60664 (stale) Mirror 13: 0x12d60664 (stale) Mirror 14: 0x12d60664 (stale) Mirror 15: 0x12d60664 (stale) Mirror 16: 0x12d60664 (stale) Mirror 17: 0xcd5e5aff (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31815): Mirror 3: 0x12d60664 (stale) Mirror 5: 0x12d60664 (stale) Mirror 6: 0x12d60664 (stale) Mirror 7: 0x12d60664 (stale) Mirror 8: 0x12d60664 (stale) Mirror 9: 0x12d60664 (stale) Mirror 11: 0x12d60664 (stale) Mirror 13: 0x12d60664 (stale) Mirror 14: 0x12d60664 (stale) Mirror 15: 0x12d60664 (stale) Mirror 16: 0x12d60664 (stale) Mirror 17: 0xcd5e5aff (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31815: skipped 000268 1790741459.984656 trunc from 0x031815 to 0x037dec (0x65d8 bytes) 000269 1790741460.018231 MIRROR_RESYNC 13 mirrors 000272 1790741465.863772 mapwrite 0x03b8e3 thru 0x03ffff (0x471d bytes) 000273 1790741466.004447 write 0x0078a9 thru 0x00a7c9 (0x2f21 bytes) 000274 1790741466.016980 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x91947ade (stale) Mirror 5: 0x91947ade (stale) Mirror 6: 0x91947ade (stale) Mirror 7: 0x91947ade (stale) Mirror 8: 0x91947ade (stale) Mirror 9: 0x91947ade (stale) Mirror 11: 0x91947ade (stale) Mirror 13: 0x91947ade (stale) Mirror 14: 0x91947ade (stale) Mirror 15: 0x91947ade (stale) Mirror 16: 0x91947ade (stale) Mirror 17: 0x91947ade (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xd68b1b5e Mirror 18: 0xd68b1b5e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000275 1790741467.857400 mapread 0x01b3cc thru 0x024153 (0x8d88 bytes) 000276 1790741467.897457 mapread 0x00baa5 thru 0x019b87 (0xe0e3 bytes) 000279 1790741467.957611 mapwrite 0x0192ce thru 0x027417 (0xe14a bytes) 000280 1790741468.232245 trunc from 0x040000 to 0x024615 (0x1b9ea bytes) 000282 1790741468.252421 write 0x03a538 thru 0x03f7da (0x52a3 bytes) 000284 1790741468.258101 mapwrite 0x0361c7 thru 0x038cdc (0x2b16 bytes) 000285 1790741468.318053 mapwrite 0x03f16e thru 0x03ffff (0xe92 bytes) 000286 1790741468.409350 trunc from 0x040000 to 0x02bc36 (0x143c9 bytes) 000287 1790741468.425780 trunc from 0x02bc37 to 0x00d523 (0x1e713 bytes) 000289 1790741468.444916 write 0x00f504 thru 0x014908 (0x5405 bytes) 000290 1790741468.468385 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x14909): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14909): Mirror 3: 0xd378625d (stale) Mirror 5: 0xd378625d (stale) Mirror 6: 0xd378625d (stale) Mirror 7: 0xd378625d (stale) Mirror 8: 0xd378625d (stale) Mirror 9: 0xd378625d (stale) Mirror 11: 0xd378625d (stale) Mirror 13: 0xd378625d (stale) Mirror 14: 0xd378625d (stale) Mirror 15: 0xd378625d (stale) Mirror 16: 0xd378625d (stale) Mirror 17: 0xd378625d (stale) Mirror 18: 0x9a73dd58 (stale) CRC-32 checksum value for chunk [0, 0x14909): Mirror 1: 0xbb8b956d Mirror 19: 0xbb8b956d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14909: skipped 000294 1790741470.418090 mapwrite 0x01ff8b thru 0x025565 (0x55db bytes) 000295 1790741470.584657 punch from 0x0083a9 to 0x00a775 (0x23cd bytes) 000296 1790741470.590272 mapread 0x01236a thru 0x01e60d (0xc2a4 bytes) 000298 1790741470.600200 punch from 0x013565 to 0x013f36 (0x9d2 bytes) 000299 1790741470.604709 punch from 0x004fb1 to 0x007dd2 (0x2e22 bytes) 000300 1790741470.610814 mapwrite 0x0185ed thru 0x01fad9 (0x74ed bytes) 000301 1790741470.669457 mapwrite 0x0002bc thru 0x00388c (0x35d1 bytes) 000302 1790741470.754134 MIRROR_RESYNC 15 mirrors 000304 1790741479.480074 read 0x004974 thru 0x00d791 (0x8e1e bytes) 000305 1790741479.491488 punch from 0x0186a9 to 0x01d972 (0x52ca bytes) 000306 1790741479.591849 mapread 0x013074 thru 0x0202c6 (0xd253 bytes) truncating to largest ever: 0x3f110 000307 1790741479.630889 trunc from 0x025566 to 0x03f10f (0x19baa bytes) 000309 1790741479.656188 read 0x013f64 thru 0x016082 (0x211f bytes) 000311 1790741479.657282 read 0x01f33f thru 0x024909 (0x55cb bytes) 000312 1790741479.659768 mapread 0x02303c thru 0x02fd04 (0xccc9 bytes) 000313 1790741479.682888 MIRROR_SPLIT mirror 1 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f110): Mirror 5: 0x7ec2cc01 (stale) Mirror 6: 0x7ec2cc01 (stale) Mirror 7: 0x7ec2cc01 (stale) Mirror 8: 0x7ec2cc01 (stale) Mirror 9: 0x7ec2cc01 (stale) Mirror 11: 0x7ec2cc01 (stale) Mirror 13: 0x7ec2cc01 (stale) Mirror 14: 0x7ec2cc01 (stale) Mirror 15: 0x7ec2cc01 (stale) Mirror 16: 0x7ec2cc01 (stale) Mirror 17: 0x7ec2cc01 (stale) Mirror 18: 0x7ec2cc01 (stale) Mirror 19: 0x7ec2cc01 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f110): Mirror 5: 0x7ec2cc01 (stale) Mirror 6: 0x7ec2cc01 (stale) Mirror 7: 0x7ec2cc01 (stale) Mirror 8: 0x7ec2cc01 (stale) Mirror 9: 0x7ec2cc01 (stale) Mirror 11: 0x7ec2cc01 (stale) Mirror 13: 0x7ec2cc01 (stale) Mirror 14: 0x7ec2cc01 (stale) Mirror 15: 0x7ec2cc01 (stale) Mirror 16: 0x7ec2cc01 (stale) Mirror 17: 0x7ec2cc01 (stale) Mirror 18: 0x7ec2cc01 (stale) Mirror 19: 0x7ec2cc01 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f110: skipped 000314 1790741480.546094 mapwrite 0x0168b9 thru 0x018ada (0x2222 bytes) 000315 1790741480.636700 write 0x02b59e thru 0x0368ce (0xb331 bytes) 000316 1790741480.662503 punch from 0x01b5c3 to 0x01f08e (0x3acc bytes) 000319 1790741480.682511 MIRROR_RESYNC 14 mirrors 000320 1790741491.922455 trunc from 0x03f110 to 0x017f19 (0x271f6 bytes) 000322 1790741492.011489 read 0x0175e5 thru 0x017f19 (0x935 bytes) 000323 1790741492.017365 punch from 0x00d738 to 0x017f19 (0xa7e2 bytes) 000324 1790741492.025222 read 0x010022 thru 0x0127d8 (0x27b7 bytes) 000325 1790741492.034978 write 0x03c9ee thru 0x03f2e9 (0x28fc bytes) 000328 1790741492.038160 mapread 0x018df1 thru 0x026e94 (0xe0a4 bytes) 000329 1790741492.047363 read 0x001987 thru 0x005805 (0x3e7f bytes) 000331 1790741492.048808 mapread 0x027a25 thru 0x02c7b6 (0x4d92 bytes) 000332 1790741492.050606 read 0x0281f5 thru 0x02a131 (0x1f3d bytes) 000333 1790741492.051290 mapwrite 0x009b97 thru 0x00c403 (0x286d bytes) 000334 1790741492.105807 mapread 0x01360d thru 0x0233d3 (0xfdc7 bytes) 000335 1790741492.107969 mapwrite 0x0203c0 thru 0x027559 (0x719a bytes) 000337 1790741492.160800 write 0x00b819 thru 0x00f68c (0x3e74 bytes) 000338 1790741492.161869 read 0x035016 thru 0x0378e5 (0x28d0 bytes) 000339 1790741492.163371 punch from 0x02f1ce to 0x0306f0 (0x1523 bytes) 000340 1790741492.178045 mapread 0x00e845 thru 0x0182ed (0x9aa9 bytes) 000341 1790741492.179253 write 0x01937d thru 0x019968 (0x5ec bytes) 000342 1790741492.180767 trunc from 0x03f2ea to 0x01fb8d (0x1f75c bytes) 000344 1790741492.208766 mapread 0x00e6e3 thru 0x01db25 (0xf443 bytes) 000346 1790741492.211733 mapwrite 0x0014d4 thru 0x008172 (0x6c9f bytes) 000347 1790741492.269928 punch from 0x0033e6 to 0x0048d3 (0x14ee bytes) 000348 1790741492.281216 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x1fb8e): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fb8e): Mirror 5: 0x1e48a1d9 (stale) Mirror 6: 0x1e48a1d9 (stale) Mirror 7: 0x1e48a1d9 (stale) Mirror 8: 0x1e48a1d9 (stale) Mirror 9: 0x1e48a1d9 (stale) Mirror 11: 0x1e48a1d9 (stale) Mirror 13: 0x1e48a1d9 (stale) Mirror 14: 0x1e48a1d9 (stale) Mirror 15: 0x1e48a1d9 (stale) Mirror 16: 0x1e48a1d9 (stale) Mirror 17: 0x1e48a1d9 (stale) Mirror 18: 0x1e48a1d9 (stale) Mirror 19: 0x1e48a1d9 (stale) CRC-32 checksum value for chunk [0, 0x1fb8e): Mirror 1: 0x2c325e37 Mirror 20: 0x2c325e37 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fb8e: skipped 000350 1790741494.075811 punch from 0x01f802 to 0x01fb8d (0x38c bytes) 000351 1790741494.195429 read 0x00e41e thru 0x01c967 (0xe54a bytes) 000353 1790741494.204921 mapwrite 0x029be8 thru 0x02adfb (0x1214 bytes) 000354 1790741494.286744 mapwrite 0x007ee1 thru 0x015a40 (0xdb60 bytes) 000355 1790741494.337872 read 0x00cca3 thru 0x017c89 (0xafe7 bytes) 000356 1790741494.342977 MIRROR_SPLIT mirror 7 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2adfc): Mirror 5: 0x6d708270 (stale) Mirror 6: 0x6d708270 (stale) Mirror 7: 0x6d708270 (stale) Mirror 8: 0x6d708270 (stale) Mirror 9: 0x6d708270 (stale) Mirror 11: 0x6d708270 (stale) Mirror 14: 0x6d708270 (stale) Mirror 15: 0x6d708270 (stale) Mirror 16: 0x6d708270 (stale) Mirror 17: 0x6d708270 (stale) Mirror 18: 0x6d708270 (stale) Mirror 19: 0x6d708270 (stale) Mirror 20: 0x6916a8b6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2adfc): Mirror 5: 0x6d708270 (stale) Mirror 6: 0x6d708270 (stale) Mirror 7: 0x6d708270 (stale) Mirror 8: 0x6d708270 (stale) Mirror 9: 0x6d708270 (stale) Mirror 11: 0x6d708270 (stale) Mirror 14: 0x6d708270 (stale) Mirror 15: 0x6d708270 (stale) Mirror 16: 0x6d708270 (stale) Mirror 17: 0x6d708270 (stale) Mirror 18: 0x6d708270 (stale) Mirror 19: 0x6d708270 (stale) Mirror 20: 0x6916a8b6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2adfc: skipped 000357 1790741495.068555 write 0x005e94 thru 0x00693f (0xaac bytes) 000358 1790741495.078803 write 0x034c4e thru 0x03ffff (0xb3b2 bytes) 000359 1790741495.082446 trunc from 0x040000 to 0x01ec80 (0x2137f bytes) 000360 1790741495.106195 mapwrite 0x00562c thru 0x0106db (0xb0b0 bytes) 000361 1790741495.172185 trunc from 0x01ec81 to 0x028b21 (0x9ea1 bytes) 000362 1790741495.192120 mapread 0x01cb4a thru 0x0231d5 (0x668c bytes) 000363 1790741495.200570 write 0x019baf thru 0x0235a2 (0x99f4 bytes) 000364 1790741495.201851 mapread 0x021a36 thru 0x022c7e (0x1249 bytes) 000366 1790741495.204516 write 0x02a45f thru 0x031397 (0x6f39 bytes) 000367 1790741495.205846 write 0x020096 thru 0x02aad2 (0xaa3d bytes) 000368 1790741495.211400 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x31398): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31398): Mirror 5: 0xceb72336 (stale) Mirror 6: 0xceb72336 (stale) Mirror 7: 0xceb72336 (stale) Mirror 8: 0xceb72336 (stale) Mirror 9: 0xceb72336 (stale) Mirror 11: 0xceb72336 (stale) Mirror 14: 0xceb72336 (stale) Mirror 15: 0xceb72336 (stale) Mirror 16: 0xceb72336 (stale) Mirror 17: 0xceb72336 (stale) Mirror 18: 0xceb72336 (stale) Mirror 19: 0xceb72336 (stale) Mirror 20: 0xd493dba6 (stale) CRC-32 checksum value for chunk [0, 0x31398): Mirror 1: 0xce0c3d9c Mirror 21: 0xce0c3d9c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31398: skipped 000369 1790741496.664313 trunc from 0x031398 to 0x038b46 (0x77af bytes) 000370 1790741496.820416 write 0x00aa06 thru 0x015540 (0xab3b bytes) 000371 1790741496.843520 mapread 0x03724d thru 0x038b46 (0x18fa bytes) 000373 1790741496.875866 MIRROR_SPLIT mirror 3 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38b47): Mirror 5: 0x60023411 (stale) Mirror 6: 0x60023411 (stale) Mirror 8: 0x60023411 (stale) Mirror 9: 0x60023411 (stale) Mirror 11: 0x60023411 (stale) Mirror 14: 0x60023411 (stale) Mirror 15: 0x60023411 (stale) Mirror 16: 0x60023411 (stale) Mirror 17: 0x60023411 (stale) Mirror 18: 0x60023411 (stale) Mirror 19: 0x60023411 (stale) Mirror 20: 0xc91c5e43 (stale) Mirror 21: 0x504feb93 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38b47): Mirror 5: 0x60023411 (stale) Mirror 6: 0x60023411 (stale) Mirror 8: 0x60023411 (stale) Mirror 9: 0x60023411 (stale) Mirror 11: 0x60023411 (stale) Mirror 14: 0x60023411 (stale) Mirror 15: 0x60023411 (stale) Mirror 16: 0x60023411 (stale) Mirror 17: 0x60023411 (stale) Mirror 18: 0x60023411 (stale) Mirror 19: 0x60023411 (stale) Mirror 20: 0xc91c5e43 (stale) Mirror 21: 0x504feb93 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38b47: skipped 000374 1790741498.194533 write 0x0150a6 thru 0x018f4c (0x3ea7 bytes) 000375 1790741498.205504 read 0x02da33 thru 0x038b46 (0xb114 bytes) 000376 1790741498.213155 punch from 0x011d50 to 0x02178c (0xfa3d bytes) 000377 1790741498.226559 mapwrite 0x008f91 thru 0x00f1cc (0x623c bytes) 000378 1790741498.299890 read 0x004d38 thru 0x0096f5 (0x49be bytes) 000379 1790741498.300821 mapread 0x024ddc thru 0x02db08 (0x8d2d bytes) 000380 1790741498.318105 mapread 0x012d3f thru 0x021dc8 (0xf08a bytes) 000381 1790741498.320840 write 0x0054c3 thru 0x00fb6e (0xa6ac bytes) 000382 1790741498.324478 mapread 0x01121b thru 0x01c7dc (0xb5c2 bytes) 000383 1790741498.325583 mapwrite 0x02131d thru 0x0308fe (0xf5e2 bytes) 000384 1790741498.390939 write 0x01bbdf thru 0x01e31a (0x273c bytes) 000385 1790741498.392461 trunc from 0x038b47 to 0x03829e (0x8a8 bytes) 000386 1790741498.410080 mapread 0x013d1c thru 0x017dcf (0x40b4 bytes) 000387 1790741498.411347 punch from 0x00f526 to 0x014fc9 (0x5aa4 bytes) 000388 1790741498.423226 punch from 0x027fc2 to 0x033b1a (0xbb59 bytes) 000392 1790741498.429051 punch from 0x01b504 to 0x01f470 (0x3f6d bytes) 000396 1790741498.434968 mapwrite 0x00c17a thru 0x00e253 (0x20da bytes) 000397 1790741498.482926 punch from 0x02ecb3 to 0x031dfa (0x3148 bytes) 000398 1790741498.489601 write 0x00e9ed thru 0x00fdfc (0x1410 bytes) 000399 1790741498.500003 mapread 0x022db1 thru 0x031cbf (0xef0f bytes) 000402 1790741498.551810 mapread 0x027030 thru 0x02ac62 (0x3c33 bytes) 000405 1790741498.557972 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x3829f): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3829f): Mirror 5: 0xc8c216a6 (stale) Mirror 6: 0xc8c216a6 (stale) Mirror 8: 0xc8c216a6 (stale) Mirror 9: 0xc8c216a6 (stale) Mirror 11: 0xc8c216a6 (stale) Mirror 14: 0xc8c216a6 (stale) Mirror 15: 0xc8c216a6 (stale) Mirror 16: 0xc8c216a6 (stale) Mirror 17: 0xc8c216a6 (stale) Mirror 18: 0xc8c216a6 (stale) Mirror 19: 0xc8c216a6 (stale) Mirror 20: 0x2520dfa3 (stale) Mirror 21: 0x69efac2 (stale) CRC-32 checksum value for chunk [0, 0x3829f): Mirror 1: 0x65f50e1c Mirror 22: 0x65f50e1c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3829f: skipped 000407 1790741500.156978 mapread 0x02f38a thru 0x033ed8 (0x4b4f bytes) 000408 1790741500.211446 write 0x006105 thru 0x00ba63 (0x595f bytes) 000409 1790741500.400526 mapread 0x0047e6 thru 0x010c87 (0xc4a2 bytes) 000410 1790741500.418378 mapread 0x01c1b9 thru 0x027827 (0xb66f bytes) 000411 1790741500.456441 mapwrite 0x002d54 thru 0x009ff2 (0x729f bytes) 000414 1790741500.564144 mapwrite 0x017574 thru 0x021eb0 (0xa93d bytes) 000415 1790741500.636398 punch from 0x026c14 to 0x0305c7 (0x99b4 bytes) 000416 1790741500.641328 mapread 0x034c27 thru 0x03829e (0x3678 bytes) 000419 1790741500.656578 mapread 0x000559 thru 0x00d376 (0xce1e bytes) 000420 1790741500.671190 trunc from 0x03829f to 0x0339b2 (0x48ec bytes) 000421 1790741500.702493 trunc from 0x0339b3 to 0x02ace8 (0x8cca bytes) 000422 1790741500.726201 mapwrite 0x01e192 thru 0x02c84d (0xe6bc bytes) 000424 1790741500.813369 read 0x0039eb thru 0x004858 (0xe6e bytes) 000425 1790741500.814812 punch from 0x004f73 to 0x012da2 (0xde30 bytes) 000426 1790741500.828757 MIRROR_SPLIT mirror 9 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c84e): Mirror 5: 0xf29c3b0a (stale) Mirror 6: 0xf29c3b0a (stale) Mirror 8: 0xf29c3b0a (stale) Mirror 9: 0xf29c3b0a (stale) Mirror 11: 0xf29c3b0a (stale) Mirror 14: 0xf29c3b0a (stale) Mirror 15: 0xf29c3b0a (stale) Mirror 16: 0xf29c3b0a (stale) Mirror 18: 0xf29c3b0a (stale) Mirror 19: 0xf29c3b0a (stale) Mirror 20: 0x92f1f263 (stale) Mirror 21: 0xe063d88a (stale) Mirror 22: 0x2471642d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c84e): Mirror 5: 0xf29c3b0a (stale) Mirror 6: 0xf29c3b0a (stale) Mirror 8: 0xf29c3b0a (stale) Mirror 9: 0xf29c3b0a (stale) Mirror 11: 0xf29c3b0a (stale) Mirror 14: 0xf29c3b0a (stale) Mirror 15: 0xf29c3b0a (stale) Mirror 16: 0xf29c3b0a (stale) Mirror 18: 0xf29c3b0a (stale) Mirror 19: 0xf29c3b0a (stale) Mirror 20: 0x92f1f263 (stale) Mirror 21: 0xe063d88a (stale) Mirror 22: 0x2471642d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c84e: skipped 000427 1790741501.795827 trunc from 0x02c84e to 0x018ede (0x1396f bytes) 000429 1790741501.826402 mapread 0x00239e thru 0x00bf4e (0x9bb1 bytes) 000430 1790741501.866144 mapwrite 0x01f271 thru 0x02e44c (0xf1dc bytes) 000431 1790741501.975219 mapwrite 0x01472e thru 0x018426 (0x3cf9 bytes) 000432 1790741502.046367 write 0x008b4c thru 0x00dc72 (0x5127 bytes) 000434 1790741502.048606 read 0x016929 thru 0x02068e (0x9d66 bytes) 000435 1790741502.050547 mapread 0x00ffc7 thru 0x019489 (0x94c3 bytes) 000436 1790741502.058927 write 0x00c00b thru 0x019e25 (0xde1b bytes) 000437 1790741502.068835 punch from 0x002a48 to 0x00a2bc (0x7875 bytes) 000439 1790741502.102717 punch from 0x02ccdf to 0x02e44c (0x176e bytes) 000440 1790741502.113551 read 0x014471 thru 0x01f2a2 (0xae32 bytes) 000441 1790741502.115062 mapread 0x0197ae thru 0x028f8f (0xf7e2 bytes) 000442 1790741502.120536 read 0x016997 thru 0x023627 (0xcc91 bytes) 000445 1790741502.127359 MIRROR_SPLIT mirror 7 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e44d): Mirror 5: 0x6979e637 (stale) Mirror 6: 0x6979e637 (stale) Mirror 8: 0x6979e637 (stale) Mirror 9: 0x6979e637 (stale) Mirror 11: 0x6979e637 (stale) Mirror 14: 0x6979e637 (stale) Mirror 16: 0x6979e637 (stale) Mirror 18: 0x6979e637 (stale) Mirror 19: 0x6979e637 (stale) Mirror 20: 0x832fde97 (stale) Mirror 21: 0xe64a59c9 (stale) Mirror 22: 0xeb2302c4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e44d): Mirror 5: 0x6979e637 (stale) Mirror 6: 0x6979e637 (stale) Mirror 8: 0x6979e637 (stale) Mirror 9: 0x6979e637 (stale) Mirror 11: 0x6979e637 (stale) Mirror 14: 0x6979e637 (stale) Mirror 16: 0x6979e637 (stale) Mirror 18: 0x6979e637 (stale) Mirror 19: 0x6979e637 (stale) Mirror 20: 0x832fde97 (stale) Mirror 21: 0xe64a59c9 (stale) Mirror 22: 0xeb2302c4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e44d: skipped 000447 1790741502.825167 write 0x000a8d thru 0x0038de (0x2e52 bytes) 000448 1790741502.845581 mapread 0x000e57 thru 0x00a8a1 (0x9a4b bytes) 000449 1790741502.873881 MIRROR_SPLIT mirror 2 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e44d): Mirror 5: 0x6979e637 (stale) Mirror 8: 0x6979e637 (stale) Mirror 9: 0x6979e637 (stale) Mirror 11: 0x6979e637 (stale) Mirror 14: 0x6979e637 (stale) Mirror 16: 0x6979e637 (stale) Mirror 18: 0x6979e637 (stale) Mirror 19: 0x6979e637 (stale) Mirror 20: 0x832fde97 (stale) Mirror 21: 0xe64a59c9 (stale) Mirror 22: 0xeb2302c4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e44d): Mirror 5: 0x6979e637 (stale) Mirror 8: 0x6979e637 (stale) Mirror 9: 0x6979e637 (stale) Mirror 11: 0x6979e637 (stale) Mirror 14: 0x6979e637 (stale) Mirror 16: 0x6979e637 (stale) Mirror 18: 0x6979e637 (stale) Mirror 19: 0x6979e637 (stale) Mirror 20: 0x832fde97 (stale) Mirror 21: 0xe64a59c9 (stale) Mirror 22: 0xeb2302c4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e44d: skipped 000450 1790741503.588897 MIRROR_RESYNC 12 mirrors 000451 1790741508.077087 write 0x00cdec thru 0x01cabf (0xfcd4 bytes) 000453 1790741508.151504 write 0x016559 thru 0x01bd16 (0x57be bytes) 000454 1790741508.152571 mapread 0x01c678 thru 0x0214d8 (0x4e61 bytes) 000456 1790741508.178595 mapwrite 0x01b797 thru 0x01cdfc (0x1666 bytes) 000457 1790741508.233308 mapread 0x01dc5d thru 0x027a6f (0x9e13 bytes) 000458 1790741508.234329 read 0x01913f thru 0x026254 (0xd116 bytes) 000459 1790741508.234887 trunc from 0x02e44d to 0x0198fb (0x14b51 bytes) 000462 1790741508.261732 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x198fc): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x198fc): Mirror 5: 0x26f71434 (stale) Mirror 8: 0x26f71434 (stale) Mirror 9: 0x26f71434 (stale) Mirror 11: 0x26f71434 (stale) Mirror 14: 0x26f71434 (stale) Mirror 16: 0x26f71434 (stale) Mirror 18: 0x26f71434 (stale) Mirror 19: 0x26f71434 (stale) Mirror 20: 0x26f71434 (stale) Mirror 21: 0x26f71434 (stale) Mirror 22: 0x26f71434 (stale) CRC-32 checksum value for chunk [0, 0x198fc): Mirror 1: 0x351f3159 Mirror 23: 0x351f3159 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x198fc: skipped 000463 1790741509.491438 mapread 0x009b40 thru 0x015646 (0xbb07 bytes) 000464 1790741509.534704 mapwrite 0x012e0f thru 0x020584 (0xd776 bytes) 000465 1790741509.727001 mapread 0x01e359 thru 0x01edb9 (0xa61 bytes) 000466 1790741509.727890 write 0x03da96 thru 0x03ffff (0x256a bytes) 000467 1790741509.735694 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 5: 0x6783181c (stale) Mirror 8: 0x6783181c (stale) Mirror 9: 0x6783181c (stale) Mirror 11: 0x6783181c (stale) Mirror 14: 0x6783181c (stale) Mirror 16: 0x6783181c (stale) Mirror 18: 0x6783181c (stale) Mirror 19: 0x6783181c (stale) Mirror 20: 0x6783181c (stale) Mirror 21: 0x6783181c (stale) Mirror 22: 0x6783181c (stale) Mirror 23: 0xecae92cf (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xf6a1d823 Mirror 24: 0xf6a1d823 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000468 1790741511.319106 trunc from 0x040000 to 0x029edd (0x16122 bytes) 000470 1790741511.446502 MIRROR_EXTEND to 15 mirrors CRC-32 checksum value for chunk [0, 0x29ede): Mirror 5: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 23: (stale - read error) Mirror 24: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29ede): Mirror 5: 0x206471dc (stale) Mirror 8: 0x206471dc (stale) Mirror 9: 0x206471dc (stale) Mirror 11: 0x206471dc (stale) Mirror 14: 0x206471dc (stale) Mirror 16: 0x206471dc (stale) Mirror 18: 0x206471dc (stale) Mirror 19: 0x206471dc (stale) Mirror 20: 0x206471dc (stale) Mirror 21: 0x206471dc (stale) Mirror 22: 0x206471dc (stale) Mirror 23: 0x5a50f964 (stale) Mirror 24: 0x3f798307 (stale) CRC-32 checksum value for chunk [0, 0x29ede): Mirror 1: 0x3f798307 Mirror 25: 0x3f798307 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29ede: skipped 000472 1790741513.291882 read 0x026dbe thru 0x029edd (0x3120 bytes) 000473 1790741513.312672 write 0x01f455 thru 0x024fa5 (0x5b51 bytes) 000474 1790741513.445819 write 0x0315f8 thru 0x03c335 (0xad3e bytes) 000475 1790741513.451360 trunc from 0x03c336 to 0x018303 (0x24032 bytes) 000476 1790741513.515236 punch from 0x009b95 to 0x00d254 (0x36c0 bytes) 000477 1790741513.523652 mapread 0x01658b thru 0x018303 (0x1d79 bytes) 000479 1790741513.567175 write 0x032c3d thru 0x03bc46 (0x900a bytes) 000480 1790741513.570725 mapread 0x0238c9 thru 0x026cf1 (0x3429 bytes) 000482 1790741513.581338 punch from 0x023b1e to 0x0240ab (0x58e bytes) 000483 1790741513.602509 MIRROR_SPLIT mirror 1 to 14 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3bc47): Mirror 8: 0x2ec5ee80 (stale) Mirror 9: 0x2ec5ee80 (stale) Mirror 11: 0x2ec5ee80 (stale) Mirror 14: 0x2ec5ee80 (stale) Mirror 16: 0x2ec5ee80 (stale) Mirror 18: 0x2ec5ee80 (stale) Mirror 19: 0x2ec5ee80 (stale) Mirror 20: 0x2ec5ee80 (stale) Mirror 21: 0x2ec5ee80 (stale) Mirror 22: 0x2ec5ee80 (stale) Mirror 23: 0x2646d917 (stale) Mirror 24: 0x9434389c (stale) Mirror 25: 0x9434389c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3bc47): Mirror 8: 0x2ec5ee80 (stale) Mirror 9: 0x2ec5ee80 (stale) Mirror 11: 0x2ec5ee80 (stale) Mirror 14: 0x2ec5ee80 (stale) Mirror 16: 0x2ec5ee80 (stale) Mirror 18: 0x2ec5ee80 (stale) Mirror 19: 0x2ec5ee80 (stale) Mirror 20: 0x2ec5ee80 (stale) Mirror 21: 0x2ec5ee80 (stale) Mirror 22: 0x2ec5ee80 (stale) Mirror 23: 0x2646d917 (stale) Mirror 24: 0x9434389c (stale) Mirror 25: 0x9434389c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3bc47: skipped 000484 1790741514.436680 mapwrite 0x00f4b8 thru 0x01ca7c (0xd5c5 bytes) 000485 1790741514.578863 mapwrite 0x03f9fb thru 0x03ffff (0x605 bytes) 000486 1790741514.713813 trunc from 0x040000 to 0x013ec7 (0x2c138 bytes) 000488 1790741514.732793 mapwrite 0x0378bd thru 0x03d5c8 (0x5d0c bytes) 000490 1790741514.937629 punch from 0x01f5e5 to 0x02e953 (0xf36f bytes) 000492 1790741514.947813 punch from 0x03ce7c to 0x03d5c8 (0x74d bytes) 000493 1790741514.954139 mapread 0x0097ee thru 0x0145f3 (0xae06 bytes) 000494 1790741514.973903 mapwrite 0x01e4ee thru 0x0297ec (0xb2ff bytes) 000495 1790741515.067143 mapread 0x00a62f thru 0x0159d7 (0xb3a9 bytes) 000496 1790741515.072589 trunc from 0x03d5c9 to 0x0064d8 (0x370f0 bytes) 000497 1790741515.094622 read 0x00046b thru 0x0064d8 (0x606e bytes) 000501 1790741515.111576 mapwrite 0x003b2d thru 0x009e91 (0x6365 bytes) 000505 1790741515.193700 mapwrite 0x01e913 thru 0x029cff (0xb3ed bytes) 000506 1790741515.282356 MIRROR_RESYNC 14 mirrors 000507 1790741518.155921 write 0x03f7f4 thru 0x03ffff (0x80c bytes) 000508 1790741518.231528 read 0x039159 thru 0x03ffff (0x6ea7 bytes) 000509 1790741518.242606 read 0x03f072 thru 0x03ffff (0xf8e bytes) 000510 1790741518.243199 punch from 0x00220c to 0x0109f1 (0xe7e6 bytes) 000511 1790741518.253484 write 0x02e305 thru 0x033409 (0x5105 bytes) 000513 1790741518.265246 write 0x0009cf thru 0x00dcea (0xd31c bytes) 000514 1790741518.266668 read 0x036443 thru 0x038856 (0x2414 bytes) 000516 1790741518.272374 MIRROR_SPLIT mirror 11 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xe29ea551 (stale) Mirror 9: 0xe29ea551 (stale) Mirror 11: 0xe29ea551 (stale) Mirror 14: 0xe29ea551 (stale) Mirror 16: 0xe29ea551 (stale) Mirror 18: 0xe29ea551 (stale) Mirror 19: 0xe29ea551 (stale) Mirror 20: 0xe29ea551 (stale) Mirror 21: 0xe29ea551 (stale) Mirror 22: 0xe29ea551 (stale) Mirror 24: 0xe29ea551 (stale) Mirror 25: 0xe29ea551 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0xe29ea551 (stale) Mirror 9: 0xe29ea551 (stale) Mirror 11: 0xe29ea551 (stale) Mirror 14: 0xe29ea551 (stale) Mirror 16: 0xe29ea551 (stale) Mirror 18: 0xe29ea551 (stale) Mirror 19: 0xe29ea551 (stale) Mirror 20: 0xe29ea551 (stale) Mirror 21: 0xe29ea551 (stale) Mirror 22: 0xe29ea551 (stale) Mirror 24: 0xe29ea551 (stale) Mirror 25: 0xe29ea551 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000517 1790741519.065693 mapwrite 0x007ddd thru 0x010408 (0x862c bytes) 000518 1790741519.154512 read 0x0373f2 thru 0x03914d (0x1d5c bytes) 000519 1790741519.160760 punch from 0x00ddcd to 0x01129b (0x34cf bytes) 000521 1790741519.166050 mapwrite 0x0313d6 thru 0x03e36d (0xcf98 bytes) 000522 1790741519.247189 mapwrite 0x03bf09 thru 0x03ffff (0x40f7 bytes) 000524 1790741519.308788 read 0x006cdd thru 0x015f29 (0xf24d bytes) 000525 1790741519.325126 punch from 0x03d221 to 0x03ffff (0x2ddf bytes) 000526 1790741519.329843 mapwrite 0x023634 thru 0x02dd01 (0xa6ce bytes) 000527 1790741519.380736 mapread 0x017279 thru 0x0179d4 (0x75c bytes) 000528 1790741519.381592 punch from 0x038dd7 to 0x03a0cf (0x12f9 bytes) 000530 1790741519.391720 mapread 0x02aea2 thru 0x0345b9 (0x9718 bytes) 000531 1790741519.393649 mapwrite 0x014e58 thru 0x0245d9 (0xf782 bytes) 000532 1790741519.470740 mapread 0x03ebb2 thru 0x03ffff (0x144e bytes) 000533 1790741519.481761 read 0x020403 thru 0x02e6b7 (0xe2b5 bytes) 000534 1790741519.483827 mapread 0x0274b6 thru 0x02e7a2 (0x72ed bytes) 000535 1790741519.485680 write 0x001f27 thru 0x00ddf7 (0xbed1 bytes) 000536 1790741519.487327 trunc from 0x040000 to 0x01a4ab (0x25b54 bytes) 000537 1790741519.505624 read 0x00b895 thru 0x00cf42 (0x16ae bytes) 000538 1790741519.506272 write 0x02a38c thru 0x034821 (0xa496 bytes) 000540 1790741519.510314 punch from 0x024aff to 0x027be6 (0x30e8 bytes) 000541 1790741519.528141 trunc from 0x034822 to 0x010a0f (0x23e12 bytes) 000542 1790741519.560037 trunc from 0x010a10 to 0x033763 (0x22d54 bytes) 000543 1790741519.582951 punch from 0x032026 to 0x033763 (0x173e bytes) 000544 1790741519.594369 mapread 0x0139ef thru 0x0192f9 (0x590b bytes) 000545 1790741519.607462 punch from 0x000d1b to 0x00c8b4 (0xbb9a bytes) 000546 1790741519.619879 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x33764): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33764): Mirror 8: 0x5fd7d358 (stale) Mirror 9: 0x5fd7d358 (stale) Mirror 11: 0x5fd7d358 (stale) Mirror 14: 0x5fd7d358 (stale) Mirror 16: 0x5fd7d358 (stale) Mirror 18: 0x5fd7d358 (stale) Mirror 19: 0x5fd7d358 (stale) Mirror 20: 0x5fd7d358 (stale) Mirror 21: 0x5fd7d358 (stale) Mirror 22: 0x5fd7d358 (stale) Mirror 24: 0x5fd7d358 (stale) Mirror 25: 0x5fd7d358 (stale) CRC-32 checksum value for chunk [0, 0x33764): Mirror 1: 0x7ea5b640 Mirror 26: 0x7ea5b640 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33764: skipped 000547 1790741521.042163 punch from 0x02b105 to 0x033763 (0x865f bytes) 000550 1790741521.193936 punch from 0x01ac59 to 0x023e25 (0x91cd bytes) 000552 1790741521.209435 mapwrite 0x00c7a9 thru 0x017ad3 (0xb32b bytes) 000553 1790741521.362796 punch from 0x00b86c to 0x019806 (0xdf9b bytes) 000555 1790741521.371999 MIRROR_SPLIT mirror 2 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33764): Mirror 8: 0x5fd7d358 (stale) Mirror 11: 0x5fd7d358 (stale) Mirror 14: 0x5fd7d358 (stale) Mirror 16: 0x5fd7d358 (stale) Mirror 18: 0x5fd7d358 (stale) Mirror 19: 0x5fd7d358 (stale) Mirror 20: 0x5fd7d358 (stale) Mirror 21: 0x5fd7d358 (stale) Mirror 22: 0x5fd7d358 (stale) Mirror 24: 0x5fd7d358 (stale) Mirror 25: 0x5fd7d358 (stale) Mirror 26: 0x7ea5b640 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33764): Mirror 8: 0x5fd7d358 (stale) Mirror 11: 0x5fd7d358 (stale) Mirror 14: 0x5fd7d358 (stale) Mirror 16: 0x5fd7d358 (stale) Mirror 18: 0x5fd7d358 (stale) Mirror 19: 0x5fd7d358 (stale) Mirror 20: 0x5fd7d358 (stale) Mirror 21: 0x5fd7d358 (stale) Mirror 22: 0x5fd7d358 (stale) Mirror 24: 0x5fd7d358 (stale) Mirror 25: 0x5fd7d358 (stale) Mirror 26: 0x7ea5b640 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33764: skipped 000556 1790741522.461787 mapread 0x02564a thru 0x02ea99 (0x9450 bytes) 000557 1790741522.483531 mapwrite 0x0178dd thru 0x023df2 (0xc516 bytes) 000558 1790741522.543392 trunc from 0x033764 to 0x004baf (0x2ebb4 bytes) 000559 1790741522.558167 trunc from 0x004bb0 to 0x02211a (0x1d56b bytes) 000560 1790741522.580901 mapwrite 0x0334e5 thru 0x03ffff (0xcb1b bytes) 000562 1790741522.672618 mapwrite 0x00710d thru 0x01618c (0xf080 bytes) 000563 1790741522.794680 write 0x01fd69 thru 0x026476 (0x670e bytes) 000564 1790741522.814773 write 0x00dd0b thru 0x01185c (0x3b52 bytes) 000565 1790741522.818245 trunc from 0x040000 to 0x017ca6 (0x28359 bytes) 000566 1790741522.867068 MIRROR_SPLIT mirror 5 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x17ca7): Mirror 8: 0x1437b2c3 (stale) Mirror 11: 0x1437b2c3 (stale) Mirror 14: 0x1437b2c3 (stale) Mirror 16: 0x1437b2c3 (stale) Mirror 19: 0x1437b2c3 (stale) Mirror 20: 0x1437b2c3 (stale) Mirror 21: 0x1437b2c3 (stale) Mirror 22: 0x1437b2c3 (stale) Mirror 24: 0x1437b2c3 (stale) Mirror 25: 0x1437b2c3 (stale) Mirror 26: 0xb7ab0efd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17ca7): Mirror 8: 0x1437b2c3 (stale) Mirror 11: 0x1437b2c3 (stale) Mirror 14: 0x1437b2c3 (stale) Mirror 16: 0x1437b2c3 (stale) Mirror 19: 0x1437b2c3 (stale) Mirror 20: 0x1437b2c3 (stale) Mirror 21: 0x1437b2c3 (stale) Mirror 22: 0x1437b2c3 (stale) Mirror 24: 0x1437b2c3 (stale) Mirror 25: 0x1437b2c3 (stale) Mirror 26: 0xb7ab0efd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17ca7: skipped 000568 1790741523.605856 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x17ca7): Mirror 8: (stale - read error) Mirror 11: (stale - read error) Mirror 14: (stale - read error) Mirror 16: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 26: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17ca7): Mirror 8: 0x1437b2c3 (stale) Mirror 11: 0x1437b2c3 (stale) Mirror 14: 0x1437b2c3 (stale) Mirror 16: 0x1437b2c3 (stale) Mirror 19: 0x1437b2c3 (stale) Mirror 20: 0x1437b2c3 (stale) Mirror 21: 0x1437b2c3 (stale) Mirror 22: 0x1437b2c3 (stale) Mirror 24: 0x1437b2c3 (stale) Mirror 25: 0x1437b2c3 (stale) Mirror 26: 0xb7ab0efd (stale) CRC-32 checksum value for chunk [0, 0x17ca7): Mirror 1: 0xc5e4327e Mirror 27: 0xc5e4327e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17ca7: skipped 000569 1790741524.932883 MIRROR_RESYNC 13 mirrors 000570 1790741528.611758 write 0x03ef78 thru 0x03ffff (0x1088 bytes) 000573 1790741528.702360 mapwrite 0x03e0d8 thru 0x03ffff (0x1f28 bytes) 000575 1790741528.742580 write 0x013774 thru 0x0194d4 (0x5d61 bytes) 000576 1790741528.757608 MIRROR_SPLIT mirror 11 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x265c576d (stale) Mirror 11: 0x265c576d (stale) Mirror 14: 0x265c576d (stale) Mirror 16: 0x265c576d (stale) Mirror 19: 0x265c576d (stale) Mirror 20: 0x265c576d (stale) Mirror 21: 0x265c576d (stale) Mirror 22: 0x265c576d (stale) Mirror 24: 0x265c576d (stale) Mirror 25: 0x265c576d (stale) Mirror 27: 0x265c576d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 8: 0x265c576d (stale) Mirror 11: 0x265c576d (stale) Mirror 14: 0x265c576d (stale) Mirror 16: 0x265c576d (stale) Mirror 19: 0x265c576d (stale) Mirror 20: 0x265c576d (stale) Mirror 21: 0x265c576d (stale) Mirror 22: 0x265c576d (stale) Mirror 24: 0x265c576d (stale) Mirror 25: 0x265c576d (stale) Mirror 27: 0x265c576d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000577 1790741529.386409 punch from 0x039e6e to 0x03ffff (0x6192 bytes) 000578 1790741529.392627 read 0x03145f thru 0x0328a9 (0x144b bytes) 000579 1790741529.398966 punch from 0x03c6e5 to 0x03ffff (0x391b bytes) 000580 1790741529.404421 punch from 0x001c61 to 0x00a67d (0x8a1d bytes) 000581 1790741529.410915 read 0x01d892 thru 0x0248ec (0x705b bytes) 000584 1790741529.430302 read 0x02effa thru 0x032bcf (0x3bd6 bytes) 000585 1790741529.431113 write 0x03db18 thru 0x03ffff (0x24e8 bytes) 000586 1790741529.433957 mapread 0x01020e thru 0x011c40 (0x1a33 bytes) 000587 1790741529.436888 mapread 0x0332c2 thru 0x039238 (0x5f77 bytes) 000588 1790741529.446054 MIRROR_SPLIT mirror 1 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x265c576d (stale) Mirror 14: 0x265c576d (stale) Mirror 16: 0x265c576d (stale) Mirror 19: 0x265c576d (stale) Mirror 20: 0x265c576d (stale) Mirror 21: 0x265c576d (stale) Mirror 22: 0x265c576d (stale) Mirror 24: 0x265c576d (stale) Mirror 25: 0x265c576d (stale) Mirror 27: 0x265c576d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x265c576d (stale) Mirror 14: 0x265c576d (stale) Mirror 16: 0x265c576d (stale) Mirror 19: 0x265c576d (stale) Mirror 20: 0x265c576d (stale) Mirror 21: 0x265c576d (stale) Mirror 22: 0x265c576d (stale) Mirror 24: 0x265c576d (stale) Mirror 25: 0x265c576d (stale) Mirror 27: 0x265c576d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000589 1790741530.207533 MIRROR_SPLIT mirror 6 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x265c576d (stale) Mirror 14: 0x265c576d (stale) Mirror 16: 0x265c576d (stale) Mirror 19: 0x265c576d (stale) Mirror 20: 0x265c576d (stale) Mirror 22: 0x265c576d (stale) Mirror 24: 0x265c576d (stale) Mirror 25: 0x265c576d (stale) Mirror 27: 0x265c576d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 11: 0x265c576d (stale) Mirror 14: 0x265c576d (stale) Mirror 16: 0x265c576d (stale) Mirror 19: 0x265c576d (stale) Mirror 20: 0x265c576d (stale) Mirror 22: 0x265c576d (stale) Mirror 24: 0x265c576d (stale) Mirror 25: 0x265c576d (stale) Mirror 27: 0x265c576d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000590 1790741530.760985 read 0x027f73 thru 0x033725 (0xb7b3 bytes) 000591 1790741530.768326 mapwrite 0x037393 thru 0x03ffff (0x8c6d bytes) 000593 1790741530.838098 read 0x01567e thru 0x0192ab (0x3c2e bytes) 000594 1790741530.849313 punch from 0x01ca6e to 0x023472 (0x6a05 bytes) 000596 1790741530.856386 trunc from 0x040000 to 0x00b3bb (0x34c44 bytes) 000598 1790741530.877062 mapwrite 0x033ebb thru 0x03ffff (0xc145 bytes) 000600 1790741531.008905 trunc from 0x040000 to 0x0174af (0x28b50 bytes) 000602 1790741531.033937 punch from 0x0039f6 to 0x010491 (0xca9c bytes) 000603 1790741531.045915 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x174b0): Mirror 14: 0x4f046a37 (stale) Mirror 16: 0x4f046a37 (stale) Mirror 19: 0x4f046a37 (stale) Mirror 20: 0x4f046a37 (stale) Mirror 22: 0x4f046a37 (stale) Mirror 24: 0x4f046a37 (stale) Mirror 25: 0x4f046a37 (stale) Mirror 27: 0x4f046a37 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x174b0): Mirror 14: 0x4f046a37 (stale) Mirror 16: 0x4f046a37 (stale) Mirror 19: 0x4f046a37 (stale) Mirror 20: 0x4f046a37 (stale) Mirror 22: 0x4f046a37 (stale) Mirror 24: 0x4f046a37 (stale) Mirror 25: 0x4f046a37 (stale) Mirror 27: 0x4f046a37 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x174b0: skipped 000604 1790741531.614980 read 0x00db99 thru 0x00e0cb (0x533 bytes) 000607 1790741531.622096 write 0x037494 thru 0x03ffff (0x8b6c bytes) 000610 1790741531.627200 trunc from 0x040000 to 0x010f0a (0x2f0f5 bytes) 000611 1790741531.647942 write 0x03face thru 0x03ffff (0x532 bytes) 000612 1790741531.649404 mapread 0x00ecbd thru 0x011659 (0x299d bytes) 000613 1790741531.669998 trunc from 0x040000 to 0x035b74 (0xa48b bytes) 000616 1790741531.694309 trunc from 0x035b75 to 0x0147ff (0x21375 bytes) 000617 1790741531.713587 write 0x003d87 thru 0x00665a (0x28d4 bytes) 000618 1790741531.725807 mapread 0x010c57 thru 0x0147ff (0x3ba9 bytes) 000619 1790741531.727140 read 0x00da50 thru 0x0147ff (0x6db0 bytes) 000623 1790741531.732210 mapwrite 0x027c88 thru 0x02b222 (0x359b bytes) 000624 1790741531.827888 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b223): Mirror 14: 0x1bac8b3a (stale) Mirror 19: 0x1bac8b3a (stale) Mirror 20: 0x1bac8b3a (stale) Mirror 22: 0x1bac8b3a (stale) Mirror 24: 0x1bac8b3a (stale) Mirror 25: 0x1bac8b3a (stale) Mirror 27: 0x1bac8b3a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b223): Mirror 14: 0x1bac8b3a (stale) Mirror 19: 0x1bac8b3a (stale) Mirror 20: 0x1bac8b3a (stale) Mirror 22: 0x1bac8b3a (stale) Mirror 24: 0x1bac8b3a (stale) Mirror 25: 0x1bac8b3a (stale) Mirror 27: 0x1bac8b3a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b223: skipped 000626 1790741532.352567 read 0x02a883 thru 0x02b222 (0x9a0 bytes) 000628 1790741532.361914 mapwrite 0x019557 thru 0x027aca (0xe574 bytes) 000630 1790741532.501820 mapwrite 0x01827d thru 0x01aaef (0x2873 bytes) 000631 1790741532.592528 read 0x01ffd2 thru 0x02144f (0x147e bytes) 000634 1790741532.598176 mapwrite 0x0038ce thru 0x00499e (0x10d1 bytes) 000636 1790741532.671045 read 0x00e700 thru 0x016a90 (0x8391 bytes) 000637 1790741532.672553 read 0x008064 thru 0x008523 (0x4c0 bytes) 000638 1790741532.675999 trunc from 0x02b223 to 0x033638 (0x8416 bytes) 000639 1790741532.711953 mapwrite 0x02defa thru 0x03b557 (0xd65e bytes) 000640 1790741532.846480 trunc from 0x03b558 to 0x010243 (0x2b314 bytes) 000641 1790741532.881467 write 0x002964 thru 0x0115c0 (0xec5d bytes) 000642 1790741532.885579 punch from 0x004f35 to 0x00b15a (0x6226 bytes) 000643 1790741532.919999 mapwrite 0x00900e thru 0x018ff1 (0xffe4 bytes) 000645 1790741533.184184 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x18ff2): Mirror 14: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 22: (stale - read error) Mirror 24: (stale - read error) Mirror 25: (stale - read error) Mirror 27: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18ff2): Mirror 14: 0xb861f500 (stale) Mirror 19: 0xb861f500 (stale) Mirror 20: 0xb861f500 (stale) Mirror 22: 0xb861f500 (stale) Mirror 24: 0xb861f500 (stale) Mirror 25: 0xb861f500 (stale) Mirror 27: 0xb861f500 (stale) CRC-32 checksum value for chunk [0, 0x18ff2): Mirror 1: 0xfd800088 Mirror 28: 0xfd800088 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18ff2: skipped 000646 1790741534.571926 mapwrite 0x009e98 thru 0x012777 (0x88e0 bytes) 000647 1790741534.894717 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18ff2): Mirror 14: 0xb861f500 (stale) Mirror 19: 0xb861f500 (stale) Mirror 20: 0xb861f500 (stale) Mirror 24: 0xb861f500 (stale) Mirror 25: 0xb861f500 (stale) Mirror 27: 0xb861f500 (stale) Mirror 28: 0xfd800088 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18ff2): Mirror 14: 0xb861f500 (stale) Mirror 19: 0xb861f500 (stale) Mirror 20: 0xb861f500 (stale) Mirror 24: 0xb861f500 (stale) Mirror 25: 0xb861f500 (stale) Mirror 27: 0xb861f500 (stale) Mirror 28: 0xfd800088 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18ff2: skipped 000648 1790741535.446121 write 0x03d0bf thru 0x03ffff (0x2f41 bytes) 000649 1790741535.447703 mapread 0x01c603 thru 0x029194 (0xcb92 bytes) 000650 1790741535.470595 mapread 0x02435e thru 0x02bfd0 (0x7c73 bytes) 000651 1790741535.472091 mapread 0x0149e7 thru 0x01d54f (0x8b69 bytes) 000652 1790741535.481607 mapread 0x0131f2 thru 0x0171a5 (0x3fb4 bytes) 000653 1790741535.482703 read 0x033a85 thru 0x035904 (0x1e80 bytes) 000654 1790741535.489239 mapwrite 0x01dbda thru 0x01f7cf (0x1bf6 bytes) 000655 1790741535.530976 mapread 0x0111fe thru 0x01d6e6 (0xc4e9 bytes) 000657 1790741535.535006 write 0x023867 thru 0x02e866 (0xb000 bytes) 000658 1790741535.538875 mapwrite 0x018a79 thru 0x01a6dc (0x1c64 bytes) 000659 1790741535.661469 trunc from 0x040000 to 0x027402 (0x18bfd bytes) 000660 1790741535.712234 punch from 0x00d3ff to 0x010bba (0x37bc bytes) 000662 1790741535.727226 mapwrite 0x013160 thru 0x022147 (0xefe8 bytes) 000663 1790741535.815902 punch from 0x006dd5 to 0x0104cd (0x96f9 bytes) 000664 1790741535.822409 mapwrite 0x00d027 thru 0x012957 (0x5931 bytes) 000665 1790741535.910454 read 0x018ee9 thru 0x01ddd7 (0x4eef bytes) 000666 1790741535.911323 trunc from 0x027403 to 0x028e69 (0x1a67 bytes) 000667 1790741535.939772 write 0x02f439 thru 0x0372cd (0x7e95 bytes) 000670 1790741535.943745 read 0x00dcdd thru 0x00f262 (0x1586 bytes) 000672 1790741535.944928 trunc from 0x0372ce to 0x009d7e (0x2d54f bytes) 000673 1790741535.966523 mapwrite 0x02a459 thru 0x038cef (0xe897 bytes) 000674 1790741536.071936 MIRROR_SPLIT mirror 5 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x38cf0): Mirror 14: 0x914a3911 (stale) Mirror 19: 0x914a3911 (stale) Mirror 20: 0x914a3911 (stale) Mirror 24: 0x914a3911 (stale) Mirror 27: 0x914a3911 (stale) Mirror 28: 0x80d6fb3a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38cf0): Mirror 14: 0x914a3911 (stale) Mirror 19: 0x914a3911 (stale) Mirror 20: 0x914a3911 (stale) Mirror 24: 0x914a3911 (stale) Mirror 27: 0x914a3911 (stale) Mirror 28: 0x80d6fb3a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38cf0: skipped 000675 1790741536.466862 punch from 0x0006cb to 0x008c1d (0x8553 bytes) 000676 1790741536.475068 read 0x01ff91 thru 0x029630 (0x96a0 bytes) 000677 1790741536.482965 punch from 0x00d8ff to 0x011ede (0x45e0 bytes) 000678 1790741536.496252 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x38cf0): Mirror 14: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38cf0): Mirror 14: 0x914a3911 (stale) Mirror 19: 0x914a3911 (stale) Mirror 20: 0x914a3911 (stale) Mirror 24: 0x914a3911 (stale) Mirror 27: 0x914a3911 (stale) Mirror 28: 0x80d6fb3a (stale) CRC-32 checksum value for chunk [0, 0x38cf0): Mirror 1: 0xdcad1bc1 Mirror 29: 0xdcad1bc1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38cf0: skipped 000679 1790741537.963539 read 0x012538 thru 0x0182c2 (0x5d8b bytes) 000680 1790741537.991954 punch from 0x01719a to 0x018dc3 (0x1c2a bytes) 000683 1790741538.075251 mapwrite 0x01f5ff thru 0x024ace (0x54d0 bytes) 000684 1790741538.149952 mapwrite 0x03c9d1 thru 0x03ffff (0x362f bytes) 000686 1790741538.238826 read 0x03f541 thru 0x03ffff (0xabf bytes) 000687 1790741538.246883 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 14: 0x265c576d (stale) Mirror 19: 0x265c576d (stale) Mirror 20: 0x265c576d (stale) Mirror 24: 0x265c576d (stale) Mirror 27: 0x265c576d (stale) Mirror 28: 0x67bc957a (stale) Mirror 29: 0xa567e843 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x665ce7cc Mirror 30: 0x665ce7cc lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000688 1790741539.372361 write 0x02359b thru 0x02415b (0xbc1 bytes) 000689 1790741539.444906 trunc from 0x040000 to 0x0383ae (0x7c51 bytes) 000690 1790741539.482990 read 0x003eeb thru 0x00ec65 (0xad7b bytes) 000691 1790741539.490825 trunc from 0x0383af to 0x02e655 (0x9d59 bytes) 000692 1790741539.505424 mapread 0x010899 thru 0x01e7ed (0xdf55 bytes) 000695 1790741539.551261 MIRROR_SPLIT mirror 8 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e656): Mirror 14: 0xf17ae97b (stale) Mirror 19: 0xf17ae97b (stale) Mirror 20: 0xf17ae97b (stale) Mirror 24: 0xf17ae97b (stale) Mirror 27: 0xf17ae97b (stale) Mirror 28: 0xdada1313 (stale) Mirror 29: 0x4f876086 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e656): Mirror 14: 0xf17ae97b (stale) Mirror 19: 0xf17ae97b (stale) Mirror 20: 0xf17ae97b (stale) Mirror 24: 0xf17ae97b (stale) Mirror 27: 0xf17ae97b (stale) Mirror 28: 0xdada1313 (stale) Mirror 29: 0x4f876086 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e656: skipped 000697 1790741540.297560 punch from 0x02872e to 0x02e57d (0x5e50 bytes) 000698 1790741540.311196 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2e656): Mirror 14: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e656): Mirror 14: 0xf17ae97b (stale) Mirror 19: 0xf17ae97b (stale) Mirror 20: 0xf17ae97b (stale) Mirror 24: 0xf17ae97b (stale) Mirror 27: 0xf17ae97b (stale) Mirror 28: 0xdada1313 (stale) Mirror 29: 0x4f876086 (stale) CRC-32 checksum value for chunk [0, 0x2e656): Mirror 1: 0x331b52e6 Mirror 30: 0x331b52e6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e656: skipped 000699 1790741541.942069 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e656): Mirror 14: 0xf17ae97b (stale) Mirror 20: 0xf17ae97b (stale) Mirror 24: 0xf17ae97b (stale) Mirror 27: 0xf17ae97b (stale) Mirror 28: 0xdada1313 (stale) Mirror 29: 0x4f876086 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e656): Mirror 14: 0xf17ae97b (stale) Mirror 20: 0xf17ae97b (stale) Mirror 24: 0xf17ae97b (stale) Mirror 27: 0xf17ae97b (stale) Mirror 28: 0xdada1313 (stale) Mirror 29: 0x4f876086 (stale) CRC-32 checksum value for chunk [0, 0x2e656): Mirror 1: 0x331b52e6 Mirror 30: 0x331b52e6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e656: skipped 000701 1790741542.964637 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x2e656): Mirror 14: (stale - read error) Mirror 20: (stale - read error) Mirror 24: (stale - read error) Mirror 27: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e656): Mirror 14: 0xf17ae97b (stale) Mirror 20: 0xf17ae97b (stale) Mirror 24: 0xf17ae97b (stale) Mirror 27: 0xf17ae97b (stale) Mirror 28: 0xdada1313 (stale) Mirror 29: 0x4f876086 (stale) CRC-32 checksum value for chunk [0, 0x2e656): Mirror 1: 0x331b52e6 Mirror 30: 0x331b52e6 Mirror 31: 0x331b52e6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e656: skipped 000702 1790741544.073906 MIRROR_SPLIT mirror 4 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e656): Mirror 14: 0xf17ae97b (stale) Mirror 20: 0xf17ae97b (stale) Mirror 24: 0xf17ae97b (stale) Mirror 28: 0xdada1313 (stale) Mirror 29: 0x4f876086 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e656): Mirror 14: 0xf17ae97b (stale) Mirror 20: 0xf17ae97b (stale) Mirror 24: 0xf17ae97b (stale) Mirror 28: 0xdada1313 (stale) Mirror 29: 0x4f876086 (stale) CRC-32 checksum value for chunk [0, 0x2e656): Mirror 1: 0x331b52e6 Mirror 30: 0x331b52e6 Mirror 31: 0x331b52e6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e656: skipped 000704 1790741544.650354 trunc from 0x02e656 to 0x035efe (0x78a9 bytes) 000705 1790741544.753679 punch from 0x01e5a2 to 0x022108 (0x3b67 bytes) 000708 1790741544.762610 mapread 0x01561f thru 0x01d584 (0x7f66 bytes) 000709 1790741544.786481 read 0x0027a3 thru 0x01192c (0xf18a bytes) 000710 1790741544.796932 punch from 0x014b60 to 0x023fa4 (0xf445 bytes) 000711 1790741544.802815 punch from 0x0046eb to 0x0047cc (0xe2 bytes) 000712 1790741544.808683 punch from 0x024733 to 0x0253b5 (0xc83 bytes) 000713 1790741544.813651 mapwrite 0x02f00e thru 0x037162 (0x8155 bytes) 000714 1790741544.887631 mapread 0x008d87 thru 0x00c0fb (0x3375 bytes) 000715 1790741544.889546 mapread 0x01f4c3 thru 0x028e62 (0x99a0 bytes) 000716 1790741544.907438 mapread 0x018e03 thru 0x02686b (0xda69 bytes) 000717 1790741544.908768 trunc from 0x037163 to 0x01cc84 (0x1a4de bytes) 000718 1790741544.930771 trunc from 0x01cc85 to 0x0065b2 (0x166d2 bytes) 000719 1790741544.957635 read 0x00330b thru 0x0065b2 (0x32a8 bytes) 000721 1790741544.970188 read 0x0058fd thru 0x0065b2 (0xcb6 bytes) 000722 1790741544.970790 write 0x002f40 thru 0x012483 (0xf544 bytes) 000723 1790741544.975648 mapread 0x00800d thru 0x008b92 (0xb86 bytes) 000724 1790741544.976555 punch from 0x00bae0 to 0x012483 (0x69a4 bytes) 000726 1790741545.014990 MIRROR_RESYNC 8 mirrors 000727 1790741547.291495 read 0x008452 thru 0x00fea0 (0x7a4f bytes) 000728 1790741547.300629 write 0x03c504 thru 0x03ffff (0x3afc bytes) 000729 1790741547.375061 mapread 0x039e44 thru 0x03ffff (0x61bc bytes) 000730 1790741547.391997 write 0x004dce thru 0x00ec8b (0x9ebe bytes) 000732 1790741547.400764 write 0x02fc11 thru 0x035bf1 (0x5fe1 bytes) 000733 1790741547.406136 trunc from 0x040000 to 0x02539f (0x1ac60 bytes) 000735 1790741547.429641 punch from 0x0034ac to 0x007e2c (0x4981 bytes) 000736 1790741547.444085 mapread 0x009687 thru 0x01333b (0x9cb5 bytes) 000737 1790741547.452392 punch from 0x010d5c to 0x013c2b (0x2ed0 bytes) 000738 1790741547.456865 write 0x03d8b0 thru 0x03e616 (0xd67 bytes) 000739 1790741547.457888 mapwrite 0x03478b thru 0x03ffff (0xb875 bytes) 000740 1790741547.539841 punch from 0x01fd96 to 0x02f453 (0xf6be bytes) 000741 1790741547.544284 mapwrite 0x037e91 thru 0x03e607 (0x6777 bytes) 000743 1790741547.593967 trunc from 0x040000 to 0x0352f7 (0xad08 bytes) 000744 1790741547.611514 read 0x020894 thru 0x0215ac (0xd19 bytes) 000745 1790741547.621546 mapwrite 0x03c768 thru 0x03ffff (0x3898 bytes) 000747 1790741547.696226 mapwrite 0x021acf thru 0x02a2be (0x87f0 bytes) 000748 1790741547.739938 mapread 0x024e9d thru 0x02e938 (0x9a9c bytes) 000750 1790741547.745571 MIRROR_RESYNC 8 mirrors 000751 1790741551.991445 mapwrite 0x038557 thru 0x03ffff (0x7aa9 bytes) 000755 1790741552.264557 punch from 0x006814 to 0x008749 (0x1f36 bytes) 000756 1790741552.269801 read 0x002f38 thru 0x00dfd3 (0xb09c bytes) 000757 1790741552.285090 mapread 0x01c208 thru 0x0249fa (0x87f3 bytes) 000758 1790741552.294527 mapwrite 0x03d0b5 thru 0x03ffff (0x2f4b bytes) 000762 1790741552.384708 mapwrite 0x034ac8 thru 0x03cae5 (0x801e bytes) 000763 1790741552.454571 read 0x013ecb thru 0x017ef3 (0x4029 bytes) 000764 1790741552.472154 read 0x02cd0a thru 0x036317 (0x960e bytes) 000765 1790741552.472959 read 0x02ee5b thru 0x037713 (0x88b9 bytes) 000766 1790741552.475124 mapwrite 0x0295da thru 0x029bd9 (0x600 bytes) 000767 1790741552.556488 trunc from 0x040000 to 0x008094 (0x37f6b bytes) 000769 1790741552.588213 write 0x000e51 thru 0x0101c6 (0xf376 bytes) 000770 1790741552.590528 read 0x003510 thru 0x00d0a6 (0x9b97 bytes) 000772 1790741552.596344 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x101c7): Mirror 14: (stale - read error) Mirror 20: (stale - read error) Mirror 24: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 30: (stale - read error) Mirror 31: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x101c7): Mirror 14: 0x4802ef80 (stale) Mirror 20: 0x4802ef80 (stale) Mirror 24: 0x4802ef80 (stale) Mirror 28: 0x4802ef80 (stale) Mirror 29: 0x4802ef80 (stale) Mirror 30: 0x4802ef80 (stale) Mirror 31: 0x4802ef80 (stale) CRC-32 checksum value for chunk [0, 0x101c7): Mirror 1: 0x44d3f4a8 Mirror 32: 0x44d3f4a8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x101c7: skipped 000775 1790741553.907927 write 0x0158c6 thru 0x020e6a (0xb5a5 bytes) 000777 1790741554.090477 mapread 0x01b302 thru 0x01e3c2 (0x30c1 bytes) 000778 1790741554.091920 write 0x006982 thru 0x0070d4 (0x753 bytes) 000780 1790741554.123141 mapread 0x018e46 thru 0x01c53d (0x36f8 bytes) 000782 1790741554.148632 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x20e6b): Mirror 14: 0x4f64b9ed (stale) Mirror 20: 0x4f64b9ed (stale) Mirror 24: 0x4f64b9ed (stale) Mirror 28: 0x4f64b9ed (stale) Mirror 29: 0x4f64b9ed (stale) Mirror 31: 0x4f64b9ed (stale) Mirror 32: 0x582e9443 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x20e6b): Mirror 14: 0x4f64b9ed (stale) Mirror 20: 0x4f64b9ed (stale) Mirror 24: 0x4f64b9ed (stale) Mirror 28: 0x4f64b9ed (stale) Mirror 29: 0x4f64b9ed (stale) Mirror 31: 0x4f64b9ed (stale) Mirror 32: 0x582e9443 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x20e6b: skipped 000786 1790741554.835285 trunc from 0x020e6b to 0x008014 (0x18e56 bytes) 000787 1790741554.864430 MIRROR_RESYNC 8 mirrors 000789 1790741556.051144 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) 000791 1790741556.476254 write 0x0374be thru 0x03ffff (0x8b42 bytes) 000792 1790741556.551773 trunc from 0x040000 to 0x025d1d (0x1a2e2 bytes) 000794 1790741556.579793 trunc from 0x025d1e to 0x01eec7 (0x6e56 bytes) 000795 1790741556.607259 trunc from 0x01eec8 to 0x03d8eb (0x1ea24 bytes) 000796 1790741556.627860 write 0x01642c thru 0x01cadd (0x66b2 bytes) 000798 1790741556.639543 mapread 0x037c5a thru 0x03d8eb (0x5c92 bytes) 000799 1790741556.658039 mapread 0x0272dc thru 0x03149b (0xa1c0 bytes) 000800 1790741556.675627 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3d8ec): Mirror 14: (stale - read error) Mirror 20: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d8ec): Mirror 14: 0xa499a0f7 (stale) Mirror 20: 0xa499a0f7 (stale) Mirror 28: 0xa499a0f7 (stale) Mirror 29: 0xa499a0f7 (stale) Mirror 31: 0xa499a0f7 (stale) Mirror 32: 0xa499a0f7 (stale) CRC-32 checksum value for chunk [0, 0x3d8ec): Mirror 1: 0x9ba9a669 Mirror 33: 0x9ba9a669 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d8ec: skipped 000801 1790741558.402844 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3d8ec): Mirror 14: (stale - read error) Mirror 20: (stale - read error) Mirror 28: (stale - read error) Mirror 29: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d8ec): Mirror 14: 0xa499a0f7 (stale) Mirror 20: 0xa499a0f7 (stale) Mirror 28: 0xa499a0f7 (stale) Mirror 29: 0xa499a0f7 (stale) Mirror 31: 0xa499a0f7 (stale) Mirror 32: 0xa499a0f7 (stale) CRC-32 checksum value for chunk [0, 0x3d8ec): Mirror 1: 0x9ba9a669 Mirror 33: 0x9ba9a669 Mirror 34: 0x9ba9a669 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d8ec: skipped 000802 1790741559.645344 mapwrite 0x023b2a thru 0x0329da (0xeeb1 bytes) 000803 1790741559.922572 trunc from 0x03d8ec to 0x018d4f (0x24b9c bytes) 000804 1790741559.957753 MIRROR_RESYNC 9 mirrors 000805 1790741562.033735 punch from 0x00de2c to 0x018d4f (0xaf24 bytes) 000806 1790741562.121447 punch from 0x0164fa to 0x018d4f (0x2856 bytes) 000809 1790741562.142630 trunc from 0x018d50 to 0x022a29 (0x9cda bytes) 000810 1790741562.164782 punch from 0x014c90 to 0x020c2a (0xbf9b bytes) 000811 1790741562.170606 read 0x013e22 thru 0x01541c (0x15fb bytes) 000814 1790741562.177865 read 0x01bcf6 thru 0x022a29 (0x6d34 bytes) 000815 1790741562.189258 read 0x01c4ee thru 0x022a29 (0x653c bytes) 000816 1790741562.189814 write 0x021e24 thru 0x0303ef (0xe5cc bytes) 000818 1790741562.193297 punch from 0x02b3c2 to 0x0303ef (0x502e bytes) 000820 1790741562.214924 MIRROR_RESYNC 9 mirrors 000821 1790741565.477884 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) 000822 1790741566.070791 write 0x0380cf thru 0x03ffff (0x7f31 bytes) 000826 1790741566.168976 mapread 0x0341c7 thru 0x03affc (0x6e36 bytes) 000828 1790741566.212378 trunc from 0x040000 to 0x003854 (0x3c7ab bytes) 000830 1790741566.248796 punch from 0x00259d to 0x003854 (0x12b8 bytes) 000831 1790741566.253679 write 0x007fff thru 0x00bbd9 (0x3bdb bytes) 000832 1790741566.254815 write 0x013a8b thru 0x021f7b (0xe4f1 bytes) 000833 1790741566.258784 mapwrite 0x035079 thru 0x035de2 (0xd6a bytes) 000834 1790741566.360265 mapwrite 0x026207 thru 0x035b45 (0xf93f bytes) 000835 1790741566.429108 MIRROR_RESYNC 8 mirrors 000836 1790741570.052848 read 0x022e3f thru 0x02328c (0x44e bytes) 000839 1790741570.061232 read 0x00f0ba thru 0x01aca3 (0xbbea bytes) 000840 1790741570.073813 punch from 0x011b7c to 0x015d50 (0x41d5 bytes) 000841 1790741570.164786 mapread 0x013f8a thru 0x020d47 (0xcdbe bytes) 000844 1790741570.301113 mapwrite 0x035991 thru 0x03c2f9 (0x6969 bytes) 000847 1790741570.464038 trunc from 0x03c2fa to 0x02e4ee (0xde0b bytes) 000850 1790741570.494747 write 0x00b601 thru 0x00e27e (0x2c7e bytes) 000851 1790741570.510040 read 0x0079b7 thru 0x00d510 (0x5b5a bytes) 000852 1790741570.537235 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e4ef): Mirror 28: 0x8f52da64 (stale) Mirror 29: 0x8f52da64 (stale) Mirror 31: 0x8f52da64 (stale) Mirror 32: 0x8f52da64 (stale) Mirror 33: 0x8f52da64 (stale) Mirror 34: 0x8f52da64 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e4ef): Mirror 28: 0x8f52da64 (stale) Mirror 29: 0x8f52da64 (stale) Mirror 31: 0x8f52da64 (stale) Mirror 32: 0x8f52da64 (stale) Mirror 33: 0x8f52da64 (stale) Mirror 34: 0x8f52da64 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e4ef: skipped 000853 1790741571.104567 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2e4ef): Mirror 28: 0x8f52da64 (stale) Mirror 31: 0x8f52da64 (stale) Mirror 32: 0x8f52da64 (stale) Mirror 33: 0x8f52da64 (stale) Mirror 34: 0x8f52da64 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e4ef): Mirror 28: 0x8f52da64 (stale) Mirror 31: 0x8f52da64 (stale) Mirror 32: 0x8f52da64 (stale) Mirror 33: 0x8f52da64 (stale) Mirror 34: 0x8f52da64 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e4ef: skipped 000854 1790741571.491495 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2e4ef): Mirror 28: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2e4ef): Mirror 28: 0x8f52da64 (stale) Mirror 31: 0x8f52da64 (stale) Mirror 32: 0x8f52da64 (stale) Mirror 33: 0x8f52da64 (stale) Mirror 34: 0x8f52da64 (stale) CRC-32 checksum value for chunk [0, 0x2e4ef): Mirror 1: 0x924414f4 Mirror 35: 0x924414f4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2e4ef: skipped 000855 1790741573.004964 mapread 0x025d7a thru 0x029e8d (0x4114 bytes) 000856 1790741573.040480 mapread 0x000f03 thru 0x00a203 (0x9301 bytes) 000858 1790741573.073745 trunc from 0x02e4ef to 0x02861d (0x5ed1 bytes) 000861 1790741573.284789 write 0x014ef2 thru 0x01eafe (0x9c0d bytes) 000862 1790741573.303439 trunc from 0x02861e to 0x020303 (0x831a bytes) 000864 1790741573.332105 mapwrite 0x019e81 thru 0x0203e5 (0x6565 bytes) 000865 1790741573.456414 mapread 0x00d328 thru 0x01953a (0xc213 bytes) 000866 1790741573.470518 punch from 0x017058 to 0x01d8f6 (0x689f bytes) 000867 1790741573.475623 read 0x00c415 thru 0x00d9f1 (0x15dd bytes) 000868 1790741573.476737 mapwrite 0x035346 thru 0x03742a (0x20e5 bytes) 000869 1790741573.548120 mapwrite 0x0045f0 thru 0x006b16 (0x2527 bytes) 000870 1790741573.596273 write 0x03ab30 thru 0x03ffff (0x54d0 bytes) 000872 1790741573.597942 mapwrite 0x0091ae thru 0x012872 (0x96c5 bytes) 000873 1790741573.653047 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 28: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 28: 0x3384c8f9 (stale) Mirror 31: 0x3384c8f9 (stale) Mirror 32: 0x3384c8f9 (stale) Mirror 33: 0x3384c8f9 (stale) Mirror 34: 0x3384c8f9 (stale) Mirror 35: 0x6234fe03 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xdb8059b2 Mirror 36: 0xdb8059b2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000874 1790741575.268474 trunc from 0x040000 to 0x02bd93 (0x1426c bytes) 000875 1790741575.426667 punch from 0x0023a2 to 0x007e19 (0x5a78 bytes) 000876 1790741575.433795 trunc from 0x02bd94 to 0x00fcff (0x1c094 bytes) 000877 1790741575.476506 trunc from 0x00fd00 to 0x039638 (0x29939 bytes) 000880 1790741575.514170 trunc from 0x039639 to 0x0388ee (0xd4a bytes) 000884 1790741575.530752 mapread 0x035773 thru 0x0388ee (0x317c bytes) 000886 1790741575.563722 mapwrite 0x01a92b thru 0x020c6e (0x6344 bytes) 000887 1790741575.636473 write 0x026bca thru 0x02da6d (0x6ea4 bytes) 000888 1790741575.652362 read 0x036d8b thru 0x0388ee (0x1b64 bytes) 000889 1790741575.653223 mapread 0x016649 thru 0x024932 (0xe2ea bytes) 000891 1790741575.665710 mapread 0x035e58 thru 0x0388ee (0x2a97 bytes) 000892 1790741575.668560 mapwrite 0x031ca2 thru 0x03b51a (0x9879 bytes) 000895 1790741575.750524 mapwrite 0x01a0b3 thru 0x024a30 (0xa97e bytes) 000896 1790741575.794119 trunc from 0x03b51b to 0x012b48 (0x289d2 bytes) 000897 1790741575.810513 mapwrite 0x00ce52 thru 0x0107d1 (0x3980 bytes) 000898 1790741575.861507 punch from 0x0104b4 to 0x012b48 (0x2695 bytes) 000899 1790741575.865948 write 0x021560 thru 0x024248 (0x2ce9 bytes) 000900 1790741575.867171 trunc from 0x024249 to 0x01f47a (0x4dce bytes) 000901 1790741575.885464 trunc from 0x01f47b to 0x023ec8 (0x4a4e bytes) 000903 1790741575.905135 write 0x02ed6e thru 0x032853 (0x3ae6 bytes) 000904 1790741575.907346 read 0x012f2a thru 0x020f7b (0xe052 bytes) 000905 1790741575.926193 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x32854): Mirror 28: (stale - read error) Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32854): Mirror 28: 0xc5eb0490 (stale) Mirror 31: 0xc5eb0490 (stale) Mirror 32: 0xc5eb0490 (stale) Mirror 33: 0xc5eb0490 (stale) Mirror 34: 0xc5eb0490 (stale) Mirror 35: 0xbfb0e5c7 (stale) Mirror 36: 0x8a252e8f (stale) CRC-32 checksum value for chunk [0, 0x32854): Mirror 1: 0x30e7b709 Mirror 37: 0x30e7b709 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32854: skipped 000906 1790741577.283911 mapwrite 0x017f4d thru 0x01a7fd (0x28b1 bytes) 000908 1790741577.506370 mapread 0x0066d4 thru 0x00abc4 (0x44f1 bytes) 000909 1790741577.532255 punch from 0x024628 to 0x024b07 (0x4e0 bytes) 000910 1790741577.551608 write 0x03a921 thru 0x03ffff (0x56df bytes) 000911 1790741577.559515 mapwrite 0x03dd70 thru 0x03ffff (0x2290 bytes) 000912 1790741577.651930 mapread 0x0271b8 thru 0x02df9c (0x6de5 bytes) 000915 1790741577.667546 mapwrite 0x022f07 thru 0x028d02 (0x5dfc bytes) 000916 1790741577.792988 write 0x0377ac thru 0x03d1e4 (0x5a39 bytes) 000917 1790741577.801576 mapread 0x0388ef thru 0x03ffff (0x7711 bytes) 000919 1790741577.807962 mapwrite 0x00088b thru 0x00f9c8 (0xf13e bytes) 000920 1790741577.940339 write 0x00d7ec thru 0x01c6b1 (0xeec6 bytes) 000921 1790741577.942280 mapread 0x036a66 thru 0x03ffff (0x959a bytes) 000922 1790741577.960412 mapread 0x00eaca thru 0x016c3c (0x8173 bytes) 000923 1790741577.962828 write 0x010a13 thru 0x02079d (0xfd8b bytes) 000924 1790741577.967685 mapread 0x0370de thru 0x03847c (0x139f bytes) 000925 1790741577.970370 mapread 0x029caf thru 0x039355 (0xf6a7 bytes) 000927 1790741577.973809 trunc from 0x040000 to 0x0319a6 (0xe659 bytes) 000929 1790741578.027915 punch from 0x01e501 to 0x024324 (0x5e24 bytes) 000930 1790741578.057634 mapwrite 0x000e35 thru 0x008e0e (0x7fda bytes) 000931 1790741578.145130 punch from 0x00bdb1 to 0x01b16f (0xf3bf bytes) 000932 1790741578.157331 MIRROR_RESYNC 9 mirrors 000933 1790741582.520852 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) 000935 1790741583.107859 punch from 0x017700 to 0x01ada5 (0x36a6 bytes) 000937 1790741583.235071 read 0x009ac1 thru 0x00bc6c (0x21ac bytes) 000938 1790741583.241745 trunc from 0x0319a7 to 0x022e7e (0xeb28 bytes) 000939 1790741583.275835 read 0x01b1cd thru 0x01da4f (0x2883 bytes) 000940 1790741583.292453 write 0x006f1b thru 0x00dc39 (0x6d1f bytes) 000942 1790741583.297862 punch from 0x0211c3 to 0x022e7e (0x1cbc bytes) 000944 1790741583.314313 read 0x01bec6 thru 0x022e7e (0x6fb9 bytes) 000945 1790741583.321175 punch from 0x00fb59 to 0x01aebb (0xb363 bytes) 000946 1790741583.330118 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x22e7f): Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22e7f): Mirror 31: 0xeda4f92d (stale) Mirror 32: 0xeda4f92d (stale) Mirror 33: 0xeda4f92d (stale) Mirror 34: 0xeda4f92d (stale) Mirror 35: 0xeda4f92d (stale) Mirror 36: 0xeda4f92d (stale) Mirror 37: 0xeda4f92d (stale) CRC-32 checksum value for chunk [0, 0x22e7f): Mirror 1: 0x95a5b4bf Mirror 38: 0x95a5b4bf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22e7f: skipped 000949 1790741584.433078 punch from 0x003757 to 0x004e38 (0x16e2 bytes) 000950 1790741584.524962 punch from 0x0116a1 to 0x01742d (0x5d8d bytes) 000951 1790741584.533773 trunc from 0x022e7f to 0x010a59 (0x12425 bytes) 000954 1790741584.658218 trunc from 0x010a5a to 0x01ba04 (0xafab bytes) 000955 1790741584.681520 punch from 0x002d93 to 0x01067c (0xd8ea bytes) 000956 1790741584.692987 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x1ba05): Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) Mirror 38: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ba05): Mirror 31: 0x445ebcf6 (stale) Mirror 32: 0x445ebcf6 (stale) Mirror 33: 0x445ebcf6 (stale) Mirror 34: 0x445ebcf6 (stale) Mirror 35: 0x445ebcf6 (stale) Mirror 36: 0x445ebcf6 (stale) Mirror 37: 0x445ebcf6 (stale) Mirror 38: 0x1f38a885 (stale) CRC-32 checksum value for chunk [0, 0x1ba05): Mirror 1: 0xf220fb27 Mirror 39: 0xf220fb27 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ba05: skipped 000957 1790741585.575946 mapread 0x0174de thru 0x01ba04 (0x4527 bytes) 000959 1790741585.610950 write 0x02ce66 thru 0x03c33a (0xf4d5 bytes) 000960 1790741585.682879 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x3c33b): Mirror 31: (stale - read error) Mirror 32: (stale - read error) Mirror 33: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) Mirror 38: (stale - read error) Mirror 39: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c33b): Mirror 31: 0x2864f261 (stale) Mirror 32: 0x2864f261 (stale) Mirror 33: 0x2864f261 (stale) Mirror 34: 0x2864f261 (stale) Mirror 35: 0x2864f261 (stale) Mirror 36: 0x2864f261 (stale) Mirror 37: 0x2864f261 (stale) Mirror 38: 0xf1dafe56 (stale) Mirror 39: 0xf425fa2d (stale) CRC-32 checksum value for chunk [0, 0x3c33b): Mirror 1: 0x4f075a34 Mirror 40: 0x4f075a34 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c33b: skipped 000961 1790741586.665767 trunc from 0x03c33b to 0x02758c (0x14dae bytes) 000962 1790741586.812328 read 0x02702e thru 0x02758c (0x55f bytes) 000963 1790741586.822877 mapread 0x022c5b thru 0x02758c (0x4932 bytes) 000964 1790741586.852861 trunc from 0x02758d to 0x00dfdb (0x195b1 bytes) 000965 1790741586.885450 punch from 0x00a7e3 to 0x00b8a5 (0x10c3 bytes) 000967 1790741586.892839 read 0x00a945 thru 0x00dfdb (0x3697 bytes) 000969 1790741586.908701 MIRROR_SPLIT mirror 3 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xdfdc): Mirror 31: 0x5a99fd65 (stale) Mirror 32: 0x5a99fd65 (stale) Mirror 34: 0x5a99fd65 (stale) Mirror 35: 0x5a99fd65 (stale) Mirror 36: 0x5a99fd65 (stale) Mirror 37: 0x5a99fd65 (stale) Mirror 38: 0x6240c15 (stale) Mirror 39: 0x8d92fe77 (stale) Mirror 40: 0x8d92fe77 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xdfdc): Mirror 31: 0x5a99fd65 (stale) Mirror 32: 0x5a99fd65 (stale) Mirror 34: 0x5a99fd65 (stale) Mirror 35: 0x5a99fd65 (stale) Mirror 36: 0x5a99fd65 (stale) Mirror 37: 0x5a99fd65 (stale) Mirror 38: 0x6240c15 (stale) Mirror 39: 0x8d92fe77 (stale) Mirror 40: 0x8d92fe77 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xdfdc: skipped 000970 1790741587.574348 punch from 0x00b708 to 0x00cd8b (0x1684 bytes) 000971 1790741587.578835 trunc from 0x00dfdc to 0x01b039 (0xd05e bytes) 000975 1790741587.604299 MIRROR_SPLIT mirror 1 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x204:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b03a): Mirror 32: 0xe25ea727 (stale) Mirror 34: 0xe25ea727 (stale) Mirror 35: 0xe25ea727 (stale) Mirror 36: 0xe25ea727 (stale) Mirror 37: 0xe25ea727 (stale) Mirror 38: 0xc69e7da0 (stale) Mirror 39: 0x9d876463 (stale) Mirror 40: 0x9d876463 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b03a): Mirror 32: 0xe25ea727 (stale) Mirror 34: 0xe25ea727 (stale) Mirror 35: 0xe25ea727 (stale) Mirror 36: 0xe25ea727 (stale) Mirror 37: 0xe25ea727 (stale) Mirror 38: 0xc69e7da0 (stale) Mirror 39: 0x9d876463 (stale) Mirror 40: 0x9d876463 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b03a: skipped 000977 1790741588.265633 write 0x00878e thru 0x00b15b (0x29ce bytes) 000978 1790741588.278369 punch from 0x0073d7 to 0x010755 (0x937f bytes) 000979 1790741588.291694 mapwrite 0x02971b thru 0x035b08 (0xc3ee bytes) 000980 1790741588.468299 punch from 0x02f6b6 to 0x032a26 (0x3371 bytes) 000981 1790741588.483928 write 0x000276 thru 0x003a1b (0x37a6 bytes) 000982 1790741588.496816 write 0x021e9a thru 0x026c25 (0x4d8c bytes) 000984 1790741588.506740 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x35b09): Mirror 32: (stale - read error) Mirror 34: (stale - read error) Mirror 35: (stale - read error) Mirror 36: (stale - read error) Mirror 37: (stale - read error) Mirror 38: (stale - read error) Mirror 39: (stale - read error) Mirror 40: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35b09): Mirror 32: 0x6cebc846 (stale) Mirror 34: 0x6cebc846 (stale) Mirror 35: 0x6cebc846 (stale) Mirror 36: 0x6cebc846 (stale) Mirror 37: 0x6cebc846 (stale) Mirror 38: 0x8f502c (stale) Mirror 39: 0x247ed078 (stale) Mirror 40: 0x984e7ada (stale) CRC-32 checksum value for chunk [0, 0x35b09): Mirror 1: 0x674650 Mirror 41: 0x674650 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35b09: skipped 000985 1790741590.594520 mapwrite 0x0392fb thru 0x03ffff (0x6d05 bytes) 000988 1790741590.874187 MIRROR_RESYNC 10 mirrors 000989 1790741596.680682 read 0x01f63a thru 0x028016 (0x89dd bytes) 000991 1790741596.691781 mapwrite 0x00a061 thru 0x015697 (0xb637 bytes) 000992 1790741596.935756 mapwrite 0x00c431 thru 0x00ef4e (0x2b1e bytes) 000993 1790741596.991295 mapread 0x03a550 thru 0x03ffff (0x5ab0 bytes) 000995 1790741597.002737 write 0x022f3f thru 0x024f58 (0x201a bytes) 000997 1790741597.014969 write 0x01732d thru 0x026d06 (0xf9da bytes) 000998 1790741597.022914 read 0x01f72b thru 0x02dbf5 (0xe4cb bytes) 001000 1790741597.035277 write 0x00b106 thru 0x01698d (0xb888 bytes) All operations completed A-OK!