== sanity-flr test 70a: flr mode fsx test ================ 12:34:23 (1774888463) striped dir -i0 -c2 -H crush /mnt/lustre/d70a.sanity-flr Seed set to 8465 fallocating to largest ever: 0x10cf4 000001 1774888466.418001 fallocate 0x00b175 thru 0x010cf3 (0x5b7f bytes) truncating to largest ever: 0x28dd4 000002 1774888466.440937 trunc from 0x010cf4 to 0x028dd3 (0x180e0 bytes) 000003 1774888466.503597 MIRROR_EXTEND to 2 mirrors 000004 1774888467.336485 read 0x0195b1 thru 0x0239da (0xa42a bytes) 000005 1774888467.373666 fallocate 0x0192cf thru 0x025f6c (0xcc9e bytes) 000006 1774888467.510552 trunc from 0x012563 to 0x0210a2 (0xeb40 bytes) 000008 1774888467.527296 fallocate 0x005dad thru 0x013761 (0xd9b5 bytes) 000009 1774888467.537697 write 0x01df04 thru 0x02680e (0x890b bytes) 000010 1774888467.577130 trunc from 0x028dd4 to 0x01b3b4 (0xda1f bytes) 000011 1774888467.640541 mapwrite 0x00bdbf thru 0x0186db (0xc91d bytes) fallocating to largest ever: 0x35880 000012 1774888467.718391 fallocate 0x025942 thru 0x03587f (0xff3e bytes) 000013 1774888467.736493 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x35880): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35880): Mirror 2: 0x762ad934 (stale) CRC-32 checksum value for chunk [0, 0x35880): Mirror 1: 0x16e29b70 Mirror 3: 0x16e29b70 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35880: skipped 000015 1774888469.281465 mapwrite 0x0110e2 thru 0x01abaf (0x9ace bytes) 000016 1774888469.459373 trunc from 0x035880 to 0x010bc4 (0x24cbb bytes) 000017 1774888469.509517 read 0x006cf5 thru 0x010bc4 (0x9ed0 bytes) 000019 1774888469.531166 mapread 0x010736 thru 0x010bc4 (0x48f bytes) 000020 1774888469.533688 trunc from 0x00abe3 to 0x010bc4 (0x5fe2 bytes) 000021 1774888469.547380 mapread 0x002789 thru 0x008034 (0x58ac bytes) 000022 1774888469.585032 trunc from 0x0024c1 to 0x00b5b1 (0x90f1 bytes) 000023 1774888469.599348 write 0x01b8a0 thru 0x021cef (0x6450 bytes) 000024 1774888469.609378 trunc from 0x009f8c to 0x00b88c (0x1901 bytes) 000025 1774888469.641540 MIRROR_RESYNC 3 mirrors truncating to largest ever: 0x3f542 000027 1774888471.562483 trunc from 0x021cf0 to 0x03f541 (0x1d852 bytes) 000028 1774888471.640477 trunc from 0x03f542 to 0x021d50 (0x1d7f1 bytes) 000030 1774888471.693311 mapread 0x00a661 thru 0x018ba5 (0xe545 bytes) 000031 1774888471.770950 write 0x020e6a thru 0x025ed2 (0x5069 bytes) 000032 1774888471.791458 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x25ed3): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25ed3): Mirror 2: 0xfa1b7e97 (stale) Mirror 3: 0xfa1b7e97 (stale) CRC-32 checksum value for chunk [0, 0x25ed3): Mirror 1: 0x4928d186 Mirror 4: 0x4928d186 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25ed3: skipped 000033 1774888473.742863 trunc from 0x007073 to 0x0125c0 (0xb54e bytes) 000034 1774888473.813250 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x25ed3): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25ed3): Mirror 2: 0xfa1b7e97 (stale) Mirror 3: 0xfa1b7e97 (stale) Mirror 4: 0x4928d186 (stale) CRC-32 checksum value for chunk [0, 0x25ed3): Mirror 1: 0x4928d186 Mirror 5: 0x4928d186 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25ed3: skipped 000035 1774888474.746522 mapread 0x012aeb thru 0x01cb67 (0xa07d bytes) 000037 1774888474.813994 trunc from 0x01e816 to 0x025ed2 (0x76bd bytes) 000038 1774888474.851738 trunc from 0x00fc67 to 0x016d34 (0x70ce bytes) 000039 1774888474.865396 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x25ed3): Mirror 3: 0xfa1b7e97 (stale) Mirror 4: 0x4928d186 (stale) Mirror 5: 0x4928d186 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25ed3): Mirror 3: 0xfa1b7e97 (stale) Mirror 4: 0x4928d186 (stale) Mirror 5: 0x4928d186 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25ed3: skipped 000040 1774888475.187637 read 0x024a26 thru 0x025ed2 (0x14ad bytes) 000041 1774888475.193567 mapread 0x01d63d thru 0x022655 (0x5019 bytes) 000042 1774888475.216978 read 0x01f1f9 thru 0x025ed2 (0x6cda bytes) 000044 1774888475.218509 mapwrite 0x03c414 thru 0x03ffff (0x3bec bytes) 000046 1774888475.295015 fallocate 0x028aeb thru 0x02ed3b (0x6251 bytes) 000047 1774888475.302254 fallocate 0x0231ed thru 0x029872 (0x6686 bytes) 000048 1774888475.311634 trunc from 0x040000 to 0x029985 (0x1667a bytes) 000049 1774888475.342475 punch from 0x0063d6 to 0x00c6d4 (0x62ff bytes) 000050 1774888475.380588 trunc from 0x029986 to 0x02995f (0x26 bytes) 000051 1774888475.444085 mapread 0x027752 thru 0x0280dc (0x98b bytes) 000053 1774888475.454102 read 0x004d2a thru 0x00e565 (0x983c bytes) 000054 1774888475.478268 MIRROR_RESYNC 4 mirrors 000055 1774888477.205963 trunc from 0x01a9dc to 0x0294ac (0xead1 bytes) fallocating to largest ever: 0x40000 000056 1774888477.256827 fallocate 0x036023 thru 0x03ffff (0x9fdd bytes) 000057 1774888477.264609 trunc from 0x029960 to 0x011685 (0x182da bytes) 000058 1774888477.290326 trunc from 0x008d04 to 0x011685 (0x8982 bytes) 000059 1774888477.296889 trunc from 0x007037 to 0x00fca0 (0x8c6a bytes) 000060 1774888477.303200 write 0x013f94 thru 0x01f07c (0xb0e9 bytes) 000061 1774888477.305966 read 0x003406 thru 0x0084cf (0x50ca bytes) 000062 1774888477.318726 mapread 0x013ee6 thru 0x01a45e (0x6579 bytes) 000063 1774888477.326278 MIRROR_RESYNC 4 mirrors 000064 1774888478.298471 punch from 0x001363 to 0x006e75 (0x5b13 bytes) 000065 1774888478.355065 trunc from 0x0040e0 to 0x0118a0 (0xd7c1 bytes) 000066 1774888478.369791 write 0x01823a thru 0x02361a (0xb3e1 bytes) 000067 1774888478.378881 trunc from 0x02361b to 0x000072 (0x235a8 bytes) 000068 1774888478.444233 mapwrite 0x02e736 thru 0x036686 (0x7f51 bytes) 000069 1774888478.589835 read 0x008bc0 thru 0x01522d (0xc66e bytes) 000071 1774888478.613308 fallocate 0x00b6e9 thru 0x010ab8 (0x53d0 bytes) 000072 1774888478.619464 read 0x01399a thru 0x01ed63 (0xb3ca bytes) 000073 1774888478.636508 read 0x00ffbe thru 0x01792d (0x7970 bytes) 000074 1774888478.637358 mapwrite 0x01d087 thru 0x02b71c (0xe696 bytes) 000075 1774888478.703387 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x36687): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36687): Mirror 3: 0x2c07b159 (stale) Mirror 4: 0x2c07b159 (stale) Mirror 5: 0x2c07b159 (stale) CRC-32 checksum value for chunk [0, 0x36687): Mirror 1: 0x8193380d Mirror 6: 0x8193380d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36687: skipped 000076 1774888480.163436 punch from 0x01a244 to 0x01e976 (0x4733 bytes) 000077 1774888480.211120 read 0x002bb5 thru 0x003a89 (0xed5 bytes) 000078 1774888480.229299 punch from 0x030fb4 to 0x032196 (0x11e3 bytes) 000079 1774888480.246588 mapwrite 0x02626e thru 0x02aacc (0x485f bytes) 000080 1774888480.299874 punch from 0x0199b8 to 0x01d4d1 (0x3b1a bytes) 000081 1774888480.306279 mapwrite 0x02ac33 thru 0x033796 (0x8b64 bytes) 000082 1774888480.345124 fallocate 0x034ce2 thru 0x03db99 (0x8eb8 bytes) 000083 1774888480.353986 trunc from 0x03db9a to 0x00477b (0x3941e bytes) 000084 1774888480.390316 read 0x0037d6 thru 0x00477b (0xfa6 bytes) 000085 1774888480.400494 punch from 0x0008a2 to 0x00477b (0x3eda bytes) 000086 1774888480.404848 mapread 0x00176c thru 0x00477b (0x3010 bytes) 000087 1774888480.430677 trunc from 0x00477c to 0x00f890 (0xb115 bytes) 000088 1774888480.452069 trunc from 0x0010d7 to 0x00b9bf (0xa8e9 bytes) 000089 1774888480.460287 trunc from 0x00f891 to 0x02bf55 (0x1c6c5 bytes) 000090 1774888480.485476 fallocate 0x023df2 thru 0x0329f9 (0xec08 bytes) 000091 1774888480.502087 mapread 0x0006cb thru 0x008be9 (0x851f bytes) 000092 1774888480.559597 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x329fa): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x329fa): Mirror 3: 0x7e6a7e19 (stale) Mirror 4: 0x7e6a7e19 (stale) Mirror 5: 0x7e6a7e19 (stale) Mirror 6: 0x8e73cc09 (stale) CRC-32 checksum value for chunk [0, 0x329fa): Mirror 1: 0x9dfbef61 Mirror 7: 0x9dfbef61 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x329fa: skipped 000093 1774888481.511735 write 0x03aa3c thru 0x03ffff (0x55c4 bytes) 000094 1774888481.573893 mapread 0x0144ee thru 0x0178ff (0x3412 bytes) 000095 1774888481.598463 punch from 0x005bea to 0x01288b (0xcca2 bytes) 000096 1774888481.604779 fallocate 0x03474a thru 0x0387bd (0x4074 bytes) 000097 1774888481.611387 punch from 0x03b996 to 0x03ffff (0x466a bytes) 000098 1774888481.634591 fallocate 0x03824b thru 0x03ffff (0x7db5 bytes) 000099 1774888481.676470 MIRROR_SPLIT mirror 3 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x7c9cc92d (stale) Mirror 4: 0x7c9cc92d (stale) Mirror 6: 0x31e07cd (stale) Mirror 7: 0xe20eea22 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x7c9cc92d (stale) Mirror 4: 0x7c9cc92d (stale) Mirror 6: 0x31e07cd (stale) Mirror 7: 0xe20eea22 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000101 1774888482.086263 mapread 0x03df61 thru 0x03ffff (0x209f bytes) 000102 1774888482.098813 mapwrite 0x00c8e1 thru 0x01aba3 (0xe2c3 bytes) 000104 1774888482.145855 punch from 0x007960 to 0x010c93 (0x9334 bytes) 000105 1774888482.150707 punch from 0x03520c to 0x03a2b5 (0x50aa bytes) 000107 1774888482.155754 read 0x03f4c7 thru 0x03ffff (0xb39 bytes) 000109 1774888482.157281 trunc from 0x0087c5 to 0x009a28 (0x1264 bytes) 000110 1774888482.162129 trunc from 0x040000 to 0x010964 (0x2f69b bytes) 000111 1774888482.204394 mapwrite 0x035ddd thru 0x03d03c (0x7260 bytes) 000112 1774888482.246881 trunc from 0x00d8c3 to 0x017f3e (0xa67c bytes) 000113 1774888482.251365 punch from 0x028a18 to 0x02c840 (0x3e29 bytes) 000114 1774888482.261410 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3d03d): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d03d): Mirror 3: 0x6a9a48de (stale) Mirror 4: 0x6a9a48de (stale) Mirror 6: 0x4bc34200 (stale) Mirror 7: 0x8bb1ff72 (stale) CRC-32 checksum value for chunk [0, 0x3d03d): Mirror 1: 0x5d7e858a Mirror 8: 0x5d7e858a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d03d: skipped 000115 1774888483.456322 mapread 0x037edd thru 0x03885e (0x982 bytes) 000116 1774888483.488111 read 0x023f84 thru 0x030388 (0xc405 bytes) 000117 1774888483.502044 trunc from 0x032857 to 0x03bafa (0x92a4 bytes) 000118 1774888483.537216 trunc from 0x03d03d to 0x01311f (0x29f1d bytes) 000119 1774888483.653267 trunc from 0x013120 to 0x0329c2 (0x1f8a3 bytes) 000120 1774888483.687169 read 0x0261ce thru 0x0277e7 (0x161a bytes) 000121 1774888483.705396 MIRROR_SPLIT mirror 2 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x329c3): Mirror 3: 0xd50c145b (stale) Mirror 6: 0xd4a9b428 (stale) Mirror 7: 0x13efb391 (stale) Mirror 8: 0x13efb391 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x329c3): Mirror 3: 0xd50c145b (stale) Mirror 6: 0xd4a9b428 (stale) Mirror 7: 0x13efb391 (stale) Mirror 8: 0x13efb391 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x329c3: skipped 000122 1774888484.379583 trunc from 0x0329c3 to 0x0223a4 (0x1061e bytes) 000123 1774888484.413185 punch from 0x006a37 to 0x014ec4 (0xe48e bytes) 000124 1774888484.418583 write 0x0118a6 thru 0x01e5b1 (0xcd0c bytes) 000125 1774888484.430201 mapwrite 0x00c333 thru 0x0133d5 (0x70a3 bytes) 000126 1774888484.465581 trunc from 0x0223a5 to 0x007c22 (0x1a782 bytes) 000127 1774888484.490856 write 0x00cd14 thru 0x01bbb7 (0xeea4 bytes) 000128 1774888484.496861 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x1bbb8): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1bbb8): Mirror 3: 0xd164b2de (stale) Mirror 6: 0x4f93f6dc (stale) Mirror 7: 0x4f93f6dc (stale) Mirror 8: 0x4f93f6dc (stale) CRC-32 checksum value for chunk [0, 0x1bbb8): Mirror 1: 0xc63b5ce7 Mirror 9: 0xc63b5ce7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1bbb8: skipped 000129 1774888485.333112 trunc from 0x00bd7a to 0x01b5d5 (0xf85c bytes) 000131 1774888485.359834 trunc from 0x003f28 to 0x00e623 (0xa6fc bytes) 000132 1774888485.364499 mapwrite 0x011d25 thru 0x015ac8 (0x3da4 bytes) 000133 1774888485.406588 write 0x005cab thru 0x013e3b (0xe191 bytes) 000134 1774888485.425614 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x1bbb8): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1bbb8): Mirror 3: 0xd164b2de (stale) Mirror 6: 0x4f93f6dc (stale) Mirror 7: 0x4f93f6dc (stale) Mirror 8: 0x4f93f6dc (stale) Mirror 9: 0xc63b5ce7 (stale) CRC-32 checksum value for chunk [0, 0x1bbb8): Mirror 1: 0xb34d5d60 Mirror 10: 0xb34d5d60 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1bbb8: skipped 000135 1774888486.357616 trunc from 0x011c07 to 0x019129 (0x7523 bytes) 000136 1774888486.397209 trunc from 0x01062f to 0x016103 (0x5ad5 bytes) 000137 1774888486.402640 punch from 0x00edac to 0x01bbb7 (0xce0c bytes) 000138 1774888486.407081 mapread 0x016560 thru 0x01bbb7 (0x5658 bytes) 000139 1774888486.426451 trunc from 0x00502a to 0x00537f (0x356 bytes) 000140 1774888486.434734 trunc from 0x00e13c to 0x019cc0 (0xbb85 bytes) 000141 1774888486.439117 mapwrite 0x01988c thru 0x01f1f7 (0x596c bytes) 000142 1774888486.509900 punch from 0x00b3c6 to 0x0176e5 (0xc320 bytes) 000143 1774888486.517939 mapwrite 0x00d710 thru 0x0147fd (0x70ee bytes) 000144 1774888486.571812 read 0x0076b2 thru 0x0137f2 (0xc141 bytes) 000145 1774888486.572395 read 0x008bef thru 0x009ef8 (0x130a bytes) 000147 1774888486.577376 MIRROR_SPLIT mirror 4 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1f1f8): Mirror 3: 0x5def6224 (stale) Mirror 6: 0x7a56271e (stale) Mirror 7: 0x9a72194 (stale) Mirror 9: 0xcd93485e (stale) Mirror 10: 0x351922bb (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f1f8): Mirror 3: 0x5def6224 (stale) Mirror 6: 0x7a56271e (stale) Mirror 7: 0x9a72194 (stale) Mirror 9: 0xcd93485e (stale) Mirror 10: 0x351922bb (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f1f8: skipped 000148 1774888486.951703 trunc from 0x008a1e to 0x00e123 (0x5706 bytes) 000149 1774888486.962989 trunc from 0x0015e5 to 0x004b27 (0x3543 bytes) 000151 1774888486.972910 fallocate 0x02fdc4 thru 0x032560 (0x279d bytes) 000152 1774888486.984026 mapread 0x00df07 thru 0x019340 (0xb43a bytes) 000153 1774888487.084001 trunc from 0x01f1f8 to 0x02f860 (0x10669 bytes) 000154 1774888487.138182 trunc from 0x02f861 to 0x00b6de (0x24182 bytes) 000155 1774888487.184864 mapread 0x009270 thru 0x009470 (0x201 bytes) 000156 1774888487.186389 write 0x03839f thru 0x03ffff (0x7c61 bytes) 000157 1774888487.189745 trunc from 0x0338af to 0x035981 (0x20d3 bytes) 000158 1774888487.195599 punch from 0x02e019 to 0x03a60f (0xc5f7 bytes) 000159 1774888487.218732 mapwrite 0x020f68 thru 0x0284c9 (0x7562 bytes) 000160 1774888487.259065 fallocate 0x034d63 thru 0x0372be (0x255c bytes) 000161 1774888487.266575 mapwrite 0x01308d thru 0x01c133 (0x90a7 bytes) 000162 1774888487.324448 trunc from 0x035661 to 0x03586b (0x20b bytes) 000163 1774888487.337533 write 0x01e4f8 thru 0x021cef (0x37f8 bytes) 000165 1774888487.339967 trunc from 0x040000 to 0x01df77 (0x22088 bytes) 000166 1774888487.373892 read 0x01c22a thru 0x01df77 (0x1d4e bytes) 000167 1774888487.376696 punch from 0x00d7af to 0x01b804 (0xe056 bytes) 000168 1774888487.387945 punch from 0x019f99 to 0x01df77 (0x3fdf bytes) 000169 1774888487.393763 mapread 0x00b2a4 thru 0x0109be (0x571b bytes) 000170 1774888487.402562 write 0x0300b0 thru 0x0380d0 (0x8021 bytes) 000171 1774888487.406039 mapread 0x01841a thru 0x020594 (0x817b bytes) 000172 1774888487.420043 mapread 0x016e8e thru 0x01fdc5 (0x8f38 bytes) 000173 1774888487.421517 read 0x01cb48 thru 0x01d38f (0x848 bytes) 000174 1774888487.422227 trunc from 0x004766 to 0x0065e3 (0x1e7e bytes) 000175 1774888487.426417 write 0x0042d0 thru 0x00a30b (0x603c bytes) 000176 1774888487.434241 trunc from 0x000cf5 to 0x003a25 (0x2d31 bytes) 000177 1774888487.439288 write 0x01dc4e thru 0x0246e4 (0x6a97 bytes) 000178 1774888487.441053 write 0x021291 thru 0x02f9e2 (0xe752 bytes) 000179 1774888487.442428 mapread 0x0095ec thru 0x00f0b3 (0x5ac8 bytes) 000180 1774888487.443625 write 0x03105e thru 0x031869 (0x80c bytes) 000181 1774888487.444445 trunc from 0x029069 to 0x03261b (0x95b3 bytes) 000183 1774888487.457220 read 0x00a5ff thru 0x0101b7 (0x5bb9 bytes) 000184 1774888487.470208 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x380d1): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x380d1): Mirror 3: 0x2f273b7 (stale) Mirror 6: 0x8e4db708 (stale) Mirror 7: 0x3a8327fd (stale) Mirror 9: 0x1d3c9391 (stale) Mirror 10: 0x2860dffe (stale) CRC-32 checksum value for chunk [0, 0x380d1): Mirror 1: 0x32f6fc13 Mirror 11: 0x32f6fc13 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x380d1: skipped 000185 1774888488.285833 write 0x01497f thru 0x017f9b (0x361d bytes) 000186 1774888488.352041 mapwrite 0x024ad9 thru 0x02f4bf (0xa9e7 bytes) 000187 1774888488.430597 trunc from 0x0380d1 to 0x00ac33 (0x2d49d bytes) 000188 1774888488.469874 fallocate 0x00d43f thru 0x014531 (0x70f3 bytes) 000189 1774888488.473918 write 0x004e51 thru 0x00f86b (0xaa1b bytes) 000190 1774888488.490772 trunc from 0x006c26 to 0x00783a (0xc15 bytes) 000191 1774888488.534096 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x14532): Mirror 3: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14532): Mirror 3: 0xdb8ab0a4 (stale) Mirror 6: 0x298bd9e3 (stale) Mirror 7: 0x298bd9e3 (stale) Mirror 9: 0x808c4625 (stale) Mirror 10: 0x76bab38d (stale) Mirror 11: 0x2b45e5da (stale) CRC-32 checksum value for chunk [0, 0x14532): Mirror 1: 0x5da4a41b Mirror 12: 0x5da4a41b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14532: skipped 000192 1774888490.034726 mapwrite 0x017784 thru 0x022988 (0xb205 bytes) 000193 1774888490.217024 read 0x00e18c thru 0x01a14f (0xbfc4 bytes) 000194 1774888490.250290 write 0x0244dd thru 0x02ae99 (0x69bd bytes) 000195 1774888490.255117 trunc from 0x0257a0 to 0x02ae99 (0x56fa bytes) 000197 1774888490.291557 mapwrite 0x01a0eb thru 0x01dc22 (0x3b38 bytes) 000198 1774888490.328719 write 0x013741 thru 0x01f8e5 (0xc1a5 bytes) 000200 1774888490.345772 MIRROR_RESYNC 8 mirrors 000201 1774888493.471930 write 0x038ec3 thru 0x03c28a (0x33c8 bytes) 000202 1774888493.547438 mapwrite 0x015296 thru 0x020399 (0xb104 bytes) 000203 1774888493.645062 fallocate 0x01fc83 thru 0x027def (0x816d bytes) 000204 1774888493.681014 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c28b): Mirror 6: 0xc9238d86 (stale) Mirror 7: 0xc9238d86 (stale) Mirror 9: 0xc9238d86 (stale) Mirror 10: 0xc9238d86 (stale) Mirror 11: 0xc9238d86 (stale) Mirror 12: 0xc9238d86 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c28b): Mirror 6: 0xc9238d86 (stale) Mirror 7: 0xc9238d86 (stale) Mirror 9: 0xc9238d86 (stale) Mirror 10: 0xc9238d86 (stale) Mirror 11: 0xc9238d86 (stale) Mirror 12: 0xc9238d86 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c28b: skipped 000205 1774888494.796758 mapwrite 0x02d99a thru 0x0356da (0x7d41 bytes) 000206 1774888494.917279 mapwrite 0x02c122 thru 0x030fc3 (0x4ea2 bytes) 000207 1774888494.943247 trunc from 0x03c28b to 0x01b456 (0x20e34 bytes) 000208 1774888494.987115 punch from 0x007f6c to 0x010847 (0x88dc bytes) 000209 1774888495.001326 trunc from 0x00756a to 0x0095f1 (0x2088 bytes) 000210 1774888495.016316 fallocate 0x01670f thru 0x023ded (0xd6df bytes) 000211 1774888495.024802 read 0x00cbcc thru 0x00d3e1 (0x816 bytes) 000212 1774888495.041461 fallocate 0x014180 thru 0x01bcb1 (0x7b32 bytes) 000213 1774888495.062201 MIRROR_RESYNC 7 mirrors 000214 1774888497.948525 trunc from 0x023dee to 0x014430 (0xf9bd bytes) 000215 1774888498.002092 read 0x013862 thru 0x014430 (0xbcf bytes) 000216 1774888498.017735 mapread 0x00458d thru 0x005ee4 (0x1958 bytes) 000217 1774888498.029504 trunc from 0x014431 to 0x036f69 (0x22b39 bytes) 000218 1774888498.051672 mapwrite 0x00ee92 thru 0x011c00 (0x2d6f bytes) 000219 1774888498.078895 mapread 0x02bb1f thru 0x02bbdc (0xbe bytes) 000220 1774888498.091765 fallocate 0x005b46 thru 0x008017 (0x24d2 bytes) 000221 1774888498.098638 mapread 0x028043 thru 0x02cf29 (0x4ee7 bytes) 000222 1774888498.100099 write 0x01a861 thru 0x024840 (0x9fe0 bytes) 000223 1774888498.112041 write 0x02992b thru 0x02a6a2 (0xd78 bytes) 000225 1774888498.115033 read 0x018d20 thru 0x01c1c7 (0x34a8 bytes) 000226 1774888498.121263 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36f6a): Mirror 7: 0x402afad0 (stale) Mirror 9: 0x402afad0 (stale) Mirror 10: 0x402afad0 (stale) Mirror 11: 0x402afad0 (stale) Mirror 12: 0x402afad0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36f6a): Mirror 7: 0x402afad0 (stale) Mirror 9: 0x402afad0 (stale) Mirror 10: 0x402afad0 (stale) Mirror 11: 0x402afad0 (stale) Mirror 12: 0x402afad0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36f6a: skipped 000227 1774888498.731121 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x36f6a): Mirror 7: 0x402afad0 (stale) Mirror 9: 0x402afad0 (stale) Mirror 10: 0x402afad0 (stale) Mirror 12: 0x402afad0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36f6a): Mirror 7: 0x402afad0 (stale) Mirror 9: 0x402afad0 (stale) Mirror 10: 0x402afad0 (stale) Mirror 12: 0x402afad0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36f6a: skipped 000228 1774888499.213928 trunc from 0x00f805 to 0x012b85 (0x3381 bytes) 000229 1774888499.221864 mapread 0x022268 thru 0x02d73b (0xb4d4 bytes) 000231 1774888499.253519 mapwrite 0x006fdc thru 0x015346 (0xe36b bytes) 000233 1774888499.301748 mapwrite 0x02f3ae thru 0x037792 (0x83e5 bytes) 000234 1774888499.358546 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37793): Mirror 7: 0x26c0e358 (stale) Mirror 9: 0x26c0e358 (stale) Mirror 10: 0x26c0e358 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37793): Mirror 7: 0x26c0e358 (stale) Mirror 9: 0x26c0e358 (stale) Mirror 10: 0x26c0e358 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37793: skipped 000235 1774888500.013067 fallocate 0x01691d thru 0x01bda6 (0x548a bytes) 000236 1774888500.020454 trunc from 0x02df72 to 0x037792 (0x9821 bytes) 000238 1774888500.044121 fallocate 0x01575f thru 0x01ccc7 (0x7569 bytes) 000240 1774888500.059370 read 0x029f97 thru 0x03632d (0xc397 bytes) 000241 1774888500.096089 write 0x021d88 thru 0x027b65 (0x5dde bytes) 000242 1774888500.138208 fallocate 0x02b712 thru 0x035875 (0xa164 bytes) 000243 1774888500.160323 punch from 0x027713 to 0x0353e9 (0xdcd7 bytes) 000244 1774888500.199217 fallocate 0x0353ca thru 0x03ffff (0xac36 bytes) 000245 1774888500.209024 mapwrite 0x006759 thru 0x00e288 (0x7b30 bytes) 000246 1774888500.321603 mapwrite 0x01222a thru 0x01d743 (0xb51a bytes) 000247 1774888500.430376 punch from 0x003884 to 0x00e9f5 (0xb172 bytes) 000248 1774888500.440837 fallocate 0x02409a thru 0x02ba14 (0x797b bytes) 000249 1774888500.448356 fallocate 0x00d918 thru 0x01c8d8 (0xefc1 bytes) 000250 1774888500.462403 punch from 0x02dd20 to 0x0372d9 (0x95ba bytes) 000251 1774888500.489910 write 0x016a89 thru 0x018c70 (0x21e8 bytes) 000252 1774888500.491105 trunc from 0x040000 to 0x036bf9 (0x9406 bytes) 000253 1774888500.511062 fallocate 0x03ca6e thru 0x03dc63 (0x11f6 bytes) 000254 1774888500.522360 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x36bfa): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36bfa): Mirror 7: 0xe6a1fa95 (stale) Mirror 9: 0xe6a1fa95 (stale) Mirror 10: 0xe6a1fa95 (stale) CRC-32 checksum value for chunk [0, 0x36bfa): Mirror 1: 0xddbcb076 Mirror 11: 0xddbcb076 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36bfa: skipped 000255 1774888501.454873 read 0x02ba97 thru 0x036bf9 (0xb163 bytes) 000256 1774888501.483484 fallocate 0x03461c thru 0x03d0c6 (0x8aab bytes) 000257 1774888501.529824 read 0x0068e2 thru 0x010e7c (0xa59b bytes) 000259 1774888501.547417 read 0x00271d thru 0x00a47e (0x7d62 bytes) 000261 1774888501.551360 mapwrite 0x0270b9 thru 0x0287e6 (0x172e bytes) 000262 1774888501.565835 trunc from 0x036bfa to 0x00c913 (0x2a2e6 bytes) 000263 1774888501.623173 fallocate 0x03eac1 thru 0x03ffff (0x153f bytes) 000265 1774888501.635688 mapread 0x03a2e4 thru 0x03ffff (0x5d1c bytes) 000266 1774888501.676375 mapread 0x0309fd thru 0x03f224 (0xe828 bytes) 000267 1774888501.677795 trunc from 0x040000 to 0x003dcf (0x3c230 bytes) 000268 1774888501.732651 mapwrite 0x00f043 thru 0x011c55 (0x2c13 bytes) 000269 1774888501.846959 trunc from 0x003a05 to 0x011b8b (0xe187 bytes) 000271 1774888501.854891 mapwrite 0x00502f thru 0x00d284 (0x8256 bytes) 000272 1774888501.991400 trunc from 0x008a74 to 0x00fae6 (0x7073 bytes) 000273 1774888502.009714 punch from 0x00f2e3 to 0x0119cf (0x26ed bytes) 000274 1774888502.021878 write 0x01d16e thru 0x025dc9 (0x8c5c bytes) 000275 1774888502.029113 punch from 0x00663a to 0x00b86c (0x5233 bytes) 000277 1774888502.051883 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x25dca): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x25dca): Mirror 7: 0x2c3c308 (stale) Mirror 9: 0x2c3c308 (stale) Mirror 10: 0x2c3c308 (stale) Mirror 11: 0xcc4ac726 (stale) CRC-32 checksum value for chunk [0, 0x25dca): Mirror 1: 0x76a320a4 Mirror 12: 0x76a320a4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x25dca: skipped 000278 1774888503.419047 fallocate 0x020602 thru 0x028963 (0x8362 bytes) 000279 1774888503.468302 mapwrite 0x01c47f thru 0x027d78 (0xb8fa bytes) 000280 1774888503.562653 read 0x01d8fe thru 0x0278fb (0x9ffe bytes) 000282 1774888503.564701 fallocate 0x005006 thru 0x00f280 (0xa27b bytes) 000283 1774888503.581298 MIRROR_SPLIT mirror 5 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27d79): Mirror 7: 0x5f7406e6 (stale) Mirror 9: 0x5f7406e6 (stale) Mirror 10: 0x5f7406e6 (stale) Mirror 11: 0xa313d6db (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27d79): Mirror 7: 0x5f7406e6 (stale) Mirror 9: 0x5f7406e6 (stale) Mirror 10: 0x5f7406e6 (stale) Mirror 11: 0xa313d6db (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27d79: skipped 000284 1774888504.060018 write 0x00c86b thru 0x016ff4 (0xa78a bytes) 000285 1774888504.080588 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x27d79): Mirror 7: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27d79): Mirror 7: 0x5f7406e6 (stale) Mirror 9: 0x5f7406e6 (stale) Mirror 10: 0x5f7406e6 (stale) Mirror 11: 0xa313d6db (stale) CRC-32 checksum value for chunk [0, 0x27d79): Mirror 1: 0xec8e3573 Mirror 12: 0xec8e3573 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27d79: skipped 000286 1774888505.213581 trunc from 0x027d79 to 0x0372e3 (0xf56b bytes) 000287 1774888505.263273 fallocate 0x026c8d thru 0x0308ed (0x9c61 bytes) 000288 1774888505.268089 write 0x03fc5a thru 0x03ffff (0x3a6 bytes) 000290 1774888505.270090 mapwrite 0x019883 thru 0x0235f8 (0x9d76 bytes) 000291 1774888505.307187 write 0x010a30 thru 0x01a43d (0x9a0e bytes) 000292 1774888505.316744 read 0x03eec4 thru 0x03ffff (0x113c bytes) 000293 1774888505.323343 trunc from 0x0254bd to 0x0337e4 (0xe328 bytes) 000294 1774888505.328780 mapwrite 0x017a31 thru 0x020c05 (0x91d5 bytes) 000295 1774888505.357595 mapwrite 0x0379b2 thru 0x03cde4 (0x5433 bytes) 000296 1774888505.396424 read 0x0112d7 thru 0x01c00a (0xad34 bytes) 000297 1774888505.398227 trunc from 0x040000 to 0x0187f5 (0x2780a bytes) 000299 1774888505.429408 read 0x00d813 thru 0x011393 (0x3b81 bytes) 000300 1774888505.430258 fallocate 0x009848 thru 0x017de1 (0xe59a bytes) 000301 1774888505.438419 read 0x006890 thru 0x015e0f (0xf580 bytes) 000302 1774888505.449745 mapread 0x00f7a9 thru 0x0187f5 (0x904d bytes) 000303 1774888505.452861 trunc from 0x011e78 to 0x016ed2 (0x505b bytes) 000304 1774888505.462351 trunc from 0x0187f6 to 0x020d33 (0x853e bytes) 000305 1774888505.495403 trunc from 0x020d34 to 0x03899c (0x17c69 bytes) 000306 1774888505.519315 mapread 0x0088c5 thru 0x017630 (0xed6c bytes) 000307 1774888505.574654 punch from 0x00eeee to 0x0199e4 (0xaaf7 bytes) 000308 1774888505.580691 trunc from 0x02d000 to 0x02f43d (0x243e bytes) 000309 1774888505.597410 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3899d): Mirror 9: 0x47922c29 (stale) Mirror 10: 0x47922c29 (stale) Mirror 11: 0x709d8fc7 (stale) Mirror 12: 0xb3f270d6 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3899d): Mirror 9: 0x47922c29 (stale) Mirror 10: 0x47922c29 (stale) Mirror 11: 0x709d8fc7 (stale) Mirror 12: 0xb3f270d6 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3899d: skipped 000310 1774888506.110065 trunc from 0x026435 to 0x0315a1 (0xb16d bytes) 000311 1774888506.116436 write 0x000fa2 thru 0x007ef2 (0x6f51 bytes) 000312 1774888506.134458 mapread 0x031c4a thru 0x03899c (0x6d53 bytes) 000313 1774888506.167526 trunc from 0x03899d to 0x0129c9 (0x25fd3 bytes) 000314 1774888506.194016 mapread 0x008a04 thru 0x0129c9 (0x9fc6 bytes) 000316 1774888506.221048 mapwrite 0x029207 thru 0x036349 (0xd143 bytes) 000317 1774888506.304174 trunc from 0x03634a to 0x01dbb2 (0x18797 bytes) 000318 1774888506.332919 fallocate 0x035c4a thru 0x037153 (0x150a bytes) 000319 1774888506.347234 mapread 0x0204e7 thru 0x02bd8a (0xb8a4 bytes) 000320 1774888506.383773 trunc from 0x037154 to 0x02c770 (0xa9e3 bytes) 000321 1774888506.438050 fallocate 0x0124a5 thru 0x01baf5 (0x9651 bytes) 000322 1774888506.452961 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c771): Mirror 9: 0x105bef2d (stale) Mirror 10: 0x105bef2d (stale) Mirror 11: 0x5b13696c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c771): Mirror 9: 0x105bef2d (stale) Mirror 10: 0x105bef2d (stale) Mirror 11: 0x5b13696c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c771: skipped 000323 1774888506.972974 read 0x011aa4 thru 0x02176e (0xfccb bytes) 000325 1774888506.988422 read 0x0008a7 thru 0x00c6ce (0xbe28 bytes) 000326 1774888507.007002 read 0x02856b thru 0x02a36b (0x1e01 bytes) 000327 1774888507.009255 mapread 0x02a9c2 thru 0x02c770 (0x1daf bytes) 000328 1774888507.014912 mapread 0x01d069 thru 0x02441d (0x73b5 bytes) 000329 1774888507.019817 trunc from 0x02bbe6 to 0x02c770 (0xb8b bytes) 000330 1774888507.043391 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c771): Mirror 10: 0x105bef2d (stale) Mirror 11: 0x5b13696c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c771): Mirror 10: 0x105bef2d (stale) Mirror 11: 0x5b13696c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c771: skipped 000331 1774888507.372536 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c771): Mirror 10: 0x105bef2d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c771): Mirror 10: 0x105bef2d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c771: skipped 000333 1774888507.661988 write 0x007094 thru 0x011ba9 (0xab16 bytes) 000334 1774888507.686250 trunc from 0x02c771 to 0x018a85 (0x13ceb bytes) 000336 1774888507.710718 fallocate 0x0130d7 thru 0x0179c4 (0x48ee bytes) 000337 1774888507.717678 fallocate 0x01c299 thru 0x0269a2 (0xa70a bytes) 000338 1774888507.722349 mapwrite 0x03dfd2 thru 0x03ffff (0x202e bytes) 000339 1774888507.767912 mapwrite 0x03752f thru 0x03d2a0 (0x5d72 bytes) 000340 1774888507.786744 read 0x02a599 thru 0x02b4e2 (0xf4a bytes) 000342 1774888507.793555 write 0x01611c thru 0x0189b6 (0x289b bytes) 000343 1774888507.809298 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) 000344 1774888507.956868 trunc from 0x00fece to 0x01c28b (0xc3be bytes) 000346 1774888507.962669 punch from 0x032d1f to 0x036427 (0x3709 bytes) 000347 1774888507.968817 trunc from 0x040000 to 0x014a29 (0x2b5d6 bytes) 000348 1774888507.988959 mapwrite 0x00b1c1 thru 0x00cd36 (0x1b76 bytes) 000349 1774888508.016548 punch from 0x008f0d to 0x00f4ce (0x65c2 bytes) 000350 1774888508.022615 mapwrite 0x035bb9 thru 0x03ffff (0xa447 bytes) 000351 1774888508.078823 trunc from 0x040000 to 0x00f654 (0x309ab bytes) 000352 1774888508.104966 write 0x02d7fb thru 0x02f0eb (0x18f1 bytes) 000353 1774888508.106172 mapread 0x00ebf2 thru 0x01daac (0xeebb bytes) 000354 1774888508.126883 trunc from 0x02f0ec to 0x02f1fc (0x111 bytes) 000355 1774888508.146324 read 0x002f51 thru 0x011340 (0xe3f0 bytes) 000356 1774888508.157642 trunc from 0x02f1fd to 0x03bd46 (0xcb4a bytes) 000358 1774888508.172703 mapread 0x034152 thru 0x037fb5 (0x3e64 bytes) 000359 1774888508.183667 fallocate 0x011b57 thru 0x017587 (0x5a31 bytes) 000360 1774888508.189029 trunc from 0x024491 to 0x02b104 (0x6c74 bytes) 000361 1774888508.197049 mapwrite 0x0062bb thru 0x00bdb6 (0x5afc bytes) 000362 1774888508.232815 write 0x015973 thru 0x018aa5 (0x3133 bytes) 000363 1774888508.234183 mapwrite 0x02da8a thru 0x03b78d (0xdd04 bytes) 000365 1774888508.271519 punch from 0x0083e9 to 0x00ca81 (0x4699 bytes) 000366 1774888508.276853 read 0x02b70f thru 0x03338a (0x7c7c bytes) 000367 1774888508.286641 punch from 0x03615c to 0x03bd46 (0x5beb bytes) 000368 1774888508.295030 read 0x0008fe thru 0x00da9b (0xd19e bytes) 000369 1774888508.296796 read 0x00ab9d thru 0x0192ec (0xe750 bytes) 000370 1774888508.297909 read 0x006274 thru 0x008d95 (0x2b22 bytes) 000372 1774888508.300976 mapwrite 0x004807 thru 0x012622 (0xde1c bytes) 000373 1774888508.329916 trunc from 0x03bd47 to 0x00d53f (0x2e807 bytes) 000374 1774888508.342803 punch from 0x006840 to 0x00c39e (0x5b5f bytes) 000376 1774888508.347928 punch from 0x008167 to 0x00d53f (0x53d9 bytes) 000377 1774888508.355215 punch from 0x00a18b to 0x00d53f (0x33b5 bytes) 000379 1774888508.360731 trunc from 0x00a76f to 0x00b363 (0xbf5 bytes) 000381 1774888508.367272 trunc from 0x000d90 to 0x006a27 (0x5c98 bytes) 000382 1774888508.373878 read 0x009cab thru 0x00d53f (0x3895 bytes) 000383 1774888508.399885 mapwrite 0x019139 thru 0x023438 (0xa300 bytes) 000384 1774888508.455017 read 0x01ac7c thru 0x023438 (0x87bd bytes) 000388 1774888508.460709 trunc from 0x012c78 to 0x01fa43 (0xcdcc bytes) 000390 1774888508.469188 trunc from 0x016016 to 0x018e2b (0x2e16 bytes) 000391 1774888508.474796 punch from 0x01675d to 0x02194d (0xb1f1 bytes) 000392 1774888508.481698 write 0x00f13f thru 0x016c1f (0x7ae1 bytes) 000395 1774888508.492027 punch from 0x006229 to 0x0129e3 (0xc7bb bytes) 000396 1774888508.509213 write 0x00fff6 thru 0x01caaf (0xcaba bytes) 000397 1774888508.521687 mapread 0x00edbc thru 0x015504 (0x6749 bytes) 000398 1774888508.529254 fallocate 0x032211 thru 0x034567 (0x2357 bytes) 000399 1774888508.534879 read 0x01abe6 thru 0x023438 (0x8853 bytes) 000400 1774888508.536953 mapwrite 0x01e634 thru 0x01ec0d (0x5da bytes) 000401 1774888508.557517 mapwrite 0x02dc5c thru 0x03d966 (0xfd0b bytes) 000402 1774888508.632755 punch from 0x0316aa to 0x03d966 (0xc2bd bytes) 000403 1774888508.640760 read 0x022ff4 thru 0x028ca2 (0x5caf bytes) 000405 1774888508.642379 read 0x011549 thru 0x01f08d (0xdb45 bytes) 000408 1774888508.647720 punch from 0x015661 to 0x02169d (0xc03d bytes) 000409 1774888508.653823 write 0x007a11 thru 0x009995 (0x1f85 bytes) 000410 1774888508.657584 punch from 0x00294f to 0x00f3b9 (0xca6b bytes) 000411 1774888508.672188 write 0x033839 thru 0x03d05f (0x9827 bytes) 000413 1774888508.685126 mapread 0x0225c8 thru 0x0309b6 (0xe3ef bytes) 000414 1774888508.688007 mapwrite 0x02f9f5 thru 0x03a150 (0xa75c bytes) 000415 1774888508.715089 trunc from 0x001137 to 0x007bf6 (0x6ac0 bytes) 000416 1774888508.720883 read 0x0152f9 thru 0x01d40d (0x8115 bytes) 000417 1774888508.721978 write 0x028218 thru 0x029065 (0xe4e bytes) 000418 1774888508.729666 mapread 0x019e60 thru 0x01f9a3 (0x5b44 bytes) 000419 1774888508.732990 trunc from 0x00548f to 0x00baec (0x665e bytes) 000420 1774888508.740352 write 0x0382bf thru 0x03ffff (0x7d41 bytes) 000421 1774888508.746104 mapwrite 0x01df07 thru 0x0264ce (0x85c8 bytes) 000422 1774888508.778217 trunc from 0x001a00 to 0x0109e5 (0xefe6 bytes) 000423 1774888508.784123 mapwrite 0x009169 thru 0x015293 (0xc12b bytes) 000424 1774888508.827236 punch from 0x01e58c to 0x02b285 (0xccfa bytes) 000425 1774888508.833914 write 0x000e8c thru 0x004049 (0x31be bytes) 000426 1774888508.835910 mapread 0x0047c3 thru 0x00ff22 (0xb760 bytes) 000427 1774888508.837910 mapwrite 0x030dfa thru 0x03cc52 (0xbe59 bytes) 000428 1774888508.859796 write 0x011ac6 thru 0x0137a9 (0x1ce4 bytes) 000429 1774888508.862642 write 0x002966 thru 0x01181b (0xeeb6 bytes) 000430 1774888508.864892 write 0x0217e6 thru 0x0254ce (0x3ce9 bytes) 000431 1774888508.875785 punch from 0x02f437 to 0x034665 (0x522f bytes) 000432 1774888508.886367 MIRROR_EXTEND to 2 mirrors 000433 1774888509.858977 trunc from 0x040000 to 0x030f03 (0xf0fc bytes) 000434 1774888509.955757 write 0x00102c thru 0x001eb1 (0xe86 bytes) 000436 1774888509.961855 trunc from 0x021d45 to 0x0255c8 (0x3884 bytes) 000437 1774888509.980727 mapwrite 0x026991 thru 0x02afe0 (0x4650 bytes) 000438 1774888510.106726 trunc from 0x0027d6 to 0x009e89 (0x76b4 bytes) 000439 1774888510.128204 mapwrite 0x01c744 thru 0x02956f (0xce2c bytes) 000440 1774888510.190826 trunc from 0x016868 to 0x01718c (0x925 bytes) 000441 1774888510.207534 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x30f04): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30f04): Mirror 2: 0xedb6f44 (stale) CRC-32 checksum value for chunk [0, 0x30f04): Mirror 1: 0xcf164519 Mirror 3: 0xcf164519 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30f04: skipped 000442 1774888511.199655 fallocate 0x0341f4 thru 0x036ab3 (0x28c0 bytes) 000443 1774888511.271104 mapread 0x031043 thru 0x036ab3 (0x5a71 bytes) 000445 1774888511.310607 trunc from 0x031026 to 0x035dac (0x4d87 bytes) 000446 1774888511.321920 mapwrite 0x01f2c4 thru 0x02d2d4 (0xe011 bytes) 000447 1774888511.393641 fallocate 0x0031e8 thru 0x01286a (0xf683 bytes) 000448 1774888511.401912 read 0x024854 thru 0x0328d9 (0xe086 bytes) 000449 1774888511.415337 fallocate 0x02d1fa thru 0x03c930 (0xf737 bytes) 000450 1774888511.425693 mapread 0x017757 thru 0x01bdca (0x4674 bytes) 000452 1774888511.440628 write 0x01dd2e thru 0x02b86b (0xdb3e bytes) 000453 1774888511.451658 write 0x031847 thru 0x03a70d (0x8ec7 bytes) 000455 1774888511.472912 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3a70e): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3a70e): Mirror 2: 0xba1a24e5 (stale) Mirror 3: 0x7b2f535c (stale) CRC-32 checksum value for chunk [0, 0x3a70e): Mirror 1: 0xd9cf95a2 Mirror 4: 0xd9cf95a2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3a70e: skipped 000456 1774888512.916126 mapwrite 0x00d17d thru 0x00f44d (0x22d1 bytes) 000457 1774888513.153398 mapwrite 0x01b998 thru 0x028ac3 (0xd12c bytes) 000458 1774888513.218996 write 0x00f599 thru 0x01b71e (0xc186 bytes) 000459 1774888513.229452 write 0x00bd2f thru 0x01172e (0x5a00 bytes) 000460 1774888513.234019 punch from 0x00cc89 to 0x01936b (0xc6e3 bytes) 000461 1774888513.274581 mapwrite 0x003e38 thru 0x006395 (0x255e bytes) 000462 1774888513.306484 write 0x0037fb thru 0x00781a (0x4020 bytes) 000463 1774888513.307870 mapwrite 0x03baf3 thru 0x03ffff (0x450d bytes) 000464 1774888513.382554 write 0x038bb6 thru 0x03efed (0x6438 bytes) 000465 1774888513.384267 mapread 0x017fdc thru 0x026530 (0xe555 bytes) 000466 1774888513.407111 punch from 0x022b3e to 0x031dee (0xf2b1 bytes) 000467 1774888513.430883 trunc from 0x040000 to 0x007e71 (0x3818e bytes) 000468 1774888513.459235 mapread 0x0001aa thru 0x005a56 (0x58ad bytes) 000469 1774888513.475619 mapread 0x00273a thru 0x007e71 (0x5738 bytes) 000471 1774888513.480102 fallocate 0x02c7dd thru 0x032fca (0x67ee bytes) 000472 1774888513.502595 mapwrite 0x001174 thru 0x00ad0d (0x9b9a bytes) 000473 1774888513.556329 punch from 0x002baa to 0x00a2d4 (0x772b bytes) 000474 1774888513.563790 trunc from 0x032fcb to 0x02646c (0xcb5e bytes) 000475 1774888513.579436 read 0x008210 thru 0x00f909 (0x76fa bytes) 000477 1774888513.589325 fallocate 0x021f91 thru 0x0305f7 (0xe667 bytes) 000478 1774888513.595771 trunc from 0x01f218 to 0x024bee (0x59d7 bytes) 000479 1774888513.601804 trunc from 0x0305f8 to 0x014ee6 (0x1b711 bytes) 000480 1774888513.620663 fallocate 0x031acd thru 0x038e2c (0x7360 bytes) 000481 1774888513.627629 trunc from 0x00833e to 0x00d213 (0x4ed6 bytes) 000483 1774888513.634702 trunc from 0x003f33 to 0x00cae7 (0x8bb5 bytes) 000484 1774888513.640506 punch from 0x002e70 to 0x00485f (0x19f0 bytes) 000485 1774888513.646871 mapread 0x0034cb thru 0x00e819 (0xb34f bytes) 000486 1774888513.661796 write 0x013317 thru 0x02286c (0xf556 bytes) 000487 1774888513.671569 read 0x009911 thru 0x00aad7 (0x11c7 bytes) 000488 1774888513.672716 punch from 0x022251 to 0x02286c (0x61c bytes) 000490 1774888513.694968 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x2286d): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2286d): Mirror 2: 0xf1c4680d (stale) Mirror 3: 0xac5c4631 (stale) Mirror 4: 0x4e28a6cc (stale) CRC-32 checksum value for chunk [0, 0x2286d): Mirror 1: 0xb800db7e Mirror 5: 0xb800db7e lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2286d: skipped 000491 1774888514.987289 MIRROR_RESYNC 5 mirrors 000492 1774888516.238739 trunc from 0x011a43 to 0x020433 (0xe9f1 bytes) 000493 1774888516.300846 mapread 0x013d2f thru 0x01649d (0x276f bytes) 000494 1774888516.327649 read 0x007a4d thru 0x012505 (0xaab9 bytes) 000495 1774888516.341313 write 0x01983a thru 0x01dd39 (0x4500 bytes) 000496 1774888516.342740 trunc from 0x010846 to 0x0172e4 (0x6a9f bytes) 000497 1774888516.348878 punch from 0x01f1ea to 0x02286c (0x3683 bytes) 000498 1774888516.355665 trunc from 0x014aae to 0x01a993 (0x5ee6 bytes) 000499 1774888516.370128 trunc from 0x02286d to 0x00830c (0x1a560 bytes) 000500 1774888516.392879 trunc from 0x006aa0 to 0x007e00 (0x1361 bytes) 000501 1774888516.399242 mapread 0x0055e1 thru 0x00830c (0x2d2c bytes) 000502 1774888516.408127 write 0x03cacd thru 0x03ffff (0x3533 bytes) 000503 1774888516.409841 fallocate 0x02a47d thru 0x03351f (0x90a3 bytes) 000504 1774888516.414508 mapread 0x023dbd thru 0x024aad (0xcf1 bytes) 000505 1774888516.421782 fallocate 0x027b7d thru 0x032924 (0xada8 bytes) 000506 1774888516.426630 mapread 0x039e92 thru 0x03fcbc (0x5e2b bytes) 000507 1774888516.435013 mapwrite 0x031ad8 thru 0x03be3e (0xa367 bytes) 000508 1774888516.507058 trunc from 0x022a3a to 0x02dd6f (0xb336 bytes) 000510 1774888516.520584 mapwrite 0x028e4b thru 0x02d6aa (0x4860 bytes) 000511 1774888516.596595 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0xb368417 (stale) Mirror 3: 0xb368417 (stale) Mirror 4: 0xb368417 (stale) Mirror 5: 0xb368417 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x3dcaeaec Mirror 6: 0x3dcaeaec lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000512 1774888517.524676 mapwrite 0x026b69 thru 0x03465c (0xdaf4 bytes) 000513 1774888517.676702 mapwrite 0x01b47e thru 0x01e21f (0x2da2 bytes) 000514 1774888517.705499 punch from 0x02346b to 0x02f610 (0xc1a6 bytes) 000516 1774888517.712021 fallocate 0x014cc1 thru 0x017a32 (0x2d72 bytes) 000517 1774888517.721816 punch from 0x035865 to 0x038096 (0x2832 bytes) 000518 1774888517.728936 write 0x019249 thru 0x019cd1 (0xa89 bytes) 000519 1774888517.735801 punch from 0x0106f3 to 0x010999 (0x2a7 bytes) 000520 1774888517.742848 read 0x034e3d thru 0x03b493 (0x6657 bytes) 000521 1774888517.759351 read 0x03cdf5 thru 0x03ffff (0x320b bytes) 000522 1774888517.791930 write 0x02a405 thru 0x02ea65 (0x4661 bytes) 000524 1774888517.795822 mapread 0x01074a thru 0x019839 (0x90f0 bytes) 000525 1774888517.800260 fallocate 0x033019 thru 0x037e64 (0x4e4c bytes) 000526 1774888517.807839 write 0x010cd4 thru 0x012db0 (0x20dd bytes) 000527 1774888517.809465 trunc from 0x012539 to 0x019836 (0x72fe bytes) 000528 1774888517.825262 punch from 0x014efb to 0x015b7f (0xc85 bytes) 000529 1774888517.831111 trunc from 0x040000 to 0x00c666 (0x33999 bytes) 000530 1774888517.913274 mapwrite 0x033c50 thru 0x038e0e (0x51bf bytes) 000531 1774888518.018817 punch from 0x021691 to 0x023f30 (0x28a0 bytes) 000532 1774888518.029565 MIRROR_RESYNC 6 mirrors 000533 1774888519.376896 trunc from 0x038e0f to 0x02a670 (0xe79e bytes) 000534 1774888519.516321 write 0x02ebe9 thru 0x034174 (0x558c bytes) 000535 1774888519.530529 read 0x00dd6f thru 0x017f43 (0xa1d5 bytes) 000536 1774888519.617978 punch from 0x003e2f to 0x003f0c (0xde bytes) 000537 1774888519.636589 fallocate 0x00168a thru 0x00b444 (0x9dbb bytes) 000538 1774888519.646088 write 0x00185c thru 0x002bbe (0x1363 bytes) 000539 1774888519.676560 write 0x03ea2c thru 0x03ffff (0x15d4 bytes) 000540 1774888519.677771 fallocate 0x0329d1 thru 0x03d631 (0xac61 bytes) 000541 1774888519.688597 trunc from 0x040000 to 0x02d89a (0x12765 bytes) 000542 1774888519.739832 mapwrite 0x03c7c9 thru 0x03ffff (0x3837 bytes) 000543 1774888519.824219 read 0x006ce5 thru 0x00d65f (0x697b bytes) 000544 1774888519.838321 mapwrite 0x00d681 thru 0x00e985 (0x1305 bytes) 000545 1774888519.857367 punch from 0x0095e9 to 0x01619f (0xcbb7 bytes) 000546 1774888519.863575 write 0x001a6f thru 0x011443 (0xf9d5 bytes) 000547 1774888519.874732 trunc from 0x040000 to 0x002cba (0x3d345 bytes) 000549 1774888519.908063 mapread 0x000269 thru 0x002cba (0x2a52 bytes) 000550 1774888519.921798 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x2cbb): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cbb): Mirror 2: 0x9384b0dd (stale) Mirror 3: 0x9384b0dd (stale) Mirror 4: 0x9384b0dd (stale) Mirror 5: 0x9384b0dd (stale) Mirror 6: 0x9384b0dd (stale) CRC-32 checksum value for chunk [0, 0x2cbb): Mirror 1: 0xf41f32e3 Mirror 7: 0xf41f32e3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cbb: skipped 000551 1774888521.119970 mapread 0x0005a7 thru 0x002cba (0x2714 bytes) 000552 1774888521.221076 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x2cbb): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cbb): Mirror 2: 0x9384b0dd (stale) Mirror 3: 0x9384b0dd (stale) Mirror 4: 0x9384b0dd (stale) Mirror 5: 0x9384b0dd (stale) Mirror 6: 0x9384b0dd (stale) CRC-32 checksum value for chunk [0, 0x2cbb): Mirror 1: 0xf41f32e3 Mirror 7: 0xf41f32e3 Mirror 8: 0xf41f32e3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cbb: skipped 000553 1774888522.322068 punch from 0x0023f5 to 0x002cba (0x8c6 bytes) 000554 1774888522.381557 fallocate 0x00af6b thru 0x010d0d (0x5da3 bytes) 000556 1774888522.394760 punch from 0x0104fc to 0x010d0d (0x812 bytes) 000557 1774888522.401213 write 0x03b637 thru 0x03ffff (0x49c9 bytes) 000558 1774888522.407544 mapwrite 0x037735 thru 0x03ffff (0x88cb bytes) 000559 1774888522.445833 MIRROR_RESYNC 8 mirrors 000560 1774888523.884880 mapwrite 0x038533 thru 0x03e955 (0x6423 bytes) 000561 1774888523.988127 fallocate 0x02bfeb thru 0x033c10 (0x7c26 bytes) 000562 1774888523.995227 read 0x0323ec thru 0x03c607 (0xa21c bytes) 000563 1774888523.996701 trunc from 0x01b839 to 0x022805 (0x6fcd bytes) 000564 1774888524.003212 write 0x01bf96 thru 0x02373c (0x77a7 bytes) 000565 1774888524.014286 fallocate 0x00391e thru 0x005176 (0x1859 bytes) 000566 1774888524.022666 write 0x018069 thru 0x0269dd (0xe975 bytes) 000567 1774888524.041804 fallocate 0x0165e8 thru 0x019ef4 (0x390d bytes) 000568 1774888524.047239 fallocate 0x0098a6 thru 0x01129f (0x79fa bytes) 000569 1774888524.054494 mapread 0x0257aa thru 0x034cb7 (0xf50e bytes) 000570 1774888524.063703 trunc from 0x032536 to 0x03ffff (0xdaca bytes) 000571 1774888524.069540 read 0x0308d8 thru 0x0371c1 (0x68ea bytes) 000572 1774888524.084603 MIRROR_RESYNC 8 mirrors 000573 1774888525.646380 mapwrite 0x035245 thru 0x03b110 (0x5ecc bytes) 000576 1774888525.740539 fallocate 0x01e3a0 thru 0x01edfb (0xa5c bytes) 000577 1774888525.753086 trunc from 0x040000 to 0x02b9b1 (0x1464e bytes) 000578 1774888525.785841 mapwrite 0x0098a0 thru 0x017153 (0xd8b4 bytes) 000581 1774888525.861207 mapwrite 0x00f931 thru 0x018eac (0x957c bytes) 000582 1774888525.926926 fallocate 0x00af09 thru 0x00b8b7 (0x9af bytes) 000584 1774888525.956601 punch from 0x0016f6 to 0x0085e3 (0x6eee bytes) 000585 1774888525.984546 MIRROR_RESYNC 8 mirrors 000586 1774888527.954359 trunc from 0x00035d to 0x002643 (0x22e7 bytes) 000587 1774888528.013571 mapread 0x01879b thru 0x01b15b (0x29c1 bytes) 000588 1774888528.069096 MIRROR_RESYNC 8 mirrors 000589 1774888529.860017 MIRROR_EXTEND to 9 mirrors 000590 1774888530.712566 mapread 0x004149 thru 0x00cb58 (0x8a10 bytes) 000591 1774888530.738722 MIRROR_SPLIT mirror 1 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) 000592 1774888531.197973 punch from 0x001ff5 to 0x0105f5 (0xe601 bytes) 000593 1774888531.252566 read 0x01b0fc thru 0x01d2c5 (0x21ca bytes) 000594 1774888531.260690 mapread 0x016370 thru 0x01c27c (0x5f0d bytes) 000597 1774888531.283612 punch from 0x00c935 to 0x00e1f2 (0x18be bytes) 000598 1774888531.293438 MIRROR_RESYNC 8 mirrors 000599 1774888532.923761 write 0x0274cb thru 0x0292ab (0x1de1 bytes) 000600 1774888532.965339 punch from 0x01250d to 0x015415 (0x2f09 bytes) 000601 1774888532.971295 punch from 0x00563b to 0x00d7f6 (0x81bc bytes) 000602 1774888532.981565 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b9b2): Mirror 4: 0xf10169dc (stale) Mirror 5: 0xf10169dc (stale) Mirror 6: 0xf10169dc (stale) Mirror 7: 0xf10169dc (stale) Mirror 8: 0xf10169dc (stale) Mirror 9: 0xf10169dc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b9b2): Mirror 4: 0xf10169dc (stale) Mirror 5: 0xf10169dc (stale) Mirror 6: 0xf10169dc (stale) Mirror 7: 0xf10169dc (stale) Mirror 8: 0xf10169dc (stale) Mirror 9: 0xf10169dc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b9b2: skipped 000603 1774888533.470187 fallocate 0x02a553 thru 0x02f1de (0x4c8c bytes) 000604 1774888533.476968 mapread 0x0257d3 thru 0x0269da (0x1208 bytes) 000605 1774888533.488362 write 0x033d9d thru 0x03f5bb (0xb81f bytes) 000606 1774888533.499695 MIRROR_RESYNC 7 mirrors 000607 1774888535.392324 read 0x0377ef thru 0x037b67 (0x379 bytes) 000608 1774888535.400096 trunc from 0x000f33 to 0x00e740 (0xd80e bytes) 000609 1774888535.435408 mapread 0x0299a7 thru 0x02eab4 (0x510e bytes) 000610 1774888535.463553 punch from 0x000102 to 0x003f48 (0x3e47 bytes) 000611 1774888535.470109 write 0x00ba6c thru 0x016013 (0xa5a8 bytes) 000612 1774888535.490495 MIRROR_RESYNC 7 mirrors 000613 1774888537.197329 punch from 0x039557 to 0x03f5bb (0x6065 bytes) 000614 1774888537.279021 write 0x00a5b1 thru 0x010493 (0x5ee3 bytes) 000618 1774888537.334301 write 0x032f56 thru 0x03b551 (0x85fc bytes) 000619 1774888537.366109 punch from 0x027f9e to 0x0320a2 (0xa105 bytes) 000620 1774888537.413797 MIRROR_RESYNC 7 mirrors 000621 1774888540.177463 trunc from 0x00aff3 to 0x00d047 (0x2055 bytes) 000623 1774888540.253604 trunc from 0x03f5bc to 0x03b123 (0x4498 bytes) 000624 1774888540.322366 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3b124): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b124): Mirror 4: 0x942e4669 (stale) Mirror 5: 0x942e4669 (stale) Mirror 6: 0x942e4669 (stale) Mirror 7: 0x942e4669 (stale) Mirror 8: 0x942e4669 (stale) Mirror 9: 0x942e4669 (stale) CRC-32 checksum value for chunk [0, 0x3b124): Mirror 1: 0xb1d18f3a Mirror 10: 0xb1d18f3a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b124: skipped 000625 1774888542.258545 mapread 0x035e44 thru 0x037e1f (0x1fdc bytes) 000626 1774888542.302041 MIRROR_SPLIT mirror 4 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b124): Mirror 4: 0x942e4669 (stale) Mirror 5: 0x942e4669 (stale) Mirror 6: 0x942e4669 (stale) Mirror 8: 0x942e4669 (stale) Mirror 9: 0x942e4669 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b124): Mirror 4: 0x942e4669 (stale) Mirror 5: 0x942e4669 (stale) Mirror 6: 0x942e4669 (stale) Mirror 8: 0x942e4669 (stale) Mirror 9: 0x942e4669 (stale) CRC-32 checksum value for chunk [0, 0x3b124): Mirror 1: 0xb1d18f3a Mirror 10: 0xb1d18f3a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b124: skipped 000627 1774888543.585613 punch from 0x016b2e to 0x017ff3 (0x14c6 bytes) 000628 1774888543.634888 mapwrite 0x01de1c thru 0x02dae8 (0xfccd bytes) 000629 1774888543.717635 write 0x0040fc thru 0x0075dc (0x34e1 bytes) 000630 1774888543.746952 mapread 0x02559a thru 0x02d0dc (0x7b43 bytes) 000631 1774888543.748388 mapread 0x00dbee thru 0x017224 (0x9637 bytes) 000632 1774888543.764877 trunc from 0x03b124 to 0x000145 (0x3afde bytes) 000633 1774888543.803589 fallocate 0x0151a6 thru 0x020677 (0xb4d2 bytes) 000634 1774888543.816369 fallocate 0x01fc56 thru 0x029d90 (0xa13b bytes) 000635 1774888543.843242 MIRROR_RESYNC 7 mirrors 000637 1774888545.170267 mapwrite 0x01da36 thru 0x01fd45 (0x2310 bytes) 000638 1774888545.261044 mapwrite 0x005367 thru 0x00d0ad (0x7d47 bytes) 000639 1774888545.292272 fallocate 0x00c0ac thru 0x016e18 (0xad6d bytes) 000640 1774888545.295832 punch from 0x013f4d to 0x01a78c (0x6840 bytes) 000641 1774888545.299510 mapread 0x00afec thru 0x017a0f (0xca24 bytes) 000642 1774888545.307300 mapwrite 0x011f68 thru 0x012ad5 (0xb6e bytes) 000643 1774888545.329002 mapwrite 0x01417c thru 0x01e1fe (0xa083 bytes) 000644 1774888545.355657 trunc from 0x020678 to 0x016d57 (0x9920 bytes) 000646 1774888545.379627 mapread 0x001f82 thru 0x010fe4 (0xf063 bytes) 000648 1774888545.383422 mapread 0x015c22 thru 0x016d57 (0x1136 bytes) 000649 1774888545.384739 read 0x008650 thru 0x010d54 (0x8705 bytes) 000650 1774888545.386349 mapread 0x01564f thru 0x016d57 (0x1709 bytes) 000651 1774888545.393345 mapread 0x01333f thru 0x013a40 (0x702 bytes) 000652 1774888545.395436 punch from 0x00f2c3 to 0x00fe25 (0xb63 bytes) 000654 1774888545.406376 trunc from 0x00ce95 to 0x0123df (0x554b bytes) 000655 1774888545.411878 read 0x00f83a thru 0x01543a (0x5c01 bytes) 000656 1774888545.433861 trunc from 0x005cd4 to 0x006327 (0x654 bytes) 000657 1774888545.441217 fallocate 0x017553 thru 0x01ae8d (0x393b bytes) 000658 1774888545.451510 write 0x024cfa thru 0x025138 (0x43f bytes) 000659 1774888545.454057 write 0x00a0d7 thru 0x00ebb3 (0x4add bytes) 000661 1774888545.456479 mapread 0x00055c thru 0x009dfb (0x98a0 bytes) 000662 1774888545.474663 punch from 0x0240a2 to 0x025138 (0x1097 bytes) 000663 1774888545.490230 trunc from 0x0173b5 to 0x01996e (0x25ba bytes) 000664 1774888545.495480 write 0x03294b thru 0x03ffff (0xd6b5 bytes) 000665 1774888545.497581 trunc from 0x03a2c7 to 0x03ffff (0x5d39 bytes) 000666 1774888545.511543 fallocate 0x026355 thru 0x035be6 (0xf892 bytes) 000667 1774888545.517833 read 0x02d259 thru 0x0306d7 (0x347f bytes) 000668 1774888545.536455 write 0x001b3d thru 0x00d412 (0xb8d6 bytes) 000670 1774888545.538682 punch from 0x0170fe to 0x01a258 (0x315b bytes) 000671 1774888545.545386 punch from 0x02b003 to 0x031706 (0x6704 bytes) 000672 1774888545.550122 mapread 0x029fc0 thru 0x0393c7 (0xf408 bytes) 000673 1774888545.588921 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe20eea22 (stale) Mirror 5: 0xe20eea22 (stale) Mirror 6: 0xe20eea22 (stale) Mirror 8: 0xe20eea22 (stale) Mirror 9: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1e51b969 Mirror 11: 0x1e51b969 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000674 1774888546.786843 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 4: 0xe20eea22 (stale) Mirror 5: 0xe20eea22 (stale) Mirror 6: 0xe20eea22 (stale) Mirror 8: 0xe20eea22 (stale) Mirror 9: 0xe20eea22 (stale) Mirror 10: 0xe20eea22 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x1e51b969 Mirror 11: 0x1e51b969 Mirror 12: 0x1e51b969 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000675 1774888548.031574 mapwrite 0x000500 thru 0x00ed79 (0xe87a bytes) 000676 1774888548.188822 trunc from 0x03aab4 to 0x03ffff (0x554c bytes) 000677 1774888548.200932 trunc from 0x018a03 to 0x01dffb (0x55f9 bytes) 000678 1774888548.212606 mapwrite 0x03df42 thru 0x03ffff (0x20be bytes) 000680 1774888548.253059 write 0x005b51 thru 0x01541c (0xf8cc bytes) 000681 1774888548.268851 MIRROR_RESYNC 9 mirrors 000682 1774888550.634069 trunc from 0x040000 to 0x036151 (0x9eae bytes) 000683 1774888550.686228 mapread 0x035cf5 thru 0x036151 (0x45d bytes) 000684 1774888550.708297 mapread 0x012f3e thru 0x02295e (0xfa21 bytes) 000685 1774888550.744506 trunc from 0x03009b to 0x03613a (0x60a0 bytes) 000686 1774888550.759506 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x36152): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x36152): Mirror 4: 0xf38ec42b (stale) Mirror 5: 0xf38ec42b (stale) Mirror 6: 0xf38ec42b (stale) Mirror 8: 0xf38ec42b (stale) Mirror 9: 0xf38ec42b (stale) Mirror 10: 0xf38ec42b (stale) Mirror 11: 0xf38ec42b (stale) Mirror 12: 0xf38ec42b (stale) CRC-32 checksum value for chunk [0, 0x36152): Mirror 1: 0x4b157349 Mirror 13: 0x4b157349 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x36152: skipped 000688 1774888551.882116 trunc from 0x029b48 to 0x02ba0f (0x1ec8 bytes) 000689 1774888551.930909 read 0x0168e5 thru 0x026509 (0xfc25 bytes) 000690 1774888551.941964 read 0x016ed2 thru 0x01e6ab (0x77da bytes) 000691 1774888551.943836 trunc from 0x036152 to 0x02625a (0xfef7 bytes) 000692 1774888551.965556 read 0x023177 thru 0x02625a (0x30e4 bytes) 000693 1774888551.966238 fallocate 0x02152a thru 0x02fd26 (0xe7fd bytes) 000694 1774888551.970603 fallocate 0x002a55 thru 0x010b71 (0xe11d bytes) 000695 1774888551.975057 trunc from 0x02fd27 to 0x01d2b9 (0x12a6d bytes) 000696 1774888551.992802 write 0x00dd79 thru 0x011e38 (0x40c0 bytes) 000697 1774888551.999728 trunc from 0x00fa9d to 0x015134 (0x5698 bytes) 000698 1774888552.012860 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x1d2ba): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d2ba): Mirror 4: 0x782f2512 (stale) Mirror 5: 0x782f2512 (stale) Mirror 6: 0x782f2512 (stale) Mirror 8: 0x782f2512 (stale) Mirror 9: 0x782f2512 (stale) Mirror 10: 0x782f2512 (stale) Mirror 11: 0x782f2512 (stale) Mirror 12: 0x782f2512 (stale) Mirror 13: 0x782f2512 (stale) CRC-32 checksum value for chunk [0, 0x1d2ba): Mirror 1: 0xec29ec0f Mirror 14: 0xec29ec0f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d2ba: skipped 000700 1774888553.538858 punch from 0x0012bf to 0x00fca8 (0xe9ea bytes) 000701 1774888553.613278 MIRROR_RESYNC 11 mirrors 000702 1774888556.786856 trunc from 0x01d2ba to 0x020c2f (0x3976 bytes) 000703 1774888556.830532 trunc from 0x020c30 to 0x01492a (0xc305 bytes) 000705 1774888556.855998 read 0x00dead thru 0x0117df (0x3933 bytes) 000706 1774888556.867110 mapwrite 0x03a101 thru 0x03bd8c (0x1c8c bytes) 000707 1774888556.908850 mapwrite 0x038fac thru 0x03f6fc (0x6751 bytes) 000708 1774888556.952837 trunc from 0x007728 to 0x007d81 (0x65a bytes) 000709 1774888556.964676 mapwrite 0x0271b6 thru 0x03284a (0xb695 bytes) 000711 1774888557.028295 fallocate 0x015fe1 thru 0x01973c (0x375c bytes) 000712 1774888557.037044 trunc from 0x03f6fd to 0x038967 (0x6d95 bytes) 000713 1774888557.059775 trunc from 0x026214 to 0x02d9e6 (0x77d3 bytes) 000714 1774888557.074491 mapwrite 0x0256bc thru 0x02c2ae (0x6bf3 bytes) 000715 1774888557.162234 trunc from 0x02d8d1 to 0x036a21 (0x9151 bytes) 000717 1774888557.172888 mapwrite 0x021e05 thru 0x02ac6a (0x8e66 bytes) 000718 1774888557.205396 trunc from 0x01dc5e to 0x024329 (0x66cc bytes) 000719 1774888557.218813 mapwrite 0x02af23 thru 0x02c913 (0x19f1 bytes) 000720 1774888557.244555 mapwrite 0x0200af thru 0x02cb17 (0xca69 bytes) 000721 1774888557.319232 read 0x022cf9 thru 0x02a7cc (0x7ad4 bytes) 000722 1774888557.321279 fallocate 0x0167a0 thru 0x01aac8 (0x4329 bytes) 000723 1774888557.361738 MIRROR_EXTEND to 12 mirrors CRC-32 checksum value for chunk [0, 0x38968): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38968): Mirror 4: 0x379d2b12 (stale) Mirror 5: 0x379d2b12 (stale) Mirror 6: 0x379d2b12 (stale) Mirror 8: 0x379d2b12 (stale) Mirror 9: 0x379d2b12 (stale) Mirror 10: 0x379d2b12 (stale) Mirror 11: 0x379d2b12 (stale) Mirror 12: 0x379d2b12 (stale) Mirror 13: 0x379d2b12 (stale) Mirror 14: 0x379d2b12 (stale) CRC-32 checksum value for chunk [0, 0x38968): Mirror 1: 0x3e84e42b Mirror 15: 0x3e84e42b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38968: skipped 000724 1774888559.223650 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x38968): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38968): Mirror 4: 0x379d2b12 (stale) Mirror 5: 0x379d2b12 (stale) Mirror 6: 0x379d2b12 (stale) Mirror 8: 0x379d2b12 (stale) Mirror 9: 0x379d2b12 (stale) Mirror 10: 0x379d2b12 (stale) Mirror 11: 0x379d2b12 (stale) Mirror 12: 0x379d2b12 (stale) Mirror 13: 0x379d2b12 (stale) Mirror 14: 0x379d2b12 (stale) CRC-32 checksum value for chunk [0, 0x38968): Mirror 1: 0x3e84e42b Mirror 15: 0x3e84e42b Mirror 16: 0x3e84e42b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38968: skipped 000725 1774888560.678849 MIRROR_RESYNC 13 mirrors 000726 1774888563.657566 mapread 0x00a212 thru 0x00e784 (0x4573 bytes) 000727 1774888563.683049 punch from 0x00624e to 0x00b161 (0x4f14 bytes) 000728 1774888563.742863 read 0x015a6c thru 0x01e838 (0x8dcd bytes) 000729 1774888563.756662 trunc from 0x03246e to 0x035a2d (0x35c0 bytes) 000730 1774888563.763372 fallocate 0x00290b thru 0x00cab1 (0xa1a7 bytes) 000731 1774888563.769973 mapwrite 0x01628a thru 0x022cd5 (0xca4c bytes) 000733 1774888563.806726 trunc from 0x038968 to 0x039432 (0xacb bytes) 000734 1774888563.839406 trunc from 0x039433 to 0x02c117 (0xd31b bytes) 000735 1774888563.867046 MIRROR_SPLIT mirror 1 to 12 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2c118): Mirror 5: 0x558519ac (stale) Mirror 6: 0x558519ac (stale) Mirror 8: 0x558519ac (stale) Mirror 9: 0x558519ac (stale) Mirror 10: 0x558519ac (stale) Mirror 11: 0x558519ac (stale) Mirror 12: 0x558519ac (stale) Mirror 13: 0x558519ac (stale) Mirror 14: 0x558519ac (stale) Mirror 15: 0x558519ac (stale) Mirror 16: 0x558519ac (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2c118): Mirror 5: 0x558519ac (stale) Mirror 6: 0x558519ac (stale) Mirror 8: 0x558519ac (stale) Mirror 9: 0x558519ac (stale) Mirror 10: 0x558519ac (stale) Mirror 11: 0x558519ac (stale) Mirror 12: 0x558519ac (stale) Mirror 13: 0x558519ac (stale) Mirror 14: 0x558519ac (stale) Mirror 15: 0x558519ac (stale) Mirror 16: 0x558519ac (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2c118: skipped 000736 1774888564.659309 fallocate 0x0238e9 thru 0x02fe4a (0xc562 bytes) 000737 1774888564.668909 write 0x028d74 thru 0x030cca (0x7f57 bytes) 000738 1774888564.692401 write 0x03c609 thru 0x03ffff (0x39f7 bytes) 000739 1774888564.694395 mapwrite 0x0043ba thru 0x00cb6a (0x87b1 bytes) 000740 1774888564.750026 trunc from 0x0227f4 to 0x02fa3d (0xd24a bytes) 000741 1774888564.756456 mapread 0x022184 thru 0x026fc8 (0x4e45 bytes) 000742 1774888564.798488 MIRROR_RESYNC 12 mirrors 000743 1774888569.811293 trunc from 0x040000 to 0x03aa76 (0x5589 bytes) 000744 1774888569.889286 write 0x01f0f6 thru 0x02c042 (0xcf4d bytes) 000745 1774888569.904765 trunc from 0x0050a2 to 0x005f53 (0xeb2 bytes) 000746 1774888569.918405 fallocate 0x02ed9a thru 0x039ebd (0xb124 bytes) 000747 1774888569.932265 write 0x000a58 thru 0x010083 (0xf62c bytes) 000748 1774888569.966659 write 0x034ef4 thru 0x037fcb (0x30d8 bytes) 000749 1774888569.997999 trunc from 0x004d2c to 0x0050e9 (0x3be bytes) 000750 1774888570.027573 trunc from 0x03aa77 to 0x01a21b (0x2085b bytes) 000751 1774888570.056265 write 0x01b5c1 thru 0x026102 (0xab42 bytes) 000752 1774888570.060844 read 0x00b7b4 thru 0x016e3a (0xb687 bytes) 000753 1774888570.073080 write 0x01b876 thru 0x01f461 (0x3bec bytes) 000754 1774888570.073991 trunc from 0x0221ec to 0x026102 (0x3f17 bytes) 000755 1774888570.098807 MIRROR_SPLIT mirror 6 to 11 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x26103): Mirror 5: 0xe205af5e (stale) Mirror 6: 0xe205af5e (stale) Mirror 8: 0xe205af5e (stale) Mirror 9: 0xe205af5e (stale) Mirror 10: 0xe205af5e (stale) Mirror 12: 0xe205af5e (stale) Mirror 13: 0xe205af5e (stale) Mirror 14: 0xe205af5e (stale) Mirror 15: 0xe205af5e (stale) Mirror 16: 0xe205af5e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x26103): Mirror 5: 0xe205af5e (stale) Mirror 6: 0xe205af5e (stale) Mirror 8: 0xe205af5e (stale) Mirror 9: 0xe205af5e (stale) Mirror 10: 0xe205af5e (stale) Mirror 12: 0xe205af5e (stale) Mirror 13: 0xe205af5e (stale) Mirror 14: 0xe205af5e (stale) Mirror 15: 0xe205af5e (stale) Mirror 16: 0xe205af5e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x26103: skipped 000757 1774888571.089501 trunc from 0x026103 to 0x02ff66 (0x9e64 bytes) 000758 1774888571.138577 MIRROR_SPLIT mirror 1 to 10 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2ff67): Mirror 6: 0xdfc7dc62 (stale) Mirror 8: 0xdfc7dc62 (stale) Mirror 9: 0xdfc7dc62 (stale) Mirror 10: 0xdfc7dc62 (stale) Mirror 12: 0xdfc7dc62 (stale) Mirror 13: 0xdfc7dc62 (stale) Mirror 14: 0xdfc7dc62 (stale) Mirror 15: 0xdfc7dc62 (stale) Mirror 16: 0xdfc7dc62 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2ff67): Mirror 6: 0xdfc7dc62 (stale) Mirror 8: 0xdfc7dc62 (stale) Mirror 9: 0xdfc7dc62 (stale) Mirror 10: 0xdfc7dc62 (stale) Mirror 12: 0xdfc7dc62 (stale) Mirror 13: 0xdfc7dc62 (stale) Mirror 14: 0xdfc7dc62 (stale) Mirror 15: 0xdfc7dc62 (stale) Mirror 16: 0xdfc7dc62 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2ff67: skipped 000759 1774888571.836401 mapwrite 0x002b2d thru 0x011ff6 (0xf4ca bytes) 000760 1774888571.949756 write 0x03703a thru 0x03ffff (0x8fc6 bytes) 000761 1774888571.983335 mapread 0x008909 thru 0x0134ef (0xabe7 bytes) 000762 1774888571.985595 trunc from 0x010d30 to 0x0172c5 (0x6596 bytes) 000763 1774888571.997442 read 0x03ea96 thru 0x03ffff (0x156a bytes) 000764 1774888571.998466 trunc from 0x040000 to 0x033b86 (0xc479 bytes) 000765 1774888572.041841 read 0x02583e thru 0x029507 (0x3cca bytes) 000766 1774888572.066409 write 0x0215f0 thru 0x0270b3 (0x5ac4 bytes) 000768 1774888572.069639 read 0x02969e thru 0x02ac89 (0x15ec bytes) 000769 1774888572.071787 fallocate 0x0206c3 thru 0x027d9f (0x76dd bytes) 000770 1774888572.080511 read 0x01aa49 thru 0x01b069 (0x621 bytes) 000771 1774888572.082612 fallocate 0x02d34b thru 0x03b9b3 (0xe669 bytes) 000772 1774888572.093625 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3b9b4): Mirror 6: 0xf2276cc (stale) Mirror 8: 0xf2276cc (stale) Mirror 10: 0xf2276cc (stale) Mirror 12: 0xf2276cc (stale) Mirror 13: 0xf2276cc (stale) Mirror 14: 0xf2276cc (stale) Mirror 15: 0xf2276cc (stale) Mirror 16: 0xf2276cc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b9b4): Mirror 6: 0xf2276cc (stale) Mirror 8: 0xf2276cc (stale) Mirror 10: 0xf2276cc (stale) Mirror 12: 0xf2276cc (stale) Mirror 13: 0xf2276cc (stale) Mirror 14: 0xf2276cc (stale) Mirror 15: 0xf2276cc (stale) Mirror 16: 0xf2276cc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b9b4: skipped 000773 1774888572.945379 write 0x016fdd thru 0x021a1f (0xaa43 bytes) 000774 1774888572.977875 trunc from 0x024f36 to 0x03187f (0xc94a bytes) 000775 1774888573.002460 fallocate 0x0142ac thru 0x0240e3 (0xfe38 bytes) 000776 1774888573.017476 mapwrite 0x03b61a thru 0x03ffff (0x49e6 bytes) 000777 1774888573.101589 read 0x027763 thru 0x02b33c (0x3bda bytes) 000778 1774888573.113608 punch from 0x024ce6 to 0x02950c (0x4827 bytes) 000779 1774888573.119713 fallocate 0x019613 thru 0x01a5a8 (0xf96 bytes) 000780 1774888573.125367 trunc from 0x015bd7 to 0x022933 (0xcd5d bytes) 000781 1774888573.131975 mapread 0x0285f4 thru 0x02e0d3 (0x5ae0 bytes) 000782 1774888573.150578 mapread 0x0385ec thru 0x03b0a8 (0x2abd bytes) 000783 1774888573.151867 trunc from 0x040000 to 0x03e24a (0x1db5 bytes) 000785 1774888573.181358 trunc from 0x02f53f to 0x03668b (0x714d bytes) 000786 1774888573.189008 punch from 0x02156b to 0x02f01a (0xdab0 bytes) 000787 1774888573.196634 mapwrite 0x00d74a thru 0x0109c4 (0x327b bytes) 000788 1774888573.242019 write 0x037fe3 thru 0x03ffff (0x801d bytes) 000789 1774888573.246776 read 0x03bb71 thru 0x03ffff (0x448f bytes) 000791 1774888573.252126 trunc from 0x010c3c to 0x01f2f6 (0xe6bb bytes) 000792 1774888573.263370 read 0x020672 thru 0x026ab5 (0x6444 bytes) 000793 1774888573.285114 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x6946b1c5 (stale) Mirror 8: 0x6946b1c5 (stale) Mirror 10: 0x6946b1c5 (stale) Mirror 12: 0x6946b1c5 (stale) Mirror 13: 0x6946b1c5 (stale) Mirror 14: 0x6946b1c5 (stale) Mirror 15: 0x6946b1c5 (stale) Mirror 16: 0x6946b1c5 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xcfbbdec7 Mirror 17: 0xcfbbdec7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000794 1774888574.868605 mapwrite 0x034a0e thru 0x03c4a0 (0x7a93 bytes) 000795 1774888575.032409 mapwrite 0x00149a thru 0x009d57 (0x88be bytes) 000797 1774888575.078058 mapread 0x0260fa thru 0x033ba4 (0xdaab bytes) 000798 1774888575.093048 trunc from 0x026bae to 0x02d7bf (0x6c12 bytes) 000799 1774888575.100617 trunc from 0x040000 to 0x008f24 (0x370db bytes) 000800 1774888575.184950 MIRROR_RESYNC 10 mirrors 000801 1774888577.056122 mapread 0x00269a thru 0x005416 (0x2d7d bytes) 000802 1774888577.099829 read 0x00135c thru 0x008f24 (0x7bc9 bytes) 000803 1774888577.100704 write 0x03f3e8 thru 0x03ffff (0xc18 bytes) 000804 1774888577.141748 write 0x006590 thru 0x008c77 (0x26e8 bytes) 000805 1774888577.156966 MIRROR_SPLIT mirror 8 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xb1197ab1 (stale) Mirror 8: 0xb1197ab1 (stale) Mirror 10: 0xb1197ab1 (stale) Mirror 12: 0xb1197ab1 (stale) Mirror 13: 0xb1197ab1 (stale) Mirror 14: 0xb1197ab1 (stale) Mirror 15: 0xb1197ab1 (stale) Mirror 17: 0xb1197ab1 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0xb1197ab1 (stale) Mirror 8: 0xb1197ab1 (stale) Mirror 10: 0xb1197ab1 (stale) Mirror 12: 0xb1197ab1 (stale) Mirror 13: 0xb1197ab1 (stale) Mirror 14: 0xb1197ab1 (stale) Mirror 15: 0xb1197ab1 (stale) Mirror 17: 0xb1197ab1 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000806 1774888577.677499 read 0x03a0a3 thru 0x03ffff (0x5f5d bytes) 000807 1774888577.694666 write 0x00e912 thru 0x0169bc (0x80ab bytes) 000808 1774888577.715686 punch from 0x018594 to 0x027030 (0xea9d bytes) 000809 1774888577.723673 trunc from 0x01be6b to 0x02a8f9 (0xea8f bytes) 000810 1774888577.730444 trunc from 0x0336b0 to 0x03801e (0x496f bytes) 000811 1774888577.737916 read 0x00974a thru 0x01775b (0xe012 bytes) 000812 1774888577.781955 mapwrite 0x0120d9 thru 0x01fc7d (0xdba5 bytes) 000813 1774888577.840391 fallocate 0x02fa49 thru 0x03094a (0xf02 bytes) 000814 1774888577.852122 trunc from 0x01593e to 0x022472 (0xcb35 bytes) 000815 1774888577.870972 mapread 0x01a0e4 thru 0x0213cd (0x72ea bytes) 000816 1774888577.937050 trunc from 0x040000 to 0x005443 (0x3abbc bytes) 000817 1774888577.960768 trunc from 0x004671 to 0x005443 (0xdd3 bytes) 000818 1774888577.972012 read 0x0052aa thru 0x005443 (0x19a bytes) 000819 1774888577.981983 punch from 0x003567 to 0x005443 (0x1edd bytes) 000820 1774888577.999687 mapread 0x0011bb thru 0x005443 (0x4289 bytes) 000821 1774888578.032379 fallocate 0x035290 thru 0x036c6c (0x19dd bytes) 000822 1774888578.049929 mapread 0x004e1e thru 0x005443 (0x626 bytes) 000823 1774888578.056414 punch from 0x000250 to 0x002113 (0x1ec4 bytes) 000824 1774888578.095652 write 0x03f202 thru 0x03ffff (0xdfe bytes) 000825 1774888578.096999 fallocate 0x01766b thru 0x01d2c1 (0x5c57 bytes) 000827 1774888578.118217 punch from 0x0010b5 to 0x00a93b (0x9887 bytes) 000828 1774888578.144999 trunc from 0x035e56 to 0x03a428 (0x45d3 bytes) 000829 1774888578.162033 read 0x0108f1 thru 0x011873 (0xf83 bytes) 000830 1774888578.200370 mapread 0x03eec9 thru 0x03ffff (0x1137 bytes) 000831 1774888578.205484 trunc from 0x040000 to 0x03012c (0xfed3 bytes) 000832 1774888578.236237 trunc from 0x03012d to 0x035933 (0x5807 bytes) 000833 1774888578.264652 mapread 0x0053c3 thru 0x00e415 (0x9053 bytes) 000834 1774888578.265985 read 0x01b801 thru 0x02020b (0x4a0b bytes) 000835 1774888578.278347 punch from 0x00352c to 0x00a00c (0x6ae1 bytes) 000836 1774888578.286344 fallocate 0x02d63e thru 0x038b0a (0xb4cd bytes) 000837 1774888578.295519 mapread 0x025598 thru 0x032add (0xd546 bytes) 000838 1774888578.308234 fallocate 0x026b2a thru 0x02f999 (0x8e70 bytes) 000839 1774888578.318116 punch from 0x01ea8a to 0x02a666 (0xbbdd bytes) 000840 1774888578.346007 mapwrite 0x0374ae thru 0x03a648 (0x319b bytes) 000841 1774888578.435377 write 0x013082 thru 0x022618 (0xf597 bytes) 000842 1774888578.463711 mapwrite 0x0207ff thru 0x02fc7d (0xf47f bytes) 000843 1774888578.589291 trunc from 0x011f0d to 0x0193f6 (0x74ea bytes) 000844 1774888578.599079 write 0x00c400 thru 0x010112 (0x3d13 bytes) 000845 1774888578.600462 fallocate 0x0064d9 thru 0x01076b (0xa293 bytes) 000847 1774888578.613299 mapread 0x001064 thru 0x0101d9 (0xf176 bytes) 000848 1774888578.619124 mapwrite 0x027476 thru 0x032f50 (0xbadb bytes) 000849 1774888578.664516 punch from 0x02d75e to 0x038452 (0xacf5 bytes) 000850 1774888578.676215 trunc from 0x00fd11 to 0x01b67c (0xb96c bytes) 000852 1774888578.682910 punch from 0x02d248 to 0x02ee0e (0x1bc7 bytes) 000853 1774888578.691861 mapwrite 0x0140bd thru 0x0230e4 (0xf028 bytes) 000854 1774888578.840542 trunc from 0x0071ab to 0x014d28 (0xdb7e bytes) 000856 1774888578.853699 read 0x011828 thru 0x012158 (0x931 bytes) 000857 1774888578.869740 trunc from 0x03a649 to 0x0163a6 (0x242a2 bytes) 000858 1774888578.894621 punch from 0x000fed to 0x009dfe (0x8e12 bytes) 000859 1774888578.900633 read 0x0153b2 thru 0x016256 (0xea5 bytes) 000860 1774888578.901753 mapread 0x015382 thru 0x015e6e (0xaed bytes) 000861 1774888578.903738 mapwrite 0x016524 thru 0x018e30 (0x290d bytes) 000862 1774888578.946761 mapread 0x01403d thru 0x018e30 (0x4df4 bytes) 000863 1774888578.948049 trunc from 0x0131e2 to 0x018e30 (0x5c4f bytes) 000864 1774888578.955057 fallocate 0x035996 thru 0x03ffff (0xa66a bytes) 000865 1774888578.962010 fallocate 0x02ccdf thru 0x037c2b (0xaf4d bytes) 000866 1774888578.969021 mapread 0x021a63 thru 0x02668f (0x4c2d bytes) 000867 1774888578.988380 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x37c2c): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37c2c): Mirror 6: 0x66836623 (stale) Mirror 8: 0x66836623 (stale) Mirror 10: 0x66836623 (stale) Mirror 12: 0x66836623 (stale) Mirror 13: 0x66836623 (stale) Mirror 14: 0x66836623 (stale) Mirror 15: 0x66836623 (stale) Mirror 17: 0x66836623 (stale) CRC-32 checksum value for chunk [0, 0x37c2c): Mirror 1: 0xa2318a2f Mirror 18: 0xa2318a2f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37c2c: skipped 000868 1774888580.397074 mapread 0x024dd9 thru 0x028792 (0x39ba bytes) 000869 1774888580.440619 mapread 0x020579 thru 0x027152 (0x6bda bytes) 000870 1774888580.460534 trunc from 0x02d6c0 to 0x037c2b (0xa56c bytes) 000871 1774888580.513481 write 0x00716b thru 0x009793 (0x2629 bytes) 000872 1774888580.531095 write 0x01f2a1 thru 0x0297cd (0xa52d bytes) 000874 1774888580.568530 write 0x028d27 thru 0x0345d8 (0xb8b2 bytes) 000875 1774888580.581937 mapwrite 0x03cdd9 thru 0x03ffff (0x3227 bytes) 000876 1774888580.649684 punch from 0x03d2da to 0x03ffff (0x2d26 bytes) 000877 1774888580.656034 mapwrite 0x029a7d thru 0x02ff55 (0x64d9 bytes) 000878 1774888580.674102 write 0x01c2c5 thru 0x01def7 (0x1c33 bytes) 000879 1774888580.675557 read 0x030c1b thru 0x03a457 (0x983d bytes) 000880 1774888580.677658 fallocate 0x024a66 thru 0x02c164 (0x76ff bytes) 000881 1774888580.682916 punch from 0x0312f8 to 0x03ce63 (0xbb6c bytes) 000882 1774888580.689423 punch from 0x0085b4 to 0x017c4f (0xf69c bytes) 000883 1774888580.696021 trunc from 0x00acd2 to 0x019143 (0xe472 bytes) 000884 1774888580.702059 mapread 0x01e5ed thru 0x025a35 (0x7449 bytes) 000885 1774888580.703856 write 0x0353ea thru 0x038a99 (0x36b0 bytes) 000887 1774888580.716119 punch from 0x013620 to 0x01af55 (0x7936 bytes) 000888 1774888580.722453 mapwrite 0x039655 thru 0x03af43 (0x18ef bytes) 000889 1774888580.741915 MIRROR_RESYNC 10 mirrors 000890 1774888584.593633 trunc from 0x040000 to 0x0290c6 (0x16f39 bytes) 000891 1774888584.643896 mapread 0x0222c2 thru 0x0290c6 (0x6e05 bytes) 000892 1774888584.677984 punch from 0x0290c2 to 0x0290c6 (0x5 bytes) 000893 1774888584.690830 write 0x03f3fe thru 0x03ffff (0xc02 bytes) 000894 1774888584.692081 trunc from 0x03a8d5 to 0x03ffff (0x572b bytes) 000895 1774888584.722565 mapread 0x030c71 thru 0x03bfb9 (0xb349 bytes) 000896 1774888584.774224 fallocate 0x033bfa thru 0x03ba8b (0x7e92 bytes) 000897 1774888584.784075 MIRROR_EXTEND to 11 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x13f645e5 (stale) Mirror 8: 0x13f645e5 (stale) Mirror 10: 0x13f645e5 (stale) Mirror 12: 0x13f645e5 (stale) Mirror 13: 0x13f645e5 (stale) Mirror 14: 0x13f645e5 (stale) Mirror 15: 0x13f645e5 (stale) Mirror 17: 0x13f645e5 (stale) Mirror 18: 0x13f645e5 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xb50824ea Mirror 19: 0xb50824ea lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000898 1774888586.042860 MIRROR_RESYNC 11 mirrors 000899 1774888588.852866 punch from 0x029520 to 0x038e20 (0xf901 bytes) 000900 1774888588.897101 write 0x0074f8 thru 0x009521 (0x202a bytes) 000901 1774888588.910119 trunc from 0x040000 to 0x03c3ad (0x3c52 bytes) 000902 1774888588.942574 fallocate 0x038ef0 thru 0x03ffff (0x7110 bytes) 000903 1774888588.953240 MIRROR_RESYNC 11 mirrors 000904 1774888592.114872 MIRROR_EXTEND to 12 mirrors 000905 1774888592.954500 mapwrite 0x006b5c thru 0x00fe4b (0x92f0 bytes) 000906 1774888593.084711 write 0x008a7c thru 0x017769 (0xecee bytes) 000907 1774888593.101786 punch from 0x03c2f0 to 0x03ffff (0x3d10 bytes) 000908 1774888593.111058 mapwrite 0x0227a3 thru 0x024120 (0x197e bytes) 000909 1774888593.143522 fallocate 0x000d65 thru 0x010066 (0xf302 bytes) 000910 1774888593.149727 read 0x032f33 thru 0x03a273 (0x7341 bytes) 000911 1774888593.159867 fallocate 0x00a786 thru 0x018d36 (0xe5b1 bytes) 000913 1774888593.166571 fallocate 0x03ee30 thru 0x03ffff (0x11d0 bytes) 000914 1774888593.172680 mapread 0x023bbb thru 0x02584a (0x1c90 bytes) 000915 1774888593.174766 write 0x008e52 thru 0x00c3c2 (0x3571 bytes) 000916 1774888593.177035 mapread 0x036f4a thru 0x03ffff (0x90b6 bytes) 000917 1774888593.186799 mapread 0x0231a7 thru 0x02a49a (0x72f4 bytes) 000918 1774888593.188013 mapread 0x0191b7 thru 0x021701 (0x854b bytes) 000919 1774888593.195730 punch from 0x00ce04 to 0x010cc0 (0x3ebd bytes) 000920 1774888593.210371 trunc from 0x03045d to 0x038bb9 (0x875d bytes) 000921 1774888593.216086 mapwrite 0x01f6dc thru 0x023c6b (0x4590 bytes) 000923 1774888593.232822 read 0x03e8f7 thru 0x03ffff (0x1709 bytes) 000924 1774888593.237739 MIRROR_RESYNC 12 mirrors 000925 1774888597.413343 read 0x003929 thru 0x00a91a (0x6ff2 bytes) 000926 1774888597.432041 punch from 0x02f726 to 0x03463d (0x4f18 bytes) 000927 1774888597.491516 trunc from 0x01a1c2 to 0x025227 (0xb066 bytes) 000928 1774888597.503379 mapwrite 0x035c6a thru 0x03ffff (0xa396 bytes) 000930 1774888597.602114 trunc from 0x040000 to 0x02a328 (0x15cd7 bytes) 000931 1774888597.633218 fallocate 0x01d387 thru 0x026821 (0x949b bytes) 000932 1774888597.642474 fallocate 0x031153 thru 0x039283 (0x8131 bytes) 000933 1774888597.653591 trunc from 0x039284 to 0x037825 (0x1a5e bytes) 000935 1774888597.680713 fallocate 0x02a88b thru 0x039abd (0xf233 bytes) 000936 1774888597.689874 mapread 0x012a70 thru 0x01bce6 (0x9277 bytes) 000937 1774888597.730559 fallocate 0x03214d thru 0x03967a (0x752e bytes) 000938 1774888597.755839 MIRROR_EXTEND to 13 mirrors CRC-32 checksum value for chunk [0, 0x3967b): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3967b): Mirror 6: 0x3a5d698f (stale) Mirror 8: 0x3a5d698f (stale) Mirror 10: 0x3a5d698f (stale) Mirror 12: 0x3a5d698f (stale) Mirror 13: 0x3a5d698f (stale) Mirror 14: 0x3a5d698f (stale) Mirror 15: 0x3a5d698f (stale) Mirror 17: 0x3a5d698f (stale) Mirror 18: 0x3a5d698f (stale) Mirror 19: 0x3a5d698f (stale) Mirror 20: 0x3a5d698f (stale) CRC-32 checksum value for chunk [0, 0x3967b): Mirror 1: 0xc796bf3 Mirror 21: 0xc796bf3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3967b: skipped 000939 1774888599.479756 mapread 0x013fd6 thru 0x01beaf (0x7eda bytes) 000940 1774888599.547674 punch from 0x039420 to 0x03967a (0x25b bytes) 000941 1774888599.645369 punch from 0x025483 to 0x032d59 (0xd8d7 bytes) 000943 1774888599.657878 fallocate 0x038385 thru 0x03ffff (0x7c7b bytes) 000944 1774888599.665453 fallocate 0x039f81 thru 0x03ffff (0x607f bytes) 000945 1774888599.671773 mapwrite 0x0010cc thru 0x0013e2 (0x317 bytes) 000946 1774888599.698129 punch from 0x00b4b6 to 0x010f9a (0x5ae5 bytes) 000947 1774888599.709322 trunc from 0x007726 to 0x0131ee (0xbac9 bytes) 000950 1774888599.718114 trunc from 0x03967b to 0x003900 (0x35d7a bytes) 000952 1774888599.759096 trunc from 0x003901 to 0x0085e4 (0x4ce4 bytes) 000953 1774888599.784067 trunc from 0x0085e5 to 0x004d0b (0x38d9 bytes) 000954 1774888599.810418 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x4d0c): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 17: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x4d0c): Mirror 6: 0xa816284d (stale) Mirror 8: 0xa816284d (stale) Mirror 10: 0xa816284d (stale) Mirror 12: 0xa816284d (stale) Mirror 13: 0xa816284d (stale) Mirror 14: 0xa816284d (stale) Mirror 15: 0xa816284d (stale) Mirror 17: 0xa816284d (stale) Mirror 18: 0xa816284d (stale) Mirror 19: 0xa816284d (stale) Mirror 20: 0xa816284d (stale) Mirror 21: 0xa816284d (stale) CRC-32 checksum value for chunk [0, 0x4d0c): Mirror 1: 0x20f87215 Mirror 22: 0x20f87215 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x4d0c: skipped 000955 1774888601.423510 mapwrite 0x003dc7 thru 0x0106ab (0xc8e5 bytes) 000957 1774888601.631009 write 0x034aff thru 0x034dca (0x2cc bytes) 000958 1774888601.634740 trunc from 0x034dcb to 0x03e6ba (0x98f0 bytes) 000959 1774888601.658695 trunc from 0x021809 to 0x027a5e (0x6256 bytes) 000960 1774888601.665511 write 0x01a82d thru 0x026f05 (0xc6d9 bytes) 000961 1774888601.697874 write 0x011ab0 thru 0x017a9e (0x5fef bytes) 000962 1774888601.717678 read 0x005016 thru 0x00bd15 (0x6d00 bytes) 000963 1774888601.718563 write 0x029ece thru 0x033618 (0x974b bytes) 000964 1774888601.768303 write 0x014b9e thru 0x021ac0 (0xcf23 bytes) 000965 1774888601.779762 mapread 0x000821 thru 0x008b10 (0x82f0 bytes) 000966 1774888601.807383 MIRROR_RESYNC 14 mirrors 000967 1774888604.606034 write 0x0113ec thru 0x011a14 (0x629 bytes) 000968 1774888604.647423 trunc from 0x0084c7 to 0x00b17c (0x2cb6 bytes) 000969 1774888604.653105 fallocate 0x033fc3 thru 0x034f9d (0xfdb bytes) 000971 1774888604.659111 fallocate 0x03d811 thru 0x03ffff (0x27ef bytes) 000972 1774888604.664973 punch from 0x016201 to 0x018616 (0x2416 bytes) 000973 1774888604.671083 punch from 0x03278e to 0x03cc57 (0xa4ca bytes) 000974 1774888604.678232 read 0x014de2 thru 0x01ac9a (0x5eb9 bytes) 000975 1774888604.690109 punch from 0x0243b5 to 0x02a7ea (0x6436 bytes) 000976 1774888604.698935 read 0x010e65 thru 0x01a684 (0x9820 bytes) 000977 1774888604.714429 write 0x022914 thru 0x02f081 (0xc76e bytes) 000978 1774888604.718317 fallocate 0x01287c thru 0x016ab1 (0x4236 bytes) 000980 1774888604.727120 trunc from 0x037779 to 0x03ae11 (0x3699 bytes) 000981 1774888604.733847 mapread 0x02f3b4 thru 0x033953 (0x45a0 bytes) 000982 1774888604.737452 mapread 0x0024da thru 0x00e3a0 (0xbec7 bytes) 000983 1774888604.740008 mapread 0x032ca9 thru 0x03dea4 (0xb1fc bytes) 000984 1774888604.771989 write 0x00c730 thru 0x00d8b3 (0x1184 bytes) 000985 1774888604.774773 punch from 0x02a460 to 0x03808b (0xdc2c bytes) 000986 1774888604.792652 trunc from 0x0077a7 to 0x00cdb5 (0x560f bytes) 000987 1774888604.804592 punch from 0x017e84 to 0x0217ea (0x9967 bytes) 000988 1774888604.814043 trunc from 0x029d94 to 0x035dea (0xc057 bytes) 000989 1774888604.821928 mapread 0x00f497 thru 0x01205f (0x2bc9 bytes) 000990 1774888604.824348 trunc from 0x03e6bb to 0x0351ab (0x950f bytes) 000991 1774888604.855928 MIRROR_SPLIT mirror 8 to 13 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x240000404:0x16b:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x351ac): Mirror 6: 0x499ad72e (stale) Mirror 8: 0x499ad72e (stale) Mirror 10: 0x499ad72e (stale) Mirror 12: 0x499ad72e (stale) Mirror 13: 0x499ad72e (stale) Mirror 14: 0x499ad72e (stale) Mirror 15: 0x499ad72e (stale) Mirror 18: 0x499ad72e (stale) Mirror 19: 0x499ad72e (stale) Mirror 20: 0x499ad72e (stale) Mirror 21: 0x499ad72e (stale) Mirror 22: 0x499ad72e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x351ac): Mirror 6: 0x499ad72e (stale) Mirror 8: 0x499ad72e (stale) Mirror 10: 0x499ad72e (stale) Mirror 12: 0x499ad72e (stale) Mirror 13: 0x499ad72e (stale) Mirror 14: 0x499ad72e (stale) Mirror 15: 0x499ad72e (stale) Mirror 18: 0x499ad72e (stale) Mirror 19: 0x499ad72e (stale) Mirror 20: 0x499ad72e (stale) Mirror 21: 0x499ad72e (stale) Mirror 22: 0x499ad72e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x351ac: skipped 000992 1774888605.568263 mapread 0x0112ed thru 0x012341 (0x1055 bytes) 000993 1774888605.583780 read 0x020683 thru 0x02e6ed (0xe06b bytes) 000994 1774888605.596365 write 0x00a206 thru 0x00f316 (0x5111 bytes) 000995 1774888605.615662 write 0x018224 thru 0x01d4dc (0x52b9 bytes) 000996 1774888605.627383 punch from 0x00d912 to 0x015a66 (0x8155 bytes) 000997 1774888605.650943 write 0x03a8b4 thru 0x03ffff (0x574c bytes) 000999 1774888605.661951 MIRROR_EXTEND to 14 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) Mirror 15: (stale - read error) Mirror 18: (stale - read error) Mirror 19: (stale - read error) Mirror 20: (stale - read error) Mirror 21: (stale - read error) Mirror 22: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 6: 0x11e86894 (stale) Mirror 8: 0x11e86894 (stale) Mirror 10: 0x11e86894 (stale) Mirror 12: 0x11e86894 (stale) Mirror 13: 0x11e86894 (stale) Mirror 14: 0x11e86894 (stale) Mirror 15: 0x11e86894 (stale) Mirror 18: 0x11e86894 (stale) Mirror 19: 0x11e86894 (stale) Mirror 20: 0x11e86894 (stale) Mirror 21: 0x11e86894 (stale) Mirror 22: 0x11e86894 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xadea5a3d Mirror 23: 0xadea5a3d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 001000 1774888607.149782 read 0x0086a8 thru 0x011893 (0x91ec bytes) All operations completed A-OK!