== sanity-flr test 70a: flr mode fsx test ================ 23:47:42 (1788666462) Seed set to 6465 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000003 1788666465.333820 MIRROR_EXTEND to 2 mirrors truncating to largest ever: 0x16711 000004 1788666465.885129 trunc from 00000000 to 0x016710 (0x16711 bytes) 000006 1788666465.974845 mapwrite 0x031a15 thru 0x034c00 (0x31ec bytes) 000007 1788666466.088760 read 0x01630a thru 0x017a10 (0x1707 bytes) 000008 1788666466.094438 read 0x02081a thru 0x0276c9 (0x6eb0 bytes) 000009 1788666466.108579 punch from 0x02d61c to 0x02ed73 (0x1758 bytes) 000011 1788666466.115090 read 0x0316e2 thru 0x034c00 (0x351f bytes) 000012 1788666466.116074 read 0x00466d thru 0x00f663 (0xaff7 bytes) 000013 1788666466.126216 MIRROR_RESYNC 2 mirrors truncating to largest ever: 0x17278 000014 1788666466.855923 trunc from 0x034c01 to 0x017277 (0x1d989 bytes) 000015 1788666466.953257 punch from 0x009a53 to 0x0123c8 (0x8976 bytes) 000016 1788666466.957623 mapread 0x0073c2 thru 0x015739 (0xe378 bytes) 000017 1788666466.982086 mapwrite 0x02f6f7 thru 0x031094 (0x199e bytes) truncating to largest ever: 0x3391b 000021 1788666467.107805 trunc from 0x031095 to 0x03391a (0x2886 bytes) 000022 1788666467.171074 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3391b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3391b): Mirror 2: 0x2a35f96e (stale) CRC-32 checksum value for chunk [0, 0x3391b): Mirror 1: 0x78eeeeaf Mirror 3: 0x78eeeeaf lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3391b: skipped 000023 1788666468.402122 read 0x002c92 thru 0x00f8ee (0xcc5d bytes) 000024 1788666468.439932 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) 000025 1788666468.795548 punch from 0x00764f to 0x0106dc (0x908e bytes) 000026 1788666468.978769 write 0x02ed51 thru 0x034a79 (0x5d29 bytes) 000027 1788666468.991101 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x34a7a): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34a7a): Mirror 3: 0xaf94ce0d (stale) CRC-32 checksum value for chunk [0, 0x34a7a): Mirror 1: 0x87047d98 Mirror 4: 0x87047d98 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34a7a: skipped 000028 1788666470.143693 read 0x02fdd9 thru 0x034a79 (0x4ca1 bytes) 000029 1788666470.158102 mapwrite 0x01af5b thru 0x0243f0 (0x9496 bytes) 000031 1788666470.377180 trunc from 0x034a7a to 0x021406 (0x13673 bytes) 000033 1788666470.410355 MIRROR_RESYNC 3 mirrors 000034 1788666471.418149 mapwrite 0x035735 thru 0x03b065 (0x5931 bytes) 000035 1788666471.623744 write 0x024004 thru 0x025967 (0x1964 bytes) 000037 1788666471.644411 read 0x0373c9 thru 0x03b065 (0x3c9d bytes) 000038 1788666471.650938 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3b066): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b066): Mirror 3: 0x5e711d64 (stale) Mirror 4: 0x5e711d64 (stale) CRC-32 checksum value for chunk [0, 0x3b066): Mirror 1: 0xa2778e38 Mirror 5: 0xa2778e38 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b066: skipped 000040 1788666472.911732 MIRROR_RESYNC 4 mirrors 000041 1788666473.993470 MIRROR_EXTEND to 5 mirrors truncating to largest ever: 0x36633 000042 1788666475.192771 trunc from 0x03b066 to 0x036632 (0x4a33 bytes) 000043 1788666475.262272 mapread 0x003fca thru 0x00a35c (0x6393 bytes) 000044 1788666475.279383 trunc from 0x036633 to 0x017fde (0x1e654 bytes) 000045 1788666475.298111 mapread 0x009207 thru 0x0154b8 (0xc2b2 bytes) 000046 1788666475.307625 mapread 0x0107b7 thru 0x01473f (0x3f89 bytes) 000047 1788666475.313404 MIRROR_RESYNC 5 mirrors 000048 1788666476.363240 mapwrite 0x024abe thru 0x027651 (0x2b94 bytes) 000049 1788666476.576614 punch from 0x004fd2 to 0x00d0e3 (0x8112 bytes) 000050 1788666476.587529 read 0x01b42f thru 0x021702 (0x62d4 bytes) 000051 1788666476.599818 write 0x03a86b thru 0x03cfd9 (0x276f bytes) 000052 1788666476.611733 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x3cfda): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3cfda): Mirror 3: 0x7839c007 (stale) Mirror 4: 0x7839c007 (stale) Mirror 5: 0x7839c007 (stale) Mirror 6: 0x7839c007 (stale) CRC-32 checksum value for chunk [0, 0x3cfda): Mirror 1: 0x1e4c0c32 Mirror 7: 0x1e4c0c32 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3cfda: skipped 000056 1788666478.080345 punch from 0x017b1f to 0x01eaec (0x6fce bytes) 000058 1788666478.155794 trunc from 0x03cfda to 0x016cd2 (0x26307 bytes) 000059 1788666478.182029 read 0x008243 thru 0x012862 (0xa620 bytes) 000061 1788666478.203619 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x16cd3): Mirror 4: 0xbed8a8c8 (stale) Mirror 5: 0xbed8a8c8 (stale) Mirror 6: 0xbed8a8c8 (stale) Mirror 7: 0xbed8a8c8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x16cd3): Mirror 4: 0xbed8a8c8 (stale) Mirror 5: 0xbed8a8c8 (stale) Mirror 6: 0xbed8a8c8 (stale) Mirror 7: 0xbed8a8c8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x16cd3: skipped 000065 1788666478.603944 read 0x00f789 thru 0x011b15 (0x238d bytes) truncating to largest ever: 0x3a8ec 000066 1788666478.615731 trunc from 0x016cd3 to 0x03a8eb (0x23c19 bytes) 000067 1788666478.634535 read 0x01fda7 thru 0x02dfd5 (0xe22f bytes) 000068 1788666478.647977 read 0x0179d4 thru 0x01d884 (0x5eb1 bytes) 000069 1788666478.648565 mapwrite 0x02f9e1 thru 0x0338e5 (0x3f05 bytes) 000070 1788666478.699371 write 0x0350b5 thru 0x03f1ca (0xa116 bytes) 000071 1788666478.700706 punch from 0x022bad to 0x02b04b (0x849f bytes) 000072 1788666478.714858 mapread 0x0148cd thru 0x0167fc (0x1f30 bytes) 000074 1788666478.721064 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f1cb): Mirror 5: 0xc86a6019 (stale) Mirror 6: 0xc86a6019 (stale) Mirror 7: 0xfba3f842 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f1cb): Mirror 5: 0xc86a6019 (stale) Mirror 6: 0xc86a6019 (stale) Mirror 7: 0xfba3f842 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f1cb: skipped 000075 1788666479.123271 punch from 0x00eee6 to 0x01223b (0x3356 bytes) 000077 1788666479.137175 MIRROR_RESYNC 4 mirrors 000078 1788666480.326396 punch from 0x019523 to 0x01b325 (0x1e03 bytes) 000081 1788666480.481724 MIRROR_RESYNC 4 mirrors 000082 1788666481.773157 write 0x0167db thru 0x02051b (0x9d41 bytes) 000083 1788666481.873153 punch from 0x03d764 to 0x03f1ca (0x1a67 bytes) 000084 1788666481.890787 write 0x00a9c5 thru 0x00b15f (0x79b bytes) 000086 1788666481.902774 mapwrite 0x007ad5 thru 0x014040 (0xc56c bytes) 000090 1788666482.022606 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f1cb): Mirror 5: 0x87ecb0d4 (stale) Mirror 6: 0x87ecb0d4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f1cb): Mirror 5: 0x87ecb0d4 (stale) Mirror 6: 0x87ecb0d4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f1cb: skipped 000092 1788666482.484094 mapwrite 0x02c052 thru 0x03bedc (0xfe8b bytes) 000095 1788666482.564412 write 0x01cf0d thru 0x01fba0 (0x2c94 bytes) 000096 1788666482.574229 mapread 0x009ddb thru 0x019948 (0xfb6e bytes) 000097 1788666482.587754 read 0x017d0f thru 0x018020 (0x312 bytes) 000098 1788666482.588775 write 0x00cbd4 thru 0x016c7e (0xa0ab bytes) 000099 1788666482.593757 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3f1cb): Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f1cb): Mirror 5: 0x87ecb0d4 (stale) Mirror 6: 0x87ecb0d4 (stale) CRC-32 checksum value for chunk [0, 0x3f1cb): Mirror 1: 0xbc727e67 Mirror 7: 0xbc727e67 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f1cb: skipped 000100 1788666483.566926 read 0x03c1aa thru 0x03f1ca (0x3021 bytes) 000101 1788666483.578610 mapwrite 0x01a419 thru 0x022b5b (0x8743 bytes) 000103 1788666483.825347 read 0x03136e thru 0x0354d7 (0x416a bytes) 000104 1788666483.836630 punch from 0x025e44 to 0x0298ad (0x3a6a bytes) 000105 1788666483.843228 read 0x034aa9 thru 0x03f1ca (0xa722 bytes) 000106 1788666483.844336 trunc from 0x03f1cb to 0x017d54 (0x27476 bytes) 000109 1788666483.876146 MIRROR_RESYNC 4 mirrors 000110 1788666485.007544 read 0x002203 thru 0x006503 (0x4301 bytes) 000111 1788666485.014117 mapwrite 0x00ed29 thru 0x01ed04 (0xffdc bytes) 000112 1788666485.178781 write 0x035944 thru 0x036fce (0x168b bytes) 000113 1788666485.180556 read 0x015fa3 thru 0x0160ec (0x14a bytes) 000114 1788666485.181551 read 0x02fa0a thru 0x036fce (0x75c5 bytes) 000115 1788666485.188566 write 0x007efe thru 0x012fcf (0xb0d2 bytes) 000116 1788666485.190184 mapwrite 0x037960 thru 0x03ffff (0x86a0 bytes) 000117 1788666485.264753 read 0x023462 thru 0x02a9d3 (0x7572 bytes) 000119 1788666485.265851 write 0x01f348 thru 0x027cd8 (0x8991 bytes) truncating to largest ever: 0x3bbfc 000120 1788666485.268050 trunc from 0x040000 to 0x03bbfb (0x4404 bytes) 000121 1788666485.282337 write 0x0228b9 thru 0x02c836 (0x9f7e bytes) 000122 1788666485.283606 read 0x033ba5 thru 0x03bbfb (0x8057 bytes) 000124 1788666485.286162 trunc from 0x03bbfc to 0x02aa9f (0x1115c bytes) 000125 1788666485.304127 trunc from 0x02aaa0 to 0x0198af (0x111f0 bytes) 000126 1788666485.319072 mapwrite 0x002355 thru 0x00c87a (0xa526 bytes) 000127 1788666485.370730 trunc from 0x0198b0 to 0x00ce27 (0xca88 bytes) 000129 1788666485.384345 read 0x00439a thru 0x0043f6 (0x5d bytes) 000132 1788666485.391053 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0xce28): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xce28): Mirror 5: 0xa96469c (stale) Mirror 6: 0xa96469c (stale) Mirror 7: 0xa96469c (stale) CRC-32 checksum value for chunk [0, 0xce28): Mirror 1: 0x201cb893 Mirror 8: 0x201cb893 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xce28: skipped 000133 1788666486.062800 trunc from 0x00ce28 to 0x001eb9 (0xaf6e bytes) 000134 1788666486.179766 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1eba): Mirror 5: 0xf6c95c89 (stale) Mirror 6: 0xf6c95c89 (stale) Mirror 7: 0xf6c95c89 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1eba): Mirror 5: 0xf6c95c89 (stale) Mirror 6: 0xf6c95c89 (stale) Mirror 7: 0xf6c95c89 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1eba: skipped 000135 1788666486.582503 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1eba): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1eba): Mirror 5: 0xf6c95c89 (stale) Mirror 6: 0xf6c95c89 (stale) Mirror 7: 0xf6c95c89 (stale) CRC-32 checksum value for chunk [0, 0x1eba): Mirror 1: 0xf6c95c89 Mirror 8: 0xf6c95c89 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1eba: skipped 000137 1788666487.769919 read 0x001843 thru 0x001eb9 (0x677 bytes) 000138 1788666487.791073 mapread 0x0013ac thru 0x001eb9 (0xb0e bytes) 000139 1788666487.796030 trunc from 0x001eba to 0x00bc8c (0x9dd3 bytes) 000141 1788666487.963667 write 0x000f95 thru 0x010a54 (0xfac0 bytes) 000142 1788666487.971807 mapwrite 0x03967d thru 0x03ffff (0x6983 bytes) 000143 1788666488.106177 write 0x0150bb thru 0x01e50c (0x9452 bytes) 000144 1788666488.116253 mapwrite 0x02bf17 thru 0x02eaa0 (0x2b8a bytes) 000145 1788666488.173606 punch from 0x028e16 to 0x036398 (0xd583 bytes) 000146 1788666488.183036 MIRROR_RESYNC 5 mirrors 000150 1788666490.368222 punch from 0x017cff to 0x01dd92 (0x6094 bytes) 000151 1788666490.485128 write 0x03746d thru 0x03ffff (0x8b93 bytes) 000152 1788666490.493557 write 0x02f9c8 thru 0x0399ea (0xa023 bytes) 000153 1788666490.509119 mapread 0x00c1d9 thru 0x01abe8 (0xea10 bytes) 000155 1788666490.551473 trunc from 0x040000 to 0x02d5cb (0x12a34 bytes) 000158 1788666490.634870 mapwrite 0x03c0af thru 0x03ffff (0x3f51 bytes) 000160 1788666490.782447 punch from 0x02b44c to 0x037d14 (0xc8c9 bytes) 000161 1788666490.787268 write 0x010320 thru 0x01eb49 (0xe82a bytes) 000163 1788666490.791292 trunc from 0x040000 to 0x022dfd (0x1d202 bytes) 000164 1788666490.838145 write 0x02137c thru 0x0226bb (0x1340 bytes) 000165 1788666490.854655 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x22dfe): Mirror 5: 0x9851e335 (stale) Mirror 6: 0x9851e335 (stale) Mirror 7: 0x9851e335 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x22dfe): Mirror 5: 0x9851e335 (stale) Mirror 6: 0x9851e335 (stale) Mirror 7: 0x9851e335 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x22dfe: skipped 000166 1788666491.334553 write 0x01da3c thru 0x02322d (0x57f2 bytes) 000167 1788666491.341029 write 0x019d8f thru 0x0275c9 (0xd83b bytes) 000168 1788666491.351625 read 0x024b4f thru 0x027431 (0x28e3 bytes) 000172 1788666491.357544 trunc from 0x0275ca to 0x018f15 (0xe6b4 bytes) 000173 1788666491.389298 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x18f16): Mirror 5: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18f16): Mirror 5: 0xbc7b3a2a (stale) Mirror 6: 0xbc7b3a2a (stale) Mirror 7: 0xbc7b3a2a (stale) CRC-32 checksum value for chunk [0, 0x18f16): Mirror 1: 0xe93b0342 Mirror 8: 0xe93b0342 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18f16: skipped 000174 1788666492.539312 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x18f16): Mirror 6: 0xbc7b3a2a (stale) Mirror 7: 0xbc7b3a2a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x18f16): Mirror 6: 0xbc7b3a2a (stale) Mirror 7: 0xbc7b3a2a (stale) CRC-32 checksum value for chunk [0, 0x18f16): Mirror 1: 0xe93b0342 Mirror 8: 0xe93b0342 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x18f16: skipped 000175 1788666493.204357 MIRROR_RESYNC 4 mirrors 000176 1788666494.156932 mapwrite 0x036728 thru 0x0368af (0x188 bytes) 000177 1788666494.284191 mapread 0x0350e7 thru 0x0368af (0x17c9 bytes) 000178 1788666494.297357 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x368b0): Mirror 6: 0x172a15c8 (stale) Mirror 7: 0x172a15c8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x368b0): Mirror 6: 0x172a15c8 (stale) Mirror 7: 0x172a15c8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x368b0: skipped 000180 1788666494.743228 punch from 0x00ee03 to 0x00eeef (0xed bytes) 000181 1788666494.748377 trunc from 0x0368b0 to 0x01005a (0x26855 bytes) 000183 1788666494.767006 mapread 0x001e20 thru 0x008bc1 (0x6da2 bytes) 000184 1788666494.786611 mapwrite 0x001a1b thru 0x00d914 (0xbefa bytes) 000186 1788666494.842367 mapread 0x00f0fe thru 0x01005a (0xf5d bytes) 000187 1788666494.843992 mapwrite 0x034ffc thru 0x03f592 (0xa597 bytes) 000191 1788666494.945922 mapread 0x008870 thru 0x01281d (0x9fae bytes) 000192 1788666494.959666 write 0x01a1b3 thru 0x01fcdf (0x5b2d bytes) 000193 1788666494.971183 punch from 0x014de1 to 0x01e678 (0x9898 bytes) 000194 1788666494.986381 read 0x03345b thru 0x03f592 (0xc138 bytes) 000196 1788666494.989522 mapread 0x0129a8 thru 0x020171 (0xd7ca bytes) 000197 1788666495.006575 punch from 0x039a2e to 0x03f592 (0x5b65 bytes) 000198 1788666495.018805 punch from 0x029745 to 0x035b55 (0xc411 bytes) 000201 1788666495.025324 mapread 0x031078 thru 0x03f592 (0xe51b bytes) 000203 1788666495.041623 read 0x00f336 thru 0x014fb6 (0x5c81 bytes) 000205 1788666495.042720 write 0x024616 thru 0x031484 (0xce6f bytes) 000206 1788666495.045434 mapwrite 0x0136ae thru 0x016805 (0x3158 bytes) 000207 1788666495.090218 mapwrite 0x020b8b thru 0x024f55 (0x43cb bytes) 000208 1788666495.142071 trunc from 0x03f593 to 0x00b191 (0x34401 bytes) 000209 1788666495.164353 trunc from 0x00b192 to 0x001f9f (0x91f2 bytes) 000210 1788666495.181131 read 0x001575 thru 0x001f9f (0xa2b bytes) 000212 1788666495.188012 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1fa0): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fa0): Mirror 6: 0x8a683c33 (stale) Mirror 7: 0x8a683c33 (stale) CRC-32 checksum value for chunk [0, 0x1fa0): Mirror 1: 0xbd625616 Mirror 8: 0xbd625616 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fa0: skipped 000213 1788666496.073376 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1fa0): Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1fa0): Mirror 6: 0x8a683c33 (stale) Mirror 7: 0x8a683c33 (stale) CRC-32 checksum value for chunk [0, 0x1fa0): Mirror 1: 0xbd625616 Mirror 8: 0xbd625616 Mirror 9: 0xbd625616 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1fa0: skipped 000214 1788666497.053787 punch from 0x000fbf to 0x001f9f (0xfe1 bytes) 000215 1788666497.160242 read 0x001d79 thru 0x001f9f (0x227 bytes) 000216 1788666497.172076 mapwrite 0x037dac thru 0x03ba2b (0x3c80 bytes) 000218 1788666497.310793 trunc from 0x03ba2c to 0x03b5e7 (0x444 bytes) 000219 1788666497.350323 punch from 0x0239f1 to 0x02d940 (0x9f50 bytes) 000220 1788666497.355288 trunc from 0x03b5e8 to 0x01e376 (0x1d271 bytes) 000221 1788666497.392621 mapread 0x00aad6 thru 0x015e87 (0xb3b2 bytes) 000223 1788666497.425449 trunc from 0x01e377 to 0x0283d1 (0xa05b bytes) 000224 1788666497.441472 punch from 0x00c180 to 0x012aae (0x692f bytes) 000225 1788666497.446570 read 0x006ff3 thru 0x014562 (0xd570 bytes) 000226 1788666497.459945 write 0x02a30e thru 0x036cc1 (0xc9b4 bytes) 000227 1788666497.462863 trunc from 0x036cc2 to 0x014c12 (0x220af bytes) 000228 1788666497.484494 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x14c13): Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x14c13): Mirror 6: 0x2a0f8a74 (stale) Mirror 7: 0x2a0f8a74 (stale) Mirror 8: 0xf0dfefa0 (stale) Mirror 9: 0xf0dfefa0 (stale) CRC-32 checksum value for chunk [0, 0x14c13): Mirror 1: 0xfb3d9869 Mirror 10: 0xfb3d9869 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x14c13: skipped 000229 1788666498.882387 punch from 0x00d8a6 to 0x014c12 (0x736d bytes) 000231 1788666498.971020 mapread 0x00372a thru 0x008fed (0x58c4 bytes) 000232 1788666498.999540 mapwrite 0x02309b thru 0x023239 (0x19f bytes) 000233 1788666499.116777 punch from 0x01a5b2 to 0x023070 (0x8abf bytes) 000234 1788666499.123303 read 0x0150ec thru 0x01bbd5 (0x6aea bytes) 000235 1788666499.134822 mapread 0x00c497 thru 0x010352 (0x3ebc bytes) 000237 1788666499.136864 write 0x00f303 thru 0x0108c5 (0x15c3 bytes) 000239 1788666499.139204 trunc from 0x02323a to 0x033837 (0x105fe bytes) 000240 1788666499.164533 MIRROR_RESYNC 6 mirrors 000242 1788666502.329314 trunc from 0x033838 to 0x009523 (0x2a314 bytes) 000243 1788666502.471992 mapread 0x0086d6 thru 0x009523 (0xe4e bytes) 000244 1788666502.489422 mapwrite 0x016487 thru 0x01d0ec (0x6c66 bytes) 000245 1788666502.613010 write 0x03e235 thru 0x03ffff (0x1dcb bytes) 000246 1788666502.615840 write 0x02f615 thru 0x02fc54 (0x640 bytes) 000247 1788666502.626523 write 0x0367bc thru 0x03a0f8 (0x393d bytes) 000248 1788666502.639496 trunc from 0x040000 to 0x0306d5 (0xf92a bytes) 000249 1788666502.662101 mapread 0x01c8a0 thru 0x023723 (0x6e84 bytes) 000250 1788666502.678540 trunc from 0x0306d6 to 0x0036f6 (0x2cfdf bytes) 000251 1788666502.703823 read 0x000959 thru 0x0036f6 (0x2d9e bytes) 000252 1788666502.714512 punch from 0x001461 to 0x001cdf (0x87f bytes) 000253 1788666502.721068 write 0x007705 thru 0x00bd21 (0x461d bytes) 000254 1788666502.722992 punch from 0x002e64 to 0x005b04 (0x2ca1 bytes) 000255 1788666502.740087 mapwrite 0x01fd57 thru 0x027743 (0x79ed bytes) 000258 1788666502.880850 punch from 0x017458 to 0x025352 (0xdefb bytes) 000259 1788666502.892541 punch from 0x004a1e to 0x01319b (0xe77e bytes) 000261 1788666502.911541 write 0x0096dd thru 0x0145c0 (0xaee4 bytes) 000262 1788666502.939238 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x27744): Mirror 7: 0x582bb677 (stale) Mirror 8: 0x582bb677 (stale) Mirror 9: 0x582bb677 (stale) Mirror 10: 0x582bb677 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x27744): Mirror 7: 0x582bb677 (stale) Mirror 8: 0x582bb677 (stale) Mirror 9: 0x582bb677 (stale) Mirror 10: 0x582bb677 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x27744: skipped 000263 1788666503.589458 mapread 0x0058d5 thru 0x0110c0 (0xb7ec bytes) truncating to largest ever: 0x3c0db 000266 1788666503.613957 trunc from 0x027744 to 0x03c0da (0x14997 bytes) 000267 1788666503.635219 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c0db): Mirror 8: 0xf55d581f (stale) Mirror 9: 0xf55d581f (stale) Mirror 10: 0xf55d581f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c0db): Mirror 8: 0xf55d581f (stale) Mirror 9: 0xf55d581f (stale) Mirror 10: 0xf55d581f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c0db: skipped 000268 1788666503.929418 trunc from 0x03c0db to 0x03b1d5 (0xf05 bytes) 000269 1788666503.948064 read 0x005860 thru 0x00b5a9 (0x5d4a bytes) truncating to largest ever: 0x3fbdd 000270 1788666503.959042 trunc from 0x03b1d6 to 0x03fbdc (0x4a07 bytes) 000271 1788666503.976172 mapwrite 0x014bcc thru 0x023264 (0xe699 bytes) 000272 1788666504.052436 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x3fbdd): Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fbdd): Mirror 8: 0x7c8ae661 (stale) Mirror 9: 0x7c8ae661 (stale) Mirror 10: 0x7c8ae661 (stale) CRC-32 checksum value for chunk [0, 0x3fbdd): Mirror 1: 0x9bf40ed9 Mirror 11: 0x9bf40ed9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fbdd: skipped 000273 1788666505.150838 mapwrite 0x02c47c thru 0x033bfa (0x777f bytes) 000274 1788666505.401926 trunc from 0x03fbdd to 0x007e8d (0x37d4f bytes) 000276 1788666505.426510 mapread 0x0039e2 thru 0x007e8d (0x44ac bytes) 000280 1788666505.461347 mapwrite 0x02d6c5 thru 0x03565a (0x7f96 bytes) 000281 1788666505.704706 punch from 0x021ccf to 0x021eb0 (0x1e2 bytes) 000283 1788666505.717970 mapread 0x01b3c5 thru 0x028b7d (0xd7b9 bytes) 000284 1788666505.768227 mapwrite 0x017366 thru 0x01f269 (0x7f04 bytes) 000285 1788666505.852611 trunc from 0x03565b to 0x00f8cf (0x25d8b bytes) 000287 1788666505.879139 mapread 0x004b1f thru 0x00f8cf (0xadb1 bytes) 000288 1788666505.892178 write 0x01d2f1 thru 0x0222e3 (0x4ff3 bytes) 000289 1788666505.894411 mapread 0x00d329 thru 0x0193bd (0xc095 bytes) 000290 1788666505.915384 MIRROR_RESYNC 5 mirrors 000291 1788666507.416147 mapread 0x000471 thru 0x00354b (0x30db bytes) 000292 1788666507.440938 mapwrite 0x01a684 thru 0x02a429 (0xfda6 bytes) 000293 1788666507.591306 punch from 0x000fb8 to 0x003b48 (0x2b91 bytes) 000295 1788666507.603088 read 0x029381 thru 0x02a429 (0x10a9 bytes) 000296 1788666507.603788 trunc from 0x02a42a to 0x0327b3 (0x838a bytes) 000297 1788666507.657920 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x327b4): Mirror 8: 0x7de6c454 (stale) Mirror 10: 0x7de6c454 (stale) Mirror 11: 0x7de6c454 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x327b4): Mirror 8: 0x7de6c454 (stale) Mirror 10: 0x7de6c454 (stale) Mirror 11: 0x7de6c454 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x327b4: skipped 000298 1788666508.108683 trunc from 0x0327b4 to 0x0039a7 (0x2ee0c bytes) 000299 1788666508.153557 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39a8): Mirror 8: 0x9286e525 (stale) Mirror 11: 0x9286e525 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39a8): Mirror 8: 0x9286e525 (stale) Mirror 11: 0x9286e525 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39a8: skipped 000300 1788666508.411322 mapread 0x002396 thru 0x0039a7 (0x1612 bytes) 000301 1788666508.428309 MIRROR_RESYNC 3 mirrors 000302 1788666509.678952 MIRROR_EXTEND to 4 mirrors 000303 1788666510.289867 mapwrite 0x020edc thru 0x02bd52 (0xae77 bytes) 000306 1788666510.570349 write 0x01751c thru 0x01f4be (0x7fa3 bytes) 000307 1788666510.585243 mapread 0x007e2e thru 0x01728b (0xf45e bytes) 000308 1788666510.607784 punch from 0x01b327 to 0x023f60 (0x8c3a bytes) 000309 1788666510.620151 read 0x00ca0f thru 0x00e658 (0x1c4a bytes) 000311 1788666510.622227 punch from 0x0224e9 to 0x02bd52 (0x986a bytes) 000312 1788666510.631471 MIRROR_RESYNC 4 mirrors 000313 1788666512.254843 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) 000314 1788666512.769206 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) 000317 1788666513.100485 read 0x0102bb thru 0x017ad4 (0x781a bytes) 000318 1788666513.109633 trunc from 0x02bd53 to 0x03e1d8 (0x12486 bytes) 000319 1788666513.269594 read 0x0088aa thru 0x00b84f (0x2fa6 bytes) 000320 1788666513.281139 mapwrite 0x006d3a thru 0x00f2c3 (0x858a bytes) 000322 1788666513.331448 write 0x018063 thru 0x01f17e (0x711c bytes) 000324 1788666513.338270 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e1d9): Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e1d9): Mirror 12: 0xe93e7d25 (stale) CRC-32 checksum value for chunk [0, 0x3e1d9): Mirror 1: 0x9c5ff95f Mirror 13: 0x9c5ff95f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e1d9: skipped 000325 1788666514.990279 trunc from 0x03e1d9 to 0x03661a (0x7bbe bytes) 000326 1788666515.072519 mapread 0x00d296 thru 0x01abca (0xd935 bytes) 000327 1788666515.117190 mapread 0x006cba thru 0x00c0b7 (0x53fe bytes) 000329 1788666515.134226 mapwrite 0x039838 thru 0x03ffff (0x67c8 bytes) 000330 1788666515.232149 mapread 0x017daf thru 0x01d4dc (0x572e bytes) 000331 1788666515.234548 mapread 0x0009b1 thru 0x00844f (0x7a9f bytes) 000332 1788666515.250783 mapread 0x01a4c5 thru 0x01c02e (0x1b6a bytes) 000333 1788666515.252200 mapread 0x00c8d5 thru 0x01040b (0x3b37 bytes) 000334 1788666515.253640 trunc from 0x040000 to 0x03888e (0x7771 bytes) 000336 1788666515.275447 write 0x03bc33 thru 0x03ffff (0x43cd bytes) 000338 1788666515.280024 write 0x0325ca thru 0x03c176 (0x9bad bytes) 000339 1788666515.291608 mapread 0x03bbdb thru 0x03ffff (0x4425 bytes) 000341 1788666515.293448 trunc from 0x040000 to 0x033914 (0xc6eb bytes) 000342 1788666515.325624 read 0x02a590 thru 0x033914 (0x9385 bytes) 000343 1788666515.344642 punch from 0x01381e to 0x01a2cc (0x6aaf bytes) 000345 1788666515.355725 trunc from 0x033915 to 0x03540c (0x1af8 bytes) 000348 1788666515.386322 trunc from 0x03540d to 0x0289d4 (0xca38 bytes) 000350 1788666515.409589 punch from 0x020af2 to 0x0289d4 (0x7ee3 bytes) 000351 1788666515.415609 trunc from 0x0289d5 to 0x0351a0 (0xc7cc bytes) 000352 1788666515.439130 read 0x01c46e thru 0x020a32 (0x45c5 bytes) 000354 1788666515.452442 read 0x015753 thru 0x01ee18 (0x96c6 bytes) 000355 1788666515.459543 MIRROR_RESYNC 3 mirrors 000356 1788666516.674449 trunc from 0x0351a1 to 0x03c53b (0x739b bytes) 000358 1788666516.759791 mapread 0x016f3a thru 0x021717 (0xa7de bytes) 000359 1788666516.815200 trunc from 0x03c53c to 0x02345f (0x190dc bytes) 000360 1788666516.843302 mapread 0x01e5de thru 0x02345f (0x4e82 bytes) 000362 1788666516.858173 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x23460): Mirror 13: 0x1814b889 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23460): Mirror 13: 0x1814b889 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23460: skipped 000363 1788666517.299041 trunc from 0x023460 to 0x0014bb (0x21fa4 bytes) 000364 1788666517.329515 trunc from 0x0014bc to 0x0264b4 (0x24ff9 bytes) 000365 1788666517.371416 MIRROR_RESYNC 2 mirrors 000368 1788666518.190286 mapwrite 0x006fb7 thru 0x010a18 (0x9a62 bytes) 000369 1788666518.365111 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) 000370 1788666518.555407 trunc from 0x0264b5 to 0x0084e9 (0x1dfcb bytes) 000371 1788666518.586588 write 0x01a95d thru 0x02a558 (0xfbfc bytes) 000372 1788666518.589134 trunc from 0x02a559 to 0x01b233 (0xf325 bytes) 000373 1788666518.613517 write 0x02e0a3 thru 0x03e02d (0xff8b bytes) 000375 1788666518.616626 read 0x0323d0 thru 0x03e02d (0xbc5e bytes) 000376 1788666518.617970 mapwrite 0x0296cd thru 0x02e356 (0x4c8a bytes) 000378 1788666518.742062 write 0x0214b7 thru 0x028263 (0x6dad bytes) 000380 1788666518.751030 mapread 0x027431 thru 0x02c0ef (0x4cbf bytes) 000384 1788666518.758017 mapwrite 0x0378c6 thru 0x03ffff (0x873a bytes) 000386 1788666518.874718 mapwrite 0x01cbcb thru 0x01fe39 (0x326f bytes) 000387 1788666519.031996 write 0x030794 thru 0x03b703 (0xaf70 bytes) 000388 1788666519.035355 mapread 0x031f3f thru 0x03eeb9 (0xcf7b bytes) 000389 1788666519.045028 mapread 0x01e722 thru 0x027e32 (0x9711 bytes) 000390 1788666519.059443 write 0x00fc81 thru 0x013a0d (0x3d8d bytes) 000391 1788666519.074785 trunc from 0x040000 to 0x005734 (0x3a8cb bytes) 000392 1788666519.099381 MIRROR_EXTEND to 2 mirrors 000393 1788666520.008457 mapread 0x002f01 thru 0x005734 (0x2834 bytes) 000394 1788666520.044904 mapwrite 0x0259c9 thru 0x034c56 (0xf28e bytes) 000396 1788666520.203066 mapwrite 0x02bf24 thru 0x03ae15 (0xeef2 bytes) 000397 1788666520.273141 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3ae16): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ae16): Mirror 2: 0x361d0b3f (stale) CRC-32 checksum value for chunk [0, 0x3ae16): Mirror 1: 0x3bbf993f Mirror 3: 0x3bbf993f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ae16: skipped 000398 1788666521.018950 punch from 0x004ffb to 0x00e8a8 (0x98ae bytes) 000399 1788666521.082323 punch from 0x00ca86 to 0x016411 (0x998c bytes) 000400 1788666521.087828 write 0x0075ce thru 0x015666 (0xe099 bytes) 000402 1788666521.098481 mapread 0x023d51 thru 0x02f260 (0xb510 bytes) 000403 1788666521.120414 trunc from 0x03ae16 to 0x01c572 (0x1e8a3 bytes) 000404 1788666521.162178 MIRROR_RESYNC 3 mirrors 000406 1788666522.134505 read 0x006eec thru 0x00b98d (0x4aa2 bytes) 000407 1788666522.160554 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) 000408 1788666522.470224 write 0x030877 thru 0x03b79f (0xaf29 bytes) 000409 1788666522.551805 mapwrite 0x0365bc thru 0x03ce84 (0x68c9 bytes) 000411 1788666522.637048 trunc from 0x03ce85 to 0x01cafb (0x20389 bytes) 000413 1788666522.662983 trunc from 0x01cafc to 0x01f4ef (0x29f4 bytes) 000414 1788666522.679451 mapread 0x006b45 thru 0x0094fe (0x29ba bytes) 000415 1788666522.693395 mapwrite 0x023ed3 thru 0x0261a1 (0x22cf bytes) 000416 1788666522.789985 MIRROR_RESYNC 2 mirrors 000418 1788666523.664745 write 0x01fd8d thru 0x02da92 (0xdd06 bytes) 000419 1788666523.738256 mapwrite 0x028ade thru 0x035e17 (0xd33a bytes) 000420 1788666523.841565 MIRROR_RESYNC 2 mirrors 000421 1788666524.763094 punch from 0x001f5a to 0x00a060 (0x8107 bytes) 000422 1788666524.857251 read 0x02f383 thru 0x035e17 (0x6a95 bytes) 000423 1788666524.869072 mapwrite 0x025d9e thru 0x02f79b (0x99fe bytes) 000424 1788666524.973227 mapread 0x0233c0 thru 0x028f5e (0x5b9f bytes) 000426 1788666524.974568 mapread 0x013a75 thru 0x02256e (0xeafa bytes) 000427 1788666524.992270 trunc from 0x035e18 to 0x00591f (0x304f8 bytes) 000429 1788666525.015545 write 0x00f54b thru 0x01730a (0x7dc0 bytes) 000431 1788666525.018434 mapwrite 0x003115 thru 0x00e183 (0xb06f bytes) 000433 1788666525.094773 mapread 0x012e65 thru 0x01730a (0x44a6 bytes) 000434 1788666525.096627 trunc from 0x01730b to 0x033a1f (0x1c715 bytes) 000435 1788666525.128211 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) 000436 1788666525.307382 trunc from 0x033a20 to 0x00a766 (0x292b9 bytes) 000437 1788666525.320464 trunc from 0x00a767 to 0x012a02 (0x829c bytes) 000438 1788666525.343246 mapwrite 0x01bb54 thru 0x01f5a1 (0x3a4e bytes) 000439 1788666525.452819 mapread 0x004790 thru 0x014649 (0xfeba bytes) 000440 1788666525.487019 mapwrite 0x02adc1 thru 0x0300d6 (0x5316 bytes) 000441 1788666525.583591 punch from 0x026374 to 0x0300d6 (0x9d63 bytes) 000442 1788666525.588132 punch from 0x02ce58 to 0x02f61b (0x27c4 bytes) 000443 1788666525.599858 mapwrite 0x02b0ef thru 0x02f739 (0x464b bytes) 000444 1788666525.665541 punch from 0x0085ac to 0x015a48 (0xd49d bytes) 000445 1788666525.670544 mapread 0x02d0b7 thru 0x0300d6 (0x3020 bytes) 000446 1788666525.671996 read 0x004452 thru 0x004d2a (0x8d9 bytes) 000449 1788666525.675152 trunc from 0x0300d7 to 0x0111ea (0x1eeec bytes) 000452 1788666525.695790 mapwrite 0x032ec1 thru 0x03362b (0x76b bytes) 000454 1788666525.812620 write 0x001607 thru 0x0017b8 (0x1b2 bytes) 000455 1788666525.817627 punch from 0x0215ab to 0x03108c (0xfae2 bytes) 000456 1788666525.837168 MIRROR_EXTEND to 2 mirrors 000457 1788666526.823404 trunc from 0x03362c to 0x02be4f (0x77dc bytes) 000459 1788666526.921687 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) 000460 1788666527.071802 mapwrite 0x0181df thru 0x01901f (0xe41 bytes) 000461 1788666527.126975 read 0x020c0c thru 0x0250e5 (0x44da bytes) 000463 1788666527.135407 punch from 0x00125c to 0x00735b (0x6100 bytes) 000464 1788666527.139556 write 0x003e03 thru 0x00d845 (0x9a43 bytes) 000466 1788666527.149556 write 0x03b058 thru 0x03ffff (0x4fa8 bytes) 000468 1788666527.151834 mapread 0x02450e thru 0x02bc0d (0x7700 bytes) 000469 1788666527.161623 mapread 0x0345cd thru 0x039568 (0x4f9c bytes) 000471 1788666527.181782 punch from 0x00714a to 0x010201 (0x90b8 bytes) 000472 1788666527.200089 read 0x03f2cc thru 0x03f8ba (0x5ef bytes) 000473 1788666527.200931 write 0x038b25 thru 0x03ffff (0x74db bytes) 000474 1788666527.203387 write 0x030127 thru 0x030d87 (0xc61 bytes) 000475 1788666527.204850 punch from 0x00096b to 0x00e05d (0xd6f3 bytes) 000476 1788666527.219003 punch from 0x02ae79 to 0x034443 (0x95cb bytes) 000478 1788666527.230806 mapread 0x032e8d thru 0x036e5e (0x3fd2 bytes) 000479 1788666527.242915 read 0x033757 thru 0x03b0b7 (0x7961 bytes) 000480 1788666527.243719 read 0x02cc53 thru 0x02fc2c (0x2fda bytes) 000481 1788666527.244670 read 0x00b1a2 thru 0x019c21 (0xea80 bytes) 000482 1788666527.245738 read 0x0299da thru 0x03787c (0xdea3 bytes) 000483 1788666527.246681 punch from 0x01f4b1 to 0x022903 (0x3453 bytes) 000484 1788666527.253609 write 0x038c0e thru 0x03ffff (0x73f2 bytes) 000485 1788666527.255103 mapread 0x015748 thru 0x021f56 (0xc80f bytes) 000486 1788666527.263799 trunc from 0x040000 to 0x011171 (0x2ee8e bytes) 000487 1788666527.291484 punch from 0x000e6f to 0x0066e8 (0x587a bytes) 000488 1788666527.297829 punch from 0x00d500 to 0x00ebbd (0x16be bytes) 000489 1788666527.303594 write 0x0317af thru 0x034ac8 (0x331a bytes) 000490 1788666527.305095 read 0x0270dd thru 0x02ef5e (0x7e82 bytes) 000495 1788666527.314994 mapwrite 0x030672 thru 0x03badc (0xb46b bytes) 000496 1788666527.379944 trunc from 0x03badd to 0x020569 (0x1b573 bytes) 000497 1788666527.395209 write 0x028e1b thru 0x0337ea (0xa9d0 bytes) 000499 1788666527.397351 trunc from 0x0337eb to 0x03370a (0xe0 bytes) 000501 1788666527.413073 read 0x000567 thru 0x007b7a (0x7614 bytes) 000502 1788666527.418122 read 0x016ca4 thru 0x02425a (0xd5b7 bytes) 000504 1788666527.432581 MIRROR_EXTEND to 2 mirrors 000508 1788666528.383590 punch from 0x004474 to 0x012af6 (0xe683 bytes) 000509 1788666528.502232 mapread 0x030fdb thru 0x03370a (0x2730 bytes) 000510 1788666528.532235 mapread 0x016d78 thru 0x018ac6 (0x1d4f bytes) 000511 1788666528.542316 read 0x0228d4 thru 0x031185 (0xe8b2 bytes) 000513 1788666528.553362 mapread 0x020cba thru 0x02e0ea (0xd431 bytes) 000514 1788666528.560029 punch from 0x016d8b to 0x01e22c (0x74a2 bytes) 000515 1788666528.569210 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3370b): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3370b): Mirror 2: 0x867d965c (stale) CRC-32 checksum value for chunk [0, 0x3370b): Mirror 1: 0x867d965c Mirror 3: 0x867d965c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3370b: skipped 000519 1788666529.595375 punch from 0x03128e to 0x03370a (0x247d bytes) 000520 1788666529.678856 mapwrite 0x03d972 thru 0x03ffff (0x268e bytes) 000521 1788666529.750028 trunc from 0x040000 to 0x02eb7f (0x11480 bytes) 000523 1788666529.766664 trunc from 0x02eb80 to 0x015ef6 (0x18c89 bytes) 000524 1788666529.784712 punch from 0x01571d to 0x015ef6 (0x7da bytes) 000525 1788666529.789788 read 0x00211e thru 0x00264d (0x530 bytes) 000526 1788666529.794776 mapwrite 0x0186c3 thru 0x018b98 (0x4d6 bytes) 000527 1788666529.879225 MIRROR_RESYNC 3 mirrors 000528 1788666530.716203 mapread 0x0098c4 thru 0x016519 (0xcc56 bytes) 000529 1788666530.753042 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) 000530 1788666531.165689 mapread 0x00f1d9 thru 0x016216 (0x703e bytes) 000531 1788666531.196860 trunc from 0x018b99 to 0x0167df (0x23b9 bytes) 000533 1788666531.279768 mapwrite 0x03eae9 thru 0x03ffff (0x1517 bytes) 000535 1788666531.359851 read 0x005a9d thru 0x007300 (0x1864 bytes) 000536 1788666531.366100 mapwrite 0x0314bc thru 0x039f18 (0x8a5d bytes) truncating to largest ever: 0x3ff5f 000538 1788666531.440824 trunc from 0x040000 to 0x03ff5e (0xa1 bytes) 000539 1788666531.468303 mapread 0x02a55f thru 0x034826 (0xa2c8 bytes) 000540 1788666531.477310 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3ff5f): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3ff5f): Mirror 3: 0xb5fd80d (stale) CRC-32 checksum value for chunk [0, 0x3ff5f): Mirror 1: 0xad76b49 Mirror 4: 0xad76b49 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3ff5f: skipped 000541 1788666532.666451 mapwrite 0x026edf thru 0x02fd78 (0x8e9a bytes) 000542 1788666532.973424 mapread 0x003398 thru 0x004d1c (0x1985 bytes) 000543 1788666532.997152 MIRROR_RESYNC 3 mirrors 000544 1788666534.063807 trunc from 0x03ff5f to 0x01aac2 (0x2549c bytes) 000545 1788666534.131101 mapwrite 0x02eef1 thru 0x03369e (0x47ae bytes) 000546 1788666534.260038 MIRROR_RESYNC 3 mirrors 000547 1788666535.297382 punch from 0x00d1c4 to 0x013fa5 (0x6de2 bytes) 000548 1788666535.384087 write 0x02991c thru 0x03962a (0xfd0f bytes) 000551 1788666535.396675 mapwrite 0x03d444 thru 0x03ffff (0x2bbc bytes) 000552 1788666535.561376 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x6d315220 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x6d315220 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000554 1788666535.872999 mapwrite 0x01a0a7 thru 0x0288cd (0xe827 bytes) 000555 1788666535.948478 MIRROR_RESYNC 2 mirrors 000556 1788666536.948121 trunc from 0x040000 to 0x017f21 (0x280de bytes) 000557 1788666537.072821 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x17f22): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x17f22): Mirror 3: 0xbfaf61b6 (stale) CRC-32 checksum value for chunk [0, 0x17f22): Mirror 1: 0xbfaf61b6 Mirror 4: 0xbfaf61b6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x17f22: skipped 000559 1788666538.149720 mapread 0x011589 thru 0x017f21 (0x6999 bytes) 000560 1788666538.186127 mapread 0x01027a thru 0x017f21 (0x7ca8 bytes) 000562 1788666538.214275 trunc from 0x017f22 to 0x02cc0c (0x14ceb bytes) 000563 1788666538.380975 mapread 0x0099c1 thru 0x00ee5b (0x549b bytes) 000564 1788666538.398733 trunc from 0x02cc0d to 0x03e9fe (0x11df2 bytes) 000565 1788666538.448511 write 0x0035f1 thru 0x00ffb0 (0xc9c0 bytes) 000566 1788666538.457005 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3e9ff): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e9ff): Mirror 3: 0xd306223b (stale) Mirror 4: 0x41be3779 (stale) CRC-32 checksum value for chunk [0, 0x3e9ff): Mirror 1: 0xe6759fd4 Mirror 5: 0xe6759fd4 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e9ff: skipped 000568 1788666539.836310 MIRROR_RESYNC 4 mirrors 000569 1788666540.810618 mapwrite 0x008a33 thru 0x00df58 (0x5526 bytes) 000571 1788666541.028373 mapwrite 0x027bb9 thru 0x035042 (0xd48a bytes) 000573 1788666541.153297 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3e9ff): Mirror 4: 0xe6759fd4 (stale) Mirror 5: 0xe6759fd4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e9ff): Mirror 4: 0xe6759fd4 (stale) Mirror 5: 0xe6759fd4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e9ff: skipped 000575 1788666541.485536 write 0x03df71 thru 0x03ffff (0x208f bytes) 000576 1788666541.491212 punch from 0x007cba to 0x0176d1 (0xfa18 bytes) 000577 1788666541.509779 read 0x000d56 thru 0x00b446 (0xa6f1 bytes) 000581 1788666541.530774 mapread 0x014193 thru 0x01bfda (0x7e48 bytes) 000582 1788666541.553356 trunc from 0x040000 to 0x00a514 (0x35aeb bytes) 000583 1788666541.574846 mapwrite 0x01268c thru 0x01a768 (0x80dd bytes) 000584 1788666541.703805 trunc from 0x01a769 to 0x024189 (0x9a21 bytes) 000586 1788666541.728862 write 0x018aa9 thru 0x01afbf (0x2517 bytes) 000587 1788666541.743967 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2418a): Mirror 5: 0x9293d992 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2418a): Mirror 5: 0x9293d992 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2418a: skipped 000588 1788666542.002099 mapwrite 0x009413 thru 0x016b3b (0xd729 bytes) 000590 1788666542.081685 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) 000591 1788666542.195146 mapread 0x00758d thru 0x015dd6 (0xe84a bytes) 000592 1788666542.234414 mapwrite 0x039740 thru 0x03ffff (0x68c0 bytes) 000593 1788666542.311379 trunc from 0x040000 to 0x01a7f5 (0x2580a bytes) 000594 1788666542.333630 trunc from 0x01a7f6 to 0x02175b (0x6f66 bytes) 000598 1788666542.357905 punch from 0x0111bf to 0x01a35f (0x91a1 bytes) 000599 1788666542.363947 mapread 0x02164d thru 0x02175b (0x10f bytes) 000600 1788666542.373440 write 0x00b6cc thru 0x00c1e6 (0xb1b bytes) 000604 1788666542.377604 mapread 0x0096df thru 0x00acab (0x15cd bytes) 000606 1788666542.379765 write 0x02f8f7 thru 0x030253 (0x95d bytes) 000607 1788666542.381491 mapread 0x026386 thru 0x0274fa (0x1175 bytes) 000610 1788666542.390644 trunc from 0x030254 to 0x0338c4 (0x3671 bytes) 000611 1788666542.411071 punch from 0x017472 to 0x01ca6d (0x55fc bytes) 000612 1788666542.423520 punch from 0x019a8f to 0x0224fe (0x8a70 bytes) 000614 1788666542.429415 mapwrite 0x0280c0 thru 0x032412 (0xa353 bytes) 000615 1788666542.523666 punch from 0x032749 to 0x0338c4 (0x117c bytes) 000616 1788666542.531135 mapwrite 0x0374b8 thru 0x03f8bb (0x8404 bytes) 000621 1788666542.679500 mapread 0x01d237 thru 0x02671e (0x94e8 bytes) 000623 1788666542.692507 punch from 0x03b8be to 0x03ec4c (0x338f bytes) 000625 1788666542.697387 mapwrite 0x00126b thru 0x0070e3 (0x5e79 bytes) 000627 1788666542.750812 read 0x03308d thru 0x038710 (0x5684 bytes) 000628 1788666542.751834 mapread 0x009d15 thru 0x00f971 (0x5c5d bytes) 000629 1788666542.754429 punch from 0x01b545 to 0x022267 (0x6d23 bytes) 000631 1788666542.764692 mapread 0x02c5db thru 0x02e2f4 (0x1d1a bytes) 000632 1788666542.766800 read 0x037034 thru 0x039a81 (0x2a4e bytes) 000633 1788666542.768998 write 0x01fb87 thru 0x02a4d7 (0xa951 bytes) 000634 1788666542.779821 read 0x0098f4 thru 0x00bde7 (0x24f4 bytes) 000635 1788666542.780450 punch from 0x01cd30 to 0x0269e4 (0x9cb5 bytes) 000639 1788666542.799072 write 0x001485 thru 0x00bab2 (0xa62e bytes) 000641 1788666542.801651 write 0x02f160 thru 0x03a5a7 (0xb448 bytes) 000644 1788666542.805234 mapread 0x00bfd8 thru 0x00ff1d (0x3f46 bytes) 000647 1788666542.808748 punch from 0x0243b2 to 0x02d0c2 (0x8d11 bytes) 000648 1788666542.824644 mapwrite 0x01fd08 thru 0x020fa4 (0x129d bytes) 000652 1788666542.888542 mapread 0x00e61b thru 0x01939c (0xad82 bytes) 000653 1788666542.890425 read 0x00f315 thru 0x01cdbf (0xdaab bytes) 000654 1788666542.891491 read 0x00c2c3 thru 0x00d4be (0x11fc bytes) 000655 1788666542.892997 read 0x036486 thru 0x03f8bb (0x9436 bytes) 000656 1788666542.893948 trunc from 0x03f8bc to 0x00fa33 (0x2fe88 bytes) 000657 1788666542.915443 read 0x00b304 thru 0x00f3bc (0x40b9 bytes) 000658 1788666542.916802 mapread 0x003341 thru 0x005d70 (0x2a30 bytes) 000659 1788666542.919990 mapwrite 0x01615e thru 0x025ba4 (0xfa47 bytes) 000660 1788666543.010406 trunc from 0x025ba5 to 0x018d6e (0xce36 bytes) 000661 1788666543.033971 trunc from 0x018d6f to 0x027a86 (0xed18 bytes) 000663 1788666543.053086 punch from 0x009854 to 0x0167a3 (0xcf50 bytes) 000665 1788666543.060092 mapwrite 0x033a4d thru 0x03b1e7 (0x779b bytes) 000666 1788666543.137984 write 0x01da95 thru 0x0251b3 (0x771f bytes) 000669 1788666543.157330 punch from 0x0125ae to 0x012ec0 (0x913 bytes) 000671 1788666543.174074 write 0x01f52e thru 0x023f37 (0x4a0a bytes) 000673 1788666543.176660 read 0x006760 thru 0x0089fe (0x229f bytes) 000675 1788666543.184397 punch from 0x039e8e to 0x03b1e7 (0x135a bytes) 000679 1788666543.206113 mapwrite 0x0000fa thru 0x0061fc (0x6103 bytes) 000680 1788666543.282092 write 0x0167ed thru 0x022532 (0xbd46 bytes) 000683 1788666543.298523 trunc from 0x03b1e8 to 0x016990 (0x24857 bytes) 000684 1788666543.318511 trunc from 0x016991 to 0x024780 (0xddf0 bytes) 000685 1788666543.333674 read 0x01aeb6 thru 0x024780 (0x98cb bytes) 000686 1788666543.344657 punch from 0x00c9c8 to 0x0186f5 (0xbd2e bytes) 000688 1788666543.353394 read 0x01b58a thru 0x0208bc (0x5333 bytes) 000689 1788666543.353966 mapwrite 0x010771 thru 0x0204b8 (0xfd48 bytes) 000690 1788666543.435303 mapread 0x007212 thru 0x0104ac (0x929b bytes) 000694 1788666543.438624 mapwrite 0x032731 thru 0x03ffff (0xd8cf bytes) 000698 1788666543.531843 mapread 0x0315dd thru 0x03e8d1 (0xd2f5 bytes) 000699 1788666543.533758 mapwrite 0x03516b thru 0x03dc66 (0x8afc bytes) 000700 1788666543.597646 read 0x006e49 thru 0x008dd3 (0x1f8b bytes) 000701 1788666543.598331 read 0x02a103 thru 0x02de32 (0x3d30 bytes) 000702 1788666543.603755 MIRROR_EXTEND to 2 mirrors 000703 1788666544.644392 punch from 0x02205b to 0x024feb (0x2f91 bytes) 000704 1788666544.787038 write 0x033e94 thru 0x03467b (0x7e8 bytes) 000705 1788666544.801006 mapwrite 0x02d6ae thru 0x034044 (0x6997 bytes) 000706 1788666544.891476 mapread 0x031774 thru 0x03e51a (0xcda7 bytes) 000707 1788666544.902496 punch from 0x02d9e7 to 0x02de43 (0x45d bytes) 000708 1788666544.910527 mapread 0x03cd23 thru 0x03ffff (0x32dd bytes) 000709 1788666544.912274 mapwrite 0x034e98 thru 0x03b6c4 (0x682d bytes) 000710 1788666544.979294 write 0x03bd3d thru 0x03ffff (0x42c3 bytes) 000711 1788666544.981195 read 0x01d353 thru 0x020ebe (0x3b6c bytes) 000714 1788666544.991105 punch from 0x01db4c to 0x027f4c (0xa401 bytes) 000715 1788666545.008397 read 0x033365 thru 0x0346e8 (0x1384 bytes) 000716 1788666545.009545 read 0x03680f thru 0x03ffff (0x97f1 bytes) 000717 1788666545.010587 mapread 0x01e9e2 thru 0x02e922 (0xff41 bytes) 000718 1788666545.023315 read 0x014f3a thru 0x01b659 (0x6720 bytes) 000719 1788666545.024044 read 0x02c069 thru 0x03b3bf (0xf357 bytes) 000720 1788666545.025324 punch from 0x03445c to 0x03ffff (0xbba4 bytes) 000721 1788666545.030569 trunc from 0x040000 to 0x005a44 (0x3a5bb bytes) 000722 1788666545.053121 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x5a45): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5a45): Mirror 2: 0x59e46652 (stale) CRC-32 checksum value for chunk [0, 0x5a45): Mirror 1: 0x59e46652 Mirror 3: 0x59e46652 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5a45: skipped 000723 1788666546.171691 MIRROR_RESYNC 3 mirrors 000724 1788666546.914806 trunc from 0x005a45 to 0x03097f (0x2af3b bytes) 000725 1788666546.994177 punch from 0x01992f to 0x01f863 (0x5f35 bytes) 000726 1788666547.002640 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x30980): Mirror 3: 0xb0159d59 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30980): Mirror 3: 0xb0159d59 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30980: skipped 000730 1788666547.267959 mapwrite 0x017352 thru 0x01b863 (0x4512 bytes) 000732 1788666547.343278 read 0x01fd90 thru 0x02bcd1 (0xbf42 bytes) 000733 1788666547.351732 read 0x013940 thru 0x017c9d (0x435e bytes) 000735 1788666547.356851 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) 000737 1788666547.480259 read 0x017c21 thru 0x026ce6 (0xf0c6 bytes) 000738 1788666547.501585 punch from 0x00569b to 0x012d59 (0xd6bf bytes) 000739 1788666547.511457 read 0x020826 thru 0x02abf8 (0xa3d3 bytes) 000740 1788666547.527821 write 0x02d0c7 thru 0x038c19 (0xbb53 bytes) 000741 1788666547.536729 write 0x030fb9 thru 0x03cf48 (0xbf90 bytes) 000742 1788666547.539036 write 0x00f69e thru 0x018526 (0x8e89 bytes) 000743 1788666547.546174 read 0x03ba59 thru 0x03cf48 (0x14f0 bytes) 000745 1788666547.549361 mapread 0x00e10b thru 0x019b1e (0xba14 bytes) 000751 1788666547.554674 trunc from 0x03cf49 to 0x01ef0d (0x1e03b bytes) 000752 1788666547.574639 punch from 0x0064de to 0x012446 (0xbf69 bytes) 000754 1788666547.591677 mapwrite 0x017f86 thru 0x01de86 (0x5f01 bytes) 000755 1788666547.653371 mapread 0x00fec7 thru 0x01be5e (0xbf98 bytes) 000757 1788666547.663821 mapread 0x01201c thru 0x01c7d1 (0xa7b6 bytes) 000760 1788666547.667379 mapread 0x00b9e5 thru 0x01b76c (0xfd88 bytes) 000762 1788666547.671515 mapread 0x009515 thru 0x0105d5 (0x70c1 bytes) 000763 1788666547.672719 punch from 0x001ae3 to 0x00ebed (0xd10b bytes) 000764 1788666547.681365 trunc from 0x01ef0e to 0x036fdf (0x180d2 bytes) 000766 1788666547.699187 mapwrite 0x00ee5b thru 0x01bd5a (0xcf00 bytes) 000767 1788666547.783700 mapwrite 0x024be7 thru 0x031f97 (0xd3b1 bytes) 000768 1788666547.864407 write 0x007012 thru 0x016f19 (0xff08 bytes) 000769 1788666547.873552 mapwrite 0x01813e thru 0x02158f (0x9452 bytes) 000771 1788666547.957733 punch from 0x01ecf2 to 0x02bd90 (0xd09f bytes) 000772 1788666547.978481 punch from 0x03048a to 0x03323a (0x2db1 bytes) 000773 1788666547.992725 mapread 0x030089 thru 0x036e8b (0x6e03 bytes) 000774 1788666548.029425 mapwrite 0x002eb2 thru 0x00b021 (0x8170 bytes) 000775 1788666548.187380 trunc from 0x036fe0 to 0x021c44 (0x1539b bytes) 000778 1788666548.210286 trunc from 0x021c45 to 0x01cce7 (0x4f5d bytes) 000781 1788666548.227190 punch from 0x01b31f to 0x01cce7 (0x19c9 bytes) 000783 1788666548.236511 MIRROR_EXTEND to 2 mirrors 000784 1788666549.160538 mapwrite 0x018cff thru 0x0282eb (0xf5ed bytes) 000789 1788666549.436817 punch from 0x019471 to 0x0196cb (0x25b bytes) 000790 1788666549.442346 write 0x00fec1 thru 0x01c44c (0xc58c bytes) 000792 1788666549.452085 write 0x00c5a6 thru 0x019e08 (0xd863 bytes) 000794 1788666549.458639 trunc from 0x0282ec to 0x003157 (0x25194 bytes) 000796 1788666549.481731 MIRROR_RESYNC 2 mirrors 000797 1788666550.356133 punch from 0x000cd1 to 0x001523 (0x853 bytes) 000798 1788666550.497179 mapwrite 0x0054f7 thru 0x01063c (0xb146 bytes) 000802 1788666550.683115 mapwrite 0x0313c0 thru 0x0374c3 (0x6104 bytes) 000804 1788666550.806728 mapread 0x033adb thru 0x036b11 (0x3037 bytes) 000805 1788666550.807615 punch from 0x007ae7 to 0x00db7c (0x6096 bytes) 000806 1788666550.832229 mapread 0x030aab thru 0x0374c3 (0x6a19 bytes) 000807 1788666550.836565 punch from 0x0346d5 to 0x0374c3 (0x2def bytes) 000808 1788666550.843625 trunc from 0x0374c4 to 0x0243b8 (0x1310b bytes) 000810 1788666550.911580 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x243b9): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x243b9): Mirror 2: 0x8b15236b (stale) CRC-32 checksum value for chunk [0, 0x243b9): Mirror 1: 0xd85f2941 Mirror 3: 0xd85f2941 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x243b9: skipped 000811 1788666552.132819 read 0x0208bc thru 0x0243b8 (0x3afd bytes) 000812 1788666552.154594 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x243b9): Mirror 2: 0x8b15236b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x243b9): Mirror 2: 0x8b15236b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x243b9: skipped 000814 1788666552.517807 trunc from 0x0243b9 to 0x002f54 (0x21464 bytes) 000819 1788666552.551054 MIRROR_RESYNC 2 mirrors 000821 1788666553.153567 mapwrite 0x0106b8 thru 0x0124da (0x1e23 bytes) 000822 1788666553.389906 trunc from 0x0124db to 0x01b91c (0x9442 bytes) 000823 1788666553.420544 trunc from 0x01b91d to 0x01a509 (0x1413 bytes) 000824 1788666553.441253 trunc from 0x01a50a to 0x006dbd (0x1374c bytes) 000825 1788666553.469494 punch from 0x000661 to 0x005d6e (0x570e bytes) 000826 1788666553.482952 mapwrite 0x014a1f thru 0x01a764 (0x5d46 bytes) 000828 1788666553.640699 mapread 0x002c1b thru 0x006b7c (0x3f62 bytes) 000830 1788666553.677105 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) 000831 1788666553.923770 mapread 0x00c532 thru 0x01a764 (0xe233 bytes) 000833 1788666553.973895 trunc from 0x01a765 to 0x02ba90 (0x1132c bytes) 000834 1788666554.019048 MIRROR_EXTEND to 2 mirrors 000836 1788666555.043026 MIRROR_RESYNC 2 mirrors 000838 1788666555.347906 mapread 0x020e6d thru 0x026109 (0x529d bytes) 000839 1788666555.375245 mapread 0x00a556 thru 0x01091f (0x63ca bytes) 000842 1788666555.393361 mapwrite 0x029dbf thru 0x02cc2b (0x2e6d bytes) 000843 1788666555.622769 trunc from 0x02cc2c to 0x013d11 (0x18f1a bytes) 000844 1788666555.674026 mapread 0x00102e thru 0x00d54b (0xc51e bytes) 000845 1788666555.685682 trunc from 0x013d12 to 0x037577 (0x23866 bytes) 000846 1788666555.711579 punch from 0x036b03 to 0x037577 (0xa75 bytes) 000847 1788666555.717520 write 0x020241 thru 0x0232d3 (0x3093 bytes) 000848 1788666555.728520 mapwrite 0x02a461 thru 0x02e806 (0x43a6 bytes) 000850 1788666555.808328 read 0x0015b2 thru 0x002224 (0xc73 bytes) 000852 1788666555.809376 write 0x0136d3 thru 0x01b5ed (0x7f1b bytes) 000853 1788666555.823788 mapread 0x02c9f5 thru 0x037577 (0xab83 bytes) 000854 1788666555.832219 trunc from 0x037578 to 0x020738 (0x16e3f bytes) 000857 1788666555.852264 mapread 0x01e062 thru 0x020738 (0x26d7 bytes) 000858 1788666555.858081 trunc from 0x020739 to 0x01a8e7 (0x5e51 bytes) 000859 1788666555.876103 punch from 0x001deb to 0x003bfb (0x1e11 bytes) 000861 1788666555.896854 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1a8e8): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a8e8): Mirror 2: 0x54a4235f (stale) CRC-32 checksum value for chunk [0, 0x1a8e8): Mirror 1: 0xcda293d6 Mirror 3: 0xcda293d6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a8e8: skipped 000863 1788666557.187339 mapread 0x003807 thru 0x0069ea (0x31e4 bytes) 000864 1788666557.233330 mapwrite 0x01c41e thru 0x028c37 (0xc81a bytes) 000865 1788666557.450334 mapwrite 0x03d27f thru 0x03ffff (0x2d81 bytes) 000866 1788666557.545269 punch from 0x01b073 to 0x02188b (0x6819 bytes) 000867 1788666557.551546 write 0x03bb6e thru 0x03ef56 (0x33e9 bytes) 000868 1788666557.553128 mapread 0x0228ab thru 0x028a4a (0x61a0 bytes) 000869 1788666557.560144 MIRROR_RESYNC 3 mirrors 000870 1788666559.044454 trunc from 0x040000 to 0x0260c6 (0x19f39 bytes) 000871 1788666559.173539 punch from 0x0180eb to 0x018faa (0xec0 bytes) 000872 1788666559.179901 read 0x01ee76 thru 0x01ff49 (0x10d4 bytes) 000873 1788666559.187472 punch from 0x00da8b to 0x00fcc6 (0x223c bytes) 000874 1788666559.194254 trunc from 0x0260c7 to 0x004b7c (0x2154a bytes) 000876 1788666559.220331 mapread 0x001b44 thru 0x004b7c (0x3039 bytes) 000878 1788666559.242277 mapwrite 0x00e525 thru 0x017813 (0x92ef bytes) 000879 1788666559.387339 mapwrite 0x00fadc thru 0x018606 (0x8b2b bytes) 000880 1788666559.497327 write 0x03babd thru 0x03ffff (0x4543 bytes) 000883 1788666559.500928 write 0x002080 thru 0x00b963 (0x98e4 bytes) 000886 1788666559.504372 mapread 0x01f2b0 thru 0x021dce (0x2b1f bytes) 000887 1788666559.524301 punch from 0x01d59b to 0x020e00 (0x3866 bytes) 000889 1788666559.552122 mapwrite 0x038f91 thru 0x03fc71 (0x6ce1 bytes) 000890 1788666559.624973 punch from 0x017395 to 0x01e3d1 (0x703d bytes) 000891 1788666559.631791 punch from 0x00115d to 0x00d94c (0xc7f0 bytes) 000892 1788666559.641679 MIRROR_RESYNC 3 mirrors 000894 1788666560.754692 read 0x01dc6e thru 0x02a31f (0xc6b2 bytes) 000895 1788666560.769915 write 0x003092 thru 0x011a32 (0xe9a1 bytes) 000897 1788666560.844117 trunc from 0x040000 to 0x03c36e (0x3c91 bytes) 000898 1788666560.868104 mapread 0x00e407 thru 0x01a84d (0xc447 bytes) 000899 1788666560.890268 punch from 0x0327e5 to 0x037b4f (0x536b bytes) 000902 1788666560.906399 mapwrite 0x018676 thru 0x01e7cc (0x6157 bytes) 000903 1788666560.967627 write 0x001ad8 thru 0x004a9b (0x2fc4 bytes) 000905 1788666560.975151 read 0x031d8c thru 0x038741 (0x69b6 bytes) 000906 1788666560.985565 write 0x03fd5a thru 0x03ffff (0x2a6 bytes) 000907 1788666560.987197 mapwrite 0x006b36 thru 0x015c2d (0xf0f8 bytes) 000908 1788666561.046636 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x2a5abe71 (stale) Mirror 3: 0x2a5abe71 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x6622ee32 Mirror 4: 0x6622ee32 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000909 1788666562.121635 mapwrite 0x00d5a8 thru 0x0101e3 (0x2c3c bytes) 000910 1788666562.285388 MIRROR_RESYNC 4 mirrors 000912 1788666563.567790 punch from 0x00cb1e to 0x011c4b (0x512e bytes) 000913 1788666563.637410 trunc from 0x040000 to 0x00e542 (0x31abd bytes) 000914 1788666563.667059 MIRROR_RESYNC 4 mirrors 000919 1788666564.363405 trunc from 0x00e543 to 0x00d529 (0x1019 bytes) 000920 1788666564.432336 write 0x026280 thru 0x02643e (0x1bf bytes) 000921 1788666564.433321 mapread 0x01ae2d thru 0x01c48f (0x1663 bytes) 000923 1788666564.448160 mapread 0x00f532 thru 0x0134af (0x3f7e bytes) 000924 1788666564.457198 mapread 0x00b9a5 thru 0x01aa23 (0xf07f bytes) 000925 1788666564.458273 mapread 0x00c4c5 thru 0x011183 (0x4cbf bytes) 000926 1788666564.463313 MIRROR_RESYNC 4 mirrors 000928 1788666565.620856 mapread 0x015970 thru 0x015b3d (0x1ce bytes) 000929 1788666565.633137 trunc from 0x02643f to 0x013f9c (0x124a2 bytes) 000930 1788666565.775911 mapread 0x0134f5 thru 0x013f9c (0xaa8 bytes) 000931 1788666565.789451 trunc from 0x013f9d to 0x010f8c (0x3010 bytes) 000932 1788666565.825776 write 0x007701 thru 0x016d46 (0xf646 bytes) 000933 1788666565.833381 trunc from 0x016d47 to 0x001377 (0x159cf bytes) 000934 1788666565.848723 read 0x000392 thru 0x001377 (0xfe6 bytes) 000936 1788666565.857511 write 0x0075a3 thru 0x0144fc (0xcf5a bytes) 000937 1788666565.861105 mapwrite 0x03fe2c thru 0x03ffff (0x1d4 bytes) 000938 1788666565.954264 mapwrite 0x02722a thru 0x028410 (0x11e7 bytes) 000939 1788666566.017675 MIRROR_RESYNC 4 mirrors 000940 1788666567.656306 trunc from 0x040000 to 0x030dbd (0xf242 bytes) 000941 1788666567.731207 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x30dbe): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30dbe): Mirror 2: 0x53a0839f (stale) Mirror 3: 0x53a0839f (stale) Mirror 4: 0x53a0839f (stale) CRC-32 checksum value for chunk [0, 0x30dbe): Mirror 1: 0x53a0839f Mirror 5: 0x53a0839f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30dbe: skipped 000942 1788666568.663105 write 0x03a2fb thru 0x03d7bf (0x34c5 bytes) 000944 1788666568.741499 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d7c0): Mirror 3: 0xfbb9fadd (stale) Mirror 4: 0xfbb9fadd (stale) Mirror 5: 0xfbb9fadd (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d7c0): Mirror 3: 0xfbb9fadd (stale) Mirror 4: 0xfbb9fadd (stale) Mirror 5: 0xfbb9fadd (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d7c0: skipped 000945 1788666569.101922 read 0x0020c2 thru 0x006229 (0x4168 bytes) 000946 1788666569.114136 mapwrite 0x001a93 thru 0x007015 (0x5583 bytes) 000947 1788666569.278263 punch from 0x00e36c to 0x01bcca (0xd95f bytes) 000948 1788666569.285532 read 0x015a32 thru 0x01acbd (0x528c bytes) 000949 1788666569.303546 mapread 0x037cbd thru 0x03b5f4 (0x3938 bytes) 000950 1788666569.305933 read 0x008c6f thru 0x014ae7 (0xbe79 bytes) 000951 1788666569.307986 mapread 0x03075f thru 0x035276 (0x4b18 bytes) 000954 1788666569.311504 punch from 0x0330b1 to 0x03a41a (0x736a bytes) 000957 1788666569.318212 trunc from 0x03d7c0 to 0x028847 (0x14f78 bytes) 000958 1788666569.337300 write 0x012da5 thru 0x021e4a (0xf0a6 bytes) 000961 1788666569.342218 mapread 0x0284d9 thru 0x028847 (0x36f bytes) 000963 1788666569.344580 mapwrite 0x02f3ef thru 0x0393c6 (0x9fd8 bytes) 000964 1788666569.435695 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x19c:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x393c7): Mirror 3: 0x22c63308 (stale) Mirror 5: 0x22c63308 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x393c7): Mirror 3: 0x22c63308 (stale) Mirror 5: 0x22c63308 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x393c7: skipped 000966 1788666569.810833 mapread 0x017336 thru 0x022af3 (0xb7be bytes) 000967 1788666569.834500 write 0x038d55 thru 0x03fb1d (0x6dc9 bytes) 000968 1788666569.845426 MIRROR_RESYNC 3 mirrors 000969 1788666570.718802 mapwrite 0x03a814 thru 0x03ea59 (0x4246 bytes) 000970 1788666570.940503 mapwrite 0x0391ba thru 0x03ffff (0x6e46 bytes) 000971 1788666571.027496 mapwrite 0x022a8e thru 0x02b94e (0x8ec1 bytes) 000972 1788666571.089945 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xe2280baf (stale) Mirror 5: 0xe2280baf (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x99f19874 Mirror 6: 0x99f19874 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000973 1788666572.015985 punch from 0x000edc to 0x001d54 (0xe79 bytes) 000974 1788666572.124022 read 0x03acd8 thru 0x03ffff (0x5328 bytes) 000976 1788666572.139344 trunc from 0x040000 to 0x00e7fb (0x31804 bytes) 000977 1788666572.209537 read 0x0034f6 thru 0x00e7fb (0xb306 bytes) 000978 1788666572.224504 trunc from 0x00e7fc to 0x02242b (0x13c30 bytes) 000979 1788666572.249344 write 0x019f70 thru 0x01cde7 (0x2e78 bytes) 000984 1788666572.267276 mapread 0x015232 thru 0x01bcb1 (0x6a80 bytes) 000985 1788666572.268686 mapread 0x0192d3 thru 0x02242b (0x9159 bytes) 000986 1788666572.275196 mapwrite 0x0100a5 thru 0x014123 (0x407f bytes) 000987 1788666572.369306 trunc from 0x02242c to 0x0002d9 (0x22152 bytes) 000990 1788666572.397678 read 0x00029c thru 0x0002d9 (0x3e bytes) 000992 1788666572.402443 MIRROR_RESYNC 4 mirrors 000993 1788666573.081058 write 0x02ed17 thru 0x0373e5 (0x86cf bytes) 000995 1788666573.183299 mapread 0x001e79 thru 0x00c50e (0xa696 bytes) 000998 1788666573.244503 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x373e6): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x373e6): Mirror 3: 0xabb4819d (stale) Mirror 5: 0xabb4819d (stale) Mirror 6: 0xabb4819d (stale) CRC-32 checksum value for chunk [0, 0x373e6): Mirror 1: 0x1595f193 Mirror 7: 0x1595f193 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x373e6: skipped 000999 1788666574.152409 read 0x00629c thru 0x008589 (0x22ee bytes) 001000 1788666574.174593 MIRROR_RESYNC 5 mirrors All operations completed A-OK!