== sanity-flr test 70a: flr mode fsx test ================ 21:55:13 (1789782913) Seed set to 2915 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x28b99 000004 1789782915.948886 trunc from 00000000 to 0x028b98 (0x28b99 bytes) 000005 1789782915.972459 read 0x0155b4 thru 0x023023 (0xda70 bytes) truncating to largest ever: 0x2c97a 000006 1789782916.002168 trunc from 0x028b99 to 0x02c979 (0x3de1 bytes) 000008 1789782916.037606 mapread 0x0217bd thru 0x022584 (0xdc8 bytes) 000011 1789782916.041018 punch from 0x02167e to 0x02c979 (0xb2fc bytes) 000012 1789782916.045999 write 0x01b366 thru 0x0206cf (0x536a bytes) truncating to largest ever: 0x3e49c 000013 1789782916.047954 trunc from 0x02c97a to 0x03e49b (0x11b22 bytes) 000015 1789782916.073093 read 0x0309f1 thru 0x036928 (0x5f38 bytes) 000016 1789782916.100727 trunc from 0x03e49c to 0x0209ce (0x1dacd bytes) 000018 1789782916.127587 MIRROR_EXTEND to 2 mirrors 000019 1789782917.134915 mapwrite 0x023b8c thru 0x026a73 (0x2ee8 bytes) 000020 1789782917.326080 trunc from 0x026a74 to 0x03b1f7 (0x14784 bytes) 000021 1789782917.350810 read 0x00972a thru 0x00e24b (0x4b22 bytes) 000023 1789782917.366434 MIRROR_RESYNC 2 mirrors 000024 1789782918.683434 write 0x03b6d3 thru 0x03ffff (0x492d bytes) 000025 1789782918.807065 mapread 0x00c017 thru 0x013b20 (0x7b0a bytes) 000026 1789782918.844723 mapread 0x0133a8 thru 0x01dfcb (0xac24 bytes) 000027 1789782918.862643 trunc from 0x040000 to 0x005818 (0x3a7e7 bytes) 000029 1789782918.911643 read 0x003c5a thru 0x005818 (0x1bbf bytes) 000030 1789782918.929868 punch from 0x000203 to 0x005818 (0x5616 bytes) 000031 1789782918.952072 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x5819): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5819): Mirror 2: 0x69591228 (stale) CRC-32 checksum value for chunk [0, 0x5819): Mirror 1: 0x69591228 Mirror 3: 0x69591228 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5819: skipped 000032 1789782920.361999 punch from 0x003830 to 0x005818 (0x1fe9 bytes) 000033 1789782920.518292 mapread 0x002a9e thru 0x004887 (0x1dea bytes) 000035 1789782920.558030 read 0x000718 thru 0x005818 (0x5101 bytes) 000037 1789782920.567861 read 0x002039 thru 0x002228 (0x1f0 bytes) 000039 1789782920.577541 MIRROR_RESYNC 3 mirrors 000041 1789782921.731354 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) 000042 1789782922.281088 punch from 0x0047c2 to 0x005818 (0x1057 bytes) 000043 1789782922.366615 mapwrite 0x031b78 thru 0x039980 (0x7e09 bytes) 000045 1789782922.497000 mapwrite 0x001c77 thru 0x005bdd (0x3f67 bytes) 000046 1789782922.586199 mapwrite 0x024679 thru 0x02bddd (0x7765 bytes) 000047 1789782922.724549 mapwrite 0x031e7c thru 0x03b4e4 (0x9669 bytes) 000048 1789782922.827059 mapread 0x020519 thru 0x028c26 (0x870e bytes) 000051 1789782922.829950 mapread 0x01744c thru 0x024a9b (0xd650 bytes) 000052 1789782922.851125 read 0x007d3d thru 0x00a65f (0x2923 bytes) 000054 1789782922.852394 punch from 0x01a6b8 to 0x02a0d1 (0xfa1a bytes) 000055 1789782922.856369 read 0x00b88a thru 0x01a807 (0xef7e bytes) 000057 1789782922.864528 write 0x03df47 thru 0x03ffff (0x20b9 bytes) 000058 1789782922.865525 punch from 0x00f4eb to 0x016aef (0x7605 bytes) 000063 1789782922.889044 write 0x03fc3f thru 0x03ffff (0x3c1 bytes) 000064 1789782922.890166 mapread 0x038dfa thru 0x0391c8 (0x3cf bytes) 000065 1789782922.891378 mapwrite 0x0390c2 thru 0x03ffff (0x6f3e bytes) 000067 1789782923.029011 mapwrite 0x01e95f thru 0x0260c4 (0x7766 bytes) 000069 1789782923.109772 MIRROR_RESYNC 2 mirrors 000070 1789782924.067059 trunc from 0x040000 to 0x01c3e0 (0x23c1f bytes) 000072 1789782924.216171 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1c3e1): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1c3e1): Mirror 3: 0xcae2e267 (stale) CRC-32 checksum value for chunk [0, 0x1c3e1): Mirror 1: 0xcae2e267 Mirror 4: 0xcae2e267 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1c3e1: skipped 000073 1789782925.227343 trunc from 0x01c3e1 to 0x01f0f2 (0x2d12 bytes) 000074 1789782925.392151 punch from 0x01dde7 to 0x01f0f2 (0x130c bytes) 000075 1789782925.399393 punch from 0x001d45 to 0x00be0c (0xa0c8 bytes) 000077 1789782925.422275 mapwrite 0x01b167 thru 0x020015 (0x4eaf bytes) 000078 1789782925.682345 mapwrite 0x038dc1 thru 0x03e60f (0x584f bytes) 000080 1789782925.824551 read 0x0111e1 thru 0x015bf9 (0x4a19 bytes) 000082 1789782925.849083 trunc from 0x03e610 to 0x036380 (0x828f bytes) 000083 1789782925.880589 write 0x022809 thru 0x0290f7 (0x68ef bytes) 000084 1789782925.903441 write 0x02137f thru 0x02857a (0x71fc bytes) 000085 1789782925.911854 trunc from 0x036381 to 0x0293bf (0xcfc1 bytes) 000086 1789782925.935645 trunc from 0x0293c0 to 0x00a0a0 (0x1f31f bytes) 000087 1789782925.962567 mapread 0x006a5c thru 0x00a0a0 (0x3645 bytes) 000088 1789782925.978171 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xa0a1): Mirror 3: 0xcc395f6f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xa0a1): Mirror 3: 0xcc395f6f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xa0a1: skipped 000092 1789782926.256937 punch from 0x009419 to 0x00a0a0 (0xc88 bytes) 000093 1789782926.272285 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) 000096 1789782926.516640 write 0x01c132 thru 0x01e007 (0x1ed6 bytes) 000097 1789782926.518338 mapwrite 0x038c7e thru 0x03b3eb (0x276e bytes) 000098 1789782926.726546 mapwrite 0x00021c thru 0x00fe3b (0xfc20 bytes) 000099 1789782926.885109 punch from 0x00ec66 to 0x01088a (0x1c25 bytes) 000100 1789782926.893336 punch from 0x029bb6 to 0x0362c6 (0xc711 bytes) 000103 1789782926.904660 MIRROR_EXTEND to 2 mirrors 000105 1789782928.782006 punch from 0x02bb29 to 0x036aa4 (0xaf7c bytes) 000107 1789782928.949134 trunc from 0x03b3ec to 0x013507 (0x27ee4 bytes) 000108 1789782929.036025 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) 000109 1789782929.357095 punch from 0x008dae to 0x00aeaf (0x2102 bytes) 000111 1789782929.376480 punch from 0x004a3c to 0x008729 (0x3cee bytes) 000112 1789782929.383963 read 0x00b394 thru 0x013507 (0x8174 bytes) 000114 1789782929.415326 mapread 0x0028a3 thru 0x0080da (0x5838 bytes) 000115 1789782929.451418 trunc from 0x013508 to 0x039836 (0x2632f bytes) 000116 1789782929.490176 mapwrite 0x020d14 thru 0x023254 (0x2541 bytes) 000117 1789782929.733640 mapwrite 0x0164c6 thru 0x01a75a (0x4295 bytes) 000120 1789782929.913361 trunc from 0x039837 to 0x00f048 (0x2a7ee bytes) 000121 1789782929.939006 trunc from 0x00f049 to 0x002f68 (0xc0e0 bytes) 000122 1789782929.974030 punch from 0x002c44 to 0x002f68 (0x325 bytes) 000123 1789782929.985512 write 0x037b3c thru 0x03b478 (0x393d bytes) 000125 1789782929.988183 write 0x0160ad thru 0x024637 (0xe58b bytes) 000127 1789782930.047504 mapread 0x039620 thru 0x03b478 (0x1e59 bytes) 000128 1789782930.049250 write 0x006e9c thru 0x00c45a (0x55bf bytes) 000129 1789782930.069801 trunc from 0x03b479 to 0x0047d3 (0x36ca5 bytes) 000131 1789782930.120830 trunc from 0x0047d4 to 0x01c16b (0x17998 bytes) 000132 1789782930.145224 trunc from 0x01c16c to 0x0304d5 (0x1436a bytes) 000134 1789782930.166553 mapwrite 0x006915 thru 0x007714 (0xe00 bytes) 000135 1789782930.277161 trunc from 0x0304d6 to 0x008abc (0x27a19 bytes) 000137 1789782930.347194 write 0x00b824 thru 0x0103bf (0x4b9c bytes) 000138 1789782930.354357 write 0x004e8c thru 0x009d03 (0x4e78 bytes) 000140 1789782930.376932 trunc from 0x0103c0 to 0x012e8f (0x2ad0 bytes) 000142 1789782930.435527 punch from 0x010f24 to 0x012e8f (0x1f6c bytes) 000145 1789782930.478014 punch from 0x0052ea to 0x00a610 (0x5327 bytes) 000146 1789782930.490608 write 0x01f3f3 thru 0x029f0a (0xab18 bytes) 000147 1789782930.496324 punch from 0x0143d6 to 0x016413 (0x203e bytes) 000148 1789782930.529232 trunc from 0x029f0b to 0x019761 (0x107a9 bytes) 000150 1789782930.572556 mapread 0x0122a0 thru 0x013bd2 (0x1933 bytes) 000151 1789782930.586113 mapwrite 0x024be7 thru 0x02cebf (0x82d9 bytes) 000152 1789782930.772248 write 0x02c4a5 thru 0x02d9a2 (0x14fe bytes) 000153 1789782930.789064 MIRROR_EXTEND to 2 mirrors 000155 1789782932.024792 MIRROR_RESYNC 2 mirrors 000156 1789782932.708966 mapwrite 0x01f7bc thru 0x01fd41 (0x586 bytes) 000158 1789782933.159443 write 0x008faa thru 0x00fce7 (0x6d3e bytes) 000159 1789782933.189611 write 0x022c32 thru 0x02694d (0x3d1c bytes) 000161 1789782933.207853 punch from 0x0261e8 to 0x028615 (0x242e bytes) 000162 1789782933.238079 punch from 0x017a1c to 0x019890 (0x1e75 bytes) 000163 1789782933.242920 mapwrite 0x01938a thru 0x027e19 (0xea90 bytes) 000166 1789782933.391888 write 0x026c40 thru 0x02cb28 (0x5ee9 bytes) 000169 1789782933.404937 MIRROR_RESYNC 2 mirrors 000171 1789782934.674502 mapwrite 0x03bcda thru 0x03e858 (0x2b7f bytes) 000174 1789782935.035337 mapwrite 0x006f81 thru 0x00b292 (0x4312 bytes) 000176 1789782935.206242 punch from 0x001c9e to 0x00b22d (0x9590 bytes) 000178 1789782935.218649 trunc from 0x03e859 to 0x028f82 (0x158d6 bytes) 000179 1789782935.265846 trunc from 0x028f83 to 0x008743 (0x2083f bytes) 000180 1789782935.350109 MIRROR_RESYNC 2 mirrors 000183 1789782936.957622 trunc from 0x008744 to 0x03d8e7 (0x351a4 bytes) 000184 1789782937.108099 read 0x01b9b9 thru 0x021161 (0x57a9 bytes) 000185 1789782937.144130 read 0x030d39 thru 0x03d8e7 (0xcbaf bytes) 000186 1789782937.186123 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) 000188 1789782937.448999 read 0x0263b0 thru 0x02b216 (0x4e67 bytes) 000189 1789782937.465435 punch from 0x0340cb to 0x03750e (0x3444 bytes) 000191 1789782937.470646 punch from 0x01f9df to 0x02afcd (0xb5ef bytes) 000192 1789782937.476249 trunc from 0x03d8e8 to 0x01f465 (0x1e482 bytes) 000193 1789782937.527499 read 0x017381 thru 0x01f465 (0x80e5 bytes) 000194 1789782937.622001 write 0x03e75c thru 0x03ffff (0x18a4 bytes) 000195 1789782937.629103 read 0x01202d thru 0x01af93 (0x8f67 bytes) 000196 1789782937.630913 read 0x010797 thru 0x014e0f (0x4679 bytes) 000197 1789782937.632411 write 0x038c68 thru 0x03ffff (0x7398 bytes) 000199 1789782937.657088 punch from 0x01127f to 0x020593 (0xf315 bytes) 000200 1789782937.695035 trunc from 0x040000 to 0x0275aa (0x18a55 bytes) 000202 1789782937.721649 mapread 0x00fe0e thru 0x0194c9 (0x96bc bytes) 000204 1789782937.802274 write 0x00d547 thru 0x0146fd (0x71b7 bytes) 000205 1789782937.807061 punch from 0x0232c8 to 0x02356f (0x2a8 bytes) 000206 1789782937.851442 mapwrite 0x0168e9 thru 0x0251b5 (0xe8cd bytes) 000211 1789782938.050060 punch from 0x009a51 to 0x00f3d6 (0x5986 bytes) 000213 1789782938.060506 mapread 0x008f7a thru 0x00aa63 (0x1aea bytes) 000214 1789782938.096702 mapwrite 0x028a38 thru 0x02bb3f (0x3108 bytes) 000215 1789782938.416611 write 0x01c43d thru 0x02a05d (0xdc21 bytes) 000217 1789782938.427798 write 0x01cafc thru 0x02a9f8 (0xdefd bytes) 000219 1789782938.429634 mapread 0x0295b6 thru 0x02bb3f (0x258a bytes) 000221 1789782938.442457 punch from 0x02741f to 0x02bb3f (0x4721 bytes) 000224 1789782938.479543 punch from 0x00b187 to 0x01782d (0xc6a7 bytes) 000226 1789782938.493887 trunc from 0x02bb40 to 0x0045af (0x27590 bytes) 000228 1789782938.588516 read 0x000730 thru 0x0045af (0x3e80 bytes) 000230 1789782938.593494 read 0x0026f9 thru 0x0045af (0x1eb7 bytes) 000231 1789782938.602892 write 0x00d772 thru 0x01d65e (0xfeed bytes) 000232 1789782938.606176 trunc from 0x01d65f to 0x01dfd9 (0x97b bytes) 000233 1789782938.679525 mapread 0x01d16b thru 0x01dfd9 (0xe6f bytes) 000235 1789782938.682813 write 0x028884 thru 0x02b506 (0x2c83 bytes) 000237 1789782938.688477 read 0x0286eb thru 0x02b506 (0x2e1c bytes) 000238 1789782938.690538 write 0x022ab7 thru 0x02e72e (0xbc78 bytes) 000239 1789782938.711451 write 0x02a01d thru 0x02e311 (0x42f5 bytes) 000240 1789782938.721404 mapread 0x028c64 thru 0x029908 (0xca5 bytes) 000241 1789782938.794057 MIRROR_EXTEND to 2 mirrors 000245 1789782940.127217 MIRROR_EXTEND to 3 mirrors 000247 1789782941.464595 mapwrite 0x03ecdc thru 0x03ffff (0x1324 bytes) 000250 1789782941.636551 mapread 0x0052fd thru 0x008c0d (0x3911 bytes) 000252 1789782941.655035 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x8fe2cac4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x8fe2cac4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000255 1789782942.213018 trunc from 0x040000 to 0x03ba08 (0x45f7 bytes) 000256 1789782942.237047 trunc from 0x03ba09 to 0x01b04e (0x209ba bytes) 000257 1789782942.297857 mapread 0x003f06 thru 0x00b043 (0x713e bytes) 000258 1789782942.349537 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1b04f): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b04f): Mirror 3: 0xd827eba9 (stale) CRC-32 checksum value for chunk [0, 0x1b04f): Mirror 1: 0xd827eba9 Mirror 4: 0xd827eba9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b04f: skipped 000259 1789782943.563114 punch from 0x0040c0 to 0x013ce0 (0xfc21 bytes) 000260 1789782943.751597 punch from 0x00cad9 to 0x016b57 (0xa07f bytes) 000261 1789782943.761374 mapread 0x00942a thru 0x00a458 (0x102f bytes) 000262 1789782943.777476 punch from 0x00a287 to 0x00a557 (0x2d1 bytes) 000263 1789782943.791721 MIRROR_RESYNC 3 mirrors 000264 1789782944.794183 read 0x01005e thru 0x0103a1 (0x344 bytes) 000266 1789782944.805391 write 0x006efb thru 0x00ca08 (0x5b0e bytes) 000269 1789782944.871483 read 0x013b00 thru 0x01b04e (0x754f bytes) 000273 1789782944.884509 mapread 0x00f9bc thru 0x013393 (0x39d8 bytes) 000274 1789782944.886141 punch from 0x002aaa to 0x0128dd (0xfe34 bytes) 000276 1789782944.898959 trunc from 0x01b04f to 0x002644 (0x18a0a bytes) 000278 1789782944.931003 mapwrite 0x034b1a thru 0x03d737 (0x8c1e bytes) 000282 1789782945.059010 punch from 0x01e25f to 0x028df7 (0xab99 bytes) 000283 1789782945.067788 write 0x026afe thru 0x03144a (0xa94d bytes) 000285 1789782945.079982 write 0x032976 thru 0x03aec7 (0x8552 bytes) 000286 1789782945.100957 MIRROR_RESYNC 3 mirrors 000287 1789782947.148326 mapwrite 0x025daf thru 0x02bc2a (0x5e7c bytes) 000288 1789782947.512077 write 0x03fdbe thru 0x03ffff (0x242 bytes) 000289 1789782947.513108 trunc from 0x040000 to 0x01365e (0x2c9a1 bytes) 000290 1789782947.570275 mapread 0x0093c1 thru 0x00dac2 (0x4702 bytes) 000291 1789782947.590216 punch from 0x005bae to 0x01082f (0xac82 bytes) 000295 1789782947.608492 trunc from 0x01365f to 0x00bb31 (0x7b2d bytes) 000297 1789782947.649606 MIRROR_RESYNC 3 mirrors 000298 1789782948.837635 mapread 0x0015e4 thru 0x009b89 (0x85a6 bytes) 000299 1789782948.876404 mapwrite 0x0020a8 thru 0x006c0c (0x4b65 bytes) 000300 1789782949.082813 trunc from 0x00bb32 to 0x00cc71 (0x1140 bytes) 000301 1789782949.106964 punch from 0x009fb1 to 0x00cc71 (0x2cc1 bytes) 000303 1789782949.113175 read 0x009f55 thru 0x00cc71 (0x2d1d bytes) 000304 1789782949.121073 punch from 0x003fed to 0x00cc71 (0x8c85 bytes) 000305 1789782949.127292 trunc from 0x00cc72 to 0x0325e4 (0x25973 bytes) 000306 1789782949.143953 punch from 0x012c95 to 0x0177be (0x4b2a bytes) 000309 1789782949.151516 read 0x01f88b thru 0x028de2 (0x9558 bytes) 000312 1789782949.171540 mapread 0x02ab10 thru 0x0325e4 (0x7ad5 bytes) 000313 1789782949.172860 mapwrite 0x016cfc thru 0x01908c (0x2391 bytes) 000314 1789782949.230564 mapread 0x02e675 thru 0x0325e4 (0x3f70 bytes) 000315 1789782949.231855 read 0x011ba8 thru 0x021460 (0xf8b9 bytes) 000316 1789782949.232526 punch from 0x00ece1 to 0x01dd26 (0xf046 bytes) 000318 1789782949.238359 write 0x013b75 thru 0x0152e7 (0x1773 bytes) 000320 1789782949.249119 mapread 0x001976 thru 0x00d195 (0xb820 bytes) 000321 1789782949.250105 write 0x0220c5 thru 0x0251f7 (0x3133 bytes) 000322 1789782949.254864 read 0x0231dd thru 0x024984 (0x17a8 bytes) 000323 1789782949.256176 read 0x010c13 thru 0x0175ea (0x69d8 bytes) 000324 1789782949.258553 punch from 0x0230d5 to 0x02c710 (0x963c bytes) 000326 1789782949.275307 punch from 0x01ea45 to 0x0249d0 (0x5f8c bytes) 000330 1789782949.282323 mapwrite 0x007ed1 thru 0x00ac40 (0x2d70 bytes) 000331 1789782949.339808 mapread 0x0094a3 thru 0x0155ea (0xc148 bytes) 000332 1789782949.341518 read 0x01bb01 thru 0x023485 (0x7985 bytes) 000333 1789782949.351980 mapread 0x02941c thru 0x02edeb (0x59d0 bytes) 000334 1789782949.353551 read 0x002c68 thru 0x00b72e (0x8ac7 bytes) 000336 1789782949.354930 mapread 0x0247d9 thru 0x02b8a5 (0x70cd bytes) 000337 1789782949.356373 write 0x023cb7 thru 0x03103d (0xd387 bytes) 000338 1789782949.357984 read 0x00cfdd thru 0x01a9ab (0xd9cf bytes) 000339 1789782949.358962 punch from 0x011f08 to 0x01969b (0x7794 bytes) 000341 1789782949.378533 read 0x022420 thru 0x027a66 (0x5647 bytes) 000343 1789782949.379620 trunc from 0x0325e5 to 0x02b959 (0x6c8b bytes) 000344 1789782949.429538 trunc from 0x02b95a to 0x00134d (0x2a60c bytes) 000345 1789782949.477540 punch from 0x000dbc to 0x00134d (0x592 bytes) 000346 1789782949.490448 mapwrite 0x00c4f0 thru 0x00fdd0 (0x38e1 bytes) 000347 1789782949.610438 mapwrite 0x026898 thru 0x0323e8 (0xbb51 bytes) 000350 1789782949.788892 mapread 0x013d50 thru 0x015689 (0x193a bytes) 000351 1789782949.789998 trunc from 0x0323e9 to 0x00baec (0x268fc bytes) 000353 1789782949.821093 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0xbaed): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xbaed): Mirror 3: 0x9afa44ba (stale) Mirror 4: 0x9afa44ba (stale) CRC-32 checksum value for chunk [0, 0xbaed): Mirror 1: 0x5e7e73f3 Mirror 5: 0x5e7e73f3 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xbaed: skipped 000354 1789782950.914636 mapwrite 0x00599c thru 0x0063c8 (0xa2d bytes) 000355 1789782951.143938 mapwrite 0x000d4d thru 0x00d424 (0xc6d8 bytes) 000359 1789782951.260382 read 0x0061d1 thru 0x00d424 (0x7254 bytes) 000360 1789782951.270772 MIRROR_RESYNC 4 mirrors 000361 1789782952.603448 MIRROR_RESYNC 4 mirrors 000362 1789782953.108941 mapread 0x000433 thru 0x0043ff (0x3fcd bytes) 000363 1789782953.180460 trunc from 0x00d425 to 0x0316b7 (0x24293 bytes) 000365 1789782953.393898 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x316b8): Mirror 4: 0x1ab58269 (stale) Mirror 5: 0x1ab58269 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x316b8): Mirror 4: 0x1ab58269 (stale) Mirror 5: 0x1ab58269 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x316b8: skipped 000366 1789782953.899885 trunc from 0x0316b8 to 0x01d9ed (0x13cca bytes) 000367 1789782953.940195 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1d9ee): Mirror 5: 0xf859296 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1d9ee): Mirror 5: 0xf859296 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1d9ee: skipped 000368 1789782954.437455 mapread 0x010887 thru 0x01d9ed (0xd167 bytes) 000370 1789782954.498546 mapread 0x01896d thru 0x018f67 (0x5fb bytes) 000371 1789782954.499923 punch from 0x000d1f to 0x007499 (0x677b bytes) 000372 1789782954.505103 trunc from 0x01d9ee to 0x0057b1 (0x1823c bytes) 000373 1789782954.527413 write 0x0376d4 thru 0x03bc2f (0x455c bytes) 000374 1789782954.535842 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) 000375 1789782954.687629 write 0x0043d6 thru 0x012844 (0xe46f bytes) 000376 1789782954.707428 mapwrite 0x01faf6 thru 0x02c77e (0xcc89 bytes) 000378 1789782954.915188 write 0x031c68 thru 0x03d032 (0xb3cb bytes) 000379 1789782954.923002 punch from 0x017b73 to 0x01aa18 (0x2ea6 bytes) 000380 1789782954.951407 write 0x031995 thru 0x03872b (0x6d97 bytes) 000383 1789782954.955421 write 0x01245c thru 0x01c873 (0xa418 bytes) 000384 1789782954.957434 punch from 0x0004d7 to 0x002b11 (0x263b bytes) 000385 1789782954.969925 read 0x006ad6 thru 0x00e8b0 (0x7ddb bytes) 000386 1789782954.970868 mapread 0x027416 thru 0x02e00a (0x6bf5 bytes) 000388 1789782954.972918 read 0x016695 thru 0x01ee48 (0x87b4 bytes) 000389 1789782954.973520 punch from 0x008fe7 to 0x015e4c (0xce66 bytes) 000390 1789782954.979376 trunc from 0x03d033 to 0x007fd0 (0x35062 bytes) 000391 1789782955.002366 trunc from 0x007fd1 to 0x0157aa (0xd7da bytes) 000394 1789782955.020887 punch from 0x0125b4 to 0x0157aa (0x31f7 bytes) 000395 1789782955.039165 MIRROR_EXTEND to 2 mirrors 000397 1789782956.274345 punch from 0x0033bc to 0x010a54 (0xd699 bytes) 000398 1789782956.417301 punch from 0x0075c8 to 0x0091fe (0x1c37 bytes) 000399 1789782956.426586 trunc from 0x0157ab to 0x011b84 (0x3c26 bytes) 000401 1789782956.480455 read 0x0033a4 thru 0x00f0fb (0xbd58 bytes) 000402 1789782956.491788 write 0x00f83c thru 0x01cab9 (0xd27e bytes) 000403 1789782956.503083 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x1caba): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1caba): Mirror 2: 0xf089f8d6 (stale) CRC-32 checksum value for chunk [0, 0x1caba): Mirror 1: 0xec649be0 Mirror 3: 0xec649be0 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1caba: skipped 000404 1789782957.727906 read 0x01bd3f thru 0x01cab9 (0xd7b bytes) 000408 1789782957.795487 punch from 0x004e3a to 0x005000 (0x1c7 bytes) 000409 1789782957.932972 trunc from 0x01caba to 0x03663d (0x19b84 bytes) 000410 1789782957.962794 trunc from 0x03663e to 0x0361d9 (0x464 bytes) 000411 1789782958.013393 punch from 0x0356c7 to 0x0361d9 (0xb13 bytes) 000412 1789782958.024474 trunc from 0x0361da to 0x02af2f (0xb2aa bytes) 000413 1789782958.045994 punch from 0x029a70 to 0x02af2f (0x14c0 bytes) 000414 1789782958.053003 punch from 0x000a8b to 0x002c5e (0x21d4 bytes) 000417 1789782958.065250 write 0x00c1a9 thru 0x01a77d (0xe5d5 bytes) 000420 1789782958.087180 mapwrite 0x00825f thru 0x00e570 (0x6312 bytes) 000422 1789782958.269128 punch from 0x029909 to 0x02af2f (0x1627 bytes) 000425 1789782958.276056 trunc from 0x02af30 to 0x034353 (0x9424 bytes) 000426 1789782958.303792 mapread 0x028127 thru 0x02a988 (0x2862 bytes) 000427 1789782958.327907 read 0x030d1f thru 0x034353 (0x3635 bytes) 000428 1789782958.354448 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x34354): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34354): Mirror 2: 0xba10fd39 (stale) Mirror 3: 0x1f92045 (stale) CRC-32 checksum value for chunk [0, 0x34354): Mirror 1: 0x482145e2 Mirror 4: 0x482145e2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34354: skipped 000429 1789782959.564647 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34354): Mirror 2: 0xba10fd39 (stale) Mirror 3: 0x1f92045 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34354): Mirror 2: 0xba10fd39 (stale) Mirror 3: 0x1f92045 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34354: skipped 000430 1789782959.985680 punch from 0x01d524 to 0x0290e3 (0xbbc0 bytes) 000432 1789782960.008315 trunc from 0x034354 to 0x00d261 (0x270f2 bytes) 000434 1789782960.103350 read 0x006549 thru 0x00d261 (0x6d19 bytes) 000437 1789782960.135762 trunc from 0x00d262 to 0x03bb59 (0x2e8f8 bytes) 000438 1789782960.175490 mapread 0x0148e9 thru 0x020302 (0xba1a bytes) 000439 1789782960.225230 write 0x03ebae thru 0x03efba (0x40d bytes) 000440 1789782960.226239 mapwrite 0x01ff94 thru 0x02a9a6 (0xaa13 bytes) 000441 1789782960.389693 mapwrite 0x00544d thru 0x005883 (0x437 bytes) 000442 1789782960.512366 mapwrite 0x0121a9 thru 0x017361 (0x51b9 bytes) 000444 1789782960.580649 trunc from 0x03efbb to 0x01349a (0x2bb20 bytes) 000446 1789782960.614659 mapwrite 0x017cbe thru 0x0273af (0xf6f2 bytes) 000447 1789782960.818958 read 0x01c05b thru 0x01d44a (0x13f0 bytes) 000448 1789782960.827809 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x273b0): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x273b0): Mirror 2: 0x5ef077ca (stale) Mirror 3: 0xa331ba56 (stale) CRC-32 checksum value for chunk [0, 0x273b0): Mirror 1: 0xb60ca5d5 Mirror 4: 0xb60ca5d5 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x273b0: skipped 000449 1789782961.937677 mapwrite 0x01cfd3 thru 0x0255a9 (0x85d7 bytes) 000452 1789782962.169573 trunc from 0x0273b0 to 0x01d5eb (0x9dc4 bytes) 000453 1789782962.216254 mapwrite 0x007f76 thru 0x00c5ea (0x4675 bytes) 000454 1789782962.343379 MIRROR_RESYNC 4 mirrors 000455 1789782963.578035 punch from 0x0008ee to 0x007d2f (0x7442 bytes) 000456 1789782963.661103 punch from 0x001e00 to 0x00c30e (0xa50f bytes) 000459 1789782963.670083 read 0x01cae4 thru 0x01d5eb (0xb08 bytes) 000460 1789782963.681238 trunc from 0x01d5ec to 0x01ad83 (0x2868 bytes) 000461 1789782963.712942 read 0x00323d thru 0x007b02 (0x48c6 bytes) 000462 1789782963.731891 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1ad84): Mirror 2: (stale - read error) Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1ad84): Mirror 2: 0xe817e9c0 (stale) Mirror 3: 0xe817e9c0 (stale) Mirror 4: 0xe817e9c0 (stale) CRC-32 checksum value for chunk [0, 0x1ad84): Mirror 1: 0xef76069f Mirror 5: 0xef76069f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1ad84: skipped 000463 1789782964.789843 trunc from 0x01ad84 to 0x026faa (0xc227 bytes) 000464 1789782964.882612 trunc from 0x026fab to 0x0079ec (0x1f5be bytes) 000465 1789782964.922988 MIRROR_RESYNC 5 mirrors 000470 1789782966.453768 trunc from 0x0079ed to 0x0053ee (0x25fe bytes) 000472 1789782966.630669 MIRROR_SPLIT mirror 1 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x53ef): Mirror 3: 0x63ac9f1f (stale) Mirror 4: 0x63ac9f1f (stale) Mirror 5: 0x63ac9f1f (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x53ef): Mirror 3: 0x63ac9f1f (stale) Mirror 4: 0x63ac9f1f (stale) Mirror 5: 0x63ac9f1f (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x53ef: skipped 000473 1789782967.158456 read 0x0003da thru 0x0053ee (0x5015 bytes) 000475 1789782967.177592 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x53ef): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x53ef): Mirror 3: 0x63ac9f1f (stale) Mirror 4: 0x63ac9f1f (stale) Mirror 5: 0x63ac9f1f (stale) CRC-32 checksum value for chunk [0, 0x53ef): Mirror 1: 0x63ac9f1f Mirror 6: 0x63ac9f1f lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x53ef: skipped 000476 1789782968.800039 mapwrite 0x03c142 thru 0x03ffff (0x3ebe bytes) 000478 1789782969.180936 write 0x017c0c thru 0x024a84 (0xce79 bytes) 000480 1789782969.205243 mapread 0x0166bd thru 0x019b10 (0x3454 bytes) 000484 1789782969.251965 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x8cc90408 (stale) Mirror 4: 0x8cc90408 (stale) Mirror 5: 0x8cc90408 (stale) Mirror 6: 0x8cc90408 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc7c57571 Mirror 7: 0xc7c57571 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000485 1789782971.849291 write 0x03eb52 thru 0x03ffff (0x14ae bytes) 000487 1789782972.105315 MIRROR_SPLIT mirror 4 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x8cc90408 (stale) Mirror 4: 0x8cc90408 (stale) Mirror 5: 0x8cc90408 (stale) Mirror 7: 0xc7c57571 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x8cc90408 (stale) Mirror 4: 0x8cc90408 (stale) Mirror 5: 0x8cc90408 (stale) Mirror 7: 0xc7c57571 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000489 1789782972.880036 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x8cc90408 (stale) Mirror 5: 0x8cc90408 (stale) Mirror 7: 0xc7c57571 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x8cc90408 (stale) Mirror 5: 0x8cc90408 (stale) Mirror 7: 0xc7c57571 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000490 1789782973.580928 punch from 0x020f47 to 0x029625 (0x86df bytes) 000492 1789782973.591065 mapwrite 0x02c785 thru 0x0341fc (0x7a78 bytes) 000493 1789782973.744687 MIRROR_RESYNC 4 mirrors 000494 1789782975.676339 MIRROR_EXTEND to 5 mirrors 000496 1789782976.610467 read 0x0355d7 thru 0x03f4a3 (0x9ecd bytes) 000497 1789782976.628411 punch from 0x004c30 to 0x00a41e (0x57ef bytes) 000498 1789782976.751382 mapwrite 0x00902c thru 0x00f99d (0x6972 bytes) 000499 1789782976.889010 write 0x018bba thru 0x02621d (0xd664 bytes) 000501 1789782976.916977 mapwrite 0x02c5ca thru 0x03a9ff (0xe436 bytes) 000502 1789782977.006781 mapread 0x02bb7f thru 0x02e306 (0x2788 bytes) 000503 1789782977.011835 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x61252fd9 (stale) Mirror 5: 0x61252fd9 (stale) Mirror 7: 0x61252fd9 (stale) Mirror 8: 0x61252fd9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x76379764 Mirror 9: 0x76379764 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000504 1789782978.279818 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x61252fd9 (stale) Mirror 5: 0x61252fd9 (stale) Mirror 7: 0x61252fd9 (stale) Mirror 8: 0x61252fd9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x76379764 Mirror 9: 0x76379764 Mirror 10: 0x76379764 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000505 1789782979.435127 MIRROR_SPLIT mirror 5 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x61252fd9 (stale) Mirror 5: 0x61252fd9 (stale) Mirror 7: 0x61252fd9 (stale) Mirror 8: 0x61252fd9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x61252fd9 (stale) Mirror 5: 0x61252fd9 (stale) Mirror 7: 0x61252fd9 (stale) Mirror 8: 0x61252fd9 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x76379764 Mirror 10: 0x76379764 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000507 1789782980.828798 mapread 0x02c595 thru 0x03163b (0x50a7 bytes) 000509 1789782980.946606 mapwrite 0x0092f5 thru 0x00f4f7 (0x6203 bytes) 000510 1789782981.215417 punch from 0x005c2f to 0x006a52 (0xe24 bytes) 000512 1789782981.222891 mapwrite 0x0160a6 thru 0x020654 (0xa5af bytes) 000513 1789782981.294803 read 0x026a5f thru 0x03266f (0xbc11 bytes) 000514 1789782981.303881 punch from 0x03e229 to 0x03ffff (0x1dd7 bytes) 000515 1789782981.311233 mapread 0x0399c3 thru 0x03f62d (0x5c6b bytes) 000516 1789782981.322173 punch from 0x03ad86 to 0x03c86e (0x1ae9 bytes) 000517 1789782981.327021 punch from 0x023f9a to 0x026900 (0x2967 bytes) 000518 1789782981.331866 mapwrite 0x01b389 thru 0x0233c1 (0x8039 bytes) 000519 1789782981.386696 trunc from 0x040000 to 0x0096d3 (0x3692c bytes) 000520 1789782981.417144 read 0x00864a thru 0x0096d3 (0x108a bytes) 000521 1789782981.417838 trunc from 0x0096d4 to 0x02ed31 (0x2565e bytes) 000522 1789782981.436577 mapwrite 0x00667d thru 0x0107bd (0xa141 bytes) 000523 1789782981.491951 mapwrite 0x03a464 thru 0x03ffff (0x5b9c bytes) truncating to largest ever: 0x3fae3 000524 1789782981.550766 trunc from 0x040000 to 0x03fae2 (0x51d bytes) 000527 1789782981.570632 punch from 0x02cab7 to 0x030ab8 (0x4002 bytes) 000528 1789782981.575816 mapwrite 0x00c1e5 thru 0x0169eb (0xa807 bytes) 000529 1789782981.613876 mapwrite 0x00cc46 thru 0x01b207 (0xe5c2 bytes) 000531 1789782981.662589 punch from 0x036513 to 0x03a768 (0x4256 bytes) 000533 1789782981.674359 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3fae3): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fae3): Mirror 3: 0x9684a540 (stale) Mirror 5: 0x9684a540 (stale) Mirror 7: 0x9684a540 (stale) Mirror 8: 0x9684a540 (stale) Mirror 10: 0x3ad7a2ff (stale) CRC-32 checksum value for chunk [0, 0x3fae3): Mirror 1: 0xed787a87 Mirror 11: 0xed787a87 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fae3: skipped 000535 1789782982.866528 trunc from 0x03fae3 to 0x01f4a8 (0x2063a bytes) 000537 1789782982.963407 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x1f4a9): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f4a9): Mirror 3: 0x85f8b3a8 (stale) Mirror 5: 0x85f8b3a8 (stale) Mirror 7: 0x85f8b3a8 (stale) Mirror 8: 0x85f8b3a8 (stale) Mirror 10: 0x730de74e (stale) Mirror 11: 0x663c6c6c (stale) CRC-32 checksum value for chunk [0, 0x1f4a9): Mirror 1: 0x663c6c6c Mirror 12: 0x663c6c6c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f4a9: skipped 000540 1789782984.309635 mapread 0x00d02c thru 0x01865d (0xb632 bytes) 000541 1789782984.422251 MIRROR_RESYNC 8 mirrors 000542 1789782986.961721 punch from 0x0134a9 to 0x01c457 (0x8faf bytes) 000543 1789782987.177354 punch from 0x00b925 to 0x014bb2 (0x928e bytes) 000545 1789782987.189226 read 0x0094e0 thru 0x016f9d (0xdabe bytes) 000547 1789782987.207253 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x1f4a9): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1f4a9): Mirror 3: 0x663c6c6c (stale) Mirror 5: 0x663c6c6c (stale) Mirror 7: 0x663c6c6c (stale) Mirror 8: 0x663c6c6c (stale) Mirror 10: 0x663c6c6c (stale) Mirror 11: 0x663c6c6c (stale) Mirror 12: 0x663c6c6c (stale) CRC-32 checksum value for chunk [0, 0x1f4a9): Mirror 1: 0xb75be69d Mirror 13: 0xb75be69d lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1f4a9: skipped 000548 1789782988.894539 punch from 0x0148ab to 0x01cde0 (0x8536 bytes) 000549 1789782989.091364 punch from 0x01990b to 0x01f4a8 (0x5b9e bytes) 000550 1789782989.103454 mapread 0x004f5d thru 0x005dc2 (0xe66 bytes) 000551 1789782989.129566 mapwrite 0x03b850 thru 0x03ffff (0x47b0 bytes) 000552 1789782989.269948 write 0x034fbb thru 0x03ffff (0xb045 bytes) 000553 1789782989.272011 trunc from 0x040000 to 0x03df1a (0x20e5 bytes) 000554 1789782989.325929 trunc from 0x03df1b to 0x019053 (0x24ec7 bytes) 000557 1789782989.444240 punch from 0x00df59 to 0x019053 (0xb0fb bytes) 000558 1789782989.455485 mapwrite 0x000c42 thru 0x00efb7 (0xe376 bytes) 000559 1789782989.583020 punch from 0x000dc4 to 0x00db44 (0xcd81 bytes) 000560 1789782989.597359 read 0x018998 thru 0x019053 (0x6bc bytes) 000561 1789782989.612175 mapwrite 0x030ef5 thru 0x03e1ec (0xd2f8 bytes) 000563 1789782989.886939 trunc from 0x03e1ed to 0x010d50 (0x2d49c bytes) 000564 1789782989.952188 mapwrite 0x03c9ae thru 0x03ffff (0x3652 bytes) 000565 1789782990.088684 read 0x018d39 thru 0x01a3f6 (0x16be bytes) 000566 1789782990.099699 trunc from 0x040000 to 0x00eaae (0x31551 bytes) 000568 1789782990.123975 mapwrite 0x00a2e9 thru 0x00fc2f (0x5947 bytes) 000569 1789782990.279896 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0xfc30): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xfc30): Mirror 3: 0x8656bf8e (stale) Mirror 5: 0x8656bf8e (stale) Mirror 7: 0x8656bf8e (stale) Mirror 8: 0x8656bf8e (stale) Mirror 10: 0x8656bf8e (stale) Mirror 11: 0x8656bf8e (stale) Mirror 12: 0x8656bf8e (stale) Mirror 13: 0x8dfdc59b (stale) CRC-32 checksum value for chunk [0, 0xfc30): Mirror 1: 0x5ced925a Mirror 14: 0x5ced925a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xfc30: skipped 000570 1789782991.316198 mapwrite 0x000202 thru 0x009f80 (0x9d7f bytes) 000573 1789782991.574322 mapread 0x00a8bf thru 0x00fc2f (0x5371 bytes) 000575 1789782991.576983 mapwrite 0x00a1a3 thru 0x00f0e1 (0x4f3f bytes) 000576 1789782991.673835 trunc from 0x00fc30 to 0x013af3 (0x3ec4 bytes) 000577 1789782991.801979 write 0x009214 thru 0x009cf9 (0xae6 bytes) 000578 1789782991.806697 mapwrite 0x014dae thru 0x016218 (0x146b bytes) 000579 1789782991.929021 mapwrite 0x00828b thru 0x012887 (0xa5fd bytes) 000582 1789782992.019143 write 0x036eab thru 0x03fe45 (0x8f9b bytes) 000583 1789782992.036163 write 0x0164ef thru 0x01a78c (0x429e bytes) 000585 1789782992.082392 write 0x018196 thru 0x023871 (0xb6dc bytes) 000586 1789782992.115158 MIRROR_SPLIT mirror 7 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3fe46): Mirror 3: 0xeef59886 (stale) Mirror 5: 0xeef59886 (stale) Mirror 7: 0xeef59886 (stale) Mirror 8: 0xeef59886 (stale) Mirror 10: 0xeef59886 (stale) Mirror 11: 0xeef59886 (stale) Mirror 13: 0x5f5c0584 (stale) Mirror 14: 0xdedc6abc (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3fe46): Mirror 3: 0xeef59886 (stale) Mirror 5: 0xeef59886 (stale) Mirror 7: 0xeef59886 (stale) Mirror 8: 0xeef59886 (stale) Mirror 10: 0xeef59886 (stale) Mirror 11: 0xeef59886 (stale) Mirror 13: 0x5f5c0584 (stale) Mirror 14: 0xdedc6abc (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3fe46: skipped 000587 1789782993.332026 mapwrite 0x008dd1 thru 0x00af11 (0x2141 bytes) 000588 1789782993.404173 trunc from 0x03fe46 to 0x022b6d (0x1d2d8 bytes) 000590 1789782993.431321 trunc from 0x022b6e to 0x038dd5 (0x16268 bytes) 000591 1789782993.467859 read 0x031dfd thru 0x037584 (0x5788 bytes) 000592 1789782993.501599 MIRROR_EXTEND to 10 mirrors CRC-32 checksum value for chunk [0, 0x38dd6): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 14: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x38dd6): Mirror 3: 0x9d64d543 (stale) Mirror 5: 0x9d64d543 (stale) Mirror 7: 0x9d64d543 (stale) Mirror 8: 0x9d64d543 (stale) Mirror 10: 0x9d64d543 (stale) Mirror 11: 0x9d64d543 (stale) Mirror 13: 0xd2c05197 (stale) Mirror 14: 0x687f52d9 (stale) CRC-32 checksum value for chunk [0, 0x38dd6): Mirror 1: 0x75259819 Mirror 15: 0x75259819 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x38dd6: skipped 000593 1789782995.532981 trunc from 0x038dd6 to 0x00769e (0x31737 bytes) 000594 1789782995.800903 mapread 0x0033d3 thru 0x00769e (0x42cc bytes) 000596 1789782995.837145 punch from 0x004c77 to 0x00769e (0x2a28 bytes) 000601 1789782995.863979 write 0x03a516 thru 0x03b0be (0xba9 bytes) 000602 1789782995.870559 punch from 0x014aba to 0x0209fd (0xbf44 bytes) 000603 1789782995.897878 read 0x035e29 thru 0x03b0be (0x5296 bytes) 000606 1789782995.936548 trunc from 0x03b0bf to 0x0173b0 (0x23d0e bytes) 000607 1789782995.976655 read 0x0085d8 thru 0x0108dd (0x8306 bytes) 000610 1789782996.004968 mapwrite 0x00f725 thru 0x012a0b (0x32e7 bytes) 000613 1789782996.186597 MIRROR_RESYNC 10 mirrors 000614 1789782999.596481 read 0x010e17 thru 0x016884 (0x5a6e bytes) 000615 1789782999.605599 punch from 0x0103c5 to 0x0139a3 (0x35df bytes) 000616 1789782999.681839 read 0x00c12a thru 0x014e7a (0x8d51 bytes) 000617 1789782999.706588 write 0x02af74 thru 0x02b743 (0x7d0 bytes) 000618 1789782999.708463 mapread 0x0227d2 thru 0x02b743 (0x8f72 bytes) 000619 1789782999.720585 read 0x011cf8 thru 0x017e2a (0x6133 bytes) 000621 1789782999.723083 mapwrite 0x01ee0c thru 0x020434 (0x1629 bytes) 000622 1789782999.812267 MIRROR_SPLIT mirror 3 to 9 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2b744): Mirror 3: 0xda505b0 (stale) Mirror 5: 0xda505b0 (stale) Mirror 8: 0xda505b0 (stale) Mirror 10: 0xda505b0 (stale) Mirror 11: 0xda505b0 (stale) Mirror 13: 0xda505b0 (stale) Mirror 14: 0xda505b0 (stale) Mirror 15: 0xda505b0 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2b744): Mirror 3: 0xda505b0 (stale) Mirror 5: 0xda505b0 (stale) Mirror 8: 0xda505b0 (stale) Mirror 10: 0xda505b0 (stale) Mirror 11: 0xda505b0 (stale) Mirror 13: 0xda505b0 (stale) Mirror 14: 0xda505b0 (stale) Mirror 15: 0xda505b0 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2b744: skipped 000623 1789783000.448796 punch from 0x00d978 to 0x016690 (0x8d19 bytes) 000624 1789783000.476236 MIRROR_RESYNC 9 mirrors 000625 1789783004.627232 read 0x02799d thru 0x02b743 (0x3da7 bytes) 000627 1789783004.654462 mapread 0x01ca28 thru 0x023fde (0x75b7 bytes) 000628 1789783004.766366 mapread 0x019f5f thru 0x021371 (0x7413 bytes) 000629 1789783004.770709 trunc from 0x02b744 to 0x033fab (0x8868 bytes) 000631 1789783005.150830 read 0x01b7bf thru 0x026fe4 (0xb826 bytes) 000632 1789783005.202530 MIRROR_SPLIT mirror 7 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x33fac): Mirror 3: 0x7d972fa3 (stale) Mirror 5: 0x7d972fa3 (stale) Mirror 8: 0x7d972fa3 (stale) Mirror 10: 0x7d972fa3 (stale) Mirror 11: 0x7d972fa3 (stale) Mirror 13: 0x7d972fa3 (stale) Mirror 15: 0x7d972fa3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x33fac): Mirror 3: 0x7d972fa3 (stale) Mirror 5: 0x7d972fa3 (stale) Mirror 8: 0x7d972fa3 (stale) Mirror 10: 0x7d972fa3 (stale) Mirror 11: 0x7d972fa3 (stale) Mirror 13: 0x7d972fa3 (stale) Mirror 15: 0x7d972fa3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x33fac: skipped 000634 1789783006.883563 mapread 0x001ecf thru 0x00df6e (0xc0a0 bytes) 000636 1789783006.929443 trunc from 0x033fac to 0x031022 (0x2f89 bytes) 000637 1789783006.980630 MIRROR_SPLIT mirror 3 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x31023): Mirror 3: 0xbb8f1a3 (stale) Mirror 5: 0xbb8f1a3 (stale) Mirror 10: 0xbb8f1a3 (stale) Mirror 11: 0xbb8f1a3 (stale) Mirror 13: 0xbb8f1a3 (stale) Mirror 15: 0xbb8f1a3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x31023): Mirror 3: 0xbb8f1a3 (stale) Mirror 5: 0xbb8f1a3 (stale) Mirror 10: 0xbb8f1a3 (stale) Mirror 11: 0xbb8f1a3 (stale) Mirror 13: 0xbb8f1a3 (stale) Mirror 15: 0xbb8f1a3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x31023: skipped 000638 1789783007.669907 mapread 0x012185 thru 0x01252f (0x3ab bytes) 000641 1789783007.695547 MIRROR_RESYNC 7 mirrors 000644 1789783009.900811 read 0x00c7e0 thru 0x0160df (0x9900 bytes) 000646 1789783009.912161 write 0x0096c3 thru 0x016e8c (0xd7ca bytes) 000647 1789783010.030328 mapwrite 0x02fc5d thru 0x03c2fe (0xc6a2 bytes) 000649 1789783010.293947 read 0x03417d thru 0x03c2fe (0x8182 bytes) 000650 1789783010.294539 write 0x015bc2 thru 0x021a24 (0xbe63 bytes) 000651 1789783010.342990 punch from 0x02a55d to 0x02bcde (0x1782 bytes) 000652 1789783010.361194 mapwrite 0x0076ae thru 0x010153 (0x8aa6 bytes) 000656 1789783010.470121 read 0x03bac5 thru 0x03c2fe (0x83a bytes) 000657 1789783010.470787 punch from 0x029b79 to 0x03088a (0x6d12 bytes) 000658 1789783010.483600 mapwrite 0x036318 thru 0x03b578 (0x5261 bytes) 000661 1789783010.568109 mapwrite 0x00d07b thru 0x01137d (0x4303 bytes) 000666 1789783010.670188 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3c2ff): Mirror 3: (stale - read error) Mirror 5: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c2ff): Mirror 3: 0x3f2280de (stale) Mirror 5: 0x3f2280de (stale) Mirror 10: 0x3f2280de (stale) Mirror 11: 0x3f2280de (stale) Mirror 13: 0x3f2280de (stale) Mirror 15: 0x3f2280de (stale) CRC-32 checksum value for chunk [0, 0x3c2ff): Mirror 1: 0x47edf20a Mirror 16: 0x47edf20a lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c2ff: skipped 000668 1789783012.417198 write 0x035312 thru 0x0360d9 (0xdc8 bytes) 000669 1789783012.634045 punch from 0x03235d to 0x038539 (0x61dd bytes) 000672 1789783012.689306 MIRROR_SPLIT mirror 2 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3c2ff): Mirror 3: 0x3f2280de (stale) Mirror 10: 0x3f2280de (stale) Mirror 11: 0x3f2280de (stale) Mirror 13: 0x3f2280de (stale) Mirror 15: 0x3f2280de (stale) Mirror 16: 0x47edf20a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c2ff): Mirror 3: 0x3f2280de (stale) Mirror 10: 0x3f2280de (stale) Mirror 11: 0x3f2280de (stale) Mirror 13: 0x3f2280de (stale) Mirror 15: 0x3f2280de (stale) Mirror 16: 0x47edf20a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c2ff: skipped 000673 1789783013.788889 trunc from 0x03c2ff to 0x00ce3d (0x2f4c1 bytes) 000674 1789783013.829584 read 0x009a35 thru 0x00ce3d (0x3409 bytes) 000675 1789783013.855339 trunc from 0x00ce3e to 0x0323a0 (0x25563 bytes) 000676 1789783013.891450 punch from 0x00aaec to 0x014279 (0x978e bytes) 000677 1789783013.899651 trunc from 0x0323a1 to 0x00db32 (0x2486e bytes) 000679 1789783013.935466 punch from 0x00d3e4 to 0x00db32 (0x74f bytes) 000680 1789783013.957499 trunc from 0x00db33 to 0x0130fa (0x55c8 bytes) 000681 1789783014.008823 read 0x009a6d thru 0x01145f (0x79f3 bytes) 000682 1789783014.047653 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x130fb): Mirror 3: 0x6a40c060 (stale) Mirror 11: 0x6a40c060 (stale) Mirror 13: 0x6a40c060 (stale) Mirror 15: 0x6a40c060 (stale) Mirror 16: 0xb3a3b5c (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x130fb): Mirror 3: 0x6a40c060 (stale) Mirror 11: 0x6a40c060 (stale) Mirror 13: 0x6a40c060 (stale) Mirror 15: 0x6a40c060 (stale) Mirror 16: 0xb3a3b5c (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x130fb: skipped 000683 1789783014.743855 write 0x02f0c6 thru 0x03687c (0x77b7 bytes) 000684 1789783014.746565 write 0x02dade thru 0x032568 (0x4a8b bytes) 000685 1789783014.755690 mapwrite 0x030f24 thru 0x03fca4 (0xed81 bytes) 000686 1789783014.888660 punch from 0x0241b6 to 0x024d85 (0xbd0 bytes) 000688 1789783014.902291 trunc from 0x03fca5 to 0x02c45e (0x13846 bytes) 000689 1789783014.956714 mapwrite 0x01ac9c thru 0x028129 (0xd48e bytes) 000690 1789783015.197129 trunc from 0x02c45f to 0x014e27 (0x17637 bytes) 000691 1789783015.261634 mapread 0x007934 thru 0x01042f (0x8afc bytes) 000692 1789783015.284817 mapwrite 0x033f31 thru 0x035eee (0x1fbe bytes) 000693 1789783015.475036 read 0x000d4d thru 0x000f74 (0x228 bytes) 000694 1789783015.488549 trunc from 0x035eef to 0x017837 (0x1e6b7 bytes) 000695 1789783015.518724 mapwrite 0x002ceb thru 0x00846c (0x5782 bytes) 000696 1789783015.690601 mapwrite 0x00fb06 thru 0x01be5d (0xc358 bytes) 000697 1789783015.849123 punch from 0x017f2b to 0x01be5d (0x3f33 bytes) 000698 1789783015.863002 write 0x008da9 thru 0x00ae08 (0x2060 bytes) 000699 1789783015.864679 write 0x036196 thru 0x03a32c (0x4197 bytes) 000700 1789783015.875101 punch from 0x027927 to 0x02cd5d (0x5437 bytes) 000701 1789783015.909284 trunc from 0x03a32d to 0x0023c0 (0x37f6c bytes) 000702 1789783015.962176 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x23c1): Mirror 3: (stale - read error) Mirror 11: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x23c1): Mirror 3: 0x7af012c1 (stale) Mirror 11: 0x7af012c1 (stale) Mirror 13: 0x7af012c1 (stale) Mirror 15: 0x7af012c1 (stale) Mirror 16: 0x7af012c1 (stale) CRC-32 checksum value for chunk [0, 0x23c1): Mirror 1: 0x7af012c1 Mirror 17: 0x7af012c1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x23c1: skipped 000703 1789783017.220523 write 0x005a74 thru 0x01274b (0xccd8 bytes) 000704 1789783017.335090 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1274c): Mirror 3: 0x5be57748 (stale) Mirror 13: 0x5be57748 (stale) Mirror 15: 0x5be57748 (stale) Mirror 16: 0x1cc6ecfe (stale) Mirror 17: 0x410a81d5 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1274c): Mirror 3: 0x5be57748 (stale) Mirror 13: 0x5be57748 (stale) Mirror 15: 0x5be57748 (stale) Mirror 16: 0x1cc6ecfe (stale) Mirror 17: 0x410a81d5 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1274c: skipped 000705 1789783017.863322 read 0x00d2a5 thru 0x01274b (0x54a7 bytes) 000706 1789783017.874580 write 0x034e38 thru 0x037327 (0x24f0 bytes) 000707 1789783017.875874 trunc from 0x037328 to 0x01112c (0x261fb bytes) 000708 1789783017.892198 mapwrite 0x00ca58 thru 0x01c414 (0xf9bd bytes) 000709 1789783018.128005 mapread 0x01c076 thru 0x01c414 (0x39f bytes) 000710 1789783018.129232 write 0x038e0b thru 0x03c8e1 (0x3ad7 bytes) 000711 1789783018.132693 read 0x03295f thru 0x03689d (0x3f3f bytes) 000712 1789783018.147147 trunc from 0x03c8e2 to 0x005832 (0x370af bytes) 000714 1789783018.175001 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x5833): Mirror 3: (stale - read error) Mirror 13: (stale - read error) Mirror 15: (stale - read error) Mirror 16: (stale - read error) Mirror 17: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5833): Mirror 3: 0x4a3eeb91 (stale) Mirror 13: 0x4a3eeb91 (stale) Mirror 15: 0x4a3eeb91 (stale) Mirror 16: 0x4a3eeb91 (stale) Mirror 17: 0x8e012ca9 (stale) CRC-32 checksum value for chunk [0, 0x5833): Mirror 1: 0x8e012ca9 Mirror 18: 0x8e012ca9 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5833: skipped 000716 1789783020.918177 punch from 0x000b40 to 0x003830 (0x2cf1 bytes) 000717 1789783021.154359 MIRROR_SPLIT mirror 1 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x5833): Mirror 13: 0x4a3eeb91 (stale) Mirror 15: 0x4a3eeb91 (stale) Mirror 16: 0x4a3eeb91 (stale) Mirror 17: 0x8e012ca9 (stale) Mirror 18: 0x8e012ca9 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x5833): Mirror 13: 0x4a3eeb91 (stale) Mirror 15: 0x4a3eeb91 (stale) Mirror 16: 0x4a3eeb91 (stale) Mirror 17: 0x8e012ca9 (stale) Mirror 18: 0x8e012ca9 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x5833: skipped 000718 1789783022.227473 mapwrite 0x021b6a thru 0x025c08 (0x409f bytes) 000719 1789783022.471131 read 0x010f73 thru 0x01dffd (0xd08b bytes) 000721 1789783022.502768 write 0x02a1a6 thru 0x02bcaf (0x1b0a bytes) 000722 1789783022.515019 MIRROR_SPLIT mirror 1 to 5 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x2bcb0): Mirror 15: 0x12fd41f7 (stale) Mirror 16: 0x197a85f9 (stale) Mirror 17: 0x3f6f391e (stale) Mirror 18: 0x3f6f391e (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2bcb0): Mirror 15: 0x12fd41f7 (stale) Mirror 16: 0x197a85f9 (stale) Mirror 17: 0x3f6f391e (stale) Mirror 18: 0x3f6f391e (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2bcb0: skipped 000724 1789783023.457900 mapwrite 0x025874 thru 0x0273eb (0x1b78 bytes) 000726 1789783023.652949 read 0x008a4c thru 0x0132f9 (0xa8ae bytes) 000728 1789783023.680631 trunc from 0x02bcb0 to 0x0037da (0x284d5 bytes) 000730 1789783023.736555 punch from 0x00373c to 0x0037da (0x9f bytes) 000731 1789783023.753599 punch from 0x0019a3 to 0x0037da (0x1e38 bytes) 000732 1789783023.770793 write 0x03395d thru 0x03f18c (0xb830 bytes) 000734 1789783023.781616 mapread 0x02b188 thru 0x038635 (0xd4ae bytes) 000735 1789783023.808313 mapread 0x00b91d thru 0x018090 (0xc774 bytes) 000736 1789783023.851580 punch from 0x0388e2 to 0x03a61e (0x1d3d bytes) 000740 1789783023.881436 mapwrite 0x027c3f thru 0x033d6a (0xc12c bytes) 000741 1789783023.977581 punch from 0x038e62 to 0x03b1bd (0x235c bytes) 000742 1789783023.988446 trunc from 0x03f18d to 0x02ea9a (0x106f2 bytes) 000744 1789783024.027555 mapread 0x0211e9 thru 0x02ea9a (0xd8b2 bytes) 000746 1789783024.042367 MIRROR_RESYNC 5 mirrors 000747 1789783026.834065 punch from 0x02972c to 0x02a155 (0xa2a bytes) 000748 1789783026.903049 read 0x00710f thru 0x007e07 (0xcf9 bytes) 000750 1789783026.912170 mapwrite 0x02bcff thru 0x0302e5 (0x45e7 bytes) 000753 1789783027.191664 read 0x014924 thru 0x01efaa (0xa687 bytes) 000754 1789783027.220829 trunc from 0x0302e6 to 0x03d5c9 (0xd2e4 bytes) 000757 1789783027.262684 trunc from 0x03d5ca to 0x016d67 (0x26862 bytes) 000759 1789783027.308170 write 0x0127d1 thru 0x01eeb9 (0xc6e9 bytes) 000760 1789783027.312785 punch from 0x01ace9 to 0x01ca70 (0x1d88 bytes) 000761 1789783027.340012 punch from 0x00695c to 0x007356 (0x9fb bytes) 000762 1789783027.350326 read 0x00d8c7 thru 0x017771 (0x9eab bytes) 000763 1789783027.371864 MIRROR_RESYNC 5 mirrors 000764 1789783030.149641 punch from 0x00fc0b to 0x0116be (0x1ab4 bytes) 000765 1789783030.229700 write 0x02fdb8 thru 0x030037 (0x280 bytes) 000767 1789783030.231261 write 0x01d330 thru 0x028f88 (0xbc59 bytes) 000769 1789783030.260673 trunc from 0x030038 to 0x011183 (0x1eeb4 bytes) 000770 1789783030.294682 write 0x035551 thru 0x0387d0 (0x3280 bytes) 000771 1789783030.300397 mapread 0x02e473 thru 0x0387d0 (0xa35e bytes) truncating to largest ever: 0x3fbb3 000773 1789783030.328672 trunc from 0x0387d1 to 0x03fbb2 (0x73e2 bytes) 000774 1789783030.341956 punch from 0x0167e8 to 0x01bd34 (0x554d bytes) 000775 1789783030.354255 trunc from 0x03fbb3 to 0x034fff (0xabb3 bytes) 000776 1789783030.387384 write 0x013185 thru 0x0230cc (0xff48 bytes) 000777 1789783030.399193 read 0x006461 thru 0x007958 (0x14f8 bytes) 000780 1789783030.418347 mapwrite 0x0148cf thru 0x01f8ab (0xafdd bytes) 000781 1789783030.591785 trunc from 0x035000 to 0x0142fd (0x20d02 bytes) 000782 1789783030.631609 read 0x00b646 thru 0x00bbff (0x5ba bytes) 000785 1789783030.664166 read 0x00e504 thru 0x0142fd (0x5dfa bytes) 000786 1789783030.683417 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x142fe): Mirror 15: 0x78a0b303 (stale) Mirror 17: 0x78a0b303 (stale) Mirror 18: 0x78a0b303 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x142fe): Mirror 15: 0x78a0b303 (stale) Mirror 17: 0x78a0b303 (stale) Mirror 18: 0x78a0b303 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x142fe: skipped 000787 1789783031.566179 MIRROR_RESYNC 4 mirrors 000788 1789783033.566172 punch from 0x002a20 to 0x00324e (0x82f bytes) 000789 1789783033.704467 punch from 0x00ba4f to 0x0142fd (0x88af bytes) 000790 1789783033.732096 trunc from 0x0142fe to 0x026d75 (0x12a78 bytes) 000791 1789783033.775072 trunc from 0x026d76 to 0x030d6a (0x9ff5 bytes) 000792 1789783033.841347 write 0x011da5 thru 0x01a925 (0x8b81 bytes) 000793 1789783033.862892 mapread 0x02cceb thru 0x02eaa1 (0x1db7 bytes) 000794 1789783033.902131 MIRROR_RESYNC 4 mirrors 000796 1789783036.149994 write 0x028a76 thru 0x031e95 (0x9420 bytes) 000797 1789783036.275620 mapwrite 0x02349d thru 0x02ba24 (0x8588 bytes) 000798 1789783036.559586 mapwrite 0x03a1c9 thru 0x03ffff (0x5e37 bytes) 000799 1789783036.868543 read 0x03c17e thru 0x03ffff (0x3e82 bytes) 000801 1789783036.877955 punch from 0x037720 to 0x0398aa (0x218b bytes) 000802 1789783036.894958 mapread 0x010a17 thru 0x01a7da (0x9dc4 bytes) 000803 1789783036.937087 mapread 0x029dbd thru 0x030dd2 (0x7016 bytes) 000807 1789783036.945410 mapwrite 0x01a4f5 thru 0x024ccf (0xa7db bytes) 000808 1789783037.085647 mapwrite 0x001202 thru 0x010e53 (0xfc52 bytes) 000809 1789783037.212050 read 0x010f1a thru 0x01ab0c (0x9bf3 bytes) 000813 1789783037.219238 trunc from 0x040000 to 0x01f6f5 (0x2090a bytes) 000814 1789783037.269968 trunc from 0x01f6f6 to 0x022a04 (0x330f bytes) 000816 1789783037.337874 mapwrite 0x0067f6 thru 0x010bf3 (0xa3fe bytes) 000818 1789783037.475971 mapwrite 0x03c1e2 thru 0x03f055 (0x2e74 bytes) 000819 1789783037.601980 mapread 0x026a34 thru 0x0302a0 (0x986d bytes) 000820 1789783037.606427 trunc from 0x03f056 to 0x008be6 (0x3646f bytes) 000821 1789783037.665622 MIRROR_RESYNC 4 mirrors 000823 1789783038.688001 read 0x0047e7 thru 0x008be6 (0x4400 bytes) 000824 1789783038.700078 MIRROR_EXTEND to 5 mirrors 000825 1789783039.377090 write 0x02b792 thru 0x03ac3a (0xf4a9 bytes) 000826 1789783039.534981 punch from 0x03166f to 0x03ac3a (0x95cc bytes) 000827 1789783039.559296 read 0x011bf8 thru 0x01ff68 (0xe371 bytes) 000828 1789783039.581043 punch from 0x000d32 to 0x00e4a8 (0xd777 bytes) 000829 1789783039.595165 punch from 0x02a454 to 0x02ab52 (0x6ff bytes) 000832 1789783039.615105 mapwrite 0x00a80b thru 0x019a86 (0xf27c bytes) 000833 1789783039.693922 trunc from 0x03ac3b to 0x03e873 (0x3c39 bytes) 000834 1789783039.718993 punch from 0x01056e to 0x01101f (0xab2 bytes) 000835 1789783039.725328 mapread 0x01b014 thru 0x026800 (0xb7ed bytes) 000836 1789783039.738983 trunc from 0x03e874 to 0x034880 (0x9ff3 bytes) 000837 1789783039.761039 write 0x02709b thru 0x0271d5 (0x13b bytes) 000838 1789783039.769571 MIRROR_RESYNC 5 mirrors 000839 1789783041.280471 write 0x00d4c5 thru 0x01322f (0x5d6b bytes) 000840 1789783041.361264 MIRROR_SPLIT mirror 4 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34881): Mirror 15: 0x258ecc30 (stale) Mirror 17: 0x258ecc30 (stale) Mirror 18: 0x258ecc30 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34881): Mirror 15: 0x258ecc30 (stale) Mirror 17: 0x258ecc30 (stale) Mirror 18: 0x258ecc30 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34881: skipped 000842 1789783042.032908 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x34881): Mirror 15: 0x258ecc30 (stale) Mirror 18: 0x258ecc30 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34881): Mirror 15: 0x258ecc30 (stale) Mirror 18: 0x258ecc30 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34881: skipped 000844 1789783042.417883 mapread 0x0268af thru 0x0283d4 (0x1b26 bytes) 000848 1789783042.446620 mapwrite 0x03798c thru 0x039d23 (0x2398 bytes) 000849 1789783042.531842 mapread 0x018e5b thru 0x022992 (0x9b38 bytes) 000850 1789783042.549090 write 0x03b643 thru 0x03ffff (0x49bd bytes) 000851 1789783042.550151 mapwrite 0x00746c thru 0x01599f (0xe534 bytes) 000854 1789783042.620020 write 0x0144c3 thru 0x01ece2 (0xa820 bytes) 000855 1789783042.622480 mapwrite 0x0147ff thru 0x01d67e (0x8e80 bytes) 000856 1789783042.685346 read 0x015620 thru 0x01ddc3 (0x87a4 bytes) 000857 1789783042.685940 punch from 0x038f61 to 0x03ffff (0x709f bytes) 000858 1789783042.693443 write 0x03b144 thru 0x03be4e (0xd0b bytes) 000859 1789783042.697927 write 0x03a5d2 thru 0x03ffff (0x5a2e bytes) 000862 1789783042.707093 mapwrite 0x00ff8a thru 0x0111fd (0x1274 bytes) 000863 1789783042.757814 write 0x006cd4 thru 0x007e9b (0x11c8 bytes) 000864 1789783042.758687 mapwrite 0x02ccfa thru 0x02e9cd (0x1cd4 bytes) 000865 1789783042.812593 trunc from 0x040000 to 0x00c60e (0x339f1 bytes) 000866 1789783042.829637 write 0x011843 thru 0x013d14 (0x24d2 bytes) 000867 1789783042.830635 mapread 0x0063cb thru 0x00903b (0x2c71 bytes) 000868 1789783042.831465 mapread 0x00f5ad thru 0x013d14 (0x4768 bytes) 000869 1789783042.838426 read 0x008759 thru 0x013d14 (0xb5bc bytes) 000870 1789783042.839118 mapread 0x0103bd thru 0x013d14 (0x3958 bytes) 000871 1789783042.840341 mapread 0x012328 thru 0x013d14 (0x19ed bytes) 000872 1789783042.841522 punch from 0x0067a0 to 0x013d14 (0xd575 bytes) 000874 1789783042.858774 mapread 0x00e4f0 thru 0x013d14 (0x5825 bytes) 000875 1789783042.877610 mapwrite 0x0368d4 thru 0x03af22 (0x464f bytes) 000877 1789783043.059717 mapwrite 0x0055c4 thru 0x0078c9 (0x2306 bytes) 000878 1789783043.103428 trunc from 0x03af23 to 0x014c49 (0x262d9 bytes) 000879 1789783043.126720 trunc from 0x014c4a to 0x00f344 (0x5905 bytes) 000880 1789783043.145534 write 0x00a5ed thru 0x0196d7 (0xf0eb bytes) 000881 1789783043.147095 mapwrite 0x03dfbf thru 0x03f265 (0x12a7 bytes) 000882 1789783043.237409 MIRROR_RESYNC 3 mirrors 000883 1789783044.924476 punch from 0x021927 to 0x02f620 (0xdcfa bytes) 000885 1789783045.037952 read 0x007f66 thru 0x00d198 (0x5233 bytes) 000886 1789783045.058466 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3f266): Mirror 15: 0x2ade5217 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3f266): Mirror 15: 0x2ade5217 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3f266: skipped 000888 1789783045.543884 mapread 0x03c69a thru 0x03dc60 (0x15c7 bytes) 000890 1789783045.592810 read 0x008610 thru 0x017ad7 (0xf4c8 bytes) 000891 1789783045.628240 trunc from 0x03f266 to 0x00d713 (0x31b52 bytes) 000892 1789783045.660421 trunc from 0x00d714 to 0x02cbec (0x1f4d9 bytes) 000893 1789783045.683403 mapread 0x0208b8 thru 0x02436c (0x3ab5 bytes) 000894 1789783045.703261 punch from 0x012882 to 0x01a6e3 (0x7e62 bytes) 000896 1789783045.715405 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x2cbed): Mirror 15: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x2cbed): Mirror 15: 0xb139eb8c (stale) CRC-32 checksum value for chunk [0, 0x2cbed): Mirror 1: 0x2b32f9d2 Mirror 16: 0x2b32f9d2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x2cbed: skipped 000897 1789783047.247883 punch from 0x00c178 to 0x018c5a (0xcae3 bytes) 000898 1789783047.355291 read 0x026e6e thru 0x028ffb (0x218e bytes) 000899 1789783047.372391 write 0x007824 thru 0x015d76 (0xe553 bytes) 000900 1789783047.406414 mapwrite 0x004d5e thru 0x00adaa (0x604d bytes) 000901 1789783047.598871 read 0x026964 thru 0x02c032 (0x56cf bytes) 000902 1789783047.616123 write 0x02fc81 thru 0x033c0d (0x3f8d bytes) 000905 1789783047.624416 MIRROR_RESYNC 3 mirrors 000907 1789783048.955634 punch from 0x01b4d3 to 0x02703c (0xbb6a bytes) 000908 1789783049.028301 mapread 0x01ad65 thru 0x01db72 (0x2e0e bytes) 000909 1789783049.052641 read 0x026c27 thru 0x02aeb0 (0x428a bytes) 000910 1789783049.091281 mapwrite 0x005a95 thru 0x007774 (0x1ce0 bytes) 000912 1789783049.153364 trunc from 0x033c0e to 0x022535 (0x116d8 bytes) 000913 1789783049.186569 write 0x008b61 thru 0x0176e2 (0xeb82 bytes) 000914 1789783049.190326 read 0x0211e2 thru 0x022535 (0x1354 bytes) 000915 1789783049.191714 read 0x010b81 thru 0x01375b (0x2bdb bytes) 000916 1789783049.192709 trunc from 0x022536 to 0x017863 (0xacd2 bytes) 000918 1789783049.222622 MIRROR_RESYNC 3 mirrors 000919 1789783050.249558 write 0x0274b9 thru 0x030a7e (0x95c6 bytes) 000920 1789783050.358083 read 0x007176 thru 0x00f94c (0x87d7 bytes) 000921 1789783050.380852 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x30a7f): Mirror 15: (stale - read error) Mirror 16: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x30a7f): Mirror 15: 0x75372eca (stale) Mirror 16: 0x75372eca (stale) CRC-32 checksum value for chunk [0, 0x30a7f): Mirror 1: 0xee4498f8 Mirror 17: 0xee4498f8 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x30a7f: skipped 000922 1789783051.968534 write 0x02b0f2 thru 0x039e8d (0xed9c bytes) 000923 1789783052.148851 MIRROR_RESYNC 4 mirrors 000924 1789783053.890586 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) 000925 1789783054.687436 mapwrite 0x02f11c thru 0x038503 (0x93e8 bytes) 000926 1789783055.144093 mapwrite 0x0335d3 thru 0x039185 (0x5bb3 bytes) 000928 1789783055.361215 mapread 0x01b56b thru 0x02913a (0xdbd0 bytes) 000930 1789783055.424324 read 0x02b0b1 thru 0x034f6d (0x9ebd bytes) 000932 1789783055.428948 write 0x019793 thru 0x024ab5 (0xb323 bytes) 000935 1789783055.437345 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x39e8e): Mirror 15: 0x1f073c05 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x39e8e): Mirror 15: 0x1f073c05 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x39e8e: skipped 000936 1789783056.003485 write 0x007db6 thru 0x00cadc (0x4d27 bytes) 000938 1789783056.024472 trunc from 0x039e8e to 0x039d50 (0x13d bytes) 000940 1789783056.057556 mapread 0x036858 thru 0x039d50 (0x34f9 bytes) 000942 1789783056.106514 trunc from 0x039d51 to 0x00e1ad (0x2bba3 bytes) 000945 1789783056.145449 mapwrite 0x03bbc3 thru 0x03ffff (0x443d bytes) 000947 1789783056.355824 read 0x0196ed thru 0x019a10 (0x324 bytes) 000949 1789783056.380240 write 0x021b0d thru 0x030e86 (0xf37a bytes) 000952 1789783056.428384 punch from 0x01b62c to 0x022a8c (0x7461 bytes) 000953 1789783056.489487 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) 000954 1789783056.653355 mapwrite 0x0047b6 thru 0x007d7c (0x35c7 bytes) 000956 1789783056.733467 punch from 0x01f7b1 to 0x02b801 (0xc051 bytes) 000957 1789783056.739498 mapwrite 0x01284e thru 0x01391d (0x10d0 bytes) 000958 1789783056.874678 MIRROR_EXTEND to 2 mirrors 000959 1789783058.437119 write 0x000b74 thru 0x00ec8c (0xe119 bytes) 000960 1789783058.549943 punch from 0x00dfd6 to 0x010966 (0x2991 bytes) 000961 1789783058.562430 mapread 0x002175 thru 0x00544e (0x32da bytes) 000962 1789783058.563650 mapwrite 0x0265b1 thru 0x0336c9 (0xd119 bytes) 000963 1789783058.634874 mapread 0x0356fe thru 0x036575 (0xe78 bytes) 000964 1789783058.635860 trunc from 0x040000 to 0x01c925 (0x236da bytes) 000965 1789783058.654697 mapread 0x008353 thru 0x00c0cb (0x3d79 bytes) 000966 1789783058.655708 read 0x00c817 thru 0x01b918 (0xf102 bytes) 000968 1789783058.667332 read 0x0082fd thru 0x00fede (0x7be2 bytes) 000969 1789783058.668013 write 0x032a00 thru 0x03fc9c (0xd29d bytes) 000971 1789783058.671302 punch from 0x018e66 to 0x02041d (0x75b8 bytes) 000972 1789783058.685420 trunc from 0x03fc9d to 0x01be4e (0x23e4e bytes) 000973 1789783058.704987 punch from 0x00619d to 0x0063dd (0x241 bytes) 000974 1789783058.710411 mapwrite 0x010b49 thru 0x0169ef (0x5ea7 bytes) 000975 1789783058.747607 mapwrite 0x01f9fa thru 0x0291e1 (0x97e8 bytes) 000976 1789783058.821807 read 0x0002f9 thru 0x000478 (0x180 bytes) 000977 1789783058.822830 mapwrite 0x0247b5 thru 0x02b68b (0x6ed7 bytes) 000978 1789783058.920559 trunc from 0x02b68c to 0x0264ea (0x51a1 bytes) 000979 1789783058.939485 mapwrite 0x014d6f thru 0x019654 (0x48e6 bytes) 000980 1789783058.994937 MIRROR_RESYNC 2 mirrors 000982 1789783059.960126 write 0x001848 thru 0x005753 (0x3f0c bytes) 000983 1789783060.197756 mapread 0x013673 thru 0x01ef9e (0xb92c bytes) 000985 1789783060.304160 mapread 0x0047c2 thru 0x00f8df (0xb11e bytes) 000986 1789783060.363196 read 0x023fae thru 0x024f2f (0xf82 bytes) 000987 1789783060.384605 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x190:0x0]: Invalid argument (22) 000989 1789783060.797262 trunc from 0x0264eb to 0x019b9b (0xc94f bytes) 000990 1789783060.830635 trunc from 0x019b9c to 0x035134 (0x1b599 bytes) 000991 1789783060.864587 punch from 0x006fa4 to 0x00f426 (0x8483 bytes) 000993 1789783060.873664 trunc from 0x035135 to 0x001914 (0x33820 bytes) 000995 1789783060.904903 read 0x000653 thru 0x001914 (0x12c2 bytes) 000998 1789783060.935349 mapread 0x00142f thru 0x001914 (0x4e6 bytes) 000999 1789783060.936373 punch from 0x0013d3 to 0x001914 (0x542 bytes) All operations completed A-OK!