== sanity-flr test 70a: flr mode fsx test ================ 16:34:10 (1790973250) Seed set to 3252 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000002 1790973252.930247 write 0x010d9a thru 0x01de67 (0xd0ce bytes) 000003 1790973252.939904 punch from 0x00af02 to 0x01910e (0xe20d bytes) 000004 1790973252.963191 read 0x0073ab thru 0x01413d (0xcd93 bytes) 000005 1790973252.974891 write 0x01d21b thru 0x01e5ad (0x1393 bytes) truncating to largest ever: 0x3f933 000006 1790973252.976480 trunc from 0x01e5ae to 0x03f932 (0x21385 bytes) 000007 1790973252.993056 trunc from 0x03f933 to 0x01f05e (0x208d4 bytes) 000008 1790973253.017270 mapwrite 0x00fbf6 thru 0x0183cd (0x87d8 bytes) 000009 1790973253.103691 write 0x03cd21 thru 0x03ffff (0x32df bytes) 000012 1790973253.105843 trunc from 0x040000 to 0x039b4f (0x64b0 bytes) 000014 1790973253.137185 punch from 0x03388e to 0x0389b9 (0x512c bytes) 000016 1790973253.147559 write 0x0228c3 thru 0x02b7c3 (0x8f01 bytes) 000017 1790973253.168317 write 0x009336 thru 0x00b030 (0x1cfb bytes) 000019 1790973253.176143 read 0x02df21 thru 0x039b4f (0xbc2f bytes) 000020 1790973253.190839 punch from 0x015393 to 0x01557d (0x1eb bytes) 000022 1790973253.208885 punch from 0x0271f1 to 0x02839e (0x11ae bytes) 000023 1790973253.215176 trunc from 0x039b50 to 0x027776 (0x123d9 bytes) 000024 1790973253.235719 read 0x0204b2 thru 0x027776 (0x72c5 bytes) 000026 1790973253.245958 mapread 0x01b8a5 thru 0x025252 (0x99ae bytes) 000027 1790973253.247457 mapwrite 0x01c702 thru 0x020ae3 (0x43e2 bytes) 000028 1790973253.335777 mapread 0x01aad3 thru 0x01c6b2 (0x1be0 bytes) 000029 1790973253.336574 read 0x010775 thru 0x0154dc (0x4d68 bytes) 000030 1790973253.337177 punch from 0x00a14b to 0x017cb9 (0xdb6f bytes) 000031 1790973253.346298 mapread 0x020490 thru 0x022f2b (0x2a9c bytes) 000032 1790973253.347286 read 0x011ffc thru 0x01accf (0x8cd4 bytes) 000033 1790973253.357878 mapread 0x012260 thru 0x01bd30 (0x9ad1 bytes) 000034 1790973253.359012 trunc from 0x027777 to 0x024abf (0x2cb7 bytes) 000038 1790973253.388051 trunc from 0x024ac0 to 0x02c770 (0x7cb1 bytes) 000039 1790973253.408137 write 0x03fb3c thru 0x03ffff (0x4c4 bytes) 000040 1790973253.409946 trunc from 0x040000 to 0x003985 (0x3c67a bytes) 000042 1790973253.428082 trunc from 0x003986 to 0x03643d (0x32ab8 bytes) 000043 1790973253.445112 trunc from 0x03643e to 0x0342f3 (0x214a bytes) 000045 1790973253.463831 trunc from 0x0342f4 to 0x006a62 (0x2d891 bytes) 000046 1790973253.485086 read 0x000c3c thru 0x006a62 (0x5e27 bytes) 000048 1790973253.492590 mapwrite 0x016c69 thru 0x018faf (0x2347 bytes) 000049 1790973253.567157 punch from 0x012550 to 0x018faf (0x6a60 bytes) 000052 1790973253.575925 mapread 0x0076f4 thru 0x0143fd (0xcd0a bytes) 000053 1790973253.595533 mapwrite 0x03d86e thru 0x03e3c0 (0xb53 bytes) 000054 1790973253.690856 write 0x0047d8 thru 0x0114ff (0xcd28 bytes) 000055 1790973253.692274 read 0x037ea1 thru 0x037fd4 (0x134 bytes) 000056 1790973253.692903 mapread 0x009efc thru 0x00bfbe (0x20c3 bytes) 000057 1790973253.696907 read 0x02b002 thru 0x03096f (0x596e bytes) 000059 1790973253.699000 punch from 0x02dba4 to 0x02e974 (0xdd1 bytes) 000061 1790973253.719801 trunc from 0x03e3c1 to 0x027ea1 (0x1651f bytes) 000064 1790973253.744528 write 0x03edf8 thru 0x03ffff (0x1208 bytes) 000065 1790973253.747546 read 0x025c84 thru 0x032dbd (0xd13a bytes) 000067 1790973253.760034 read 0x00a6a8 thru 0x012f82 (0x88db bytes) 000068 1790973253.760814 write 0x009305 thru 0x00eb00 (0x57fc bytes) 000069 1790973253.762871 write 0x0103cc thru 0x014742 (0x4377 bytes) 000071 1790973253.765573 mapwrite 0x00498c thru 0x005f57 (0x15cc bytes) 000072 1790973253.810386 punch from 0x0034c4 to 0x003634 (0x171 bytes) 000074 1790973253.817008 trunc from 0x040000 to 0x01873b (0x278c4 bytes) 000077 1790973253.836053 write 0x0249b5 thru 0x02cb55 (0x81a1 bytes) 000082 1790973253.845674 write 0x00c682 thru 0x01507a (0x89f9 bytes) 000084 1790973253.849930 read 0x00cad4 thru 0x015ca5 (0x91d2 bytes) 000086 1790973253.852072 mapwrite 0x000995 thru 0x00f6a6 (0xed12 bytes) 000087 1790973253.910836 punch from 0x01f59f to 0x01fe7d (0x8df bytes) 000092 1790973253.919079 read 0x01b280 thru 0x01e709 (0x348a bytes) 000093 1790973253.919924 mapread 0x012ef2 thru 0x01afd8 (0x80e7 bytes) 000096 1790973253.922937 read 0x01fb4f thru 0x02cb55 (0xd007 bytes) 000097 1790973253.928783 trunc from 0x02cb56 to 0x033666 (0x6b11 bytes) 000098 1790973253.948111 punch from 0x00b18b to 0x01b098 (0xff0e bytes) 000100 1790973253.956906 read 0x0150e9 thru 0x024463 (0xf37b bytes) 000101 1790973253.966159 mapwrite 0x00afa7 thru 0x011d8e (0x6de8 bytes) 000102 1790973254.017506 punch from 0x02c627 to 0x033666 (0x7040 bytes) 000104 1790973254.024476 mapread 0x00e6b5 thru 0x018189 (0x9ad5 bytes) 000105 1790973254.026417 write 0x03836d thru 0x03ffff (0x7c93 bytes) 000106 1790973254.028473 trunc from 0x040000 to 0x00e7f0 (0x3180f bytes) 000108 1790973254.080563 trunc from 0x00e7f1 to 0x019659 (0xae69 bytes) 000109 1790973254.136081 trunc from 0x01965a to 0x034158 (0x1aaff bytes) 000112 1790973254.178997 MIRROR_EXTEND to 2 mirrors 000113 1790973255.172483 read 0x027878 thru 0x0284c6 (0xc4f bytes) 000114 1790973255.178121 mapwrite 0x003f2c thru 0x00bdfa (0x7ecf bytes) 000115 1790973255.343253 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x34159): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x34159): Mirror 2: 0x3dfd3159 (stale) CRC-32 checksum value for chunk [0, 0x34159): Mirror 1: 0x7af84e48 Mirror 3: 0x7af84e48 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x34159: skipped 000117 1790973256.598266 write 0x008e8a thru 0x014286 (0xb3fd bytes) 000118 1790973256.669296 trunc from 0x034159 to 0x029521 (0xac37 bytes) 000119 1790973256.690098 write 0x025444 thru 0x0322b1 (0xce6e bytes) 000120 1790973256.701799 mapread 0x017f45 thru 0x01e859 (0x6915 bytes) 000122 1790973256.732428 punch from 0x01a6ef to 0x01e379 (0x3c8b bytes) 000123 1790973256.747756 mapwrite 0x01905a thru 0x01ec9a (0x5c41 bytes) 000125 1790973256.809407 read 0x028c2e thru 0x0322b1 (0x9684 bytes) 000126 1790973256.810851 trunc from 0x0322b2 to 0x00d83a (0x24a77 bytes) 000128 1790973256.830466 MIRROR_RESYNC 3 mirrors 000129 1790973257.485187 punch from 0x00247b to 0x00c1d8 (0x9d5e bytes) 000130 1790973257.559953 read 0x00bdf8 thru 0x00d83a (0x1a43 bytes) 000131 1790973257.565996 trunc from 0x00d83b to 0x012a66 (0x522c bytes) 000134 1790973257.593124 write 0x02cf10 thru 0x0353ca (0x84bb bytes) 000137 1790973257.596657 mapread 0x001b7c thru 0x004249 (0x26ce bytes) 000139 1790973257.615816 write 0x025463 thru 0x02d784 (0x8322 bytes) 000141 1790973257.621323 mapread 0x02bcf6 thru 0x0353ca (0x96d5 bytes) 000143 1790973257.622720 mapwrite 0x02d35e thru 0x033299 (0x5f3c bytes) 000144 1790973257.719913 punch from 0x00896c to 0x008e55 (0x4ea bytes) 000145 1790973257.726983 write 0x03e303 thru 0x03ffff (0x1cfd bytes) 000146 1790973257.729824 mapwrite 0x033c34 thru 0x035b87 (0x1f54 bytes) 000151 1790973257.853129 write 0x019178 thru 0x01e12c (0x4fb5 bytes) 000154 1790973257.869814 read 0x03cd66 thru 0x03ffff (0x329a bytes) 000155 1790973257.901499 punch from 0x02f406 to 0x031d7b (0x2976 bytes) 000156 1790973257.953880 read 0x0135c9 thru 0x01bbc4 (0x85fc bytes) 000157 1790973257.954509 punch from 0x02210f to 0x02ad62 (0x8c54 bytes) 000159 1790973257.960683 write 0x01faf7 thru 0x027eb3 (0x83bd bytes) 000160 1790973257.999770 read 0x00eefd thru 0x010453 (0x1557 bytes) 000161 1790973258.000795 mapwrite 0x0046d1 thru 0x00c3c0 (0x7cf0 bytes) 000164 1790973258.092077 write 0x013663 thru 0x017161 (0x3aff bytes) 000166 1790973258.093657 read 0x01e545 thru 0x02606f (0x7b2b bytes) 000167 1790973258.098368 punch from 0x024d95 to 0x0281a3 (0x340f bytes) 000168 1790973258.139839 mapread 0x01a9d5 thru 0x01f950 (0x4f7c bytes) 000169 1790973258.142065 mapwrite 0x024929 thru 0x02fc55 (0xb32d bytes) 000170 1790973258.272716 punch from 0x0171b7 to 0x025c3e (0xea88 bytes) 000171 1790973258.282560 read 0x010f32 thru 0x01e06e (0xd13d bytes) 000172 1790973258.312252 read 0x01c02a thru 0x01c1ca (0x1a1 bytes) 000173 1790973258.313550 read 0x01e579 thru 0x028c17 (0xa69f bytes) 000174 1790973258.314849 read 0x02bf42 thru 0x02c382 (0x441 bytes) 000175 1790973258.355546 mapwrite 0x03d503 thru 0x03ffff (0x2afd bytes) 000176 1790973258.537473 read 0x010822 thru 0x0185b8 (0x7d97 bytes) 000177 1790973258.538172 mapwrite 0x03adf9 thru 0x03f6c5 (0x48cd bytes) 000178 1790973258.627303 write 0x0016e6 thru 0x00b607 (0x9f22 bytes) 000179 1790973258.628583 punch from 0x01eda6 to 0x01ff6f (0x11ca bytes) 000180 1790973258.657240 mapwrite 0x02200a thru 0x026052 (0x4049 bytes) 000181 1790973258.753375 mapwrite 0x00441d thru 0x010970 (0xc554 bytes) 000182 1790973258.852064 read 0x01e4c5 thru 0x02d50d (0xf049 bytes) 000186 1790973258.866405 read 0x010681 thru 0x011f22 (0x18a2 bytes) 000187 1790973258.873442 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x212:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1ffa4ac8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x1ffa4ac8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000190 1790973259.199152 write 0x01b916 thru 0x01bc13 (0x2fe bytes) 000191 1790973259.205279 punch from 0x03cacb to 0x03ffff (0x3535 bytes) 000192 1790973259.213526 read 0x0306e6 thru 0x03a501 (0x9e1c bytes) 000193 1790973259.223483 read 0x030f1e thru 0x03de3c (0xcf1f bytes) 000194 1790973259.235275 mapread 0x010b33 thru 0x019658 (0x8b26 bytes) 000195 1790973259.237348 trunc from 0x040000 to 0x03de02 (0x21fd bytes) 000196 1790973259.259204 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3de03): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3de03): Mirror 3: 0x3f660685 (stale) CRC-32 checksum value for chunk [0, 0x3de03): Mirror 1: 0x634c1549 Mirror 4: 0x634c1549 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3de03: skipped 000197 1790973260.351509 trunc from 0x03de03 to 0x002dec (0x3b016 bytes) 000198 1790973260.579226 mapread 0x001d4c thru 0x002dec (0x10a1 bytes) 000199 1790973260.601231 write 0x003c10 thru 0x0043c0 (0x7b1 bytes) 000200 1790973260.603147 mapread 0x002a5b thru 0x0043c0 (0x1966 bytes) 000201 1790973260.618450 trunc from 0x0043c1 to 0x036fd9 (0x32c19 bytes) 000203 1790973260.676448 read 0x005bdc thru 0x0070a9 (0x14ce bytes) 000204 1790973260.686700 trunc from 0x036fda to 0x00f8f6 (0x276e3 bytes) 000205 1790973260.710923 punch from 0x00816a to 0x00f8f6 (0x778d bytes) 000206 1790973260.739516 punch from 0x006874 to 0x009b06 (0x3293 bytes) 000207 1790973260.745984 trunc from 0x00f8f7 to 0x0336d2 (0x23ddc bytes) 000208 1790973260.773423 trunc from 0x0336d3 to 0x01b21c (0x184b6 bytes) 000211 1790973260.815647 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x212:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x1b21d): Mirror 3: 0x93347e23 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1b21d): Mirror 3: 0x93347e23 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1b21d: skipped 000214 1790973261.248190 read 0x019544 thru 0x01a7b3 (0x1270 bytes) 000215 1790973261.257840 write 0x01ab9e thru 0x01eafe (0x3f61 bytes) 000217 1790973261.262197 mapwrite 0x01c750 thru 0x0220b1 (0x5962 bytes) 000222 1790973261.385122 punch from 0x000180 to 0x00ced7 (0xcd58 bytes) 000224 1790973261.405367 mapread 0x018cb5 thru 0x01a5d9 (0x1925 bytes) 000226 1790973261.417835 read 0x00540a thru 0x00f976 (0xa56d bytes) 000227 1790973261.436369 read 0x01f959 thru 0x0220b1 (0x2759 bytes) 000228 1790973261.436978 write 0x01997b thru 0x02315d (0x97e3 bytes) 000229 1790973261.440705 mapread 0x01e51d thru 0x02315d (0x4c41 bytes) 000231 1790973261.442133 write 0x01bf9e thru 0x024058 (0x80bb bytes) 000232 1790973261.443412 write 0x007bf5 thru 0x00e8ea (0x6cf6 bytes) 000233 1790973261.447578 trunc from 0x024059 to 0x032000 (0xdfa8 bytes) 000235 1790973261.470111 punch from 0x029adf to 0x032000 (0x8522 bytes) 000237 1790973261.492978 trunc from 0x032001 to 0x036aa0 (0x4aa0 bytes) 000238 1790973261.514940 mapwrite 0x02d53d thru 0x0398c2 (0xc386 bytes) 000239 1790973261.600977 mapread 0x00b59d thru 0x00e605 (0x3069 bytes) 000241 1790973261.610627 MIRROR_RESYNC 2 mirrors 000242 1790973262.388667 mapread 0x016262 thru 0x02615f (0xfefe bytes) 000243 1790973262.428811 MIRROR_RESYNC 2 mirrors 000244 1790973262.857712 punch from 0x0067b1 to 0x0082b3 (0x1b03 bytes) 000245 1790973263.026206 trunc from 0x0398c3 to 0x03c0ca (0x2808 bytes) 000246 1790973263.084595 mapwrite 0x011ecb thru 0x01c8b9 (0xa9ef bytes) 000248 1790973263.353824 punch from 0x01f35f to 0x021e54 (0x2af6 bytes) 000252 1790973263.360562 punch from 0x01af76 to 0x0287d8 (0xd863 bytes) 000253 1790973263.387652 MIRROR_RESYNC 2 mirrors 000255 1790973264.523159 mapwrite 0x026297 thru 0x02ae8b (0x4bf5 bytes) 000256 1790973264.773790 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3c0cb): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c0cb): Mirror 3: 0x35d7ad9f (stale) CRC-32 checksum value for chunk [0, 0x3c0cb): Mirror 1: 0x2ef1f734 Mirror 4: 0x2ef1f734 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c0cb: skipped 000257 1790973266.087009 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x3c0cb): Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c0cb): Mirror 3: 0x35d7ad9f (stale) CRC-32 checksum value for chunk [0, 0x3c0cb): Mirror 1: 0x2ef1f734 Mirror 4: 0x2ef1f734 Mirror 5: 0x2ef1f734 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c0cb: skipped 000258 1790973267.409701 write 0x0345e2 thru 0x03a6ed (0x610c bytes) 000260 1790973267.506102 mapread 0x0291ab thru 0x03763e (0xe494 bytes) 000263 1790973267.532365 mapread 0x0190ec thru 0x019fed (0xf02 bytes) 000264 1790973267.547562 write 0x023751 thru 0x026913 (0x31c3 bytes) 000265 1790973267.553560 punch from 0x008734 to 0x00e32c (0x5bf9 bytes) 000267 1790973267.574644 mapread 0x005724 thru 0x00e0c9 (0x89a6 bytes) 000268 1790973267.582912 trunc from 0x03c0cb to 0x00b004 (0x310c6 bytes) 000269 1790973267.614154 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x212:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0xb005): Mirror 3: 0x8a9be524 (stale) Mirror 4: 0x8a9be524 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xb005): Mirror 3: 0x8a9be524 (stale) Mirror 4: 0x8a9be524 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xb005: skipped 000270 1790973267.933288 read 0x003cc8 thru 0x00b004 (0x733d bytes) 000271 1790973267.947922 punch from 0x00abb5 to 0x00b004 (0x450 bytes) 000274 1790973267.957260 mapread 0x0073bf thru 0x00b004 (0x3c46 bytes) 000275 1790973267.975967 mapwrite 0x03508a thru 0x0362e1 (0x1258 bytes) 000277 1790973268.070086 trunc from 0x0362e2 to 0x01bcc9 (0x1a618 bytes) 000278 1790973268.093931 trunc from 0x01bcca to 0x004a1a (0x172af bytes) 000280 1790973268.112490 punch from 0x0008ac to 0x0010dd (0x832 bytes) 000281 1790973268.118859 mapwrite 0x01afbe thru 0x01b1b7 (0x1fa bytes) 000282 1790973268.195979 mapwrite 0x03c400 thru 0x03fbf8 (0x37f9 bytes) 000283 1790973268.295291 write 0x02f13e thru 0x02f46b (0x32e bytes) 000285 1790973268.316260 write 0x00438a thru 0x00b5b2 (0x7229 bytes) 000287 1790973268.323059 read 0x0370d1 thru 0x03f6fa (0x862a bytes) 000288 1790973268.325198 read 0x028286 thru 0x0305aa (0x8325 bytes) 000289 1790973268.361180 trunc from 0x03fbf9 to 0x011780 (0x2e478 bytes) 000290 1790973268.417914 MIRROR_SPLIT mirror 1 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x212:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x11781): Mirror 4: 0xe045151b (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x11781): Mirror 4: 0xe045151b (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x11781: skipped 000292 1790973268.772324 mapread 0x00fd5b thru 0x011780 (0x1a26 bytes) 000293 1790973268.831877 trunc from 0x011781 to 0x03839b (0x26c1b bytes) 000294 1790973268.876291 MIRROR_RESYNC 2 mirrors 000295 1790973269.561988 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x212:0x0]: Invalid argument (22) 000297 1790973269.690271 read 0x035834 thru 0x03839b (0x2b68 bytes) 000298 1790973269.699714 punch from 0x001c9c to 0x01113d (0xf4a2 bytes) 000300 1790973269.725917 write 0x03e3b3 thru 0x03ffff (0x1c4d bytes) 000303 1790973269.729726 mapwrite 0x0361cf thru 0x03ffff (0x9e31 bytes) 000304 1790973269.800374 punch from 0x033741 to 0x03ffff (0xc8bf bytes) 000308 1790973269.807724 read 0x0234e2 thru 0x031d29 (0xe848 bytes) 000310 1790973269.823900 write 0x00ebe2 thru 0x0134d8 (0x48f7 bytes) 000311 1790973269.825498 punch from 0x022db7 to 0x02fdd6 (0xd020 bytes) 000312 1790973269.840068 read 0x000226 thru 0x005760 (0x553b bytes) 000313 1790973269.845407 MIRROR_EXTEND to 2 mirrors 000314 1790973270.609943 write 0x0139b0 thru 0x01a816 (0x6e67 bytes) 000316 1790973270.685891 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x5d4525d4 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x8323aca2 Mirror 3: 0x8323aca2 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000317 1790973271.983421 MIRROR_RESYNC 3 mirrors 000318 1790973273.105988 punch from 0x03a933 to 0x03ffff (0x56cd bytes) 000320 1790973273.209091 punch from 0x019091 to 0x023470 (0xa3e0 bytes) 000321 1790973273.228122 write 0x0308b7 thru 0x037f9d (0x76e7 bytes) 000322 1790973273.252112 mapwrite 0x006fe9 thru 0x00b023 (0x403b bytes) 000323 1790973273.441977 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: (stale - read error) Mirror 3: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 2: 0x8323aca2 (stale) Mirror 3: 0x8323aca2 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0x2d19f2e7 Mirror 4: 0x2d19f2e7 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000324 1790973274.638457 MIRROR_RESYNC 4 mirrors 000325 1790973275.499264 mapread 0x026e38 thru 0x033631 (0xc7fa bytes) 000326 1790973275.526814 write 0x00e037 thru 0x010271 (0x223b bytes) 000327 1790973275.606694 mapwrite 0x0364e1 thru 0x03a3de (0x3efe bytes) 000328 1790973275.656254 mapwrite 0x01fb3e thru 0x02dd2b (0xe1ee bytes) 000329 1790973275.720595 trunc from 0x040000 to 0x02ed9c (0x11263 bytes) 000330 1790973275.744473 MIRROR_RESYNC 4 mirrors 000331 1790973276.545198 MIRROR_SPLIT mirror 2 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x212:0x0]: Invalid argument (22) 000332 1790973277.039128 punch from 0x007d22 to 0x012b76 (0xae55 bytes) 000333 1790973277.221088 read 0x021bde thru 0x02e79f (0xcbc2 bytes) 000335 1790973277.238069 mapwrite 0x017004 thru 0x01844d (0x144a bytes) 000337 1790973277.368956 trunc from 0x02ed9d to 0x008910 (0x2648c bytes) 000338 1790973277.393190 trunc from 0x008911 to 0x002786 (0x618a bytes) 000339 1790973277.409636 mapwrite 0x00a702 thru 0x00eda7 (0x46a6 bytes) 000340 1790973277.550884 write 0x01b11a thru 0x02a1f3 (0xf0da bytes) 000341 1790973277.570154 MIRROR_RESYNC 3 mirrors 000342 1790973278.625129 punch from 0x007a7b to 0x00c1f2 (0x4778 bytes) 000343 1790973278.678067 write 0x003e0c thru 0x0123cf (0xe5c4 bytes) 000344 1790973278.688319 trunc from 0x02a1f4 to 0x01bd3d (0xe4b6 bytes) 000345 1790973278.717627 trunc from 0x01bd3e to 0x02f809 (0x13acc bytes) 000346 1790973278.740125 mapwrite 0x02a0b3 thru 0x037f98 (0xdee6 bytes) 000347 1790973278.844624 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x212:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x37f99): Mirror 2: 0x6ba3ef89 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x37f99): Mirror 2: 0x6ba3ef89 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x37f99: skipped 000348 1790973279.102688 write 0x008513 thru 0x00e7ca (0x62b8 bytes) 000349 1790973279.116720 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x212:0x0]: Invalid argument (22) 000352 1790973279.302519 trunc from 0x037f99 to 0x01f814 (0x18784 bytes) 000355 1790973279.329301 read 0x00a290 thru 0x019106 (0xee77 bytes) 000358 1790973279.347334 MIRROR_EXTEND to 2 mirrors 000359 1790973279.847325 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x212:0x0]: Invalid argument (22) 000360 1790973280.064848 write 0x03e225 thru 0x03fdce (0x1baa bytes) 000361 1790973280.080989 mapwrite 0x01ac18 thru 0x01ca3e (0x1e27 bytes) 000362 1790973280.236670 trunc from 0x03fdcf to 0x00cd3d (0x33091 bytes) 000364 1790973280.286519 trunc from 0x00cd3e to 0x00f783 (0x2a46 bytes) 000365 1790973280.321015 write 0x001972 thru 0x00b226 (0x98b5 bytes) 000367 1790973280.339544 read 0x00218f thru 0x00f783 (0xd5f5 bytes) 000369 1790973280.340586 read 0x009c66 thru 0x00f783 (0x5b1e bytes) 000370 1790973280.341112 punch from 0x00631c to 0x00d6e8 (0x73cd bytes) 000371 1790973280.353346 write 0x002bd5 thru 0x011d9b (0xf1c7 bytes) 000373 1790973280.355576 read 0x00d4a1 thru 0x0108b2 (0x3412 bytes) 000374 1790973280.357290 punch from 0x007130 to 0x007fc1 (0xe92 bytes) 000378 1790973280.375521 read 0x009818 thru 0x00c1d6 (0x29bf bytes) 000380 1790973280.377485 trunc from 0x011d9c to 0x011918 (0x483 bytes) 000383 1790973280.393244 punch from 0x003768 to 0x004b0d (0x13a6 bytes) 000384 1790973280.397592 mapread 0x00d6ce thru 0x011918 (0x424b bytes) 000385 1790973280.399235 punch from 0x0011a1 to 0x002e45 (0x1ca5 bytes) 000386 1790973280.403589 mapread 0x000d1f thru 0x008608 (0x78ea bytes) 000387 1790973280.416066 mapread 0x002142 thru 0x002c07 (0xac6 bytes) 000388 1790973280.422077 MIRROR_EXTEND to 2 mirrors 000389 1790973280.980055 read 0x008af7 thru 0x00de5f (0x5369 bytes) 000391 1790973280.998250 write 0x011bb2 thru 0x01a289 (0x86d8 bytes) 000392 1790973281.092956 mapread 0x00db6a thru 0x01514b (0x75e2 bytes) 000393 1790973281.111520 trunc from 0x01a28a to 0x03c59b (0x22312 bytes) 000396 1790973281.161900 mapwrite 0x038b22 thru 0x03e151 (0x5630 bytes) 000398 1790973281.269501 mapwrite 0x010325 thru 0x0152cf (0x4fab bytes) 000400 1790973281.418068 punch from 0x03d0f3 to 0x03e151 (0x105f bytes) 000401 1790973281.433725 MIRROR_EXTEND to 3 mirrors CRC-32 checksum value for chunk [0, 0x3e152): Mirror 2: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3e152): Mirror 2: 0x496766cb (stale) CRC-32 checksum value for chunk [0, 0x3e152): Mirror 1: 0xa2c240f1 Mirror 3: 0xa2c240f1 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3e152: skipped 000402 1790973282.514516 trunc from 0x03e152 to 0x0023d1 (0x3bd80 bytes) 000403 1790973282.621427 write 0x01ae53 thru 0x029832 (0xe9e0 bytes) 000404 1790973282.623111 mapwrite 0x00bdfb thru 0x0175cc (0xb7d2 bytes) 000405 1790973282.689573 read 0x01499f thru 0x01ec95 (0xa2f7 bytes) 000406 1790973282.690816 read 0x00d48c thru 0x00ee2e (0x19a3 bytes) 000408 1790973282.696499 punch from 0x003604 to 0x0085cd (0x4fca bytes) 000410 1790973282.701757 read 0x010ef2 thru 0x0200a6 (0xf1b5 bytes) 000411 1790973282.702556 write 0x014417 thru 0x01da24 (0x960e bytes) 000412 1790973282.707914 MIRROR_SPLIT mirror 2 to 2 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x212:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x29833): Mirror 2: 0x9b00e7d (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x29833): Mirror 2: 0x9b00e7d (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x29833: skipped 000416 1790973283.140344 MIRROR_RESYNC 2 mirrors 000417 1790973284.245159 read 0x022277 thru 0x0245d9 (0x2363 bytes) 000418 1790973284.254145 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x212:0x0]: Invalid argument (22) 000419 1790973284.405491 punch from 0x01554d to 0x016008 (0xabc bytes) 000422 1790973284.429165 punch from 0x0276ff to 0x029832 (0x2134 bytes) 000423 1790973284.432971 write 0x02d15e thru 0x034a12 (0x78b5 bytes) 000426 1790973284.436381 punch from 0x0098fa to 0x009d44 (0x44b bytes) 000428 1790973284.446277 mapread 0x00687e thru 0x007847 (0xfca bytes) 000429 1790973284.455024 mapwrite 0x0110d7 thru 0x020389 (0xf2b3 bytes) 000430 1790973284.504166 mapwrite 0x01b5db thru 0x01c7f5 (0x121b bytes) 000431 1790973284.542759 trunc from 0x034a13 to 0x03baac (0x709a bytes) 000432 1790973284.564945 write 0x02f93d thru 0x03f336 (0xf9fa bytes) 000433 1790973284.566773 write 0x01fb90 thru 0x021d82 (0x21f3 bytes) 000434 1790973284.569637 write 0x021d22 thru 0x02cab3 (0xad92 bytes) 000436 1790973284.575845 read 0x033421 thru 0x03bcdf (0x88bf bytes) 000437 1790973284.577551 punch from 0x006d8b to 0x008a30 (0x1ca6 bytes) 000439 1790973284.591831 punch from 0x009aff to 0x00bfd3 (0x24d5 bytes) 000440 1790973284.596718 read 0x02bc0c thru 0x0378b3 (0xbca8 bytes) 000444 1790973284.599074 mapwrite 0x007fe4 thru 0x014725 (0xc742 bytes) 000445 1790973284.649590 mapread 0x0065f5 thru 0x006cbc (0x6c8 bytes) 000446 1790973284.651351 mapread 0x02709f thru 0x02ec73 (0x7bd5 bytes) 000448 1790973284.653363 write 0x02ec64 thru 0x03789f (0x8c3c bytes) 000449 1790973284.655016 write 0x024b50 thru 0x02c997 (0x7e48 bytes) 000450 1790973284.656157 write 0x0039f3 thru 0x0098c1 (0x5ecf bytes) 000451 1790973284.657423 punch from 0x00580d to 0x007925 (0x2119 bytes) 000452 1790973284.671726 punch from 0x00ac06 to 0x00e0f2 (0x34ed bytes) 000454 1790973284.679040 punch from 0x02b888 to 0x032c09 (0x7382 bytes) 000455 1790973284.686409 trunc from 0x03f337 to 0x027870 (0x17ac6 bytes) 000461 1790973284.715564 read 0x019d59 thru 0x01a802 (0xaaa bytes) 000462 1790973284.716518 punch from 0x0065c5 to 0x008368 (0x1da4 bytes) 000463 1790973284.724861 MIRROR_EXTEND to 2 mirrors 000464 1790973285.401616 mapread 0x02254c thru 0x027870 (0x5325 bytes) 000465 1790973285.420197 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x212:0x0]: Invalid argument (22) 000467 1790973285.536708 write 0x02f0a6 thru 0x03b396 (0xc2f1 bytes) 000468 1790973285.550274 trunc from 0x03b397 to 0x011ef1 (0x294a5 bytes) 000469 1790973285.575579 mapwrite 0x01497a thru 0x021bd1 (0xd258 bytes) 000470 1790973285.661281 write 0x013f23 thru 0x01fa65 (0xbb43 bytes) 000472 1790973285.663067 mapwrite 0x0250d2 thru 0x02ad4a (0x5c79 bytes) 000474 1790973285.731819 punch from 0x00cf72 to 0x0112be (0x434d bytes) 000476 1790973285.736995 punch from 0x00d33c to 0x01b3fe (0xe0c3 bytes) 000478 1790973285.742255 mapwrite 0x003ce6 thru 0x00b79e (0x7ab9 bytes) 000479 1790973285.789432 punch from 0x01b1db to 0x022c47 (0x7a6d bytes) 000481 1790973285.796194 mapread 0x008d1e thru 0x017613 (0xe8f6 bytes) 000484 1790973285.808388 mapwrite 0x02335e thru 0x02e0e8 (0xad8b bytes) 000485 1790973285.867868 mapwrite 0x02fdba thru 0x03724a (0x7491 bytes) 000486 1790973285.933588 read 0x02b6ff thru 0x02f389 (0x3c8b bytes) 000487 1790973285.934206 read 0x00e520 thru 0x019ba9 (0xb68a bytes) 000489 1790973285.935539 write 0x02cab4 thru 0x03707b (0xa5c8 bytes) 000491 1790973285.938974 trunc from 0x03724b to 0x01df53 (0x192f7 bytes) 000492 1790973285.958135 mapwrite 0x034705 thru 0x03ffff (0xb8fb bytes) 000494 1790973286.037585 punch from 0x0142a2 to 0x023113 (0xee72 bytes) 000495 1790973286.044208 mapwrite 0x00fa77 thru 0x013e0a (0x4394 bytes) 000497 1790973286.085437 mapwrite 0x001b40 thru 0x00be05 (0xa2c6 bytes) 000498 1790973286.136322 read 0x001d1f thru 0x00b2d4 (0x95b6 bytes) 000501 1790973286.138058 read 0x0254d4 thru 0x032c21 (0xd74e bytes) 000503 1790973286.142439 mapwrite 0x0112e2 thru 0x017e3b (0x6b5a bytes) 000505 1790973286.187473 mapread 0x024fda thru 0x03232e (0xd355 bytes) 000506 1790973286.188785 trunc from 0x040000 to 0x00189f (0x3e760 bytes) 000507 1790973286.204914 punch from 0x000a81 to 0x00189f (0xe1f bytes) 000509 1790973286.214775 punch from 0x0004f7 to 0x00189f (0x13a9 bytes) 000510 1790973286.223687 MIRROR_EXTEND to 2 mirrors 000512 1790973286.843517 read 0x000f0e thru 0x00189f (0x992 bytes) 000513 1790973286.850107 write 0x000eb2 thru 0x004428 (0x3577 bytes) 000514 1790973286.937582 write 0x017891 thru 0x01b97e (0x40ee bytes) 000515 1790973286.938929 write 0x012c14 thru 0x01324a (0x637 bytes) 000516 1790973286.954551 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x212:0x0]: Invalid argument (22) 000518 1790973287.114239 mapread 0x002b42 thru 0x005cec (0x31ab bytes) 000520 1790973287.165132 trunc from 0x01b97f to 0x03b291 (0x1f913 bytes) 000521 1790973287.197276 trunc from 0x03b292 to 0x02e226 (0xd06b bytes) 000523 1790973287.235926 trunc from 0x02e227 to 0x01f567 (0xecbf bytes) 000528 1790973287.261938 mapwrite 0x01e9c1 thru 0x029424 (0xaa64 bytes) 000529 1790973287.431577 punch from 0x0237e9 to 0x028627 (0x4e3f bytes) 000530 1790973287.452211 MIRROR_EXTEND to 2 mirrors 000533 1790973288.167201 punch from 0x0207b2 to 0x029424 (0x8c73 bytes) 000534 1790973288.251699 punch from 0x022384 to 0x029424 (0x70a1 bytes) 000535 1790973288.259953 punch from 0x0215a8 to 0x029424 (0x7e7d bytes) 000537 1790973288.278170 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x212:0x0]: Invalid argument (22) 000539 1790973288.436097 mapread 0x019c6f thru 0x02763a (0xd9cc bytes) 000540 1790973288.472172 write 0x03c592 thru 0x03ffff (0x3a6e bytes) 000541 1790973288.474984 punch from 0x01d195 to 0x024c88 (0x7af4 bytes) 000543 1790973288.486602 write 0x0313a3 thru 0x03e905 (0xd563 bytes) 000544 1790973288.492934 read 0x035bb1 thru 0x03ffff (0xa44f bytes) 000545 1790973288.494208 punch from 0x01415b to 0x018576 (0x441c bytes) 000546 1790973288.511108 read 0x022443 thru 0x0241c0 (0x1d7e bytes) 000547 1790973288.530570 read 0x012f85 thru 0x015a6b (0x2ae7 bytes) 000548 1790973288.531860 trunc from 0x040000 to 0x02603e (0x19fc1 bytes) 000549 1790973288.586999 mapread 0x01431a thru 0x021ded (0xdad4 bytes) 000550 1790973288.589132 mapread 0x01f65a thru 0x02603e (0x69e5 bytes) 000551 1790973288.589879 write 0x0349b2 thru 0x03a7d7 (0x5e26 bytes) 000552 1790973288.590949 mapwrite 0x036eee thru 0x03ffff (0x9112 bytes) 000553 1790973288.661375 write 0x0010bf thru 0x003527 (0x2469 bytes) 000554 1790973288.662605 mapwrite 0x03b410 thru 0x03ffff (0x4bf0 bytes) 000555 1790973288.698789 mapread 0x003479 thru 0x00e5e7 (0xb16f bytes) 000556 1790973288.699884 mapwrite 0x020cd1 thru 0x02a76e (0x9a9e bytes) 000557 1790973288.739600 mapread 0x0187ad thru 0x026b73 (0xe3c7 bytes) 000558 1790973288.740845 mapread 0x033bc7 thru 0x0389c8 (0x4e02 bytes) 000559 1790973288.742084 write 0x0185ef thru 0x01d506 (0x4f18 bytes) 000560 1790973288.743869 mapread 0x00c914 thru 0x01747f (0xab6c bytes) 000561 1790973288.745092 read 0x033237 thru 0x0393f4 (0x61be bytes) 000562 1790973288.745894 trunc from 0x040000 to 0x026de5 (0x1921a bytes) 000563 1790973288.768225 write 0x000176 thru 0x000b73 (0x9fe bytes) 000564 1790973288.769526 trunc from 0x026de6 to 0x0249d6 (0x240f bytes) 000565 1790973288.792387 MIRROR_EXTEND to 2 mirrors 000566 1790973289.408724 mapwrite 0x024998 thru 0x02bef3 (0x755c bytes) 000567 1790973289.573342 mapwrite 0x000ade thru 0x0073b8 (0x68db bytes) 000569 1790973289.629483 mapread 0x021bd4 thru 0x02bef3 (0xa320 bytes) 000570 1790973289.630693 punch from 0x015bf0 to 0x01fbbb (0x9fcc bytes) 000571 1790973289.636163 mapread 0x016cb4 thru 0x01de59 (0x71a6 bytes) 000572 1790973289.643961 punch from 0x02993a to 0x02bef3 (0x25ba bytes) 000574 1790973289.649822 mapread 0x02727c thru 0x02ac6e (0x39f3 bytes) 000575 1790973289.656116 trunc from 0x02bef4 to 0x008b3c (0x233b7 bytes) 000576 1790973289.677204 punch from 0x003334 to 0x008b3c (0x5809 bytes) 000579 1790973289.685154 write 0x02946b thru 0x02fa1b (0x65b1 bytes) 000581 1790973289.687484 read 0x004221 thru 0x00fe39 (0xbc19 bytes) 000582 1790973289.697550 read 0x02dc3c thru 0x02fa1b (0x1de0 bytes) 000583 1790973289.698217 trunc from 0x02fa1c to 0x03178a (0x1d6f bytes) 000585 1790973289.724336 MIRROR_SPLIT mirror 1 to 1 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x212:0x0]: Invalid argument (22) 000587 1790973289.969153 trunc from 0x03178b to 0x00da09 (0x23d81 bytes) 000588 1790973289.989219 read 0x0042fe thru 0x00da09 (0x970c bytes) 000593 1790973290.002861 mapwrite 0x038f6d thru 0x03ffff (0x7093 bytes) 000594 1790973290.094118 mapwrite 0x013219 thru 0x014d25 (0x1b0d bytes) 000595 1790973290.146667 trunc from 0x040000 to 0x025622 (0x1a9dd bytes) 000596 1790973290.163382 mapwrite 0x00ef07 thru 0x0135c7 (0x46c1 bytes) 000597 1790973290.268339 read 0x0192b2 thru 0x01d2fc (0x404b bytes) 000603 1790973290.285162 trunc from 0x025623 to 0x018a55 (0xcbcd bytes) 000604 1790973290.320909 punch from 0x006809 to 0x0139ce (0xd1c6 bytes) 000606 1790973290.327670 punch from 0x012e47 to 0x018a55 (0x5c0f bytes) 000610 1790973290.336088 trunc from 0x018a56 to 0x00023b (0x1881a bytes) 000611 1790973290.354399 punch from 0x000048 to 0x00023b (0x1f4 bytes) 000612 1790973290.364363 punch from 0x0001b7 to 0x00023b (0x85 bytes) 000614 1790973290.370250 mapread 0x0001aa thru 0x00023b (0x92 bytes) 000615 1790973290.374890 write 0x03c83e thru 0x03ce8a (0x64d bytes) 000616 1790973290.377137 mapwrite 0x027407 thru 0x0364b8 (0xf0b2 bytes) 000619 1790973290.432544 mapwrite 0x02e733 thru 0x038d38 (0xa606 bytes) 000620 1790973290.476331 punch from 0x0091b8 to 0x013df5 (0xac3e bytes) 000621 1790973290.480810 punch from 0x00e4e9 to 0x014796 (0x62ae bytes) 000622 1790973290.485586 trunc from 0x03ce8b to 0x027aa2 (0x153e8 bytes) 000623 1790973290.504877 mapwrite 0x0124bb thru 0x02015c (0xdca2 bytes) 000624 1790973290.605878 read 0x016b4b thru 0x017f4c (0x1402 bytes) 000629 1790973290.611247 write 0x036a2f thru 0x03d434 (0x6a06 bytes) 000630 1790973290.612944 punch from 0x00d20c to 0x013fcb (0x6dc0 bytes) 000631 1790973290.623925 punch from 0x00c078 to 0x010c39 (0x4bc2 bytes) 000634 1790973290.629594 mapread 0x035afc thru 0x03d434 (0x7939 bytes) 000636 1790973290.650177 read 0x01a9cf thru 0x0294cd (0xeaff bytes) 000637 1790973290.650887 trunc from 0x03d435 to 0x0236ae (0x19d86 bytes) 000638 1790973290.671972 read 0x001646 thru 0x00b499 (0x9e54 bytes) 000640 1790973290.673281 mapwrite 0x024ec2 thru 0x027edb (0x301a bytes) 000641 1790973290.741890 punch from 0x019fa4 to 0x0246bc (0xa719 bytes) 000648 1790973290.751556 trunc from 0x027edc to 0x03e121 (0x16246 bytes) 000650 1790973290.767385 punch from 0x0075e4 to 0x016b7d (0xf59a bytes) 000653 1790973290.777785 write 0x02e38d thru 0x03d72c (0xf3a0 bytes) 000655 1790973290.796812 punch from 0x015619 to 0x016ee6 (0x18ce bytes) 000656 1790973290.809485 punch from 0x02aece to 0x037e30 (0xcf63 bytes) 000657 1790973290.820549 mapwrite 0x025030 thru 0x031055 (0xc026 bytes) 000658 1790973290.936141 mapwrite 0x01694b thru 0x01f658 (0x8d0e bytes) 000660 1790973291.050095 MIRROR_EXTEND to 2 mirrors 000661 1790973291.723677 MIRROR_EXTEND to 3 mirrors 000662 1790973292.576199 MIRROR_EXTEND to 4 mirrors 000663 1790973293.466552 mapwrite 0x015a27 thru 0x01b979 (0x5f53 bytes) 000665 1790973293.769644 mapread 0x0010b6 thru 0x008a80 (0x79cb bytes) 000667 1790973293.785548 write 0x02250a thru 0x02688f (0x4386 bytes) 000669 1790973293.797690 mapwrite 0x00335e thru 0x00a709 (0x73ac bytes) 000670 1790973293.864321 write 0x011a0b thru 0x01d672 (0xbc68 bytes) 000671 1790973293.868483 mapread 0x016235 thru 0x017be3 (0x19af bytes) 000673 1790973293.869873 read 0x024882 thru 0x031e0a (0xd589 bytes) 000674 1790973293.883807 mapread 0x014efb thru 0x01909e (0x41a4 bytes) 000675 1790973293.888823 punch from 0x0312c0 to 0x03d80e (0xc54f bytes) 000676 1790973293.904145 write 0x03be0d thru 0x03ffff (0x41f3 bytes) 000677 1790973293.914288 mapread 0x01dc24 thru 0x02bc9f (0xe07c bytes) 000678 1790973293.932046 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x212:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd838a7e3 (stale) Mirror 4: 0xd838a7e3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0xd838a7e3 (stale) Mirror 4: 0xd838a7e3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000679 1790973294.291036 mapread 0x034d04 thru 0x03ffff (0xb2fc bytes) 000680 1790973294.316776 write 0x00c506 thru 0x01b3e1 (0xeedc bytes) 000681 1790973294.335407 MIRROR_RESYNC 3 mirrors 000682 1790973295.183809 mapwrite 0x039b58 thru 0x03ffff (0x64a8 bytes) 000683 1790973295.401646 MIRROR_RESYNC 3 mirrors 000684 1790973296.177835 mapread 0x020eb7 thru 0x02edbe (0xdf08 bytes) 000687 1790973296.217185 read 0x02faaf thru 0x02feae (0x400 bytes) 000688 1790973296.217716 punch from 0x01d6a0 to 0x022ccb (0x562c bytes) 000689 1790973296.274181 trunc from 0x040000 to 0x001284 (0x3ed7b bytes) 000690 1790973296.304280 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x1285): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1285): Mirror 3: 0xfbc38a69 (stale) Mirror 4: 0xfbc38a69 (stale) CRC-32 checksum value for chunk [0, 0x1285): Mirror 1: 0xfbc38a69 Mirror 5: 0xfbc38a69 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1285: skipped 000691 1790973297.394351 write 0x01edda thru 0x02ba86 (0xccad bytes) 000694 1790973297.512686 mapwrite 0x023693 thru 0x024836 (0x11a4 bytes) 000696 1790973297.662359 punch from 0x00961e to 0x00f3c0 (0x5da3 bytes) 000697 1790973297.669812 trunc from 0x02ba87 to 0x01d3bf (0xe6c7 bytes) 000699 1790973297.698322 mapwrite 0x02ff94 thru 0x03bdb7 (0xbe24 bytes) 000701 1790973297.805770 read 0x00e2d6 thru 0x019384 (0xb0af bytes) 000702 1790973297.816677 read 0x03920a thru 0x03bdb7 (0x2bae bytes) 000703 1790973297.818790 punch from 0x03a1ce to 0x03bdb7 (0x1bea bytes) 000705 1790973297.825516 mapwrite 0x02eb43 thru 0x033d9d (0x525b bytes) 000706 1790973297.878782 trunc from 0x03bdb8 to 0x030bff (0xb1b8 bytes) 000708 1790973297.907031 mapwrite 0x00f9ab thru 0x017d02 (0x8358 bytes) 000709 1790973298.022513 read 0x02a8d3 thru 0x030bff (0x632d bytes) 000711 1790973298.024827 trunc from 0x030c00 to 0x03dd61 (0xd162 bytes) 000713 1790973298.065032 mapread 0x02398a thru 0x0241d0 (0x847 bytes) 000714 1790973298.110544 MIRROR_SPLIT mirror 3 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x212:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3dd62): Mirror 3: 0x6cc44fb8 (stale) Mirror 4: 0x6cc44fb8 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3dd62): Mirror 3: 0x6cc44fb8 (stale) Mirror 4: 0x6cc44fb8 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3dd62: skipped 000715 1790973298.817317 mapread 0x002604 thru 0x0053eb (0x2de8 bytes) 000716 1790973298.836416 write 0x00dc17 thru 0x01572c (0x7b16 bytes) 000717 1790973298.842404 write 0x00eed1 thru 0x016ff2 (0x8122 bytes) 000718 1790973298.848159 mapwrite 0x03e8e6 thru 0x03ffff (0x171a bytes) 000719 1790973298.921011 MIRROR_EXTEND to 4 mirrors CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: (stale - read error) Mirror 4: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 3: 0x487f58a7 (stale) Mirror 4: 0x487f58a7 (stale) CRC-32 checksum value for chunk [0, 0x40000): Mirror 1: 0xc0746179 Mirror 5: 0xc0746179 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000720 1790973299.849216 mapread 0x00fd48 thru 0x0108ba (0xb73 bytes) 000721 1790973299.872298 write 0x0001c3 thru 0x00315c (0x2f9a bytes) 000722 1790973299.963965 mapread 0x01143a thru 0x018514 (0x70db bytes) 000723 1790973299.981511 MIRROR_RESYNC 4 mirrors 000724 1790973301.516337 MIRROR_SPLIT mirror 1 to 3 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x212:0x0]: Invalid argument (22) 000725 1790973301.948750 mapread 0x02f292 thru 0x03999b (0xa70a bytes) 000726 1790973301.983213 MIRROR_EXTEND to 4 mirrors 000727 1790973303.024472 punch from 0x00e702 to 0x01903f (0xa93e bytes) 000729 1790973303.110477 read 0x004f05 thru 0x0136cb (0xe7c7 bytes) 000730 1790973303.129555 mapwrite 0x03bbb5 thru 0x03f663 (0x3aaf bytes) 000733 1790973303.292615 mapread 0x004c10 thru 0x00a8ce (0x5cbf bytes) 000734 1790973303.293847 write 0x021b89 thru 0x0318e4 (0xfd5c bytes) 000738 1790973303.333820 punch from 0x011b5b to 0x01da27 (0xbecd bytes) 000740 1790973303.375148 mapread 0x0294a9 thru 0x036bc0 (0xd718 bytes) 000742 1790973303.392229 read 0x036184 thru 0x03ffff (0x9e7c bytes) 000744 1790973303.394219 mapread 0x03571a thru 0x03ee58 (0x973f bytes) 000745 1790973303.395432 read 0x01cb58 thru 0x0276e8 (0xab91 bytes) 000746 1790973303.408482 MIRROR_RESYNC 4 mirrors 000749 1790973304.668972 punch from 0x03b850 to 0x03db1c (0x22cd bytes) 000750 1790973304.783033 trunc from 0x040000 to 0x035137 (0xaec8 bytes) 000751 1790973304.830094 write 0x00c1c5 thru 0x011a67 (0x58a3 bytes) 000752 1790973304.858508 read 0x034857 thru 0x035137 (0x8e1 bytes) 000753 1790973304.887193 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x35138): Mirror 4: (stale - read error) Mirror 5: (stale - read error) Mirror 6: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35138): Mirror 4: 0xbd65bcb7 (stale) Mirror 5: 0xbd65bcb7 (stale) Mirror 6: 0xbd65bcb7 (stale) CRC-32 checksum value for chunk [0, 0x35138): Mirror 1: 0xf9f23448 Mirror 7: 0xf9f23448 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35138: skipped 000754 1790973305.899995 MIRROR_RESYNC 5 mirrors 000756 1790973306.725564 punch from 0x02c484 to 0x02e734 (0x22b1 bytes) 000757 1790973306.797197 write 0x005916 thru 0x0068db (0xfc6 bytes) 000758 1790973306.808204 MIRROR_SPLIT mirror 2 to 4 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x212:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x35138): Mirror 4: 0xf9f23448 (stale) Mirror 6: 0xf9f23448 (stale) Mirror 7: 0xf9f23448 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x35138): Mirror 4: 0xf9f23448 (stale) Mirror 6: 0xf9f23448 (stale) Mirror 7: 0xf9f23448 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x35138: skipped 000759 1790973307.142608 punch from 0x00b215 to 0x019a3a (0xe826 bytes) 000760 1790973307.148091 read 0x0113b0 thru 0x020a08 (0xf659 bytes) 000764 1790973307.163061 mapread 0x02d18c thru 0x035137 (0x7fac bytes) 000765 1790973307.184172 mapread 0x00d7ab thru 0x016e21 (0x9677 bytes) 000767 1790973307.195960 trunc from 0x035138 to 0x0331dc (0x1f5b bytes) 000769 1790973307.223398 write 0x002b9a thru 0x00b89a (0x8d01 bytes) 000771 1790973307.233328 trunc from 0x0331dd to 0x0123d4 (0x20e08 bytes) 000772 1790973307.262334 trunc from 0x0123d5 to 0x01f591 (0xd1bd bytes) 000774 1790973307.295110 mapwrite 0x01fe03 thru 0x02a64d (0xa84b bytes) 000775 1790973307.404944 trunc from 0x02a64e to 0x01a857 (0xfdf6 bytes) 000776 1790973307.434720 write 0x00e3a3 thru 0x017ed7 (0x9b35 bytes) 000777 1790973307.445181 MIRROR_EXTEND to 5 mirrors CRC-32 checksum value for chunk [0, 0x1a858): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x1a858): Mirror 4: 0xd308e757 (stale) Mirror 6: 0xd308e757 (stale) Mirror 7: 0xd308e757 (stale) CRC-32 checksum value for chunk [0, 0x1a858): Mirror 1: 0xf3d10023 Mirror 8: 0xf3d10023 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x1a858: skipped 000779 1790973308.294485 punch from 0x0133b2 to 0x01a857 (0x74a6 bytes) 000780 1790973308.434549 mapread 0x01a829 thru 0x01a857 (0x2f bytes) 000783 1790973308.452008 read 0x0044d2 thru 0x0114ab (0xcfda bytes) 000784 1790973308.465658 mapread 0x0064fa thru 0x01628d (0xfd94 bytes) 000785 1790973308.483078 read 0x004ab9 thru 0x00d299 (0x87e1 bytes) 000786 1790973308.483946 trunc from 0x01a858 to 0x037d0e (0x1d4b7 bytes) 000787 1790973308.547519 punch from 0x018f88 to 0x019f5c (0xfd5 bytes) 000788 1790973308.567721 read 0x00cb59 thru 0x015f03 (0x93ab bytes) 000789 1790973308.568803 trunc from 0x037d0f to 0x020350 (0x179be bytes) 000790 1790973308.586476 read 0x019d95 thru 0x01eed3 (0x513f bytes) 000795 1790973308.610607 mapwrite 0x015918 thru 0x01f33d (0x9a26 bytes) 000796 1790973308.662384 read 0x0114ba thru 0x012557 (0x109e bytes) 000797 1790973308.664239 punch from 0x008ef1 to 0x00cadc (0x3bec bytes) 000798 1790973308.682191 read 0x00a1ff thru 0x016d34 (0xcb36 bytes) 000800 1790973308.694301 read 0x019fc3 thru 0x01c8ee (0x292c bytes) 000804 1790973308.696961 mapwrite 0x01fb11 thru 0x028f15 (0x9405 bytes) 000805 1790973308.787545 mapread 0x021b94 thru 0x028f15 (0x7382 bytes) 000806 1790973308.789406 mapread 0x01079f thru 0x015ba4 (0x5406 bytes) 000807 1790973308.796197 MIRROR_EXTEND to 6 mirrors CRC-32 checksum value for chunk [0, 0x28f16): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x28f16): Mirror 4: 0x601aad8b (stale) Mirror 6: 0x601aad8b (stale) Mirror 7: 0x601aad8b (stale) Mirror 8: 0xb5061056 (stale) CRC-32 checksum value for chunk [0, 0x28f16): Mirror 1: 0x90b1b55b Mirror 9: 0x90b1b55b lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x28f16: skipped 000808 1790973309.660323 MIRROR_RESYNC 6 mirrors 000811 1790973310.613356 read 0x015767 thru 0x018b2b (0x33c5 bytes) 000812 1790973310.619355 read 0x02812a thru 0x028f15 (0xdec bytes) 000814 1790973310.631901 write 0x00c845 thru 0x018193 (0xb94f bytes) 000815 1790973310.718056 trunc from 0x028f16 to 0x0226eb (0x682a bytes) 000816 1790973310.739629 trunc from 0x0226ec to 0x0351bb (0x12ad0 bytes) 000817 1790973310.758842 write 0x016de1 thru 0x018b17 (0x1d37 bytes) 000819 1790973310.761349 mapwrite 0x017ce2 thru 0x01a0ca (0x23e9 bytes) 000820 1790973310.817961 read 0x028c5a thru 0x030bff (0x7fa6 bytes) 000821 1790973310.830923 mapwrite 0x0060a9 thru 0x00d081 (0x6fd9 bytes) 000823 1790973310.871696 mapread 0x02d604 thru 0x034e1a (0x7817 bytes) 000824 1790973310.872909 punch from 0x02564f to 0x027c3b (0x25ed bytes) 000826 1790973310.878525 read 0x00e8b3 thru 0x01d485 (0xebd3 bytes) 000829 1790973310.880219 punch from 0x02ef79 to 0x0351bb (0x6243 bytes) 000830 1790973310.885031 trunc from 0x0351bc to 0x0354d6 (0x31b bytes) 000832 1790973310.900371 punch from 0x02d212 to 0x0354d6 (0x82c5 bytes) 000833 1790973310.906020 trunc from 0x0354d7 to 0x01755a (0x1df7c bytes) 000835 1790973310.922532 punch from 0x00fbad to 0x01755a (0x79ae bytes) 000836 1790973310.927294 trunc from 0x01755b to 0x00e413 (0x9147 bytes) 000838 1790973310.947771 read 0x005ad9 thru 0x00e413 (0x893b bytes) 000839 1790973310.948421 punch from 0x004dbd to 0x00b8fe (0x6b42 bytes) 000840 1790973310.953987 punch from 0x005992 to 0x00c631 (0x6ca0 bytes) 000841 1790973310.959616 punch from 0x0066a1 to 0x00c812 (0x6172 bytes) 000842 1790973310.964542 read 0x00bb9a thru 0x00e413 (0x287a bytes) 000843 1790973310.973240 punch from 0x000b0e to 0x00b548 (0xaa3b bytes) 000844 1790973310.977502 read 0x00c8d2 thru 0x00e413 (0x1b42 bytes) 000845 1790973310.978199 write 0x032c07 thru 0x03da05 (0xadff bytes) 000846 1790973310.980603 mapread 0x0363ba thru 0x03da05 (0x764c bytes) 000849 1790973310.983346 mapread 0x026b7f thru 0x02f9fd (0x8e7f bytes) 000850 1790973310.992969 mapread 0x00f724 thru 0x018c45 (0x9522 bytes) 000852 1790973310.994302 read 0x026d5a thru 0x02e82d (0x7ad4 bytes) 000853 1790973310.995176 write 0x0251fe thru 0x0284b1 (0x32b4 bytes) 000854 1790973310.996524 read 0x039234 thru 0x03da05 (0x47d2 bytes) 000855 1790973311.001668 MIRROR_RESYNC 6 mirrors 000856 1790973312.149580 write 0x013c85 thru 0x02194c (0xdcc8 bytes) 000857 1790973312.226884 trunc from 0x03da06 to 0x0260c2 (0x17943 bytes) 000858 1790973312.241934 trunc from 0x0260c3 to 0x030b29 (0xaa67 bytes) 000859 1790973312.255236 mapread 0x00d7ab thru 0x015a0c (0x8262 bytes) 000860 1790973312.284772 mapwrite 0x01cb0d thru 0x023e8f (0x7383 bytes) 000861 1790973312.391329 trunc from 0x030b2a to 0x025109 (0xba20 bytes) 000862 1790973312.430781 mapread 0x006e4e thru 0x00ae9e (0x4051 bytes) 000866 1790973312.446336 mapread 0x007fd9 thru 0x014a84 (0xcaac bytes) 000867 1790973312.450833 read 0x01d3f8 thru 0x025109 (0x7d12 bytes) 000868 1790973312.451430 read 0x01284e thru 0x01fbef (0xd3a2 bytes) 000869 1790973312.452661 trunc from 0x02510a to 0x03c226 (0x1711d bytes) 000870 1790973312.480609 MIRROR_EXTEND to 7 mirrors CRC-32 checksum value for chunk [0, 0x3c227): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3c227): Mirror 4: 0x82125de6 (stale) Mirror 6: 0x82125de6 (stale) Mirror 7: 0x82125de6 (stale) Mirror 8: 0x82125de6 (stale) Mirror 9: 0x82125de6 (stale) CRC-32 checksum value for chunk [0, 0x3c227): Mirror 1: 0xc47ff66c Mirror 10: 0xc47ff66c lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3c227: skipped 000871 1790973313.959973 mapwrite 0x01e946 thru 0x027ef9 (0x95b4 bytes) 000872 1790973314.140537 write 0x01ecd9 thru 0x025da3 (0x70cb bytes) 000873 1790973314.142165 mapwrite 0x02c9dd thru 0x039701 (0xcd25 bytes) 000874 1790973314.206047 mapwrite 0x01ac9c thru 0x029ade (0xee43 bytes) 000875 1790973314.249588 read 0x00cc26 thru 0x01880d (0xbbe8 bytes) 000876 1790973314.261626 mapread 0x027a4b thru 0x02e4bc (0x6a72 bytes) 000877 1790973314.262538 trunc from 0x03c227 to 0x023e6c (0x183ba bytes) 000878 1790973314.289667 mapwrite 0x032561 thru 0x03b51e (0x8fbe bytes) 000879 1790973314.356386 write 0x00f79a thru 0x01bac0 (0xc327 bytes) 000880 1790973314.357671 punch from 0x0120b7 to 0x0144e1 (0x242b bytes) 000881 1790973314.379266 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0x3b51f): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3b51f): Mirror 4: 0xc947b0f6 (stale) Mirror 6: 0xc947b0f6 (stale) Mirror 7: 0xc947b0f6 (stale) Mirror 8: 0xc947b0f6 (stale) Mirror 9: 0xc947b0f6 (stale) Mirror 10: 0xdfed93f (stale) CRC-32 checksum value for chunk [0, 0x3b51f): Mirror 1: 0x157c6af Mirror 11: 0x157c6af lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3b51f: skipped 000883 1790973315.259255 trunc from 0x03b51f to 0x019f8c (0x21592 bytes) 000884 1790973315.461160 trunc from 0x019f8d to 0x00e8ac (0xb6e0 bytes) 000886 1790973315.500982 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0xe8ad): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 10: (stale - read error) Mirror 11: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xe8ad): Mirror 4: 0x28bc2f82 (stale) Mirror 6: 0x28bc2f82 (stale) Mirror 7: 0x28bc2f82 (stale) Mirror 8: 0x28bc2f82 (stale) Mirror 9: 0x28bc2f82 (stale) Mirror 10: 0x28bc2f82 (stale) Mirror 11: 0x28bc2f82 (stale) CRC-32 checksum value for chunk [0, 0xe8ad): Mirror 1: 0x28bc2f82 Mirror 12: 0x28bc2f82 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xe8ad: skipped 000888 1790973316.460567 mapwrite 0x01f87c thru 0x027005 (0x778a bytes) 000889 1790973316.684877 write 0x01a822 thru 0x02a20d (0xf9ec bytes) 000891 1790973316.688603 mapread 0x018985 thru 0x01906f (0x6eb bytes) 000893 1790973316.704525 trunc from 0x02a20e to 0x001bb2 (0x2865b bytes) 000894 1790973316.749001 write 0x01df92 thru 0x02499d (0x6a0c bytes) 000895 1790973316.750346 trunc from 0x02499e to 0x01d3c7 (0x75d6 bytes) 000896 1790973316.767520 mapwrite 0x022e71 thru 0x0295ea (0x677a bytes) 000897 1790973316.880976 trunc from 0x0295eb to 0x03d4a4 (0x13eba bytes) 000898 1790973316.893642 mapwrite 0x03aa39 thru 0x03acb7 (0x27f bytes) 000899 1790973316.948980 read 0x032002 thru 0x03809b (0x609a bytes) 000901 1790973316.975384 MIRROR_SPLIT mirror 6 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x212:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x3d4a5): Mirror 4: 0xc8e77efd (stale) Mirror 6: 0xc8e77efd (stale) Mirror 7: 0xc8e77efd (stale) Mirror 8: 0xc8e77efd (stale) Mirror 9: 0xc8e77efd (stale) Mirror 11: 0x74a09719 (stale) Mirror 12: 0x3d365114 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d4a5): Mirror 4: 0xc8e77efd (stale) Mirror 6: 0xc8e77efd (stale) Mirror 7: 0xc8e77efd (stale) Mirror 8: 0xc8e77efd (stale) Mirror 9: 0xc8e77efd (stale) Mirror 11: 0x74a09719 (stale) Mirror 12: 0x3d365114 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d4a5: skipped 000910 1790973317.589868 MIRROR_EXTEND to 9 mirrors CRC-32 checksum value for chunk [0, 0x3d4a5): Mirror 4: (stale - read error) Mirror 6: (stale - read error) Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x3d4a5): Mirror 4: 0xc8e77efd (stale) Mirror 6: 0xc8e77efd (stale) Mirror 7: 0xc8e77efd (stale) Mirror 8: 0xc8e77efd (stale) Mirror 9: 0xc8e77efd (stale) Mirror 11: 0x74a09719 (stale) Mirror 12: 0x3d365114 (stale) CRC-32 checksum value for chunk [0, 0x3d4a5): Mirror 1: 0x3aeeff56 Mirror 13: 0x3aeeff56 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x3d4a5: skipped 000914 1790973318.411885 mapwrite 0x00a04c thru 0x016955 (0xc90a bytes) 000917 1790973318.679132 punch from 0x01d2ff to 0x02c314 (0xf016 bytes) 000918 1790973318.696104 trunc from 0x03d4a5 to 0x00beff (0x315a5 bytes) 000919 1790973318.751171 write 0x013365 thru 0x016f3f (0x3bdb bytes) 000920 1790973318.752952 read 0x015d99 thru 0x016f3f (0x11a7 bytes) 000921 1790973318.753668 write 0x029e4d thru 0x0373d6 (0xd58a bytes) 000922 1790973318.766964 MIRROR_SPLIT mirror 2 to 8 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x212:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x373d7): Mirror 4: 0xd828f704 (stale) Mirror 7: 0xd828f704 (stale) Mirror 8: 0xd828f704 (stale) Mirror 9: 0xd828f704 (stale) Mirror 11: 0x2d614a4c (stale) Mirror 12: 0xf077acfc (stale) Mirror 13: 0x8e55bec4 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x373d7): Mirror 4: 0xd828f704 (stale) Mirror 7: 0xd828f704 (stale) Mirror 8: 0xd828f704 (stale) Mirror 9: 0xd828f704 (stale) Mirror 11: 0x2d614a4c (stale) Mirror 12: 0xf077acfc (stale) Mirror 13: 0x8e55bec4 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x373d7: skipped 000923 1790973319.396587 mapwrite 0x03a9fb thru 0x03ffff (0x5605 bytes) 000925 1790973319.486992 punch from 0x022244 to 0x027cfe (0x5abb bytes) 000929 1790973319.498300 MIRROR_RESYNC 8 mirrors 000931 1790973321.017379 mapwrite 0x026a4e thru 0x02bc98 (0x524b bytes) 000932 1790973321.268276 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x212:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xe414add3 (stale) Mirror 8: 0xe414add3 (stale) Mirror 9: 0xe414add3 (stale) Mirror 11: 0xe414add3 (stale) Mirror 12: 0xe414add3 (stale) Mirror 13: 0xe414add3 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x40000): Mirror 7: 0xe414add3 (stale) Mirror 8: 0xe414add3 (stale) Mirror 9: 0xe414add3 (stale) Mirror 11: 0xe414add3 (stale) Mirror 12: 0xe414add3 (stale) Mirror 13: 0xe414add3 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x40000: skipped 000933 1790973321.798692 MIRROR_RESYNC 7 mirrors 000935 1790973322.887349 trunc from 0x040000 to 0x003a47 (0x3c5b8 bytes) 000937 1790973322.957720 mapread 0x001f2a thru 0x003a47 (0x1b1e bytes) 000938 1790973322.989019 trunc from 0x003a48 to 0x00c63d (0x8bf6 bytes) 000939 1790973323.018502 read 0x003fc3 thru 0x00c63d (0x867b bytes) 000940 1790973323.031725 MIRROR_EXTEND to 8 mirrors CRC-32 checksum value for chunk [0, 0xc63e): Mirror 7: (stale - read error) Mirror 8: (stale - read error) Mirror 9: (stale - read error) Mirror 11: (stale - read error) Mirror 12: (stale - read error) Mirror 13: (stale - read error) mirror op 0: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0xc63e): Mirror 7: 0x16cfa9a7 (stale) Mirror 8: 0x16cfa9a7 (stale) Mirror 9: 0x16cfa9a7 (stale) Mirror 11: 0x16cfa9a7 (stale) Mirror 12: 0x16cfa9a7 (stale) Mirror 13: 0x16cfa9a7 (stale) CRC-32 checksum value for chunk [0, 0xc63e): Mirror 1: 0x20d2fab6 Mirror 14: 0x20d2fab6 lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0xc63e: skipped 000942 1790973323.960009 read 0x0067bd thru 0x00c63d (0x5e81 bytes) 000945 1790973324.001968 mapwrite 0x000ff3 thru 0x001c30 (0xc3e bytes) 000946 1790973324.247151 mapread 0x00beac thru 0x00c63d (0x792 bytes) 000947 1790973324.270135 punch from 0x0006d8 to 0x00c63d (0xbf66 bytes) 000948 1790973324.283595 MIRROR_RESYNC 8 mirrors 000949 1790973325.422247 trunc from 0x00c63e to 0x03a639 (0x2dffc bytes) 000950 1790973325.489233 mapwrite 0x00c94e thru 0x018763 (0xbe16 bytes) 000951 1790973325.597589 read 0x037d4c thru 0x03a639 (0x28ee bytes) 000952 1790973325.602497 punch from 0x010801 to 0x016921 (0x6121 bytes) 000954 1790973325.606555 mapread 0x0066a6 thru 0x010327 (0x9c82 bytes) 000955 1790973325.613519 write 0x00feb9 thru 0x0158e6 (0x5a2e bytes) 000956 1790973325.619351 trunc from 0x03a63a to 0x03b30b (0xcd2 bytes) 000957 1790973325.644459 trunc from 0x03b30c to 0x0134d8 (0x27e33 bytes) 000958 1790973325.673273 write 0x0390bc thru 0x03ffff (0x6f44 bytes) 000959 1790973325.674591 punch from 0x0086ac to 0x00f346 (0x6c9b bytes) 000960 1790973325.683594 mapwrite 0x0051bd thru 0x00660d (0x1451 bytes) 000961 1790973325.728768 trunc from 0x040000 to 0x00fb7b (0x30484 bytes) 000962 1790973325.752352 mapwrite 0x0040b7 thru 0x01000a (0xbf54 bytes) 000964 1790973325.836792 trunc from 0x01000b to 0x0168f3 (0x68e9 bytes) 000965 1790973325.858916 mapread 0x000802 thru 0x005fd3 (0x57d2 bytes) 000966 1790973325.865559 trunc from 0x0168f4 to 0x021d9e (0xb4ab bytes) 000967 1790973325.879268 read 0x014f06 thru 0x01ae44 (0x5f3f bytes) 000968 1790973325.889038 punch from 0x00ae94 to 0x015ebf (0xb02c bytes) 000970 1790973325.893339 punch from 0x00bbfb to 0x013f02 (0x8308 bytes) 000972 1790973325.902187 MIRROR_SPLIT mirror 1 to 7 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x212:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x21d9f): Mirror 8: 0x1a5387a (stale) Mirror 9: 0x1a5387a (stale) Mirror 11: 0x1a5387a (stale) Mirror 12: 0x1a5387a (stale) Mirror 13: 0x1a5387a (stale) Mirror 14: 0x1a5387a (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x21d9f): Mirror 8: 0x1a5387a (stale) Mirror 9: 0x1a5387a (stale) Mirror 11: 0x1a5387a (stale) Mirror 12: 0x1a5387a (stale) Mirror 13: 0x1a5387a (stale) Mirror 14: 0x1a5387a (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x21d9f: skipped 000973 1790973326.338770 mapwrite 0x00f24c thru 0x012e0c (0x3bc1 bytes) 000975 1790973326.434833 read 0x000e9b thru 0x001766 (0x8cc bytes) 000976 1790973326.440482 read 0x002897 thru 0x005a85 (0x31ef bytes) 000977 1790973326.451299 mapwrite 0x0095d1 thru 0x018e02 (0xf832 bytes) 000978 1790973326.504384 mapread 0x00b86b thru 0x01a893 (0xf029 bytes) 000979 1790973326.506556 mapwrite 0x0011d8 thru 0x00f9a6 (0xe7cf bytes) 000980 1790973326.562626 punch from 0x00504b to 0x01123d (0xc1f3 bytes) 000981 1790973326.568785 write 0x027cb7 thru 0x032ffe (0xb348 bytes) 000982 1790973326.571573 punch from 0x024ddc to 0x026cde (0x1f03 bytes) 000984 1790973326.591638 write 0x009344 thru 0x013ad6 (0xa793 bytes) 000985 1790973326.609072 punch from 0x012c25 to 0x01d0e1 (0xa4bd bytes) 000986 1790973326.625728 mapread 0x0044d4 thru 0x007259 (0x2d86 bytes) 000988 1790973326.653083 MIRROR_SPLIT mirror 2 to 6 mirrors lfs mirror mirror: cannot get UNLOCK lease, ext 8 for [0x200000404:0x212:0x0]: Invalid argument (22) CRC-32 checksum value for chunk [0, 0x32fff): Mirror 8: 0x38addb71 (stale) Mirror 11: 0x38addb71 (stale) Mirror 12: 0x38addb71 (stale) Mirror 13: 0x38addb71 (stale) Mirror 14: 0x38addb71 (stale) mirror op 1: lfs mirror verify /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr: 116 CRC-32 checksum value for chunk [0, 0x32fff): Mirror 8: 0x38addb71 (stale) Mirror 11: 0x38addb71 (stale) Mirror 12: 0x38addb71 (stale) Mirror 13: 0x38addb71 (stale) Mirror 14: 0x38addb71 (stale) lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0, 0x100000) is only valid in mirror 1: skipped lfs verify: '/mnt/lustre/d70a.sanity-flr/f70a.sanity-flr' chunk [0x100000, 0xffffffffffffffff) exceeds file size 0x32fff: skipped 000990 1790973327.002215 punch from 0x01f489 to 0x0275d2 (0x814a bytes) 000991 1790973327.006804 mapread 0x00862b thru 0x00b31b (0x2cf1 bytes) 000992 1790973327.026306 punch from 0x00b67a to 0x00db9c (0x2523 bytes) 000994 1790973327.031189 mapwrite 0x025b37 thru 0x02c69d (0x6b67 bytes) 000996 1790973327.084083 write 0x006545 thru 0x01103c (0xaaf8 bytes) 000998 1790973327.085840 punch from 0x026375 to 0x028e88 (0x2b14 bytes) 000999 1790973327.099287 mapread 0x02a4cd thru 0x02d397 (0x2ecb bytes) All operations completed A-OK!