== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 09:32:51 (1789306371) Stopping clients: oleg201-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg201-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg201-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg201-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg201-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg201-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg201-server oleg201-server: oleg201-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg201-server' oleg201-server: oleg201-server.virtnet: executing load_modules_local oleg201-server: kmemleak disabled oleg201-server: Loading modules from /home/green/git/lustre-release/lustre oleg201-server: detected 4 online CPUs by sysfs oleg201-server: MODOPTS_LIBCFS= oleg201-server: Force libcfs to create 2 CPU partitions oleg201-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg201-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg201-server: oleg201-server.virtnet: executing set_default_debug -1 all pdsh@oleg201-client: oleg201-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg201-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg201-server: oleg201-server.virtnet: executing set_default_debug -1 all pdsh@oleg201-client: oleg201-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg201-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg201-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg201-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg201-server: oleg201-server.virtnet: executing set_default_debug -1 all pdsh@oleg201-client: oleg201-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg201-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg201-client.virtnet: -o user_xattr,flock 192.168.202.101@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H all_char /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 971 (time 1789306530.34 total 10.01 last 96.96) - open/close 1852 (time 1789306540.34 total 20.02 last 88.08) - open/close 2700 (time 1789306550.37 total 30.05 last 84.53) - open/close 3629 (time 1789306560.38 total 40.06 last 92.79) total: 4500 open/close in 49.28 seconds: 91.31 ops/second - /unlink 1658 (time 1789306583.13 total 10.00 last 165.76) - /unlink 3327 (time 1789306593.14 total 20.01 last 166.85) total: 4500 /unlink in 26.26 seconds: 171.38 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 861 (time 1789306612.45 total 10.00 last 86.09) - open/close 1825 (time 1789306622.45 total 20.00 last 96.37) - open/close 2900 (time 1789306632.46 total 30.01 last 107.40) - open/close 3913 (time 1789306642.46 total 40.01 last 101.30) total: 4500 open/close in 46.03 seconds: 97.77 ops/second - /unlink 2351 (time 1789306661.00 total 10.00 last 235.05) total: 4500 /unlink in 19.92 seconds: 225.90 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 998 (time 1789306684.61 total 10.01 last 99.75) - open/close 2075 (time 1789306694.61 total 20.01 last 107.64) - open/close 3139 (time 1789306704.62 total 30.02 last 106.32) - open/close 4194 (time 1789306714.62 total 40.02 last 105.46) total: 4500 open/close in 43.26 seconds: 104.03 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 - /unlink 2111 (time 1789306730.87 total 10.00 last 211.01) - /unlink 4042 (time 1789306740.87 total 20.01 last 193.05) total: 4500 /unlink in 22.36 seconds: 201.28 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 1024 (time 1789306755.84 total 10.01 last 102.28) - open/close 2158 (time 1789306765.84 total 20.02 last 113.36) - open/close 3192 (time 1789306775.85 total 30.02 last 103.32) - open/close 4193 (time 1789306785.86 total 40.04 last 99.97) total: 4500 open/close in 43.18 seconds: 104.21 ops/second - /unlink 1693 (time 1789306801.89 total 10.00 last 169.23) - /unlink 3366 (time 1789306811.89 total 20.01 last 167.23) total: 4500 /unlink in 26.77 seconds: 168.08 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 979 (time 1789306831.49 total 10.00 last 97.86) - open/close 2024 (time 1789306841.50 total 20.01 last 104.42) - open/close 3112 (time 1789306851.50 total 30.02 last 108.75) - open/close 4193 (time 1789306861.50 total 40.02 last 108.05) total: 4500 open/close in 42.50 seconds: 105.88 ops/second - /unlink 2717 (time 1789306876.31 total 10.00 last 271.65) total: 4500 /unlink in 15.69 seconds: 286.78 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 1279 (time 1789306893.75 total 10.00 last 127.86) - open/close 2362 (time 1789306903.76 total 20.01 last 108.21) - open/close 3549 (time 1789306913.77 total 30.02 last 118.58) total: 4500 open/close in 37.10 seconds: 121.30 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 - /unlink 2291 (time 1789306932.89 total 10.00 last 229.05) total: 4500 /unlink in 19.47 seconds: 231.12 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 1615 (time 1789306954.92 total 10.00 last 161.47) - open/close 2892 (time 1789306964.92 total 20.01 last 127.66) - open/close 4099 (time 1789306974.93 total 30.01 last 120.60) total: 4500 open/close in 33.30 seconds: 135.14 ops/second - /unlink 2354 (time 1789306990.54 total 10.00 last 235.36) total: 4500 /unlink in 18.52 seconds: 242.92 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 1129 (time 1789307011.22 total 10.00 last 112.85) - open/close 2266 (time 1789307021.23 total 20.01 last 113.63) - open/close 3428 (time 1789307031.23 total 30.01 last 116.16) total: 4500 open/close in 38.66 seconds: 116.40 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 - /unlink 2276 (time 1789307051.99 total 10.00 last 227.57) total: 4500 /unlink in 18.69 seconds: 240.75 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 1243 (time 1789307072.99 total 10.01 last 124.22) - open/close 2830 (time 1789307082.99 total 20.01 last 158.64) - open/close 4340 (time 1789307092.99 total 30.01 last 150.99) total: 4500 open/close in 31.07 seconds: 144.85 ops/second - /unlink 2494 (time 1789307106.20 total 10.00 last 249.36) total: 4500 /unlink in 18.79 seconds: 239.45 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 1450 (time 1789307128.23 total 10.01 last 144.83) - open/close 2730 (time 1789307138.23 total 20.02 last 127.95) - open/close 3893 (time 1789307148.24 total 30.02 last 116.25) total: 4500 open/close in 34.71 seconds: 129.65 ops/second - /unlink 2613 (time 1789307164.99 total 10.00 last 261.19) total: 4500 /unlink in 17.53 seconds: 256.64 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 1664 (time 1789307184.66 total 10.00 last 166.35) - open/close 2989 (time 1789307194.66 total 20.00 last 132.48) - open/close 4304 (time 1789307204.67 total 30.02 last 131.30) total: 4500 open/close in 31.79 seconds: 141.56 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 - /unlink 2712 (time 1789307218.31 total 10.01 last 270.96) total: 4500 /unlink in 17.25 seconds: 260.83 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 1388 (time 1789307238.27 total 10.00 last 138.79) - open/close 2708 (time 1789307248.27 total 20.01 last 131.93) - open/close 3904 (time 1789307258.28 total 30.01 last 119.51) total: 4500 open/close in 35.01 seconds: 128.52 ops/second - /unlink 2782 (time 1789307275.51 total 10.00 last 278.15) total: 4500 /unlink in 16.69 seconds: 269.66 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 1267 (time 1789307295.03 total 10.01 last 126.56) - open/close 2713 (time 1789307305.03 total 20.01 last 144.58) - open/close 4385 (time 1789307315.04 total 30.02 last 167.07) total: 4500 open/close in 30.51 seconds: 147.47 ops/second - /unlink 3613 (time 1789307327.28 total 10.00 last 361.15) total: 4500 /unlink in 13.15 seconds: 342.16 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 lustre-MDT0000: clear the changelog for cl1 to record #246998 - open/close 1373 (time 1789307342.71 total 10.01 last 137.12) - open/close 2615 (time 1789307352.71 total 20.02 last 124.17) - open/close 4106 (time 1789307362.72 total 30.02 last 149.02) total: 4500 open/close in 33.12 seconds: 135.88 ops/second - /unlink 3314 (time 1789307377.99 total 10.00 last 331.37) total: 4500 /unlink in 14.44 seconds: 311.71 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 1408 (time 1789307394.50 total 10.00 last 140.77) - open/close 3035 (time 1789307404.51 total 20.00 last 162.66) total: 4500 open/close in 27.77 seconds: 162.04 ops/second - /unlink 3839 (time 1789307423.96 total 10.00 last 383.77) total: 4500 /unlink in 11.49 seconds: 391.77 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 1507 (time 1789307437.13 total 10.00 last 150.63) - open/close 2906 (time 1789307447.13 total 20.01 last 139.89) total: 4500 open/close in 28.31 seconds: 158.96 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 - /unlink 3526 (time 1789307467.16 total 10.00 last 352.60) total: 4500 /unlink in 12.69 seconds: 354.68 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 1619 (time 1789307481.68 total 10.00 last 161.86) - open/close 3971 (time 1789307491.68 total 20.01 last 235.13) total: 4500 open/close in 21.81 seconds: 206.31 ops/second total: 4500 /unlink in 8.83 seconds: 509.91 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 1769 (time 1789307515.48 total 10.00 last 176.88) - open/close 4129 (time 1789307525.48 total 20.00 last 235.95) total: 4500 open/close in 21.00 seconds: 214.24 ops/second total: 4500 /unlink in 7.10 seconds: 633.40 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11350: 94971 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg201-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg201-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg201-server stop mds service on oleg201-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg201-server stop mds service on oleg201-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg201-server unloading modules via unload_modules_local on: 'oleg201-server' oleg201-server: oleg201-server.virtnet: executing unload_modules_local oleg201-server: kmemleak disabled modules unloaded.