== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 07:56:44 (1788868604) Stopping clients: oleg643-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg643-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg643-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg643-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg643-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg643-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg643-server oleg643-server: oleg643-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg643-server' oleg643-server: oleg643-server.virtnet: executing load_modules_local oleg643-server: kmemleak disabled oleg643-server: Loading modules from /home/green/git/lustre-release/lustre oleg643-server: detected 4 online CPUs by sysfs oleg643-server: MODOPTS_LIBCFS= oleg643-server: Force libcfs to create 2 CPU partitions oleg643-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg643-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg643-server: oleg643-server.virtnet: executing set_default_debug -1 all pdsh@oleg643-client: oleg643-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg643-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg643-server: oleg643-server.virtnet: executing set_default_debug -1 all pdsh@oleg643-client: oleg643-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg643-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg643-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg643-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg643-server: oleg643-server.virtnet: executing set_default_debug -1 all pdsh@oleg643-client: oleg643-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg643-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg643-client.virtnet: -o user_xattr,flock 192.168.206.143@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H crush /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 1652 (time 1788868728.65 total 10.01 last 165.09) - open/close 3183 (time 1788868738.66 total 20.01 last 153.07) total: 4500 open/close in 27.97 seconds: 160.89 ops/second - /unlink 3390 (time 1788868758.54 total 10.00 last 338.99) total: 4500 /unlink in 12.84 seconds: 350.37 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 1539 (time 1788868773.15 total 10.00 last 153.87) - open/close 3057 (time 1788868783.15 total 20.00 last 151.79) total: 4500 open/close in 29.82 seconds: 150.89 ops/second - /unlink 3112 (time 1788868804.83 total 10.00 last 311.15) total: 4500 /unlink in 14.31 seconds: 314.56 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 1622 (time 1788868821.01 total 10.00 last 162.14) - open/close 3181 (time 1788868831.01 total 20.01 last 155.84) total: 4500 open/close in 29.00 seconds: 155.16 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 - /unlink 3787 (time 1788868851.89 total 10.00 last 378.67) total: 4500 /unlink in 12.09 seconds: 372.07 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 1528 (time 1788868865.89 total 10.00 last 152.74) - open/close 2869 (time 1788868875.90 total 20.01 last 134.07) - open/close 4145 (time 1788868885.90 total 30.01 last 127.57) total: 4500 open/close in 32.65 seconds: 137.83 ops/second - /unlink 3075 (time 1788868900.40 total 10.00 last 307.40) total: 4500 /unlink in 15.16 seconds: 296.92 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 1557 (time 1788868918.09 total 10.00 last 155.63) - open/close 2967 (time 1788868928.09 total 20.01 last 140.97) - open/close 4332 (time 1788868938.09 total 30.01 last 136.41) total: 4500 open/close in 31.22 seconds: 144.16 ops/second - /unlink 3388 (time 1788868951.33 total 10.00 last 338.68) total: 4500 /unlink in 13.74 seconds: 327.53 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 1774 (time 1788868967.16 total 10.00 last 177.37) - open/close 3616 (time 1788868977.16 total 20.00 last 184.16) total: 4500 open/close in 24.43 seconds: 184.19 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 - /unlink 3471 (time 1788868993.23 total 10.00 last 347.03) total: 4500 /unlink in 13.33 seconds: 337.63 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 1600 (time 1788869008.43 total 10.00 last 160.00) - open/close 3285 (time 1788869018.44 total 20.01 last 168.33) total: 4500 open/close in 27.87 seconds: 161.48 ops/second - /unlink 3501 (time 1788869038.19 total 10.00 last 350.08) total: 4500 /unlink in 12.36 seconds: 364.20 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 2337 (time 1788869052.44 total 10.00 last 233.66) total: 4500 open/close in 18.99 seconds: 236.93 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 - /unlink 3731 (time 1788869073.11 total 10.00 last 373.00) total: 4500 /unlink in 11.76 seconds: 382.58 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 1604 (time 1788869086.54 total 10.00 last 160.38) - open/close 3584 (time 1788869096.54 total 20.00 last 197.97) total: 4500 open/close in 24.04 seconds: 187.18 ops/second - /unlink 3340 (time 1788869112.41 total 10.00 last 333.92) total: 4500 /unlink in 13.91 seconds: 323.54 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 1358 (time 1788869128.20 total 10.00 last 135.73) - open/close 2893 (time 1788869138.20 total 20.00 last 153.50) total: 4500 open/close in 27.80 seconds: 161.90 ops/second - /unlink 3859 (time 1788869157.65 total 10.00 last 385.88) total: 4500 /unlink in 11.87 seconds: 379.08 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 1520 (time 1788869171.33 total 10.00 last 151.98) - open/close 3083 (time 1788869181.33 total 20.00 last 156.25) total: 4500 open/close in 28.97 seconds: 155.34 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 - /unlink 2969 (time 1788869202.26 total 10.00 last 296.87) total: 4500 /unlink in 15.46 seconds: 291.10 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 1447 (time 1788869219.66 total 10.00 last 144.63) - open/close 2720 (time 1788869229.67 total 20.01 last 127.23) - open/close 3864 (time 1788869239.67 total 30.02 last 114.32) total: 4500 open/close in 35.53 seconds: 126.64 ops/second - /unlink 2547 (time 1788869257.33 total 10.00 last 254.64) total: 4500 /unlink in 17.76 seconds: 253.33 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 1392 (time 1788869277.44 total 10.01 last 139.07) - open/close 2631 (time 1788869287.44 total 20.01 last 123.86) - open/close 4350 (time 1788869297.45 total 30.02 last 171.84) total: 4500 open/close in 30.83 seconds: 145.97 ops/second - /unlink 3346 (time 1788869310.04 total 10.00 last 334.53) total: 4500 /unlink in 13.29 seconds: 338.49 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 lustre-MDT0000: clear the changelog for cl1 to record #246998 - open/close 1792 (time 1788869325.16 total 10.00 last 179.14) - open/close 3198 (time 1788869335.16 total 20.01 last 140.57) total: 4500 open/close in 29.28 seconds: 153.68 ops/second - /unlink 3218 (time 1788869356.48 total 10.00 last 321.77) total: 4500 /unlink in 13.62 seconds: 330.44 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 1480 (time 1788869371.79 total 10.00 last 147.96) - open/close 3092 (time 1788869381.80 total 20.01 last 161.07) - open/close 4448 (time 1788869391.80 total 30.01 last 135.56) total: 4500 open/close in 30.33 seconds: 148.37 ops/second - /unlink 2952 (time 1788869404.15 total 10.00 last 295.12) total: 4500 /unlink in 16.11 seconds: 279.37 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 1392 (time 1788869422.76 total 10.01 last 139.11) - open/close 2790 (time 1788869432.76 total 20.01 last 139.74) - open/close 4086 (time 1788869442.77 total 30.02 last 129.47) total: 4500 open/close in 32.57 seconds: 138.16 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 - /unlink 3017 (time 1788869457.07 total 10.00 last 301.69) total: 4500 /unlink in 15.32 seconds: 293.65 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 1579 (time 1788869474.43 total 10.00 last 157.87) - open/close 3362 (time 1788869484.43 total 20.00 last 178.29) total: 4500 open/close in 27.04 seconds: 166.40 ops/second - /unlink 3836 (time 1788869503.21 total 10.00 last 383.55) total: 4500 /unlink in 11.89 seconds: 378.47 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 1301 (time 1788869516.98 total 10.01 last 129.99) - open/close 2776 (time 1788869526.99 total 20.02 last 147.40) - open/close 4384 (time 1788869536.99 total 30.02 last 160.79) total: 4500 open/close in 30.75 seconds: 146.33 ops/second - /unlink 2503 (time 1788869549.62 total 10.00 last 250.25) total: 4500 /unlink in 17.44 seconds: 257.97 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11344: 94459 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg643-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg643-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg643-server stop mds service on oleg643-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg643-server stop mds service on oleg643-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg643-server unloading modules via unload_modules_local on: 'oleg643-server' oleg643-server: oleg643-server.virtnet: executing unload_modules_local oleg643-server: kmemleak disabled modules unloaded.