== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 06:24:15 (1783074255) Stopping clients: oleg323-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg323-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg323-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg323-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg323-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg323-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg323-server oleg323-server: oleg323-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg323-server' oleg323-server: oleg323-server.virtnet: executing load_modules_local oleg323-server: Loading modules from /home/green/git/lustre-release/lustre oleg323-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg323-server: detected 4 online CPUs by sysfs oleg323-server: MODOPTS_LIBCFS= oleg323-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg323-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg323-server: oleg323-server.virtnet: executing set_default_debug -1 all pdsh@oleg323-client: oleg323-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg323-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg323-server: oleg323-server.virtnet: executing set_default_debug -1 all pdsh@oleg323-client: oleg323-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg323-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg323-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg323-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg323-server: oleg323-server.virtnet: executing set_default_debug -1 all pdsh@oleg323-client: oleg323-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg323-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg323-client.virtnet: -o user_xattr,flock 192.168.203.123@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H crush2 /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 1483 (time 1783074364.56 total 10.00 last 148.29) - open/close 3202 (time 1783074374.56 total 20.00 last 171.90) total: 4500 open/close in 28.64 seconds: 157.13 ops/second - /unlink 3379 (time 1783074395.20 total 10.00 last 337.80) total: 4500 /unlink in 13.80 seconds: 326.17 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 1690 (time 1783074411.13 total 10.00 last 169.00) - open/close 3571 (time 1783074421.14 total 20.00 last 188.06) total: 4500 open/close in 24.86 seconds: 181.01 ops/second - /unlink 3771 (time 1783074437.81 total 10.00 last 377.05) total: 4500 /unlink in 11.67 seconds: 385.45 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 2040 (time 1783074451.15 total 10.01 last 203.76) - open/close 3835 (time 1783074461.15 total 20.01 last 179.48) total: 4500 open/close in 23.30 seconds: 193.12 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 - /unlink 2466 (time 1783074476.29 total 10.00 last 246.59) total: 4500 /unlink in 16.62 seconds: 270.79 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 1546 (time 1783074494.94 total 10.00 last 154.60) - open/close 3213 (time 1783074504.95 total 20.01 last 166.60) total: 4500 open/close in 27.64 seconds: 162.82 ops/second - /unlink 3845 (time 1783074524.35 total 10.00 last 384.45) total: 4500 /unlink in 11.73 seconds: 383.56 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 1641 (time 1783074537.83 total 10.00 last 164.09) - open/close 3528 (time 1783074547.83 total 20.00 last 188.65) total: 4500 open/close in 25.90 seconds: 173.75 ops/second - /unlink 3669 (time 1783074565.62 total 10.00 last 366.87) total: 4500 /unlink in 12.40 seconds: 362.88 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 1695 (time 1783074580.01 total 10.01 last 169.41) - open/close 3293 (time 1783074590.02 total 20.02 last 159.63) total: 4500 open/close in 27.65 seconds: 162.78 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 - /unlink 3084 (time 1783074609.60 total 10.00 last 308.37) total: 4500 /unlink in 14.78 seconds: 304.57 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 1573 (time 1783074626.39 total 10.00 last 157.29) - open/close 3454 (time 1783074636.39 total 20.00 last 188.05) total: 4500 open/close in 24.44 seconds: 184.10 ops/second - /unlink 4413 (time 1783074652.51 total 10.00 last 441.22) total: 4500 /unlink in 10.16 seconds: 442.80 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 2300 (time 1783074664.26 total 10.00 last 229.97) - open/close 3980 (time 1783074674.26 total 20.00 last 167.95) total: 4500 open/close in 23.17 seconds: 194.19 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 - /unlink 3637 (time 1783074689.33 total 10.00 last 363.66) total: 4500 /unlink in 12.31 seconds: 365.63 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 1716 (time 1783074703.42 total 10.00 last 171.59) - open/close 3262 (time 1783074713.43 total 20.00 last 154.56) total: 4500 open/close in 26.60 seconds: 169.15 ops/second - /unlink 2850 (time 1783074731.97 total 10.00 last 284.87) total: 4500 /unlink in 16.09 seconds: 279.65 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 1424 (time 1783074750.05 total 10.00 last 142.37) - open/close 3028 (time 1783074760.06 total 20.01 last 160.34) total: 4500 open/close in 28.62 seconds: 157.21 ops/second - /unlink 3806 (time 1783074780.48 total 10.00 last 380.56) total: 4500 /unlink in 11.91 seconds: 377.95 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 2024 (time 1783074794.18 total 10.01 last 202.29) - open/close 3898 (time 1783074804.19 total 20.01 last 187.30) total: 4500 open/close in 23.36 seconds: 192.62 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 - /unlink 3761 (time 1783074819.30 total 10.00 last 376.06) total: 4500 /unlink in 11.88 seconds: 378.93 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 1918 (time 1783074832.75 total 10.00 last 191.77) - open/close 3759 (time 1783074842.76 total 20.01 last 184.02) total: 4500 open/close in 23.53 seconds: 191.23 ops/second total: 4500 /unlink in 7.32 seconds: 614.48 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 2346 (time 1783074866.61 total 10.00 last 234.60) total: 4500 open/close in 16.37 seconds: 274.89 ops/second total: 4500 /unlink in 7.25 seconds: 621.04 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 lustre-MDT0000: clear the changelog for cl1 to record #246998 - open/close 1896 (time 1783074893.10 total 10.00 last 189.57) total: 4500 open/close in 19.05 seconds: 236.18 ops/second - /unlink 4471 (time 1783074913.61 total 10.00 last 447.07) total: 4500 /unlink in 10.06 seconds: 447.21 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 2419 (time 1783074925.37 total 10.00 last 241.89) total: 4500 open/close in 16.66 seconds: 270.14 ops/second total: 4500 /unlink in 9.30 seconds: 484.04 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 3131 (time 1783074954.26 total 10.00 last 313.10) total: 4500 open/close in 15.69 seconds: 286.77 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 total: 4500 /unlink in 8.39 seconds: 536.32 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 2640 (time 1783074981.34 total 10.00 last 263.97) total: 4500 open/close in 15.63 seconds: 287.88 ops/second total: 4500 /unlink in 7.47 seconds: 602.56 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 2820 (time 1783075007.27 total 10.00 last 281.88) total: 4500 open/close in 15.97 seconds: 281.85 ops/second total: 4500 /unlink in 6.35 seconds: 708.76 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11242: 94397 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg323-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg323-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg323-server stop mds service on oleg323-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg323-server stop mds service on oleg323-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg323-server unloading modules via unload_modules_local on: 'oleg323-server' oleg323-server: oleg323-server.virtnet: executing unload_modules_local oleg323-server: modules unloaded.