== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 01:36:54 (1759815414) Stopping clients: oleg121-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg121-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg121-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg121-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg121-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg121-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg121-server oleg121-server: oleg121-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg121-server' oleg121-server: oleg121-server.virtnet: executing load_modules_local oleg121-server: Loading modules from /home/green/git/lustre-release/lustre oleg121-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg121-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy oleg121-server: detected 4 online CPUs by sysfs oleg121-server: MODOPTS_LIBCFS= oleg121-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg121-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg121-server: oleg121-server.virtnet: executing set_default_debug -1 all pdsh@oleg121-client: oleg121-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg121-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg121-server: oleg121-server.virtnet: executing set_default_debug -1 all pdsh@oleg121-client: oleg121-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg121-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg121-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg121-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg121-server: oleg121-server.virtnet: executing set_default_debug -1 all pdsh@oleg121-client: oleg121-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg121-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg121-client.virtnet: -o user_xattr,flock 192.168.201.121@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 3654 (time 1759815505.93 total 10.00 last 365.35) total: 4500 open/close in 12.38 seconds: 363.63 ops/second total: 4500 /unlink in 7.25 seconds: 621.06 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 3479 (time 1759815528.73 total 10.00 last 347.89) total: 4500 open/close in 12.68 seconds: 354.75 ops/second total: 4500 /unlink in 6.59 seconds: 683.36 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 4004 (time 1759815550.82 total 10.00 last 400.36) total: 4500 open/close in 11.18 seconds: 402.34 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 total: 4500 /unlink in 5.79 seconds: 776.90 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 4124 (time 1759815570.51 total 10.00 last 412.38) total: 4500 open/close in 11.07 seconds: 406.57 ops/second total: 4500 /unlink in 6.46 seconds: 697.10 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 3706 (time 1759815591.10 total 10.00 last 370.57) total: 4500 open/close in 11.98 seconds: 375.55 ops/second total: 4500 /unlink in 6.25 seconds: 720.53 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 3512 (time 1759815612.18 total 10.00 last 351.19) total: 4500 open/close in 12.71 seconds: 354.15 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 total: 4500 /unlink in 6.94 seconds: 648.65 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 3449 (time 1759815634.78 total 10.00 last 344.84) total: 4500 open/close in 13.20 seconds: 340.79 ops/second total: 4500 /unlink in 6.90 seconds: 652.48 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 3666 (time 1759815657.77 total 10.00 last 366.55) total: 4500 open/close in 12.01 seconds: 374.68 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 total: 4500 /unlink in 5.88 seconds: 765.78 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 4296 (time 1759815678.43 total 10.00 last 429.53) total: 4500 open/close in 10.48 seconds: 429.51 ops/second total: 4500 /unlink in 5.65 seconds: 796.79 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 4461 (time 1759815697.26 total 10.00 last 446.04) total: 4500 open/close in 10.13 seconds: 444.23 ops/second total: 4500 /unlink in 5.50 seconds: 818.88 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 4214 (time 1759815715.46 total 10.00 last 421.35) total: 4500 open/close in 10.71 seconds: 420.28 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 total: 4500 /unlink in 5.19 seconds: 866.48 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 4211 (time 1759815733.97 total 10.00 last 421.09) total: 4500 open/close in 10.70 seconds: 420.70 ops/second total: 4500 /unlink in 6.56 seconds: 685.93 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 3818 (time 1759815754.34 total 10.00 last 381.78) total: 4500 open/close in 11.77 seconds: 382.34 ops/second total: 4500 /unlink in 6.24 seconds: 721.54 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 - open/close 3772 (time 1759815775.30 total 10.00 last 377.18) total: 4500 open/close in 12.14 seconds: 370.62 ops/second lustre-MDT0000: clear the changelog for cl1 to record #246998 total: 4500 /unlink in 6.33 seconds: 711.44 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 3925 (time 1759815796.86 total 10.00 last 392.50) total: 4500 open/close in 11.43 seconds: 393.61 ops/second total: 4500 /unlink in 6.31 seconds: 712.71 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 4114 (time 1759815817.39 total 10.00 last 411.36) total: 4500 open/close in 10.99 seconds: 409.39 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 total: 4500 /unlink in 6.23 seconds: 722.14 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 3641 (time 1759815837.50 total 10.00 last 364.04) total: 4500 open/close in 13.00 seconds: 346.12 ops/second total: 4500 /unlink in 7.57 seconds: 594.78 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 2633 (time 1759815861.18 total 10.00 last 263.29) total: 4500 open/close in 16.77 seconds: 268.35 ops/second total: 4500 /unlink in 8.54 seconds: 526.78 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11154: 93361 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg121-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg121-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg121-server stop mds service on oleg121-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg121-server stop mds service on oleg121-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg121-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg121-server' oleg121-server: oleg121-server.virtnet: executing unload_modules_local oleg121-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg121-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded.