== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 10:22:35 (1761142955) Stopping clients: oleg109-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg109-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg109-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg109-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg109-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg109-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg109-server oleg109-server: oleg109-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg109-server' oleg109-server: oleg109-server.virtnet: executing load_modules_local oleg109-server: Loading modules from /home/green/git/lustre-release/lustre oleg109-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg109-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy oleg109-server: detected 4 online CPUs by sysfs oleg109-server: MODOPTS_LIBCFS= oleg109-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg109-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg109-server: oleg109-server.virtnet: executing set_default_debug -1 all pdsh@oleg109-client: oleg109-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg109-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg109-server: oleg109-server.virtnet: executing set_default_debug -1 all pdsh@oleg109-client: oleg109-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg109-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg109-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg109-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg109-server: oleg109-server.virtnet: executing set_default_debug -1 all pdsh@oleg109-client: oleg109-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg109-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg109-client.virtnet: -o user_xattr,flock 192.168.201.109@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H crush /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog - open/close 4256 (time 1761143054.95 total 10.00 last 425.53) total: 4500 open/close in 10.57 seconds: 425.59 ops/second lustre-MDT0000: clear the changelog for cl1 to record #12998 total: 4500 /unlink in 6.06 seconds: 742.70 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 3991 (time 1761143074.49 total 10.00 last 399.06) total: 4500 open/close in 11.27 seconds: 399.34 ops/second total: 4500 /unlink in 6.02 seconds: 747.26 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 4113 (time 1761143094.71 total 10.00 last 411.24) total: 4500 open/close in 10.91 seconds: 412.60 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 total: 4500 /unlink in 5.76 seconds: 781.45 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 4318 (time 1761143114.03 total 10.00 last 431.71) total: 4500 open/close in 10.42 seconds: 431.70 ops/second total: 4500 /unlink in 6.03 seconds: 746.48 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 4309 (time 1761143133.20 total 10.00 last 430.86) total: 4500 open/close in 10.50 seconds: 428.58 ops/second total: 4500 /unlink in 5.76 seconds: 781.59 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 4280 (time 1761143152.06 total 10.00 last 427.97) total: 4500 open/close in 10.52 seconds: 427.93 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 total: 4500 /unlink in 5.80 seconds: 775.90 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 4134 (time 1761143171.23 total 10.00 last 413.32) total: 4500 open/close in 10.83 seconds: 415.55 ops/second total: 4500 /unlink in 5.75 seconds: 782.46 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 4365 (time 1761143190.58 total 10.00 last 436.39) total: 4500 open/close in 10.40 seconds: 432.84 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 total: 4500 /unlink in 5.82 seconds: 773.49 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 4238 (time 1761143209.64 total 10.00 last 423.71) total: 4500 open/close in 10.68 seconds: 421.41 ops/second total: 4500 /unlink in 5.69 seconds: 790.21 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 4177 (time 1761143228.82 total 10.00 last 417.69) total: 4500 open/close in 10.80 seconds: 416.54 ops/second total: 4500 /unlink in 6.06 seconds: 742.99 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 4231 (time 1761143248.42 total 10.00 last 423.08) total: 4500 open/close in 10.62 seconds: 423.69 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 total: 4500 /unlink in 5.95 seconds: 756.12 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 4263 (time 1761143267.58 total 10.00 last 426.22) total: 4500 open/close in 10.55 seconds: 426.66 ops/second total: 4500 /unlink in 5.68 seconds: 792.54 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 4228 (time 1761143286.53 total 10.00 last 422.76) total: 4500 open/close in 10.63 seconds: 423.35 ops/second total: 4500 /unlink in 6.20 seconds: 726.01 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 - open/close 4252 (time 1761143306.17 total 10.00 last 425.16) total: 4500 open/close in 10.59 seconds: 425.08 ops/second lustre-MDT0000: clear the changelog for cl1 to record #246998 total: 4500 /unlink in 5.71 seconds: 788.06 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 4304 (time 1761143325.13 total 10.00 last 430.37) total: 4500 open/close in 10.45 seconds: 430.50 ops/second total: 4500 /unlink in 5.95 seconds: 756.93 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 4077 (time 1761143344.27 total 10.00 last 407.66) total: 4500 open/close in 11.01 seconds: 408.72 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 total: 4500 /unlink in 5.92 seconds: 760.04 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 4201 (time 1761143363.77 total 10.00 last 420.08) total: 4500 open/close in 10.77 seconds: 418.00 ops/second total: 4500 /unlink in 5.91 seconds: 761.72 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 3138 (time 1761143383.29 total 10.00 last 313.75) total: 4500 open/close in 13.77 seconds: 326.68 ops/second total: 4500 /unlink in 6.55 seconds: 686.98 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11102: 93240 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg109-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg109-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg109-server stop mds service on oleg109-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg109-server stop mds service on oleg109-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg109-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg109-server' oleg109-server: oleg109-server.virtnet: executing unload_modules_local oleg109-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg109-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded.