== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 21:16:04 (1754010964) Stopping clients: oleg414-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg414-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg414-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg414-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg414-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg414-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg414-server oleg414-server: oleg414-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1024: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1025: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg414-server' oleg414-server: oleg414-server.virtnet: executing load_modules_local oleg414-server: Loading modules from /home/green/git/lustre-release/lustre oleg414-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1024: echo: write error: Device or resource busy oleg414-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1025: echo: write error: Device or resource busy oleg414-server: detected 4 online CPUs by sysfs oleg414-server: MODOPTS_LIBCFS= oleg414-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg414-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg414-server: oleg414-server.virtnet: executing set_default_debug -1 all pdsh@oleg414-client: oleg414-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg414-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg414-server: oleg414-server.virtnet: executing set_default_debug -1 all pdsh@oleg414-client: oleg414-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg414-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg414-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg414-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg414-server: oleg414-server.virtnet: executing set_default_debug -1 all pdsh@oleg414-client: oleg414-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg414-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg414-client.virtnet: -o user_xattr,flock 192.168.204.114@tcp:/lustre /mnt/lustre oleg414-client: fail_loc=0x1312 oleg414-client: fail_val=5 oleg414-server: fail_loc=0x1312 oleg414-server: fail_val=5 striped dir -i0 -c1 -H crush /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 4382 (time 1754011060.21 total 10.00 last 438.17) total: 4500 open/close in 10.30 seconds: 437.10 ops/second total: 4500 /unlink in 5.75 seconds: 782.41 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 4365 (time 1754011078.77 total 10.00 last 436.40) total: 4500 open/close in 10.41 seconds: 432.19 ops/second total: 4500 /unlink in 5.82 seconds: 773.69 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 total: 4500 open/close in 9.75 seconds: 461.33 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 total: 4500 /unlink in 5.30 seconds: 848.30 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 4307 (time 1754011114.89 total 10.00 last 430.60) total: 4500 open/close in 10.46 seconds: 430.07 ops/second total: 4500 /unlink in 5.95 seconds: 756.79 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 total: 4500 open/close in 9.97 seconds: 451.24 ops/second total: 4500 /unlink in 5.45 seconds: 826.37 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 total: 4500 open/close in 9.96 seconds: 451.79 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 total: 4500 /unlink in 5.61 seconds: 801.59 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 4104 (time 1754011169.72 total 10.00 last 410.38) total: 4500 open/close in 10.95 seconds: 410.99 ops/second total: 4500 /unlink in 5.99 seconds: 751.25 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 4268 (time 1754011189.07 total 10.00 last 426.79) total: 4500 open/close in 10.55 seconds: 426.64 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 total: 4500 /unlink in 5.99 seconds: 751.58 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 4061 (time 1754011207.97 total 10.00 last 406.04) total: 4500 open/close in 11.11 seconds: 405.13 ops/second total: 4500 /unlink in 6.01 seconds: 748.95 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 3948 (time 1754011227.46 total 10.00 last 394.72) total: 4500 open/close in 11.42 seconds: 393.91 ops/second total: 4500 /unlink in 6.32 seconds: 711.65 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 3974 (time 1754011247.63 total 10.00 last 397.40) total: 4500 open/close in 11.16 seconds: 403.22 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 total: 4500 /unlink in 5.54 seconds: 812.71 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 4205 (time 1754011266.66 total 10.00 last 420.46) total: 4500 open/close in 10.74 seconds: 419.09 ops/second total: 4500 /unlink in 6.10 seconds: 737.16 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 4239 (time 1754011285.96 total 10.03 last 422.68) total: 4500 open/close in 10.65 seconds: 422.56 ops/second total: 4500 /unlink in 5.92 seconds: 759.92 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 lustre-MDT0000: clear the changelog for cl1 to record #246998 - open/close 4404 (time 1754011305.07 total 10.00 last 440.36) total: 4500 open/close in 10.24 seconds: 439.39 ops/second total: 4500 /unlink in 5.46 seconds: 824.12 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 4108 (time 1754011323.16 total 10.00 last 410.73) total: 4500 open/close in 10.96 seconds: 410.74 ops/second total: 4500 /unlink in 6.04 seconds: 744.47 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 4251 (time 1754011342.75 total 10.00 last 425.03) total: 4500 open/close in 10.58 seconds: 425.20 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 total: 4500 /unlink in 6.37 seconds: 706.40 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 4419 (time 1754011362.26 total 10.00 last 441.87) total: 4500 open/close in 10.20 seconds: 441.21 ops/second total: 4500 /unlink in 5.40 seconds: 833.20 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 4432 (time 1754011380.39 total 10.00 last 443.13) total: 4500 open/close in 10.19 seconds: 441.47 ops/second - /unlink 3921 (time 1754011392.21 total 10.00 last 392.10) total: 4500 /unlink in 12.03 seconds: 374.19 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11149: 93143 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg414-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg414-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg414-server stop mds service on oleg414-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg414-server stop mds service on oleg414-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg414-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg414-server' oleg414-server: oleg414-server.virtnet: executing unload_modules_local oleg414-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg414-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded.