== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 22:33:48 (1761964428) Stopping clients: oleg349-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg349-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg349-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg349-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg349-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg349-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg349-server oleg349-server: oleg349-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg349-server' oleg349-server: oleg349-server.virtnet: executing load_modules_local oleg349-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy oleg349-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy oleg349-server: Loading modules from /home/green/git/lustre-release/lustre oleg349-server: detected 4 online CPUs by sysfs oleg349-server: MODOPTS_LIBCFS= oleg349-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg349-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg349-server: oleg349-server.virtnet: executing set_default_debug -1 all pdsh@oleg349-client: oleg349-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg349-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg349-server: oleg349-server.virtnet: executing set_default_debug -1 all pdsh@oleg349-client: oleg349-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg349-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg349-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg349-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg349-server: oleg349-server.virtnet: executing set_default_debug -1 all pdsh@oleg349-client: oleg349-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg349-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg349-client.virtnet: -o user_xattr,flock 192.168.203.149@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H all_char /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog - open/close 4087 (time 1761964529.47 total 10.00 last 408.67) total: 4500 open/close in 11.01 seconds: 408.79 ops/second lustre-MDT0000: clear the changelog for cl1 to record #12998 total: 4500 /unlink in 5.88 seconds: 765.45 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 4212 (time 1761964549.07 total 10.00 last 421.19) total: 4500 open/close in 10.70 seconds: 420.43 ops/second total: 4500 /unlink in 5.78 seconds: 778.52 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 4226 (time 1761964568.21 total 10.00 last 422.59) total: 4500 open/close in 10.66 seconds: 422.25 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 total: 4500 /unlink in 5.67 seconds: 794.05 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 4265 (time 1761964587.13 total 10.00 last 426.45) total: 4500 open/close in 10.61 seconds: 424.08 ops/second total: 4500 /unlink in 5.82 seconds: 772.90 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 4113 (time 1761964606.21 total 10.00 last 411.27) total: 4500 open/close in 10.94 seconds: 411.39 ops/second total: 4500 /unlink in 5.88 seconds: 765.70 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 4117 (time 1761964625.71 total 10.00 last 411.62) total: 4500 open/close in 11.04 seconds: 407.49 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 total: 4500 /unlink in 5.90 seconds: 762.96 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 4160 (time 1761964645.31 total 10.00 last 415.96) total: 4500 open/close in 10.85 seconds: 414.91 ops/second total: 4500 /unlink in 5.93 seconds: 759.04 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 3991 (time 1761964664.70 total 10.00 last 399.08) total: 4500 open/close in 11.28 seconds: 398.97 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 total: 4500 /unlink in 5.93 seconds: 758.71 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 3571 (time 1761964684.60 total 10.00 last 357.03) total: 4500 open/close in 12.79 seconds: 351.71 ops/second total: 4500 /unlink in 6.02 seconds: 748.04 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 4160 (time 1761964706.08 total 10.00 last 415.95) total: 4500 open/close in 10.94 seconds: 411.25 ops/second total: 4500 /unlink in 5.99 seconds: 751.88 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 3854 (time 1761964725.67 total 10.00 last 385.33) total: 4500 open/close in 11.77 seconds: 382.22 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 total: 4500 /unlink in 6.07 seconds: 740.76 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 3944 (time 1761964746.16 total 10.00 last 394.31) total: 4500 open/close in 11.53 seconds: 390.26 ops/second total: 4500 /unlink in 7.01 seconds: 641.55 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 3950 (time 1761964767.36 total 10.00 last 394.92) total: 4500 open/close in 11.43 seconds: 393.65 ops/second total: 4500 /unlink in 6.96 seconds: 646.24 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 - open/close 4159 (time 1761964788.27 total 10.00 last 415.81) total: 4500 open/close in 10.87 seconds: 414.01 ops/second lustre-MDT0000: clear the changelog for cl1 to record #246998 total: 4500 /unlink in 5.80 seconds: 775.40 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 4088 (time 1761964807.42 total 10.04 last 407.28) total: 4500 open/close in 11.06 seconds: 406.89 ops/second total: 4500 /unlink in 6.54 seconds: 687.79 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 4046 (time 1761964827.56 total 10.00 last 404.55) total: 4500 open/close in 11.09 seconds: 405.81 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 total: 4500 /unlink in 5.78 seconds: 778.11 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 4251 (time 1761964847.00 total 10.00 last 425.01) total: 4500 open/close in 10.59 seconds: 424.87 ops/second total: 4500 /unlink in 5.83 seconds: 771.53 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 4180 (time 1761964866.01 total 10.00 last 417.95) total: 4500 open/close in 10.79 seconds: 417.14 ops/second total: 4500 /unlink in 6.20 seconds: 725.71 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11090: 91869 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg349-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg349-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg349-server stop mds service on oleg349-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg349-server stop mds service on oleg349-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg349-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg349-server' oleg349-server: oleg349-server.virtnet: executing unload_modules_local oleg349-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg349-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded.