== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 09:40:11 (1773236411) Stopping clients: oleg438-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg438-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg438-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg438-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg438-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg438-server oleg438-server: oleg438-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg438-server' oleg438-server: oleg438-server.virtnet: executing load_modules_local oleg438-server: Loading modules from /home/green/git/lustre-release/lustre oleg438-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy oleg438-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy oleg438-server: detected 4 online CPUs by sysfs oleg438-server: MODOPTS_LIBCFS= oleg438-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg438-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg438-server: oleg438-server.virtnet: executing set_default_debug -1 all pdsh@oleg438-client: oleg438-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 oleg438-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg438-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg438-server: oleg438-server.virtnet: executing set_default_debug -1 all pdsh@oleg438-client: oleg438-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg438-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg438-client.virtnet: -o user_xattr,flock 192.168.204.138@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl1' Wrap arround changelog catalog - open/close 2653 (time 1773236496.55 total 10.00 last 265.27) total: 4500 open/close in 17.44 seconds: 258.01 ops/second lustre-MDT0000: clear the changelog for cl1 to record #12998 total: 4500 /unlink in 9.37 seconds: 480.27 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 2173 (time 1773236526.50 total 10.01 last 217.18) - open/close 4282 (time 1773236536.50 total 20.01 last 210.90) total: 4500 open/close in 20.90 seconds: 215.28 ops/second - /unlink 4201 (time 1773236548.97 total 10.00 last 420.07) total: 4500 /unlink in 10.64 seconds: 423.09 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 3154 (time 1773236561.19 total 10.00 last 315.25) total: 4500 open/close in 13.47 seconds: 334.05 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 total: 4500 /unlink in 7.47 seconds: 602.73 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 1650 (time 1773236585.20 total 10.01 last 164.88) - open/close 3603 (time 1773236595.20 total 20.01 last 195.27) total: 4500 open/close in 25.05 seconds: 179.68 ops/second - /unlink 3582 (time 1773236612.03 total 10.00 last 358.19) total: 4500 /unlink in 12.82 seconds: 350.95 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 2064 (time 1773236626.71 total 10.00 last 206.37) - open/close 4184 (time 1773236636.72 total 20.01 last 211.92) total: 4500 open/close in 21.40 seconds: 210.28 ops/second - /unlink 4053 (time 1773236649.88 total 10.00 last 405.26) total: 4500 /unlink in 10.71 seconds: 420.27 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 3073 (time 1773236662.22 total 10.00 last 307.26) total: 4500 open/close in 14.25 seconds: 315.73 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 total: 4500 /unlink in 7.99 seconds: 563.40 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 3284 (time 1773236687.33 total 10.00 last 328.33) total: 4500 open/close in 14.25 seconds: 315.87 ops/second total: 4500 /unlink in 7.89 seconds: 570.01 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 3500 (time 1773236712.37 total 10.00 last 349.98) total: 4500 open/close in 12.68 seconds: 354.87 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 total: 4500 /unlink in 6.87 seconds: 655.34 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 3431 (time 1773236734.79 total 10.00 last 343.05) total: 4500 open/close in 13.41 seconds: 335.67 ops/second total: 4500 /unlink in 6.77 seconds: 664.49 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 3688 (time 1773236757.83 total 10.00 last 368.71) total: 4500 open/close in 12.18 seconds: 369.33 ops/second total: 4500 /unlink in 7.29 seconds: 617.04 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 2175 (time 1773236780.23 total 10.00 last 217.46) total: 4500 open/close in 19.16 seconds: 234.85 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 total: 4500 /unlink in 6.86 seconds: 655.61 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 2975 (time 1773236809.13 total 10.00 last 297.39) total: 4500 open/close in 15.20 seconds: 296.14 ops/second total: 4500 /unlink in 6.48 seconds: 693.96 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 2148 (time 1773236833.69 total 10.00 last 214.77) total: 4500 open/close in 16.71 seconds: 269.32 ops/second total: 4500 /unlink in 8.36 seconds: 538.50 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 lustre-MDT0000: clear the changelog for cl1 to record #246998 - open/close 2830 (time 1773236861.76 total 10.00 last 282.92) total: 4500 open/close in 15.51 seconds: 290.10 ops/second total: 4500 /unlink in 6.03 seconds: 745.95 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 3459 (time 1773236885.94 total 10.00 last 345.88) total: 4500 open/close in 13.13 seconds: 342.67 ops/second total: 4500 /unlink in 7.04 seconds: 639.00 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 3361 (time 1773236909.02 total 10.00 last 336.09) total: 4500 open/close in 13.32 seconds: 337.86 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 total: 4500 /unlink in 9.01 seconds: 499.54 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 2692 (time 1773236934.18 total 10.00 last 269.15) total: 4500 open/close in 17.76 seconds: 253.38 ops/second total: 4500 /unlink in 9.40 seconds: 478.60 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 3886 (time 1773236964.32 total 10.00 last 388.58) total: 4500 open/close in 11.48 seconds: 391.97 ops/second total: 4500 /unlink in 5.96 seconds: 754.87 ops/second lustre-MDT0000: clear the changelog for cl1 to record #324998 - open/close 3844 (time 1773236984.44 total 10.00 last 384.34) total: 4500 open/close in 11.61 seconds: 387.49 ops/second lustre-MDT0000: clear the changelog for cl1 to record #337998 total: 4500 /unlink in 5.97 seconds: 753.82 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11098: 74142 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg438-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg438-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg438-server stop mds service on oleg438-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg438-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg438-server' oleg438-server: oleg438-server.virtnet: executing unload_modules_local oleg438-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg438-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded.