== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 11:40:35 (1783352435) Stopping clients: oleg111-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg111-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg111-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg111-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg111-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg111-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg111-server oleg111-server: oleg111-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg111-server' oleg111-server: oleg111-server.virtnet: executing load_modules_local oleg111-server: Loading modules from /home/green/git/lustre-release/lustre oleg111-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg111-server: detected 4 online CPUs by sysfs oleg111-server: MODOPTS_LIBCFS= oleg111-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg111-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg111-server: oleg111-server.virtnet: executing set_default_debug -1 all pdsh@oleg111-client: oleg111-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg111-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg111-server: oleg111-server.virtnet: executing set_default_debug -1 all pdsh@oleg111-client: oleg111-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg111-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg111-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg111-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg111-server: oleg111-server.virtnet: executing set_default_debug -1 all pdsh@oleg111-client: oleg111-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg111-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg111-client.virtnet: -o user_xattr,flock 192.168.201.111@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H all_char /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 1565 (time 1783352549.01 total 10.00 last 156.50) - open/close 3245 (time 1783352559.01 total 20.00 last 167.96) total: 4500 open/close in 27.04 seconds: 166.41 ops/second - /unlink 4097 (time 1783352577.94 total 10.00 last 409.70) total: 4500 /unlink in 11.13 seconds: 404.39 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 1551 (time 1783352591.04 total 10.00 last 155.09) - open/close 3528 (time 1783352601.05 total 20.00 last 197.69) total: 4500 open/close in 23.51 seconds: 191.45 ops/second - /unlink 3973 (time 1783352616.20 total 10.00 last 397.28) total: 4500 /unlink in 11.15 seconds: 403.68 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 2263 (time 1783352629.03 total 10.00 last 226.27) total: 4500 open/close in 19.65 seconds: 229.02 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 total: 4500 /unlink in 8.90 seconds: 505.39 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 2934 (time 1783352660.58 total 10.00 last 293.34) total: 4500 open/close in 13.98 seconds: 322.00 ops/second total: 4500 /unlink in 9.06 seconds: 496.89 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 2203 (time 1783352686.48 total 10.00 last 220.27) - open/close 3920 (time 1783352696.48 total 20.00 last 171.66) total: 4500 open/close in 22.48 seconds: 200.14 ops/second - /unlink 3711 (time 1783352710.63 total 10.00 last 370.96) total: 4500 /unlink in 12.44 seconds: 361.66 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 1845 (time 1783352724.83 total 10.00 last 184.47) - open/close 3886 (time 1783352734.83 total 20.00 last 204.08) total: 4500 open/close in 22.78 seconds: 197.58 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 - /unlink 4258 (time 1783352749.23 total 10.00 last 425.74) total: 4500 /unlink in 10.69 seconds: 421.10 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 1792 (time 1783352761.67 total 10.00 last 179.12) - open/close 4033 (time 1783352771.67 total 20.01 last 223.97) total: 4500 open/close in 21.94 seconds: 205.14 ops/second total: 4500 /unlink in 8.17 seconds: 550.75 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 3679 (time 1783352794.82 total 10.00 last 367.81) total: 4500 open/close in 12.45 seconds: 361.34 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 total: 4500 /unlink in 5.72 seconds: 786.38 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 3046 (time 1783352815.82 total 10.00 last 304.53) total: 4500 open/close in 14.97 seconds: 300.55 ops/second total: 4500 /unlink in 6.14 seconds: 733.12 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 2708 (time 1783352839.72 total 10.00 last 270.77) total: 4500 open/close in 14.96 seconds: 300.72 ops/second total: 4500 /unlink in 6.39 seconds: 704.26 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 3209 (time 1783352863.85 total 10.00 last 320.87) total: 4500 open/close in 14.57 seconds: 308.93 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 total: 4500 /unlink in 8.72 seconds: 515.82 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 2993 (time 1783352890.17 total 10.01 last 299.15) total: 4500 open/close in 14.61 seconds: 307.93 ops/second total: 4500 /unlink in 7.85 seconds: 573.16 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 2426 (time 1783352915.55 total 10.01 last 242.45) total: 4500 open/close in 18.25 seconds: 246.55 ops/second total: 4500 /unlink in 8.16 seconds: 551.38 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 - open/close 2886 (time 1783352944.90 total 10.00 last 288.53) total: 4500 open/close in 16.28 seconds: 276.41 ops/second lustre-MDT0000: clear the changelog for cl1 to record #246998 total: 4500 /unlink in 7.12 seconds: 632.47 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 3291 (time 1783352971.24 total 10.00 last 329.08) total: 4500 open/close in 13.93 seconds: 323.01 ops/second total: 4500 /unlink in 7.86 seconds: 572.77 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 3709 (time 1783352995.98 total 10.00 last 370.90) total: 4500 open/close in 12.17 seconds: 369.62 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 total: 4500 /unlink in 7.71 seconds: 583.37 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 3707 (time 1783353018.78 total 10.00 last 370.59) total: 4500 open/close in 12.67 seconds: 355.06 ops/second total: 4500 /unlink in 6.43 seconds: 699.59 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 3637 (time 1783353040.62 total 10.00 last 363.63) total: 4500 open/close in 12.57 seconds: 358.06 ops/second total: 4500 /unlink in 5.65 seconds: 796.17 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11242: 94457 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg111-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg111-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg111-server stop mds service on oleg111-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg111-server stop mds service on oleg111-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg111-server unloading modules via unload_modules_local on: 'oleg111-server' oleg111-server: oleg111-server.virtnet: executing unload_modules_local oleg111-server: modules unloaded.