== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 01:01:41 (1763877701) Stopping clients: oleg201-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg201-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg201-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg201-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg201-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg201-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg201-server oleg201-server: oleg201-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg201-server' oleg201-server: oleg201-server.virtnet: executing load_modules_local oleg201-server: Loading modules from /home/green/git/lustre-release/lustre oleg201-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy oleg201-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy oleg201-server: detected 4 online CPUs by sysfs oleg201-server: MODOPTS_LIBCFS= oleg201-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg201-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg201-server: oleg201-server.virtnet: executing set_default_debug -1 all pdsh@oleg201-client: oleg201-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg201-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg201-server: oleg201-server.virtnet: executing set_default_debug -1 all pdsh@oleg201-client: oleg201-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg201-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg201-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg201-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg201-server: oleg201-server.virtnet: executing set_default_debug -1 all pdsh@oleg201-client: oleg201-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg201-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg201-client.virtnet: -o user_xattr,flock 192.168.202.101@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 2397 (time 1763877814.71 total 10.00 last 239.69) total: 4500 open/close in 18.58 seconds: 242.20 ops/second total: 4500 /unlink in 8.28 seconds: 543.25 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 3262 (time 1763877844.87 total 10.00 last 326.13) total: 4500 open/close in 13.97 seconds: 322.20 ops/second total: 4500 /unlink in 8.53 seconds: 527.72 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 3044 (time 1763877871.01 total 10.00 last 304.39) total: 4500 open/close in 14.83 seconds: 303.53 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 total: 4500 /unlink in 8.96 seconds: 502.01 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 2542 (time 1763877898.70 total 10.00 last 254.13) total: 4500 open/close in 15.83 seconds: 284.19 ops/second total: 4500 /unlink in 6.07 seconds: 741.16 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 3638 (time 1763877923.99 total 10.00 last 363.70) total: 4500 open/close in 12.27 seconds: 366.64 ops/second total: 4500 /unlink in 5.74 seconds: 784.06 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 3927 (time 1763877944.62 total 10.00 last 392.64) total: 4500 open/close in 11.36 seconds: 396.17 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 total: 4500 /unlink in 6.24 seconds: 720.90 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 3480 (time 1763877965.06 total 10.00 last 347.96) total: 4500 open/close in 12.53 seconds: 359.17 ops/second total: 4500 /unlink in 6.03 seconds: 745.85 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 4125 (time 1763877986.26 total 10.00 last 412.45) total: 4500 open/close in 10.99 seconds: 409.40 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 total: 4500 /unlink in 5.96 seconds: 755.52 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 3387 (time 1763878006.01 total 10.00 last 338.68) total: 4500 open/close in 12.69 seconds: 354.60 ops/second total: 4500 /unlink in 5.66 seconds: 795.32 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 3834 (time 1763878026.98 total 10.00 last 383.34) total: 4500 open/close in 11.64 seconds: 386.61 ops/second total: 4500 /unlink in 6.35 seconds: 708.88 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 3752 (time 1763878047.52 total 10.00 last 375.16) total: 4500 open/close in 11.85 seconds: 379.63 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 total: 4500 /unlink in 5.63 seconds: 799.32 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 3793 (time 1763878067.55 total 10.02 last 378.67) total: 4500 open/close in 11.65 seconds: 386.16 ops/second total: 4500 /unlink in 6.00 seconds: 749.58 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 3972 (time 1763878087.77 total 10.00 last 397.09) total: 4500 open/close in 11.33 seconds: 397.13 ops/second total: 4500 /unlink in 5.88 seconds: 765.51 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 lustre-MDT0000: clear the changelog for cl1 to record #246998 - open/close 3697 (time 1763878107.42 total 10.00 last 369.63) total: 4500 open/close in 12.00 seconds: 375.01 ops/second total: 4500 /unlink in 6.56 seconds: 686.18 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 3399 (time 1763878128.56 total 10.00 last 339.86) total: 4500 open/close in 13.06 seconds: 344.48 ops/second total: 4500 /unlink in 6.22 seconds: 723.47 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 3694 (time 1763878150.47 total 10.03 last 368.25) total: 4500 open/close in 12.23 seconds: 367.82 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 total: 4500 /unlink in 5.99 seconds: 750.90 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 3648 (time 1763878171.71 total 10.00 last 364.73) total: 4500 open/close in 12.12 seconds: 371.41 ops/second total: 4500 /unlink in 6.16 seconds: 730.97 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 3901 (time 1763878192.57 total 10.00 last 390.08) total: 4500 open/close in 11.52 seconds: 390.47 ops/second total: 4500 /unlink in 6.58 seconds: 683.52 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11098: 93195 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg201-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg201-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg201-server stop mds service on oleg201-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg201-server stop mds service on oleg201-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg201-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg201-server' oleg201-server: oleg201-server.virtnet: executing unload_modules_local oleg201-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg201-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded.