== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 14:01:59 (1771441319) Stopping clients: oleg255-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg255-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg255-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg255-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg255-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg255-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg255-server oleg255-server: oleg255-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy oleg255-server: detected 4 online CPUs by sysfs oleg255-server: MODOPTS_LIBCFS= oleg255-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg255-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg255-server: oleg255-server.virtnet: executing set_default_debug -1 all pdsh@oleg255-client: oleg255-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg255-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg255-server: oleg255-server.virtnet: executing set_default_debug -1 all pdsh@oleg255-client: oleg255-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg255-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg255-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg255-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg255-server: oleg255-server.virtnet: executing set_default_debug -1 all pdsh@oleg255-client: oleg255-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg255-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg255-client.virtnet: -o user_xattr,flock 192.168.202.155@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H all_char /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 1121 (time 1771441434.83 total 10.01 last 111.95) - open/close 2363 (time 1771441444.84 total 20.02 last 124.12) - open/close 3614 (time 1771441454.84 total 30.02 last 125.05) total: 4500 open/close in 35.73 seconds: 125.95 ops/second - /unlink 2932 (time 1771441472.43 total 10.00 last 293.11) total: 4500 /unlink in 15.62 seconds: 288.11 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 1586 (time 1771441489.94 total 10.00 last 158.54) - open/close 2839 (time 1771441499.95 total 20.02 last 125.12) - open/close 4119 (time 1771441509.95 total 30.02 last 127.98) total: 4500 open/close in 32.89 seconds: 136.84 ops/second - /unlink 1926 (time 1771441525.25 total 10.00 last 192.52) - /unlink 3851 (time 1771441535.25 total 20.01 last 192.43) total: 4500 /unlink in 23.35 seconds: 192.73 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 1125 (time 1771441551.30 total 10.00 last 112.50) - open/close 2507 (time 1771441561.31 total 20.01 last 138.12) - open/close 3800 (time 1771441571.31 total 30.01 last 129.24) total: 4500 open/close in 35.74 seconds: 125.93 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 - /unlink 2748 (time 1771441588.94 total 10.00 last 274.75) total: 4500 /unlink in 16.47 seconds: 273.22 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 2299 (time 1771441607.88 total 10.00 last 229.84) - open/close 3956 (time 1771441617.90 total 20.02 last 165.43) total: 4500 open/close in 24.62 seconds: 182.74 ops/second - /unlink 2205 (time 1771441634.70 total 10.01 last 220.30) - /unlink 4401 (time 1771441644.71 total 20.01 last 219.53) total: 4500 /unlink in 20.42 seconds: 220.42 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 1321 (time 1771441657.22 total 10.00 last 132.10) - open/close 2614 (time 1771441667.22 total 20.00 last 129.26) - open/close 4152 (time 1771441677.23 total 30.01 last 153.71) total: 4500 open/close in 32.64 seconds: 137.88 ops/second - /unlink 2575 (time 1771441692.11 total 10.00 last 257.49) total: 4500 /unlink in 16.10 seconds: 279.53 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 1672 (time 1771441709.97 total 10.00 last 167.18) - open/close 3010 (time 1771441719.97 total 20.00 last 133.75) total: 4500 open/close in 27.37 seconds: 164.42 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 - /unlink 2805 (time 1771441738.96 total 10.00 last 280.49) total: 4500 /unlink in 17.14 seconds: 262.48 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 1730 (time 1771441758.64 total 10.01 last 172.88) - open/close 3237 (time 1771441768.64 total 20.01 last 150.66) total: 4500 open/close in 27.63 seconds: 162.89 ops/second - /unlink 3057 (time 1771441787.96 total 10.00 last 305.68) total: 4500 /unlink in 15.75 seconds: 285.76 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 1346 (time 1771441805.86 total 10.00 last 134.58) - open/close 3022 (time 1771441815.86 total 20.00 last 167.58) total: 4500 open/close in 28.84 seconds: 156.05 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 - /unlink 4414 (time 1771441836.37 total 10.00 last 441.29) total: 4500 /unlink in 10.29 seconds: 437.48 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 2580 (time 1771441848.44 total 10.00 last 257.98) total: 4500 open/close in 15.71 seconds: 286.37 ops/second total: 4500 /unlink in 9.87 seconds: 455.88 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 3207 (time 1771441877.21 total 10.00 last 320.68) total: 4500 open/close in 14.23 seconds: 316.28 ops/second total: 4500 /unlink in 9.05 seconds: 497.29 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 1892 (time 1771441903.40 total 10.00 last 189.11) - open/close 4142 (time 1771441913.41 total 20.01 last 224.89) total: 4500 open/close in 21.90 seconds: 205.49 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 - /unlink 4246 (time 1771441927.12 total 10.00 last 424.58) total: 4500 /unlink in 10.61 seconds: 424.24 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 2613 (time 1771441939.45 total 10.00 last 261.25) total: 4500 open/close in 14.90 seconds: 301.99 ops/second total: 4500 /unlink in 6.03 seconds: 745.75 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 3534 (time 1771441963.07 total 10.00 last 353.23) total: 4500 open/close in 12.52 seconds: 359.33 ops/second total: 4500 /unlink in 6.25 seconds: 720.38 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 lustre-MDT0000: clear the changelog for cl1 to record #246998 - open/close 3345 (time 1771441984.63 total 10.00 last 334.40) total: 4500 open/close in 14.25 seconds: 315.70 ops/second - /unlink 4476 (time 1771442000.47 total 10.00 last 447.56) total: 4500 /unlink in 10.03 seconds: 448.51 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 2323 (time 1771442012.19 total 10.00 last 232.23) - open/close 4465 (time 1771442022.20 total 20.01 last 214.12) total: 4500 open/close in 20.15 seconds: 223.34 ops/second total: 4500 /unlink in 7.77 seconds: 579.16 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 1894 (time 1771442043.12 total 10.00 last 189.39) - open/close 4225 (time 1771442053.12 total 20.00 last 233.08) total: 4500 open/close in 21.20 seconds: 212.25 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 - /unlink 2916 (time 1771442066.09 total 10.00 last 291.55) total: 4500 /unlink in 15.24 seconds: 295.32 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 1901 (time 1771442083.45 total 10.01 last 189.94) - open/close 3589 (time 1771442093.46 total 20.01 last 168.76) total: 4500 open/close in 27.07 seconds: 166.22 ops/second - /unlink 2879 (time 1771442112.46 total 10.00 last 287.82) total: 4500 /unlink in 14.26 seconds: 315.63 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 1641 (time 1771442128.36 total 10.00 last 164.04) - open/close 3712 (time 1771442138.36 total 20.01 last 207.05) total: 4500 open/close in 22.92 seconds: 196.34 ops/second - /unlink 4229 (time 1771442153.15 total 10.00 last 422.82) total: 4500 /unlink in 10.74 seconds: 418.82 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11166: 93495 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg255-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg255-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg255-server stop mds service on oleg255-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg255-server stop mds service on oleg255-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg255-server unloading modules via unload_modules_local on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing unload_modules_local oleg255-server: modules unloaded.