== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 13:09:46 (1774890586) Stopping clients: oleg413-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg413-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg413-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg413-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg413-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg413-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg413-server oleg413-server: oleg413-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg413-server' oleg413-server: oleg413-server.virtnet: executing load_modules_local oleg413-server: Loading modules from /home/green/git/lustre-release/lustre oleg413-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy oleg413-server: detected 4 online CPUs by sysfs oleg413-server: MODOPTS_LIBCFS= oleg413-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg413-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg413-server: oleg413-server.virtnet: executing set_default_debug -1 all pdsh@oleg413-client: oleg413-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg413-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg413-server: oleg413-server.virtnet: executing set_default_debug -1 all pdsh@oleg413-client: oleg413-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg413-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg413-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg413-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg413-server: oleg413-server.virtnet: executing set_default_debug -1 all pdsh@oleg413-client: oleg413-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg413-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg413-client.virtnet: -o user_xattr,flock 192.168.204.113@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H all_char /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 1092 (time 1774890709.04 total 10.01 last 109.14) - open/close 2088 (time 1774890719.05 total 20.02 last 99.47) - open/close 3169 (time 1774890729.06 total 30.02 last 108.04) - open/close 4134 (time 1774890739.06 total 40.03 last 96.46) total: 4500 open/close in 44.01 seconds: 102.25 ops/second - /unlink 2026 (time 1774890755.47 total 10.00 last 202.58) - /unlink 4025 (time 1774890765.47 total 20.00 last 199.87) total: 4500 /unlink in 22.41 seconds: 200.78 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 1037 (time 1774890780.18 total 10.01 last 103.63) - open/close 2256 (time 1774890790.18 total 20.01 last 121.89) - open/close 3473 (time 1774890800.19 total 30.01 last 121.63) - open/close 4486 (time 1774890810.20 total 40.03 last 101.17) total: 4500 open/close in 40.18 seconds: 112.01 ops/second - /unlink 2323 (time 1774890822.65 total 10.00 last 232.29) total: 4500 /unlink in 19.48 seconds: 231.00 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 1134 (time 1774890844.91 total 10.00 last 113.39) - open/close 2363 (time 1774890854.92 total 20.01 last 122.80) - open/close 3366 (time 1774890864.92 total 30.01 last 100.25) total: 4500 open/close in 39.52 seconds: 113.86 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 - /unlink 2447 (time 1774890886.57 total 10.00 last 244.65) total: 4500 /unlink in 19.88 seconds: 226.34 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 1055 (time 1774890908.51 total 10.00 last 105.48) - open/close 2002 (time 1774890918.52 total 20.01 last 94.60) - open/close 2923 (time 1774890928.53 total 30.02 last 92.04) - open/close 3965 (time 1774890938.53 total 40.02 last 104.17) total: 4500 open/close in 43.99 seconds: 102.29 ops/second - /unlink 2295 (time 1774890954.62 total 10.00 last 229.41) total: 4500 /unlink in 18.53 seconds: 242.89 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 1147 (time 1774890975.60 total 10.00 last 114.64) - open/close 2105 (time 1774890985.60 total 20.01 last 95.79) - open/close 3301 (time 1774890995.61 total 30.01 last 119.55) total: 4500 open/close in 38.95 seconds: 115.54 ops/second - /unlink 2135 (time 1774891016.81 total 10.00 last 213.43) - /unlink 3908 (time 1774891026.81 total 20.00 last 177.29) total: 4500 /unlink in 23.45 seconds: 191.91 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 1100 (time 1774891043.17 total 10.00 last 109.97) - open/close 2133 (time 1774891053.17 total 20.00 last 103.28) - open/close 3180 (time 1774891063.18 total 30.01 last 104.60) - open/close 4274 (time 1774891073.19 total 40.02 last 109.29) total: 4500 open/close in 41.96 seconds: 107.24 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 - /unlink 2264 (time 1774891087.31 total 10.00 last 226.39) total: 4500 /unlink in 19.70 seconds: 228.38 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 1269 (time 1774891109.85 total 10.01 last 126.79) - open/close 2600 (time 1774891119.85 total 20.01 last 133.09) - open/close 3966 (time 1774891129.85 total 30.02 last 136.50) total: 4500 open/close in 33.90 seconds: 132.76 ops/second - /unlink 2248 (time 1774891145.88 total 10.00 last 224.78) total: 4500 /unlink in 19.47 seconds: 231.08 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 1599 (time 1774891167.49 total 10.00 last 159.87) - open/close 3029 (time 1774891177.50 total 20.00 last 142.98) total: 4500 open/close in 27.61 seconds: 162.96 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 - /unlink 3847 (time 1774891196.78 total 10.00 last 384.69) total: 4500 /unlink in 11.57 seconds: 389.03 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 1697 (time 1774891210.11 total 10.00 last 169.67) - open/close 3892 (time 1774891220.12 total 20.01 last 219.39) total: 4500 open/close in 23.59 seconds: 190.76 ops/second - /unlink 3413 (time 1774891235.49 total 10.00 last 341.26) total: 4500 /unlink in 12.92 seconds: 348.21 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 1937 (time 1774891250.17 total 10.00 last 193.69) - open/close 3987 (time 1774891260.17 total 20.00 last 204.98) total: 4500 open/close in 22.45 seconds: 200.46 ops/second - /unlink 2486 (time 1774891274.69 total 10.00 last 248.57) total: 4500 /unlink in 17.14 seconds: 262.56 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 1938 (time 1774891293.76 total 10.00 last 193.79) - open/close 3833 (time 1774891303.76 total 20.00 last 189.50) total: 4500 open/close in 23.46 seconds: 191.86 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 - /unlink 3814 (time 1774891319.00 total 10.00 last 381.32) total: 4500 /unlink in 11.82 seconds: 380.58 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 1743 (time 1774891332.53 total 10.00 last 174.23) - open/close 3528 (time 1774891342.53 total 20.00 last 178.49) total: 4500 open/close in 24.76 seconds: 181.74 ops/second - /unlink 3618 (time 1774891359.03 total 10.00 last 361.75) total: 4500 /unlink in 12.29 seconds: 366.07 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 2986 (time 1774891373.04 total 10.00 last 298.56) total: 4500 open/close in 14.73 seconds: 305.41 ops/second total: 4500 /unlink in 6.89 seconds: 653.04 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 - open/close 2987 (time 1774891397.53 total 10.00 last 298.65) total: 4500 open/close in 14.64 seconds: 307.33 ops/second lustre-MDT0000: clear the changelog for cl1 to record #246998 total: 4500 /unlink in 8.11 seconds: 555.04 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 3152 (time 1774891423.11 total 10.00 last 315.13) total: 4500 open/close in 16.05 seconds: 280.43 ops/second total: 4500 /unlink in 9.26 seconds: 485.95 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 2142 (time 1774891451.49 total 10.00 last 214.16) - open/close 4494 (time 1774891461.50 total 20.00 last 235.18) total: 4500 open/close in 20.02 seconds: 224.83 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 total: 4500 /unlink in 8.02 seconds: 560.90 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 3023 (time 1774891482.30 total 10.00 last 302.30) total: 4500 open/close in 15.88 seconds: 283.45 ops/second total: 4500 /unlink in 8.99 seconds: 500.75 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 2593 (time 1774891510.25 total 10.00 last 259.29) total: 4500 open/close in 18.45 seconds: 243.94 ops/second total: 4500 /unlink in 8.98 seconds: 501.19 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11168: 93881 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg413-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg413-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg413-server stop mds service on oleg413-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg413-server stop mds service on oleg413-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg413-server unloading modules via unload_modules_local on: 'oleg413-server' oleg413-server: oleg413-server.virtnet: executing unload_modules_local oleg413-server: modules unloaded.