== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 07:50:38 (1750593038) Stopping clients: oleg401-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg401-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg401-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg401-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg401-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg401-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg401-server oleg401-server: oleg401-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory loading modules on: 'oleg401-server' oleg401-server: oleg401-server.virtnet: executing load_modules_local oleg401-server: Loading modules from /home/green/git/lustre-release/lustre oleg401-server: detected 4 online CPUs by sysfs oleg401-server: MODOPTS_LIBCFS= oleg401-server: Force libcfs to create 2 CPU partitions oleg401-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg401-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg401-server: oleg401-server.virtnet: executing set_default_debug -1 all pdsh@oleg401-client: oleg401-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg401-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg401-server: oleg401-server.virtnet: executing set_default_debug -1 all pdsh@oleg401-client: oleg401-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg401-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg401-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg401-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg401-server: oleg401-server.virtnet: executing set_default_debug -1 all pdsh@oleg401-client: oleg401-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg401-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg401-client.virtnet: -o user_xattr,flock 192.168.204.101@tcp:/lustre /mnt/lustre oleg401-client: fail_loc=0x1312 oleg401-client: fail_val=5 oleg401-server: fail_loc=0x1312 oleg401-server: fail_val=5 striped dir -i0 -c1 -H crush2 /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 1241 (time 1750593159.38 total 10.00 last 124.06) - open/close 2427 (time 1750593169.39 total 20.01 last 118.52) - open/close 3740 (time 1750593179.39 total 30.01 last 131.25) total: 4500 open/close in 36.74 seconds: 122.48 ops/second - /unlink 1876 (time 1750593198.46 total 10.00 last 187.54) - /unlink 4132 (time 1750593208.46 total 20.01 last 225.47) total: 4500 /unlink in 21.52 seconds: 209.08 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 1196 (time 1750593222.22 total 10.01 last 119.48) - open/close 2410 (time 1750593232.23 total 20.01 last 121.38) - open/close 3644 (time 1750593242.23 total 30.01 last 123.38) total: 4500 open/close in 36.69 seconds: 122.65 ops/second - /unlink 2221 (time 1750593260.72 total 10.00 last 222.04) - /unlink 4222 (time 1750593270.72 total 20.00 last 200.09) total: 4500 /unlink in 21.49 seconds: 209.40 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 1078 (time 1750593284.27 total 10.00 last 107.78) - open/close 2365 (time 1750593294.28 total 20.01 last 128.66) - open/close 3567 (time 1750593304.28 total 30.01 last 120.18) total: 4500 open/close in 38.16 seconds: 117.91 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 - /unlink 2096 (time 1750593324.33 total 10.00 last 209.59) - /unlink 4034 (time 1750593334.33 total 20.01 last 193.69) total: 4500 /unlink in 22.49 seconds: 200.12 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 1246 (time 1750593349.06 total 10.01 last 124.43) - open/close 2440 (time 1750593359.07 total 20.02 last 119.37) - open/close 3735 (time 1750593369.07 total 30.02 last 129.49) total: 4500 open/close in 35.64 seconds: 126.28 ops/second - /unlink 2414 (time 1750593386.63 total 10.00 last 241.37) total: 4500 /unlink in 17.95 seconds: 250.70 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 1154 (time 1750593406.30 total 10.01 last 115.34) - open/close 2369 (time 1750593416.31 total 20.01 last 121.42) - open/close 3544 (time 1750593426.32 total 30.02 last 117.43) total: 4500 open/close in 38.27 seconds: 117.58 ops/second - /unlink 1976 (time 1750593446.65 total 10.01 last 197.49) - /unlink 4144 (time 1750593456.65 total 20.01 last 216.78) total: 4500 /unlink in 21.58 seconds: 208.51 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 1261 (time 1750593470.10 total 10.01 last 126.02) - open/close 2463 (time 1750593480.12 total 20.03 last 119.92) - open/close 3558 (time 1750593490.13 total 30.03 last 109.45) total: 4500 open/close in 38.01 seconds: 118.40 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 - /unlink 2216 (time 1750593510.42 total 10.01 last 221.47) - /unlink 4250 (time 1750593520.42 total 20.01 last 203.40) total: 4500 /unlink in 20.99 seconds: 214.43 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 1319 (time 1750593533.72 total 10.00 last 131.87) - open/close 2662 (time 1750593543.73 total 20.01 last 134.22) - open/close 3795 (time 1750593553.73 total 30.01 last 113.27) total: 4500 open/close in 35.71 seconds: 126.01 ops/second - /unlink 1971 (time 1750593571.79 total 10.00 last 197.08) - /unlink 3945 (time 1750593581.80 total 20.01 last 197.28) total: 4500 /unlink in 23.16 seconds: 194.30 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 1072 (time 1750593596.96 total 10.00 last 107.15) - open/close 2134 (time 1750593606.97 total 20.01 last 106.15) - open/close 3173 (time 1750593616.98 total 30.02 last 103.74) - open/close 4427 (time 1750593626.99 total 40.03 last 125.29) total: 4500 open/close in 40.61 seconds: 110.80 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 - /unlink 1935 (time 1750593639.63 total 10.00 last 193.44) - /unlink 3872 (time 1750593649.64 total 20.01 last 193.65) total: 4500 /unlink in 22.90 seconds: 196.53 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 1142 (time 1750593664.31 total 10.00 last 114.20) - open/close 2364 (time 1750593674.31 total 20.00 last 122.19) - open/close 3493 (time 1750593684.31 total 30.00 last 112.88) total: 4500 open/close in 39.01 seconds: 115.35 ops/second - /unlink 2012 (time 1750593705.22 total 10.00 last 201.17) - /unlink 3778 (time 1750593715.22 total 20.00 last 176.58) total: 4500 /unlink in 23.47 seconds: 191.74 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 1136 (time 1750593730.63 total 10.01 last 113.52) - open/close 2262 (time 1750593740.64 total 20.02 last 112.46) - open/close 3443 (time 1750593750.66 total 30.03 last 117.95) total: 4500 open/close in 38.25 seconds: 117.64 ops/second - /unlink 2144 (time 1750593770.92 total 10.00 last 214.35) total: 4500 /unlink in 19.72 seconds: 228.24 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 1131 (time 1750593792.66 total 10.01 last 113.03) - open/close 2244 (time 1750593802.66 total 20.01 last 111.27) - open/close 3316 (time 1750593812.67 total 30.01 last 107.15) - open/close 4457 (time 1750593822.67 total 40.02 last 114.06) total: 4500 open/close in 40.41 seconds: 111.37 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 - /unlink 2252 (time 1750593835.11 total 10.01 last 225.05) total: 4500 /unlink in 19.85 seconds: 226.66 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 1197 (time 1750593856.80 total 10.01 last 119.59) - open/close 2490 (time 1750593866.81 total 20.02 last 129.20) - open/close 3767 (time 1750593876.82 total 30.02 last 127.60) total: 4500 open/close in 35.70 seconds: 126.04 ops/second - /unlink 2764 (time 1750593894.28 total 10.00 last 276.35) total: 4500 /unlink in 16.66 seconds: 270.13 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 1495 (time 1750593912.42 total 10.01 last 149.41) - open/close 3000 (time 1750593922.43 total 20.01 last 150.44) - open/close 4313 (time 1750593932.43 total 30.01 last 131.29) total: 4500 open/close in 31.33 seconds: 143.62 ops/second - /unlink 2652 (time 1750593945.45 total 10.00 last 265.15) total: 4500 /unlink in 18.19 seconds: 247.34 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 lustre-MDT0000: clear the changelog for cl1 to record #246998 - open/close 1193 (time 1750593965.81 total 10.00 last 119.27) - open/close 2601 (time 1750593975.82 total 20.01 last 140.66) - open/close 3983 (time 1750593985.82 total 30.01 last 138.17) total: 4500 open/close in 34.09 seconds: 132.01 ops/second - /unlink 2491 (time 1750594001.45 total 10.00 last 249.09) total: 4500 /unlink in 17.87 seconds: 251.86 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 1213 (time 1750594021.26 total 10.01 last 121.24) - open/close 2442 (time 1750594031.26 total 20.01 last 122.85) - open/close 3719 (time 1750594041.27 total 30.01 last 127.64) total: 4500 open/close in 36.42 seconds: 123.54 ops/second - /unlink 2082 (time 1750594059.64 total 10.00 last 208.15) total: 4500 /unlink in 19.76 seconds: 227.76 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 1315 (time 1750594080.99 total 10.00 last 131.50) - open/close 2750 (time 1750594090.99 total 20.00 last 143.44) - open/close 4183 (time 1750594101.00 total 30.01 last 143.22) total: 4500 open/close in 32.27 seconds: 139.44 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 - /unlink 2826 (time 1750594114.90 total 10.00 last 282.51) total: 4500 /unlink in 17.71 seconds: 254.06 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 1308 (time 1750594134.61 total 10.00 last 130.76) - open/close 2626 (time 1750594144.61 total 20.00 last 131.79) - open/close 3908 (time 1750594154.62 total 30.01 last 128.06) total: 4500 open/close in 34.55 seconds: 130.25 ops/second - /unlink 2135 (time 1750594171.04 total 10.00 last 213.43) total: 4500 /unlink in 19.80 seconds: 227.30 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 1189 (time 1750594192.53 total 10.02 last 118.67) - open/close 2473 (time 1750594202.54 total 20.03 last 128.31) - open/close 3819 (time 1750594212.54 total 30.03 last 134.58) total: 4500 open/close in 35.51 seconds: 126.71 ops/second - /unlink 2279 (time 1750594230.11 total 10.00 last 227.90) total: 4500 /unlink in 19.35 seconds: 232.52 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11149: 31810 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg401-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg401-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg401-server stop mds service on oleg401-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg401-server stop mds service on oleg401-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg401-server unloading modules via unload_modules_local on: 'oleg401-server' oleg401-server: oleg401-server.virtnet: executing unload_modules_local modules unloaded.