== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 10:33:48 (1786372428) Stopping clients: oleg339-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg339-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg339-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg339-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg339-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg339-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg339-server oleg339-server: oleg339-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg339-server' oleg339-server: oleg339-server.virtnet: executing load_modules_local oleg339-server: Loading modules from /home/green/git/lustre-release/lustre oleg339-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg339-server: detected 4 online CPUs by sysfs oleg339-server: MODOPTS_LIBCFS= oleg339-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg339-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg339-server: oleg339-server.virtnet: executing set_default_debug -1 all pdsh@oleg339-client: oleg339-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg339-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg339-server: oleg339-server.virtnet: executing set_default_debug -1 all pdsh@oleg339-client: oleg339-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg339-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg339-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg339-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg339-server: oleg339-server.virtnet: executing set_default_debug -1 all pdsh@oleg339-client: oleg339-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg339-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg339-client.virtnet: -o user_xattr,flock 192.168.203.139@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H all_char /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 2843 (time 1786372548.99 total 10.00 last 284.24) total: 4500 open/close in 17.55 seconds: 256.37 ops/second - /unlink 4237 (time 1786372568.19 total 10.00 last 423.66) total: 4500 /unlink in 10.82 seconds: 415.98 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 2128 (time 1786372580.90 total 10.00 last 212.70) - open/close 4377 (time 1786372590.90 total 20.01 last 224.89) total: 4500 open/close in 20.71 seconds: 217.24 ops/second total: 4500 /unlink in 8.53 seconds: 527.75 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 2620 (time 1786372613.36 total 10.00 last 261.95) total: 4500 open/close in 17.85 seconds: 252.12 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 - /unlink 4279 (time 1786372632.83 total 10.00 last 427.87) total: 4500 /unlink in 10.62 seconds: 423.88 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 1902 (time 1786372645.25 total 10.00 last 190.15) - open/close 3879 (time 1786372655.25 total 20.01 last 197.62) total: 4500 open/close in 22.93 seconds: 196.21 ops/second total: 4500 /unlink in 8.87 seconds: 507.60 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 2828 (time 1786372680.07 total 10.00 last 282.74) total: 4500 open/close in 16.31 seconds: 275.97 ops/second total: 4500 /unlink in 8.02 seconds: 561.21 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 2737 (time 1786372707.26 total 10.00 last 273.66) total: 4500 open/close in 17.07 seconds: 263.59 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 total: 4500 /unlink in 9.59 seconds: 469.11 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 2553 (time 1786372737.12 total 10.00 last 255.24) total: 4500 open/close in 18.63 seconds: 241.48 ops/second - /unlink 3934 (time 1786372757.55 total 10.00 last 393.32) total: 4500 /unlink in 11.98 seconds: 375.75 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 2402 (time 1786372771.43 total 10.00 last 240.16) - open/close 4247 (time 1786372781.43 total 20.01 last 184.42) total: 4500 open/close in 21.56 seconds: 208.67 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 - /unlink 3788 (time 1786372794.90 total 10.00 last 378.79) total: 4500 /unlink in 11.45 seconds: 392.88 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 2552 (time 1786372807.96 total 10.00 last 255.15) total: 4500 open/close in 19.12 seconds: 235.31 ops/second - /unlink 3313 (time 1786372828.96 total 10.00 last 331.22) total: 4500 /unlink in 14.04 seconds: 320.57 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 2069 (time 1786372844.82 total 10.01 last 206.78) - open/close 4122 (time 1786372854.82 total 20.01 last 205.20) total: 4500 open/close in 21.91 seconds: 205.39 ops/second - /unlink 4204 (time 1786372868.43 total 10.00 last 420.36) total: 4500 /unlink in 10.71 seconds: 420.18 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 2924 (time 1786372880.80 total 10.00 last 292.40) total: 4500 open/close in 16.35 seconds: 275.31 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 - /unlink 1707 (time 1786372899.44 total 10.05 last 169.89) - /unlink 3378 (time 1786372909.44 total 20.05 last 167.04) total: 4500 /unlink in 26.77 seconds: 168.13 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 899 (time 1786372929.99 total 10.01 last 89.83) - open/close 1841 (time 1786372939.99 total 20.01 last 94.16) - open/close 3053 (time 1786372950.00 total 30.02 last 121.16) - open/close 4253 (time 1786372960.00 total 40.02 last 119.96) total: 4500 open/close in 42.11 seconds: 106.86 ops/second - /unlink 2692 (time 1786372974.23 total 10.00 last 269.16) total: 4500 /unlink in 17.22 seconds: 261.25 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 1176 (time 1786372993.68 total 10.00 last 117.60) - open/close 2239 (time 1786373003.69 total 20.01 last 106.14) - open/close 3416 (time 1786373013.70 total 30.02 last 117.65) total: 4500 open/close in 38.68 seconds: 116.34 ops/second - /unlink 2230 (time 1786373034.53 total 10.00 last 222.94) - /unlink 4378 (time 1786373044.54 total 20.00 last 214.76) total: 4500 /unlink in 20.56 seconds: 218.90 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 lustre-MDT0000: clear the changelog for cl1 to record #246998 - open/close 1113 (time 1786373057.59 total 10.01 last 111.23) - open/close 2384 (time 1786373067.59 total 20.01 last 127.06) - open/close 4041 (time 1786373077.60 total 30.02 last 165.60) total: 4500 open/close in 32.85 seconds: 136.98 ops/second - /unlink 3076 (time 1786373092.32 total 10.00 last 307.55) total: 4500 /unlink in 14.97 seconds: 300.68 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 1369 (time 1786373109.77 total 10.00 last 136.89) - open/close 2820 (time 1786373119.78 total 20.01 last 145.04) - open/close 4234 (time 1786373129.78 total 30.01 last 141.33) total: 4500 open/close in 31.93 seconds: 140.95 ops/second - /unlink 2774 (time 1786373143.68 total 10.00 last 277.34) total: 4500 /unlink in 16.65 seconds: 270.33 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 1372 (time 1786373162.50 total 10.01 last 137.09) - open/close 2817 (time 1786373172.50 total 20.01 last 144.41) - open/close 4366 (time 1786373182.50 total 30.02 last 154.86) total: 4500 open/close in 30.83 seconds: 145.95 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 - /unlink 3312 (time 1786373195.15 total 10.00 last 331.20) total: 4500 /unlink in 14.08 seconds: 319.52 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 1709 (time 1786373211.25 total 10.01 last 170.80) - open/close 3342 (time 1786373221.25 total 20.01 last 163.26) total: 4500 open/close in 26.25 seconds: 171.41 ops/second - /unlink 3191 (time 1786373239.37 total 10.00 last 319.08) total: 4500 /unlink in 13.67 seconds: 329.11 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 1654 (time 1786373255.11 total 10.00 last 165.38) - open/close 3137 (time 1786373265.11 total 20.01 last 148.24) total: 4500 open/close in 27.18 seconds: 165.57 ops/second - /unlink 2734 (time 1786373284.35 total 10.00 last 273.39) total: 4500 /unlink in 16.35 seconds: 275.21 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11316: 94865 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg339-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg339-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg339-server stop mds service on oleg339-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg339-server stop mds service on oleg339-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg339-server unloading modules via unload_modules_local on: 'oleg339-server' oleg339-server: oleg339-server.virtnet: executing unload_modules_local oleg339-server: modules unloaded.