== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 12:39:51 (1786466391) Stopping clients: oleg446-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg446-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg446-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg446-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg446-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg446-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg446-server oleg446-server: oleg446-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg446-server' oleg446-server: oleg446-server.virtnet: executing load_modules_local oleg446-server: Loading modules from /home/green/git/lustre-release/lustre oleg446-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg446-server: detected 4 online CPUs by sysfs oleg446-server: MODOPTS_LIBCFS= oleg446-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg446-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg446-server: oleg446-server.virtnet: executing set_default_debug -1 all pdsh@oleg446-client: oleg446-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg446-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg446-server: oleg446-server.virtnet: executing set_default_debug -1 all pdsh@oleg446-client: oleg446-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg446-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg446-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg446-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg446-server: oleg446-server.virtnet: executing set_default_debug -1 all pdsh@oleg446-client: oleg446-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg446-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg446-client.virtnet: -o user_xattr,flock 192.168.204.146@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H crush /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 934 (time 1786466545.53 total 10.00 last 93.36) - open/close 1861 (time 1786466555.53 total 20.00 last 92.70) - open/close 2818 (time 1786466565.54 total 30.01 last 95.65) - open/close 3654 (time 1786466575.54 total 40.01 last 83.58) total: 4500 open/close in 49.24 seconds: 91.39 ops/second - /unlink 1717 (time 1786466597.78 total 10.00 last 171.69) - /unlink 3293 (time 1786466607.79 total 20.01 last 157.51) total: 4500 /unlink in 27.80 seconds: 161.85 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 959 (time 1786466629.07 total 10.00 last 95.85) - open/close 1881 (time 1786466639.08 total 20.02 last 92.11) - open/close 2828 (time 1786466649.09 total 30.02 last 94.64) - open/close 3722 (time 1786466659.09 total 40.02 last 89.39) total: 4500 open/close in 48.24 seconds: 93.28 ops/second - /unlink 1738 (time 1786466680.11 total 10.00 last 173.75) - /unlink 3522 (time 1786466690.11 total 20.01 last 178.31) total: 4500 /unlink in 25.96 seconds: 173.32 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 952 (time 1786466709.30 total 10.01 last 95.15) - open/close 1924 (time 1786466719.30 total 20.01 last 97.18) - open/close 2894 (time 1786466729.30 total 30.01 last 97.00) - open/close 3807 (time 1786466739.30 total 40.01 last 91.27) total: 4500 open/close in 46.90 seconds: 95.96 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 - /unlink 1531 (time 1786466759.25 total 10.01 last 152.92) - /unlink 3142 (time 1786466769.25 total 20.02 last 161.04) total: 4500 /unlink in 28.96 seconds: 155.40 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 958 (time 1786466791.61 total 10.01 last 95.75) - open/close 1937 (time 1786466801.61 total 20.01 last 97.90) - open/close 2863 (time 1786466811.62 total 30.01 last 92.54) - open/close 3782 (time 1786466821.63 total 40.03 last 91.78) total: 4500 open/close in 48.04 seconds: 93.67 ops/second - /unlink 1863 (time 1786466842.71 total 10.00 last 186.24) - /unlink 3634 (time 1786466852.72 total 20.01 last 176.98) total: 4500 /unlink in 24.99 seconds: 180.10 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 984 (time 1786466870.72 total 10.01 last 98.34) - open/close 1988 (time 1786466880.73 total 20.02 last 100.28) - open/close 2945 (time 1786466890.73 total 30.02 last 95.68) - open/close 3925 (time 1786466900.74 total 40.03 last 97.95) total: 4500 open/close in 45.35 seconds: 99.22 ops/second - /unlink 1855 (time 1786466918.58 total 10.00 last 185.41) - /unlink 3674 (time 1786466928.58 total 20.01 last 181.85) total: 4500 /unlink in 23.88 seconds: 188.44 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 1081 (time 1786466945.92 total 10.01 last 108.02) - open/close 2154 (time 1786466955.92 total 20.01 last 107.30) - open/close 3251 (time 1786466965.93 total 30.02 last 109.60) - open/close 4363 (time 1786466975.94 total 40.03 last 111.08) total: 4500 open/close in 41.11 seconds: 109.46 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 - /unlink 2041 (time 1786466989.30 total 10.00 last 204.06) - /unlink 4109 (time 1786466999.30 total 20.00 last 206.79) total: 4500 /unlink in 21.67 seconds: 207.65 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 1334 (time 1786467013.26 total 10.01 last 133.33) - open/close 2358 (time 1786467023.26 total 20.01 last 102.33) - open/close 3550 (time 1786467033.26 total 30.01 last 119.19) total: 4500 open/close in 38.58 seconds: 116.65 ops/second - /unlink 2278 (time 1786467054.06 total 10.00 last 227.75) - /unlink 4408 (time 1786467064.06 total 20.01 last 212.87) total: 4500 /unlink in 20.48 seconds: 219.77 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 1090 (time 1786467077.08 total 10.00 last 108.99) - open/close 2254 (time 1786467087.08 total 20.00 last 116.37) - open/close 3536 (time 1786467097.09 total 30.01 last 128.13) total: 4500 open/close in 38.24 seconds: 117.68 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 - /unlink 2330 (time 1786467117.66 total 10.00 last 232.97) - /unlink 4425 (time 1786467127.66 total 20.00 last 209.48) total: 4500 /unlink in 20.29 seconds: 221.76 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 1263 (time 1786467140.73 total 10.01 last 126.21) - open/close 2361 (time 1786467150.73 total 20.01 last 109.76) - open/close 3518 (time 1786467160.74 total 30.02 last 115.59) total: 4500 open/close in 38.13 seconds: 118.03 ops/second - /unlink 2294 (time 1786467181.07 total 10.00 last 229.33) total: 4500 /unlink in 19.43 seconds: 231.61 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 1202 (time 1786467202.61 total 10.01 last 120.11) - open/close 2260 (time 1786467212.62 total 20.02 last 105.72) - open/close 3348 (time 1786467222.62 total 30.02 last 108.79) total: 4500 open/close in 38.71 seconds: 116.26 ops/second - /unlink 2232 (time 1786467243.75 total 10.01 last 223.09) - /unlink 4294 (time 1786467253.75 total 20.01 last 206.16) total: 4500 /unlink in 20.92 seconds: 215.06 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 1202 (time 1786467267.59 total 10.00 last 120.17) - open/close 2616 (time 1786467277.60 total 20.01 last 141.30) - open/close 3954 (time 1786467287.61 total 30.02 last 133.67) total: 4500 open/close in 34.57 seconds: 130.15 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 - /unlink 2959 (time 1786467304.27 total 10.00 last 295.86) total: 4500 /unlink in 15.50 seconds: 290.36 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 1580 (time 1786467322.20 total 10.01 last 157.92) - open/close 3057 (time 1786467332.20 total 20.01 last 147.68) - open/close 4457 (time 1786467342.20 total 30.01 last 139.97) total: 4500 open/close in 30.32 seconds: 148.42 ops/second - /unlink 2945 (time 1786467354.42 total 10.00 last 294.40) total: 4500 /unlink in 15.62 seconds: 288.07 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 1326 (time 1786467371.94 total 10.01 last 132.51) - open/close 2611 (time 1786467381.95 total 20.01 last 128.42) - open/close 3916 (time 1786467391.95 total 30.02 last 130.42) total: 4500 open/close in 33.90 seconds: 132.76 ops/second - /unlink 2692 (time 1786467407.73 total 10.00 last 269.16) total: 4500 /unlink in 16.35 seconds: 275.31 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 lustre-MDT0000: clear the changelog for cl1 to record #246998 - open/close 1618 (time 1786467426.00 total 10.00 last 161.73) - open/close 3107 (time 1786467436.00 total 20.01 last 148.89) total: 4500 open/close in 29.31 seconds: 153.52 ops/second - /unlink 3365 (time 1786467457.51 total 10.00 last 336.41) total: 4500 /unlink in 13.84 seconds: 325.18 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 1445 (time 1786467473.43 total 10.01 last 144.42) - open/close 2911 (time 1786467483.43 total 20.01 last 146.56) - open/close 4343 (time 1786467493.43 total 30.01 last 143.14) total: 4500 open/close in 31.12 seconds: 144.62 ops/second - /unlink 2624 (time 1786467506.59 total 10.00 last 262.27) total: 4500 /unlink in 16.70 seconds: 269.43 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 1753 (time 1786467525.37 total 10.00 last 175.27) - open/close 3761 (time 1786467535.37 total 20.01 last 200.67) total: 4500 open/close in 24.82 seconds: 181.33 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 - /unlink 3476 (time 1786467552.12 total 10.00 last 347.58) total: 4500 /unlink in 13.78 seconds: 326.61 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 1493 (time 1786467568.11 total 10.01 last 149.11) - open/close 3093 (time 1786467578.12 total 20.03 last 159.78) total: 4500 open/close in 29.40 seconds: 153.07 ops/second - /unlink 3387 (time 1786467599.29 total 10.00 last 338.60) total: 4500 /unlink in 12.98 seconds: 346.80 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 1797 (time 1786467614.18 total 10.00 last 179.67) - open/close 3557 (time 1786467624.18 total 20.00 last 175.96) total: 4500 open/close in 25.66 seconds: 175.36 ops/second - /unlink 2732 (time 1786467641.85 total 10.00 last 273.15) total: 4500 /unlink in 15.97 seconds: 281.71 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11316: 94719 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg446-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg446-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg446-server stop mds service on oleg446-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg446-server stop mds service on oleg446-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg446-server unloading modules via unload_modules_local on: 'oleg446-server' oleg446-server: oleg446-server.virtnet: executing unload_modules_local oleg446-server: modules unloaded.