== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 01:57:33 (1789797453) Stopping clients: oleg420-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg420-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg420-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg420-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg420-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg420-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg420-server oleg420-server: oleg420-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg420-server' oleg420-server: oleg420-server.virtnet: executing load_modules_local oleg420-server: kmemleak disabled oleg420-server: Loading modules from /home/green/git/lustre-release/lustre oleg420-server: detected 4 online CPUs by sysfs oleg420-server: MODOPTS_LIBCFS= oleg420-server: Force libcfs to create 2 CPU partitions oleg420-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg420-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg420-server: oleg420-server.virtnet: executing set_default_debug -1 all pdsh@oleg420-client: oleg420-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg420-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg420-server: oleg420-server.virtnet: executing set_default_debug -1 all pdsh@oleg420-client: oleg420-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg420-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg420-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg420-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg420-server: oleg420-server.virtnet: executing set_default_debug -1 all pdsh@oleg420-client: oleg420-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg420-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg420-client.virtnet: -o user_xattr,flock 192.168.204.120@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H all_char /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 3054 (time 1789797550.96 total 10.00 last 305.38) total: 4500 open/close in 14.50 seconds: 310.40 ops/second total: 4500 /unlink in 6.68 seconds: 673.56 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 3754 (time 1789797575.03 total 10.00 last 375.38) total: 4500 open/close in 12.01 seconds: 374.60 ops/second total: 4500 /unlink in 5.77 seconds: 779.66 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 4055 (time 1789797595.56 total 10.00 last 405.45) total: 4500 open/close in 11.19 seconds: 401.98 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 total: 4500 /unlink in 6.86 seconds: 655.90 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 1506 (time 1789797616.52 total 10.00 last 150.55) - open/close 2265 (time 1789797626.52 total 20.01 last 75.89) - open/close 2993 (time 1789797636.53 total 30.01 last 72.73) - open/close 3765 (time 1789797646.53 total 40.02 last 77.18) - open/close 4479 (time 1789797656.54 total 50.02 last 71.38) total: 4500 open/close in 50.18 seconds: 89.69 ops/second - /unlink 1620 (time 1789797670.53 total 10.00 last 161.93) - /unlink 3198 (time 1789797680.53 total 20.01 last 157.78) total: 4500 /unlink in 29.03 seconds: 155.02 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 855 (time 1789797702.92 total 10.00 last 85.47) - open/close 1743 (time 1789797712.93 total 20.01 last 88.78) - open/close 2621 (time 1789797722.93 total 30.01 last 87.78) - open/close 3579 (time 1789797732.93 total 40.01 last 95.76) total: 4500 open/close in 49.43 seconds: 91.03 ops/second - /unlink 2203 (time 1789797754.69 total 10.00 last 220.26) - /unlink 4466 (time 1789797764.70 total 20.00 last 226.26) total: 4500 /unlink in 20.15 seconds: 223.28 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 1172 (time 1789797777.38 total 10.01 last 117.13) - open/close 2193 (time 1789797787.39 total 20.01 last 102.03) - open/close 3150 (time 1789797797.40 total 30.02 last 95.63) - open/close 4080 (time 1789797807.41 total 40.03 last 92.92) total: 4500 open/close in 44.65 seconds: 100.78 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 - /unlink 1978 (time 1789797824.56 total 10.00 last 197.74) total: 4500 /unlink in 18.99 seconds: 237.02 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 999 (time 1789797845.49 total 10.01 last 99.84) - open/close 2023 (time 1789797855.50 total 20.01 last 102.31) - open/close 2929 (time 1789797865.51 total 30.03 last 90.50) - open/close 3835 (time 1789797875.51 total 40.03 last 90.60) total: 4500 open/close in 46.48 seconds: 96.81 ops/second - /unlink 1772 (time 1789797894.56 total 10.00 last 177.19) - /unlink 3572 (time 1789797904.56 total 20.01 last 179.89) total: 4500 /unlink in 24.74 seconds: 181.92 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 970 (time 1789797921.85 total 10.00 last 96.99) - open/close 1858 (time 1789797931.86 total 20.01 last 88.70) - open/close 2912 (time 1789797941.87 total 30.02 last 105.31) - open/close 4004 (time 1789797951.87 total 40.02 last 109.15) total: 4500 open/close in 44.55 seconds: 101.01 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 - /unlink 1982 (time 1789797968.80 total 10.00 last 198.16) - /unlink 3856 (time 1789797978.81 total 20.00 last 187.38) total: 4500 /unlink in 23.81 seconds: 189.00 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 927 (time 1789797998.25 total 10.00 last 92.68) - open/close 1872 (time 1789798008.26 total 20.01 last 94.43) - open/close 2782 (time 1789798018.27 total 30.02 last 90.93) - open/close 3791 (time 1789798028.28 total 40.03 last 100.79) total: 4500 open/close in 46.27 seconds: 97.25 ops/second - /unlink 2121 (time 1789798046.80 total 10.00 last 212.09) - /unlink 4296 (time 1789798056.80 total 20.00 last 217.50) total: 4500 /unlink in 20.80 seconds: 216.33 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 1149 (time 1789798069.89 total 10.00 last 114.89) - open/close 2164 (time 1789798079.89 total 20.00 last 101.50) - open/close 3156 (time 1789798089.90 total 30.01 last 99.11) - open/close 4192 (time 1789798099.91 total 40.02 last 103.48) total: 4500 open/close in 43.09 seconds: 104.44 ops/second - /unlink 1926 (time 1789798115.41 total 10.00 last 192.54) - /unlink 3878 (time 1789798125.41 total 20.00 last 195.18) total: 4500 /unlink in 23.06 seconds: 195.12 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 942 (time 1789798141.10 total 10.01 last 94.11) - open/close 1975 (time 1789798151.10 total 20.01 last 103.27) - open/close 3175 (time 1789798161.11 total 30.02 last 119.96) - open/close 4285 (time 1789798171.11 total 40.02 last 110.93) total: 4500 open/close in 42.20 seconds: 106.65 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 - /unlink 2058 (time 1789798185.79 total 10.00 last 205.78) - /unlink 4261 (time 1789798195.79 total 20.00 last 220.29) total: 4500 /unlink in 21.13 seconds: 212.98 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 1084 (time 1789798209.19 total 10.01 last 108.34) - open/close 2160 (time 1789798219.20 total 20.01 last 107.51) - open/close 3276 (time 1789798229.20 total 30.02 last 111.55) - open/close 4307 (time 1789798239.21 total 40.02 last 103.04) total: 4500 open/close in 41.98 seconds: 107.18 ops/second - /unlink 2294 (time 1789798253.69 total 10.00 last 229.34) - /unlink 4453 (time 1789798263.69 total 20.01 last 215.80) total: 4500 /unlink in 20.25 seconds: 222.19 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 1132 (time 1789798276.28 total 10.00 last 113.20) - open/close 2079 (time 1789798286.29 total 20.01 last 94.63) - open/close 3043 (time 1789798296.29 total 30.01 last 96.39) - open/close 4035 (time 1789798306.29 total 40.01 last 99.14) total: 4500 open/close in 44.15 seconds: 101.92 ops/second - /unlink 1962 (time 1789798322.72 total 10.00 last 196.16) - /unlink 3862 (time 1789798332.73 total 20.01 last 189.88) total: 4500 /unlink in 23.09 seconds: 194.86 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 lustre-MDT0000: clear the changelog for cl1 to record #246998 - open/close 982 (time 1789798348.49 total 10.00 last 98.15) - open/close 1931 (time 1789798358.49 total 20.00 last 94.90) - open/close 2951 (time 1789798368.49 total 30.01 last 102.00) - open/close 3980 (time 1789798378.49 total 40.01 last 102.85) total: 4500 open/close in 44.85 seconds: 100.33 ops/second - /unlink 2159 (time 1789798395.84 total 10.00 last 215.82) - /unlink 4100 (time 1789798405.84 total 20.01 last 194.06) total: 4500 /unlink in 22.21 seconds: 202.58 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 1013 (time 1789798420.56 total 10.00 last 101.28) - open/close 2010 (time 1789798430.56 total 20.01 last 99.64) - open/close 2963 (time 1789798440.56 total 30.01 last 95.29) - open/close 3870 (time 1789798450.58 total 40.02 last 90.59) total: 4500 open/close in 47.17 seconds: 95.41 ops/second - /unlink 2471 (time 1789798470.32 total 10.00 last 247.01) total: 4500 /unlink in 18.52 seconds: 242.96 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 1334 (time 1789798491.08 total 10.01 last 133.31) - open/close 2714 (time 1789798501.08 total 20.01 last 138.00) - open/close 4069 (time 1789798511.08 total 30.01 last 135.46) total: 4500 open/close in 33.13 seconds: 135.84 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 - /unlink 2652 (time 1789798526.20 total 10.01 last 264.95) total: 4500 /unlink in 16.52 seconds: 272.35 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 1435 (time 1789798544.58 total 10.00 last 143.43) - open/close 3237 (time 1789798554.59 total 20.01 last 180.08) total: 4500 open/close in 29.28 seconds: 153.69 ops/second - /unlink 2549 (time 1789798576.03 total 10.00 last 254.87) total: 4500 /unlink in 17.06 seconds: 263.74 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 1450 (time 1789798594.89 total 10.00 last 144.98) - open/close 2733 (time 1789798604.90 total 20.01 last 128.22) - open/close 4124 (time 1789798614.91 total 30.02 last 138.99) total: 4500 open/close in 32.81 seconds: 137.14 ops/second - /unlink 2612 (time 1789798629.82 total 10.00 last 261.17) total: 4500 /unlink in 18.11 seconds: 248.45 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11344: 94592 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg420-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg420-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg420-server stop mds service on oleg420-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg420-server stop mds service on oleg420-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg420-server unloading modules via unload_modules_local on: 'oleg420-server' oleg420-server: oleg420-server.virtnet: executing unload_modules_local oleg420-server: kmemleak disabled modules unloaded.