== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 17:20:05 (1786483205) Stopping clients: oleg408-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg408-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg408-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg408-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg408-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg408-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg408-server oleg408-server: oleg408-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg408-server' oleg408-server: oleg408-server.virtnet: executing load_modules_local oleg408-server: Loading modules from /home/green/git/lustre-release/lustre oleg408-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg408-server: detected 4 online CPUs by sysfs oleg408-server: MODOPTS_LIBCFS= oleg408-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg408-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg408-server: oleg408-server.virtnet: executing set_default_debug -1 all pdsh@oleg408-client: oleg408-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg408-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg408-server: oleg408-server.virtnet: executing set_default_debug -1 all pdsh@oleg408-client: oleg408-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg408-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg408-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg408-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg408-server: oleg408-server.virtnet: executing set_default_debug -1 all pdsh@oleg408-client: oleg408-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg408-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg408-client.virtnet: -o user_xattr,flock 192.168.204.108@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H crush /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 1597 (time 1786483321.58 total 10.00 last 159.66) - open/close 3054 (time 1786483331.58 total 20.00 last 145.67) - open/close 4429 (time 1786483341.58 total 30.01 last 137.50) total: 4500 open/close in 30.56 seconds: 147.26 ops/second - /unlink 2835 (time 1786483354.21 total 10.00 last 283.40) total: 4500 /unlink in 16.00 seconds: 281.30 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 1765 (time 1786483372.05 total 10.00 last 176.48) - open/close 3646 (time 1786483382.05 total 20.00 last 188.07) total: 4500 open/close in 24.90 seconds: 180.74 ops/second - /unlink 3378 (time 1786483398.71 total 10.00 last 337.75) total: 4500 /unlink in 13.60 seconds: 330.90 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 1617 (time 1786483414.21 total 10.01 last 161.60) - open/close 3210 (time 1786483424.21 total 20.01 last 159.27) total: 4500 open/close in 27.38 seconds: 164.35 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 - /unlink 2971 (time 1786483443.52 total 10.00 last 297.09) total: 4500 /unlink in 14.78 seconds: 304.41 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 1965 (time 1786483460.17 total 10.01 last 196.37) - open/close 3522 (time 1786483470.17 total 20.01 last 155.64) total: 4500 open/close in 26.47 seconds: 170.02 ops/second - /unlink 2918 (time 1786483488.65 total 10.00 last 291.69) total: 4500 /unlink in 14.88 seconds: 302.41 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 1530 (time 1786483505.45 total 10.00 last 153.00) - open/close 3262 (time 1786483515.46 total 20.00 last 173.15) total: 4500 open/close in 27.85 seconds: 161.55 ops/second - /unlink 3213 (time 1786483535.16 total 10.00 last 321.26) total: 4500 /unlink in 14.24 seconds: 316.02 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 1637 (time 1786483551.27 total 10.00 last 163.63) - open/close 3547 (time 1786483561.28 total 20.01 last 190.95) total: 4500 open/close in 25.45 seconds: 176.81 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 - /unlink 3945 (time 1786483578.44 total 10.00 last 394.46) total: 4500 /unlink in 11.35 seconds: 396.35 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 1876 (time 1786483591.46 total 10.00 last 187.55) - open/close 3866 (time 1786483601.46 total 20.00 last 199.00) total: 4500 open/close in 23.22 seconds: 193.80 ops/second - /unlink 3816 (time 1786483616.37 total 10.00 last 381.50) total: 4500 /unlink in 11.66 seconds: 385.85 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 2098 (time 1786483629.79 total 10.00 last 209.78) total: 4500 open/close in 18.63 seconds: 241.55 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 - /unlink 4464 (time 1786483650.04 total 10.00 last 446.40) total: 4500 /unlink in 10.04 seconds: 448.14 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 1981 (time 1786483661.56 total 10.00 last 198.07) - open/close 4074 (time 1786483671.56 total 20.00 last 209.23) total: 4500 open/close in 22.25 seconds: 202.29 ops/second - /unlink 3621 (time 1786483685.48 total 10.00 last 362.08) total: 4500 /unlink in 11.92 seconds: 377.52 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 2590 (time 1786483699.07 total 10.00 last 258.99) total: 4500 open/close in 16.16 seconds: 278.50 ops/second total: 4500 /unlink in 9.87 seconds: 456.03 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 2619 (time 1786483728.37 total 10.00 last 261.86) total: 4500 open/close in 17.65 seconds: 254.92 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 total: 4500 /unlink in 9.69 seconds: 464.37 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 2136 (time 1786483758.84 total 10.00 last 213.57) - open/close 3973 (time 1786483768.84 total 20.01 last 183.62) total: 4500 open/close in 23.24 seconds: 193.63 ops/second - /unlink 3274 (time 1786483783.90 total 10.00 last 327.34) total: 4500 /unlink in 13.30 seconds: 338.42 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 1883 (time 1786483799.04 total 10.00 last 188.26) - open/close 4042 (time 1786483809.04 total 20.00 last 215.89) total: 4500 open/close in 21.83 seconds: 206.14 ops/second - /unlink 4028 (time 1786483822.61 total 10.00 last 402.78) total: 4500 /unlink in 10.83 seconds: 415.45 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 - open/close 2259 (time 1786483835.34 total 10.01 last 225.77) - open/close 4030 (time 1786483845.34 total 20.01 last 177.07) total: 4500 open/close in 22.40 seconds: 200.92 ops/second lustre-MDT0000: clear the changelog for cl1 to record #246998 - /unlink 3762 (time 1786483859.49 total 10.00 last 376.19) total: 4500 /unlink in 11.66 seconds: 385.87 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 2732 (time 1786483872.74 total 10.00 last 273.17) total: 4500 open/close in 15.29 seconds: 294.37 ops/second total: 4500 /unlink in 8.06 seconds: 558.07 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 2099 (time 1786483899.01 total 10.00 last 209.80) - open/close 4103 (time 1786483909.01 total 20.01 last 200.35) total: 4500 open/close in 21.88 seconds: 205.63 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 - /unlink 3701 (time 1786483922.51 total 10.00 last 370.09) total: 4500 /unlink in 12.37 seconds: 363.73 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 1874 (time 1786483936.69 total 10.00 last 187.35) - open/close 3323 (time 1786483946.70 total 20.01 last 144.74) - open/close 4173 (time 1786483956.70 total 30.01 last 84.99) total: 4500 open/close in 33.48 seconds: 134.40 ops/second - /unlink 1604 (time 1786483973.54 total 10.00 last 160.34) - /unlink 3205 (time 1786483983.54 total 20.00 last 160.10) total: 4500 /unlink in 27.12 seconds: 165.95 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 1066 (time 1786484003.75 total 10.00 last 106.55) - open/close 2055 (time 1786484013.75 total 20.01 last 98.87) - open/close 2865 (time 1786484023.78 total 30.03 last 80.83) - open/close 3372 (time 1786484033.78 total 40.03 last 50.68) - open/close 3940 (time 1786484043.80 total 50.05 last 56.70) total: 4500 open/close in 59.56 seconds: 75.56 ops/second - /unlink 1043 (time 1786484069.33 total 10.01 last 104.22) - /unlink 1908 (time 1786484079.33 total 20.02 last 86.43) - /unlink 2956 (time 1786484089.35 total 30.03 last 104.66) - /unlink 3984 (time 1786484099.35 total 40.03 last 102.75) total: 4500 /unlink in 44.71 seconds: 100.66 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11316: 95020 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg408-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg408-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg408-server stop mds service on oleg408-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg408-server stop mds service on oleg408-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg408-server unloading modules via unload_modules_local on: 'oleg408-server' oleg408-server: oleg408-server.virtnet: executing unload_modules_local oleg408-server: modules unloaded.