== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 20:05:24 (1773619524) Stopping clients: oleg305-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg305-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg305-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg305-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg305-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg305-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg305-server oleg305-server: oleg305-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg305-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg305-server: oleg305-server.virtnet: executing set_default_debug -1 all pdsh@oleg305-client: oleg305-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg305-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg305-server: oleg305-server.virtnet: executing set_default_debug -1 all pdsh@oleg305-client: oleg305-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg305-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg305-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg305-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg305-server: oleg305-server.virtnet: executing set_default_debug -1 all pdsh@oleg305-client: oleg305-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg305-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H crush2 /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog - open/close 2670 (time 1773619622.02 total 10.00 last 266.93) total: 4500 open/close in 16.24 seconds: 277.02 ops/second lustre-MDT0000: clear the changelog for cl1 to record #12998 total: 4500 /unlink in 8.03 seconds: 560.29 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 2612 (time 1773619649.27 total 10.00 last 261.14) total: 4500 open/close in 18.52 seconds: 243.01 ops/second total: 4500 /unlink in 9.95 seconds: 452.21 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 2292 (time 1773619681.00 total 10.01 last 229.05) - open/close 4359 (time 1773619691.01 total 20.01 last 206.64) total: 4500 open/close in 20.59 seconds: 218.60 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 - /unlink 4018 (time 1773619703.19 total 10.00 last 401.80) total: 4500 /unlink in 11.29 seconds: 398.63 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 2017 (time 1773619716.19 total 10.00 last 201.63) total: 4500 open/close in 19.99 seconds: 225.10 ops/second - /unlink 4150 (time 1773619737.72 total 10.00 last 414.92) total: 4500 /unlink in 10.79 seconds: 417.22 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 2478 (time 1773619750.16 total 10.00 last 247.80) total: 4500 open/close in 18.66 seconds: 241.14 ops/second - /unlink 3774 (time 1773619770.54 total 10.00 last 377.36) total: 4500 /unlink in 11.52 seconds: 390.54 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 2553 (time 1773619783.80 total 10.01 last 255.15) total: 4500 open/close in 19.30 seconds: 233.16 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 - /unlink 4326 (time 1773619804.76 total 10.00 last 432.41) total: 4500 /unlink in 10.52 seconds: 427.94 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 2738 (time 1773619816.93 total 10.00 last 273.72) total: 4500 open/close in 16.04 seconds: 280.50 ops/second total: 4500 /unlink in 7.81 seconds: 576.26 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 3005 (time 1773619843.74 total 10.00 last 300.49) total: 4500 open/close in 14.40 seconds: 312.53 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 total: 4500 /unlink in 6.83 seconds: 658.78 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 2861 (time 1773619867.76 total 10.00 last 286.02) total: 4500 open/close in 16.11 seconds: 279.36 ops/second total: 4500 /unlink in 8.36 seconds: 538.25 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 2949 (time 1773619895.20 total 10.00 last 294.88) total: 4500 open/close in 15.53 seconds: 289.82 ops/second total: 4500 /unlink in 7.82 seconds: 575.32 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 2728 (time 1773619921.36 total 10.00 last 272.75) total: 4500 open/close in 15.95 seconds: 282.15 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 total: 4500 /unlink in 9.28 seconds: 484.77 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 2542 (time 1773619949.50 total 10.01 last 254.02) total: 4500 open/close in 17.36 seconds: 259.24 ops/second total: 4500 /unlink in 8.95 seconds: 503.05 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 2614 (time 1773619978.66 total 10.00 last 261.32) total: 4500 open/close in 17.65 seconds: 254.97 ops/second total: 4500 /unlink in 7.17 seconds: 627.20 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 - open/close 2967 (time 1773620006.34 total 10.00 last 296.66) total: 4500 open/close in 15.00 seconds: 300.06 ops/second lustre-MDT0000: clear the changelog for cl1 to record #246998 total: 4500 /unlink in 7.64 seconds: 589.17 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 3158 (time 1773620031.85 total 10.00 last 315.80) total: 4500 open/close in 14.71 seconds: 306.00 ops/second total: 4500 /unlink in 7.81 seconds: 575.99 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 3212 (time 1773620057.19 total 10.00 last 321.14) total: 4500 open/close in 13.18 seconds: 341.36 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 total: 4500 /unlink in 5.98 seconds: 751.89 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 3901 (time 1773620079.03 total 10.00 last 390.08) total: 4500 open/close in 11.54 seconds: 389.96 ops/second total: 4500 /unlink in 6.45 seconds: 697.46 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 3453 (time 1773620099.67 total 10.00 last 345.25) total: 4500 open/close in 13.03 seconds: 345.40 ops/second total: 4500 /unlink in 8.15 seconds: 552.37 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11170: 93404 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg305-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg305-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg305-server stop mds service on oleg305-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg305-server stop mds service on oleg305-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg305-server unloading modules via unload_modules_local on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing unload_modules_local oleg305-server: modules unloaded.