== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 03:53:21 (1780386801) Stopping clients: oleg408-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg408-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg408-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg408-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg408-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg408-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg408-server oleg408-server: oleg408-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg408-server' oleg408-server: oleg408-server.virtnet: executing load_modules_local oleg408-server: Loading modules from /home/green/git/lustre-release/lustre oleg408-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg408-server: detected 4 online CPUs by sysfs oleg408-server: MODOPTS_LIBCFS= oleg408-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg408-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg408-server: oleg408-server.virtnet: executing set_default_debug -1 all pdsh@oleg408-client: oleg408-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg408-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg408-server: oleg408-server.virtnet: executing set_default_debug -1 all pdsh@oleg408-client: oleg408-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg408-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg408-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg408-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg408-server: oleg408-server.virtnet: executing set_default_debug -1 all pdsh@oleg408-client: oleg408-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg408-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg408-client.virtnet: -o user_xattr,flock 192.168.204.108@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H crush2 /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 1468 (time 1780386904.72 total 10.00 last 146.77) - open/close 2980 (time 1780386914.73 total 20.01 last 151.15) total: 4500 open/close in 29.31 seconds: 153.53 ops/second - /unlink 3513 (time 1780386935.83 total 10.00 last 351.26) total: 4500 /unlink in 11.76 seconds: 382.68 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 1743 (time 1780386949.33 total 10.01 last 174.21) - open/close 3350 (time 1780386959.34 total 20.01 last 160.62) total: 4500 open/close in 27.74 seconds: 162.21 ops/second - /unlink 3034 (time 1780386978.83 total 10.00 last 303.39) total: 4500 /unlink in 15.14 seconds: 297.32 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 1568 (time 1780386996.08 total 10.00 last 156.79) - open/close 3483 (time 1780387006.08 total 20.01 last 191.42) total: 4500 open/close in 24.22 seconds: 185.79 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 - /unlink 3039 (time 1780387022.17 total 10.00 last 303.87) total: 4500 /unlink in 14.43 seconds: 311.89 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 1841 (time 1780387038.37 total 10.00 last 184.05) - open/close 4136 (time 1780387048.37 total 20.00 last 229.48) total: 4500 open/close in 21.43 seconds: 209.95 ops/second total: 4500 /unlink in 9.61 seconds: 468.36 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 2703 (time 1780387072.50 total 10.00 last 270.20) total: 4500 open/close in 17.17 seconds: 262.05 ops/second total: 4500 /unlink in 9.36 seconds: 481.02 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 2624 (time 1780387102.07 total 10.00 last 262.32) total: 4500 open/close in 18.23 seconds: 246.85 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 - /unlink 4356 (time 1780387121.88 total 10.00 last 435.49) total: 4500 /unlink in 10.31 seconds: 436.41 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 2188 (time 1780387133.93 total 10.00 last 218.76) - open/close 4226 (time 1780387143.94 total 20.01 last 203.72) total: 4500 open/close in 21.27 seconds: 211.52 ops/second total: 4500 /unlink in 6.37 seconds: 706.83 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 2813 (time 1780387164.55 total 10.00 last 281.26) total: 4500 open/close in 16.28 seconds: 276.36 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 total: 4500 /unlink in 9.42 seconds: 477.61 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 3297 (time 1780387193.35 total 10.00 last 329.69) total: 4500 open/close in 13.83 seconds: 325.41 ops/second total: 4500 /unlink in 8.38 seconds: 536.72 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 3223 (time 1780387218.40 total 10.00 last 322.24) total: 4500 open/close in 14.82 seconds: 303.61 ops/second total: 4500 /unlink in 8.21 seconds: 548.02 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 3588 (time 1780387244.49 total 10.00 last 358.69) total: 4500 open/close in 12.97 seconds: 347.08 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 total: 4500 /unlink in 6.80 seconds: 662.02 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 2519 (time 1780387267.13 total 10.00 last 251.81) total: 4500 open/close in 16.40 seconds: 274.35 ops/second total: 4500 /unlink in 6.52 seconds: 690.60 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 3361 (time 1780387292.81 total 10.00 last 336.08) total: 4500 open/close in 14.07 seconds: 319.93 ops/second total: 4500 /unlink in 6.59 seconds: 682.64 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 lustre-MDT0000: clear the changelog for cl1 to record #246998 - open/close 3170 (time 1780387316.44 total 10.00 last 316.96) total: 4500 open/close in 13.56 seconds: 331.82 ops/second total: 4500 /unlink in 6.00 seconds: 750.57 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 3771 (time 1780387338.90 total 10.00 last 377.06) total: 4500 open/close in 11.89 seconds: 378.51 ops/second total: 4500 /unlink in 5.81 seconds: 774.30 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 3559 (time 1780387359.35 total 10.00 last 355.88) total: 4500 open/close in 12.35 seconds: 364.31 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 total: 4500 /unlink in 5.85 seconds: 769.70 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 3442 (time 1780387380.28 total 10.00 last 344.16) total: 4500 open/close in 12.65 seconds: 355.87 ops/second total: 4500 /unlink in 5.54 seconds: 812.38 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 total: 4500 open/close in 9.59 seconds: 469.35 ops/second total: 4500 /unlink in 4.78 seconds: 941.03 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11196: 93494 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg408-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg408-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg408-server stop mds service on oleg408-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg408-server stop mds service on oleg408-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg408-server unloading modules via unload_modules_local on: 'oleg408-server' oleg408-server: oleg408-server.virtnet: executing unload_modules_local oleg408-server: modules unloaded.