== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 02:42:08 (1783147328)
Stopping clients: oleg113-client.virtnet /mnt/lustre (opts:-f)
Stopping client oleg113-client.virtnet /mnt/lustre opts:-f
Stopping clients: oleg113-client.virtnet /mnt/lustre2 (opts:-f)
Stopping /mnt/lustre-mds1 (opts:-f) on oleg113-server
Stopping /mnt/lustre-mds2 (opts:-f) on oleg113-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg113-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg113-server
oleg113-server: oleg113-server.virtnet: executing set_hostid
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg113-server'
oleg113-server: oleg113-server.virtnet: executing load_modules_local
oleg113-server: Loading modules from /home/green/git/lustre-release/lustre
oleg113-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy
oleg113-server: detected 4 online CPUs by sysfs
oleg113-server: MODOPTS_LIBCFS=
oleg113-server: Force libcfs to create 2 CPU partitions
Formatting mgs, mds, osts
Format mds1: /dev/mapper/mds1_flakey
Format mds2: /dev/mapper/mds2_flakey
Format ost1: /dev/mapper/ost1_flakey
Format ost2: /dev/mapper/ost2_flakey
start mds service on oleg113-server
Start mds1: mount -t lustre -o localrecov  /dev/mapper/mds1_flakey /mnt/lustre-mds1
oleg113-server: oleg113-server.virtnet: executing set_default_debug -1 all
pdsh@oleg113-client: oleg113-server: ssh exited with exit code 1
Commit the device label on /dev/mapper/mds1_flakey
Started lustre-MDT0000
start mds service on oleg113-server
Start mds2: mount -t lustre -o localrecov  /dev/mapper/mds2_flakey /mnt/lustre-mds2
oleg113-server: oleg113-server.virtnet: executing set_default_debug -1 all
pdsh@oleg113-client: oleg113-server: ssh exited with exit code 1
Commit the device label on /dev/mapper/mds2_flakey
Started lustre-MDT0001
oleg113-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid
oleg113-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid
start ost1 service on oleg113-server
Start ost1: mount -t lustre -o localrecov  /dev/mapper/ost1_flakey /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg113-server: oleg113-server.virtnet: executing set_default_debug -1 all
pdsh@oleg113-client: oleg113-server: ssh exited with exit code 1
Commit the device label on /dev/mapper/ost1_flakey
Started lustre-OST0000
oleg113-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
mount lustre  on /mnt/lustre.....
Starting client: oleg113-client.virtnet:  -o user_xattr,flock 192.168.201.113@tcp:/lustre /mnt/lustre
fail_loc=0x1312
fail_val=5
fail_loc=0x1312
fail_val=5
striped dir -i0 -c1 -H all_char  /mnt/lustre/d135.conf-sanity
seq.cli-lustre-OST0000-super.width=0x1ffffff
mdd.lustre-MDT0000.changelog_mask=ALL
mdd.lustre-MDT0001.changelog_mask=ALL
mdd.lustre-MDT0000.changelog_mask=+hsm
mdd.lustre-MDT0001.changelog_mask=+hsm
Registered 2 changelog users: 'cl1 cl1'

Wrap arround changelog catalog
total: 4500 open/close in 9.95 seconds: 452.05 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #12998
total: 4500 /unlink in 5.39 seconds: 834.54 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #25998
 - open/close 4310 (time 1783147437.15 total 10.00 last 430.97)
total: 4500 open/close in 10.48 seconds: 429.33 ops/second
total: 4500 /unlink in 6.94 seconds: 648.59 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #38998
 - open/close 3734 (time 1783147457.74 total 10.00 last 373.32)
total: 4500 open/close in 12.06 seconds: 373.00 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #51998
total: 4500 /unlink in 6.56 seconds: 686.20 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #64998
 - open/close 3171 (time 1783147479.13 total 10.00 last 316.95)
total: 4500 open/close in 13.87 seconds: 324.51 ops/second
total: 4500 /unlink in 5.71 seconds: 788.17 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #77998
 - open/close 4217 (time 1783147501.46 total 10.00 last 421.63)
total: 4500 open/close in 10.70 seconds: 420.48 ops/second
total: 4500 /unlink in 5.97 seconds: 753.67 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #90998
 - open/close 4205 (time 1783147520.74 total 10.00 last 420.50)
total: 4500 open/close in 10.68 seconds: 421.40 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #103998
total: 4500 /unlink in 5.40 seconds: 832.73 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #116998
 - open/close 3847 (time 1783147539.25 total 10.00 last 384.55)
total: 4500 open/close in 12.20 seconds: 368.73 ops/second
total: 4500 /unlink in 8.43 seconds: 534.12 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #129998
 - open/close 3122 (time 1783147563.54 total 10.00 last 312.11)
total: 4500 open/close in 13.80 seconds: 326.20 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #142998
total: 4500 /unlink in 9.27 seconds: 485.25 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #155998
 - open/close 2663 (time 1783147590.37 total 10.00 last 266.27)
total: 4500 open/close in 16.48 seconds: 273.07 ops/second
total: 4500 /unlink in 9.19 seconds: 489.85 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #168998
 - open/close 2644 (time 1783147619.67 total 10.00 last 264.32)
total: 4500 open/close in 17.46 seconds: 257.77 ops/second
total: 4500 /unlink in 9.35 seconds: 481.44 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #181998
 - open/close 3747 (time 1783147650.13 total 10.00 last 374.65)
total: 4500 open/close in 12.17 seconds: 369.79 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #194998
total: 4500 /unlink in 7.64 seconds: 588.87 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #207998
 - open/close 3168 (time 1783147672.97 total 10.00 last 316.70)
total: 4500 open/close in 13.65 seconds: 329.58 ops/second
total: 4500 /unlink in 7.42 seconds: 606.13 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #220998
 - open/close 3060 (time 1783147697.03 total 10.00 last 305.93)
total: 4500 open/close in 15.45 seconds: 291.26 ops/second
total: 4500 /unlink in 8.89 seconds: 506.11 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #233998
lustre-MDT0000: clear the changelog for cl1 to record #246998
 - open/close 2868 (time 1783147724.82 total 10.00 last 286.78)
total: 4500 open/close in 16.62 seconds: 270.71 ops/second
total: 4500 /unlink in 9.35 seconds: 481.40 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #259998
 - open/close 2644 (time 1783147754.57 total 10.00 last 264.40)
total: 4500 open/close in 17.59 seconds: 255.82 ops/second
total: 4500 /unlink in 9.26 seconds: 485.92 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #272998
 - open/close 2870 (time 1783147784.61 total 10.00 last 286.97)
total: 4500 open/close in 16.00 seconds: 281.32 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #285998
total: 4500 /unlink in 8.97 seconds: 501.70 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #298998
 - open/close 2779 (time 1783147813.39 total 10.00 last 277.88)
total: 4500 open/close in 16.65 seconds: 270.31 ops/second
total: 4500 /unlink in 9.46 seconds: 475.49 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #311998
 - open/close 2257 (time 1783147843.34 total 10.00 last 225.66)
total: 4500 open/close in 19.27 seconds: 233.51 ops/second
total: 4500 /unlink in 8.73 seconds: 515.76 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #324998
 - open/close 3134 (time 1783147874.59 total 10.00 last 313.38)
total: 4500 open/close in 15.64 seconds: 287.71 ops/second
lustre-MDT0000: clear the changelog for cl1 to record #337998
total: 4500 /unlink in 9.00 seconds: 500.20 ops/second
kill changelog reader
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11242: 94184 Terminated              coproc COPROC $LFS changelog --follow $service  (wd: ~)
lustre-MDT0001: clear the changelog for cl1 of all records
lustre-MDT0001: Deregistered changelog user #1
lustre-MDT0000: clear the changelog for cl1 of all records
lustre-MDT0000: Deregistered changelog user #1

Cleanup test_135
umount lustre on /mnt/lustre.....
Stopping client oleg113-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg113-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg113-server
stop mds service on oleg113-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg113-server
stop mds service on oleg113-server
Stopping /mnt/lustre-mds2 (opts:-f) on oleg113-server

unloading modules via unload_modules_local on: 'oleg113-server'
oleg113-server: oleg113-server.virtnet: executing unload_modules_local
oleg113-server: 
modules unloaded.