== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 08:29:28 (1788870568) Stopping clients: oleg611-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg611-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg611-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg611-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg611-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg611-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg611-server oleg611-server: oleg611-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg611-server' oleg611-server: oleg611-server.virtnet: executing load_modules_local oleg611-server: Loading modules from /home/green/git/lustre-release/lustre oleg611-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg611-server: detected 4 online CPUs by sysfs oleg611-server: MODOPTS_LIBCFS= oleg611-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg611-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg611-server: oleg611-server.virtnet: executing set_default_debug -1 all pdsh@oleg611-client: oleg611-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg611-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg611-server: oleg611-server.virtnet: executing set_default_debug -1 all pdsh@oleg611-client: oleg611-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg611-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg611-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg611-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg611-server: oleg611-server.virtnet: executing set_default_debug -1 all pdsh@oleg611-client: oleg611-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg611-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg611-client.virtnet: -o user_xattr,flock 192.168.206.111@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H crush /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 2921 (time 1788870671.14 total 10.00 last 292.04) total: 4500 open/close in 16.45 seconds: 273.54 ops/second total: 4500 /unlink in 7.86 seconds: 572.71 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 2012 (time 1788870698.19 total 10.00 last 201.17) - open/close 4309 (time 1788870708.20 total 20.01 last 229.60) total: 4500 open/close in 20.79 seconds: 216.50 ops/second - /unlink 4160 (time 1788870720.64 total 10.00 last 415.98) total: 4500 /unlink in 10.68 seconds: 421.42 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 2481 (time 1788870732.94 total 10.00 last 248.02) total: 4500 open/close in 17.16 seconds: 262.28 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 - /unlink 3397 (time 1788870751.84 total 10.00 last 339.63) total: 4500 /unlink in 12.77 seconds: 352.36 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 2425 (time 1788870766.38 total 10.00 last 242.45) - open/close 4028 (time 1788870776.38 total 20.00 last 160.27) total: 4500 open/close in 22.67 seconds: 198.52 ops/second total: 4500 /unlink in 9.69 seconds: 464.32 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 2198 (time 1788870802.19 total 10.00 last 219.74) - open/close 4174 (time 1788870812.19 total 20.00 last 197.59) total: 4500 open/close in 21.36 seconds: 210.65 ops/second - /unlink 3181 (time 1788870825.42 total 10.00 last 318.07) total: 4500 /unlink in 14.02 seconds: 320.87 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 3179 (time 1788870841.18 total 10.00 last 317.81) total: 4500 open/close in 14.17 seconds: 317.63 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 total: 4500 /unlink in 7.93 seconds: 567.36 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 2821 (time 1788870866.09 total 10.00 last 282.05) total: 4500 open/close in 17.15 seconds: 262.36 ops/second - /unlink 4356 (time 1788870884.88 total 10.00 last 435.56) total: 4500 /unlink in 10.25 seconds: 439.10 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 3512 (time 1788870896.64 total 10.00 last 351.15) total: 4500 open/close in 13.19 seconds: 341.24 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 total: 4500 /unlink in 5.87 seconds: 766.89 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 3646 (time 1788870918.69 total 10.00 last 364.52) total: 4500 open/close in 12.50 seconds: 360.13 ops/second total: 4500 /unlink in 6.99 seconds: 644.22 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 2824 (time 1788870940.83 total 10.00 last 282.30) total: 4500 open/close in 17.99 seconds: 250.19 ops/second total: 4500 /unlink in 9.59 seconds: 469.13 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 2047 (time 1788870971.55 total 10.00 last 204.66) total: 4500 open/close in 18.86 seconds: 238.55 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 - /unlink 3789 (time 1788870991.90 total 10.00 last 378.76) total: 4500 /unlink in 11.96 seconds: 376.10 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 2139 (time 1788871005.70 total 10.00 last 213.89) - open/close 4359 (time 1788871015.70 total 20.00 last 222.00) total: 4500 open/close in 20.45 seconds: 220.04 ops/second - /unlink 3794 (time 1788871027.73 total 10.00 last 379.38) total: 4500 /unlink in 11.95 seconds: 376.48 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 2055 (time 1788871041.42 total 10.00 last 205.44) - open/close 4462 (time 1788871051.42 total 20.01 last 240.58) total: 4500 open/close in 20.20 seconds: 222.75 ops/second total: 4500 /unlink in 9.94 seconds: 452.93 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 lustre-MDT0000: clear the changelog for cl1 to record #246998 - open/close 2078 (time 1788871074.91 total 10.00 last 207.76) - open/close 4085 (time 1788871084.91 total 20.01 last 200.62) total: 4500 open/close in 21.40 seconds: 210.27 ops/second total: 4500 /unlink in 8.55 seconds: 526.46 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 2653 (time 1788871107.78 total 10.00 last 265.28) - open/close 4351 (time 1788871117.78 total 20.00 last 169.77) total: 4500 open/close in 20.78 seconds: 216.56 ops/second - /unlink 4187 (time 1788871130.37 total 10.00 last 418.61) total: 4500 /unlink in 10.72 seconds: 419.87 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 2087 (time 1788871142.75 total 10.01 last 208.59) - open/close 3942 (time 1788871152.76 total 20.01 last 185.44) total: 4500 open/close in 22.91 seconds: 196.43 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 - /unlink 3738 (time 1788871167.50 total 10.00 last 373.75) total: 4500 /unlink in 11.74 seconds: 383.14 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 2482 (time 1788871180.83 total 10.00 last 248.09) - open/close 4007 (time 1788871190.84 total 20.01 last 152.46) total: 4500 open/close in 23.80 seconds: 189.10 ops/second - /unlink 3793 (time 1788871206.66 total 10.00 last 379.21) total: 4500 /unlink in 11.34 seconds: 396.69 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 2386 (time 1788871219.57 total 10.00 last 238.54) total: 4500 open/close in 19.22 seconds: 234.11 ops/second - /unlink 4441 (time 1788871240.56 total 10.00 last 444.01) total: 4500 /unlink in 10.11 seconds: 444.90 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11243: 94462 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg611-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg611-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg611-server stop mds service on oleg611-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg611-server stop mds service on oleg611-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg611-server unloading modules via unload_modules_local on: 'oleg611-server' oleg611-server: oleg611-server.virtnet: executing unload_modules_local oleg611-server: modules unloaded.