== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 06:59:25 (1781607565) Stopping clients: oleg330-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg330-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg330-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg330-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg330-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg330-server oleg330-server: oleg330-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1045: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg330-server' oleg330-server: oleg330-server.virtnet: executing load_modules_local oleg330-server: Loading modules from /home/green/git/lustre-release/lustre oleg330-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1045: echo: write error: Device or resource busy oleg330-server: detected 4 online CPUs by sysfs oleg330-server: MODOPTS_LIBCFS= oleg330-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg330-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg330-server: oleg330-server.virtnet: executing set_default_debug -1 all pdsh@oleg330-client: oleg330-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 oleg330-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg330-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg330-server: oleg330-server.virtnet: executing set_default_debug -1 all pdsh@oleg330-client: oleg330-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg330-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg330-client.virtnet: -o user_xattr,flock 192.168.203.130@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 1131 (time 1781607672.38 total 10.00 last 113.08) - open/close 2418 (time 1781607682.39 total 20.01 last 128.61) - open/close 3483 (time 1781607692.40 total 30.02 last 106.41) total: 4500 open/close in 38.81 seconds: 115.93 ops/second - /unlink 2270 (time 1781607713.67 total 10.00 last 226.98) - /unlink 4434 (time 1781607723.68 total 20.00 last 216.32) total: 4500 /unlink in 20.40 seconds: 220.54 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 1099 (time 1781607736.82 total 10.00 last 109.87) - open/close 2265 (time 1781607746.82 total 20.00 last 116.59) - open/close 3469 (time 1781607756.83 total 30.01 last 120.33) total: 4500 open/close in 39.26 seconds: 114.62 ops/second - /unlink 2275 (time 1781607778.59 total 10.00 last 227.48) total: 4500 /unlink in 19.83 seconds: 226.95 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 1295 (time 1781607800.66 total 10.01 last 129.43) - open/close 2527 (time 1781607810.66 total 20.01 last 123.14) - open/close 3633 (time 1781607820.67 total 30.02 last 110.52) total: 4500 open/close in 37.01 seconds: 121.58 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 - /unlink 2461 (time 1781607839.80 total 10.00 last 246.02) total: 4500 /unlink in 18.50 seconds: 243.25 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 1195 (time 1781607860.59 total 10.01 last 119.43) - open/close 2490 (time 1781607870.59 total 20.01 last 129.44) - open/close 3857 (time 1781607880.59 total 30.01 last 136.65) total: 4500 open/close in 34.06 seconds: 132.13 ops/second - /unlink 2893 (time 1781607896.68 total 10.00 last 289.23) total: 4500 /unlink in 15.16 seconds: 296.91 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 1579 (time 1781607913.65 total 10.00 last 157.83) - open/close 2972 (time 1781607923.65 total 20.01 last 139.24) - open/close 4206 (time 1781607933.65 total 30.01 last 123.39) total: 4500 open/close in 32.47 seconds: 138.59 ops/second - /unlink 2402 (time 1781607948.37 total 10.00 last 240.16) total: 4500 /unlink in 17.19 seconds: 261.80 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 1831 (time 1781607967.57 total 10.00 last 183.05) - open/close 3919 (time 1781607977.57 total 20.00 last 208.79) total: 4500 open/close in 22.53 seconds: 199.77 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 total: 4500 /unlink in 9.64 seconds: 466.72 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 1825 (time 1781608003.02 total 10.00 last 182.42) - open/close 3813 (time 1781608013.03 total 20.01 last 198.71) total: 4500 open/close in 22.95 seconds: 196.06 ops/second - /unlink 4061 (time 1781608027.72 total 10.00 last 405.98) total: 4500 /unlink in 11.09 seconds: 405.72 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 1623 (time 1781608040.50 total 10.01 last 162.19) - open/close 3176 (time 1781608050.51 total 20.01 last 155.25) total: 4500 open/close in 28.67 seconds: 156.94 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 - /unlink 2852 (time 1781608071.13 total 10.00 last 285.18) total: 4500 /unlink in 16.17 seconds: 278.23 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 1677 (time 1781608089.39 total 10.00 last 167.63) - open/close 3417 (time 1781608099.40 total 20.01 last 173.83) total: 4500 open/close in 27.39 seconds: 164.29 ops/second - /unlink 3334 (time 1781608118.65 total 10.00 last 333.34) total: 4500 /unlink in 13.93 seconds: 323.12 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 1601 (time 1781608134.37 total 10.00 last 160.03) - open/close 3181 (time 1781608144.38 total 20.01 last 157.91) total: 4500 open/close in 28.40 seconds: 158.47 ops/second - /unlink 3599 (time 1781608164.69 total 10.00 last 359.83) total: 4500 /unlink in 12.30 seconds: 365.71 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 1852 (time 1781608178.78 total 10.00 last 185.13) - open/close 3856 (time 1781608188.78 total 20.01 last 200.36) total: 4500 open/close in 23.39 seconds: 192.41 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 - /unlink 3384 (time 1781608203.97 total 10.00 last 338.38) total: 4500 /unlink in 13.06 seconds: 344.63 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 1826 (time 1781608218.83 total 10.00 last 182.56) - open/close 3725 (time 1781608228.83 total 20.00 last 189.89) total: 4500 open/close in 23.41 seconds: 192.19 ops/second - /unlink 3573 (time 1781608244.05 total 10.00 last 357.30) total: 4500 /unlink in 12.57 seconds: 357.87 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 1931 (time 1781608258.50 total 10.00 last 193.03) - open/close 3633 (time 1781608268.50 total 20.01 last 170.17) total: 4500 open/close in 25.32 seconds: 177.71 ops/second - /unlink 3646 (time 1781608285.59 total 10.00 last 364.47) total: 4500 /unlink in 12.37 seconds: 363.75 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 - open/close 1802 (time 1781608299.86 total 10.00 last 180.12) - open/close 4346 (time 1781608309.87 total 20.01 last 254.28) total: 4500 open/close in 20.60 seconds: 218.50 ops/second lustre-MDT0000: clear the changelog for cl1 to record #246998 total: 4500 /unlink in 9.00 seconds: 500.20 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 2759 (time 1781608332.58 total 10.00 last 275.87) total: 4500 open/close in 18.92 seconds: 237.82 ops/second - /unlink 3254 (time 1781608353.49 total 10.00 last 325.39) total: 4500 /unlink in 13.75 seconds: 327.19 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 1819 (time 1781608369.14 total 10.00 last 181.84) - open/close 3325 (time 1781608379.15 total 20.01 last 150.55) total: 4500 open/close in 26.89 seconds: 167.35 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 - /unlink 4233 (time 1781608397.77 total 10.00 last 423.24) total: 4500 /unlink in 10.63 seconds: 423.14 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 1801 (time 1781608410.16 total 10.00 last 180.04) - open/close 3023 (time 1781608420.17 total 20.01 last 122.15) - open/close 4396 (time 1781608430.17 total 30.01 last 137.26) total: 4500 open/close in 30.59 seconds: 147.11 ops/second - /unlink 3422 (time 1781608442.66 total 10.00 last 342.18) total: 4500 /unlink in 13.11 seconds: 343.37 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 1431 (time 1781608457.57 total 10.00 last 143.07) - open/close 2720 (time 1781608467.57 total 20.00 last 128.90) - open/close 3879 (time 1781608477.58 total 30.01 last 115.83) total: 4500 open/close in 35.12 seconds: 128.13 ops/second - /unlink 3030 (time 1781608494.59 total 10.00 last 302.93) total: 4500 /unlink in 15.19 seconds: 296.25 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11225: 74966 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg330-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg330-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg330-server stop mds service on oleg330-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg330-server unloading modules via unload_modules_local on: 'oleg330-server' oleg330-server: oleg330-server.virtnet: executing unload_modules_local oleg330-server: modules unloaded.