== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 18:02:49 (1777500169) Stopping clients: oleg333-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg333-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg333-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg333-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg333-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg333-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg333-server oleg333-server: oleg333-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg333-server' oleg333-server: oleg333-server.virtnet: executing load_modules_local oleg333-server: Loading modules from /home/green/git/lustre-release/lustre oleg333-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg333-server: detected 4 online CPUs by sysfs oleg333-server: MODOPTS_LIBCFS= oleg333-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg333-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg333-server: oleg333-server.virtnet: executing set_default_debug -1 all pdsh@oleg333-client: oleg333-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg333-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg333-server: oleg333-server.virtnet: executing set_default_debug -1 all pdsh@oleg333-client: oleg333-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg333-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg333-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg333-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg333-server: oleg333-server.virtnet: executing set_default_debug -1 all pdsh@oleg333-client: oleg333-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg333-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg333-client.virtnet: -o user_xattr,flock 192.168.203.133@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 1063 (time 1777500307.80 total 10.00 last 106.28) - open/close 2144 (time 1777500317.81 total 20.01 last 108.03) - open/close 3355 (time 1777500327.81 total 30.01 last 121.03) - open/close 4473 (time 1777500337.82 total 40.02 last 111.73) total: 4500 open/close in 40.30 seconds: 111.67 ops/second - /unlink 2080 (time 1777500350.44 total 10.00 last 207.99) - /unlink 4135 (time 1777500360.44 total 20.00 last 205.46) total: 4500 /unlink in 21.76 seconds: 206.82 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 1175 (time 1777500374.99 total 10.00 last 117.47) - open/close 2454 (time 1777500384.99 total 20.00 last 127.87) - open/close 3751 (time 1777500394.99 total 30.01 last 129.69) total: 4500 open/close in 36.25 seconds: 124.14 ops/second - /unlink 2365 (time 1777500413.39 total 10.00 last 236.50) - /unlink 4459 (time 1777500423.39 total 20.00 last 209.35) total: 4500 /unlink in 20.19 seconds: 222.89 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 1778 (time 1777500435.97 total 10.00 last 177.79) - open/close 3513 (time 1777500445.98 total 20.01 last 173.39) total: 4500 open/close in 25.88 seconds: 173.88 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 - /unlink 3789 (time 1777500463.49 total 10.00 last 378.86) total: 4500 /unlink in 12.50 seconds: 359.98 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 2133 (time 1777500477.75 total 10.00 last 213.21) - open/close 3815 (time 1777500487.75 total 20.01 last 168.18) total: 4500 open/close in 23.63 seconds: 190.48 ops/second - /unlink 3677 (time 1777500503.19 total 10.00 last 367.67) total: 4500 /unlink in 12.32 seconds: 365.26 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 2674 (time 1777500517.21 total 10.00 last 267.39) total: 4500 open/close in 18.23 seconds: 246.89 ops/second - /unlink 3745 (time 1777500537.38 total 10.00 last 374.43) total: 4500 /unlink in 12.90 seconds: 348.71 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 1543 (time 1777500552.29 total 10.00 last 154.29) - open/close 3128 (time 1777500562.30 total 20.01 last 158.37) total: 4500 open/close in 29.51 seconds: 152.47 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 - /unlink 3526 (time 1777500583.77 total 10.00 last 352.53) total: 4500 /unlink in 11.87 seconds: 379.19 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 1626 (time 1777500597.47 total 10.01 last 162.50) - open/close 3297 (time 1777500607.47 total 20.01 last 167.05) total: 4500 open/close in 26.80 seconds: 167.92 ops/second - /unlink 3189 (time 1777500626.01 total 10.00 last 318.80) total: 4500 /unlink in 13.44 seconds: 334.89 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 1871 (time 1777500641.24 total 10.00 last 187.05) - open/close 4114 (time 1777500651.24 total 20.01 last 224.24) total: 4500 open/close in 21.58 seconds: 208.49 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 total: 4500 /unlink in 9.80 seconds: 459.03 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 1439 (time 1777500676.04 total 10.01 last 143.72) - open/close 3171 (time 1777500686.04 total 20.01 last 173.18) total: 4500 open/close in 27.51 seconds: 163.60 ops/second - /unlink 3530 (time 1777500705.34 total 10.00 last 352.91) total: 4500 /unlink in 12.65 seconds: 355.77 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 1887 (time 1777500719.87 total 10.01 last 188.60) - open/close 3673 (time 1777500729.88 total 20.01 last 178.51) total: 4500 open/close in 24.36 seconds: 184.74 ops/second - /unlink 4093 (time 1777500745.93 total 10.00 last 409.22) total: 4500 /unlink in 10.78 seconds: 417.60 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 2259 (time 1777500758.35 total 10.00 last 225.84) total: 4500 open/close in 19.02 seconds: 236.62 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 - /unlink 3943 (time 1777500778.92 total 10.00 last 394.27) total: 4500 /unlink in 11.54 seconds: 389.82 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 2678 (time 1777500792.14 total 10.00 last 267.80) total: 4500 open/close in 15.65 seconds: 287.60 ops/second total: 4500 /unlink in 9.15 seconds: 491.66 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 2809 (time 1777500819.72 total 10.00 last 280.87) total: 4500 open/close in 16.04 seconds: 280.60 ops/second total: 4500 /unlink in 7.93 seconds: 567.37 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 - open/close 2263 (time 1777500846.66 total 10.00 last 226.25) total: 4500 open/close in 19.90 seconds: 226.16 ops/second lustre-MDT0000: clear the changelog for cl1 to record #246998 total: 4500 /unlink in 7.60 seconds: 592.24 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 2477 (time 1777500877.26 total 10.00 last 247.67) total: 4500 open/close in 17.44 seconds: 258.01 ops/second total: 4500 /unlink in 7.03 seconds: 640.07 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 1952 (time 1777500904.65 total 10.00 last 195.18) - open/close 4001 (time 1777500914.65 total 20.00 last 204.87) total: 4500 open/close in 21.62 seconds: 208.13 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 total: 4500 /unlink in 8.12 seconds: 554.05 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 3415 (time 1777500937.33 total 10.00 last 341.42) total: 4500 open/close in 13.66 seconds: 329.40 ops/second total: 4500 /unlink in 7.10 seconds: 633.58 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 4071 (time 1777500961.09 total 10.00 last 406.96) total: 4500 open/close in 11.12 seconds: 404.56 ops/second total: 4500 /unlink in 7.64 seconds: 588.99 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11187: 93708 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg333-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg333-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg333-server stop mds service on oleg333-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg333-server stop mds service on oleg333-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg333-server unloading modules via unload_modules_local on: 'oleg333-server' oleg333-server: oleg333-server.virtnet: executing unload_modules_local oleg333-server: modules unloaded.