== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 10:49:59 (1787410199) Stopping clients: oleg657-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg657-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg657-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg657-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg657-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg657-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg657-server oleg657-server: oleg657-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg657-server' oleg657-server: oleg657-server.virtnet: executing load_modules_local oleg657-server: Loading modules from /home/green/git/lustre-release/lustre oleg657-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg657-server: detected 4 online CPUs by sysfs oleg657-server: MODOPTS_LIBCFS= oleg657-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg657-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg657-server: oleg657-server.virtnet: executing set_default_debug -1 all pdsh@oleg657-client: oleg657-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg657-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg657-server: oleg657-server.virtnet: executing set_default_debug -1 all pdsh@oleg657-client: oleg657-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg657-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg657-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg657-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg657-server: oleg657-server.virtnet: executing set_default_debug -1 all pdsh@oleg657-client: oleg657-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg657-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg657-client.virtnet: -o user_xattr,flock 192.168.206.157@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H all_char /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 1219 (time 1787410319.53 total 10.00 last 121.84) - open/close 2428 (time 1787410329.53 total 20.01 last 120.85) - open/close 3680 (time 1787410339.54 total 30.02 last 125.07) total: 4500 open/close in 36.05 seconds: 124.83 ops/second - /unlink 2598 (time 1787410357.57 total 10.00 last 259.72) total: 4500 /unlink in 16.98 seconds: 265.03 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 1512 (time 1787410376.51 total 10.00 last 151.14) - open/close 3017 (time 1787410386.51 total 20.00 last 150.50) - open/close 4409 (time 1787410396.51 total 30.01 last 139.18) total: 4500 open/close in 30.64 seconds: 146.85 ops/second - /unlink 2758 (time 1787410409.24 total 10.00 last 275.77) total: 4500 /unlink in 16.11 seconds: 279.27 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 1325 (time 1787410427.20 total 10.00 last 132.49) - open/close 2668 (time 1787410437.20 total 20.00 last 134.28) - open/close 4182 (time 1787410447.21 total 30.01 last 151.31) total: 4500 open/close in 32.31 seconds: 139.30 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 - /unlink 2387 (time 1787410461.55 total 10.00 last 238.63) total: 4500 /unlink in 17.89 seconds: 251.55 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 1401 (time 1787410481.34 total 10.00 last 140.04) - open/close 2721 (time 1787410491.34 total 20.01 last 131.95) - open/close 4309 (time 1787410501.35 total 30.01 last 158.72) total: 4500 open/close in 31.22 seconds: 144.13 ops/second - /unlink 2724 (time 1787410514.46 total 10.01 last 272.23) total: 4500 /unlink in 15.61 seconds: 288.36 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 1900 (time 1787410531.87 total 10.00 last 189.98) - open/close 3703 (time 1787410541.87 total 20.00 last 180.28) total: 4500 open/close in 23.93 seconds: 188.05 ops/second - /unlink 3697 (time 1787410557.44 total 10.00 last 369.69) total: 4500 /unlink in 12.13 seconds: 371.05 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 1825 (time 1787410571.27 total 10.00 last 182.50) - open/close 3655 (time 1787410581.27 total 20.00 last 182.98) total: 4500 open/close in 24.04 seconds: 187.16 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 - /unlink 3832 (time 1787410596.95 total 10.00 last 383.14) total: 4500 /unlink in 11.62 seconds: 387.20 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 1731 (time 1787410610.26 total 10.00 last 173.06) - open/close 3358 (time 1787410620.27 total 20.01 last 162.58) total: 4500 open/close in 26.50 seconds: 169.79 ops/second - /unlink 4268 (time 1787410638.50 total 10.00 last 426.73) total: 4500 /unlink in 10.49 seconds: 429.17 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 2656 (time 1787410650.56 total 10.00 last 265.55) total: 4500 open/close in 19.29 seconds: 233.34 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 - /unlink 4080 (time 1787410671.52 total 10.00 last 407.90) total: 4500 /unlink in 11.18 seconds: 402.55 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 2148 (time 1787410684.33 total 10.00 last 214.73) - open/close 3806 (time 1787410694.34 total 20.01 last 165.70) total: 4500 open/close in 24.30 seconds: 185.20 ops/second - /unlink 3066 (time 1787410710.39 total 10.00 last 306.50) total: 4500 /unlink in 13.60 seconds: 331.00 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 2335 (time 1787410725.59 total 10.01 last 233.37) total: 4500 open/close in 19.52 seconds: 230.58 ops/second - /unlink 3244 (time 1787410746.70 total 10.00 last 324.36) total: 4500 /unlink in 14.09 seconds: 319.39 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 1713 (time 1787410762.71 total 10.01 last 171.21) - open/close 3462 (time 1787410772.72 total 20.01 last 174.80) total: 4500 open/close in 26.58 seconds: 169.28 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 - /unlink 3259 (time 1787410790.99 total 10.00 last 325.81) total: 4500 /unlink in 13.61 seconds: 330.68 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 2016 (time 1787410806.30 total 10.00 last 201.55) - open/close 3797 (time 1787410816.31 total 20.01 last 178.04) total: 4500 open/close in 24.56 seconds: 183.20 ops/second - /unlink 3280 (time 1787410832.77 total 10.00 last 327.97) total: 4500 /unlink in 14.19 seconds: 317.15 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 1634 (time 1787410848.86 total 10.00 last 163.39) - open/close 3084 (time 1787410858.86 total 20.00 last 144.95) total: 4500 open/close in 27.51 seconds: 163.56 ops/second - /unlink 3417 (time 1787410878.22 total 10.00 last 341.68) total: 4500 /unlink in 13.33 seconds: 337.52 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 lustre-MDT0000: clear the changelog for cl1 to record #246998 - open/close 1869 (time 1787410893.43 total 10.00 last 186.86) - open/close 4076 (time 1787410903.44 total 20.01 last 220.63) total: 4500 open/close in 21.91 seconds: 205.42 ops/second - /unlink 3224 (time 1787410917.08 total 10.00 last 322.36) total: 4500 /unlink in 14.13 seconds: 318.39 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 1843 (time 1787410933.10 total 10.00 last 184.24) - open/close 4089 (time 1787410943.10 total 20.01 last 224.53) total: 4500 open/close in 21.59 seconds: 208.39 ops/second - /unlink 4381 (time 1787410956.36 total 10.00 last 438.08) total: 4500 /unlink in 10.25 seconds: 438.91 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 2080 (time 1787410968.29 total 10.01 last 207.84) - open/close 4129 (time 1787410978.29 total 20.01 last 204.87) total: 4500 open/close in 22.11 seconds: 203.52 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 total: 4500 /unlink in 9.33 seconds: 482.38 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 2800 (time 1787411002.77 total 10.00 last 279.95) total: 4500 open/close in 16.96 seconds: 265.31 ops/second total: 4500 /unlink in 6.77 seconds: 664.25 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 3363 (time 1787411029.43 total 10.04 last 334.88) total: 4500 open/close in 13.51 seconds: 333.02 ops/second - /unlink 4397 (time 1787411044.44 total 10.00 last 439.61) total: 4500 /unlink in 10.28 seconds: 437.65 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11242: 94662 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user 'cl1': success lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user 'cl1': success Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg657-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg657-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg657-server stop mds service on oleg657-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg657-server stop mds service on oleg657-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg657-server unloading modules via unload_modules_local on: 'oleg657-server' oleg657-server: oleg657-server.virtnet: executing unload_modules_local oleg657-server: modules unloaded.