== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 10:20:08 (1782483608) Stopping clients: oleg136-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg136-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg136-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg136-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg136-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg136-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg136-server oleg136-server: oleg136-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg136-server' oleg136-server: oleg136-server.virtnet: executing load_modules_local oleg136-server: Loading modules from /home/green/git/lustre-release/lustre oleg136-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg136-server: detected 4 online CPUs by sysfs oleg136-server: MODOPTS_LIBCFS= oleg136-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg136-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg136-server: oleg136-server.virtnet: executing set_default_debug -1 all pdsh@oleg136-client: oleg136-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg136-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg136-server: oleg136-server.virtnet: executing set_default_debug -1 all pdsh@oleg136-client: oleg136-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg136-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg136-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg136-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg136-server: oleg136-server.virtnet: executing set_default_debug -1 all pdsh@oleg136-client: oleg136-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg136-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg136-client.virtnet: -o user_xattr,flock 192.168.201.136@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 1500 (time 1782483716.35 total 10.00 last 149.96) - open/close 2939 (time 1782483726.36 total 20.01 last 143.78) total: 4500 open/close in 28.81 seconds: 156.18 ops/second - /unlink 3036 (time 1782483747.05 total 10.00 last 303.52) total: 4500 /unlink in 15.09 seconds: 298.20 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 1506 (time 1782483764.27 total 10.00 last 150.59) - open/close 3041 (time 1782483774.28 total 20.00 last 153.44) total: 4500 open/close in 28.97 seconds: 155.32 ops/second - /unlink 3348 (time 1782483795.25 total 10.00 last 334.77) total: 4500 /unlink in 14.12 seconds: 318.78 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 1506 (time 1782483811.86 total 10.00 last 150.58) - open/close 3734 (time 1782483821.86 total 20.01 last 222.70) total: 4500 open/close in 23.80 seconds: 189.05 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 - /unlink 2994 (time 1782483837.59 total 10.00 last 299.38) total: 4500 /unlink in 14.74 seconds: 305.36 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 1916 (time 1782483854.29 total 10.00 last 191.59) - open/close 3777 (time 1782483864.30 total 20.00 last 186.06) total: 4500 open/close in 22.91 seconds: 196.40 ops/second total: 4500 /unlink in 8.41 seconds: 535.12 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 2739 (time 1782483888.83 total 10.00 last 273.87) - open/close 4496 (time 1782483898.83 total 20.00 last 175.66) total: 4500 open/close in 20.01 seconds: 224.86 ops/second - /unlink 4428 (time 1782483910.61 total 10.00 last 442.77) total: 4500 /unlink in 10.10 seconds: 445.54 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 1963 (time 1782483922.34 total 10.01 last 196.18) - open/close 3738 (time 1782483932.34 total 20.01 last 177.44) total: 4500 open/close in 23.22 seconds: 193.80 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 - /unlink 3528 (time 1782483947.35 total 10.00 last 352.77) total: 4500 /unlink in 12.59 seconds: 357.34 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 2243 (time 1782483961.81 total 10.01 last 224.11) - open/close 4044 (time 1782483971.81 total 20.01 last 180.01) total: 4500 open/close in 22.62 seconds: 198.93 ops/second total: 4500 /unlink in 8.29 seconds: 542.56 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 2360 (time 1782483996.12 total 10.00 last 235.98) - open/close 4321 (time 1782484006.12 total 20.00 last 196.05) total: 4500 open/close in 21.16 seconds: 212.70 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 total: 4500 /unlink in 9.78 seconds: 459.99 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 3282 (time 1782484030.89 total 10.00 last 328.14) total: 4500 open/close in 13.99 seconds: 321.67 ops/second total: 4500 /unlink in 8.03 seconds: 560.24 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 2982 (time 1782484055.76 total 10.00 last 298.16) total: 4500 open/close in 14.04 seconds: 320.61 ops/second - /unlink 4421 (time 1782484071.29 total 10.00 last 442.05) total: 4500 /unlink in 10.16 seconds: 442.81 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 1808 (time 1782484083.15 total 10.00 last 180.76) total: 4500 open/close in 18.90 seconds: 238.11 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 total: 4500 /unlink in 7.74 seconds: 581.58 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 2815 (time 1782484112.65 total 10.00 last 281.48) total: 4500 open/close in 16.42 seconds: 274.03 ops/second total: 4500 /unlink in 9.35 seconds: 481.50 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 3047 (time 1782484141.37 total 10.00 last 304.66) total: 4500 open/close in 13.93 seconds: 322.99 ops/second total: 4500 /unlink in 8.34 seconds: 539.32 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 lustre-MDT0000: clear the changelog for cl1 to record #246998 - open/close 1125 (time 1782484166.64 total 10.00 last 112.46) - open/close 2098 (time 1782484176.64 total 20.01 last 97.28) - open/close 3261 (time 1782484186.64 total 30.01 last 116.29) - open/close 4398 (time 1782484196.64 total 40.01 last 113.70) total: 4500 open/close in 41.06 seconds: 109.59 ops/second - /unlink 1201 (time 1782484210.93 total 10.00 last 120.10) - /unlink 2648 (time 1782484220.94 total 20.01 last 144.60) total: 4500 /unlink in 28.87 seconds: 155.86 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 1138 (time 1782484242.83 total 10.01 last 113.72) - open/close 2417 (time 1782484252.84 total 20.01 last 127.81) - open/close 3824 (time 1782484262.85 total 30.03 last 140.54) total: 4500 open/close in 34.78 seconds: 129.40 ops/second - /unlink 2021 (time 1782484280.27 total 10.00 last 202.06) - /unlink 4041 (time 1782484290.28 total 20.00 last 201.95) total: 4500 /unlink in 21.92 seconds: 205.26 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 1247 (time 1782484305.02 total 10.00 last 124.69) - open/close 2461 (time 1782484315.02 total 20.00 last 121.36) - open/close 3684 (time 1782484325.03 total 30.01 last 122.23) total: 4500 open/close in 36.39 seconds: 123.68 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 - /unlink 2293 (time 1782484344.13 total 10.00 last 229.30) - /unlink 4130 (time 1782484354.13 total 20.01 last 183.58) total: 4500 /unlink in 24.23 seconds: 185.74 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 387 (time 1782484376.23 total 10.02 last 38.63) - open/close 933 (time 1782484386.24 total 20.03 last 54.56) - open/close 1467 (time 1782484396.26 total 30.05 last 53.26) - open/close 1900 (time 1782484406.27 total 40.06 last 43.28) - open/close 2460 (time 1782484416.28 total 50.07 last 55.94) - open/close 3023 (time 1782484426.31 total 60.10 last 56.12) - open/close 3720 (time 1782484436.33 total 70.12 last 69.58) - open/close 4386 (time 1782484446.35 total 80.14 last 66.49) total: 4500 open/close in 81.52 seconds: 55.20 ops/second - /unlink 1531 (time 1782484462.26 total 10.01 last 153.00) - /unlink 2761 (time 1782484472.26 total 20.01 last 122.98) - /unlink 4177 (time 1782484482.26 total 30.01 last 141.59) total: 4500 /unlink in 32.12 seconds: 140.09 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 833 (time 1782484498.83 total 10.01 last 83.25) - open/close 1821 (time 1782484508.84 total 20.01 last 98.72) - open/close 2633 (time 1782484518.84 total 30.02 last 81.12) - open/close 3490 (time 1782484528.85 total 40.03 last 85.66) - open/close 4404 (time 1782484538.86 total 50.04 last 91.30) total: 4500 open/close in 50.97 seconds: 88.29 ops/second - /unlink 1421 (time 1782484554.69 total 10.00 last 142.04) - /unlink 2784 (time 1782484564.69 total 20.01 last 136.26) - /unlink 4287 (time 1782484574.69 total 30.01 last 150.26) total: 4500 /unlink in 31.59 seconds: 142.45 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11242: 94363 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg136-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg136-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg136-server stop mds service on oleg136-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg136-server stop mds service on oleg136-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg136-server unloading modules via unload_modules_local on: 'oleg136-server' oleg136-server: oleg136-server.virtnet: executing unload_modules_local oleg136-server: modules unloaded.