== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 09:21:51 (1781011311) Stopping clients: oleg139-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg139-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg139-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg139-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg139-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg139-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg139-server oleg139-server: oleg139-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1045: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg139-server' oleg139-server: oleg139-server.virtnet: executing load_modules_local oleg139-server: Loading modules from /home/green/git/lustre-release/lustre oleg139-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1045: echo: write error: Device or resource busy oleg139-server: detected 4 online CPUs by sysfs oleg139-server: MODOPTS_LIBCFS= oleg139-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg139-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg139-server: oleg139-server.virtnet: executing set_default_debug -1 all pdsh@oleg139-client: oleg139-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg139-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg139-server: oleg139-server.virtnet: executing set_default_debug -1 all pdsh@oleg139-client: oleg139-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg139-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg139-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg139-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg139-server: oleg139-server.virtnet: executing set_default_debug -1 all pdsh@oleg139-client: oleg139-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg139-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg139-client.virtnet: -o user_xattr,flock 192.168.201.139@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H crush /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 4068 (time 1781011403.17 total 10.00 last 406.80) total: 4500 open/close in 11.19 seconds: 402.31 ops/second total: 4500 /unlink in 5.85 seconds: 768.89 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 3767 (time 1781011422.97 total 10.00 last 376.65) total: 4500 open/close in 12.01 seconds: 374.74 ops/second total: 4500 /unlink in 9.11 seconds: 493.73 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 3070 (time 1781011447.10 total 10.00 last 306.97) total: 4500 open/close in 16.89 seconds: 266.46 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 total: 4500 /unlink in 6.72 seconds: 669.52 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 2700 (time 1781011473.63 total 10.00 last 269.90) total: 4500 open/close in 16.66 seconds: 270.06 ops/second total: 4500 /unlink in 7.21 seconds: 624.22 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 3206 (time 1781011500.30 total 10.00 last 320.59) total: 4500 open/close in 13.63 seconds: 330.03 ops/second total: 4500 /unlink in 6.85 seconds: 656.70 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 3277 (time 1781011523.59 total 10.00 last 327.55) total: 4500 open/close in 14.10 seconds: 319.06 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 total: 4500 /unlink in 5.88 seconds: 764.99 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 3249 (time 1781011546.13 total 10.00 last 324.81) total: 4500 open/close in 14.06 seconds: 319.96 ops/second total: 4500 /unlink in 8.24 seconds: 546.32 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 1883 (time 1781011571.37 total 10.01 last 188.21) - open/close 3036 (time 1781011581.37 total 20.01 last 115.28) - open/close 4441 (time 1781011591.37 total 30.01 last 140.43) total: 4500 open/close in 30.38 seconds: 148.14 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 - /unlink 2603 (time 1781011604.43 total 10.00 last 260.27) - /unlink 4372 (time 1781011614.44 total 20.01 last 176.76) total: 4500 /unlink in 21.12 seconds: 213.11 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 906 (time 1781011629.45 total 10.00 last 90.57) - open/close 1967 (time 1781011639.45 total 20.01 last 106.05) - open/close 3056 (time 1781011649.46 total 30.01 last 108.84) - open/close 4115 (time 1781011659.46 total 40.02 last 105.86) total: 4500 open/close in 43.26 seconds: 104.02 ops/second - /unlink 2293 (time 1781011675.45 total 10.00 last 229.28) total: 4500 /unlink in 19.93 seconds: 225.78 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 1083 (time 1781011697.91 total 10.00 last 108.30) - open/close 2176 (time 1781011707.91 total 20.00 last 109.30) - open/close 3315 (time 1781011717.91 total 30.00 last 113.87) total: 4500 open/close in 39.70 seconds: 113.36 ops/second - /unlink 2046 (time 1781011739.71 total 10.00 last 204.56) - /unlink 4335 (time 1781011749.71 total 20.00 last 228.86) total: 4500 /unlink in 20.46 seconds: 219.97 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 1181 (time 1781011762.80 total 10.01 last 118.03) - open/close 2371 (time 1781011772.80 total 20.01 last 118.96) - open/close 3584 (time 1781011782.80 total 30.01 last 121.26) total: 4500 open/close in 37.97 seconds: 118.50 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 - /unlink 2085 (time 1781011803.66 total 10.01 last 208.38) - /unlink 4287 (time 1781011813.67 total 20.01 last 220.02) total: 4500 /unlink in 21.13 seconds: 212.94 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 1082 (time 1781011827.55 total 10.00 last 108.16) - open/close 2285 (time 1781011837.55 total 20.01 last 120.27) - open/close 3372 (time 1781011847.56 total 30.01 last 108.66) - open/close 4371 (time 1781011857.56 total 40.01 last 99.90) total: 4500 open/close in 41.29 seconds: 108.99 ops/second - /unlink 2019 (time 1781011871.67 total 10.01 last 201.74) - /unlink 3944 (time 1781011881.67 total 20.01 last 192.41) total: 4500 /unlink in 22.87 seconds: 196.74 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 1104 (time 1781011897.18 total 10.00 last 110.38) - open/close 2163 (time 1781011907.19 total 20.01 last 105.85) - open/close 3236 (time 1781011917.19 total 30.01 last 107.24) - open/close 4334 (time 1781011927.20 total 40.02 last 109.75) total: 4500 open/close in 41.43 seconds: 108.63 ops/second - /unlink 2084 (time 1781011941.30 total 10.00 last 208.36) - /unlink 4394 (time 1781011951.30 total 20.00 last 231.00) total: 4500 /unlink in 20.67 seconds: 217.72 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 lustre-MDT0000: clear the changelog for cl1 to record #246998 - open/close 1062 (time 1781011964.74 total 10.01 last 106.15) - open/close 2120 (time 1781011974.74 total 20.01 last 105.79) - open/close 3249 (time 1781011984.76 total 30.02 last 112.75) - open/close 4366 (time 1781011994.77 total 40.03 last 111.59) total: 4500 open/close in 41.14 seconds: 109.38 ops/second - /unlink 2407 (time 1781012008.36 total 10.01 last 240.53) - /unlink 4388 (time 1781012018.36 total 20.01 last 198.00) total: 4500 /unlink in 20.92 seconds: 215.15 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 1150 (time 1781012032.43 total 10.01 last 114.93) - open/close 2288 (time 1781012042.44 total 20.01 last 113.69) - open/close 3326 (time 1781012052.44 total 30.02 last 103.76) - open/close 4465 (time 1781012062.45 total 40.02 last 113.84) total: 4500 open/close in 40.35 seconds: 111.52 ops/second - /unlink 2167 (time 1781012075.62 total 10.01 last 216.59) - /unlink 4349 (time 1781012085.62 total 20.01 last 218.15) total: 4500 /unlink in 20.69 seconds: 217.55 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 1197 (time 1781012099.02 total 10.00 last 119.68) - open/close 2370 (time 1781012109.02 total 20.00 last 117.28) - open/close 3619 (time 1781012119.02 total 30.00 last 124.88) total: 4500 open/close in 36.73 seconds: 122.51 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 - /unlink 2658 (time 1781012138.00 total 10.01 last 265.65) total: 4500 /unlink in 17.25 seconds: 260.86 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 1153 (time 1781012157.80 total 10.00 last 115.29) - open/close 2408 (time 1781012167.80 total 20.00 last 125.50) - open/close 3733 (time 1781012177.81 total 30.00 last 132.45) total: 4500 open/close in 36.17 seconds: 124.40 ops/second - /unlink 2243 (time 1781012195.98 total 10.00 last 224.20) - /unlink 4489 (time 1781012205.98 total 20.01 last 224.51) total: 4500 /unlink in 20.06 seconds: 224.36 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 1259 (time 1781012218.65 total 10.01 last 125.80) - open/close 2545 (time 1781012228.65 total 20.01 last 128.55) - open/close 3855 (time 1781012238.65 total 30.01 last 130.97) total: 4500 open/close in 34.32 seconds: 131.13 ops/second - /unlink 2684 (time 1781012254.84 total 10.00 last 268.39) total: 4500 /unlink in 17.13 seconds: 262.68 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11203: 93264 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg139-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg139-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg139-server stop mds service on oleg139-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg139-server stop mds service on oleg139-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg139-server unloading modules via unload_modules_local on: 'oleg139-server' oleg139-server: oleg139-server.virtnet: executing unload_modules_local oleg139-server: modules unloaded.