== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 14:20:50 (1780856450) Stopping clients: oleg451-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg451-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg451-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg451-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg451-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg451-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg451-server oleg451-server: oleg451-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg451-server' oleg451-server: oleg451-server.virtnet: executing load_modules_local oleg451-server: Loading modules from /home/green/git/lustre-release/lustre oleg451-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg451-server: detected 4 online CPUs by sysfs oleg451-server: MODOPTS_LIBCFS= oleg451-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg451-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg451-server: oleg451-server.virtnet: executing set_default_debug -1 all pdsh@oleg451-client: oleg451-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg451-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg451-server: oleg451-server.virtnet: executing set_default_debug -1 all pdsh@oleg451-client: oleg451-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg451-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg451-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg451-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg451-server: oleg451-server.virtnet: executing set_default_debug -1 all pdsh@oleg451-client: oleg451-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg451-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg451-client.virtnet: -o user_xattr,flock 192.168.204.151@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H all_char /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 1062 (time 1780856589.07 total 10.00 last 106.17) - open/close 2114 (time 1780856599.07 total 20.01 last 105.17) - open/close 3105 (time 1780856609.08 total 30.01 last 99.06) - open/close 4033 (time 1780856619.08 total 40.02 last 92.74) total: 4500 open/close in 45.33 seconds: 99.28 ops/second - /unlink 1683 (time 1780856637.16 total 10.00 last 168.26) - /unlink 3490 (time 1780856647.16 total 20.00 last 180.69) total: 4500 /unlink in 26.52 seconds: 169.66 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 877 (time 1780856666.84 total 10.01 last 87.59) - open/close 1748 (time 1780856676.84 total 20.02 last 87.08) - open/close 2899 (time 1780856686.85 total 30.02 last 115.05) - open/close 3863 (time 1780856696.85 total 40.03 last 96.35) total: 4500 open/close in 46.28 seconds: 97.24 ops/second - /unlink 2375 (time 1780856715.50 total 10.00 last 237.46) total: 4500 /unlink in 19.68 seconds: 228.68 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 1245 (time 1780856737.96 total 10.00 last 124.50) - open/close 2753 (time 1780856747.97 total 20.01 last 150.70) - open/close 4368 (time 1780856757.97 total 30.01 last 161.44) total: 4500 open/close in 30.82 seconds: 146.02 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 - /unlink 2974 (time 1780856770.75 total 10.00 last 297.40) total: 4500 /unlink in 15.24 seconds: 295.21 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 1189 (time 1780856787.94 total 10.00 last 118.87) - open/close 2172 (time 1780856797.95 total 20.01 last 98.22) - open/close 3257 (time 1780856807.95 total 30.01 last 108.48) - open/close 4366 (time 1780856817.97 total 40.03 last 110.67) total: 4500 open/close in 41.27 seconds: 109.04 ops/second - /unlink 2100 (time 1780856831.61 total 10.00 last 209.98) - /unlink 4046 (time 1780856841.61 total 20.00 last 194.52) total: 4500 /unlink in 22.00 seconds: 204.55 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 1269 (time 1780856855.72 total 10.00 last 126.85) - open/close 2314 (time 1780856865.73 total 20.00 last 104.49) - open/close 3419 (time 1780856875.73 total 30.01 last 110.41) - open/close 4482 (time 1780856885.74 total 40.02 last 106.21) total: 4500 open/close in 40.18 seconds: 111.99 ops/second - /unlink 2202 (time 1780856898.37 total 10.00 last 220.15) total: 4500 /unlink in 19.72 seconds: 228.16 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 1128 (time 1780856920.46 total 10.00 last 112.77) - open/close 2275 (time 1780856930.47 total 20.01 last 114.61) - open/close 3461 (time 1780856940.47 total 30.02 last 118.54) total: 4500 open/close in 37.14 seconds: 121.17 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 - /unlink 2429 (time 1780856959.87 total 10.00 last 242.83) - /unlink 4441 (time 1780856969.88 total 20.01 last 201.08) total: 4500 /unlink in 20.30 seconds: 221.67 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 942 (time 1780856983.06 total 10.01 last 94.12) - open/close 1871 (time 1780856993.07 total 20.01 last 92.87) - open/close 3067 (time 1780857003.07 total 30.02 last 119.53) - open/close 4435 (time 1780857013.08 total 40.02 last 136.69) total: 4500 open/close in 40.57 seconds: 110.91 ops/second - /unlink 2227 (time 1780857026.03 total 10.00 last 222.68) total: 4500 /unlink in 19.59 seconds: 229.73 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 1192 (time 1780857047.76 total 10.00 last 119.14) - open/close 2408 (time 1780857057.77 total 20.01 last 121.51) - open/close 3534 (time 1780857067.77 total 30.01 last 112.60) total: 4500 open/close in 36.92 seconds: 121.88 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 - /unlink 2410 (time 1780857086.71 total 10.00 last 240.93) total: 4500 /unlink in 17.64 seconds: 255.13 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 1404 (time 1780857106.36 total 10.01 last 140.32) - open/close 2789 (time 1780857116.36 total 20.01 last 138.50) - open/close 4458 (time 1780857126.37 total 30.01 last 166.82) total: 4500 open/close in 30.30 seconds: 148.51 ops/second - /unlink 2634 (time 1780857138.66 total 10.00 last 263.31) total: 4500 /unlink in 16.48 seconds: 273.05 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 1144 (time 1780857157.29 total 10.00 last 114.38) - open/close 2311 (time 1780857167.30 total 20.01 last 116.61) - open/close 3740 (time 1780857177.30 total 30.01 last 142.86) total: 4500 open/close in 36.09 seconds: 124.69 ops/second - /unlink 2891 (time 1780857195.55 total 10.00 last 289.06) total: 4500 /unlink in 15.46 seconds: 290.99 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 2590 (time 1780857213.00 total 10.00 last 258.95) total: 4500 open/close in 19.92 seconds: 225.86 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 - /unlink 4435 (time 1780857234.83 total 10.00 last 443.45) total: 4500 /unlink in 10.12 seconds: 444.52 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 2486 (time 1780857246.74 total 10.00 last 248.58) total: 4500 open/close in 16.97 seconds: 265.16 ops/second - /unlink 4327 (time 1780857265.61 total 10.00 last 432.69) total: 4500 /unlink in 10.56 seconds: 426.02 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 2680 (time 1780857277.91 total 10.00 last 268.00) total: 4500 open/close in 16.22 seconds: 277.37 ops/second total: 4500 /unlink in 6.79 seconds: 662.35 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 lustre-MDT0000: clear the changelog for cl1 to record #246998 - open/close 3496 (time 1780857304.11 total 10.00 last 349.57) total: 4500 open/close in 13.01 seconds: 345.93 ops/second total: 4500 /unlink in 7.84 seconds: 574.10 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 2165 (time 1780857327.87 total 10.00 last 216.45) - open/close 4292 (time 1780857337.87 total 20.00 last 212.70) total: 4500 open/close in 21.19 seconds: 212.37 ops/second - /unlink 3635 (time 1780857350.77 total 10.00 last 363.44) total: 4500 /unlink in 12.08 seconds: 372.65 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 1873 (time 1780857364.73 total 10.00 last 187.26) - open/close 3890 (time 1780857374.73 total 20.00 last 201.67) total: 4500 open/close in 23.56 seconds: 191.01 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 - /unlink 4380 (time 1780857389.99 total 10.00 last 437.95) total: 4500 /unlink in 10.20 seconds: 441.22 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 2944 (time 1780857401.84 total 10.00 last 294.35) total: 4500 open/close in 16.33 seconds: 275.48 ops/second total: 4500 /unlink in 8.37 seconds: 537.38 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 3062 (time 1780857429.59 total 10.00 last 306.14) total: 4500 open/close in 15.01 seconds: 299.87 ops/second - /unlink 4165 (time 1780857446.26 total 10.00 last 416.49) total: 4500 /unlink in 10.91 seconds: 412.48 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11196: 93791 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg451-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg451-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg451-server stop mds service on oleg451-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg451-server stop mds service on oleg451-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg451-server unloading modules via unload_modules_local on: 'oleg451-server' oleg451-server: oleg451-server.virtnet: executing unload_modules_local oleg451-server: modules unloaded.