== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 17:26:07 (1788902767) Stopping clients: oleg444-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg444-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg444-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg444-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg444-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg444-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg444-server oleg444-server: oleg444-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg444-server' oleg444-server: oleg444-server.virtnet: executing load_modules_local oleg444-server: kmemleak disabled oleg444-server: Loading modules from /home/green/git/lustre-release/lustre oleg444-server: detected 4 online CPUs by sysfs oleg444-server: MODOPTS_LIBCFS= oleg444-server: Force libcfs to create 2 CPU partitions oleg444-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg444-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg444-server: oleg444-server.virtnet: executing set_default_debug -1 all pdsh@oleg444-client: oleg444-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg444-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg444-server: oleg444-server.virtnet: executing set_default_debug -1 all pdsh@oleg444-client: oleg444-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg444-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg444-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg444-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg444-server: oleg444-server.virtnet: executing set_default_debug -1 all pdsh@oleg444-client: oleg444-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg444-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg444-client.virtnet: -o user_xattr,flock 192.168.204.144@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H crush /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 1367 (time 1788902874.00 total 10.01 last 136.58) - open/close 1802 (time 1788902884.02 total 20.02 last 43.43) - open/close 2240 (time 1788902894.04 total 30.05 last 43.71) - open/close 2596 (time 1788902904.07 total 40.07 last 35.50) - open/close 2902 (time 1788902914.11 total 50.11 last 30.48) - open/close 3112 (time 1788902924.14 total 60.15 last 20.92) - open/close 3424 (time 1788902934.17 total 70.18 last 31.12) - open/close 3988 (time 1788902944.19 total 80.19 last 56.32) - open/close 4432 (time 1788902954.21 total 90.22 last 44.28) total: 4500 open/close in 92.44 seconds: 48.68 ops/second - /unlink 840 (time 1788902973.20 total 10.01 last 83.94) - /unlink 1676 (time 1788902983.21 total 20.01 last 83.55) - /unlink 2840 (time 1788902993.21 total 30.02 last 116.35) - /unlink 4054 (time 1788903003.22 total 40.03 last 121.30) total: 4500 /unlink in 43.06 seconds: 104.50 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 635 (time 1788903021.00 total 10.01 last 63.47) - open/close 1269 (time 1788903031.00 total 20.01 last 63.39) - open/close 1869 (time 1788903041.01 total 30.02 last 59.92) - open/close 2451 (time 1788903051.01 total 40.02 last 58.19) - open/close 3093 (time 1788903061.02 total 50.03 last 64.16) - open/close 3715 (time 1788903071.02 total 60.03 last 62.19) - open/close 4338 (time 1788903081.02 total 70.03 last 62.29) total: 4500 open/close in 72.16 seconds: 62.36 ops/second - /unlink 1206 (time 1788903098.23 total 10.01 last 120.50) - /unlink 2381 (time 1788903108.23 total 20.01 last 117.49) - /unlink 3588 (time 1788903118.25 total 30.02 last 120.52) total: 4500 /unlink in 37.18 seconds: 121.02 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 602 (time 1788903141.02 total 10.01 last 60.16) - open/close 1186 (time 1788903151.02 total 20.01 last 58.40) - open/close 1782 (time 1788903161.04 total 30.02 last 59.51) - open/close 2439 (time 1788903171.06 total 40.04 last 65.58) - open/close 3018 (time 1788903181.06 total 50.04 last 57.88) - open/close 3604 (time 1788903191.06 total 60.05 last 58.58) - open/close 4134 (time 1788903201.07 total 70.05 last 52.97) total: 4500 open/close in 76.48 seconds: 58.84 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 - /unlink 1060 (time 1788903223.09 total 10.00 last 105.97) - /unlink 2125 (time 1788903233.09 total 20.01 last 106.42) - /unlink 3300 (time 1788903243.10 total 30.02 last 117.43) - /unlink 4463 (time 1788903253.11 total 40.02 last 116.24) total: 4500 /unlink in 40.31 seconds: 111.63 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 647 (time 1788903268.53 total 10.01 last 64.66) - open/close 1305 (time 1788903278.54 total 20.02 last 65.72) - open/close 1947 (time 1788903288.55 total 30.03 last 64.13) - open/close 2545 (time 1788903298.57 total 40.05 last 59.68) - open/close 3211 (time 1788903308.58 total 50.06 last 66.53) - open/close 3861 (time 1788903318.59 total 60.06 last 64.99) - open/close 4292 (time 1788903328.59 total 70.06 last 43.08) total: 4500 open/close in 74.46 seconds: 60.43 ops/second - /unlink 1021 (time 1788903349.36 total 10.00 last 102.10) - /unlink 2104 (time 1788903359.37 total 20.01 last 108.23) - /unlink 3186 (time 1788903369.37 total 30.01 last 108.20) - /unlink 4199 (time 1788903379.37 total 40.01 last 101.28) total: 4500 /unlink in 42.58 seconds: 105.69 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 628 (time 1788903398.52 total 10.00 last 62.78) - open/close 1235 (time 1788903408.53 total 20.01 last 60.65) - open/close 1824 (time 1788903418.53 total 30.02 last 58.86) - open/close 2504 (time 1788903428.55 total 40.03 last 67.92) - open/close 3245 (time 1788903438.55 total 50.03 last 74.09) - open/close 3965 (time 1788903448.55 total 60.04 last 71.97) total: 4500 open/close in 67.69 seconds: 66.48 ops/second - /unlink 1550 (time 1788903469.97 total 10.00 last 154.92) - /unlink 3344 (time 1788903479.97 total 20.01 last 179.37) total: 4500 /unlink in 24.36 seconds: 184.75 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 1040 (time 1788903496.98 total 10.01 last 103.93) - open/close 2097 (time 1788903506.99 total 20.01 last 105.66) - open/close 3038 (time 1788903516.99 total 30.01 last 94.07) - open/close 4036 (time 1788903526.99 total 40.02 last 99.77) total: 4500 open/close in 44.06 seconds: 102.13 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 - /unlink 2401 (time 1788903543.00 total 10.00 last 240.08) total: 4500 /unlink in 17.64 seconds: 255.07 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 1328 (time 1788903562.51 total 10.00 last 132.76) - open/close 2496 (time 1788903572.51 total 20.00 last 116.80) - open/close 3703 (time 1788903582.52 total 30.01 last 120.67) total: 4500 open/close in 35.61 seconds: 126.37 ops/second - /unlink 2941 (time 1788903599.99 total 10.00 last 294.04) total: 4500 /unlink in 15.89 seconds: 283.18 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 1438 (time 1788903617.89 total 10.01 last 143.73) - open/close 2714 (time 1788903627.89 total 20.01 last 127.57) - open/close 4292 (time 1788903637.90 total 30.01 last 157.72) total: 4500 open/close in 31.42 seconds: 143.24 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 - /unlink 2305 (time 1788903651.43 total 10.02 last 230.10) total: 4500 /unlink in 19.56 seconds: 230.08 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 1340 (time 1788903673.21 total 10.00 last 133.94) - open/close 3026 (time 1788903683.21 total 20.01 last 168.54) - open/close 4474 (time 1788903693.21 total 30.01 last 144.80) total: 4500 open/close in 30.16 seconds: 149.22 ops/second - /unlink 3467 (time 1788903705.32 total 10.00 last 346.55) total: 4500 /unlink in 12.69 seconds: 354.61 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 1878 (time 1788903719.89 total 10.00 last 187.74) - open/close 3782 (time 1788903729.90 total 20.01 last 190.37) total: 4500 open/close in 24.23 seconds: 185.70 ops/second - /unlink 3261 (time 1788903745.96 total 10.00 last 326.03) total: 4500 /unlink in 13.51 seconds: 333.01 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 2697 (time 1788903761.16 total 10.00 last 269.63) total: 4500 open/close in 18.79 seconds: 239.44 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 total: 4500 /unlink in 9.61 seconds: 468.36 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 1859 (time 1788903792.73 total 10.00 last 185.82) - open/close 3765 (time 1788903802.74 total 20.01 last 190.57) total: 4500 open/close in 23.46 seconds: 191.80 ops/second total: 4500 /unlink in 8.63 seconds: 521.67 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 3566 (time 1788903827.87 total 10.00 last 356.54) total: 4500 open/close in 12.17 seconds: 369.85 ops/second total: 4500 /unlink in 5.60 seconds: 804.15 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 - open/close 4306 (time 1788903848.37 total 10.00 last 430.58) total: 4500 open/close in 10.44 seconds: 431.16 ops/second lustre-MDT0000: clear the changelog for cl1 to record #246998 total: 4500 /unlink in 4.83 seconds: 932.14 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 4109 (time 1788903866.20 total 10.00 last 410.87) total: 4500 open/close in 10.82 seconds: 415.98 ops/second total: 4500 /unlink in 4.71 seconds: 955.47 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 4448 (time 1788903884.22 total 10.00 last 444.69) total: 4500 open/close in 10.13 seconds: 444.22 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 total: 4500 /unlink in 5.30 seconds: 849.16 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 4260 (time 1788903902.20 total 10.00 last 425.92) total: 4500 open/close in 10.53 seconds: 427.27 ops/second total: 4500 /unlink in 5.48 seconds: 821.24 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 4179 (time 1788903920.85 total 10.00 last 417.87) total: 4500 open/close in 10.72 seconds: 419.71 ops/second total: 4500 /unlink in 5.71 seconds: 788.12 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11344: 94488 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg444-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg444-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg444-server stop mds service on oleg444-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg444-server stop mds service on oleg444-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg444-server unloading modules via unload_modules_local on: 'oleg444-server' oleg444-server: oleg444-server.virtnet: executing unload_modules_local oleg444-server: kmemleak disabled modules unloaded.