== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 14:00:59 (1789063259) Stopping clients: oleg156-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg156-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg156-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg156-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg156-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg156-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg156-server oleg156-server: oleg156-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg156-server' oleg156-server: oleg156-server.virtnet: executing load_modules_local oleg156-server: kmemleak disabled oleg156-server: Loading modules from /home/green/git/lustre-release/lustre oleg156-server: detected 4 online CPUs by sysfs oleg156-server: MODOPTS_LIBCFS= oleg156-server: Force libcfs to create 2 CPU partitions oleg156-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg156-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg156-server: oleg156-server.virtnet: executing set_default_debug -1 all pdsh@oleg156-client: oleg156-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg156-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg156-server: oleg156-server.virtnet: executing set_default_debug -1 all pdsh@oleg156-client: oleg156-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg156-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg156-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg156-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg156-server: oleg156-server.virtnet: executing set_default_debug -1 all pdsh@oleg156-client: oleg156-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg156-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg156-client.virtnet: -o user_xattr,flock 192.168.201.156@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 515 (time 1789063509.01 total 10.00 last 51.48) - open/close 1278 (time 1789063519.01 total 20.01 last 76.28) - open/close 2144 (time 1789063529.02 total 30.01 last 86.53) - open/close 3004 (time 1789063539.03 total 40.02 last 85.97) - open/close 3722 (time 1789063549.03 total 50.02 last 71.79) total: 4500 open/close in 59.33 seconds: 75.84 ops/second - /unlink 1276 (time 1789063572.78 total 10.00 last 127.58) - /unlink 2515 (time 1789063582.78 total 20.00 last 123.90) - /unlink 3496 (time 1789063592.79 total 30.01 last 98.05) total: 4500 /unlink in 38.15 seconds: 117.94 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 1030 (time 1789063616.91 total 10.01 last 102.92) - open/close 1684 (time 1789063626.92 total 20.01 last 65.36) - open/close 2315 (time 1789063636.93 total 30.03 last 63.02) - open/close 2839 (time 1789063646.96 total 40.06 last 52.25) - open/close 3523 (time 1789063656.97 total 50.07 last 68.31) - open/close 4373 (time 1789063666.98 total 60.07 last 84.95) total: 4500 open/close in 61.81 seconds: 72.81 ops/second - /unlink 1145 (time 1789063684.48 total 10.00 last 114.48) - /unlink 2521 (time 1789063694.49 total 20.02 last 137.39) - /unlink 3890 (time 1789063704.50 total 30.03 last 136.74) total: 4500 /unlink in 33.80 seconds: 133.13 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 722 (time 1789063724.91 total 10.02 last 72.02) - open/close 1412 (time 1789063734.91 total 20.03 last 68.99) - open/close 2132 (time 1789063744.92 total 30.03 last 71.97) - open/close 3012 (time 1789063754.93 total 40.04 last 87.88) - open/close 3996 (time 1789063764.94 total 50.05 last 98.37) total: 4500 open/close in 56.17 seconds: 80.11 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 - /unlink 1676 (time 1789063785.42 total 10.00 last 167.60) - /unlink 3026 (time 1789063795.42 total 20.00 last 135.00) total: 4500 /unlink in 28.19 seconds: 159.61 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 860 (time 1789063818.14 total 10.01 last 85.96) - open/close 1591 (time 1789063828.14 total 20.01 last 73.09) - open/close 2405 (time 1789063838.14 total 30.01 last 81.40) - open/close 3261 (time 1789063848.15 total 40.01 last 85.57) - open/close 4094 (time 1789063858.16 total 50.02 last 83.19) total: 4500 open/close in 55.60 seconds: 80.94 ops/second - /unlink 1972 (time 1789063878.09 total 10.00 last 197.14) - /unlink 3506 (time 1789063888.10 total 20.02 last 153.20) total: 4500 /unlink in 27.30 seconds: 164.81 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 892 (time 1789063911.12 total 10.00 last 89.19) - open/close 1619 (time 1789063921.12 total 20.00 last 72.70) - open/close 2633 (time 1789063931.13 total 30.01 last 101.34) - open/close 3662 (time 1789063941.13 total 40.01 last 102.83) total: 4500 open/close in 49.64 seconds: 90.65 ops/second - /unlink 1588 (time 1789063965.30 total 10.00 last 158.76) - /unlink 3094 (time 1789063975.31 total 20.01 last 150.53) total: 4500 /unlink in 27.76 seconds: 162.08 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 597 (time 1789063999.17 total 10.02 last 59.58) - open/close 1233 (time 1789064009.18 total 20.03 last 63.51) - open/close 1857 (time 1789064019.18 total 30.04 last 62.38) - open/close 2534 (time 1789064029.20 total 40.05 last 67.62) - open/close 3305 (time 1789064039.22 total 50.07 last 76.94) - open/close 3818 (time 1789064049.24 total 60.09 last 51.20) - open/close 4404 (time 1789064059.24 total 70.09 last 58.58) total: 4500 open/close in 72.36 seconds: 62.19 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 - /unlink 1340 (time 1789064078.98 total 10.00 last 134.00) - /unlink 2685 (time 1789064088.99 total 20.00 last 134.45) total: 4500 /unlink in 29.37 seconds: 153.21 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 894 (time 1789064113.50 total 10.01 last 89.35) - open/close 1896 (time 1789064123.52 total 20.02 last 100.01) - open/close 2680 (time 1789064133.52 total 30.03 last 78.37) - open/close 3524 (time 1789064143.52 total 40.03 last 84.40) - open/close 4342 (time 1789064153.52 total 50.03 last 81.79) total: 4500 open/close in 52.11 seconds: 86.36 ops/second - /unlink 1807 (time 1789064170.38 total 10.00 last 180.64) - /unlink 3627 (time 1789064180.38 total 20.00 last 181.98) total: 4500 /unlink in 24.82 seconds: 181.33 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 857 (time 1789064200.72 total 10.00 last 85.69) - open/close 1799 (time 1789064210.73 total 20.01 last 94.12) - open/close 2854 (time 1789064220.73 total 30.02 last 105.43) - open/close 3666 (time 1789064230.74 total 40.03 last 81.12) - open/close 4493 (time 1789064240.75 total 50.03 last 82.64) total: 4500 open/close in 50.09 seconds: 89.84 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 - /unlink 1527 (time 1789064255.41 total 10.01 last 152.60) - /unlink 3039 (time 1789064265.41 total 20.01 last 151.15) total: 4500 /unlink in 29.69 seconds: 151.54 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 879 (time 1789064289.46 total 10.01 last 87.78) - open/close 1636 (time 1789064299.46 total 20.02 last 75.68) - open/close 2461 (time 1789064309.48 total 30.03 last 82.38) - open/close 3409 (time 1789064319.49 total 40.05 last 94.63) - open/close 4237 (time 1789064329.50 total 50.06 last 82.74) total: 4500 open/close in 53.08 seconds: 84.77 ops/second - /unlink 1672 (time 1789064347.16 total 10.00 last 167.16) - /unlink 3346 (time 1789064357.16 total 20.00 last 167.39) total: 4500 /unlink in 26.31 seconds: 171.03 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 899 (time 1789064378.00 total 10.02 last 89.71) - open/close 1796 (time 1789064388.00 total 20.03 last 89.65) - open/close 2567 (time 1789064398.01 total 30.03 last 77.07) - open/close 3340 (time 1789064408.02 total 40.04 last 77.22) - open/close 4174 (time 1789064418.03 total 50.05 last 83.30) total: 4500 open/close in 53.37 seconds: 84.31 ops/second - /unlink 1855 (time 1789064435.34 total 10.01 last 185.40) - /unlink 3551 (time 1789064445.34 total 20.01 last 169.52) total: 4500 /unlink in 26.50 seconds: 169.79 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 824 (time 1789064466.42 total 10.00 last 82.39) - open/close 1662 (time 1789064476.42 total 20.01 last 83.74) - open/close 2666 (time 1789064486.44 total 30.02 last 100.29) - open/close 3441 (time 1789064496.44 total 40.02 last 77.46) - open/close 4349 (time 1789064506.46 total 50.04 last 90.64) total: 4500 open/close in 51.54 seconds: 87.31 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 - /unlink 1818 (time 1789064521.86 total 10.00 last 181.75) - /unlink 3665 (time 1789064531.87 total 20.00 last 184.68) total: 4500 /unlink in 24.61 seconds: 182.86 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 853 (time 1789064550.87 total 10.00 last 85.28) - open/close 1703 (time 1789064560.88 total 20.01 last 84.95) - open/close 2580 (time 1789064570.89 total 30.02 last 87.61) - open/close 3504 (time 1789064580.89 total 40.03 last 92.34) - open/close 4437 (time 1789064590.90 total 50.03 last 93.27) total: 4500 open/close in 51.70 seconds: 87.05 ops/second - /unlink 1870 (time 1789064607.17 total 10.00 last 186.94) - /unlink 3479 (time 1789064617.17 total 20.01 last 160.82) total: 4500 /unlink in 26.31 seconds: 171.01 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 780 (time 1789064637.99 total 10.00 last 77.99) - open/close 1655 (time 1789064648.00 total 20.01 last 87.43) - open/close 2613 (time 1789064658.01 total 30.02 last 95.72) - open/close 3320 (time 1789064668.02 total 40.03 last 70.59) - open/close 3980 (time 1789064678.03 total 50.04 last 65.97) total: 4500 open/close in 56.85 seconds: 79.16 ops/second - /unlink 1760 (time 1789064700.52 total 10.00 last 175.98) - /unlink 3426 (time 1789064710.52 total 20.00 last 166.59) total: 4500 /unlink in 28.95 seconds: 155.45 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 lustre-MDT0000: clear the changelog for cl1 to record #246998 - open/close 680 (time 1789064734.13 total 10.00 last 67.97) - open/close 1517 (time 1789064744.13 total 20.00 last 83.70) - open/close 2394 (time 1789064754.15 total 30.02 last 87.56) - open/close 3245 (time 1789064764.16 total 40.03 last 85.02) - open/close 4016 (time 1789064774.18 total 50.05 last 76.96) total: 4500 open/close in 56.16 seconds: 80.13 ops/second - /unlink 1297 (time 1789064795.34 total 10.02 last 129.47) - /unlink 2446 (time 1789064805.35 total 20.02 last 114.87) - /unlink 3888 (time 1789064815.35 total 30.02 last 144.17) total: 4500 /unlink in 34.33 seconds: 131.07 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 743 (time 1789064835.23 total 10.01 last 74.26) - open/close 1470 (time 1789064845.23 total 20.01 last 72.67) - open/close 2366 (time 1789064855.26 total 30.03 last 89.41) - open/close 3232 (time 1789064865.26 total 40.04 last 86.52) - open/close 4107 (time 1789064875.27 total 50.04 last 87.47) total: 4500 open/close in 53.74 seconds: 83.73 ops/second - /unlink 1867 (time 1789064893.19 total 10.00 last 186.69) - /unlink 3650 (time 1789064903.20 total 20.01 last 178.15) total: 4500 /unlink in 24.83 seconds: 181.23 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 706 (time 1789064923.18 total 10.04 last 70.30) - open/close 1332 (time 1789064933.19 total 20.05 last 62.55) - open/close 2225 (time 1789064943.20 total 30.06 last 89.19) - open/close 3101 (time 1789064953.20 total 40.06 last 87.59) - open/close 4002 (time 1789064963.20 total 50.06 last 90.09) total: 4500 open/close in 55.09 seconds: 81.69 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 - /unlink 1758 (time 1789064982.31 total 10.00 last 175.74) - /unlink 3360 (time 1789064992.31 total 20.01 last 160.12) total: 4500 /unlink in 26.07 seconds: 172.62 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 851 (time 1789065012.61 total 10.00 last 85.09) - open/close 1709 (time 1789065022.61 total 20.01 last 85.76) - open/close 2671 (time 1789065032.62 total 30.01 last 96.15) - open/close 3503 (time 1789065042.62 total 40.02 last 83.16) - open/close 4457 (time 1789065052.63 total 50.02 last 95.32) total: 4500 open/close in 50.77 seconds: 88.63 ops/second - /unlink 1339 (time 1789065067.84 total 10.01 last 133.83) - /unlink 2662 (time 1789065077.85 total 20.01 last 132.24) - /unlink 3844 (time 1789065087.85 total 30.01 last 118.17) total: 4500 /unlink in 34.89 seconds: 128.98 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 673 (time 1789065107.05 total 10.01 last 67.26) - open/close 1514 (time 1789065117.05 total 20.01 last 84.10) - open/close 2355 (time 1789065127.06 total 30.01 last 84.02) - open/close 3176 (time 1789065137.08 total 40.03 last 81.98) - open/close 4026 (time 1789065147.08 total 50.03 last 84.95) total: 4500 open/close in 55.04 seconds: 81.76 ops/second - /unlink 1458 (time 1789065166.69 total 10.00 last 145.75) - /unlink 2608 (time 1789065176.69 total 20.01 last 114.95) - /unlink 4059 (time 1789065186.70 total 30.01 last 145.04) total: 4500 /unlink in 33.91 seconds: 132.70 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11344: 95355 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg156-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg156-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg156-server stop mds service on oleg156-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg156-server stop mds service on oleg156-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg156-server unloading modules via unload_modules_local on: 'oleg156-server' oleg156-server: oleg156-server.virtnet: executing unload_modules_local oleg156-server: kmemleak disabled modules unloaded.