== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 02:05:58 (1786341958) Stopping clients: oleg336-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg336-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg336-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg336-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg336-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg336-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg336-server oleg336-server: oleg336-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg336-server' oleg336-server: oleg336-server.virtnet: executing load_modules_local oleg336-server: Loading modules from /home/green/git/lustre-release/lustre oleg336-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg336-server: detected 4 online CPUs by sysfs oleg336-server: MODOPTS_LIBCFS= oleg336-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg336-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg336-server: oleg336-server.virtnet: executing set_default_debug -1 all pdsh@oleg336-client: oleg336-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg336-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg336-server: oleg336-server.virtnet: executing set_default_debug -1 all pdsh@oleg336-client: oleg336-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg336-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg336-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg336-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg336-server: oleg336-server.virtnet: executing set_default_debug -1 all pdsh@oleg336-client: oleg336-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg336-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg336-client.virtnet: -o user_xattr,flock 192.168.203.136@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 1387 (time 1786342076.69 total 10.00 last 138.64) - open/close 2938 (time 1786342086.69 total 20.01 last 155.09) - open/close 4450 (time 1786342096.69 total 30.01 last 151.19) total: 4500 open/close in 30.30 seconds: 148.50 ops/second - /unlink 3029 (time 1786342109.16 total 10.00 last 302.85) total: 4500 /unlink in 15.02 seconds: 299.70 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 1672 (time 1786342126.12 total 10.00 last 167.15) - open/close 3753 (time 1786342136.13 total 20.01 last 208.02) total: 4500 open/close in 24.96 seconds: 180.27 ops/second - /unlink 3472 (time 1786342153.15 total 10.00 last 347.17) total: 4500 /unlink in 13.32 seconds: 337.71 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 1512 (time 1786342168.51 total 10.00 last 151.13) - open/close 2982 (time 1786342178.52 total 20.01 last 146.93) total: 4500 open/close in 29.97 seconds: 150.16 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 - /unlink 3093 (time 1786342200.67 total 10.00 last 309.21) total: 4500 /unlink in 14.77 seconds: 304.74 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 1992 (time 1786342217.42 total 10.00 last 199.11) - open/close 4249 (time 1786342227.42 total 20.01 last 225.63) total: 4500 open/close in 21.24 seconds: 211.89 ops/second total: 4500 /unlink in 8.61 seconds: 522.66 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 2000 (time 1786342250.42 total 10.00 last 199.91) - open/close 3872 (time 1786342260.43 total 20.01 last 187.11) total: 4500 open/close in 23.39 seconds: 192.36 ops/second - /unlink 3413 (time 1786342275.76 total 10.00 last 341.26) total: 4500 /unlink in 13.76 seconds: 327.03 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 1703 (time 1786342291.56 total 10.01 last 170.21) - open/close 3386 (time 1786342301.56 total 20.01 last 168.30) total: 4500 open/close in 27.68 seconds: 162.56 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 - /unlink 2712 (time 1786342321.48 total 10.00 last 271.11) total: 4500 /unlink in 16.91 seconds: 266.13 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 1511 (time 1786342340.74 total 10.01 last 151.01) - open/close 2968 (time 1786342350.74 total 20.01 last 145.68) - open/close 4423 (time 1786342360.75 total 30.01 last 145.44) total: 4500 open/close in 30.53 seconds: 147.38 ops/second - /unlink 3313 (time 1786342373.25 total 10.00 last 331.24) total: 4500 /unlink in 13.74 seconds: 327.60 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 1453 (time 1786342389.01 total 10.00 last 145.27) - open/close 2981 (time 1786342399.01 total 20.00 last 152.79) total: 4500 open/close in 29.68 seconds: 151.62 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 - /unlink 2591 (time 1786342420.82 total 10.00 last 259.03) total: 4500 /unlink in 16.55 seconds: 271.95 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 1439 (time 1786342439.38 total 10.00 last 143.85) - open/close 2842 (time 1786342449.39 total 20.01 last 140.20) - open/close 4284 (time 1786342459.40 total 30.01 last 144.15) total: 4500 open/close in 31.35 seconds: 143.56 ops/second - /unlink 2823 (time 1786342472.70 total 10.00 last 282.18) total: 4500 /unlink in 16.14 seconds: 278.89 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 1463 (time 1786342490.85 total 10.00 last 146.24) - open/close 2938 (time 1786342500.85 total 20.01 last 147.45) - open/close 4440 (time 1786342510.86 total 30.01 last 150.16) total: 4500 open/close in 30.38 seconds: 148.10 ops/second - /unlink 3211 (time 1786342523.39 total 10.00 last 321.03) total: 4500 /unlink in 14.14 seconds: 318.34 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 1585 (time 1786342539.59 total 10.00 last 158.46) - open/close 3150 (time 1786342549.59 total 20.01 last 156.45) total: 4500 open/close in 27.64 seconds: 162.81 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 - /unlink 3864 (time 1786342569.14 total 10.00 last 386.35) total: 4500 /unlink in 11.42 seconds: 393.96 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 1903 (time 1786342582.39 total 10.00 last 190.29) - open/close 3623 (time 1786342592.39 total 20.01 last 171.90) total: 4500 open/close in 25.00 seconds: 179.99 ops/second - /unlink 3294 (time 1786342609.23 total 10.00 last 329.36) total: 4500 /unlink in 13.49 seconds: 333.47 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 2256 (time 1786342624.39 total 10.00 last 225.54) total: 4500 open/close in 19.45 seconds: 231.35 ops/second total: 4500 /unlink in 9.43 seconds: 477.18 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 lustre-MDT0000: clear the changelog for cl1 to record #246998 - open/close 2130 (time 1786342656.22 total 10.00 last 212.97) - open/close 3839 (time 1786342666.22 total 20.00 last 170.89) total: 4500 open/close in 23.86 seconds: 188.63 ops/second - /unlink 3469 (time 1786342681.94 total 10.00 last 346.88) total: 4500 /unlink in 13.17 seconds: 341.66 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 1660 (time 1786342697.12 total 10.00 last 165.97) - open/close 3809 (time 1786342707.13 total 20.01 last 214.81) total: 4500 open/close in 23.59 seconds: 190.73 ops/second - /unlink 3092 (time 1786342722.68 total 10.00 last 309.16) total: 4500 /unlink in 13.88 seconds: 324.28 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 1782 (time 1786342738.30 total 10.01 last 178.11) - open/close 3483 (time 1786342748.31 total 20.01 last 169.98) total: 4500 open/close in 25.91 seconds: 173.69 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 - /unlink 3521 (time 1786342766.10 total 10.00 last 352.06) total: 4500 /unlink in 12.61 seconds: 356.91 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 2113 (time 1786342780.55 total 10.00 last 211.30) - open/close 4117 (time 1786342790.55 total 20.01 last 200.30) total: 4500 open/close in 22.24 seconds: 202.38 ops/second total: 4500 /unlink in 9.64 seconds: 466.76 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 2176 (time 1786342815.56 total 10.00 last 217.59) - open/close 4358 (time 1786342825.56 total 20.00 last 218.15) total: 4500 open/close in 20.49 seconds: 219.59 ops/second - /unlink 4220 (time 1786342837.63 total 10.00 last 421.99) total: 4500 /unlink in 10.84 seconds: 415.16 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11316: 94985 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg336-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg336-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg336-server stop mds service on oleg336-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg336-server stop mds service on oleg336-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg336-server unloading modules via unload_modules_local on: 'oleg336-server' oleg336-server: oleg336-server.virtnet: executing unload_modules_local oleg336-server: modules unloaded.