== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 22:32:55 (1781231575) Stopping clients: oleg645-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg645-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg645-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg645-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg645-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg645-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg645-server oleg645-server: oleg645-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg645-server' oleg645-server: oleg645-server.virtnet: executing load_modules_local oleg645-server: Loading modules from /home/green/git/lustre-release/lustre oleg645-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg645-server: detected 4 online CPUs by sysfs oleg645-server: MODOPTS_LIBCFS= oleg645-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg645-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg645-server: oleg645-server.virtnet: executing set_default_debug -1 all pdsh@oleg645-client: oleg645-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg645-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg645-server: oleg645-server.virtnet: executing set_default_debug -1 all pdsh@oleg645-client: oleg645-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg645-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg645-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg645-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg645-server: oleg645-server.virtnet: executing set_default_debug -1 all pdsh@oleg645-client: oleg645-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg645-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg645-client.virtnet: -o user_xattr,flock 192.168.206.145@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H all_char /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog - open/close 1939 (time 1781231695.29 total 10.00 last 193.82) - open/close 3390 (time 1781231705.29 total 20.01 last 145.07) total: 4500 open/close in 25.95 seconds: 173.41 ops/second lustre-MDT0000: clear the changelog for cl1 to record #12998 - /unlink 2622 (time 1781231723.23 total 10.00 last 262.13) total: 4500 /unlink in 17.40 seconds: 258.56 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 1217 (time 1781231742.84 total 10.01 last 121.62) - open/close 2305 (time 1781231752.86 total 20.02 last 108.65) - open/close 3277 (time 1781231762.86 total 30.03 last 97.13) - open/close 4379 (time 1781231772.86 total 40.03 last 110.20) total: 4500 open/close in 41.02 seconds: 109.69 ops/second - /unlink 2167 (time 1781231786.45 total 10.00 last 216.59) total: 4500 /unlink in 19.33 seconds: 232.78 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 1446 (time 1781231808.07 total 10.00 last 144.59) - open/close 2842 (time 1781231818.08 total 20.01 last 139.51) - open/close 4281 (time 1781231828.09 total 30.02 last 143.79) total: 4500 open/close in 31.76 seconds: 141.68 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 - /unlink 2528 (time 1781231841.89 total 10.00 last 252.75) total: 4500 /unlink in 17.93 seconds: 251.03 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 1130 (time 1781231861.95 total 10.00 last 112.97) - open/close 2276 (time 1781231871.96 total 20.01 last 114.54) - open/close 3456 (time 1781231881.96 total 30.01 last 117.95) - open/close 4351 (time 1781231891.97 total 40.02 last 89.42) total: 4500 open/close in 41.58 seconds: 108.23 ops/second - /unlink 2105 (time 1781231906.53 total 10.00 last 210.46) - /unlink 4075 (time 1781231916.54 total 20.01 last 196.87) total: 4500 /unlink in 22.07 seconds: 203.91 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 1074 (time 1781231930.84 total 10.00 last 107.36) - open/close 2047 (time 1781231940.86 total 20.02 last 97.10) - open/close 3102 (time 1781231950.87 total 30.03 last 105.48) - open/close 4343 (time 1781231960.87 total 40.03 last 124.06) total: 4500 open/close in 41.22 seconds: 109.18 ops/second - /unlink 2437 (time 1781231973.99 total 10.00 last 243.68) total: 4500 /unlink in 18.75 seconds: 239.95 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 1052 (time 1781231995.04 total 10.00 last 105.16) - open/close 2154 (time 1781232005.04 total 20.01 last 110.17) - open/close 3285 (time 1781232015.05 total 30.01 last 113.02) total: 4500 open/close in 39.48 seconds: 113.98 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 - /unlink 2415 (time 1781232036.54 total 10.00 last 241.48) total: 4500 /unlink in 18.97 seconds: 237.26 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 1224 (time 1781232057.47 total 10.00 last 122.35) - open/close 2482 (time 1781232067.47 total 20.01 last 125.75) - open/close 3690 (time 1781232077.47 total 30.01 last 120.80) total: 4500 open/close in 36.66 seconds: 122.76 ops/second - /unlink 2423 (time 1781232096.14 total 10.00 last 242.26) total: 4500 /unlink in 19.58 seconds: 229.79 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 1190 (time 1781232118.02 total 10.01 last 118.92) - open/close 2384 (time 1781232128.02 total 20.01 last 119.40) - open/close 3659 (time 1781232138.02 total 30.01 last 127.44) total: 4500 open/close in 36.89 seconds: 121.97 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 - /unlink 2221 (time 1781232157.05 total 10.00 last 222.06) total: 4500 /unlink in 19.69 seconds: 228.54 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 1256 (time 1781232178.99 total 10.00 last 125.58) - open/close 2273 (time 1781232189.00 total 20.01 last 101.61) - open/close 3275 (time 1781232199.00 total 30.01 last 100.19) - open/close 4267 (time 1781232209.00 total 40.01 last 99.19) total: 4500 open/close in 42.48 seconds: 105.94 ops/second - /unlink 2063 (time 1781232224.25 total 10.01 last 206.17) - /unlink 4116 (time 1781232234.25 total 20.01 last 205.22) total: 4500 /unlink in 21.58 seconds: 208.49 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 1224 (time 1781232247.87 total 10.01 last 122.33) - open/close 2649 (time 1781232257.87 total 20.01 last 142.50) - open/close 4073 (time 1781232267.87 total 30.01 last 142.36) total: 4500 open/close in 33.34 seconds: 134.99 ops/second - /unlink 2382 (time 1781232283.54 total 10.00 last 238.16) total: 4500 /unlink in 17.61 seconds: 255.51 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 1428 (time 1781232302.92 total 10.00 last 142.75) - open/close 2614 (time 1781232312.93 total 20.01 last 118.56) - open/close 3812 (time 1781232322.93 total 30.01 last 119.79) total: 4500 open/close in 35.80 seconds: 125.69 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 - /unlink 2565 (time 1781232340.83 total 10.00 last 256.44) total: 4500 /unlink in 18.12 seconds: 248.41 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 1478 (time 1781232361.20 total 10.00 last 147.73) - open/close 3239 (time 1781232371.20 total 20.01 last 176.08) total: 4500 open/close in 28.84 seconds: 156.05 ops/second - /unlink 2874 (time 1781232391.83 total 10.00 last 287.28) total: 4500 /unlink in 16.10 seconds: 279.45 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 1394 (time 1781232409.97 total 10.00 last 139.37) - open/close 3095 (time 1781232419.97 total 20.01 last 170.04) total: 4500 open/close in 27.66 seconds: 162.69 ops/second - /unlink 2844 (time 1781232439.59 total 10.00 last 284.38) total: 4500 /unlink in 15.63 seconds: 287.91 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 lustre-MDT0000: clear the changelog for cl1 to record #246998 - open/close 1246 (time 1781232457.24 total 10.00 last 124.54) - open/close 2642 (time 1781232467.24 total 20.00 last 139.60) - open/close 4116 (time 1781232477.25 total 30.01 last 147.31) total: 4500 open/close in 32.87 seconds: 136.90 ops/second - /unlink 2415 (time 1781232492.21 total 10.00 last 241.48) total: 4500 /unlink in 17.97 seconds: 250.44 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 1191 (time 1781232512.42 total 10.00 last 119.04) - open/close 2645 (time 1781232522.43 total 20.01 last 145.36) - open/close 4358 (time 1781232532.43 total 30.01 last 171.29) total: 4500 open/close in 30.75 seconds: 146.36 ops/second - /unlink 2986 (time 1781232544.89 total 10.00 last 298.53) total: 4500 /unlink in 14.77 seconds: 304.58 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 1508 (time 1781232561.51 total 10.00 last 150.75) - open/close 3073 (time 1781232571.51 total 20.01 last 156.47) total: 4500 open/close in 29.27 seconds: 153.73 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 - /unlink 3323 (time 1781232592.89 total 10.00 last 332.26) total: 4500 /unlink in 13.79 seconds: 326.22 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 1879 (time 1781232608.58 total 10.00 last 187.87) - open/close 3440 (time 1781232618.59 total 20.01 last 156.02) total: 4500 open/close in 26.38 seconds: 170.60 ops/second - /unlink 3258 (time 1781232636.71 total 10.00 last 325.80) total: 4500 /unlink in 14.13 seconds: 318.47 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 1541 (time 1781232652.62 total 10.00 last 154.06) - open/close 3011 (time 1781232662.62 total 20.00 last 147.00) total: 4500 open/close in 29.32 seconds: 153.47 ops/second - /unlink 3439 (time 1781232683.84 total 10.00 last 343.87) total: 4500 /unlink in 13.33 seconds: 337.69 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11195: 93306 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg645-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg645-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg645-server stop mds service on oleg645-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg645-server stop mds service on oleg645-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg645-server unloading modules via unload_modules_local on: 'oleg645-server' oleg645-server: oleg645-server.virtnet: executing unload_modules_local oleg645-server: modules unloaded.