== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 09:55:23 (1784123723) Stopping clients: oleg131-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg131-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg131-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg131-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg131-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg131-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg131-server oleg131-server: oleg131-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg131-server' oleg131-server: oleg131-server.virtnet: executing load_modules_local oleg131-server: Loading modules from /home/green/git/lustre-release/lustre oleg131-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg131-server: detected 4 online CPUs by sysfs oleg131-server: MODOPTS_LIBCFS= oleg131-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg131-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg131-server: oleg131-server.virtnet: executing set_default_debug -1 all pdsh@oleg131-client: oleg131-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg131-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg131-server: oleg131-server.virtnet: executing set_default_debug -1 all pdsh@oleg131-client: oleg131-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg131-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg131-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg131-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg131-server: oleg131-server.virtnet: executing set_default_debug -1 all pdsh@oleg131-client: oleg131-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg131-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg131-client.virtnet: -o user_xattr,flock 192.168.201.131@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog total: 4500 open/close in 9.66 seconds: 465.82 ops/second lustre-MDT0000: clear the changelog for cl1 to record #12998 total: 4500 /unlink in 7.73 seconds: 582.34 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 1892 (time 1784123844.97 total 10.00 last 189.11) - open/close 3433 (time 1784123854.97 total 20.01 last 154.09) total: 4500 open/close in 26.55 seconds: 169.50 ops/second - /unlink 3773 (time 1784123873.79 total 10.00 last 377.26) total: 4500 /unlink in 11.45 seconds: 393.10 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 1071 (time 1784123887.18 total 10.01 last 107.01) - open/close 2349 (time 1784123897.18 total 20.01 last 127.77) - open/close 4311 (time 1784123907.18 total 30.01 last 196.20) total: 4500 open/close in 31.24 seconds: 144.05 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 - /unlink 3770 (time 1784123920.37 total 10.00 last 376.91) total: 4500 /unlink in 12.98 seconds: 346.62 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 1521 (time 1784123935.45 total 10.00 last 152.03) - open/close 3101 (time 1784123945.45 total 20.01 last 157.95) total: 4500 open/close in 28.51 seconds: 157.83 ops/second - /unlink 2719 (time 1784123965.69 total 10.00 last 271.80) total: 4500 /unlink in 16.55 seconds: 271.87 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 1525 (time 1784123984.22 total 10.01 last 152.33) - open/close 3101 (time 1784123994.23 total 20.02 last 157.46) total: 4500 open/close in 29.11 seconds: 154.60 ops/second - /unlink 2846 (time 1784124015.03 total 10.00 last 284.49) total: 4500 /unlink in 16.44 seconds: 273.68 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 2016 (time 1784124033.19 total 10.00 last 201.60) - open/close 3400 (time 1784124043.19 total 20.01 last 138.29) total: 4500 open/close in 28.65 seconds: 157.07 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 - /unlink 2197 (time 1784124064.29 total 10.00 last 219.68) total: 4500 /unlink in 19.35 seconds: 232.53 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 1021 (time 1784124086.58 total 10.00 last 102.07) - open/close 2105 (time 1784124096.58 total 20.01 last 108.34) - open/close 3353 (time 1784124106.58 total 30.01 last 124.79) total: 4500 open/close in 39.17 seconds: 114.89 ops/second - /unlink 2222 (time 1784124128.14 total 10.00 last 222.13) total: 4500 /unlink in 19.82 seconds: 227.06 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 1295 (time 1784124150.50 total 10.00 last 129.46) - open/close 2496 (time 1784124160.51 total 20.00 last 120.09) - open/close 3856 (time 1784124170.51 total 30.00 last 136.00) total: 4500 open/close in 35.30 seconds: 127.49 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 - /unlink 2287 (time 1784124188.27 total 10.00 last 228.68) - /unlink 4419 (time 1784124198.27 total 20.00 last 213.17) total: 4500 /unlink in 20.52 seconds: 219.33 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 1082 (time 1784124211.75 total 10.01 last 108.14) - open/close 2207 (time 1784124221.76 total 20.02 last 112.33) - open/close 3475 (time 1784124231.77 total 30.03 last 126.71) total: 4500 open/close in 38.53 seconds: 116.81 ops/second - /unlink 2146 (time 1784124252.79 total 10.00 last 214.57) - /unlink 4487 (time 1784124262.79 total 20.00 last 234.09) total: 4500 /unlink in 20.05 seconds: 224.45 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 1271 (time 1784124275.00 total 10.02 last 126.89) - open/close 2486 (time 1784124285.00 total 20.02 last 121.47) - open/close 3871 (time 1784124295.00 total 30.02 last 138.43) total: 4500 open/close in 34.43 seconds: 130.69 ops/second - /unlink 3333 (time 1784124311.10 total 10.00 last 333.30) total: 4500 /unlink in 14.51 seconds: 310.23 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 1300 (time 1784124327.77 total 10.01 last 129.91) - open/close 2840 (time 1784124337.77 total 20.01 last 153.95) - open/close 4432 (time 1784124347.78 total 30.01 last 159.14) total: 4500 open/close in 30.41 seconds: 147.98 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 - /unlink 3498 (time 1784124360.05 total 10.00 last 349.67) total: 4500 /unlink in 12.41 seconds: 362.74 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 2461 (time 1784124374.18 total 10.00 last 246.06) - open/close 4482 (time 1784124384.19 total 20.01 last 201.99) total: 4500 open/close in 20.12 seconds: 223.69 ops/second - /unlink 4079 (time 1784124396.22 total 10.00 last 407.90) total: 4500 /unlink in 10.83 seconds: 415.67 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 2927 (time 1784124408.59 total 10.00 last 292.64) total: 4500 open/close in 18.76 seconds: 239.93 ops/second - /unlink 4261 (time 1784124429.17 total 10.00 last 426.04) total: 4500 /unlink in 10.79 seconds: 417.16 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 lustre-MDT0000: clear the changelog for cl1 to record #246998 - open/close 2869 (time 1784124441.85 total 10.00 last 286.88) total: 4500 open/close in 15.70 seconds: 286.54 ops/second total: 4500 /unlink in 7.47 seconds: 602.12 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 3646 (time 1784124467.86 total 10.00 last 364.57) total: 4500 open/close in 13.43 seconds: 335.19 ops/second - /unlink 3599 (time 1784124482.72 total 10.00 last 359.89) total: 4500 /unlink in 14.66 seconds: 306.86 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 983 (time 1784124500.67 total 10.04 last 97.88) - open/close 1968 (time 1784124510.68 total 20.05 last 98.43) - open/close 3165 (time 1784124520.68 total 30.05 last 119.68) - open/close 4249 (time 1784124530.68 total 40.06 last 108.35) total: 4500 open/close in 42.43 seconds: 106.05 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 - /unlink 2388 (time 1784124546.18 total 10.00 last 238.79) total: 4500 /unlink in 19.77 seconds: 227.65 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 1215 (time 1784124568.91 total 10.00 last 121.44) - open/close 2395 (time 1784124578.91 total 20.00 last 118.00) - open/close 3737 (time 1784124588.91 total 30.01 last 134.14) total: 4500 open/close in 36.64 seconds: 122.80 ops/second - /unlink 2548 (time 1784124607.96 total 10.00 last 254.80) total: 4500 /unlink in 17.94 seconds: 250.88 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 1597 (time 1784124627.73 total 10.00 last 159.67) - open/close 2947 (time 1784124637.73 total 20.00 last 134.99) total: 4500 open/close in 29.36 seconds: 153.26 ops/second - /unlink 2792 (time 1784124659.51 total 10.00 last 279.18) total: 4500 /unlink in 17.09 seconds: 263.32 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11243: 94296 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg131-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg131-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg131-server stop mds service on oleg131-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg131-server stop mds service on oleg131-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg131-server unloading modules via unload_modules_local on: 'oleg131-server' oleg131-server: oleg131-server.virtnet: executing unload_modules_local oleg131-server: modules unloaded.