== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 13:01:42 (1772474502) Stopping clients: oleg257-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg257-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg257-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg257-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg257-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg257-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg257-server oleg257-server: oleg257-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing load_modules_local oleg257-server: Loading modules from /home/green/git/lustre-release/lustre oleg257-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy oleg257-server: detected 4 online CPUs by sysfs oleg257-server: MODOPTS_LIBCFS= oleg257-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg257-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg257-server: oleg257-server.virtnet: executing set_default_debug -1 all pdsh@oleg257-client: oleg257-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg257-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg257-server: oleg257-server.virtnet: executing set_default_debug -1 all pdsh@oleg257-client: oleg257-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg257-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg257-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg257-server: oleg257-server.virtnet: executing set_default_debug -1 all pdsh@oleg257-client: oleg257-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg257-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg257-client.virtnet: -o user_xattr,flock 192.168.202.157@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H crush /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 1045 (time 1772474636.86 total 10.00 last 104.48) - open/close 2041 (time 1772474646.86 total 20.00 last 99.59) - open/close 3044 (time 1772474656.86 total 30.01 last 100.24) - open/close 4181 (time 1772474666.88 total 40.02 last 113.56) total: 4500 open/close in 43.20 seconds: 104.17 ops/second - /unlink 2120 (time 1772474682.97 total 10.00 last 211.98) - /unlink 4070 (time 1772474692.97 total 20.00 last 194.94) total: 4500 /unlink in 22.03 seconds: 204.28 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 1050 (time 1772474707.91 total 10.00 last 104.99) - open/close 2104 (time 1772474717.92 total 20.01 last 105.34) - open/close 3085 (time 1772474727.92 total 30.01 last 98.08) - open/close 4088 (time 1772474737.92 total 40.01 last 100.28) total: 4500 open/close in 44.08 seconds: 102.09 ops/second - /unlink 2033 (time 1772474754.95 total 10.00 last 203.26) - /unlink 4172 (time 1772474764.95 total 20.01 last 213.82) total: 4500 /unlink in 21.41 seconds: 210.22 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 1100 (time 1772474778.89 total 10.00 last 109.97) - open/close 2162 (time 1772474788.89 total 20.00 last 106.18) - open/close 3279 (time 1772474798.89 total 30.01 last 111.69) - open/close 4434 (time 1772474808.90 total 40.01 last 115.48) total: 4500 open/close in 40.49 seconds: 111.13 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 - /unlink 2224 (time 1772474821.53 total 10.00 last 222.39) - /unlink 4230 (time 1772474831.53 total 20.00 last 200.58) total: 4500 /unlink in 21.41 seconds: 210.16 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 1076 (time 1772474845.72 total 10.01 last 107.51) - open/close 2105 (time 1772474855.72 total 20.01 last 102.88) - open/close 3279 (time 1772474865.72 total 30.01 last 117.39) - open/close 4289 (time 1772474875.73 total 40.02 last 100.93) total: 4500 open/close in 42.15 seconds: 106.76 ops/second - /unlink 1990 (time 1772474890.44 total 10.00 last 198.97) - /unlink 4130 (time 1772474900.45 total 20.01 last 213.85) total: 4500 /unlink in 21.91 seconds: 205.36 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 1098 (time 1772474915.35 total 10.01 last 109.74) - open/close 2226 (time 1772474925.35 total 20.01 last 112.75) - open/close 3267 (time 1772474935.36 total 30.02 last 104.02) - open/close 4299 (time 1772474945.37 total 40.03 last 103.12) total: 4500 open/close in 42.00 seconds: 107.15 ops/second - /unlink 1960 (time 1772474960.53 total 10.00 last 195.96) - /unlink 3912 (time 1772474970.53 total 20.00 last 195.16) total: 4500 /unlink in 22.78 seconds: 197.52 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 1137 (time 1772474986.15 total 10.00 last 113.68) - open/close 2214 (time 1772474996.15 total 20.00 last 107.68) - open/close 3298 (time 1772475006.15 total 30.01 last 108.37) - open/close 4427 (time 1772475016.15 total 40.01 last 112.90) total: 4500 open/close in 40.48 seconds: 111.16 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 - /unlink 2057 (time 1772475029.26 total 10.00 last 205.69) - /unlink 4092 (time 1772475039.26 total 20.00 last 203.42) total: 4500 /unlink in 22.06 seconds: 204.00 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 1091 (time 1772475054.16 total 10.00 last 109.05) - open/close 2192 (time 1772475064.16 total 20.01 last 110.09) - open/close 3334 (time 1772475074.17 total 30.02 last 114.08) - open/close 4471 (time 1772475084.17 total 40.02 last 113.63) total: 4500 open/close in 40.30 seconds: 111.66 ops/second - /unlink 2209 (time 1772475097.04 total 10.00 last 220.87) - /unlink 4295 (time 1772475107.04 total 20.00 last 208.57) total: 4500 /unlink in 20.83 seconds: 216.04 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 1172 (time 1772475120.08 total 10.00 last 117.15) - open/close 2393 (time 1772475130.10 total 20.02 last 121.93) - open/close 3602 (time 1772475140.10 total 30.02 last 120.86) total: 4500 open/close in 36.53 seconds: 123.20 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 - /unlink 2874 (time 1772475158.59 total 10.00 last 287.35) total: 4500 /unlink in 17.09 seconds: 263.28 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 1338 (time 1772475178.02 total 10.00 last 133.78) - open/close 2722 (time 1772475188.03 total 20.01 last 138.34) - open/close 4279 (time 1772475198.04 total 30.01 last 155.58) total: 4500 open/close in 31.32 seconds: 143.66 ops/second - /unlink 2957 (time 1772475211.15 total 10.00 last 295.67) total: 4500 /unlink in 16.33 seconds: 275.48 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998 - open/close 1282 (time 1772475229.32 total 10.00 last 128.19) - open/close 2581 (time 1772475239.32 total 20.00 last 129.85) - open/close 3938 (time 1772475249.32 total 30.01 last 135.69) total: 4500 open/close in 33.50 seconds: 134.34 ops/second - /unlink 2884 (time 1772475264.76 total 10.00 last 288.30) total: 4500 /unlink in 13.88 seconds: 324.16 ops/second lustre-MDT0000: clear the changelog for cl1 to record #181998 - open/close 1864 (time 1772475280.37 total 10.00 last 186.39) - open/close 3643 (time 1772475290.37 total 20.00 last 177.88) total: 4500 open/close in 26.07 seconds: 172.60 ops/second lustre-MDT0000: clear the changelog for cl1 to record #194998 - /unlink 2517 (time 1772475308.47 total 10.00 last 251.69) total: 4500 /unlink in 17.12 seconds: 262.83 ops/second lustre-MDT0000: clear the changelog for cl1 to record #207998 - open/close 1479 (time 1772475327.68 total 10.01 last 147.82) - open/close 2888 (time 1772475337.68 total 20.01 last 140.88) - open/close 4138 (time 1772475347.68 total 30.01 last 124.99) total: 4500 open/close in 32.76 seconds: 137.34 ops/second - /unlink 2671 (time 1772475362.45 total 10.00 last 267.10) total: 4500 /unlink in 16.23 seconds: 277.21 ops/second lustre-MDT0000: clear the changelog for cl1 to record #220998 - open/close 1535 (time 1772475380.35 total 10.01 last 153.39) - open/close 2910 (time 1772475390.35 total 20.01 last 137.49) - open/close 4389 (time 1772475400.36 total 30.02 last 147.72) total: 4500 open/close in 30.84 seconds: 145.93 ops/second - /unlink 2712 (time 1772475413.60 total 10.00 last 271.17) total: 4500 /unlink in 16.19 seconds: 277.92 ops/second lustre-MDT0000: clear the changelog for cl1 to record #233998 lustre-MDT0000: clear the changelog for cl1 to record #246998 - open/close 2130 (time 1772475431.52 total 10.00 last 212.94) - open/close 3849 (time 1772475441.52 total 20.00 last 171.88) total: 4500 open/close in 23.95 seconds: 187.87 ops/second - /unlink 3901 (time 1772475457.15 total 10.00 last 390.00) total: 4500 /unlink in 12.02 seconds: 374.32 ops/second lustre-MDT0000: clear the changelog for cl1 to record #259998 - open/close 1713 (time 1772475471.28 total 10.00 last 171.24) - open/close 3467 (time 1772475481.28 total 20.01 last 175.37) total: 4500 open/close in 25.43 seconds: 176.97 ops/second - /unlink 3305 (time 1772475498.77 total 10.00 last 330.43) total: 4500 /unlink in 13.44 seconds: 334.75 ops/second lustre-MDT0000: clear the changelog for cl1 to record #272998 - open/close 1624 (time 1772475513.96 total 10.00 last 162.39) - open/close 3048 (time 1772475523.96 total 20.01 last 142.28) total: 4500 open/close in 29.42 seconds: 152.97 ops/second lustre-MDT0000: clear the changelog for cl1 to record #285998 - /unlink 3177 (time 1772475545.12 total 10.00 last 317.56) total: 4500 /unlink in 14.73 seconds: 305.44 ops/second lustre-MDT0000: clear the changelog for cl1 to record #298998 - open/close 1575 (time 1772475561.65 total 10.00 last 157.49) - open/close 3002 (time 1772475571.65 total 20.01 last 142.63) total: 4500 open/close in 28.67 seconds: 156.98 ops/second - /unlink 2614 (time 1772475592.24 total 10.00 last 261.33) total: 4500 /unlink in 17.37 seconds: 259.10 ops/second lustre-MDT0000: clear the changelog for cl1 to record #311998 - open/close 1280 (time 1772475611.77 total 10.00 last 128.00) - open/close 2480 (time 1772475621.78 total 20.01 last 119.92) - open/close 3790 (time 1772475631.79 total 30.02 last 130.87) total: 4500 open/close in 34.53 seconds: 130.32 ops/second - /unlink 3169 (time 1772475648.39 total 10.00 last 316.79) total: 4500 /unlink in 13.48 seconds: 333.73 ops/second kill changelog reader /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 11170: 94012 Terminated coproc COPROC $LFS changelog --follow $service (wd: ~) lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 Cleanup test_135 umount lustre on /mnt/lustre..... Stopping client oleg257-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg257-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg257-server stop mds service on oleg257-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg257-server stop mds service on oleg257-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg257-server unloading modules via unload_modules_local on: 'oleg257-server' oleg257-server: oleg257-server.virtnet: executing unload_modules_local oleg257-server: modules unloaded.