== conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 10:52:54 (1782226374) Stopping clients: oleg119-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg119-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg119-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg119-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg119-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg119-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg119-server oleg119-server: oleg119-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg119-server' oleg119-server: oleg119-server.virtnet: executing load_modules_local oleg119-server: Loading modules from /home/green/git/lustre-release/lustre oleg119-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg119-server: detected 4 online CPUs by sysfs oleg119-server: MODOPTS_LIBCFS= oleg119-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: /dev/mapper/mds1_flakey Format mds2: /dev/mapper/mds2_flakey Format ost1: /dev/mapper/ost1_flakey Format ost2: /dev/mapper/ost2_flakey start mds service on oleg119-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg119-server: oleg119-server.virtnet: executing set_default_debug -1 all pdsh@oleg119-client: oleg119-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds1_flakey Started lustre-MDT0000 start mds service on oleg119-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg119-server: oleg119-server.virtnet: executing set_default_debug -1 all pdsh@oleg119-client: oleg119-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/mds2_flakey Started lustre-MDT0001 oleg119-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg119-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid start ost1 service on oleg119-server Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg119-server: oleg119-server.virtnet: executing set_default_debug -1 all pdsh@oleg119-client: oleg119-server: ssh exited with exit code 1 Commit the device label on /dev/mapper/ost1_flakey Started lustre-OST0000 oleg119-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg119-client.virtnet: -o user_xattr,flock 192.168.201.119@tcp:/lustre /mnt/lustre fail_loc=0x1312 fail_val=5 fail_loc=0x1312 fail_val=5 striped dir -i0 -c1 -H all_char /mnt/lustre/d135.conf-sanity seq.cli-lustre-OST0000-super.width=0x1ffffff mdd.lustre-MDT0000.changelog_mask=ALL mdd.lustre-MDT0001.changelog_mask=ALL mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' Wrap arround changelog catalog lustre-MDT0000: clear the changelog for cl1 to record #12998 - open/close 640 (time 1782226627.73 total 10.01 last 63.92) - open/close 1299 (time 1782226637.75 total 20.03 last 65.82) - open/close 1804 (time 1782226647.76 total 30.04 last 50.45) - open/close 2302 (time 1782226657.77 total 40.05 last 49.72) - open/close 2955 (time 1782226667.78 total 50.06 last 65.28) - open/close 3585 (time 1782226677.79 total 60.07 last 62.93) - open/close 4296 (time 1782226687.80 total 70.08 last 71.02) total: 4500 open/close in 72.86 seconds: 61.76 ops/second - /unlink 1249 (time 1782226705.70 total 10.00 last 124.85) - /unlink 2481 (time 1782226715.70 total 20.01 last 123.15) - /unlink 3660 (time 1782226725.71 total 30.02 last 117.76) total: 4500 /unlink in 36.89 seconds: 121.97 ops/second lustre-MDT0000: clear the changelog for cl1 to record #25998 - open/close 645 (time 1782226748.74 total 10.01 last 64.42) - open/close 1377 (time 1782226758.75 total 20.03 last 73.08) - open/close 2151 (time 1782226768.76 total 30.03 last 77.39) - open/close 2733 (time 1782226778.77 total 40.04 last 58.13) - open/close 3434 (time 1782226788.77 total 50.05 last 70.08) - open/close 4124 (time 1782226798.77 total 60.05 last 68.98) total: 4500 open/close in 65.37 seconds: 68.84 ops/second - /unlink 1500 (time 1782226819.33 total 10.00 last 149.96) - /unlink 2737 (time 1782226829.34 total 20.01 last 123.62) - /unlink 3837 (time 1782226839.35 total 30.02 last 109.89) total: 4500 /unlink in 34.92 seconds: 128.87 ops/second lustre-MDT0000: clear the changelog for cl1 to record #38998 - open/close 576 (time 1782226859.75 total 10.00 last 57.58) - open/close 1069 (time 1782226869.75 total 20.01 last 49.29) - open/close 1439 (time 1782226879.82 total 30.07 last 36.75) - open/close 1820 (time 1782226889.86 total 40.11 last 37.95) - open/close 2413 (time 1782226899.86 total 50.12 last 59.26) - open/close 3177 (time 1782226909.87 total 60.12 last 76.37) - open/close 3810 (time 1782226919.87 total 70.13 last 63.29) - open/close 4485 (time 1782226929.88 total 80.14 last 67.43) total: 4500 open/close in 80.30 seconds: 56.04 ops/second lustre-MDT0000: clear the changelog for cl1 to record #51998 - /unlink 1090 (time 1782226946.41 total 10.01 last 108.90) - /unlink 2234 (time 1782226956.42 total 20.01 last 114.34) - /unlink 3308 (time 1782226966.42 total 30.02 last 107.39) - /unlink 4390 (time 1782226976.42 total 40.02 last 108.15) total: 4500 /unlink in 41.56 seconds: 108.28 ops/second lustre-MDT0000: clear the changelog for cl1 to record #64998 - open/close 638 (time 1782226995.37 total 10.00 last 63.77) - open/close 1218 (time 1782227005.38 total 20.01 last 57.99) - open/close 1857 (time 1782227015.38 total 30.01 last 63.89) - open/close 2351 (time 1782227025.39 total 40.02 last 49.33) - open/close 2933 (time 1782227035.40 total 50.03 last 58.18) - open/close 3555 (time 1782227045.40 total 60.03 last 62.19) - open/close 4245 (time 1782227055.40 total 70.03 last 68.97) total: 4500 open/close in 74.11 seconds: 60.72 ops/second - /unlink 1250 (time 1782227075.44 total 10.00 last 124.94) - /unlink 2433 (time 1782227085.44 total 20.01 last 118.28) - /unlink 3678 (time 1782227095.45 total 30.02 last 124.33) total: 4500 /unlink in 37.15 seconds: 121.13 ops/second lustre-MDT0000: clear the changelog for cl1 to record #77998 - open/close 574 (time 1782227119.08 total 10.01 last 57.35) - open/close 1220 (time 1782227129.09 total 20.02 last 64.54) - open/close 1834 (time 1782227139.09 total 30.02 last 61.36) - open/close 2420 (time 1782227149.10 total 40.03 last 58.55) - open/close 3036 (time 1782227159.11 total 50.04 last 61.58) - open/close 3668 (time 1782227169.12 total 60.05 last 63.10) - open/close 4307 (time 1782227179.12 total 70.05 last 63.89) total: 4500 open/close in 72.71 seconds: 61.89 ops/second - /unlink 1048 (time 1782227198.23 total 10.01 last 104.73) - /unlink 2231 (time 1782227208.25 total 20.02 last 118.17) - /unlink 3403 (time 1782227218.25 total 30.02 last 117.14) - /unlink 4454 (time 1782227228.25 total 40.03 last 105.06) total: 4500 /unlink in 40.44 seconds: 111.28 ops/second lustre-MDT0000: clear the changelog for cl1 to record #90998 - open/close 568 (time 1782227244.73 total 10.01 last 56.75) - open/close 1205 (time 1782227254.73 total 20.02 last 63.65) - open/close 1918 (time 1782227264.75 total 30.03 last 71.21) - open/close 2551 (time 1782227274.77 total 40.05 last 63.17) - open/close 3234 (time 1782227284.78 total 50.06 last 68.24) - open/close 3956 (time 1782227294.78 total 60.06 last 72.20) total: 4500 open/close in 67.68 seconds: 66.49 ops/second lustre-MDT0000: clear the changelog for cl1 to record #103998 - /unlink 1133 (time 1782227319.13 total 10.00 last 113.27) - /unlink 2107 (time 1782227329.14 total 20.01 last 97.36) - /unlink 3412 (time 1782227339.14 total 30.01 last 130.48) total: 4500 /unlink in 38.89 seconds: 115.70 ops/second lustre-MDT0000: clear the changelog for cl1 to record #116998 - open/close 487 (time 1782227364.56 total 10.01 last 48.66) - open/close 888 (time 1782227374.58 total 20.02 last 40.04) - open/close 1441 (time 1782227384.59 total 30.04 last 55.24) - open/close 2173 (time 1782227394.59 total 40.04 last 73.19) - open/close 2814 (time 1782227404.60 total 50.05 last 64.04) - open/close 3389 (time 1782227414.60 total 60.05 last 57.50) - open/close 4016 (time 1782227424.61 total 70.06 last 62.62) total: 4500 open/close in 79.17 seconds: 56.84 ops/second - /unlink 1097 (time 1782227450.50 total 10.01 last 109.58) - /unlink 2024 (time 1782227460.52 total 20.03 last 92.56) - /unlink 3020 (time 1782227470.53 total 30.03 last 99.51) - /unlink 4002 (time 1782227480.53 total 40.04 last 98.18) total: 4500 /unlink in 45.27 seconds: 99.40 ops/second lustre-MDT0000: clear the changelog for cl1 to record #129998 - open/close 610 (time 1782227502.55 total 10.00 last 60.99) - open/close 1297 (time 1782227512.55 total 20.00 last 68.69) - open/close 1987 (time 1782227522.55 total 30.00 last 69.00) - open/close 2612 (time 1782227532.61 total 40.06 last 62.17) - open/close 3012 (time 1782227542.61 total 50.06 last 39.99) - open/close 3690 (time 1782227552.61 total 60.06 last 67.78) - open/close 4365 (time 1782227562.62 total 70.07 last 67.44) total: 4500 open/close in 72.52 seconds: 62.05 ops/second lustre-MDT0000: clear the changelog for cl1 to record #142998 - /unlink 1430 (time 1782227580.56 total 10.00 last 142.96) - /unlink 2725 (time 1782227590.57 total 20.01 last 129.35) - /unlink 3840 (time 1782227600.58 total 30.02 last 111.42) total: 4500 /unlink in 35.80 seconds: 125.70 ops/second lustre-MDT0000: clear the changelog for cl1 to record #155998 - open/close 666 (time 1782227622.62 total 10.01 last 66.56) - open/close 1331 (time 1782227632.63 total 20.01 last 66.49) - open/close 2066 (time 1782227642.63 total 30.01 last 73.47) - open/close 2548 (time 1782227652.65 total 40.03 last 48.13) - open/close 3211 (time 1782227662.67 total 50.06 last 66.11) - open/close 3822 (time 1782227672.69 total 60.07 last 61.01) - open/close 4460 (time 1782227682.70 total 70.08 last 63.72) total: 4500 open/close in 70.58 seconds: 63.76 ops/second - /unlink 1156 (time 1782227699.23 total 10.00 last 115.56) - /unlink 2404 (time 1782227709.24 total 20.01 last 124.72) - /unlink 3551 (time 1782227719.24 total 30.01 last 114.68) total: 4500 /unlink in 38.35 seconds: 117.33 ops/second lustre-MDT0000: clear the changelog for cl1 to record #168998