== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 23:46:24 (1709786784) start mds service on oleg208-server Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg208-server: oleg208-server.virtnet: executing set_default_debug -1 all pdsh@oleg208-client: oleg208-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg208-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg208-server Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg208-server: oleg208-server.virtnet: executing set_default_debug -1 all pdsh@oleg208-client: oleg208-server: ssh exited with exit code 1 Started lustre-OST0000 oleg208-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg208-client.virtnet: -o user_xattr,flock oleg208-server@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff - open/close 313 (time 1709786813.72 total 10.78 last 29.04) - open/close 672 (time 1709786823.85 total 20.91 last 35.45) - open/close 901 (time 1709786833.85 total 30.91 last 22.89) - open/close 1136 (time 1709786845.99 total 43.05 last 19.36) - open/close 1306 (time 1709786855.99 total 53.05 last 17.00) - open/close 1583 (time 1709786866.00 total 63.06 last 27.67) - open/close 1885 (time 1709786876.00 total 73.06 last 30.20) - open/close 2034 (time 1709786886.90 total 83.96 last 13.67) - open/close 2231 (time 1709786896.90 total 93.96 last 19.70) - open/close 2536 (time 1709786906.91 total 103.96 last 30.48) - open/close 2689 (time 1709786917.13 total 114.19 last 14.97) - open/close 2916 (time 1709786929.24 total 126.30 last 18.75) - open/close 3188 (time 1709786939.24 total 136.30 last 27.19) - open/close 3323 (time 1709786949.24 total 146.30 last 13.50) - open/close 3520 (time 1709786959.25 total 156.31 last 19.68) - open/close 3810 (time 1709786969.36 total 166.42 last 28.69) - open/close 4077 (time 1709786980.01 total 177.06 last 25.08) - open/close 4230 (time 1709786990.36 total 187.41 last 14.78) - open/close 4574 (time 1709787000.36 total 197.41 last 34.40) - open/close 4848 (time 1709787010.37 total 207.42 last 27.37) - open/close 5020 (time 1709787021.34 total 218.40 last 15.67) - open/close 5294 (time 1709787032.13 total 229.19 last 25.40) - open/close 5547 (time 1709787042.13 total 239.19 last 25.29) - open/close 5666 (time 1709787052.28 total 249.33 last 11.73) - open/close 5935 (time 1709787062.33 total 259.38 last 26.76) - open/close 6091 (time 1709787072.34 total 269.39 last 15.59) - open/close 6347 (time 1709787082.90 total 279.95 last 24.24) - open/close 6580 (time 1709787092.93 total 289.99 last 23.23) - open/close 6894 (time 1709787103.79 total 300.85 last 28.91) - open/close 7101 (time 1709787114.31 total 311.37 last 19.68) - open/close 7324 (time 1709787124.31 total 321.37 last 22.29) open(/mnt/lustre/d101a.conf-sanity/f101a.conf-sanity-7441) error: No space left on device total: 7441 open/close in 326.90 seconds: 22.76 ops/second /home/green/git/lustre-release/lustre/tests/conf-sanity.sh: line 8267: kill: (28652) - No such process - unlinked 0 (time 1709787138 ; total 0 ; last 0) unlink(/mnt/lustre/d101a.conf-sanity/f101a.conf-sanity-7441) error: No such file or directory total: 7441 unlinks in 57 seconds: 130.543854 unlinks/second umount lustre on /mnt/lustre..... Stopping client oleg208-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg208-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg208-server stop mds service on oleg208-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg208-server unloading modules on: 'oleg208-server' oleg208-server: oleg208-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg208-client: oleg208-server: ssh exited with exit code 2 pdsh@oleg208-client: oleg208-client: ssh exited with exit code 2 pdsh@oleg208-client: oleg208-client: ssh exited with exit code 2 pdsh@oleg208-client: oleg208-server: ssh exited with exit code 2