== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 23:54:42 (1709787282) start mds service on oleg104-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg104-server: oleg104-server.virtnet: executing set_default_debug -1 all pdsh@oleg104-client: oleg104-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg104-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg104-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg104-server: oleg104-server.virtnet: executing set_default_debug -1 all pdsh@oleg104-client: oleg104-server: ssh exited with exit code 1 Started lustre-OST0000 oleg104-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg104-client.virtnet: -o user_xattr,flock oleg104-server@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff - open/close 145 (time 1709787316.01 total 10.22 last 14.19) - open/close 343 (time 1709787326.02 total 20.23 last 19.78) - open/close 533 (time 1709787336.69 total 30.89 last 17.82) - open/close 737 (time 1709787346.95 total 41.16 last 19.87) - open/close 829 (time 1709787357.60 total 51.80 last 8.64) - open/close 1078 (time 1709787367.96 total 62.17 last 24.03) - open/close 1227 (time 1709787378.32 total 72.52 last 14.39) - open/close 1403 (time 1709787388.33 total 82.53 last 17.59) - open/close 1622 (time 1709787399.14 total 93.34 last 20.26) - open/close 1771 (time 1709787409.19 total 103.39 last 14.83) - open/close 1968 (time 1709787419.42 total 113.62 last 19.26) - open/close 2191 (time 1709787429.42 total 123.62 last 22.30) - open/close 2401 (time 1709787439.70 total 133.91 last 20.42) - open/close 2563 (time 1709787450.64 total 144.84 last 14.81) - open/close 2711 (time 1709787460.64 total 154.85 last 14.80) - open/close 2890 (time 1709787471.21 total 165.41 last 16.94) - open/close 3094 (time 1709787481.22 total 175.42 last 20.39) - open/close 3261 (time 1709787491.24 total 185.45 last 16.65) - open/close 3446 (time 1709787501.59 total 195.79 last 17.88) - open/close 3621 (time 1709787512.39 total 206.60 last 16.20) - open/close 3755 (time 1709787523.26 total 217.46 last 12.33) - open/close 3839 (time 1709787533.72 total 227.92 last 8.03) - open/close 3987 (time 1709787543.75 total 237.95 last 14.76) - open/close 4178 (time 1709787554.73 total 248.93 last 17.40) - open/close 4350 (time 1709787564.74 total 258.94 last 17.18) - open/close 4493 (time 1709787575.50 total 269.71 last 13.29) - open/close 4690 (time 1709787585.52 total 279.72 last 19.68) - open/close 4835 (time 1709787595.53 total 289.73 last 14.48) open(/mnt/lustre/d101a.conf-sanity/f101a.conf-sanity-4881) error: No space left on device total: 4881 open/close in 293.68 seconds: 16.62 ops/second /home/green/git/lustre-release/lustre/tests/conf-sanity.sh: line 8267: kill: (29923) - No such process - unlinked 0 (time 1709787606 ; total 0 ; last 0) unlink(/mnt/lustre/d101a.conf-sanity/f101a.conf-sanity-4881) error: No such file or directory total: 4881 unlinks in 37 seconds: 131.918915 unlinks/second umount lustre on /mnt/lustre..... Stopping client oleg104-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg104-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg104-server stop mds service on oleg104-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg104-server unloading modules on: 'oleg104-server' oleg104-server: oleg104-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg104-client: oleg104-server: ssh exited with exit code 2 pdsh@oleg104-client: oleg104-client: ssh exited with exit code 2 pdsh@oleg104-client: oleg104-client: ssh exited with exit code 2 pdsh@oleg104-client: oleg104-server: ssh exited with exit code 2