== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 23:58:09 (1709787489)
start mds service on oleg409-server
Starting mds1: -o localrecov  /dev/mapper/mds1_flakey /mnt/lustre-mds1
oleg409-server: oleg409-server.virtnet: executing set_default_debug -1 all
pdsh@oleg409-client: oleg409-server: ssh exited with exit code 1
Started lustre-MDT0000
start mds service on oleg409-server
Starting mds2: -o localrecov  /dev/mapper/mds2_flakey /mnt/lustre-mds2
oleg409-server: oleg409-server.virtnet: executing set_default_debug -1 all
pdsh@oleg409-client: oleg409-server: ssh exited with exit code 1
Started lustre-MDT0001
oleg409-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid
oleg409-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid
start ost1 service on oleg409-server
Starting ost1: -o localrecov  /dev/mapper/ost1_flakey /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg409-server: oleg409-server.virtnet: executing set_default_debug -1 all
pdsh@oleg409-client: oleg409-server: ssh exited with exit code 1
Started lustre-OST0000
oleg409-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
mount lustre  on /mnt/lustre.....
Starting client: oleg409-client.virtnet:  -o user_xattr,flock oleg409-server@tcp:/lustre /mnt/lustre
seq.cli-lustre-OST0000-super.width=0x1ffffff
 - open/close 165 (time 1709787545.91 total 10.00 last 16.49)
 - open/close 322 (time 1709787556.94 total 21.03 last 14.24)
 - open/close 561 (time 1709787567.61 total 31.70 last 22.40)
 - open/close 719 (time 1709787577.75 total 41.85 last 15.58)
 - open/close 855 (time 1709787588.14 total 52.24 last 13.09)
 - open/close 1145 (time 1709787598.14 total 62.24 last 29.00)
 - open/close 1394 (time 1709787608.70 total 72.79 last 23.59)
 - open/close 1733 (time 1709787618.71 total 82.80 last 33.88)
 - open/close 2048 (time 1709787629.09 total 93.18 last 30.33)
 - open/close 2355 (time 1709787639.71 total 103.80 last 28.92)
 - open/close 2535 (time 1709787650.11 total 114.20 last 17.31)
 - open/close 2882 (time 1709787660.12 total 124.21 last 34.68)
 - open/close 3107 (time 1709787670.81 total 134.90 last 21.04)
 - open/close 3299 (time 1709787687.73 total 151.82 last 11.35)
 - open/close 3475 (time 1709787697.91 total 162.00 last 17.29)
 - open/close 3714 (time 1709787708.88 total 172.97 last 21.79)
 - open/close 3867 (time 1709787719.12 total 183.22 last 14.94)
 - open/close 3965 (time 1709787729.37 total 193.46 last 9.57)
open(/mnt/lustre/d101a.conf-sanity/f101a.conf-sanity-3985) error: No space left on device
total: 3985 open/close in 193.66 seconds: 20.58 ops/second
/home/green/git/lustre-release/lustre/tests/conf-sanity.sh: line 8267: kill: (3175) - No such process
 - unlinked 0 (time 1709787734 ; total 0 ; last 0)
unlink(/mnt/lustre/d101a.conf-sanity/f101a.conf-sanity-3985) error: No such file or directory
total: 3985 unlinks in 21 seconds: 189.761902 unlinks/second
umount lustre on /mnt/lustre.....
Stopping client oleg409-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg409-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg409-server
stop mds service on oleg409-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg409-server
stop mds service on oleg409-server
Stopping /mnt/lustre-mds2 (opts:-f) on oleg409-server
unloading modules on: 'oleg409-server'
oleg409-server: oleg409-server.virtnet: executing unload_modules_local
modules unloaded.
pdsh@oleg409-client: oleg409-client: ssh exited with exit code 2
pdsh@oleg409-client: oleg409-server: ssh exited with exit code 2
pdsh@oleg409-client: oleg409-client: ssh exited with exit code 2
pdsh@oleg409-client: oleg409-server: ssh exited with exit code 2