== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 23:21:31 (1709785291)
start mds service on oleg243-server
Starting mds1: -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg243-server: oleg243-server.virtnet: executing set_default_debug -1 all
pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1
Started lustre-MDT0000
start mds service on oleg243-server
Starting mds2: -o localrecov  lustre-mdt2/mdt2 /mnt/lustre-mds2
oleg243-server: oleg243-server.virtnet: executing set_default_debug -1 all
pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1
Started lustre-MDT0001
oleg243-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid
oleg243-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid
start ost1 service on oleg243-server
Starting ost1: -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg243-server: oleg243-server.virtnet: executing set_default_debug -1 all
pdsh@oleg243-client: oleg243-server: ssh exited with exit code 1
Started lustre-OST0000
oleg243-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
mount lustre  on /mnt/lustre.....
Starting client: oleg243-client.virtnet:  -o user_xattr,flock oleg243-server@tcp:/lustre /mnt/lustre
seq.cli-lustre-OST0000-super.width=0x1ffffff
 - open/close 522 (time 1709785319.69 total 10.00 last 52.20)
 - open/close 975 (time 1709785330.62 total 20.93 last 41.44)
 - open/close 1634 (time 1709785341.14 total 31.45 last 62.63)
 - open/close 2260 (time 1709785351.60 total 41.91 last 59.83)
 - open/close 2870 (time 1709785362.24 total 52.56 last 57.30)
 - open/close 3379 (time 1709785372.71 total 63.02 last 48.65)
 - open/close 3638 (time 1709785383.59 total 73.90 last 23.80)
 - open/close 4107 (time 1709785394.13 total 84.45 last 44.47)
 - open/close 4412 (time 1709785404.14 total 94.45 last 30.49)
 - open/close 4823 (time 1709785414.57 total 104.88 last 39.40)
 - open/close 5311 (time 1709785425.15 total 115.47 last 46.09)
 - open/close 5808 (time 1709785435.81 total 126.12 last 46.65)
 - open/close 6340 (time 1709785448.80 total 139.12 last 40.94)
 - open/close 6779 (time 1709785459.46 total 149.78 last 41.18)
 - open/close 7276 (time 1709785469.46 total 159.78 last 49.70)
 - open/close 7570 (time 1709785479.84 total 170.16 last 28.33)
 - open/close 7981 (time 1709785490.78 total 181.09 last 37.59)
 - open/close 8312 (time 1709785503.45 total 193.76 last 26.12)
 - open/close 8711 (time 1709785514.44 total 204.75 last 36.31)
 - open/close 9027 (time 1709785525.26 total 215.57 last 29.20)
 - open/close 9397 (time 1709785535.26 total 225.58 last 36.98)
 - open/close 9832 (time 1709785545.73 total 236.04 last 41.56)
open(/mnt/lustre/d101a.conf-sanity/f101a.conf-sanity-9873) error: No space left on device
total: 9873 open/close in 236.26 seconds: 41.79 ops/second
/home/green/git/lustre-release/lustre/tests/conf-sanity.sh: line 8267: kill: (4595) - No such process
 - unlinked 0 (time 1709785547 ; total 0 ; last 0)
unlink(/mnt/lustre/d101a.conf-sanity/f101a.conf-sanity-9873) error: No such file or directory
total: 9873 unlinks in 30 seconds: 329.100006 unlinks/second
umount lustre on /mnt/lustre.....
Stopping client oleg243-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg243-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg243-server
stop mds service on oleg243-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg243-server
stop mds service on oleg243-server
Stopping /mnt/lustre-mds2 (opts:-f) on oleg243-server
unloading modules on: 'oleg243-server'
oleg243-server: oleg243-server.virtnet: executing unload_modules_local
modules unloaded.
pdsh@oleg243-client: oleg243-client: ssh exited with exit code 2
pdsh@oleg243-client: oleg243-server: ssh exited with exit code 2
pdsh@oleg243-client: oleg243-client: ssh exited with exit code 2
pdsh@oleg243-client: oleg243-server: ssh exited with exit code 2