== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 17:45:35 (1738968335)
start mds service on oleg430-server
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
ln: failed to create symbolic link '/sbin/.libs': Read-only file system
loading modules on: 'oleg430-server'
oleg430-server: oleg430-server.virtnet: executing load_modules_local
oleg430-server: Loading modules from /home/green/git/lustre-release/lustre
oleg430-server: detected 4 online CPUs by sysfs
oleg430-server: MODOPTS_LIBCFS=
oleg430-server: Force libcfs to create 2 CPU partitions
oleg430-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
oleg430-server: quota/lquota options: 'hash_lqs_cur_bits=3'
Starting mds1: -o localrecov  /dev/mapper/mds1_flakey /mnt/lustre-mds1
oleg430-server: oleg430-server.virtnet: executing set_default_debug -1 all
pdsh@oleg430-client: oleg430-server: ssh exited with exit code 1
Started lustre-MDT0000
start mds service on oleg430-server
Starting mds2: -o localrecov  /dev/mapper/mds2_flakey /mnt/lustre-mds2
oleg430-server: oleg430-server.virtnet: executing set_default_debug -1 all
pdsh@oleg430-client: oleg430-server: ssh exited with exit code 1
Started lustre-MDT0001
oleg430-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid
oleg430-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid
start ost1 service on oleg430-server
Starting ost1: -o localrecov  /dev/mapper/ost1_flakey /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg430-server: oleg430-server.virtnet: executing set_default_debug -1 all
pdsh@oleg430-client: oleg430-server: ssh exited with exit code 1
Started lustre-OST0000
oleg430-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
mount lustre  on /mnt/lustre.....
Starting client: oleg430-client.virtnet:  -o user_xattr,flock 192.168.204.130@tcp:/lustre /mnt/lustre
seq.cli-lustre-OST0000-super.width=0x1ffffff
 - open/close 194 (time 1738968389.01 total 11.81 last 16.42)
 - open/close 614 (time 1738968401.70 total 24.50 last 33.10)
 - open/close 791 (time 1738968412.39 total 35.19 last 16.56)
 - open/close 904 (time 1738968422.87 total 45.67 last 10.78)
 - open/close 1024 (time 1738968433.38 total 56.17 last 11.43)
 - open/close 1357 (time 1738968443.67 total 66.47 last 32.34)
 - open/close 1467 (time 1738968454.14 total 76.94 last 10.51)
 - open/close 1766 (time 1738968464.36 total 87.15 last 29.26)
 - open/close 1951 (time 1738968475.11 total 97.90 last 17.21)
 - open/close 2229 (time 1738968485.11 total 107.91 last 27.79)
 - open/close 2528 (time 1738968495.21 total 118.01 last 29.59)
 - open/close 2761 (time 1738968506.09 total 128.89 last 21.42)
 - open/close 2937 (time 1738968516.81 total 139.61 last 16.41)
 - open/close 3101 (time 1738968529.52 total 152.32 last 12.91)
 - open/close 3432 (time 1738968539.80 total 162.60 last 32.18)
 - open/close 3608 (time 1738968550.49 total 173.29 last 16.46)
 - open/close 3828 (time 1738968566.41 total 189.21 last 13.82)
 - open/close 4003 (time 1738968579.07 total 201.86 last 13.83)
 - open/close 4129 (time 1738968589.57 total 212.36 last 12.00)
open(/mnt/lustre/d101a.conf-sanity/f101a.conf-sanity-4305) error: No space left on device
total: 4305 open/close in 221.99 seconds: 19.39 ops/second
/home/green/git/lustre-release/lustre/tests/conf-sanity.sh: line 8933: kill: (12456) - No such process
 - unlinked 0 (time 1738968603 ; total 0 ; last 0)
unlink(/mnt/lustre/d101a.conf-sanity/f101a.conf-sanity-4305) error: No such file or directory
total: 4305 unlinks in 9 seconds: 478.333344 unlinks/second
umount lustre on /mnt/lustre.....
Stopping client oleg430-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg430-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg430-server
stop mds service on oleg430-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg430-server
stop mds service on oleg430-server
Stopping /mnt/lustre-mds2 (opts:-f) on oleg430-server
unloading modules via unload_modules_local on: 'oleg430-server'
oleg430-server: oleg430-server.virtnet: executing unload_modules_local
modules unloaded.
pdsh@oleg430-client: oleg430-client: ssh exited with exit code 2
pdsh@oleg430-client: oleg430-server: ssh exited with exit code 2
pdsh@oleg430-client: oleg430-client: ssh exited with exit code 2
pdsh@oleg430-client: oleg430-server: ssh exited with exit code 2