== conf-sanity test 30a: Big config llog and permanent parameter deletion ========================================================== 11:54:48 (1786377288)
start mds service on oleg419-server
Start mds1: mount -t lustre -o localrecov  /dev/mapper/mds1_flakey /mnt/lustre-mds1
oleg419-server: mount.lustre: according to /etc/mtab /dev/mapper/mds1_flakey is already mounted on /mnt/lustre-mds1
pdsh@oleg419-client: oleg419-server: ssh exited with exit code 17
Start of /dev/mapper/mds1_flakey on mds1 failed 17
start ost1 service on oleg419-server
Start ost1: mount -t lustre -o localrecov  /dev/mapper/ost1_flakey /mnt/lustre-ost1
oleg419-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1
pdsh@oleg419-client: oleg419-server: ssh exited with exit code 17
seq.cli-lustre-OST0000-super.width=65536
Start of /dev/mapper/ost1_flakey on ost1 failed 17
mount lustre  on /mnt/lustre.....
Starting client: oleg419-client.virtnet:  -o user_xattr,flock 192.168.204.119@tcp:/lustre /mnt/lustre
mount.lustre: according to /etc/mtab 192.168.204.119@tcp:/lustre is already mounted on /mnt/lustre
Big config llog
Setting lustre.llite.max_read_ahead_whole_mb from 4 to 1
Waiting 90s for '1'
Updated after 6s: want '1' got '1'
Setting lustre.llite.max_read_ahead_whole_mb from 1 to 2
Waiting 90s for '2'
Updated after 6s: want '2' got '2'
Setting lustre.llite.max_read_ahead_whole_mb from 2 to 3
Waiting 90s for '3'
Updated after 8s: want '3' got '3'
Setting lustre.llite.max_read_ahead_whole_mb from 3 to 4
Waiting 90s for '4'
Updated after 9s: want '4' got '4'
Setting lustre.llite.max_read_ahead_whole_mb from 4 to 5
Waiting 90s for '5'
Updated after 9s: want '5' got '5'
Setting lustre.llite.max_read_ahead_whole_mb from 5 to 4
Waiting 90s for '4'
Updated after 8s: want '4' got '4'
Setting lustre.llite.max_read_ahead_whole_mb from 4 to 3
Waiting 90s for '3'
Updated after 4s: want '3' got '3'
Setting lustre.llite.max_read_ahead_whole_mb from 3 to 2
Waiting 90s for '2'
Updated after 5s: want '2' got '2'
Setting lustre.llite.max_read_ahead_whole_mb from 2 to 1
Waiting 90s for '1'
Updated after 9s: want '1' got '1'
Setting lustre.llite.max_read_ahead_whole_mb from 1 to 2
Waiting 90s for '2'
Updated after 8s: want '2' got '2'
Setting lustre.llite.max_read_ahead_whole_mb from 2 to 3
Waiting 90s for '3'
Updated after 5s: want '3' got '3'
Setting lustre.llite.max_read_ahead_whole_mb from 3 to 4
Waiting 90s for '4'
Updated after 7s: want '4' got '4'
Setting lustre.llite.max_read_ahead_whole_mb from 4 to 5
Waiting 90s for '5'
Updated after 8s: want '5' got '5'
Setting lustre.llite.max_read_ahead_whole_mb from 5 to 4
Waiting 90s for '4'
Updated after 4s: want '4' got '4'
Setting lustre.llite.max_read_ahead_whole_mb from 4 to 3
Waiting 90s for '3'
Updated after 7s: want '3' got '3'
Setting lustre.llite.max_read_ahead_whole_mb from 3 to 2
Waiting 90s for '2'
Updated after 6s: want '2' got '2'
Setting lustre.llite.max_read_ahead_whole_mb from 2 to 1
Waiting 90s for '1'
Updated after 6s: want '1' got '1'
Setting lustre.llite.max_read_ahead_whole_mb from 1 to 2
Waiting 90s for '2'
Updated after 7s: want '2' got '2'
Setting lustre.llite.max_read_ahead_whole_mb from 2 to 3
Waiting 90s for '3'
Updated after 4s: want '3' got '3'
Setting lustre.llite.max_read_ahead_whole_mb from 3 to 4
Waiting 90s for '4'
Updated after 7s: want '4' got '4'
Setting lustre.llite.max_read_ahead_whole_mb from 4 to 5
Waiting 90s for '5'
Updated after 8s: want '5' got '5'
umount lustre on /mnt/lustre.....
Stopping client oleg419-client.virtnet /mnt/lustre (opts:)
mount lustre  on /mnt/lustre.....
Starting client: oleg419-client.virtnet:  -o user_xattr,flock 192.168.204.119@tcp:/lustre /mnt/lustre
error: set_param: param_path 'debug': No such file or directory
error: set_param: setting 'debug'='-1': No such file or directory
error: set_param: param_path 'subsystem_debug': No such file or directory
error: set_param: setting 'subsystem_debug'='all': No such file or directory
PASS 
Erase parameter setting
umount lustre on /mnt/lustre.....
Stopping client oleg419-client.virtnet /mnt/lustre (opts:)
mount lustre  on /mnt/lustre.....
Starting client: oleg419-client.virtnet:  -o user_xattr,flock 192.168.204.119@tcp:/lustre /mnt/lustre
error: set_param: param_path 'debug': No such file or directory
error: set_param: setting 'debug'='-1': No such file or directory
error: set_param: param_path 'subsystem_debug': No such file or directory
error: set_param: setting 'subsystem_debug'='all': No such file or directory
deleted (default) value=4, orig=4
umount lustre on /mnt/lustre.....
Stopping client oleg419-client.virtnet /mnt/lustre (opts:)
stop ost1 service on oleg419-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg419-server
stop mds service on oleg419-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg419-server
stop mds service on oleg419-server
Stopping /mnt/lustre-mds2 (opts:-f) on oleg419-server
unloading modules via unload_modules_local on: 'oleg419-server'
oleg419-server: oleg419-server.virtnet: executing unload_modules_local
oleg419-server: lustre_rmmod: wait 40s for 6 OBD devices
oleg419-server: lustre_rmmod: OBD devices after 60s:
oleg419-server: 
oleg419-server: rmmod: ERROR: Module mdd is in use
pdsh@oleg419-client: oleg419-server: ssh exited with exit code 2
modules unloaded.
pdsh@oleg419-client: oleg419-client: ssh exited with exit code 2
pdsh@oleg419-client: oleg419-client: ssh exited with exit code 2