== conf-sanity test 157c: test allow_register timeout functionality ========================================================== 06:25:57 (1789381557)
start mds service on oleg354-server
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
-rwxr-xr-x. 1 green green 1931560 Sep 14 04:14 /home/green/git/lustre-release/lustre/utils/mount.lustre
-rwxr-xr-x. 1 root  root       12 Jan 31  2019 /usr/sbin/mount.lustre
mount --bind /home/green/git/lustre-release/lustre/utils/mount.lustre /usr/sbin/mount.lustre
loading modules on: 'oleg354-server'
oleg354-server: oleg354-server.virtnet: executing load_modules_local
oleg354-server: kmemleak disabled
oleg354-server: Loading modules from /home/green/git/lustre-release/lustre
oleg354-server: detected 4 online CPUs by sysfs
oleg354-server: MODOPTS_LIBCFS=
oleg354-server: Force libcfs to create 2 CPU partitions
oleg354-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
oleg354-server: quota/lquota options: 'hash_lqs_cur_bits=3'
oleg354-server: mdt/mdt options: 'mdt_enable_flr_ec=1'
oleg354-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg354-server: oleg354-server.virtnet: executing set_default_debug -1 all
pdsh@oleg354-client: oleg354-server: ssh exited with exit code 1
Started lustre-MDT0000
oleg354-server: params: OBD_IOC_LLOG_PRINT failed: No such file or directory
pdsh@oleg354-client: oleg354-server: ssh exited with exit code 2
pdsh@oleg354-client: oleg354-server: ssh exited with exit code 123
allow_register=unlimited
start mds service on oleg354-server
Start mds2: mount -t lustre -o localrecov  lustre-mdt2/mdt2 /mnt/lustre-mds2
oleg354-server: oleg354-server.virtnet: executing set_default_debug -1 all
pdsh@oleg354-client: oleg354-server: ssh exited with exit code 1
Started lustre-MDT0001
oleg354-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0
oleg354-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0
start ost1 service on oleg354-server
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg354-server: oleg354-server.virtnet: executing set_default_debug -1 all
pdsh@oleg354-client: oleg354-server: ssh exited with exit code 1
Started lustre-OST0000
oleg354-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0
mount lustre  on /mnt/lustre.....
Starting client: oleg354-client.virtnet:  -o user_xattr,flock 192.168.203.154@tcp:/lustre /mnt/lustre
allow_register=unlimited

   Permanent disk data:
Device:     lustre-ost1_2/ost1_2
Target:     fs20344:OST0000
Index:      0
Lustre FS:  fs20344
Mount type: zfs
Flags:      0x62
              (OST first_time update )
Persistent mount opts: 
Parameters: mgsnode=192.168.203.154@tcp:192.168.203.154@tcp sys.timeout=20 autodegrade=on
mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1_2 /tmp/lustre-ost1_2
mkfs_cmd = zfs create -o canmount=off  -o quota=409600000 lustre-ost1_2/ost1_2
  xattr=sa
  dnodesize=auto
  recordsize=1M
  compression=off
Writing lustre-ost1_2/ost1_2 properties
  lustre:mgsnode=192.168.203.154@tcp:192.168.203.154@tcp
  lustre:sys.timeout=20
  lustre:autodegrade=on
  lustre:version=1
  lustre:flags=98
  lustre:index=0
  lustre:fsname=fs20344
  lustre:svname=fs20344:OST0000
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1890: OST_INDICES: bad array subscript
Start fs2ost: mount -t lustre -o localrecov  lustre-ost1_2/ost1_2 /mnt/lustre-fs2ost
seq.cli-fs20344-OST0000-super.width=65536
oleg354-server: oleg354-server.virtnet: executing set_default_debug -1 all
pdsh@oleg354-client: oleg354-server: ssh exited with exit code 1
Commit the device label on lustre-ost1_2/ost1_2
Started fs20344-OST0000
allow_register=60s
obdfilter.fs20344-OST0000.recovery_status=status: INACTIVE
Waiting for allow_register timeout to expire
Waiting 66s for '1'
Waiting 56s for '1'
Waiting 46s for '1'
Waiting 36s for '1'
Waiting 26s for '1'
Waiting 16s for '1'
Updated after 58s: want '1' got '1'

   Permanent disk data:
Device:     lustre-ost2_2/ost2_2
Target:     fs20344:OST0001
Index:      1
Lustre FS:  fs20344
Mount type: zfs
Flags:      0x62
              (OST first_time update )
Persistent mount opts: 
Parameters: mgsnode=192.168.203.154@tcp:192.168.203.154@tcp sys.timeout=20 autodegrade=on
mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost2_2 /tmp/lustre-ost2_2
mkfs_cmd = zfs create -o canmount=off  -o quota=409600000 lustre-ost2_2/ost2_2
  xattr=sa
  dnodesize=auto
  recordsize=1M
  compression=off
Writing lustre-ost2_2/ost2_2 properties
  lustre:mgsnode=192.168.203.154@tcp:192.168.203.154@tcp
  lustre:sys.timeout=20
  lustre:autodegrade=on
  lustre:version=1
  lustre:flags=98
  lustre:index=1
  lustre:fsname=fs20344
  lustre:svname=fs20344:OST0001
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1890: OST_INDICES: bad array subscript
Start fs3ost: mount -t lustre -o localrecov  lustre-ost2_2/ost2_2 /mnt/lustre-fs3ost
oleg354-server: mount.lustre: mount lustre-ost2_2/ost2_2 at /mnt/lustre-fs3ost failed: Permission denied
pdsh@oleg354-client: oleg354-server: ssh exited with exit code 13
oleg354-server: error: set_param: param_path 'seq/cli-fs20344:OST0001-super/width': No such file or directory
oleg354-server: error: set_param: setting 'seq/cli-fs20344:OST0001-super/width'='65536': No such file or directory
pdsh@oleg354-client: oleg354-server: ssh exited with exit code 2
Start of lustre-ost2_2/ost2_2 on fs3ost failed 13
allow_register=unlimited
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1890: OST_INDICES: bad array subscript
Start fs3ost: mount -t lustre -o localrecov  lustre-ost2_2/ost2_2 /mnt/lustre-fs3ost
seq.cli-fs20344-OST0001-super.width=65536
oleg354-server: oleg354-server.virtnet: executing set_default_debug -1 all
pdsh@oleg354-client: oleg354-server: ssh exited with exit code 1
Commit the device label on lustre-ost2_2/ost2_2
Started fs20344-OST0001
obdfilter.fs20344-OST0000.recovery_status=status: INACTIVE
obdfilter.fs20344-OST0001.recovery_status=status: INACTIVE
Cleaning up test 157c...
Stopping /mnt/lustre-fs2ost (opts:-f) on oleg354-server
Stopping /mnt/lustre-fs3ost (opts:-f) on oleg354-server
umount lustre on /mnt/lustre.....
Stopping client oleg354-client.virtnet /mnt/lustre (opts:)
oleg354-server: params: OBD_IOC_LLOG_PRINT failed: No such file or directory
pdsh@oleg354-client: oleg354-server: ssh exited with exit code 2
pdsh@oleg354-client: oleg354-server: ssh exited with exit code 123
allow_register=unlimited
stop ost1 service on oleg354-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg354-server
stop mds service on oleg354-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg354-server
stop mds service on oleg354-server
Stopping /mnt/lustre-mds2 (opts:-f) on oleg354-server
unloading modules via unload_modules_local on: 'oleg354-server'
oleg354-server: oleg354-server.virtnet: executing unload_modules_local
oleg354-server: kmemleak disabled
modules unloaded.