== conf-sanity test 157c: test allow_register timeout functionality ========================================================== 04:42:18 (1789375338) start mds service on oleg146-server Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' -rwxr-xr-x. 1 green green 1931560 Sep 14 04:14 /home/green/git/lustre-release/lustre/utils/mount.lustre -rwxr-xr-x. 1 root root 12 Jan 31 2019 /usr/sbin/mount.lustre mount --bind /home/green/git/lustre-release/lustre/utils/mount.lustre /usr/sbin/mount.lustre loading modules on: 'oleg146-server' oleg146-server: oleg146-server.virtnet: executing load_modules_local oleg146-server: kmemleak disabled oleg146-server: Loading modules from /home/green/git/lustre-release/lustre oleg146-server: detected 4 online CPUs by sysfs oleg146-server: MODOPTS_LIBCFS= oleg146-server: Force libcfs to create 2 CPU partitions oleg146-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg146-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg146-server: mdt/mdt options: 'mdt_enable_flr_ec=1' oleg146-server: /usr/sbin/ not writable for /usr/sbin/mount.lustre_tgt Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg146-server: oleg146-server.virtnet: executing set_default_debug -1 all pdsh@oleg146-client: oleg146-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg146-server: params: OBD_IOC_LLOG_PRINT failed: No such file or directory pdsh@oleg146-client: oleg146-server: ssh exited with exit code 2 pdsh@oleg146-client: oleg146-server: ssh exited with exit code 123 allow_register=unlimited oleg146-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg146-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg146-server: oleg146-server.virtnet: executing set_default_debug -1 all pdsh@oleg146-client: oleg146-server: ssh exited with exit code 1 Started lustre-OST0000 oleg146-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg146-client.virtnet: -o user_xattr,flock 192.168.201.146@tcp:/lustre /mnt/lustre allow_register=unlimited Permanent disk data: Device: lustre-ost1_2/ost1_2 Target: fs17789:OST0000 Index: 0 Lustre FS: fs17789 Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: mgsnode=192.168.201.146@tcp:192.168.201.146@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1_2 /tmp/lustre-ost1_2 mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1_2/ost1_2 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1_2/ost1_2 properties lustre:mgsnode=192.168.201.146@tcp:192.168.201.146@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=98 lustre:index=0 lustre:fsname=fs17789 lustre:svname=fs17789:OST0000 /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1890: OST_INDICES: bad array subscript Start fs2ost: mount -t lustre -o localrecov lustre-ost1_2/ost1_2 /mnt/lustre-fs2ost seq.cli-fs17789-OST0000-super.width=65536 oleg146-server: oleg146-server.virtnet: executing set_default_debug -1 all pdsh@oleg146-client: oleg146-server: ssh exited with exit code 1 Commit the device label on lustre-ost1_2/ost1_2 Started fs17789-OST0000 allow_register=60s obdfilter.fs17789-OST0000.recovery_status=status: INACTIVE Waiting for allow_register timeout to expire Waiting 66s for '1' Waiting 56s for '1' Waiting 46s for '1' Waiting 36s for '1' Updated after 61s: want '1' got '1' Permanent disk data: Device: lustre-ost2_2/ost2_2 Target: fs17789:OST0001 Index: 1 Lustre FS: fs17789 Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: mgsnode=192.168.201.146@tcp:192.168.201.146@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost2_2 /tmp/lustre-ost2_2 mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost2_2/ost2_2 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost2_2/ost2_2 properties lustre:mgsnode=192.168.201.146@tcp:192.168.201.146@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=98 lustre:index=1 lustre:fsname=fs17789 lustre:svname=fs17789:OST0001 /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1890: OST_INDICES: bad array subscript Start fs3ost: mount -t lustre -o localrecov lustre-ost2_2/ost2_2 /mnt/lustre-fs3ost oleg146-server: mount.lustre: mount lustre-ost2_2/ost2_2 at /mnt/lustre-fs3ost failed: Permission denied pdsh@oleg146-client: oleg146-server: ssh exited with exit code 13 oleg146-server: error: set_param: param_path 'seq/cli-fs17789:OST0001-super/width': No such file or directory oleg146-server: error: set_param: setting 'seq/cli-fs17789:OST0001-super/width'='65536': No such file or directory pdsh@oleg146-client: oleg146-server: ssh exited with exit code 2 Start of lustre-ost2_2/ost2_2 on fs3ost failed 13 allow_register=unlimited /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1890: OST_INDICES: bad array subscript Start fs3ost: mount -t lustre -o localrecov lustre-ost2_2/ost2_2 /mnt/lustre-fs3ost seq.cli-fs17789-OST0001-super.width=65536 oleg146-server: oleg146-server.virtnet: executing set_default_debug -1 all pdsh@oleg146-client: oleg146-server: ssh exited with exit code 1 Commit the device label on lustre-ost2_2/ost2_2 Started fs17789-OST0001 obdfilter.fs17789-OST0000.recovery_status=status: INACTIVE obdfilter.fs17789-OST0001.recovery_status=status: INACTIVE Cleaning up test 157c... Stopping /mnt/lustre-fs2ost (opts:-f) on oleg146-server Stopping /mnt/lustre-fs3ost (opts:-f) on oleg146-server umount lustre on /mnt/lustre..... Stopping client oleg146-client.virtnet /mnt/lustre (opts:) oleg146-server: params: OBD_IOC_LLOG_PRINT failed: No such file or directory pdsh@oleg146-client: oleg146-server: ssh exited with exit code 2 pdsh@oleg146-client: oleg146-server: ssh exited with exit code 123 allow_register=unlimited stop ost1 service on oleg146-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg146-server stop mds service on oleg146-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg146-server unloading modules via unload_modules_local on: 'oleg146-server' oleg146-server: oleg146-server.virtnet: executing unload_modules_local oleg146-server: kmemleak disabled modules unloaded.