== conf-sanity test 73b: Large failnode NID list in mountdata ========================================================== 11:54:46 (1773676486) checking for existing Lustre data: found Read previous values: Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x2 (OST ) Persistent mount opts: Parameters: mgsnode=192.168.201.137@tcp sys.timeout=20 autodegrade=on failover.node=1.2.3.4@tcp Permanent disk data: Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x2 (OST ) Persistent mount opts: Parameters: mgsnode=192.168.201.137@tcp sys.timeout=20 autodegrade=on failover.node=1.2.3.4@tcp autodegrade=onComment: just a comment for tail Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.201.137@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:failover.node=1.2.3.4@tcp lustre:autodegrade=on lustre:version=1 lustre:flags=2 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 lustre:userdata=just a comment for tail oleg137-server: tunefs.lustre: params are too long: oleg137-server: mgsnode=192.168.201.137@tcp:111.222.173.1@tcp,111.222.142.1@tcp:111.222.173.2@tcp,111.222.142.2@tcp:111.222.173.3@tcp,111.222.142.3@tcp:111.222.173.4@tcp,111.222.142.4@tcp:111.222.173.5@tcp,111.222.142.5@tcp:111.222.173.6@tcp,111.222.142.6@tcp:111.222.173.7@tcp,111.222.142.7@tcp:111.222.173.8@tcp,111.222.142.8@tcp:111.222.173.9@tcp,111.222.142.9@tcp:111.222.173.10@tcp,111.222.142.10@tcp:111.222.173.11@tcp,111.222.142.11@tcp:111.222.173.12@tcp,111.222.142.12@tcp:111.222.173.13@tcp,111.222.142.13@tcp:111.222.173.14@tcp,111.222.142.14@tcp:111.222.173.15@tcp,111.222.142.15@tcp:111.222.173.16@tcp,111.222.142.16@tcp:111.222.173.17@tcp,111.222.142.17@tcp:111.222.173.18@tcp,111.222.142.18@tcp:111.222.173.19@tcp,111.222.142.19@tcp:111.222.173.20@tcp,111.222.142.20@tcp:111.222.173.21@tcp,111.222.142.21@tcp:111.222.173.22@tcp,111.222.142.22@tcp:111.222.173.23@tcp,111.222.142.23@tcp:111.222.173.24@tcp,111.222.142.24@tcp:111.222.173.25@tcp,111.222.142.25@tcp:111.222.173.26@tcp,111.222.142.26@tcp:111.222.173.27@tcp,111.222.142.27@tcp:111.222.173.28@tcp,111.222.142.28@tcp:111.222.173.29@tcp,111.222.142.29@tcp:111.222.173.30@tcp,111.222.142.30@tcp:111.222.173.31@tcp,111.222.142.31@tcp:111.222.173.32@tcp,111.222.142.32@tcp:111.222.173.33@tcp,111.222.142.33@tcp:111.222.173.34@tcp,111.222.142.34@tcp:111.222.173.35@tcp,111.222.142.35@tcp:111.222.173.36@tcp,111.222.142.36@tcp:111.222.173.37@tcp,111.222.142.37@tcp:111.222.173.38@tcp,111.222.142.38@tcp:111.222.173.39@tcp,111.222.142.39@tcp:111.222.173.40@tcp,111.222.142.40@tcp:111.222.173.41@tcp,111.222.142.41@tcp:111.222.173.42@tcp,111.222.142.42@tcp:111.222.173.43@tcp,111.222.142.43@tcp:111.222.173.44@tcp,111.222.142.44@tcp:111.222.173.45@tcp,111.222.142.45@tcp:111.222.173.46@tcp,111.222.142.46@tcp:111.222.173.47@tcp,111.222.142.47@tcp:111.222.173.48@tcp,111.222.142.48@tcp:111.222.173.49@tcp,111.222.142.49@tcp sys.timeout=20 autodegrade=on failover.node=1.2.3.4@tcp:111.222.173.1@tcp,111.222.142.1@tcp:111.222.173.2@tcp,111.222.142.2@tcp:111.222.173.3@tcp,111.222.142.3@tcp:111.222.173.4@tcp,111.222.142.4@tcp:111.222.173.5@tcp,111.222.142.5@tcp:111.222.173.6@tcp,111.222.142.6@tcp:111.222.173.7@tcp,111.222.142.7@tcp:111.222.173.8@tcp,111.222.142.8@tcp:111.222.173.9@tcp,111.222.142.9@tcp:111.222.173.10@tcp,111.222.142.10@tcp:111.222.173.11@tcp,111.222.142.11@tcp:111.222.173.12@tcp,111.222.142.12@tcp:111.222.173.13@tcp,111.222.142.13@tcp:111.222.173.14@tcp,111.222.142.14@tcp:111.222.173.15@tcp,111.222.142.15@tcp:111.222.173.16@tcp,111.222.142.16@tcp:111.222.173.17@tcp,111.222.142.17@tcp:111.222.173.18@tcp,111.222.142.18@tcp:111.222.173.19@tcp,111.222.142.19@tcp:111.222.173.20@tcp,111.222.142.20@tcp:111.222.173.21@tcp,111.222.142.21@tcp:111.222.173.22@tcp,111.222.142.22@tcp:111.222.173.23@tcp,111.222.142.23@tcp:111.222.173.24@tcp,111.222.142.24@tcp:111.222.173.25@tcp,111.222.142.25@tcp:111.222.173.26@tcp,111.222.142.26@tcp:111.222.173.27@tcp,111.222.142.27@tcp:111.222.173.28@tcp,111.222.142.28@tcp:111.222.173.29@tcp,111.222.142.29@tcp:111.222.173.30@tcp,111.222.142.30@tcp:111.222.173.31@tcp,111.222.142.31@tcp:111.222.173.32@tcp,111.222.142.32@tcp:111.222.173.33@tcp,111.222.142.33@tcp:111.222.173.34@tcp,111.222.142.34@tcp:111.222.173.35@tcp,111.222.142.35@tcp:111.222.173.36@tcp,111.222.142.36@tcp:111.222.173.37@tcp,111.222.142.37@tcp:111.222.173.38@tcp,111.222.142.38@tcp:111.222.173.39@tcp,111.222.142.39@tcp:111.222.173.40@tcp,111.222.142.40@tcp:111.222.173.41@tcp,111.222.142.41@tcp:111.222.173.42@tcp,111.222.142.42@tcp:111.222.173.43@tcp,111.222.142.43@tcp:111.222.173.44@tcp,111.222.142.44@tcp:111.222.173.45@tcp,111.222.142.45@tcp:111.222.173.46@tcp,111.222.142.46@tcp:111.222.173.47@tcp,111.222.142.47@tcp:111.222.173.48@tcp,111.222.142.48@tcp:111.222.173.49@tcp,111.222.142.49@tcp:111.222.173.50@tcp,111.222.142.50@tcp +mgsnode==111.222.173.50@tcp,111.222.142.50@tcp oleg137-server: tunefs.lustre: exiting with 7 (Argument list too long) pdsh@oleg137-client: oleg137-server: ssh exited with exit code 7 start mds service on oleg137-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg137-server: oleg137-server.virtnet: executing set_default_debug -1 all pdsh@oleg137-client: oleg137-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg137-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg137-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg137-server: oleg137-server.virtnet: executing set_default_debug -1 all pdsh@oleg137-client: oleg137-server: ssh exited with exit code 1 Started lustre-OST0000 oleg137-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid stop ost1 service on oleg137-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg137-server stop mds service on oleg137-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg137-server Found total 198 NIDs in parameters Stopping clients: oleg137-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg137-client.virtnet /mnt/lustre2 (opts:-f) oleg137-server: oleg137-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy oleg137-server: detected 4 online CPUs by sysfs oleg137-server: MODOPTS_LIBCFS= oleg137-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2