== sanityn test 109: Race with several mount instances on 1 node ========================================================== 12:00:19 (1773676819)
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)
Starting race between client mount instances (50 iterations):
Iteration 1
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 2
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 3
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 4
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 5
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 6
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 7
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 8
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 9
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 10
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 11
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 12
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 13
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 14
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 15
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 16
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 17
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 18
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 19
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 20
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 21
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 22
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 23
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 24
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 25
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 26
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 27
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 28
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 29
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 30
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 31
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 32
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 33
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 34
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 35
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 36
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 37
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 38
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 39
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 40
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 41
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 42
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 43
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 44
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 45
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 46
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 47
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 48
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 49
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Iteration 50
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2
192.168.204.132@tcp:/lustre /mnt/lustre2 lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
192.168.204.132@tcp:/lustre /mnt/lustre lustre rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0
Stopping client oleg432-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg432-client.virtnet /mnt/lustre (opts:)

/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
../libcfs/libcfs/libcfs options: 'cpu_npartitions=2'
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
mdt/mdt options: 'mdt_enable_flr_ec=1'
loading modules on: 'oleg432-server'
oleg432-server: oleg432-server.virtnet: executing load_modules_local
oleg432-server: Loading modules from /home/green/git/lustre-release/lustre
oleg432-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1040: echo: write error: Device or resource busy
oleg432-server: detected 4 online CPUs by sysfs
oleg432-server: MODOPTS_LIBCFS=
oleg432-server: Force libcfs to create 2 CPU partitions

Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre
Starting client: oleg432-client.virtnet:  -o user_xattr,flock 192.168.204.132@tcp:/lustre /mnt/lustre2