-----============= acceptance-small: conf-sanity ============----- Fri Oct 24 09:52:58 EDT 2025
oleg150-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory
excepting tests: 32newtarball 110 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a
skipping tests SLOW=no: 45 69 106 111
Stopping clients: oleg150-client.virtnet /mnt/lustre (opts:-f)
Stopping client oleg150-client.virtnet /mnt/lustre opts:-f
Stopping clients: oleg150-client.virtnet /mnt/lustre2 (opts:-f)
Stopping /mnt/lustre-mds1 (opts:-f) on oleg150-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg150-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg150-server
oleg150-server: oleg150-server.virtnet: executing set_hostid
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg150-server'
oleg150-server: oleg150-server.virtnet: executing load_modules_local
oleg150-server: Loading modules from /home/green/git/lustre-release/lustre
oleg150-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy
oleg150-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy
oleg150-server: detected 4 online CPUs by sysfs
oleg150-server: Force libcfs to create 2 CPU partitions
Formatting mgs, mds, osts
Format mds1: lustre-mdt1/mdt1
Format ost1: lustre-ost1/ost1
Format ost2: lustre-ost2/ost2
start mds service on oleg150-server
Starting mds1: -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg150-server: oleg150-server.virtnet: executing set_default_debug -1 all 8
pdsh@oleg150-client: oleg150-server: ssh exited with exit code 1
Commit the device label on lustre-mdt1/mdt1
Started lustre-MDT0000
oleg150-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid
start ost1 service on oleg150-server
Starting ost1: -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
oleg150-server: oleg150-server.virtnet: executing set_default_debug -1 all 8
pdsh@oleg150-client: oleg150-server: ssh exited with exit code 1
Commit the device label on lustre-ost1/ost1
Started lustre-OST0000
oleg150-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
oleg150-server: oleg150-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 40
oleg150-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
stop ost1 service on oleg150-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg150-server
stop mds service on oleg150-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg150-server

 SKIP: conf-sanity test_121 skipping ALWAYS excluded test 121

 SKIP: conf-sanity test_122a skipping ALWAYS excluded test 122a

== conf-sanity test 122b: Check OST sequence wouldn't change when IDIF 32bit overflows ========================================================== 09:55:05 (1761314105)
Stopping clients: oleg150-client.virtnet /mnt/lustre (opts:-f)
Stopping clients: oleg150-client.virtnet /mnt/lustre2 (opts:-f)
oleg150-server: oleg150-server.virtnet: executing set_hostid
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg150-server'
oleg150-server: oleg150-server.virtnet: executing load_modules_local
oleg150-server: Loading modules from /home/green/git/lustre-release/lustre
oleg150-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy
oleg150-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy
oleg150-server: detected 4 online CPUs by sysfs
oleg150-server: Force libcfs to create 2 CPU partitions
Formatting mgs, mds, osts
Format mds1: lustre-mdt1/mdt1
Format ost1: lustre-ost1/ost1
Format ost2: lustre-ost2/ost2
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg150-server'
oleg150-server: oleg150-server.virtnet: executing load_modules_local
oleg150-server: Loading modules from /home/green/git/lustre-release/lustre
oleg150-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy
oleg150-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy
oleg150-server: detected 4 online CPUs by sysfs
oleg150-server: Force libcfs to create 2 CPU partitions
fail_loc=0x00001e0
start mds service on oleg150-server
Starting mds1: -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg150-server: oleg150-server.virtnet: executing set_default_debug -1 all 8
pdsh@oleg150-client: oleg150-server: ssh exited with exit code 1
Commit the device label on lustre-mdt1/mdt1
Started lustre-MDT0000
oleg150-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid
start ost1 service on oleg150-server
Starting ost1: -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
oleg150-server: oleg150-server.virtnet: executing set_default_debug -1 all 8
pdsh@oleg150-client: oleg150-server: ssh exited with exit code 1
Commit the device label on lustre-ost1/ost1
Started lustre-OST0000
oleg150-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
mount lustre  on /mnt/lustre.....
Starting client: oleg150-client.virtnet:  -o user_xattr,flock oleg150-server@tcp:/lustre /mnt/lustre
obdfilter.lustre-OST0000.precreate_batch=256
fail_loc=0
On OST0, 11872 inodes available. Want 100500. rc=0
open(/mnt/lustre/d122b.conf-sanity/f122b.conf-sanity-1-0) error: No space left on device
total: 0 open/close in 61.01 seconds: 0.00 ops/second
 conf-sanity test_122b: @@@@@@ FAIL: createmany fail create 10000 files: 28 
  Trace dump:
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6482:error()
  = /home/green/git/lustre-release/lustre/tests/conf-sanity.sh:9178:test_122b()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6840:run_one()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6887:run_one_logged()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6713:run_test()
  = /home/green/git/lustre-release/lustre/tests/conf-sanity.sh:9200:main()
Dumping lctl log to /tmp/testlogs//conf-sanity.test_122b.*.1761314262.log
umount lustre on /mnt/lustre.....
Stopping client oleg150-client.virtnet /mnt/lustre (opts:)
rsync: chown "/tmp/testlogs/.conf-sanity.test_122b.debug_log.oleg150-server.1761314262.log.2c3stR" failed: Operation not permitted (1)
rsync: chown "/tmp/testlogs/.conf-sanity.test_122b.dmesg.oleg150-server.1761314262.log.FwZPfj" failed: Operation not permitted (1)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3]
stop ost1 service on oleg150-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg150-server
stop mds service on oleg150-server
Stopping /mnt/lustre-mds1 (opts:-f) on oleg150-server
/home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy
LNET ready to unload
/home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy
unloading modules on: 'oleg150-server'
oleg150-server: oleg150-server.virtnet: executing unload_modules_local
oleg150-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy
oleg150-server: LNET ready to unload
oleg150-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy
modules unloaded.
FAIL 122b (191s)

 SKIP: conf-sanity test_123aa skipping ALWAYS excluded test 123aa

 SKIP: conf-sanity test_123ab skipping ALWAYS excluded test 123ab

 SKIP: conf-sanity test_123ac skipping ALWAYS excluded test 123ac

 SKIP: conf-sanity test_123ad skipping ALWAYS excluded test 123ad

 SKIP: conf-sanity test_123ae skipping ALWAYS excluded test 123ae

 SKIP: conf-sanity test_123af skipping ALWAYS excluded test 123af

 SKIP: conf-sanity test_123ag skipping ALWAYS excluded test 123ag

== conf-sanity test 123ai: llog_print display all non skipped records ========================================================== 09:58:30 (1761314310)
start mds service on oleg150-server
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
Force libcfs to create 2 CPU partitions
ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
quota/lquota options: 'hash_lqs_cur_bits=3'
loading modules on: 'oleg150-server'
oleg150-server: oleg150-server.virtnet: executing load_modules_local
oleg150-server: Loading modules from /home/green/git/lustre-release/lustre
oleg150-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy
oleg150-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy
oleg150-server: detected 4 online CPUs by sysfs
oleg150-server: Force libcfs to create 2 CPU partitions
oleg150-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1'
oleg150-server: quota/lquota options: 'hash_lqs_cur_bits=3'
Starting mds1: -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg150-server: oleg150-server.virtnet: executing set_default_debug -1 all 8
pdsh@oleg150-client: oleg150-server: ssh exited with exit code 1
Started lustre-MDT0000
oleg150-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid
start ost1 service on oleg150-server
Starting ost1: -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
oleg150-server: oleg150-server.virtnet: executing set_default_debug -1 all 8
pdsh@oleg150-client: oleg150-server: ssh exited with exit code 1
Started lustre-OST0000
oleg150-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
mount lustre  on /mnt/lustre.....
Starting client: oleg150-client.virtnet:  -o user_xattr,flock oleg150-server@tcp:/lustre /mnt/lustre
oleg150-server: params: OBD_IOC_LLOG_PRINT failed: No such file or directory
pdsh@oleg150-client: oleg150-server: ssh exited with exit code 2
- { index: 394, event: set_param, device: general, parameter: timeout, value: 129 }
cleanup test 123ai
timeout=20
timeout=20
PASS 123ai (148s)

 SKIP: conf-sanity test_123F skipping ALWAYS excluded test 123F

== conf-sanity test 124: check failover after replace_nids ========================================================== 10:00:59 (1761314459)

 SKIP: conf-sanity test_124 needs >= 2 MDTs
SKIP 124 (3s)

== conf-sanity test 125: check l_tunedisk only tunes OSTs and their slave devices ========================================================== 10:01:02 (1761314462)

 SKIP: conf-sanity test_125 ldiskfs only test
SKIP 125 (4s)

 SKIP: conf-sanity test_126 skipping ALWAYS excluded test 126

== conf-sanity test 127: direct io overwrite on full ost ========================================================== 10:01:08 (1761314468)

 SKIP: conf-sanity test_127 ldiskfs only test
SKIP 127 (4s)

== conf-sanity test 128: Force using remote logs with --nolocallogs ========================================================== 10:01:11 (1761314471)

 SKIP: conf-sanity test_128 need separate mgs device
SKIP 128 (3s)

 SKIP: conf-sanity test_129 skipping ALWAYS excluded test 129

== conf-sanity test 130: re-register an MDT after writeconf ========================================================== 10:01:15 (1761314475)

 SKIP: conf-sanity test_130 needs >= 2 MDTs
SKIP 130 (2s)

== conf-sanity test 131: MDT backup restore with project ID ========================================================== 10:01:18 (1761314478)

 SKIP: conf-sanity test_131 ldiskfs only test
SKIP 131 (2s)

 SKIP: conf-sanity test_132 skipping ALWAYS excluded test 132
Stopping clients: oleg150-client.virtnet /mnt/lustre (opts:-f)
Stopping client oleg150-client.virtnet /mnt/lustre opts:-f
Stopping clients: oleg150-client.virtnet /mnt/lustre2 (opts:-f)
Stopping /mnt/lustre-mds1 (opts:-f) on oleg150-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg150-server
oleg150-server: oleg150-server.virtnet: executing set_hostid
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg150-server'
oleg150-server: oleg150-server.virtnet: executing load_modules_local
oleg150-server: Loading modules from /home/green/git/lustre-release/lustre
oleg150-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy
oleg150-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy
oleg150-server: detected 4 online CPUs by sysfs
oleg150-server: Force libcfs to create 2 CPU partitions
Formatting mgs, mds, osts
Format mds1: lustre-mdt1/mdt1
Format ost1: lustre-ost1/ost1
Format ost2: lustre-ost2/ost2
== conf-sanity test complete, duration 575 sec =========== 10:02:34 (1761314554)
conf-sanity: FAIL: test_122b createmany fail create 10000 files: 28