-----============= acceptance-small: conf-sanity ============----- Thu Oct 23 12:43:29 EDT 2025 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg448-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32b 32c 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg448-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg448-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg448-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg448-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg448-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg448-server oleg448-server: oleg448-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg448-server' oleg448-server: oleg448-server.virtnet: executing load_modules_local oleg448-server: Loading modules from /home/green/git/lustre-release/lustre oleg448-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg448-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy oleg448-server: detected 4 online CPUs by sysfs oleg448-server: MODOPTS_LIBCFS= oleg448-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg448-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg448-server: oleg448-server.virtnet: executing set_default_debug -1 all pdsh@oleg448-client: oleg448-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg448-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg448-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg448-server: oleg448-server.virtnet: executing set_default_debug -1 all pdsh@oleg448-client: oleg448-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg448-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg448-server: oleg448-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg448-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg448-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg448-server stop mds service on oleg448-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg448-server == conf-sanity test 45: long unlink handling in ptlrpcd == 12:46:21 (1761237981) start mds service on oleg448-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg448-server: oleg448-server.virtnet: executing set_default_debug -1 all pdsh@oleg448-client: oleg448-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg448-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg448-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg448-server: oleg448-server.virtnet: executing set_default_debug -1 all pdsh@oleg448-client: oleg448-server: ssh exited with exit code 1 Started lustre-OST0000 oleg448-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg448-client.virtnet: -o user_xattr,flock 192.168.204.148@tcp:/lustre /mnt/lustre setup single mount lustre success stop mds service on oleg448-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg448-server sleep 60 sec fail_loc=0x8000050f sleep 10 sec manual umount lustre on /mnt/lustre.... df: /mnt/lustre: Input/output error fail_loc=0x0 start mds service on oleg448-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg448-server: oleg448-server.virtnet: executing set_default_debug -1 all pdsh@oleg448-client: oleg448-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg448-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg448-client.virtnet: -o user_xattr,flock 192.168.204.148@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg448-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg448-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg448-server stop mds service on oleg448-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg448-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg448-server' oleg448-server: oleg448-server.virtnet: executing unload_modules_local oleg448-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg448-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded. pdsh@oleg448-client: oleg448-server: ssh exited with exit code 2 pdsh@oleg448-client: oleg448-client: ssh exited with exit code 2 pdsh@oleg448-client: oleg448-server: ssh exited with exit code 2 pdsh@oleg448-client: oleg448-client: ssh exited with exit code 2 PASS 45 (192s) == conf-sanity test 69: replace an OST with the same index ========================================================== 12:49:34 (1761238174) start mds service on oleg448-server /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg448-server' oleg448-server: oleg448-server.virtnet: executing load_modules_local oleg448-server: Loading modules from /home/green/git/lustre-release/lustre oleg448-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg448-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy oleg448-server: detected 4 online CPUs by sysfs oleg448-server: MODOPTS_LIBCFS= oleg448-server: Force libcfs to create 2 CPU partitions oleg448-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg448-server: quota/lquota options: 'hash_lqs_cur_bits=3' Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg448-server: oleg448-server.virtnet: executing set_default_debug -1 all pdsh@oleg448-client: oleg448-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg448-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg448-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg448-server: oleg448-server.virtnet: executing set_default_debug -1 all pdsh@oleg448-client: oleg448-server: ssh exited with exit code 1 Started lustre-OST0000 oleg448-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg448-client.virtnet: -o user_xattr,flock 192.168.204.148@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 11872 inodes available. Want 99872. rc=0 - open/close 777 (time 1761238250.01 total 10.01 last 77.64) - open/close 1478 (time 1761238260.02 total 20.02 last 70.04) - open/close 2207 (time 1761238270.03 total 30.03 last 72.83) - open/close 2980 (time 1761238280.04 total 40.04 last 77.22) - open/close 3666 (time 1761238290.06 total 50.06 last 68.47) - open/close 4275 (time 1761238300.06 total 60.06 last 60.87) - open/close 5036 (time 1761238310.07 total 70.07 last 76.05) - open/close 5751 (time 1761238320.07 total 80.07 last 71.47) - open/close 6379 (time 1761238330.07 total 90.07 last 62.78) - open/close 7003 (time 1761238340.08 total 100.08 last 62.37) - open/close 7766 (time 1761238350.10 total 110.10 last 76.12) - open/close 8461 (time 1761238360.10 total 120.10 last 69.50) - open/close 9199 (time 1761238370.11 total 130.11 last 73.73) - open/close 9971 (time 1761238380.12 total 140.12 last 77.10) total: 10000 open/close in 140.72 seconds: 71.06 ops/second - unlinked 0 (time 1761238384 ; total 0 ; last 0) total: 10000 unlinks in 81 seconds: 123.456787 unlinks/second - open/close 752 (time 1761238479.68 total 10.00 last 75.17) - open/close 1472 (time 1761238489.69 total 20.01 last 71.96) - open/close 2063 (time 1761238499.69 total 30.01 last 59.09) - open/close 2755 (time 1761238509.70 total 40.02 last 69.12) - open/close 3527 (time 1761238519.70 total 50.03 last 77.17) - open/close 4292 (time 1761238529.71 total 60.03 last 76.44) - open/close 5049 (time 1761238539.73 total 70.05 last 75.58) - open/close 5799 (time 1761238549.74 total 80.06 last 74.89) - open/close 6531 (time 1761238559.75 total 90.07 last 73.14) - open/close 7190 (time 1761238569.75 total 100.08 last 65.85) - open/close 7905 (time 1761238579.77 total 110.09 last 71.42) - open/close 8671 (time 1761238589.79 total 120.12 last 76.40) - open/close 9397 (time 1761238599.79 total 130.12 last 72.59) total: 10000 open/close in 138.02 seconds: 72.45 ops/second - unlinked 0 (time 1761238612 ; total 0 ; last 0) total: 10000 unlinks in 77 seconds: 129.870132 unlinks/second - open/close 731 (time 1761238703.31 total 10.01 last 73.04) - open/close 1480 (time 1761238713.31 total 20.01 last 74.90) - open/close 2266 (time 1761238723.32 total 30.02 last 78.51) - open/close 3051 (time 1761238733.32 total 40.02 last 78.47) - open/close 3857 (time 1761238743.32 total 50.02 last 80.59) - open/close 4594 (time 1761238753.35 total 60.05 last 73.53) - open/close 5402 (time 1761238763.35 total 70.06 last 80.74) - open/close 6164 (time 1761238773.36 total 80.06 last 76.15) - open/close 6894 (time 1761238783.38 total 90.08 last 72.85) - open/close 7695 (time 1761238793.40 total 100.10 last 79.98) - open/close 8480 (time 1761238803.41 total 110.11 last 78.42) - open/close 9226 (time 1761238813.41 total 120.11 last 74.57) total: 10000 open/close in 129.72 seconds: 77.09 ops/second - unlinked 0 (time 1761238826 ; total 0 ; last 0) total: 10000 unlinks in 73 seconds: 136.986298 unlinks/second - open/close 891 (time 1761238912.61 total 10.01 last 89.03) - open/close 1581 (time 1761238922.62 total 20.02 last 68.90) - open/close 2328 (time 1761238932.63 total 30.03 last 74.64) - open/close 3114 (time 1761238942.64 total 40.03 last 78.56) - open/close 4035 (time 1761238952.64 total 50.04 last 92.06) - open/close 4898 (time 1761238962.64 total 60.04 last 86.30) - open/close 5696 (time 1761238972.64 total 70.04 last 79.78) - open/close 6601 (time 1761238982.65 total 80.05 last 90.43) - open/close 7415 (time 1761238992.67 total 90.07 last 81.23) - open/close 8143 (time 1761239002.68 total 100.07 last 72.78) - open/close 8953 (time 1761239012.69 total 110.08 last 80.92) - open/close 9711 (time 1761239022.70 total 120.10 last 75.68) total: 10000 open/close in 123.53 seconds: 80.95 ops/second - unlinked 0 (time 1761239029 ; total 0 ; last 0) total: 10000 unlinks in 63 seconds: 158.730164 unlinks/second - open/close 1029 (time 1761239105.33 total 10.00 last 102.90) - open/close 1989 (time 1761239115.33 total 20.00 last 95.97) - open/close 3016 (time 1761239125.33 total 30.00 last 102.69) - open/close 3976 (time 1761239135.34 total 40.01 last 95.95) - open/close 5039 (time 1761239145.34 total 50.01 last 106.24) - open/close 5967 (time 1761239155.35 total 60.02 last 92.78) - open/close 6854 (time 1761239165.36 total 70.03 last 88.62) - open/close 7830 (time 1761239175.36 total 80.03 last 97.56) - open/close 8719 (time 1761239185.36 total 90.03 last 88.90) - open/close 9651 (time 1761239195.36 total 100.03 last 93.18) total: 10000 open/close in 103.85 seconds: 96.29 ops/second - unlinked 0 (time 1761239202 ; total 0 ; last 0) total: 10000 unlinks in 58 seconds: 172.413788 unlinks/second - open/close 940 (time 1761239273.20 total 10.01 last 93.95) - open/close 1838 (time 1761239283.21 total 20.01 last 89.75) - open/close 2819 (time 1761239293.21 total 30.02 last 98.04) - open/close 3815 (time 1761239303.21 total 40.02 last 99.58) - open/close 4685 (time 1761239313.22 total 50.02 last 86.97) - open/close 5513 (time 1761239323.22 total 60.03 last 82.76) - open/close 6404 (time 1761239333.23 total 70.03 last 89.05) - open/close 7275 (time 1761239343.23 total 80.04 last 87.06) - open/close 8109 (time 1761239353.24 total 90.04 last 83.34) - open/close 8955 (time 1761239363.25 total 100.05 last 84.50) - open/close 9994 (time 1761239373.25 total 110.06 last 103.89) total: 10000 open/close in 110.10 seconds: 90.83 ops/second - unlinked 0 (time 1761239375 ; total 0 ; last 0) total: 10000 unlinks in 52 seconds: 192.307693 unlinks/second - open/close 1249 (time 1761239439.88 total 10.00 last 124.86) - open/close 2276 (time 1761239449.88 total 20.01 last 102.63) - open/close 3470 (time 1761239459.89 total 30.02 last 119.31) - open/close 4911 (time 1761239469.89 total 40.02 last 144.03) - open/close 6060 (time 1761239479.90 total 50.02 last 114.88) - open/close 7014 (time 1761239489.91 total 60.03 last 95.31) - open/close 8124 (time 1761239499.91 total 70.04 last 110.92) - open/close 9035 (time 1761239509.92 total 80.05 last 91.01) - open/close 9891 (time 1761239519.93 total 90.06 last 85.52) total: 10000 open/close in 91.30 seconds: 109.52 ops/second - unlinked 0 (time 1761239524 ; total 0 ; last 0) total: 10000 unlinks in 61 seconds: 163.934433 unlinks/second - open/close 972 (time 1761239597.60 total 10.01 last 97.13) - open/close 1863 (time 1761239607.61 total 20.01 last 89.08) - open/close 2792 (time 1761239617.61 total 30.02 last 92.82) - open/close 3726 (time 1761239627.63 total 40.03 last 93.27) - open/close 4596 (time 1761239637.63 total 50.03 last 86.97) - open/close 5384 (time 1761239647.64 total 60.04 last 78.73) - open/close 6313 (time 1761239657.64 total 70.04 last 92.90) - open/close 7236 (time 1761239667.65 total 80.06 last 92.20) - open/close 8086 (time 1761239677.66 total 90.06 last 84.97) - open/close 8987 (time 1761239687.66 total 100.06 last 90.05) - open/close 9875 (time 1761239697.67 total 110.07 last 88.75) total: 10000 open/close in 111.50 seconds: 89.68 ops/second - unlinked 0 (time 1761239702 ; total 0 ; last 0) total: 10000 unlinks in 63 seconds: 158.730164 unlinks/second - open/close 989 (time 1761239778.72 total 10.00 last 98.89) - open/close 1927 (time 1761239788.73 total 20.01 last 93.73) - open/close 2856 (time 1761239798.73 total 30.01 last 92.87) - open/close 3813 (time 1761239808.74 total 40.02 last 95.64) - open/close 4725 (time 1761239818.74 total 50.02 last 91.18) - open/close 5665 (time 1761239828.75 total 60.03 last 93.93) - open/close 6661 (time 1761239838.75 total 70.03 last 99.55) - open/close 7666 (time 1761239848.76 total 80.04 last 100.45) - open/close 8754 (time 1761239858.76 total 90.04 last 108.75) - open/close 9891 (time 1761239868.76 total 100.04 last 113.67) total: 10000 open/close in 101.05 seconds: 98.96 ops/second - unlinked 0 (time 1761239872 ; total 0 ; last 0) total: 10000 unlinks in 43 seconds: 232.558136 unlinks/second - open/close 1506 (time 1761239927.76 total 10.00 last 150.53) - open/close 2615 (time 1761239937.76 total 20.01 last 110.82) - open/close 3582 (time 1761239947.77 total 30.01 last 96.68) - open/close 4464 (time 1761239957.77 total 40.02 last 88.18) - open/close 5235 (time 1761239967.78 total 50.03 last 77.01) - open/close 6222 (time 1761239977.78 total 60.03 last 98.66) - open/close 7297 (time 1761239987.80 total 70.04 last 107.38) - open/close 8240 (time 1761239997.81 total 80.05 last 94.21) - open/close 9141 (time 1761240007.81 total 90.06 last 90.08) total: 10000 open/close in 98.37 seconds: 101.66 ops/second - unlinked 0 (time 1761240018 ; total 0 ; last 0) total: 10000 unlinks in 70 seconds: 142.857147 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg448-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg448-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg448-server Permanent disk data: Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: mgsnode=192.168.204.148@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.204.148@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg448-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg448-server: oleg448-server.virtnet: executing set_default_debug -1 all pdsh@oleg448-client: oleg448-server: ssh exited with exit code 1 Started lustre-OST0000 oleg448-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg448-server: oleg448-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg448-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg448-client.virtnet: -o user_xattr,flock 192.168.204.148@tcp:/lustre /mnt/lustre On OST0, 16405 used inodes rc=0 pdsh@oleg448-client: oleg448-server: ssh exited with exit code 22 umount lustre on /mnt/lustre..... Stopping client oleg448-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg448-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg448-server Permanent disk data: Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: mgsnode=192.168.204.148@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.204.148@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=98 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre:OST0000 checking for existing Lustre data: found Read previous values: Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: mgsnode=192.168.204.148@tcp autodegrade=on sys.timeout=20 Permanent disk data: Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: mgsnode=192.168.204.148@tcp autodegrade=on sys.timeout=20 autodegrade=on lustre:svname=lustre-OST0000 Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.204.148@tcp lustre:autodegrade=on lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg448-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg448-server: oleg448-server.virtnet: executing set_default_debug -1 all pdsh@oleg448-client: oleg448-server: ssh exited with exit code 1 Started lustre-OST0000 oleg448-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg448-server: oleg448-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg448-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 6 sec mount lustre on /mnt/lustre..... Starting client: oleg448-client.virtnet: -o user_xattr,flock 192.168.204.148@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg448-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg448-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg448-server stop mds service on oleg448-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg448-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg448-server' oleg448-server: oleg448-server.virtnet: executing unload_modules_local oleg448-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg448-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded. pdsh@oleg448-client: oleg448-client: ssh exited with exit code 2 pdsh@oleg448-client: oleg448-server: ssh exited with exit code 2 pdsh@oleg448-client: oleg448-client: ssh exited with exit code 2 pdsh@oleg448-client: oleg448-server: ssh exited with exit code 2 PASS 69 (2018s) == conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 13:23:13 (1761240193) SKIP: conf-sanity test_111 Only applicable to ldiskfs-based MDTs SKIP 111 (3s) Stopping clients: oleg448-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg448-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg448-client: oleg448-server: ssh exited with exit code 2 oleg448-server: oleg448-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg448-server' oleg448-server: oleg448-server.virtnet: executing load_modules_local oleg448-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg448-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy oleg448-server: Loading modules from /home/green/git/lustre-release/lustre oleg448-server: detected 4 online CPUs by sysfs oleg448-server: MODOPTS_LIBCFS= oleg448-server: Force libcfs to create 2 CPU partitions oleg448-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg448-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 2433 sec ========== 13:24:04 (1761240244) === conf-sanity: start cleanup 13:24:05 (1761240245) === === conf-sanity: finish cleanup 13:24:08 (1761240248) ===