-----============= acceptance-small: conf-sanity ============----- Mon May 25 03:13:36 EDT 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg416-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32b 32c 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg416-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg416-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg416-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg416-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg416-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg416-server oleg416-server: oleg416-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg416-server' oleg416-server: oleg416-server.virtnet: executing load_modules_local oleg416-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg416-server: Loading modules from /home/green/git/lustre-release/lustre oleg416-server: detected 4 online CPUs by sysfs oleg416-server: MODOPTS_LIBCFS= oleg416-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg416-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg416-server: oleg416-server.virtnet: executing set_default_debug -1 all pdsh@oleg416-client: oleg416-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg416-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg416-server: oleg416-server.virtnet: executing set_default_debug -1 all pdsh@oleg416-client: oleg416-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg416-server: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg416-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg416-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg416-server stop mds service on oleg416-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg416-server == conf-sanity test 45: long unlink handling in ptlrpcd == 03:16:16 (1779693376) start mds service on oleg416-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg416-server: oleg416-server.virtnet: executing set_default_debug -1 all pdsh@oleg416-client: oleg416-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg416-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg416-server: oleg416-server.virtnet: executing set_default_debug -1 all pdsh@oleg416-client: oleg416-server: ssh exited with exit code 1 Started lustre-OST0000 oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg416-client.virtnet: -o user_xattr,flock 192.168.204.116@tcp:/lustre /mnt/lustre setup single mount lustre success stop mds service on oleg416-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg416-server sleep 60 sec fail_loc=0x8000050f sleep 10 sec manual umount lustre on /mnt/lustre.... df: /mnt/lustre: Input/output error fail_loc=0x0 start mds service on oleg416-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg416-server: oleg416-server.virtnet: executing set_default_debug -1 all pdsh@oleg416-client: oleg416-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg416-client.virtnet: -o user_xattr,flock 192.168.204.116@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg416-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg416-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg416-server stop mds service on oleg416-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg416-server unloading modules via unload_modules_local on: 'oleg416-server' oleg416-server: oleg416-server.virtnet: executing unload_modules_local oleg416-server: modules unloaded. pdsh@oleg416-client: oleg416-client: ssh exited with exit code 2 pdsh@oleg416-client: oleg416-server: ssh exited with exit code 2 pdsh@oleg416-client: oleg416-client: ssh exited with exit code 2 pdsh@oleg416-client: oleg416-server: ssh exited with exit code 2 PASS 45 (200s) == conf-sanity test 69: replace an OST with the same index ========================================================== 03:19:37 (1779693577) start mds service on oleg416-server /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg416-server' oleg416-server: oleg416-server.virtnet: executing load_modules_local oleg416-server: Loading modules from /home/green/git/lustre-release/lustre oleg416-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg416-server: detected 4 online CPUs by sysfs oleg416-server: MODOPTS_LIBCFS= oleg416-server: Force libcfs to create 2 CPU partitions oleg416-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg416-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg416-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg416-server: oleg416-server.virtnet: executing set_default_debug -1 all pdsh@oleg416-client: oleg416-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg416-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg416-server: oleg416-server.virtnet: executing set_default_debug -1 all pdsh@oleg416-client: oleg416-server: ssh exited with exit code 1 Started lustre-OST0000 oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg416-client.virtnet: -o user_xattr,flock 192.168.204.116@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 11904 inodes available. Want 99872. rc=0 - open/close 651 (time 1779693659.41 total 10.01 last 65.02) - open/close 1272 (time 1779693669.44 total 20.05 last 61.89) - open/close 1961 (time 1779693679.44 total 30.05 last 68.89) - open/close 2638 (time 1779693689.45 total 40.05 last 67.67) - open/close 3341 (time 1779693699.46 total 50.06 last 70.24) - open/close 3993 (time 1779693709.46 total 60.06 last 65.18) - open/close 4561 (time 1779693719.49 total 70.09 last 56.66) - open/close 5281 (time 1779693729.50 total 80.10 last 71.92) - open/close 6006 (time 1779693739.50 total 90.11 last 72.45) - open/close 6586 (time 1779693749.51 total 100.11 last 57.96) - open/close 7336 (time 1779693759.51 total 110.11 last 75.00) - open/close 8057 (time 1779693769.51 total 120.12 last 72.09) - open/close 8679 (time 1779693779.53 total 130.13 last 62.09) - open/close 9348 (time 1779693789.54 total 140.15 last 66.81) - open/close 9949 (time 1779693799.55 total 150.15 last 60.06) total: 10000 open/close in 151.14 seconds: 66.16 ops/second - unlinked 0 (time 1779693805 ; total 0 ; last 0) total: 10000 unlinks in 89 seconds: 112.359550 unlinks/second - open/close 693 (time 1779693908.71 total 10.01 last 69.24) - open/close 1381 (time 1779693918.72 total 20.02 last 68.75) - open/close 2007 (time 1779693928.73 total 30.02 last 62.55) - open/close 2664 (time 1779693938.74 total 40.03 last 65.65) - open/close 3368 (time 1779693948.74 total 50.03 last 70.39) - open/close 4127 (time 1779693958.75 total 60.04 last 75.84) - open/close 4789 (time 1779693968.76 total 70.05 last 66.11) - open/close 5528 (time 1779693978.76 total 80.06 last 73.90) - open/close 6208 (time 1779693988.77 total 90.06 last 67.96) - open/close 6751 (time 1779693998.78 total 100.08 last 54.21) - open/close 7312 (time 1779694008.79 total 110.09 last 56.04) - open/close 7879 (time 1779694018.81 total 120.10 last 56.62) - open/close 8489 (time 1779694028.81 total 130.11 last 60.98) - open/close 9121 (time 1779694038.82 total 140.11 last 63.14) - open/close 9769 (time 1779694048.83 total 150.12 last 64.74) total: 10000 open/close in 153.31 seconds: 65.23 ops/second - unlinked 0 (time 1779694056 ; total 0 ; last 0) total: 10000 unlinks in 108 seconds: 92.592590 unlinks/second - open/close 542 (time 1779694178.90 total 10.01 last 54.15) - open/close 1080 (time 1779694188.91 total 20.02 last 53.72) - open/close 1707 (time 1779694198.92 total 30.03 last 62.64) - open/close 2354 (time 1779694208.94 total 40.05 last 64.61) - open/close 2998 (time 1779694218.94 total 50.05 last 64.40) - open/close 3667 (time 1779694228.94 total 60.05 last 66.90) - open/close 4412 (time 1779694238.96 total 70.07 last 74.35) - open/close 4977 (time 1779694248.98 total 80.09 last 56.37) - open/close 5584 (time 1779694258.98 total 90.09 last 60.69) - open/close 6230 (time 1779694269.00 total 100.11 last 64.48) - open/close 6836 (time 1779694279.00 total 110.11 last 60.60) - open/close 7450 (time 1779694289.01 total 120.12 last 61.37) - open/close 8068 (time 1779694299.02 total 130.13 last 61.74) - open/close 8745 (time 1779694309.03 total 140.14 last 67.63) - open/close 9339 (time 1779694319.03 total 150.14 last 59.37) - open/close 9885 (time 1779694329.03 total 160.14 last 54.59) total: 10000 open/close in 161.88 seconds: 61.77 ops/second - unlinked 0 (time 1779694335 ; total 0 ; last 0) total: 10000 unlinks in 100 seconds: 100.000000 unlinks/second - open/close 630 (time 1779694450.12 total 10.02 last 62.88) - open/close 1256 (time 1779694460.13 total 20.03 last 62.54) - open/close 1975 (time 1779694470.13 total 30.04 last 71.85) - open/close 2602 (time 1779694480.14 total 40.04 last 62.66) - open/close 3194 (time 1779694490.15 total 50.06 last 59.12) - open/close 3790 (time 1779694500.16 total 60.06 last 59.57) - open/close 4436 (time 1779694510.16 total 70.06 last 64.58) - open/close 5148 (time 1779694520.17 total 80.07 last 71.15) - open/close 5759 (time 1779694530.20 total 90.10 last 60.94) - open/close 6373 (time 1779694540.20 total 100.11 last 61.35) - open/close 7028 (time 1779694550.21 total 110.11 last 65.45) - open/close 7689 (time 1779694560.22 total 120.12 last 66.06) - open/close 8312 (time 1779694570.23 total 130.13 last 62.25) - open/close 8944 (time 1779694580.23 total 140.13 last 63.19) - open/close 9616 (time 1779694590.23 total 150.13 last 67.18) total: 10000 open/close in 155.96 seconds: 64.12 ops/second - unlinked 0 (time 1779694601 ; total 1 ; last 1) total: 10000 unlinks in 99 seconds: 101.010101 unlinks/second - open/close 666 (time 1779694713.84 total 10.01 last 66.54) - open/close 1352 (time 1779694723.85 total 20.02 last 68.49) - open/close 2012 (time 1779694733.86 total 30.03 last 65.94) - open/close 2567 (time 1779694743.88 total 40.06 last 55.37) - open/close 3159 (time 1779694753.89 total 50.07 last 59.14) - open/close 3773 (time 1779694763.90 total 60.07 last 61.36) - open/close 4393 (time 1779694773.90 total 70.07 last 61.99) - open/close 4965 (time 1779694783.91 total 80.08 last 57.15) - open/close 5565 (time 1779694793.93 total 90.10 last 59.89) - open/close 6241 (time 1779694803.94 total 100.12 last 67.50) - open/close 6945 (time 1779694813.95 total 110.12 last 70.34) - open/close 7468 (time 1779694823.97 total 120.14 last 52.20) - open/close 8092 (time 1779694833.98 total 130.15 last 62.34) - open/close 8760 (time 1779694843.99 total 140.16 last 66.77) - open/close 9457 (time 1779694854.00 total 150.18 last 69.57) total: 10000 open/close in 158.09 seconds: 63.25 ops/second - unlinked 0 (time 1779694866 ; total 0 ; last 0) total: 10000 unlinks in 98 seconds: 102.040817 unlinks/second - open/close 713 (time 1779694979.38 total 10.01 last 71.25) - open/close 1366 (time 1779694989.40 total 20.02 last 65.20) - open/close 2095 (time 1779694999.41 total 30.03 last 72.82) - open/close 2834 (time 1779695009.42 total 40.05 last 73.82) - open/close 3565 (time 1779695019.43 total 50.05 last 73.05) - open/close 4305 (time 1779695029.43 total 60.06 last 73.96) - open/close 5032 (time 1779695039.44 total 70.06 last 72.66) - open/close 5803 (time 1779695049.44 total 80.07 last 77.04) - open/close 6528 (time 1779695059.46 total 90.08 last 72.40) - open/close 7236 (time 1779695069.46 total 100.09 last 70.77) - open/close 7945 (time 1779695079.46 total 110.09 last 70.90) - open/close 8661 (time 1779695089.47 total 120.10 last 71.56) - open/close 9417 (time 1779695099.48 total 130.11 last 75.49) total: 10000 open/close in 138.19 seconds: 72.37 ops/second - unlinked 0 (time 1779695112 ; total 0 ; last 0) total: 10000 unlinks in 90 seconds: 111.111115 unlinks/second - open/close 702 (time 1779695217.56 total 10.00 last 70.17) - open/close 1423 (time 1779695227.57 total 20.02 last 72.01) - open/close 2151 (time 1779695237.58 total 30.02 last 72.75) - open/close 2870 (time 1779695247.58 total 40.03 last 71.87) - open/close 3604 (time 1779695257.59 total 50.04 last 73.34) - open/close 4343 (time 1779695267.60 total 60.04 last 73.85) - open/close 5015 (time 1779695277.61 total 70.06 last 67.10) - open/close 5713 (time 1779695287.63 total 80.07 last 69.69) - open/close 6416 (time 1779695297.64 total 90.09 last 70.19) - open/close 6979 (time 1779695307.65 total 100.10 last 56.23) - open/close 7471 (time 1779695317.66 total 110.11 last 49.17) - open/close 8194 (time 1779695327.67 total 120.12 last 72.20) - open/close 8757 (time 1779695337.68 total 130.13 last 56.24) - open/close 9486 (time 1779695347.69 total 140.14 last 72.86) total: 10000 open/close in 147.89 seconds: 67.62 ops/second - unlinked 0 (time 1779695359 ; total 0 ; last 0) total: 10000 unlinks in 93 seconds: 107.526878 unlinks/second - open/close 713 (time 1779695466.50 total 10.02 last 71.13) - open/close 1404 (time 1779695476.51 total 20.03 last 69.08) - open/close 2010 (time 1779695486.52 total 30.04 last 60.54) - open/close 2548 (time 1779695496.52 total 40.04 last 53.78) - open/close 3058 (time 1779695506.52 total 50.04 last 50.98) - open/close 3681 (time 1779695516.54 total 60.06 last 62.19) - open/close 4389 (time 1779695526.55 total 70.07 last 70.74) - open/close 5093 (time 1779695536.56 total 80.08 last 70.34) - open/close 5801 (time 1779695546.57 total 90.09 last 70.71) - open/close 6503 (time 1779695556.58 total 100.10 last 70.15) - open/close 7261 (time 1779695566.58 total 110.10 last 75.77) - open/close 7897 (time 1779695576.58 total 120.10 last 63.60) - open/close 8635 (time 1779695586.59 total 130.11 last 73.77) - open/close 9369 (time 1779695596.59 total 140.11 last 73.38) total: 10000 open/close in 149.04 seconds: 67.10 ops/second - unlinked 0 (time 1779695609 ; total 0 ; last 0) total: 10000 unlinks in 85 seconds: 117.647057 unlinks/second - open/close 728 (time 1779695709.07 total 10.02 last 72.69) - open/close 1482 (time 1779695719.08 total 20.02 last 75.33) - open/close 2202 (time 1779695729.09 total 30.04 last 71.93) - open/close 2907 (time 1779695739.10 total 40.04 last 70.46) - open/close 3591 (time 1779695749.11 total 50.05 last 68.35) - open/close 4355 (time 1779695759.12 total 60.06 last 76.29) - open/close 5091 (time 1779695769.14 total 70.08 last 73.44) - open/close 5841 (time 1779695779.15 total 80.09 last 74.93) - open/close 6563 (time 1779695789.15 total 90.09 last 72.20) - open/close 7249 (time 1779695799.17 total 100.11 last 68.50) - open/close 7887 (time 1779695809.19 total 110.13 last 63.65) - open/close 8518 (time 1779695819.19 total 120.14 last 63.08) - open/close 9235 (time 1779695829.20 total 130.15 last 71.63) - open/close 9988 (time 1779695839.21 total 140.15 last 75.29) total: 10000 open/close in 140.31 seconds: 71.27 ops/second - unlinked 0 (time 1779695843 ; total 0 ; last 0) total: 10000 unlinks in 93 seconds: 107.526878 unlinks/second - open/close 674 (time 1779695951.93 total 10.00 last 67.39) - open/close 1369 (time 1779695961.93 total 20.01 last 69.47) - open/close 2094 (time 1779695971.94 total 30.01 last 72.48) - open/close 2823 (time 1779695981.95 total 40.02 last 72.84) - open/close 3451 (time 1779695991.95 total 50.02 last 62.77) - open/close 4232 (time 1779696001.96 total 60.03 last 78.03) - open/close 4919 (time 1779696011.96 total 70.03 last 68.69) - open/close 5598 (time 1779696021.97 total 80.05 last 67.82) - open/close 6293 (time 1779696031.98 total 90.05 last 69.48) - open/close 6967 (time 1779696041.98 total 100.05 last 67.39) - open/close 7712 (time 1779696051.99 total 110.06 last 74.41) - open/close 8371 (time 1779696062.01 total 120.08 last 65.79) - open/close 9125 (time 1779696072.01 total 130.09 last 75.34) - open/close 9831 (time 1779696082.02 total 140.09 last 70.56) total: 10000 open/close in 142.48 seconds: 70.18 ops/second - unlinked 0 (time 1779696089 ; total 1 ; last 1) total: 10000 unlinks in 90 seconds: 111.111115 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg416-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg416-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg416-server Permanent disk data: Device: lustre-ost1/ost1 Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: mgsnode=192.168.204.116@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.204.116@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg416-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg416-server: oleg416-server.virtnet: executing set_default_debug -1 all pdsh@oleg416-client: oleg416-server: ssh exited with exit code 1 Started lustre-OST0000 oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg416-server: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg416-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 5 sec mount lustre on /mnt/lustre..... Starting client: oleg416-client.virtnet: -o user_xattr,flock 192.168.204.116@tcp:/lustre /mnt/lustre On OST0, 17030 used inodes rc=0 pdsh@oleg416-client: oleg416-server: ssh exited with exit code 22 umount lustre on /mnt/lustre..... Stopping client oleg416-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg416-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg416-server Permanent disk data: Device: lustre-ost1/ost1 Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: mgsnode=192.168.204.116@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.204.116@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=98 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre:OST0000 checking for existing Lustre data: found Read previous values: Device: lustre-ost1/ost1 Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: mgsnode=192.168.204.116@tcp sys.timeout=20 autodegrade=on Permanent disk data: Device: lustre-ost1/ost1 Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: mgsnode=192.168.204.116@tcp sys.timeout=20 autodegrade=on autodegrade=on lustre:svname=lustre-OST0000 Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.204.116@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg416-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg416-server: oleg416-server.virtnet: executing set_default_debug -1 all pdsh@oleg416-client: oleg416-server: ssh exited with exit code 1 Started lustre-OST0000 oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg416-server: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg416-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg416-client.virtnet: -o user_xattr,flock 192.168.204.116@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg416-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg416-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg416-server stop mds service on oleg416-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg416-server unloading modules via unload_modules_local on: 'oleg416-server' oleg416-server: oleg416-server.virtnet: executing unload_modules_local oleg416-server: modules unloaded. pdsh@oleg416-client: oleg416-client: ssh exited with exit code 2 pdsh@oleg416-client: oleg416-server: ssh exited with exit code 2 pdsh@oleg416-client: oleg416-client: ssh exited with exit code 2 pdsh@oleg416-client: oleg416-server: ssh exited with exit code 2 PASS 69 (2752s) == conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 04:05:29 (1779696329) SKIP: conf-sanity test_111 Only applicable to ldiskfs-based MDTs SKIP 111 (4s) Stopping clients: oleg416-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg416-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg416-client: oleg416-server: ssh exited with exit code 2 oleg416-server: oleg416-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg416-server' oleg416-server: oleg416-server.virtnet: executing load_modules_local oleg416-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1042: echo: write error: Device or resource busy oleg416-server: Loading modules from /home/green/git/lustre-release/lustre oleg416-server: detected 4 online CPUs by sysfs oleg416-server: MODOPTS_LIBCFS= oleg416-server: Force libcfs to create 2 CPU partitions oleg416-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg416-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg416-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 3183 sec ========== 04:06:40 (1779696400) === conf-sanity: start cleanup 04:06:42 (1779696402) === === conf-sanity: finish cleanup 04:06:45 (1779696405) ===