-----============= acceptance-small: conf-sanity ============----- Fri Jan 16 04:02:15 EST 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg207-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32b 32c 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg207-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg207-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg207-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg207-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg207-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg207-server oleg207-server: oleg207-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1033: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg207-server' oleg207-server: oleg207-server.virtnet: executing load_modules_local oleg207-server: Loading modules from /home/green/git/lustre-release/lustre oleg207-server: detected 4 online CPUs by sysfs oleg207-server: MODOPTS_LIBCFS= oleg207-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1033: echo: write error: Device or resource busy oleg207-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg207-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg207-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg207-server: oleg207-server.virtnet: executing set_default_debug -1 all pdsh@oleg207-client: oleg207-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg207-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg207-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg207-server: oleg207-server.virtnet: executing set_default_debug -1 all pdsh@oleg207-client: oleg207-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg207-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg207-server: oleg207-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg207-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg207-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg207-server stop mds service on oleg207-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg207-server == conf-sanity test 45: long unlink handling in ptlrpcd == 04:04:56 (1768554296) start mds service on oleg207-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg207-server: oleg207-server.virtnet: executing set_default_debug -1 all pdsh@oleg207-client: oleg207-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg207-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg207-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg207-server: oleg207-server.virtnet: executing set_default_debug -1 all pdsh@oleg207-client: oleg207-server: ssh exited with exit code 1 Started lustre-OST0000 oleg207-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg207-client.virtnet: -o user_xattr,flock 192.168.202.107@tcp:/lustre /mnt/lustre setup single mount lustre success stop mds service on oleg207-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg207-server sleep 60 sec fail_loc=0x8000050f sleep 10 sec manual umount lustre on /mnt/lustre.... df: /mnt/lustre: Input/output error fail_loc=0x0 start mds service on oleg207-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg207-server: oleg207-server.virtnet: executing set_default_debug -1 all pdsh@oleg207-client: oleg207-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg207-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg207-client.virtnet: -o user_xattr,flock 192.168.202.107@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg207-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg207-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg207-server stop mds service on oleg207-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg207-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg207-server' oleg207-server: oleg207-server.virtnet: executing unload_modules_local oleg207-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg207-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded. pdsh@oleg207-client: oleg207-client: ssh exited with exit code 2 pdsh@oleg207-client: oleg207-server: ssh exited with exit code 2 pdsh@oleg207-client: oleg207-client: ssh exited with exit code 2 pdsh@oleg207-client: oleg207-server: ssh exited with exit code 2 PASS 45 (206s) == conf-sanity test 69: replace an OST with the same index ========================================================== 04:08:23 (1768554503) start mds service on oleg207-server /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1033: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg207-server' oleg207-server: oleg207-server.virtnet: executing load_modules_local oleg207-server: Loading modules from /home/green/git/lustre-release/lustre oleg207-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1033: echo: write error: Device or resource busy oleg207-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg207-server: detected 4 online CPUs by sysfs oleg207-server: MODOPTS_LIBCFS= oleg207-server: Force libcfs to create 2 CPU partitions oleg207-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg207-server: quota/lquota options: 'hash_lqs_cur_bits=3' Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg207-server: oleg207-server.virtnet: executing set_default_debug -1 all pdsh@oleg207-client: oleg207-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg207-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg207-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg207-server: oleg207-server.virtnet: executing set_default_debug -1 all pdsh@oleg207-client: oleg207-server: ssh exited with exit code 1 Started lustre-OST0000 oleg207-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg207-client.virtnet: -o user_xattr,flock 192.168.202.107@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 11872 inodes available. Want 99872. rc=0 - open/close 661 (time 1768554587.58 total 10.01 last 66.06) - open/close 1280 (time 1768554597.58 total 20.01 last 61.87) - open/close 2012 (time 1768554607.58 total 30.01 last 73.19) - open/close 2599 (time 1768554617.60 total 40.03 last 58.62) - open/close 3174 (time 1768554627.61 total 50.04 last 57.44) - open/close 3736 (time 1768554637.62 total 60.05 last 56.14) - open/close 4231 (time 1768554647.62 total 70.05 last 49.47) - open/close 4998 (time 1768554657.63 total 80.06 last 76.63) - open/close 5560 (time 1768554667.64 total 90.07 last 56.15) - open/close 6109 (time 1768554677.69 total 100.12 last 54.65) - open/close 6756 (time 1768554687.69 total 110.12 last 64.67) - open/close 7321 (time 1768554697.71 total 120.14 last 56.42) - open/close 7969 (time 1768554707.71 total 130.14 last 64.78) - open/close 8679 (time 1768554717.72 total 140.15 last 70.92) - open/close 9274 (time 1768554727.72 total 150.15 last 59.50) - open/close 9866 (time 1768554737.73 total 160.16 last 59.13) total: 10000 open/close in 162.17 seconds: 61.66 ops/second - unlinked 0 (time 1768554744 ; total 0 ; last 0) total: 10000 unlinks in 90 seconds: 111.111115 unlinks/second - open/close 651 (time 1768554850.07 total 10.02 last 65.00) - open/close 1309 (time 1768554860.08 total 20.03 last 65.69) - open/close 1950 (time 1768554870.10 total 30.05 last 64.01) - open/close 2644 (time 1768554880.11 total 40.06 last 69.29) - open/close 3354 (time 1768554890.12 total 50.07 last 70.94) - open/close 4053 (time 1768554900.13 total 60.08 last 69.82) - open/close 4681 (time 1768554910.14 total 70.09 last 62.77) - open/close 5291 (time 1768554920.15 total 80.10 last 60.95) - open/close 5947 (time 1768554930.16 total 90.11 last 65.51) - open/close 6599 (time 1768554940.17 total 100.12 last 65.14) - open/close 7343 (time 1768554950.18 total 110.12 last 74.35) - open/close 8054 (time 1768554960.19 total 120.14 last 71.01) - open/close 8707 (time 1768554970.21 total 130.16 last 65.16) - open/close 9352 (time 1768554980.22 total 140.16 last 64.47) total: 10000 open/close in 148.22 seconds: 67.47 ops/second - unlinked 0 (time 1768554993 ; total 0 ; last 0) total: 10000 unlinks in 86 seconds: 116.279068 unlinks/second - open/close 620 (time 1768555093.68 total 10.01 last 61.93) - open/close 1343 (time 1768555103.68 total 20.02 last 72.27) - open/close 1945 (time 1768555113.69 total 30.02 last 60.18) - open/close 2466 (time 1768555123.69 total 40.02 last 52.09) - open/close 2990 (time 1768555133.72 total 50.05 last 52.25) - open/close 3646 (time 1768555143.72 total 60.06 last 65.56) - open/close 4317 (time 1768555153.73 total 70.06 last 67.06) - open/close 4887 (time 1768555163.73 total 80.07 last 56.97) - open/close 5504 (time 1768555173.74 total 90.07 last 61.68) - open/close 6152 (time 1768555183.74 total 100.07 last 64.76) - open/close 6832 (time 1768555193.76 total 110.09 last 67.90) - open/close 7550 (time 1768555203.76 total 120.09 last 71.79) - open/close 8264 (time 1768555213.76 total 130.10 last 71.35) - open/close 8959 (time 1768555223.78 total 140.12 last 69.36) - open/close 9594 (time 1768555233.79 total 150.12 last 63.46) total: 10000 open/close in 156.13 seconds: 64.05 ops/second - unlinked 0 (time 1768555244 ; total 0 ; last 0) total: 10000 unlinks in 87 seconds: 114.942528 unlinks/second - open/close 597 (time 1768555347.60 total 10.01 last 59.67) - open/close 1365 (time 1768555357.61 total 20.01 last 76.76) - open/close 2071 (time 1768555367.61 total 30.02 last 70.55) - open/close 2777 (time 1768555377.62 total 40.02 last 70.59) - open/close 3458 (time 1768555387.62 total 50.02 last 68.07) - open/close 4145 (time 1768555397.62 total 60.03 last 68.66) - open/close 4718 (time 1768555407.64 total 70.05 last 57.21) - open/close 5305 (time 1768555417.65 total 80.06 last 58.62) - open/close 5811 (time 1768555427.67 total 90.07 last 50.53) - open/close 6525 (time 1768555437.69 total 100.09 last 71.24) - open/close 7168 (time 1768555447.70 total 110.10 last 64.23) - open/close 7938 (time 1768555457.70 total 120.11 last 77.00) - open/close 8751 (time 1768555467.70 total 130.11 last 81.30) - open/close 9510 (time 1768555477.71 total 140.12 last 75.80) total: 10000 open/close in 147.74 seconds: 67.68 ops/second - unlinked 0 (time 1768555490 ; total 0 ; last 0) total: 10000 unlinks in 92 seconds: 108.695656 unlinks/second - open/close 604 (time 1768555597.96 total 10.01 last 60.36) - open/close 1273 (time 1768555607.98 total 20.02 last 66.78) - open/close 1869 (time 1768555617.98 total 30.03 last 59.57) - open/close 2492 (time 1768555627.99 total 40.04 last 62.26) - open/close 3167 (time 1768555637.99 total 50.04 last 67.46) - open/close 3874 (time 1768555648.01 total 60.06 last 70.61) - open/close 4537 (time 1768555658.01 total 70.06 last 66.27) - open/close 5179 (time 1768555668.02 total 80.07 last 64.13) - open/close 5711 (time 1768555678.03 total 90.08 last 53.16) - open/close 6354 (time 1768555688.04 total 100.09 last 64.23) - open/close 6858 (time 1768555698.04 total 110.09 last 50.39) - open/close 7456 (time 1768555708.06 total 120.10 last 59.73) - open/close 8130 (time 1768555718.06 total 130.11 last 67.39) - open/close 8801 (time 1768555728.07 total 140.11 last 67.05) - open/close 9564 (time 1768555738.08 total 150.13 last 76.22) total: 10000 open/close in 156.32 seconds: 63.97 ops/second - unlinked 0 (time 1768555748 ; total 0 ; last 0) total: 10000 unlinks in 88 seconds: 113.636360 unlinks/second - open/close 679 (time 1768555850.82 total 10.01 last 67.82) - open/close 1280 (time 1768555860.85 total 20.04 last 59.94) - open/close 1884 (time 1768555870.85 total 30.04 last 60.38) - open/close 2561 (time 1768555880.86 total 40.05 last 67.62) - open/close 3387 (time 1768555890.87 total 50.06 last 82.56) - open/close 4162 (time 1768555900.87 total 60.06 last 77.48) - open/close 4929 (time 1768555910.88 total 70.07 last 76.64) - open/close 5548 (time 1768555920.89 total 80.08 last 61.82) - open/close 6175 (time 1768555930.91 total 90.10 last 62.58) - open/close 6921 (time 1768555940.91 total 100.10 last 74.56) - open/close 7685 (time 1768555950.92 total 110.11 last 76.36) - open/close 8402 (time 1768555960.92 total 120.11 last 71.69) - open/close 9112 (time 1768555970.93 total 130.12 last 70.95) - open/close 9721 (time 1768555980.94 total 140.13 last 60.82) total: 10000 open/close in 145.03 seconds: 68.95 ops/second - unlinked 0 (time 1768555990 ; total 0 ; last 0) total: 10000 unlinks in 84 seconds: 119.047623 unlinks/second - open/close 784 (time 1768556088.04 total 10.01 last 78.30) - open/close 1339 (time 1768556098.05 total 20.02 last 55.45) - open/close 2027 (time 1768556108.06 total 30.03 last 68.76) - open/close 2797 (time 1768556118.06 total 40.03 last 76.97) - open/close 3477 (time 1768556128.06 total 50.03 last 67.99) - open/close 4116 (time 1768556138.08 total 60.05 last 63.79) - open/close 4759 (time 1768556148.09 total 70.06 last 64.23) - open/close 5363 (time 1768556158.09 total 80.06 last 60.40) - open/close 5935 (time 1768556168.10 total 90.07 last 57.16) - open/close 6570 (time 1768556178.10 total 100.07 last 63.45) - open/close 7120 (time 1768556188.12 total 110.09 last 54.90) - open/close 7787 (time 1768556198.14 total 120.11 last 66.58) - open/close 8430 (time 1768556208.15 total 130.12 last 64.24) - open/close 9075 (time 1768556218.15 total 140.12 last 64.47) - open/close 9750 (time 1768556228.15 total 150.12 last 67.49) total: 10000 open/close in 153.25 seconds: 65.25 ops/second - unlinked 0 (time 1768556236 ; total 0 ; last 0) total: 10000 unlinks in 91 seconds: 109.890106 unlinks/second - open/close 745 (time 1768556342.86 total 10.01 last 74.44) - open/close 1461 (time 1768556352.87 total 20.02 last 71.53) - open/close 2103 (time 1768556362.87 total 30.02 last 64.18) - open/close 2747 (time 1768556372.87 total 40.02 last 64.40) - open/close 3444 (time 1768556382.87 total 50.02 last 69.70) - open/close 4198 (time 1768556392.87 total 60.02 last 75.40) - open/close 4915 (time 1768556402.88 total 70.03 last 71.63) - open/close 5580 (time 1768556412.89 total 80.04 last 66.44) - open/close 6260 (time 1768556422.90 total 90.05 last 67.91) - open/close 6894 (time 1768556432.92 total 100.07 last 63.31) - open/close 7554 (time 1768556442.92 total 110.07 last 65.95) - open/close 8191 (time 1768556452.94 total 120.09 last 63.63) - open/close 8926 (time 1768556462.95 total 130.10 last 73.37) - open/close 9703 (time 1768556472.97 total 140.11 last 77.62) total: 10000 open/close in 145.09 seconds: 68.92 ops/second - unlinked 0 (time 1768556482 ; total 0 ; last 0) total: 10000 unlinks in 89 seconds: 112.359550 unlinks/second - open/close 645 (time 1768556587.52 total 10.00 last 64.48) - open/close 1214 (time 1768556597.54 total 20.02 last 56.80) - open/close 1878 (time 1768556607.56 total 30.04 last 66.26) - open/close 2556 (time 1768556617.56 total 40.05 last 67.78) - open/close 3212 (time 1768556627.57 total 50.05 last 65.59) - open/close 3931 (time 1768556637.57 total 60.06 last 71.83) - open/close 4647 (time 1768556647.58 total 70.06 last 71.58) - open/close 5255 (time 1768556657.59 total 80.07 last 60.73) - open/close 6026 (time 1768556667.61 total 90.09 last 76.96) - open/close 6742 (time 1768556677.61 total 100.09 last 71.59) - open/close 7463 (time 1768556687.63 total 110.11 last 71.98) - open/close 8309 (time 1768556697.63 total 120.11 last 84.59) - open/close 9057 (time 1768556707.63 total 130.11 last 74.76) - open/close 9750 (time 1768556717.64 total 140.12 last 69.25) total: 10000 open/close in 143.68 seconds: 69.60 ops/second - unlinked 0 (time 1768556725 ; total 0 ; last 0) total: 10000 unlinks in 90 seconds: 111.111115 unlinks/second - open/close 810 (time 1768556830.29 total 10.01 last 80.95) - open/close 1441 (time 1768556840.30 total 20.02 last 63.01) - open/close 2097 (time 1768556850.30 total 30.02 last 65.58) - open/close 2750 (time 1768556860.31 total 40.03 last 65.24) - open/close 3387 (time 1768556870.32 total 50.04 last 63.65) - open/close 4021 (time 1768556880.33 total 60.05 last 63.34) - open/close 4679 (time 1768556890.33 total 70.05 last 65.78) - open/close 5351 (time 1768556900.34 total 80.06 last 67.17) - open/close 6078 (time 1768556910.35 total 90.07 last 72.65) - open/close 6778 (time 1768556920.35 total 100.07 last 69.96) - open/close 7482 (time 1768556930.36 total 110.08 last 70.37) - open/close 8375 (time 1768556940.36 total 120.08 last 89.24) - open/close 8959 (time 1768556950.37 total 130.09 last 58.34) - open/close 9565 (time 1768556960.38 total 140.10 last 60.58) total: 10000 open/close in 146.41 seconds: 68.30 ops/second - unlinked 0 (time 1768556971 ; total 0 ; last 0) total: 10000 unlinks in 74 seconds: 135.135132 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg207-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg207-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg207-server Permanent disk data: Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: mgsnode=192.168.202.107@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.202.107@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg207-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg207-server: oleg207-server.virtnet: executing set_default_debug -1 all pdsh@oleg207-client: oleg207-server: ssh exited with exit code 1 Started lustre-OST0000 oleg207-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg207-server: oleg207-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg207-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg207-client.virtnet: -o user_xattr,flock 192.168.202.107@tcp:/lustre /mnt/lustre On OST0, 20325 used inodes rc=0 pdsh@oleg207-client: oleg207-server: ssh exited with exit code 22 umount lustre on /mnt/lustre..... Stopping client oleg207-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg207-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg207-server Permanent disk data: Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: mgsnode=192.168.202.107@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.202.107@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=98 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre:OST0000 checking for existing Lustre data: found Read previous values: Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: autodegrade=on sys.timeout=20 mgsnode=192.168.202.107@tcp Permanent disk data: Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: autodegrade=on sys.timeout=20 mgsnode=192.168.202.107@tcp autodegrade=on lustre:svname=lustre-OST0000 Writing lustre-ost1/ost1 properties lustre:autodegrade=on lustre:sys.timeout=20 lustre:mgsnode=192.168.202.107@tcp lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg207-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg207-server: oleg207-server.virtnet: executing set_default_debug -1 all pdsh@oleg207-client: oleg207-server: ssh exited with exit code 1 Started lustre-OST0000 oleg207-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg207-server: oleg207-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg207-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg207-client.virtnet: -o user_xattr,flock 192.168.202.107@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg207-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg207-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg207-server stop mds service on oleg207-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg207-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg207-server' oleg207-server: oleg207-server.virtnet: executing unload_modules_local oleg207-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg207-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded. pdsh@oleg207-client: oleg207-client: ssh exited with exit code 2 pdsh@oleg207-client: oleg207-server: ssh exited with exit code 2 pdsh@oleg207-client: oleg207-client: ssh exited with exit code 2 pdsh@oleg207-client: oleg207-server: ssh exited with exit code 2 PASS 69 (2675s) == conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 04:52:59 (1768557179) SKIP: conf-sanity test_111 Only applicable to ldiskfs-based MDTs SKIP 111 (3s) Stopping clients: oleg207-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg207-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg207-client: oleg207-server: ssh exited with exit code 2 oleg207-server: oleg207-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1033: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg207-server' oleg207-server: oleg207-server.virtnet: executing load_modules_local oleg207-server: Loading modules from /home/green/git/lustre-release/lustre oleg207-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1033: echo: write error: Device or resource busy oleg207-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg207-server: detected 4 online CPUs by sysfs oleg207-server: MODOPTS_LIBCFS= oleg207-server: Force libcfs to create 2 CPU partitions oleg207-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg207-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 3117 sec ========== 04:54:14 (1768557254) === conf-sanity: start cleanup 04:54:17 (1768557257) === === conf-sanity: finish cleanup 04:54:20 (1768557260) ===