-----============= acceptance-small: conf-sanity ============----- Sun Nov 16 17:29:19 EST 2025 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg212-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32b 32c 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg212-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg212-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg212-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg212-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg212-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg212-server oleg212-server: oleg212-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg212-server' oleg212-server: oleg212-server.virtnet: executing load_modules_local oleg212-server: Loading modules from /home/green/git/lustre-release/lustre oleg212-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy oleg212-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy oleg212-server: detected 4 online CPUs by sysfs oleg212-server: MODOPTS_LIBCFS= oleg212-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg212-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg212-server: oleg212-server.virtnet: executing set_default_debug -1 all pdsh@oleg212-client: oleg212-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg212-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg212-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg212-server: oleg212-server.virtnet: executing set_default_debug -1 all pdsh@oleg212-client: oleg212-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg212-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg212-server: oleg212-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg212-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg212-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg212-server stop mds service on oleg212-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg212-server == conf-sanity test 45: long unlink handling in ptlrpcd == 17:31:27 (1763332287) start mds service on oleg212-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg212-server: oleg212-server.virtnet: executing set_default_debug -1 all pdsh@oleg212-client: oleg212-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg212-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg212-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg212-server: oleg212-server.virtnet: executing set_default_debug -1 all pdsh@oleg212-client: oleg212-server: ssh exited with exit code 1 Started lustre-OST0000 oleg212-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg212-client.virtnet: -o user_xattr,flock 192.168.202.112@tcp:/lustre /mnt/lustre setup single mount lustre success stop mds service on oleg212-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg212-server sleep 60 sec fail_loc=0x8000050f sleep 10 sec manual umount lustre on /mnt/lustre.... df: /mnt/lustre: Input/output error fail_loc=0x0 start mds service on oleg212-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg212-server: oleg212-server.virtnet: executing set_default_debug -1 all pdsh@oleg212-client: oleg212-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg212-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg212-client.virtnet: -o user_xattr,flock 192.168.202.112@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg212-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg212-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg212-server stop mds service on oleg212-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg212-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg212-server' oleg212-server: oleg212-server.virtnet: executing unload_modules_local oleg212-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg212-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded. pdsh@oleg212-client: oleg212-server: ssh exited with exit code 2 pdsh@oleg212-client: oleg212-client: ssh exited with exit code 2 pdsh@oleg212-client: oleg212-client: ssh exited with exit code 2 pdsh@oleg212-client: oleg212-server: ssh exited with exit code 2 PASS 45 (199s) == conf-sanity test 69: replace an OST with the same index ========================================================== 17:34:47 (1763332487) start mds service on oleg212-server /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg212-server' oleg212-server: oleg212-server.virtnet: executing load_modules_local oleg212-server: Loading modules from /home/green/git/lustre-release/lustre oleg212-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy oleg212-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy oleg212-server: detected 4 online CPUs by sysfs oleg212-server: MODOPTS_LIBCFS= oleg212-server: Force libcfs to create 2 CPU partitions oleg212-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg212-server: quota/lquota options: 'hash_lqs_cur_bits=3' Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg212-server: oleg212-server.virtnet: executing set_default_debug -1 all pdsh@oleg212-client: oleg212-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg212-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg212-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg212-server: oleg212-server.virtnet: executing set_default_debug -1 all pdsh@oleg212-client: oleg212-server: ssh exited with exit code 1 Started lustre-OST0000 oleg212-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg212-client.virtnet: -o user_xattr,flock 192.168.202.112@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 11872 inodes available. Want 99872. rc=0 - open/close 652 (time 1763332557.41 total 10.00 last 65.19) - open/close 1387 (time 1763332567.42 total 20.01 last 73.40) - open/close 2100 (time 1763332577.43 total 30.02 last 71.24) - open/close 2819 (time 1763332587.44 total 40.02 last 71.89) - open/close 3619 (time 1763332597.44 total 50.03 last 79.92) - open/close 4504 (time 1763332607.46 total 60.05 last 88.39) - open/close 5349 (time 1763332617.47 total 70.06 last 84.36) - open/close 6029 (time 1763332627.48 total 80.07 last 67.97) - open/close 6720 (time 1763332637.49 total 90.08 last 69.01) - open/close 7411 (time 1763332647.50 total 100.09 last 69.05) - open/close 8087 (time 1763332657.52 total 110.11 last 67.49) - open/close 8764 (time 1763332667.52 total 120.11 last 67.69) - open/close 9510 (time 1763332677.53 total 130.12 last 74.52) total: 10000 open/close in 137.46 seconds: 72.75 ops/second - unlinked 0 (time 1763332689 ; total 0 ; last 0) total: 10000 unlinks in 90 seconds: 111.111115 unlinks/second - open/close 610 (time 1763332794.53 total 10.00 last 60.98) - open/close 1253 (time 1763332804.54 total 20.01 last 64.24) - open/close 1900 (time 1763332814.55 total 30.02 last 64.66) - open/close 2523 (time 1763332824.56 total 40.02 last 62.26) - open/close 3134 (time 1763332834.59 total 50.06 last 60.90) - open/close 3697 (time 1763332844.59 total 60.06 last 56.29) - open/close 4255 (time 1763332854.60 total 70.07 last 55.74) - open/close 4799 (time 1763332864.61 total 80.08 last 54.32) - open/close 5364 (time 1763332874.64 total 90.11 last 56.38) - open/close 5974 (time 1763332884.65 total 100.12 last 60.92) - open/close 6562 (time 1763332894.66 total 110.13 last 58.72) - open/close 7175 (time 1763332904.67 total 120.13 last 61.30) - open/close 7814 (time 1763332914.68 total 130.15 last 63.83) - open/close 8451 (time 1763332924.69 total 140.16 last 63.61) - open/close 9094 (time 1763332934.70 total 150.17 last 64.26) - open/close 9751 (time 1763332944.71 total 160.18 last 65.61) total: 10000 open/close in 164.19 seconds: 60.91 ops/second - unlinked 0 (time 1763332953 ; total 0 ; last 0) total: 10000 unlinks in 89 seconds: 112.359550 unlinks/second - open/close 682 (time 1763333055.71 total 10.01 last 68.10) - open/close 1344 (time 1763333065.73 total 20.03 last 66.09) - open/close 2015 (time 1763333075.73 total 30.04 last 67.06) - open/close 2685 (time 1763333085.74 total 40.04 last 66.94) - open/close 3318 (time 1763333095.76 total 50.06 last 63.19) - open/close 3970 (time 1763333105.78 total 60.08 last 65.09) - open/close 4658 (time 1763333115.78 total 70.09 last 68.74) - open/close 5330 (time 1763333125.80 total 80.10 last 67.12) - open/close 5998 (time 1763333135.81 total 90.11 last 66.73) - open/close 6652 (time 1763333145.82 total 100.12 last 65.34) - open/close 7376 (time 1763333155.83 total 110.14 last 72.28) - open/close 8028 (time 1763333165.84 total 120.14 last 65.17) - open/close 8684 (time 1763333175.84 total 130.15 last 65.58) - open/close 9417 (time 1763333185.85 total 140.15 last 73.24) total: 10000 open/close in 147.87 seconds: 67.63 ops/second - unlinked 0 (time 1763333196 ; total 0 ; last 0) total: 10000 unlinks in 72 seconds: 138.888885 unlinks/second - open/close 752 (time 1763333281.63 total 10.01 last 75.13) - open/close 1485 (time 1763333291.63 total 20.02 last 73.26) - open/close 2227 (time 1763333301.63 total 30.02 last 74.19) - open/close 2958 (time 1763333311.64 total 40.02 last 73.06) - open/close 3719 (time 1763333321.67 total 50.05 last 75.90) - open/close 4415 (time 1763333331.68 total 60.06 last 69.49) - open/close 5144 (time 1763333341.68 total 70.07 last 72.88) - open/close 5868 (time 1763333351.69 total 80.08 last 72.33) - open/close 6598 (time 1763333361.71 total 90.09 last 72.88) - open/close 7313 (time 1763333371.73 total 100.11 last 71.36) - open/close 8027 (time 1763333381.73 total 110.11 last 71.40) - open/close 8710 (time 1763333391.73 total 120.12 last 68.27) - open/close 9362 (time 1763333401.75 total 130.13 last 65.10) - open/close 9982 (time 1763333411.76 total 140.14 last 61.95) total: 10000 open/close in 140.37 seconds: 71.24 ops/second - unlinked 0 (time 1763333416 ; total 0 ; last 0) total: 10000 unlinks in 91 seconds: 109.890106 unlinks/second - open/close 673 (time 1763333521.76 total 10.00 last 67.29) - open/close 1322 (time 1763333531.76 total 20.00 last 64.89) - open/close 1980 (time 1763333541.76 total 30.01 last 65.76) - open/close 2665 (time 1763333551.77 total 40.01 last 68.46) - open/close 3390 (time 1763333561.77 total 50.02 last 72.48) - open/close 4029 (time 1763333571.79 total 60.03 last 63.81) - open/close 4601 (time 1763333581.82 total 70.07 last 57.01) - open/close 5148 (time 1763333591.82 total 80.07 last 54.67) - open/close 5815 (time 1763333601.83 total 90.08 last 66.65) - open/close 6450 (time 1763333611.84 total 100.08 last 63.46) - open/close 7141 (time 1763333621.85 total 110.09 last 69.04) - open/close 7854 (time 1763333631.87 total 120.11 last 71.16) - open/close 8525 (time 1763333641.88 total 130.12 last 67.04) - open/close 9224 (time 1763333651.89 total 140.13 last 69.84) total: 10000 open/close in 149.97 seconds: 66.68 ops/second - unlinked 0 (time 1763333664 ; total 0 ; last 0) total: 10000 unlinks in 78 seconds: 128.205124 unlinks/second - open/close 631 (time 1763333755.80 total 10.00 last 63.08) - open/close 1246 (time 1763333765.81 total 20.01 last 61.45) - open/close 1964 (time 1763333775.82 total 30.02 last 71.77) - open/close 2636 (time 1763333785.82 total 40.02 last 67.18) - open/close 3271 (time 1763333795.83 total 50.03 last 63.45) - open/close 3969 (time 1763333805.84 total 60.04 last 69.74) - open/close 4686 (time 1763333815.85 total 70.05 last 71.58) - open/close 5447 (time 1763333825.86 total 80.06 last 76.03) - open/close 6159 (time 1763333835.87 total 90.07 last 71.17) - open/close 6862 (time 1763333845.88 total 100.08 last 70.23) - open/close 7633 (time 1763333855.89 total 110.08 last 77.05) - open/close 8385 (time 1763333865.90 total 120.10 last 75.07) - open/close 9070 (time 1763333875.91 total 130.11 last 68.45) - open/close 9762 (time 1763333885.92 total 140.12 last 69.15) total: 10000 open/close in 143.54 seconds: 69.67 ops/second - unlinked 0 (time 1763333893 ; total 0 ; last 0) total: 10000 unlinks in 84 seconds: 119.047623 unlinks/second - open/close 730 (time 1763333990.60 total 10.00 last 72.98) - open/close 1394 (time 1763334000.60 total 20.01 last 66.35) - open/close 2095 (time 1763334010.61 total 30.02 last 70.04) - open/close 2851 (time 1763334020.62 total 40.02 last 75.56) - open/close 3588 (time 1763334030.62 total 50.03 last 73.65) - open/close 4302 (time 1763334040.63 total 60.04 last 71.36) - open/close 5003 (time 1763334050.64 total 70.05 last 70.03) - open/close 5747 (time 1763334060.65 total 80.05 last 74.35) - open/close 6380 (time 1763334070.65 total 90.06 last 63.28) - open/close 7019 (time 1763334080.65 total 100.06 last 63.90) - open/close 7707 (time 1763334090.66 total 110.07 last 68.73) - open/close 8321 (time 1763334100.66 total 120.07 last 61.38) - open/close 8951 (time 1763334110.66 total 130.07 last 63.00) - open/close 9640 (time 1763334120.66 total 140.07 last 68.90) total: 10000 open/close in 144.77 seconds: 69.07 ops/second - unlinked 0 (time 1763334128 ; total 0 ; last 0) total: 10000 unlinks in 83 seconds: 120.481926 unlinks/second - open/close 655 (time 1763334224.92 total 10.01 last 65.45) - open/close 1391 (time 1763334234.92 total 20.01 last 73.59) - open/close 2163 (time 1763334244.92 total 30.01 last 77.20) - open/close 2928 (time 1763334254.93 total 40.02 last 76.45) - open/close 3673 (time 1763334264.94 total 50.03 last 74.41) - open/close 4349 (time 1763334274.95 total 60.04 last 67.53) - open/close 4972 (time 1763334284.97 total 70.05 last 62.21) - open/close 5552 (time 1763334294.98 total 80.07 last 57.91) - open/close 6195 (time 1763334304.99 total 90.07 last 64.29) - open/close 6868 (time 1763334314.99 total 100.08 last 67.27) - open/close 7549 (time 1763334324.99 total 110.08 last 68.09) - open/close 8255 (time 1763334335.03 total 120.11 last 70.36) - open/close 8959 (time 1763334345.06 total 130.14 last 70.17) - open/close 9594 (time 1763334355.07 total 140.16 last 63.43) total: 10000 open/close in 145.40 seconds: 68.78 ops/second - unlinked 0 (time 1763334364 ; total 0 ; last 0) total: 10000 unlinks in 83 seconds: 120.481926 unlinks/second - open/close 806 (time 1763334460.67 total 10.01 last 80.50) - open/close 1709 (time 1763334470.68 total 20.02 last 90.25) - open/close 2657 (time 1763334480.68 total 30.02 last 94.76) - open/close 3396 (time 1763334490.69 total 40.03 last 73.82) - open/close 4120 (time 1763334500.70 total 50.03 last 72.38) - open/close 4821 (time 1763334510.70 total 60.04 last 70.09) - open/close 5495 (time 1763334520.70 total 70.04 last 67.38) - open/close 6124 (time 1763334530.72 total 80.06 last 62.80) - open/close 6814 (time 1763334540.74 total 90.08 last 68.81) - open/close 7475 (time 1763334550.75 total 100.08 last 66.10) - open/close 8130 (time 1763334560.75 total 110.08 last 65.49) - open/close 8848 (time 1763334570.75 total 120.09 last 71.76) - open/close 9552 (time 1763334580.77 total 130.10 last 70.31) total: 10000 open/close in 136.70 seconds: 73.15 ops/second - unlinked 0 (time 1763334590 ; total 0 ; last 0) total: 10000 unlinks in 83 seconds: 120.481926 unlinks/second - open/close 676 (time 1763334687.36 total 10.02 last 67.49) - open/close 1470 (time 1763334697.36 total 20.03 last 79.33) - open/close 2216 (time 1763334707.38 total 30.04 last 74.52) - open/close 3024 (time 1763334717.39 total 40.05 last 80.67) - open/close 3845 (time 1763334727.40 total 50.06 last 82.07) - open/close 4592 (time 1763334737.40 total 60.06 last 74.66) - open/close 5458 (time 1763334747.41 total 70.07 last 86.54) - open/close 6245 (time 1763334757.41 total 80.07 last 78.67) - open/close 7014 (time 1763334767.42 total 90.08 last 76.85) - open/close 8048 (time 1763334777.42 total 100.09 last 103.33) - open/close 9016 (time 1763334787.43 total 110.09 last 96.75) - open/close 9837 (time 1763334797.43 total 120.09 last 82.10) total: 10000 open/close in 121.98 seconds: 81.98 ops/second - unlinked 0 (time 1763334801 ; total 0 ; last 0) total: 10000 unlinks in 76 seconds: 131.578949 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg212-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg212-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg212-server Permanent disk data: Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: mgsnode=192.168.202.112@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.202.112@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg212-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg212-server: oleg212-server.virtnet: executing set_default_debug -1 all pdsh@oleg212-client: oleg212-server: ssh exited with exit code 1 Started lustre-OST0000 oleg212-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg212-server: oleg212-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg212-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg212-client.virtnet: -o user_xattr,flock 192.168.202.112@tcp:/lustre /mnt/lustre On OST0, 13445 used inodes rc=0 pdsh@oleg212-client: oleg212-server: ssh exited with exit code 22 umount lustre on /mnt/lustre..... Stopping client oleg212-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg212-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg212-server Permanent disk data: Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: mgsnode=192.168.202.112@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.202.112@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=98 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre:OST0000 checking for existing Lustre data: found Read previous values: Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: autodegrade=on sys.timeout=20 mgsnode=192.168.202.112@tcp Permanent disk data: Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: autodegrade=on sys.timeout=20 mgsnode=192.168.202.112@tcp autodegrade=on lustre:svname=lustre-OST0000 Writing lustre-ost1/ost1 properties lustre:autodegrade=on lustre:sys.timeout=20 lustre:mgsnode=192.168.202.112@tcp lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg212-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg212-server: oleg212-server.virtnet: executing set_default_debug -1 all pdsh@oleg212-client: oleg212-server: ssh exited with exit code 1 Started lustre-OST0000 oleg212-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg212-server: oleg212-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg212-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg212-client.virtnet: -o user_xattr,flock 192.168.202.112@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg212-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg212-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg212-server stop mds service on oleg212-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg212-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg212-server' oleg212-server: oleg212-server.virtnet: executing unload_modules_local oleg212-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg212-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded. pdsh@oleg212-client: oleg212-client: ssh exited with exit code 2 pdsh@oleg212-client: oleg212-server: ssh exited with exit code 2 pdsh@oleg212-client: oleg212-server: ssh exited with exit code 2 pdsh@oleg212-client: oleg212-client: ssh exited with exit code 2 PASS 69 (2507s) == conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 18:16:35 (1763334995) SKIP: conf-sanity test_111 Only applicable to ldiskfs-based MDTs SKIP 111 (3s) Stopping clients: oleg212-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg212-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg212-client: oleg212-server: ssh exited with exit code 2 oleg212-server: oleg212-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg212-server' oleg212-server: oleg212-server.virtnet: executing load_modules_local oleg212-server: Loading modules from /home/green/git/lustre-release/lustre oleg212-server: detected 4 online CPUs by sysfs oleg212-server: MODOPTS_LIBCFS= oleg212-server: Force libcfs to create 2 CPU partitions oleg212-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy oleg212-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy oleg212-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg212-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 2895 sec ========== 18:17:35 (1763335055) === conf-sanity: start cleanup 18:17:37 (1763335057) === === conf-sanity: finish cleanup 18:17:40 (1763335060) ===