-----============= acceptance-small: conf-sanity ============----- Mon Aug 31 04:23:08 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg415-server: /home/green/git/lustre-release/lustre/tests/except/conf-sanity.ex - see CLIENT_VERSION > v2_15_63-53-g1a6ef725c2 (34682934 > 34553653) for LU-16938, go 81 excepting tests: 32b 32c 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg415-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg415-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg415-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg415-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg415-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg415-server oleg415-server: oleg415-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg415-server' oleg415-server: oleg415-server.virtnet: executing load_modules_local oleg415-server: Loading modules from /home/green/git/lustre-release/lustre oleg415-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg415-server: detected 4 online CPUs by sysfs oleg415-server: MODOPTS_LIBCFS= oleg415-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg415-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg415-server: oleg415-server.virtnet: executing set_default_debug -1 all pdsh@oleg415-client: oleg415-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg415-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg415-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg415-server: oleg415-server.virtnet: executing set_default_debug -1 all pdsh@oleg415-client: oleg415-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg415-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg415-server: oleg415-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg415-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg415-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg415-server stop mds service on oleg415-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg415-server == conf-sanity test 45: long unlink handling in ptlrpcd == 04:26:06 (1788164766) start mds service on oleg415-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg415-server: oleg415-server.virtnet: executing set_default_debug -1 all pdsh@oleg415-client: oleg415-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg415-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg415-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg415-server: oleg415-server.virtnet: executing set_default_debug -1 all pdsh@oleg415-client: oleg415-server: ssh exited with exit code 1 Started lustre-OST0000 oleg415-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg415-client.virtnet: -o user_xattr,flock 192.168.204.115@tcp:/lustre /mnt/lustre setup single mount lustre success stop mds service on oleg415-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg415-server sleep 60 sec fail_loc=0x8000050f sleep 10 sec manual umount lustre on /mnt/lustre.... df: /mnt/lustre: Input/output error fail_loc=0x0 start mds service on oleg415-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg415-server: oleg415-server.virtnet: executing set_default_debug -1 all pdsh@oleg415-client: oleg415-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg415-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg415-client.virtnet: -o user_xattr,flock 192.168.204.115@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg415-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg415-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg415-server stop mds service on oleg415-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg415-server unloading modules via unload_modules_local on: 'oleg415-server' oleg415-server: oleg415-server.virtnet: executing unload_modules_local oleg415-server: modules unloaded. pdsh@oleg415-client: oleg415-client: ssh exited with exit code 2 pdsh@oleg415-client: oleg415-server: ssh exited with exit code 2 pdsh@oleg415-client: oleg415-server: ssh exited with exit code 2 pdsh@oleg415-client: oleg415-client: ssh exited with exit code 2 PASS 45 (221s) == conf-sanity test 69: replace an OST with the same index ========================================================== 04:29:47 (1788164987) start mds service on oleg415-server /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg415-server' oleg415-server: oleg415-server.virtnet: executing load_modules_local oleg415-server: Loading modules from /home/green/git/lustre-release/lustre oleg415-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg415-server: detected 4 online CPUs by sysfs oleg415-server: MODOPTS_LIBCFS= oleg415-server: Force libcfs to create 2 CPU partitions oleg415-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg415-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg415-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg415-server: oleg415-server.virtnet: executing set_default_debug -1 all pdsh@oleg415-client: oleg415-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg415-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 start ost1 service on oleg415-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg415-server: oleg415-server.virtnet: executing set_default_debug -1 all pdsh@oleg415-client: oleg415-server: ssh exited with exit code 1 Started lustre-OST0000 oleg415-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 mount lustre on /mnt/lustre..... Starting client: oleg415-client.virtnet: -o user_xattr,flock 192.168.204.115@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 11904 inodes available. Want 99872. rc=0 - open/close 708 (time 1788165070.92 total 10.01 last 70.71) - open/close 1356 (time 1788165080.92 total 20.01 last 64.80) - open/close 2020 (time 1788165090.93 total 30.02 last 66.34) - open/close 2654 (time 1788165100.93 total 40.02 last 63.39) - open/close 3311 (time 1788165110.94 total 50.03 last 65.65) - open/close 3890 (time 1788165120.94 total 60.03 last 57.89) - open/close 4522 (time 1788165130.95 total 70.05 last 63.12) - open/close 5019 (time 1788165140.96 total 80.05 last 49.67) - open/close 5602 (time 1788165150.96 total 90.06 last 58.27) - open/close 6091 (time 1788165160.96 total 100.06 last 48.89) - open/close 6630 (time 1788165170.99 total 110.08 last 53.77) - open/close 7345 (time 1788165181.00 total 120.09 last 71.44) - open/close 7927 (time 1788165191.00 total 130.10 last 58.18) - open/close 8539 (time 1788165201.00 total 140.10 last 61.18) - open/close 9086 (time 1788165211.02 total 150.11 last 54.63) - open/close 9649 (time 1788165221.03 total 160.12 last 56.25) total: 10000 open/close in 167.03 seconds: 59.87 ops/second - unlinked 0 (time 1788165232 ; total 0 ; last 0) total: 10000 unlinks in 114 seconds: 87.719299 unlinks/second - open/close 648 (time 1788165361.17 total 10.01 last 64.76) - open/close 1318 (time 1788165371.18 total 20.02 last 66.94) - open/close 1986 (time 1788165381.19 total 30.03 last 66.70) - open/close 2625 (time 1788165391.21 total 40.05 last 63.78) - open/close 3275 (time 1788165401.22 total 50.06 last 64.93) - open/close 3971 (time 1788165411.22 total 60.06 last 69.59) - open/close 4620 (time 1788165421.23 total 70.07 last 64.83) - open/close 5313 (time 1788165431.24 total 80.08 last 69.26) - open/close 5999 (time 1788165441.25 total 90.09 last 68.53) - open/close 6596 (time 1788165451.25 total 100.09 last 59.66) - open/close 7204 (time 1788165461.26 total 110.10 last 60.77) - open/close 7806 (time 1788165471.27 total 120.11 last 60.13) - open/close 8456 (time 1788165481.28 total 130.12 last 64.94) - open/close 9109 (time 1788165491.30 total 140.14 last 65.18) - open/close 9727 (time 1788165501.30 total 150.14 last 61.77) total: 10000 open/close in 154.26 seconds: 64.82 ops/second - unlinked 0 (time 1788165509 ; total 0 ; last 0) total: 10000 unlinks in 95 seconds: 105.263161 unlinks/second - open/close 658 (time 1788165619.00 total 10.02 last 65.70) - open/close 1296 (time 1788165629.00 total 20.02 last 63.77) - open/close 1999 (time 1788165639.01 total 30.03 last 70.20) - open/close 2614 (time 1788165649.02 total 40.04 last 61.49) - open/close 3234 (time 1788165659.03 total 50.05 last 61.94) - open/close 3863 (time 1788165669.03 total 60.05 last 62.87) - open/close 4500 (time 1788165679.04 total 70.06 last 63.62) - open/close 5133 (time 1788165689.06 total 80.08 last 63.22) - open/close 5684 (time 1788165699.06 total 90.08 last 55.08) - open/close 6286 (time 1788165709.06 total 100.08 last 60.18) - open/close 6937 (time 1788165719.07 total 110.09 last 65.04) - open/close 7561 (time 1788165729.10 total 120.12 last 62.21) - open/close 8196 (time 1788165739.11 total 130.13 last 63.46) - open/close 8833 (time 1788165749.11 total 140.13 last 63.69) - open/close 9462 (time 1788165759.12 total 150.13 last 62.89) total: 10000 open/close in 158.05 seconds: 63.27 ops/second - unlinked 0 (time 1788165771 ; total 0 ; last 0) total: 10000 unlinks in 102 seconds: 98.039215 unlinks/second - open/close 526 (time 1788165888.30 total 10.00 last 52.59) - open/close 1196 (time 1788165898.31 total 20.01 last 66.94) - open/close 1820 (time 1788165908.32 total 30.02 last 62.34) - open/close 2329 (time 1788165918.32 total 40.02 last 50.89) - open/close 2952 (time 1788165928.33 total 50.03 last 62.25) - open/close 3646 (time 1788165938.33 total 60.03 last 69.38) - open/close 4291 (time 1788165948.35 total 70.05 last 64.41) - open/close 4956 (time 1788165958.35 total 80.05 last 66.46) - open/close 5508 (time 1788165968.36 total 90.06 last 55.15) - open/close 6153 (time 1788165978.38 total 100.08 last 64.38) - open/close 6787 (time 1788165988.39 total 110.09 last 63.35) - open/close 7402 (time 1788165998.40 total 120.10 last 61.44) - open/close 8056 (time 1788166008.41 total 130.11 last 65.32) - open/close 8634 (time 1788166018.42 total 140.13 last 57.73) - open/close 9186 (time 1788166028.45 total 150.15 last 55.08) - open/close 9854 (time 1788166038.45 total 160.15 last 66.78) total: 10000 open/close in 162.13 seconds: 61.68 ops/second - unlinked 0 (time 1788166045 ; total 0 ; last 0) total: 10000 unlinks in 105 seconds: 95.238098 unlinks/second - open/close 570 (time 1788166165.59 total 10.01 last 56.95) - open/close 1187 (time 1788166175.60 total 20.01 last 61.69) - open/close 1801 (time 1788166185.60 total 30.01 last 61.40) - open/close 2422 (time 1788166195.62 total 40.03 last 61.98) - open/close 3050 (time 1788166205.62 total 50.03 last 62.78) - open/close 3732 (time 1788166215.64 total 60.05 last 68.07) - open/close 4348 (time 1788166225.64 total 70.05 last 61.60) - open/close 4881 (time 1788166235.65 total 80.07 last 53.22) - open/close 5417 (time 1788166245.69 total 90.10 last 53.43) - open/close 5980 (time 1788166255.69 total 100.11 last 56.25) - open/close 6616 (time 1788166265.71 total 110.12 last 63.53) - open/close 7213 (time 1788166275.71 total 120.12 last 59.69) - open/close 7791 (time 1788166285.73 total 130.14 last 57.68) - open/close 8396 (time 1788166295.73 total 140.14 last 60.50) - open/close 8953 (time 1788166305.73 total 150.15 last 55.67) - open/close 9444 (time 1788166315.74 total 160.16 last 49.06) total: 10000 open/close in 169.02 seconds: 59.16 ops/second - unlinked 0 (time 1788166329 ; total 0 ; last 0) total: 10000 unlinks in 109 seconds: 91.743118 unlinks/second - open/close 614 (time 1788166453.04 total 10.01 last 61.33) - open/close 1167 (time 1788166463.06 total 20.03 last 55.17) - open/close 1808 (time 1788166473.09 total 30.06 last 63.93) - open/close 2427 (time 1788166483.10 total 40.08 last 61.81) - open/close 3067 (time 1788166493.11 total 50.08 last 63.97) - open/close 3715 (time 1788166503.12 total 60.09 last 64.72) - open/close 4365 (time 1788166513.13 total 70.10 last 64.93) - open/close 5010 (time 1788166523.14 total 80.12 last 64.42) - open/close 5664 (time 1788166533.15 total 90.12 last 65.38) - open/close 6298 (time 1788166543.15 total 100.13 last 63.36) - open/close 6964 (time 1788166553.15 total 110.13 last 66.60) - open/close 7581 (time 1788166563.16 total 120.14 last 61.63) - open/close 8239 (time 1788166573.17 total 130.15 last 65.75) - open/close 8904 (time 1788166583.18 total 140.16 last 66.43) - open/close 9542 (time 1788166593.19 total 150.17 last 63.74) total: 10000 open/close in 158.10 seconds: 63.25 ops/second - unlinked 0 (time 1788166605 ; total 0 ; last 0) total: 10000 unlinks in 110 seconds: 90.909088 unlinks/second - open/close 580 (time 1788166730.32 total 10.01 last 57.95) - open/close 1208 (time 1788166740.32 total 20.01 last 62.78) - open/close 1761 (time 1788166750.33 total 30.02 last 55.26) - open/close 2354 (time 1788166760.33 total 40.02 last 59.30) - open/close 2939 (time 1788166770.33 total 50.02 last 58.47) - open/close 3510 (time 1788166780.34 total 60.03 last 57.06) - open/close 4122 (time 1788166790.34 total 70.03 last 61.19) - open/close 4708 (time 1788166800.35 total 80.04 last 58.56) - open/close 5274 (time 1788166810.36 total 90.05 last 56.56) - open/close 5813 (time 1788166820.36 total 100.05 last 53.89) - open/close 6380 (time 1788166830.37 total 110.06 last 56.65) - open/close 6996 (time 1788166840.37 total 120.06 last 61.59) - open/close 7562 (time 1788166850.38 total 130.07 last 56.56) - open/close 8139 (time 1788166860.39 total 140.08 last 57.63) - open/close 8666 (time 1788166870.40 total 150.09 last 52.66) - open/close 9253 (time 1788166880.41 total 160.10 last 58.62) - open/close 9836 (time 1788166890.42 total 170.11 last 58.25) total: 10000 open/close in 173.10 seconds: 57.77 ops/second - unlinked 0 (time 1788166897 ; total 0 ; last 0) total: 10000 unlinks in 103 seconds: 97.087379 unlinks/second - open/close 506 (time 1788167015.10 total 10.02 last 50.48) - open/close 1065 (time 1788167025.11 total 20.03 last 55.84) - open/close 1569 (time 1788167035.12 total 30.04 last 50.36) - open/close 2138 (time 1788167045.13 total 40.05 last 56.84) - open/close 2771 (time 1788167055.16 total 50.08 last 63.14) - open/close 3438 (time 1788167065.16 total 60.08 last 66.66) - open/close 4037 (time 1788167075.18 total 70.10 last 59.80) - open/close 4686 (time 1788167085.18 total 80.10 last 64.87) - open/close 5333 (time 1788167095.19 total 90.11 last 64.68) - open/close 6012 (time 1788167105.22 total 100.14 last 67.71) - open/close 6650 (time 1788167115.22 total 110.14 last 63.77) - open/close 7298 (time 1788167125.22 total 120.14 last 64.78) - open/close 7982 (time 1788167135.23 total 130.15 last 68.36) - open/close 8628 (time 1788167145.23 total 140.15 last 64.58) - open/close 9263 (time 1788167155.26 total 150.18 last 63.32) - open/close 9916 (time 1788167165.27 total 160.19 last 65.24) total: 10000 open/close in 161.32 seconds: 61.99 ops/second - unlinked 0 (time 1788167170 ; total 0 ; last 0) total: 10000 unlinks in 99 seconds: 101.010101 unlinks/second - open/close 718 (time 1788167283.92 total 10.01 last 71.73) - open/close 1392 (time 1788167293.92 total 20.01 last 67.37) - open/close 2021 (time 1788167303.94 total 30.03 last 62.78) - open/close 2642 (time 1788167313.95 total 40.04 last 62.04) - open/close 3211 (time 1788167323.96 total 50.05 last 56.87) - open/close 3836 (time 1788167333.96 total 60.05 last 62.49) - open/close 4483 (time 1788167343.97 total 70.06 last 64.63) - open/close 5126 (time 1788167353.98 total 80.07 last 64.22) - open/close 5817 (time 1788167363.98 total 90.08 last 69.07) - open/close 6476 (time 1788167373.99 total 100.08 last 65.89) - open/close 7141 (time 1788167383.99 total 110.08 last 66.46) - open/close 7810 (time 1788167394.00 total 120.10 last 66.81) - open/close 8433 (time 1788167404.03 total 130.12 last 62.16) - open/close 9114 (time 1788167414.04 total 140.13 last 68.01) - open/close 9792 (time 1788167424.05 total 150.15 last 67.72) total: 10000 open/close in 153.04 seconds: 65.34 ops/second - unlinked 0 (time 1788167431 ; total 0 ; last 0) total: 10000 unlinks in 95 seconds: 105.263161 unlinks/second - open/close 664 (time 1788167540.91 total 10.00 last 66.37) - open/close 1330 (time 1788167550.93 total 20.02 last 66.49) - open/close 2023 (time 1788167560.94 total 30.03 last 69.22) - open/close 2632 (time 1788167570.94 total 40.03 last 60.90) - open/close 3323 (time 1788167580.95 total 50.04 last 69.04) - open/close 3958 (time 1788167590.95 total 60.04 last 63.49) - open/close 4577 (time 1788167600.96 total 70.05 last 61.87) - open/close 5247 (time 1788167610.97 total 80.06 last 66.93) - open/close 5848 (time 1788167620.98 total 90.07 last 60.02) - open/close 6435 (time 1788167630.99 total 100.08 last 58.65) - open/close 7155 (time 1788167640.99 total 110.08 last 71.97) - open/close 7776 (time 1788167651.00 total 120.10 last 62.02) - open/close 8310 (time 1788167661.02 total 130.11 last 53.34) - open/close 8883 (time 1788167671.04 total 140.13 last 57.16) - open/close 9461 (time 1788167681.06 total 150.15 last 57.69) total: 10000 open/close in 158.51 seconds: 63.09 ops/second - unlinked 0 (time 1788167694 ; total 0 ; last 0) total: 10000 unlinks in 97 seconds: 103.092781 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg415-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg415-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg415-server Permanent disk data: Device: lustre-ost1/ost1 Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: mgsnode=192.168.204.115@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.204.115@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg415-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg415-server: oleg415-server.virtnet: executing set_default_debug -1 all pdsh@oleg415-client: oleg415-server: ssh exited with exit code 1 Started lustre-OST0000 oleg415-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg415-server: oleg415-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg415-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg415-client.virtnet: -o user_xattr,flock 192.168.204.115@tcp:/lustre /mnt/lustre On OST0, 20326 used inodes rc=0 pdsh@oleg415-client: oleg415-server: ssh exited with exit code 22 umount lustre on /mnt/lustre..... Stopping client oleg415-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg415-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg415-server Permanent disk data: Device: lustre-ost1/ost1 Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: mgsnode=192.168.204.115@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.204.115@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=98 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre:OST0000 checking for existing Lustre data: found Read previous values: Device: lustre-ost1/ost1 Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: autodegrade=on sys.timeout=20 mgsnode=192.168.204.115@tcp Permanent disk data: Device: lustre-ost1/ost1 Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: autodegrade=on sys.timeout=20 mgsnode=192.168.204.115@tcp autodegrade=on lustre:svname=lustre-OST0000 Writing lustre-ost1/ost1 properties lustre:autodegrade=on lustre:sys.timeout=20 lustre:mgsnode=192.168.204.115@tcp lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg415-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg415-server: oleg415-server.virtnet: executing set_default_debug -1 all pdsh@oleg415-client: oleg415-server: ssh exited with exit code 1 Started lustre-OST0000 oleg415-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 oleg415-server: oleg415-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg415-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg415-client.virtnet: -o user_xattr,flock 192.168.204.115@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg415-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg415-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg415-server stop mds service on oleg415-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg415-server unloading modules via unload_modules_local on: 'oleg415-server' oleg415-server: oleg415-server.virtnet: executing unload_modules_local oleg415-server: modules unloaded. pdsh@oleg415-client: oleg415-client: ssh exited with exit code 2 pdsh@oleg415-client: oleg415-server: ssh exited with exit code 2 pdsh@oleg415-client: oleg415-client: ssh exited with exit code 2 pdsh@oleg415-client: oleg415-server: ssh exited with exit code 2 PASS 69 (2954s) == conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 05:19:02 (1788167942) SKIP: conf-sanity test_111 Only applicable to ldiskfs-based MDTs SKIP 111 (3s) Stopping clients: oleg415-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg415-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg415-client: oleg415-server: ssh exited with exit code 2 oleg415-server: oleg415-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' mdt/mdt options: 'mdt_enable_flr_ec=1' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg415-server' oleg415-server: oleg415-server.virtnet: executing load_modules_local oleg415-server: Loading modules from /home/green/git/lustre-release/lustre oleg415-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1048: echo: write error: Device or resource busy oleg415-server: detected 4 online CPUs by sysfs oleg415-server: MODOPTS_LIBCFS= oleg415-server: Force libcfs to create 2 CPU partitions oleg415-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg415-server: quota/lquota options: 'hash_lqs_cur_bits=3' oleg415-server: mdt/mdt options: 'mdt_enable_flr_ec=1' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 3425 sec ========== 05:20:15 (1788168015) === conf-sanity: start cleanup 05:20:16 (1788168016) === === conf-sanity: finish cleanup 05:20:20 (1788168020) ===