-----============= acceptance-small: conf-sanity ============----- Mon Nov 17 12:50:38 EST 2025 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg147-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32b 32c 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg147-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg147-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg147-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg147-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg147-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg147-server oleg147-server: oleg147-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg147-server' oleg147-server: oleg147-server.virtnet: executing load_modules_local oleg147-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy oleg147-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy oleg147-server: Loading modules from /home/green/git/lustre-release/lustre oleg147-server: detected 4 online CPUs by sysfs oleg147-server: MODOPTS_LIBCFS= oleg147-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg147-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg147-server: oleg147-server.virtnet: executing set_default_debug -1 all pdsh@oleg147-client: oleg147-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg147-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg147-server: oleg147-server.virtnet: executing set_default_debug -1 all pdsh@oleg147-client: oleg147-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg147-server: oleg147-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg147-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg147-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg147-server stop mds service on oleg147-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg147-server == conf-sanity test 45: long unlink handling in ptlrpcd == 12:53:32 (1763402012) start mds service on oleg147-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg147-server: oleg147-server.virtnet: executing set_default_debug -1 all pdsh@oleg147-client: oleg147-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg147-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg147-server: oleg147-server.virtnet: executing set_default_debug -1 all pdsh@oleg147-client: oleg147-server: ssh exited with exit code 1 Started lustre-OST0000 oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg147-client.virtnet: -o user_xattr,flock 192.168.201.147@tcp:/lustre /mnt/lustre setup single mount lustre success stop mds service on oleg147-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg147-server sleep 60 sec fail_loc=0x8000050f sleep 10 sec manual umount lustre on /mnt/lustre.... df: /mnt/lustre: Input/output error fail_loc=0x0 start mds service on oleg147-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg147-server: oleg147-server.virtnet: executing set_default_debug -1 all pdsh@oleg147-client: oleg147-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg147-client.virtnet: -o user_xattr,flock 192.168.201.147@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg147-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg147-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg147-server stop mds service on oleg147-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg147-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg147-server' oleg147-server: oleg147-server.virtnet: executing unload_modules_local oleg147-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg147-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded. pdsh@oleg147-client: oleg147-client: ssh exited with exit code 2 pdsh@oleg147-client: oleg147-server: ssh exited with exit code 2 pdsh@oleg147-client: oleg147-client: ssh exited with exit code 2 pdsh@oleg147-client: oleg147-server: ssh exited with exit code 2 PASS 45 (198s) == conf-sanity test 69: replace an OST with the same index ========================================================== 12:56:51 (1763402211) start mds service on oleg147-server /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg147-server' oleg147-server: oleg147-server.virtnet: executing load_modules_local oleg147-server: Loading modules from /home/green/git/lustre-release/lustre oleg147-server: detected 4 online CPUs by sysfs oleg147-server: MODOPTS_LIBCFS= oleg147-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy oleg147-server: Force libcfs to create 2 CPU partitions oleg147-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy oleg147-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg147-server: quota/lquota options: 'hash_lqs_cur_bits=3' Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg147-server: oleg147-server.virtnet: executing set_default_debug -1 all pdsh@oleg147-client: oleg147-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg147-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg147-server: oleg147-server.virtnet: executing set_default_debug -1 all pdsh@oleg147-client: oleg147-server: ssh exited with exit code 1 Started lustre-OST0000 oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg147-client.virtnet: -o user_xattr,flock 192.168.201.147@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 11872 inodes available. Want 99872. rc=0 - open/close 615 (time 1763402290.83 total 10.00 last 61.48) - open/close 1270 (time 1763402300.83 total 20.00 last 65.50) - open/close 1935 (time 1763402310.84 total 30.01 last 66.46) - open/close 2617 (time 1763402320.84 total 40.01 last 68.18) - open/close 3264 (time 1763402330.84 total 50.01 last 64.70) - open/close 3904 (time 1763402340.85 total 60.02 last 63.97) - open/close 4573 (time 1763402350.85 total 70.03 last 66.84) - open/close 5208 (time 1763402360.86 total 80.03 last 63.47) - open/close 5854 (time 1763402370.86 total 90.03 last 64.60) - open/close 6545 (time 1763402380.87 total 100.04 last 69.06) - open/close 7247 (time 1763402390.87 total 110.04 last 70.17) - open/close 7863 (time 1763402400.88 total 120.05 last 61.54) - open/close 8501 (time 1763402410.88 total 130.05 last 63.80) - open/close 9160 (time 1763402420.89 total 140.07 last 65.81) - open/close 9784 (time 1763402430.91 total 150.09 last 62.29) total: 10000 open/close in 153.47 seconds: 65.16 ops/second - unlinked 0 (time 1763402438 ; total 0 ; last 0) total: 10000 unlinks in 87 seconds: 114.942528 unlinks/second - open/close 636 (time 1763402540.08 total 10.02 last 63.48) - open/close 1333 (time 1763402550.08 total 20.02 last 69.66) - open/close 2051 (time 1763402560.10 total 30.03 last 71.72) - open/close 2750 (time 1763402570.11 total 40.05 last 69.79) - open/close 3468 (time 1763402580.12 total 50.06 last 71.71) - open/close 4145 (time 1763402590.13 total 60.07 last 67.65) - open/close 4820 (time 1763402600.13 total 70.07 last 67.48) - open/close 5500 (time 1763402610.14 total 80.08 last 67.94) - open/close 6168 (time 1763402620.15 total 90.09 last 66.72) - open/close 6851 (time 1763402630.16 total 100.10 last 68.24) - open/close 7546 (time 1763402640.16 total 110.10 last 69.50) - open/close 8232 (time 1763402650.18 total 120.12 last 68.50) - open/close 8957 (time 1763402660.18 total 130.12 last 72.47) - open/close 9688 (time 1763402670.19 total 140.13 last 73.02) total: 10000 open/close in 144.37 seconds: 69.27 ops/second - unlinked 0 (time 1763402678 ; total 0 ; last 0) total: 10000 unlinks in 81 seconds: 123.456787 unlinks/second - open/close 794 (time 1763402772.76 total 10.01 last 79.31) - open/close 1550 (time 1763402782.76 total 20.01 last 75.59) - open/close 2312 (time 1763402792.77 total 30.02 last 76.12) - open/close 3017 (time 1763402802.79 total 40.04 last 70.38) - open/close 3689 (time 1763402812.81 total 50.06 last 67.08) - open/close 4368 (time 1763402822.82 total 60.07 last 67.80) - open/close 5054 (time 1763402832.83 total 70.08 last 68.55) - open/close 5804 (time 1763402842.86 total 80.11 last 74.78) - open/close 6504 (time 1763402852.87 total 90.12 last 69.93) - open/close 7202 (time 1763402862.88 total 100.12 last 69.76) - open/close 7879 (time 1763402872.88 total 110.13 last 67.67) - open/close 8548 (time 1763402882.89 total 120.14 last 66.81) - open/close 9271 (time 1763402892.90 total 130.15 last 72.24) total: 10000 open/close in 140.13 seconds: 71.36 ops/second - unlinked 0 (time 1763402906 ; total 0 ; last 0) total: 10000 unlinks in 80 seconds: 125.000000 unlinks/second - open/close 782 (time 1763403000.38 total 10.01 last 78.16) - open/close 1529 (time 1763403010.39 total 20.02 last 74.59) - open/close 2312 (time 1763403020.40 total 30.03 last 78.27) - open/close 3062 (time 1763403030.41 total 40.04 last 74.88) - open/close 3833 (time 1763403040.42 total 50.04 last 77.08) - open/close 4596 (time 1763403050.42 total 60.05 last 76.27) - open/close 5308 (time 1763403060.42 total 70.05 last 71.20) - open/close 6034 (time 1763403070.43 total 80.05 last 72.56) - open/close 6726 (time 1763403080.43 total 90.06 last 69.16) - open/close 7437 (time 1763403090.44 total 100.06 last 71.07) - open/close 8117 (time 1763403100.45 total 110.08 last 67.93) - open/close 8801 (time 1763403110.45 total 120.08 last 68.37) - open/close 9592 (time 1763403120.46 total 130.09 last 79.06) total: 10000 open/close in 135.17 seconds: 73.98 ops/second - unlinked 0 (time 1763403128 ; total 0 ; last 0) total: 10000 unlinks in 73 seconds: 136.986298 unlinks/second - open/close 689 (time 1763403215.82 total 10.01 last 68.85) - open/close 1418 (time 1763403225.82 total 20.01 last 72.90) - open/close 2191 (time 1763403235.83 total 30.02 last 77.23) - open/close 3031 (time 1763403245.83 total 40.02 last 83.98) - open/close 3789 (time 1763403255.83 total 50.02 last 75.78) - open/close 4587 (time 1763403265.83 total 60.02 last 79.80) - open/close 5504 (time 1763403275.84 total 70.02 last 91.67) - open/close 6301 (time 1763403285.84 total 80.03 last 79.66) - open/close 6929 (time 1763403295.84 total 90.03 last 62.79) - open/close 7525 (time 1763403305.85 total 100.03 last 59.58) - open/close 8356 (time 1763403315.85 total 110.04 last 83.07) - open/close 9090 (time 1763403325.85 total 120.04 last 73.37) - open/close 9821 (time 1763403335.86 total 130.05 last 73.04) total: 10000 open/close in 132.36 seconds: 75.55 ops/second - unlinked 0 (time 1763403341 ; total 0 ; last 0) total: 10000 unlinks in 78 seconds: 128.205124 unlinks/second - open/close 729 (time 1763403433.33 total 10.01 last 72.84) - open/close 1428 (time 1763403443.34 total 20.01 last 69.88) - open/close 2095 (time 1763403453.35 total 30.02 last 66.64) - open/close 2769 (time 1763403463.36 total 40.03 last 67.31) - open/close 3452 (time 1763403473.37 total 50.04 last 68.22) - open/close 4205 (time 1763403483.37 total 60.05 last 75.29) - open/close 4892 (time 1763403493.38 total 70.06 last 68.63) - open/close 5589 (time 1763403503.39 total 80.06 last 69.65) - open/close 6258 (time 1763403513.39 total 90.07 last 66.87) - open/close 6948 (time 1763403523.41 total 100.08 last 68.89) - open/close 7639 (time 1763403533.42 total 110.09 last 69.05) - open/close 8263 (time 1763403543.42 total 120.10 last 62.36) - open/close 8943 (time 1763403553.42 total 130.10 last 67.99) - open/close 9634 (time 1763403563.43 total 140.10 last 69.06) total: 10000 open/close in 145.58 seconds: 68.69 ops/second - unlinked 0 (time 1763403572 ; total 0 ; last 0) total: 10000 unlinks in 78 seconds: 128.205124 unlinks/second - open/close 731 (time 1763403664.51 total 10.01 last 73.03) - open/close 1431 (time 1763403674.52 total 20.02 last 69.92) - open/close 2205 (time 1763403684.53 total 30.03 last 77.34) - open/close 2940 (time 1763403694.54 total 40.04 last 73.41) - open/close 3734 (time 1763403704.54 total 50.04 last 79.37) - open/close 4502 (time 1763403714.55 total 60.05 last 76.77) - open/close 5240 (time 1763403724.55 total 70.05 last 73.77) - open/close 5960 (time 1763403734.56 total 80.06 last 71.97) - open/close 6682 (time 1763403744.56 total 90.06 last 72.15) - open/close 7417 (time 1763403754.57 total 100.07 last 73.47) - open/close 8113 (time 1763403764.57 total 110.07 last 69.58) - open/close 8784 (time 1763403774.58 total 120.09 last 67.00) - open/close 9456 (time 1763403784.59 total 130.09 last 67.15) total: 10000 open/close in 137.66 seconds: 72.64 ops/second - unlinked 0 (time 1763403796 ; total 1 ; last 1) total: 10000 unlinks in 78 seconds: 128.205124 unlinks/second - open/close 765 (time 1763403886.13 total 10.01 last 76.43) - open/close 1482 (time 1763403896.14 total 20.02 last 71.65) - open/close 2236 (time 1763403906.14 total 30.02 last 75.39) - open/close 2994 (time 1763403916.15 total 40.03 last 75.73) - open/close 3699 (time 1763403926.17 total 50.05 last 70.37) - open/close 4345 (time 1763403936.17 total 60.06 last 64.54) - open/close 5076 (time 1763403946.19 total 70.07 last 72.99) - open/close 5799 (time 1763403956.20 total 80.08 last 72.26) - open/close 6549 (time 1763403966.20 total 90.08 last 74.97) - open/close 7307 (time 1763403976.20 total 100.08 last 75.79) - open/close 8047 (time 1763403986.20 total 110.08 last 73.99) - open/close 8744 (time 1763403996.21 total 120.09 last 69.62) - open/close 9429 (time 1763404006.22 total 130.10 last 68.46) total: 10000 open/close in 138.32 seconds: 72.29 ops/second - unlinked 0 (time 1763404018 ; total 0 ; last 0) total: 10000 unlinks in 81 seconds: 123.456787 unlinks/second - open/close 695 (time 1763404113.27 total 10.00 last 69.48) - open/close 1413 (time 1763404123.29 total 20.02 last 71.69) - open/close 2133 (time 1763404133.29 total 30.02 last 71.97) - open/close 2805 (time 1763404143.30 total 40.03 last 67.13) - open/close 3488 (time 1763404153.30 total 50.04 last 68.29) - open/close 4236 (time 1763404163.31 total 60.04 last 74.75) - open/close 4927 (time 1763404173.31 total 70.05 last 69.07) - open/close 5599 (time 1763404183.32 total 80.05 last 67.15) - open/close 6339 (time 1763404193.33 total 90.06 last 73.96) - open/close 7009 (time 1763404203.33 total 100.06 last 66.97) - open/close 7691 (time 1763404213.33 total 110.07 last 68.18) - open/close 8322 (time 1763404223.34 total 120.08 last 63.04) - open/close 8984 (time 1763404233.35 total 130.08 last 66.16) - open/close 9640 (time 1763404243.36 total 140.09 last 65.52) total: 10000 open/close in 145.70 seconds: 68.63 ops/second - unlinked 0 (time 1763404252 ; total 0 ; last 0) total: 10000 unlinks in 90 seconds: 111.111115 unlinks/second - open/close 658 (time 1763404357.12 total 10.01 last 65.74) - open/close 1285 (time 1763404367.13 total 20.01 last 62.67) - open/close 1887 (time 1763404377.13 total 30.02 last 60.17) - open/close 2504 (time 1763404387.15 total 40.03 last 61.62) - open/close 3245 (time 1763404397.15 total 50.04 last 74.05) - open/close 3907 (time 1763404407.16 total 60.04 last 66.18) - open/close 4506 (time 1763404417.17 total 70.05 last 59.83) - open/close 5204 (time 1763404427.18 total 80.06 last 69.74) - open/close 5846 (time 1763404437.18 total 90.07 last 64.16) - open/close 6496 (time 1763404447.20 total 100.09 last 64.90) - open/close 7165 (time 1763404457.21 total 110.09 last 66.84) - open/close 7827 (time 1763404467.23 total 120.11 last 66.09) - open/close 8481 (time 1763404477.23 total 130.11 last 65.39) - open/close 9120 (time 1763404487.23 total 140.12 last 63.88) - open/close 9805 (time 1763404497.25 total 150.14 last 68.33) total: 10000 open/close in 153.10 seconds: 65.32 ops/second - unlinked 0 (time 1763404503 ; total 0 ; last 0) total: 10000 unlinks in 87 seconds: 114.942528 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg147-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg147-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg147-server Permanent disk data: Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: mgsnode=192.168.201.147@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.201.147@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg147-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg147-server: oleg147-server.virtnet: executing set_default_debug -1 all pdsh@oleg147-client: oleg147-server: ssh exited with exit code 1 Started lustre-OST0000 oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg147-server: oleg147-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg147-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 4 sec mount lustre on /mnt/lustre..... Starting client: oleg147-client.virtnet: -o user_xattr,flock 192.168.201.147@tcp:/lustre /mnt/lustre On OST0, 12605 used inodes rc=0 pdsh@oleg147-client: oleg147-server: ssh exited with exit code 22 umount lustre on /mnt/lustre..... Stopping client oleg147-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg147-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg147-server Permanent disk data: Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: mgsnode=192.168.201.147@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.201.147@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=98 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre:OST0000 checking for existing Lustre data: found Read previous values: Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: mgsnode=192.168.201.147@tcp sys.timeout=20 autodegrade=on Permanent disk data: Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: mgsnode=192.168.201.147@tcp sys.timeout=20 autodegrade=on autodegrade=on lustre:svname=lustre-OST0000 Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.201.147@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg147-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg147-server: oleg147-server.virtnet: executing set_default_debug -1 all pdsh@oleg147-client: oleg147-server: ssh exited with exit code 1 Started lustre-OST0000 oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg147-server: oleg147-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg147-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg147-client.virtnet: -o user_xattr,flock 192.168.201.147@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg147-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg147-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg147-server stop mds service on oleg147-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg147-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg147-server' oleg147-server: oleg147-server.virtnet: executing unload_modules_local oleg147-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg147-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded. pdsh@oleg147-client: oleg147-server: ssh exited with exit code 2 pdsh@oleg147-client: oleg147-client: ssh exited with exit code 2 pdsh@oleg147-client: oleg147-client: ssh exited with exit code 2 pdsh@oleg147-client: oleg147-server: ssh exited with exit code 2 PASS 69 (2528s) == conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 13:39:00 (1763404740) SKIP: conf-sanity test_111 Only applicable to ldiskfs-based MDTs SKIP 111 (4s) Stopping clients: oleg147-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg147-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg147-client: oleg147-server: ssh exited with exit code 2 oleg147-server: oleg147-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg147-server' oleg147-server: oleg147-server.virtnet: executing load_modules_local oleg147-server: Loading modules from /home/green/git/lustre-release/lustre oleg147-server: detected 4 online CPUs by sysfs oleg147-server: MODOPTS_LIBCFS= oleg147-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1030: echo: write error: Device or resource busy oleg147-server: Force libcfs to create 2 CPU partitions oleg147-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1031: echo: write error: Device or resource busy oleg147-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg147-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 2979 sec ========== 13:40:19 (1763404819) === conf-sanity: start cleanup 13:40:21 (1763404821) === === conf-sanity: finish cleanup 13:40:25 (1763404825) ===