-----============= acceptance-small: conf-sanity ============----- Thu Jan 22 04:13:52 EST 2026 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg217-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32b 32c 32newtarball 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg217-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg217-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg217-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg217-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg217-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg217-server oleg217-server: oleg217-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1033: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions loading modules on: 'oleg217-server' oleg217-server: oleg217-server.virtnet: executing load_modules_local oleg217-server: Loading modules from /home/green/git/lustre-release/lustre oleg217-server: detected 4 online CPUs by sysfs oleg217-server: MODOPTS_LIBCFS= oleg217-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1033: echo: write error: Device or resource busy oleg217-server: Force libcfs to create 2 CPU partitions oleg217-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg217-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg217-server: oleg217-server.virtnet: executing set_default_debug -1 all pdsh@oleg217-client: oleg217-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg217-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg217-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg217-server: oleg217-server.virtnet: executing set_default_debug -1 all pdsh@oleg217-client: oleg217-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg217-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg217-server: oleg217-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg217-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg217-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg217-server stop mds service on oleg217-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg217-server == conf-sanity test 45: long unlink handling in ptlrpcd == 04:17:42 (1769073462) start mds service on oleg217-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg217-server: oleg217-server.virtnet: executing set_default_debug -1 all pdsh@oleg217-client: oleg217-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg217-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg217-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg217-server: oleg217-server.virtnet: executing set_default_debug -1 all pdsh@oleg217-client: oleg217-server: ssh exited with exit code 1 Started lustre-OST0000 oleg217-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg217-client.virtnet: -o user_xattr,flock 192.168.202.117@tcp:/lustre /mnt/lustre setup single mount lustre success stop mds service on oleg217-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg217-server sleep 60 sec fail_loc=0x8000050f sleep 10 sec manual umount lustre on /mnt/lustre.... df: /mnt/lustre: Input/output error fail_loc=0x0 start mds service on oleg217-server Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg217-server: oleg217-server.virtnet: executing set_default_debug -1 all pdsh@oleg217-client: oleg217-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg217-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg217-client.virtnet: -o user_xattr,flock 192.168.202.117@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg217-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg217-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg217-server stop mds service on oleg217-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg217-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg217-server' oleg217-server: oleg217-server.virtnet: executing unload_modules_local oleg217-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg217-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded. pdsh@oleg217-client: oleg217-client: ssh exited with exit code 2 pdsh@oleg217-client: oleg217-server: ssh exited with exit code 2 pdsh@oleg217-client: oleg217-client: ssh exited with exit code 2 pdsh@oleg217-client: oleg217-server: ssh exited with exit code 2 PASS 45 (241s) == conf-sanity test 69: replace an OST with the same index ========================================================== 04:21:44 (1769073704) start mds service on oleg217-server /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1033: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg217-server' oleg217-server: oleg217-server.virtnet: executing load_modules_local oleg217-server: Loading modules from /home/green/git/lustre-release/lustre oleg217-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1033: echo: write error: Device or resource busy oleg217-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg217-server: detected 4 online CPUs by sysfs oleg217-server: MODOPTS_LIBCFS= oleg217-server: Force libcfs to create 2 CPU partitions oleg217-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg217-server: quota/lquota options: 'hash_lqs_cur_bits=3' Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg217-server: oleg217-server.virtnet: executing set_default_debug -1 all pdsh@oleg217-client: oleg217-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg217-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg217-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg217-server: oleg217-server.virtnet: executing set_default_debug -1 all pdsh@oleg217-client: oleg217-server: ssh exited with exit code 1 Started lustre-OST0000 oleg217-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg217-client.virtnet: -o user_xattr,flock 192.168.202.117@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff On OST0, 11872 inodes available. Want 99872. rc=0 - open/close 540 (time 1769073806.16 total 10.00 last 53.98) - open/close 1225 (time 1769073816.16 total 20.01 last 68.44) - open/close 1809 (time 1769073826.18 total 30.02 last 58.34) - open/close 2480 (time 1769073836.19 total 40.04 last 66.97) - open/close 3211 (time 1769073846.20 total 50.04 last 73.10) - open/close 3925 (time 1769073856.21 total 60.05 last 71.33) - open/close 4625 (time 1769073866.21 total 70.06 last 69.98) - open/close 5197 (time 1769073876.21 total 80.06 last 57.18) - open/close 5806 (time 1769073886.22 total 90.07 last 60.84) - open/close 6402 (time 1769073896.24 total 100.09 last 59.49) - open/close 6967 (time 1769073906.26 total 110.10 last 56.42) - open/close 7582 (time 1769073916.27 total 120.11 last 61.43) - open/close 8340 (time 1769073926.27 total 130.12 last 75.74) - open/close 9036 (time 1769073936.28 total 140.13 last 69.54) - open/close 9702 (time 1769073946.30 total 150.15 last 66.46) total: 10000 open/close in 155.04 seconds: 64.50 ops/second - unlinked 0 (time 1769073956 ; total 0 ; last 0) total: 10000 unlinks in 100 seconds: 100.000000 unlinks/second - open/close 569 (time 1769074072.62 total 10.01 last 56.86) - open/close 1125 (time 1769074082.62 total 20.01 last 55.60) - open/close 1809 (time 1769074092.63 total 30.02 last 68.35) - open/close 2452 (time 1769074102.64 total 40.03 last 64.22) - open/close 2944 (time 1769074112.65 total 50.03 last 49.17) - open/close 3629 (time 1769074122.65 total 60.04 last 68.46) - open/close 4365 (time 1769074132.69 total 70.07 last 73.37) - open/close 4938 (time 1769074142.69 total 80.07 last 57.28) - open/close 5539 (time 1769074152.69 total 90.08 last 60.08) - open/close 6117 (time 1769074162.71 total 100.09 last 57.71) - open/close 6692 (time 1769074172.73 total 110.11 last 57.39) - open/close 7299 (time 1769074182.76 total 120.15 last 60.50) - open/close 7856 (time 1769074192.76 total 130.15 last 55.70) - open/close 8414 (time 1769074202.77 total 140.16 last 55.73) - open/close 9042 (time 1769074212.78 total 150.17 last 62.73) - open/close 9657 (time 1769074222.79 total 160.17 last 61.48) total: 10000 open/close in 165.74 seconds: 60.34 ops/second - unlinked 0 (time 1769074233 ; total 0 ; last 0) total: 10000 unlinks in 104 seconds: 96.153847 unlinks/second - open/close 648 (time 1769074353.72 total 10.01 last 64.76) - open/close 1259 (time 1769074363.72 total 20.01 last 61.08) - open/close 1943 (time 1769074373.72 total 30.01 last 68.38) - open/close 2605 (time 1769074383.73 total 40.02 last 66.18) - open/close 3331 (time 1769074393.73 total 50.03 last 72.53) - open/close 3930 (time 1769074403.74 total 60.03 last 59.86) - open/close 4563 (time 1769074413.75 total 70.04 last 63.23) - open/close 5169 (time 1769074423.77 total 80.06 last 60.47) - open/close 5781 (time 1769074433.78 total 90.07 last 61.17) - open/close 6343 (time 1769074443.78 total 100.07 last 56.20) - open/close 6925 (time 1769074453.79 total 110.08 last 58.13) - open/close 7564 (time 1769074463.79 total 120.08 last 63.88) - open/close 8117 (time 1769074473.79 total 130.08 last 55.30) - open/close 8823 (time 1769074483.80 total 140.09 last 70.57) - open/close 9331 (time 1769074493.81 total 150.10 last 50.72) total: 10000 open/close in 159.72 seconds: 62.61 ops/second - unlinked 0 (time 1769074508 ; total 0 ; last 0) total: 10000 unlinks in 97 seconds: 103.092781 unlinks/second - open/close 683 (time 1769074621.00 total 10.01 last 68.20) - open/close 1270 (time 1769074631.00 total 20.02 last 58.69) - open/close 1814 (time 1769074641.04 total 30.05 last 54.21) - open/close 2348 (time 1769074651.06 total 40.08 last 53.27) - open/close 2983 (time 1769074661.07 total 50.08 last 63.48) - open/close 3608 (time 1769074671.07 total 60.08 last 62.50) - open/close 4275 (time 1769074681.07 total 70.08 last 66.69) - open/close 4811 (time 1769074691.09 total 80.10 last 53.49) - open/close 5367 (time 1769074701.09 total 90.11 last 55.58) - open/close 5955 (time 1769074711.11 total 100.12 last 58.70) - open/close 6401 (time 1769074721.11 total 110.12 last 44.60) - open/close 6859 (time 1769074731.11 total 120.13 last 45.79) - open/close 7464 (time 1769074741.13 total 130.14 last 60.38) - open/close 8013 (time 1769074751.14 total 140.15 last 54.86) - open/close 8607 (time 1769074761.15 total 150.16 last 59.34) - open/close 9233 (time 1769074771.16 total 160.17 last 62.56) - open/close 9831 (time 1769074781.16 total 170.17 last 59.79) total: 10000 open/close in 172.78 seconds: 57.88 ops/second - unlinked 0 (time 1769074789 ; total 0 ; last 0) total: 10000 unlinks in 99 seconds: 101.010101 unlinks/second - open/close 669 (time 1769074904.62 total 10.01 last 66.82) - open/close 1176 (time 1769074914.70 total 20.10 last 50.26) - open/close 1711 (time 1769074924.72 total 30.11 last 53.41) - open/close 2308 (time 1769074934.74 total 40.14 last 59.56) - open/close 2917 (time 1769074944.74 total 50.14 last 60.88) - open/close 3595 (time 1769074954.75 total 60.14 last 67.79) - open/close 4182 (time 1769074964.76 total 70.15 last 58.64) - open/close 4778 (time 1769074974.76 total 80.15 last 59.59) - open/close 5357 (time 1769074984.77 total 90.17 last 57.81) - open/close 6025 (time 1769074994.78 total 100.18 last 66.73) - open/close 6719 (time 1769075004.79 total 110.18 last 69.38) - open/close 7422 (time 1769075014.79 total 120.19 last 70.26) - open/close 8007 (time 1769075024.80 total 130.20 last 58.45) - open/close 8580 (time 1769075034.80 total 140.20 last 57.30) - open/close 9075 (time 1769075044.82 total 150.22 last 49.39) - open/close 9645 (time 1769075054.84 total 160.23 last 56.92) total: 10000 open/close in 166.42 seconds: 60.09 ops/second - unlinked 0 (time 1769075066 ; total 0 ; last 0) total: 10000 unlinks in 93 seconds: 107.526878 unlinks/second - open/close 719 (time 1769075174.03 total 10.01 last 71.85) - open/close 1317 (time 1769075184.03 total 20.01 last 59.79) - open/close 1944 (time 1769075194.03 total 30.01 last 62.68) - open/close 2545 (time 1769075204.04 total 40.01 last 60.08) - open/close 3097 (time 1769075214.05 total 50.03 last 55.10) - open/close 3672 (time 1769075224.06 total 60.04 last 57.46) - open/close 4250 (time 1769075234.07 total 70.04 last 57.78) - open/close 4960 (time 1769075244.08 total 80.06 last 70.91) - open/close 5666 (time 1769075254.09 total 90.06 last 70.54) - open/close 6359 (time 1769075264.09 total 100.07 last 69.27) - open/close 6964 (time 1769075274.09 total 110.07 last 60.49) - open/close 7683 (time 1769075284.10 total 120.08 last 71.84) - open/close 8321 (time 1769075294.11 total 130.08 last 63.77) - open/close 9062 (time 1769075304.11 total 140.09 last 74.03) - open/close 9732 (time 1769075314.12 total 150.10 last 66.96) total: 10000 open/close in 154.08 seconds: 64.90 ops/second - unlinked 0 (time 1769075323 ; total 0 ; last 0) total: 10000 unlinks in 100 seconds: 100.000000 unlinks/second - open/close 500 (time 1769075439.35 total 10.00 last 49.98) - open/close 1040 (time 1769075449.36 total 20.01 last 53.96) - open/close 1540 (time 1769075459.38 total 30.03 last 49.90) - open/close 2064 (time 1769075469.40 total 40.05 last 52.28) - open/close 2549 (time 1769075479.41 total 50.06 last 48.46) - open/close 3134 (time 1769075489.41 total 60.06 last 58.50) - open/close 3723 (time 1769075499.42 total 70.07 last 58.85) - open/close 4262 (time 1769075509.43 total 80.08 last 53.84) - open/close 4868 (time 1769075519.44 total 90.09 last 60.54) - open/close 5439 (time 1769075529.44 total 100.09 last 57.10) - open/close 6093 (time 1769075539.44 total 110.09 last 65.40) - open/close 6884 (time 1769075549.44 total 120.10 last 79.08) - open/close 7548 (time 1769075559.44 total 130.10 last 66.39) - open/close 8144 (time 1769075569.46 total 140.11 last 59.49) - open/close 8652 (time 1769075579.47 total 150.12 last 50.78) - open/close 9272 (time 1769075589.48 total 160.13 last 61.92) - open/close 9888 (time 1769075599.48 total 170.13 last 61.57) total: 10000 open/close in 171.95 seconds: 58.16 ops/second - unlinked 0 (time 1769075607 ; total 0 ; last 0) total: 10000 unlinks in 91 seconds: 109.890106 unlinks/second - open/close 409 (time 1769075713.10 total 10.00 last 40.89) - open/close 1019 (time 1769075723.12 total 20.03 last 60.84) - open/close 1577 (time 1769075733.13 total 30.04 last 55.74) - open/close 2136 (time 1769075743.14 total 40.05 last 55.85) - open/close 2794 (time 1769075753.16 total 50.06 last 65.71) - open/close 3544 (time 1769075763.16 total 60.07 last 74.96) - open/close 4271 (time 1769075773.17 total 70.08 last 72.62) - open/close 4942 (time 1769075783.17 total 80.08 last 67.09) - open/close 5464 (time 1769075793.18 total 90.09 last 52.17) - open/close 5977 (time 1769075803.19 total 100.10 last 51.25) - open/close 6396 (time 1769075813.20 total 110.11 last 41.85) - open/close 6932 (time 1769075823.21 total 120.11 last 53.57) - open/close 7590 (time 1769075833.21 total 130.11 last 65.79) - open/close 8267 (time 1769075843.22 total 140.12 last 67.63) - open/close 8992 (time 1769075853.22 total 150.12 last 72.49) - open/close 9650 (time 1769075863.22 total 160.12 last 65.80) total: 10000 open/close in 165.49 seconds: 60.43 ops/second - unlinked 0 (time 1769075873 ; total 0 ; last 0) total: 10000 unlinks in 96 seconds: 104.166664 unlinks/second - open/close 651 (time 1769075985.73 total 10.02 last 64.96) - open/close 1286 (time 1769075995.74 total 20.03 last 63.44) - open/close 1935 (time 1769076005.78 total 30.07 last 64.64) - open/close 2595 (time 1769076015.79 total 40.08 last 65.94) - open/close 3280 (time 1769076025.81 total 50.10 last 68.38) - open/close 3991 (time 1769076035.82 total 60.11 last 71.02) - open/close 4546 (time 1769076045.82 total 70.11 last 55.49) - open/close 5006 (time 1769076055.83 total 80.12 last 45.97) - open/close 5446 (time 1769076065.85 total 90.14 last 43.91) - open/close 5985 (time 1769076075.86 total 100.15 last 53.85) - open/close 6624 (time 1769076085.88 total 110.17 last 63.75) - open/close 7176 (time 1769076095.89 total 120.18 last 55.15) - open/close 7752 (time 1769076105.89 total 130.18 last 57.58) - open/close 8252 (time 1769076115.91 total 140.20 last 49.91) - open/close 8804 (time 1769076125.93 total 150.22 last 55.10) - open/close 9133 (time 1769076135.94 total 160.23 last 32.87) - open/close 9605 (time 1769076145.96 total 170.25 last 47.09) total: 10000 open/close in 177.67 seconds: 56.28 ops/second - unlinked 0 (time 1769076159 ; total 0 ; last 0) total: 10000 unlinks in 96 seconds: 104.166664 unlinks/second - open/close 763 (time 1769076270.16 total 10.01 last 76.26) - open/close 1382 (time 1769076280.17 total 20.01 last 61.86) - open/close 1925 (time 1769076290.18 total 30.02 last 54.25) - open/close 2585 (time 1769076300.18 total 40.03 last 65.97) - open/close 3362 (time 1769076310.19 total 50.03 last 77.65) - open/close 4014 (time 1769076320.20 total 60.04 last 65.13) - open/close 4536 (time 1769076330.28 total 70.12 last 51.81) - open/close 5062 (time 1769076340.28 total 80.13 last 52.56) - open/close 5617 (time 1769076350.29 total 90.13 last 55.46) - open/close 6118 (time 1769076360.30 total 100.14 last 50.05) - open/close 6837 (time 1769076370.31 total 110.15 last 71.85) - open/close 7530 (time 1769076380.32 total 120.16 last 69.23) - open/close 8305 (time 1769076390.33 total 130.17 last 77.39) - open/close 9031 (time 1769076400.34 total 140.18 last 72.54) - open/close 9746 (time 1769076410.38 total 150.22 last 71.23) total: 10000 open/close in 154.45 seconds: 64.75 ops/second - unlinked 0 (time 1769076420 ; total 0 ; last 0) total: 10000 unlinks in 90 seconds: 111.111115 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg217-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg217-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg217-server Permanent disk data: Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: mgsnode=192.168.202.117@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.202.117@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg217-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg217-server: oleg217-server.virtnet: executing set_default_debug -1 all pdsh@oleg217-client: oleg217-server: ssh exited with exit code 1 Started lustre-OST0000 oleg217-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg217-server: oleg217-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg217-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 3 sec mount lustre on /mnt/lustre..... Starting client: oleg217-client.virtnet: -o user_xattr,flock 192.168.202.117@tcp:/lustre /mnt/lustre On OST0, 18125 used inodes rc=0 pdsh@oleg217-client: oleg217-server: ssh exited with exit code 22 umount lustre on /mnt/lustre..... Stopping client oleg217-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg217-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg217-server Permanent disk data: Target: lustre:OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: mgsnode=192.168.202.117@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.202.117@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=98 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre:OST0000 checking for existing Lustre data: found Read previous values: Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x62 (OST first_time update ) Persistent mount opts: Parameters: autodegrade=on sys.timeout=20 mgsnode=192.168.202.117@tcp Permanent disk data: Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: autodegrade=on sys.timeout=20 mgsnode=192.168.202.117@tcp autodegrade=on lustre:svname=lustre-OST0000 Writing lustre-ost1/ost1 properties lustre:autodegrade=on lustre:sys.timeout=20 lustre:mgsnode=192.168.202.117@tcp lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg217-server Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg217-server: oleg217-server.virtnet: executing set_default_debug -1 all pdsh@oleg217-client: oleg217-server: ssh exited with exit code 1 Started lustre-OST0000 oleg217-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg217-server: oleg217-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 oleg217-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 3 sec mount lustre on /mnt/lustre..... Starting client: oleg217-client.virtnet: -o user_xattr,flock 192.168.202.117@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg217-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg217-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg217-server stop mds service on oleg217-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg217-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy unloading modules via unload_modules_local on: 'oleg217-server' oleg217-server: oleg217-server.virtnet: executing unload_modules_local oleg217-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 114: echo: write error: Device or resource busy oleg217-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 156: echo: write error: Device or resource busy modules unloaded. pdsh@oleg217-client: oleg217-client: ssh exited with exit code 2 pdsh@oleg217-client: oleg217-server: ssh exited with exit code 2 pdsh@oleg217-client: oleg217-client: ssh exited with exit code 2 pdsh@oleg217-client: oleg217-server: ssh exited with exit code 2 PASS 69 (2993s) == conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 05:11:39 (1769076699) SKIP: conf-sanity test_111 Only applicable to ldiskfs-based MDTs SKIP 111 (5s) Stopping clients: oleg217-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg217-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg217-client: oleg217-server: ssh exited with exit code 2 oleg217-server: oleg217-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1033: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' ln: failed to create symbolic link '/sbin/.libs': Read-only file system loading modules on: 'oleg217-server' oleg217-server: oleg217-server.virtnet: executing load_modules_local oleg217-server: Loading modules from /home/green/git/lustre-release/lustre oleg217-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1033: echo: write error: Device or resource busy oleg217-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy oleg217-server: detected 4 online CPUs by sysfs oleg217-server: MODOPTS_LIBCFS= oleg217-server: Force libcfs to create 2 CPU partitions oleg217-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg217-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 3555 sec ========== 05:13:09 (1769076789) === conf-sanity: start cleanup 05:13:12 (1769076792) === === conf-sanity: finish cleanup 05:13:17 (1769076797) ===