-----============= acceptance-small: conf-sanity ============----- Mon May 11 17:26:26 EDT 2026 oleg233-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/conf-sanity.*ex': No such file or directory excepting tests: 32b 32c 32newtarball 110 108a 112a 112b 113 117 119 121 122a 123aa 123ab 123ac 123ad 123ae 123af 123ag 123ah 123ahi 123F 123G 123H 126 129 132 133 135 136 137 150 152 153a 153b 153c 155 802a Stopping clients: oleg233-client.virtnet /mnt/lustre (opts:-f) Stopping client oleg233-client.virtnet /mnt/lustre opts:-f Stopping clients: oleg233-client.virtnet /mnt/lustre2 (opts:-f) Stopping /mnt/lustre-mds1 (opts:-f) on oleg233-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg233-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg233-server oleg233-server: oleg233-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg233-server' oleg233-server: oleg233-server.virtnet: executing load_modules_local oleg233-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg233-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg233-server: Loading modules from /home/green/git/lustre-release/lustre oleg233-server: detected 4 online CPUs by sysfs oleg233-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg233-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg233-server: oleg233-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg233-client: oleg233-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg233-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 oleg233-server: oleg233-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg233-client: oleg233-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg233-server: oleg233-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 40 oleg233-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec stop ost1 service on oleg233-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg233-server stop mds service on oleg233-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg233-server == conf-sanity test 45: long unlink handling in ptlrpcd == 17:28:22 (1778534902) start mds service on oleg233-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg233-server: oleg233-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg233-client: oleg233-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg233-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 oleg233-server: oleg233-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg233-client: oleg233-server: ssh exited with exit code 1 Started lustre-OST0000 oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg233-client.virtnet: -o user_xattr,flock oleg233-server@tcp:/lustre /mnt/lustre setup single mount lustre success stop mds service on oleg233-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg233-server sleep 60 sec fail_loc=0x8000050f sleep 10 sec manual umount lustre on /mnt/lustre.... df: /mnt/lustre: Input/output error fail_loc=0x0 start mds service on oleg233-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg233-server: oleg233-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg233-client: oleg233-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg233-client.virtnet: -o user_xattr,flock oleg233-server@tcp:/lustre /mnt/lustre umount lustre on /mnt/lustre..... Stopping client oleg233-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg233-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg233-server stop mds service on oleg233-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg233-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy unloading modules on: 'oleg233-server' oleg233-server: oleg233-server.virtnet: executing unload_modules_local oleg233-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy oleg233-server: LNET ready to unload oleg233-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy modules unloaded. pdsh@oleg233-client: oleg233-client: ssh exited with exit code 2 pdsh@oleg233-client: oleg233-server: ssh exited with exit code 2 pdsh@oleg233-client: oleg233-client: ssh exited with exit code 2 pdsh@oleg233-client: oleg233-server: ssh exited with exit code 2 PASS 45 (191s) == conf-sanity test 69: replace an OST with the same index ========================================================== 17:31:34 (1778535094) start mds service on oleg233-server /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg233-server' oleg233-server: oleg233-server.virtnet: executing load_modules_local oleg233-server: Loading modules from /home/green/git/lustre-release/lustre oleg233-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg233-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg233-server: detected 4 online CPUs by sysfs oleg233-server: Force libcfs to create 2 CPU partitions oleg233-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg233-server: quota/lquota options: 'hash_lqs_cur_bits=3' Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg233-server: oleg233-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg233-client: oleg233-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg233-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 oleg233-server: oleg233-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg233-client: oleg233-server: ssh exited with exit code 1 Started lustre-OST0000 oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg233-client.virtnet: -o user_xattr,flock oleg233-server@tcp:/lustre /mnt/lustre On OST0, 11872 inodes available. Want 99872. rc=0 - open/close 947 (time 1778535152.93 total 10.00 last 94.67) - open/close 1873 (time 1778535162.94 total 20.01 last 92.54) - open/close 2851 (time 1778535172.94 total 30.01 last 97.75) - open/close 3957 (time 1778535182.95 total 40.02 last 110.54) - open/close 4905 (time 1778535192.95 total 50.03 last 94.73) - open/close 5879 (time 1778535202.96 total 60.03 last 97.35) - open/close 7005 (time 1778535212.97 total 70.04 last 112.48) - open/close 8049 (time 1778535222.98 total 80.05 last 104.36) - open/close 8923 (time 1778535232.98 total 90.06 last 87.33) - open/close 9870 (time 1778535242.99 total 100.06 last 94.67) total: 10000 open/close in 101.35 seconds: 98.67 ops/second - unlinked 0 (time 1778535246 ; total 0 ; last 0) total: 10000 unlinks in 50 seconds: 200.000000 unlinks/second - open/close 1065 (time 1778535308.79 total 10.00 last 106.46) - open/close 1986 (time 1778535318.80 total 20.01 last 92.08) - open/close 2806 (time 1778535328.80 total 30.01 last 81.94) - open/close 3788 (time 1778535338.80 total 40.01 last 98.19) - open/close 4920 (time 1778535348.81 total 50.02 last 113.15) - open/close 6058 (time 1778535358.81 total 60.02 last 113.76) - open/close 7068 (time 1778535368.82 total 70.03 last 100.92) - open/close 8074 (time 1778535378.83 total 80.04 last 100.47) - open/close 9121 (time 1778535388.84 total 90.05 last 104.63) total: 10000 open/close in 98.88 seconds: 101.14 ops/second - unlinked 0 (time 1778535400 ; total 0 ; last 0) total: 10000 unlinks in 58 seconds: 172.413788 unlinks/second - open/close 1057 (time 1778535471.14 total 10.01 last 105.59) - open/close 2062 (time 1778535481.15 total 20.02 last 100.41) - open/close 3087 (time 1778535491.16 total 30.03 last 102.38) - open/close 4093 (time 1778535501.17 total 40.04 last 100.52) - open/close 5136 (time 1778535511.17 total 50.04 last 104.29) - open/close 6133 (time 1778535521.18 total 60.05 last 99.64) - open/close 7243 (time 1778535531.18 total 70.05 last 110.91) - open/close 8169 (time 1778535541.19 total 80.06 last 92.56) - open/close 9089 (time 1778535551.19 total 90.06 last 91.98) total: 10000 open/close in 99.78 seconds: 100.22 ops/second - unlinked 0 (time 1778535564 ; total 0 ; last 0) total: 10000 unlinks in 54 seconds: 185.185181 unlinks/second - open/close 1212 (time 1778535631.17 total 10.01 last 121.10) - open/close 2239 (time 1778535641.17 total 20.01 last 102.66) - open/close 3330 (time 1778535651.17 total 30.01 last 109.09) - open/close 4415 (time 1778535661.18 total 40.02 last 108.44) - open/close 5523 (time 1778535671.18 total 50.02 last 110.76) - open/close 6629 (time 1778535681.19 total 60.02 last 110.57) - open/close 7827 (time 1778535691.19 total 70.03 last 119.77) - open/close 9002 (time 1778535701.20 total 80.03 last 117.40) total: 10000 open/close in 88.86 seconds: 112.54 ops/second - unlinked 0 (time 1778535712 ; total 0 ; last 0) total: 10000 unlinks in 49 seconds: 204.081635 unlinks/second - open/close 1146 (time 1778535773.32 total 10.02 last 114.33) - open/close 2245 (time 1778535783.32 total 20.02 last 109.89) - open/close 3439 (time 1778535793.32 total 30.03 last 119.39) - open/close 4545 (time 1778535803.33 total 40.03 last 110.54) - open/close 5674 (time 1778535813.33 total 50.04 last 112.84) - open/close 6762 (time 1778535823.34 total 60.04 last 108.74) - open/close 7963 (time 1778535833.34 total 70.04 last 120.07) - open/close 9254 (time 1778535843.37 total 80.07 last 128.71) total: 10000 open/close in 87.10 seconds: 114.81 ops/second - unlinked 0 (time 1778535852 ; total 0 ; last 0) total: 10000 unlinks in 47 seconds: 212.765961 unlinks/second - open/close 1285 (time 1778535912.08 total 10.00 last 128.48) - open/close 2538 (time 1778535922.08 total 20.01 last 125.26) - open/close 3723 (time 1778535932.09 total 30.01 last 118.48) - open/close 5017 (time 1778535942.09 total 40.01 last 129.39) - open/close 6374 (time 1778535952.09 total 50.01 last 135.61) - open/close 8226 (time 1778535962.10 total 60.02 last 185.11) - open/close 9901 (time 1778535972.10 total 70.02 last 167.47) total: 10000 open/close in 70.66 seconds: 141.52 ops/second - unlinked 0 (time 1778535974 ; total 0 ; last 0) total: 10000 unlinks in 34 seconds: 294.117645 unlinks/second - open/close 1731 (time 1778536020.01 total 10.00 last 173.06) - open/close 3170 (time 1778536030.02 total 20.01 last 143.86) - open/close 4604 (time 1778536040.02 total 30.01 last 143.36) - open/close 5983 (time 1778536050.02 total 40.01 last 137.86) - open/close 7449 (time 1778536060.02 total 50.01 last 146.58) - open/close 8840 (time 1778536070.02 total 60.01 last 139.10) total: 10000 open/close in 69.12 seconds: 144.69 ops/second - unlinked 0 (time 1778536081 ; total 0 ; last 0) total: 10000 unlinks in 36 seconds: 277.777771 unlinks/second - open/close 1403 (time 1778536130.16 total 10.00 last 140.24) - open/close 2956 (time 1778536140.17 total 20.01 last 155.26) - open/close 4573 (time 1778536150.17 total 30.01 last 161.62) - open/close 6113 (time 1778536160.17 total 40.02 last 153.95) - open/close 8004 (time 1778536170.18 total 50.02 last 189.03) - open/close 9789 (time 1778536180.18 total 60.02 last 178.47) total: 10000 open/close in 60.96 seconds: 164.05 ops/second - unlinked 0 (time 1778536182 ; total 0 ; last 0) total: 10000 unlinks in 23 seconds: 434.782623 unlinks/second - open/close 2121 (time 1778536217.38 total 10.01 last 211.98) - open/close 4634 (time 1778536227.38 total 20.01 last 251.26) - open/close 6824 (time 1778536237.38 total 30.01 last 219.00) - open/close 9579 (time 1778536247.39 total 40.01 last 275.37) total: 10000 open/close in 42.42 seconds: 235.75 ops/second - unlinked 0 (time 1778536251 ; total 0 ; last 0) total: 10000 unlinks in 22 seconds: 454.545441 unlinks/second - open/close 2746 (time 1778536284.89 total 10.01 last 274.44) - open/close 5472 (time 1778536294.89 total 20.01 last 272.55) - open/close 7698 (time 1778536304.90 total 30.02 last 222.43) total: 10000 open/close in 38.87 seconds: 257.25 ops/second - unlinked 0 (time 1778536315 ; total 0 ; last 0) total: 10000 unlinks in 19 seconds: 526.315796 unlinks/second rm: missing operand Try 'rm --help' for more information. umount lustre on /mnt/lustre..... Stopping client oleg233-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg233-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg233-server Permanent disk data: Target: lustre-OST0000 Index: 0 Lustre FS: lustre Mount type: zfs Flags: 0x42 (OST update ) Persistent mount opts: Parameters: mgsnode=192.168.202.133@tcp sys.timeout=20 autodegrade=on mkfs_cmd = zpool create -o feature@longname=disabled -f -O canmount=off lustre-ost1 /dev/vde mkfs_cmd = zfs create -o canmount=off -o quota=409600000 lustre-ost1/ost1 xattr=sa dnodesize=auto recordsize=1M compression=off Writing lustre-ost1/ost1 properties lustre:mgsnode=192.168.202.133@tcp lustre:sys.timeout=20 lustre:autodegrade=on lustre:version=1 lustre:flags=66 lustre:index=0 lustre:fsname=lustre lustre:svname=lustre-OST0000 start ost1 service on oleg233-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 oleg233-server: oleg233-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg233-client: oleg233-server: ssh exited with exit code 1 Started lustre-OST0000 oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid oleg233-server: oleg233-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 40 oleg233-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec mount lustre on /mnt/lustre..... Starting client: oleg233-client.virtnet: -o user_xattr,flock oleg233-server@tcp:/lustre /mnt/lustre On OST0, 10357 used inodes rc=0 umount lustre on /mnt/lustre..... Stopping client oleg233-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg233-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg233-server stop mds service on oleg233-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg233-server /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy unloading modules on: 'oleg233-server' oleg233-server: oleg233-server.virtnet: executing unload_modules_local oleg233-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy oleg233-server: LNET ready to unload oleg233-server: /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy modules unloaded. pdsh@oleg233-client: oleg233-client: ssh exited with exit code 2 pdsh@oleg233-client: oleg233-server: ssh exited with exit code 2 pdsh@oleg233-client: oleg233-client: ssh exited with exit code 2 pdsh@oleg233-client: oleg233-server: ssh exited with exit code 2 PASS 69 (1329s) == conf-sanity test 111: Adding large_dir with over 2GB directory ========================================================== 17:53:44 (1778536424) SKIP: conf-sanity test_111 Only applicable to ldiskfs-based MDTs SKIP 111 (3s) Stopping clients: oleg233-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg233-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg233-client: oleg233-server: ssh exited with exit code 2 oleg233-server: oleg233-server.virtnet: executing set_hostid /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg233-server' oleg233-server: oleg233-server.virtnet: executing load_modules_local oleg233-server: Loading modules from /home/green/git/lustre-release/lustre oleg233-server: detected 4 online CPUs by sysfs oleg233-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg233-server: Force libcfs to create 2 CPU partitions oleg233-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg233-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg233-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 == conf-sanity test complete, duration 1694 sec ========== 17:54:41 (1778536481)