== conf-sanity test 122b: Check OST sequence wouldn't change when IDIF 32bit overflows ========================================================== 11:49:06 (1737132546) Stopping clients: oleg445-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg445-client.virtnet /mnt/lustre2 (opts:-f) oleg445-server: oleg445-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg445-server' oleg445-server: oleg445-server.virtnet: executing load_modules_local oleg445-server: Loading modules from /home/green/git/lustre-release/lustre oleg445-server: detected 4 online CPUs by sysfs oleg445-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg445-server' oleg445-server: oleg445-server.virtnet: executing load_modules_local oleg445-server: Loading modules from /home/green/git/lustre-release/lustre oleg445-server: detected 4 online CPUs by sysfs oleg445-server: Force libcfs to create 2 CPU partitions fail_loc=0x00001e0 start mds service on oleg445-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg445-server: oleg445-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg445-client: oleg445-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg445-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg445-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 oleg445-server: oleg445-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg445-client: oleg445-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg445-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg445-client.virtnet: -o user_xattr,flock oleg445-server@tcp:/lustre /mnt/lustre obdfilter.lustre-OST0000.precreate_batch=256 fail_loc=0 On OST0, 11872 inodes available. Want 100500. rc=0 - open/close 3533 (time 1737132587.84 total 10.00 last 353.29) - open/close 8852 (time 1737132597.85 total 20.00 last 531.85) total: 10000 open/close in 22.64 seconds: 441.67 ops/second - unlinked 0 (time 1737132601 ; total 0 ; last 0) total: 10000 unlinks in 41 seconds: 243.902435 unlinks/second - open/close 1858 (time 1737132654.66 total 10.00 last 185.79) - open/close 3412 (time 1737132664.66 total 20.00 last 155.40) - open/close 5331 (time 1737132674.67 total 30.00 last 191.82) - open/close 6551 (time 1737132684.68 total 40.01 last 121.88) - open/close 7600 (time 1737132694.68 total 50.02 last 104.88) - open/close 8887 (time 1737132704.69 total 60.02 last 128.60) total: 10000 open/close in 67.98 seconds: 147.10 ops/second - unlinked 0 (time 1737132714 ; total 0 ; last 0) total: 10000 unlinks in 24 seconds: 416.666656 unlinks/second - open/close 2967 (time 1737132749.01 total 10.00 last 296.67) - open/close 5483 (time 1737132759.01 total 20.01 last 251.47) - open/close 7167 (time 1737132769.02 total 30.01 last 168.30) - open/close 9441 (time 1737132779.02 total 40.01 last 227.35) total: 10000 open/close in 41.86 seconds: 238.90 ops/second - unlinked 0 (time 1737132781 ; total 0 ; last 0) total: 10000 unlinks in 15 seconds: 666.666687 unlinks/second - open/close 3538 (time 1737132807.60 total 10.00 last 353.77) - open/close 7862 (time 1737132817.60 total 20.00 last 432.36) total: 10000 open/close in 25.23 seconds: 396.41 ops/second - unlinked 0 (time 1737132823 ; total 0 ; last 0) total: 10000 unlinks in 12 seconds: 833.333313 unlinks/second - open/close 5361 (time 1737132846.62 total 10.00 last 536.08) total: 10000 open/close in 17.33 seconds: 577.18 ops/second - unlinked 0 (time 1737132854 ; total 0 ; last 0) total: 10000 unlinks in 10 seconds: 1000.000000 unlinks/second - open/close 5758 (time 1737132875.22 total 10.00 last 575.76) total: 10000 open/close in 17.44 seconds: 573.30 ops/second - unlinked 0 (time 1737132883 ; total 0 ; last 0) total: 10000 unlinks in 10 seconds: 1000.000000 unlinks/second - open/close 6029 (time 1737132903.87 total 10.00 last 602.88) total: 10000 open/close in 16.93 seconds: 590.82 ops/second - unlinked 0 (time 1737132911 ; total 0 ; last 0) total: 10000 unlinks in 10 seconds: 1000.000000 unlinks/second - open/close 4749 (time 1737132932.10 total 10.00 last 474.80) total: 10000 open/close in 19.31 seconds: 517.79 ops/second - unlinked 0 (time 1737132942 ; total 0 ; last 0) total: 10000 unlinks in 11 seconds: 909.090881 unlinks/second - open/close 5594 (time 1737132964.38 total 10.00 last 559.35) total: 10000 open/close in 18.37 seconds: 544.26 ops/second - unlinked 0 (time 1737132973 ; total 0 ; last 0) total: 10000 unlinks in 10 seconds: 1000.000000 unlinks/second - open/close 5106 (time 1737132994.35 total 10.00 last 510.53) total: 10000 open/close in 18.97 seconds: 527.05 ops/second - unlinked 0 (time 1737133004 ; total 0 ; last 0) total: 10000 unlinks in 10 seconds: 1000.000000 unlinks/second - open/close 5773 (time 1737133025.34 total 10.00 last 577.20) total: 10000 open/close in 17.58 seconds: 568.84 ops/second - unlinked 0 (time 1737133033 ; total 0 ; last 0) total: 10000 unlinks in 10 seconds: 1000.000000 unlinks/second UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 383616 6272 375296 2% /mnt/lustre[MDT:0] lustre-OST0000_UUID 382976 4096 376832 2% /mnt/lustre[OST:0] filesystem_summary: 382976 4096 376832 2% /mnt/lustre 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.113641 s, 9.2 MB/s fail_loc=0x80000204 Failing ost1 on oleg445-server Stopping /mnt/lustre-ost1 (opts:) on oleg445-server reboot facets: ost1 Failover ost1 to oleg445-server mount facets: ost1 Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 oleg445-server: oleg445-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg445-client: oleg445-server: ssh exited with exit code 1 Started lustre-OST0000 oleg445-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec - open/close 0 (time 1737133071.41 total 5.16 last 0.00) total: 100 open/close in 5.60 seconds: 17.85 ops/second umount lustre on /mnt/lustre..... Stopping client oleg445-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg445-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg445-server stop mds service on oleg445-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg445-server LNET ready to unload unloading modules on: 'oleg445-server' oleg445-server: oleg445-server.virtnet: executing unload_modules_local oleg445-server: LNET ready to unload modules unloaded.