== conf-sanity test 122b: Check OST sequence wouldn't change when IDIF 32bit overflows ========================================================== 06:09:06 (1721383746) Stopping clients: oleg432-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg432-client.virtnet /mnt/lustre2 (opts:-f) oleg432-server: oleg432-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg432-server' oleg432-server: oleg432-server.virtnet: executing load_modules_local oleg432-server: Loading modules from /home/green/git/lustre-release/lustre oleg432-server: detected 4 online CPUs by sysfs oleg432-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg432-server' oleg432-server: oleg432-server.virtnet: executing load_modules_local oleg432-server: Loading modules from /home/green/git/lustre-release/lustre oleg432-server: detected 4 online CPUs by sysfs oleg432-server: Force libcfs to create 2 CPU partitions fail_loc=0x00001e0 start mds service on oleg432-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg432-server: oleg432-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg432-client: oleg432-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg432-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg432-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 oleg432-server: oleg432-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg432-client: oleg432-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg432-client.virtnet: -o user_xattr,flock oleg432-server@tcp:/lustre /mnt/lustre obdfilter.lustre-OST0000.precreate_batch=256 fail_loc=0 On OST0, 11872 inodes available. Want 100500. rc=0 - open/close 5684 (time 1721383786.04 total 10.00 last 568.34) total: 10000 open/close in 18.10 seconds: 552.38 ops/second - unlinked 0 (time 1721383795 ; total 0 ; last 0) total: 10000 unlinks in 10 seconds: 1000.000000 unlinks/second - open/close 5379 (time 1721383816.43 total 10.00 last 537.88) total: 10000 open/close in 18.77 seconds: 532.69 ops/second - unlinked 0 (time 1721383826 ; total 0 ; last 0) total: 10000 unlinks in 10 seconds: 1000.000000 unlinks/second - open/close 5262 (time 1721383847.81 total 10.00 last 526.16) total: 10000 open/close in 18.96 seconds: 527.53 ops/second - unlinked 0 (time 1721383857 ; total 0 ; last 0) total: 10000 unlinks in 11 seconds: 909.090881 unlinks/second - open/close 5212 (time 1721383879.56 total 10.00 last 521.12) total: 10000 open/close in 18.94 seconds: 527.85 ops/second - unlinked 0 (time 1721383889 ; total 0 ; last 0) total: 10000 unlinks in 11 seconds: 909.090881 unlinks/second - open/close 5516 (time 1721383910.87 total 10.00 last 551.53) total: 10000 open/close in 18.17 seconds: 550.50 ops/second - unlinked 0 (time 1721383919 ; total 0 ; last 0) total: 10000 unlinks in 11 seconds: 909.090881 unlinks/second - open/close 5554 (time 1721383941.25 total 10.00 last 555.30) total: 10000 open/close in 18.71 seconds: 534.38 ops/second - unlinked 0 (time 1721383950 ; total 0 ; last 0) total: 10000 unlinks in 11 seconds: 909.090881 unlinks/second - open/close 5525 (time 1721383972.47 total 10.00 last 552.44) total: 10000 open/close in 18.28 seconds: 546.96 ops/second - unlinked 0 (time 1721383981 ; total 0 ; last 0) total: 10000 unlinks in 11 seconds: 909.090881 unlinks/second - open/close 5328 (time 1721384002.96 total 10.00 last 532.78) total: 10000 open/close in 18.62 seconds: 537.08 ops/second - unlinked 0 (time 1721384012 ; total 0 ; last 0) total: 10000 unlinks in 10 seconds: 1000.000000 unlinks/second - open/close 5725 (time 1721384033.33 total 10.00 last 572.48) total: 10000 open/close in 18.04 seconds: 554.23 ops/second - unlinked 0 (time 1721384042 ; total 0 ; last 0) total: 10000 unlinks in 10 seconds: 1000.000000 unlinks/second - open/close 4922 (time 1721384063.71 total 10.00 last 492.10) - open/close 9224 (time 1721384073.71 total 20.00 last 430.11) total: 10000 open/close in 21.96 seconds: 455.33 ops/second - unlinked 0 (time 1721384076 ; total 0 ; last 0) total: 10000 unlinks in 11 seconds: 909.090881 unlinks/second - open/close 5467 (time 1721384098.09 total 10.00 last 546.70) total: 10000 open/close in 18.53 seconds: 539.77 ops/second - unlinked 0 (time 1721384107 ; total 0 ; last 0) total: 10000 unlinks in 10 seconds: 1000.000000 unlinks/second UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 383616 6400 375168 2% /mnt/lustre[MDT:0] lustre-OST0000_UUID 382976 4096 376832 2% /mnt/lustre[OST:0] filesystem_summary: 382976 4096 376832 2% /mnt/lustre 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0969456 s, 10.8 MB/s fail_loc=0x80000204 Failing ost1 on oleg432-server Stopping /mnt/lustre-ost1 (opts:) on oleg432-server reboot facets: ost1 Failover ost1 to oleg432-server mount facets: ost1 Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 oleg432-server: oleg432-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg432-client: oleg432-server: ssh exited with exit code 1 Started lustre-OST0000 oleg432-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec - open/close 0 (time 1721384147.92 total 5.53 last 0.00) total: 100 open/close in 5.98 seconds: 16.73 ops/second umount lustre on /mnt/lustre..... Stopping client oleg432-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg432-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg432-server stop mds service on oleg432-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg432-server LNET ready to unload unloading modules on: 'oleg432-server' oleg432-server: oleg432-server.virtnet: executing unload_modules_local oleg432-server: LNET ready to unload modules unloaded.