== conf-sanity test 122b: Check OST sequence wouldn't change when IDIF 32bit overflows ========================================================== 20:16:30 (1718928990) Stopping clients: oleg123-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg123-client.virtnet /mnt/lustre2 (opts:-f) oleg123-server: oleg123-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg123-server' oleg123-server: oleg123-server.virtnet: executing load_modules_local oleg123-server: Loading modules from /home/green/git/lustre-release/lustre oleg123-server: detected 4 online CPUs by sysfs oleg123-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg123-server' oleg123-server: oleg123-server.virtnet: executing load_modules_local oleg123-server: Loading modules from /home/green/git/lustre-release/lustre oleg123-server: detected 4 online CPUs by sysfs oleg123-server: Force libcfs to create 2 CPU partitions oleg123-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory fail_loc=0x00001e0 start mds service on oleg123-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg123-server: oleg123-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg123-client: oleg123-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg123-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg123-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 oleg123-server: oleg123-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg123-client: oleg123-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg123-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg123-client.virtnet: -o user_xattr,flock oleg123-server@tcp:/lustre /mnt/lustre obdfilter.lustre-OST0000.precreate_batch=256 fail_loc=0 On OST0, 11872 inodes available. Want 100500. rc=0 - open/close 4803 (time 1718929039.72 total 10.00 last 480.27) - open/close 8386 (time 1718929049.72 total 20.00 last 358.18) total: 10000 open/close in 25.35 seconds: 394.48 ops/second - unlinked 0 (time 1718929056 ; total 0 ; last 0) total: 10000 unlinks in 10 seconds: 1000.000000 unlinks/second - open/close 5182 (time 1718929077.19 total 10.00 last 518.13) - open/close 8827 (time 1718929087.19 total 20.00 last 364.47) total: 10000 open/close in 22.45 seconds: 445.43 ops/second - unlinked 0 (time 1718929090 ; total 0 ; last 0) total: 10000 unlinks in 11 seconds: 909.090881 unlinks/second - open/close 4440 (time 1718929112.19 total 10.00 last 443.92) - open/close 9844 (time 1718929122.19 total 20.00 last 540.34) total: 10000 open/close in 20.31 seconds: 492.48 ops/second - unlinked 0 (time 1718929123 ; total 0 ; last 0) total: 10000 unlinks in 10 seconds: 1000.000000 unlinks/second - open/close 5228 (time 1718929144.20 total 10.00 last 522.74) total: 10000 open/close in 18.89 seconds: 529.32 ops/second - unlinked 0 (time 1718929153 ; total 0 ; last 0) total: 10000 unlinks in 12 seconds: 833.333313 unlinks/second - open/close 5439 (time 1718929176.03 total 10.00 last 543.81) total: 10000 open/close in 18.86 seconds: 530.28 ops/second - unlinked 0 (time 1718929185 ; total 0 ; last 0) total: 10000 unlinks in 10 seconds: 1000.000000 unlinks/second - open/close 5245 (time 1718929206.14 total 10.00 last 524.46) total: 10000 open/close in 18.76 seconds: 533.13 ops/second - unlinked 0 (time 1718929215 ; total 0 ; last 0) total: 10000 unlinks in 10 seconds: 1000.000000 unlinks/second - open/close 4665 (time 1718929236.61 total 10.00 last 466.45) - open/close 8816 (time 1718929246.61 total 20.00 last 415.08) total: 10000 open/close in 23.04 seconds: 433.95 ops/second - unlinked 0 (time 1718929250 ; total 0 ; last 0) total: 10000 unlinks in 12 seconds: 833.333313 unlinks/second - open/close 3289 (time 1718929273.64 total 10.00 last 328.88) - open/close 6264 (time 1718929283.64 total 20.00 last 297.38) - open/close 9192 (time 1718929293.64 total 30.01 last 292.75) total: 10000 open/close in 32.48 seconds: 307.87 ops/second - unlinked 0 (time 1718929297 ; total 0 ; last 0) total: 10000 unlinks in 14 seconds: 714.285706 unlinks/second - open/close 4195 (time 1718929322.42 total 10.00 last 419.47) - open/close 8123 (time 1718929332.42 total 20.00 last 392.74) total: 10000 open/close in 26.40 seconds: 378.74 ops/second - unlinked 0 (time 1718929340 ; total 0 ; last 0) total: 10000 unlinks in 14 seconds: 714.285706 unlinks/second - open/close 4969 (time 1718929365.14 total 10.00 last 496.85) - open/close 9800 (time 1718929375.14 total 20.00 last 483.03) total: 10000 open/close in 20.41 seconds: 489.91 ops/second - unlinked 0 (time 1718929376 ; total 0 ; last 0) total: 10000 unlinks in 15 seconds: 666.666687 unlinks/second - open/close 3123 (time 1718929402.65 total 10.00 last 312.22) - open/close 5868 (time 1718929412.66 total 20.00 last 274.46) - open/close 8627 (time 1718929422.66 total 30.00 last 275.87) total: 10000 open/close in 33.74 seconds: 296.37 ops/second - unlinked 0 (time 1718929427 ; total 0 ; last 0) total: 10000 unlinks in 18 seconds: 555.555542 unlinks/second UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 383616 6144 375424 2% /mnt/lustre[MDT:0] lustre-OST0000_UUID 382976 4096 376832 2% /mnt/lustre[OST:0] filesystem_summary: 382976 4096 376832 2% /mnt/lustre 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.19695 s, 5.3 MB/s fail_loc=0x80000204 Failing ost1 on oleg123-server Stopping /mnt/lustre-ost1 (opts:) on oleg123-server reboot facets: ost1 Failover ost1 to oleg123-server mount facets: ost1 Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 oleg123-server: oleg123-server.virtnet: executing set_default_debug -1 all 8 pdsh@oleg123-client: oleg123-server: ssh exited with exit code 1 Started lustre-OST0000 oleg123-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec - open/close 0 (time 1718929477.55 total 4.56 last 0.00) total: 100 open/close in 5.22 seconds: 19.16 ops/second umount lustre on /mnt/lustre..... Stopping client oleg123-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg123-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg123-server stop mds service on oleg123-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg123-server LNET ready to unload unloading modules on: 'oleg123-server' oleg123-server: oleg123-server.virtnet: executing unload_modules_local oleg123-server: LNET ready to unload modules unloaded.