[ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Initializing cgroup subsys cpuacct [ 0.000000] Linux version 3.10.0-7.9-debug (green@centos7-base) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-44) (GCC) ) #1 SMP Sat Mar 26 23:28:42 EDT 2022 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:centos7:ext4:ro:-p,-b4096 ro crashkernel=128M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] e820: BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000013edfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0.0 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.3-2.fc40 04/01/2014 [ 0.000000] Hypervisor detected: KVM [ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved [ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable [ 0.000000] e820: last_pfn = 0x13ee00 max_arch_pfn = 0x400000000 [ 0.000000] MTRR default type: write-back [ 0.000000] MTRR fixed ranges enabled: [ 0.000000] 00000-9FFFF write-back [ 0.000000] A0000-BFFFF uncachable [ 0.000000] C0000-FFFFF write-protect [ 0.000000] MTRR variable ranges enabled: [ 0.000000] 0 base 0000C0000000 mask 3FFFC0000000 uncachable [ 0.000000] 1 disabled [ 0.000000] 2 disabled [ 0.000000] 3 disabled [ 0.000000] 4 disabled [ 0.000000] 5 disabled [ 0.000000] 6 disabled [ 0.000000] 7 disabled [ 0.000000] PAT configuration [0-7]: WB WC UC- UC WB WP UC- UC [ 0.000000] e820: last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f53f0-0x000f53ff] mapped at [ffffffffff2003f0] [ 0.000000] Base memory trampoline at [ffff880000099000] 99000 size 24576 [ 0.000000] Using GB pages for direct mapping [ 0.000000] BRK [0x023c1000, 0x023c1fff] PGTABLE [ 0.000000] BRK [0x023c2000, 0x023c2fff] PGTABLE [ 0.000000] BRK [0x023c3000, 0x023c3fff] PGTABLE [ 0.000000] BRK [0x023c4000, 0x023c4fff] PGTABLE [ 0.000000] BRK [0x023c5000, 0x023c5fff] PGTABLE [ 0.000000] BRK [0x023c6000, 0x023c6fff] PGTABLE [ 0.000000] RAMDISK: [mem 0xbc2e2000-0xbffbffff] [ 0.000000] Early table checksum verification disabled [ 0.000000] ACPI: RSDP 00000000000f5200 00014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 00000000bffe1d87 00034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 00000000bffe1c23 00074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 00000000bffe0040 01BE3 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 00000000bffe0000 00040 [ 0.000000] ACPI: APIC 00000000bffe1c97 00090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 00000000bffe1d27 00038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 00000000bffe1d5f 00028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000013edfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x13e5e3000-0x13e609fff] [ 0.000000] Reserving 128MB of memory at 768MB for crashkernel (System RAM: 4077MB) [ 0.000000] kvm-clock: cpu 0, msr 1:3e592001, primary cpu clock [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 442672740 cycles [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x00001000-0x00ffffff] [ 0.000000] DMA32 [mem 0x01000000-0xffffffff] [ 0.000000] Normal [mem 0x100000000-0x13edfffff] [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x00001000-0x0009efff] [ 0.000000] node 0: [mem 0x00100000-0xbffcdfff] [ 0.000000] node 0: [mem 0x100000000-0x13edfffff] [ 0.000000] Initmem setup node 0 [mem 0x00001000-0x13edfffff] [ 0.000000] On node 0 totalpages: 1043820 [ 0.000000] DMA zone: 64 pages used for memmap [ 0.000000] DMA zone: 21 pages reserved [ 0.000000] DMA zone: 3998 pages, LIFO batch:0 [ 0.000000] DMA32 zone: 12224 pages used for memmap [ 0.000000] DMA32 zone: 782286 pages, LIFO batch:31 [ 0.000000] Normal zone: 4024 pages used for memmap [ 0.000000] Normal zone: 257536 pages, LIFO batch:31 [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] enabled) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] ACPI: IRQ0 used by override. [ 0.000000] ACPI: IRQ5 used by override. [ 0.000000] ACPI: IRQ9 used by override. [ 0.000000] ACPI: IRQ10 used by override. [ 0.000000] ACPI: IRQ11 used by override. [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] e820: [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 38 pages/cpu s115176 r8192 d32280 u524288 [ 0.000000] pcpu-alloc: s115176 r8192 d32280 u524288 alloc=1*2097152 [ 0.000000] pcpu-alloc: [0] 0 1 2 3 [ 0.000000] KVM setup async PF for cpu 0 [ 0.000000] kvm-stealtime: cpu 0, msr 13e2135c0 [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes) [ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 1027487 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:centos7:ext4:ro:-p,-b4096 ro crashkernel=128M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] audit: disabled (until reboot) [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) [ 0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100 [ 0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form [ 0.000000] Memory: 3820268k/5224448k available (8172k kernel code, 1049168k absent, 355012k reserved, 5773k data, 2532k init) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] Hierarchical RCU implementation. [ 0.000000] RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=4. [ 0.000000] Offload RCU callbacks from all CPUs [ 0.000000] Offload RCU callbacks from CPUs: 0-3. [ 0.000000] NR_IRQS:327936 nr_irqs:456 0 [ 0.000000] Console: colour *CGA 80x25 [ 0.000000] console [ttyS1] enabled [ 0.000000] allocated 25165824 bytes of page_cgroup [ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ODEBUG: 73 of 73 active objects replaced [ 0.000000] hpet clockevent registered [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.505483] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.510296] pid_max: default: 32768 minimum: 301 [ 0.512365] Security Framework initialized [ 0.513770] SELinux: Initializing. [ 0.514803] SELinux: Starting in permissive mode [ 0.516674] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes) [ 0.521825] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes) [ 0.526765] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes) [ 0.529384] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes) [ 0.532786] Initializing cgroup subsys memory [ 0.534483] Initializing cgroup subsys devices [ 0.536177] Initializing cgroup subsys freezer [ 0.537758] Initializing cgroup subsys net_cls [ 0.539569] Initializing cgroup subsys blkio [ 0.540755] Initializing cgroup subsys perf_event [ 0.542327] Initializing cgroup subsys hugetlb [ 0.543540] Initializing cgroup subsys pids [ 0.545341] Initializing cgroup subsys net_prio [ 0.547320] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.550226] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.551763] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.553372] tlb_flushall_shift: 6 [ 0.554613] FEATURE SPEC_CTRL Present [ 0.555644] FEATURE IBPB_SUPPORT Present [ 0.557368] Spectre V2 : Enabling Indirect Branch Prediction Barrier [ 0.560544] Spectre V2 : Vulnerable [ 0.561506] Speculative Store Bypass: Vulnerable [ 0.564028] debug: unmapping init [mem 0xffffffff82019000-0xffffffff8201ffff] [ 0.572410] ACPI: Core revision 20130517 [ 0.575692] ACPI: All ACPI Tables successfully acquired [ 0.578166] ftrace: allocating 30294 entries in 119 pages [ 0.639957] Enabling x2apic [ 0.641286] Enabled x2apic [ 0.643367] Switched APIC routing to physical x2apic. [ 0.647973] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.650441] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (fam: 06, model: 3e, stepping: 04) [ 0.655298] TSC deadline timer enabled [ 0.655528] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.658698] ... version: 2 [ 0.660917] ... bit width: 48 [ 0.662564] ... generic registers: 4 [ 0.664374] ... value mask: 0000ffffffffffff [ 0.665997] ... max period: 00007fffffffffff [ 0.668288] ... fixed-purpose events: 3 [ 0.669929] ... event mask: 000000070000000f [ 0.672112] KVM setup paravirtual spinlock [ 0.678801] kvm-clock: cpu 1, msr 1:3e592041, secondary cpu clock [ 0.685816] KVM setup async PF for cpu 1 [ 0.688903] kvm-stealtime: cpu 1, msr 13e2935c0 [ 0.695742] kvm-clock: cpu 2, msr 1:3e592081, secondary cpu clock [ 0.675972] smpboot: Booting Node 0, Processors #1 #2 #3 OK [ 0.702795] KVM setup async PF for cpu 2 [ 0.703844] kvm-stealtime: cpu 2, msr 13e3135c0 [ 0.705348] kvm-clock: cpu 3, msr 1:3e5920c1, secondary cpu clock [ 0.707307] Brought up 4 CPUs [ 0.707641] KVM setup async PF for cpu 3 [ 0.707649] kvm-stealtime: cpu 3, msr 13e3935c0 [ 0.712030] smpboot: Max logical packages: 1 [ 0.713622] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.720334] devtmpfs: initialized [ 0.722139] x86/mm: Memory block size: 128MB [ 0.727437] EVM: security.selinux [ 0.728868] EVM: security.ima [ 0.730032] EVM: security.capability [ 0.737553] atomic64 test passed for x86-64 platform with CX8 and with SSE [ 0.740039] NET: Registered protocol family 16 [ 0.742068] cpuidle: using governor haltpoll [ 0.744204] ACPI: bus type PCI registered [ 0.745466] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.748730] PCI: Using configuration type 1 for base access [ 0.751101] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.764290] ACPI: Added _OSI(Module Device) [ 0.765991] ACPI: Added _OSI(Processor Device) [ 0.767810] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.769866] ACPI: Added _OSI(Processor Aggregator Device) [ 0.771643] ACPI: Added _OSI(Linux-Dell-Video) [ 0.773922] ACPI: EC: Look up EC in DSDT [ 0.776509] ACPI: Interpreter enabled [ 0.777647] ACPI: (supports S0 S3 S4 S5) [ 0.778397] ACPI: Using IOAPIC for interrupt routing [ 0.779444] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.782104] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.789322] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.791342] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI] [ 0.793247] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM [ 0.795412] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.800108] acpiphp: Slot [2] registered [ 0.801746] acpiphp: Slot [5] registered [ 0.803084] acpiphp: Slot [6] registered [ 0.804265] acpiphp: Slot [7] registered [ 0.805361] acpiphp: Slot [8] registered [ 0.806715] acpiphp: Slot [9] registered [ 0.808267] acpiphp: Slot [10] registered [ 0.810019] acpiphp: Slot [3] registered [ 0.812949] acpiphp: Slot [4] registered [ 0.814740] acpiphp: Slot [11] registered [ 0.815786] acpiphp: Slot [12] registered [ 0.817294] acpiphp: Slot [13] registered [ 0.818893] acpiphp: Slot [14] registered [ 0.820474] acpiphp: Slot [15] registered [ 0.821906] acpiphp: Slot [16] registered [ 0.823382] acpiphp: Slot [17] registered [ 0.824842] acpiphp: Slot [18] registered [ 0.826502] acpiphp: Slot [19] registered [ 0.827846] acpiphp: Slot [20] registered [ 0.829302] acpiphp: Slot [21] registered [ 0.830747] acpiphp: Slot [22] registered [ 0.833657] acpiphp: Slot [23] registered [ 0.834988] acpiphp: Slot [24] registered [ 0.836550] acpiphp: Slot [25] registered [ 0.838113] acpiphp: Slot [26] registered [ 0.839681] acpiphp: Slot [27] registered [ 0.841172] acpiphp: Slot [28] registered [ 0.843661] acpiphp: Slot [29] registered [ 0.845166] acpiphp: Slot [30] registered [ 0.846384] acpiphp: Slot [31] registered [ 0.847768] PCI host bridge to bus 0000:00 [ 0.850251] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.852101] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.854301] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.856779] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.859504] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window] [ 0.861976] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.863878] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.864651] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.865571] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.873730] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.875821] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.878126] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.880366] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.882905] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.887604] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.888356] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.890880] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.894269] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.897623] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.909910] pci 0000:00:02.0: reg 0x20: [mem 0x380000000000-0x380000003fff 64bit pref] [ 0.912545] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.914019] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.930969] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.934332] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.949427] pci 0000:00:05.0: reg 0x20: [mem 0x380000004000-0x380000007fff 64bit pref] [ 0.957262] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.962561] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.966233] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.983871] pci 0000:00:06.0: reg 0x20: [mem 0x380000008000-0x38000000bfff 64bit pref] [ 0.992351] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.995825] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 1.000057] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 1.013645] pci 0000:00:07.0: reg 0x20: [mem 0x38000000c000-0x38000000ffff 64bit pref] [ 1.020838] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 1.024002] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 1.027077] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 1.040186] pci 0000:00:08.0: reg 0x20: [mem 0x380000010000-0x380000013fff 64bit pref] [ 1.048550] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 1.053970] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 1.059267] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 1.074392] pci 0000:00:09.0: reg 0x20: [mem 0x380000014000-0x380000017fff 64bit pref] [ 1.080831] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 1.087377] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 1.090831] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 1.103955] pci 0000:00:0a.0: reg 0x20: [mem 0x380000018000-0x38000001bfff 64bit pref] [ 1.110924] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11) [ 1.114624] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11) [ 1.117583] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11) [ 1.120766] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11) [ 1.123708] ACPI: PCI Interrupt Link [LNKS] (IRQs *9) [ 1.127088] vgaarb: loaded [ 1.128199] SCSI subsystem initialized [ 1.129985] ACPI: bus type USB registered [ 1.131797] usbcore: registered new interface driver usbfs [ 1.133656] usbcore: registered new interface driver hub [ 1.135508] usbcore: registered new device driver usb [ 1.137499] PCI: Using ACPI for IRQ routing [ 1.139438] PCI: pci_cache_line_size set to 64 bytes [ 1.139840] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff] [ 1.139847] e820: reserve RAM buffer [mem 0xbffce000-0xbfffffff] [ 1.139849] e820: reserve RAM buffer [mem 0x13ee00000-0x13fffffff] [ 1.140206] NetLabel: Initializing [ 1.141445] NetLabel: domain hash size = 128 [ 1.142794] NetLabel: protocols = UNLABELED CIPSOv4 [ 1.144379] NetLabel: unlabeled traffic allowed by default [ 1.146657] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 1.148273] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 1.153614] amd_nb: Cannot enumerate AMD northbridges [ 1.155469] Switched to clocksource kvm-clock [ 1.176802] pnp: PnP ACPI init [ 1.177886] ACPI: bus type PNP registered [ 1.179284] pnp 00:00: Plug and Play ACPI device, IDs PNP0303 (active) [ 1.179367] pnp 00:01: Plug and Play ACPI device, IDs PNP0f13 (active) [ 1.179410] pnp 00:02: [dma 2] [ 1.179444] pnp 00:02: Plug and Play ACPI device, IDs PNP0700 (active) [ 1.179529] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active) [ 1.179602] pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active) [ 1.179675] pnp 00:05: Plug and Play ACPI device, IDs PNP0b00 (active) [ 1.180050] pnp: PnP ACPI: found 6 devices [ 1.181374] ACPI: bus type PNP unregistered [ 1.203167] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.203174] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 1.203177] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.203180] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 1.203182] pci_bus 0000:00: resource 8 [mem 0x380000000000-0x38007fffffff window] [ 1.203558] NET: Registered protocol family 2 [ 1.205941] TCP established hash table entries: 32768 (order: 6, 262144 bytes) [ 1.210664] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes) [ 1.215047] TCP: Hash tables configured (established 32768 bind 32768) [ 1.218333] TCP: reno registered [ 1.222301] UDP hash table entries: 2048 (order: 5, 196608 bytes) [ 1.225170] UDP-Lite hash table entries: 2048 (order: 5, 196608 bytes) [ 1.229639] NET: Registered protocol family 1 [ 1.232064] RPC: Registered named UNIX socket transport module. [ 1.235716] RPC: Registered udp transport module. [ 1.237171] RPC: Registered tcp transport module. [ 1.239777] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 1.242909] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 1.245001] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 1.248132] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 1.251243] PCI: CLS 0 bytes, default 64 [ 1.253300] Unpacking initramfs... [ 3.032610] debug: unmapping init [mem 0xffff8800bc2e2000-0xffff8800bffbffff] [ 3.039332] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.043899] software IO TLB [mem 0xb82e2000-0xbc2e2000] (64MB) mapped at [ffff8800b82e2000-ffff8800bc2e1fff] [ 3.052575] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 10737418240 ms ovfl timer [ 3.056145] RAPL PMU: hw unit of domain pp0-core 2^-0 Joules [ 3.067450] RAPL PMU: hw unit of domain package 2^-0 Joules [ 3.073888] RAPL PMU: hw unit of domain dram 2^-0 Joules [ 3.085153] cryptomgr_test (52) used greatest stack depth: 14480 bytes left [ 3.085784] futex hash table entries: 1024 (order: 4, 65536 bytes) [ 3.085841] Initialise system trusted keyring [ 3.128252] HugeTLB registered 1 GB page size, pre-allocated 0 pages [ 3.131241] HugeTLB registered 2 MB page size, pre-allocated 0 pages [ 3.141129] zpool: loaded [ 3.142127] zbud: loaded [ 3.143532] VFS: Disk quotas dquot_6.6.0 [ 3.144971] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 3.150408] NFS: Registering the id_resolver key type [ 3.152429] Key type id_resolver registered [ 3.153862] Key type id_legacy registered [ 3.154979] nfs4filelayout_init: NFSv4 File Layout Driver Registering... [ 3.158687] Key type big_key registered [ 3.159992] SELinux: Registering netfilter hooks [ 3.163915] cryptomgr_test (58) used greatest stack depth: 14048 bytes left [ 3.171069] cryptomgr_test (63) used greatest stack depth: 13984 bytes left [ 3.173385] NET: Registered protocol family 38 [ 3.173398] Key type asymmetric registered [ 3.173402] Asymmetric key parser 'x509' registered [ 3.173570] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250) [ 3.177159] io scheduler noop registered [ 3.177164] io scheduler deadline registered (default) [ 3.177279] io scheduler cfq registered [ 3.177285] io scheduler mq-deadline registered [ 3.177289] io scheduler kyber registered [ 3.179259] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 [ 3.179271] pciehp: PCI Express Hot Plug Controller Driver version: 0.4 [ 3.201663] intel_idle: does not run on family 6 model 62 [ 3.201826] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 3.204271] ACPI: Power Button [PWRF] [ 3.206575] GHES: HEST is not enabled! [ 3.274202] ACPI: PCI Interrupt Link [LNKB] enabled at IRQ 10 [ 3.352446] ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 11 [ 3.498191] ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 11 [ 3.565774] ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 10 [ 3.710813] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.750453] 00:03: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A [ 3.786240] 00:04: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A [ 3.791656] Non-volatile memory driver v1.3 [ 3.793495] Linux agpgart interface v0.103 [ 3.795585] crash memory driver: version 1.1 [ 3.797595] nbd: registered device at major 43 [ 3.802966] virtio-pci 0000:00:05.0: irq 24 for MSI/MSI-X [ 3.803012] virtio-pci 0000:00:05.0: irq 25 for MSI/MSI-X [ 3.803053] virtio-pci 0000:00:05.0: irq 26 for MSI/MSI-X [ 3.803099] virtio-pci 0000:00:05.0: irq 27 for MSI/MSI-X [ 3.803149] virtio-pci 0000:00:05.0: irq 28 for MSI/MSI-X [ 3.812160] virtio_blk virtio1: [vda] 115448 512-byte logical blocks (59.1 MB/56.3 MiB) [ 3.818508] virtio-pci 0000:00:06.0: irq 29 for MSI/MSI-X [ 3.818566] virtio-pci 0000:00:06.0: irq 30 for MSI/MSI-X [ 3.818606] virtio-pci 0000:00:06.0: irq 31 for MSI/MSI-X [ 3.818647] virtio-pci 0000:00:06.0: irq 32 for MSI/MSI-X [ 3.818687] virtio-pci 0000:00:06.0: irq 33 for MSI/MSI-X [ 3.842419] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 3.854620] virtio-pci 0000:00:07.0: irq 34 for MSI/MSI-X [ 3.854676] virtio-pci 0000:00:07.0: irq 35 for MSI/MSI-X [ 3.854721] virtio-pci 0000:00:07.0: irq 36 for MSI/MSI-X [ 3.854763] virtio-pci 0000:00:07.0: irq 37 for MSI/MSI-X [ 3.854807] virtio-pci 0000:00:07.0: irq 38 for MSI/MSI-X [ 3.866778] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.875463] virtio-pci 0000:00:08.0: irq 39 for MSI/MSI-X [ 3.875519] virtio-pci 0000:00:08.0: irq 40 for MSI/MSI-X [ 3.875551] virtio-pci 0000:00:08.0: irq 41 for MSI/MSI-X [ 3.875594] virtio-pci 0000:00:08.0: irq 42 for MSI/MSI-X [ 3.875633] virtio-pci 0000:00:08.0: irq 43 for MSI/MSI-X [ 3.884389] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.894544] virtio-pci 0000:00:09.0: irq 44 for MSI/MSI-X [ 3.894591] virtio-pci 0000:00:09.0: irq 45 for MSI/MSI-X [ 3.894636] virtio-pci 0000:00:09.0: irq 46 for MSI/MSI-X [ 3.894679] virtio-pci 0000:00:09.0: irq 47 for MSI/MSI-X [ 3.894728] virtio-pci 0000:00:09.0: irq 48 for MSI/MSI-X [ 3.904014] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.912076] virtio-pci 0000:00:0a.0: irq 49 for MSI/MSI-X [ 3.912126] virtio-pci 0000:00:0a.0: irq 50 for MSI/MSI-X [ 3.912179] virtio-pci 0000:00:0a.0: irq 51 for MSI/MSI-X [ 3.912238] virtio-pci 0000:00:0a.0: irq 52 for MSI/MSI-X [ 3.912280] virtio-pci 0000:00:0a.0: irq 53 for MSI/MSI-X [ 3.920082] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.929018] rdac: device handler registered [ 3.932570] hp_sw: device handler registered [ 3.934159] emc: device handler registered [ 3.935638] libphy: Fixed MDIO Bus: probed [ 3.940954] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 3.944245] ehci-pci: EHCI PCI platform driver [ 3.945904] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 3.948264] ohci-pci: OHCI PCI platform driver [ 3.949935] uhci_hcd: USB Universal Host Controller Interface driver [ 3.952434] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.958521] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.960576] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.963609] mousedev: PS/2 mouse device common for all mice [ 3.968629] rtc_cmos 00:05: RTC can wake from S4 [ 3.970384] rtc_cmos 00:05: rtc core: registered rtc_cmos as rtc0 [ 3.973299] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.975296] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.988846] hidraw: raw HID events driver (C) Jiri Kosina [ 3.992520] usbcore: registered new interface driver usbhid [ 3.995585] usbhid: USB HID core driver [ 3.997926] drop_monitor: Initializing network drop monitor service [ 4.000389] Netfilter messages via NETLINK v0.30. [ 4.001953] TCP: cubic registered [ 4.003540] Initializing XFRM netlink socket [ 4.006001] NET: Registered protocol family 10 [ 4.012438] NET: Registered protocol family 17 [ 4.014310] Key type dns_resolver registered [ 4.016929] mce: Using 10 MCE banks [ 4.019984] Loading compiled-in X.509 certificates [ 4.023310] Loaded X.509 cert 'Magrathea: Glacier signing key: e34d0e1b7fcf5b414cce75d36d8482945c781ed6' [ 4.026553] registered taskstats version 1 [ 4.034639] modprobe (72) used greatest stack depth: 13456 bytes left [ 4.041440] Key type trusted registered [ 4.057877] Key type encrypted registered [ 4.060147] IMA: No TPM chip found, activating TPM-bypass! (rc=-19) [ 4.064718] BERT: Boot Error Record Table support is disabled. Enable it by using bert_enable as kernel parameter. [ 4.069778] rtc_cmos 00:05: setting system clock to 2025-05-01 19:01:47 UTC (1746126107) [ 4.071928] debug: unmapping init [mem 0xffffffff81da0000-0xffffffff82018fff] [ 4.075861] Write protecting the kernel read-only data: 12288k [ 4.079976] debug: unmapping init [mem 0xffff8800017fe000-0xffff8800017fffff] [ 4.083817] tsc: Refined TSC clocksource calibration: 2399.961 MHz [ 4.087399] debug: unmapping init [mem 0xffff880001b9b000-0xffff880001bfffff] [ 4.103040] random: systemd: uninitialized urandom read (16 bytes read) [ 4.112084] random: systemd: uninitialized urandom read (16 bytes read) [ 4.126808] random: systemd: uninitialized urandom read (16 bytes read) [ 4.136043] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN) [ 4.145678] systemd[1]: Detected virtualization kvm. [ 4.148383] systemd[1]: Detected architecture x86-64. [ 4.150899] systemd[1]: Running in initial RAM disk. [ 4.161777] systemd[1]: No hostname configured. [ 4.165097] systemd[1]: Set hostname to . [ 4.167999] random: systemd: uninitialized urandom read (16 bytes read) [ 4.170964] systemd[1]: Initializing machine ID from random generator. [ 4.258642] dracut-rootfs-g (86) used greatest stack depth: 13264 bytes left [ 4.264896] random: systemd: uninitialized urandom read (16 bytes read) [ 4.267643] random: systemd: uninitialized urandom read (16 bytes read) [ 4.270040] random: systemd: uninitialized urandom read (16 bytes read) [ 4.273337] random: systemd: uninitialized urandom read (16 bytes read) [ 4.277062] random: systemd: uninitialized urandom read (16 bytes read) [ 4.280289] random: systemd: uninitialized urandom read (16 bytes read) [ 4.302640] systemd[1]: Created slice Root Slice. [ 4.308983] systemd[1]: Reached target Timers. [ 4.319849] systemd[1]: Reached target Swap. [ 4.332579] systemd[1]: Listening on Journal Socket. [ 4.339240] systemd[1]: Created slice System Slice. [ 4.353559] systemd[1]: Starting Load Kernel Modules... [ 4.367206] systemd[1]: Starting dracut cmdline hook... [ 4.386356] systemd[1]: Starting Create list of required static device nodes for the current kernel... [ 4.415778] systemd[1]: Starting Setup Virtual Console... [ 4.432242] systemd[1]: Listening on udev Kernel Socket. [ 4.442289] systemd[1]: Reached target Slices. [ 4.460198] systemd[1]: Starting Journal Service... [ 4.478480] systemd[1]: Listening on udev Control Socket. [ 4.487624] systemd[1]: Reached target Sockets. [ 4.495236] systemd[1]: Reached target Local File Systems. [ 4.502082] systemd[1]: Started Load Kernel Modules. [ 4.518023] systemd[1]: Started Create list of required static device nodes for the current kernel. [ 4.532789] systemd[1]: Started Setup Virtual Console. [ 4.541903] systemd[1]: Starting Create Static Device Nodes in /dev... [ 4.557533] systemd[1]: Starting Apply Kernel Variables... [ 4.575938] systemd[1]: Started Journal Service. [ 4.883570] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input2 [ 5.329098] random: fast init done [ 5.465847] libata version 3.00 loaded. [ 5.530867] ata_piix 0000:00:01.1: version 2.13 [ 5.560997] scsi host0: ata_piix [ 5.564883] scsi host1: ata_piix [ 5.566207] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 5.571556] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 5.791179] ip (323) used greatest stack depth: 13080 bytes left [ 5.885380] ip (346) used greatest stack depth: 12336 bytes left [ 9.248303] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ 9.966248] systemd-journald[111]: Received SIGTERM from PID 1 (systemd). [ 10.346413] SELinux: Disabled at runtime. [ 10.349176] SELinux: Unregistering netfilter hooks [ 10.465015] ip_tables: (C) 2000-2006 Netfilter Core Team [ 10.469813] systemd[1]: Inserted module 'ip_tables' [ 11.363563] systemd-journald[569]: Received request to flush runtime journal from PID 1 [ 11.694811] input: PC Speaker as /devices/platform/pcspkr/input/input3 [ 11.756958] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 11.954993] cryptd: max_cpu_qlen set to 1000 [ 12.251461] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ 12.355967] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 12.403920] AVX version of gcm_enc/dec engaged. [ 12.405727] AES CTR mode by8 optimization enabled [ 12.451969] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni) [ 12.458625] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni) [ 12.794318] EDAC MC: Ver: 3.0.0 [ 12.810268] EDAC sbridge: Seeking for: PCI ID 8086:0ea0 [ 12.810279] EDAC sbridge: Ver: 1.1.2 [ 15.931663] mount.nfs (774) used greatest stack depth: 10704 bytes left [ 29.896763] device-mapper: uevent: version 1.0.3 [ 29.898853] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com [ 35.000081] libcfs: loading out-of-tree module taints kernel. [ 35.002202] libcfs: module verification failed: signature and/or required key missing - tainting kernel [ 35.033291] Lustre: DEBUG MARKER: oleg123-server.virtnet: executing set_hostid [ 40.504965] Lustre: DEBUG MARKER: oleg123-server.virtnet: executing load_modules_local [ 40.819856] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 40.826109] alg: No test for adler32 (adler32-zlib) [ 41.750418] Lustre: Lustre: Build Version: 2.16.54_66_g664720d [ 41.964116] LNet: Added LNI 192.168.201.123@tcp [8/256/0/180] [ 41.967311] LNet: Accept secure, port 988 [ 43.543909] Key type lgssc registered [ 43.932374] Lustre: Echo OBD driver; http://www.lustre.org/ [ 47.685755] icp: module license 'CDDL' taints kernel. [ 47.687344] Disabling lock debugging due to kernel taint [ 49.325336] ZFS: Loaded module v2.1.5-1, ZFS pool version 5000, ZFS filesystem version 5 [ 52.875513] LDISKFS-fs (vdc): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 58.233444] LDISKFS-fs (vdd): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 62.441947] LDISKFS-fs (vde): file extents enabled, maximum tree depth=5 [ 62.454493] LDISKFS-fs (vde): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 67.088452] LDISKFS-fs (vdf): file extents enabled, maximum tree depth=5 [ 67.111781] LDISKFS-fs (vdf): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 74.834158] Lustre: DEBUG MARKER: oleg123-server.virtnet: executing load_modules_local [ 82.378626] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 82.408189] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 82.425583] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 83.389615] hrtimer: interrupt took 6142783 ns [ 83.631368] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall in log lustre-MDT0000 [ 83.648623] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 83.724135] Lustre: lustre-MDT0000: new disk, initializing [ 83.829818] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 83.848049] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 83.930792] mount.lustre (7213) used greatest stack depth: 9728 bytes left [ 85.524663] Lustre: DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 93.398635] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 93.439450] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 93.483134] Lustre: Modifying parameter lustre-MDT0001.mdt.identity_upcall in log lustre-MDT0001 [ 93.504438] Lustre: 8374:0:(mgc_request_server.c:550:mgc_llog_local_copy()) MGC192.168.201.123@tcp: no remote llog for lustre-sptlrpc, check MGS config [ 93.528116] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 93.535324] Lustre: Skipped 1 previous similar message [ 93.604400] Lustre: lustre-MDT0001: new disk, initializing [ 93.681085] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 93.721611] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 93.735324] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 95.524950] Lustre: DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 98.568943] Lustre: Modifying parameter general.debug_raw_pointers in log params [ 103.823297] LDISKFS-fs (dm-2): file extents enabled, maximum tree depth=5 [ 103.833296] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 103.877764] LDISKFS-fs (dm-2): file extents enabled, maximum tree depth=5 [ 103.888167] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 104.016005] Lustre: 9579:0:(mgc_request_server.c:550:mgc_llog_local_copy()) MGC192.168.201.123@tcp: no remote llog for lustre-sptlrpc, check MGS config [ 104.045892] Lustre: lustre-OST0000: new disk, initializing [ 104.049219] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 104.079746] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 105.327689] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 105.331818] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 105.353205] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 106.616427] Lustre: DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 110.526607] random: crng init done [ 113.674322] LDISKFS-fs (dm-3): file extents enabled, maximum tree depth=5 [ 113.681425] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 113.703043] LDISKFS-fs (dm-3): file extents enabled, maximum tree depth=5 [ 113.707384] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 113.743178] Lustre: 10915:0:(mgc_request_server.c:550:mgc_llog_local_copy()) MGC192.168.201.123@tcp: no remote llog for lustre-sptlrpc, check MGS config [ 113.754972] Lustre: lustre-OST0001: new disk, initializing [ 113.759103] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 113.786020] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 114.299008] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 114.304226] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 114.327672] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 115.811488] Lustre: DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 122.086164] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 124.654236] Lustre: Setting parameter general.lod.*.mdt_hash in log params [ 131.623408] Lustre: DEBUG MARKER: oleg123-server.virtnet: executing check_logdir /tmp/testlogs/ [ 133.329283] Lustre: DEBUG MARKER: oleg123-server.virtnet: executing yml_node [ 135.536277] Lustre: DEBUG MARKER: Client: 2.16.54.66 [ 137.031962] Lustre: DEBUG MARKER: MDS: 2.16.54.66 [ 138.460491] Lustre: DEBUG MARKER: OSS: 2.16.54.66 [ 139.252708] Lustre: DEBUG MARKER: -----============= acceptance-small: sanity-hsm ============----- Thu May 1 15:04:01 EDT 2025 [ 146.823729] Lustre: DEBUG MARKER: excepting tests: [ 147.528494] Lustre: DEBUG MARKER: === sanity-hsm: start setup 15:04:09 (1746126249) === [ 149.090959] Lustre: DEBUG MARKER: oleg123-client.virtnet: executing check_config_client /mnt/lustre [ 156.876985] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 158.735267] Lustre: Modifying parameter general.lod.*.mdt_hash in log params [ 160.244353] Lustre: DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 164.079858] Lustre: DEBUG MARKER: === sanity-hsm: finish setup 15:04:25 (1746126265) === [ 188.510264] Lustre: DEBUG MARKER: == sanity-hsm test 1A: lfs hsm flags root/non-root access ========================================================== 15:04:50 (1746126290) [ 192.337527] Lustre: DEBUG MARKER: == sanity-hsm test 1a: mmap [ 200.115420] Lustre: DEBUG MARKER: == sanity-hsm test 1b: Archive, Release and Restore composite file ========================================================== 15:05:01 (1746126301) [ 207.466365] Lustre: DEBUG MARKER: == sanity-hsm test 1c: Check setting archive-id in lfs hsm_set ========================================================== 15:05:09 (1746126309) [ 212.147663] Lustre: DEBUG MARKER: == sanity-hsm test 1d: Archive, Release and Restore DoM file ========================================================== 15:05:13 (1746126313) [ 220.919139] Lustre: DEBUG MARKER: == sanity-hsm test 1e: Archive, Release and Restore SEL file ========================================================== 15:05:22 (1746126322) [ 222.037087] Lustre: 7239:0:(lod_lov.c:1417:lod_parse_striping()) lustre-MDT0000-mdtlov: EXTENSION flags=40 set on component[2]=1 of non-SEL file [0x200000402:0xf:0x0] with magic=0xbd60bd0 [ 223.127588] Lustre: 7235:0:(lod_lov.c:1417:lod_parse_striping()) lustre-MDT0000-mdtlov: EXTENSION flags=50 set on component[2]=1 of non-SEL file [0x200000403:0x6:0x0] with magic=0xbd60bd0 [ 223.144641] Lustre: 7235:0:(lod_lov.c:1417:lod_parse_striping()) Skipped 5 previous similar messages [ 228.949119] Lustre: DEBUG MARKER: == sanity-hsm test 1f: DoM file release after restore ==== 15:05:30 (1746126330) [ 238.721684] Lustre: DEBUG MARKER: == sanity-hsm test 2: Check file dirtyness when doing setattr ========================================================== 15:05:40 (1746126340) [ 243.702680] Lustre: DEBUG MARKER: == sanity-hsm test 3: Check file dirtyness when opening for write ========================================================== 15:05:45 (1746126345) [ 248.604500] Lustre: DEBUG MARKER: == sanity-hsm test 4: Useless cancel must not be registered ========================================================== 15:05:50 (1746126350) [ 253.232447] Lustre: DEBUG MARKER: == sanity-hsm test 8: Test default archive number ======== 15:05:54 (1746126354) [ 257.963510] Lustre: DEBUG MARKER: == sanity-hsm test 9A: Use of explicit archive number, with dedicated copytool ========================================================== 15:05:59 (1746126359) [ 264.143692] Lustre: DEBUG MARKER: oleg123-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool [ 266.315243] Lustre: DEBUG MARKER: oleg123-client.virtnet: executing get_client_uuid /mnt/lustre2 [ 273.631103] Lustre: DEBUG MARKER: == sanity-hsm test 9a: Multiple remote agents ============ 15:06:15 (1746126375) [ 274.577655] Lustre: DEBUG MARKER: SKIP: sanity-hsm test_9a Need 3 or more clients, have 1 [ 275.617297] Lustre: DEBUG MARKER: == sanity-hsm test 10a: Archive a file =================== 15:06:17 (1746126377) [ 281.942242] Lustre: DEBUG MARKER: == sanity-hsm test 10b: Archive of non dirty file must work without doing request ========================================================== 15:06:23 (1746126383) [ 289.348840] Lustre: DEBUG MARKER: == sanity-hsm test 10c: Check forbidden archive ========== 15:06:30 (1746126390) [ 294.382113] Lustre: DEBUG MARKER: == sanity-hsm test 10d: Archive a file on the default archive id ========================================================== 15:06:35 (1746126395) [ 300.635330] Lustre: DEBUG MARKER: == sanity-hsm test 11a: Import a file ==================== 15:06:42 (1746126402) [ 306.373932] Lustre: DEBUG MARKER: == sanity-hsm test 11b: Import a deleted file using its FID ========================================================== 15:06:47 (1746126407) [ 313.151288] Lustre: DEBUG MARKER: == sanity-hsm test 11c: Import a file to a directory with a pool ========================================================== 15:06:54 (1746126414) [ 331.457999] Lustre: DEBUG MARKER: == sanity-hsm test 12a: Restore an imported file explicitly ========================================================== 15:07:13 (1746126433) [ 337.270247] Lustre: DEBUG MARKER: == sanity-hsm test 12b: Restore an imported file implicitly ========================================================== 15:07:18 (1746126438) [ 342.772626] Lustre: DEBUG MARKER: == sanity-hsm test 12c: Restore a file with stripe of 2 == 15:07:24 (1746126444) [ 350.310076] Lustre: DEBUG MARKER: == sanity-hsm test 12d: Restore of a non archived, non released file must work ========================================================== 15:07:32 (1746126452) [ 356.464545] Lustre: DEBUG MARKER: == sanity-hsm test 12e: Check forbidden restore ========== 15:07:38 (1746126458) [ 363.047427] Lustre: DEBUG MARKER: == sanity-hsm test 12f: Restore a released file explicitly ========================================================== 15:07:44 (1746126464) [ 370.347365] Lustre: DEBUG MARKER: == sanity-hsm test 12g: Restore a released file implicitly ========================================================== 15:07:52 (1746126472) [ 377.302940] Lustre: DEBUG MARKER: == sanity-hsm test 12h: Restore a released file implicitly from a second node ========================================================== 15:07:58 (1746126478) [ 378.436206] Lustre: DEBUG MARKER: SKIP: sanity-hsm test_12h Need 2 or more clients, have 1 [ 379.862235] Lustre: DEBUG MARKER: == sanity-hsm test 12m: Archive/release/implicit restore ========================================================== 15:08:01 (1746126481) [ 388.559662] Lustre: DEBUG MARKER: == sanity-hsm test 12n: Import/implicit restore/release == 15:08:10 (1746126490) [ 394.096363] Lustre: DEBUG MARKER: == sanity-hsm test 12o: Layout-swap failure during Restore leaves file released ========================================================== 15:08:15 (1746126495) [ 398.135256] Lustre: *** cfs_fail_loc=152, val=0*** [ 422.843735] Lustre: DEBUG MARKER: == sanity-hsm test 12p: implicit restore of a file on copytool mount point ========================================================== 15:08:44 (1746126524) [ 430.367725] Lustre: DEBUG MARKER: == sanity-hsm test 12q: file attributes are refreshed after restore ========================================================== 15:08:52 (1746126532) [ 445.489070] Lustre: DEBUG MARKER: == sanity-hsm test 12r: lseek restores released file ===== 15:09:07 (1746126547) [ 452.609887] Lustre: DEBUG MARKER: == sanity-hsm test 12s: race between restore requests ==== 15:09:14 (1746126554) [ 455.795165] LustreError: 7237:0:(mdt_hsm_cdt_client.c:349:mdt_hsm_register_hal()) cfs_race id 18b sleeping [ 460.806626] LustreError: 7237:0:(mdt_hsm_cdt_client.c:349:mdt_hsm_register_hal()) cfs_fail_race id 18b awake: rc=0 [ 466.657758] Lustre: DEBUG MARKER: == sanity-hsm test 12t: Multiple parallel reads for a HSM imported file ========================================================== 15:09:28 (1746126568) [ 474.799390] Lustre: DEBUG MARKER: == sanity-hsm test 12u: Multiple reads on multiple HSM imported files in parallel ========================================================== 15:09:36 (1746126576) [ 492.156682] Lustre: DEBUG MARKER: == sanity-hsm test 13: Recursively import and restore a directory ========================================================== 15:09:53 (1746126593) [ 516.100237] Lustre: DEBUG MARKER: == sanity-hsm test 14: Rebind archived file to a new fid ========================================================== 15:10:17 (1746126617) [ 522.749777] Lustre: DEBUG MARKER: == sanity-hsm test 15: Rebind a list of files ============ 15:10:24 (1746126624) [ 535.970188] Lustre: DEBUG MARKER: == sanity-hsm test 16: Test CT bandwith control option === 15:10:37 (1746126637) [ 561.089987] Lustre: DEBUG MARKER: == sanity-hsm test 20: Release is not permitted ========== 15:11:02 (1746126662) [ 565.199634] Lustre: DEBUG MARKER: == sanity-hsm test 21: Simple release tests ============== 15:11:07 (1746126667) [ 573.661796] Lustre: DEBUG MARKER: == sanity-hsm test 22: Could not swap a release file ===== 15:11:15 (1746126675) [ 580.049451] Lustre: DEBUG MARKER: == sanity-hsm test 23: Release does not change a/mtime (utime) ========================================================== 15:11:21 (1746126681) [ 585.226772] Lustre: DEBUG MARKER: == sanity-hsm test 24a: Archive, release, and restore does not change a/mtime (i/o) ========================================================== 15:11:26 (1746126686) [ 594.927849] Lustre: DEBUG MARKER: == sanity-hsm test 24b: root can archive, release, and restore user files ========================================================== 15:11:36 (1746126696) [ 605.158987] Lustre: DEBUG MARKER: == sanity-hsm test 24c: check that user,group,other request masks work ========================================================== 15:11:46 (1746126706) [ 620.095088] Lustre: DEBUG MARKER: == sanity-hsm test 24d: check that read-only mounts are respected ========================================================== 15:12:01 (1746126721) [ 633.537329] Lustre: DEBUG MARKER: == sanity-hsm test 24e: tar succeeds on HSM released files ========================================================== 15:12:15 (1746126735) [ 642.196670] Lustre: DEBUG MARKER: == sanity-hsm test 24f: root can archive, release, and restore tar files ========================================================== 15:12:23 (1746126743) [ 649.005003] Lustre: DEBUG MARKER: == sanity-hsm test 24g: write by non-owner still sets dirty ========================================================== 15:12:30 (1746126750) [ 653.828706] Lustre: DEBUG MARKER: == sanity-hsm test 25a: Restore lost file (HS_LOST flag) from import ========================================================== 15:12:35 (1746126755) [ 658.511022] Lustre: DEBUG MARKER: == sanity-hsm test 25b: Restore lost file (HS_LOST flag) after release ========================================================== 15:12:40 (1746126760) [ 666.205983] Lustre: DEBUG MARKER: == sanity-hsm test 26A: Remove the archive of a valid file ========================================================== 15:12:47 (1746126767) [ 673.327874] Lustre: DEBUG MARKER: == sanity-hsm test 26a: Remove Archive On Last Unlink (RAoLU) policy ========================================================== 15:12:55 (1746126775) [ 695.777764] Lustre: DEBUG MARKER: == sanity-hsm test 26b: RAoLU policy when CDT off ======== 15:13:17 (1746126797) [ 710.549948] Lustre: DEBUG MARKER: == sanity-hsm test 26c: RAoLU effective when file closed ========================================================== 15:13:32 (1746126812) [ 742.667941] Lustre: DEBUG MARKER: == sanity-hsm test 26d: RAoLU when Client eviction ======= 15:14:04 (1746126844) [ 748.739927] Lustre: 15039:0:(genops.c:1791:obd_export_evict_by_uuid()) lustre-MDT0000: evicting 73861046-96ae-43d3-b2e2-b54feee4506d at adminstrative request [ 762.352802] Lustre: DEBUG MARKER: == sanity-hsm test 26e: RAoLU with a non-started coordinator ========================================================== 15:14:24 (1746126864) [ 766.771949] Lustre: Modifying parameter lustre.mdt.lustre-MDT0000.hsm_control in log params [ 766.775237] Lustre: Skipped 2 previous similar messages [ 788.528076] Lustre: Failing over lustre-MDT0000 [ 788.659857] LustreError: 16524:0:(obd_class.h:479:obd_check_dev()) Device 28 not setup [ 788.711918] Lustre: server umount lustre-MDT0000 complete [ 789.943938] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 789.948249] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 795.433851] LustreError: 11606:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 795.447299] LustreError: 11606:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 10 previous similar messages [ 795.985372] LustreError: 11606:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.23@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 795.999265] LustreError: 11606:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 1 previous similar message [ 800.442518] LustreError: 14409:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 800.459666] LustreError: 14409:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 3 previous similar messages [ 804.234705] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 804.361435] LustreError: MGC192.168.201.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 804.581869] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 804.626274] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 805.994485] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 806.604228] Lustre: DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 809.591856] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to (at 0@lo) [ 809.595893] Lustre: lustre-MDT0000: Recovery over after 0:03, of 3 clients 3 recovered and 0 were evicted. [ 809.638991] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:92 to 0x2c0000401:129) [ 809.644141] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:91 to 0x280000401:129) [ 811.852195] Lustre: DEBUG MARKER: oleg123-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 812.851120] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 824.830295] Lustre: Modifying parameter lustre.mdt.lustre-MDT0000.hsm_control in log params [ 824.833708] Lustre: Skipped 1 previous similar message [ 846.459163] Lustre: DEBUG MARKER: == sanity-hsm test 27a: Remove the archive of an imported file (Operation not permitted) ========================================================== 15:15:48 (1746126948) [ 851.954505] Lustre: DEBUG MARKER: == sanity-hsm test 27b: Remove the archive of a relased file (Operation not permitted) ========================================================== 15:15:53 (1746126953) [ 858.714956] Lustre: DEBUG MARKER: == sanity-hsm test 28: Concurrent archive/file remove ==== 15:16:00 (1746126960) [ 869.240943] Lustre: DEBUG MARKER: == sanity-hsm test 29a: Tests --mntpath and --archive options ========================================================== 15:16:10 (1746126970) [ 874.041371] Lustre: DEBUG MARKER: == sanity-hsm test 29b: Archive/delete/remove by FID from the archive. ========================================================== 15:16:15 (1746126975) [ 882.570903] Lustre: DEBUG MARKER: == sanity-hsm test 29c: Archive/delete/remove by FID, using a file list. ========================================================== 15:16:24 (1746126984) [ 890.766634] Lustre: DEBUG MARKER: == sanity-hsm test 29d: hsm_remove by FID with archive_id 0 for unlinked file cause ========================================================== 15:16:32 (1746126992) [ 891.488388] Lustre: DEBUG MARKER: SKIP: sanity-hsm test_29d Need 3 or more clients, have 1 [ 892.388190] Lustre: DEBUG MARKER: == sanity-hsm test 30a: Restore at exec (import case) ==== 15:16:34 (1746126994) [ 893.167163] Lustre: DEBUG MARKER: SKIP: sanity-hsm test_30a Need 2 or more clients, have 1 [ 894.181781] Lustre: DEBUG MARKER: == sanity-hsm test 30b: Restore at exec (release case) === 15:16:35 (1746126995) [ 895.031092] Lustre: DEBUG MARKER: SKIP: sanity-hsm test_30b Need 2 or more clients, have 1 [ 895.945329] Lustre: DEBUG MARKER: == sanity-hsm test 30c: Update during exec of released file must fail ========================================================== 15:16:37 (1746126997) [ 896.706848] Lustre: DEBUG MARKER: SKIP: sanity-hsm test_30c Need 2 or more clients, have 1 [ 897.731894] Lustre: DEBUG MARKER: == sanity-hsm test 31a: Import a large file and check size during restore ========================================================== 15:16:39 (1746126999) [ 913.981390] Lustre: DEBUG MARKER: == sanity-hsm test 31b: Restore a large unaligned file and check size during restore ========================================================== 15:16:55 (1746127015) [ 931.197388] Lustre: DEBUG MARKER: == sanity-hsm test 31c: Restore a large aligned file and check size during restore ========================================================== 15:17:12 (1746127032) [ 948.299915] Lustre: DEBUG MARKER: == sanity-hsm test 33: Kill a restore waiting process ==== 15:17:30 (1746127050) [ 953.675652] Lustre: DEBUG MARKER: == sanity-hsm test 34: Remove file during restore ======== 15:17:35 (1746127055) [ 960.553072] Lustre: DEBUG MARKER: == sanity-hsm test 35: Overwrite file during restore ===== 15:17:42 (1746127062) [ 969.344590] Lustre: DEBUG MARKER: == sanity-hsm test 36: Move file during restore ========== 15:17:51 (1746127071) [ 977.409990] Lustre: DEBUG MARKER: == sanity-hsm test 37: re-archive a dirty file =========== 15:17:59 (1746127079) [ 1053.858161] Lustre: DEBUG MARKER: == sanity-hsm test 40: Parallel archive requests ========= 15:19:15 (1746127155) [ 1163.008192] Lustre: DEBUG MARKER: == sanity-hsm test 50: Archive with large number of pending HSM actions ========================================================== 15:21:04 (1746127264) [ 1758.991983] Lustre: DEBUG MARKER: == sanity-hsm test 52: Opened for write file on an evicted client should be set dirty ========================================================== 15:31:01 (1746127861) [ 1761.115303] Lustre: 30468:0:(genops.c:1791:obd_export_evict_by_uuid()) lustre-MDT0000: evicting 73861046-96ae-43d3-b2e2-b54feee4506d at adminstrative request [ 1767.332240] Lustre: DEBUG MARKER: == sanity-hsm test 53: Opened for read file on an evicted client should not be set dirty ========================================================== 15:31:09 (1746127869) [ 1771.641846] Lustre: 30933:0:(genops.c:1791:obd_export_evict_by_uuid()) lustre-MDT0000: evicting 73861046-96ae-43d3-b2e2-b54feee4506d at adminstrative request [ 1776.130359] Lustre: DEBUG MARKER: == sanity-hsm test 54: Write during an archive cancels it ========================================================== 15:31:18 (1746127878) [ 1819.914296] Lustre: DEBUG MARKER: == sanity-hsm test 55: Truncate during an archive cancels it ========================================================== 15:32:01 (1746127921) [ 1829.543280] Lustre: DEBUG MARKER: == sanity-hsm test 56: Setattr during an archive is ok === 15:32:11 (1746127931) [ 1873.593796] Lustre: DEBUG MARKER: == sanity-hsm test 57: Archive a file with dirty cache on another node ========================================================== 15:32:55 (1746127975) [ 1874.376054] Lustre: DEBUG MARKER: SKIP: sanity-hsm test_57 Need 2 or more clients, have 1 [ 1875.292193] Lustre: DEBUG MARKER: == sanity-hsm test 58: Truncate a released file will trigger restore ========================================================== 15:32:57 (1746127977) [ 1887.856866] Lustre: DEBUG MARKER: == sanity-hsm test 59: Release stripeless file with non-zero size ========================================================== 15:33:09 (1746127989) [ 1893.072716] Lustre: DEBUG MARKER: == sanity-hsm test 60: Changing progress update interval from default ========================================================== 15:33:14 (1746127994) [ 1908.639066] Lustre: DEBUG MARKER: == sanity-hsm test 61: Waiting archive of a removed file should fail ========================================================== 15:33:30 (1746128010) [ 1917.709666] Lustre: DEBUG MARKER: == sanity-hsm test 70: Copytool logs JSON register/unregister events to FIFO ========================================================== 15:33:39 (1746128019) [ 1924.130022] Lustre: DEBUG MARKER: == sanity-hsm test 71: Copytool logs JSON archive events to FIFO ========================================================== 15:33:45 (1746128025) [ 1935.907007] Lustre: DEBUG MARKER: == sanity-hsm test 72: Copytool logs JSON restore events to FIFO ========================================================== 15:33:57 (1746128037) [ 1945.144371] Lustre: DEBUG MARKER: == sanity-hsm test 90: Archive/restore a file list ======= 15:34:07 (1746128047) [ 2025.432546] Lustre: DEBUG MARKER: == sanity-hsm test 100: Set coordinator /proc tunables === 15:35:27 (1746128127) [ 2050.112501] Lustre: DEBUG MARKER: == sanity-hsm test 102: Verify coordinator control ======= 15:35:51 (1746128151) [ 2063.009026] Lustre: DEBUG MARKER: == sanity-hsm test 103: Purge all requests =============== 15:36:04 (1746128164) [ 2073.805906] Lustre: DEBUG MARKER: == sanity-hsm test 103a: Purge pending restore requests == 15:36:15 (1746128175) [ 2088.469879] Lustre: DEBUG MARKER: == sanity-hsm test 104: Copy tool data field ============= 15:36:30 (1746128190) [ 2096.845984] Lustre: DEBUG MARKER: == sanity-hsm test 105: Restart of coordinator =========== 15:36:38 (1746128198) [ 2120.081255] Lustre: DEBUG MARKER: == sanity-hsm test 106: Copytool register/unregister ===== 15:37:01 (1746128221) [ 2122.940489] Lustre: DEBUG MARKER: oleg123-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool [ 2125.175422] Lustre: DEBUG MARKER: oleg123-client.virtnet: executing get_client_uuid /mnt/lustre2 [ 2130.482019] Lustre: DEBUG MARKER: oleg123-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool [ 2132.725196] Lustre: DEBUG MARKER: oleg123-client.virtnet: executing get_client_uuid /mnt/lustre2 [ 2137.429818] Lustre: DEBUG MARKER: == sanity-hsm test 107: Copytool re-register after MDS restart ========================================================== 15:37:19 (1746128239) [ 2141.076221] Lustre: Failing over lustre-MDT0000 [ 2141.263747] LustreError: 18588:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 2141.267018] LustreError: 18588:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 2141.402387] Lustre: server umount lustre-MDT0000 complete [ 2142.007995] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2142.014514] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2142.027251] Lustre: Skipped 3 previous similar messages [ 2142.044167] LustreError: 9595:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2142.071121] LustreError: 9595:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 2 previous similar messages [ 2142.842611] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2142.842838] LustreError: 9595:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2147.847883] LustreError: 28916:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2147.855279] LustreError: 28916:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 8 previous similar messages [ 2152.859071] LustreError: 11606:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2152.869850] LustreError: 11606:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 4 previous similar messages [ 2156.466184] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2156.559366] LustreError: MGC192.168.201.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2156.720651] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2156.772503] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 2158.230944] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 2158.788206] Lustre: DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 2161.707985] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to (at 0@lo) [ 2161.711739] Lustre: Skipped 3 previous similar messages [ 2161.740798] Lustre: lustre-MDT0000: Recovery over after 0:04, of 3 clients 3 recovered and 0 were evicted. [ 2161.796631] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:221 to 0x280000401:257) [ 2161.797098] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:222 to 0x2c0000401:257) [ 2164.041262] Lustre: DEBUG MARKER: oleg123-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2165.010058] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 2171.466291] Lustre: DEBUG MARKER: == sanity-hsm test 109: Policy display/change ============ 15:37:53 (1746128273) [ 2179.453329] Lustre: 20915:0:(mdt_coordinator.c:2165:mdt_hsm_policy_seq_write()) lustre-MDT0000: 'wrong' is unknown, supported policies are: [ 2188.474013] Lustre: DEBUG MARKER: == sanity-hsm test 110a: Non blocking restore policy (import case) ========================================================== 15:38:09 (1746128289) [ 2197.542857] Lustre: DEBUG MARKER: == sanity-hsm test 110b: Non blocking restore policy (release case) ========================================================== 15:38:19 (1746128299) [ 2207.462105] Lustre: DEBUG MARKER: == sanity-hsm test 111a: No retry policy (import case), restore will error ========================================================== 15:38:29 (1746128309) [ 2216.320849] Lustre: DEBUG MARKER: == sanity-hsm test 111b: No retry policy (release case), restore will error ========================================================== 15:38:37 (1746128317) [ 2228.928747] Lustre: DEBUG MARKER: == sanity-hsm test 112: State of recorded request ======== 15:38:50 (1746128330) [ 2239.335505] Lustre: DEBUG MARKER: == sanity-hsm test 113: wrong stat after restore ========= 15:39:01 (1746128341) [ 2249.553642] Lustre: DEBUG MARKER: == sanity-hsm test 114: Incompatible request does not set other requests as STARTED ========================================================== 15:39:11 (1746128351) [ 2266.108656] Lustre: DEBUG MARKER: == sanity-hsm test 200: Register/Cancel archive ========== 15:39:27 (1746128367) [ 2274.895068] Lustre: DEBUG MARKER: == sanity-hsm test 201: Register/Cancel restore ========== 15:39:36 (1746128376) [ 2287.532138] Lustre: DEBUG MARKER: == sanity-hsm test 202: Register/Cancel remove =========== 15:39:49 (1746128389) [ 2299.719176] Lustre: DEBUG MARKER: == sanity-hsm test 220A: Changelog for archive =========== 15:40:01 (1746128401) [ 2301.951125] Lustre: lustre-MDD0000: changelog on [ 2304.087653] Lustre: lustre-MDD0001: changelog on [ 2309.216137] Lustre: lustre-MDD0001: changelog off [ 2311.194725] Lustre: lustre-MDD0000: changelog off [ 2313.176138] Lustre: DEBUG MARKER: == sanity-hsm test 220a: Changelog for failed archive ==== 15:40:14 (1746128414) [ 2315.416793] Lustre: lustre-MDD0000: changelog on [ 2317.491246] Lustre: lustre-MDD0001: changelog on [ 2326.342415] Lustre: lustre-MDD0001: changelog off [ 2330.536847] Lustre: DEBUG MARKER: == sanity-hsm test 221: Changelog for archive canceled === 15:40:31 (1746128431) [ 2333.112212] Lustre: lustre-MDD0000: changelog on [ 2344.144822] Lustre: lustre-MDD0001: changelog off [ 2344.147063] Lustre: Skipped 1 previous similar message [ 2349.253419] Lustre: DEBUG MARKER: == sanity-hsm test 222a: Changelog for explicit restore == 15:40:50 (1746128450) [ 2352.250026] Lustre: lustre-MDD0000: changelog on [ 2352.252446] Lustre: Skipped 1 previous similar message [ 2361.083405] Lustre: lustre-MDD0001: changelog off [ 2361.085285] Lustre: Skipped 1 previous similar message [ 2366.215553] Lustre: DEBUG MARKER: == sanity-hsm test 222b: Changelog for implicit restore == 15:41:07 (1746128467) [ 2369.147154] Lustre: lustre-MDD0000: changelog on [ 2369.150717] Lustre: Skipped 1 previous similar message [ 2381.608961] Lustre: lustre-MDD0001: changelog off [ 2381.615043] Lustre: Skipped 1 previous similar message [ 2386.205379] Lustre: DEBUG MARKER: == sanity-hsm test 222c: Changelog for failed explicit restore ========================================================== 15:41:27 (1746128487) [ 2400.981752] Lustre: lustre-MDD0001: changelog off [ 2400.984508] Lustre: Skipped 1 previous similar message [ 2405.301051] Lustre: DEBUG MARKER: == sanity-hsm test 222d: Changelog for failed implicit restore ========================================================== 15:41:46 (1746128506) [ 2408.154272] Lustre: lustre-MDD0000: changelog on [ 2408.156430] Lustre: Skipped 3 previous similar messages [ 2422.548410] Lustre: DEBUG MARKER: == sanity-hsm test 223a: Changelog for restore canceled (import case) ========================================================== 15:42:03 (1746128523) [ 2467.843723] Lustre: lustre-MDD0001: changelog off [ 2467.846972] Lustre: Skipped 3 previous similar messages [ 2472.717395] Lustre: DEBUG MARKER: == sanity-hsm test 223b: Changelog for restore canceled (release case) ========================================================== 15:42:53 (1746128573) [ 2475.504563] Lustre: lustre-MDD0000: changelog on [ 2475.509263] Lustre: Skipped 3 previous similar messages [ 2495.472613] Lustre: DEBUG MARKER: == sanity-hsm test 224A: Changelog for remove ============ 15:43:16 (1746128596) [ 2514.487134] Lustre: DEBUG MARKER: == sanity-hsm test 224a: Changelog for failed remove ===== 15:43:35 (1746128615) [ 2532.457093] Lustre: lustre-MDD0000: changelog off [ 2532.460007] Lustre: Skipped 6 previous similar messages [ 2535.191641] Lustre: DEBUG MARKER: == sanity-hsm test 225: Changelog for remove canceled ==== 15:43:56 (1746128636) [ 2541.212289] Lustre: DEBUG MARKER: == sanity-hsm test 226: changelog for last rm/mv with exiting archive ========================================================== 15:44:02 (1746128642) [ 2562.088129] Lustre: DEBUG MARKER: == sanity-hsm test 227: changelog when explicit setting of HSM flags ========================================================== 15:44:23 (1746128663) [ 2580.856602] Lustre: DEBUG MARKER: == sanity-hsm test 228: On released file, return extend to FIEMAP. For [cp,tar] --sparse ========================================================== 15:44:42 (1746128682) [ 2591.393929] Lustre: DEBUG MARKER: == sanity-hsm test 250: Coordinator max request ========== 15:44:52 (1746128692) [ 2615.799449] Lustre: DEBUG MARKER: == sanity-hsm test 251: Coordinator request timeout ====== 15:45:17 (1746128717) [ 2638.931226] LustreError: 7236:0:(mdt_coordinator.c:1719:mdt_hsm_update_request_state()) lustre-MDT0000: Cannot find running request for cookie 0x68146392 on fid=[0x200000403:0x17d:0x0] [ 2640.765897] Lustre: DEBUG MARKER: == sanity-hsm test 252: Timeout'ed running archive of a removed file should be canceled ========================================================== 15:45:41 (1746128741) [ 2647.330161] LustreError: 7235:0:(mdt_coordinator.c:1719:mdt_hsm_update_request_state()) lustre-MDT0000: Cannot find running request for cookie 0x68146394 on fid=[0x200000403:0x182:0x0] [ 2647.347367] LustreError: 7235:0:(mdt_coordinator.c:1719:mdt_hsm_update_request_state()) Skipped 4 previous similar messages [ 2655.347905] Lustre: DEBUG MARKER: == sanity-hsm test 253: Check for wrong file size after release ========================================================== 15:45:56 (1746128756) [ 2661.731258] Lustre: DEBUG MARKER: == sanity-hsm test 254a: Request counters are initialized to zero ========================================================== 15:46:03 (1746128763) [ 2668.607914] Lustre: DEBUG MARKER: == sanity-hsm test 254b: Request counters are correctly incremented and decremented ========================================================== 15:46:10 (1746128770) [ 2702.687492] Lustre: DEBUG MARKER: == sanity-hsm test 255: Copytool registration wakes the coordinator up ========================================================== 15:46:44 (1746128804) [ 2726.866711] Lustre: DEBUG MARKER: == sanity-hsm test 260a: Restore request have priority over other requests ========================================================== 15:47:08 (1746128828) [ 2759.937738] Lustre: DEBUG MARKER: == sanity-hsm test 260b: Restore request have priority over other requests ========================================================== 15:47:40 (1746128860) [ 2793.388791] Lustre: DEBUG MARKER: == sanity-hsm test 260c: Requests are not reordered on the 'hot' path of the coordinator ========================================================== 15:48:14 (1746128894) [ 2833.188831] Lustre: DEBUG MARKER: == sanity-hsm test 261: Report 0 bytes size after HSM release ========================================================== 15:48:54 (1746128934) [ 2843.370001] Lustre: DEBUG MARKER: == sanity-hsm test 262: The client should return 1 block for HSM released files ========================================================== 15:49:04 (1746128944) [ 2853.697003] Lustre: DEBUG MARKER: == sanity-hsm test 300: On disk coordinator state kept between MDT umount/mount ========================================================== 15:49:14 (1746128954) [ 2857.606110] Lustre: Disabling parameter lustre.mdt.lustre-MDT0000.hsm_control in log params [ 2857.610619] Lustre: Skipped 1 previous similar message [ 2861.516649] Lustre: Failing over lustre-MDT0000 [ 2861.668963] LustreError: 30789:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 2861.675574] LustreError: 30789:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 2861.733230] Lustre: server umount lustre-MDT0000 complete [ 2863.298586] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2863.313778] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2863.339702] Lustre: Skipped 2 previous similar messages [ 2863.345195] LustreError: 9595:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2863.354168] LustreError: 9595:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 2 previous similar messages [ 2865.878867] LustreError: 7237:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.23@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2865.905334] LustreError: 7237:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 1 previous similar message [ 2866.137387] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2866.166521] Lustre: Skipped 2 previous similar messages [ 2870.863201] LustreError: 7236:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.23@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2870.901435] LustreError: 7236:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 5 previous similar messages [ 2875.872350] LustreError: 14409:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.23@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2875.926413] LustreError: 14409:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 5 previous similar messages [ 2878.423754] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2878.636579] LustreError: MGC192.168.201.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2878.894110] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2878.968711] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 2880.876189] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 2881.673293] Lustre: DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 2883.883648] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to (at 0@lo) [ 2883.896951] Lustre: Skipped 3 previous similar messages [ 2883.939539] Lustre: lustre-MDT0000: Recovery over after 0:03, of 3 clients 3 recovered and 0 were evicted. [ 2883.982718] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:361 to 0x2c0000401:385) [ 2883.986348] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:361 to 0x280000401:385) [ 2888.755239] Lustre: DEBUG MARKER: oleg123-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2890.522856] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 2894.569233] Lustre: Setting parameter lustre.mdt.lustre-MDT0000.hsm_control in log params [ 2894.573282] Lustre: Skipped 1 previous similar message [ 2918.665538] Lustre: Failing over lustre-MDT0000 [ 2918.844178] LustreError: 32502:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 2918.859853] LustreError: 32502:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 2918.954788] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2918.958354] LustreError: 24804:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2918.958356] LustreError: 24804:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 4 previous similar messages [ 2919.032516] Lustre: Skipped 3 previous similar messages [ 2919.084783] Lustre: server umount lustre-MDT0000 complete [ 2928.970504] LustreError: 27026:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2928.989514] LustreError: 27026:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 14 previous similar messages [ 2934.993719] Lustre: 3772:0:(client.c:2346:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1746129022/real 1746129022] req@ffff8800908cdf80 x1830945970983168/t0(0) o400->MGC192.168.201.123@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1746129038 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 [ 2935.024328] LustreError: MGC192.168.201.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2936.028701] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2945.046313] LustreError: 24804:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2945.074177] LustreError: 24804:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 23 previous similar messages [ 2945.279002] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2945.334827] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 2947.066500] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 2947.881938] Lustre: DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 2950.273227] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to (at 0@lo) [ 2950.279813] Lustre: Skipped 3 previous similar messages [ 2950.323619] Lustre: lustre-MDT0000: Recovery over after 0:03, of 3 clients 3 recovered and 0 were evicted. [ 2950.350798] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:361 to 0x280000401:417) [ 2950.351854] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:361 to 0x2c0000401:417) [ 2954.732585] Lustre: DEBUG MARKER: oleg123-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2956.070831] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 2965.968767] Lustre: DEBUG MARKER: == sanity-hsm test 301: HSM tunnable are persistent ====== 15:51:06 (1746129066) [ 2967.610096] Lustre: Setting parameter lustre.mdt.lustre-MDT0000.hsm.default_archive_id in log params [ 2967.614505] Lustre: Skipped 1 previous similar message [ 2970.243194] Lustre: Failing over lustre-MDT0000 [ 2970.310730] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2970.317513] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2970.537735] LustreError: 1984:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 2970.551779] LustreError: 1984:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 2970.673824] Lustre: server umount lustre-MDT0000 complete [ 2977.123561] LustreError: 24804:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.23@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2977.177793] LustreError: 24804:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 7 previous similar messages [ 2986.685322] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2986.871031] LustreError: MGC192.168.201.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2987.080041] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2987.123525] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 2987.150121] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 2989.234406] Lustre: DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 2992.084565] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to (at 0@lo) [ 2992.090778] Lustre: Skipped 3 previous similar messages [ 2992.128737] Lustre: lustre-MDT0000: Recovery over after 0:05, of 3 clients 3 recovered and 0 were evicted. [ 2992.229593] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:361 to 0x2c0000401:449) [ 2992.233538] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:361 to 0x280000401:449) [ 2995.104325] Lustre: DEBUG MARKER: oleg123-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2996.404519] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 2999.302664] Lustre: Disabling parameter lustre.mdt.lustre-MDT0000.hsm.default_archive_id in log params [ 2999.309630] Lustre: Skipped 1 previous similar message [ 3006.036177] Lustre: DEBUG MARKER: == sanity-hsm test 302: HSM tunnable are persistent when CDT is off ========================================================== 15:51:47 (1746129107) [ 3013.681738] Lustre: Failing over lustre-MDT0000 [ 3013.869073] LustreError: 4229:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 3013.871420] LustreError: 4229:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 3013.929665] Lustre: server umount lustre-MDT0000 complete [ 3017.135755] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3017.156346] Lustre: Skipped 6 previous similar messages [ 3029.600758] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3029.704975] LustreError: MGC192.168.201.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3029.851288] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3029.889217] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 3031.961297] Lustre: DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 3032.220020] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 3034.867701] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to (at 0@lo) [ 3034.872205] Lustre: Skipped 3 previous similar messages [ 3034.884797] Lustre: lustre-MDT0000: Recovery over after 0:03, of 3 clients 3 recovered and 0 were evicted. [ 3034.966821] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:361 to 0x2c0000401:481) [ 3034.972770] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:361 to 0x280000401:481) [ 3037.936948] Lustre: DEBUG MARKER: oleg123-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3038.964411] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 3041.988972] Lustre: Failing over lustre-MDT0001 [ 3042.285934] LustreError: 5534:0:(obd_class.h:479:obd_check_dev()) Device 27 not setup [ 3042.289639] Lustre: lustre-MDT0001: Not available for connect from 192.168.201.23@tcp (stopping) [ 3042.289641] Lustre: Skipped 4 previous similar messages [ 3042.348522] LustreError: 5534:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 3042.463733] Lustre: server umount lustre-MDT0001 complete [ 3044.870863] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 3044.874780] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3044.881111] LustreError: 14409:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3044.881114] LustreError: 14409:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 28 previous similar messages [ 3044.957003] Lustre: Skipped 2 previous similar messages [ 3059.221247] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3059.429093] Lustre: 6074:0:(mgc_request_server.c:550:mgc_llog_local_copy()) MGC192.168.201.123@tcp: no remote llog for lustre-sptlrpc, check MGS config [ 3059.709012] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3059.726777] Lustre: lustre-MDT0001: in recovery but waiting for the first client to connect [ 3061.506807] Lustre: lustre-MDT0001: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 3062.388227] Lustre: DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 3064.716854] Lustre: lustre-MDT0001: Recovery over after 0:04, of 3 clients 3 recovered and 0 were evicted. [ 3064.716886] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to (at 0@lo) [ 3064.716888] Lustre: Skipped 3 previous similar messages [ 3064.785696] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:228 to 0x2c0000400:257) [ 3064.787956] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:228 to 0x280000400:257) [ 3067.920014] Lustre: DEBUG MARKER: oleg123-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3069.127345] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 3073.656052] Lustre: Disabling parameter lustre.mdt.lustre-MDT0000.hsm.default_archive_id in log params [ 3073.660636] Lustre: Skipped 3 previous similar messages [ 3080.214353] Lustre: DEBUG MARKER: == sanity-hsm test 400: Single request is sent to the right MDT ========================================================== 15:53:01 (1746129181) [ 3088.986894] Lustre: DEBUG MARKER: == sanity-hsm test 401: Compound requests split and sent to their respective MDTs ========================================================== 15:53:10 (1746129190) [ 3098.780453] Lustre: DEBUG MARKER: == sanity-hsm test 402a: Copytool start fails if all MDTs are inactive ========================================================== 15:53:20 (1746129200) [ 3101.584401] Lustre: lustre-MDT0000: Client 73861046-96ae-43d3-b2e2-b54feee4506d (at 192.168.201.23@tcp) reconnecting [ 3106.961395] Lustre: DEBUG MARKER: == sanity-hsm test 402b: CDT must retry request upon slow start of CT ========================================================== 15:53:28 (1746129208) [ 3108.221633] LustreError: 4808:0:(mdt_hsm_cdt_agent.c:561:mdt_hsm_agent_send()) lustre-MDT0000: cannot send request to agent '483e2b12-401b-40c8-a543-eb1a1d9632b0': rc = -11 [ 3112.240350] LustreError: 4808:0:(mdt_hsm_cdt_agent.c:561:mdt_hsm_agent_send()) lustre-MDT0000: cannot send request to agent '483e2b12-401b-40c8-a543-eb1a1d9632b0': rc = -11 [ 3127.819345] Lustre: DEBUG MARKER: == sanity-hsm test 403: Copytool starts with inactive MDT and register on reconnect ========================================================== 15:53:49 (1746129229) [ 3130.502602] Lustre: DEBUG MARKER: oleg123-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool [ 3133.253892] Lustre: DEBUG MARKER: oleg123-client.virtnet: executing get_client_uuid /mnt/lustre2 [ 3134.923816] Lustre: lustre-MDT0001: Client 73861046-96ae-43d3-b2e2-b54feee4506d (at 192.168.201.23@tcp) reconnecting [ 3134.930180] Lustre: Skipped 3 previous similar messages [ 3141.277170] Lustre: DEBUG MARKER: == sanity-hsm test 404: Inactive MDT does not block requests for active MDTs ========================================================== 15:54:02 (1746129242) [ 3142.972931] Lustre: lustre-MDT0001: Client 73861046-96ae-43d3-b2e2-b54feee4506d (at 192.168.201.23@tcp) reconnecting [ 3142.978919] Lustre: Skipped 1 previous similar message [ 3143.108138] Lustre: HSM agent 483e2b12-401b-40c8-a543-eb1a1d9632b0 already registered [ 3148.265020] Lustre: DEBUG MARKER: == sanity-hsm test 405: archive and release under striped directory ========================================================== 15:54:09 (1746129249) [ 3163.009450] Lustre: DEBUG MARKER: == sanity-hsm test 406: attempting to migrate HSM archived files is safe ========================================================== 15:54:24 (1746129264) [ 3164.573009] LustreError: 7250:0:(mdt_reint.c:2523:mdt_reint_migrate()) lustre-MDT0000: migrate [0x240000bd3:0x4:0x0]/f406.sanity-hsm failed: rc = -95 [ 3176.766913] Lustre: DEBUG MARKER: == sanity-hsm test 407: Check for double RESTORE records in llog ========================================================== 15:54:38 (1746129278) [ 3178.917277] LustreError: 7236:0:(mdt_hsm_cdt_client.c:366:mdt_hsm_register_hal()) cfs_fail_timeout id 164 sleeping for 5000ms [ 3183.087588] Lustre: Failing over lustre-MDT0000 [ 3183.962359] LustreError: 7236:0:(mdt_hsm_cdt_client.c:366:mdt_hsm_register_hal()) cfs_fail_timeout id 164 awake [ 3184.036269] Lustre: lustre-MDT0000: Not available for connect from 192.168.201.23@tcp (stopping) [ 3184.131312] LustreError: 12006:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 3184.138813] LustreError: 12006:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 3184.247855] Lustre: server umount lustre-MDT0000 complete [ 3184.913346] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3184.928389] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3184.946927] LustreError: 27411:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3184.962837] LustreError: 27411:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 14 previous similar messages [ 3199.600261] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3199.721592] LustreError: MGC192.168.201.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3199.956643] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3199.976923] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 3201.529112] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 3202.309290] Lustre: DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 3204.946482] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to (at 0@lo) [ 3204.956144] Lustre: Skipped 2 previous similar messages [ 3204.990270] Lustre: lustre-MDT0000: Recovery over after 0:04, of 3 clients 3 recovered and 0 were evicted. [ 3205.014862] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:486 to 0x2c0000401:513) [ 3205.015271] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:487 to 0x280000401:513) [ 3207.443378] Lustre: DEBUG MARKER: oleg123-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3208.374384] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 3216.909972] Lustre: DEBUG MARKER: == sanity-hsm test 408: Verify fiemap on release file ==== 15:55:18 (1746129318) [ 3223.727409] Lustre: DEBUG MARKER: == sanity-hsm test 409a: Coordinator should not stop when in use ========================================================== 15:55:25 (1746129325) [ 3227.281816] LustreError: 32418:0:(mdt_hsm_cdt_client.c:366:mdt_hsm_register_hal()) cfs_fail_timeout id 164 sleeping for 5000ms [ 3232.348578] LustreError: 32418:0:(mdt_hsm_cdt_client.c:366:mdt_hsm_register_hal()) cfs_fail_timeout id 164 awake [ 3249.780158] Lustre: DEBUG MARKER: == sanity-hsm test 409b: getattr released file with CDT stopped after remount ========================================================== 15:55:51 (1746129351) [ 3252.155870] Lustre: Modifying parameter lustre.mdt.lustre-MDT0000.hsm_control in log params [ 3252.159765] Lustre: Skipped 1 previous similar message [ 3275.617885] Lustre: Failing over lustre-MDT0000 [ 3275.787890] LustreError: 16083:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 3275.802568] LustreError: 16083:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 3275.927745] Lustre: server umount lustre-MDT0000 complete [ 3280.072077] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3280.081740] Lustre: Skipped 6 previous similar messages [ 3292.054683] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3292.203905] LustreError: MGC192.168.201.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3292.392858] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3292.436573] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 3292.709272] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 3295.115009] Lustre: DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 3297.391163] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to (at 0@lo) [ 3297.396586] Lustre: Skipped 3 previous similar messages [ 3297.424017] Lustre: lustre-MDT0000: Recovery over after 0:05, of 3 clients 3 recovered and 0 were evicted. [ 3297.471443] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:517 to 0x2c0000401:545) [ 3297.471545] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:516 to 0x280000401:545) [ 3301.114547] Lustre: DEBUG MARKER: oleg123-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3302.519722] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 3332.740088] Lustre: DEBUG MARKER: == sanity-hsm test 410: lfs data_version -s allows release of force-archived file ========================================================== 15:57:14 (1746129434) [ 3338.880298] Lustre: DEBUG MARKER: == sanity-hsm test 411: hsm_ops rbac role ================ 15:57:20 (1746129440) [ 3422.613897] Lustre: DEBUG MARKER: == sanity-hsm test 500: various LLAPI HSM tests ========== 15:58:44 (1746129524) [ 3485.334162] Lustre: HSM agent 73861046-96ae-43d3-b2e2-b54feee4506d already registered [ 3503.217119] LustreError: 7235:0:(mdt_coordinator.c:1719:mdt_hsm_update_request_state()) lustre-MDT0001: Cannot find running request for cookie 0x6813d11e on fid=[0x240000bd3:0x13:0x0] [ 3518.387918] Lustre: DEBUG MARKER: == sanity-hsm test 600: Changelog fields 'u=' and 'nid=' ========================================================== 16:00:20 (1746129620) [ 3520.350959] Lustre: lustre-MDD0000: changelog on [ 3520.353116] Lustre: Skipped 9 previous similar messages [ 3528.871507] Lustre: lustre-MDD0001: changelog off [ 3528.874359] Lustre: Skipped 4 previous similar messages [ 3533.276880] Lustre: DEBUG MARKER: == sanity-hsm test 601: OPEN Changelog entry ============= 16:00:34 (1746129634) [ 3538.008082] Lustre: lustre-MDD0001: changelog on [ 3538.010545] Lustre: Skipped 2 previous similar messages [ 3546.546943] Lustre: lustre-MDD0000: changelog off [ 3546.552166] Lustre: Skipped 2 previous similar messages [ 3548.578414] Lustre: DEBUG MARKER: == sanity-hsm test 602: Changelog record CLOSE only if open+write or OPEN recorded ========================================================== 16:00:49 (1746129649) [ 3567.142772] Lustre: DEBUG MARKER: == sanity-hsm test 603: GETXATTR Changelog entry ========= 16:01:08 (1746129668) [ 3571.641199] Lustre: lustre-MDD0001: changelog on [ 3571.642789] Lustre: Skipped 3 previous similar messages [ 3579.275759] Lustre: lustre-MDD0001: changelog off [ 3579.277779] Lustre: Skipped 2 previous similar messages [ 3583.843165] Lustre: DEBUG MARKER: == sanity-hsm test 604: NOPEN Changelog entry ============ 16:01:25 (1746129685) [ 3621.770848] Lustre: DEBUG MARKER: == sanity-hsm test 605: Test OPEN and CLOSE rate limit in Changelogs ========================================================== 16:02:03 (1746129723) [ 3639.337193] Lustre: DEBUG MARKER: == sanity-hsm test 606: llog_reader groks changelog fields ========================================================== 16:02:20 (1746129740) [ 3643.040896] Lustre: lustre-MDD0000: changelog on [ 3643.043073] Lustre: Skipped 4 previous similar messages [ 3647.500557] Lustre: Failing over lustre-MDT0000 [ 3647.658446] LustreError: 28504:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 3647.664368] LustreError: 28504:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 3647.759365] Lustre: server umount lustre-MDT0000 complete [ 3647.977406] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3647.978220] LustreError: 7235:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3647.978223] LustreError: 7235:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 37 previous similar messages [ 3648.017576] Lustre: Skipped 3 previous similar messages [ 3652.314939] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 3662.853793] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3662.951503] LustreError: MGC192.168.201.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3663.001678] Lustre: lustre-MDT0000: Not available for connect from 0@lo (not set up) [ 3663.005093] Lustre: Skipped 3 previous similar messages [ 3663.105435] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3663.149259] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 3663.359791] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 3665.437524] Lustre: DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 3668.066189] Lustre: lustre-MDD0001: changelog off [ 3668.067938] Lustre: Skipped 5 previous similar messages [ 3668.107272] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to (at 0@lo) [ 3668.123761] Lustre: Skipped 3 previous similar messages [ 3668.164837] Lustre: lustre-MDT0000: Recovery over after 0:05, of 3 clients 3 recovered and 0 were evicted. [ 3668.241154] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:551 to 0x2c0000401:577) [ 3668.241359] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:550 to 0x280000401:577) [ 3672.911862] Lustre: DEBUG MARKER: == sanity-hsm test 607a: release a file that was migrated after being archived ========================================================== 16:02:54 (1746129774) [ 3683.885938] Lustre: DEBUG MARKER: == sanity-hsm test 607b: Migrate should not change the HSM attribute of dirty files ========================================================== 16:03:05 (1746129785) [ 3687.065461] Lustre: DEBUG MARKER: sanity-hsm test_607b: @@@@@@ FAIL: could not migrate file to OST 1