Apr 3 01:18:07 oleg421-client kernel: Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 Apr 3 01:18:07 oleg421-client kernel: Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 Apr 3 01:18:07 oleg421-client kernel: x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' Apr 3 01:18:07 oleg421-client kernel: x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' Apr 3 01:18:07 oleg421-client kernel: x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' Apr 3 01:18:07 oleg421-client kernel: x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 Apr 3 01:18:07 oleg421-client kernel: x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. Apr 3 01:18:07 oleg421-client kernel: signal: max sigframe size: 1776 Apr 3 01:18:07 oleg421-client kernel: BIOS-provided physical RAM map: Apr 3 01:18:07 oleg421-client kernel: BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable Apr 3 01:18:07 oleg421-client kernel: BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved Apr 3 01:18:07 oleg421-client kernel: BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved Apr 3 01:18:07 oleg421-client kernel: BIOS-e820: [mem 0x0000000000100000-0x00000000bffd9fff] usable Apr 3 01:18:07 oleg421-client kernel: BIOS-e820: [mem 0x00000000bffda000-0x00000000bfffffff] reserved Apr 3 01:18:07 oleg421-client kernel: BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved Apr 3 01:18:07 oleg421-client kernel: BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved Apr 3 01:18:07 oleg421-client kernel: BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable Apr 3 01:18:07 oleg421-client kernel: NX (Execute Disable) protection: active Apr 3 01:18:07 oleg421-client kernel: SMBIOS 2.8 present. Apr 3 01:18:07 oleg421-client kernel: DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-8.fc42 06/10/2025 Apr 3 01:18:07 oleg421-client kernel: Hypervisor detected: KVM Apr 3 01:18:07 oleg421-client kernel: kvm-clock: Using msrs 4b564d01 and 4b564d00 Apr 3 01:18:07 oleg421-client kernel: kvm-clock: using sched offset of 440165439 cycles Apr 3 01:18:07 oleg421-client kernel: clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns Apr 3 01:18:07 oleg421-client kernel: tsc: Detected 2399.998 MHz processor Apr 3 01:18:07 oleg421-client kernel: e820: update [mem 0x00000000-0x00000fff] usable ==> reserved Apr 3 01:18:07 oleg421-client kernel: e820: remove [mem 0x000a0000-0x000fffff] usable Apr 3 01:18:07 oleg421-client kernel: last_pfn = 0x146e00 max_arch_pfn = 0x400000000 Apr 3 01:18:07 oleg421-client kernel: MTRR default type: write-back Apr 3 01:18:07 oleg421-client kernel: MTRR fixed ranges enabled: Apr 3 01:18:07 oleg421-client kernel: 00000-9FFFF write-back Apr 3 01:18:07 oleg421-client kernel: A0000-BFFFF uncachable Apr 3 01:18:07 oleg421-client kernel: C0000-FFFFF write-protect Apr 3 01:18:07 oleg421-client kernel: MTRR variable ranges enabled: Apr 3 01:18:07 oleg421-client kernel: 0 base 0000C0000000 mask 3FFFC0000000 uncachable Apr 3 01:18:07 oleg421-client kernel: 1 disabled Apr 3 01:18:07 oleg421-client kernel: 2 disabled Apr 3 01:18:07 oleg421-client kernel: 3 disabled Apr 3 01:18:07 oleg421-client kernel: 4 disabled Apr 3 01:18:07 oleg421-client kernel: 5 disabled Apr 3 01:18:07 oleg421-client kernel: 6 disabled Apr 3 01:18:07 oleg421-client kernel: 7 disabled Apr 3 01:18:07 oleg421-client kernel: x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT Apr 3 01:18:07 oleg421-client kernel: last_pfn = 0xbffda max_arch_pfn = 0x400000000 Apr 3 01:18:07 oleg421-client kernel: found SMP MP-table at [mem 0x000f54d0-0x000f54df] Apr 3 01:18:07 oleg421-client kernel: BRK [0x121201000, 0x121201fff] PGTABLE Apr 3 01:18:07 oleg421-client kernel: BRK [0x121202000, 0x121202fff] PGTABLE Apr 3 01:18:07 oleg421-client kernel: BRK [0x121203000, 0x121203fff] PGTABLE Apr 3 01:18:07 oleg421-client kernel: BRK [0x121204000, 0x121204fff] PGTABLE Apr 3 01:18:07 oleg421-client kernel: BRK [0x121205000, 0x121205fff] PGTABLE Apr 3 01:18:07 oleg421-client kernel: BRK [0x121206000, 0x121206fff] PGTABLE Apr 3 01:18:07 oleg421-client kernel: BRK [0x121207000, 0x121207fff] PGTABLE Apr 3 01:18:07 oleg421-client kernel: BRK [0x121208000, 0x121208fff] PGTABLE Apr 3 01:18:07 oleg421-client kernel: BRK [0x121209000, 0x121209fff] PGTABLE Apr 3 01:18:07 oleg421-client kernel: BRK [0x12120a000, 0x12120afff] PGTABLE Apr 3 01:18:07 oleg421-client kernel: BRK [0x12120b000, 0x12120bfff] PGTABLE Apr 3 01:18:07 oleg421-client kernel: BRK [0x12120c000, 0x12120cfff] PGTABLE Apr 3 01:18:07 oleg421-client kernel: RAMDISK: [mem 0xbcc64000-0xbffcffff] Apr 3 01:18:07 oleg421-client kernel: ACPI: Early table checksum verification disabled Apr 3 01:18:07 oleg421-client kernel: ACPI: RSDP 0x00000000000F52F0 000014 (v00 BOCHS ) Apr 3 01:18:07 oleg421-client kernel: ACPI: RSDT 0x00000000BFFE2421 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) Apr 3 01:18:07 oleg421-client kernel: ACPI: FACP 0x00000000BFFE22BD 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) Apr 3 01:18:07 oleg421-client kernel: ACPI: DSDT 0x00000000BFFE0040 00227D (v01 BOCHS BXPC 00000001 BXPC 00000001) Apr 3 01:18:07 oleg421-client kernel: ACPI: FACS 0x00000000BFFE0000 000040 Apr 3 01:18:07 oleg421-client kernel: ACPI: APIC 0x00000000BFFE2331 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) Apr 3 01:18:07 oleg421-client kernel: ACPI: HPET 0x00000000BFFE23C1 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) Apr 3 01:18:07 oleg421-client kernel: ACPI: WAET 0x00000000BFFE23F9 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) Apr 3 01:18:07 oleg421-client kernel: ACPI: Reserving FACP table memory at [mem 0xbffe22bd-0xbffe2330] Apr 3 01:18:07 oleg421-client kernel: ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe22bc] Apr 3 01:18:07 oleg421-client kernel: ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] Apr 3 01:18:07 oleg421-client kernel: ACPI: Reserving APIC table memory at [mem 0xbffe2331-0xbffe23c0] Apr 3 01:18:07 oleg421-client kernel: ACPI: Reserving HPET table memory at [mem 0xbffe23c1-0xbffe23f8] Apr 3 01:18:07 oleg421-client kernel: ACPI: Reserving WAET table memory at [mem 0xbffe23f9-0xbffe2420] Apr 3 01:18:07 oleg421-client kernel: ACPI: Local APIC address 0xfee00000 Apr 3 01:18:07 oleg421-client kernel: No NUMA configuration found Apr 3 01:18:07 oleg421-client kernel: Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] Apr 3 01:18:07 oleg421-client kernel: NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] Apr 3 01:18:07 oleg421-client kernel: Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) Apr 3 01:18:07 oleg421-client kernel: Zone ranges: Apr 3 01:18:07 oleg421-client kernel: DMA [mem 0x0000000000001000-0x0000000000ffffff] Apr 3 01:18:07 oleg421-client kernel: DMA32 [mem 0x0000000001000000-0x00000000ffffffff] Apr 3 01:18:07 oleg421-client kernel: Normal [mem 0x0000000100000000-0x0000000146dfffff] Apr 3 01:18:07 oleg421-client kernel: Device empty Apr 3 01:18:07 oleg421-client kernel: Movable zone start for each node Apr 3 01:18:07 oleg421-client kernel: Early memory node ranges Apr 3 01:18:07 oleg421-client kernel: node 0: [mem 0x0000000000001000-0x000000000009efff] Apr 3 01:18:07 oleg421-client kernel: node 0: [mem 0x0000000000100000-0x00000000bffd9fff] Apr 3 01:18:07 oleg421-client kernel: node 0: [mem 0x0000000100000000-0x0000000146dfffff] Apr 3 01:18:07 oleg421-client kernel: Zeroed struct page in unavailable ranges: 4744 pages Apr 3 01:18:07 oleg421-client kernel: Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] Apr 3 01:18:07 oleg421-client kernel: On node 0 totalpages: 1076600 Apr 3 01:18:07 oleg421-client kernel: DMA zone: 64 pages used for memmap Apr 3 01:18:07 oleg421-client kernel: DMA zone: 158 pages reserved Apr 3 01:18:07 oleg421-client kernel: DMA zone: 3998 pages, LIFO batch:0 Apr 3 01:18:07 oleg421-client kernel: DMA32 zone: 12224 pages used for memmap Apr 3 01:18:07 oleg421-client kernel: DMA32 zone: 782298 pages, LIFO batch:63 Apr 3 01:18:07 oleg421-client kernel: Normal zone: 4536 pages used for memmap Apr 3 01:18:07 oleg421-client kernel: Normal zone: 290304 pages, LIFO batch:63 Apr 3 01:18:07 oleg421-client kernel: ACPI: PM-Timer IO Port: 0x608 Apr 3 01:18:07 oleg421-client kernel: ACPI: Local APIC address 0xfee00000 Apr 3 01:18:07 oleg421-client kernel: ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) Apr 3 01:18:07 oleg421-client kernel: IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 Apr 3 01:18:07 oleg421-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) Apr 3 01:18:07 oleg421-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) Apr 3 01:18:07 oleg421-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) Apr 3 01:18:07 oleg421-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) Apr 3 01:18:07 oleg421-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) Apr 3 01:18:07 oleg421-client kernel: ACPI: IRQ0 used by override. Apr 3 01:18:07 oleg421-client kernel: ACPI: IRQ5 used by override. Apr 3 01:18:07 oleg421-client kernel: ACPI: IRQ9 used by override. Apr 3 01:18:07 oleg421-client kernel: ACPI: IRQ10 used by override. Apr 3 01:18:07 oleg421-client kernel: ACPI: IRQ11 used by override. Apr 3 01:18:07 oleg421-client kernel: Using ACPI (MADT) for SMP configuration information Apr 3 01:18:07 oleg421-client kernel: ACPI: HPET id: 0x8086a201 base: 0xfed00000 Apr 3 01:18:07 oleg421-client kernel: TSC deadline timer available Apr 3 01:18:07 oleg421-client kernel: smpboot: Allowing 4 CPUs, 0 hotplug CPUs Apr 3 01:18:07 oleg421-client kernel: kvm-guest: KVM setup pv remote TLB flush Apr 3 01:18:07 oleg421-client kernel: kvm-guest: setup PV sched yield Apr 3 01:18:07 oleg421-client kernel: PM: Registered nosave memory: [mem 0x00000000-0x00000fff] Apr 3 01:18:07 oleg421-client kernel: PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] Apr 3 01:18:07 oleg421-client kernel: PM: Registered nosave memory: [mem 0x000a0000-0x000effff] Apr 3 01:18:07 oleg421-client kernel: PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] Apr 3 01:18:07 oleg421-client kernel: PM: Registered nosave memory: [mem 0xbffda000-0xbfffffff] Apr 3 01:18:07 oleg421-client kernel: PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] Apr 3 01:18:07 oleg421-client kernel: PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] Apr 3 01:18:07 oleg421-client kernel: PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] Apr 3 01:18:07 oleg421-client kernel: PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] Apr 3 01:18:07 oleg421-client kernel: [mem 0xc0000000-0xfeffbfff] available for PCI devices Apr 3 01:18:07 oleg421-client kernel: Booting paravirtualized kernel on KVM Apr 3 01:18:07 oleg421-client kernel: clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns Apr 3 01:18:07 oleg421-client kernel: setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 Apr 3 01:18:07 oleg421-client kernel: percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 Apr 3 01:18:07 oleg421-client kernel: pcpu-alloc: s221184 r8192 d28672 u524288 alloc=1*2097152 Apr 3 01:18:07 oleg421-client kernel: pcpu-alloc: [0] 0 1 2 3 Apr 3 01:18:07 oleg421-client kernel: kvm-guest: PV spinlocks enabled Apr 3 01:18:07 oleg421-client kernel: PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) Apr 3 01:18:07 oleg421-client kernel: Built 1 zonelists, mobility grouping on. Total pages: 1059618 Apr 3 01:18:07 oleg421-client kernel: Policy zone: Normal Apr 3 01:18:07 oleg421-client kernel: Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 Apr 3 01:18:07 oleg421-client kernel: Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. Apr 3 01:18:07 oleg421-client kernel: audit: disabled (until reboot) Apr 3 01:18:07 oleg421-client kernel: software IO TLB: area num 4. Apr 3 01:18:07 oleg421-client kernel: Memory: 2895288K/4306400K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524584K reserved, 0K cma-reserved) Apr 3 01:18:07 oleg421-client kernel: SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 Apr 3 01:18:07 oleg421-client kernel: kmemleak: Kernel memory leak detector disabled Apr 3 01:18:07 oleg421-client kernel: ftrace: allocating 41240 entries in 162 pages Apr 3 01:18:07 oleg421-client kernel: ftrace: allocated 162 pages with 3 groups Apr 3 01:18:07 oleg421-client kernel: rcu: Hierarchical RCU implementation. Apr 3 01:18:07 oleg421-client kernel: rcu: #011RCU event tracing is enabled. Apr 3 01:18:07 oleg421-client kernel: rcu: #011RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. Apr 3 01:18:07 oleg421-client kernel: rcu: #011RCU callback double-/use-after-free debug enabled. Apr 3 01:18:07 oleg421-client kernel: #011Rude variant of Tasks RCU enabled. Apr 3 01:18:07 oleg421-client kernel: #011Tracing variant of Tasks RCU enabled. Apr 3 01:18:07 oleg421-client kernel: rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. Apr 3 01:18:07 oleg421-client kernel: rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 Apr 3 01:18:07 oleg421-client kernel: NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 Apr 3 01:18:07 oleg421-client kernel: random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 Apr 3 01:18:07 oleg421-client kernel: Console: colour *CGA 80x25 Apr 3 01:18:07 oleg421-client kernel: printk: console [ttyS1] enabled Apr 3 01:18:07 oleg421-client kernel: ACPI: Core revision 20220331 Apr 3 01:18:07 oleg421-client kernel: clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns Apr 3 01:18:07 oleg421-client kernel: hpet clockevent registered Apr 3 01:18:07 oleg421-client kernel: APIC: Switch to symmetric I/O mode setup Apr 3 01:18:07 oleg421-client kernel: x2apic enabled Apr 3 01:18:07 oleg421-client kernel: Switched APIC routing to physical x2apic. Apr 3 01:18:07 oleg421-client kernel: kvm-guest: setup PV IPIs Apr 3 01:18:07 oleg421-client kernel: ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 Apr 3 01:18:07 oleg421-client kernel: clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns Apr 3 01:18:07 oleg421-client kernel: Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) Apr 3 01:18:07 oleg421-client kernel: pid_max: default: 32768 minimum: 301 Apr 3 01:18:07 oleg421-client kernel: LSM: Security Framework initializing Apr 3 01:18:07 oleg421-client kernel: Yama: becoming mindful. Apr 3 01:18:07 oleg421-client kernel: SELinux: Initializing. Apr 3 01:18:07 oleg421-client kernel: *** VALIDATE selinux *** Apr 3 01:18:07 oleg421-client kernel: Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) Apr 3 01:18:07 oleg421-client kernel: Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) Apr 3 01:18:07 oleg421-client kernel: Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) Apr 3 01:18:07 oleg421-client kernel: Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) Apr 3 01:18:07 oleg421-client kernel: *** VALIDATE tmpfs *** Apr 3 01:18:07 oleg421-client kernel: *** VALIDATE proc *** Apr 3 01:18:07 oleg421-client kernel: *** VALIDATE cgroup *** Apr 3 01:18:07 oleg421-client kernel: *** VALIDATE cgroup2 *** Apr 3 01:18:07 oleg421-client kernel: x86/cpu: User Mode Instruction Prevention (UMIP) activated Apr 3 01:18:07 oleg421-client kernel: Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 Apr 3 01:18:07 oleg421-client kernel: Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 Apr 3 01:18:07 oleg421-client kernel: Spectre V2 : User space: Vulnerable Apr 3 01:18:07 oleg421-client kernel: Speculative Store Bypass: Vulnerable Apr 3 01:18:07 oleg421-client kernel: debug: unmapping init [mem 0xffffffffa6c59000-0xffffffffa6c60fff] Apr 3 01:18:07 oleg421-client kernel: smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) Apr 3 01:18:07 oleg421-client kernel: Performance Events: IvyBridge events, full-width counters, Intel PMU driver. Apr 3 01:18:07 oleg421-client kernel: ... version: 2 Apr 3 01:18:07 oleg421-client kernel: ... bit width: 48 Apr 3 01:18:07 oleg421-client kernel: ... generic registers: 4 Apr 3 01:18:07 oleg421-client kernel: ... value mask: 0000ffffffffffff Apr 3 01:18:07 oleg421-client kernel: ... max period: 00007fffffffffff Apr 3 01:18:07 oleg421-client kernel: ... fixed-purpose events: 3 Apr 3 01:18:07 oleg421-client kernel: ... event mask: 000000070000000f Apr 3 01:18:07 oleg421-client kernel: rcu: Hierarchical SRCU implementation. Apr 3 01:18:07 oleg421-client kernel: smp: Bringing up secondary CPUs ... Apr 3 01:18:07 oleg421-client kernel: x86: Booting SMP configuration: Apr 3 01:18:07 oleg421-client kernel: .... node #0, CPUs: #1 #2 #3 Apr 3 01:18:07 oleg421-client kernel: smp: Brought up 1 node, 4 CPUs Apr 3 01:18:07 oleg421-client kernel: smpboot: Max logical packages: 1 Apr 3 01:18:07 oleg421-client kernel: smpboot: Total of 4 processors activated (19199.98 BogoMIPS) Apr 3 01:18:07 oleg421-client kernel: node 0 deferred pages initialised in 43ms Apr 3 01:18:07 oleg421-client kernel: devtmpfs: initialized Apr 3 01:18:07 oleg421-client kernel: x86/mm: Memory block size: 128MB Apr 3 01:18:07 oleg421-client kernel: gcov: version magic: 0x41383552 Apr 3 01:18:07 oleg421-client kernel: clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns Apr 3 01:18:07 oleg421-client kernel: futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) Apr 3 01:18:07 oleg421-client kernel: pinctrl core: initialized pinctrl subsystem Apr 3 01:18:07 oleg421-client kernel: Apr 3 01:18:07 oleg421-client kernel: ************************************************************* Apr 3 01:18:07 oleg421-client kernel: ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** Apr 3 01:18:07 oleg421-client kernel: ** ** Apr 3 01:18:07 oleg421-client kernel: ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** Apr 3 01:18:07 oleg421-client kernel: ** ** Apr 3 01:18:07 oleg421-client kernel: ** This means that this kernel is built to expose internal ** Apr 3 01:18:07 oleg421-client kernel: ** IOMMU data structures, which may compromise security on ** Apr 3 01:18:07 oleg421-client kernel: ** your system. ** Apr 3 01:18:07 oleg421-client kernel: ** ** Apr 3 01:18:07 oleg421-client kernel: ** If you see this message and you are not debugging the ** Apr 3 01:18:07 oleg421-client kernel: ** kernel, report this immediately to your vendor! ** Apr 3 01:18:07 oleg421-client kernel: ** ** Apr 3 01:18:07 oleg421-client kernel: ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** Apr 3 01:18:07 oleg421-client kernel: ************************************************************* Apr 3 01:18:07 oleg421-client kernel: NET: Registered protocol family 16 Apr 3 01:18:07 oleg421-client kernel: DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations Apr 3 01:18:07 oleg421-client kernel: DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations Apr 3 01:18:07 oleg421-client kernel: DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations Apr 3 01:18:07 oleg421-client kernel: cpuidle: using governor menu Apr 3 01:18:07 oleg421-client kernel: acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 Apr 3 01:18:07 oleg421-client kernel: PCI: Using configuration type 1 for base access Apr 3 01:18:07 oleg421-client kernel: core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on Apr 3 01:18:07 oleg421-client kernel: HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages Apr 3 01:18:07 oleg421-client kernel: HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages Apr 3 01:18:07 oleg421-client kernel: cryptd: max_cpu_qlen set to 1000 Apr 3 01:18:07 oleg421-client kernel: ACPI: Added _OSI(Module Device) Apr 3 01:18:07 oleg421-client kernel: ACPI: Added _OSI(Processor Device) Apr 3 01:18:07 oleg421-client kernel: ACPI: Added _OSI(3.0 _SCP Extensions) Apr 3 01:18:07 oleg421-client kernel: ACPI: Added _OSI(Processor Aggregator Device) Apr 3 01:18:07 oleg421-client kernel: ACPI: 1 ACPI AML tables successfully acquired and loaded Apr 3 01:18:07 oleg421-client kernel: ACPI: Interpreter enabled Apr 3 01:18:07 oleg421-client kernel: ACPI: PM: (supports S0 S3 S4 S5) Apr 3 01:18:07 oleg421-client kernel: ACPI: Using IOAPIC for interrupt routing Apr 3 01:18:07 oleg421-client kernel: PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug Apr 3 01:18:07 oleg421-client kernel: ACPI: Enabled 2 GPEs in block 00 to 0F Apr 3 01:18:07 oleg421-client kernel: ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) Apr 3 01:18:07 oleg421-client kernel: acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] Apr 3 01:18:07 oleg421-client kernel: acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] Apr 3 01:18:07 oleg421-client kernel: acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [2] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [5] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [6] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [3] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [4] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [7] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [8] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [9] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [10] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [11] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [12] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [13] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [14] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [15] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [16] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [17] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [18] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [19] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [20] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [21] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [22] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [23] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [24] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [25] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [26] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [27] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [28] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [29] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [30] registered Apr 3 01:18:07 oleg421-client kernel: acpiphp: Slot [31] registered Apr 3 01:18:07 oleg421-client kernel: PCI host bridge to bus 0000:00 Apr 3 01:18:07 oleg421-client kernel: pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] Apr 3 01:18:07 oleg421-client kernel: pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] Apr 3 01:18:07 oleg421-client kernel: pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] Apr 3 01:18:07 oleg421-client kernel: pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] Apr 3 01:18:07 oleg421-client kernel: pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] Apr 3 01:18:07 oleg421-client kernel: pci_bus 0000:00: root bus resource [bus 00-ff] Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:01.1: reg 0x20: [io 0xc120-0xc12f] Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:02.0: reg 0x10: [io 0xc100-0xc11f] Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] Apr 3 01:18:07 oleg421-client kernel: ACPI: PCI: Interrupt link LNKA configured for IRQ 10 Apr 3 01:18:07 oleg421-client kernel: ACPI: PCI: Interrupt link LNKB configured for IRQ 10 Apr 3 01:18:07 oleg421-client kernel: ACPI: PCI: Interrupt link LNKC configured for IRQ 11 Apr 3 01:18:07 oleg421-client kernel: ACPI: PCI: Interrupt link LNKD configured for IRQ 11 Apr 3 01:18:07 oleg421-client kernel: ACPI: PCI: Interrupt link LNKS configured for IRQ 9 Apr 3 01:18:07 oleg421-client kernel: iommu: Default domain type: Passthrough Apr 3 01:18:07 oleg421-client kernel: SCSI subsystem initialized Apr 3 01:18:07 oleg421-client kernel: ACPI: bus type USB registered Apr 3 01:18:07 oleg421-client kernel: usbcore: registered new interface driver usbfs Apr 3 01:18:07 oleg421-client kernel: usbcore: registered new interface driver hub Apr 3 01:18:07 oleg421-client kernel: usbcore: registered new device driver usb Apr 3 01:18:07 oleg421-client kernel: pps_core: LinuxPPS API ver. 1 registered Apr 3 01:18:07 oleg421-client kernel: pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti Apr 3 01:18:07 oleg421-client kernel: PTP clock support registered Apr 3 01:18:07 oleg421-client kernel: EDAC MC: Ver: 3.0.0 Apr 3 01:18:07 oleg421-client kernel: PCI: Using ACPI for IRQ routing Apr 3 01:18:07 oleg421-client kernel: PCI: pci_cache_line_size set to 64 bytes Apr 3 01:18:07 oleg421-client kernel: e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff] Apr 3 01:18:07 oleg421-client kernel: e820: reserve RAM buffer [mem 0xbffda000-0xbfffffff] Apr 3 01:18:07 oleg421-client kernel: e820: reserve RAM buffer [mem 0x146e00000-0x147ffffff] Apr 3 01:18:07 oleg421-client kernel: NetLabel: Initializing Apr 3 01:18:07 oleg421-client kernel: NetLabel: domain hash size = 128 Apr 3 01:18:07 oleg421-client kernel: NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO Apr 3 01:18:07 oleg421-client kernel: NetLabel: unlabeled traffic allowed by default Apr 3 01:18:07 oleg421-client kernel: vgaarb: loaded Apr 3 01:18:07 oleg421-client kernel: hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 Apr 3 01:18:07 oleg421-client kernel: hpet0: 3 comparators, 64-bit 100.000000 MHz counter Apr 3 01:18:07 oleg421-client kernel: clocksource: Switched to clocksource kvm-clock Apr 3 01:18:07 oleg421-client kernel: VFS: Disk quotas dquot_6.6.0 Apr 3 01:18:07 oleg421-client kernel: VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Apr 3 01:18:07 oleg421-client kernel: *** VALIDATE ramfs *** Apr 3 01:18:07 oleg421-client kernel: *** VALIDATE hugetlbfs *** Apr 3 01:18:07 oleg421-client kernel: pnp: PnP ACPI init Apr 3 01:18:07 oleg421-client kernel: pnp 00:00: Plug and Play ACPI device, IDs PNP0303 (active) Apr 3 01:18:07 oleg421-client kernel: pnp 00:01: Plug and Play ACPI device, IDs PNP0f13 (active) Apr 3 01:18:07 oleg421-client kernel: pnp 00:02: [dma 2] Apr 3 01:18:07 oleg421-client kernel: pnp 00:02: Plug and Play ACPI device, IDs PNP0700 (active) Apr 3 01:18:07 oleg421-client kernel: pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active) Apr 3 01:18:07 oleg421-client kernel: pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active) Apr 3 01:18:07 oleg421-client kernel: pnp 00:05: Plug and Play ACPI device, IDs PNP0b00 (active) Apr 3 01:18:07 oleg421-client kernel: pnp: PnP ACPI: found 6 devices Apr 3 01:18:07 oleg421-client kernel: clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns Apr 3 01:18:07 oleg421-client kernel: pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] Apr 3 01:18:07 oleg421-client kernel: pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] Apr 3 01:18:07 oleg421-client kernel: pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] Apr 3 01:18:07 oleg421-client kernel: pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] Apr 3 01:18:07 oleg421-client kernel: pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] Apr 3 01:18:07 oleg421-client kernel: NET: Registered protocol family 2 Apr 3 01:18:07 oleg421-client kernel: IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) Apr 3 01:18:07 oleg421-client kernel: tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) Apr 3 01:18:07 oleg421-client kernel: TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) Apr 3 01:18:07 oleg421-client kernel: TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) Apr 3 01:18:07 oleg421-client kernel: TCP: Hash tables configured (established 65536 bind 65536) Apr 3 01:18:07 oleg421-client kernel: MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) Apr 3 01:18:07 oleg421-client kernel: UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) Apr 3 01:18:07 oleg421-client kernel: UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) Apr 3 01:18:07 oleg421-client kernel: NET: Registered protocol family 1 Apr 3 01:18:07 oleg421-client kernel: RPC: Registered named UNIX socket transport module. Apr 3 01:18:07 oleg421-client kernel: RPC: Registered udp transport module. Apr 3 01:18:07 oleg421-client kernel: RPC: Registered tcp transport module. Apr 3 01:18:07 oleg421-client kernel: RPC: Registered tcp NFSv4.1 backchannel transport module. Apr 3 01:18:07 oleg421-client kernel: NET: Registered protocol family 44 Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:00.0: Limiting direct PCI/PCI transfers Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:01.0: PIIX3: Enabling Passive Release Apr 3 01:18:07 oleg421-client kernel: pci 0000:00:01.0: Activating ISA DMA hang workarounds Apr 3 01:18:07 oleg421-client kernel: PCI: CLS 0 bytes, default 64 Apr 3 01:18:07 oleg421-client kernel: Unpacking initramfs... Apr 3 01:18:07 oleg421-client kernel: debug: unmapping init [mem 0xffff9623fcc64000-0xffff9623fffcffff] Apr 3 01:18:07 oleg421-client kernel: PCI-DMA: Using software bounce buffering for IO (SWIOTLB) Apr 3 01:18:07 oleg421-client kernel: software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) Apr 3 01:18:07 oleg421-client kernel: clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns Apr 3 01:18:07 oleg421-client kernel: Initialise system trusted keyrings Apr 3 01:18:07 oleg421-client kernel: Key type blacklist registered Apr 3 01:18:07 oleg421-client kernel: workingset: timestamp_bits=36 max_order=20 bucket_order=0 Apr 3 01:18:07 oleg421-client kernel: zbud: loaded Apr 3 01:18:07 oleg421-client kernel: *** VALIDATE nfs *** Apr 3 01:18:07 oleg421-client kernel: *** VALIDATE nfs4 *** Apr 3 01:18:07 oleg421-client kernel: pstore: using deflate compression Apr 3 01:18:07 oleg421-client kernel: Platform Keyring initialized Apr 3 01:18:07 oleg421-client kernel: NET: Registered protocol family 38 Apr 3 01:18:07 oleg421-client kernel: Key type asymmetric registered Apr 3 01:18:07 oleg421-client kernel: Asymmetric key parser 'x509' registered Apr 3 01:18:07 oleg421-client kernel: Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) Apr 3 01:18:07 oleg421-client kernel: io scheduler mq-deadline registered Apr 3 01:18:07 oleg421-client kernel: io scheduler kyber registered Apr 3 01:18:07 oleg421-client kernel: io scheduler bfq registered Apr 3 01:18:07 oleg421-client kernel: atomic64_test: passed for x86-64 platform with CX8 and with SSE Apr 3 01:18:07 oleg421-client kernel: shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 Apr 3 01:18:07 oleg421-client kernel: input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 Apr 3 01:18:07 oleg421-client kernel: ACPI: Power Button [PWRF] Apr 3 01:18:07 oleg421-client kernel: ACPI: \_SB_.LNKB: Enabled at IRQ 10 Apr 3 01:18:07 oleg421-client kernel: ACPI: \_SB_.LNKA: Enabled at IRQ 11 Apr 3 01:18:07 oleg421-client kernel: Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled Apr 3 01:18:07 oleg421-client kernel: 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A Apr 3 01:18:07 oleg421-client kernel: 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A Apr 3 01:18:07 oleg421-client kernel: Non-volatile memory driver v1.3 Apr 3 01:18:07 oleg421-client kernel: Linux agpgart interface v0.103 Apr 3 01:18:07 oleg421-client kernel: virtio_blk virtio1: [vda] 133944 512-byte logical blocks (68.6 MB/65.4 MiB) Apr 3 01:18:07 oleg421-client kernel: vda: detected capacity change from 0 to 68579328 Apr 3 01:18:07 oleg421-client kernel: virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) Apr 3 01:18:07 oleg421-client kernel: vdb: detected capacity change from 0 to 1073741824 Apr 3 01:18:07 oleg421-client kernel: libphy: Fixed MDIO Bus: probed Apr 3 01:18:07 oleg421-client kernel: usbcore: registered new interface driver usbserial_generic Apr 3 01:18:07 oleg421-client kernel: usbserial: USB Serial support registered for generic Apr 3 01:18:07 oleg421-client kernel: i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 Apr 3 01:18:07 oleg421-client kernel: serio: i8042 KBD port at 0x60,0x64 irq 1 Apr 3 01:18:07 oleg421-client kernel: serio: i8042 AUX port at 0x60,0x64 irq 12 Apr 3 01:18:07 oleg421-client kernel: mousedev: PS/2 mouse device common for all mice Apr 3 01:18:07 oleg421-client kernel: rtc_cmos 00:05: RTC can wake from S4 Apr 3 01:18:07 oleg421-client kernel: rtc_cmos 00:05: registered as rtc0 Apr 3 01:18:07 oleg421-client kernel: input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 Apr 3 01:18:07 oleg421-client kernel: rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs Apr 3 01:18:07 oleg421-client kernel: input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 Apr 3 01:18:07 oleg421-client kernel: intel_pstate: CPU model not supported Apr 3 01:18:07 oleg421-client kernel: input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 Apr 3 01:18:07 oleg421-client kernel: hid: raw HID events driver (C) Jiri Kosina Apr 3 01:18:07 oleg421-client kernel: usbcore: registered new interface driver usbhid Apr 3 01:18:07 oleg421-client kernel: usbhid: USB HID core driver Apr 3 01:18:07 oleg421-client kernel: drop_monitor: Initializing network drop monitor service Apr 3 01:18:07 oleg421-client kernel: Initializing XFRM netlink socket Apr 3 01:18:07 oleg421-client kernel: NET: Registered protocol family 10 Apr 3 01:18:07 oleg421-client kernel: Segment Routing with IPv6 Apr 3 01:18:07 oleg421-client kernel: NET: Registered protocol family 17 Apr 3 01:18:07 oleg421-client kernel: mpls_gso: MPLS GSO support Apr 3 01:18:07 oleg421-client kernel: start plist test Apr 3 01:18:07 oleg421-client kernel: end plist test Apr 3 01:18:07 oleg421-client kernel: RAS: Correctable Errors collector initialized. Apr 3 01:18:07 oleg421-client kernel: AVX version of gcm_enc/dec engaged. Apr 3 01:18:07 oleg421-client kernel: AES CTR mode by8 optimization enabled Apr 3 01:18:07 oleg421-client kernel: sched_clock: Marking stable (3048433549, 0)->(4008757950, -960324401) Apr 3 01:18:07 oleg421-client kernel: registered taskstats version 1 Apr 3 01:18:07 oleg421-client kernel: Loading compiled-in X.509 certificates Apr 3 01:18:07 oleg421-client kernel: zswap: loaded using pool lzo/zbud Apr 3 01:18:07 oleg421-client kernel: Key type big_key registered Apr 3 01:18:07 oleg421-client kernel: Key type encrypted registered Apr 3 01:18:07 oleg421-client kernel: ima: No TPM chip found, activating TPM-bypass! Apr 3 01:18:07 oleg421-client kernel: ima: Allocated hash algorithm: sha1 Apr 3 01:18:07 oleg421-client kernel: ima: No architecture policies found Apr 3 01:18:07 oleg421-client kernel: evm: Initialising EVM extended attributes: Apr 3 01:18:07 oleg421-client kernel: evm: security.selinux Apr 3 01:18:07 oleg421-client kernel: evm: security.ima Apr 3 01:18:07 oleg421-client kernel: evm: security.capability Apr 3 01:18:07 oleg421-client kernel: evm: HMAC attrs: 0x1 Apr 3 01:18:07 oleg421-client kernel: rtc_cmos 00:05: setting system clock to 2026-04-03 05:18:07 UTC (1775193487) Apr 3 01:18:07 oleg421-client kernel: debug: unmapping init [mem 0xffffffffa7c03000-0xffffffffa7dfffff] Apr 3 01:18:07 oleg421-client kernel: debug: unmapping init [mem 0xffffffffa6982000-0xffffffffa6c58fff] Apr 3 01:18:07 oleg421-client kernel: Write protecting the kernel read-only data: 28672k Apr 3 01:18:07 oleg421-client kernel: debug: unmapping init [mem 0xffffffffa5003000-0xffffffffa51fffff] Apr 3 01:18:07 oleg421-client kernel: debug: unmapping init [mem 0xffffffffa5914000-0xffffffffa59fffff] Apr 3 01:18:07 oleg421-client systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Apr 3 01:18:07 oleg421-client systemd[1]: Detected virtualization kvm. Apr 3 01:18:07 oleg421-client systemd[1]: Detected architecture x86-64. Apr 3 01:18:07 oleg421-client systemd[1]: Running in initial RAM disk. Apr 3 01:18:07 oleg421-client systemd[1]: No hostname configured. Apr 3 01:18:07 oleg421-client systemd[1]: Set hostname to . Apr 3 01:18:07 oleg421-client kernel: random: systemd: uninitialized urandom read (16 bytes read) Apr 3 01:18:07 oleg421-client systemd[1]: Initializing machine ID from random generator. Apr 3 01:18:07 oleg421-client kernel: random: ln: uninitialized urandom read (6 bytes read) Apr 3 01:18:07 oleg421-client kernel: random: systemd: uninitialized urandom read (16 bytes read) Apr 3 01:18:07 oleg421-client systemd[1]: Listening on Journal Socket (/dev/log). Apr 3 01:18:07 oleg421-client systemd[1]: Listening on udev Control Socket. Apr 3 01:18:07 oleg421-client systemd[1]: Reached target Timers. Apr 3 01:18:07 oleg421-client systemd-journald[232]: Journal started Apr 3 01:18:07 oleg421-client systemd-journald[232]: Runtime journal (/run/log/journal/2685ad9c4a6646b98801ab3cfc714d80) is 8.0M, max 184.6M, 176.6M free. Apr 3 01:18:07 oleg421-client systemd-vconsole-setup[231]: KD_FONT_OP_GET failed while trying to get the font metadata: Invalid argument Apr 3 01:18:07 oleg421-client systemd-vconsole-setup[231]: Fonts will not be copied to remaining consoles Apr 3 01:18:07 oleg421-client systemd[1]: Started Create Static Device Nodes in /dev. Apr 3 01:18:07 oleg421-client dracut-cmdline[253]: dracut-8.10 (Green Obsidian) dracut-049-233.git20240115.el8 Apr 3 01:18:07 oleg421-client dracut-cmdline[253]: Using kernel command line parameters: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 Apr 3 01:18:08 oleg421-client systemd[1]: Started dracut cmdline hook. Apr 3 01:18:08 oleg421-client systemd[1]: Starting dracut pre-udev hook... Apr 3 01:18:08 oleg421-client kernel: device-mapper: uevent: version 1.0.3 Apr 3 01:18:08 oleg421-client kernel: device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com Apr 3 01:18:08 oleg421-client rpc.statd[387]: Version 2.3.3 starting Apr 3 01:18:08 oleg421-client rpc.statd[387]: Initializing NSM state Apr 3 01:18:08 oleg421-client rpc.idmapd[392]: Setting log level to 0 Apr 3 01:18:08 oleg421-client systemd[1]: Started dracut pre-udev hook. Apr 3 01:18:08 oleg421-client systemd[1]: Starting udev Kernel Device Manager... Apr 3 01:18:08 oleg421-client systemd[1]: Started udev Kernel Device Manager. Apr 3 01:18:08 oleg421-client systemd[1]: Starting dracut pre-trigger hook... Apr 3 01:18:08 oleg421-client systemd[1]: Started dracut pre-trigger hook. Apr 3 01:18:08 oleg421-client systemd[1]: Starting udev Coldplug all Devices... Apr 3 01:18:09 oleg421-client systemd[1]: Mounting Kernel Configuration File System... Apr 3 01:18:09 oleg421-client systemd[1]: Mounted Kernel Configuration File System. Apr 3 01:18:09 oleg421-client systemd[1]: Started udev Coldplug all Devices. Apr 3 01:18:09 oleg421-client systemd[1]: Starting dracut initqueue hook... Apr 3 01:18:09 oleg421-client systemd[1]: Reached target System Initialization. Apr 3 01:18:09 oleg421-client systemd[1]: Reached target Basic System. Apr 3 01:18:09 oleg421-client systemd[1]: Started Hardware RNG Entropy Gatherer Daemon. Apr 3 01:18:09 oleg421-client rngd[447]: Disabling 7: PKCS11 Entropy generator (pkcs11) Apr 3 01:18:09 oleg421-client rngd[447]: Disabling 5: NIST Network Entropy Beacon (nist) Apr 3 01:18:09 oleg421-client rngd[447]: Disabling 9: Qrypt quantum entropy beacon (qrypt) Apr 3 01:18:09 oleg421-client rngd[447]: Initializing available sources Apr 3 01:18:09 oleg421-client rngd[447]: [hwrng ]: Initialization Failed Apr 3 01:18:09 oleg421-client rngd[447]: [rdrand]: Enabling RDRAND rng support Apr 3 01:18:09 oleg421-client rngd[447]: [rdrand]: Initialized Apr 3 01:18:09 oleg421-client rngd[447]: [jitter]: JITTER timeout set to 5 sec Apr 3 01:18:09 oleg421-client systemd-udevd[446]: Using default interface naming scheme 'rhel-8.0'. Apr 3 01:18:09 oleg421-client kernel: libata version 3.00 loaded. Apr 3 01:18:09 oleg421-client systemd-udevd[446]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Apr 3 01:18:09 oleg421-client kernel: virtio_net virtio0 ens2: renamed from eth0 Apr 3 01:18:09 oleg421-client kernel: ata_piix 0000:00:01.1: version 2.13 Apr 3 01:18:09 oleg421-client kernel: scsi host0: ata_piix Apr 3 01:18:09 oleg421-client kernel: scsi host1: ata_piix Apr 3 01:18:09 oleg421-client kernel: ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc120 irq 14 Apr 3 01:18:09 oleg421-client kernel: ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc128 irq 15 Apr 3 01:18:09 oleg421-client systemd-udevd[434]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Apr 3 01:18:09 oleg421-client rngd[447]: [jitter]: Initializing AES buffer Apr 3 01:18:09 oleg421-client systemd-udevd[436]: Using default interface naming scheme 'rhel-8.0'. Apr 3 01:18:10 oleg421-client dracut-initqueue[502]: Starting dhcp for interface ens2 Apr 3 01:18:10 oleg421-client dracut-initqueue[535]: dhcp: PREINIT ens2 up Apr 3 01:18:10 oleg421-client dhclient[534]: Created duid "\000\004&\205\255\234JfF\271\210\001\253<\374qM\200". Apr 3 01:18:10 oleg421-client dhclient[534]: DHCPDISCOVER on ens2 to 255.255.255.255 port 67 interval 8 (xid=0xf4a2323f) Apr 3 01:18:10 oleg421-client dhclient[534]: DHCPREQUEST on ens2 to 255.255.255.255 port 67 (xid=0xf4a2323f) Apr 3 01:18:10 oleg421-client dhclient[534]: DHCPOFFER from 192.168.204.254 Apr 3 01:18:10 oleg421-client dhclient[534]: DHCPACK from 192.168.204.254 (xid=0xf4a2323f) Apr 3 01:18:10 oleg421-client dracut-initqueue[553]: dhcp: BOND setting ens2 Apr 3 01:18:12 oleg421-client dhclient[534]: bound to 192.168.204.21 -- renewal in 23714 seconds. Apr 3 01:18:12 oleg421-client dracut-initqueue[581]: RTNETLINK answers: File exists Apr 3 01:18:14 oleg421-client rngd[447]: [jitter]: Unable to obtain AES key, disabling JITTER source Apr 3 01:18:14 oleg421-client rngd[447]: [jitter]: Initialization Failed Apr 3 01:18:14 oleg421-client kernel: random: crng init done Apr 3 01:18:14 oleg421-client kernel: random: 7 urandom warning(s) missed due to ratelimiting Apr 3 01:18:14 oleg421-client systemd[1]: Reloading. Apr 3 01:18:14 oleg421-client systemd[615]: /usr/lib/systemd/system-generators/systemd-fstab-generator failed with exit status 1. Apr 3 01:18:14 oleg421-client systemd[1]: Starting nbd nbd0... Apr 3 01:18:14 oleg421-client nbd-client[650]: Negotiation: ..size = 30720MB Apr 3 01:18:14 oleg421-client nbd-client[650]: Connected /dev/nbd0 Apr 3 01:18:14 oleg421-client systemd[1]: nbd0.service: Succeeded. Apr 3 01:18:14 oleg421-client systemd[1]: Started nbd nbd0. Apr 3 01:18:14 oleg421-client systemd[1]: Started dracut initqueue hook. Apr 3 01:18:14 oleg421-client systemd[1]: Reached target Remote File Systems (Pre). Apr 3 01:18:14 oleg421-client systemd[1]: Reached target Remote File Systems. Apr 3 01:18:14 oleg421-client systemd[1]: Mounting /sysroot... Apr 3 01:18:14 oleg421-client kernel: EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) Apr 3 01:18:14 oleg421-client systemd[1]: Mounted /sysroot. Apr 3 01:18:14 oleg421-client systemd[1]: Reached target Initrd Root File System. Apr 3 01:18:14 oleg421-client systemd[1]: Starting Reload Configuration from the Real Root... Apr 3 01:18:14 oleg421-client systemd[1]: Reloading. Apr 3 01:18:14 oleg421-client systemd[672]: /usr/lib/systemd/system-generators/systemd-fstab-generator failed with exit status 1. Apr 3 01:18:14 oleg421-client systemd[1]: initrd-parse-etc.service: Succeeded. Apr 3 01:18:14 oleg421-client systemd[1]: Started Reload Configuration from the Real Root. Apr 3 01:18:14 oleg421-client systemd[1]: Reached target Initrd File Systems. Apr 3 01:18:14 oleg421-client systemd[1]: Reached target Initrd Default Target. Apr 3 01:18:14 oleg421-client systemd[1]: Starting dracut pre-pivot and cleanup hook... Apr 3 01:18:14 oleg421-client systemd[1]: var-lib-nfs-rpc_pipefs.mount: Succeeded. Apr 3 01:18:15 oleg421-client systemd[1]: Started dracut pre-pivot and cleanup hook. Apr 3 01:18:15 oleg421-client systemd[1]: Starting Cleaning Up and Shutting Down Daemons... Apr 3 01:18:15 oleg421-client rngd[447]: [rdrand]: Shutting down Apr 3 01:18:15 oleg421-client systemd[1]: Stopping Hardware RNG Entropy Gatherer Daemon... Apr 3 01:18:15 oleg421-client systemd[1]: Stopped target Timers. Apr 3 01:18:15 oleg421-client systemd[1]: dracut-pre-pivot.service: Succeeded. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped dracut pre-pivot and cleanup hook. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped target Initrd Default Target. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped target Initrd Root Device. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped target Remote File Systems. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped target Remote File Systems (Pre). Apr 3 01:18:15 oleg421-client systemd[1]: dracut-initqueue.service: Succeeded. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped dracut initqueue hook. Apr 3 01:18:15 oleg421-client systemd[1]: rngd.service: Succeeded. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped Hardware RNG Entropy Gatherer Daemon. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped target Basic System. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped target Slices. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped target System Initialization. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped target Local Encrypted Volumes. Apr 3 01:18:15 oleg421-client systemd[1]: systemd-sysctl.service: Succeeded. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped Apply Kernel Variables. Apr 3 01:18:15 oleg421-client systemd[1]: systemd-udev-trigger.service: Succeeded. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped udev Coldplug all Devices. Apr 3 01:18:15 oleg421-client systemd[1]: dracut-pre-trigger.service: Succeeded. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped dracut pre-trigger hook. Apr 3 01:18:15 oleg421-client systemd[1]: Stopping udev Kernel Device Manager... Apr 3 01:18:15 oleg421-client systemd[1]: systemd-tmpfiles-setup.service: Succeeded. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped Create Volatile Files and Directories. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped target Local File Systems. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped target Swap. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped target Sockets. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped target Paths. Apr 3 01:18:15 oleg421-client systemd[1]: systemd-ask-password-console.path: Succeeded. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. Apr 3 01:18:15 oleg421-client systemd[1]: initrd-cleanup.service: Succeeded. Apr 3 01:18:15 oleg421-client systemd[1]: Started Cleaning Up and Shutting Down Daemons. Apr 3 01:18:15 oleg421-client systemd[1]: systemd-udevd.service: Succeeded. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped udev Kernel Device Manager. Apr 3 01:18:15 oleg421-client systemd[1]: dracut-pre-udev.service: Succeeded. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped dracut pre-udev hook. Apr 3 01:18:15 oleg421-client systemd[1]: dracut-cmdline.service: Succeeded. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped dracut cmdline hook. Apr 3 01:18:15 oleg421-client systemd[1]: systemd-tmpfiles-setup-dev.service: Succeeded. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped Create Static Device Nodes in /dev. Apr 3 01:18:15 oleg421-client systemd[1]: kmod-static-nodes.service: Succeeded. Apr 3 01:18:15 oleg421-client systemd[1]: Stopped Create list of required static device nodes for the current kernel. Apr 3 01:18:15 oleg421-client systemd[1]: systemd-udevd-control.socket: Succeeded. Apr 3 01:18:15 oleg421-client systemd[1]: Closed udev Control Socket. Apr 3 01:18:15 oleg421-client systemd[1]: systemd-udevd-kernel.socket: Succeeded. Apr 3 01:18:15 oleg421-client systemd[1]: Closed udev Kernel Socket. Apr 3 01:18:15 oleg421-client systemd[1]: Starting Cleanup udevd DB... Apr 3 01:18:15 oleg421-client systemd[1]: initrd-udevadm-cleanup-db.service: Succeeded. Apr 3 01:18:15 oleg421-client systemd[1]: Started Cleanup udevd DB. Apr 3 01:18:15 oleg421-client systemd[1]: Reached target Switch Root. Apr 3 01:18:15 oleg421-client systemd[1]: Starting Switch Root... Apr 3 01:18:15 oleg421-client systemd[1]: Switching root. Apr 3 01:18:15 oleg421-client systemd-journald[232]: Journal stopped Apr 3 01:18:16 oleg421-client kernel: printk: systemd: 25 output lines suppressed due to ratelimiting Apr 3 01:18:16 oleg421-client kernel: SELinux: Disabled at runtime. Apr 3 01:18:16 oleg421-client systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Apr 3 01:18:16 oleg421-client systemd[1]: Detected virtualization kvm. Apr 3 01:18:16 oleg421-client systemd[1]: Detected architecture x86-64. Apr 3 01:18:16 oleg421-client systemd[1]: initrd-switch-root.service: Succeeded. Apr 3 01:18:16 oleg421-client systemd[1]: Stopped Switch Root. Apr 3 01:18:16 oleg421-client systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. Apr 3 01:18:16 oleg421-client systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. Apr 3 01:18:16 oleg421-client systemd[1]: Stopped Journal Service. Apr 3 01:18:16 oleg421-client systemd[1]: Starting Journal Service... Apr 3 01:18:16 oleg421-client systemd[1]: Starting Remount Root and Kernel File Systems... Apr 3 01:18:16 oleg421-client kernel: Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS Apr 3 01:18:16 oleg421-client systemd-journald[787]: Journal started Apr 3 01:18:16 oleg421-client systemd-journald[787]: Runtime journal (/run/log/journal/a82c5ce2bafb4275b974cc7d83c03742) is 1.2M, max 10.0M, 8.7M free. Apr 3 01:18:16 oleg421-client systemd[1]: systemd-journald.service: Succeeded. Apr 3 01:18:16 oleg421-client systemd-remount-fs[788]: /usr/bin/mount for / exited with exit status 32. Apr 3 01:18:16 oleg421-client systemd-remount-fs[793]: mount.nfs: access denied by server while mounting 192.168.10.1:/exports/rhel8.5-nfsroot Apr 3 01:18:16 oleg421-client systemd[1]: systemd-remount-fs.service: Main process exited, code=exited, status=1/FAILURE Apr 3 01:18:16 oleg421-client systemd[1]: systemd-remount-fs.service: Failed with result 'exit-code'. Apr 3 01:18:16 oleg421-client systemd[1]: Failed to start Remount Root and Kernel File Systems. Apr 3 01:18:16 oleg421-client systemd[1]: Activated swap /dev/disk/by-label/SWAP. Apr 3 01:18:16 oleg421-client systemd[1]: Started Apply Kernel Variables. Apr 3 01:18:16 oleg421-client systemd[1]: Mounted POSIX Message Queue File System. Apr 3 01:18:16 oleg421-client systemd[1]: Mounted Huge Pages File System. Apr 3 01:18:16 oleg421-client systemd[1]: Mounted Kernel Debug File System. Apr 3 01:18:16 oleg421-client systemd[1]: Started Create list of required static device nodes for the current kernel. Apr 3 01:18:16 oleg421-client systemd[1]: Reached target Swap. Apr 3 01:18:16 oleg421-client systemd[1]: Starting Create Static Device Nodes in /dev... Apr 3 01:18:16 oleg421-client systemd[1]: Starting Configure read-only root support... Apr 3 01:18:16 oleg421-client systemd[1]: Starting Flush Journal to Persistent Storage... Apr 3 01:18:16 oleg421-client systemd-journald[787]: Runtime journal (/run/log/journal/a82c5ce2bafb4275b974cc7d83c03742) is 1.2M, max 10.0M, 8.7M free. Apr 3 01:18:16 oleg421-client systemd[1]: Started Flush Journal to Persistent Storage. Apr 3 01:18:16 oleg421-client systemd[1]: Started Create Static Device Nodes in /dev. Apr 3 01:18:16 oleg421-client systemd[1]: Starting udev Kernel Device Manager... Apr 3 01:18:16 oleg421-client systemd[1]: Reached target Local File Systems (Pre). Apr 3 01:18:16 oleg421-client systemd[1]: Mounting /mnt... Apr 3 01:18:16 oleg421-client systemd[1]: Mounting /home/green/git/lustre-release... Apr 3 01:18:16 oleg421-client systemd[1]: Started udev Coldplug all Devices. Apr 3 01:18:16 oleg421-client systemd[1]: Mounted /mnt. Apr 3 01:18:16 oleg421-client kernel: squashfs: version 4.0 (2009/01/31) Phillip Lougher Apr 3 01:18:16 oleg421-client systemd[1]: Mounted /home/green/git/lustre-release. Apr 3 01:18:16 oleg421-client systemd[1]: Started udev Kernel Device Manager. Apr 3 01:18:17 oleg421-client kernel: piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 Apr 3 01:18:17 oleg421-client kernel: input: PC Speaker as /devices/platform/pcspkr/input/input5 Apr 3 01:18:17 oleg421-client kernel: RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer Apr 3 01:18:17 oleg421-client systemd-udevd[858]: Using default interface naming scheme 'rhel-8.0'. Apr 3 01:18:17 oleg421-client systemd-udevd[858]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Apr 3 01:18:17 oleg421-client kernel: EDAC sbridge: Seeking for: PCI ID 8086:0ea0 Apr 3 01:18:17 oleg421-client kernel: EDAC sbridge: Ver: 1.1.2 Apr 3 01:18:17 oleg421-client systemd-udevd[866]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Apr 3 01:18:18 oleg421-client kernel: Key type dns_resolver registered Apr 3 01:18:18 oleg421-client kernel: NFS: Registering the id_resolver key type Apr 3 01:18:18 oleg421-client kernel: Key type id_resolver registered Apr 3 01:18:18 oleg421-client kernel: Key type id_legacy registered Apr 3 01:18:18 oleg421-client nfsrahead[983]: setting /var/lib/stateless/state readahead to 128 Apr 3 01:18:18 oleg421-client systemd[1]: Started Configure read-only root support. Apr 3 01:18:18 oleg421-client systemd[1]: Starting Load/Save Random Seed... Apr 3 01:18:19 oleg421-client systemd[1]: Reached target Local File Systems. Apr 3 01:18:19 oleg421-client systemd[1]: Starting Rebuild Dynamic Linker Cache... Apr 3 01:18:19 oleg421-client systemd[1]: Starting Mark the need to relabel after reboot... Apr 3 01:18:19 oleg421-client systemd[1]: Starting Create Volatile Files and Directories... Apr 3 01:18:19 oleg421-client touch[996]: /bin/touch: cannot touch '/.autorelabel': Read-only file system Apr 3 01:18:19 oleg421-client systemd[1]: Started Load/Save Random Seed. Apr 3 01:18:19 oleg421-client systemd[1]: Started Mark the need to relabel after reboot. Apr 3 01:18:19 oleg421-client systemd-tmpfiles[998]: rm(/var/lib/rpm/__db.003): Read-only file system Apr 3 01:18:19 oleg421-client systemd-tmpfiles[998]: rm(/var/lib/rpm/__db.002): Read-only file system Apr 3 01:18:19 oleg421-client systemd-tmpfiles[998]: rm(/var/lib/rpm/__db.001): Read-only file system Apr 3 01:18:19 oleg421-client systemd[1]: Started Create Volatile Files and Directories. Apr 3 01:18:19 oleg421-client systemd[1]: Starting RPC Bind... Apr 3 01:18:19 oleg421-client systemd[1]: Starting Update UTMP about System Boot/Shutdown... Apr 3 01:18:19 oleg421-client systemd[1]: Started Update UTMP about System Boot/Shutdown. Apr 3 01:18:19 oleg421-client systemd[1]: Started RPC Bind. Apr 3 01:18:19 oleg421-client systemd[1]: Started Rebuild Dynamic Linker Cache. Apr 3 01:18:19 oleg421-client systemd[1]: Starting Update is Completed... Apr 3 01:18:19 oleg421-client systemd[1]: Started Update is Completed. Apr 3 01:18:19 oleg421-client systemd[1]: Reached target System Initialization. Apr 3 01:18:19 oleg421-client systemd[1]: Started dnf makecache --timer. Apr 3 01:18:19 oleg421-client systemd[1]: Started Daily Cleanup of Temporary Directories. Apr 3 01:18:19 oleg421-client systemd[1]: Listening on D-Bus System Message Bus Socket. Apr 3 01:18:19 oleg421-client systemd[1]: Reached target Sockets. Apr 3 01:18:19 oleg421-client systemd[1]: Started daily update of the root trust anchor for DNSSEC. Apr 3 01:18:19 oleg421-client systemd[1]: Reached target Timers. Apr 3 01:18:19 oleg421-client systemd[1]: Reached target Basic System. Apr 3 01:18:19 oleg421-client systemd[1]: Starting Restore /run/initramfs on shutdown... Apr 3 01:18:19 oleg421-client systemd[1]: Started Hardware RNG Entropy Gatherer Daemon. Apr 3 01:18:19 oleg421-client systemd[1]: Reached target sshd-keygen.target. Apr 3 01:18:19 oleg421-client systemd[1]: Starting Login Service... Apr 3 01:18:19 oleg421-client systemd[1]: Started D-Bus System Message Bus. Apr 3 01:18:20 oleg421-client systemd[1]: Starting Network Manager... Apr 3 01:18:20 oleg421-client rngd[1009]: Disabling 7: PKCS11 Entropy generator (pkcs11) Apr 3 01:18:20 oleg421-client rngd[1009]: Disabling 5: NIST Network Entropy Beacon (nist) Apr 3 01:18:20 oleg421-client rngd[1009]: Disabling 9: Qrypt quantum entropy beacon (qrypt) Apr 3 01:18:20 oleg421-client rngd[1009]: Initializing available sources Apr 3 01:18:20 oleg421-client rngd[1009]: [hwrng ]: Initialization Failed Apr 3 01:18:20 oleg421-client rngd[1009]: [rdrand]: Enabling RDRAND rng support Apr 3 01:18:20 oleg421-client rngd[1009]: [rdrand]: Initialized Apr 3 01:18:20 oleg421-client rngd[1009]: [jitter]: JITTER timeout set to 5 sec Apr 3 01:18:20 oleg421-client systemd[1]: Started irqbalance daemon. Apr 3 01:18:20 oleg421-client systemd[1]: Started Restore /run/initramfs on shutdown. Apr 3 01:18:20 oleg421-client systemd-logind[1011]: Watching system buttons on /dev/input/event0 (Power Button) Apr 3 01:18:20 oleg421-client systemd-logind[1011]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Apr 3 01:18:20 oleg421-client systemd-logind[1011]: New seat seat0. Apr 3 01:18:20 oleg421-client dbus-daemon[1012]: [system] Successfully activated service 'org.freedesktop.systemd1' Apr 3 01:18:20 oleg421-client systemd[1]: Started Login Service. Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.1253] NetworkManager (version 1.40.16-19.el8_10) is starting... (boot:9d21ed52-bf68-4ff6-bf1d-cf59ff8ad515) Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.1307] Read config: /etc/NetworkManager/NetworkManager.conf (run: 10-dracut-dhclient.conf) Apr 3 01:18:20 oleg421-client rngd[1009]: [jitter]: Initializing AES buffer Apr 3 01:18:20 oleg421-client systemd[1]: Started Network Manager. Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.1439] bus-manager: acquired D-Bus service "org.freedesktop.NetworkManager" Apr 3 01:18:20 oleg421-client systemd[1]: Reached target Network. Apr 3 01:18:20 oleg421-client systemd[1]: Starting GSSAPI Proxy Daemon... Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.1627] manager[0x55b35a2b8020]: monitoring kernel firmware directory '/lib/firmware'. Apr 3 01:18:20 oleg421-client dbus-daemon[1012]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service' requested by ':1.2' (uid=0 pid=1013 comm="/usr/sbin/NetworkManager --no-daemon ") Apr 3 01:18:20 oleg421-client systemd[1]: Starting OpenSSH server daemon... Apr 3 01:18:20 oleg421-client systemd[1]: Starting Dynamic System Tuning Daemon... Apr 3 01:18:20 oleg421-client systemd[1]: Starting Network Manager Wait Online... Apr 3 01:18:20 oleg421-client sshd[1030]: Server listening on 0.0.0.0 port 22. Apr 3 01:18:20 oleg421-client sshd[1030]: Server listening on :: port 22. Apr 3 01:18:20 oleg421-client systemd[1]: Started OpenSSH server daemon. Apr 3 01:18:20 oleg421-client systemd[1]: Started GSSAPI Proxy Daemon. Apr 3 01:18:20 oleg421-client systemd[1]: Reached target NFS client services. Apr 3 01:18:20 oleg421-client systemd[1]: Reached target Remote File Systems (Pre). Apr 3 01:18:20 oleg421-client systemd[1]: Reached target Remote File Systems. Apr 3 01:18:20 oleg421-client systemd[1]: Starting Permit User Sessions... Apr 3 01:18:20 oleg421-client systemd[1]: Starting Hostname Service... Apr 3 01:18:20 oleg421-client systemd[1]: Started Permit User Sessions. Apr 3 01:18:20 oleg421-client systemd[1]: Started Getty on tty1. Apr 3 01:18:20 oleg421-client systemd[1]: Started Serial Getty on ttyS0. Apr 3 01:18:20 oleg421-client systemd[1]: Started Command Scheduler. Apr 3 01:18:20 oleg421-client systemd[1]: Started Serial Getty on ttyS1. Apr 3 01:18:20 oleg421-client crond[1049]: (CRON) STARTUP (1.5.2) Apr 3 01:18:20 oleg421-client crond[1049]: (CRON) INFO (RANDOM_DELAY will be scaled with factor 60% if used.) Apr 3 01:18:20 oleg421-client systemd[1]: Reached target Login Prompts. Apr 3 01:18:20 oleg421-client crond[1049]: (CRON) INFO (running with inotify support) Apr 3 01:18:20 oleg421-client dbus-daemon[1012]: [system] Successfully activated service 'org.freedesktop.hostname1' Apr 3 01:18:20 oleg421-client systemd[1]: Started Hostname Service. Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.8409] hostname: hostname: using hostnamed Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.8417] dns-mgr: init: dns=default,systemd-resolved rc-manager=symlink Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.8600] Loaded device plugin: NMTeamFactory (/usr/lib64/NetworkManager/1.40.16-19.el8_10/libnm-device-plugin-team.so) Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.8600] manager: rfkill: Wi-Fi enabled by radio killswitch; enabled by state file Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.8602] manager: rfkill: WWAN enabled by radio killswitch; enabled by state file Apr 3 01:18:20 oleg421-client dbus-daemon[1012]: [system] Activating via systemd: service name='org.freedesktop.nm_dispatcher' unit='dbus-org.freedesktop.nm-dispatcher.service' requested by ':1.2' (uid=0 pid=1013 comm="/usr/sbin/NetworkManager --no-daemon ") Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.8603] manager: Networking is enabled by state file Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.8653] settings: Loaded settings plugin: ifcfg-rh ("/usr/lib64/NetworkManager/1.40.16-19.el8_10/libnm-settings-plugin-ifcfg-rh.so") Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.8656] settings: Loaded settings plugin: keyfile (internal) Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.8956] dhcp: init: Using DHCP client 'dhclient' Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.8969] device (lo): carrier: link connected Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.9027] manager: (lo): new Generic device (/org/freedesktop/NetworkManager/Devices/1) Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.9128] device (ens2): carrier: link connected Apr 3 01:18:20 oleg421-client systemd[1]: Starting Network Manager Script Dispatcher Service... Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.9161] manager: (ens2): new Ethernet device (/org/freedesktop/NetworkManager/Devices/2) Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.9223] manager: (ens2): assume: will attempt to assume matching connection 'ens2' (733dbd11-9d53-4113-a685-46f5cf8225d4) (guessed) Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.9246] manager: (ens2): assume: taking over an initramfs-configured connection Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.9249] device (ens2): state change: unmanaged -> unavailable (reason 'connection-assumed', sys-iface-state: 'assume') Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.9350] device (ens2): state change: unavailable -> disconnected (reason 'connection-assumed', sys-iface-state: 'assume') Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.9493] device (ens2): Activation: starting connection 'ens2' (733dbd11-9d53-4113-a685-46f5cf8225d4) Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.9533] device (ens2): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'assume') Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.9540] device (ens2): state change: prepare -> config (reason 'none', sys-iface-state: 'assume') Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.9544] device (ens2): state change: config -> ip-config (reason 'none', sys-iface-state: 'assume') Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.9666] dhcp4 (ens2): activation: beginning transaction (timeout in 45 seconds) Apr 3 01:18:20 oleg421-client NetworkManager[1013]: [1775193500.9894] dhcp4 (ens2): dhclient started with pid 1052 Apr 3 01:18:20 oleg421-client dbus-daemon[1012]: [system] Activating via systemd: service name='org.freedesktop.resolve1' unit='dbus-org.freedesktop.resolve1.service' requested by ':1.2' (uid=0 pid=1013 comm="/usr/sbin/NetworkManager --no-daemon ") Apr 3 01:18:20 oleg421-client dbus-daemon[1012]: [system] Activation via systemd failed for unit 'dbus-org.freedesktop.resolve1.service': Unit dbus-org.freedesktop.resolve1.service not found. Apr 3 01:18:21 oleg421-client dbus-daemon[1012]: [system] Successfully activated service 'org.freedesktop.nm_dispatcher' Apr 3 01:18:21 oleg421-client systemd[1]: Started Network Manager Script Dispatcher Service. Apr 3 01:18:21 oleg421-client dhclient[1052]: DHCPREQUEST on ens2 to 255.255.255.255 port 67 (xid=0xb6ed593d) Apr 3 01:18:21 oleg421-client dhclient[1052]: DHCPACK from 192.168.204.254 (xid=0xb6ed593d) Apr 3 01:18:21 oleg421-client NetworkManager[1013]: [1775193501.2059] dhcp4 (ens2): address 192.168.204.21 Apr 3 01:18:21 oleg421-client NetworkManager[1013]: [1775193501.2060] dhcp4 (ens2): plen 24 (255.255.255.0) Apr 3 01:18:21 oleg421-client NetworkManager[1013]: [1775193501.2061] dhcp4 (ens2): gateway 192.168.204.254 Apr 3 01:18:21 oleg421-client NetworkManager[1013]: [1775193501.2061] dhcp4 (ens2): lease time 60000 Apr 3 01:18:21 oleg421-client NetworkManager[1013]: [1775193501.2061] dhcp4 (ens2): hostname 'oleg421-client.virtnet' Apr 3 01:18:21 oleg421-client NetworkManager[1013]: [1775193501.2061] dhcp4 (ens2): nameserver '192.168.200.253' Apr 3 01:18:21 oleg421-client NetworkManager[1013]: [1775193501.2062] dhcp4 (ens2): domain name 'virtnet' Apr 3 01:18:21 oleg421-client NetworkManager[1013]: [1775193501.2062] dhcp4 (ens2): state changed new lease, address=192.168.204.21 Apr 3 01:18:21 oleg421-client NetworkManager[1013]: [1775193501.2078] policy: set 'ens2' (ens2) as default for IPv4 routing and DNS Apr 3 01:18:21 oleg421-client NetworkManager[1013]: [1775193501.2162] device (ens2): state change: ip-config -> ip-check (reason 'none', sys-iface-state: 'assume') Apr 3 01:18:21 oleg421-client NetworkManager[1013]: [1775193501.2308] device (ens2): state change: ip-check -> secondaries (reason 'none', sys-iface-state: 'assume') Apr 3 01:18:21 oleg421-client NetworkManager[1013]: [1775193501.2312] device (ens2): state change: secondaries -> activated (reason 'none', sys-iface-state: 'assume') Apr 3 01:18:21 oleg421-client NetworkManager[1013]: [1775193501.2319] manager: NetworkManager state is now CONNECTED_SITE Apr 3 01:18:21 oleg421-client NetworkManager[1013]: [1775193501.2324] device (ens2): Activation: successful, device activated. Apr 3 01:18:21 oleg421-client NetworkManager[1013]: [1775193501.2333] manager: NetworkManager state is now CONNECTED_GLOBAL Apr 3 01:18:21 oleg421-client NetworkManager[1013]: [1775193501.2358] manager: startup complete Apr 3 01:18:21 oleg421-client dhclient[1052]: bound to 192.168.204.21 -- renewal in 22528 seconds. Apr 3 01:18:21 oleg421-client systemd[1]: Started Network Manager Wait Online. Apr 3 01:18:21 oleg421-client systemd[1]: Reached target Network is Online. Apr 3 01:18:21 oleg421-client systemd[1]: Starting Notify NFS peers of a restart... Apr 3 01:18:21 oleg421-client systemd[1]: Starting Crash recovery kernel arming... Apr 3 01:18:21 oleg421-client systemd[1]: Starting System Logging Service... Apr 3 01:18:21 oleg421-client sm-notify[1071]: Version 2.3.3 starting Apr 3 01:18:21 oleg421-client systemd[1]: Started Notify NFS peers of a restart. Apr 3 01:18:21 oleg421-client rsyslogd[1073]: [origin software="rsyslogd" swVersion="8.2102.0-15.el8_10.1" x-pid="1073" x-info="https://www.rsyslog.com"] start Apr 3 01:18:21 oleg421-client systemd[1]: Started System Logging Service. Apr 3 01:18:21 oleg421-client rsyslogd[1073]: imjournal: No statefile exists, /var/lib/rsyslog/imjournal.state will be created (ignore if this is first run): No such file or directory [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/2040 ] Apr 3 01:18:21 oleg421-client rsyslogd[1073]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Apr 3 01:18:22 oleg421-client kdumpctl[1193]: basename: missing operand Apr 3 01:18:22 oleg421-client kdumpctl[1193]: Try 'basename --help' for more information. Apr 3 01:18:23 oleg421-client dbus-daemon[1012]: [system] Activating via systemd: service name='org.freedesktop.PolicyKit1' unit='polkit.service' requested by ':1.7' (uid=0 pid=1031 comm="/usr/libexec/platform-python -Es /usr/sbin/tuned -") Apr 3 01:18:23 oleg421-client systemd[1]: Starting Authorization Manager... Apr 3 01:18:23 oleg421-client polkitd[1351]: Started polkitd version 0.115 Apr 3 01:18:23 oleg421-client polkitd[1351]: Loading rules from directory /etc/polkit-1/rules.d Apr 3 01:18:23 oleg421-client polkitd[1351]: Loading rules from directory /usr/share/polkit-1/rules.d Apr 3 01:18:23 oleg421-client polkitd[1351]: Finished loading, compiling and executing 2 rules Apr 3 01:18:23 oleg421-client dbus-daemon[1012]: [system] Successfully activated service 'org.freedesktop.PolicyKit1' Apr 3 01:18:23 oleg421-client systemd[1]: Started Authorization Manager. Apr 3 01:18:23 oleg421-client polkitd[1351]: Acquired the name org.freedesktop.PolicyKit1 on the system bus Apr 3 01:18:23 oleg421-client systemd[1]: Started Dynamic System Tuning Daemon. Apr 3 01:18:23 oleg421-client systemd[1]: Reached target Multi-User System. Apr 3 01:18:23 oleg421-client systemd[1]: Reached target Graphical Interface. Apr 3 01:18:23 oleg421-client systemd[1]: Starting Update UTMP about System Runlevel Changes... Apr 3 01:18:23 oleg421-client systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Apr 3 01:18:23 oleg421-client systemd[1]: Started Update UTMP about System Runlevel Changes. Apr 3 01:18:25 oleg421-client rngd[1009]: [jitter]: Unable to obtain AES key, disabling JITTER source Apr 3 01:18:25 oleg421-client rngd[1009]: [jitter]: Initialization Failed Apr 3 01:18:25 oleg421-client rngd[1009]: Process privileges have been dropped to 2:2 Apr 3 01:18:27 oleg421-client sshd[1377]: Accepted publickey for root from 192.168.200.253 port 51248 ssh2: RSA SHA256:9e8LCkrakioBi3TKSwi0ueMHJ3ih9q2KxjmcAXV6W0I Apr 3 01:18:27 oleg421-client systemd[1]: Created slice User Slice of UID 0. Apr 3 01:18:27 oleg421-client systemd[1]: Starting User runtime directory /run/user/0... Apr 3 01:18:27 oleg421-client systemd-logind[1011]: New session 1 of user root. Apr 3 01:18:27 oleg421-client systemd[1]: Started User runtime directory /run/user/0. Apr 3 01:18:27 oleg421-client systemd[1]: Starting User Manager for UID 0... Apr 3 01:18:27 oleg421-client systemd[1392]: pam_unix(systemd-user:session): session opened for user root by (uid=0) Apr 3 01:18:27 oleg421-client systemd[1392]: Reached target Timers. Apr 3 01:18:27 oleg421-client systemd[1392]: Reached target Paths. Apr 3 01:18:28 oleg421-client systemd[1392]: Starting D-Bus User Message Bus Socket. Apr 3 01:18:28 oleg421-client systemd[1392]: Listening on D-Bus User Message Bus Socket. Apr 3 01:18:28 oleg421-client systemd[1392]: Reached target Sockets. Apr 3 01:18:28 oleg421-client systemd[1392]: Reached target Basic System. Apr 3 01:18:28 oleg421-client systemd[1]: Started User Manager for UID 0. Apr 3 01:18:28 oleg421-client systemd[1]: Started Session 1 of user root. Apr 3 01:18:28 oleg421-client systemd[1392]: Reached target Default. Apr 3 01:18:28 oleg421-client systemd[1392]: Startup finished in 362ms. Apr 3 01:18:28 oleg421-client sshd[1377]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:18:30 oleg421-client kdumpctl[1078]: kdump: kexec: loaded kdump kernel Apr 3 01:18:30 oleg421-client kdumpctl[1078]: kdump: Starting kdump: [OK] Apr 3 01:18:30 oleg421-client systemd[1]: Started Crash recovery kernel arming. Apr 3 01:18:30 oleg421-client systemd[1]: Startup finished in 3.165s (kernel) + 8.219s (initrd) + 14.508s (userspace) = 25.894s. Apr 3 01:18:30 oleg421-client sshd[1411]: Received disconnect from 192.168.200.253 port 51248:11: disconnected by user Apr 3 01:18:30 oleg421-client sshd[1411]: Disconnected from user root 192.168.200.253 port 51248 Apr 3 01:18:30 oleg421-client sshd[1377]: pam_unix(sshd:session): session closed for user root Apr 3 01:18:30 oleg421-client systemd[1]: session-1.scope: Succeeded. Apr 3 01:18:30 oleg421-client systemd-logind[1011]: Session 1 logged out. Waiting for processes to exit. Apr 3 01:18:30 oleg421-client systemd-logind[1011]: Removed session 1. Apr 3 01:18:30 oleg421-client sshd[1512]: Accepted publickey for root from 192.168.200.253 port 43922 ssh2: RSA SHA256:9e8LCkrakioBi3TKSwi0ueMHJ3ih9q2KxjmcAXV6W0I Apr 3 01:18:30 oleg421-client systemd-logind[1011]: New session 3 of user root. Apr 3 01:18:31 oleg421-client systemd[1]: Started Session 3 of user root. Apr 3 01:18:31 oleg421-client sshd[1512]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:18:31 oleg421-client systemd[1]: NetworkManager-dispatcher.service: Succeeded. Apr 3 01:18:50 oleg421-client systemd[1]: systemd-hostnamed.service: Succeeded. Apr 3 01:19:16 oleg421-client systemd-logind[1011]: Watching system buttons on /dev/input/event0 (Power Button) Apr 3 01:19:16 oleg421-client systemd-udevd[2295]: Using default interface naming scheme 'rhel-8.0'. Apr 3 01:19:16 oleg421-client systemd-logind[1011]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Apr 3 01:19:16 oleg421-client kernel: libcfs: loading out-of-tree module taints kernel. Apr 3 01:19:16 oleg421-client kernel: Key type ._llcrypt registered Apr 3 01:19:16 oleg421-client kernel: Key type .llcrypt registered Apr 3 01:19:17 oleg421-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Apr 3 01:19:17 oleg421-client kernel: alg: No test for adler32 (adler32-zlib) Apr 3 01:19:18 oleg421-client kernel: Lustre: Lustre: Build Version: 2.17.51_74_g48b5ed2 Apr 3 01:19:19 oleg421-client kernel: LNet: Added LNI 192.168.204.21@tcp [8/256/0/180] Apr 3 01:19:21 oleg421-client kernel: Key type lgssc registered Apr 3 01:19:23 oleg421-client kernel: Lustre: Echo OBD driver; http://www.lustre.org/ Apr 3 01:20:34 oleg421-client systemd-logind[1011]: Watching system buttons on /dev/input/event0 (Power Button) Apr 3 01:20:34 oleg421-client systemd-udevd[4480]: Using default interface naming scheme 'rhel-8.0'. Apr 3 01:20:34 oleg421-client systemd-logind[1011]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Apr 3 01:21:39 oleg421-client kernel: hrtimer: interrupt took 6727446 ns Apr 3 01:22:19 oleg421-client kernel: Lustre: Mounted lustre-client Apr 3 01:22:21 oleg421-client sshd[6241]: Accepted publickey for root from 192.168.204.21 port 54408 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:22:21 oleg421-client systemd[1]: Started Session 4 of user root. Apr 3 01:22:21 oleg421-client systemd-logind[1011]: New session 4 of user root. Apr 3 01:22:21 oleg421-client sshd[6241]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:22:22 oleg421-client sshd[6254]: Received disconnect from 192.168.204.21 port 54408:11: disconnected by user Apr 3 01:22:22 oleg421-client sshd[6254]: Disconnected from user root 192.168.204.21 port 54408 Apr 3 01:22:22 oleg421-client sshd[6241]: pam_unix(sshd:session): session closed for user root Apr 3 01:22:22 oleg421-client systemd-logind[1011]: Session 4 logged out. Waiting for processes to exit. Apr 3 01:22:22 oleg421-client systemd[1]: session-4.scope: Succeeded. Apr 3 01:22:22 oleg421-client systemd-logind[1011]: Removed session 4. Apr 3 01:22:25 oleg421-client sshd[6418]: Accepted publickey for root from 192.168.204.21 port 54422 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:22:25 oleg421-client systemd[1]: Started Session 5 of user root. Apr 3 01:22:25 oleg421-client systemd-logind[1011]: New session 5 of user root. Apr 3 01:22:25 oleg421-client sshd[6418]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:22:25 oleg421-client kernel: Lustre: DEBUG MARKER: Using TIMEOUT=20 Apr 3 01:22:25 oleg421-client sshd[6431]: Received disconnect from 192.168.204.21 port 54422:11: disconnected by user Apr 3 01:22:25 oleg421-client sshd[6431]: Disconnected from user root 192.168.204.21 port 54422 Apr 3 01:22:25 oleg421-client sshd[6418]: pam_unix(sshd:session): session closed for user root Apr 3 01:22:25 oleg421-client systemd[1]: session-5.scope: Succeeded. Apr 3 01:22:25 oleg421-client systemd-logind[1011]: Session 5 logged out. Waiting for processes to exit. Apr 3 01:22:25 oleg421-client systemd-logind[1011]: Removed session 5. Apr 3 01:22:27 oleg421-client sshd[6553]: Accepted publickey for root from 192.168.204.21 port 54430 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:22:27 oleg421-client systemd-logind[1011]: New session 6 of user root. Apr 3 01:22:27 oleg421-client systemd[1]: Started Session 6 of user root. Apr 3 01:22:27 oleg421-client sshd[6553]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:22:27 oleg421-client sshd[6566]: Received disconnect from 192.168.204.21 port 54430:11: disconnected by user Apr 3 01:22:27 oleg421-client sshd[6566]: Disconnected from user root 192.168.204.21 port 54430 Apr 3 01:22:27 oleg421-client sshd[6553]: pam_unix(sshd:session): session closed for user root Apr 3 01:22:27 oleg421-client systemd-logind[1011]: Session 6 logged out. Waiting for processes to exit. Apr 3 01:22:27 oleg421-client systemd[1]: session-6.scope: Succeeded. Apr 3 01:22:27 oleg421-client systemd-logind[1011]: Removed session 6. Apr 3 01:22:35 oleg421-client systemd-udevd[6726]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Apr 3 01:22:42 oleg421-client sshd[6845]: Accepted publickey for root from 192.168.204.21 port 45486 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:22:42 oleg421-client systemd-logind[1011]: New session 7 of user root. Apr 3 01:22:42 oleg421-client systemd[1]: Started Session 7 of user root. Apr 3 01:22:42 oleg421-client sshd[6845]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:22:45 oleg421-client kernel: Lustre: lustre-OST0000-osc-ffff962451dc4800: disconnect after 23s idle Apr 3 01:22:46 oleg421-client kernel: Lustre: DEBUG MARKER: oleg421-client.virtnet: executing check_logdir /tmp/testlogs/ Apr 3 01:22:46 oleg421-client sshd[6858]: Received disconnect from 192.168.204.21 port 45486:11: disconnected by user Apr 3 01:22:46 oleg421-client sshd[6858]: Disconnected from user root 192.168.204.21 port 45486 Apr 3 01:22:46 oleg421-client sshd[6845]: pam_unix(sshd:session): session closed for user root Apr 3 01:22:46 oleg421-client systemd[1]: session-7.scope: Succeeded. Apr 3 01:22:46 oleg421-client systemd-logind[1011]: Session 7 logged out. Waiting for processes to exit. Apr 3 01:22:46 oleg421-client systemd-logind[1011]: Removed session 7. Apr 3 01:22:48 oleg421-client sshd[7107]: Accepted publickey for root from 192.168.204.21 port 44726 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:22:48 oleg421-client systemd-logind[1011]: New session 8 of user root. Apr 3 01:22:48 oleg421-client systemd[1]: Started Session 8 of user root. Apr 3 01:22:48 oleg421-client sshd[7107]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:22:51 oleg421-client kernel: Lustre: DEBUG MARKER: oleg421-client.virtnet: executing yml_node Apr 3 01:22:52 oleg421-client sshd[7121]: Received disconnect from 192.168.204.21 port 44726:11: disconnected by user Apr 3 01:22:52 oleg421-client sshd[7121]: Disconnected from user root 192.168.204.21 port 44726 Apr 3 01:22:52 oleg421-client sshd[7107]: pam_unix(sshd:session): session closed for user root Apr 3 01:22:52 oleg421-client systemd[1]: session-8.scope: Succeeded. Apr 3 01:22:52 oleg421-client systemd-logind[1011]: Session 8 logged out. Waiting for processes to exit. Apr 3 01:22:52 oleg421-client systemd-logind[1011]: Removed session 8. Apr 3 01:22:55 oleg421-client sshd[7690]: Accepted publickey for root from 192.168.204.21 port 44740 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:22:55 oleg421-client systemd-logind[1011]: New session 9 of user root. Apr 3 01:22:55 oleg421-client systemd[1]: Started Session 9 of user root. Apr 3 01:22:55 oleg421-client sshd[7690]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:22:56 oleg421-client kernel: Lustre: DEBUG MARKER: Client: 2.17.51.74 Apr 3 01:22:56 oleg421-client sshd[7703]: Received disconnect from 192.168.204.21 port 44740:11: disconnected by user Apr 3 01:22:56 oleg421-client sshd[7703]: Disconnected from user root 192.168.204.21 port 44740 Apr 3 01:22:56 oleg421-client sshd[7690]: pam_unix(sshd:session): session closed for user root Apr 3 01:22:56 oleg421-client systemd-logind[1011]: Session 9 logged out. Waiting for processes to exit. Apr 3 01:22:56 oleg421-client systemd[1]: session-9.scope: Succeeded. Apr 3 01:22:56 oleg421-client systemd-logind[1011]: Removed session 9. Apr 3 01:22:58 oleg421-client sshd[7846]: Accepted publickey for root from 192.168.204.21 port 53512 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:22:58 oleg421-client systemd[1]: Started Session 10 of user root. Apr 3 01:22:58 oleg421-client systemd-logind[1011]: New session 10 of user root. Apr 3 01:22:58 oleg421-client sshd[7846]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:22:59 oleg421-client kernel: Lustre: DEBUG MARKER: MDS: 2.17.51.74 Apr 3 01:22:59 oleg421-client sshd[7859]: Received disconnect from 192.168.204.21 port 53512:11: disconnected by user Apr 3 01:22:59 oleg421-client sshd[7859]: Disconnected from user root 192.168.204.21 port 53512 Apr 3 01:22:59 oleg421-client sshd[7846]: pam_unix(sshd:session): session closed for user root Apr 3 01:22:59 oleg421-client systemd-logind[1011]: Session 10 logged out. Waiting for processes to exit. Apr 3 01:22:59 oleg421-client systemd[1]: session-10.scope: Succeeded. Apr 3 01:22:59 oleg421-client systemd-logind[1011]: Removed session 10. Apr 3 01:23:01 oleg421-client sshd[8003]: Accepted publickey for root from 192.168.204.21 port 53514 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:23:02 oleg421-client systemd-logind[1011]: New session 11 of user root. Apr 3 01:23:02 oleg421-client sshd[8003]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:23:02 oleg421-client systemd[1]: Started Session 11 of user root. Apr 3 01:23:02 oleg421-client kernel: Lustre: DEBUG MARKER: OSS: 2.17.51.74 Apr 3 01:23:02 oleg421-client sshd[8016]: Received disconnect from 192.168.204.21 port 53514:11: disconnected by user Apr 3 01:23:02 oleg421-client sshd[8016]: Disconnected from user root 192.168.204.21 port 53514 Apr 3 01:23:02 oleg421-client sshd[8003]: pam_unix(sshd:session): session closed for user root Apr 3 01:23:02 oleg421-client systemd-logind[1011]: Session 11 logged out. Waiting for processes to exit. Apr 3 01:23:02 oleg421-client systemd[1]: session-11.scope: Succeeded. Apr 3 01:23:02 oleg421-client systemd-logind[1011]: Removed session 11. Apr 3 01:23:03 oleg421-client sshd[8150]: Accepted publickey for root from 192.168.204.21 port 53518 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:23:04 oleg421-client systemd[1]: Started Session 12 of user root. Apr 3 01:23:04 oleg421-client systemd-logind[1011]: New session 12 of user root. Apr 3 01:23:04 oleg421-client sshd[8150]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:23:04 oleg421-client kernel: Lustre: DEBUG MARKER: -----============= acceptance-small: recovery-small ============----- Fri Apr 3 01:23:02 EDT 2026 Apr 3 01:23:04 oleg421-client sshd[8163]: Received disconnect from 192.168.204.21 port 53518:11: disconnected by user Apr 3 01:23:04 oleg421-client sshd[8163]: Disconnected from user root 192.168.204.21 port 53518 Apr 3 01:23:04 oleg421-client sshd[8150]: pam_unix(sshd:session): session closed for user root Apr 3 01:23:04 oleg421-client systemd-logind[1011]: Session 12 logged out. Waiting for processes to exit. Apr 3 01:23:04 oleg421-client systemd[1]: session-12.scope: Succeeded. Apr 3 01:23:04 oleg421-client systemd-logind[1011]: Removed session 12. Apr 3 01:23:23 oleg421-client sshd[8681]: Accepted publickey for root from 192.168.204.21 port 58390 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:23:23 oleg421-client systemd-logind[1011]: New session 13 of user root. Apr 3 01:23:23 oleg421-client systemd[1]: Started Session 13 of user root. Apr 3 01:23:23 oleg421-client sshd[8681]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:23:23 oleg421-client kernel: Lustre: DEBUG MARKER: excepting tests: 136 Apr 3 01:23:23 oleg421-client sshd[8694]: Received disconnect from 192.168.204.21 port 58390:11: disconnected by user Apr 3 01:23:23 oleg421-client sshd[8694]: Disconnected from user root 192.168.204.21 port 58390 Apr 3 01:23:23 oleg421-client sshd[8681]: pam_unix(sshd:session): session closed for user root Apr 3 01:23:23 oleg421-client systemd-logind[1011]: Session 13 logged out. Waiting for processes to exit. Apr 3 01:23:23 oleg421-client systemd[1]: session-13.scope: Succeeded. Apr 3 01:23:23 oleg421-client systemd-logind[1011]: Removed session 13. Apr 3 01:23:25 oleg421-client sshd[8868]: Accepted publickey for root from 192.168.204.21 port 58402 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:23:25 oleg421-client systemd-logind[1011]: New session 14 of user root. Apr 3 01:23:25 oleg421-client systemd[1]: Started Session 14 of user root. Apr 3 01:23:25 oleg421-client sshd[8868]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:23:25 oleg421-client kernel: Lustre: DEBUG MARKER: === recovery-small: start setup 01:23:24 (1775193804) === Apr 3 01:23:25 oleg421-client sshd[8881]: Received disconnect from 192.168.204.21 port 58402:11: disconnected by user Apr 3 01:23:25 oleg421-client sshd[8881]: Disconnected from user root 192.168.204.21 port 58402 Apr 3 01:23:25 oleg421-client sshd[8868]: pam_unix(sshd:session): session closed for user root Apr 3 01:23:26 oleg421-client systemd-logind[1011]: Session 14 logged out. Waiting for processes to exit. Apr 3 01:23:26 oleg421-client systemd[1]: session-14.scope: Succeeded. Apr 3 01:23:26 oleg421-client systemd-logind[1011]: Removed session 14. Apr 3 01:23:29 oleg421-client sshd[9116]: Accepted publickey for root from 192.168.204.21 port 55680 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:23:29 oleg421-client systemd-logind[1011]: New session 15 of user root. Apr 3 01:23:29 oleg421-client systemd[1]: Started Session 15 of user root. Apr 3 01:23:29 oleg421-client sshd[9116]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:23:29 oleg421-client kernel: Lustre: DEBUG MARKER: oleg421-client.virtnet: executing check_config_client /mnt/lustre Apr 3 01:23:29 oleg421-client sshd[9129]: Received disconnect from 192.168.204.21 port 55680:11: disconnected by user Apr 3 01:23:29 oleg421-client sshd[9129]: Disconnected from user root 192.168.204.21 port 55680 Apr 3 01:23:30 oleg421-client sshd[9116]: pam_unix(sshd:session): session closed for user root Apr 3 01:23:30 oleg421-client systemd[1]: session-15.scope: Succeeded. Apr 3 01:23:30 oleg421-client systemd-logind[1011]: Session 15 logged out. Waiting for processes to exit. Apr 3 01:23:30 oleg421-client systemd-logind[1011]: Removed session 15. Apr 3 01:23:50 oleg421-client sshd[9856]: Accepted publickey for root from 192.168.204.21 port 38442 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:23:51 oleg421-client systemd-logind[1011]: New session 16 of user root. Apr 3 01:23:51 oleg421-client systemd[1]: Started Session 16 of user root. Apr 3 01:23:51 oleg421-client sshd[9856]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:23:51 oleg421-client kernel: Lustre: DEBUG MARKER: Using TIMEOUT=20 Apr 3 01:23:51 oleg421-client sshd[9869]: Received disconnect from 192.168.204.21 port 38442:11: disconnected by user Apr 3 01:23:51 oleg421-client sshd[9869]: Disconnected from user root 192.168.204.21 port 38442 Apr 3 01:23:51 oleg421-client sshd[9856]: pam_unix(sshd:session): session closed for user root Apr 3 01:23:51 oleg421-client systemd[1]: session-16.scope: Succeeded. Apr 3 01:23:51 oleg421-client systemd-logind[1011]: Session 16 logged out. Waiting for processes to exit. Apr 3 01:23:51 oleg421-client systemd-logind[1011]: Removed session 16. Apr 3 01:23:52 oleg421-client sshd[9991]: Accepted publickey for root from 192.168.204.21 port 38444 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:23:52 oleg421-client systemd[1]: Started Session 17 of user root. Apr 3 01:23:52 oleg421-client systemd-logind[1011]: New session 17 of user root. Apr 3 01:23:52 oleg421-client sshd[9991]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:23:52 oleg421-client sshd[10004]: Received disconnect from 192.168.204.21 port 38444:11: disconnected by user Apr 3 01:23:52 oleg421-client sshd[10004]: Disconnected from user root 192.168.204.21 port 38444 Apr 3 01:23:52 oleg421-client sshd[9991]: pam_unix(sshd:session): session closed for user root Apr 3 01:23:53 oleg421-client systemd[1]: session-17.scope: Succeeded. Apr 3 01:23:53 oleg421-client systemd-logind[1011]: Session 17 logged out. Waiting for processes to exit. Apr 3 01:23:53 oleg421-client systemd-logind[1011]: Removed session 17. Apr 3 01:24:03 oleg421-client sshd[10452]: Accepted publickey for root from 192.168.204.21 port 43348 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:24:03 oleg421-client systemd-logind[1011]: New session 18 of user root. Apr 3 01:24:03 oleg421-client systemd[1]: Started Session 18 of user root. Apr 3 01:24:03 oleg421-client sshd[10452]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:24:04 oleg421-client sshd[10465]: Received disconnect from 192.168.204.21 port 43348:11: disconnected by user Apr 3 01:24:04 oleg421-client sshd[10465]: Disconnected from user root 192.168.204.21 port 43348 Apr 3 01:24:04 oleg421-client sshd[10452]: pam_unix(sshd:session): session closed for user root Apr 3 01:24:06 oleg421-client sshd[10591]: Accepted publickey for root from 192.168.204.21 port 43354 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:24:06 oleg421-client systemd-logind[1011]: New session 19 of user root. Apr 3 01:24:06 oleg421-client systemd[1]: Started Session 19 of user root. Apr 3 01:24:06 oleg421-client sshd[10591]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:24:06 oleg421-client kernel: Lustre: DEBUG MARKER: === recovery-small: finish setup 01:24:04 (1775193844) === Apr 3 01:24:06 oleg421-client sshd[10604]: Received disconnect from 192.168.204.21 port 43354:11: disconnected by user Apr 3 01:24:06 oleg421-client sshd[10604]: Disconnected from user root 192.168.204.21 port 43354 Apr 3 01:24:06 oleg421-client sshd[10591]: pam_unix(sshd:session): session closed for user root Apr 3 01:24:06 oleg421-client systemd[1]: session-19.scope: Succeeded. Apr 3 01:24:06 oleg421-client systemd-logind[1011]: Session 19 logged out. Waiting for processes to exit. Apr 3 01:24:06 oleg421-client systemd-logind[1011]: Removed session 19. Apr 3 01:24:08 oleg421-client sshd[10747]: Accepted publickey for root from 192.168.204.21 port 60598 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:24:08 oleg421-client systemd[1]: Started Session 20 of user root. Apr 3 01:24:08 oleg421-client systemd-logind[1011]: New session 20 of user root. Apr 3 01:24:08 oleg421-client sshd[10747]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:24:08 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 1: create, chmod, stat: drop req, drop rep ========================================================== 01:24:07 (1775193847) Apr 3 01:24:09 oleg421-client sshd[10760]: Received disconnect from 192.168.204.21 port 60598:11: disconnected by user Apr 3 01:24:09 oleg421-client sshd[10760]: Disconnected from user root 192.168.204.21 port 60598 Apr 3 01:24:09 oleg421-client sshd[10747]: pam_unix(sshd:session): session closed for user root Apr 3 01:24:09 oleg421-client systemd[1]: session-20.scope: Succeeded. Apr 3 01:24:09 oleg421-client systemd-logind[1011]: Session 20 logged out. Waiting for processes to exit. Apr 3 01:24:09 oleg421-client systemd-logind[1011]: Removed session 20. Apr 3 01:24:26 oleg421-client kernel: Lustre: 10809:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775193850/real 1775193850] req@ffff9624435f4a80 x1861425361337984/t0(0) o700->lustre-MDT0000-mdc-ffff962451dc4800@192.168.204.121@tcp:30/10 lens 264/248 e 0 to 1 dl 1775193866 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 Apr 3 01:24:26 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962451dc4800: Connection to lustre-MDT0000 (at 192.168.204.121@tcp) was lost; in progress operations using this service will wait for recovery to complete Apr 3 01:24:26 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962451dc4800: Connection restored to 192.168.204.121@tcp (at 192.168.204.121@tcp) Apr 3 01:24:44 oleg421-client kernel: Lustre: 10830:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775193868/real 1775193868] req@ffff962444848000 x1861425361340288/t0(0) o36->lustre-MDT0000-mdc-ffff962451dc4800@192.168.204.121@tcp:12/10 lens 520/576 e 0 to 1 dl 1775193884 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 Apr 3 01:24:44 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962451dc4800: Connection to lustre-MDT0000 (at 192.168.204.121@tcp) was lost; in progress operations using this service will wait for recovery to complete Apr 3 01:24:44 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962451dc4800: Connection restored to 192.168.204.121@tcp (at 192.168.204.121@tcp) Apr 3 01:25:02 oleg421-client kernel: Lustre: 10855:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775193886/real 1775193886] req@ffff962444848000 x1861425361342080/t0(0) o101->lustre-MDT0000-mdc-ffff962451dc4800@192.168.204.121@tcp:12/10 lens 576/1152 e 0 to 1 dl 1775193902 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'tchmod.0' uid:0 gid:0 projid:0 Apr 3 01:25:02 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962451dc4800: Connection to lustre-MDT0000 (at 192.168.204.121@tcp) was lost; in progress operations using this service will wait for recovery to complete Apr 3 01:25:02 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962451dc4800: Connection restored to 192.168.204.121@tcp (at 192.168.204.121@tcp) Apr 3 01:25:21 oleg421-client kernel: Lustre: 10876:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775193905/real 1775193905] req@ffff962444849c00 x1861425361344896/t0(0) o36->lustre-MDT0000-mdc-ffff962451dc4800@192.168.204.121@tcp:12/10 lens 488/512 e 0 to 1 dl 1775193921 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'tchmod.0' uid:0 gid:0 projid:4294967295 Apr 3 01:25:21 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962451dc4800: Connection to lustre-MDT0000 (at 192.168.204.121@tcp) was lost; in progress operations using this service will wait for recovery to complete Apr 3 01:25:21 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962451dc4800: Connection restored to 192.168.204.121@tcp (at 192.168.204.121@tcp) Apr 3 01:25:40 oleg421-client kernel: Lustre: 10902:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775193924/real 1775193924] req@ffff962443e84000 x1861425361346688/t0(0) o34->lustre-MDT0000-mdc-ffff962451dc4800@192.168.204.121@tcp:12/10 lens 472/728 e 0 to 1 dl 1775193940 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'statone.0' uid:0 gid:0 projid:0 Apr 3 01:25:40 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962451dc4800: Connection to lustre-MDT0000 (at 192.168.204.121@tcp) was lost; in progress operations using this service will wait for recovery to complete Apr 3 01:25:40 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962451dc4800: Connection restored to 192.168.204.121@tcp (at 192.168.204.121@tcp) Apr 3 01:25:58 oleg421-client kernel: Lustre: 10922:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775193942/real 1775193942] req@ffff9624435f6680 x1861425361348480/t0(0) o34->lustre-MDT0000-mdc-ffff962451dc4800@192.168.204.121@tcp:12/10 lens 472/728 e 0 to 1 dl 1775193958 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'statone.0' uid:0 gid:0 projid:0 Apr 3 01:25:58 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962451dc4800: Connection to lustre-MDT0000 (at 192.168.204.121@tcp) was lost; in progress operations using this service will wait for recovery to complete Apr 3 01:25:58 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962451dc4800: Connection restored to 192.168.204.121@tcp (at 192.168.204.121@tcp) Apr 3 01:26:01 oleg421-client sshd[11021]: Accepted publickey for root from 192.168.204.21 port 42614 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:26:02 oleg421-client systemd-logind[1011]: New session 21 of user root. Apr 3 01:26:02 oleg421-client systemd[1]: Started Session 21 of user root. Apr 3 01:26:02 oleg421-client sshd[11021]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:26:02 oleg421-client sshd[11034]: Received disconnect from 192.168.204.21 port 42614:11: disconnected by user Apr 3 01:26:02 oleg421-client sshd[11034]: Disconnected from user root 192.168.204.21 port 42614 Apr 3 01:26:02 oleg421-client sshd[11021]: pam_unix(sshd:session): session closed for user root Apr 3 01:26:02 oleg421-client systemd[1]: session-21.scope: Succeeded. Apr 3 01:26:02 oleg421-client systemd-logind[1011]: Session 21 logged out. Waiting for processes to exit. Apr 3 01:26:02 oleg421-client systemd-logind[1011]: Removed session 21. Apr 3 01:26:03 oleg421-client sshd[11160]: Accepted publickey for root from 192.168.204.21 port 42626 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:26:03 oleg421-client systemd-logind[1011]: New session 22 of user root. Apr 3 01:26:03 oleg421-client systemd[1]: Started Session 22 of user root. Apr 3 01:26:03 oleg421-client rsyslogd[1073]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Apr 3 01:26:03 oleg421-client sshd[11160]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:26:04 oleg421-client sshd[11174]: Received disconnect from 192.168.204.21 port 42626:11: disconnected by user Apr 3 01:26:04 oleg421-client sshd[11174]: Disconnected from user root 192.168.204.21 port 42626 Apr 3 01:26:04 oleg421-client sshd[11160]: pam_unix(sshd:session): session closed for user root Apr 3 01:26:04 oleg421-client systemd[1]: session-22.scope: Succeeded. Apr 3 01:26:04 oleg421-client systemd-logind[1011]: Session 22 logged out. Waiting for processes to exit. Apr 3 01:26:04 oleg421-client systemd-logind[1011]: Removed session 22. Apr 3 01:26:05 oleg421-client sshd[11307]: Accepted publickey for root from 192.168.204.21 port 42632 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:26:05 oleg421-client systemd-logind[1011]: New session 23 of user root. Apr 3 01:26:05 oleg421-client systemd[1]: Started Session 23 of user root. Apr 3 01:26:05 oleg421-client sshd[11307]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:26:06 oleg421-client sshd[11320]: Received disconnect from 192.168.204.21 port 42632:11: disconnected by user Apr 3 01:26:06 oleg421-client sshd[11320]: Disconnected from user root 192.168.204.21 port 42632 Apr 3 01:26:06 oleg421-client sshd[11307]: pam_unix(sshd:session): session closed for user root Apr 3 01:26:06 oleg421-client systemd[1]: session-23.scope: Succeeded. Apr 3 01:26:06 oleg421-client systemd-logind[1011]: Session 23 logged out. Waiting for processes to exit. Apr 3 01:26:06 oleg421-client systemd-logind[1011]: Removed session 23. Apr 3 01:26:08 oleg421-client sshd[11465]: Accepted publickey for root from 192.168.204.21 port 59830 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:26:08 oleg421-client systemd-logind[1011]: New session 24 of user root. Apr 3 01:26:08 oleg421-client systemd[1]: Started Session 24 of user root. Apr 3 01:26:08 oleg421-client sshd[11465]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:26:08 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 4: open: drop req, drop rep ======= 01:26:06 (1775193966) Apr 3 01:26:08 oleg421-client sshd[11478]: Received disconnect from 192.168.204.21 port 59830:11: disconnected by user Apr 3 01:26:08 oleg421-client sshd[11478]: Disconnected from user root 192.168.204.21 port 59830 Apr 3 01:26:08 oleg421-client sshd[11465]: pam_unix(sshd:session): session closed for user root Apr 3 01:26:09 oleg421-client systemd[1]: session-24.scope: Succeeded. Apr 3 01:26:09 oleg421-client systemd-logind[1011]: Session 24 logged out. Waiting for processes to exit. Apr 3 01:26:09 oleg421-client systemd-logind[1011]: Removed session 24. Apr 3 01:26:26 oleg421-client kernel: Lustre: 11534:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775193970/real 1775193970] req@ffff962450119180 x1861425361351808/t0(0) o101->lustre-MDT0000-mdc-ffff962451dc4800@192.168.204.121@tcp:12/10 lens 576/1152 e 0 to 1 dl 1775193986 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 Apr 3 01:26:26 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962451dc4800: Connection to lustre-MDT0000 (at 192.168.204.121@tcp) was lost; in progress operations using this service will wait for recovery to complete Apr 3 01:26:26 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962451dc4800: Connection restored to 192.168.204.121@tcp (at 192.168.204.121@tcp) Apr 3 01:26:47 oleg421-client sshd[11654]: Accepted publickey for root from 192.168.204.21 port 58942 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:26:47 oleg421-client systemd-logind[1011]: New session 25 of user root. Apr 3 01:26:47 oleg421-client systemd[1]: Started Session 25 of user root. Apr 3 01:26:47 oleg421-client sshd[11654]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:26:48 oleg421-client sshd[11667]: Received disconnect from 192.168.204.21 port 58942:11: disconnected by user Apr 3 01:26:48 oleg421-client sshd[11667]: Disconnected from user root 192.168.204.21 port 58942 Apr 3 01:26:48 oleg421-client sshd[11654]: pam_unix(sshd:session): session closed for user root Apr 3 01:26:48 oleg421-client systemd[1]: session-25.scope: Succeeded. Apr 3 01:26:48 oleg421-client systemd-logind[1011]: Session 25 logged out. Waiting for processes to exit. Apr 3 01:26:48 oleg421-client systemd-logind[1011]: Removed session 25. Apr 3 01:26:49 oleg421-client sshd[11794]: Accepted publickey for root from 192.168.204.21 port 58956 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:26:49 oleg421-client systemd-logind[1011]: New session 26 of user root. Apr 3 01:26:49 oleg421-client systemd[1]: Started Session 26 of user root. Apr 3 01:26:49 oleg421-client sshd[11794]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:26:49 oleg421-client sshd[11807]: Received disconnect from 192.168.204.21 port 58956:11: disconnected by user Apr 3 01:26:49 oleg421-client sshd[11807]: Disconnected from user root 192.168.204.21 port 58956 Apr 3 01:26:49 oleg421-client sshd[11794]: pam_unix(sshd:session): session closed for user root Apr 3 01:26:49 oleg421-client systemd[1]: session-26.scope: Succeeded. Apr 3 01:26:49 oleg421-client systemd-logind[1011]: Session 26 logged out. Waiting for processes to exit. Apr 3 01:26:49 oleg421-client systemd-logind[1011]: Removed session 26. Apr 3 01:26:51 oleg421-client sshd[11940]: Accepted publickey for root from 192.168.204.21 port 58970 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:26:51 oleg421-client systemd-logind[1011]: New session 27 of user root. Apr 3 01:26:51 oleg421-client systemd[1]: Started Session 27 of user root. Apr 3 01:26:51 oleg421-client sshd[11940]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:26:51 oleg421-client sshd[11953]: Received disconnect from 192.168.204.21 port 58970:11: disconnected by user Apr 3 01:26:51 oleg421-client sshd[11953]: Disconnected from user root 192.168.204.21 port 58970 Apr 3 01:26:51 oleg421-client sshd[11940]: pam_unix(sshd:session): session closed for user root Apr 3 01:26:51 oleg421-client systemd[1]: session-27.scope: Succeeded. Apr 3 01:26:51 oleg421-client systemd-logind[1011]: Session 27 logged out. Waiting for processes to exit. Apr 3 01:26:51 oleg421-client systemd-logind[1011]: Removed session 27. Apr 3 01:26:53 oleg421-client sshd[12096]: Accepted publickey for root from 192.168.204.21 port 58986 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:26:53 oleg421-client systemd[1]: Started Session 28 of user root. Apr 3 01:26:53 oleg421-client systemd-logind[1011]: New session 28 of user root. Apr 3 01:26:53 oleg421-client sshd[12096]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:26:54 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 5: rename: drop req, drop rep ===== 01:26:52 (1775194012) Apr 3 01:26:54 oleg421-client sshd[12109]: Received disconnect from 192.168.204.21 port 58986:11: disconnected by user Apr 3 01:26:54 oleg421-client sshd[12109]: Disconnected from user root 192.168.204.21 port 58986 Apr 3 01:26:54 oleg421-client sshd[12096]: pam_unix(sshd:session): session closed for user root Apr 3 01:26:54 oleg421-client systemd-logind[1011]: Session 28 logged out. Waiting for processes to exit. Apr 3 01:26:54 oleg421-client systemd[1]: session-28.scope: Succeeded. Apr 3 01:26:54 oleg421-client systemd-logind[1011]: Removed session 28. Apr 3 01:27:11 oleg421-client kernel: Lustre: 12164:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775194015/real 1775194015] req@ffff96244484bb80 x1861425361359488/t0(0) o101->lustre-MDT0000-mdc-ffff962451dc4800@192.168.204.121@tcp:12/10 lens 576/1152 e 0 to 1 dl 1775194031 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'mv.0' uid:0 gid:0 projid:0 Apr 3 01:27:11 oleg421-client kernel: Lustre: 12164:0:(client.c:2479:ptlrpc_expire_one_request()) Skipped 1 previous similar message Apr 3 01:27:11 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962451dc4800: Connection to lustre-MDT0000 (at 192.168.204.121@tcp) was lost; in progress operations using this service will wait for recovery to complete Apr 3 01:27:11 oleg421-client kernel: Lustre: Skipped 1 previous similar message Apr 3 01:27:11 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962451dc4800: Connection restored to 192.168.204.121@tcp (at 192.168.204.121@tcp) Apr 3 01:27:11 oleg421-client kernel: Lustre: Skipped 1 previous similar message Apr 3 01:27:32 oleg421-client sshd[12296]: Accepted publickey for root from 192.168.204.21 port 57200 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:27:32 oleg421-client systemd-logind[1011]: New session 29 of user root. Apr 3 01:27:32 oleg421-client systemd[1]: Started Session 29 of user root. Apr 3 01:27:32 oleg421-client sshd[12296]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:27:33 oleg421-client sshd[12309]: Received disconnect from 192.168.204.21 port 57200:11: disconnected by user Apr 3 01:27:33 oleg421-client sshd[12309]: Disconnected from user root 192.168.204.21 port 57200 Apr 3 01:27:33 oleg421-client sshd[12296]: pam_unix(sshd:session): session closed for user root Apr 3 01:27:33 oleg421-client systemd-logind[1011]: Session 29 logged out. Waiting for processes to exit. Apr 3 01:27:33 oleg421-client systemd[1]: session-29.scope: Succeeded. Apr 3 01:27:33 oleg421-client systemd-logind[1011]: Removed session 29. Apr 3 01:27:34 oleg421-client sshd[12437]: Accepted publickey for root from 192.168.204.21 port 57214 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:27:34 oleg421-client systemd-logind[1011]: New session 30 of user root. Apr 3 01:27:34 oleg421-client systemd[1]: Started Session 30 of user root. Apr 3 01:27:34 oleg421-client sshd[12437]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:27:35 oleg421-client sshd[12450]: Received disconnect from 192.168.204.21 port 57214:11: disconnected by user Apr 3 01:27:35 oleg421-client sshd[12450]: Disconnected from user root 192.168.204.21 port 57214 Apr 3 01:27:35 oleg421-client sshd[12437]: pam_unix(sshd:session): session closed for user root Apr 3 01:27:35 oleg421-client systemd[1]: session-30.scope: Succeeded. Apr 3 01:27:35 oleg421-client systemd-logind[1011]: Session 30 logged out. Waiting for processes to exit. Apr 3 01:27:35 oleg421-client systemd-logind[1011]: Removed session 30. Apr 3 01:27:36 oleg421-client sshd[12583]: Accepted publickey for root from 192.168.204.21 port 57220 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:27:36 oleg421-client systemd-logind[1011]: New session 31 of user root. Apr 3 01:27:36 oleg421-client systemd[1]: Started Session 31 of user root. Apr 3 01:27:36 oleg421-client sshd[12583]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:27:37 oleg421-client sshd[12596]: Received disconnect from 192.168.204.21 port 57220:11: disconnected by user Apr 3 01:27:37 oleg421-client sshd[12596]: Disconnected from user root 192.168.204.21 port 57220 Apr 3 01:27:37 oleg421-client sshd[12583]: pam_unix(sshd:session): session closed for user root Apr 3 01:27:37 oleg421-client systemd-logind[1011]: Session 31 logged out. Waiting for processes to exit. Apr 3 01:27:37 oleg421-client systemd[1]: session-31.scope: Succeeded. Apr 3 01:27:37 oleg421-client systemd-logind[1011]: Removed session 31. Apr 3 01:27:39 oleg421-client sshd[12738]: Accepted publickey for root from 192.168.204.21 port 60734 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:27:39 oleg421-client systemd[1]: Started Session 32 of user root. Apr 3 01:27:39 oleg421-client systemd-logind[1011]: New session 32 of user root. Apr 3 01:27:39 oleg421-client sshd[12738]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:27:39 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 6: link, unlink: drop req, drop rep ========================================================== 01:27:37 (1775194057) Apr 3 01:27:39 oleg421-client sshd[12752]: Received disconnect from 192.168.204.21 port 60734:11: disconnected by user Apr 3 01:27:40 oleg421-client sshd[12752]: Disconnected from user root 192.168.204.21 port 60734 Apr 3 01:27:40 oleg421-client sshd[12738]: pam_unix(sshd:session): session closed for user root Apr 3 01:27:40 oleg421-client systemd[1]: session-32.scope: Succeeded. Apr 3 01:27:40 oleg421-client systemd-logind[1011]: Session 32 logged out. Waiting for processes to exit. Apr 3 01:27:40 oleg421-client systemd-logind[1011]: Removed session 32. Apr 3 01:27:57 oleg421-client kernel: Lustre: lustre-OST0000-osc-ffff962451dc4800: disconnect after 20s idle Apr 3 01:27:57 oleg421-client kernel: Lustre: Skipped 1 previous similar message Apr 3 01:28:16 oleg421-client kernel: Lustre: 12828:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775194080/real 1775194080] req@ffff9624435f6680 x1861425361372672/t0(0) o36->lustre-MDT0000-mdc-ffff962451dc4800@192.168.204.121@tcp:12/10 lens 512/440 e 0 to 1 dl 1775194096 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'link.0' uid:0 gid:0 projid:4294967295 Apr 3 01:28:16 oleg421-client kernel: Lustre: 12828:0:(client.c:2479:ptlrpc_expire_one_request()) Skipped 2 previous similar messages Apr 3 01:28:16 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962451dc4800: Connection to lustre-MDT0000 (at 192.168.204.121@tcp) was lost; in progress operations using this service will wait for recovery to complete Apr 3 01:28:16 oleg421-client kernel: Lustre: Skipped 2 previous similar messages Apr 3 01:28:16 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962451dc4800: Connection restored to 192.168.204.121@tcp (at 192.168.204.121@tcp) Apr 3 01:28:16 oleg421-client kernel: Lustre: Skipped 2 previous similar messages Apr 3 01:28:57 oleg421-client sshd[12979]: Accepted publickey for root from 192.168.204.21 port 33238 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:28:57 oleg421-client systemd[1]: Started Session 33 of user root. Apr 3 01:28:57 oleg421-client systemd-logind[1011]: New session 33 of user root. Apr 3 01:28:57 oleg421-client sshd[12979]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:28:58 oleg421-client sshd[12992]: Received disconnect from 192.168.204.21 port 33238:11: disconnected by user Apr 3 01:28:58 oleg421-client sshd[12992]: Disconnected from user root 192.168.204.21 port 33238 Apr 3 01:28:58 oleg421-client sshd[12979]: pam_unix(sshd:session): session closed for user root Apr 3 01:28:58 oleg421-client systemd-logind[1011]: Session 33 logged out. Waiting for processes to exit. Apr 3 01:28:58 oleg421-client systemd[1]: session-33.scope: Succeeded. Apr 3 01:28:58 oleg421-client systemd-logind[1011]: Removed session 33. Apr 3 01:28:59 oleg421-client sshd[13118]: Accepted publickey for root from 192.168.204.21 port 33248 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:28:59 oleg421-client systemd-logind[1011]: New session 34 of user root. Apr 3 01:28:59 oleg421-client systemd[1]: Started Session 34 of user root. Apr 3 01:28:59 oleg421-client sshd[13118]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:29:00 oleg421-client sshd[13131]: Received disconnect from 192.168.204.21 port 33248:11: disconnected by user Apr 3 01:29:00 oleg421-client sshd[13131]: Disconnected from user root 192.168.204.21 port 33248 Apr 3 01:29:00 oleg421-client sshd[13118]: pam_unix(sshd:session): session closed for user root Apr 3 01:29:00 oleg421-client systemd[1]: session-34.scope: Succeeded. Apr 3 01:29:00 oleg421-client systemd-logind[1011]: Session 34 logged out. Waiting for processes to exit. Apr 3 01:29:00 oleg421-client systemd-logind[1011]: Removed session 34. Apr 3 01:29:01 oleg421-client sshd[13265]: Accepted publickey for root from 192.168.204.21 port 33260 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:29:01 oleg421-client systemd[1]: Started Session 35 of user root. Apr 3 01:29:01 oleg421-client systemd-logind[1011]: New session 35 of user root. Apr 3 01:29:01 oleg421-client sshd[13265]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:29:02 oleg421-client sshd[13278]: Received disconnect from 192.168.204.21 port 33260:11: disconnected by user Apr 3 01:29:02 oleg421-client sshd[13278]: Disconnected from user root 192.168.204.21 port 33260 Apr 3 01:29:02 oleg421-client sshd[13265]: pam_unix(sshd:session): session closed for user root Apr 3 01:29:02 oleg421-client systemd-logind[1011]: Session 35 logged out. Waiting for processes to exit. Apr 3 01:29:02 oleg421-client systemd[1]: session-35.scope: Succeeded. Apr 3 01:29:02 oleg421-client systemd-logind[1011]: Removed session 35. Apr 3 01:29:03 oleg421-client sshd[13420]: Accepted publickey for root from 192.168.204.21 port 33270 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:29:03 oleg421-client systemd[1]: Started Session 36 of user root. Apr 3 01:29:03 oleg421-client systemd-logind[1011]: New session 36 of user root. Apr 3 01:29:03 oleg421-client sshd[13420]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:29:03 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 8: touch: drop rep (bug 1423) ===== 01:29:02 (1775194142) Apr 3 01:29:03 oleg421-client sshd[13433]: Received disconnect from 192.168.204.21 port 33270:11: disconnected by user Apr 3 01:29:04 oleg421-client sshd[13433]: Disconnected from user root 192.168.204.21 port 33270 Apr 3 01:29:04 oleg421-client sshd[13420]: pam_unix(sshd:session): session closed for user root Apr 3 01:29:04 oleg421-client systemd[1]: session-36.scope: Succeeded. Apr 3 01:29:04 oleg421-client systemd-logind[1011]: Session 36 logged out. Waiting for processes to exit. Apr 3 01:29:04 oleg421-client systemd-logind[1011]: Removed session 36. Apr 3 01:29:25 oleg421-client sshd[13575]: Accepted publickey for root from 192.168.204.21 port 41616 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:29:25 oleg421-client systemd-logind[1011]: New session 37 of user root. Apr 3 01:29:25 oleg421-client systemd[1]: Started Session 37 of user root. Apr 3 01:29:25 oleg421-client sshd[13575]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:29:26 oleg421-client sshd[13588]: Received disconnect from 192.168.204.21 port 41616:11: disconnected by user Apr 3 01:29:26 oleg421-client sshd[13588]: Disconnected from user root 192.168.204.21 port 41616 Apr 3 01:29:26 oleg421-client sshd[13575]: pam_unix(sshd:session): session closed for user root Apr 3 01:29:26 oleg421-client systemd[1]: session-37.scope: Succeeded. Apr 3 01:29:26 oleg421-client systemd-logind[1011]: Session 37 logged out. Waiting for processes to exit. Apr 3 01:29:26 oleg421-client systemd-logind[1011]: Removed session 37. Apr 3 01:29:28 oleg421-client sshd[13715]: Accepted publickey for root from 192.168.204.21 port 56096 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:29:28 oleg421-client systemd-logind[1011]: New session 38 of user root. Apr 3 01:29:28 oleg421-client systemd[1]: Started Session 38 of user root. Apr 3 01:29:28 oleg421-client sshd[13715]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:29:28 oleg421-client sshd[13728]: Received disconnect from 192.168.204.21 port 56096:11: disconnected by user Apr 3 01:29:28 oleg421-client sshd[13728]: Disconnected from user root 192.168.204.21 port 56096 Apr 3 01:29:29 oleg421-client sshd[13715]: pam_unix(sshd:session): session closed for user root Apr 3 01:29:29 oleg421-client systemd-logind[1011]: Session 38 logged out. Waiting for processes to exit. Apr 3 01:29:29 oleg421-client systemd[1]: session-38.scope: Succeeded. Apr 3 01:29:29 oleg421-client systemd-logind[1011]: Removed session 38. Apr 3 01:29:31 oleg421-client sshd[13862]: Accepted publickey for root from 192.168.204.21 port 56108 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:29:31 oleg421-client systemd[1]: Started Session 39 of user root. Apr 3 01:29:31 oleg421-client systemd-logind[1011]: New session 39 of user root. Apr 3 01:29:31 oleg421-client sshd[13862]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:29:32 oleg421-client sshd[13875]: Received disconnect from 192.168.204.21 port 56108:11: disconnected by user Apr 3 01:29:32 oleg421-client sshd[13875]: Disconnected from user root 192.168.204.21 port 56108 Apr 3 01:29:32 oleg421-client sshd[13862]: pam_unix(sshd:session): session closed for user root Apr 3 01:29:32 oleg421-client systemd[1]: session-39.scope: Succeeded. Apr 3 01:29:32 oleg421-client systemd-logind[1011]: Session 39 logged out. Waiting for processes to exit. Apr 3 01:29:32 oleg421-client systemd-logind[1011]: Removed session 39. Apr 3 01:29:33 oleg421-client sshd[14018]: Accepted publickey for root from 192.168.204.21 port 56120 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:29:33 oleg421-client systemd-logind[1011]: New session 40 of user root. Apr 3 01:29:33 oleg421-client systemd[1]: Started Session 40 of user root. Apr 3 01:29:33 oleg421-client sshd[14018]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:29:33 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 9: pause bulk on OST (bug 1420) === 01:29:32 (1775194172) Apr 3 01:29:33 oleg421-client sshd[14031]: Received disconnect from 192.168.204.21 port 56120:11: disconnected by user Apr 3 01:29:33 oleg421-client sshd[14031]: Disconnected from user root 192.168.204.21 port 56120 Apr 3 01:29:33 oleg421-client sshd[14018]: pam_unix(sshd:session): session closed for user root Apr 3 01:29:34 oleg421-client systemd[1]: session-40.scope: Succeeded. Apr 3 01:29:34 oleg421-client systemd-logind[1011]: Session 40 logged out. Waiting for processes to exit. Apr 3 01:29:34 oleg421-client systemd-logind[1011]: Removed session 40. Apr 3 01:29:44 oleg421-client sshd[14257]: Accepted publickey for root from 192.168.204.21 port 36158 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:29:45 oleg421-client systemd-logind[1011]: New session 41 of user root. Apr 3 01:29:45 oleg421-client systemd[1]: Started Session 41 of user root. Apr 3 01:29:45 oleg421-client sshd[14257]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:29:45 oleg421-client sshd[14270]: Received disconnect from 192.168.204.21 port 36158:11: disconnected by user Apr 3 01:29:45 oleg421-client sshd[14270]: Disconnected from user root 192.168.204.21 port 36158 Apr 3 01:29:45 oleg421-client sshd[14257]: pam_unix(sshd:session): session closed for user root Apr 3 01:29:45 oleg421-client systemd[1]: session-41.scope: Succeeded. Apr 3 01:29:45 oleg421-client systemd-logind[1011]: Session 41 logged out. Waiting for processes to exit. Apr 3 01:29:45 oleg421-client systemd-logind[1011]: Removed session 41. Apr 3 01:29:46 oleg421-client sshd[14396]: Accepted publickey for root from 192.168.204.21 port 36170 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:29:46 oleg421-client systemd[1]: Started Session 42 of user root. Apr 3 01:29:46 oleg421-client systemd-logind[1011]: New session 42 of user root. Apr 3 01:29:46 oleg421-client sshd[14396]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:29:46 oleg421-client sshd[14409]: Received disconnect from 192.168.204.21 port 36170:11: disconnected by user Apr 3 01:29:46 oleg421-client sshd[14409]: Disconnected from user root 192.168.204.21 port 36170 Apr 3 01:29:46 oleg421-client sshd[14396]: pam_unix(sshd:session): session closed for user root Apr 3 01:29:47 oleg421-client systemd[1]: session-42.scope: Succeeded. Apr 3 01:29:47 oleg421-client systemd-logind[1011]: Session 42 logged out. Waiting for processes to exit. Apr 3 01:29:47 oleg421-client systemd-logind[1011]: Removed session 42. Apr 3 01:29:48 oleg421-client sshd[14542]: Accepted publickey for root from 192.168.204.21 port 50538 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:29:48 oleg421-client systemd-logind[1011]: New session 43 of user root. Apr 3 01:29:48 oleg421-client systemd[1]: Started Session 43 of user root. Apr 3 01:29:48 oleg421-client sshd[14542]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:29:49 oleg421-client sshd[14556]: Received disconnect from 192.168.204.21 port 50538:11: disconnected by user Apr 3 01:29:49 oleg421-client sshd[14556]: Disconnected from user root 192.168.204.21 port 50538 Apr 3 01:29:49 oleg421-client sshd[14542]: pam_unix(sshd:session): session closed for user root Apr 3 01:29:49 oleg421-client systemd-logind[1011]: Session 43 logged out. Waiting for processes to exit. Apr 3 01:29:49 oleg421-client systemd[1]: session-43.scope: Succeeded. Apr 3 01:29:49 oleg421-client systemd-logind[1011]: Removed session 43. Apr 3 01:29:50 oleg421-client sshd[14700]: Accepted publickey for root from 192.168.204.21 port 50548 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:29:51 oleg421-client systemd[1]: Started Session 44 of user root. Apr 3 01:29:51 oleg421-client systemd-logind[1011]: New session 44 of user root. Apr 3 01:29:51 oleg421-client sshd[14700]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:29:51 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10a: finish request on server after client eviction (bug 1521) ========================================================== 01:29:49 (1775194189) Apr 3 01:29:51 oleg421-client sshd[14713]: Received disconnect from 192.168.204.21 port 50548:11: disconnected by user Apr 3 01:29:51 oleg421-client sshd[14713]: Disconnected from user root 192.168.204.21 port 50548 Apr 3 01:29:51 oleg421-client sshd[14700]: pam_unix(sshd:session): session closed for user root Apr 3 01:29:51 oleg421-client systemd[1]: session-44.scope: Succeeded. Apr 3 01:29:51 oleg421-client systemd-logind[1011]: Session 44 logged out. Waiting for processes to exit. Apr 3 01:29:51 oleg421-client systemd-logind[1011]: Removed session 44. Apr 3 01:29:52 oleg421-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Apr 3 01:30:07 oleg421-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Apr 3 01:30:12 oleg421-client kernel: Lustre: lustre-OST0000-osc-ffff962451dc4800: disconnect after 24s idle Apr 3 01:30:24 oleg421-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Apr 3 01:30:40 oleg421-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Apr 3 01:30:55 oleg421-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Apr 3 01:31:12 oleg421-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Apr 3 01:31:28 oleg421-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Apr 3 01:31:44 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962451dc4800: operation ldlm_enqueue to node 192.168.204.121@tcp failed: rc = -107 Apr 3 01:31:44 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962451dc4800: Connection to lustre-MDT0000 (at 192.168.204.121@tcp) was lost; in progress operations using this service will wait for recovery to complete Apr 3 01:31:44 oleg421-client kernel: Lustre: Skipped 3 previous similar messages Apr 3 01:31:44 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962451dc4800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Apr 3 01:31:44 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962451dc4800: Connection restored to 192.168.204.121@tcp (at 192.168.204.121@tcp) Apr 3 01:31:44 oleg421-client kernel: Lustre: Skipped 3 previous similar messages Apr 3 01:31:48 oleg421-client sshd[14956]: Accepted publickey for root from 192.168.204.21 port 42074 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:31:48 oleg421-client systemd-logind[1011]: New session 45 of user root. Apr 3 01:31:48 oleg421-client systemd[1]: Started Session 45 of user root. Apr 3 01:31:48 oleg421-client sshd[14956]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:31:49 oleg421-client sshd[14969]: Received disconnect from 192.168.204.21 port 42074:11: disconnected by user Apr 3 01:31:49 oleg421-client sshd[14969]: Disconnected from user root 192.168.204.21 port 42074 Apr 3 01:31:49 oleg421-client sshd[14956]: pam_unix(sshd:session): session closed for user root Apr 3 01:31:49 oleg421-client systemd[1]: session-45.scope: Succeeded. Apr 3 01:31:49 oleg421-client systemd-logind[1011]: Session 45 logged out. Waiting for processes to exit. Apr 3 01:31:49 oleg421-client systemd-logind[1011]: Removed session 45. Apr 3 01:31:50 oleg421-client sshd[15096]: Accepted publickey for root from 192.168.204.21 port 42084 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:31:50 oleg421-client systemd-logind[1011]: New session 46 of user root. Apr 3 01:31:50 oleg421-client systemd[1]: Started Session 46 of user root. Apr 3 01:31:50 oleg421-client sshd[15096]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:31:50 oleg421-client sshd[15109]: Received disconnect from 192.168.204.21 port 42084:11: disconnected by user Apr 3 01:31:50 oleg421-client sshd[15109]: Disconnected from user root 192.168.204.21 port 42084 Apr 3 01:31:50 oleg421-client sshd[15096]: pam_unix(sshd:session): session closed for user root Apr 3 01:31:50 oleg421-client systemd-logind[1011]: Session 46 logged out. Waiting for processes to exit. Apr 3 01:31:50 oleg421-client systemd[1]: session-46.scope: Succeeded. Apr 3 01:31:50 oleg421-client systemd-logind[1011]: Removed session 46. Apr 3 01:31:51 oleg421-client sshd[15243]: Accepted publickey for root from 192.168.204.21 port 42096 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:31:52 oleg421-client systemd-logind[1011]: New session 47 of user root. Apr 3 01:31:52 oleg421-client systemd[1]: Started Session 47 of user root. Apr 3 01:31:52 oleg421-client sshd[15243]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:31:52 oleg421-client sshd[15256]: Received disconnect from 192.168.204.21 port 42096:11: disconnected by user Apr 3 01:31:52 oleg421-client sshd[15256]: Disconnected from user root 192.168.204.21 port 42096 Apr 3 01:31:52 oleg421-client sshd[15243]: pam_unix(sshd:session): session closed for user root Apr 3 01:31:52 oleg421-client systemd[1]: session-47.scope: Succeeded. Apr 3 01:31:52 oleg421-client systemd-logind[1011]: Session 47 logged out. Waiting for processes to exit. Apr 3 01:31:52 oleg421-client systemd-logind[1011]: Removed session 47. Apr 3 01:31:53 oleg421-client sshd[15399]: Accepted publickey for root from 192.168.204.21 port 42112 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:31:54 oleg421-client systemd[1]: Started Session 48 of user root. Apr 3 01:31:54 oleg421-client systemd-logind[1011]: New session 48 of user root. Apr 3 01:31:54 oleg421-client sshd[15399]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:31:54 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10b: re-send BL AST =============== 01:31:52 (1775194312) Apr 3 01:31:54 oleg421-client sshd[15412]: Received disconnect from 192.168.204.21 port 42112:11: disconnected by user Apr 3 01:31:54 oleg421-client sshd[15412]: Disconnected from user root 192.168.204.21 port 42112 Apr 3 01:31:54 oleg421-client sshd[15399]: pam_unix(sshd:session): session closed for user root Apr 3 01:31:54 oleg421-client systemd[1]: session-48.scope: Succeeded. Apr 3 01:31:54 oleg421-client systemd-logind[1011]: Session 48 logged out. Waiting for processes to exit. Apr 3 01:31:54 oleg421-client systemd-logind[1011]: Removed session 48. Apr 3 01:32:10 oleg421-client kernel: Lustre: lustre-OST0000-osc-ffff962451dc4800: disconnect after 20s idle Apr 3 01:32:13 oleg421-client sshd[15609]: Accepted publickey for root from 192.168.204.21 port 60586 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:32:13 oleg421-client systemd-logind[1011]: New session 49 of user root. Apr 3 01:32:13 oleg421-client systemd[1]: Started Session 49 of user root. Apr 3 01:32:13 oleg421-client sshd[15609]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:32:14 oleg421-client sshd[15622]: Received disconnect from 192.168.204.21 port 60586:11: disconnected by user Apr 3 01:32:14 oleg421-client sshd[15622]: Disconnected from user root 192.168.204.21 port 60586 Apr 3 01:32:14 oleg421-client sshd[15609]: pam_unix(sshd:session): session closed for user root Apr 3 01:32:14 oleg421-client systemd-logind[1011]: Session 49 logged out. Waiting for processes to exit. Apr 3 01:32:14 oleg421-client systemd[1]: session-49.scope: Succeeded. Apr 3 01:32:14 oleg421-client systemd-logind[1011]: Removed session 49. Apr 3 01:32:15 oleg421-client sshd[15749]: Accepted publickey for root from 192.168.204.21 port 60598 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:32:15 oleg421-client systemd-logind[1011]: New session 50 of user root. Apr 3 01:32:15 oleg421-client systemd[1]: Started Session 50 of user root. Apr 3 01:32:15 oleg421-client sshd[15749]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:32:16 oleg421-client sshd[15762]: Received disconnect from 192.168.204.21 port 60598:11: disconnected by user Apr 3 01:32:16 oleg421-client sshd[15762]: Disconnected from user root 192.168.204.21 port 60598 Apr 3 01:32:16 oleg421-client sshd[15749]: pam_unix(sshd:session): session closed for user root Apr 3 01:32:16 oleg421-client systemd[1]: session-50.scope: Succeeded. Apr 3 01:32:16 oleg421-client systemd-logind[1011]: Session 50 logged out. Waiting for processes to exit. Apr 3 01:32:16 oleg421-client systemd-logind[1011]: Removed session 50. Apr 3 01:32:17 oleg421-client sshd[15895]: Accepted publickey for root from 192.168.204.21 port 60600 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:32:17 oleg421-client systemd[1]: Started Session 51 of user root. Apr 3 01:32:17 oleg421-client systemd-logind[1011]: New session 51 of user root. Apr 3 01:32:17 oleg421-client sshd[15895]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:32:17 oleg421-client sshd[15908]: Received disconnect from 192.168.204.21 port 60600:11: disconnected by user Apr 3 01:32:17 oleg421-client sshd[15908]: Disconnected from user root 192.168.204.21 port 60600 Apr 3 01:32:17 oleg421-client sshd[15895]: pam_unix(sshd:session): session closed for user root Apr 3 01:32:17 oleg421-client systemd[1]: session-51.scope: Succeeded. Apr 3 01:32:17 oleg421-client systemd-logind[1011]: Session 51 logged out. Waiting for processes to exit. Apr 3 01:32:17 oleg421-client systemd-logind[1011]: Removed session 51. Apr 3 01:32:18 oleg421-client sshd[16051]: Accepted publickey for root from 192.168.204.21 port 57624 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:32:18 oleg421-client systemd-logind[1011]: New session 52 of user root. Apr 3 01:32:18 oleg421-client systemd[1]: Started Session 52 of user root. Apr 3 01:32:18 oleg421-client sshd[16051]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:32:19 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10c: re-send BL AST vs reconnect race (LU-5569) ========================================================== 01:32:18 (1775194338) Apr 3 01:32:19 oleg421-client sshd[16064]: Received disconnect from 192.168.204.21 port 57624:11: disconnected by user Apr 3 01:32:19 oleg421-client sshd[16064]: Disconnected from user root 192.168.204.21 port 57624 Apr 3 01:32:19 oleg421-client sshd[16051]: pam_unix(sshd:session): session closed for user root Apr 3 01:32:19 oleg421-client systemd[1]: session-52.scope: Succeeded. Apr 3 01:32:19 oleg421-client systemd-logind[1011]: Session 52 logged out. Waiting for processes to exit. Apr 3 01:32:19 oleg421-client systemd-logind[1011]: Removed session 52. Apr 3 01:32:19 oleg421-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Apr 3 01:32:19 oleg421-client kernel: Lustre: Skipped 1 previous similar message Apr 3 01:32:21 oleg421-client sshd[16253]: Accepted publickey for root from 192.168.204.21 port 57638 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:32:21 oleg421-client systemd-logind[1011]: New session 53 of user root. Apr 3 01:32:21 oleg421-client systemd[1]: Started Session 53 of user root. Apr 3 01:32:22 oleg421-client sshd[16253]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:32:22 oleg421-client sshd[16266]: Received disconnect from 192.168.204.21 port 57638:11: disconnected by user Apr 3 01:32:22 oleg421-client sshd[16266]: Disconnected from user root 192.168.204.21 port 57638 Apr 3 01:32:22 oleg421-client sshd[16253]: pam_unix(sshd:session): session closed for user root Apr 3 01:32:22 oleg421-client systemd-logind[1011]: Session 53 logged out. Waiting for processes to exit. Apr 3 01:32:22 oleg421-client systemd[1]: session-53.scope: Succeeded. Apr 3 01:32:22 oleg421-client systemd-logind[1011]: Removed session 53. Apr 3 01:32:23 oleg421-client sshd[16392]: Accepted publickey for root from 192.168.204.21 port 57640 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:32:23 oleg421-client systemd-logind[1011]: New session 54 of user root. Apr 3 01:32:23 oleg421-client systemd[1]: Started Session 54 of user root. Apr 3 01:32:23 oleg421-client sshd[16392]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:32:23 oleg421-client sshd[16405]: Received disconnect from 192.168.204.21 port 57640:11: disconnected by user Apr 3 01:32:23 oleg421-client sshd[16405]: Disconnected from user root 192.168.204.21 port 57640 Apr 3 01:32:23 oleg421-client sshd[16392]: pam_unix(sshd:session): session closed for user root Apr 3 01:32:24 oleg421-client systemd-logind[1011]: Session 54 logged out. Waiting for processes to exit. Apr 3 01:32:24 oleg421-client systemd[1]: session-54.scope: Succeeded. Apr 3 01:32:24 oleg421-client systemd-logind[1011]: Removed session 54. Apr 3 01:32:25 oleg421-client sshd[16538]: Accepted publickey for root from 192.168.204.21 port 57652 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:32:25 oleg421-client systemd-logind[1011]: New session 55 of user root. Apr 3 01:32:25 oleg421-client systemd[1]: Started Session 55 of user root. Apr 3 01:32:25 oleg421-client sshd[16538]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:32:25 oleg421-client sshd[16551]: Received disconnect from 192.168.204.21 port 57652:11: disconnected by user Apr 3 01:32:25 oleg421-client sshd[16551]: Disconnected from user root 192.168.204.21 port 57652 Apr 3 01:32:25 oleg421-client sshd[16538]: pam_unix(sshd:session): session closed for user root Apr 3 01:32:25 oleg421-client systemd-logind[1011]: Session 55 logged out. Waiting for processes to exit. Apr 3 01:32:25 oleg421-client systemd[1]: session-55.scope: Succeeded. Apr 3 01:32:25 oleg421-client systemd-logind[1011]: Removed session 55. Apr 3 01:32:26 oleg421-client sshd[16693]: Accepted publickey for root from 192.168.204.21 port 57664 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:32:26 oleg421-client systemd[1]: Started Session 56 of user root. Apr 3 01:32:26 oleg421-client systemd-logind[1011]: New session 56 of user root. Apr 3 01:32:27 oleg421-client sshd[16693]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:32:27 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10d: test failed blocking ast ===== 01:32:25 (1775194345) Apr 3 01:32:27 oleg421-client sshd[16706]: Received disconnect from 192.168.204.21 port 57664:11: disconnected by user Apr 3 01:32:27 oleg421-client sshd[16706]: Disconnected from user root 192.168.204.21 port 57664 Apr 3 01:32:27 oleg421-client sshd[16693]: pam_unix(sshd:session): session closed for user root Apr 3 01:32:27 oleg421-client systemd-logind[1011]: Session 56 logged out. Waiting for processes to exit. Apr 3 01:32:27 oleg421-client systemd[1]: session-56.scope: Succeeded. Apr 3 01:32:27 oleg421-client systemd-logind[1011]: Removed session 56. Apr 3 01:32:30 oleg421-client systemd[1]: mnt-lustre.mount: Succeeded. Apr 3 01:32:30 oleg421-client kernel: LustreError: 16767:0:(lov_obd.c:786:lov_cleanup()) lustre-clilov-ffff962451dc4800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Apr 3 01:32:30 oleg421-client kernel: Lustre: Unmounted lustre-client Apr 3 01:32:30 oleg421-client systemd-udevd[16808]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Apr 3 01:32:30 oleg421-client kernel: Lustre: Mounted lustre-client Apr 3 01:32:31 oleg421-client systemd-udevd[16843]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Apr 3 01:32:31 oleg421-client kernel: Lustre: Mounted lustre-client Apr 3 01:32:32 oleg421-client kernel: LustreError: lustre-OST0000-osc-ffff962443e10000: operation ost_statfs to node 192.168.204.121@tcp failed: rc = -107 Apr 3 01:32:32 oleg421-client kernel: LustreError: lustre-OST0000-osc-ffff962443e10000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Apr 3 01:32:32 oleg421-client kernel: Lustre: 2404:0:(llite_lib.c:4149:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.204.121@tcp:/lustre/fid: [0x200000404:0x1:0x0]/ may get corrupted (rc -108) Apr 3 01:32:35 oleg421-client systemd[1]: mnt-lustre2.mount: Succeeded. Apr 3 01:32:35 oleg421-client kernel: LustreError: 16967:0:(lov_obd.c:786:lov_cleanup()) lustre-clilov-ffff9624467ca000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Apr 3 01:32:35 oleg421-client kernel: LustreError: 16967:0:(lov_obd.c:786:lov_cleanup()) Skipped 1 previous similar message Apr 3 01:32:35 oleg421-client kernel: Lustre: Unmounted lustre-client Apr 3 01:32:36 oleg421-client sshd[17055]: Accepted publickey for root from 192.168.204.21 port 37868 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:32:36 oleg421-client systemd-logind[1011]: New session 57 of user root. Apr 3 01:32:36 oleg421-client systemd[1]: Started Session 57 of user root. Apr 3 01:32:36 oleg421-client sshd[17055]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:32:37 oleg421-client sshd[17068]: Received disconnect from 192.168.204.21 port 37868:11: disconnected by user Apr 3 01:32:37 oleg421-client sshd[17068]: Disconnected from user root 192.168.204.21 port 37868 Apr 3 01:32:37 oleg421-client sshd[17055]: pam_unix(sshd:session): session closed for user root Apr 3 01:32:37 oleg421-client systemd[1]: session-57.scope: Succeeded. Apr 3 01:32:37 oleg421-client systemd-logind[1011]: Session 57 logged out. Waiting for processes to exit. Apr 3 01:32:37 oleg421-client systemd-logind[1011]: Removed session 57. Apr 3 01:32:38 oleg421-client sshd[17195]: Accepted publickey for root from 192.168.204.21 port 38836 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:32:38 oleg421-client systemd[1]: Started Session 58 of user root. Apr 3 01:32:38 oleg421-client systemd-logind[1011]: New session 58 of user root. Apr 3 01:32:38 oleg421-client sshd[17195]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:32:38 oleg421-client sshd[17208]: Received disconnect from 192.168.204.21 port 38836:11: disconnected by user Apr 3 01:32:38 oleg421-client sshd[17208]: Disconnected from user root 192.168.204.21 port 38836 Apr 3 01:32:38 oleg421-client sshd[17195]: pam_unix(sshd:session): session closed for user root Apr 3 01:32:39 oleg421-client systemd[1]: session-58.scope: Succeeded. Apr 3 01:32:39 oleg421-client systemd-logind[1011]: Session 58 logged out. Waiting for processes to exit. Apr 3 01:32:39 oleg421-client systemd-logind[1011]: Removed session 58. Apr 3 01:32:40 oleg421-client sshd[17341]: Accepted publickey for root from 192.168.204.21 port 38844 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:32:40 oleg421-client systemd-logind[1011]: New session 59 of user root. Apr 3 01:32:40 oleg421-client systemd[1]: Started Session 59 of user root. Apr 3 01:32:40 oleg421-client sshd[17341]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:32:40 oleg421-client sshd[17354]: Received disconnect from 192.168.204.21 port 38844:11: disconnected by user Apr 3 01:32:40 oleg421-client sshd[17354]: Disconnected from user root 192.168.204.21 port 38844 Apr 3 01:32:40 oleg421-client sshd[17341]: pam_unix(sshd:session): session closed for user root Apr 3 01:32:40 oleg421-client systemd-logind[1011]: Session 59 logged out. Waiting for processes to exit. Apr 3 01:32:40 oleg421-client systemd[1]: session-59.scope: Succeeded. Apr 3 01:32:40 oleg421-client systemd-logind[1011]: Removed session 59. Apr 3 01:32:42 oleg421-client sshd[17496]: Accepted publickey for root from 192.168.204.21 port 38846 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:32:42 oleg421-client systemd-logind[1011]: New session 60 of user root. Apr 3 01:32:42 oleg421-client systemd[1]: Started Session 60 of user root. Apr 3 01:32:42 oleg421-client sshd[17496]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:32:42 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10e: re-send BL AST vs reconnect race 2 ========================================================== 01:32:41 (1775194361) Apr 3 01:32:42 oleg421-client sshd[17509]: Received disconnect from 192.168.204.21 port 38846:11: disconnected by user Apr 3 01:32:42 oleg421-client sshd[17509]: Disconnected from user root 192.168.204.21 port 38846 Apr 3 01:32:42 oleg421-client sshd[17496]: pam_unix(sshd:session): session closed for user root Apr 3 01:32:42 oleg421-client systemd[1]: session-60.scope: Succeeded. Apr 3 01:32:42 oleg421-client systemd-logind[1011]: Session 60 logged out. Waiting for processes to exit. Apr 3 01:32:42 oleg421-client systemd-logind[1011]: Removed session 60. Apr 3 01:32:43 oleg421-client sshd[17638]: Accepted publickey for root from 192.168.204.21 port 38852 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:32:43 oleg421-client systemd-logind[1011]: New session 61 of user root. Apr 3 01:32:43 oleg421-client systemd[1]: Started Session 61 of user root. Apr 3 01:32:43 oleg421-client sshd[17638]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:32:44 oleg421-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_10e need two clients Apr 3 01:32:44 oleg421-client sshd[17651]: Received disconnect from 192.168.204.21 port 38852:11: disconnected by user Apr 3 01:32:44 oleg421-client sshd[17651]: Disconnected from user root 192.168.204.21 port 38852 Apr 3 01:32:44 oleg421-client sshd[17638]: pam_unix(sshd:session): session closed for user root Apr 3 01:32:44 oleg421-client systemd[1]: session-61.scope: Succeeded. Apr 3 01:32:44 oleg421-client systemd-logind[1011]: Session 61 logged out. Waiting for processes to exit. Apr 3 01:32:44 oleg421-client systemd-logind[1011]: Removed session 61. Apr 3 01:32:45 oleg421-client sshd[17792]: Accepted publickey for root from 192.168.204.21 port 38858 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:32:45 oleg421-client systemd-logind[1011]: New session 62 of user root. Apr 3 01:32:45 oleg421-client systemd[1]: Started Session 62 of user root. Apr 3 01:32:45 oleg421-client sshd[17792]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:32:45 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 11: wake up a thread waiting for completion after eviction (b=2460) ========================================================== 01:32:44 (1775194364) Apr 3 01:32:45 oleg421-client sshd[17805]: Received disconnect from 192.168.204.21 port 38858:11: disconnected by user Apr 3 01:32:45 oleg421-client sshd[17805]: Disconnected from user root 192.168.204.21 port 38858 Apr 3 01:32:45 oleg421-client sshd[17792]: pam_unix(sshd:session): session closed for user root Apr 3 01:32:46 oleg421-client systemd[1]: session-62.scope: Succeeded. Apr 3 01:32:46 oleg421-client systemd-logind[1011]: Session 62 logged out. Waiting for processes to exit. Apr 3 01:32:46 oleg421-client systemd-logind[1011]: Removed session 62. Apr 3 01:33:05 oleg421-client systemd[1]: Starting Cleanup of Temporary Directories... Apr 3 01:33:05 oleg421-client sshd[17914]: Accepted publickey for root from 192.168.204.21 port 47780 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:33:05 oleg421-client systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Apr 3 01:33:05 oleg421-client systemd[1]: Started Cleanup of Temporary Directories. Apr 3 01:33:05 oleg421-client systemd-logind[1011]: New session 63 of user root. Apr 3 01:33:05 oleg421-client systemd[1]: Started Session 63 of user root. Apr 3 01:33:05 oleg421-client sshd[17914]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:33:05 oleg421-client sshd[17929]: Received disconnect from 192.168.204.21 port 47780:11: disconnected by user Apr 3 01:33:05 oleg421-client sshd[17929]: Disconnected from user root 192.168.204.21 port 47780 Apr 3 01:33:05 oleg421-client sshd[17914]: pam_unix(sshd:session): session closed for user root Apr 3 01:33:05 oleg421-client systemd[1]: session-63.scope: Succeeded. Apr 3 01:33:05 oleg421-client systemd-logind[1011]: Session 63 logged out. Waiting for processes to exit. Apr 3 01:33:05 oleg421-client systemd-logind[1011]: Removed session 63. Apr 3 01:33:06 oleg421-client sshd[18048]: Accepted publickey for root from 192.168.204.21 port 47784 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:33:06 oleg421-client systemd-logind[1011]: New session 64 of user root. Apr 3 01:33:06 oleg421-client systemd[1]: Started Session 64 of user root. Apr 3 01:33:06 oleg421-client sshd[18048]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:33:07 oleg421-client sshd[18061]: Received disconnect from 192.168.204.21 port 47784:11: disconnected by user Apr 3 01:33:07 oleg421-client sshd[18061]: Disconnected from user root 192.168.204.21 port 47784 Apr 3 01:33:07 oleg421-client sshd[18048]: pam_unix(sshd:session): session closed for user root Apr 3 01:33:07 oleg421-client systemd[1]: session-64.scope: Succeeded. Apr 3 01:33:07 oleg421-client systemd-logind[1011]: Session 64 logged out. Waiting for processes to exit. Apr 3 01:33:07 oleg421-client systemd-logind[1011]: Removed session 64. Apr 3 01:33:09 oleg421-client sshd[18187]: Accepted publickey for root from 192.168.204.21 port 58868 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:33:09 oleg421-client systemd-logind[1011]: New session 65 of user root. Apr 3 01:33:09 oleg421-client systemd[1]: Started Session 65 of user root. Apr 3 01:33:09 oleg421-client sshd[18187]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:33:09 oleg421-client sshd[18200]: Received disconnect from 192.168.204.21 port 58868:11: disconnected by user Apr 3 01:33:09 oleg421-client sshd[18200]: Disconnected from user root 192.168.204.21 port 58868 Apr 3 01:33:09 oleg421-client sshd[18187]: pam_unix(sshd:session): session closed for user root Apr 3 01:33:09 oleg421-client systemd[1]: session-65.scope: Succeeded. Apr 3 01:33:09 oleg421-client systemd-logind[1011]: Session 65 logged out. Waiting for processes to exit. Apr 3 01:33:09 oleg421-client systemd-logind[1011]: Removed session 65. Apr 3 01:33:10 oleg421-client sshd[18334]: Accepted publickey for root from 192.168.204.21 port 58872 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:33:10 oleg421-client systemd[1]: Started Session 66 of user root. Apr 3 01:33:10 oleg421-client systemd-logind[1011]: New session 66 of user root. Apr 3 01:33:10 oleg421-client sshd[18334]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:33:11 oleg421-client sshd[18347]: Received disconnect from 192.168.204.21 port 58872:11: disconnected by user Apr 3 01:33:11 oleg421-client sshd[18347]: Disconnected from user root 192.168.204.21 port 58872 Apr 3 01:33:11 oleg421-client sshd[18334]: pam_unix(sshd:session): session closed for user root Apr 3 01:33:11 oleg421-client systemd[1]: session-66.scope: Succeeded. Apr 3 01:33:11 oleg421-client systemd-logind[1011]: Session 66 logged out. Waiting for processes to exit. Apr 3 01:33:11 oleg421-client systemd-logind[1011]: Removed session 66. Apr 3 01:33:12 oleg421-client sshd[18489]: Accepted publickey for root from 192.168.204.21 port 58888 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:33:12 oleg421-client systemd-logind[1011]: New session 67 of user root. Apr 3 01:33:12 oleg421-client systemd[1]: Started Session 67 of user root. Apr 3 01:33:12 oleg421-client sshd[18489]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:33:13 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 12: recover from timed out resend in ptlrpcd (b=2494) ========================================================== 01:33:11 (1775194391) Apr 3 01:33:13 oleg421-client sshd[18502]: Received disconnect from 192.168.204.21 port 58888:11: disconnected by user Apr 3 01:33:13 oleg421-client sshd[18502]: Disconnected from user root 192.168.204.21 port 58888 Apr 3 01:33:13 oleg421-client sshd[18489]: pam_unix(sshd:session): session closed for user root Apr 3 01:33:13 oleg421-client kernel: Lustre: DEBUG MARKER: multiop /mnt/lustre/f12.recovery-small OS_c Apr 3 01:33:13 oleg421-client systemd[1]: session-67.scope: Succeeded. Apr 3 01:33:13 oleg421-client systemd-logind[1011]: Session 67 logged out. Waiting for processes to exit. Apr 3 01:33:13 oleg421-client systemd-logind[1011]: Removed session 67. Apr 3 01:33:30 oleg421-client kernel: Lustre: 18549:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775194394/real 1775194394] req@ffff962444849c00 x1861425361453824/t0(0) o35->lustre-MDT0000-mdc-ffff962443e10000@192.168.204.121@tcp:23/10 lens 392/624 e 0 to 1 dl 1775194410 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 Apr 3 01:33:30 oleg421-client kernel: Lustre: 18549:0:(client.c:2479:ptlrpc_expire_one_request()) Skipped 3 previous similar messages Apr 3 01:33:32 oleg421-client sshd[18567]: Accepted publickey for root from 192.168.204.21 port 58342 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:33:32 oleg421-client systemd-logind[1011]: New session 68 of user root. Apr 3 01:33:32 oleg421-client systemd[1]: Started Session 68 of user root. Apr 3 01:33:32 oleg421-client sshd[18567]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:33:32 oleg421-client sshd[18580]: Received disconnect from 192.168.204.21 port 58342:11: disconnected by user Apr 3 01:33:33 oleg421-client sshd[18580]: Disconnected from user root 192.168.204.21 port 58342 Apr 3 01:33:33 oleg421-client sshd[18567]: pam_unix(sshd:session): session closed for user root Apr 3 01:33:33 oleg421-client systemd[1]: session-68.scope: Succeeded. Apr 3 01:33:33 oleg421-client systemd-logind[1011]: Session 68 logged out. Waiting for processes to exit. Apr 3 01:33:33 oleg421-client systemd-logind[1011]: Removed session 68. Apr 3 01:33:33 oleg421-client sshd[18699]: Accepted publickey for root from 192.168.204.21 port 58354 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:33:34 oleg421-client systemd-logind[1011]: New session 69 of user root. Apr 3 01:33:34 oleg421-client systemd[1]: Started Session 69 of user root. Apr 3 01:33:34 oleg421-client sshd[18699]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:33:34 oleg421-client sshd[18712]: Received disconnect from 192.168.204.21 port 58354:11: disconnected by user Apr 3 01:33:34 oleg421-client sshd[18712]: Disconnected from user root 192.168.204.21 port 58354 Apr 3 01:33:34 oleg421-client sshd[18699]: pam_unix(sshd:session): session closed for user root Apr 3 01:33:34 oleg421-client systemd[1]: session-69.scope: Succeeded. Apr 3 01:33:34 oleg421-client systemd-logind[1011]: Session 69 logged out. Waiting for processes to exit. Apr 3 01:33:34 oleg421-client systemd-logind[1011]: Removed session 69. Apr 3 01:33:36 oleg421-client sshd[18838]: Accepted publickey for root from 192.168.204.21 port 58366 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:33:36 oleg421-client systemd-logind[1011]: New session 70 of user root. Apr 3 01:33:36 oleg421-client systemd[1]: Started Session 70 of user root. Apr 3 01:33:36 oleg421-client sshd[18838]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:33:36 oleg421-client sshd[18851]: Received disconnect from 192.168.204.21 port 58366:11: disconnected by user Apr 3 01:33:36 oleg421-client sshd[18851]: Disconnected from user root 192.168.204.21 port 58366 Apr 3 01:33:36 oleg421-client rsyslogd[1073]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Apr 3 01:33:36 oleg421-client sshd[18838]: pam_unix(sshd:session): session closed for user root Apr 3 01:33:36 oleg421-client systemd[1]: session-70.scope: Succeeded. Apr 3 01:33:36 oleg421-client systemd-logind[1011]: Session 70 logged out. Waiting for processes to exit. Apr 3 01:33:36 oleg421-client systemd-logind[1011]: Removed session 70. Apr 3 01:33:38 oleg421-client sshd[18985]: Accepted publickey for root from 192.168.204.21 port 36636 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:33:38 oleg421-client systemd-logind[1011]: New session 71 of user root. Apr 3 01:33:38 oleg421-client systemd[1]: Started Session 71 of user root. Apr 3 01:33:38 oleg421-client sshd[18985]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:33:38 oleg421-client sshd[18999]: Received disconnect from 192.168.204.21 port 36636:11: disconnected by user Apr 3 01:33:38 oleg421-client sshd[18999]: Disconnected from user root 192.168.204.21 port 36636 Apr 3 01:33:38 oleg421-client sshd[18985]: pam_unix(sshd:session): session closed for user root Apr 3 01:33:38 oleg421-client systemd[1]: session-71.scope: Succeeded. Apr 3 01:33:38 oleg421-client systemd-logind[1011]: Session 71 logged out. Waiting for processes to exit. Apr 3 01:33:38 oleg421-client systemd-logind[1011]: Removed session 71. Apr 3 01:33:57 oleg421-client sshd[19151]: Accepted publickey for root from 192.168.204.21 port 58312 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:33:57 oleg421-client systemd[1]: Started Session 72 of user root. Apr 3 01:33:57 oleg421-client systemd-logind[1011]: New session 72 of user root. Apr 3 01:33:57 oleg421-client sshd[19151]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:33:57 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 13: mdc_readpage restart test (bug 1138) ========================================================== 01:33:56 (1775194436) Apr 3 01:33:57 oleg421-client sshd[19164]: Received disconnect from 192.168.204.21 port 58312:11: disconnected by user Apr 3 01:33:57 oleg421-client sshd[19164]: Disconnected from user root 192.168.204.21 port 58312 Apr 3 01:33:57 oleg421-client sshd[19151]: pam_unix(sshd:session): session closed for user root Apr 3 01:33:57 oleg421-client systemd[1]: session-72.scope: Succeeded. Apr 3 01:33:57 oleg421-client systemd-logind[1011]: Session 72 logged out. Waiting for processes to exit. Apr 3 01:33:57 oleg421-client systemd-logind[1011]: Removed session 72. Apr 3 01:34:17 oleg421-client sshd[19309]: Accepted publickey for root from 192.168.204.21 port 51610 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:34:17 oleg421-client systemd[1]: Started Session 73 of user root. Apr 3 01:34:17 oleg421-client systemd-logind[1011]: New session 73 of user root. Apr 3 01:34:17 oleg421-client sshd[19309]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:34:17 oleg421-client sshd[19322]: Received disconnect from 192.168.204.21 port 51610:11: disconnected by user Apr 3 01:34:17 oleg421-client sshd[19322]: Disconnected from user root 192.168.204.21 port 51610 Apr 3 01:34:17 oleg421-client sshd[19309]: pam_unix(sshd:session): session closed for user root Apr 3 01:34:17 oleg421-client systemd[1]: session-73.scope: Succeeded. Apr 3 01:34:17 oleg421-client systemd-logind[1011]: Session 73 logged out. Waiting for processes to exit. Apr 3 01:34:17 oleg421-client systemd-logind[1011]: Removed session 73. Apr 3 01:34:19 oleg421-client sshd[19448]: Accepted publickey for root from 192.168.204.21 port 36388 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:34:19 oleg421-client systemd-logind[1011]: New session 74 of user root. Apr 3 01:34:19 oleg421-client systemd[1]: Started Session 74 of user root. Apr 3 01:34:19 oleg421-client sshd[19448]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:34:19 oleg421-client sshd[19462]: Received disconnect from 192.168.204.21 port 36388:11: disconnected by user Apr 3 01:34:19 oleg421-client sshd[19462]: Disconnected from user root 192.168.204.21 port 36388 Apr 3 01:34:19 oleg421-client sshd[19448]: pam_unix(sshd:session): session closed for user root Apr 3 01:34:20 oleg421-client systemd[1]: session-74.scope: Succeeded. Apr 3 01:34:20 oleg421-client systemd-logind[1011]: Session 74 logged out. Waiting for processes to exit. Apr 3 01:34:20 oleg421-client systemd-logind[1011]: Removed session 74. Apr 3 01:34:21 oleg421-client sshd[19595]: Accepted publickey for root from 192.168.204.21 port 36390 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:34:21 oleg421-client systemd-logind[1011]: New session 75 of user root. Apr 3 01:34:21 oleg421-client systemd[1]: Started Session 75 of user root. Apr 3 01:34:21 oleg421-client sshd[19595]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:34:21 oleg421-client sshd[19608]: Received disconnect from 192.168.204.21 port 36390:11: disconnected by user Apr 3 01:34:21 oleg421-client sshd[19608]: Disconnected from user root 192.168.204.21 port 36390 Apr 3 01:34:21 oleg421-client sshd[19595]: pam_unix(sshd:session): session closed for user root Apr 3 01:34:21 oleg421-client systemd[1]: session-75.scope: Succeeded. Apr 3 01:34:21 oleg421-client systemd-logind[1011]: Session 75 logged out. Waiting for processes to exit. Apr 3 01:34:21 oleg421-client systemd-logind[1011]: Removed session 75. Apr 3 01:34:23 oleg421-client sshd[19750]: Accepted publickey for root from 192.168.204.21 port 36394 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:34:23 oleg421-client systemd-logind[1011]: New session 76 of user root. Apr 3 01:34:23 oleg421-client systemd[1]: Started Session 76 of user root. Apr 3 01:34:23 oleg421-client sshd[19750]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:34:23 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 14: mdc_readpage resend test (bug 1138) ========================================================== 01:34:22 (1775194462) Apr 3 01:34:24 oleg421-client sshd[19763]: Received disconnect from 192.168.204.21 port 36394:11: disconnected by user Apr 3 01:34:24 oleg421-client sshd[19763]: Disconnected from user root 192.168.204.21 port 36394 Apr 3 01:34:24 oleg421-client sshd[19750]: pam_unix(sshd:session): session closed for user root Apr 3 01:34:24 oleg421-client systemd[1]: session-76.scope: Succeeded. Apr 3 01:34:24 oleg421-client systemd-logind[1011]: Session 76 logged out. Waiting for processes to exit. Apr 3 01:34:24 oleg421-client systemd-logind[1011]: Removed session 76. Apr 3 01:34:27 oleg421-client sshd[19904]: Accepted publickey for root from 192.168.204.21 port 50794 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:34:28 oleg421-client systemd-logind[1011]: New session 77 of user root. Apr 3 01:34:28 oleg421-client systemd[1]: Started Session 77 of user root. Apr 3 01:34:28 oleg421-client sshd[19904]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:34:28 oleg421-client sshd[19917]: Received disconnect from 192.168.204.21 port 50794:11: disconnected by user Apr 3 01:34:28 oleg421-client sshd[19917]: Disconnected from user root 192.168.204.21 port 50794 Apr 3 01:34:28 oleg421-client sshd[19904]: pam_unix(sshd:session): session closed for user root Apr 3 01:34:28 oleg421-client systemd-logind[1011]: Session 77 logged out. Waiting for processes to exit. Apr 3 01:34:28 oleg421-client systemd[1]: session-77.scope: Succeeded. Apr 3 01:34:28 oleg421-client systemd-logind[1011]: Removed session 77. Apr 3 01:34:29 oleg421-client sshd[20043]: Accepted publickey for root from 192.168.204.21 port 50802 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:34:29 oleg421-client systemd[1]: Started Session 78 of user root. Apr 3 01:34:29 oleg421-client systemd-logind[1011]: New session 78 of user root. Apr 3 01:34:29 oleg421-client sshd[20043]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:34:29 oleg421-client sshd[20056]: Received disconnect from 192.168.204.21 port 50802:11: disconnected by user Apr 3 01:34:29 oleg421-client sshd[20056]: Disconnected from user root 192.168.204.21 port 50802 Apr 3 01:34:29 oleg421-client sshd[20043]: pam_unix(sshd:session): session closed for user root Apr 3 01:34:30 oleg421-client systemd[1]: session-78.scope: Succeeded. Apr 3 01:34:30 oleg421-client systemd-logind[1011]: Session 78 logged out. Waiting for processes to exit. Apr 3 01:34:30 oleg421-client systemd-logind[1011]: Removed session 78. Apr 3 01:34:31 oleg421-client sshd[20189]: Accepted publickey for root from 192.168.204.21 port 50816 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:34:31 oleg421-client systemd-logind[1011]: New session 79 of user root. Apr 3 01:34:31 oleg421-client systemd[1]: Started Session 79 of user root. Apr 3 01:34:31 oleg421-client sshd[20189]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:34:32 oleg421-client sshd[20202]: Received disconnect from 192.168.204.21 port 50816:11: disconnected by user Apr 3 01:34:32 oleg421-client sshd[20202]: Disconnected from user root 192.168.204.21 port 50816 Apr 3 01:34:32 oleg421-client sshd[20189]: pam_unix(sshd:session): session closed for user root Apr 3 01:34:32 oleg421-client systemd[1]: session-79.scope: Succeeded. Apr 3 01:34:32 oleg421-client systemd-logind[1011]: Session 79 logged out. Waiting for processes to exit. Apr 3 01:34:32 oleg421-client systemd-logind[1011]: Removed session 79. Apr 3 01:34:33 oleg421-client sshd[20344]: Accepted publickey for root from 192.168.204.21 port 50818 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:34:33 oleg421-client systemd-logind[1011]: New session 80 of user root. Apr 3 01:34:33 oleg421-client systemd[1]: Started Session 80 of user root. Apr 3 01:34:33 oleg421-client sshd[20344]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:34:34 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 15: failed open (-ENOMEM) ========= 01:34:32 (1775194472) Apr 3 01:34:34 oleg421-client sshd[20358]: Received disconnect from 192.168.204.21 port 50818:11: disconnected by user Apr 3 01:34:34 oleg421-client sshd[20358]: Disconnected from user root 192.168.204.21 port 50818 Apr 3 01:34:34 oleg421-client sshd[20344]: pam_unix(sshd:session): session closed for user root Apr 3 01:34:34 oleg421-client systemd[1]: session-80.scope: Succeeded. Apr 3 01:34:34 oleg421-client systemd-logind[1011]: Session 80 logged out. Waiting for processes to exit. Apr 3 01:34:34 oleg421-client systemd-logind[1011]: Removed session 80. Apr 3 01:34:36 oleg421-client sshd[20488]: Accepted publickey for root from 192.168.204.21 port 50820 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:34:37 oleg421-client systemd[1]: Started Session 81 of user root. Apr 3 01:34:37 oleg421-client systemd-logind[1011]: New session 81 of user root. Apr 3 01:34:37 oleg421-client sshd[20488]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:34:37 oleg421-client sshd[20501]: Received disconnect from 192.168.204.21 port 50820:11: disconnected by user Apr 3 01:34:37 oleg421-client sshd[20501]: Disconnected from user root 192.168.204.21 port 50820 Apr 3 01:34:37 oleg421-client sshd[20488]: pam_unix(sshd:session): session closed for user root Apr 3 01:34:37 oleg421-client systemd[1]: session-81.scope: Succeeded. Apr 3 01:34:37 oleg421-client systemd-logind[1011]: Session 81 logged out. Waiting for processes to exit. Apr 3 01:34:37 oleg421-client systemd-logind[1011]: Removed session 81. Apr 3 01:34:38 oleg421-client sshd[20627]: Accepted publickey for root from 192.168.204.21 port 59240 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:34:38 oleg421-client systemd-logind[1011]: New session 82 of user root. Apr 3 01:34:38 oleg421-client systemd[1]: Starting dnf makecache... Apr 3 01:34:38 oleg421-client systemd[1]: Started Session 82 of user root. Apr 3 01:34:38 oleg421-client sshd[20627]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:34:39 oleg421-client sshd[20641]: Received disconnect from 192.168.204.21 port 59240:11: disconnected by user Apr 3 01:34:39 oleg421-client sshd[20641]: Disconnected from user root 192.168.204.21 port 59240 Apr 3 01:34:39 oleg421-client sshd[20627]: pam_unix(sshd:session): session closed for user root Apr 3 01:34:39 oleg421-client systemd[1]: session-82.scope: Succeeded. Apr 3 01:34:39 oleg421-client systemd-logind[1011]: Session 82 logged out. Waiting for processes to exit. Apr 3 01:34:39 oleg421-client systemd-logind[1011]: Removed session 82. Apr 3 01:34:40 oleg421-client sshd[20776]: Accepted publickey for root from 192.168.204.21 port 59250 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:34:40 oleg421-client systemd-logind[1011]: New session 83 of user root. Apr 3 01:34:41 oleg421-client systemd[1]: Started Session 83 of user root. Apr 3 01:34:41 oleg421-client sshd[20776]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:34:41 oleg421-client sshd[20789]: Received disconnect from 192.168.204.21 port 59250:11: disconnected by user Apr 3 01:34:41 oleg421-client sshd[20789]: Disconnected from user root 192.168.204.21 port 59250 Apr 3 01:34:41 oleg421-client sshd[20776]: pam_unix(sshd:session): session closed for user root Apr 3 01:34:41 oleg421-client systemd[1]: session-83.scope: Succeeded. Apr 3 01:34:41 oleg421-client systemd-logind[1011]: Session 83 logged out. Waiting for processes to exit. Apr 3 01:34:41 oleg421-client systemd-logind[1011]: Removed session 83. Apr 3 01:34:43 oleg421-client sshd[20935]: Accepted publickey for root from 192.168.204.21 port 59264 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:34:43 oleg421-client systemd[1]: Started Session 84 of user root. Apr 3 01:34:43 oleg421-client sshd[20935]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:34:43 oleg421-client systemd-logind[1011]: New session 84 of user root. Apr 3 01:34:43 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 16: timeout bulk put, don't evict client (2732) ========================================================== 01:34:41 (1775194481) Apr 3 01:34:43 oleg421-client sshd[20948]: Received disconnect from 192.168.204.21 port 59264:11: disconnected by user Apr 3 01:34:43 oleg421-client sshd[20948]: Disconnected from user root 192.168.204.21 port 59264 Apr 3 01:34:43 oleg421-client sshd[20935]: pam_unix(sshd:session): session closed for user root Apr 3 01:34:43 oleg421-client systemd-logind[1011]: Session 84 logged out. Waiting for processes to exit. Apr 3 01:34:43 oleg421-client systemd[1]: session-84.scope: Succeeded. Apr 3 01:34:44 oleg421-client systemd-logind[1011]: Removed session 84. Apr 3 01:34:49 oleg421-client dnf[20639]: Failed determining last makecache time. Apr 3 01:34:49 oleg421-client dnf[20639]: [Errno 30] Read-only file system: '/var/cache/dnf/metadata_lock.pid' Apr 3 01:34:49 oleg421-client dnf[20639]: Failed to store expired repos cache: [Errno 30] Read-only file system: '/var/cache/dnf/expired_repos.json' Apr 3 01:34:50 oleg421-client systemd[1]: dnf-makecache.service: Main process exited, code=exited, status=1/FAILURE Apr 3 01:34:50 oleg421-client systemd[1]: dnf-makecache.service: Failed with result 'exit-code'. Apr 3 01:34:50 oleg421-client systemd[1]: Failed to start dnf makecache. Apr 3 01:35:25 oleg421-client sshd[21159]: Accepted publickey for root from 192.168.204.21 port 59016 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:35:26 oleg421-client systemd-logind[1011]: New session 85 of user root. Apr 3 01:35:26 oleg421-client systemd[1]: Started Session 85 of user root. Apr 3 01:35:26 oleg421-client sshd[21159]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:35:26 oleg421-client sshd[21172]: Received disconnect from 192.168.204.21 port 59016:11: disconnected by user Apr 3 01:35:26 oleg421-client sshd[21172]: Disconnected from user root 192.168.204.21 port 59016 Apr 3 01:35:26 oleg421-client sshd[21159]: pam_unix(sshd:session): session closed for user root Apr 3 01:35:26 oleg421-client systemd[1]: session-85.scope: Succeeded. Apr 3 01:35:26 oleg421-client systemd-logind[1011]: Session 85 logged out. Waiting for processes to exit. Apr 3 01:35:26 oleg421-client systemd-logind[1011]: Removed session 85. Apr 3 01:35:28 oleg421-client sshd[21299]: Accepted publickey for root from 192.168.204.21 port 42170 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:35:28 oleg421-client systemd-logind[1011]: New session 86 of user root. Apr 3 01:35:28 oleg421-client systemd[1]: Started Session 86 of user root. Apr 3 01:35:28 oleg421-client sshd[21299]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:35:29 oleg421-client sshd[21312]: Received disconnect from 192.168.204.21 port 42170:11: disconnected by user Apr 3 01:35:29 oleg421-client sshd[21312]: Disconnected from user root 192.168.204.21 port 42170 Apr 3 01:35:29 oleg421-client sshd[21299]: pam_unix(sshd:session): session closed for user root Apr 3 01:35:29 oleg421-client systemd[1]: session-86.scope: Succeeded. Apr 3 01:35:29 oleg421-client systemd-logind[1011]: Session 86 logged out. Waiting for processes to exit. Apr 3 01:35:29 oleg421-client systemd-logind[1011]: Removed session 86. Apr 3 01:35:30 oleg421-client sshd[21445]: Accepted publickey for root from 192.168.204.21 port 42172 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:35:30 oleg421-client systemd[1]: Started Session 87 of user root. Apr 3 01:35:30 oleg421-client systemd-logind[1011]: New session 87 of user root. Apr 3 01:35:30 oleg421-client sshd[21445]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:35:31 oleg421-client sshd[21458]: Received disconnect from 192.168.204.21 port 42172:11: disconnected by user Apr 3 01:35:31 oleg421-client sshd[21458]: Disconnected from user root 192.168.204.21 port 42172 Apr 3 01:35:31 oleg421-client sshd[21445]: pam_unix(sshd:session): session closed for user root Apr 3 01:35:31 oleg421-client systemd[1]: session-87.scope: Succeeded. Apr 3 01:35:31 oleg421-client systemd-logind[1011]: Session 87 logged out. Waiting for processes to exit. Apr 3 01:35:31 oleg421-client systemd-logind[1011]: Removed session 87. Apr 3 01:35:32 oleg421-client sshd[21600]: Accepted publickey for root from 192.168.204.21 port 42178 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:35:32 oleg421-client systemd-logind[1011]: New session 88 of user root. Apr 3 01:35:32 oleg421-client systemd[1]: Started Session 88 of user root. Apr 3 01:35:32 oleg421-client sshd[21600]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:35:33 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 17a: timeout bulk get, don't evict client (2732) ========================================================== 01:35:31 (1775194531) Apr 3 01:35:33 oleg421-client sshd[21613]: Received disconnect from 192.168.204.21 port 42178:11: disconnected by user Apr 3 01:35:33 oleg421-client sshd[21613]: Disconnected from user root 192.168.204.21 port 42178 Apr 3 01:35:33 oleg421-client sshd[21600]: pam_unix(sshd:session): session closed for user root Apr 3 01:35:33 oleg421-client systemd-logind[1011]: Session 88 logged out. Waiting for processes to exit. Apr 3 01:35:33 oleg421-client systemd[1]: session-88.scope: Succeeded. Apr 3 01:35:33 oleg421-client systemd-logind[1011]: Removed session 88. Apr 3 01:36:23 oleg421-client sshd[21956]: Accepted publickey for root from 192.168.204.21 port 54730 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:36:23 oleg421-client systemd[1]: Started Session 89 of user root. Apr 3 01:36:23 oleg421-client systemd-logind[1011]: New session 89 of user root. Apr 3 01:36:23 oleg421-client sshd[21956]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:36:24 oleg421-client sshd[21969]: Received disconnect from 192.168.204.21 port 54730:11: disconnected by user Apr 3 01:36:24 oleg421-client sshd[21969]: Disconnected from user root 192.168.204.21 port 54730 Apr 3 01:36:24 oleg421-client sshd[21956]: pam_unix(sshd:session): session closed for user root Apr 3 01:36:24 oleg421-client systemd[1]: session-89.scope: Succeeded. Apr 3 01:36:24 oleg421-client systemd-logind[1011]: Session 89 logged out. Waiting for processes to exit. Apr 3 01:36:24 oleg421-client systemd-logind[1011]: Removed session 89. Apr 3 01:36:25 oleg421-client sshd[22095]: Accepted publickey for root from 192.168.204.21 port 54738 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:36:25 oleg421-client systemd[1]: Started Session 90 of user root. Apr 3 01:36:25 oleg421-client systemd-logind[1011]: New session 90 of user root. Apr 3 01:36:25 oleg421-client sshd[22095]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:36:25 oleg421-client sshd[22108]: Received disconnect from 192.168.204.21 port 54738:11: disconnected by user Apr 3 01:36:25 oleg421-client sshd[22108]: Disconnected from user root 192.168.204.21 port 54738 Apr 3 01:36:25 oleg421-client sshd[22095]: pam_unix(sshd:session): session closed for user root Apr 3 01:36:26 oleg421-client systemd-logind[1011]: Session 90 logged out. Waiting for processes to exit. Apr 3 01:36:26 oleg421-client systemd[1]: session-90.scope: Succeeded. Apr 3 01:36:26 oleg421-client systemd-logind[1011]: Removed session 90. Apr 3 01:36:27 oleg421-client sshd[22241]: Accepted publickey for root from 192.168.204.21 port 35426 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:36:27 oleg421-client systemd-logind[1011]: New session 91 of user root. Apr 3 01:36:27 oleg421-client systemd[1]: Started Session 91 of user root. Apr 3 01:36:27 oleg421-client sshd[22241]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:36:28 oleg421-client sshd[22254]: Received disconnect from 192.168.204.21 port 35426:11: disconnected by user Apr 3 01:36:28 oleg421-client sshd[22254]: Disconnected from user root 192.168.204.21 port 35426 Apr 3 01:36:28 oleg421-client sshd[22241]: pam_unix(sshd:session): session closed for user root Apr 3 01:36:28 oleg421-client systemd[1]: session-91.scope: Succeeded. Apr 3 01:36:28 oleg421-client systemd-logind[1011]: Session 91 logged out. Waiting for processes to exit. Apr 3 01:36:28 oleg421-client systemd-logind[1011]: Removed session 91. Apr 3 01:36:29 oleg421-client sshd[22397]: Accepted publickey for root from 192.168.204.21 port 35438 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:36:29 oleg421-client systemd[1]: Started Session 92 of user root. Apr 3 01:36:29 oleg421-client systemd-logind[1011]: New session 92 of user root. Apr 3 01:36:29 oleg421-client sshd[22397]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:36:30 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 17b: timeout bulk get, dont evict client (3582) ========================================================== 01:36:28 (1775194588) Apr 3 01:36:30 oleg421-client sshd[22410]: Received disconnect from 192.168.204.21 port 35438:11: disconnected by user Apr 3 01:36:30 oleg421-client sshd[22410]: Disconnected from user root 192.168.204.21 port 35438 Apr 3 01:36:30 oleg421-client sshd[22397]: pam_unix(sshd:session): session closed for user root Apr 3 01:36:30 oleg421-client systemd-logind[1011]: Session 92 logged out. Waiting for processes to exit. Apr 3 01:36:30 oleg421-client systemd[1]: session-92.scope: Succeeded. Apr 3 01:36:30 oleg421-client systemd-logind[1011]: Removed session 92. Apr 3 01:36:31 oleg421-client sshd[22535]: Accepted publickey for root from 192.168.204.21 port 35442 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:36:31 oleg421-client systemd-logind[1011]: New session 93 of user root. Apr 3 01:36:31 oleg421-client systemd[1]: Started Session 93 of user root. Apr 3 01:36:31 oleg421-client sshd[22535]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:36:31 oleg421-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_17b Needs multiple clients Apr 3 01:36:31 oleg421-client sshd[22548]: Received disconnect from 192.168.204.21 port 35442:11: disconnected by user Apr 3 01:36:31 oleg421-client sshd[22548]: Disconnected from user root 192.168.204.21 port 35442 Apr 3 01:36:32 oleg421-client sshd[22535]: pam_unix(sshd:session): session closed for user root Apr 3 01:36:32 oleg421-client systemd[1]: session-93.scope: Succeeded. Apr 3 01:36:32 oleg421-client systemd-logind[1011]: Session 93 logged out. Waiting for processes to exit. Apr 3 01:36:32 oleg421-client systemd-logind[1011]: Removed session 93. Apr 3 01:36:33 oleg421-client sshd[22689]: Accepted publickey for root from 192.168.204.21 port 35450 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:36:33 oleg421-client systemd-logind[1011]: New session 94 of user root. Apr 3 01:36:33 oleg421-client systemd[1]: Started Session 94 of user root. Apr 3 01:36:33 oleg421-client sshd[22689]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:36:34 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 18a: manual ost invalidate clears page cache immediately ========================================================== 01:36:32 (1775194592) Apr 3 01:36:34 oleg421-client sshd[22702]: Received disconnect from 192.168.204.21 port 35450:11: disconnected by user Apr 3 01:36:34 oleg421-client sshd[22702]: Disconnected from user root 192.168.204.21 port 35450 Apr 3 01:36:34 oleg421-client sshd[22689]: pam_unix(sshd:session): session closed for user root Apr 3 01:36:34 oleg421-client systemd-logind[1011]: Session 94 logged out. Waiting for processes to exit. Apr 3 01:36:34 oleg421-client systemd[1]: session-94.scope: Succeeded. Apr 3 01:36:34 oleg421-client systemd-logind[1011]: Removed session 94. Apr 3 01:36:35 oleg421-client kernel: Lustre: setting import lustre-OST0001_UUID INACTIVE by administrator request Apr 3 01:36:35 oleg421-client kernel: Lustre: lustre-OST0001-osc-ffff962443e10000: Connection to lustre-OST0001 (at 192.168.204.121@tcp) was lost; in progress operations using this service will wait for recovery to complete Apr 3 01:36:35 oleg421-client kernel: Lustre: Skipped 5 previous similar messages Apr 3 01:36:35 oleg421-client kernel: LustreError: lustre-OST0001-osc-ffff962443e10000: This client was evicted by lustre-OST0001; in progress operations using this service will fail. Apr 3 01:36:36 oleg421-client sshd[22869]: Accepted publickey for root from 192.168.204.21 port 35458 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:36:36 oleg421-client systemd-logind[1011]: New session 95 of user root. Apr 3 01:36:36 oleg421-client systemd[1]: Started Session 95 of user root. Apr 3 01:36:36 oleg421-client sshd[22869]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:36:37 oleg421-client sshd[22882]: Received disconnect from 192.168.204.21 port 35458:11: disconnected by user Apr 3 01:36:37 oleg421-client sshd[22882]: Disconnected from user root 192.168.204.21 port 35458 Apr 3 01:36:37 oleg421-client sshd[22869]: pam_unix(sshd:session): session closed for user root Apr 3 01:36:37 oleg421-client systemd[1]: session-95.scope: Succeeded. Apr 3 01:36:37 oleg421-client systemd-logind[1011]: Session 95 logged out. Waiting for processes to exit. Apr 3 01:36:37 oleg421-client systemd-logind[1011]: Removed session 95. Apr 3 01:36:38 oleg421-client sshd[23008]: Accepted publickey for root from 192.168.204.21 port 50878 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:36:38 oleg421-client systemd[1]: Started Session 96 of user root. Apr 3 01:36:38 oleg421-client systemd-logind[1011]: New session 96 of user root. Apr 3 01:36:38 oleg421-client sshd[23008]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:36:39 oleg421-client sshd[23021]: Received disconnect from 192.168.204.21 port 50878:11: disconnected by user Apr 3 01:36:39 oleg421-client sshd[23021]: Disconnected from user root 192.168.204.21 port 50878 Apr 3 01:36:39 oleg421-client sshd[23008]: pam_unix(sshd:session): session closed for user root Apr 3 01:36:39 oleg421-client systemd-logind[1011]: Session 96 logged out. Waiting for processes to exit. Apr 3 01:36:39 oleg421-client systemd[1]: session-96.scope: Succeeded. Apr 3 01:36:39 oleg421-client systemd-logind[1011]: Removed session 96. Apr 3 01:36:40 oleg421-client sshd[23154]: Accepted publickey for root from 192.168.204.21 port 50890 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:36:40 oleg421-client systemd-logind[1011]: New session 97 of user root. Apr 3 01:36:40 oleg421-client systemd[1]: Started Session 97 of user root. Apr 3 01:36:40 oleg421-client sshd[23154]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:36:40 oleg421-client sshd[23167]: Received disconnect from 192.168.204.21 port 50890:11: disconnected by user Apr 3 01:36:40 oleg421-client sshd[23167]: Disconnected from user root 192.168.204.21 port 50890 Apr 3 01:36:40 oleg421-client sshd[23154]: pam_unix(sshd:session): session closed for user root Apr 3 01:36:41 oleg421-client systemd[1]: session-97.scope: Succeeded. Apr 3 01:36:41 oleg421-client systemd-logind[1011]: Session 97 logged out. Waiting for processes to exit. Apr 3 01:36:41 oleg421-client systemd-logind[1011]: Removed session 97. Apr 3 01:36:42 oleg421-client sshd[23310]: Accepted publickey for root from 192.168.204.21 port 50900 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:36:42 oleg421-client systemd-logind[1011]: New session 98 of user root. Apr 3 01:36:42 oleg421-client systemd[1]: Started Session 98 of user root. Apr 3 01:36:42 oleg421-client sshd[23310]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:36:42 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 18b: eviction and reconnect clears page cache (2766) ========================================================== 01:36:41 (1775194601) Apr 3 01:36:42 oleg421-client sshd[23323]: Received disconnect from 192.168.204.21 port 50900:11: disconnected by user Apr 3 01:36:43 oleg421-client sshd[23323]: Disconnected from user root 192.168.204.21 port 50900 Apr 3 01:36:43 oleg421-client sshd[23310]: pam_unix(sshd:session): session closed for user root Apr 3 01:36:43 oleg421-client systemd[1]: session-98.scope: Succeeded. Apr 3 01:36:43 oleg421-client systemd-logind[1011]: Session 98 logged out. Waiting for processes to exit. Apr 3 01:36:43 oleg421-client systemd-logind[1011]: Removed session 98. Apr 3 01:36:49 oleg421-client kernel: LustreError: lustre-OST0000-osc-ffff962443e10000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Apr 3 01:36:49 oleg421-client kernel: Lustre: lustre-OST0000-osc-ffff962443e10000: Connection restored to 192.168.204.121@tcp (at 192.168.204.121@tcp) Apr 3 01:36:49 oleg421-client kernel: Lustre: Skipped 4 previous similar messages Apr 3 01:37:08 oleg421-client sshd[23527]: Accepted publickey for root from 192.168.204.21 port 46098 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:37:08 oleg421-client systemd-logind[1011]: New session 99 of user root. Apr 3 01:37:08 oleg421-client systemd[1]: Started Session 99 of user root. Apr 3 01:37:08 oleg421-client sshd[23527]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:37:09 oleg421-client sshd[23540]: Received disconnect from 192.168.204.21 port 46098:11: disconnected by user Apr 3 01:37:09 oleg421-client sshd[23540]: Disconnected from user root 192.168.204.21 port 46098 Apr 3 01:37:09 oleg421-client sshd[23527]: pam_unix(sshd:session): session closed for user root Apr 3 01:37:09 oleg421-client systemd[1]: session-99.scope: Succeeded. Apr 3 01:37:09 oleg421-client systemd-logind[1011]: Session 99 logged out. Waiting for processes to exit. Apr 3 01:37:09 oleg421-client systemd-logind[1011]: Removed session 99. Apr 3 01:37:11 oleg421-client sshd[23667]: Accepted publickey for root from 192.168.204.21 port 46104 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:37:11 oleg421-client systemd-logind[1011]: New session 100 of user root. Apr 3 01:37:11 oleg421-client systemd[1]: Started Session 100 of user root. Apr 3 01:37:11 oleg421-client sshd[23667]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:37:11 oleg421-client sshd[23680]: Received disconnect from 192.168.204.21 port 46104:11: disconnected by user Apr 3 01:37:11 oleg421-client sshd[23680]: Disconnected from user root 192.168.204.21 port 46104 Apr 3 01:37:11 oleg421-client sshd[23667]: pam_unix(sshd:session): session closed for user root Apr 3 01:37:11 oleg421-client systemd[1]: session-100.scope: Succeeded. Apr 3 01:37:11 oleg421-client systemd-logind[1011]: Session 100 logged out. Waiting for processes to exit. Apr 3 01:37:11 oleg421-client systemd-logind[1011]: Removed session 100. Apr 3 01:37:13 oleg421-client sshd[23813]: Accepted publickey for root from 192.168.204.21 port 46106 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:37:13 oleg421-client systemd-logind[1011]: New session 101 of user root. Apr 3 01:37:13 oleg421-client systemd[1]: Started Session 101 of user root. Apr 3 01:37:13 oleg421-client sshd[23813]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:37:13 oleg421-client sshd[23826]: Received disconnect from 192.168.204.21 port 46106:11: disconnected by user Apr 3 01:37:13 oleg421-client sshd[23826]: Disconnected from user root 192.168.204.21 port 46106 Apr 3 01:37:13 oleg421-client sshd[23813]: pam_unix(sshd:session): session closed for user root Apr 3 01:37:13 oleg421-client systemd[1]: session-101.scope: Succeeded. Apr 3 01:37:13 oleg421-client systemd-logind[1011]: Session 101 logged out. Waiting for processes to exit. Apr 3 01:37:13 oleg421-client systemd-logind[1011]: Removed session 101. Apr 3 01:37:15 oleg421-client sshd[23968]: Accepted publickey for root from 192.168.204.21 port 46112 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:37:15 oleg421-client systemd[1]: Started Session 102 of user root. Apr 3 01:37:15 oleg421-client systemd-logind[1011]: New session 102 of user root. Apr 3 01:37:15 oleg421-client sshd[23968]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:37:15 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 18c: Dropped connect reply after eviction handing (14755) ========================================================== 01:37:14 (1775194634) Apr 3 01:37:15 oleg421-client sshd[23981]: Received disconnect from 192.168.204.21 port 46112:11: disconnected by user Apr 3 01:37:15 oleg421-client sshd[23981]: Disconnected from user root 192.168.204.21 port 46112 Apr 3 01:37:15 oleg421-client sshd[23968]: pam_unix(sshd:session): session closed for user root Apr 3 01:37:15 oleg421-client systemd[1]: session-102.scope: Succeeded. Apr 3 01:37:15 oleg421-client systemd-logind[1011]: Session 102 logged out. Waiting for processes to exit. Apr 3 01:37:15 oleg421-client systemd-logind[1011]: Removed session 102. Apr 3 01:37:19 oleg421-client kernel: LustreError: lustre-OST0000-osc-ffff962443e10000: operation ost_statfs to node 192.168.204.121@tcp failed: rc = -107 Apr 3 01:37:29 oleg421-client kernel: Lustre: Evicted from lustre-OST0000_UUID (at 192.168.204.121@tcp) after server handle changed from 0x1d1756950ceb91ba to 0x1d1756950ceb931f Apr 3 01:37:29 oleg421-client kernel: LustreError: lustre-OST0000-osc-ffff962443e10000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Apr 3 01:37:32 oleg421-client sshd[24195]: Accepted publickey for root from 192.168.204.21 port 34946 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:37:32 oleg421-client systemd-logind[1011]: New session 103 of user root. Apr 3 01:37:32 oleg421-client systemd[1]: Started Session 103 of user root. Apr 3 01:37:32 oleg421-client sshd[24195]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:37:33 oleg421-client sshd[24208]: Received disconnect from 192.168.204.21 port 34946:11: disconnected by user Apr 3 01:37:33 oleg421-client sshd[24208]: Disconnected from user root 192.168.204.21 port 34946 Apr 3 01:37:33 oleg421-client sshd[24195]: pam_unix(sshd:session): session closed for user root Apr 3 01:37:33 oleg421-client systemd[1]: session-103.scope: Succeeded. Apr 3 01:37:33 oleg421-client systemd-logind[1011]: Session 103 logged out. Waiting for processes to exit. Apr 3 01:37:33 oleg421-client systemd-logind[1011]: Removed session 103. Apr 3 01:37:35 oleg421-client sshd[24334]: Accepted publickey for root from 192.168.204.21 port 34960 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:37:35 oleg421-client systemd-logind[1011]: New session 104 of user root. Apr 3 01:37:35 oleg421-client systemd[1]: Started Session 104 of user root. Apr 3 01:37:35 oleg421-client sshd[24334]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:37:35 oleg421-client sshd[24347]: Received disconnect from 192.168.204.21 port 34960:11: disconnected by user Apr 3 01:37:35 oleg421-client sshd[24347]: Disconnected from user root 192.168.204.21 port 34960 Apr 3 01:37:35 oleg421-client sshd[24334]: pam_unix(sshd:session): session closed for user root Apr 3 01:37:36 oleg421-client systemd-logind[1011]: Session 104 logged out. Waiting for processes to exit. Apr 3 01:37:36 oleg421-client systemd[1]: session-104.scope: Succeeded. Apr 3 01:37:36 oleg421-client systemd-logind[1011]: Removed session 104. Apr 3 01:37:37 oleg421-client sshd[24480]: Accepted publickey for root from 192.168.204.21 port 34972 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:37:37 oleg421-client systemd-logind[1011]: New session 105 of user root. Apr 3 01:37:37 oleg421-client systemd[1]: Started Session 105 of user root. Apr 3 01:37:37 oleg421-client sshd[24480]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:37:37 oleg421-client sshd[24493]: Received disconnect from 192.168.204.21 port 34972:11: disconnected by user Apr 3 01:37:37 oleg421-client sshd[24493]: Disconnected from user root 192.168.204.21 port 34972 Apr 3 01:37:37 oleg421-client sshd[24480]: pam_unix(sshd:session): session closed for user root Apr 3 01:37:37 oleg421-client systemd[1]: session-105.scope: Succeeded. Apr 3 01:37:37 oleg421-client systemd-logind[1011]: Session 105 logged out. Waiting for processes to exit. Apr 3 01:37:37 oleg421-client systemd-logind[1011]: Removed session 105. Apr 3 01:37:39 oleg421-client sshd[24636]: Accepted publickey for root from 192.168.204.21 port 34980 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:37:39 oleg421-client systemd-logind[1011]: New session 106 of user root. Apr 3 01:37:39 oleg421-client systemd[1]: Started Session 106 of user root. Apr 3 01:37:39 oleg421-client sshd[24636]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:37:39 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 19a: test expired_lock_main on mds (2867) ========================================================== 01:37:38 (1775194658) Apr 3 01:37:39 oleg421-client sshd[24649]: Received disconnect from 192.168.204.21 port 34980:11: disconnected by user Apr 3 01:37:39 oleg421-client sshd[24649]: Disconnected from user root 192.168.204.21 port 34980 Apr 3 01:37:39 oleg421-client sshd[24636]: pam_unix(sshd:session): session closed for user root Apr 3 01:37:39 oleg421-client systemd[1]: session-106.scope: Succeeded. Apr 3 01:37:39 oleg421-client systemd-logind[1011]: Session 106 logged out. Waiting for processes to exit. Apr 3 01:37:40 oleg421-client systemd-logind[1011]: Removed session 106. Apr 3 01:37:40 oleg421-client systemd-udevd[24706]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Apr 3 01:37:40 oleg421-client kernel: Lustre: Mounted lustre-client Apr 3 01:37:58 oleg421-client kernel: Lustre: 2404:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775194662/real 1775194662] req@ffff9624435f5180 x1861425361521280/t0(0) o103->lustre-MDT0000-mdc-ffff962443e10000@192.168.204.121@tcp:17/18 lens 328/224 e 0 to 1 dl 1775194678 ref 1 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 Apr 3 01:37:58 oleg421-client kernel: Lustre: 2404:0:(client.c:2479:ptlrpc_expire_one_request()) Skipped 2 previous similar messages Apr 3 01:39:24 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962443e10000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Apr 3 01:39:24 oleg421-client kernel: LustreError: 24862:0:(file.c:251:ll_close_inode_openhandle()) lustre-clilmv-ffff962443e10000: inode [0x200000404:0x1:0x0] mdc close failed: rc = -108 Apr 3 01:39:28 oleg421-client systemd[1]: mnt-lustre2.mount: Succeeded. Apr 3 01:39:28 oleg421-client kernel: LustreError: 24895:0:(lov_obd.c:786:lov_cleanup()) lustre-clilov-ffff9624463ff000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Apr 3 01:39:28 oleg421-client kernel: LustreError: 24895:0:(lov_obd.c:786:lov_cleanup()) Skipped 1 previous similar message Apr 3 01:39:28 oleg421-client kernel: Lustre: Unmounted lustre-client Apr 3 01:39:30 oleg421-client sshd[25003]: Accepted publickey for root from 192.168.204.21 port 56474 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:39:30 oleg421-client systemd-logind[1011]: New session 107 of user root. Apr 3 01:39:30 oleg421-client systemd[1]: Started Session 107 of user root. Apr 3 01:39:30 oleg421-client sshd[25003]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:39:31 oleg421-client sshd[25016]: Received disconnect from 192.168.204.21 port 56474:11: disconnected by user Apr 3 01:39:31 oleg421-client sshd[25016]: Disconnected from user root 192.168.204.21 port 56474 Apr 3 01:39:31 oleg421-client sshd[25003]: pam_unix(sshd:session): session closed for user root Apr 3 01:39:31 oleg421-client systemd[1]: session-107.scope: Succeeded. Apr 3 01:39:31 oleg421-client systemd-logind[1011]: Session 107 logged out. Waiting for processes to exit. Apr 3 01:39:31 oleg421-client systemd-logind[1011]: Removed session 107. Apr 3 01:39:32 oleg421-client sshd[25142]: Accepted publickey for root from 192.168.204.21 port 56480 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:39:32 oleg421-client systemd-logind[1011]: New session 108 of user root. Apr 3 01:39:32 oleg421-client systemd[1]: Started Session 108 of user root. Apr 3 01:39:32 oleg421-client sshd[25142]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:39:32 oleg421-client sshd[25155]: Received disconnect from 192.168.204.21 port 56480:11: disconnected by user Apr 3 01:39:32 oleg421-client sshd[25155]: Disconnected from user root 192.168.204.21 port 56480 Apr 3 01:39:32 oleg421-client sshd[25142]: pam_unix(sshd:session): session closed for user root Apr 3 01:39:32 oleg421-client systemd-logind[1011]: Session 108 logged out. Waiting for processes to exit. Apr 3 01:39:32 oleg421-client systemd[1]: session-108.scope: Succeeded. Apr 3 01:39:32 oleg421-client systemd-logind[1011]: Removed session 108. Apr 3 01:39:33 oleg421-client sshd[25288]: Accepted publickey for root from 192.168.204.21 port 56496 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:39:33 oleg421-client systemd-logind[1011]: New session 109 of user root. Apr 3 01:39:33 oleg421-client systemd[1]: Started Session 109 of user root. Apr 3 01:39:33 oleg421-client sshd[25288]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:39:34 oleg421-client sshd[25301]: Received disconnect from 192.168.204.21 port 56496:11: disconnected by user Apr 3 01:39:34 oleg421-client sshd[25301]: Disconnected from user root 192.168.204.21 port 56496 Apr 3 01:39:34 oleg421-client sshd[25288]: pam_unix(sshd:session): session closed for user root Apr 3 01:39:34 oleg421-client systemd-logind[1011]: Session 109 logged out. Waiting for processes to exit. Apr 3 01:39:34 oleg421-client systemd[1]: session-109.scope: Succeeded. Apr 3 01:39:34 oleg421-client systemd-logind[1011]: Removed session 109. Apr 3 01:39:35 oleg421-client sshd[25443]: Accepted publickey for root from 192.168.204.21 port 56510 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:39:35 oleg421-client systemd-logind[1011]: New session 110 of user root. Apr 3 01:39:35 oleg421-client systemd[1]: Started Session 110 of user root. Apr 3 01:39:35 oleg421-client sshd[25443]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:39:36 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 19b: test expired_lock_main on ost (2867) ========================================================== 01:39:34 (1775194774) Apr 3 01:39:36 oleg421-client sshd[25457]: Received disconnect from 192.168.204.21 port 56510:11: disconnected by user Apr 3 01:39:36 oleg421-client sshd[25457]: Disconnected from user root 192.168.204.21 port 56510 Apr 3 01:39:36 oleg421-client sshd[25443]: pam_unix(sshd:session): session closed for user root Apr 3 01:39:36 oleg421-client systemd[1]: session-110.scope: Succeeded. Apr 3 01:39:36 oleg421-client systemd-logind[1011]: Session 110 logged out. Waiting for processes to exit. Apr 3 01:39:36 oleg421-client systemd-logind[1011]: Removed session 110. Apr 3 01:39:37 oleg421-client systemd-udevd[25510]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Apr 3 01:39:37 oleg421-client kernel: Lustre: Mounted lustre-client Apr 3 01:41:25 oleg421-client kernel: LustreError: lustre-OST0001-osc-ffff962443e10000: This client was evicted by lustre-OST0001; in progress operations using this service will fail. Apr 3 01:41:28 oleg421-client systemd[1]: mnt-lustre2.mount: Succeeded. Apr 3 01:41:28 oleg421-client kernel: LustreError: 25695:0:(lov_obd.c:786:lov_cleanup()) lustre-clilov-ffff9624447bc800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Apr 3 01:41:28 oleg421-client kernel: LustreError: 25695:0:(lov_obd.c:786:lov_cleanup()) Skipped 1 previous similar message Apr 3 01:41:28 oleg421-client kernel: Lustre: Unmounted lustre-client Apr 3 01:41:30 oleg421-client sshd[25808]: Accepted publickey for root from 192.168.204.21 port 37334 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:41:30 oleg421-client systemd[1]: Started Session 111 of user root. Apr 3 01:41:30 oleg421-client systemd-logind[1011]: New session 111 of user root. Apr 3 01:41:30 oleg421-client sshd[25808]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:41:31 oleg421-client sshd[25821]: Received disconnect from 192.168.204.21 port 37334:11: disconnected by user Apr 3 01:41:31 oleg421-client sshd[25821]: Disconnected from user root 192.168.204.21 port 37334 Apr 3 01:41:31 oleg421-client sshd[25808]: pam_unix(sshd:session): session closed for user root Apr 3 01:41:31 oleg421-client systemd[1]: session-111.scope: Succeeded. Apr 3 01:41:31 oleg421-client systemd-logind[1011]: Session 111 logged out. Waiting for processes to exit. Apr 3 01:41:31 oleg421-client systemd-logind[1011]: Removed session 111. Apr 3 01:41:32 oleg421-client sshd[25947]: Accepted publickey for root from 192.168.204.21 port 37336 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:41:32 oleg421-client systemd-logind[1011]: New session 112 of user root. Apr 3 01:41:32 oleg421-client systemd[1]: Started Session 112 of user root. Apr 3 01:41:32 oleg421-client sshd[25947]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:41:33 oleg421-client sshd[25960]: Received disconnect from 192.168.204.21 port 37336:11: disconnected by user Apr 3 01:41:33 oleg421-client sshd[25960]: Disconnected from user root 192.168.204.21 port 37336 Apr 3 01:41:33 oleg421-client sshd[25947]: pam_unix(sshd:session): session closed for user root Apr 3 01:41:33 oleg421-client systemd[1]: session-112.scope: Succeeded. Apr 3 01:41:33 oleg421-client systemd-logind[1011]: Session 112 logged out. Waiting for processes to exit. Apr 3 01:41:33 oleg421-client systemd-logind[1011]: Removed session 112. Apr 3 01:41:34 oleg421-client sshd[26094]: Accepted publickey for root from 192.168.204.21 port 37344 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:41:34 oleg421-client systemd[1]: Started Session 113 of user root. Apr 3 01:41:34 oleg421-client systemd-logind[1011]: New session 113 of user root. Apr 3 01:41:34 oleg421-client sshd[26094]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:41:35 oleg421-client sshd[26107]: Received disconnect from 192.168.204.21 port 37344:11: disconnected by user Apr 3 01:41:35 oleg421-client sshd[26107]: Disconnected from user root 192.168.204.21 port 37344 Apr 3 01:41:35 oleg421-client sshd[26094]: pam_unix(sshd:session): session closed for user root Apr 3 01:41:35 oleg421-client systemd[1]: session-113.scope: Succeeded. Apr 3 01:41:35 oleg421-client systemd-logind[1011]: Session 113 logged out. Waiting for processes to exit. Apr 3 01:41:35 oleg421-client systemd-logind[1011]: Removed session 113. Apr 3 01:41:37 oleg421-client sshd[26249]: Accepted publickey for root from 192.168.204.21 port 37356 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:41:37 oleg421-client systemd-logind[1011]: New session 114 of user root. Apr 3 01:41:37 oleg421-client systemd[1]: Started Session 114 of user root. Apr 3 01:41:37 oleg421-client sshd[26249]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:41:37 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 19c: check reconnect and lock resend do not trigger expired_lock_main ========================================================== 01:41:35 (1775194895) Apr 3 01:41:37 oleg421-client sshd[26262]: Received disconnect from 192.168.204.21 port 37356:11: disconnected by user Apr 3 01:41:37 oleg421-client sshd[26262]: Disconnected from user root 192.168.204.21 port 37356 Apr 3 01:41:37 oleg421-client sshd[26249]: pam_unix(sshd:session): session closed for user root Apr 3 01:41:38 oleg421-client systemd[1]: session-114.scope: Succeeded. Apr 3 01:41:38 oleg421-client systemd-logind[1011]: Session 114 logged out. Waiting for processes to exit. Apr 3 01:41:38 oleg421-client systemd-logind[1011]: Removed session 114. Apr 3 01:41:38 oleg421-client systemd-udevd[26325]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Apr 3 01:41:38 oleg421-client kernel: Lustre: Mounted lustre-client Apr 3 01:41:44 oleg421-client systemd[1]: mnt-lustre2.mount: Succeeded. Apr 3 01:41:44 oleg421-client kernel: LustreError: 26374:0:(lov_obd.c:786:lov_cleanup()) lustre-clilov-ffff96245254f800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Apr 3 01:41:44 oleg421-client kernel: LustreError: 26374:0:(lov_obd.c:786:lov_cleanup()) Skipped 1 previous similar message Apr 3 01:41:44 oleg421-client kernel: Lustre: Unmounted lustre-client Apr 3 01:41:50 oleg421-client sshd[26473]: Accepted publickey for root from 192.168.204.21 port 56208 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:41:50 oleg421-client systemd-logind[1011]: New session 115 of user root. Apr 3 01:41:50 oleg421-client systemd[1]: Started Session 115 of user root. Apr 3 01:41:50 oleg421-client sshd[26473]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:41:51 oleg421-client sshd[26486]: Received disconnect from 192.168.204.21 port 56208:11: disconnected by user Apr 3 01:41:51 oleg421-client sshd[26486]: Disconnected from user root 192.168.204.21 port 56208 Apr 3 01:41:51 oleg421-client sshd[26473]: pam_unix(sshd:session): session closed for user root Apr 3 01:41:51 oleg421-client systemd-logind[1011]: Session 115 logged out. Waiting for processes to exit. Apr 3 01:41:51 oleg421-client systemd[1]: session-115.scope: Succeeded. Apr 3 01:41:51 oleg421-client systemd-logind[1011]: Removed session 115. Apr 3 01:41:52 oleg421-client sshd[26612]: Accepted publickey for root from 192.168.204.21 port 56220 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:41:52 oleg421-client systemd-logind[1011]: New session 116 of user root. Apr 3 01:41:52 oleg421-client systemd[1]: Started Session 116 of user root. Apr 3 01:41:52 oleg421-client sshd[26612]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:41:53 oleg421-client sshd[26625]: Received disconnect from 192.168.204.21 port 56220:11: disconnected by user Apr 3 01:41:53 oleg421-client sshd[26625]: Disconnected from user root 192.168.204.21 port 56220 Apr 3 01:41:53 oleg421-client sshd[26612]: pam_unix(sshd:session): session closed for user root Apr 3 01:41:53 oleg421-client systemd[1]: session-116.scope: Succeeded. Apr 3 01:41:53 oleg421-client systemd-logind[1011]: Session 116 logged out. Waiting for processes to exit. Apr 3 01:41:53 oleg421-client systemd-logind[1011]: Removed session 116. Apr 3 01:41:54 oleg421-client sshd[26758]: Accepted publickey for root from 192.168.204.21 port 56234 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:41:54 oleg421-client systemd-logind[1011]: New session 117 of user root. Apr 3 01:41:54 oleg421-client systemd[1]: Started Session 117 of user root. Apr 3 01:41:54 oleg421-client sshd[26758]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:41:55 oleg421-client sshd[26772]: Received disconnect from 192.168.204.21 port 56234:11: disconnected by user Apr 3 01:41:55 oleg421-client sshd[26772]: Disconnected from user root 192.168.204.21 port 56234 Apr 3 01:41:55 oleg421-client sshd[26758]: pam_unix(sshd:session): session closed for user root Apr 3 01:41:55 oleg421-client systemd-logind[1011]: Session 117 logged out. Waiting for processes to exit. Apr 3 01:41:55 oleg421-client systemd[1]: session-117.scope: Succeeded. Apr 3 01:41:55 oleg421-client systemd-logind[1011]: Removed session 117. Apr 3 01:41:56 oleg421-client sshd[26914]: Accepted publickey for root from 192.168.204.21 port 56240 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:41:56 oleg421-client systemd-logind[1011]: New session 118 of user root. Apr 3 01:41:56 oleg421-client systemd[1]: Started Session 118 of user root. Apr 3 01:41:56 oleg421-client sshd[26914]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:41:56 oleg421-client rsyslogd[1073]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Apr 3 01:41:57 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 20a: ldlm_handle_enqueue error (should return error) ========================================================== 01:41:55 (1775194915) Apr 3 01:41:57 oleg421-client sshd[26928]: Received disconnect from 192.168.204.21 port 56240:11: disconnected by user Apr 3 01:41:57 oleg421-client sshd[26928]: Disconnected from user root 192.168.204.21 port 56240 Apr 3 01:41:57 oleg421-client sshd[26914]: pam_unix(sshd:session): session closed for user root Apr 3 01:41:57 oleg421-client systemd-logind[1011]: Session 118 logged out. Waiting for processes to exit. Apr 3 01:41:57 oleg421-client systemd[1]: session-118.scope: Succeeded. Apr 3 01:41:57 oleg421-client systemd-logind[1011]: Removed session 118. Apr 3 01:41:58 oleg421-client kernel: LustreError: lustre-OST0000-osc-ffff962443e10000: operation ldlm_enqueue to node 192.168.204.121@tcp failed: rc = -12 Apr 3 01:41:59 oleg421-client sshd[27099]: Accepted publickey for root from 192.168.204.21 port 48912 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:41:59 oleg421-client systemd[1]: Started Session 119 of user root. Apr 3 01:41:59 oleg421-client systemd-logind[1011]: New session 119 of user root. Apr 3 01:41:59 oleg421-client sshd[27099]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:42:00 oleg421-client sshd[27112]: Received disconnect from 192.168.204.21 port 48912:11: disconnected by user Apr 3 01:42:00 oleg421-client sshd[27112]: Disconnected from user root 192.168.204.21 port 48912 Apr 3 01:42:00 oleg421-client sshd[27099]: pam_unix(sshd:session): session closed for user root Apr 3 01:42:00 oleg421-client systemd[1]: session-119.scope: Succeeded. Apr 3 01:42:00 oleg421-client systemd-logind[1011]: Session 119 logged out. Waiting for processes to exit. Apr 3 01:42:00 oleg421-client systemd-logind[1011]: Removed session 119. Apr 3 01:42:01 oleg421-client sshd[27238]: Accepted publickey for root from 192.168.204.21 port 48922 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:42:01 oleg421-client systemd-logind[1011]: New session 120 of user root. Apr 3 01:42:01 oleg421-client systemd[1]: Started Session 120 of user root. Apr 3 01:42:01 oleg421-client sshd[27238]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:42:02 oleg421-client sshd[27252]: Received disconnect from 192.168.204.21 port 48922:11: disconnected by user Apr 3 01:42:02 oleg421-client sshd[27252]: Disconnected from user root 192.168.204.21 port 48922 Apr 3 01:42:02 oleg421-client sshd[27238]: pam_unix(sshd:session): session closed for user root Apr 3 01:42:02 oleg421-client systemd[1]: session-120.scope: Succeeded. Apr 3 01:42:02 oleg421-client systemd-logind[1011]: Session 120 logged out. Waiting for processes to exit. Apr 3 01:42:02 oleg421-client systemd-logind[1011]: Removed session 120. Apr 3 01:42:03 oleg421-client sshd[27385]: Accepted publickey for root from 192.168.204.21 port 48930 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:42:03 oleg421-client systemd[1]: Started Session 121 of user root. Apr 3 01:42:03 oleg421-client systemd-logind[1011]: New session 121 of user root. Apr 3 01:42:03 oleg421-client sshd[27385]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:42:03 oleg421-client sshd[27398]: Received disconnect from 192.168.204.21 port 48930:11: disconnected by user Apr 3 01:42:03 oleg421-client sshd[27398]: Disconnected from user root 192.168.204.21 port 48930 Apr 3 01:42:03 oleg421-client sshd[27385]: pam_unix(sshd:session): session closed for user root Apr 3 01:42:03 oleg421-client systemd-logind[1011]: Session 121 logged out. Waiting for processes to exit. Apr 3 01:42:03 oleg421-client systemd[1]: session-121.scope: Succeeded. Apr 3 01:42:03 oleg421-client systemd-logind[1011]: Removed session 121. Apr 3 01:42:05 oleg421-client sshd[27540]: Accepted publickey for root from 192.168.204.21 port 48934 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:42:05 oleg421-client systemd[1]: Started Session 122 of user root. Apr 3 01:42:05 oleg421-client systemd-logind[1011]: New session 122 of user root. Apr 3 01:42:05 oleg421-client sshd[27540]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:42:05 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 20b: ldlm_handle_enqueue error (should return error) ========================================================== 01:42:04 (1775194924) Apr 3 01:42:05 oleg421-client sshd[27553]: Received disconnect from 192.168.204.21 port 48934:11: disconnected by user Apr 3 01:42:05 oleg421-client sshd[27553]: Disconnected from user root 192.168.204.21 port 48934 Apr 3 01:42:05 oleg421-client sshd[27540]: pam_unix(sshd:session): session closed for user root Apr 3 01:42:05 oleg421-client systemd-logind[1011]: Session 122 logged out. Waiting for processes to exit. Apr 3 01:42:05 oleg421-client systemd[1]: session-122.scope: Succeeded. Apr 3 01:42:05 oleg421-client systemd-logind[1011]: Removed session 122. Apr 3 01:42:07 oleg421-client kernel: LustreError: lustre-OST0000-osc-ffff962443e10000: operation ldlm_enqueue to node 192.168.204.121@tcp failed: rc = -12 Apr 3 01:42:09 oleg421-client sshd[27723]: Accepted publickey for root from 192.168.204.21 port 41472 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:42:09 oleg421-client systemd-logind[1011]: New session 123 of user root. Apr 3 01:42:09 oleg421-client systemd[1]: Started Session 123 of user root. Apr 3 01:42:09 oleg421-client sshd[27723]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:42:09 oleg421-client sshd[27736]: Received disconnect from 192.168.204.21 port 41472:11: disconnected by user Apr 3 01:42:09 oleg421-client sshd[27736]: Disconnected from user root 192.168.204.21 port 41472 Apr 3 01:42:09 oleg421-client sshd[27723]: pam_unix(sshd:session): session closed for user root Apr 3 01:42:09 oleg421-client systemd[1]: session-123.scope: Succeeded. Apr 3 01:42:09 oleg421-client systemd-logind[1011]: Session 123 logged out. Waiting for processes to exit. Apr 3 01:42:09 oleg421-client systemd-logind[1011]: Removed session 123. Apr 3 01:42:10 oleg421-client sshd[27862]: Accepted publickey for root from 192.168.204.21 port 41480 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:42:11 oleg421-client systemd-logind[1011]: New session 124 of user root. Apr 3 01:42:11 oleg421-client systemd[1]: Started Session 124 of user root. Apr 3 01:42:11 oleg421-client sshd[27862]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:42:11 oleg421-client sshd[27875]: Received disconnect from 192.168.204.21 port 41480:11: disconnected by user Apr 3 01:42:11 oleg421-client sshd[27875]: Disconnected from user root 192.168.204.21 port 41480 Apr 3 01:42:11 oleg421-client sshd[27862]: pam_unix(sshd:session): session closed for user root Apr 3 01:42:11 oleg421-client systemd-logind[1011]: Session 124 logged out. Waiting for processes to exit. Apr 3 01:42:11 oleg421-client systemd[1]: session-124.scope: Succeeded. Apr 3 01:42:11 oleg421-client systemd-logind[1011]: Removed session 124. Apr 3 01:42:12 oleg421-client sshd[28008]: Accepted publickey for root from 192.168.204.21 port 41484 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:42:12 oleg421-client systemd-logind[1011]: New session 125 of user root. Apr 3 01:42:12 oleg421-client systemd[1]: Started Session 125 of user root. Apr 3 01:42:12 oleg421-client sshd[28008]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:42:13 oleg421-client sshd[28021]: Received disconnect from 192.168.204.21 port 41484:11: disconnected by user Apr 3 01:42:13 oleg421-client sshd[28021]: Disconnected from user root 192.168.204.21 port 41484 Apr 3 01:42:13 oleg421-client sshd[28008]: pam_unix(sshd:session): session closed for user root Apr 3 01:42:13 oleg421-client systemd[1]: session-125.scope: Succeeded. Apr 3 01:42:13 oleg421-client systemd-logind[1011]: Session 125 logged out. Waiting for processes to exit. Apr 3 01:42:13 oleg421-client systemd-logind[1011]: Removed session 125. Apr 3 01:42:14 oleg421-client sshd[28163]: Accepted publickey for root from 192.168.204.21 port 41488 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:42:14 oleg421-client systemd-logind[1011]: New session 126 of user root. Apr 3 01:42:14 oleg421-client systemd[1]: Started Session 126 of user root. Apr 3 01:42:14 oleg421-client sshd[28163]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:42:15 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21a: drop close request while close and open are both in flight ========================================================== 01:42:13 (1775194933) Apr 3 01:42:15 oleg421-client sshd[28176]: Received disconnect from 192.168.204.21 port 41488:11: disconnected by user Apr 3 01:42:15 oleg421-client sshd[28176]: Disconnected from user root 192.168.204.21 port 41488 Apr 3 01:42:15 oleg421-client sshd[28163]: pam_unix(sshd:session): session closed for user root Apr 3 01:42:15 oleg421-client systemd[1]: session-126.scope: Succeeded. Apr 3 01:42:15 oleg421-client systemd-logind[1011]: Session 126 logged out. Waiting for processes to exit. Apr 3 01:42:15 oleg421-client systemd-logind[1011]: Removed session 126. Apr 3 01:42:38 oleg421-client sshd[28349]: Accepted publickey for root from 192.168.204.21 port 50282 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:42:38 oleg421-client systemd[1]: Started Session 127 of user root. Apr 3 01:42:38 oleg421-client systemd-logind[1011]: New session 127 of user root. Apr 3 01:42:38 oleg421-client sshd[28349]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:42:39 oleg421-client sshd[28362]: Received disconnect from 192.168.204.21 port 50282:11: disconnected by user Apr 3 01:42:39 oleg421-client sshd[28362]: Disconnected from user root 192.168.204.21 port 50282 Apr 3 01:42:39 oleg421-client sshd[28349]: pam_unix(sshd:session): session closed for user root Apr 3 01:42:39 oleg421-client systemd[1]: session-127.scope: Succeeded. Apr 3 01:42:39 oleg421-client systemd-logind[1011]: Session 127 logged out. Waiting for processes to exit. Apr 3 01:42:39 oleg421-client systemd-logind[1011]: Removed session 127. Apr 3 01:42:40 oleg421-client sshd[28488]: Accepted publickey for root from 192.168.204.21 port 50288 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:42:40 oleg421-client systemd[1]: Started Session 128 of user root. Apr 3 01:42:40 oleg421-client systemd-logind[1011]: New session 128 of user root. Apr 3 01:42:40 oleg421-client sshd[28488]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:42:40 oleg421-client sshd[28501]: Received disconnect from 192.168.204.21 port 50288:11: disconnected by user Apr 3 01:42:40 oleg421-client sshd[28501]: Disconnected from user root 192.168.204.21 port 50288 Apr 3 01:42:40 oleg421-client sshd[28488]: pam_unix(sshd:session): session closed for user root Apr 3 01:42:41 oleg421-client systemd[1]: session-128.scope: Succeeded. Apr 3 01:42:41 oleg421-client systemd-logind[1011]: Session 128 logged out. Waiting for processes to exit. Apr 3 01:42:41 oleg421-client systemd-logind[1011]: Removed session 128. Apr 3 01:42:42 oleg421-client sshd[28634]: Accepted publickey for root from 192.168.204.21 port 50302 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:42:42 oleg421-client systemd-logind[1011]: New session 129 of user root. Apr 3 01:42:42 oleg421-client systemd[1]: Started Session 129 of user root. Apr 3 01:42:42 oleg421-client sshd[28634]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:42:42 oleg421-client sshd[28647]: Received disconnect from 192.168.204.21 port 50302:11: disconnected by user Apr 3 01:42:42 oleg421-client sshd[28647]: Disconnected from user root 192.168.204.21 port 50302 Apr 3 01:42:42 oleg421-client sshd[28634]: pam_unix(sshd:session): session closed for user root Apr 3 01:42:42 oleg421-client systemd-logind[1011]: Session 129 logged out. Waiting for processes to exit. Apr 3 01:42:42 oleg421-client systemd[1]: session-129.scope: Succeeded. Apr 3 01:42:42 oleg421-client systemd-logind[1011]: Removed session 129. Apr 3 01:42:44 oleg421-client sshd[28790]: Accepted publickey for root from 192.168.204.21 port 50314 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:42:44 oleg421-client systemd-logind[1011]: New session 130 of user root. Apr 3 01:42:44 oleg421-client systemd[1]: Started Session 130 of user root. Apr 3 01:42:44 oleg421-client sshd[28790]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:42:45 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21b: drop open request while close and open are both in flight ========================================================== 01:42:43 (1775194963) Apr 3 01:42:45 oleg421-client sshd[28803]: Received disconnect from 192.168.204.21 port 50314:11: disconnected by user Apr 3 01:42:45 oleg421-client sshd[28803]: Disconnected from user root 192.168.204.21 port 50314 Apr 3 01:42:45 oleg421-client sshd[28790]: pam_unix(sshd:session): session closed for user root Apr 3 01:42:45 oleg421-client systemd-logind[1011]: Session 130 logged out. Waiting for processes to exit. Apr 3 01:42:45 oleg421-client systemd[1]: session-130.scope: Succeeded. Apr 3 01:42:45 oleg421-client systemd-logind[1011]: Removed session 130. Apr 3 01:45:08 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962443e10000: Connection to lustre-MDT0000 (at 192.168.204.121@tcp) was lost; in progress operations using this service will wait for recovery to complete Apr 3 01:45:08 oleg421-client kernel: Lustre: Skipped 17 previous similar messages Apr 3 01:45:10 oleg421-client sshd[28978]: Accepted publickey for root from 192.168.204.21 port 36132 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:45:10 oleg421-client systemd[1]: Started Session 131 of user root. Apr 3 01:45:10 oleg421-client systemd-logind[1011]: New session 131 of user root. Apr 3 01:45:10 oleg421-client sshd[28978]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:45:11 oleg421-client sshd[28991]: Received disconnect from 192.168.204.21 port 36132:11: disconnected by user Apr 3 01:45:11 oleg421-client sshd[28991]: Disconnected from user root 192.168.204.21 port 36132 Apr 3 01:45:11 oleg421-client sshd[28978]: pam_unix(sshd:session): session closed for user root Apr 3 01:45:11 oleg421-client systemd-logind[1011]: Session 131 logged out. Waiting for processes to exit. Apr 3 01:45:11 oleg421-client systemd[1]: session-131.scope: Succeeded. Apr 3 01:45:11 oleg421-client systemd-logind[1011]: Removed session 131. Apr 3 01:45:12 oleg421-client sshd[29117]: Accepted publickey for root from 192.168.204.21 port 36136 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:45:12 oleg421-client systemd-logind[1011]: New session 132 of user root. Apr 3 01:45:12 oleg421-client systemd[1]: Started Session 132 of user root. Apr 3 01:45:12 oleg421-client sshd[29117]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:45:13 oleg421-client sshd[29130]: Received disconnect from 192.168.204.21 port 36136:11: disconnected by user Apr 3 01:45:13 oleg421-client sshd[29130]: Disconnected from user root 192.168.204.21 port 36136 Apr 3 01:45:13 oleg421-client sshd[29117]: pam_unix(sshd:session): session closed for user root Apr 3 01:45:13 oleg421-client systemd-logind[1011]: Session 132 logged out. Waiting for processes to exit. Apr 3 01:45:13 oleg421-client systemd[1]: session-132.scope: Succeeded. Apr 3 01:45:13 oleg421-client systemd-logind[1011]: Removed session 132. Apr 3 01:45:14 oleg421-client sshd[29263]: Accepted publickey for root from 192.168.204.21 port 36144 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:45:14 oleg421-client systemd-logind[1011]: New session 133 of user root. Apr 3 01:45:14 oleg421-client systemd[1]: Started Session 133 of user root. Apr 3 01:45:14 oleg421-client sshd[29263]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:45:15 oleg421-client sshd[29276]: Received disconnect from 192.168.204.21 port 36144:11: disconnected by user Apr 3 01:45:15 oleg421-client sshd[29276]: Disconnected from user root 192.168.204.21 port 36144 Apr 3 01:45:15 oleg421-client sshd[29263]: pam_unix(sshd:session): session closed for user root Apr 3 01:45:15 oleg421-client systemd[1]: session-133.scope: Succeeded. Apr 3 01:45:15 oleg421-client systemd-logind[1011]: Session 133 logged out. Waiting for processes to exit. Apr 3 01:45:15 oleg421-client systemd-logind[1011]: Removed session 133. Apr 3 01:45:16 oleg421-client sshd[29419]: Accepted publickey for root from 192.168.204.21 port 36158 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:45:16 oleg421-client systemd[1]: Started Session 134 of user root. Apr 3 01:45:16 oleg421-client systemd-logind[1011]: New session 134 of user root. Apr 3 01:45:16 oleg421-client sshd[29419]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:45:17 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21c: drop both request while close and open are both in flight ========================================================== 01:45:15 (1775195115) Apr 3 01:45:17 oleg421-client sshd[29432]: Received disconnect from 192.168.204.21 port 36158:11: disconnected by user Apr 3 01:45:17 oleg421-client sshd[29432]: Disconnected from user root 192.168.204.21 port 36158 Apr 3 01:45:17 oleg421-client sshd[29419]: pam_unix(sshd:session): session closed for user root Apr 3 01:45:17 oleg421-client systemd-logind[1011]: Session 134 logged out. Waiting for processes to exit. Apr 3 01:45:17 oleg421-client systemd[1]: session-134.scope: Succeeded. Apr 3 01:45:17 oleg421-client systemd-logind[1011]: Removed session 134. Apr 3 01:45:39 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962443e10000: Connection restored to 192.168.204.121@tcp (at 192.168.204.121@tcp) Apr 3 01:45:39 oleg421-client kernel: Lustre: Skipped 16 previous similar messages Apr 3 01:45:42 oleg421-client sshd[29605]: Accepted publickey for root from 192.168.204.21 port 54922 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:45:42 oleg421-client systemd-logind[1011]: New session 135 of user root. Apr 3 01:45:42 oleg421-client systemd[1]: Started Session 135 of user root. Apr 3 01:45:42 oleg421-client sshd[29605]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:45:43 oleg421-client sshd[29618]: Received disconnect from 192.168.204.21 port 54922:11: disconnected by user Apr 3 01:45:43 oleg421-client sshd[29618]: Disconnected from user root 192.168.204.21 port 54922 Apr 3 01:45:43 oleg421-client sshd[29605]: pam_unix(sshd:session): session closed for user root Apr 3 01:45:43 oleg421-client systemd[1]: session-135.scope: Succeeded. Apr 3 01:45:43 oleg421-client systemd-logind[1011]: Session 135 logged out. Waiting for processes to exit. Apr 3 01:45:43 oleg421-client systemd-logind[1011]: Removed session 135. Apr 3 01:45:44 oleg421-client sshd[29745]: Accepted publickey for root from 192.168.204.21 port 54932 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:45:44 oleg421-client systemd-logind[1011]: New session 136 of user root. Apr 3 01:45:44 oleg421-client systemd[1]: Started Session 136 of user root. Apr 3 01:45:44 oleg421-client sshd[29745]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:45:45 oleg421-client sshd[29759]: Received disconnect from 192.168.204.21 port 54932:11: disconnected by user Apr 3 01:45:45 oleg421-client sshd[29759]: Disconnected from user root 192.168.204.21 port 54932 Apr 3 01:45:45 oleg421-client sshd[29745]: pam_unix(sshd:session): session closed for user root Apr 3 01:45:45 oleg421-client systemd[1]: session-136.scope: Succeeded. Apr 3 01:45:45 oleg421-client systemd-logind[1011]: Session 136 logged out. Waiting for processes to exit. Apr 3 01:45:45 oleg421-client systemd-logind[1011]: Removed session 136. Apr 3 01:45:47 oleg421-client sshd[29892]: Accepted publickey for root from 192.168.204.21 port 54944 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:45:47 oleg421-client systemd[1]: Started Session 137 of user root. Apr 3 01:45:47 oleg421-client systemd-logind[1011]: New session 137 of user root. Apr 3 01:45:47 oleg421-client sshd[29892]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:45:47 oleg421-client sshd[29906]: Received disconnect from 192.168.204.21 port 54944:11: disconnected by user Apr 3 01:45:47 oleg421-client sshd[29906]: Disconnected from user root 192.168.204.21 port 54944 Apr 3 01:45:47 oleg421-client sshd[29892]: pam_unix(sshd:session): session closed for user root Apr 3 01:45:47 oleg421-client systemd-logind[1011]: Session 137 logged out. Waiting for processes to exit. Apr 3 01:45:47 oleg421-client systemd[1]: session-137.scope: Succeeded. Apr 3 01:45:47 oleg421-client systemd-logind[1011]: Removed session 137. Apr 3 01:45:49 oleg421-client sshd[30048]: Accepted publickey for root from 192.168.204.21 port 42620 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:45:49 oleg421-client systemd-logind[1011]: New session 138 of user root. Apr 3 01:45:49 oleg421-client systemd[1]: Started Session 138 of user root. Apr 3 01:45:49 oleg421-client sshd[30048]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:45:49 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21d: drop close reply while close and open are both in flight ========================================================== 01:45:48 (1775195148) Apr 3 01:45:49 oleg421-client sshd[30061]: Received disconnect from 192.168.204.21 port 42620:11: disconnected by user Apr 3 01:45:49 oleg421-client sshd[30061]: Disconnected from user root 192.168.204.21 port 42620 Apr 3 01:45:49 oleg421-client sshd[30048]: pam_unix(sshd:session): session closed for user root Apr 3 01:45:50 oleg421-client systemd-logind[1011]: Session 138 logged out. Waiting for processes to exit. Apr 3 01:45:50 oleg421-client systemd[1]: session-138.scope: Succeeded. Apr 3 01:45:50 oleg421-client systemd-logind[1011]: Removed session 138. Apr 3 01:46:14 oleg421-client sshd[30234]: Accepted publickey for root from 192.168.204.21 port 52084 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:46:14 oleg421-client systemd-logind[1011]: New session 139 of user root. Apr 3 01:46:14 oleg421-client systemd[1]: Started Session 139 of user root. Apr 3 01:46:14 oleg421-client sshd[30234]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:46:14 oleg421-client sshd[30247]: Received disconnect from 192.168.204.21 port 52084:11: disconnected by user Apr 3 01:46:14 oleg421-client sshd[30247]: Disconnected from user root 192.168.204.21 port 52084 Apr 3 01:46:14 oleg421-client sshd[30234]: pam_unix(sshd:session): session closed for user root Apr 3 01:46:14 oleg421-client systemd[1]: session-139.scope: Succeeded. Apr 3 01:46:14 oleg421-client systemd-logind[1011]: Session 139 logged out. Waiting for processes to exit. Apr 3 01:46:14 oleg421-client systemd-logind[1011]: Removed session 139. Apr 3 01:46:15 oleg421-client sshd[30373]: Accepted publickey for root from 192.168.204.21 port 52096 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:46:15 oleg421-client systemd-logind[1011]: New session 140 of user root. Apr 3 01:46:15 oleg421-client systemd[1]: Started Session 140 of user root. Apr 3 01:46:16 oleg421-client sshd[30373]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:46:16 oleg421-client sshd[30386]: Received disconnect from 192.168.204.21 port 52096:11: disconnected by user Apr 3 01:46:16 oleg421-client sshd[30386]: Disconnected from user root 192.168.204.21 port 52096 Apr 3 01:46:16 oleg421-client sshd[30373]: pam_unix(sshd:session): session closed for user root Apr 3 01:46:16 oleg421-client systemd-logind[1011]: Session 140 logged out. Waiting for processes to exit. Apr 3 01:46:16 oleg421-client systemd[1]: session-140.scope: Succeeded. Apr 3 01:46:16 oleg421-client systemd-logind[1011]: Removed session 140. Apr 3 01:46:18 oleg421-client sshd[30520]: Accepted publickey for root from 192.168.204.21 port 59198 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:46:18 oleg421-client systemd-logind[1011]: New session 141 of user root. Apr 3 01:46:18 oleg421-client systemd[1]: Started Session 141 of user root. Apr 3 01:46:18 oleg421-client sshd[30520]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:46:18 oleg421-client sshd[30533]: Received disconnect from 192.168.204.21 port 59198:11: disconnected by user Apr 3 01:46:18 oleg421-client sshd[30533]: Disconnected from user root 192.168.204.21 port 59198 Apr 3 01:46:18 oleg421-client sshd[30520]: pam_unix(sshd:session): session closed for user root Apr 3 01:46:18 oleg421-client systemd[1]: session-141.scope: Succeeded. Apr 3 01:46:18 oleg421-client systemd-logind[1011]: Session 141 logged out. Waiting for processes to exit. Apr 3 01:46:18 oleg421-client systemd-logind[1011]: Removed session 141. Apr 3 01:46:20 oleg421-client sshd[30675]: Accepted publickey for root from 192.168.204.21 port 59202 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:46:20 oleg421-client systemd[1]: Started Session 142 of user root. Apr 3 01:46:20 oleg421-client systemd-logind[1011]: New session 142 of user root. Apr 3 01:46:20 oleg421-client sshd[30675]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:46:20 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21e: drop open reply while close and open are both in flight ========================================================== 01:46:19 (1775195179) Apr 3 01:46:20 oleg421-client sshd[30688]: Received disconnect from 192.168.204.21 port 59202:11: disconnected by user Apr 3 01:46:20 oleg421-client sshd[30688]: Disconnected from user root 192.168.204.21 port 59202 Apr 3 01:46:20 oleg421-client sshd[30675]: pam_unix(sshd:session): session closed for user root Apr 3 01:46:20 oleg421-client systemd-logind[1011]: Session 142 logged out. Waiting for processes to exit. Apr 3 01:46:20 oleg421-client systemd[1]: session-142.scope: Succeeded. Apr 3 01:46:20 oleg421-client systemd-logind[1011]: Removed session 142. Apr 3 01:46:46 oleg421-client sshd[30845]: Accepted publickey for root from 192.168.204.21 port 50780 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:46:46 oleg421-client systemd-logind[1011]: New session 143 of user root. Apr 3 01:46:46 oleg421-client systemd[1]: Started Session 143 of user root. Apr 3 01:46:46 oleg421-client sshd[30845]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:46:47 oleg421-client sshd[30858]: Received disconnect from 192.168.204.21 port 50780:11: disconnected by user Apr 3 01:46:47 oleg421-client sshd[30858]: Disconnected from user root 192.168.204.21 port 50780 Apr 3 01:46:47 oleg421-client sshd[30845]: pam_unix(sshd:session): session closed for user root Apr 3 01:46:47 oleg421-client systemd-logind[1011]: Session 143 logged out. Waiting for processes to exit. Apr 3 01:46:47 oleg421-client systemd[1]: session-143.scope: Succeeded. Apr 3 01:46:47 oleg421-client systemd-logind[1011]: Removed session 143. Apr 3 01:46:49 oleg421-client sshd[30986]: Accepted publickey for root from 192.168.204.21 port 53556 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:46:49 oleg421-client systemd-logind[1011]: New session 144 of user root. Apr 3 01:46:49 oleg421-client systemd[1]: Started Session 144 of user root. Apr 3 01:46:49 oleg421-client sshd[30986]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:46:50 oleg421-client sshd[30999]: Received disconnect from 192.168.204.21 port 53556:11: disconnected by user Apr 3 01:46:50 oleg421-client sshd[30999]: Disconnected from user root 192.168.204.21 port 53556 Apr 3 01:46:50 oleg421-client sshd[30986]: pam_unix(sshd:session): session closed for user root Apr 3 01:46:50 oleg421-client systemd-logind[1011]: Session 144 logged out. Waiting for processes to exit. Apr 3 01:46:50 oleg421-client systemd[1]: session-144.scope: Succeeded. Apr 3 01:46:50 oleg421-client systemd-logind[1011]: Removed session 144. Apr 3 01:46:52 oleg421-client sshd[31133]: Accepted publickey for root from 192.168.204.21 port 53570 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:46:52 oleg421-client systemd[1]: Started Session 145 of user root. Apr 3 01:46:52 oleg421-client systemd-logind[1011]: New session 145 of user root. Apr 3 01:46:52 oleg421-client sshd[31133]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:46:52 oleg421-client sshd[31146]: Received disconnect from 192.168.204.21 port 53570:11: disconnected by user Apr 3 01:46:52 oleg421-client sshd[31146]: Disconnected from user root 192.168.204.21 port 53570 Apr 3 01:46:52 oleg421-client sshd[31133]: pam_unix(sshd:session): session closed for user root Apr 3 01:46:52 oleg421-client systemd[1]: session-145.scope: Succeeded. Apr 3 01:46:52 oleg421-client systemd-logind[1011]: Session 145 logged out. Waiting for processes to exit. Apr 3 01:46:52 oleg421-client systemd-logind[1011]: Removed session 145. Apr 3 01:48:43 oleg421-client kernel: Lustre: 30736:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775195181/real 1775195181] req@ffff962444849500 x1861425361656448/t0(0) o36->lustre-MDT0000-mdc-ffff962443e10000@192.168.204.121@tcp:12/10 lens 488/512 e 0 to 1 dl 1775195323 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:4294967295 Apr 3 01:48:43 oleg421-client kernel: Lustre: 30736:0:(client.c:2479:ptlrpc_expire_one_request()) Skipped 15 previous similar messages Apr 3 01:48:45 oleg421-client sshd[31305]: Accepted publickey for root from 192.168.204.21 port 34446 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:48:45 oleg421-client systemd[1]: Started Session 146 of user root. Apr 3 01:48:45 oleg421-client systemd-logind[1011]: New session 146 of user root. Apr 3 01:48:45 oleg421-client sshd[31305]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:48:45 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21f: drop both reply while close and open are both in flight ========================================================== 01:48:43 (1775195323) Apr 3 01:48:45 oleg421-client sshd[31318]: Received disconnect from 192.168.204.21 port 34446:11: disconnected by user Apr 3 01:48:45 oleg421-client sshd[31318]: Disconnected from user root 192.168.204.21 port 34446 Apr 3 01:48:45 oleg421-client sshd[31305]: pam_unix(sshd:session): session closed for user root Apr 3 01:48:46 oleg421-client systemd[1]: session-146.scope: Succeeded. Apr 3 01:48:46 oleg421-client systemd-logind[1011]: Session 146 logged out. Waiting for processes to exit. Apr 3 01:48:46 oleg421-client systemd-logind[1011]: Removed session 146. Apr 3 01:49:07 oleg421-client sshd[31491]: Accepted publickey for root from 192.168.204.21 port 57736 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:49:07 oleg421-client systemd-logind[1011]: New session 147 of user root. Apr 3 01:49:07 oleg421-client systemd[1]: Started Session 147 of user root. Apr 3 01:49:07 oleg421-client sshd[31491]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:49:07 oleg421-client sshd[31504]: Received disconnect from 192.168.204.21 port 57736:11: disconnected by user Apr 3 01:49:07 oleg421-client sshd[31504]: Disconnected from user root 192.168.204.21 port 57736 Apr 3 01:49:07 oleg421-client sshd[31491]: pam_unix(sshd:session): session closed for user root Apr 3 01:49:08 oleg421-client systemd[1]: session-147.scope: Succeeded. Apr 3 01:49:08 oleg421-client systemd-logind[1011]: Session 147 logged out. Waiting for processes to exit. Apr 3 01:49:08 oleg421-client systemd-logind[1011]: Removed session 147. Apr 3 01:49:09 oleg421-client sshd[31631]: Accepted publickey for root from 192.168.204.21 port 52562 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:49:09 oleg421-client systemd-logind[1011]: New session 148 of user root. Apr 3 01:49:09 oleg421-client systemd[1]: Started Session 148 of user root. Apr 3 01:49:09 oleg421-client sshd[31631]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:49:10 oleg421-client sshd[31644]: Received disconnect from 192.168.204.21 port 52562:11: disconnected by user Apr 3 01:49:10 oleg421-client sshd[31644]: Disconnected from user root 192.168.204.21 port 52562 Apr 3 01:49:10 oleg421-client sshd[31631]: pam_unix(sshd:session): session closed for user root Apr 3 01:49:10 oleg421-client systemd-logind[1011]: Session 148 logged out. Waiting for processes to exit. Apr 3 01:49:10 oleg421-client systemd[1]: session-148.scope: Succeeded. Apr 3 01:49:10 oleg421-client systemd-logind[1011]: Removed session 148. Apr 3 01:49:11 oleg421-client sshd[31777]: Accepted publickey for root from 192.168.204.21 port 52576 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:49:11 oleg421-client systemd[1]: Started Session 149 of user root. Apr 3 01:49:11 oleg421-client systemd-logind[1011]: New session 149 of user root. Apr 3 01:49:11 oleg421-client sshd[31777]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:49:12 oleg421-client sshd[31790]: Received disconnect from 192.168.204.21 port 52576:11: disconnected by user Apr 3 01:49:12 oleg421-client sshd[31790]: Disconnected from user root 192.168.204.21 port 52576 Apr 3 01:49:12 oleg421-client sshd[31777]: pam_unix(sshd:session): session closed for user root Apr 3 01:49:12 oleg421-client systemd-logind[1011]: Session 149 logged out. Waiting for processes to exit. Apr 3 01:49:12 oleg421-client systemd[1]: session-149.scope: Succeeded. Apr 3 01:49:12 oleg421-client systemd-logind[1011]: Removed session 149. Apr 3 01:49:13 oleg421-client sshd[31932]: Accepted publickey for root from 192.168.204.21 port 52588 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:49:13 oleg421-client systemd[1]: Started Session 150 of user root. Apr 3 01:49:13 oleg421-client systemd-logind[1011]: New session 150 of user root. Apr 3 01:49:13 oleg421-client sshd[31932]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:49:14 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21g: drop open reply and close request while close and open are both in flight ========================================================== 01:49:12 (1775195352) Apr 3 01:49:14 oleg421-client sshd[31945]: Received disconnect from 192.168.204.21 port 52588:11: disconnected by user Apr 3 01:49:14 oleg421-client sshd[31945]: Disconnected from user root 192.168.204.21 port 52588 Apr 3 01:49:14 oleg421-client sshd[31932]: pam_unix(sshd:session): session closed for user root Apr 3 01:49:14 oleg421-client systemd-logind[1011]: Session 150 logged out. Waiting for processes to exit. Apr 3 01:49:14 oleg421-client systemd[1]: session-150.scope: Succeeded. Apr 3 01:49:14 oleg421-client systemd-logind[1011]: Removed session 150. Apr 3 01:49:35 oleg421-client sshd[32118]: Accepted publickey for root from 192.168.204.21 port 52804 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:49:35 oleg421-client systemd-logind[1011]: New session 151 of user root. Apr 3 01:49:35 oleg421-client systemd[1]: Started Session 151 of user root. Apr 3 01:49:35 oleg421-client sshd[32118]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:49:36 oleg421-client sshd[32131]: Received disconnect from 192.168.204.21 port 52804:11: disconnected by user Apr 3 01:49:36 oleg421-client sshd[32131]: Disconnected from user root 192.168.204.21 port 52804 Apr 3 01:49:36 oleg421-client sshd[32118]: pam_unix(sshd:session): session closed for user root Apr 3 01:49:36 oleg421-client systemd[1]: session-151.scope: Succeeded. Apr 3 01:49:36 oleg421-client systemd-logind[1011]: Session 151 logged out. Waiting for processes to exit. Apr 3 01:49:36 oleg421-client systemd-logind[1011]: Removed session 151. Apr 3 01:49:37 oleg421-client sshd[32257]: Accepted publickey for root from 192.168.204.21 port 52812 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:49:37 oleg421-client systemd-logind[1011]: New session 152 of user root. Apr 3 01:49:37 oleg421-client systemd[1]: Started Session 152 of user root. Apr 3 01:49:37 oleg421-client sshd[32257]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:49:38 oleg421-client sshd[32270]: Received disconnect from 192.168.204.21 port 52812:11: disconnected by user Apr 3 01:49:38 oleg421-client sshd[32270]: Disconnected from user root 192.168.204.21 port 52812 Apr 3 01:49:38 oleg421-client sshd[32257]: pam_unix(sshd:session): session closed for user root Apr 3 01:49:38 oleg421-client systemd[1]: session-152.scope: Succeeded. Apr 3 01:49:38 oleg421-client systemd-logind[1011]: Session 152 logged out. Waiting for processes to exit. Apr 3 01:49:38 oleg421-client systemd-logind[1011]: Removed session 152. Apr 3 01:49:39 oleg421-client sshd[32403]: Accepted publickey for root from 192.168.204.21 port 57944 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:49:39 oleg421-client systemd-logind[1011]: New session 153 of user root. Apr 3 01:49:39 oleg421-client systemd[1]: Started Session 153 of user root. Apr 3 01:49:39 oleg421-client sshd[32403]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:49:39 oleg421-client sshd[32417]: Received disconnect from 192.168.204.21 port 57944:11: disconnected by user Apr 3 01:49:39 oleg421-client sshd[32417]: Disconnected from user root 192.168.204.21 port 57944 Apr 3 01:49:39 oleg421-client sshd[32403]: pam_unix(sshd:session): session closed for user root Apr 3 01:49:39 oleg421-client systemd[1]: session-153.scope: Succeeded. Apr 3 01:49:39 oleg421-client systemd-logind[1011]: Session 153 logged out. Waiting for processes to exit. Apr 3 01:49:39 oleg421-client systemd-logind[1011]: Removed session 153. Apr 3 01:49:41 oleg421-client sshd[32559]: Accepted publickey for root from 192.168.204.21 port 57958 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:49:41 oleg421-client systemd-logind[1011]: New session 154 of user root. Apr 3 01:49:41 oleg421-client systemd[1]: Started Session 154 of user root. Apr 3 01:49:41 oleg421-client sshd[32559]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:49:42 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21h: drop open request and close reply while close and open are both in flight ========================================================== 01:49:40 (1775195380) Apr 3 01:49:42 oleg421-client sshd[32572]: Received disconnect from 192.168.204.21 port 57958:11: disconnected by user Apr 3 01:49:42 oleg421-client sshd[32572]: Disconnected from user root 192.168.204.21 port 57958 Apr 3 01:49:42 oleg421-client sshd[32559]: pam_unix(sshd:session): session closed for user root Apr 3 01:49:42 oleg421-client systemd-logind[1011]: Session 154 logged out. Waiting for processes to exit. Apr 3 01:49:42 oleg421-client systemd[1]: session-154.scope: Succeeded. Apr 3 01:49:42 oleg421-client systemd-logind[1011]: Removed session 154. Apr 3 01:50:03 oleg421-client sshd[32745]: Accepted publickey for root from 192.168.204.21 port 58338 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:50:03 oleg421-client systemd-logind[1011]: New session 155 of user root. Apr 3 01:50:03 oleg421-client systemd[1]: Started Session 155 of user root. Apr 3 01:50:03 oleg421-client sshd[32745]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:50:04 oleg421-client sshd[32758]: Received disconnect from 192.168.204.21 port 58338:11: disconnected by user Apr 3 01:50:04 oleg421-client sshd[32758]: Disconnected from user root 192.168.204.21 port 58338 Apr 3 01:50:04 oleg421-client sshd[32745]: pam_unix(sshd:session): session closed for user root Apr 3 01:50:04 oleg421-client systemd[1]: session-155.scope: Succeeded. Apr 3 01:50:04 oleg421-client systemd-logind[1011]: Session 155 logged out. Waiting for processes to exit. Apr 3 01:50:04 oleg421-client systemd-logind[1011]: Removed session 155. Apr 3 01:50:05 oleg421-client sshd[32885]: Accepted publickey for root from 192.168.204.21 port 58342 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:50:05 oleg421-client systemd[1]: Started Session 156 of user root. Apr 3 01:50:05 oleg421-client systemd-logind[1011]: New session 156 of user root. Apr 3 01:50:05 oleg421-client sshd[32885]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:50:05 oleg421-client sshd[32898]: Received disconnect from 192.168.204.21 port 58342:11: disconnected by user Apr 3 01:50:05 oleg421-client sshd[32898]: Disconnected from user root 192.168.204.21 port 58342 Apr 3 01:50:06 oleg421-client sshd[32885]: pam_unix(sshd:session): session closed for user root Apr 3 01:50:06 oleg421-client systemd[1]: session-156.scope: Succeeded. Apr 3 01:50:06 oleg421-client systemd-logind[1011]: Session 156 logged out. Waiting for processes to exit. Apr 3 01:50:06 oleg421-client systemd-logind[1011]: Removed session 156. Apr 3 01:50:07 oleg421-client sshd[33031]: Accepted publickey for root from 192.168.204.21 port 48644 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:50:07 oleg421-client systemd[1]: Started Session 157 of user root. Apr 3 01:50:07 oleg421-client systemd-logind[1011]: New session 157 of user root. Apr 3 01:50:07 oleg421-client sshd[33031]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:50:08 oleg421-client sshd[33044]: Received disconnect from 192.168.204.21 port 48644:11: disconnected by user Apr 3 01:50:08 oleg421-client sshd[33044]: Disconnected from user root 192.168.204.21 port 48644 Apr 3 01:50:08 oleg421-client sshd[33031]: pam_unix(sshd:session): session closed for user root Apr 3 01:50:08 oleg421-client systemd[1]: session-157.scope: Succeeded. Apr 3 01:50:08 oleg421-client systemd-logind[1011]: Session 157 logged out. Waiting for processes to exit. Apr 3 01:50:08 oleg421-client systemd-logind[1011]: Removed session 157. Apr 3 01:50:09 oleg421-client sshd[33186]: Accepted publickey for root from 192.168.204.21 port 48646 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:50:09 oleg421-client systemd-logind[1011]: New session 158 of user root. Apr 3 01:50:09 oleg421-client systemd[1]: Started Session 158 of user root. Apr 3 01:50:09 oleg421-client sshd[33186]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:50:10 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 22: drop close request and do mknod ========================================================== 01:50:08 (1775195408) Apr 3 01:50:10 oleg421-client sshd[33199]: Received disconnect from 192.168.204.21 port 48646:11: disconnected by user Apr 3 01:50:10 oleg421-client sshd[33199]: Disconnected from user root 192.168.204.21 port 48646 Apr 3 01:50:10 oleg421-client sshd[33186]: pam_unix(sshd:session): session closed for user root Apr 3 01:50:10 oleg421-client systemd-logind[1011]: Session 158 logged out. Waiting for processes to exit. Apr 3 01:50:10 oleg421-client systemd[1]: session-158.scope: Succeeded. Apr 3 01:50:10 oleg421-client systemd-logind[1011]: Removed session 158. Apr 3 01:50:29 oleg421-client sshd[33351]: Accepted publickey for root from 192.168.204.21 port 55320 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:50:29 oleg421-client systemd-logind[1011]: New session 159 of user root. Apr 3 01:50:29 oleg421-client systemd[1]: Started Session 159 of user root. Apr 3 01:50:29 oleg421-client sshd[33351]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:50:29 oleg421-client sshd[33364]: Received disconnect from 192.168.204.21 port 55320:11: disconnected by user Apr 3 01:50:30 oleg421-client sshd[33364]: Disconnected from user root 192.168.204.21 port 55320 Apr 3 01:50:30 oleg421-client sshd[33351]: pam_unix(sshd:session): session closed for user root Apr 3 01:50:30 oleg421-client systemd[1]: session-159.scope: Succeeded. Apr 3 01:50:30 oleg421-client systemd-logind[1011]: Session 159 logged out. Waiting for processes to exit. Apr 3 01:50:30 oleg421-client systemd-logind[1011]: Removed session 159. Apr 3 01:50:32 oleg421-client sshd[33491]: Accepted publickey for root from 192.168.204.21 port 55332 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:50:32 oleg421-client systemd-logind[1011]: New session 160 of user root. Apr 3 01:50:32 oleg421-client systemd[1]: Started Session 160 of user root. Apr 3 01:50:32 oleg421-client sshd[33491]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:50:32 oleg421-client sshd[33504]: Received disconnect from 192.168.204.21 port 55332:11: disconnected by user Apr 3 01:50:32 oleg421-client sshd[33504]: Disconnected from user root 192.168.204.21 port 55332 Apr 3 01:50:32 oleg421-client sshd[33491]: pam_unix(sshd:session): session closed for user root Apr 3 01:50:32 oleg421-client systemd-logind[1011]: Session 160 logged out. Waiting for processes to exit. Apr 3 01:50:32 oleg421-client systemd[1]: session-160.scope: Succeeded. Apr 3 01:50:33 oleg421-client systemd-logind[1011]: Removed session 160. Apr 3 01:50:34 oleg421-client sshd[33637]: Accepted publickey for root from 192.168.204.21 port 55338 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:50:34 oleg421-client systemd[1]: Started Session 161 of user root. Apr 3 01:50:34 oleg421-client systemd-logind[1011]: New session 161 of user root. Apr 3 01:50:34 oleg421-client sshd[33637]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:50:34 oleg421-client sshd[33650]: Received disconnect from 192.168.204.21 port 55338:11: disconnected by user Apr 3 01:50:34 oleg421-client sshd[33650]: Disconnected from user root 192.168.204.21 port 55338 Apr 3 01:50:34 oleg421-client sshd[33637]: pam_unix(sshd:session): session closed for user root Apr 3 01:50:35 oleg421-client systemd[1]: session-161.scope: Succeeded. Apr 3 01:50:35 oleg421-client systemd-logind[1011]: Session 161 logged out. Waiting for processes to exit. Apr 3 01:50:35 oleg421-client systemd-logind[1011]: Removed session 161. Apr 3 01:50:36 oleg421-client sshd[33792]: Accepted publickey for root from 192.168.204.21 port 55344 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:50:36 oleg421-client systemd[1]: Started Session 162 of user root. Apr 3 01:50:36 oleg421-client systemd-logind[1011]: New session 162 of user root. Apr 3 01:50:36 oleg421-client sshd[33792]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:50:37 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 23: client hang when close a file after mds crash ========================================================== 01:50:35 (1775195435) Apr 3 01:50:37 oleg421-client sshd[33805]: Received disconnect from 192.168.204.21 port 55344:11: disconnected by user Apr 3 01:50:37 oleg421-client sshd[33805]: Disconnected from user root 192.168.204.21 port 55344 Apr 3 01:50:37 oleg421-client sshd[33792]: pam_unix(sshd:session): session closed for user root Apr 3 01:50:37 oleg421-client systemd[1]: session-162.scope: Succeeded. Apr 3 01:50:37 oleg421-client systemd-logind[1011]: Session 162 logged out. Waiting for processes to exit. Apr 3 01:50:37 oleg421-client systemd-logind[1011]: Removed session 162. Apr 3 01:51:06 oleg421-client kernel: LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 192.168.204.121@tcp) was lost; in progress operations using this service will fail Apr 3 01:51:16 oleg421-client kernel: Lustre: Evicted from MGS (at 192.168.204.121@tcp) after server handle changed from 0x1d1756950ceb8805 to 0x1d1756950cebae85 Apr 3 01:51:26 oleg421-client sshd[34148]: Accepted publickey for root from 192.168.204.21 port 56556 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:51:26 oleg421-client systemd-logind[1011]: New session 163 of user root. Apr 3 01:51:26 oleg421-client systemd[1]: Started Session 163 of user root. Apr 3 01:51:26 oleg421-client sshd[34148]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:51:27 oleg421-client sshd[34161]: Received disconnect from 192.168.204.21 port 56556:11: disconnected by user Apr 3 01:51:27 oleg421-client sshd[34161]: Disconnected from user root 192.168.204.21 port 56556 Apr 3 01:51:27 oleg421-client sshd[34148]: pam_unix(sshd:session): session closed for user root Apr 3 01:51:27 oleg421-client systemd-logind[1011]: Session 163 logged out. Waiting for processes to exit. Apr 3 01:51:27 oleg421-client systemd[1]: session-163.scope: Succeeded. Apr 3 01:51:27 oleg421-client systemd-logind[1011]: Removed session 163. Apr 3 01:51:30 oleg421-client sshd[34384]: Accepted publickey for root from 192.168.204.21 port 58662 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:51:30 oleg421-client systemd-logind[1011]: New session 164 of user root. Apr 3 01:51:30 oleg421-client systemd[1]: Started Session 164 of user root. Apr 3 01:51:30 oleg421-client sshd[34384]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:51:31 oleg421-client kernel: Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid Apr 3 01:51:31 oleg421-client sshd[34397]: Received disconnect from 192.168.204.21 port 58662:11: disconnected by user Apr 3 01:51:31 oleg421-client sshd[34397]: Disconnected from user root 192.168.204.21 port 58662 Apr 3 01:51:31 oleg421-client sshd[34384]: pam_unix(sshd:session): session closed for user root Apr 3 01:51:31 oleg421-client systemd-logind[1011]: Session 164 logged out. Waiting for processes to exit. Apr 3 01:51:31 oleg421-client systemd[1]: session-164.scope: Succeeded. Apr 3 01:51:31 oleg421-client systemd-logind[1011]: Removed session 164. Apr 3 01:51:32 oleg421-client sshd[34540]: Accepted publickey for root from 192.168.204.21 port 58666 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:51:32 oleg421-client systemd-logind[1011]: New session 165 of user root. Apr 3 01:51:32 oleg421-client systemd[1]: Started Session 165 of user root. Apr 3 01:51:32 oleg421-client sshd[34540]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:51:33 oleg421-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Apr 3 01:51:33 oleg421-client sshd[34553]: Received disconnect from 192.168.204.21 port 58666:11: disconnected by user Apr 3 01:51:33 oleg421-client sshd[34553]: Disconnected from user root 192.168.204.21 port 58666 Apr 3 01:51:33 oleg421-client sshd[34540]: pam_unix(sshd:session): session closed for user root Apr 3 01:51:33 oleg421-client systemd-logind[1011]: Session 165 logged out. Waiting for processes to exit. Apr 3 01:51:33 oleg421-client systemd[1]: session-165.scope: Succeeded. Apr 3 01:51:33 oleg421-client systemd-logind[1011]: Removed session 165. Apr 3 01:51:34 oleg421-client sshd[34594]: Accepted publickey for root from 192.168.204.21 port 58668 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:51:34 oleg421-client systemd[1]: Started Session 166 of user root. Apr 3 01:51:34 oleg421-client systemd-logind[1011]: New session 166 of user root. Apr 3 01:51:34 oleg421-client sshd[34594]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:51:35 oleg421-client sshd[34607]: Received disconnect from 192.168.204.21 port 58668:11: disconnected by user Apr 3 01:51:35 oleg421-client sshd[34607]: Disconnected from user root 192.168.204.21 port 58668 Apr 3 01:51:35 oleg421-client sshd[34594]: pam_unix(sshd:session): session closed for user root Apr 3 01:51:35 oleg421-client systemd-logind[1011]: Session 166 logged out. Waiting for processes to exit. Apr 3 01:51:35 oleg421-client systemd[1]: session-166.scope: Succeeded. Apr 3 01:51:35 oleg421-client systemd-logind[1011]: Removed session 166. Apr 3 01:51:36 oleg421-client sshd[34727]: Accepted publickey for root from 192.168.204.21 port 58682 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:51:36 oleg421-client systemd-logind[1011]: New session 167 of user root. Apr 3 01:51:36 oleg421-client systemd[1]: Started Session 167 of user root. Apr 3 01:51:36 oleg421-client sshd[34727]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:51:37 oleg421-client sshd[34740]: Received disconnect from 192.168.204.21 port 58682:11: disconnected by user Apr 3 01:51:37 oleg421-client sshd[34740]: Disconnected from user root 192.168.204.21 port 58682 Apr 3 01:51:37 oleg421-client sshd[34727]: pam_unix(sshd:session): session closed for user root Apr 3 01:51:37 oleg421-client systemd-logind[1011]: Session 167 logged out. Waiting for processes to exit. Apr 3 01:51:37 oleg421-client systemd[1]: session-167.scope: Succeeded. Apr 3 01:51:37 oleg421-client systemd-logind[1011]: Removed session 167. Apr 3 01:51:38 oleg421-client sshd[34866]: Accepted publickey for root from 192.168.204.21 port 59818 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:51:38 oleg421-client systemd-logind[1011]: New session 168 of user root. Apr 3 01:51:38 oleg421-client systemd[1]: Started Session 168 of user root. Apr 3 01:51:38 oleg421-client sshd[34866]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:51:38 oleg421-client sshd[34879]: Received disconnect from 192.168.204.21 port 59818:11: disconnected by user Apr 3 01:51:38 oleg421-client sshd[34879]: Disconnected from user root 192.168.204.21 port 59818 Apr 3 01:51:39 oleg421-client sshd[34866]: pam_unix(sshd:session): session closed for user root Apr 3 01:51:39 oleg421-client systemd[1]: session-168.scope: Succeeded. Apr 3 01:51:39 oleg421-client systemd-logind[1011]: Session 168 logged out. Waiting for processes to exit. Apr 3 01:51:39 oleg421-client systemd-logind[1011]: Removed session 168. Apr 3 01:51:40 oleg421-client sshd[35012]: Accepted publickey for root from 192.168.204.21 port 59828 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:51:40 oleg421-client systemd-logind[1011]: New session 169 of user root. Apr 3 01:51:40 oleg421-client systemd[1]: Started Session 169 of user root. Apr 3 01:51:40 oleg421-client rsyslogd[1073]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Apr 3 01:51:40 oleg421-client sshd[35012]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:51:40 oleg421-client sshd[35027]: Received disconnect from 192.168.204.21 port 59828:11: disconnected by user Apr 3 01:51:40 oleg421-client sshd[35027]: Disconnected from user root 192.168.204.21 port 59828 Apr 3 01:51:40 oleg421-client sshd[35012]: pam_unix(sshd:session): session closed for user root Apr 3 01:51:40 oleg421-client systemd-logind[1011]: Session 169 logged out. Waiting for processes to exit. Apr 3 01:51:40 oleg421-client systemd[1]: session-169.scope: Succeeded. Apr 3 01:51:40 oleg421-client systemd-logind[1011]: Removed session 169. Apr 3 01:51:42 oleg421-client sshd[35169]: Accepted publickey for root from 192.168.204.21 port 59838 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:51:42 oleg421-client systemd-logind[1011]: New session 170 of user root. Apr 3 01:51:42 oleg421-client systemd[1]: Started Session 170 of user root. Apr 3 01:51:42 oleg421-client sshd[35169]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:51:42 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 24a: fsync error (should return error) ========================================================== 01:51:41 (1775195501) Apr 3 01:51:42 oleg421-client sshd[35182]: Received disconnect from 192.168.204.21 port 59838:11: disconnected by user Apr 3 01:51:42 oleg421-client sshd[35182]: Disconnected from user root 192.168.204.21 port 59838 Apr 3 01:51:42 oleg421-client sshd[35169]: pam_unix(sshd:session): session closed for user root Apr 3 01:51:43 oleg421-client systemd[1]: session-170.scope: Succeeded. Apr 3 01:51:43 oleg421-client systemd-logind[1011]: Session 170 logged out. Waiting for processes to exit. Apr 3 01:51:43 oleg421-client systemd-logind[1011]: Removed session 170. Apr 3 01:51:44 oleg421-client kernel: LustreError: lustre-OST0000-osc-ffff962443e10000: operation ost_write to node 192.168.204.121@tcp failed: rc = -107 Apr 3 01:51:44 oleg421-client kernel: LustreError: lustre-OST0000-osc-ffff962443e10000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Apr 3 01:51:44 oleg421-client kernel: Lustre: 2404:0:(llite_lib.c:4149:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.204.121@tcp:/lustre/fid: [0x240000402:0x8:0x0]// may get corrupted (rc -5) Apr 3 01:51:46 oleg421-client sshd[35367]: Accepted publickey for root from 192.168.204.21 port 59852 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:51:47 oleg421-client systemd-logind[1011]: New session 171 of user root. Apr 3 01:51:47 oleg421-client systemd[1]: Started Session 171 of user root. Apr 3 01:51:47 oleg421-client sshd[35367]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:51:47 oleg421-client sshd[35380]: Received disconnect from 192.168.204.21 port 59852:11: disconnected by user Apr 3 01:51:47 oleg421-client sshd[35380]: Disconnected from user root 192.168.204.21 port 59852 Apr 3 01:51:47 oleg421-client sshd[35367]: pam_unix(sshd:session): session closed for user root Apr 3 01:51:47 oleg421-client systemd[1]: session-171.scope: Succeeded. Apr 3 01:51:47 oleg421-client systemd-logind[1011]: Session 171 logged out. Waiting for processes to exit. Apr 3 01:51:47 oleg421-client systemd-logind[1011]: Removed session 171. Apr 3 01:51:48 oleg421-client sshd[35507]: Accepted publickey for root from 192.168.204.21 port 60234 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:51:48 oleg421-client systemd-logind[1011]: New session 172 of user root. Apr 3 01:51:48 oleg421-client systemd[1]: Started Session 172 of user root. Apr 3 01:51:48 oleg421-client sshd[35507]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:51:48 oleg421-client sshd[35520]: Received disconnect from 192.168.204.21 port 60234:11: disconnected by user Apr 3 01:51:49 oleg421-client sshd[35520]: Disconnected from user root 192.168.204.21 port 60234 Apr 3 01:51:49 oleg421-client sshd[35507]: pam_unix(sshd:session): session closed for user root Apr 3 01:51:49 oleg421-client systemd[1]: session-172.scope: Succeeded. Apr 3 01:51:49 oleg421-client systemd-logind[1011]: Session 172 logged out. Waiting for processes to exit. Apr 3 01:51:49 oleg421-client systemd-logind[1011]: Removed session 172. Apr 3 01:51:50 oleg421-client sshd[35653]: Accepted publickey for root from 192.168.204.21 port 60240 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:51:50 oleg421-client systemd[1]: Started Session 173 of user root. Apr 3 01:51:50 oleg421-client systemd-logind[1011]: New session 173 of user root. Apr 3 01:51:50 oleg421-client sshd[35653]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:51:50 oleg421-client sshd[35666]: Received disconnect from 192.168.204.21 port 60240:11: disconnected by user Apr 3 01:51:50 oleg421-client sshd[35666]: Disconnected from user root 192.168.204.21 port 60240 Apr 3 01:51:50 oleg421-client sshd[35653]: pam_unix(sshd:session): session closed for user root Apr 3 01:51:51 oleg421-client systemd-logind[1011]: Session 173 logged out. Waiting for processes to exit. Apr 3 01:51:51 oleg421-client systemd[1]: session-173.scope: Succeeded. Apr 3 01:51:51 oleg421-client systemd-logind[1011]: Removed session 173. Apr 3 01:51:52 oleg421-client sshd[35808]: Accepted publickey for root from 192.168.204.21 port 60248 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:51:52 oleg421-client systemd-logind[1011]: New session 174 of user root. Apr 3 01:51:52 oleg421-client systemd[1]: Started Session 174 of user root. Apr 3 01:51:52 oleg421-client sshd[35808]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:51:53 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 24b: test dirty page discard due to client eviction ========================================================== 01:51:51 (1775195511) Apr 3 01:51:53 oleg421-client sshd[35821]: Received disconnect from 192.168.204.21 port 60248:11: disconnected by user Apr 3 01:51:53 oleg421-client sshd[35821]: Disconnected from user root 192.168.204.21 port 60248 Apr 3 01:51:53 oleg421-client sshd[35808]: pam_unix(sshd:session): session closed for user root Apr 3 01:51:53 oleg421-client systemd-logind[1011]: Session 174 logged out. Waiting for processes to exit. Apr 3 01:51:53 oleg421-client systemd[1]: session-174.scope: Succeeded. Apr 3 01:51:53 oleg421-client systemd-logind[1011]: Removed session 174. Apr 3 01:51:55 oleg421-client kernel: LustreError: lustre-OST0000-osc-ffff962443e10000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Apr 3 01:51:55 oleg421-client kernel: Lustre: 2405:0:(llite_lib.c:4149:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.204.121@tcp:/lustre/fid: [0x200000405:0x2f:0x0]// may get corrupted (rc -108) Apr 3 01:51:57 oleg421-client sshd[36013]: Accepted publickey for root from 192.168.204.21 port 60254 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:51:57 oleg421-client systemd-logind[1011]: New session 175 of user root. Apr 3 01:51:57 oleg421-client systemd[1]: Started Session 175 of user root. Apr 3 01:51:57 oleg421-client sshd[36013]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:51:57 oleg421-client sshd[36026]: Received disconnect from 192.168.204.21 port 60254:11: disconnected by user Apr 3 01:51:57 oleg421-client sshd[36026]: Disconnected from user root 192.168.204.21 port 60254 Apr 3 01:51:57 oleg421-client sshd[36013]: pam_unix(sshd:session): session closed for user root Apr 3 01:51:57 oleg421-client systemd[1]: session-175.scope: Succeeded. Apr 3 01:51:57 oleg421-client systemd-logind[1011]: Session 175 logged out. Waiting for processes to exit. Apr 3 01:51:57 oleg421-client systemd-logind[1011]: Removed session 175. Apr 3 01:51:58 oleg421-client sshd[36152]: Accepted publickey for root from 192.168.204.21 port 56994 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:51:59 oleg421-client systemd[1]: Started Session 176 of user root. Apr 3 01:51:59 oleg421-client systemd-logind[1011]: New session 176 of user root. Apr 3 01:51:59 oleg421-client sshd[36152]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:51:59 oleg421-client sshd[36165]: Received disconnect from 192.168.204.21 port 56994:11: disconnected by user Apr 3 01:51:59 oleg421-client sshd[36165]: Disconnected from user root 192.168.204.21 port 56994 Apr 3 01:51:59 oleg421-client sshd[36152]: pam_unix(sshd:session): session closed for user root Apr 3 01:51:59 oleg421-client systemd-logind[1011]: Session 176 logged out. Waiting for processes to exit. Apr 3 01:51:59 oleg421-client systemd[1]: session-176.scope: Succeeded. Apr 3 01:51:59 oleg421-client systemd-logind[1011]: Removed session 176. Apr 3 01:52:00 oleg421-client sshd[36298]: Accepted publickey for root from 192.168.204.21 port 57010 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:52:00 oleg421-client systemd-logind[1011]: New session 177 of user root. Apr 3 01:52:00 oleg421-client systemd[1]: Started Session 177 of user root. Apr 3 01:52:00 oleg421-client sshd[36298]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:52:01 oleg421-client sshd[36312]: Received disconnect from 192.168.204.21 port 57010:11: disconnected by user Apr 3 01:52:01 oleg421-client sshd[36312]: Disconnected from user root 192.168.204.21 port 57010 Apr 3 01:52:01 oleg421-client sshd[36298]: pam_unix(sshd:session): session closed for user root Apr 3 01:52:01 oleg421-client systemd[1]: session-177.scope: Succeeded. Apr 3 01:52:01 oleg421-client systemd-logind[1011]: Session 177 logged out. Waiting for processes to exit. Apr 3 01:52:01 oleg421-client systemd-logind[1011]: Removed session 177. Apr 3 01:52:02 oleg421-client sshd[36454]: Accepted publickey for root from 192.168.204.21 port 57022 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:52:03 oleg421-client systemd-logind[1011]: New session 178 of user root. Apr 3 01:52:03 oleg421-client systemd[1]: Started Session 178 of user root. Apr 3 01:52:03 oleg421-client sshd[36454]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:52:03 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 26a: evict dead exports =========== 01:52:01 (1775195521) Apr 3 01:52:03 oleg421-client sshd[36467]: Received disconnect from 192.168.204.21 port 57022:11: disconnected by user Apr 3 01:52:03 oleg421-client sshd[36467]: Disconnected from user root 192.168.204.21 port 57022 Apr 3 01:52:03 oleg421-client sshd[36454]: pam_unix(sshd:session): session closed for user root Apr 3 01:52:03 oleg421-client systemd[1]: session-178.scope: Succeeded. Apr 3 01:52:03 oleg421-client systemd-logind[1011]: Session 178 logged out. Waiting for processes to exit. Apr 3 01:52:03 oleg421-client systemd-logind[1011]: Removed session 178. Apr 3 01:52:05 oleg421-client sshd[36688]: Accepted publickey for root from 192.168.204.21 port 57032 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:52:05 oleg421-client systemd[1]: Started Session 179 of user root. Apr 3 01:52:05 oleg421-client systemd-logind[1011]: New session 179 of user root. Apr 3 01:52:05 oleg421-client sshd[36688]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:52:05 oleg421-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_26a msg and ost1 are at the same node Apr 3 01:52:05 oleg421-client sshd[36701]: Received disconnect from 192.168.204.21 port 57032:11: disconnected by user Apr 3 01:52:05 oleg421-client sshd[36701]: Disconnected from user root 192.168.204.21 port 57032 Apr 3 01:52:05 oleg421-client sshd[36688]: pam_unix(sshd:session): session closed for user root Apr 3 01:52:05 oleg421-client systemd[1]: session-179.scope: Succeeded. Apr 3 01:52:05 oleg421-client systemd-logind[1011]: Session 179 logged out. Waiting for processes to exit. Apr 3 01:52:06 oleg421-client systemd-logind[1011]: Removed session 179. Apr 3 01:52:07 oleg421-client sshd[36843]: Accepted publickey for root from 192.168.204.21 port 43792 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:52:07 oleg421-client systemd[1]: Started Session 180 of user root. Apr 3 01:52:07 oleg421-client systemd-logind[1011]: New session 180 of user root. Apr 3 01:52:07 oleg421-client sshd[36843]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:52:08 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 26b: evict dead exports =========== 01:52:06 (1775195526) Apr 3 01:52:08 oleg421-client sshd[36856]: Received disconnect from 192.168.204.21 port 43792:11: disconnected by user Apr 3 01:52:08 oleg421-client sshd[36856]: Disconnected from user root 192.168.204.21 port 43792 Apr 3 01:52:08 oleg421-client sshd[36843]: pam_unix(sshd:session): session closed for user root Apr 3 01:52:08 oleg421-client systemd[1]: session-180.scope: Succeeded. Apr 3 01:52:08 oleg421-client systemd-logind[1011]: Session 180 logged out. Waiting for processes to exit. Apr 3 01:52:08 oleg421-client systemd-logind[1011]: Removed session 180. Apr 3 01:52:09 oleg421-client sshd[37014]: Accepted publickey for root from 192.168.204.21 port 43798 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:52:09 oleg421-client systemd[1]: Started Session 181 of user root. Apr 3 01:52:09 oleg421-client systemd-logind[1011]: New session 181 of user root. Apr 3 01:52:09 oleg421-client sshd[37014]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:52:10 oleg421-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_26b msg and ost1 are at the same node Apr 3 01:52:10 oleg421-client sshd[37027]: Received disconnect from 192.168.204.21 port 43798:11: disconnected by user Apr 3 01:52:10 oleg421-client sshd[37027]: Disconnected from user root 192.168.204.21 port 43798 Apr 3 01:52:10 oleg421-client sshd[37014]: pam_unix(sshd:session): session closed for user root Apr 3 01:52:10 oleg421-client systemd-logind[1011]: Session 181 logged out. Waiting for processes to exit. Apr 3 01:52:10 oleg421-client systemd[1]: session-181.scope: Succeeded. Apr 3 01:52:10 oleg421-client systemd-logind[1011]: Removed session 181. Apr 3 01:52:11 oleg421-client sshd[37169]: Accepted publickey for root from 192.168.204.21 port 43812 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:52:11 oleg421-client systemd-logind[1011]: New session 182 of user root. Apr 3 01:52:11 oleg421-client systemd[1]: Started Session 182 of user root. Apr 3 01:52:11 oleg421-client sshd[37169]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:52:12 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 27: fail LOV while using OSC's ==== 01:52:10 (1775195530) Apr 3 01:52:12 oleg421-client sshd[37182]: Received disconnect from 192.168.204.21 port 43812:11: disconnected by user Apr 3 01:52:12 oleg421-client sshd[37182]: Disconnected from user root 192.168.204.21 port 43812 Apr 3 01:52:12 oleg421-client sshd[37169]: pam_unix(sshd:session): session closed for user root Apr 3 01:52:12 oleg421-client systemd-logind[1011]: Session 182 logged out. Waiting for processes to exit. Apr 3 01:52:12 oleg421-client systemd[1]: session-182.scope: Succeeded. Apr 3 01:52:12 oleg421-client systemd-logind[1011]: Removed session 182. Apr 3 01:52:16 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962443e10000: operation ldlm_enqueue to node 192.168.204.121@tcp failed: rc = -19 Apr 3 01:52:16 oleg421-client kernel: LustreError: Skipped 1 previous similar message Apr 3 01:52:37 oleg421-client kernel: LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 192.168.204.121@tcp) was lost; in progress operations using this service will fail Apr 3 01:52:47 oleg421-client kernel: Lustre: Evicted from MGS (at 192.168.204.121@tcp) after server handle changed from 0x1d1756950cebae85 to 0x1d1756950cebcd56 Apr 3 01:54:29 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962443e10000: operation mds_reint to node 192.168.204.121@tcp failed: rc = -19 Apr 3 01:54:29 oleg421-client kernel: LustreError: Skipped 1 previous similar message Apr 3 01:54:50 oleg421-client kernel: LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 192.168.204.121@tcp) was lost; in progress operations using this service will fail Apr 3 01:55:00 oleg421-client kernel: Lustre: Evicted from MGS (at 192.168.204.121@tcp) after server handle changed from 0x1d1756950cebcd56 to 0x1d1756950cedb33c Apr 3 01:55:07 oleg421-client sshd[38186]: Accepted publickey for root from 192.168.204.21 port 45640 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:55:07 oleg421-client systemd-logind[1011]: New session 183 of user root. Apr 3 01:55:07 oleg421-client systemd[1]: Started Session 183 of user root. Apr 3 01:55:07 oleg421-client sshd[38186]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:55:07 oleg421-client sshd[38199]: Received disconnect from 192.168.204.21 port 45640:11: disconnected by user Apr 3 01:55:07 oleg421-client sshd[38199]: Disconnected from user root 192.168.204.21 port 45640 Apr 3 01:55:07 oleg421-client sshd[38186]: pam_unix(sshd:session): session closed for user root Apr 3 01:55:07 oleg421-client systemd-logind[1011]: Session 183 logged out. Waiting for processes to exit. Apr 3 01:55:07 oleg421-client systemd[1]: session-183.scope: Succeeded. Apr 3 01:55:07 oleg421-client systemd-logind[1011]: Removed session 183. Apr 3 01:55:08 oleg421-client sshd[38325]: Accepted publickey for root from 192.168.204.21 port 49472 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:55:08 oleg421-client systemd[1]: Started Session 184 of user root. Apr 3 01:55:08 oleg421-client systemd-logind[1011]: New session 184 of user root. Apr 3 01:55:08 oleg421-client sshd[38325]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:55:09 oleg421-client sshd[38338]: Received disconnect from 192.168.204.21 port 49472:11: disconnected by user Apr 3 01:55:09 oleg421-client sshd[38338]: Disconnected from user root 192.168.204.21 port 49472 Apr 3 01:55:09 oleg421-client sshd[38325]: pam_unix(sshd:session): session closed for user root Apr 3 01:55:09 oleg421-client systemd[1]: session-184.scope: Succeeded. Apr 3 01:55:09 oleg421-client systemd-logind[1011]: Session 184 logged out. Waiting for processes to exit. Apr 3 01:55:09 oleg421-client systemd-logind[1011]: Removed session 184. Apr 3 01:55:10 oleg421-client sshd[38471]: Accepted publickey for root from 192.168.204.21 port 49478 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:55:10 oleg421-client systemd[1]: Started Session 185 of user root. Apr 3 01:55:10 oleg421-client systemd-logind[1011]: New session 185 of user root. Apr 3 01:55:10 oleg421-client sshd[38471]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:55:10 oleg421-client sshd[38484]: Received disconnect from 192.168.204.21 port 49478:11: disconnected by user Apr 3 01:55:10 oleg421-client sshd[38484]: Disconnected from user root 192.168.204.21 port 49478 Apr 3 01:55:10 oleg421-client sshd[38471]: pam_unix(sshd:session): session closed for user root Apr 3 01:55:11 oleg421-client systemd[1]: session-185.scope: Succeeded. Apr 3 01:55:11 oleg421-client systemd-logind[1011]: Session 185 logged out. Waiting for processes to exit. Apr 3 01:55:11 oleg421-client systemd-logind[1011]: Removed session 185. Apr 3 01:55:12 oleg421-client sshd[38627]: Accepted publickey for root from 192.168.204.21 port 49488 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:55:12 oleg421-client systemd[1]: Started Session 186 of user root. Apr 3 01:55:12 oleg421-client systemd-logind[1011]: New session 186 of user root. Apr 3 01:55:12 oleg421-client sshd[38627]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:55:12 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 28: handle error adding new clients (bug 6086) ========================================================== 01:55:11 (1775195711) Apr 3 01:55:12 oleg421-client sshd[38640]: Received disconnect from 192.168.204.21 port 49488:11: disconnected by user Apr 3 01:55:12 oleg421-client sshd[38640]: Disconnected from user root 192.168.204.21 port 49488 Apr 3 01:55:12 oleg421-client sshd[38627]: pam_unix(sshd:session): session closed for user root Apr 3 01:55:12 oleg421-client systemd-logind[1011]: Session 186 logged out. Waiting for processes to exit. Apr 3 01:55:12 oleg421-client systemd[1]: session-186.scope: Succeeded. Apr 3 01:55:12 oleg421-client systemd-logind[1011]: Removed session 186. Apr 3 01:55:13 oleg421-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Apr 3 01:55:13 oleg421-client kernel: Lustre: Skipped 2 previous similar messages Apr 3 01:55:32 oleg421-client sshd[38735]: Accepted publickey for root from 192.168.204.21 port 54460 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:55:33 oleg421-client systemd-logind[1011]: New session 187 of user root. Apr 3 01:55:33 oleg421-client systemd[1]: Started Session 187 of user root. Apr 3 01:55:33 oleg421-client sshd[38735]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:55:33 oleg421-client kernel: LustreError: lustre-OST0000-osc-ffff962443e10000: operation ost_connect to node 192.168.204.121@tcp failed: rc = -75 Apr 3 01:55:33 oleg421-client kernel: LustreError: Skipped 2 previous similar messages Apr 3 01:55:36 oleg421-client sshd[38748]: Received disconnect from 192.168.204.21 port 54460:11: disconnected by user Apr 3 01:55:36 oleg421-client sshd[38748]: Disconnected from user root 192.168.204.21 port 54460 Apr 3 01:55:36 oleg421-client sshd[38735]: pam_unix(sshd:session): session closed for user root Apr 3 01:55:36 oleg421-client systemd[1]: session-187.scope: Succeeded. Apr 3 01:55:36 oleg421-client systemd-logind[1011]: Session 187 logged out. Waiting for processes to exit. Apr 3 01:55:36 oleg421-client systemd-logind[1011]: Removed session 187. Apr 3 01:55:41 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962443e10000: Connection to lustre-MDT0000 (at 192.168.204.121@tcp) was lost; in progress operations using this service will wait for recovery to complete Apr 3 01:55:41 oleg421-client kernel: Lustre: Skipped 12 previous similar messages Apr 3 01:55:57 oleg421-client kernel: LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 192.168.204.121@tcp) was lost; in progress operations using this service will fail Apr 3 01:56:07 oleg421-client kernel: Lustre: Evicted from MGS (at 192.168.204.121@tcp) after server handle changed from 0x1d1756950cedb33c to 0x1d1756950cedbee9 Apr 3 01:56:07 oleg421-client kernel: Lustre: MGC192.168.204.121@tcp: Connection restored to 192.168.204.121@tcp (at 192.168.204.121@tcp) Apr 3 01:56:07 oleg421-client kernel: Lustre: Skipped 13 previous similar messages Apr 3 01:56:17 oleg421-client sshd[39061]: Accepted publickey for root from 192.168.204.21 port 58760 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:56:17 oleg421-client systemd-logind[1011]: New session 188 of user root. Apr 3 01:56:17 oleg421-client systemd[1]: Started Session 188 of user root. Apr 3 01:56:17 oleg421-client sshd[39061]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:56:18 oleg421-client sshd[39074]: Received disconnect from 192.168.204.21 port 58760:11: disconnected by user Apr 3 01:56:18 oleg421-client sshd[39074]: Disconnected from user root 192.168.204.21 port 58760 Apr 3 01:56:18 oleg421-client sshd[39061]: pam_unix(sshd:session): session closed for user root Apr 3 01:56:18 oleg421-client systemd-logind[1011]: Session 188 logged out. Waiting for processes to exit. Apr 3 01:56:18 oleg421-client systemd[1]: session-188.scope: Succeeded. Apr 3 01:56:18 oleg421-client systemd-logind[1011]: Removed session 188. Apr 3 01:56:22 oleg421-client sshd[39297]: Accepted publickey for root from 192.168.204.21 port 58776 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:56:22 oleg421-client systemd-logind[1011]: New session 189 of user root. Apr 3 01:56:22 oleg421-client systemd[1]: Started Session 189 of user root. Apr 3 01:56:22 oleg421-client sshd[39297]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:56:23 oleg421-client kernel: Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid Apr 3 01:56:23 oleg421-client sshd[39310]: Received disconnect from 192.168.204.21 port 58776:11: disconnected by user Apr 3 01:56:23 oleg421-client sshd[39310]: Disconnected from user root 192.168.204.21 port 58776 Apr 3 01:56:23 oleg421-client sshd[39297]: pam_unix(sshd:session): session closed for user root Apr 3 01:56:23 oleg421-client systemd[1]: session-189.scope: Succeeded. Apr 3 01:56:23 oleg421-client systemd-logind[1011]: Session 189 logged out. Waiting for processes to exit. Apr 3 01:56:23 oleg421-client systemd-logind[1011]: Removed session 189. Apr 3 01:56:25 oleg421-client sshd[39453]: Accepted publickey for root from 192.168.204.21 port 58792 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:56:25 oleg421-client systemd[1]: Started Session 190 of user root. Apr 3 01:56:25 oleg421-client systemd-logind[1011]: New session 190 of user root. Apr 3 01:56:25 oleg421-client sshd[39453]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:56:25 oleg421-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Apr 3 01:56:25 oleg421-client sshd[39466]: Received disconnect from 192.168.204.21 port 58792:11: disconnected by user Apr 3 01:56:25 oleg421-client sshd[39466]: Disconnected from user root 192.168.204.21 port 58792 Apr 3 01:56:25 oleg421-client sshd[39453]: pam_unix(sshd:session): session closed for user root Apr 3 01:56:25 oleg421-client systemd[1]: session-190.scope: Succeeded. Apr 3 01:56:25 oleg421-client systemd-logind[1011]: Session 190 logged out. Waiting for processes to exit. Apr 3 01:56:25 oleg421-client systemd-logind[1011]: Removed session 190. Apr 3 01:56:27 oleg421-client sshd[39508]: Accepted publickey for root from 192.168.204.21 port 58802 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:56:27 oleg421-client systemd[1]: Started Session 191 of user root. Apr 3 01:56:27 oleg421-client systemd-logind[1011]: New session 191 of user root. Apr 3 01:56:27 oleg421-client sshd[39508]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:56:28 oleg421-client sshd[39521]: Received disconnect from 192.168.204.21 port 58802:11: disconnected by user Apr 3 01:56:28 oleg421-client sshd[39521]: Disconnected from user root 192.168.204.21 port 58802 Apr 3 01:56:28 oleg421-client sshd[39508]: pam_unix(sshd:session): session closed for user root Apr 3 01:56:28 oleg421-client systemd[1]: session-191.scope: Succeeded. Apr 3 01:56:28 oleg421-client systemd-logind[1011]: Session 191 logged out. Waiting for processes to exit. Apr 3 01:56:28 oleg421-client systemd-logind[1011]: Removed session 191. Apr 3 01:56:29 oleg421-client sshd[39640]: Accepted publickey for root from 192.168.204.21 port 53280 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:56:29 oleg421-client systemd-logind[1011]: New session 192 of user root. Apr 3 01:56:29 oleg421-client systemd[1]: Started Session 192 of user root. Apr 3 01:56:29 oleg421-client sshd[39640]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:56:30 oleg421-client sshd[39653]: Received disconnect from 192.168.204.21 port 53280:11: disconnected by user Apr 3 01:56:30 oleg421-client sshd[39653]: Disconnected from user root 192.168.204.21 port 53280 Apr 3 01:56:30 oleg421-client sshd[39640]: pam_unix(sshd:session): session closed for user root Apr 3 01:56:30 oleg421-client systemd[1]: session-192.scope: Succeeded. Apr 3 01:56:30 oleg421-client systemd-logind[1011]: Session 192 logged out. Waiting for processes to exit. Apr 3 01:56:30 oleg421-client systemd-logind[1011]: Removed session 192. Apr 3 01:56:31 oleg421-client sshd[39780]: Accepted publickey for root from 192.168.204.21 port 53284 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:56:31 oleg421-client systemd-logind[1011]: New session 193 of user root. Apr 3 01:56:31 oleg421-client systemd[1]: Started Session 193 of user root. Apr 3 01:56:31 oleg421-client sshd[39780]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:56:32 oleg421-client sshd[39793]: Received disconnect from 192.168.204.21 port 53284:11: disconnected by user Apr 3 01:56:32 oleg421-client sshd[39793]: Disconnected from user root 192.168.204.21 port 53284 Apr 3 01:56:32 oleg421-client sshd[39780]: pam_unix(sshd:session): session closed for user root Apr 3 01:56:32 oleg421-client systemd[1]: session-193.scope: Succeeded. Apr 3 01:56:32 oleg421-client systemd-logind[1011]: Session 193 logged out. Waiting for processes to exit. Apr 3 01:56:32 oleg421-client systemd-logind[1011]: Removed session 193. Apr 3 01:56:33 oleg421-client sshd[39926]: Accepted publickey for root from 192.168.204.21 port 53296 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:56:33 oleg421-client systemd-logind[1011]: New session 194 of user root. Apr 3 01:56:33 oleg421-client systemd[1]: Started Session 194 of user root. Apr 3 01:56:33 oleg421-client sshd[39926]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:56:34 oleg421-client sshd[39939]: Received disconnect from 192.168.204.21 port 53296:11: disconnected by user Apr 3 01:56:34 oleg421-client sshd[39939]: Disconnected from user root 192.168.204.21 port 53296 Apr 3 01:56:34 oleg421-client sshd[39926]: pam_unix(sshd:session): session closed for user root Apr 3 01:56:34 oleg421-client systemd[1]: session-194.scope: Succeeded. Apr 3 01:56:34 oleg421-client systemd-logind[1011]: Session 194 logged out. Waiting for processes to exit. Apr 3 01:56:34 oleg421-client systemd-logind[1011]: Removed session 194. Apr 3 01:56:35 oleg421-client sshd[40081]: Accepted publickey for root from 192.168.204.21 port 53304 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:56:35 oleg421-client systemd[1]: Started Session 195 of user root. Apr 3 01:56:35 oleg421-client systemd-logind[1011]: New session 195 of user root. Apr 3 01:56:35 oleg421-client sshd[40081]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:56:36 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 29a: error adding new clients doesn't cause LBUG (bug 22273) ========================================================== 01:56:34 (1775195794) Apr 3 01:56:36 oleg421-client sshd[40094]: Received disconnect from 192.168.204.21 port 53304:11: disconnected by user Apr 3 01:56:36 oleg421-client sshd[40094]: Disconnected from user root 192.168.204.21 port 53304 Apr 3 01:56:36 oleg421-client sshd[40081]: pam_unix(sshd:session): session closed for user root Apr 3 01:56:36 oleg421-client systemd-logind[1011]: Session 195 logged out. Waiting for processes to exit. Apr 3 01:56:36 oleg421-client systemd[1]: session-195.scope: Succeeded. Apr 3 01:56:36 oleg421-client systemd-logind[1011]: Removed session 195. Apr 3 01:56:53 oleg421-client kernel: LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 192.168.204.121@tcp) was lost; in progress operations using this service will fail Apr 3 01:56:54 oleg421-client kernel: Lustre: Evicted from MGS (at 192.168.204.121@tcp) after server handle changed from 0x1d1756950cedbee9 to 0x1d1756950cedc33b Apr 3 01:56:59 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962443e10000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Apr 3 01:57:07 oleg421-client sshd[40409]: Accepted publickey for root from 192.168.204.21 port 47908 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:57:07 oleg421-client systemd-logind[1011]: New session 196 of user root. Apr 3 01:57:07 oleg421-client systemd[1]: Started Session 196 of user root. Apr 3 01:57:07 oleg421-client sshd[40409]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:57:07 oleg421-client sshd[40422]: Received disconnect from 192.168.204.21 port 47908:11: disconnected by user Apr 3 01:57:07 oleg421-client sshd[40422]: Disconnected from user root 192.168.204.21 port 47908 Apr 3 01:57:07 oleg421-client sshd[40409]: pam_unix(sshd:session): session closed for user root Apr 3 01:57:07 oleg421-client systemd-logind[1011]: Session 196 logged out. Waiting for processes to exit. Apr 3 01:57:07 oleg421-client systemd[1]: session-196.scope: Succeeded. Apr 3 01:57:07 oleg421-client systemd-logind[1011]: Removed session 196. Apr 3 01:57:09 oleg421-client sshd[40462]: Accepted publickey for root from 192.168.204.21 port 37200 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:57:09 oleg421-client systemd-logind[1011]: New session 197 of user root. Apr 3 01:57:09 oleg421-client systemd[1]: Started Session 197 of user root. Apr 3 01:57:09 oleg421-client sshd[40462]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:57:09 oleg421-client sshd[40475]: Received disconnect from 192.168.204.21 port 37200:11: disconnected by user Apr 3 01:57:09 oleg421-client sshd[40475]: Disconnected from user root 192.168.204.21 port 37200 Apr 3 01:57:10 oleg421-client sshd[40462]: pam_unix(sshd:session): session closed for user root Apr 3 01:57:10 oleg421-client systemd[1]: session-197.scope: Succeeded. Apr 3 01:57:10 oleg421-client systemd-logind[1011]: Session 197 logged out. Waiting for processes to exit. Apr 3 01:57:10 oleg421-client systemd-logind[1011]: Removed session 197. Apr 3 01:57:20 oleg421-client sshd[40626]: Accepted publickey for root from 192.168.204.21 port 48970 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:57:20 oleg421-client systemd-logind[1011]: New session 198 of user root. Apr 3 01:57:20 oleg421-client systemd[1]: Started Session 198 of user root. Apr 3 01:57:20 oleg421-client sshd[40626]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:57:20 oleg421-client sshd[40639]: Received disconnect from 192.168.204.21 port 48970:11: disconnected by user Apr 3 01:57:20 oleg421-client sshd[40639]: Disconnected from user root 192.168.204.21 port 48970 Apr 3 01:57:21 oleg421-client sshd[40626]: pam_unix(sshd:session): session closed for user root Apr 3 01:57:21 oleg421-client systemd[1]: session-198.scope: Succeeded. Apr 3 01:57:21 oleg421-client systemd-logind[1011]: Session 198 logged out. Waiting for processes to exit. Apr 3 01:57:21 oleg421-client systemd-logind[1011]: Removed session 198. Apr 3 01:57:26 oleg421-client sshd[40817]: Accepted publickey for root from 192.168.204.21 port 48986 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:57:26 oleg421-client systemd-logind[1011]: New session 199 of user root. Apr 3 01:57:26 oleg421-client systemd[1]: Started Session 199 of user root. Apr 3 01:57:26 oleg421-client sshd[40817]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:57:27 oleg421-client sshd[40830]: Received disconnect from 192.168.204.21 port 48986:11: disconnected by user Apr 3 01:57:27 oleg421-client sshd[40830]: Disconnected from user root 192.168.204.21 port 48986 Apr 3 01:57:27 oleg421-client sshd[40817]: pam_unix(sshd:session): session closed for user root Apr 3 01:57:27 oleg421-client systemd[1]: session-199.scope: Succeeded. Apr 3 01:57:27 oleg421-client systemd-logind[1011]: Session 199 logged out. Waiting for processes to exit. Apr 3 01:57:27 oleg421-client systemd-logind[1011]: Removed session 199. Apr 3 01:57:28 oleg421-client sshd[40956]: Accepted publickey for root from 192.168.204.21 port 57622 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:57:28 oleg421-client systemd-logind[1011]: New session 200 of user root. Apr 3 01:57:28 oleg421-client systemd[1]: Started Session 200 of user root. Apr 3 01:57:28 oleg421-client sshd[40956]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:57:29 oleg421-client sshd[40969]: Received disconnect from 192.168.204.21 port 57622:11: disconnected by user Apr 3 01:57:29 oleg421-client sshd[40969]: Disconnected from user root 192.168.204.21 port 57622 Apr 3 01:57:29 oleg421-client sshd[40956]: pam_unix(sshd:session): session closed for user root Apr 3 01:57:29 oleg421-client systemd[1]: session-200.scope: Succeeded. Apr 3 01:57:29 oleg421-client systemd-logind[1011]: Session 200 logged out. Waiting for processes to exit. Apr 3 01:57:29 oleg421-client systemd-logind[1011]: Removed session 200. Apr 3 01:57:30 oleg421-client sshd[41103]: Accepted publickey for root from 192.168.204.21 port 57626 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:57:30 oleg421-client systemd-logind[1011]: New session 201 of user root. Apr 3 01:57:30 oleg421-client systemd[1]: Started Session 201 of user root. Apr 3 01:57:30 oleg421-client sshd[41103]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:57:30 oleg421-client sshd[41116]: Received disconnect from 192.168.204.21 port 57626:11: disconnected by user Apr 3 01:57:30 oleg421-client sshd[41116]: Disconnected from user root 192.168.204.21 port 57626 Apr 3 01:57:30 oleg421-client sshd[41103]: pam_unix(sshd:session): session closed for user root Apr 3 01:57:30 oleg421-client systemd[1]: session-201.scope: Succeeded. Apr 3 01:57:30 oleg421-client systemd-logind[1011]: Session 201 logged out. Waiting for processes to exit. Apr 3 01:57:30 oleg421-client systemd-logind[1011]: Removed session 201. Apr 3 01:57:31 oleg421-client sshd[41258]: Accepted publickey for root from 192.168.204.21 port 57640 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:57:32 oleg421-client systemd[1]: Started Session 202 of user root. Apr 3 01:57:32 oleg421-client sshd[41258]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:57:32 oleg421-client systemd-logind[1011]: New session 202 of user root. Apr 3 01:57:32 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 29b: error adding new clients doesn't cause LBUG (bug 22273) ========================================================== 01:57:30 (1775195850) Apr 3 01:57:32 oleg421-client sshd[41272]: Received disconnect from 192.168.204.21 port 57640:11: disconnected by user Apr 3 01:57:32 oleg421-client sshd[41272]: Disconnected from user root 192.168.204.21 port 57640 Apr 3 01:57:32 oleg421-client sshd[41258]: pam_unix(sshd:session): session closed for user root Apr 3 01:57:32 oleg421-client systemd-logind[1011]: Session 202 logged out. Waiting for processes to exit. Apr 3 01:57:32 oleg421-client systemd[1]: session-202.scope: Succeeded. Apr 3 01:57:32 oleg421-client systemd-logind[1011]: Removed session 202. Apr 3 01:57:58 oleg421-client sshd[41577]: Accepted publickey for root from 192.168.204.21 port 52156 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:57:58 oleg421-client systemd[1]: Started Session 203 of user root. Apr 3 01:57:58 oleg421-client systemd-logind[1011]: New session 203 of user root. Apr 3 01:57:58 oleg421-client sshd[41577]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:57:58 oleg421-client sshd[41590]: Received disconnect from 192.168.204.21 port 52156:11: disconnected by user Apr 3 01:57:58 oleg421-client sshd[41590]: Disconnected from user root 192.168.204.21 port 52156 Apr 3 01:57:58 oleg421-client sshd[41577]: pam_unix(sshd:session): session closed for user root Apr 3 01:57:58 oleg421-client systemd[1]: session-203.scope: Succeeded. Apr 3 01:57:58 oleg421-client systemd-logind[1011]: Session 203 logged out. Waiting for processes to exit. Apr 3 01:57:58 oleg421-client systemd-logind[1011]: Removed session 203. Apr 3 01:57:59 oleg421-client sshd[41630]: Accepted publickey for root from 192.168.204.21 port 52170 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:58:00 oleg421-client systemd-logind[1011]: New session 204 of user root. Apr 3 01:58:00 oleg421-client systemd[1]: Started Session 204 of user root. Apr 3 01:58:00 oleg421-client sshd[41630]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:58:00 oleg421-client sshd[41643]: Received disconnect from 192.168.204.21 port 52170:11: disconnected by user Apr 3 01:58:00 oleg421-client sshd[41643]: Disconnected from user root 192.168.204.21 port 52170 Apr 3 01:58:00 oleg421-client sshd[41630]: pam_unix(sshd:session): session closed for user root Apr 3 01:58:00 oleg421-client systemd[1]: session-204.scope: Succeeded. Apr 3 01:58:00 oleg421-client systemd-logind[1011]: Session 204 logged out. Waiting for processes to exit. Apr 3 01:58:00 oleg421-client systemd-logind[1011]: Removed session 204. Apr 3 01:58:10 oleg421-client sshd[41794]: Accepted publickey for root from 192.168.204.21 port 60978 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:58:10 oleg421-client systemd-logind[1011]: New session 205 of user root. Apr 3 01:58:10 oleg421-client systemd[1]: Started Session 205 of user root. Apr 3 01:58:10 oleg421-client sshd[41794]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:58:10 oleg421-client sshd[41807]: Received disconnect from 192.168.204.21 port 60978:11: disconnected by user Apr 3 01:58:10 oleg421-client sshd[41807]: Disconnected from user root 192.168.204.21 port 60978 Apr 3 01:58:10 oleg421-client sshd[41794]: pam_unix(sshd:session): session closed for user root Apr 3 01:58:11 oleg421-client systemd[1]: session-205.scope: Succeeded. Apr 3 01:58:11 oleg421-client systemd-logind[1011]: Session 205 logged out. Waiting for processes to exit. Apr 3 01:58:11 oleg421-client systemd-logind[1011]: Removed session 205. Apr 3 01:58:11 oleg421-client sshd[41926]: Accepted publickey for root from 192.168.204.21 port 60992 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:58:11 oleg421-client systemd-logind[1011]: New session 206 of user root. Apr 3 01:58:11 oleg421-client systemd[1]: Started Session 206 of user root. Apr 3 01:58:11 oleg421-client sshd[41926]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:58:12 oleg421-client sshd[41939]: Received disconnect from 192.168.204.21 port 60992:11: disconnected by user Apr 3 01:58:12 oleg421-client sshd[41939]: Disconnected from user root 192.168.204.21 port 60992 Apr 3 01:58:12 oleg421-client sshd[41926]: pam_unix(sshd:session): session closed for user root Apr 3 01:58:12 oleg421-client systemd[1]: session-206.scope: Succeeded. Apr 3 01:58:12 oleg421-client systemd-logind[1011]: Session 206 logged out. Waiting for processes to exit. Apr 3 01:58:12 oleg421-client systemd-logind[1011]: Removed session 206. Apr 3 01:58:13 oleg421-client sshd[42065]: Accepted publickey for root from 192.168.204.21 port 60998 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:58:13 oleg421-client systemd-logind[1011]: New session 207 of user root. Apr 3 01:58:13 oleg421-client systemd[1]: Started Session 207 of user root. Apr 3 01:58:13 oleg421-client sshd[42065]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:58:13 oleg421-client sshd[42078]: Received disconnect from 192.168.204.21 port 60998:11: disconnected by user Apr 3 01:58:13 oleg421-client sshd[42078]: Disconnected from user root 192.168.204.21 port 60998 Apr 3 01:58:13 oleg421-client sshd[42065]: pam_unix(sshd:session): session closed for user root Apr 3 01:58:13 oleg421-client systemd[1]: session-207.scope: Succeeded. Apr 3 01:58:13 oleg421-client systemd-logind[1011]: Session 207 logged out. Waiting for processes to exit. Apr 3 01:58:13 oleg421-client systemd-logind[1011]: Removed session 207. Apr 3 01:58:14 oleg421-client sshd[42211]: Accepted publickey for root from 192.168.204.21 port 32768 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:58:15 oleg421-client systemd-logind[1011]: New session 208 of user root. Apr 3 01:58:15 oleg421-client systemd[1]: Started Session 208 of user root. Apr 3 01:58:15 oleg421-client sshd[42211]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:58:15 oleg421-client sshd[42224]: Received disconnect from 192.168.204.21 port 32768:11: disconnected by user Apr 3 01:58:15 oleg421-client sshd[42224]: Disconnected from user root 192.168.204.21 port 32768 Apr 3 01:58:15 oleg421-client sshd[42211]: pam_unix(sshd:session): session closed for user root Apr 3 01:58:15 oleg421-client systemd[1]: session-208.scope: Succeeded. Apr 3 01:58:15 oleg421-client systemd-logind[1011]: Session 208 logged out. Waiting for processes to exit. Apr 3 01:58:15 oleg421-client systemd-logind[1011]: Removed session 208. Apr 3 01:58:17 oleg421-client sshd[42367]: Accepted publickey for root from 192.168.204.21 port 32770 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:58:17 oleg421-client systemd-logind[1011]: New session 209 of user root. Apr 3 01:58:17 oleg421-client systemd[1]: Started Session 209 of user root. Apr 3 01:58:17 oleg421-client sshd[42367]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:58:17 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 50: failover MDS under load ======= 01:58:16 (1775195896) Apr 3 01:58:17 oleg421-client sshd[42380]: Received disconnect from 192.168.204.21 port 32770:11: disconnected by user Apr 3 01:58:17 oleg421-client sshd[42380]: Disconnected from user root 192.168.204.21 port 32770 Apr 3 01:58:17 oleg421-client sshd[42367]: pam_unix(sshd:session): session closed for user root Apr 3 01:58:18 oleg421-client systemd[1]: session-209.scope: Succeeded. Apr 3 01:58:18 oleg421-client systemd-logind[1011]: Session 209 logged out. Waiting for processes to exit. Apr 3 01:58:18 oleg421-client systemd-logind[1011]: Removed session 209. Apr 3 01:58:53 oleg421-client kernel: Lustre: 2404:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775195916/real 1775195916] req@ffff962446b21c00 x1861425363762688/t0(0) o400->MGC192.168.204.121@tcp@192.168.204.121@tcp:26/25 lens 224/224 e 0 to 1 dl 1775195932 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 Apr 3 01:58:53 oleg421-client kernel: Lustre: 2404:0:(client.c:2479:ptlrpc_expire_one_request()) Skipped 9 previous similar messages Apr 3 01:58:53 oleg421-client kernel: LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 192.168.204.121@tcp) was lost; in progress operations using this service will fail Apr 3 01:59:03 oleg421-client kernel: Lustre: Evicted from MGS (at 192.168.204.121@tcp) after server handle changed from 0x1d1756950cedc33b to 0x1d1756950ceec817 Apr 3 01:59:10 oleg421-client sshd[42703]: Accepted publickey for root from 192.168.204.21 port 36984 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:59:10 oleg421-client systemd-logind[1011]: New session 210 of user root. Apr 3 01:59:10 oleg421-client systemd[1]: Started Session 210 of user root. Apr 3 01:59:10 oleg421-client sshd[42703]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:59:11 oleg421-client sshd[42716]: Received disconnect from 192.168.204.21 port 36984:11: disconnected by user Apr 3 01:59:11 oleg421-client sshd[42716]: Disconnected from user root 192.168.204.21 port 36984 Apr 3 01:59:11 oleg421-client sshd[42703]: pam_unix(sshd:session): session closed for user root Apr 3 01:59:11 oleg421-client systemd-logind[1011]: Session 210 logged out. Waiting for processes to exit. Apr 3 01:59:11 oleg421-client systemd[1]: session-210.scope: Succeeded. Apr 3 01:59:11 oleg421-client systemd-logind[1011]: Removed session 210. Apr 3 01:59:15 oleg421-client sshd[42938]: Accepted publickey for root from 192.168.204.21 port 36992 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:59:15 oleg421-client systemd-logind[1011]: New session 211 of user root. Apr 3 01:59:15 oleg421-client systemd[1]: Started Session 211 of user root. Apr 3 01:59:15 oleg421-client sshd[42938]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:59:15 oleg421-client kernel: Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid Apr 3 01:59:15 oleg421-client sshd[42951]: Received disconnect from 192.168.204.21 port 36992:11: disconnected by user Apr 3 01:59:15 oleg421-client sshd[42951]: Disconnected from user root 192.168.204.21 port 36992 Apr 3 01:59:15 oleg421-client sshd[42938]: pam_unix(sshd:session): session closed for user root Apr 3 01:59:15 oleg421-client systemd[1]: session-211.scope: Succeeded. Apr 3 01:59:15 oleg421-client systemd-logind[1011]: Session 211 logged out. Waiting for processes to exit. Apr 3 01:59:15 oleg421-client systemd-logind[1011]: Removed session 211. Apr 3 01:59:17 oleg421-client sshd[43095]: Accepted publickey for root from 192.168.204.21 port 37008 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:59:17 oleg421-client systemd-logind[1011]: New session 212 of user root. Apr 3 01:59:17 oleg421-client systemd[1]: Started Session 212 of user root. Apr 3 01:59:17 oleg421-client sshd[43095]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:59:17 oleg421-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Apr 3 01:59:17 oleg421-client sshd[43108]: Received disconnect from 192.168.204.21 port 37008:11: disconnected by user Apr 3 01:59:17 oleg421-client sshd[43108]: Disconnected from user root 192.168.204.21 port 37008 Apr 3 01:59:17 oleg421-client sshd[43095]: pam_unix(sshd:session): session closed for user root Apr 3 01:59:17 oleg421-client systemd[1]: session-212.scope: Succeeded. Apr 3 01:59:17 oleg421-client systemd-logind[1011]: Session 212 logged out. Waiting for processes to exit. Apr 3 01:59:17 oleg421-client systemd-logind[1011]: Removed session 212. Apr 3 01:59:19 oleg421-client sshd[43149]: Accepted publickey for root from 192.168.204.21 port 54846 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 01:59:19 oleg421-client systemd-logind[1011]: New session 213 of user root. Apr 3 01:59:19 oleg421-client systemd[1]: Started Session 213 of user root. Apr 3 01:59:19 oleg421-client sshd[43149]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 01:59:19 oleg421-client sshd[43162]: Received disconnect from 192.168.204.21 port 54846:11: disconnected by user Apr 3 01:59:19 oleg421-client sshd[43162]: Disconnected from user root 192.168.204.21 port 54846 Apr 3 01:59:19 oleg421-client sshd[43149]: pam_unix(sshd:session): session closed for user root Apr 3 01:59:20 oleg421-client systemd[1]: session-213.scope: Succeeded. Apr 3 01:59:20 oleg421-client systemd-logind[1011]: Session 213 logged out. Waiting for processes to exit. Apr 3 01:59:20 oleg421-client systemd-logind[1011]: Removed session 213. Apr 3 02:00:42 oleg421-client kernel: LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 192.168.204.121@tcp) was lost; in progress operations using this service will fail Apr 3 02:00:52 oleg421-client kernel: Lustre: Evicted from MGS (at 192.168.204.121@tcp) after server handle changed from 0x1d1756950ceec817 to 0x1d1756950cf12788 Apr 3 02:01:00 oleg421-client sshd[43486]: Accepted publickey for root from 192.168.204.21 port 41908 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:01:00 oleg421-client systemd-logind[1011]: New session 214 of user root. Apr 3 02:01:00 oleg421-client systemd[1]: Started Session 214 of user root. Apr 3 02:01:00 oleg421-client sshd[43486]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:01:01 oleg421-client sshd[43500]: Received disconnect from 192.168.204.21 port 41908:11: disconnected by user Apr 3 02:01:01 oleg421-client sshd[43500]: Disconnected from user root 192.168.204.21 port 41908 Apr 3 02:01:01 oleg421-client sshd[43486]: pam_unix(sshd:session): session closed for user root Apr 3 02:01:01 oleg421-client CROND[43547]: (root) CMD (run-parts /etc/cron.hourly) Apr 3 02:01:01 oleg421-client systemd[1]: session-214.scope: Succeeded. Apr 3 02:01:01 oleg421-client systemd-logind[1011]: Session 214 logged out. Waiting for processes to exit. Apr 3 02:01:01 oleg421-client systemd-logind[1011]: Removed session 214. Apr 3 02:01:01 oleg421-client run-parts[43547]: (/etc/cron.hourly) starting 0anacron Apr 3 02:01:01 oleg421-client anacron[43564]: Anacron started on 2026-04-03 Apr 3 02:01:01 oleg421-client anacron[43564]: Will run job `cron.daily' in 48 min. Apr 3 02:01:02 oleg421-client anacron[43564]: Will run job `cron.weekly' in 68 min. Apr 3 02:01:02 oleg421-client anacron[43564]: Will run job `cron.monthly' in 88 min. Apr 3 02:01:02 oleg421-client anacron[43564]: Jobs will be executed sequentially Apr 3 02:01:02 oleg421-client run-parts[43547]: (/etc/cron.hourly) finished 0anacron Apr 3 02:01:06 oleg421-client sshd[43735]: Accepted publickey for root from 192.168.204.21 port 41914 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:01:06 oleg421-client systemd-logind[1011]: New session 215 of user root. Apr 3 02:01:06 oleg421-client systemd[1]: Started Session 215 of user root. Apr 3 02:01:06 oleg421-client sshd[43735]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:01:06 oleg421-client kernel: Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid Apr 3 02:01:06 oleg421-client sshd[43749]: Received disconnect from 192.168.204.21 port 41914:11: disconnected by user Apr 3 02:01:06 oleg421-client sshd[43749]: Disconnected from user root 192.168.204.21 port 41914 Apr 3 02:01:06 oleg421-client sshd[43735]: pam_unix(sshd:session): session closed for user root Apr 3 02:01:06 oleg421-client systemd[1]: session-215.scope: Succeeded. Apr 3 02:01:06 oleg421-client systemd-logind[1011]: Session 215 logged out. Waiting for processes to exit. Apr 3 02:01:06 oleg421-client systemd-logind[1011]: Removed session 215. Apr 3 02:01:08 oleg421-client sshd[43892]: Accepted publickey for root from 192.168.204.21 port 59762 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:01:08 oleg421-client systemd-logind[1011]: New session 216 of user root. Apr 3 02:01:08 oleg421-client systemd[1]: Started Session 216 of user root. Apr 3 02:01:08 oleg421-client sshd[43892]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:01:09 oleg421-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Apr 3 02:01:09 oleg421-client sshd[43905]: Received disconnect from 192.168.204.21 port 59762:11: disconnected by user Apr 3 02:01:09 oleg421-client sshd[43905]: Disconnected from user root 192.168.204.21 port 59762 Apr 3 02:01:09 oleg421-client sshd[43892]: pam_unix(sshd:session): session closed for user root Apr 3 02:01:09 oleg421-client systemd[1]: session-216.scope: Succeeded. Apr 3 02:01:09 oleg421-client systemd-logind[1011]: Session 216 logged out. Waiting for processes to exit. Apr 3 02:01:09 oleg421-client systemd-logind[1011]: Removed session 216. Apr 3 02:01:11 oleg421-client sshd[43946]: Accepted publickey for root from 192.168.204.21 port 59776 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:01:11 oleg421-client systemd-logind[1011]: New session 217 of user root. Apr 3 02:01:11 oleg421-client systemd[1]: Started Session 217 of user root. Apr 3 02:01:11 oleg421-client sshd[43946]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:01:11 oleg421-client sshd[43959]: Received disconnect from 192.168.204.21 port 59776:11: disconnected by user Apr 3 02:01:11 oleg421-client rsyslogd[1073]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Apr 3 02:01:11 oleg421-client sshd[43959]: Disconnected from user root 192.168.204.21 port 59776 Apr 3 02:01:11 oleg421-client sshd[43946]: pam_unix(sshd:session): session closed for user root Apr 3 02:01:12 oleg421-client systemd[1]: session-217.scope: Succeeded. Apr 3 02:01:12 oleg421-client systemd-logind[1011]: Session 217 logged out. Waiting for processes to exit. Apr 3 02:01:12 oleg421-client systemd-logind[1011]: Removed session 217. Apr 3 02:02:35 oleg421-client kernel: LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 192.168.204.121@tcp) was lost; in progress operations using this service will fail Apr 3 02:02:45 oleg421-client kernel: Lustre: Evicted from MGS (at 192.168.204.121@tcp) after server handle changed from 0x1d1756950cf12788 to 0x1d1756950cf37bdf Apr 3 02:02:57 oleg421-client sshd[44282]: Accepted publickey for root from 192.168.204.21 port 39608 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:02:57 oleg421-client systemd-logind[1011]: New session 218 of user root. Apr 3 02:02:57 oleg421-client systemd[1]: Started Session 218 of user root. Apr 3 02:02:57 oleg421-client sshd[44282]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:02:57 oleg421-client sshd[44295]: Received disconnect from 192.168.204.21 port 39608:11: disconnected by user Apr 3 02:02:57 oleg421-client sshd[44295]: Disconnected from user root 192.168.204.21 port 39608 Apr 3 02:02:57 oleg421-client sshd[44282]: pam_unix(sshd:session): session closed for user root Apr 3 02:02:58 oleg421-client systemd[1]: session-218.scope: Succeeded. Apr 3 02:02:58 oleg421-client systemd-logind[1011]: Session 218 logged out. Waiting for processes to exit. Apr 3 02:02:58 oleg421-client systemd-logind[1011]: Removed session 218. Apr 3 02:03:01 oleg421-client sshd[44519]: Accepted publickey for root from 192.168.204.21 port 40476 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:03:02 oleg421-client systemd-logind[1011]: New session 219 of user root. Apr 3 02:03:02 oleg421-client systemd[1]: Started Session 219 of user root. Apr 3 02:03:02 oleg421-client sshd[44519]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:03:02 oleg421-client kernel: Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid Apr 3 02:03:02 oleg421-client sshd[44532]: Received disconnect from 192.168.204.21 port 40476:11: disconnected by user Apr 3 02:03:02 oleg421-client sshd[44532]: Disconnected from user root 192.168.204.21 port 40476 Apr 3 02:03:02 oleg421-client sshd[44519]: pam_unix(sshd:session): session closed for user root Apr 3 02:03:02 oleg421-client systemd[1]: session-219.scope: Succeeded. Apr 3 02:03:02 oleg421-client systemd-logind[1011]: Session 219 logged out. Waiting for processes to exit. Apr 3 02:03:02 oleg421-client systemd-logind[1011]: Removed session 219. Apr 3 02:03:04 oleg421-client sshd[44675]: Accepted publickey for root from 192.168.204.21 port 40482 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:03:04 oleg421-client systemd[1]: Started Session 220 of user root. Apr 3 02:03:04 oleg421-client systemd-logind[1011]: New session 220 of user root. Apr 3 02:03:04 oleg421-client sshd[44675]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:03:04 oleg421-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Apr 3 02:03:04 oleg421-client sshd[44688]: Received disconnect from 192.168.204.21 port 40482:11: disconnected by user Apr 3 02:03:04 oleg421-client sshd[44688]: Disconnected from user root 192.168.204.21 port 40482 Apr 3 02:03:05 oleg421-client sshd[44675]: pam_unix(sshd:session): session closed for user root Apr 3 02:03:05 oleg421-client systemd[1]: session-220.scope: Succeeded. Apr 3 02:03:05 oleg421-client systemd-logind[1011]: Session 220 logged out. Waiting for processes to exit. Apr 3 02:03:05 oleg421-client systemd-logind[1011]: Removed session 220. Apr 3 02:03:06 oleg421-client sshd[44731]: Accepted publickey for root from 192.168.204.21 port 40488 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:03:06 oleg421-client systemd[1]: Started Session 221 of user root. Apr 3 02:03:06 oleg421-client systemd-logind[1011]: New session 221 of user root. Apr 3 02:03:06 oleg421-client sshd[44731]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:03:07 oleg421-client sshd[44744]: Received disconnect from 192.168.204.21 port 40488:11: disconnected by user Apr 3 02:03:07 oleg421-client sshd[44744]: Disconnected from user root 192.168.204.21 port 40488 Apr 3 02:03:07 oleg421-client sshd[44731]: pam_unix(sshd:session): session closed for user root Apr 3 02:03:07 oleg421-client systemd-logind[1011]: Session 221 logged out. Waiting for processes to exit. Apr 3 02:03:07 oleg421-client systemd[1]: session-221.scope: Succeeded. Apr 3 02:03:07 oleg421-client systemd-logind[1011]: Removed session 221. Apr 3 02:03:28 oleg421-client sshd[44867]: Accepted publickey for root from 192.168.204.21 port 38866 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:03:28 oleg421-client systemd-logind[1011]: New session 222 of user root. Apr 3 02:03:28 oleg421-client systemd[1]: Started Session 222 of user root. Apr 3 02:03:28 oleg421-client sshd[44867]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:03:29 oleg421-client sshd[44880]: Received disconnect from 192.168.204.21 port 38866:11: disconnected by user Apr 3 02:03:29 oleg421-client sshd[44880]: Disconnected from user root 192.168.204.21 port 38866 Apr 3 02:03:29 oleg421-client sshd[44867]: pam_unix(sshd:session): session closed for user root Apr 3 02:03:29 oleg421-client systemd[1]: session-222.scope: Succeeded. Apr 3 02:03:29 oleg421-client systemd-logind[1011]: Session 222 logged out. Waiting for processes to exit. Apr 3 02:03:29 oleg421-client systemd-logind[1011]: Removed session 222. Apr 3 02:03:31 oleg421-client sshd[45006]: Accepted publickey for root from 192.168.204.21 port 38880 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:03:31 oleg421-client systemd-logind[1011]: New session 223 of user root. Apr 3 02:03:31 oleg421-client systemd[1]: Started Session 223 of user root. Apr 3 02:03:31 oleg421-client sshd[45006]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:03:32 oleg421-client sshd[45019]: Received disconnect from 192.168.204.21 port 38880:11: disconnected by user Apr 3 02:03:32 oleg421-client sshd[45019]: Disconnected from user root 192.168.204.21 port 38880 Apr 3 02:03:32 oleg421-client sshd[45006]: pam_unix(sshd:session): session closed for user root Apr 3 02:03:32 oleg421-client systemd[1]: session-223.scope: Succeeded. Apr 3 02:03:32 oleg421-client systemd-logind[1011]: Session 223 logged out. Waiting for processes to exit. Apr 3 02:03:32 oleg421-client systemd-logind[1011]: Removed session 223. Apr 3 02:03:33 oleg421-client sshd[45153]: Accepted publickey for root from 192.168.204.21 port 38896 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:03:33 oleg421-client systemd-logind[1011]: New session 224 of user root. Apr 3 02:03:33 oleg421-client systemd[1]: Started Session 224 of user root. Apr 3 02:03:33 oleg421-client sshd[45153]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:03:33 oleg421-client sshd[45166]: Received disconnect from 192.168.204.21 port 38896:11: disconnected by user Apr 3 02:03:33 oleg421-client sshd[45166]: Disconnected from user root 192.168.204.21 port 38896 Apr 3 02:03:33 oleg421-client sshd[45153]: pam_unix(sshd:session): session closed for user root Apr 3 02:03:33 oleg421-client systemd-logind[1011]: Session 224 logged out. Waiting for processes to exit. Apr 3 02:03:33 oleg421-client systemd[1]: session-224.scope: Succeeded. Apr 3 02:03:33 oleg421-client systemd-logind[1011]: Removed session 224. Apr 3 02:03:35 oleg421-client sshd[45308]: Accepted publickey for root from 192.168.204.21 port 38902 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:03:35 oleg421-client systemd-logind[1011]: New session 225 of user root. Apr 3 02:03:35 oleg421-client systemd[1]: Started Session 225 of user root. Apr 3 02:03:35 oleg421-client sshd[45308]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:03:35 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 51: failover MDS during recovery == 02:03:34 (1775196214) Apr 3 02:03:35 oleg421-client sshd[45321]: Received disconnect from 192.168.204.21 port 38902:11: disconnected by user Apr 3 02:03:35 oleg421-client sshd[45321]: Disconnected from user root 192.168.204.21 port 38902 Apr 3 02:03:35 oleg421-client sshd[45308]: pam_unix(sshd:session): session closed for user root Apr 3 02:03:36 oleg421-client systemd[1]: session-225.scope: Succeeded. Apr 3 02:03:36 oleg421-client systemd-logind[1011]: Session 225 logged out. Waiting for processes to exit. Apr 3 02:03:36 oleg421-client systemd-logind[1011]: Removed session 225. Apr 3 02:03:40 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962443e10000: operation mds_reint to node 192.168.204.121@tcp failed: rc = -19 Apr 3 02:03:40 oleg421-client kernel: LustreError: Skipped 1 previous similar message Apr 3 02:03:59 oleg421-client kernel: LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 192.168.204.121@tcp) was lost; in progress operations using this service will fail Apr 3 02:04:09 oleg421-client kernel: Lustre: Evicted from MGS (at 192.168.204.121@tcp) after server handle changed from 0x1d1756950cf37bdf to 0x1d1756950cf46fe3 Apr 3 02:04:19 oleg421-client sshd[45737]: Accepted publickey for root from 192.168.204.21 port 46046 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:04:19 oleg421-client systemd[1]: Started Session 226 of user root. Apr 3 02:04:19 oleg421-client systemd-logind[1011]: New session 226 of user root. Apr 3 02:04:19 oleg421-client sshd[45737]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:04:19 oleg421-client kernel: Lustre: DEBUG MARKER: test_51: failover in 1 sec Apr 3 02:04:19 oleg421-client sshd[45750]: Received disconnect from 192.168.204.21 port 46046:11: disconnected by user Apr 3 02:04:19 oleg421-client sshd[45750]: Disconnected from user root 192.168.204.21 port 46046 Apr 3 02:04:19 oleg421-client sshd[45737]: pam_unix(sshd:session): session closed for user root Apr 3 02:04:19 oleg421-client systemd[1]: session-226.scope: Succeeded. Apr 3 02:04:19 oleg421-client systemd-logind[1011]: Session 226 logged out. Waiting for processes to exit. Apr 3 02:04:19 oleg421-client systemd-logind[1011]: Removed session 226. Apr 3 02:05:00 oleg421-client sshd[46150]: Accepted publickey for root from 192.168.204.21 port 53432 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:05:00 oleg421-client systemd-logind[1011]: New session 227 of user root. Apr 3 02:05:00 oleg421-client systemd[1]: Started Session 227 of user root. Apr 3 02:05:00 oleg421-client sshd[46150]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:05:00 oleg421-client kernel: Lustre: DEBUG MARKER: test_51: failover in 5 sec Apr 3 02:05:00 oleg421-client sshd[46163]: Received disconnect from 192.168.204.21 port 53432:11: disconnected by user Apr 3 02:05:00 oleg421-client sshd[46163]: Disconnected from user root 192.168.204.21 port 53432 Apr 3 02:05:00 oleg421-client sshd[46150]: pam_unix(sshd:session): session closed for user root Apr 3 02:05:01 oleg421-client systemd[1]: session-227.scope: Succeeded. Apr 3 02:05:01 oleg421-client systemd-logind[1011]: Session 227 logged out. Waiting for processes to exit. Apr 3 02:05:01 oleg421-client systemd-logind[1011]: Removed session 227. Apr 3 02:05:47 oleg421-client sshd[46564]: Accepted publickey for root from 192.168.204.21 port 51662 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:05:47 oleg421-client systemd[1]: Started Session 228 of user root. Apr 3 02:05:47 oleg421-client systemd-logind[1011]: New session 228 of user root. Apr 3 02:05:47 oleg421-client sshd[46564]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:05:47 oleg421-client kernel: Lustre: DEBUG MARKER: test_51: failover in 10 sec Apr 3 02:05:47 oleg421-client sshd[46577]: Received disconnect from 192.168.204.21 port 51662:11: disconnected by user Apr 3 02:05:47 oleg421-client sshd[46577]: Disconnected from user root 192.168.204.21 port 51662 Apr 3 02:05:47 oleg421-client sshd[46564]: pam_unix(sshd:session): session closed for user root Apr 3 02:05:47 oleg421-client systemd-logind[1011]: Session 228 logged out. Waiting for processes to exit. Apr 3 02:05:48 oleg421-client systemd[1]: session-228.scope: Succeeded. Apr 3 02:05:48 oleg421-client systemd-logind[1011]: Removed session 228. Apr 3 02:06:02 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962443e10000: Connection to lustre-MDT0000 (at 192.168.204.121@tcp) was lost; in progress operations using this service will wait for recovery to complete Apr 3 02:06:02 oleg421-client kernel: Lustre: Skipped 7 previous similar messages Apr 3 02:06:20 oleg421-client kernel: LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 192.168.204.121@tcp) was lost; in progress operations using this service will fail Apr 3 02:06:20 oleg421-client kernel: LustreError: Skipped 2 previous similar messages Apr 3 02:06:30 oleg421-client kernel: Lustre: Evicted from MGS (at 192.168.204.121@tcp) after server handle changed from 0x1d1756950cf4efc6 to 0x1d1756950cf55d42 Apr 3 02:06:30 oleg421-client kernel: Lustre: Skipped 2 previous similar messages Apr 3 02:06:30 oleg421-client kernel: Lustre: MGC192.168.204.121@tcp: Connection restored to 192.168.204.121@tcp (at 192.168.204.121@tcp) Apr 3 02:06:30 oleg421-client kernel: Lustre: Skipped 15 previous similar messages Apr 3 02:06:40 oleg421-client sshd[46976]: Accepted publickey for root from 192.168.204.21 port 51316 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:06:40 oleg421-client systemd-logind[1011]: New session 229 of user root. Apr 3 02:06:40 oleg421-client systemd[1]: Started Session 229 of user root. Apr 3 02:06:40 oleg421-client sshd[46976]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:06:40 oleg421-client kernel: Lustre: DEBUG MARKER: test_51: failover in 20 sec Apr 3 02:06:40 oleg421-client sshd[46989]: Received disconnect from 192.168.204.21 port 51316:11: disconnected by user Apr 3 02:06:40 oleg421-client sshd[46989]: Disconnected from user root 192.168.204.21 port 51316 Apr 3 02:06:40 oleg421-client sshd[46976]: pam_unix(sshd:session): session closed for user root Apr 3 02:06:41 oleg421-client systemd-logind[1011]: Session 229 logged out. Waiting for processes to exit. Apr 3 02:06:41 oleg421-client systemd[1]: session-229.scope: Succeeded. Apr 3 02:06:41 oleg421-client systemd-logind[1011]: Removed session 229. Apr 3 02:07:44 oleg421-client sshd[47393]: Accepted publickey for root from 192.168.204.21 port 36074 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:07:44 oleg421-client systemd-logind[1011]: New session 230 of user root. Apr 3 02:07:44 oleg421-client systemd[1]: Started Session 230 of user root. Apr 3 02:07:44 oleg421-client sshd[47393]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:07:45 oleg421-client kernel: Lustre: DEBUG MARKER: test_51: failover in 25 sec Apr 3 02:07:45 oleg421-client sshd[47406]: Received disconnect from 192.168.204.21 port 36074:11: disconnected by user Apr 3 02:07:45 oleg421-client sshd[47406]: Disconnected from user root 192.168.204.21 port 36074 Apr 3 02:07:45 oleg421-client sshd[47393]: pam_unix(sshd:session): session closed for user root Apr 3 02:07:45 oleg421-client systemd[1]: session-230.scope: Succeeded. Apr 3 02:07:45 oleg421-client systemd-logind[1011]: Session 230 logged out. Waiting for processes to exit. Apr 3 02:07:45 oleg421-client systemd-logind[1011]: Removed session 230. Apr 3 02:08:14 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962443e10000: operation ldlm_enqueue to node 192.168.204.121@tcp failed: rc = -19 Apr 3 02:08:14 oleg421-client kernel: LustreError: Skipped 5 previous similar messages Apr 3 02:08:44 oleg421-client kernel: Lustre: 16794:0:(mgc_request.c:1917:mgc_process_log()) MGC192.168.204.121@tcp: IR log lustre-cliir failed, not fatal: rc = -2 Apr 3 02:09:02 oleg421-client sshd[47810]: Accepted publickey for root from 192.168.204.21 port 56930 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:09:02 oleg421-client systemd[1]: Started Session 231 of user root. Apr 3 02:09:02 oleg421-client systemd-logind[1011]: New session 231 of user root. Apr 3 02:09:02 oleg421-client sshd[47810]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:09:02 oleg421-client kernel: Lustre: DEBUG MARKER: test_51: failover in 30 sec Apr 3 02:09:02 oleg421-client sshd[47823]: Received disconnect from 192.168.204.21 port 56930:11: disconnected by user Apr 3 02:09:02 oleg421-client sshd[47823]: Disconnected from user root 192.168.204.21 port 56930 Apr 3 02:09:02 oleg421-client sshd[47810]: pam_unix(sshd:session): session closed for user root Apr 3 02:09:03 oleg421-client systemd[1]: session-231.scope: Succeeded. Apr 3 02:09:03 oleg421-client systemd-logind[1011]: Session 231 logged out. Waiting for processes to exit. Apr 3 02:09:03 oleg421-client systemd-logind[1011]: Removed session 231. Apr 3 02:09:57 oleg421-client kernel: Lustre: 2403:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775196581/real 1775196581] req@ffff962446af2680 x1861425371488512/t0(0) o400->MGC192.168.204.121@tcp@192.168.204.121@tcp:26/25 lens 224/224 e 0 to 1 dl 1775196597 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 Apr 3 02:09:57 oleg421-client kernel: Lustre: 2403:0:(client.c:2479:ptlrpc_expire_one_request()) Skipped 8 previous similar messages Apr 3 02:10:35 oleg421-client sshd[48227]: Accepted publickey for root from 192.168.204.21 port 35338 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:10:35 oleg421-client systemd[1]: Started Session 232 of user root. Apr 3 02:10:35 oleg421-client systemd-logind[1011]: New session 232 of user root. Apr 3 02:10:35 oleg421-client sshd[48227]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:10:36 oleg421-client sshd[48240]: Received disconnect from 192.168.204.21 port 35338:11: disconnected by user Apr 3 02:10:36 oleg421-client sshd[48240]: Disconnected from user root 192.168.204.21 port 35338 Apr 3 02:10:36 oleg421-client sshd[48227]: pam_unix(sshd:session): session closed for user root Apr 3 02:10:36 oleg421-client systemd-logind[1011]: Session 232 logged out. Waiting for processes to exit. Apr 3 02:10:36 oleg421-client systemd[1]: session-232.scope: Succeeded. Apr 3 02:10:36 oleg421-client systemd-logind[1011]: Removed session 232. Apr 3 02:10:38 oleg421-client sshd[48366]: Accepted publickey for root from 192.168.204.21 port 51378 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:10:38 oleg421-client systemd-logind[1011]: New session 233 of user root. Apr 3 02:10:38 oleg421-client systemd[1]: Started Session 233 of user root. Apr 3 02:10:38 oleg421-client sshd[48366]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:10:38 oleg421-client sshd[48379]: Received disconnect from 192.168.204.21 port 51378:11: disconnected by user Apr 3 02:10:38 oleg421-client sshd[48379]: Disconnected from user root 192.168.204.21 port 51378 Apr 3 02:10:38 oleg421-client sshd[48366]: pam_unix(sshd:session): session closed for user root Apr 3 02:10:38 oleg421-client systemd-logind[1011]: Session 233 logged out. Waiting for processes to exit. Apr 3 02:10:38 oleg421-client systemd[1]: session-233.scope: Succeeded. Apr 3 02:10:38 oleg421-client systemd-logind[1011]: Removed session 233. Apr 3 02:10:40 oleg421-client sshd[48513]: Accepted publickey for root from 192.168.204.21 port 51388 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:10:40 oleg421-client systemd-logind[1011]: New session 234 of user root. Apr 3 02:10:40 oleg421-client systemd[1]: Started Session 234 of user root. Apr 3 02:10:40 oleg421-client sshd[48513]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:10:41 oleg421-client sshd[48526]: Received disconnect from 192.168.204.21 port 51388:11: disconnected by user Apr 3 02:10:41 oleg421-client sshd[48526]: Disconnected from user root 192.168.204.21 port 51388 Apr 3 02:10:41 oleg421-client sshd[48513]: pam_unix(sshd:session): session closed for user root Apr 3 02:10:41 oleg421-client systemd[1]: session-234.scope: Succeeded. Apr 3 02:10:41 oleg421-client systemd-logind[1011]: Session 234 logged out. Waiting for processes to exit. Apr 3 02:10:41 oleg421-client systemd-logind[1011]: Removed session 234. Apr 3 02:10:42 oleg421-client sshd[48669]: Accepted publickey for root from 192.168.204.21 port 51400 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:10:43 oleg421-client systemd-logind[1011]: New session 235 of user root. Apr 3 02:10:43 oleg421-client systemd[1]: Started Session 235 of user root. Apr 3 02:10:43 oleg421-client sshd[48669]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:10:43 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 52: failover OST under load ======= 02:10:41 (1775196641) Apr 3 02:10:43 oleg421-client sshd[48682]: Received disconnect from 192.168.204.21 port 51400:11: disconnected by user Apr 3 02:10:43 oleg421-client sshd[48682]: Disconnected from user root 192.168.204.21 port 51400 Apr 3 02:10:43 oleg421-client sshd[48669]: pam_unix(sshd:session): session closed for user root Apr 3 02:10:43 oleg421-client systemd[1]: session-235.scope: Succeeded. Apr 3 02:10:43 oleg421-client systemd-logind[1011]: Session 235 logged out. Waiting for processes to exit. Apr 3 02:10:43 oleg421-client systemd-logind[1011]: Removed session 235. Apr 3 02:11:31 oleg421-client sshd[49042]: Accepted publickey for root from 192.168.204.21 port 58564 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:11:31 oleg421-client systemd[1]: Started Session 236 of user root. Apr 3 02:11:31 oleg421-client systemd-logind[1011]: New session 236 of user root. Apr 3 02:11:31 oleg421-client sshd[49042]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:11:31 oleg421-client sshd[49055]: Received disconnect from 192.168.204.21 port 58564:11: disconnected by user Apr 3 02:11:31 oleg421-client sshd[49055]: Disconnected from user root 192.168.204.21 port 58564 Apr 3 02:11:31 oleg421-client sshd[49042]: pam_unix(sshd:session): session closed for user root Apr 3 02:11:31 oleg421-client systemd[1]: session-236.scope: Succeeded. Apr 3 02:11:31 oleg421-client systemd-logind[1011]: Session 236 logged out. Waiting for processes to exit. Apr 3 02:11:31 oleg421-client systemd-logind[1011]: Removed session 236. Apr 3 02:11:36 oleg421-client sshd[49279]: Accepted publickey for root from 192.168.204.21 port 58576 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:11:36 oleg421-client systemd-logind[1011]: New session 237 of user root. Apr 3 02:11:36 oleg421-client systemd[1]: Started Session 237 of user root. Apr 3 02:11:36 oleg421-client sshd[49279]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:11:37 oleg421-client kernel: Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid Apr 3 02:11:37 oleg421-client sshd[49292]: Received disconnect from 192.168.204.21 port 58576:11: disconnected by user Apr 3 02:11:37 oleg421-client sshd[49292]: Disconnected from user root 192.168.204.21 port 58576 Apr 3 02:11:37 oleg421-client sshd[49279]: pam_unix(sshd:session): session closed for user root Apr 3 02:11:37 oleg421-client systemd[1]: session-237.scope: Succeeded. Apr 3 02:11:37 oleg421-client systemd-logind[1011]: Session 237 logged out. Waiting for processes to exit. Apr 3 02:11:37 oleg421-client systemd-logind[1011]: Removed session 237. Apr 3 02:11:39 oleg421-client sshd[49436]: Accepted publickey for root from 192.168.204.21 port 35586 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:11:39 oleg421-client systemd-logind[1011]: New session 238 of user root. Apr 3 02:11:39 oleg421-client systemd[1]: Started Session 238 of user root. Apr 3 02:11:39 oleg421-client sshd[49436]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:11:39 oleg421-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec Apr 3 02:11:39 oleg421-client sshd[49449]: Received disconnect from 192.168.204.21 port 35586:11: disconnected by user Apr 3 02:11:39 oleg421-client sshd[49449]: Disconnected from user root 192.168.204.21 port 35586 Apr 3 02:11:40 oleg421-client sshd[49436]: pam_unix(sshd:session): session closed for user root Apr 3 02:11:40 oleg421-client systemd[1]: session-238.scope: Succeeded. Apr 3 02:11:40 oleg421-client systemd-logind[1011]: Session 238 logged out. Waiting for processes to exit. Apr 3 02:11:40 oleg421-client systemd-logind[1011]: Removed session 238. Apr 3 02:11:41 oleg421-client sshd[49490]: Accepted publickey for root from 192.168.204.21 port 35594 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:11:41 oleg421-client systemd-logind[1011]: New session 239 of user root. Apr 3 02:11:41 oleg421-client systemd[1]: Started Session 239 of user root. Apr 3 02:11:41 oleg421-client sshd[49490]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:11:42 oleg421-client sshd[49503]: Received disconnect from 192.168.204.21 port 35594:11: disconnected by user Apr 3 02:11:42 oleg421-client sshd[49503]: Disconnected from user root 192.168.204.21 port 35594 Apr 3 02:11:42 oleg421-client sshd[49490]: pam_unix(sshd:session): session closed for user root Apr 3 02:11:42 oleg421-client systemd[1]: session-239.scope: Succeeded. Apr 3 02:11:42 oleg421-client systemd-logind[1011]: Session 239 logged out. Waiting for processes to exit. Apr 3 02:11:42 oleg421-client systemd-logind[1011]: Removed session 239. Apr 3 02:16:29 oleg421-client kernel: Lustre: lustre-OST0000-osc-ffff962443e10000: Connection to lustre-OST0000 (at 192.168.204.121@tcp) was lost; in progress operations using this service will wait for recovery to complete Apr 3 02:16:29 oleg421-client kernel: Lustre: Skipped 4 previous similar messages Apr 3 02:16:54 oleg421-client kernel: Lustre: lustre-OST0000-osc-ffff962443e10000: Connection restored to 192.168.204.121@tcp (at 192.168.204.121@tcp) Apr 3 02:16:54 oleg421-client kernel: Lustre: Skipped 7 previous similar messages Apr 3 02:17:06 oleg421-client sshd[49873]: Accepted publickey for root from 192.168.204.21 port 45050 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:17:07 oleg421-client systemd[1]: Started Session 240 of user root. Apr 3 02:17:07 oleg421-client systemd-logind[1011]: New session 240 of user root. Apr 3 02:17:07 oleg421-client sshd[49873]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:17:07 oleg421-client sshd[49886]: Received disconnect from 192.168.204.21 port 45050:11: disconnected by user Apr 3 02:17:07 oleg421-client sshd[49886]: Disconnected from user root 192.168.204.21 port 45050 Apr 3 02:17:07 oleg421-client sshd[49873]: pam_unix(sshd:session): session closed for user root Apr 3 02:17:08 oleg421-client systemd[1]: session-240.scope: Succeeded. Apr 3 02:17:08 oleg421-client systemd-logind[1011]: Session 240 logged out. Waiting for processes to exit. Apr 3 02:17:08 oleg421-client systemd-logind[1011]: Removed session 240. Apr 3 02:17:13 oleg421-client sshd[50110]: Accepted publickey for root from 192.168.204.21 port 37790 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:17:13 oleg421-client systemd[1]: Started Session 241 of user root. Apr 3 02:17:13 oleg421-client systemd-logind[1011]: New session 241 of user root. Apr 3 02:17:13 oleg421-client sshd[50110]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:17:14 oleg421-client kernel: Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid Apr 3 02:17:14 oleg421-client sshd[50123]: Received disconnect from 192.168.204.21 port 37790:11: disconnected by user Apr 3 02:17:14 oleg421-client sshd[50123]: Disconnected from user root 192.168.204.21 port 37790 Apr 3 02:17:14 oleg421-client sshd[50110]: pam_unix(sshd:session): session closed for user root Apr 3 02:17:14 oleg421-client systemd[1]: session-241.scope: Succeeded. Apr 3 02:17:14 oleg421-client systemd-logind[1011]: Session 241 logged out. Waiting for processes to exit. Apr 3 02:17:14 oleg421-client systemd-logind[1011]: Removed session 241. Apr 3 02:17:17 oleg421-client sshd[50269]: Accepted publickey for root from 192.168.204.21 port 37792 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:17:17 oleg421-client systemd-logind[1011]: New session 242 of user root. Apr 3 02:17:17 oleg421-client systemd[1]: Started Session 242 of user root. Apr 3 02:17:17 oleg421-client sshd[50269]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:17:17 oleg421-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec Apr 3 02:17:17 oleg421-client sshd[50282]: Received disconnect from 192.168.204.21 port 37792:11: disconnected by user Apr 3 02:17:17 oleg421-client sshd[50282]: Disconnected from user root 192.168.204.21 port 37792 Apr 3 02:17:17 oleg421-client sshd[50269]: pam_unix(sshd:session): session closed for user root Apr 3 02:17:18 oleg421-client systemd[1]: session-242.scope: Succeeded. Apr 3 02:17:18 oleg421-client systemd-logind[1011]: Session 242 logged out. Waiting for processes to exit. Apr 3 02:17:18 oleg421-client systemd-logind[1011]: Removed session 242. Apr 3 02:17:19 oleg421-client sshd[50323]: Accepted publickey for root from 192.168.204.21 port 42228 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:17:19 oleg421-client systemd-logind[1011]: New session 243 of user root. Apr 3 02:17:19 oleg421-client systemd[1]: Started Session 243 of user root. Apr 3 02:17:19 oleg421-client sshd[50323]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:17:19 oleg421-client sshd[50336]: Received disconnect from 192.168.204.21 port 42228:11: disconnected by user Apr 3 02:17:19 oleg421-client sshd[50336]: Disconnected from user root 192.168.204.21 port 42228 Apr 3 02:17:19 oleg421-client sshd[50323]: pam_unix(sshd:session): session closed for user root Apr 3 02:17:20 oleg421-client systemd[1]: session-243.scope: Succeeded. Apr 3 02:17:20 oleg421-client systemd-logind[1011]: Session 243 logged out. Waiting for processes to exit. Apr 3 02:17:20 oleg421-client systemd-logind[1011]: Removed session 243. Apr 3 02:22:02 oleg421-client kernel: LustreError: lustre-OST0000-osc-ffff962443e10000: operation ldlm_enqueue to node 192.168.204.121@tcp failed: rc = -107 Apr 3 02:22:02 oleg421-client kernel: LustreError: Skipped 4 previous similar messages Apr 3 02:22:39 oleg421-client sshd[50704]: Accepted publickey for root from 192.168.204.21 port 34432 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:22:40 oleg421-client systemd[1]: Started Session 244 of user root. Apr 3 02:22:40 oleg421-client systemd-logind[1011]: New session 244 of user root. Apr 3 02:22:40 oleg421-client sshd[50704]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:22:40 oleg421-client sshd[50717]: Received disconnect from 192.168.204.21 port 34432:11: disconnected by user Apr 3 02:22:40 oleg421-client sshd[50717]: Disconnected from user root 192.168.204.21 port 34432 Apr 3 02:22:40 oleg421-client sshd[50704]: pam_unix(sshd:session): session closed for user root Apr 3 02:22:40 oleg421-client systemd[1]: session-244.scope: Succeeded. Apr 3 02:22:40 oleg421-client systemd-logind[1011]: Session 244 logged out. Waiting for processes to exit. Apr 3 02:22:40 oleg421-client systemd-logind[1011]: Removed session 244. Apr 3 02:22:46 oleg421-client sshd[50942]: Accepted publickey for root from 192.168.204.21 port 34434 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:22:46 oleg421-client systemd-logind[1011]: New session 245 of user root. Apr 3 02:22:46 oleg421-client systemd[1]: Started Session 245 of user root. Apr 3 02:22:46 oleg421-client sshd[50942]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:22:46 oleg421-client kernel: Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid Apr 3 02:22:46 oleg421-client sshd[50955]: Received disconnect from 192.168.204.21 port 34434:11: disconnected by user Apr 3 02:22:46 oleg421-client sshd[50955]: Disconnected from user root 192.168.204.21 port 34434 Apr 3 02:22:46 oleg421-client sshd[50942]: pam_unix(sshd:session): session closed for user root Apr 3 02:22:47 oleg421-client systemd[1]: session-245.scope: Succeeded. Apr 3 02:22:47 oleg421-client systemd-logind[1011]: Session 245 logged out. Waiting for processes to exit. Apr 3 02:22:47 oleg421-client systemd-logind[1011]: Removed session 245. Apr 3 02:22:49 oleg421-client sshd[51100]: Accepted publickey for root from 192.168.204.21 port 36102 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:22:49 oleg421-client systemd[1]: Started Session 246 of user root. Apr 3 02:22:49 oleg421-client systemd-logind[1011]: New session 246 of user root. Apr 3 02:22:49 oleg421-client sshd[51100]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:22:50 oleg421-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec Apr 3 02:22:50 oleg421-client sshd[51113]: Received disconnect from 192.168.204.21 port 36102:11: disconnected by user Apr 3 02:22:50 oleg421-client sshd[51113]: Disconnected from user root 192.168.204.21 port 36102 Apr 3 02:22:50 oleg421-client sshd[51100]: pam_unix(sshd:session): session closed for user root Apr 3 02:22:50 oleg421-client systemd[1]: session-246.scope: Succeeded. Apr 3 02:22:50 oleg421-client systemd-logind[1011]: Session 246 logged out. Waiting for processes to exit. Apr 3 02:22:50 oleg421-client systemd-logind[1011]: Removed session 246. Apr 3 02:22:52 oleg421-client sshd[51154]: Accepted publickey for root from 192.168.204.21 port 36118 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:22:52 oleg421-client systemd[1]: Started Session 247 of user root. Apr 3 02:22:52 oleg421-client systemd-logind[1011]: New session 247 of user root. Apr 3 02:22:52 oleg421-client sshd[51154]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:22:53 oleg421-client sshd[51167]: Received disconnect from 192.168.204.21 port 36118:11: disconnected by user Apr 3 02:22:53 oleg421-client sshd[51167]: Disconnected from user root 192.168.204.21 port 36118 Apr 3 02:22:53 oleg421-client sshd[51154]: pam_unix(sshd:session): session closed for user root Apr 3 02:22:53 oleg421-client systemd[1]: session-247.scope: Succeeded. Apr 3 02:22:53 oleg421-client systemd-logind[1011]: Session 247 logged out. Waiting for processes to exit. Apr 3 02:22:53 oleg421-client systemd-logind[1011]: Removed session 247. Apr 3 02:26:52 oleg421-client sshd[51331]: Accepted publickey for root from 192.168.204.21 port 40924 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:26:52 oleg421-client systemd[1]: Started Session 248 of user root. Apr 3 02:26:52 oleg421-client systemd-logind[1011]: New session 248 of user root. Apr 3 02:26:52 oleg421-client sshd[51331]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:26:53 oleg421-client sshd[51344]: Received disconnect from 192.168.204.21 port 40924:11: disconnected by user Apr 3 02:26:53 oleg421-client sshd[51344]: Disconnected from user root 192.168.204.21 port 40924 Apr 3 02:26:53 oleg421-client sshd[51331]: pam_unix(sshd:session): session closed for user root Apr 3 02:26:53 oleg421-client systemd-logind[1011]: Session 248 logged out. Waiting for processes to exit. Apr 3 02:26:53 oleg421-client systemd[1]: session-248.scope: Succeeded. Apr 3 02:26:53 oleg421-client systemd-logind[1011]: Removed session 248. Apr 3 02:26:56 oleg421-client sshd[51472]: Accepted publickey for root from 192.168.204.21 port 40932 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:26:56 oleg421-client systemd[1]: Started Session 249 of user root. Apr 3 02:26:56 oleg421-client systemd-logind[1011]: New session 249 of user root. Apr 3 02:26:56 oleg421-client sshd[51472]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:26:56 oleg421-client sshd[51485]: Received disconnect from 192.168.204.21 port 40932:11: disconnected by user Apr 3 02:26:56 oleg421-client sshd[51485]: Disconnected from user root 192.168.204.21 port 40932 Apr 3 02:26:56 oleg421-client sshd[51472]: pam_unix(sshd:session): session closed for user root Apr 3 02:26:56 oleg421-client systemd-logind[1011]: Session 249 logged out. Waiting for processes to exit. Apr 3 02:26:56 oleg421-client systemd[1]: session-249.scope: Succeeded. Apr 3 02:26:56 oleg421-client systemd-logind[1011]: Removed session 249. Apr 3 02:26:58 oleg421-client sshd[51618]: Accepted publickey for root from 192.168.204.21 port 48792 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:26:58 oleg421-client systemd[1]: Started Session 250 of user root. Apr 3 02:26:58 oleg421-client systemd-logind[1011]: New session 250 of user root. Apr 3 02:26:58 oleg421-client sshd[51618]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:26:58 oleg421-client sshd[51631]: Received disconnect from 192.168.204.21 port 48792:11: disconnected by user Apr 3 02:26:58 oleg421-client sshd[51631]: Disconnected from user root 192.168.204.21 port 48792 Apr 3 02:26:58 oleg421-client sshd[51618]: pam_unix(sshd:session): session closed for user root Apr 3 02:26:58 oleg421-client systemd-logind[1011]: Session 250 logged out. Waiting for processes to exit. Apr 3 02:26:58 oleg421-client systemd[1]: session-250.scope: Succeeded. Apr 3 02:26:59 oleg421-client systemd-logind[1011]: Removed session 250. Apr 3 02:27:01 oleg421-client sshd[51773]: Accepted publickey for root from 192.168.204.21 port 48796 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:27:01 oleg421-client systemd-logind[1011]: New session 251 of user root. Apr 3 02:27:01 oleg421-client systemd[1]: Started Session 251 of user root. Apr 3 02:27:01 oleg421-client sshd[51773]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:27:01 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 53a: touch: drop rep ============== 02:26:59 (1775197619) Apr 3 02:27:01 oleg421-client sshd[51786]: Received disconnect from 192.168.204.21 port 48796:11: disconnected by user Apr 3 02:27:01 oleg421-client sshd[51786]: Disconnected from user root 192.168.204.21 port 48796 Apr 3 02:27:01 oleg421-client sshd[51773]: pam_unix(sshd:session): session closed for user root Apr 3 02:27:01 oleg421-client systemd[1]: session-251.scope: Succeeded. Apr 3 02:27:01 oleg421-client systemd-logind[1011]: Session 251 logged out. Waiting for processes to exit. Apr 3 02:27:01 oleg421-client systemd-logind[1011]: Removed session 251. Apr 3 02:27:19 oleg421-client kernel: Lustre: 51891:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775197623/real 1775197623] req@ffff962446b91c00 x1861425389121408/t0(0) o101->lustre-MDT0000-mdc-ffff962443e10000@192.168.204.121@tcp:12/10 lens 576/1152 e 0 to 1 dl 1775197639 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'openfile.0' uid:0 gid:0 projid:0 Apr 3 02:27:19 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962443e10000: Connection to lustre-MDT0000 (at 192.168.204.121@tcp) was lost; in progress operations using this service will wait for recovery to complete Apr 3 02:27:19 oleg421-client kernel: Lustre: Skipped 1 previous similar message Apr 3 02:27:19 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962443e10000: Connection restored to 192.168.204.121@tcp (at 192.168.204.121@tcp) Apr 3 02:27:19 oleg421-client kernel: Lustre: Skipped 1 previous similar message Apr 3 02:27:22 oleg421-client sshd[52017]: Accepted publickey for root from 192.168.204.21 port 42026 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:27:22 oleg421-client systemd-logind[1011]: New session 252 of user root. Apr 3 02:27:22 oleg421-client systemd[1]: Started Session 252 of user root. Apr 3 02:27:22 oleg421-client sshd[52017]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:27:22 oleg421-client sshd[52030]: Received disconnect from 192.168.204.21 port 42026:11: disconnected by user Apr 3 02:27:22 oleg421-client sshd[52030]: Disconnected from user root 192.168.204.21 port 42026 Apr 3 02:27:22 oleg421-client sshd[52017]: pam_unix(sshd:session): session closed for user root Apr 3 02:27:23 oleg421-client systemd[1]: session-252.scope: Succeeded. Apr 3 02:27:23 oleg421-client systemd-logind[1011]: Session 252 logged out. Waiting for processes to exit. Apr 3 02:27:23 oleg421-client systemd-logind[1011]: Removed session 252. Apr 3 02:27:24 oleg421-client sshd[52156]: Accepted publickey for root from 192.168.204.21 port 42028 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:27:24 oleg421-client systemd-logind[1011]: New session 253 of user root. Apr 3 02:27:24 oleg421-client systemd[1]: Started Session 253 of user root. Apr 3 02:27:24 oleg421-client sshd[52156]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:27:24 oleg421-client sshd[52169]: Received disconnect from 192.168.204.21 port 42028:11: disconnected by user Apr 3 02:27:24 oleg421-client sshd[52169]: Disconnected from user root 192.168.204.21 port 42028 Apr 3 02:27:24 oleg421-client sshd[52156]: pam_unix(sshd:session): session closed for user root Apr 3 02:27:24 oleg421-client systemd[1]: session-253.scope: Succeeded. Apr 3 02:27:24 oleg421-client systemd-logind[1011]: Session 253 logged out. Waiting for processes to exit. Apr 3 02:27:24 oleg421-client systemd-logind[1011]: Removed session 253. Apr 3 02:27:25 oleg421-client sshd[52302]: Accepted publickey for root from 192.168.204.21 port 42044 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:27:25 oleg421-client systemd-logind[1011]: New session 254 of user root. Apr 3 02:27:25 oleg421-client systemd[1]: Started Session 254 of user root. Apr 3 02:27:25 oleg421-client sshd[52302]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:27:26 oleg421-client sshd[52315]: Received disconnect from 192.168.204.21 port 42044:11: disconnected by user Apr 3 02:27:26 oleg421-client sshd[52315]: Disconnected from user root 192.168.204.21 port 42044 Apr 3 02:27:26 oleg421-client sshd[52302]: pam_unix(sshd:session): session closed for user root Apr 3 02:27:26 oleg421-client systemd[1]: session-254.scope: Succeeded. Apr 3 02:27:26 oleg421-client systemd-logind[1011]: Session 254 logged out. Waiting for processes to exit. Apr 3 02:27:26 oleg421-client systemd-logind[1011]: Removed session 254. Apr 3 02:27:28 oleg421-client sshd[52458]: Accepted publickey for root from 192.168.204.21 port 47864 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:27:28 oleg421-client systemd[1]: Started Session 255 of user root. Apr 3 02:27:28 oleg421-client systemd-logind[1011]: New session 255 of user root. Apr 3 02:27:28 oleg421-client sshd[52458]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:27:29 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 53b: touch: drop rep ============== 02:27:26 (1775197646) Apr 3 02:27:29 oleg421-client sshd[52471]: Received disconnect from 192.168.204.21 port 47864:11: disconnected by user Apr 3 02:27:29 oleg421-client sshd[52471]: Disconnected from user root 192.168.204.21 port 47864 Apr 3 02:27:29 oleg421-client sshd[52458]: pam_unix(sshd:session): session closed for user root Apr 3 02:27:29 oleg421-client systemd[1]: session-255.scope: Succeeded. Apr 3 02:27:29 oleg421-client systemd-logind[1011]: Session 255 logged out. Waiting for processes to exit. Apr 3 02:27:29 oleg421-client systemd-logind[1011]: Removed session 255. Apr 3 02:27:51 oleg421-client sshd[52702]: Accepted publickey for root from 192.168.204.21 port 49424 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:27:51 oleg421-client systemd[1]: Started Session 256 of user root. Apr 3 02:27:51 oleg421-client systemd-logind[1011]: New session 256 of user root. Apr 3 02:27:51 oleg421-client sshd[52702]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:27:51 oleg421-client sshd[52715]: Received disconnect from 192.168.204.21 port 49424:11: disconnected by user Apr 3 02:27:51 oleg421-client sshd[52715]: Disconnected from user root 192.168.204.21 port 49424 Apr 3 02:27:51 oleg421-client sshd[52702]: pam_unix(sshd:session): session closed for user root Apr 3 02:27:51 oleg421-client systemd[1]: session-256.scope: Succeeded. Apr 3 02:27:51 oleg421-client systemd-logind[1011]: Session 256 logged out. Waiting for processes to exit. Apr 3 02:27:51 oleg421-client systemd-logind[1011]: Removed session 256. Apr 3 02:27:52 oleg421-client sshd[52841]: Accepted publickey for root from 192.168.204.21 port 49432 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:27:52 oleg421-client systemd[1]: Started Session 257 of user root. Apr 3 02:27:52 oleg421-client systemd-logind[1011]: New session 257 of user root. Apr 3 02:27:52 oleg421-client sshd[52841]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:27:53 oleg421-client sshd[52854]: Received disconnect from 192.168.204.21 port 49432:11: disconnected by user Apr 3 02:27:53 oleg421-client sshd[52854]: Disconnected from user root 192.168.204.21 port 49432 Apr 3 02:27:53 oleg421-client sshd[52841]: pam_unix(sshd:session): session closed for user root Apr 3 02:27:53 oleg421-client systemd[1]: session-257.scope: Succeeded. Apr 3 02:27:53 oleg421-client systemd-logind[1011]: Session 257 logged out. Waiting for processes to exit. Apr 3 02:27:53 oleg421-client systemd-logind[1011]: Removed session 257. Apr 3 02:27:54 oleg421-client sshd[52987]: Accepted publickey for root from 192.168.204.21 port 49436 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:27:54 oleg421-client systemd-logind[1011]: New session 258 of user root. Apr 3 02:27:54 oleg421-client systemd[1]: Started Session 258 of user root. Apr 3 02:27:54 oleg421-client sshd[52987]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:27:55 oleg421-client sshd[53000]: Received disconnect from 192.168.204.21 port 49436:11: disconnected by user Apr 3 02:27:55 oleg421-client sshd[53000]: Disconnected from user root 192.168.204.21 port 49436 Apr 3 02:27:55 oleg421-client sshd[52987]: pam_unix(sshd:session): session closed for user root Apr 3 02:27:55 oleg421-client systemd[1]: session-258.scope: Succeeded. Apr 3 02:27:55 oleg421-client systemd-logind[1011]: Session 258 logged out. Waiting for processes to exit. Apr 3 02:27:55 oleg421-client systemd-logind[1011]: Removed session 258. Apr 3 02:27:56 oleg421-client sshd[53143]: Accepted publickey for root from 192.168.204.21 port 49442 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:27:57 oleg421-client systemd[1]: Started Session 259 of user root. Apr 3 02:27:57 oleg421-client systemd-logind[1011]: New session 259 of user root. Apr 3 02:27:57 oleg421-client sshd[53143]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:27:57 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 53c: touch: drop rep ============== 02:27:55 (1775197675) Apr 3 02:27:57 oleg421-client sshd[53156]: Received disconnect from 192.168.204.21 port 49442:11: disconnected by user Apr 3 02:27:57 oleg421-client sshd[53156]: Disconnected from user root 192.168.204.21 port 49442 Apr 3 02:27:57 oleg421-client sshd[53143]: pam_unix(sshd:session): session closed for user root Apr 3 02:27:57 oleg421-client systemd-logind[1011]: Session 259 logged out. Waiting for processes to exit. Apr 3 02:27:57 oleg421-client systemd[1]: session-259.scope: Succeeded. Apr 3 02:27:57 oleg421-client systemd-logind[1011]: Removed session 259. Apr 3 02:28:18 oleg421-client sshd[53386]: Accepted publickey for root from 192.168.204.21 port 58908 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:28:18 oleg421-client systemd-logind[1011]: New session 260 of user root. Apr 3 02:28:18 oleg421-client systemd[1]: Started Session 260 of user root. Apr 3 02:28:18 oleg421-client sshd[53386]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:28:18 oleg421-client sshd[53399]: Received disconnect from 192.168.204.21 port 58908:11: disconnected by user Apr 3 02:28:18 oleg421-client sshd[53399]: Disconnected from user root 192.168.204.21 port 58908 Apr 3 02:28:18 oleg421-client sshd[53386]: pam_unix(sshd:session): session closed for user root Apr 3 02:28:18 oleg421-client systemd[1]: session-260.scope: Succeeded. Apr 3 02:28:18 oleg421-client systemd-logind[1011]: Session 260 logged out. Waiting for processes to exit. Apr 3 02:28:19 oleg421-client systemd-logind[1011]: Removed session 260. Apr 3 02:28:20 oleg421-client sshd[53526]: Accepted publickey for root from 192.168.204.21 port 58922 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:28:20 oleg421-client systemd[1]: Started Session 261 of user root. Apr 3 02:28:20 oleg421-client systemd-logind[1011]: New session 261 of user root. Apr 3 02:28:20 oleg421-client sshd[53526]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:28:20 oleg421-client sshd[53539]: Received disconnect from 192.168.204.21 port 58922:11: disconnected by user Apr 3 02:28:20 oleg421-client sshd[53539]: Disconnected from user root 192.168.204.21 port 58922 Apr 3 02:28:20 oleg421-client sshd[53526]: pam_unix(sshd:session): session closed for user root Apr 3 02:28:20 oleg421-client systemd-logind[1011]: Session 261 logged out. Waiting for processes to exit. Apr 3 02:28:20 oleg421-client systemd[1]: session-261.scope: Succeeded. Apr 3 02:28:20 oleg421-client systemd-logind[1011]: Removed session 261. Apr 3 02:28:21 oleg421-client sshd[53672]: Accepted publickey for root from 192.168.204.21 port 58930 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:28:21 oleg421-client systemd-logind[1011]: New session 262 of user root. Apr 3 02:28:21 oleg421-client systemd[1]: Started Session 262 of user root. Apr 3 02:28:21 oleg421-client sshd[53672]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:28:22 oleg421-client sshd[53685]: Received disconnect from 192.168.204.21 port 58930:11: disconnected by user Apr 3 02:28:22 oleg421-client sshd[53685]: Disconnected from user root 192.168.204.21 port 58930 Apr 3 02:28:22 oleg421-client sshd[53672]: pam_unix(sshd:session): session closed for user root Apr 3 02:28:22 oleg421-client systemd[1]: session-262.scope: Succeeded. Apr 3 02:28:22 oleg421-client systemd-logind[1011]: Session 262 logged out. Waiting for processes to exit. Apr 3 02:28:22 oleg421-client systemd-logind[1011]: Removed session 262. Apr 3 02:28:23 oleg421-client sshd[53827]: Accepted publickey for root from 192.168.204.21 port 58938 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:28:23 oleg421-client systemd-logind[1011]: New session 263 of user root. Apr 3 02:28:23 oleg421-client systemd[1]: Started Session 263 of user root. Apr 3 02:28:23 oleg421-client sshd[53827]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:28:24 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 54: back in time ================== 02:28:22 (1775197702) Apr 3 02:28:24 oleg421-client sshd[53840]: Received disconnect from 192.168.204.21 port 58938:11: disconnected by user Apr 3 02:28:24 oleg421-client sshd[53840]: Disconnected from user root 192.168.204.21 port 58938 Apr 3 02:28:24 oleg421-client sshd[53827]: pam_unix(sshd:session): session closed for user root Apr 3 02:28:24 oleg421-client systemd[1]: session-263.scope: Succeeded. Apr 3 02:28:24 oleg421-client systemd-logind[1011]: Session 263 logged out. Waiting for processes to exit. Apr 3 02:28:24 oleg421-client systemd-logind[1011]: Removed session 263. Apr 3 02:28:24 oleg421-client systemd-udevd[53903]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Apr 3 02:28:24 oleg421-client kernel: Lustre: Mounted lustre-client Apr 3 02:28:57 oleg421-client kernel: LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 192.168.204.121@tcp) was lost; in progress operations using this service will fail Apr 3 02:28:57 oleg421-client kernel: LustreError: Skipped 3 previous similar messages Apr 3 02:29:07 oleg421-client kernel: Lustre: Evicted from MGS (at 192.168.204.121@tcp) after server handle changed from 0x1d1756950cf79d87 to 0x1d1756950d0d2d2a Apr 3 02:29:07 oleg421-client kernel: Lustre: Skipped 3 previous similar messages Apr 3 02:29:15 oleg421-client sshd[54215]: Accepted publickey for root from 192.168.204.21 port 45816 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:29:15 oleg421-client systemd-logind[1011]: New session 264 of user root. Apr 3 02:29:15 oleg421-client systemd[1]: Started Session 264 of user root. Apr 3 02:29:15 oleg421-client sshd[54215]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:29:15 oleg421-client sshd[54228]: Received disconnect from 192.168.204.21 port 45816:11: disconnected by user Apr 3 02:29:15 oleg421-client sshd[54228]: Disconnected from user root 192.168.204.21 port 45816 Apr 3 02:29:15 oleg421-client sshd[54215]: pam_unix(sshd:session): session closed for user root Apr 3 02:29:15 oleg421-client systemd-logind[1011]: Session 264 logged out. Waiting for processes to exit. Apr 3 02:29:15 oleg421-client systemd[1]: session-264.scope: Succeeded. Apr 3 02:29:15 oleg421-client systemd-logind[1011]: Removed session 264. Apr 3 02:29:19 oleg421-client sshd[54451]: Accepted publickey for root from 192.168.204.21 port 37986 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:29:19 oleg421-client systemd-logind[1011]: New session 265 of user root. Apr 3 02:29:19 oleg421-client systemd[1]: Started Session 265 of user root. Apr 3 02:29:19 oleg421-client sshd[54451]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:29:19 oleg421-client kernel: Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid Apr 3 02:29:19 oleg421-client sshd[54464]: Received disconnect from 192.168.204.21 port 37986:11: disconnected by user Apr 3 02:29:19 oleg421-client sshd[54464]: Disconnected from user root 192.168.204.21 port 37986 Apr 3 02:29:19 oleg421-client sshd[54451]: pam_unix(sshd:session): session closed for user root Apr 3 02:29:19 oleg421-client systemd-logind[1011]: Session 265 logged out. Waiting for processes to exit. Apr 3 02:29:19 oleg421-client systemd[1]: session-265.scope: Succeeded. Apr 3 02:29:19 oleg421-client systemd-logind[1011]: Removed session 265. Apr 3 02:29:21 oleg421-client sshd[54608]: Accepted publickey for root from 192.168.204.21 port 37992 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:29:21 oleg421-client rsyslogd[1073]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Apr 3 02:29:21 oleg421-client systemd-logind[1011]: New session 266 of user root. Apr 3 02:29:21 oleg421-client systemd[1]: Started Session 266 of user root. Apr 3 02:29:21 oleg421-client sshd[54608]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:29:21 oleg421-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Apr 3 02:29:21 oleg421-client sshd[54622]: Received disconnect from 192.168.204.21 port 37992:11: disconnected by user Apr 3 02:29:21 oleg421-client sshd[54622]: Disconnected from user root 192.168.204.21 port 37992 Apr 3 02:29:21 oleg421-client sshd[54608]: pam_unix(sshd:session): session closed for user root Apr 3 02:29:21 oleg421-client systemd[1]: session-266.scope: Succeeded. Apr 3 02:29:21 oleg421-client systemd-logind[1011]: Session 266 logged out. Waiting for processes to exit. Apr 3 02:29:21 oleg421-client systemd-logind[1011]: Removed session 266. Apr 3 02:29:23 oleg421-client sshd[54663]: Accepted publickey for root from 192.168.204.21 port 38006 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:29:23 oleg421-client systemd-logind[1011]: New session 267 of user root. Apr 3 02:29:23 oleg421-client systemd[1]: Started Session 267 of user root. Apr 3 02:29:23 oleg421-client sshd[54663]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:29:23 oleg421-client sshd[54676]: Received disconnect from 192.168.204.21 port 38006:11: disconnected by user Apr 3 02:29:23 oleg421-client sshd[54676]: Disconnected from user root 192.168.204.21 port 38006 Apr 3 02:29:23 oleg421-client sshd[54663]: pam_unix(sshd:session): session closed for user root Apr 3 02:29:23 oleg421-client systemd[1]: mnt-lustre2.mount: Succeeded. Apr 3 02:29:23 oleg421-client kernel: LustreError: 54700:0:(lov_obd.c:786:lov_cleanup()) lustre-clilov-ffff9624447cd800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Apr 3 02:29:23 oleg421-client kernel: LustreError: 54700:0:(lov_obd.c:786:lov_cleanup()) Skipped 1 previous similar message Apr 3 02:29:23 oleg421-client systemd[1]: session-267.scope: Succeeded. Apr 3 02:29:23 oleg421-client systemd-logind[1011]: Session 267 logged out. Waiting for processes to exit. Apr 3 02:29:23 oleg421-client kernel: Lustre: Unmounted lustre-client Apr 3 02:29:23 oleg421-client systemd-logind[1011]: Removed session 267. Apr 3 02:29:24 oleg421-client sshd[54802]: Accepted publickey for root from 192.168.204.21 port 38018 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:29:24 oleg421-client systemd-logind[1011]: New session 268 of user root. Apr 3 02:29:24 oleg421-client systemd[1]: Started Session 268 of user root. Apr 3 02:29:24 oleg421-client sshd[54802]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:29:25 oleg421-client sshd[54816]: Received disconnect from 192.168.204.21 port 38018:11: disconnected by user Apr 3 02:29:25 oleg421-client sshd[54816]: Disconnected from user root 192.168.204.21 port 38018 Apr 3 02:29:25 oleg421-client sshd[54802]: pam_unix(sshd:session): session closed for user root Apr 3 02:29:25 oleg421-client systemd[1]: session-268.scope: Succeeded. Apr 3 02:29:25 oleg421-client systemd-logind[1011]: Session 268 logged out. Waiting for processes to exit. Apr 3 02:29:25 oleg421-client systemd-logind[1011]: Removed session 268. Apr 3 02:29:26 oleg421-client sshd[54942]: Accepted publickey for root from 192.168.204.21 port 38034 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:29:26 oleg421-client systemd[1]: Started Session 269 of user root. Apr 3 02:29:26 oleg421-client systemd-logind[1011]: New session 269 of user root. Apr 3 02:29:26 oleg421-client sshd[54942]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:29:26 oleg421-client sshd[54955]: Received disconnect from 192.168.204.21 port 38034:11: disconnected by user Apr 3 02:29:26 oleg421-client sshd[54955]: Disconnected from user root 192.168.204.21 port 38034 Apr 3 02:29:26 oleg421-client sshd[54942]: pam_unix(sshd:session): session closed for user root Apr 3 02:29:26 oleg421-client systemd-logind[1011]: Session 269 logged out. Waiting for processes to exit. Apr 3 02:29:26 oleg421-client systemd[1]: session-269.scope: Succeeded. Apr 3 02:29:26 oleg421-client systemd-logind[1011]: Removed session 269. Apr 3 02:29:27 oleg421-client sshd[55088]: Accepted publickey for root from 192.168.204.21 port 58650 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:29:27 oleg421-client systemd[1]: Started Session 270 of user root. Apr 3 02:29:27 oleg421-client systemd-logind[1011]: New session 270 of user root. Apr 3 02:29:27 oleg421-client sshd[55088]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:29:27 oleg421-client sshd[55101]: Received disconnect from 192.168.204.21 port 58650:11: disconnected by user Apr 3 02:29:27 oleg421-client sshd[55101]: Disconnected from user root 192.168.204.21 port 58650 Apr 3 02:29:28 oleg421-client sshd[55088]: pam_unix(sshd:session): session closed for user root Apr 3 02:29:28 oleg421-client systemd[1]: session-270.scope: Succeeded. Apr 3 02:29:28 oleg421-client systemd-logind[1011]: Session 270 logged out. Waiting for processes to exit. Apr 3 02:29:28 oleg421-client systemd-logind[1011]: Removed session 270. Apr 3 02:29:29 oleg421-client sshd[55243]: Accepted publickey for root from 192.168.204.21 port 58664 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:29:29 oleg421-client systemd[1]: Started Session 271 of user root. Apr 3 02:29:29 oleg421-client systemd-logind[1011]: New session 271 of user root. Apr 3 02:29:29 oleg421-client sshd[55243]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:29:29 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 55: ost_brw_read/write drops timed-out read/write request ========================================================== 02:29:28 (1775197768) Apr 3 02:29:29 oleg421-client sshd[55256]: Received disconnect from 192.168.204.21 port 58664:11: disconnected by user Apr 3 02:29:29 oleg421-client sshd[55256]: Disconnected from user root 192.168.204.21 port 58664 Apr 3 02:29:29 oleg421-client sshd[55243]: pam_unix(sshd:session): session closed for user root Apr 3 02:29:29 oleg421-client systemd[1]: session-271.scope: Succeeded. Apr 3 02:29:29 oleg421-client systemd-logind[1011]: Session 271 logged out. Waiting for processes to exit. Apr 3 02:29:29 oleg421-client systemd-logind[1011]: Removed session 271. Apr 3 02:31:04 oleg421-client sshd[55539]: Accepted publickey for root from 192.168.204.21 port 34524 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:31:04 oleg421-client systemd-logind[1011]: New session 272 of user root. Apr 3 02:31:04 oleg421-client systemd[1]: Started Session 272 of user root. Apr 3 02:31:04 oleg421-client sshd[55539]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:31:05 oleg421-client sshd[55552]: Received disconnect from 192.168.204.21 port 34524:11: disconnected by user Apr 3 02:31:05 oleg421-client sshd[55552]: Disconnected from user root 192.168.204.21 port 34524 Apr 3 02:31:05 oleg421-client sshd[55539]: pam_unix(sshd:session): session closed for user root Apr 3 02:31:05 oleg421-client systemd[1]: session-272.scope: Succeeded. Apr 3 02:31:05 oleg421-client systemd-logind[1011]: Session 272 logged out. Waiting for processes to exit. Apr 3 02:31:05 oleg421-client systemd-logind[1011]: Removed session 272. Apr 3 02:31:06 oleg421-client sshd[55678]: Accepted publickey for root from 192.168.204.21 port 34534 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:31:06 oleg421-client systemd-logind[1011]: New session 273 of user root. Apr 3 02:31:06 oleg421-client systemd[1]: Started Session 273 of user root. Apr 3 02:31:06 oleg421-client sshd[55678]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:31:07 oleg421-client sshd[55691]: Received disconnect from 192.168.204.21 port 34534:11: disconnected by user Apr 3 02:31:07 oleg421-client sshd[55691]: Disconnected from user root 192.168.204.21 port 34534 Apr 3 02:31:07 oleg421-client sshd[55678]: pam_unix(sshd:session): session closed for user root Apr 3 02:31:07 oleg421-client systemd[1]: session-273.scope: Succeeded. Apr 3 02:31:07 oleg421-client systemd-logind[1011]: Session 273 logged out. Waiting for processes to exit. Apr 3 02:31:07 oleg421-client systemd-logind[1011]: Removed session 273. Apr 3 02:31:08 oleg421-client sshd[55824]: Accepted publickey for root from 192.168.204.21 port 52712 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:31:08 oleg421-client systemd[1]: Started Session 274 of user root. Apr 3 02:31:08 oleg421-client systemd-logind[1011]: New session 274 of user root. Apr 3 02:31:08 oleg421-client sshd[55824]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:31:08 oleg421-client sshd[55838]: Received disconnect from 192.168.204.21 port 52712:11: disconnected by user Apr 3 02:31:08 oleg421-client sshd[55838]: Disconnected from user root 192.168.204.21 port 52712 Apr 3 02:31:08 oleg421-client sshd[55824]: pam_unix(sshd:session): session closed for user root Apr 3 02:31:08 oleg421-client systemd[1]: session-274.scope: Succeeded. Apr 3 02:31:08 oleg421-client systemd-logind[1011]: Session 274 logged out. Waiting for processes to exit. Apr 3 02:31:08 oleg421-client systemd-logind[1011]: Removed session 274. Apr 3 02:31:10 oleg421-client sshd[55981]: Accepted publickey for root from 192.168.204.21 port 52716 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:31:11 oleg421-client systemd-logind[1011]: New session 275 of user root. Apr 3 02:31:11 oleg421-client systemd[1]: Started Session 275 of user root. Apr 3 02:31:11 oleg421-client sshd[55981]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:31:11 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 56: do not fail on getattr resend ========================================================== 02:31:09 (1775197869) Apr 3 02:31:11 oleg421-client sshd[55994]: Received disconnect from 192.168.204.21 port 52716:11: disconnected by user Apr 3 02:31:11 oleg421-client sshd[55994]: Disconnected from user root 192.168.204.21 port 52716 Apr 3 02:31:11 oleg421-client sshd[55981]: pam_unix(sshd:session): session closed for user root Apr 3 02:31:11 oleg421-client systemd[1]: session-275.scope: Succeeded. Apr 3 02:31:11 oleg421-client systemd-logind[1011]: Session 275 logged out. Waiting for processes to exit. Apr 3 02:31:11 oleg421-client systemd-logind[1011]: Removed session 275. Apr 3 02:31:55 oleg421-client sshd[56142]: Accepted publickey for root from 192.168.204.21 port 41356 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:31:55 oleg421-client systemd-logind[1011]: New session 276 of user root. Apr 3 02:31:55 oleg421-client systemd[1]: Started Session 276 of user root. Apr 3 02:31:55 oleg421-client sshd[56142]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:31:55 oleg421-client sshd[56155]: Received disconnect from 192.168.204.21 port 41356:11: disconnected by user Apr 3 02:31:55 oleg421-client sshd[56155]: Disconnected from user root 192.168.204.21 port 41356 Apr 3 02:31:55 oleg421-client sshd[56142]: pam_unix(sshd:session): session closed for user root Apr 3 02:31:56 oleg421-client systemd[1]: session-276.scope: Succeeded. Apr 3 02:31:56 oleg421-client systemd-logind[1011]: Session 276 logged out. Waiting for processes to exit. Apr 3 02:31:56 oleg421-client systemd-logind[1011]: Removed session 276. Apr 3 02:31:57 oleg421-client sshd[56281]: Accepted publickey for root from 192.168.204.21 port 41362 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:31:57 oleg421-client systemd-logind[1011]: New session 277 of user root. Apr 3 02:31:57 oleg421-client systemd[1]: Started Session 277 of user root. Apr 3 02:31:57 oleg421-client sshd[56281]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:31:57 oleg421-client sshd[56294]: Received disconnect from 192.168.204.21 port 41362:11: disconnected by user Apr 3 02:31:57 oleg421-client sshd[56294]: Disconnected from user root 192.168.204.21 port 41362 Apr 3 02:31:57 oleg421-client sshd[56281]: pam_unix(sshd:session): session closed for user root Apr 3 02:31:58 oleg421-client systemd[1]: session-277.scope: Succeeded. Apr 3 02:31:58 oleg421-client systemd-logind[1011]: Session 277 logged out. Waiting for processes to exit. Apr 3 02:31:58 oleg421-client systemd-logind[1011]: Removed session 277. Apr 3 02:31:59 oleg421-client sshd[56428]: Accepted publickey for root from 192.168.204.21 port 54632 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:31:59 oleg421-client systemd-logind[1011]: New session 278 of user root. Apr 3 02:31:59 oleg421-client systemd[1]: Started Session 278 of user root. Apr 3 02:31:59 oleg421-client sshd[56428]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:31:59 oleg421-client sshd[56441]: Received disconnect from 192.168.204.21 port 54632:11: disconnected by user Apr 3 02:31:59 oleg421-client sshd[56441]: Disconnected from user root 192.168.204.21 port 54632 Apr 3 02:31:59 oleg421-client sshd[56428]: pam_unix(sshd:session): session closed for user root Apr 3 02:32:00 oleg421-client systemd[1]: session-278.scope: Succeeded. Apr 3 02:32:00 oleg421-client systemd-logind[1011]: Session 278 logged out. Waiting for processes to exit. Apr 3 02:32:00 oleg421-client systemd-logind[1011]: Removed session 278. Apr 3 02:32:01 oleg421-client sshd[56583]: Accepted publickey for root from 192.168.204.21 port 54646 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:32:01 oleg421-client systemd[1]: Started Session 279 of user root. Apr 3 02:32:01 oleg421-client systemd-logind[1011]: New session 279 of user root. Apr 3 02:32:01 oleg421-client sshd[56583]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:32:02 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 57: read procfs entries causes kernel crash ========================================================== 02:32:00 (1775197920) Apr 3 02:32:02 oleg421-client sshd[56596]: Received disconnect from 192.168.204.21 port 54646:11: disconnected by user Apr 3 02:32:02 oleg421-client sshd[56596]: Disconnected from user root 192.168.204.21 port 54646 Apr 3 02:32:02 oleg421-client sshd[56583]: pam_unix(sshd:session): session closed for user root Apr 3 02:32:02 oleg421-client systemd[1]: session-279.scope: Succeeded. Apr 3 02:32:02 oleg421-client systemd-logind[1011]: Session 279 logged out. Waiting for processes to exit. Apr 3 02:32:02 oleg421-client systemd-logind[1011]: Removed session 279. Apr 3 02:32:06 oleg421-client systemd[1]: mnt-lustre.mount: Succeeded. Apr 3 02:32:06 oleg421-client kernel: LustreError: 56654:0:(lov_obd.c:786:lov_cleanup()) lustre-clilov-ffff962443e10000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Apr 3 02:32:06 oleg421-client kernel: LustreError: 56654:0:(lov_obd.c:786:lov_cleanup()) Skipped 1 previous similar message Apr 3 02:32:06 oleg421-client kernel: Lustre: Unmounted lustre-client Apr 3 02:32:30 oleg421-client sshd[56915]: Accepted publickey for root from 192.168.204.21 port 39942 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:32:30 oleg421-client systemd-logind[1011]: New session 280 of user root. Apr 3 02:32:30 oleg421-client systemd[1]: Started Session 280 of user root. Apr 3 02:32:30 oleg421-client sshd[56915]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:32:31 oleg421-client sshd[56928]: Received disconnect from 192.168.204.21 port 39942:11: disconnected by user Apr 3 02:32:31 oleg421-client sshd[56928]: Disconnected from user root 192.168.204.21 port 39942 Apr 3 02:32:31 oleg421-client sshd[56915]: pam_unix(sshd:session): session closed for user root Apr 3 02:32:31 oleg421-client systemd[1]: session-280.scope: Succeeded. Apr 3 02:32:31 oleg421-client systemd-logind[1011]: Session 280 logged out. Waiting for processes to exit. Apr 3 02:32:31 oleg421-client systemd-logind[1011]: Removed session 280. Apr 3 02:32:32 oleg421-client sshd[56969]: Accepted publickey for root from 192.168.204.21 port 39952 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:32:32 oleg421-client systemd[1]: Started Session 281 of user root. Apr 3 02:32:32 oleg421-client systemd-logind[1011]: New session 281 of user root. Apr 3 02:32:32 oleg421-client sshd[56969]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:32:33 oleg421-client sshd[56982]: Received disconnect from 192.168.204.21 port 39952:11: disconnected by user Apr 3 02:32:33 oleg421-client sshd[56982]: Disconnected from user root 192.168.204.21 port 39952 Apr 3 02:32:33 oleg421-client sshd[56969]: pam_unix(sshd:session): session closed for user root Apr 3 02:32:33 oleg421-client systemd[1]: session-281.scope: Succeeded. Apr 3 02:32:33 oleg421-client systemd-logind[1011]: Session 281 logged out. Waiting for processes to exit. Apr 3 02:32:33 oleg421-client systemd-logind[1011]: Removed session 281. Apr 3 02:32:42 oleg421-client systemd-udevd[57161]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Apr 3 02:32:42 oleg421-client kernel: Lustre: Mounted lustre-client Apr 3 02:32:44 oleg421-client sshd[57277]: Accepted publickey for root from 192.168.204.21 port 57256 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:32:44 oleg421-client systemd-logind[1011]: New session 282 of user root. Apr 3 02:32:44 oleg421-client systemd[1]: Started Session 282 of user root. Apr 3 02:32:44 oleg421-client sshd[57277]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:32:44 oleg421-client sshd[57290]: Received disconnect from 192.168.204.21 port 57256:11: disconnected by user Apr 3 02:32:44 oleg421-client sshd[57290]: Disconnected from user root 192.168.204.21 port 57256 Apr 3 02:32:44 oleg421-client sshd[57277]: pam_unix(sshd:session): session closed for user root Apr 3 02:32:45 oleg421-client systemd[1]: session-282.scope: Succeeded. Apr 3 02:32:45 oleg421-client systemd-logind[1011]: Session 282 logged out. Waiting for processes to exit. Apr 3 02:32:45 oleg421-client systemd-logind[1011]: Removed session 282. Apr 3 02:32:46 oleg421-client sshd[57416]: Accepted publickey for root from 192.168.204.21 port 57268 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:32:46 oleg421-client systemd-logind[1011]: New session 283 of user root. Apr 3 02:32:46 oleg421-client systemd[1]: Started Session 283 of user root. Apr 3 02:32:46 oleg421-client sshd[57416]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:32:46 oleg421-client sshd[57429]: Received disconnect from 192.168.204.21 port 57268:11: disconnected by user Apr 3 02:32:46 oleg421-client sshd[57429]: Disconnected from user root 192.168.204.21 port 57268 Apr 3 02:32:46 oleg421-client sshd[57416]: pam_unix(sshd:session): session closed for user root Apr 3 02:32:46 oleg421-client systemd[1]: session-283.scope: Succeeded. Apr 3 02:32:46 oleg421-client systemd-logind[1011]: Session 283 logged out. Waiting for processes to exit. Apr 3 02:32:46 oleg421-client systemd-logind[1011]: Removed session 283. Apr 3 02:32:48 oleg421-client sshd[57562]: Accepted publickey for root from 192.168.204.21 port 47876 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:32:48 oleg421-client systemd[1]: Started Session 284 of user root. Apr 3 02:32:48 oleg421-client systemd-logind[1011]: New session 284 of user root. Apr 3 02:32:48 oleg421-client sshd[57562]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:32:48 oleg421-client sshd[57575]: Received disconnect from 192.168.204.21 port 47876:11: disconnected by user Apr 3 02:32:48 oleg421-client sshd[57575]: Disconnected from user root 192.168.204.21 port 47876 Apr 3 02:32:48 oleg421-client sshd[57562]: pam_unix(sshd:session): session closed for user root Apr 3 02:32:48 oleg421-client systemd[1]: session-284.scope: Succeeded. Apr 3 02:32:48 oleg421-client systemd-logind[1011]: Session 284 logged out. Waiting for processes to exit. Apr 3 02:32:48 oleg421-client systemd-logind[1011]: Removed session 284. Apr 3 02:32:50 oleg421-client sshd[57718]: Accepted publickey for root from 192.168.204.21 port 47880 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:32:50 oleg421-client systemd[1]: Started Session 285 of user root. Apr 3 02:32:50 oleg421-client systemd-logind[1011]: New session 285 of user root. Apr 3 02:32:50 oleg421-client sshd[57718]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:32:50 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 58: Eviction in the middle of open RPC reply processing ========================================================== 02:32:49 (1775197969) Apr 3 02:32:50 oleg421-client sshd[57731]: Received disconnect from 192.168.204.21 port 47880:11: disconnected by user Apr 3 02:32:51 oleg421-client sshd[57731]: Disconnected from user root 192.168.204.21 port 47880 Apr 3 02:32:51 oleg421-client sshd[57718]: pam_unix(sshd:session): session closed for user root Apr 3 02:32:51 oleg421-client systemd[1]: session-285.scope: Succeeded. Apr 3 02:32:51 oleg421-client systemd-logind[1011]: Session 285 logged out. Waiting for processes to exit. Apr 3 02:32:51 oleg421-client systemd-logind[1011]: Removed session 285. Apr 3 02:32:51 oleg421-client kernel: LustreError: 57769:0:(mdc_locks.c:1335:mdc_finish_intent_lock()) cfs_fail_timeout id 801 sleeping for 20000ms Apr 3 02:32:52 oleg421-client kernel: LustreError: 57769:0:(mdc_locks.c:1335:mdc_finish_intent_lock()) cfs_fail_timeout interrupted Apr 3 02:32:52 oleg421-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Apr 3 02:33:09 oleg421-client sshd[57903]: Accepted publickey for root from 192.168.204.21 port 46762 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:33:09 oleg421-client systemd-logind[1011]: New session 286 of user root. Apr 3 02:33:09 oleg421-client systemd[1]: Started Session 286 of user root. Apr 3 02:33:09 oleg421-client sshd[57903]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:33:09 oleg421-client sshd[57916]: Received disconnect from 192.168.204.21 port 46762:11: disconnected by user Apr 3 02:33:09 oleg421-client sshd[57916]: Disconnected from user root 192.168.204.21 port 46762 Apr 3 02:33:09 oleg421-client sshd[57903]: pam_unix(sshd:session): session closed for user root Apr 3 02:33:09 oleg421-client systemd[1]: session-286.scope: Succeeded. Apr 3 02:33:09 oleg421-client systemd-logind[1011]: Session 286 logged out. Waiting for processes to exit. Apr 3 02:33:09 oleg421-client systemd-logind[1011]: Removed session 286. Apr 3 02:33:11 oleg421-client sshd[58042]: Accepted publickey for root from 192.168.204.21 port 46776 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:33:11 oleg421-client systemd-logind[1011]: New session 287 of user root. Apr 3 02:33:11 oleg421-client systemd[1]: Started Session 287 of user root. Apr 3 02:33:11 oleg421-client sshd[58042]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:33:12 oleg421-client sshd[58055]: Received disconnect from 192.168.204.21 port 46776:11: disconnected by user Apr 3 02:33:12 oleg421-client sshd[58055]: Disconnected from user root 192.168.204.21 port 46776 Apr 3 02:33:12 oleg421-client sshd[58042]: pam_unix(sshd:session): session closed for user root Apr 3 02:33:12 oleg421-client systemd[1]: session-287.scope: Succeeded. Apr 3 02:33:12 oleg421-client systemd-logind[1011]: Session 287 logged out. Waiting for processes to exit. Apr 3 02:33:12 oleg421-client systemd-logind[1011]: Removed session 287. Apr 3 02:33:13 oleg421-client sshd[58189]: Accepted publickey for root from 192.168.204.21 port 46792 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:33:13 oleg421-client systemd-logind[1011]: New session 288 of user root. Apr 3 02:33:13 oleg421-client systemd[1]: Started Session 288 of user root. Apr 3 02:33:13 oleg421-client sshd[58189]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:33:13 oleg421-client sshd[58202]: Received disconnect from 192.168.204.21 port 46792:11: disconnected by user Apr 3 02:33:13 oleg421-client sshd[58202]: Disconnected from user root 192.168.204.21 port 46792 Apr 3 02:33:13 oleg421-client sshd[58189]: pam_unix(sshd:session): session closed for user root Apr 3 02:33:14 oleg421-client systemd[1]: session-288.scope: Succeeded. Apr 3 02:33:14 oleg421-client systemd-logind[1011]: Session 288 logged out. Waiting for processes to exit. Apr 3 02:33:14 oleg421-client systemd-logind[1011]: Removed session 288. Apr 3 02:33:15 oleg421-client sshd[58344]: Accepted publickey for root from 192.168.204.21 port 46804 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:33:15 oleg421-client systemd-logind[1011]: New session 289 of user root. Apr 3 02:33:15 oleg421-client systemd[1]: Started Session 289 of user root. Apr 3 02:33:15 oleg421-client sshd[58344]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:33:16 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 59: Read cancel race on client eviction ========================================================== 02:33:14 (1775197994) Apr 3 02:33:16 oleg421-client sshd[58358]: Received disconnect from 192.168.204.21 port 46804:11: disconnected by user Apr 3 02:33:16 oleg421-client sshd[58358]: Disconnected from user root 192.168.204.21 port 46804 Apr 3 02:33:16 oleg421-client sshd[58344]: pam_unix(sshd:session): session closed for user root Apr 3 02:33:16 oleg421-client systemd-logind[1011]: Session 289 logged out. Waiting for processes to exit. Apr 3 02:33:16 oleg421-client systemd[1]: session-289.scope: Succeeded. Apr 3 02:33:16 oleg421-client systemd-logind[1011]: Removed session 289. Apr 3 02:33:16 oleg421-client systemd-udevd[58410]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Apr 3 02:33:17 oleg421-client kernel: Lustre: Mounted lustre-client Apr 3 02:33:20 oleg421-client kernel: Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request Apr 3 02:33:30 oleg421-client systemd[1]: mnt-lustre2.mount: Succeeded. Apr 3 02:33:30 oleg421-client kernel: Lustre: Unmounted lustre-client Apr 3 02:33:32 oleg421-client sshd[58557]: Accepted publickey for root from 192.168.204.21 port 48142 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:33:32 oleg421-client systemd-logind[1011]: New session 290 of user root. Apr 3 02:33:32 oleg421-client systemd[1]: Started Session 290 of user root. Apr 3 02:33:32 oleg421-client sshd[58557]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:33:32 oleg421-client sshd[58570]: Received disconnect from 192.168.204.21 port 48142:11: disconnected by user Apr 3 02:33:32 oleg421-client sshd[58570]: Disconnected from user root 192.168.204.21 port 48142 Apr 3 02:33:32 oleg421-client sshd[58557]: pam_unix(sshd:session): session closed for user root Apr 3 02:33:32 oleg421-client systemd[1]: session-290.scope: Succeeded. Apr 3 02:33:32 oleg421-client systemd-logind[1011]: Session 290 logged out. Waiting for processes to exit. Apr 3 02:33:32 oleg421-client systemd-logind[1011]: Removed session 290. Apr 3 02:33:34 oleg421-client sshd[58696]: Accepted publickey for root from 192.168.204.21 port 48148 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:33:34 oleg421-client systemd-logind[1011]: New session 291 of user root. Apr 3 02:33:34 oleg421-client systemd[1]: Started Session 291 of user root. Apr 3 02:33:34 oleg421-client sshd[58696]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:33:34 oleg421-client sshd[58710]: Received disconnect from 192.168.204.21 port 48148:11: disconnected by user Apr 3 02:33:34 oleg421-client sshd[58710]: Disconnected from user root 192.168.204.21 port 48148 Apr 3 02:33:35 oleg421-client sshd[58696]: pam_unix(sshd:session): session closed for user root Apr 3 02:33:35 oleg421-client systemd-logind[1011]: Session 291 logged out. Waiting for processes to exit. Apr 3 02:33:35 oleg421-client systemd[1]: session-291.scope: Succeeded. Apr 3 02:33:35 oleg421-client systemd-logind[1011]: Removed session 291. Apr 3 02:33:36 oleg421-client sshd[58843]: Accepted publickey for root from 192.168.204.21 port 48154 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:33:36 oleg421-client systemd[1]: Started Session 292 of user root. Apr 3 02:33:36 oleg421-client systemd-logind[1011]: New session 292 of user root. Apr 3 02:33:36 oleg421-client sshd[58843]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:33:36 oleg421-client sshd[58856]: Received disconnect from 192.168.204.21 port 48154:11: disconnected by user Apr 3 02:33:36 oleg421-client sshd[58856]: Disconnected from user root 192.168.204.21 port 48154 Apr 3 02:33:37 oleg421-client sshd[58843]: pam_unix(sshd:session): session closed for user root Apr 3 02:33:37 oleg421-client systemd[1]: session-292.scope: Succeeded. Apr 3 02:33:37 oleg421-client systemd-logind[1011]: Session 292 logged out. Waiting for processes to exit. Apr 3 02:33:37 oleg421-client systemd-logind[1011]: Removed session 292. Apr 3 02:33:38 oleg421-client sshd[58999]: Accepted publickey for root from 192.168.204.21 port 47640 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:33:38 oleg421-client systemd-logind[1011]: New session 293 of user root. Apr 3 02:33:38 oleg421-client systemd[1]: Started Session 293 of user root. Apr 3 02:33:38 oleg421-client sshd[58999]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:33:38 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 60: Add Changelog entries during MDS failover ========================================================== 02:33:37 (1775198017) Apr 3 02:33:38 oleg421-client sshd[59012]: Received disconnect from 192.168.204.21 port 47640:11: disconnected by user Apr 3 02:33:38 oleg421-client sshd[59012]: Disconnected from user root 192.168.204.21 port 47640 Apr 3 02:33:38 oleg421-client sshd[58999]: pam_unix(sshd:session): session closed for user root Apr 3 02:33:39 oleg421-client systemd-logind[1011]: Session 293 logged out. Waiting for processes to exit. Apr 3 02:33:39 oleg421-client systemd[1]: session-293.scope: Succeeded. Apr 3 02:33:39 oleg421-client systemd-logind[1011]: Removed session 293. Apr 3 02:33:47 oleg421-client sshd[59204]: Accepted publickey for root from 192.168.204.21 port 47650 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:33:47 oleg421-client systemd-logind[1011]: New session 294 of user root. Apr 3 02:33:47 oleg421-client systemd[1]: Started Session 294 of user root. Apr 3 02:33:47 oleg421-client sshd[59204]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:33:47 oleg421-client sshd[59217]: Received disconnect from 192.168.204.21 port 47650:11: disconnected by user Apr 3 02:33:47 oleg421-client sshd[59217]: Disconnected from user root 192.168.204.21 port 47650 Apr 3 02:33:47 oleg421-client sshd[59204]: pam_unix(sshd:session): session closed for user root Apr 3 02:33:47 oleg421-client systemd[1]: session-294.scope: Succeeded. Apr 3 02:33:47 oleg421-client systemd-logind[1011]: Session 294 logged out. Waiting for processes to exit. Apr 3 02:33:47 oleg421-client systemd-logind[1011]: Removed session 294. Apr 3 02:35:09 oleg421-client sshd[59430]: Accepted publickey for root from 192.168.204.21 port 49236 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:35:09 oleg421-client systemd[1]: Started Session 295 of user root. Apr 3 02:35:09 oleg421-client systemd-logind[1011]: New session 295 of user root. Apr 3 02:35:09 oleg421-client sshd[59430]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:35:09 oleg421-client sshd[59451]: Received disconnect from 192.168.204.21 port 49236:11: disconnected by user Apr 3 02:35:09 oleg421-client sshd[59451]: Disconnected from user root 192.168.204.21 port 49236 Apr 3 02:35:09 oleg421-client sshd[59430]: pam_unix(sshd:session): session closed for user root Apr 3 02:35:09 oleg421-client systemd[1]: session-295.scope: Succeeded. Apr 3 02:35:09 oleg421-client systemd-logind[1011]: Session 295 logged out. Waiting for processes to exit. Apr 3 02:35:09 oleg421-client systemd-logind[1011]: Removed session 295. Apr 3 02:35:10 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962446bf0800: operation mds_reint to node 192.168.204.121@tcp failed: rc = -19 Apr 3 02:35:26 oleg421-client kernel: LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 192.168.204.121@tcp) was lost; in progress operations using this service will fail Apr 3 02:35:37 oleg421-client kernel: Lustre: Evicted from MGS (at 192.168.204.121@tcp) after server handle changed from 0x1d1756950d0d3d53 to 0x1d1756950d0ff9c3 Apr 3 02:37:36 oleg421-client sshd[59991]: Accepted publickey for root from 192.168.204.21 port 54892 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:37:37 oleg421-client systemd-logind[1011]: New session 296 of user root. Apr 3 02:37:37 oleg421-client systemd[1]: Started Session 296 of user root. Apr 3 02:37:37 oleg421-client sshd[59991]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:37:37 oleg421-client sshd[60005]: Received disconnect from 192.168.204.21 port 54892:11: disconnected by user Apr 3 02:37:37 oleg421-client sshd[60005]: Disconnected from user root 192.168.204.21 port 54892 Apr 3 02:37:37 oleg421-client sshd[59991]: pam_unix(sshd:session): session closed for user root Apr 3 02:37:38 oleg421-client systemd-logind[1011]: Session 296 logged out. Waiting for processes to exit. Apr 3 02:37:38 oleg421-client systemd[1]: session-296.scope: Succeeded. Apr 3 02:37:38 oleg421-client systemd-logind[1011]: Removed session 296. Apr 3 02:37:39 oleg421-client sshd[60131]: Accepted publickey for root from 192.168.204.21 port 47430 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:37:39 oleg421-client systemd-logind[1011]: New session 297 of user root. Apr 3 02:37:39 oleg421-client systemd[1]: Started Session 297 of user root. Apr 3 02:37:39 oleg421-client sshd[60131]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:37:39 oleg421-client sshd[60144]: Received disconnect from 192.168.204.21 port 47430:11: disconnected by user Apr 3 02:37:39 oleg421-client sshd[60144]: Disconnected from user root 192.168.204.21 port 47430 Apr 3 02:37:39 oleg421-client sshd[60131]: pam_unix(sshd:session): session closed for user root Apr 3 02:37:39 oleg421-client systemd[1]: session-297.scope: Succeeded. Apr 3 02:37:39 oleg421-client systemd-logind[1011]: Session 297 logged out. Waiting for processes to exit. Apr 3 02:37:40 oleg421-client systemd-logind[1011]: Removed session 297. Apr 3 02:37:41 oleg421-client sshd[60277]: Accepted publickey for root from 192.168.204.21 port 47432 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:37:41 oleg421-client systemd[1]: Started Session 298 of user root. Apr 3 02:37:41 oleg421-client sshd[60277]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:37:41 oleg421-client systemd-logind[1011]: New session 298 of user root. Apr 3 02:37:41 oleg421-client sshd[60290]: Received disconnect from 192.168.204.21 port 47432:11: disconnected by user Apr 3 02:37:41 oleg421-client sshd[60290]: Disconnected from user root 192.168.204.21 port 47432 Apr 3 02:37:41 oleg421-client sshd[60277]: pam_unix(sshd:session): session closed for user root Apr 3 02:37:41 oleg421-client systemd[1]: session-298.scope: Succeeded. Apr 3 02:37:41 oleg421-client systemd-logind[1011]: Session 298 logged out. Waiting for processes to exit. Apr 3 02:37:41 oleg421-client systemd-logind[1011]: Removed session 298. Apr 3 02:37:48 oleg421-client sshd[60479]: Accepted publickey for root from 192.168.204.21 port 59942 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:37:48 oleg421-client systemd[1]: Started Session 299 of user root. Apr 3 02:37:48 oleg421-client systemd-logind[1011]: New session 299 of user root. Apr 3 02:37:48 oleg421-client sshd[60479]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:37:49 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 61: Verify to not reuse orphan objects - bug 17025 ========================================================== 02:37:47 (1775198267) Apr 3 02:37:49 oleg421-client sshd[60492]: Received disconnect from 192.168.204.21 port 59942:11: disconnected by user Apr 3 02:37:49 oleg421-client sshd[60492]: Disconnected from user root 192.168.204.21 port 59942 Apr 3 02:37:49 oleg421-client sshd[60479]: pam_unix(sshd:session): session closed for user root Apr 3 02:37:49 oleg421-client systemd[1]: session-299.scope: Succeeded. Apr 3 02:37:49 oleg421-client systemd-logind[1011]: Session 299 logged out. Waiting for processes to exit. Apr 3 02:37:49 oleg421-client systemd-logind[1011]: Removed session 299. Apr 3 02:38:00 oleg421-client kernel: Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 Apr 3 02:38:05 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962446bf0800: Connection to lustre-MDT0000 (at 192.168.204.121@tcp) was lost; in progress operations using this service will wait for recovery to complete Apr 3 02:38:05 oleg421-client kernel: Lustre: Skipped 12 previous similar messages Apr 3 02:38:21 oleg421-client kernel: Lustre: 2403:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775198285/real 1775198285] req@ffff9624435f4e00 x1861425393469440/t0(0) o400->MGC192.168.204.121@tcp@192.168.204.121@tcp:26/25 lens 224/224 e 0 to 1 dl 1775198301 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 Apr 3 02:38:21 oleg421-client kernel: Lustre: 2403:0:(client.c:2479:ptlrpc_expire_one_request()) Skipped 39 previous similar messages Apr 3 02:38:21 oleg421-client kernel: LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 192.168.204.121@tcp) was lost; in progress operations using this service will fail Apr 3 02:38:21 oleg421-client kernel: Lustre: Evicted from MGS (at 192.168.204.121@tcp) after server handle changed from 0x1d1756950d0ff9c3 to 0x1d1756950d13b726 Apr 3 02:38:21 oleg421-client kernel: Lustre: MGC192.168.204.121@tcp: Connection restored to 192.168.204.121@tcp (at 192.168.204.121@tcp) Apr 3 02:38:21 oleg421-client kernel: Lustre: Skipped 14 previous similar messages Apr 3 02:38:21 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962446bf0800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Apr 3 02:38:27 oleg421-client sshd[60950]: Accepted publickey for root from 192.168.204.21 port 57294 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:38:27 oleg421-client systemd-logind[1011]: New session 300 of user root. Apr 3 02:38:27 oleg421-client systemd[1]: Started Session 300 of user root. Apr 3 02:38:27 oleg421-client sshd[60950]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:38:28 oleg421-client sshd[60964]: Received disconnect from 192.168.204.21 port 57294:11: disconnected by user Apr 3 02:38:28 oleg421-client sshd[60964]: Disconnected from user root 192.168.204.21 port 57294 Apr 3 02:38:28 oleg421-client sshd[60950]: pam_unix(sshd:session): session closed for user root Apr 3 02:38:28 oleg421-client systemd[1]: session-300.scope: Succeeded. Apr 3 02:38:28 oleg421-client systemd-logind[1011]: Session 300 logged out. Waiting for processes to exit. Apr 3 02:38:28 oleg421-client systemd-logind[1011]: Removed session 300. Apr 3 02:38:29 oleg421-client sshd[61003]: Accepted publickey for root from 192.168.204.21 port 57302 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:38:29 oleg421-client systemd-logind[1011]: New session 301 of user root. Apr 3 02:38:29 oleg421-client systemd[1]: Started Session 301 of user root. Apr 3 02:38:29 oleg421-client sshd[61003]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:38:30 oleg421-client sshd[61016]: Received disconnect from 192.168.204.21 port 57302:11: disconnected by user Apr 3 02:38:30 oleg421-client sshd[61016]: Disconnected from user root 192.168.204.21 port 57302 Apr 3 02:38:30 oleg421-client sshd[61003]: pam_unix(sshd:session): session closed for user root Apr 3 02:38:30 oleg421-client systemd[1]: session-301.scope: Succeeded. Apr 3 02:38:30 oleg421-client systemd-logind[1011]: Session 301 logged out. Waiting for processes to exit. Apr 3 02:38:30 oleg421-client systemd-logind[1011]: Removed session 301. Apr 3 02:38:39 oleg421-client sshd[61253]: Accepted publickey for root from 192.168.204.21 port 41296 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:38:39 oleg421-client systemd[1]: Started Session 302 of user root. Apr 3 02:38:39 oleg421-client systemd-logind[1011]: New session 302 of user root. Apr 3 02:38:39 oleg421-client sshd[61253]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:38:40 oleg421-client sshd[61266]: Received disconnect from 192.168.204.21 port 41296:11: disconnected by user Apr 3 02:38:40 oleg421-client sshd[61266]: Disconnected from user root 192.168.204.21 port 41296 Apr 3 02:38:40 oleg421-client sshd[61253]: pam_unix(sshd:session): session closed for user root Apr 3 02:38:40 oleg421-client systemd-logind[1011]: Session 302 logged out. Waiting for processes to exit. Apr 3 02:38:40 oleg421-client systemd[1]: session-302.scope: Succeeded. Apr 3 02:38:40 oleg421-client systemd-logind[1011]: Removed session 302. Apr 3 02:38:41 oleg421-client sshd[61393]: Accepted publickey for root from 192.168.204.21 port 41310 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:38:41 oleg421-client systemd-logind[1011]: New session 303 of user root. Apr 3 02:38:41 oleg421-client systemd[1]: Started Session 303 of user root. Apr 3 02:38:41 oleg421-client sshd[61393]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:38:41 oleg421-client sshd[61406]: Received disconnect from 192.168.204.21 port 41310:11: disconnected by user Apr 3 02:38:41 oleg421-client sshd[61406]: Disconnected from user root 192.168.204.21 port 41310 Apr 3 02:38:41 oleg421-client sshd[61393]: pam_unix(sshd:session): session closed for user root Apr 3 02:38:42 oleg421-client systemd[1]: session-303.scope: Succeeded. Apr 3 02:38:42 oleg421-client systemd-logind[1011]: Session 303 logged out. Waiting for processes to exit. Apr 3 02:38:42 oleg421-client systemd-logind[1011]: Removed session 303. Apr 3 02:38:43 oleg421-client sshd[61539]: Accepted publickey for root from 192.168.204.21 port 41322 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:38:43 oleg421-client systemd-logind[1011]: New session 304 of user root. Apr 3 02:38:43 oleg421-client systemd[1]: Started Session 304 of user root. Apr 3 02:38:43 oleg421-client sshd[61539]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:38:43 oleg421-client sshd[61552]: Received disconnect from 192.168.204.21 port 41322:11: disconnected by user Apr 3 02:38:43 oleg421-client sshd[61552]: Disconnected from user root 192.168.204.21 port 41322 Apr 3 02:38:43 oleg421-client sshd[61539]: pam_unix(sshd:session): session closed for user root Apr 3 02:38:43 oleg421-client systemd-logind[1011]: Session 304 logged out. Waiting for processes to exit. Apr 3 02:38:43 oleg421-client systemd[1]: session-304.scope: Succeeded. Apr 3 02:38:43 oleg421-client systemd-logind[1011]: Removed session 304. Apr 3 02:38:45 oleg421-client sshd[61694]: Accepted publickey for root from 192.168.204.21 port 41328 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:38:45 oleg421-client systemd-logind[1011]: New session 305 of user root. Apr 3 02:38:45 oleg421-client systemd[1]: Started Session 305 of user root. Apr 3 02:38:45 oleg421-client sshd[61694]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:38:45 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 65: lock enqueue for destroyed export ========================================================== 02:38:44 (1775198324) Apr 3 02:38:45 oleg421-client sshd[61708]: Received disconnect from 192.168.204.21 port 41328:11: disconnected by user Apr 3 02:38:45 oleg421-client sshd[61708]: Disconnected from user root 192.168.204.21 port 41328 Apr 3 02:38:45 oleg421-client sshd[61694]: pam_unix(sshd:session): session closed for user root Apr 3 02:38:46 oleg421-client systemd[1]: session-305.scope: Succeeded. Apr 3 02:38:46 oleg421-client systemd-logind[1011]: Session 305 logged out. Waiting for processes to exit. Apr 3 02:38:46 oleg421-client systemd-logind[1011]: Removed session 305. Apr 3 02:38:46 oleg421-client systemd-udevd[61763]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Apr 3 02:38:46 oleg421-client kernel: Lustre: Mounted lustre-client Apr 3 02:38:54 oleg421-client kernel: LustreError: lustre-OST0000-osc-ffff962446bf0800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Apr 3 02:38:54 oleg421-client kernel: LustreError: 61813:0:(ldlm_resource.c:1170:ldlm_resource_complain()) lustre-OST0000-osc-ffff962446bf0800: namespace resource [0x280000401:0x3403:0x0].0x0 (ffff9624442f7100) refcount nonzero (1) after lock cleanup; forcing cleanup. Apr 3 02:39:07 oleg421-client systemd[1]: mnt-lustre2.mount: Succeeded. Apr 3 02:39:07 oleg421-client kernel: LustreError: 61843:0:(lov_obd.c:786:lov_cleanup()) lustre-clilov-ffff9624447bb800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Apr 3 02:39:07 oleg421-client kernel: LustreError: 61843:0:(lov_obd.c:786:lov_cleanup()) Skipped 1 previous similar message Apr 3 02:39:07 oleg421-client kernel: Lustre: Unmounted lustre-client Apr 3 02:39:09 oleg421-client sshd[61932]: Accepted publickey for root from 192.168.204.21 port 52374 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:39:09 oleg421-client systemd-logind[1011]: New session 306 of user root. Apr 3 02:39:09 oleg421-client systemd[1]: Started Session 306 of user root. Apr 3 02:39:09 oleg421-client sshd[61932]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:39:09 oleg421-client sshd[61945]: Received disconnect from 192.168.204.21 port 52374:11: disconnected by user Apr 3 02:39:09 oleg421-client sshd[61945]: Disconnected from user root 192.168.204.21 port 52374 Apr 3 02:39:09 oleg421-client sshd[61932]: pam_unix(sshd:session): session closed for user root Apr 3 02:39:09 oleg421-client systemd[1]: session-306.scope: Succeeded. Apr 3 02:39:09 oleg421-client systemd-logind[1011]: Session 306 logged out. Waiting for processes to exit. Apr 3 02:39:09 oleg421-client systemd-logind[1011]: Removed session 306. Apr 3 02:39:11 oleg421-client sshd[62071]: Accepted publickey for root from 192.168.204.21 port 52388 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:39:11 oleg421-client systemd-logind[1011]: New session 307 of user root. Apr 3 02:39:11 oleg421-client systemd[1]: Started Session 307 of user root. Apr 3 02:39:11 oleg421-client sshd[62071]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:39:11 oleg421-client sshd[62084]: Received disconnect from 192.168.204.21 port 52388:11: disconnected by user Apr 3 02:39:11 oleg421-client sshd[62084]: Disconnected from user root 192.168.204.21 port 52388 Apr 3 02:39:11 oleg421-client sshd[62071]: pam_unix(sshd:session): session closed for user root Apr 3 02:39:12 oleg421-client systemd-logind[1011]: Session 307 logged out. Waiting for processes to exit. Apr 3 02:39:12 oleg421-client systemd[1]: session-307.scope: Succeeded. Apr 3 02:39:12 oleg421-client systemd-logind[1011]: Removed session 307. Apr 3 02:39:13 oleg421-client sshd[62217]: Accepted publickey for root from 192.168.204.21 port 52390 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:39:13 oleg421-client systemd-logind[1011]: New session 308 of user root. Apr 3 02:39:13 oleg421-client systemd[1]: Started Session 308 of user root. Apr 3 02:39:13 oleg421-client sshd[62217]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:39:13 oleg421-client sshd[62230]: Received disconnect from 192.168.204.21 port 52390:11: disconnected by user Apr 3 02:39:13 oleg421-client sshd[62230]: Disconnected from user root 192.168.204.21 port 52390 Apr 3 02:39:13 oleg421-client sshd[62217]: pam_unix(sshd:session): session closed for user root Apr 3 02:39:13 oleg421-client systemd-logind[1011]: Session 308 logged out. Waiting for processes to exit. Apr 3 02:39:13 oleg421-client systemd[1]: session-308.scope: Succeeded. Apr 3 02:39:13 oleg421-client systemd-logind[1011]: Removed session 308. Apr 3 02:39:15 oleg421-client sshd[62373]: Accepted publickey for root from 192.168.204.21 port 52394 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:39:15 oleg421-client systemd-logind[1011]: New session 309 of user root. Apr 3 02:39:15 oleg421-client systemd[1]: Started Session 309 of user root. Apr 3 02:39:15 oleg421-client sshd[62373]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:39:15 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 66: lock enqueue re-send vs client eviction ========================================================== 02:39:14 (1775198354) Apr 3 02:39:15 oleg421-client sshd[62386]: Received disconnect from 192.168.204.21 port 52394:11: disconnected by user Apr 3 02:39:15 oleg421-client sshd[62386]: Disconnected from user root 192.168.204.21 port 52394 Apr 3 02:39:15 oleg421-client sshd[62373]: pam_unix(sshd:session): session closed for user root Apr 3 02:39:15 oleg421-client systemd[1]: session-309.scope: Succeeded. Apr 3 02:39:15 oleg421-client systemd-logind[1011]: Session 309 logged out. Waiting for processes to exit. Apr 3 02:39:15 oleg421-client systemd-logind[1011]: Removed session 309. Apr 3 02:39:22 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962446bf0800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Apr 3 02:39:22 oleg421-client kernel: LustreError: 62496:0:(file.c:6097:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -5 Apr 3 02:39:24 oleg421-client sshd[62712]: Accepted publickey for root from 192.168.204.21 port 54234 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:39:24 oleg421-client systemd-logind[1011]: New session 310 of user root. Apr 3 02:39:24 oleg421-client systemd[1]: Started Session 310 of user root. Apr 3 02:39:24 oleg421-client sshd[62712]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:39:25 oleg421-client sshd[62725]: Received disconnect from 192.168.204.21 port 54234:11: disconnected by user Apr 3 02:39:25 oleg421-client sshd[62725]: Disconnected from user root 192.168.204.21 port 54234 Apr 3 02:39:25 oleg421-client sshd[62712]: pam_unix(sshd:session): session closed for user root Apr 3 02:39:25 oleg421-client systemd-logind[1011]: Session 310 logged out. Waiting for processes to exit. Apr 3 02:39:25 oleg421-client systemd[1]: session-310.scope: Succeeded. Apr 3 02:39:25 oleg421-client systemd-logind[1011]: Removed session 310. Apr 3 02:39:26 oleg421-client sshd[62851]: Accepted publickey for root from 192.168.204.21 port 54236 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:39:26 oleg421-client systemd-logind[1011]: New session 311 of user root. Apr 3 02:39:26 oleg421-client systemd[1]: Started Session 311 of user root. Apr 3 02:39:26 oleg421-client sshd[62851]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:39:26 oleg421-client sshd[62864]: Received disconnect from 192.168.204.21 port 54236:11: disconnected by user Apr 3 02:39:26 oleg421-client sshd[62864]: Disconnected from user root 192.168.204.21 port 54236 Apr 3 02:39:26 oleg421-client sshd[62851]: pam_unix(sshd:session): session closed for user root Apr 3 02:39:26 oleg421-client systemd-logind[1011]: Session 311 logged out. Waiting for processes to exit. Apr 3 02:39:26 oleg421-client systemd[1]: session-311.scope: Succeeded. Apr 3 02:39:27 oleg421-client systemd-logind[1011]: Removed session 311. Apr 3 02:39:27 oleg421-client sshd[62997]: Accepted publickey for root from 192.168.204.21 port 60300 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:39:27 oleg421-client systemd[1]: Started Session 312 of user root. Apr 3 02:39:27 oleg421-client systemd-logind[1011]: New session 312 of user root. Apr 3 02:39:27 oleg421-client sshd[62997]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:39:28 oleg421-client sshd[63011]: Received disconnect from 192.168.204.21 port 60300:11: disconnected by user Apr 3 02:39:28 oleg421-client sshd[63011]: Disconnected from user root 192.168.204.21 port 60300 Apr 3 02:39:28 oleg421-client sshd[62997]: pam_unix(sshd:session): session closed for user root Apr 3 02:39:28 oleg421-client systemd[1]: session-312.scope: Succeeded. Apr 3 02:39:28 oleg421-client systemd-logind[1011]: Session 312 logged out. Waiting for processes to exit. Apr 3 02:39:28 oleg421-client systemd-logind[1011]: Removed session 312. Apr 3 02:39:30 oleg421-client sshd[63153]: Accepted publickey for root from 192.168.204.21 port 60310 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:39:30 oleg421-client systemd-logind[1011]: New session 313 of user root. Apr 3 02:39:30 oleg421-client systemd[1]: Started Session 313 of user root. Apr 3 02:39:30 oleg421-client sshd[63153]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:39:31 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 67: connect vs import invalidate race ========================================================== 02:39:29 (1775198369) Apr 3 02:39:31 oleg421-client sshd[63166]: Received disconnect from 192.168.204.21 port 60310:11: disconnected by user Apr 3 02:39:31 oleg421-client sshd[63166]: Disconnected from user root 192.168.204.21 port 60310 Apr 3 02:39:31 oleg421-client sshd[63153]: pam_unix(sshd:session): session closed for user root Apr 3 02:39:31 oleg421-client kernel: LustreError: 63205:0:(recover.c:330:ptlrpc_recover_import()) cfs_race id 531 sleeping Apr 3 02:39:31 oleg421-client systemd[1]: session-313.scope: Succeeded. Apr 3 02:39:31 oleg421-client systemd-logind[1011]: Session 313 logged out. Waiting for processes to exit. Apr 3 02:39:31 oleg421-client systemd-logind[1011]: Removed session 313. Apr 3 02:39:36 oleg421-client kernel: LustreError: 63205:0:(recover.c:330:ptlrpc_recover_import()) cfs_fail_race id 531 awake: rc=0 Apr 3 02:39:36 oleg421-client kernel: LustreError: 63205:0:(import.c:710:ptlrpc_connect_import_locked()) already connected Apr 3 02:39:37 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962446bf0800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Apr 3 02:39:37 oleg421-client kernel: LustreError: 63224:0:(import.c:291:ptlrpc_invalidate_import()) cfs_fail_race id 531 waking Apr 3 02:39:37 oleg421-client kernel: LustreError: 63229:0:(file.c:6097:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 Apr 3 02:39:39 oleg421-client kernel: LustreError: 63235:0:(file.c:6097:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 Apr 3 02:39:39 oleg421-client kernel: LustreError: 63235:0:(file.c:6097:ll_inode_revalidate_fini()) Skipped 5 previous similar messages Apr 3 02:39:41 oleg421-client kernel: LustreError: 63258:0:(file.c:6097:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 Apr 3 02:39:41 oleg421-client kernel: LustreError: 63258:0:(file.c:6097:ll_inode_revalidate_fini()) Skipped 13 previous similar messages Apr 3 02:39:46 oleg421-client kernel: LustreError: 63303:0:(file.c:6097:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 Apr 3 02:39:46 oleg421-client kernel: LustreError: 63303:0:(file.c:6097:ll_inode_revalidate_fini()) Skipped 27 previous similar messages Apr 3 02:39:50 oleg421-client sshd[63423]: Accepted publickey for root from 192.168.204.21 port 54972 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:39:50 oleg421-client systemd[1]: Started Session 314 of user root. Apr 3 02:39:50 oleg421-client systemd-logind[1011]: New session 314 of user root. Apr 3 02:39:50 oleg421-client rsyslogd[1073]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Apr 3 02:39:50 oleg421-client sshd[63423]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:39:50 oleg421-client sshd[63437]: Received disconnect from 192.168.204.21 port 54972:11: disconnected by user Apr 3 02:39:50 oleg421-client sshd[63437]: Disconnected from user root 192.168.204.21 port 54972 Apr 3 02:39:50 oleg421-client sshd[63423]: pam_unix(sshd:session): session closed for user root Apr 3 02:39:51 oleg421-client systemd[1]: session-314.scope: Succeeded. Apr 3 02:39:51 oleg421-client systemd-logind[1011]: Session 314 logged out. Waiting for processes to exit. Apr 3 02:39:51 oleg421-client systemd-logind[1011]: Removed session 314. Apr 3 02:39:52 oleg421-client sshd[63563]: Accepted publickey for root from 192.168.204.21 port 54986 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:39:52 oleg421-client systemd-logind[1011]: New session 315 of user root. Apr 3 02:39:52 oleg421-client systemd[1]: Started Session 315 of user root. Apr 3 02:39:52 oleg421-client sshd[63563]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:39:53 oleg421-client sshd[63576]: Received disconnect from 192.168.204.21 port 54986:11: disconnected by user Apr 3 02:39:53 oleg421-client sshd[63576]: Disconnected from user root 192.168.204.21 port 54986 Apr 3 02:39:53 oleg421-client sshd[63563]: pam_unix(sshd:session): session closed for user root Apr 3 02:39:53 oleg421-client systemd-logind[1011]: Session 315 logged out. Waiting for processes to exit. Apr 3 02:39:53 oleg421-client systemd[1]: session-315.scope: Succeeded. Apr 3 02:39:53 oleg421-client systemd-logind[1011]: Removed session 315. Apr 3 02:39:54 oleg421-client sshd[63709]: Accepted publickey for root from 192.168.204.21 port 54994 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:39:54 oleg421-client systemd-logind[1011]: New session 316 of user root. Apr 3 02:39:54 oleg421-client systemd[1]: Started Session 316 of user root. Apr 3 02:39:54 oleg421-client sshd[63709]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:39:55 oleg421-client sshd[63723]: Received disconnect from 192.168.204.21 port 54994:11: disconnected by user Apr 3 02:39:55 oleg421-client sshd[63723]: Disconnected from user root 192.168.204.21 port 54994 Apr 3 02:39:55 oleg421-client sshd[63709]: pam_unix(sshd:session): session closed for user root Apr 3 02:39:55 oleg421-client systemd[1]: session-316.scope: Succeeded. Apr 3 02:39:55 oleg421-client systemd-logind[1011]: Session 316 logged out. Waiting for processes to exit. Apr 3 02:39:55 oleg421-client systemd-logind[1011]: Removed session 316. Apr 3 02:39:56 oleg421-client sshd[63865]: Accepted publickey for root from 192.168.204.21 port 55006 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:39:56 oleg421-client systemd-logind[1011]: New session 317 of user root. Apr 3 02:39:56 oleg421-client systemd[1]: Started Session 317 of user root. Apr 3 02:39:56 oleg421-client sshd[63865]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:39:57 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 100: IR: Make sure normal recovery still works w/o IR ========================================================== 02:39:55 (1775198395) Apr 3 02:39:57 oleg421-client sshd[63878]: Received disconnect from 192.168.204.21 port 55006:11: disconnected by user Apr 3 02:39:57 oleg421-client sshd[63878]: Disconnected from user root 192.168.204.21 port 55006 Apr 3 02:39:57 oleg421-client sshd[63865]: pam_unix(sshd:session): session closed for user root Apr 3 02:39:57 oleg421-client systemd[1]: session-317.scope: Succeeded. Apr 3 02:39:57 oleg421-client systemd-logind[1011]: Session 317 logged out. Waiting for processes to exit. Apr 3 02:39:57 oleg421-client systemd-logind[1011]: Removed session 317. Apr 3 02:40:32 oleg421-client sshd[64230]: Accepted publickey for root from 192.168.204.21 port 41402 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:40:32 oleg421-client systemd-logind[1011]: New session 318 of user root. Apr 3 02:40:32 oleg421-client systemd[1]: Started Session 318 of user root. Apr 3 02:40:32 oleg421-client sshd[64230]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:40:33 oleg421-client sshd[64243]: Received disconnect from 192.168.204.21 port 41402:11: disconnected by user Apr 3 02:40:33 oleg421-client sshd[64243]: Disconnected from user root 192.168.204.21 port 41402 Apr 3 02:40:33 oleg421-client sshd[64230]: pam_unix(sshd:session): session closed for user root Apr 3 02:40:33 oleg421-client systemd-logind[1011]: Session 318 logged out. Waiting for processes to exit. Apr 3 02:40:33 oleg421-client systemd[1]: session-318.scope: Succeeded. Apr 3 02:40:33 oleg421-client systemd-logind[1011]: Removed session 318. Apr 3 02:40:36 oleg421-client sshd[64467]: Accepted publickey for root from 192.168.204.21 port 41410 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:40:36 oleg421-client systemd[1]: Started Session 319 of user root. Apr 3 02:40:36 oleg421-client systemd-logind[1011]: New session 319 of user root. Apr 3 02:40:36 oleg421-client sshd[64467]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:40:36 oleg421-client kernel: Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid Apr 3 02:40:36 oleg421-client sshd[64480]: Received disconnect from 192.168.204.21 port 41410:11: disconnected by user Apr 3 02:40:36 oleg421-client sshd[64480]: Disconnected from user root 192.168.204.21 port 41410 Apr 3 02:40:36 oleg421-client sshd[64467]: pam_unix(sshd:session): session closed for user root Apr 3 02:40:36 oleg421-client systemd[1]: session-319.scope: Succeeded. Apr 3 02:40:36 oleg421-client systemd-logind[1011]: Session 319 logged out. Waiting for processes to exit. Apr 3 02:40:36 oleg421-client systemd-logind[1011]: Removed session 319. Apr 3 02:40:37 oleg421-client sshd[64623]: Accepted publickey for root from 192.168.204.21 port 36916 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:40:37 oleg421-client systemd-logind[1011]: New session 320 of user root. Apr 3 02:40:37 oleg421-client systemd[1]: Started Session 320 of user root. Apr 3 02:40:37 oleg421-client sshd[64623]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:40:38 oleg421-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec Apr 3 02:40:38 oleg421-client sshd[64636]: Received disconnect from 192.168.204.21 port 36916:11: disconnected by user Apr 3 02:40:38 oleg421-client sshd[64636]: Disconnected from user root 192.168.204.21 port 36916 Apr 3 02:40:38 oleg421-client sshd[64623]: pam_unix(sshd:session): session closed for user root Apr 3 02:40:38 oleg421-client systemd[1]: session-320.scope: Succeeded. Apr 3 02:40:38 oleg421-client systemd-logind[1011]: Session 320 logged out. Waiting for processes to exit. Apr 3 02:40:38 oleg421-client systemd-logind[1011]: Removed session 320. Apr 3 02:40:39 oleg421-client sshd[64678]: Accepted publickey for root from 192.168.204.21 port 36932 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:40:39 oleg421-client systemd-logind[1011]: New session 321 of user root. Apr 3 02:40:39 oleg421-client systemd[1]: Started Session 321 of user root. Apr 3 02:40:39 oleg421-client sshd[64678]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:40:40 oleg421-client sshd[64691]: Received disconnect from 192.168.204.21 port 36932:11: disconnected by user Apr 3 02:40:40 oleg421-client sshd[64691]: Disconnected from user root 192.168.204.21 port 36932 Apr 3 02:40:40 oleg421-client sshd[64678]: pam_unix(sshd:session): session closed for user root Apr 3 02:40:40 oleg421-client systemd-logind[1011]: Session 321 logged out. Waiting for processes to exit. Apr 3 02:40:40 oleg421-client systemd[1]: session-321.scope: Succeeded. Apr 3 02:40:40 oleg421-client systemd-logind[1011]: Removed session 321. Apr 3 02:40:43 oleg421-client sshd[64842]: Accepted publickey for root from 192.168.204.21 port 36936 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:40:43 oleg421-client systemd-logind[1011]: New session 322 of user root. Apr 3 02:40:43 oleg421-client systemd[1]: Started Session 322 of user root. Apr 3 02:40:43 oleg421-client sshd[64842]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:40:43 oleg421-client sshd[64855]: Received disconnect from 192.168.204.21 port 36936:11: disconnected by user Apr 3 02:40:43 oleg421-client sshd[64855]: Disconnected from user root 192.168.204.21 port 36936 Apr 3 02:40:43 oleg421-client sshd[64842]: pam_unix(sshd:session): session closed for user root Apr 3 02:40:43 oleg421-client systemd[1]: session-322.scope: Succeeded. Apr 3 02:40:43 oleg421-client systemd-logind[1011]: Session 322 logged out. Waiting for processes to exit. Apr 3 02:40:43 oleg421-client systemd-logind[1011]: Removed session 322. Apr 3 02:40:44 oleg421-client sshd[64981]: Accepted publickey for root from 192.168.204.21 port 36948 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:40:44 oleg421-client systemd-logind[1011]: New session 323 of user root. Apr 3 02:40:44 oleg421-client systemd[1]: Started Session 323 of user root. Apr 3 02:40:44 oleg421-client sshd[64981]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:40:44 oleg421-client sshd[64994]: Received disconnect from 192.168.204.21 port 36948:11: disconnected by user Apr 3 02:40:44 oleg421-client sshd[64994]: Disconnected from user root 192.168.204.21 port 36948 Apr 3 02:40:44 oleg421-client sshd[64981]: pam_unix(sshd:session): session closed for user root Apr 3 02:40:44 oleg421-client systemd[1]: session-323.scope: Succeeded. Apr 3 02:40:44 oleg421-client systemd-logind[1011]: Session 323 logged out. Waiting for processes to exit. Apr 3 02:40:44 oleg421-client systemd-logind[1011]: Removed session 323. Apr 3 02:40:46 oleg421-client sshd[65129]: Accepted publickey for root from 192.168.204.21 port 36956 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:40:46 oleg421-client systemd[1]: Started Session 324 of user root. Apr 3 02:40:46 oleg421-client systemd-logind[1011]: New session 324 of user root. Apr 3 02:40:46 oleg421-client sshd[65129]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:40:46 oleg421-client sshd[65142]: Received disconnect from 192.168.204.21 port 36956:11: disconnected by user Apr 3 02:40:46 oleg421-client sshd[65142]: Disconnected from user root 192.168.204.21 port 36956 Apr 3 02:40:46 oleg421-client sshd[65129]: pam_unix(sshd:session): session closed for user root Apr 3 02:40:46 oleg421-client systemd-logind[1011]: Session 324 logged out. Waiting for processes to exit. Apr 3 02:40:46 oleg421-client systemd[1]: session-324.scope: Succeeded. Apr 3 02:40:46 oleg421-client systemd-logind[1011]: Removed session 324. Apr 3 02:40:48 oleg421-client sshd[65284]: Accepted publickey for root from 192.168.204.21 port 57720 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:40:48 oleg421-client systemd-logind[1011]: New session 325 of user root. Apr 3 02:40:48 oleg421-client systemd[1]: Started Session 325 of user root. Apr 3 02:40:48 oleg421-client sshd[65284]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:40:49 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 101a: IR: Make sure IR works w/o normal recovery ========================================================== 02:40:47 (1775198447) Apr 3 02:40:49 oleg421-client sshd[65297]: Received disconnect from 192.168.204.21 port 57720:11: disconnected by user Apr 3 02:40:49 oleg421-client sshd[65297]: Disconnected from user root 192.168.204.21 port 57720 Apr 3 02:40:49 oleg421-client sshd[65284]: pam_unix(sshd:session): session closed for user root Apr 3 02:40:49 oleg421-client systemd[1]: session-325.scope: Succeeded. Apr 3 02:40:49 oleg421-client systemd-logind[1011]: Session 325 logged out. Waiting for processes to exit. Apr 3 02:40:49 oleg421-client systemd-logind[1011]: Removed session 325. Apr 3 02:41:22 oleg421-client sshd[65624]: Accepted publickey for root from 192.168.204.21 port 44508 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:41:22 oleg421-client systemd[1]: Started Session 326 of user root. Apr 3 02:41:22 oleg421-client systemd-logind[1011]: New session 326 of user root. Apr 3 02:41:22 oleg421-client sshd[65624]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:41:22 oleg421-client sshd[65637]: Received disconnect from 192.168.204.21 port 44508:11: disconnected by user Apr 3 02:41:22 oleg421-client sshd[65637]: Disconnected from user root 192.168.204.21 port 44508 Apr 3 02:41:22 oleg421-client sshd[65624]: pam_unix(sshd:session): session closed for user root Apr 3 02:41:22 oleg421-client systemd-logind[1011]: Session 326 logged out. Waiting for processes to exit. Apr 3 02:41:22 oleg421-client systemd[1]: session-326.scope: Succeeded. Apr 3 02:41:22 oleg421-client systemd-logind[1011]: Removed session 326. Apr 3 02:41:26 oleg421-client sshd[65860]: Accepted publickey for root from 192.168.204.21 port 44514 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:41:26 oleg421-client systemd-logind[1011]: New session 327 of user root. Apr 3 02:41:26 oleg421-client systemd[1]: Started Session 327 of user root. Apr 3 02:41:26 oleg421-client sshd[65860]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:41:26 oleg421-client kernel: Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid Apr 3 02:41:26 oleg421-client sshd[65873]: Received disconnect from 192.168.204.21 port 44514:11: disconnected by user Apr 3 02:41:26 oleg421-client sshd[65873]: Disconnected from user root 192.168.204.21 port 44514 Apr 3 02:41:26 oleg421-client sshd[65860]: pam_unix(sshd:session): session closed for user root Apr 3 02:41:26 oleg421-client systemd[1]: session-327.scope: Succeeded. Apr 3 02:41:26 oleg421-client systemd-logind[1011]: Session 327 logged out. Waiting for processes to exit. Apr 3 02:41:26 oleg421-client systemd-logind[1011]: Removed session 327. Apr 3 02:41:28 oleg421-client sshd[66017]: Accepted publickey for root from 192.168.204.21 port 45152 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:41:28 oleg421-client systemd-logind[1011]: New session 328 of user root. Apr 3 02:41:28 oleg421-client systemd[1]: Started Session 328 of user root. Apr 3 02:41:28 oleg421-client sshd[66017]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:41:28 oleg421-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec Apr 3 02:41:28 oleg421-client sshd[66030]: Received disconnect from 192.168.204.21 port 45152:11: disconnected by user Apr 3 02:41:28 oleg421-client sshd[66030]: Disconnected from user root 192.168.204.21 port 45152 Apr 3 02:41:28 oleg421-client sshd[66017]: pam_unix(sshd:session): session closed for user root Apr 3 02:41:29 oleg421-client systemd-logind[1011]: Session 328 logged out. Waiting for processes to exit. Apr 3 02:41:29 oleg421-client systemd[1]: session-328.scope: Succeeded. Apr 3 02:41:29 oleg421-client systemd-logind[1011]: Removed session 328. Apr 3 02:41:30 oleg421-client sshd[66071]: Accepted publickey for root from 192.168.204.21 port 45160 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:41:30 oleg421-client systemd-logind[1011]: New session 329 of user root. Apr 3 02:41:30 oleg421-client systemd[1]: Started Session 329 of user root. Apr 3 02:41:30 oleg421-client sshd[66071]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:41:30 oleg421-client sshd[66084]: Received disconnect from 192.168.204.21 port 45160:11: disconnected by user Apr 3 02:41:30 oleg421-client sshd[66084]: Disconnected from user root 192.168.204.21 port 45160 Apr 3 02:41:30 oleg421-client sshd[66071]: pam_unix(sshd:session): session closed for user root Apr 3 02:41:31 oleg421-client systemd[1]: session-329.scope: Succeeded. Apr 3 02:41:31 oleg421-client systemd-logind[1011]: Session 329 logged out. Waiting for processes to exit. Apr 3 02:41:31 oleg421-client systemd-logind[1011]: Removed session 329. Apr 3 02:41:33 oleg421-client sshd[66237]: Accepted publickey for root from 192.168.204.21 port 45162 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:41:33 oleg421-client systemd-logind[1011]: New session 330 of user root. Apr 3 02:41:33 oleg421-client systemd[1]: Started Session 330 of user root. Apr 3 02:41:33 oleg421-client sshd[66237]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:41:34 oleg421-client sshd[66250]: Received disconnect from 192.168.204.21 port 45162:11: disconnected by user Apr 3 02:41:34 oleg421-client sshd[66250]: Disconnected from user root 192.168.204.21 port 45162 Apr 3 02:41:34 oleg421-client sshd[66237]: pam_unix(sshd:session): session closed for user root Apr 3 02:41:34 oleg421-client systemd[1]: session-330.scope: Succeeded. Apr 3 02:41:34 oleg421-client systemd-logind[1011]: Session 330 logged out. Waiting for processes to exit. Apr 3 02:41:34 oleg421-client systemd-logind[1011]: Removed session 330. Apr 3 02:41:35 oleg421-client sshd[66376]: Accepted publickey for root from 192.168.204.21 port 45170 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:41:35 oleg421-client systemd-logind[1011]: New session 331 of user root. Apr 3 02:41:35 oleg421-client systemd[1]: Started Session 331 of user root. Apr 3 02:41:35 oleg421-client sshd[66376]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:41:35 oleg421-client sshd[66389]: Received disconnect from 192.168.204.21 port 45170:11: disconnected by user Apr 3 02:41:35 oleg421-client sshd[66389]: Disconnected from user root 192.168.204.21 port 45170 Apr 3 02:41:35 oleg421-client sshd[66376]: pam_unix(sshd:session): session closed for user root Apr 3 02:41:36 oleg421-client systemd[1]: session-331.scope: Succeeded. Apr 3 02:41:36 oleg421-client systemd-logind[1011]: Session 331 logged out. Waiting for processes to exit. Apr 3 02:41:36 oleg421-client systemd-logind[1011]: Removed session 331. Apr 3 02:41:36 oleg421-client sshd[66522]: Accepted publickey for root from 192.168.204.21 port 45182 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:41:36 oleg421-client systemd[1]: Started Session 332 of user root. Apr 3 02:41:36 oleg421-client systemd-logind[1011]: New session 332 of user root. Apr 3 02:41:36 oleg421-client sshd[66522]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:41:37 oleg421-client sshd[66536]: Received disconnect from 192.168.204.21 port 45182:11: disconnected by user Apr 3 02:41:37 oleg421-client sshd[66536]: Disconnected from user root 192.168.204.21 port 45182 Apr 3 02:41:37 oleg421-client sshd[66522]: pam_unix(sshd:session): session closed for user root Apr 3 02:41:37 oleg421-client systemd[1]: session-332.scope: Succeeded. Apr 3 02:41:37 oleg421-client systemd-logind[1011]: Session 332 logged out. Waiting for processes to exit. Apr 3 02:41:37 oleg421-client systemd-logind[1011]: Removed session 332. Apr 3 02:41:38 oleg421-client sshd[66679]: Accepted publickey for root from 192.168.204.21 port 53928 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:41:38 oleg421-client systemd-logind[1011]: New session 333 of user root. Apr 3 02:41:38 oleg421-client systemd[1]: Started Session 333 of user root. Apr 3 02:41:38 oleg421-client sshd[66679]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:41:39 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 101b: IR: Make sure IR works w/o normal recovery and proceed EAGAIN ========================================================== 02:41:37 (1775198497) Apr 3 02:41:39 oleg421-client sshd[66692]: Received disconnect from 192.168.204.21 port 53928:11: disconnected by user Apr 3 02:41:39 oleg421-client sshd[66692]: Disconnected from user root 192.168.204.21 port 53928 Apr 3 02:41:39 oleg421-client sshd[66679]: pam_unix(sshd:session): session closed for user root Apr 3 02:41:39 oleg421-client systemd[1]: session-333.scope: Succeeded. Apr 3 02:41:39 oleg421-client systemd-logind[1011]: Session 333 logged out. Waiting for processes to exit. Apr 3 02:41:39 oleg421-client systemd-logind[1011]: Removed session 333. Apr 3 02:42:38 oleg421-client sshd[67031]: Accepted publickey for root from 192.168.204.21 port 40464 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:42:38 oleg421-client systemd-logind[1011]: New session 334 of user root. Apr 3 02:42:38 oleg421-client systemd[1]: Started Session 334 of user root. Apr 3 02:42:38 oleg421-client sshd[67031]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:42:38 oleg421-client sshd[67045]: Received disconnect from 192.168.204.21 port 40464:11: disconnected by user Apr 3 02:42:38 oleg421-client sshd[67045]: Disconnected from user root 192.168.204.21 port 40464 Apr 3 02:42:38 oleg421-client sshd[67031]: pam_unix(sshd:session): session closed for user root Apr 3 02:42:38 oleg421-client systemd-logind[1011]: Session 334 logged out. Waiting for processes to exit. Apr 3 02:42:38 oleg421-client systemd[1]: session-334.scope: Succeeded. Apr 3 02:42:38 oleg421-client systemd-logind[1011]: Removed session 334. Apr 3 02:42:41 oleg421-client sshd[67268]: Accepted publickey for root from 192.168.204.21 port 40468 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:42:41 oleg421-client systemd[1]: Started Session 335 of user root. Apr 3 02:42:41 oleg421-client systemd-logind[1011]: New session 335 of user root. Apr 3 02:42:41 oleg421-client sshd[67268]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:42:42 oleg421-client kernel: Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid Apr 3 02:42:42 oleg421-client sshd[67281]: Received disconnect from 192.168.204.21 port 40468:11: disconnected by user Apr 3 02:42:42 oleg421-client sshd[67281]: Disconnected from user root 192.168.204.21 port 40468 Apr 3 02:42:42 oleg421-client sshd[67268]: pam_unix(sshd:session): session closed for user root Apr 3 02:42:42 oleg421-client systemd-logind[1011]: Session 335 logged out. Waiting for processes to exit. Apr 3 02:42:42 oleg421-client systemd[1]: session-335.scope: Succeeded. Apr 3 02:42:42 oleg421-client systemd-logind[1011]: Removed session 335. Apr 3 02:42:43 oleg421-client sshd[67424]: Accepted publickey for root from 192.168.204.21 port 40482 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:42:43 oleg421-client systemd-logind[1011]: New session 336 of user root. Apr 3 02:42:43 oleg421-client systemd[1]: Started Session 336 of user root. Apr 3 02:42:43 oleg421-client sshd[67424]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:42:43 oleg421-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec Apr 3 02:42:43 oleg421-client sshd[67437]: Received disconnect from 192.168.204.21 port 40482:11: disconnected by user Apr 3 02:42:43 oleg421-client sshd[67437]: Disconnected from user root 192.168.204.21 port 40482 Apr 3 02:42:43 oleg421-client sshd[67424]: pam_unix(sshd:session): session closed for user root Apr 3 02:42:43 oleg421-client systemd-logind[1011]: Session 336 logged out. Waiting for processes to exit. Apr 3 02:42:43 oleg421-client systemd[1]: session-336.scope: Succeeded. Apr 3 02:42:43 oleg421-client systemd-logind[1011]: Removed session 336. Apr 3 02:42:45 oleg421-client sshd[67479]: Accepted publickey for root from 192.168.204.21 port 40496 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:42:45 oleg421-client systemd-logind[1011]: New session 337 of user root. Apr 3 02:42:45 oleg421-client systemd[1]: Started Session 337 of user root. Apr 3 02:42:45 oleg421-client sshd[67479]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:42:45 oleg421-client sshd[67492]: Received disconnect from 192.168.204.21 port 40496:11: disconnected by user Apr 3 02:42:45 oleg421-client sshd[67492]: Disconnected from user root 192.168.204.21 port 40496 Apr 3 02:42:45 oleg421-client sshd[67479]: pam_unix(sshd:session): session closed for user root Apr 3 02:42:45 oleg421-client systemd[1]: session-337.scope: Succeeded. Apr 3 02:42:45 oleg421-client systemd-logind[1011]: Session 337 logged out. Waiting for processes to exit. Apr 3 02:42:45 oleg421-client systemd-logind[1011]: Removed session 337. Apr 3 02:42:46 oleg421-client sshd[67611]: Accepted publickey for root from 192.168.204.21 port 40500 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:42:46 oleg421-client systemd-logind[1011]: New session 338 of user root. Apr 3 02:42:46 oleg421-client systemd[1]: Started Session 338 of user root. Apr 3 02:42:46 oleg421-client sshd[67611]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:42:46 oleg421-client sshd[67624]: Received disconnect from 192.168.204.21 port 40500:11: disconnected by user Apr 3 02:42:46 oleg421-client sshd[67624]: Disconnected from user root 192.168.204.21 port 40500 Apr 3 02:42:46 oleg421-client sshd[67611]: pam_unix(sshd:session): session closed for user root Apr 3 02:42:46 oleg421-client systemd-logind[1011]: Session 338 logged out. Waiting for processes to exit. Apr 3 02:42:46 oleg421-client systemd[1]: session-338.scope: Succeeded. Apr 3 02:42:46 oleg421-client systemd-logind[1011]: Removed session 338. Apr 3 02:42:47 oleg421-client sshd[67750]: Accepted publickey for root from 192.168.204.21 port 47024 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:42:47 oleg421-client systemd[1]: Started Session 339 of user root. Apr 3 02:42:47 oleg421-client systemd-logind[1011]: New session 339 of user root. Apr 3 02:42:47 oleg421-client sshd[67750]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:42:48 oleg421-client sshd[67763]: Received disconnect from 192.168.204.21 port 47024:11: disconnected by user Apr 3 02:42:48 oleg421-client sshd[67763]: Disconnected from user root 192.168.204.21 port 47024 Apr 3 02:42:48 oleg421-client sshd[67750]: pam_unix(sshd:session): session closed for user root Apr 3 02:42:48 oleg421-client systemd-logind[1011]: Session 339 logged out. Waiting for processes to exit. Apr 3 02:42:48 oleg421-client systemd[1]: session-339.scope: Succeeded. Apr 3 02:42:48 oleg421-client systemd-logind[1011]: Removed session 339. Apr 3 02:42:49 oleg421-client sshd[67897]: Accepted publickey for root from 192.168.204.21 port 47032 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:42:49 oleg421-client systemd-logind[1011]: New session 340 of user root. Apr 3 02:42:49 oleg421-client systemd[1]: Started Session 340 of user root. Apr 3 02:42:49 oleg421-client sshd[67897]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:42:49 oleg421-client sshd[67910]: Received disconnect from 192.168.204.21 port 47032:11: disconnected by user Apr 3 02:42:49 oleg421-client sshd[67910]: Disconnected from user root 192.168.204.21 port 47032 Apr 3 02:42:49 oleg421-client sshd[67897]: pam_unix(sshd:session): session closed for user root Apr 3 02:42:49 oleg421-client systemd[1]: session-340.scope: Succeeded. Apr 3 02:42:49 oleg421-client systemd-logind[1011]: Session 340 logged out. Waiting for processes to exit. Apr 3 02:42:49 oleg421-client systemd-logind[1011]: Removed session 340. Apr 3 02:42:50 oleg421-client sshd[68053]: Accepted publickey for root from 192.168.204.21 port 47036 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:42:51 oleg421-client systemd[1]: Started Session 341 of user root. Apr 3 02:42:51 oleg421-client systemd-logind[1011]: New session 341 of user root. Apr 3 02:42:51 oleg421-client sshd[68053]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:42:51 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 102: IR: New client gets updated nidtbl after MGS restart ========================================================== 02:42:50 (1775198570) Apr 3 02:42:51 oleg421-client sshd[68066]: Received disconnect from 192.168.204.21 port 47036:11: disconnected by user Apr 3 02:42:51 oleg421-client sshd[68066]: Disconnected from user root 192.168.204.21 port 47036 Apr 3 02:42:51 oleg421-client sshd[68053]: pam_unix(sshd:session): session closed for user root Apr 3 02:42:51 oleg421-client systemd-logind[1011]: Session 341 logged out. Waiting for processes to exit. Apr 3 02:42:51 oleg421-client systemd[1]: session-341.scope: Succeeded. Apr 3 02:42:51 oleg421-client systemd-logind[1011]: Removed session 341. Apr 3 02:43:22 oleg421-client sshd[68388]: Accepted publickey for root from 192.168.204.21 port 49788 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:43:22 oleg421-client systemd[1]: Started Session 342 of user root. Apr 3 02:43:22 oleg421-client systemd-logind[1011]: New session 342 of user root. Apr 3 02:43:22 oleg421-client sshd[68388]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:43:23 oleg421-client sshd[68401]: Received disconnect from 192.168.204.21 port 49788:11: disconnected by user Apr 3 02:43:23 oleg421-client sshd[68401]: Disconnected from user root 192.168.204.21 port 49788 Apr 3 02:43:23 oleg421-client sshd[68388]: pam_unix(sshd:session): session closed for user root Apr 3 02:43:23 oleg421-client systemd[1]: session-342.scope: Succeeded. Apr 3 02:43:23 oleg421-client systemd-logind[1011]: Session 342 logged out. Waiting for processes to exit. Apr 3 02:43:23 oleg421-client systemd-logind[1011]: Removed session 342. Apr 3 02:43:27 oleg421-client sshd[68625]: Accepted publickey for root from 192.168.204.21 port 49790 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:43:27 oleg421-client systemd-logind[1011]: New session 343 of user root. Apr 3 02:43:27 oleg421-client systemd[1]: Started Session 343 of user root. Apr 3 02:43:27 oleg421-client sshd[68625]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:43:27 oleg421-client kernel: Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid Apr 3 02:43:27 oleg421-client sshd[68638]: Received disconnect from 192.168.204.21 port 49790:11: disconnected by user Apr 3 02:43:27 oleg421-client sshd[68638]: Disconnected from user root 192.168.204.21 port 49790 Apr 3 02:43:27 oleg421-client sshd[68625]: pam_unix(sshd:session): session closed for user root Apr 3 02:43:27 oleg421-client systemd[1]: session-343.scope: Succeeded. Apr 3 02:43:27 oleg421-client systemd-logind[1011]: Session 343 logged out. Waiting for processes to exit. Apr 3 02:43:28 oleg421-client systemd-logind[1011]: Removed session 343. Apr 3 02:43:29 oleg421-client sshd[68781]: Accepted publickey for root from 192.168.204.21 port 47446 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:43:29 oleg421-client systemd[1]: Started Session 344 of user root. Apr 3 02:43:29 oleg421-client systemd-logind[1011]: New session 344 of user root. Apr 3 02:43:29 oleg421-client sshd[68781]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:43:30 oleg421-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec Apr 3 02:43:30 oleg421-client sshd[68795]: Received disconnect from 192.168.204.21 port 47446:11: disconnected by user Apr 3 02:43:30 oleg421-client sshd[68795]: Disconnected from user root 192.168.204.21 port 47446 Apr 3 02:43:30 oleg421-client sshd[68781]: pam_unix(sshd:session): session closed for user root Apr 3 02:43:30 oleg421-client systemd[1]: session-344.scope: Succeeded. Apr 3 02:43:30 oleg421-client systemd-logind[1011]: Session 344 logged out. Waiting for processes to exit. Apr 3 02:43:30 oleg421-client systemd-logind[1011]: Removed session 344. Apr 3 02:43:31 oleg421-client sshd[68836]: Accepted publickey for root from 192.168.204.21 port 47462 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:43:31 oleg421-client systemd[1]: Started Session 345 of user root. Apr 3 02:43:31 oleg421-client systemd-logind[1011]: New session 345 of user root. Apr 3 02:43:31 oleg421-client sshd[68836]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:43:32 oleg421-client sshd[68849]: Received disconnect from 192.168.204.21 port 47462:11: disconnected by user Apr 3 02:43:32 oleg421-client sshd[68849]: Disconnected from user root 192.168.204.21 port 47462 Apr 3 02:43:32 oleg421-client sshd[68836]: pam_unix(sshd:session): session closed for user root Apr 3 02:43:32 oleg421-client systemd[1]: session-345.scope: Succeeded. Apr 3 02:43:32 oleg421-client systemd-logind[1011]: Session 345 logged out. Waiting for processes to exit. Apr 3 02:43:32 oleg421-client systemd-logind[1011]: Removed session 345. Apr 3 02:43:36 oleg421-client systemd[1]: mnt-lustre.mount: Succeeded. Apr 3 02:43:36 oleg421-client kernel: LustreError: 68940:0:(lov_obd.c:786:lov_cleanup()) lustre-clilov-ffff962446bf0800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Apr 3 02:43:36 oleg421-client kernel: LustreError: 68940:0:(lov_obd.c:786:lov_cleanup()) Skipped 1 previous similar message Apr 3 02:43:36 oleg421-client kernel: Lustre: Unmounted lustre-client Apr 3 02:44:24 oleg421-client sshd[69411]: Accepted publickey for root from 192.168.204.21 port 34782 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:44:24 oleg421-client systemd[1]: Started Session 346 of user root. Apr 3 02:44:24 oleg421-client systemd-logind[1011]: New session 346 of user root. Apr 3 02:44:24 oleg421-client sshd[69411]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:44:25 oleg421-client sshd[69424]: Received disconnect from 192.168.204.21 port 34782:11: disconnected by user Apr 3 02:44:25 oleg421-client sshd[69424]: Disconnected from user root 192.168.204.21 port 34782 Apr 3 02:44:25 oleg421-client sshd[69411]: pam_unix(sshd:session): session closed for user root Apr 3 02:44:25 oleg421-client systemd-logind[1011]: Session 346 logged out. Waiting for processes to exit. Apr 3 02:44:25 oleg421-client systemd[1]: session-346.scope: Succeeded. Apr 3 02:44:25 oleg421-client systemd-logind[1011]: Removed session 346. Apr 3 02:44:28 oleg421-client sshd[69649]: Accepted publickey for root from 192.168.204.21 port 47842 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:44:28 oleg421-client systemd-logind[1011]: New session 347 of user root. Apr 3 02:44:28 oleg421-client systemd[1]: Started Session 347 of user root. Apr 3 02:44:28 oleg421-client sshd[69649]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:44:28 oleg421-client kernel: Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid Apr 3 02:44:28 oleg421-client sshd[69662]: Received disconnect from 192.168.204.21 port 47842:11: disconnected by user Apr 3 02:44:28 oleg421-client sshd[69662]: Disconnected from user root 192.168.204.21 port 47842 Apr 3 02:44:28 oleg421-client sshd[69649]: pam_unix(sshd:session): session closed for user root Apr 3 02:44:28 oleg421-client systemd[1]: session-347.scope: Succeeded. Apr 3 02:44:28 oleg421-client systemd-logind[1011]: Session 347 logged out. Waiting for processes to exit. Apr 3 02:44:28 oleg421-client systemd-logind[1011]: Removed session 347. Apr 3 02:44:30 oleg421-client sshd[69711]: Accepted publickey for root from 192.168.204.21 port 47856 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:44:30 oleg421-client systemd-logind[1011]: New session 348 of user root. Apr 3 02:44:30 oleg421-client systemd[1]: Started Session 348 of user root. Apr 3 02:44:30 oleg421-client sshd[69711]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:44:30 oleg421-client sshd[69724]: Received disconnect from 192.168.204.21 port 47856:11: disconnected by user Apr 3 02:44:30 oleg421-client sshd[69724]: Disconnected from user root 192.168.204.21 port 47856 Apr 3 02:44:30 oleg421-client sshd[69711]: pam_unix(sshd:session): session closed for user root Apr 3 02:44:31 oleg421-client systemd[1]: session-348.scope: Succeeded. Apr 3 02:44:31 oleg421-client systemd-logind[1011]: Session 348 logged out. Waiting for processes to exit. Apr 3 02:44:31 oleg421-client systemd-logind[1011]: Removed session 348. Apr 3 02:44:31 oleg421-client systemd-udevd[69795]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Apr 3 02:44:31 oleg421-client kernel: Lustre: Mounted lustre-client Apr 3 02:44:32 oleg421-client sshd[69920]: Accepted publickey for root from 192.168.204.21 port 47870 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:44:32 oleg421-client systemd[1]: Started Session 349 of user root. Apr 3 02:44:32 oleg421-client systemd-logind[1011]: New session 349 of user root. Apr 3 02:44:32 oleg421-client sshd[69920]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:44:33 oleg421-client sshd[69933]: Received disconnect from 192.168.204.21 port 47870:11: disconnected by user Apr 3 02:44:33 oleg421-client sshd[69933]: Disconnected from user root 192.168.204.21 port 47870 Apr 3 02:44:33 oleg421-client sshd[69920]: pam_unix(sshd:session): session closed for user root Apr 3 02:44:33 oleg421-client systemd[1]: session-349.scope: Succeeded. Apr 3 02:44:33 oleg421-client systemd-logind[1011]: Session 349 logged out. Waiting for processes to exit. Apr 3 02:44:33 oleg421-client systemd-logind[1011]: Removed session 349. Apr 3 02:44:34 oleg421-client sshd[70059]: Accepted publickey for root from 192.168.204.21 port 47880 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:44:34 oleg421-client systemd-logind[1011]: New session 350 of user root. Apr 3 02:44:34 oleg421-client systemd[1]: Started Session 350 of user root. Apr 3 02:44:34 oleg421-client sshd[70059]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:44:35 oleg421-client sshd[70072]: Received disconnect from 192.168.204.21 port 47880:11: disconnected by user Apr 3 02:44:35 oleg421-client sshd[70072]: Disconnected from user root 192.168.204.21 port 47880 Apr 3 02:44:35 oleg421-client sshd[70059]: pam_unix(sshd:session): session closed for user root Apr 3 02:44:35 oleg421-client systemd-logind[1011]: Session 350 logged out. Waiting for processes to exit. Apr 3 02:44:35 oleg421-client systemd[1]: session-350.scope: Succeeded. Apr 3 02:44:35 oleg421-client systemd-logind[1011]: Removed session 350. Apr 3 02:44:36 oleg421-client sshd[70205]: Accepted publickey for root from 192.168.204.21 port 47882 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:44:36 oleg421-client systemd[1]: Started Session 351 of user root. Apr 3 02:44:36 oleg421-client systemd-logind[1011]: New session 351 of user root. Apr 3 02:44:36 oleg421-client sshd[70205]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:44:36 oleg421-client sshd[70219]: Received disconnect from 192.168.204.21 port 47882:11: disconnected by user Apr 3 02:44:36 oleg421-client sshd[70219]: Disconnected from user root 192.168.204.21 port 47882 Apr 3 02:44:36 oleg421-client sshd[70205]: pam_unix(sshd:session): session closed for user root Apr 3 02:44:37 oleg421-client systemd[1]: session-351.scope: Succeeded. Apr 3 02:44:37 oleg421-client systemd-logind[1011]: Session 351 logged out. Waiting for processes to exit. Apr 3 02:44:37 oleg421-client systemd-logind[1011]: Removed session 351. Apr 3 02:44:39 oleg421-client sshd[70361]: Accepted publickey for root from 192.168.204.21 port 33788 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:44:39 oleg421-client systemd-logind[1011]: New session 352 of user root. Apr 3 02:44:39 oleg421-client systemd[1]: Started Session 352 of user root. Apr 3 02:44:39 oleg421-client sshd[70361]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:44:39 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 103: IR: MDS can start w/o MGS and get updated nidtbl later ========================================================== 02:44:37 (1775198677) Apr 3 02:44:39 oleg421-client sshd[70374]: Received disconnect from 192.168.204.21 port 33788:11: disconnected by user Apr 3 02:44:39 oleg421-client sshd[70374]: Disconnected from user root 192.168.204.21 port 33788 Apr 3 02:44:39 oleg421-client sshd[70361]: pam_unix(sshd:session): session closed for user root Apr 3 02:44:39 oleg421-client systemd-logind[1011]: Session 352 logged out. Waiting for processes to exit. Apr 3 02:44:39 oleg421-client systemd[1]: session-352.scope: Succeeded. Apr 3 02:44:39 oleg421-client systemd-logind[1011]: Removed session 352. Apr 3 02:44:43 oleg421-client sshd[70524]: Accepted publickey for root from 192.168.204.21 port 33798 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:44:43 oleg421-client systemd-logind[1011]: New session 353 of user root. Apr 3 02:44:43 oleg421-client systemd[1]: Started Session 353 of user root. Apr 3 02:44:43 oleg421-client sshd[70524]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:44:43 oleg421-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_103 needs separate mgs and mds Apr 3 02:44:43 oleg421-client sshd[70537]: Received disconnect from 192.168.204.21 port 33798:11: disconnected by user Apr 3 02:44:43 oleg421-client sshd[70537]: Disconnected from user root 192.168.204.21 port 33798 Apr 3 02:44:43 oleg421-client sshd[70524]: pam_unix(sshd:session): session closed for user root Apr 3 02:44:44 oleg421-client systemd-logind[1011]: Session 353 logged out. Waiting for processes to exit. Apr 3 02:44:44 oleg421-client systemd[1]: session-353.scope: Succeeded. Apr 3 02:44:44 oleg421-client systemd-logind[1011]: Removed session 353. Apr 3 02:44:46 oleg421-client systemd[1]: Starting dnf makecache... Apr 3 02:44:46 oleg421-client sshd[70678]: Accepted publickey for root from 192.168.204.21 port 33808 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:44:46 oleg421-client systemd[1]: Started Session 354 of user root. Apr 3 02:44:46 oleg421-client systemd-logind[1011]: New session 354 of user root. Apr 3 02:44:46 oleg421-client sshd[70678]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:44:47 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 104: IR: ost can disable IR voluntarily ========================================================== 02:44:44 (1775198684) Apr 3 02:44:47 oleg421-client sshd[70693]: Received disconnect from 192.168.204.21 port 33808:11: disconnected by user Apr 3 02:44:47 oleg421-client sshd[70693]: Disconnected from user root 192.168.204.21 port 33808 Apr 3 02:44:47 oleg421-client sshd[70678]: pam_unix(sshd:session): session closed for user root Apr 3 02:44:47 oleg421-client systemd-logind[1011]: Session 354 logged out. Waiting for processes to exit. Apr 3 02:44:48 oleg421-client systemd[1]: session-354.scope: Succeeded. Apr 3 02:44:48 oleg421-client systemd-logind[1011]: Removed session 354. Apr 3 02:44:54 oleg421-client dnf[70686]: Failed determining last makecache time. Apr 3 02:44:55 oleg421-client dnf[70686]: [Errno 30] Read-only file system: '/var/cache/dnf/metadata_lock.pid' Apr 3 02:44:55 oleg421-client dnf[70686]: Failed to store expired repos cache: [Errno 30] Read-only file system: '/var/cache/dnf/expired_repos.json' Apr 3 02:44:55 oleg421-client systemd[1]: dnf-makecache.service: Main process exited, code=exited, status=1/FAILURE Apr 3 02:44:55 oleg421-client systemd[1]: dnf-makecache.service: Failed with result 'exit-code'. Apr 3 02:44:55 oleg421-client systemd[1]: Failed to start dnf makecache. Apr 3 02:45:16 oleg421-client sshd[70983]: Accepted publickey for root from 192.168.204.21 port 36178 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:45:16 oleg421-client systemd-logind[1011]: New session 355 of user root. Apr 3 02:45:16 oleg421-client systemd[1]: Started Session 355 of user root. Apr 3 02:45:16 oleg421-client sshd[70983]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:45:16 oleg421-client sshd[70997]: Received disconnect from 192.168.204.21 port 36178:11: disconnected by user Apr 3 02:45:16 oleg421-client sshd[70997]: Disconnected from user root 192.168.204.21 port 36178 Apr 3 02:45:16 oleg421-client sshd[70983]: pam_unix(sshd:session): session closed for user root Apr 3 02:45:16 oleg421-client systemd[1]: session-355.scope: Succeeded. Apr 3 02:45:16 oleg421-client systemd-logind[1011]: Session 355 logged out. Waiting for processes to exit. Apr 3 02:45:16 oleg421-client systemd-logind[1011]: Removed session 355. Apr 3 02:45:20 oleg421-client sshd[71135]: Accepted publickey for root from 192.168.204.21 port 38142 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:45:20 oleg421-client systemd-logind[1011]: New session 356 of user root. Apr 3 02:45:20 oleg421-client systemd[1]: Started Session 356 of user root. Apr 3 02:45:20 oleg421-client sshd[71135]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:45:20 oleg421-client sshd[71148]: Received disconnect from 192.168.204.21 port 38142:11: disconnected by user Apr 3 02:45:21 oleg421-client sshd[71148]: Disconnected from user root 192.168.204.21 port 38142 Apr 3 02:45:21 oleg421-client sshd[71135]: pam_unix(sshd:session): session closed for user root Apr 3 02:45:21 oleg421-client systemd[1]: session-356.scope: Succeeded. Apr 3 02:45:21 oleg421-client systemd-logind[1011]: Session 356 logged out. Waiting for processes to exit. Apr 3 02:45:21 oleg421-client systemd-logind[1011]: Removed session 356. Apr 3 02:45:21 oleg421-client sshd[71274]: Accepted publickey for root from 192.168.204.21 port 38154 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:45:22 oleg421-client systemd-logind[1011]: New session 357 of user root. Apr 3 02:45:22 oleg421-client systemd[1]: Started Session 357 of user root. Apr 3 02:45:22 oleg421-client sshd[71274]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:45:22 oleg421-client sshd[71287]: Received disconnect from 192.168.204.21 port 38154:11: disconnected by user Apr 3 02:45:22 oleg421-client sshd[71287]: Disconnected from user root 192.168.204.21 port 38154 Apr 3 02:45:22 oleg421-client sshd[71274]: pam_unix(sshd:session): session closed for user root Apr 3 02:45:22 oleg421-client systemd-logind[1011]: Session 357 logged out. Waiting for processes to exit. Apr 3 02:45:22 oleg421-client systemd[1]: session-357.scope: Succeeded. Apr 3 02:45:22 oleg421-client systemd-logind[1011]: Removed session 357. Apr 3 02:45:23 oleg421-client sshd[71421]: Accepted publickey for root from 192.168.204.21 port 38160 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:45:23 oleg421-client systemd[1]: Started Session 358 of user root. Apr 3 02:45:23 oleg421-client systemd-logind[1011]: New session 358 of user root. Apr 3 02:45:23 oleg421-client sshd[71421]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:45:24 oleg421-client sshd[71434]: Received disconnect from 192.168.204.21 port 38160:11: disconnected by user Apr 3 02:45:24 oleg421-client sshd[71434]: Disconnected from user root 192.168.204.21 port 38160 Apr 3 02:45:24 oleg421-client sshd[71421]: pam_unix(sshd:session): session closed for user root Apr 3 02:45:24 oleg421-client systemd[1]: session-358.scope: Succeeded. Apr 3 02:45:24 oleg421-client systemd-logind[1011]: Session 358 logged out. Waiting for processes to exit. Apr 3 02:45:24 oleg421-client systemd-logind[1011]: Removed session 358. Apr 3 02:45:26 oleg421-client sshd[71576]: Accepted publickey for root from 192.168.204.21 port 38176 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:45:26 oleg421-client systemd-logind[1011]: New session 359 of user root. Apr 3 02:45:26 oleg421-client systemd[1]: Started Session 359 of user root. Apr 3 02:45:26 oleg421-client sshd[71576]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:45:26 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 105: IR: NON IR clients support === 02:45:24 (1775198724) Apr 3 02:45:26 oleg421-client sshd[71589]: Received disconnect from 192.168.204.21 port 38176:11: disconnected by user Apr 3 02:45:26 oleg421-client sshd[71589]: Disconnected from user root 192.168.204.21 port 38176 Apr 3 02:45:26 oleg421-client sshd[71576]: pam_unix(sshd:session): session closed for user root Apr 3 02:45:26 oleg421-client systemd[1]: session-359.scope: Succeeded. Apr 3 02:45:26 oleg421-client systemd-logind[1011]: Session 359 logged out. Waiting for processes to exit. Apr 3 02:45:26 oleg421-client systemd-logind[1011]: Removed session 359. Apr 3 02:45:27 oleg421-client sshd[71714]: Accepted publickey for root from 192.168.204.21 port 57154 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:45:27 oleg421-client systemd-logind[1011]: New session 360 of user root. Apr 3 02:45:27 oleg421-client systemd[1]: Started Session 360 of user root. Apr 3 02:45:27 oleg421-client sshd[71714]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:45:28 oleg421-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_105 Needs multiple clients Apr 3 02:45:28 oleg421-client sshd[71727]: Received disconnect from 192.168.204.21 port 57154:11: disconnected by user Apr 3 02:45:28 oleg421-client sshd[71727]: Disconnected from user root 192.168.204.21 port 57154 Apr 3 02:45:28 oleg421-client sshd[71714]: pam_unix(sshd:session): session closed for user root Apr 3 02:45:28 oleg421-client systemd-logind[1011]: Session 360 logged out. Waiting for processes to exit. Apr 3 02:45:28 oleg421-client systemd[1]: session-360.scope: Succeeded. Apr 3 02:45:28 oleg421-client systemd-logind[1011]: Removed session 360. Apr 3 02:45:29 oleg421-client sshd[71869]: Accepted publickey for root from 192.168.204.21 port 57170 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:45:29 oleg421-client systemd-logind[1011]: New session 361 of user root. Apr 3 02:45:29 oleg421-client systemd[1]: Started Session 361 of user root. Apr 3 02:45:29 oleg421-client sshd[71869]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:45:30 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 106: lightweight connection support ========================================================== 02:45:28 (1775198728) Apr 3 02:45:30 oleg421-client sshd[71882]: Received disconnect from 192.168.204.21 port 57170:11: disconnected by user Apr 3 02:45:30 oleg421-client sshd[71882]: Disconnected from user root 192.168.204.21 port 57170 Apr 3 02:45:30 oleg421-client sshd[71869]: pam_unix(sshd:session): session closed for user root Apr 3 02:45:30 oleg421-client systemd[1]: session-361.scope: Succeeded. Apr 3 02:45:30 oleg421-client systemd-logind[1011]: Session 361 logged out. Waiting for processes to exit. Apr 3 02:45:30 oleg421-client systemd-logind[1011]: Removed session 361. Apr 3 02:45:31 oleg421-client kernel: Lustre: *** cfs_fail_loc=805, val=0*** Apr 3 02:45:31 oleg421-client systemd-udevd[71950]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Apr 3 02:45:31 oleg421-client kernel: Lustre: Mounted lustre-client Apr 3 02:45:43 oleg421-client kernel: Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 Apr 3 02:46:03 oleg421-client kernel: LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 192.168.204.121@tcp) was lost; in progress operations using this service will fail Apr 3 02:46:13 oleg421-client kernel: Lustre: Evicted from MGS (at 192.168.204.121@tcp) after server handle changed from 0x1d1756950d13c27f to 0x1d1756950d13c4d2 Apr 3 02:46:23 oleg421-client systemd[1]: mnt-lustre2.mount: Succeeded. Apr 3 02:46:23 oleg421-client kernel: LustreError: 72420:0:(lov_obd.c:786:lov_cleanup()) lustre-clilov-ffff96244461c800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Apr 3 02:46:23 oleg421-client kernel: LustreError: 72420:0:(lov_obd.c:786:lov_cleanup()) Skipped 1 previous similar message Apr 3 02:46:24 oleg421-client kernel: Lustre: Unmounted lustre-client Apr 3 02:46:26 oleg421-client sshd[72571]: Accepted publickey for root from 192.168.204.21 port 49126 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:46:26 oleg421-client systemd[1]: Started Session 362 of user root. Apr 3 02:46:26 oleg421-client systemd-logind[1011]: New session 362 of user root. Apr 3 02:46:26 oleg421-client sshd[72571]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:46:26 oleg421-client sshd[72584]: Received disconnect from 192.168.204.21 port 49126:11: disconnected by user Apr 3 02:46:27 oleg421-client sshd[72584]: Disconnected from user root 192.168.204.21 port 49126 Apr 3 02:46:27 oleg421-client sshd[72571]: pam_unix(sshd:session): session closed for user root Apr 3 02:46:27 oleg421-client systemd[1]: session-362.scope: Succeeded. Apr 3 02:46:27 oleg421-client systemd-logind[1011]: Session 362 logged out. Waiting for processes to exit. Apr 3 02:46:27 oleg421-client systemd-logind[1011]: Removed session 362. Apr 3 02:46:28 oleg421-client sshd[72711]: Accepted publickey for root from 192.168.204.21 port 49402 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:46:28 oleg421-client systemd-logind[1011]: New session 363 of user root. Apr 3 02:46:28 oleg421-client systemd[1]: Started Session 363 of user root. Apr 3 02:46:28 oleg421-client rsyslogd[1073]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Apr 3 02:46:28 oleg421-client sshd[72711]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:46:28 oleg421-client rsyslogd[1073]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Apr 3 02:46:28 oleg421-client sshd[72725]: Received disconnect from 192.168.204.21 port 49402:11: disconnected by user Apr 3 02:46:28 oleg421-client sshd[72725]: Disconnected from user root 192.168.204.21 port 49402 Apr 3 02:46:28 oleg421-client sshd[72711]: pam_unix(sshd:session): session closed for user root Apr 3 02:46:28 oleg421-client systemd[1]: session-363.scope: Succeeded. Apr 3 02:46:28 oleg421-client systemd-logind[1011]: Session 363 logged out. Waiting for processes to exit. Apr 3 02:46:28 oleg421-client systemd-logind[1011]: Removed session 363. Apr 3 02:46:29 oleg421-client sshd[72858]: Accepted publickey for root from 192.168.204.21 port 49408 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:46:29 oleg421-client systemd-logind[1011]: New session 364 of user root. Apr 3 02:46:29 oleg421-client systemd[1]: Started Session 364 of user root. Apr 3 02:46:29 oleg421-client sshd[72858]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:46:30 oleg421-client sshd[72871]: Received disconnect from 192.168.204.21 port 49408:11: disconnected by user Apr 3 02:46:30 oleg421-client sshd[72871]: Disconnected from user root 192.168.204.21 port 49408 Apr 3 02:46:30 oleg421-client sshd[72858]: pam_unix(sshd:session): session closed for user root Apr 3 02:46:30 oleg421-client systemd[1]: session-364.scope: Succeeded. Apr 3 02:46:30 oleg421-client systemd-logind[1011]: Session 364 logged out. Waiting for processes to exit. Apr 3 02:46:30 oleg421-client systemd-logind[1011]: Removed session 364. Apr 3 02:46:32 oleg421-client sshd[73014]: Accepted publickey for root from 192.168.204.21 port 49412 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:46:32 oleg421-client systemd-logind[1011]: New session 365 of user root. Apr 3 02:46:32 oleg421-client systemd[1]: Started Session 365 of user root. Apr 3 02:46:32 oleg421-client sshd[73014]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:46:32 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 107: drop reint reply, then restart MDT ========================================================== 02:46:30 (1775198790) Apr 3 02:46:32 oleg421-client sshd[73027]: Received disconnect from 192.168.204.21 port 49412:11: disconnected by user Apr 3 02:46:32 oleg421-client sshd[73027]: Disconnected from user root 192.168.204.21 port 49412 Apr 3 02:46:32 oleg421-client sshd[73014]: pam_unix(sshd:session): session closed for user root Apr 3 02:46:32 oleg421-client systemd-logind[1011]: Session 365 logged out. Waiting for processes to exit. Apr 3 02:46:32 oleg421-client systemd[1]: session-365.scope: Succeeded. Apr 3 02:46:32 oleg421-client systemd-logind[1011]: Removed session 365. Apr 3 02:47:08 oleg421-client kernel: LustreError: 2402:0:(client.c:3419:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff962447c48e00 x1861425393588736/t94489280516(94489280516) o101->lustre-MDT0000-mdc-ffff9624446f7000@192.168.204.121@tcp:12/10 lens 536/664 e 0 to 0 dl 1775198844 ref 2 fl Interpret:RPQU/604/0 rc 301/301 job:'multiop.0' uid:0 gid:0 projid:0 Apr 3 02:47:15 oleg421-client sshd[73360]: Accepted publickey for root from 192.168.204.21 port 35884 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:47:15 oleg421-client systemd-logind[1011]: New session 366 of user root. Apr 3 02:47:15 oleg421-client systemd[1]: Started Session 366 of user root. Apr 3 02:47:15 oleg421-client sshd[73360]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:47:16 oleg421-client sshd[73373]: Received disconnect from 192.168.204.21 port 35884:11: disconnected by user Apr 3 02:47:16 oleg421-client sshd[73373]: Disconnected from user root 192.168.204.21 port 35884 Apr 3 02:47:16 oleg421-client sshd[73360]: pam_unix(sshd:session): session closed for user root Apr 3 02:47:16 oleg421-client systemd[1]: session-366.scope: Succeeded. Apr 3 02:47:16 oleg421-client systemd-logind[1011]: Session 366 logged out. Waiting for processes to exit. Apr 3 02:47:16 oleg421-client systemd-logind[1011]: Removed session 366. Apr 3 02:47:19 oleg421-client sshd[73596]: Accepted publickey for root from 192.168.204.21 port 55124 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:47:19 oleg421-client systemd-logind[1011]: New session 367 of user root. Apr 3 02:47:19 oleg421-client systemd[1]: Started Session 367 of user root. Apr 3 02:47:19 oleg421-client sshd[73596]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:47:20 oleg421-client kernel: Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid Apr 3 02:47:20 oleg421-client sshd[73609]: Received disconnect from 192.168.204.21 port 55124:11: disconnected by user Apr 3 02:47:20 oleg421-client sshd[73609]: Disconnected from user root 192.168.204.21 port 55124 Apr 3 02:47:20 oleg421-client sshd[73596]: pam_unix(sshd:session): session closed for user root Apr 3 02:47:20 oleg421-client systemd[1]: session-367.scope: Succeeded. Apr 3 02:47:20 oleg421-client systemd-logind[1011]: Session 367 logged out. Waiting for processes to exit. Apr 3 02:47:20 oleg421-client systemd-logind[1011]: Removed session 367. Apr 3 02:47:21 oleg421-client sshd[73752]: Accepted publickey for root from 192.168.204.21 port 55128 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:47:21 oleg421-client systemd-logind[1011]: New session 368 of user root. Apr 3 02:47:21 oleg421-client systemd[1]: Started Session 368 of user root. Apr 3 02:47:21 oleg421-client sshd[73752]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:47:22 oleg421-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Apr 3 02:47:22 oleg421-client sshd[73765]: Received disconnect from 192.168.204.21 port 55128:11: disconnected by user Apr 3 02:47:22 oleg421-client sshd[73765]: Disconnected from user root 192.168.204.21 port 55128 Apr 3 02:47:22 oleg421-client sshd[73752]: pam_unix(sshd:session): session closed for user root Apr 3 02:47:22 oleg421-client systemd-logind[1011]: Session 368 logged out. Waiting for processes to exit. Apr 3 02:47:22 oleg421-client systemd[1]: session-368.scope: Succeeded. Apr 3 02:47:22 oleg421-client systemd-logind[1011]: Removed session 368. Apr 3 02:47:23 oleg421-client sshd[73806]: Accepted publickey for root from 192.168.204.21 port 55142 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:47:23 oleg421-client systemd-logind[1011]: New session 369 of user root. Apr 3 02:47:23 oleg421-client systemd[1]: Started Session 369 of user root. Apr 3 02:47:23 oleg421-client sshd[73806]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:47:24 oleg421-client sshd[73819]: Received disconnect from 192.168.204.21 port 55142:11: disconnected by user Apr 3 02:47:24 oleg421-client sshd[73819]: Disconnected from user root 192.168.204.21 port 55142 Apr 3 02:47:24 oleg421-client sshd[73806]: pam_unix(sshd:session): session closed for user root Apr 3 02:47:24 oleg421-client systemd[1]: session-369.scope: Succeeded. Apr 3 02:47:24 oleg421-client systemd-logind[1011]: Session 369 logged out. Waiting for processes to exit. Apr 3 02:47:24 oleg421-client systemd-logind[1011]: Removed session 369. Apr 3 02:47:25 oleg421-client sshd[73940]: Accepted publickey for root from 192.168.204.21 port 55152 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:47:25 oleg421-client systemd[1]: Started Session 370 of user root. Apr 3 02:47:25 oleg421-client systemd-logind[1011]: New session 370 of user root. Apr 3 02:47:25 oleg421-client sshd[73940]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:47:26 oleg421-client sshd[73953]: Received disconnect from 192.168.204.21 port 55152:11: disconnected by user Apr 3 02:47:26 oleg421-client sshd[73953]: Disconnected from user root 192.168.204.21 port 55152 Apr 3 02:47:26 oleg421-client sshd[73940]: pam_unix(sshd:session): session closed for user root Apr 3 02:47:26 oleg421-client systemd-logind[1011]: Session 370 logged out. Waiting for processes to exit. Apr 3 02:47:26 oleg421-client systemd[1]: session-370.scope: Succeeded. Apr 3 02:47:26 oleg421-client systemd-logind[1011]: Removed session 370. Apr 3 02:47:27 oleg421-client sshd[74079]: Accepted publickey for root from 192.168.204.21 port 55160 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:47:27 oleg421-client systemd[1]: Started Session 371 of user root. Apr 3 02:47:27 oleg421-client systemd-logind[1011]: New session 371 of user root. Apr 3 02:47:27 oleg421-client sshd[74079]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:47:27 oleg421-client sshd[74092]: Received disconnect from 192.168.204.21 port 55160:11: disconnected by user Apr 3 02:47:27 oleg421-client sshd[74092]: Disconnected from user root 192.168.204.21 port 55160 Apr 3 02:47:27 oleg421-client sshd[74079]: pam_unix(sshd:session): session closed for user root Apr 3 02:47:27 oleg421-client systemd-logind[1011]: Session 371 logged out. Waiting for processes to exit. Apr 3 02:47:27 oleg421-client systemd[1]: session-371.scope: Succeeded. Apr 3 02:47:27 oleg421-client systemd-logind[1011]: Removed session 371. Apr 3 02:47:28 oleg421-client sshd[74225]: Accepted publickey for root from 192.168.204.21 port 43676 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:47:29 oleg421-client systemd-logind[1011]: New session 372 of user root. Apr 3 02:47:29 oleg421-client systemd[1]: Started Session 372 of user root. Apr 3 02:47:29 oleg421-client sshd[74225]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:47:29 oleg421-client sshd[74238]: Received disconnect from 192.168.204.21 port 43676:11: disconnected by user Apr 3 02:47:29 oleg421-client sshd[74238]: Disconnected from user root 192.168.204.21 port 43676 Apr 3 02:47:29 oleg421-client sshd[74225]: pam_unix(sshd:session): session closed for user root Apr 3 02:47:29 oleg421-client systemd[1]: session-372.scope: Succeeded. Apr 3 02:47:29 oleg421-client systemd-logind[1011]: Session 372 logged out. Waiting for processes to exit. Apr 3 02:47:29 oleg421-client systemd-logind[1011]: Removed session 372. Apr 3 02:47:30 oleg421-client sshd[74381]: Accepted publickey for root from 192.168.204.21 port 43686 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:47:30 oleg421-client systemd-logind[1011]: New session 373 of user root. Apr 3 02:47:30 oleg421-client systemd[1]: Started Session 373 of user root. Apr 3 02:47:30 oleg421-client sshd[74381]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:47:31 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 108: client eviction don't crash == 02:47:30 (1775198850) Apr 3 02:47:31 oleg421-client sshd[74394]: Received disconnect from 192.168.204.21 port 43686:11: disconnected by user Apr 3 02:47:31 oleg421-client sshd[74394]: Disconnected from user root 192.168.204.21 port 43686 Apr 3 02:47:31 oleg421-client sshd[74381]: pam_unix(sshd:session): session closed for user root Apr 3 02:47:31 oleg421-client systemd-logind[1011]: Session 373 logged out. Waiting for processes to exit. Apr 3 02:47:31 oleg421-client systemd[1]: session-373.scope: Succeeded. Apr 3 02:47:31 oleg421-client systemd-logind[1011]: Removed session 373. Apr 3 02:47:39 oleg421-client kernel: LustreError: 2402:0:(osc_request.c:1024:osc_init_grant()) lustre-OST0000-osc-ffff9624446f7000: granted 8437760 but already consumed 16850944 Apr 3 02:47:39 oleg421-client kernel: LustreError: lustre-OST0000-osc-ffff9624446f7000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Apr 3 02:47:39 oleg421-client kernel: Lustre: 2405:0:(llite_lib.c:4149:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.204.121@tcp:/lustre/fid: [0x240000408:0x2:0x0]// may get corrupted (rc -5) Apr 3 02:47:39 oleg421-client kernel: LustreError: 74445:0:(ldlm_resource.c:1170:ldlm_resource_complain()) lustre-OST0000-osc-ffff9624446f7000: namespace resource [0x280000400:0xff8:0x0].0x0 (ffff962444331700) refcount nonzero (1) after lock cleanup; forcing cleanup. Apr 3 02:47:41 oleg421-client sshd[74452]: Accepted publickey for root from 192.168.204.21 port 58708 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:47:41 oleg421-client systemd-logind[1011]: New session 374 of user root. Apr 3 02:47:41 oleg421-client systemd[1]: Started Session 374 of user root. Apr 3 02:47:41 oleg421-client sshd[74452]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:47:41 oleg421-client sshd[74465]: Received disconnect from 192.168.204.21 port 58708:11: disconnected by user Apr 3 02:47:41 oleg421-client sshd[74465]: Disconnected from user root 192.168.204.21 port 58708 Apr 3 02:47:41 oleg421-client sshd[74452]: pam_unix(sshd:session): session closed for user root Apr 3 02:47:42 oleg421-client systemd-logind[1011]: Session 374 logged out. Waiting for processes to exit. Apr 3 02:47:42 oleg421-client systemd[1]: session-374.scope: Succeeded. Apr 3 02:47:42 oleg421-client systemd-logind[1011]: Removed session 374. Apr 3 02:47:43 oleg421-client sshd[74585]: Accepted publickey for root from 192.168.204.21 port 58720 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:47:43 oleg421-client systemd-logind[1011]: New session 375 of user root. Apr 3 02:47:43 oleg421-client systemd[1]: Started Session 375 of user root. Apr 3 02:47:43 oleg421-client sshd[74585]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:47:43 oleg421-client sshd[74598]: Received disconnect from 192.168.204.21 port 58720:11: disconnected by user Apr 3 02:47:44 oleg421-client sshd[74598]: Disconnected from user root 192.168.204.21 port 58720 Apr 3 02:47:44 oleg421-client sshd[74585]: pam_unix(sshd:session): session closed for user root Apr 3 02:47:44 oleg421-client systemd-logind[1011]: Session 375 logged out. Waiting for processes to exit. Apr 3 02:47:44 oleg421-client systemd[1]: session-375.scope: Succeeded. Apr 3 02:47:44 oleg421-client systemd-logind[1011]: Removed session 375. Apr 3 02:47:45 oleg421-client sshd[74725]: Accepted publickey for root from 192.168.204.21 port 58726 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:47:45 oleg421-client systemd[1]: Started Session 376 of user root. Apr 3 02:47:45 oleg421-client systemd-logind[1011]: New session 376 of user root. Apr 3 02:47:45 oleg421-client sshd[74725]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:47:46 oleg421-client sshd[74738]: Received disconnect from 192.168.204.21 port 58726:11: disconnected by user Apr 3 02:47:46 oleg421-client sshd[74738]: Disconnected from user root 192.168.204.21 port 58726 Apr 3 02:47:46 oleg421-client sshd[74725]: pam_unix(sshd:session): session closed for user root Apr 3 02:47:46 oleg421-client systemd[1]: session-376.scope: Succeeded. Apr 3 02:47:46 oleg421-client systemd-logind[1011]: Session 376 logged out. Waiting for processes to exit. Apr 3 02:47:46 oleg421-client systemd-logind[1011]: Removed session 376. Apr 3 02:47:47 oleg421-client sshd[74871]: Accepted publickey for root from 192.168.204.21 port 58728 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:47:47 oleg421-client systemd[1]: Started Session 377 of user root. Apr 3 02:47:47 oleg421-client systemd-logind[1011]: New session 377 of user root. Apr 3 02:47:47 oleg421-client sshd[74871]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:47:47 oleg421-client sshd[74884]: Received disconnect from 192.168.204.21 port 58728:11: disconnected by user Apr 3 02:47:47 oleg421-client sshd[74884]: Disconnected from user root 192.168.204.21 port 58728 Apr 3 02:47:47 oleg421-client sshd[74871]: pam_unix(sshd:session): session closed for user root Apr 3 02:47:48 oleg421-client systemd[1]: session-377.scope: Succeeded. Apr 3 02:47:48 oleg421-client systemd-logind[1011]: Session 377 logged out. Waiting for processes to exit. Apr 3 02:47:48 oleg421-client systemd-logind[1011]: Removed session 377. Apr 3 02:47:49 oleg421-client sshd[75026]: Accepted publickey for root from 192.168.204.21 port 46094 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:47:49 oleg421-client systemd-logind[1011]: New session 378 of user root. Apr 3 02:47:49 oleg421-client systemd[1]: Started Session 378 of user root. Apr 3 02:47:49 oleg421-client sshd[75026]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:47:50 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110a: create remote directory: drop client req ========================================================== 02:47:48 (1775198868) Apr 3 02:47:50 oleg421-client sshd[75039]: Received disconnect from 192.168.204.21 port 46094:11: disconnected by user Apr 3 02:47:50 oleg421-client sshd[75039]: Disconnected from user root 192.168.204.21 port 46094 Apr 3 02:47:50 oleg421-client sshd[75026]: pam_unix(sshd:session): session closed for user root Apr 3 02:47:50 oleg421-client systemd[1]: session-378.scope: Succeeded. Apr 3 02:47:50 oleg421-client systemd-logind[1011]: Session 378 logged out. Waiting for processes to exit. Apr 3 02:47:50 oleg421-client systemd-logind[1011]: Removed session 378. Apr 3 02:48:09 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff9624446f7000: Connection to lustre-MDT0000 (at 192.168.204.121@tcp) was lost; in progress operations using this service will wait for recovery to complete Apr 3 02:48:09 oleg421-client kernel: Lustre: Skipped 15 previous similar messages Apr 3 02:48:12 oleg421-client sshd[75209]: Accepted publickey for root from 192.168.204.21 port 51994 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:48:12 oleg421-client systemd[1]: Started Session 379 of user root. Apr 3 02:48:12 oleg421-client systemd-logind[1011]: New session 379 of user root. Apr 3 02:48:12 oleg421-client sshd[75209]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:48:13 oleg421-client sshd[75222]: Received disconnect from 192.168.204.21 port 51994:11: disconnected by user Apr 3 02:48:13 oleg421-client sshd[75222]: Disconnected from user root 192.168.204.21 port 51994 Apr 3 02:48:13 oleg421-client sshd[75209]: pam_unix(sshd:session): session closed for user root Apr 3 02:48:13 oleg421-client systemd-logind[1011]: Session 379 logged out. Waiting for processes to exit. Apr 3 02:48:13 oleg421-client systemd[1]: session-379.scope: Succeeded. Apr 3 02:48:13 oleg421-client systemd-logind[1011]: Removed session 379. Apr 3 02:48:15 oleg421-client sshd[75348]: Accepted publickey for root from 192.168.204.21 port 52006 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:48:15 oleg421-client systemd-logind[1011]: New session 380 of user root. Apr 3 02:48:15 oleg421-client systemd[1]: Started Session 380 of user root. Apr 3 02:48:15 oleg421-client sshd[75348]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:48:15 oleg421-client sshd[75361]: Received disconnect from 192.168.204.21 port 52006:11: disconnected by user Apr 3 02:48:15 oleg421-client sshd[75361]: Disconnected from user root 192.168.204.21 port 52006 Apr 3 02:48:15 oleg421-client sshd[75348]: pam_unix(sshd:session): session closed for user root Apr 3 02:48:15 oleg421-client systemd[1]: session-380.scope: Succeeded. Apr 3 02:48:15 oleg421-client systemd-logind[1011]: Session 380 logged out. Waiting for processes to exit. Apr 3 02:48:15 oleg421-client systemd-logind[1011]: Removed session 380. Apr 3 02:48:16 oleg421-client sshd[75495]: Accepted publickey for root from 192.168.204.21 port 52012 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:48:16 oleg421-client systemd-logind[1011]: New session 381 of user root. Apr 3 02:48:16 oleg421-client systemd[1]: Started Session 381 of user root. Apr 3 02:48:16 oleg421-client sshd[75495]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:48:17 oleg421-client sshd[75508]: Received disconnect from 192.168.204.21 port 52012:11: disconnected by user Apr 3 02:48:17 oleg421-client sshd[75508]: Disconnected from user root 192.168.204.21 port 52012 Apr 3 02:48:17 oleg421-client sshd[75495]: pam_unix(sshd:session): session closed for user root Apr 3 02:48:17 oleg421-client systemd[1]: session-381.scope: Succeeded. Apr 3 02:48:17 oleg421-client systemd-logind[1011]: Session 381 logged out. Waiting for processes to exit. Apr 3 02:48:17 oleg421-client systemd-logind[1011]: Removed session 381. Apr 3 02:48:18 oleg421-client sshd[75650]: Accepted publickey for root from 192.168.204.21 port 41828 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:48:18 oleg421-client systemd[1]: Started Session 382 of user root. Apr 3 02:48:18 oleg421-client systemd-logind[1011]: New session 382 of user root. Apr 3 02:48:18 oleg421-client sshd[75650]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:48:19 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110b: create remote directory: drop Master rep ========================================================== 02:48:17 (1775198897) Apr 3 02:48:19 oleg421-client sshd[75663]: Received disconnect from 192.168.204.21 port 41828:11: disconnected by user Apr 3 02:48:19 oleg421-client sshd[75663]: Disconnected from user root 192.168.204.21 port 41828 Apr 3 02:48:19 oleg421-client sshd[75650]: pam_unix(sshd:session): session closed for user root Apr 3 02:48:19 oleg421-client systemd[1]: session-382.scope: Succeeded. Apr 3 02:48:19 oleg421-client systemd-logind[1011]: Session 382 logged out. Waiting for processes to exit. Apr 3 02:48:19 oleg421-client systemd-logind[1011]: Removed session 382. Apr 3 02:48:36 oleg421-client kernel: Lustre: 75707:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775198900/real 1775198900] req@ffff962445c45880 x1861425393617280/t0(0) o36->lustre-MDT0001-mdc-ffff9624446f7000@192.168.204.121@tcp:12/10 lens 560/576 e 0 to 1 dl 1775198916 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:4294967295 Apr 3 02:48:36 oleg421-client kernel: Lustre: 75707:0:(client.c:2479:ptlrpc_expire_one_request()) Skipped 6 previous similar messages Apr 3 02:48:36 oleg421-client kernel: Lustre: lustre-MDT0001-mdc-ffff9624446f7000: Connection restored to 192.168.204.121@tcp (at 192.168.204.121@tcp) Apr 3 02:48:36 oleg421-client kernel: Lustre: Skipped 16 previous similar messages Apr 3 02:48:40 oleg421-client sshd[75811]: Accepted publickey for root from 192.168.204.21 port 43206 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:48:40 oleg421-client systemd-logind[1011]: New session 383 of user root. Apr 3 02:48:40 oleg421-client systemd[1]: Started Session 383 of user root. Apr 3 02:48:40 oleg421-client sshd[75811]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:48:40 oleg421-client sshd[75824]: Received disconnect from 192.168.204.21 port 43206:11: disconnected by user Apr 3 02:48:40 oleg421-client sshd[75824]: Disconnected from user root 192.168.204.21 port 43206 Apr 3 02:48:40 oleg421-client sshd[75811]: pam_unix(sshd:session): session closed for user root Apr 3 02:48:40 oleg421-client systemd[1]: session-383.scope: Succeeded. Apr 3 02:48:40 oleg421-client systemd-logind[1011]: Session 383 logged out. Waiting for processes to exit. Apr 3 02:48:40 oleg421-client systemd-logind[1011]: Removed session 383. Apr 3 02:48:41 oleg421-client sshd[75950]: Accepted publickey for root from 192.168.204.21 port 43212 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:48:41 oleg421-client systemd-logind[1011]: New session 384 of user root. Apr 3 02:48:41 oleg421-client systemd[1]: Started Session 384 of user root. Apr 3 02:48:42 oleg421-client sshd[75950]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:48:42 oleg421-client sshd[75963]: Received disconnect from 192.168.204.21 port 43212:11: disconnected by user Apr 3 02:48:42 oleg421-client sshd[75963]: Disconnected from user root 192.168.204.21 port 43212 Apr 3 02:48:42 oleg421-client sshd[75950]: pam_unix(sshd:session): session closed for user root Apr 3 02:48:42 oleg421-client systemd-logind[1011]: Session 384 logged out. Waiting for processes to exit. Apr 3 02:48:42 oleg421-client systemd[1]: session-384.scope: Succeeded. Apr 3 02:48:42 oleg421-client systemd-logind[1011]: Removed session 384. Apr 3 02:48:43 oleg421-client sshd[76096]: Accepted publickey for root from 192.168.204.21 port 43224 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:48:43 oleg421-client systemd-logind[1011]: New session 385 of user root. Apr 3 02:48:43 oleg421-client systemd[1]: Started Session 385 of user root. Apr 3 02:48:43 oleg421-client sshd[76096]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:48:44 oleg421-client sshd[76109]: Received disconnect from 192.168.204.21 port 43224:11: disconnected by user Apr 3 02:48:44 oleg421-client sshd[76109]: Disconnected from user root 192.168.204.21 port 43224 Apr 3 02:48:44 oleg421-client sshd[76096]: pam_unix(sshd:session): session closed for user root Apr 3 02:48:44 oleg421-client systemd[1]: session-385.scope: Succeeded. Apr 3 02:48:44 oleg421-client systemd-logind[1011]: Session 385 logged out. Waiting for processes to exit. Apr 3 02:48:44 oleg421-client systemd-logind[1011]: Removed session 385. Apr 3 02:48:46 oleg421-client sshd[76251]: Accepted publickey for root from 192.168.204.21 port 43238 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:48:46 oleg421-client systemd[1]: Started Session 386 of user root. Apr 3 02:48:46 oleg421-client systemd-logind[1011]: New session 386 of user root. Apr 3 02:48:46 oleg421-client sshd[76251]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:48:46 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110c: create remote directory: drop update rep on slave MDT ========================================================== 02:48:44 (1775198924) Apr 3 02:48:46 oleg421-client sshd[76265]: Received disconnect from 192.168.204.21 port 43238:11: disconnected by user Apr 3 02:48:46 oleg421-client sshd[76265]: Disconnected from user root 192.168.204.21 port 43238 Apr 3 02:48:46 oleg421-client sshd[76251]: pam_unix(sshd:session): session closed for user root Apr 3 02:48:46 oleg421-client systemd[1]: session-386.scope: Succeeded. Apr 3 02:48:46 oleg421-client systemd-logind[1011]: Session 386 logged out. Waiting for processes to exit. Apr 3 02:48:46 oleg421-client systemd-logind[1011]: Removed session 386. Apr 3 02:49:01 oleg421-client anacron[43564]: Job `cron.daily' started Apr 3 02:49:01 oleg421-client run-parts[76317]: (/etc/cron.daily) starting logrotate Apr 3 02:49:01 oleg421-client run-parts[76317]: (/etc/cron.daily) finished logrotate Apr 3 02:49:01 oleg421-client anacron[43564]: Job `cron.daily' terminated Apr 3 02:49:07 oleg421-client sshd[76425]: Accepted publickey for root from 192.168.204.21 port 41066 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:49:07 oleg421-client systemd-logind[1011]: New session 387 of user root. Apr 3 02:49:07 oleg421-client systemd[1]: Started Session 387 of user root. Apr 3 02:49:07 oleg421-client sshd[76425]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:49:07 oleg421-client sshd[76438]: Received disconnect from 192.168.204.21 port 41066:11: disconnected by user Apr 3 02:49:07 oleg421-client sshd[76438]: Disconnected from user root 192.168.204.21 port 41066 Apr 3 02:49:07 oleg421-client sshd[76425]: pam_unix(sshd:session): session closed for user root Apr 3 02:49:08 oleg421-client systemd[1]: session-387.scope: Succeeded. Apr 3 02:49:08 oleg421-client systemd-logind[1011]: Session 387 logged out. Waiting for processes to exit. Apr 3 02:49:08 oleg421-client systemd-logind[1011]: Removed session 387. Apr 3 02:49:09 oleg421-client sshd[76564]: Accepted publickey for root from 192.168.204.21 port 51366 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:49:09 oleg421-client systemd-logind[1011]: New session 388 of user root. Apr 3 02:49:09 oleg421-client systemd[1]: Started Session 388 of user root. Apr 3 02:49:09 oleg421-client sshd[76564]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:49:09 oleg421-client sshd[76577]: Received disconnect from 192.168.204.21 port 51366:11: disconnected by user Apr 3 02:49:09 oleg421-client sshd[76577]: Disconnected from user root 192.168.204.21 port 51366 Apr 3 02:49:09 oleg421-client sshd[76564]: pam_unix(sshd:session): session closed for user root Apr 3 02:49:10 oleg421-client systemd-logind[1011]: Session 388 logged out. Waiting for processes to exit. Apr 3 02:49:10 oleg421-client systemd[1]: session-388.scope: Succeeded. Apr 3 02:49:10 oleg421-client systemd-logind[1011]: Removed session 388. Apr 3 02:49:11 oleg421-client sshd[76710]: Accepted publickey for root from 192.168.204.21 port 51382 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:49:11 oleg421-client systemd-logind[1011]: New session 389 of user root. Apr 3 02:49:11 oleg421-client systemd[1]: Started Session 389 of user root. Apr 3 02:49:11 oleg421-client sshd[76710]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:49:11 oleg421-client sshd[76723]: Received disconnect from 192.168.204.21 port 51382:11: disconnected by user Apr 3 02:49:11 oleg421-client sshd[76723]: Disconnected from user root 192.168.204.21 port 51382 Apr 3 02:49:11 oleg421-client sshd[76710]: pam_unix(sshd:session): session closed for user root Apr 3 02:49:11 oleg421-client systemd-logind[1011]: Session 389 logged out. Waiting for processes to exit. Apr 3 02:49:11 oleg421-client systemd[1]: session-389.scope: Succeeded. Apr 3 02:49:11 oleg421-client systemd-logind[1011]: Removed session 389. Apr 3 02:49:13 oleg421-client sshd[76866]: Accepted publickey for root from 192.168.204.21 port 51384 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:49:13 oleg421-client systemd-logind[1011]: New session 390 of user root. Apr 3 02:49:13 oleg421-client systemd[1]: Started Session 390 of user root. Apr 3 02:49:13 oleg421-client sshd[76866]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:49:14 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110d: remove remote directory: drop client req ========================================================== 02:49:12 (1775198952) Apr 3 02:49:14 oleg421-client sshd[76879]: Received disconnect from 192.168.204.21 port 51384:11: disconnected by user Apr 3 02:49:14 oleg421-client sshd[76879]: Disconnected from user root 192.168.204.21 port 51384 Apr 3 02:49:14 oleg421-client sshd[76866]: pam_unix(sshd:session): session closed for user root Apr 3 02:49:14 oleg421-client systemd[1]: session-390.scope: Succeeded. Apr 3 02:49:14 oleg421-client systemd-logind[1011]: Session 390 logged out. Waiting for processes to exit. Apr 3 02:49:14 oleg421-client systemd-logind[1011]: Removed session 390. Apr 3 02:50:14 oleg421-client sshd[77035]: Accepted publickey for root from 192.168.204.21 port 36084 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:50:14 oleg421-client systemd[1]: Started Session 391 of user root. Apr 3 02:50:14 oleg421-client systemd-logind[1011]: New session 391 of user root. Apr 3 02:50:14 oleg421-client sshd[77035]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:50:15 oleg421-client sshd[77048]: Received disconnect from 192.168.204.21 port 36084:11: disconnected by user Apr 3 02:50:15 oleg421-client sshd[77048]: Disconnected from user root 192.168.204.21 port 36084 Apr 3 02:50:15 oleg421-client sshd[77035]: pam_unix(sshd:session): session closed for user root Apr 3 02:50:15 oleg421-client systemd[1]: session-391.scope: Succeeded. Apr 3 02:50:15 oleg421-client systemd-logind[1011]: Session 391 logged out. Waiting for processes to exit. Apr 3 02:50:15 oleg421-client systemd-logind[1011]: Removed session 391. Apr 3 02:50:16 oleg421-client sshd[77174]: Accepted publickey for root from 192.168.204.21 port 36100 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:50:16 oleg421-client systemd-logind[1011]: New session 392 of user root. Apr 3 02:50:16 oleg421-client systemd[1]: Started Session 392 of user root. Apr 3 02:50:16 oleg421-client sshd[77174]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:50:17 oleg421-client sshd[77187]: Received disconnect from 192.168.204.21 port 36100:11: disconnected by user Apr 3 02:50:17 oleg421-client sshd[77187]: Disconnected from user root 192.168.204.21 port 36100 Apr 3 02:50:17 oleg421-client sshd[77174]: pam_unix(sshd:session): session closed for user root Apr 3 02:50:17 oleg421-client systemd[1]: session-392.scope: Succeeded. Apr 3 02:50:17 oleg421-client systemd-logind[1011]: Session 392 logged out. Waiting for processes to exit. Apr 3 02:50:17 oleg421-client systemd-logind[1011]: Removed session 392. Apr 3 02:50:18 oleg421-client sshd[77320]: Accepted publickey for root from 192.168.204.21 port 37666 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:50:18 oleg421-client systemd[1]: Started Session 393 of user root. Apr 3 02:50:18 oleg421-client systemd-logind[1011]: New session 393 of user root. Apr 3 02:50:18 oleg421-client sshd[77320]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:50:18 oleg421-client sshd[77334]: Received disconnect from 192.168.204.21 port 37666:11: disconnected by user Apr 3 02:50:18 oleg421-client sshd[77334]: Disconnected from user root 192.168.204.21 port 37666 Apr 3 02:50:18 oleg421-client sshd[77320]: pam_unix(sshd:session): session closed for user root Apr 3 02:50:19 oleg421-client systemd[1]: session-393.scope: Succeeded. Apr 3 02:50:19 oleg421-client systemd-logind[1011]: Session 393 logged out. Waiting for processes to exit. Apr 3 02:50:19 oleg421-client systemd-logind[1011]: Removed session 393. Apr 3 02:50:20 oleg421-client sshd[77476]: Accepted publickey for root from 192.168.204.21 port 37672 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:50:20 oleg421-client systemd-logind[1011]: New session 394 of user root. Apr 3 02:50:20 oleg421-client systemd[1]: Started Session 394 of user root. Apr 3 02:50:20 oleg421-client sshd[77476]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:50:21 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110e: remove remote directory: drop master rep ========================================================== 02:50:19 (1775199019) Apr 3 02:50:21 oleg421-client sshd[77489]: Received disconnect from 192.168.204.21 port 37672:11: disconnected by user Apr 3 02:50:21 oleg421-client sshd[77489]: Disconnected from user root 192.168.204.21 port 37672 Apr 3 02:50:21 oleg421-client sshd[77476]: pam_unix(sshd:session): session closed for user root Apr 3 02:50:21 oleg421-client systemd[1]: session-394.scope: Succeeded. Apr 3 02:50:21 oleg421-client systemd-logind[1011]: Session 394 logged out. Waiting for processes to exit. Apr 3 02:50:21 oleg421-client systemd-logind[1011]: Removed session 394. Apr 3 02:51:21 oleg421-client sshd[77639]: Accepted publickey for root from 192.168.204.21 port 49682 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:51:21 oleg421-client systemd-logind[1011]: New session 395 of user root. Apr 3 02:51:21 oleg421-client systemd[1]: Started Session 395 of user root. Apr 3 02:51:21 oleg421-client sshd[77639]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:51:21 oleg421-client sshd[77653]: Received disconnect from 192.168.204.21 port 49682:11: disconnected by user Apr 3 02:51:21 oleg421-client sshd[77653]: Disconnected from user root 192.168.204.21 port 49682 Apr 3 02:51:21 oleg421-client sshd[77639]: pam_unix(sshd:session): session closed for user root Apr 3 02:51:22 oleg421-client systemd[1]: session-395.scope: Succeeded. Apr 3 02:51:22 oleg421-client systemd-logind[1011]: Session 395 logged out. Waiting for processes to exit. Apr 3 02:51:22 oleg421-client systemd-logind[1011]: Removed session 395. Apr 3 02:51:23 oleg421-client sshd[77780]: Accepted publickey for root from 192.168.204.21 port 49692 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:51:23 oleg421-client systemd[1]: Started Session 396 of user root. Apr 3 02:51:23 oleg421-client systemd-logind[1011]: New session 396 of user root. Apr 3 02:51:23 oleg421-client sshd[77780]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:51:23 oleg421-client sshd[77793]: Received disconnect from 192.168.204.21 port 49692:11: disconnected by user Apr 3 02:51:23 oleg421-client sshd[77793]: Disconnected from user root 192.168.204.21 port 49692 Apr 3 02:51:23 oleg421-client sshd[77780]: pam_unix(sshd:session): session closed for user root Apr 3 02:51:23 oleg421-client systemd[1]: session-396.scope: Succeeded. Apr 3 02:51:23 oleg421-client systemd-logind[1011]: Session 396 logged out. Waiting for processes to exit. Apr 3 02:51:23 oleg421-client systemd-logind[1011]: Removed session 396. Apr 3 02:51:24 oleg421-client sshd[77926]: Accepted publickey for root from 192.168.204.21 port 49706 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:51:24 oleg421-client systemd-logind[1011]: New session 397 of user root. Apr 3 02:51:24 oleg421-client systemd[1]: Started Session 397 of user root. Apr 3 02:51:24 oleg421-client sshd[77926]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:51:25 oleg421-client sshd[77939]: Received disconnect from 192.168.204.21 port 49706:11: disconnected by user Apr 3 02:51:25 oleg421-client sshd[77939]: Disconnected from user root 192.168.204.21 port 49706 Apr 3 02:51:25 oleg421-client sshd[77926]: pam_unix(sshd:session): session closed for user root Apr 3 02:51:25 oleg421-client systemd[1]: session-397.scope: Succeeded. Apr 3 02:51:25 oleg421-client systemd-logind[1011]: Session 397 logged out. Waiting for processes to exit. Apr 3 02:51:25 oleg421-client systemd-logind[1011]: Removed session 397. Apr 3 02:51:27 oleg421-client sshd[78081]: Accepted publickey for root from 192.168.204.21 port 49718 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:51:27 oleg421-client systemd-logind[1011]: New session 398 of user root. Apr 3 02:51:27 oleg421-client systemd[1]: Started Session 398 of user root. Apr 3 02:51:27 oleg421-client sshd[78081]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:51:27 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110f: remove remote directory: drop slave rep ========================================================== 02:51:26 (1775199086) Apr 3 02:51:27 oleg421-client sshd[78094]: Received disconnect from 192.168.204.21 port 49718:11: disconnected by user Apr 3 02:51:27 oleg421-client sshd[78094]: Disconnected from user root 192.168.204.21 port 49718 Apr 3 02:51:27 oleg421-client sshd[78081]: pam_unix(sshd:session): session closed for user root Apr 3 02:51:28 oleg421-client systemd[1]: session-398.scope: Succeeded. Apr 3 02:51:28 oleg421-client systemd-logind[1011]: Session 398 logged out. Waiting for processes to exit. Apr 3 02:51:28 oleg421-client systemd-logind[1011]: Removed session 398. Apr 3 02:51:49 oleg421-client sshd[78244]: Accepted publickey for root from 192.168.204.21 port 52330 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:51:49 oleg421-client systemd-logind[1011]: New session 399 of user root. Apr 3 02:51:49 oleg421-client systemd[1]: Started Session 399 of user root. Apr 3 02:51:49 oleg421-client sshd[78244]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:51:49 oleg421-client sshd[78257]: Received disconnect from 192.168.204.21 port 52330:11: disconnected by user Apr 3 02:51:49 oleg421-client sshd[78257]: Disconnected from user root 192.168.204.21 port 52330 Apr 3 02:51:49 oleg421-client sshd[78244]: pam_unix(sshd:session): session closed for user root Apr 3 02:51:49 oleg421-client systemd[1]: session-399.scope: Succeeded. Apr 3 02:51:50 oleg421-client systemd-logind[1011]: Session 399 logged out. Waiting for processes to exit. Apr 3 02:51:50 oleg421-client systemd-logind[1011]: Removed session 399. Apr 3 02:51:51 oleg421-client sshd[78384]: Accepted publickey for root from 192.168.204.21 port 52344 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:51:51 oleg421-client systemd-logind[1011]: New session 400 of user root. Apr 3 02:51:51 oleg421-client systemd[1]: Started Session 400 of user root. Apr 3 02:51:51 oleg421-client sshd[78384]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:51:51 oleg421-client sshd[78397]: Received disconnect from 192.168.204.21 port 52344:11: disconnected by user Apr 3 02:51:51 oleg421-client sshd[78397]: Disconnected from user root 192.168.204.21 port 52344 Apr 3 02:51:51 oleg421-client sshd[78384]: pam_unix(sshd:session): session closed for user root Apr 3 02:51:51 oleg421-client systemd[1]: session-400.scope: Succeeded. Apr 3 02:51:51 oleg421-client systemd-logind[1011]: Session 400 logged out. Waiting for processes to exit. Apr 3 02:51:51 oleg421-client systemd-logind[1011]: Removed session 400. Apr 3 02:51:53 oleg421-client sshd[78530]: Accepted publickey for root from 192.168.204.21 port 52358 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:51:53 oleg421-client systemd-logind[1011]: New session 401 of user root. Apr 3 02:51:53 oleg421-client systemd[1]: Started Session 401 of user root. Apr 3 02:51:53 oleg421-client sshd[78530]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:51:53 oleg421-client sshd[78544]: Received disconnect from 192.168.204.21 port 52358:11: disconnected by user Apr 3 02:51:53 oleg421-client sshd[78544]: Disconnected from user root 192.168.204.21 port 52358 Apr 3 02:51:53 oleg421-client sshd[78530]: pam_unix(sshd:session): session closed for user root Apr 3 02:51:53 oleg421-client systemd[1]: session-401.scope: Succeeded. Apr 3 02:51:53 oleg421-client systemd-logind[1011]: Session 401 logged out. Waiting for processes to exit. Apr 3 02:51:53 oleg421-client systemd-logind[1011]: Removed session 401. Apr 3 02:51:55 oleg421-client sshd[78686]: Accepted publickey for root from 192.168.204.21 port 52366 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:51:55 oleg421-client systemd-logind[1011]: New session 402 of user root. Apr 3 02:51:55 oleg421-client systemd[1]: Started Session 402 of user root. Apr 3 02:51:55 oleg421-client sshd[78686]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:51:55 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110g: drop reply during migration ========================================================== 02:51:53 (1775199113) Apr 3 02:51:55 oleg421-client sshd[78699]: Received disconnect from 192.168.204.21 port 52366:11: disconnected by user Apr 3 02:51:55 oleg421-client sshd[78699]: Disconnected from user root 192.168.204.21 port 52366 Apr 3 02:51:55 oleg421-client sshd[78686]: pam_unix(sshd:session): session closed for user root Apr 3 02:51:55 oleg421-client systemd-logind[1011]: Session 402 logged out. Waiting for processes to exit. Apr 3 02:51:55 oleg421-client systemd[1]: session-402.scope: Succeeded. Apr 3 02:51:55 oleg421-client systemd-logind[1011]: Removed session 402. Apr 3 02:52:54 oleg421-client sshd[78857]: Accepted publickey for root from 192.168.204.21 port 55530 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:52:54 oleg421-client systemd-logind[1011]: New session 403 of user root. Apr 3 02:52:54 oleg421-client systemd[1]: Started Session 403 of user root. Apr 3 02:52:54 oleg421-client sshd[78857]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:52:54 oleg421-client sshd[78870]: Received disconnect from 192.168.204.21 port 55530:11: disconnected by user Apr 3 02:52:54 oleg421-client sshd[78870]: Disconnected from user root 192.168.204.21 port 55530 Apr 3 02:52:54 oleg421-client sshd[78857]: pam_unix(sshd:session): session closed for user root Apr 3 02:52:54 oleg421-client systemd-logind[1011]: Session 403 logged out. Waiting for processes to exit. Apr 3 02:52:54 oleg421-client systemd[1]: session-403.scope: Succeeded. Apr 3 02:52:54 oleg421-client systemd-logind[1011]: Removed session 403. Apr 3 02:52:56 oleg421-client sshd[78996]: Accepted publickey for root from 192.168.204.21 port 55532 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:52:56 oleg421-client systemd[1]: Started Session 404 of user root. Apr 3 02:52:56 oleg421-client systemd-logind[1011]: New session 404 of user root. Apr 3 02:52:56 oleg421-client sshd[78996]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:52:56 oleg421-client sshd[79010]: Received disconnect from 192.168.204.21 port 55532:11: disconnected by user Apr 3 02:52:56 oleg421-client sshd[79010]: Disconnected from user root 192.168.204.21 port 55532 Apr 3 02:52:56 oleg421-client sshd[78996]: pam_unix(sshd:session): session closed for user root Apr 3 02:52:56 oleg421-client systemd[1]: session-404.scope: Succeeded. Apr 3 02:52:56 oleg421-client systemd-logind[1011]: Session 404 logged out. Waiting for processes to exit. Apr 3 02:52:56 oleg421-client systemd-logind[1011]: Removed session 404. Apr 3 02:52:58 oleg421-client sshd[79143]: Accepted publickey for root from 192.168.204.21 port 44658 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:52:58 oleg421-client systemd-logind[1011]: New session 405 of user root. Apr 3 02:52:58 oleg421-client systemd[1]: Started Session 405 of user root. Apr 3 02:52:58 oleg421-client sshd[79143]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:52:58 oleg421-client sshd[79156]: Received disconnect from 192.168.204.21 port 44658:11: disconnected by user Apr 3 02:52:58 oleg421-client sshd[79156]: Disconnected from user root 192.168.204.21 port 44658 Apr 3 02:52:58 oleg421-client sshd[79143]: pam_unix(sshd:session): session closed for user root Apr 3 02:52:58 oleg421-client systemd[1]: session-405.scope: Succeeded. Apr 3 02:52:58 oleg421-client systemd-logind[1011]: Session 405 logged out. Waiting for processes to exit. Apr 3 02:52:59 oleg421-client systemd-logind[1011]: Removed session 405. Apr 3 02:53:00 oleg421-client sshd[79298]: Accepted publickey for root from 192.168.204.21 port 44662 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:53:00 oleg421-client systemd-logind[1011]: New session 406 of user root. Apr 3 02:53:00 oleg421-client systemd[1]: Started Session 406 of user root. Apr 3 02:53:00 oleg421-client sshd[79298]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:53:01 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110h: drop update reply during cross-MDT file rename ========================================================== 02:52:59 (1775199179) Apr 3 02:53:01 oleg421-client sshd[79311]: Received disconnect from 192.168.204.21 port 44662:11: disconnected by user Apr 3 02:53:01 oleg421-client sshd[79311]: Disconnected from user root 192.168.204.21 port 44662 Apr 3 02:53:01 oleg421-client sshd[79298]: pam_unix(sshd:session): session closed for user root Apr 3 02:53:01 oleg421-client systemd[1]: session-406.scope: Succeeded. Apr 3 02:53:01 oleg421-client systemd-logind[1011]: Session 406 logged out. Waiting for processes to exit. Apr 3 02:53:01 oleg421-client systemd-logind[1011]: Removed session 406. Apr 3 02:53:22 oleg421-client sshd[79466]: Accepted publickey for root from 192.168.204.21 port 54440 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:53:23 oleg421-client systemd[1]: Started Session 407 of user root. Apr 3 02:53:23 oleg421-client systemd-logind[1011]: New session 407 of user root. Apr 3 02:53:23 oleg421-client sshd[79466]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:53:23 oleg421-client sshd[79479]: Received disconnect from 192.168.204.21 port 54440:11: disconnected by user Apr 3 02:53:23 oleg421-client sshd[79479]: Disconnected from user root 192.168.204.21 port 54440 Apr 3 02:53:23 oleg421-client sshd[79466]: pam_unix(sshd:session): session closed for user root Apr 3 02:53:23 oleg421-client systemd-logind[1011]: Session 407 logged out. Waiting for processes to exit. Apr 3 02:53:23 oleg421-client systemd[1]: session-407.scope: Succeeded. Apr 3 02:53:23 oleg421-client systemd-logind[1011]: Removed session 407. Apr 3 02:53:24 oleg421-client sshd[79605]: Accepted publickey for root from 192.168.204.21 port 54456 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:53:24 oleg421-client systemd-logind[1011]: New session 408 of user root. Apr 3 02:53:24 oleg421-client systemd[1]: Started Session 408 of user root. Apr 3 02:53:24 oleg421-client sshd[79605]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:53:25 oleg421-client sshd[79618]: Received disconnect from 192.168.204.21 port 54456:11: disconnected by user Apr 3 02:53:25 oleg421-client sshd[79618]: Disconnected from user root 192.168.204.21 port 54456 Apr 3 02:53:25 oleg421-client sshd[79605]: pam_unix(sshd:session): session closed for user root Apr 3 02:53:25 oleg421-client systemd[1]: session-408.scope: Succeeded. Apr 3 02:53:25 oleg421-client systemd-logind[1011]: Session 408 logged out. Waiting for processes to exit. Apr 3 02:53:25 oleg421-client systemd-logind[1011]: Removed session 408. Apr 3 02:53:26 oleg421-client sshd[79753]: Accepted publickey for root from 192.168.204.21 port 54462 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:53:26 oleg421-client systemd-logind[1011]: New session 409 of user root. Apr 3 02:53:26 oleg421-client systemd[1]: Started Session 409 of user root. Apr 3 02:53:26 oleg421-client sshd[79753]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:53:27 oleg421-client sshd[79766]: Received disconnect from 192.168.204.21 port 54462:11: disconnected by user Apr 3 02:53:27 oleg421-client sshd[79766]: Disconnected from user root 192.168.204.21 port 54462 Apr 3 02:53:27 oleg421-client sshd[79753]: pam_unix(sshd:session): session closed for user root Apr 3 02:53:27 oleg421-client systemd[1]: session-409.scope: Succeeded. Apr 3 02:53:27 oleg421-client systemd-logind[1011]: Session 409 logged out. Waiting for processes to exit. Apr 3 02:53:27 oleg421-client systemd-logind[1011]: Removed session 409. Apr 3 02:53:29 oleg421-client sshd[79908]: Accepted publickey for root from 192.168.204.21 port 56786 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:53:29 oleg421-client systemd-logind[1011]: New session 410 of user root. Apr 3 02:53:29 oleg421-client systemd[1]: Started Session 410 of user root. Apr 3 02:53:29 oleg421-client sshd[79908]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:53:30 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110i: drop update reply during cross-MDT dir rename ========================================================== 02:53:27 (1775199207) Apr 3 02:53:30 oleg421-client sshd[79921]: Received disconnect from 192.168.204.21 port 56786:11: disconnected by user Apr 3 02:53:30 oleg421-client sshd[79921]: Disconnected from user root 192.168.204.21 port 56786 Apr 3 02:53:30 oleg421-client sshd[79908]: pam_unix(sshd:session): session closed for user root Apr 3 02:53:30 oleg421-client systemd[1]: session-410.scope: Succeeded. Apr 3 02:53:30 oleg421-client systemd-logind[1011]: Session 410 logged out. Waiting for processes to exit. Apr 3 02:53:30 oleg421-client systemd-logind[1011]: Removed session 410. Apr 3 02:53:50 oleg421-client sshd[80079]: Accepted publickey for root from 192.168.204.21 port 40446 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:53:50 oleg421-client systemd-logind[1011]: New session 411 of user root. Apr 3 02:53:50 oleg421-client systemd[1]: Started Session 411 of user root. Apr 3 02:53:50 oleg421-client sshd[80079]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:53:51 oleg421-client sshd[80092]: Received disconnect from 192.168.204.21 port 40446:11: disconnected by user Apr 3 02:53:51 oleg421-client sshd[80092]: Disconnected from user root 192.168.204.21 port 40446 Apr 3 02:53:51 oleg421-client sshd[80079]: pam_unix(sshd:session): session closed for user root Apr 3 02:53:51 oleg421-client systemd[1]: session-411.scope: Succeeded. Apr 3 02:53:51 oleg421-client systemd-logind[1011]: Session 411 logged out. Waiting for processes to exit. Apr 3 02:53:51 oleg421-client systemd-logind[1011]: Removed session 411. Apr 3 02:53:52 oleg421-client sshd[80219]: Accepted publickey for root from 192.168.204.21 port 40452 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:53:52 oleg421-client systemd-logind[1011]: New session 412 of user root. Apr 3 02:53:52 oleg421-client systemd[1]: Started Session 412 of user root. Apr 3 02:53:52 oleg421-client sshd[80219]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:53:52 oleg421-client sshd[80232]: Received disconnect from 192.168.204.21 port 40452:11: disconnected by user Apr 3 02:53:52 oleg421-client sshd[80232]: Disconnected from user root 192.168.204.21 port 40452 Apr 3 02:53:52 oleg421-client sshd[80219]: pam_unix(sshd:session): session closed for user root Apr 3 02:53:53 oleg421-client systemd[1]: session-412.scope: Succeeded. Apr 3 02:53:53 oleg421-client systemd-logind[1011]: Session 412 logged out. Waiting for processes to exit. Apr 3 02:53:53 oleg421-client systemd-logind[1011]: Removed session 412. Apr 3 02:53:54 oleg421-client sshd[80365]: Accepted publickey for root from 192.168.204.21 port 40462 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:53:54 oleg421-client systemd[1]: Started Session 413 of user root. Apr 3 02:53:54 oleg421-client systemd-logind[1011]: New session 413 of user root. Apr 3 02:53:54 oleg421-client sshd[80365]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:53:54 oleg421-client rsyslogd[1073]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Apr 3 02:53:54 oleg421-client sshd[80379]: Received disconnect from 192.168.204.21 port 40462:11: disconnected by user Apr 3 02:53:54 oleg421-client sshd[80379]: Disconnected from user root 192.168.204.21 port 40462 Apr 3 02:53:54 oleg421-client sshd[80365]: pam_unix(sshd:session): session closed for user root Apr 3 02:53:54 oleg421-client systemd[1]: session-413.scope: Succeeded. Apr 3 02:53:54 oleg421-client systemd-logind[1011]: Session 413 logged out. Waiting for processes to exit. Apr 3 02:53:54 oleg421-client systemd-logind[1011]: Removed session 413. Apr 3 02:53:56 oleg421-client sshd[80522]: Accepted publickey for root from 192.168.204.21 port 40466 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:53:56 oleg421-client systemd-logind[1011]: New session 414 of user root. Apr 3 02:53:56 oleg421-client systemd[1]: Started Session 414 of user root. Apr 3 02:53:56 oleg421-client sshd[80522]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:53:56 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110j: drop update reply during cross-MDT ln ========================================================== 02:53:55 (1775199235) Apr 3 02:53:56 oleg421-client sshd[80535]: Received disconnect from 192.168.204.21 port 40466:11: disconnected by user Apr 3 02:53:56 oleg421-client sshd[80535]: Disconnected from user root 192.168.204.21 port 40466 Apr 3 02:53:56 oleg421-client sshd[80522]: pam_unix(sshd:session): session closed for user root Apr 3 02:53:56 oleg421-client systemd[1]: session-414.scope: Succeeded. Apr 3 02:53:56 oleg421-client systemd-logind[1011]: Session 414 logged out. Waiting for processes to exit. Apr 3 02:53:56 oleg421-client systemd-logind[1011]: Removed session 414. Apr 3 02:54:17 oleg421-client sshd[80690]: Accepted publickey for root from 192.168.204.21 port 54136 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:54:17 oleg421-client systemd-logind[1011]: New session 415 of user root. Apr 3 02:54:17 oleg421-client systemd[1]: Started Session 415 of user root. Apr 3 02:54:17 oleg421-client sshd[80690]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:54:17 oleg421-client sshd[80703]: Received disconnect from 192.168.204.21 port 54136:11: disconnected by user Apr 3 02:54:17 oleg421-client sshd[80703]: Disconnected from user root 192.168.204.21 port 54136 Apr 3 02:54:17 oleg421-client sshd[80690]: pam_unix(sshd:session): session closed for user root Apr 3 02:54:17 oleg421-client systemd[1]: session-415.scope: Succeeded. Apr 3 02:54:17 oleg421-client systemd-logind[1011]: Session 415 logged out. Waiting for processes to exit. Apr 3 02:54:17 oleg421-client systemd-logind[1011]: Removed session 415. Apr 3 02:54:18 oleg421-client sshd[80829]: Accepted publickey for root from 192.168.204.21 port 56180 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:54:18 oleg421-client systemd-logind[1011]: New session 416 of user root. Apr 3 02:54:18 oleg421-client systemd[1]: Started Session 416 of user root. Apr 3 02:54:18 oleg421-client sshd[80829]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:54:19 oleg421-client sshd[80842]: Received disconnect from 192.168.204.21 port 56180:11: disconnected by user Apr 3 02:54:19 oleg421-client sshd[80842]: Disconnected from user root 192.168.204.21 port 56180 Apr 3 02:54:19 oleg421-client sshd[80829]: pam_unix(sshd:session): session closed for user root Apr 3 02:54:19 oleg421-client systemd[1]: session-416.scope: Succeeded. Apr 3 02:54:19 oleg421-client systemd-logind[1011]: Session 416 logged out. Waiting for processes to exit. Apr 3 02:54:19 oleg421-client systemd-logind[1011]: Removed session 416. Apr 3 02:54:20 oleg421-client sshd[80975]: Accepted publickey for root from 192.168.204.21 port 56196 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:54:20 oleg421-client systemd-logind[1011]: New session 417 of user root. Apr 3 02:54:20 oleg421-client systemd[1]: Started Session 417 of user root. Apr 3 02:54:20 oleg421-client sshd[80975]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:54:21 oleg421-client sshd[80988]: Received disconnect from 192.168.204.21 port 56196:11: disconnected by user Apr 3 02:54:21 oleg421-client sshd[80988]: Disconnected from user root 192.168.204.21 port 56196 Apr 3 02:54:21 oleg421-client sshd[80975]: pam_unix(sshd:session): session closed for user root Apr 3 02:54:21 oleg421-client systemd[1]: session-417.scope: Succeeded. Apr 3 02:54:21 oleg421-client systemd-logind[1011]: Session 417 logged out. Waiting for processes to exit. Apr 3 02:54:21 oleg421-client systemd-logind[1011]: Removed session 417. Apr 3 02:54:23 oleg421-client sshd[81131]: Accepted publickey for root from 192.168.204.21 port 56210 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:54:23 oleg421-client systemd-logind[1011]: New session 418 of user root. Apr 3 02:54:23 oleg421-client systemd[1]: Started Session 418 of user root. Apr 3 02:54:23 oleg421-client sshd[81131]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:54:23 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110k: FID_QUERY failed during recovery ========================================================== 02:54:21 (1775199261) Apr 3 02:54:23 oleg421-client sshd[81144]: Received disconnect from 192.168.204.21 port 56210:11: disconnected by user Apr 3 02:54:23 oleg421-client sshd[81144]: Disconnected from user root 192.168.204.21 port 56210 Apr 3 02:54:23 oleg421-client sshd[81131]: pam_unix(sshd:session): session closed for user root Apr 3 02:54:23 oleg421-client systemd[1]: session-418.scope: Succeeded. Apr 3 02:54:23 oleg421-client systemd-logind[1011]: Session 418 logged out. Waiting for processes to exit. Apr 3 02:54:23 oleg421-client systemd-logind[1011]: Removed session 418. Apr 3 02:54:24 oleg421-client systemd[1]: mnt-lustre.mount: Succeeded. Apr 3 02:54:24 oleg421-client kernel: LustreError: 81182:0:(lov_obd.c:786:lov_cleanup()) lustre-clilov-ffff9624446f7000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Apr 3 02:54:24 oleg421-client kernel: LustreError: 81182:0:(lov_obd.c:786:lov_cleanup()) Skipped 1 previous similar message Apr 3 02:54:24 oleg421-client kernel: Lustre: Unmounted lustre-client Apr 3 02:55:09 oleg421-client systemd-udevd[81685]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Apr 3 02:55:09 oleg421-client kernel: Lustre: Mounted lustre-client Apr 3 02:55:10 oleg421-client sshd[81713]: Accepted publickey for root from 192.168.204.21 port 60656 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:55:10 oleg421-client systemd[1]: Started Session 419 of user root. Apr 3 02:55:10 oleg421-client systemd-logind[1011]: New session 419 of user root. Apr 3 02:55:10 oleg421-client sshd[81713]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:55:11 oleg421-client sshd[81726]: Received disconnect from 192.168.204.21 port 60656:11: disconnected by user Apr 3 02:55:11 oleg421-client sshd[81726]: Disconnected from user root 192.168.204.21 port 60656 Apr 3 02:55:11 oleg421-client sshd[81713]: pam_unix(sshd:session): session closed for user root Apr 3 02:55:11 oleg421-client systemd[1]: session-419.scope: Succeeded. Apr 3 02:55:11 oleg421-client systemd-logind[1011]: Session 419 logged out. Waiting for processes to exit. Apr 3 02:55:11 oleg421-client systemd-logind[1011]: Removed session 419. Apr 3 02:55:20 oleg421-client sshd[81957]: Accepted publickey for root from 192.168.204.21 port 46628 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:55:20 oleg421-client systemd-logind[1011]: New session 420 of user root. Apr 3 02:55:20 oleg421-client systemd[1]: Started Session 420 of user root. Apr 3 02:55:20 oleg421-client sshd[81957]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:55:20 oleg421-client sshd[81970]: Received disconnect from 192.168.204.21 port 46628:11: disconnected by user Apr 3 02:55:20 oleg421-client sshd[81970]: Disconnected from user root 192.168.204.21 port 46628 Apr 3 02:55:20 oleg421-client sshd[81957]: pam_unix(sshd:session): session closed for user root Apr 3 02:55:21 oleg421-client systemd[1]: session-420.scope: Succeeded. Apr 3 02:55:21 oleg421-client systemd-logind[1011]: Session 420 logged out. Waiting for processes to exit. Apr 3 02:55:21 oleg421-client systemd-logind[1011]: Removed session 420. Apr 3 02:55:21 oleg421-client sshd[82096]: Accepted publickey for root from 192.168.204.21 port 46634 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:55:22 oleg421-client systemd-logind[1011]: New session 421 of user root. Apr 3 02:55:22 oleg421-client systemd[1]: Started Session 421 of user root. Apr 3 02:55:22 oleg421-client sshd[82096]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:55:22 oleg421-client sshd[82109]: Received disconnect from 192.168.204.21 port 46634:11: disconnected by user Apr 3 02:55:22 oleg421-client sshd[82109]: Disconnected from user root 192.168.204.21 port 46634 Apr 3 02:55:22 oleg421-client sshd[82096]: pam_unix(sshd:session): session closed for user root Apr 3 02:55:22 oleg421-client systemd[1]: session-421.scope: Succeeded. Apr 3 02:55:22 oleg421-client systemd-logind[1011]: Session 421 logged out. Waiting for processes to exit. Apr 3 02:55:22 oleg421-client systemd-logind[1011]: Removed session 421. Apr 3 02:55:23 oleg421-client sshd[82242]: Accepted publickey for root from 192.168.204.21 port 46648 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:55:23 oleg421-client systemd-logind[1011]: New session 422 of user root. Apr 3 02:55:23 oleg421-client systemd[1]: Started Session 422 of user root. Apr 3 02:55:23 oleg421-client sshd[82242]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:55:23 oleg421-client sshd[82255]: Received disconnect from 192.168.204.21 port 46648:11: disconnected by user Apr 3 02:55:23 oleg421-client sshd[82255]: Disconnected from user root 192.168.204.21 port 46648 Apr 3 02:55:23 oleg421-client sshd[82242]: pam_unix(sshd:session): session closed for user root Apr 3 02:55:24 oleg421-client systemd[1]: session-422.scope: Succeeded. Apr 3 02:55:24 oleg421-client systemd-logind[1011]: Session 422 logged out. Waiting for processes to exit. Apr 3 02:55:24 oleg421-client systemd-logind[1011]: Removed session 422. Apr 3 02:55:26 oleg421-client sshd[82397]: Accepted publickey for root from 192.168.204.21 port 46654 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:55:26 oleg421-client systemd-logind[1011]: New session 423 of user root. Apr 3 02:55:26 oleg421-client systemd[1]: Started Session 423 of user root. Apr 3 02:55:26 oleg421-client sshd[82397]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:55:27 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110m: update resent vs original RPC race ========================================================== 02:55:24 (1775199324) Apr 3 02:55:27 oleg421-client sshd[82410]: Received disconnect from 192.168.204.21 port 46654:11: disconnected by user Apr 3 02:55:27 oleg421-client sshd[82410]: Disconnected from user root 192.168.204.21 port 46654 Apr 3 02:55:27 oleg421-client sshd[82397]: pam_unix(sshd:session): session closed for user root Apr 3 02:55:27 oleg421-client systemd-logind[1011]: Session 423 logged out. Waiting for processes to exit. Apr 3 02:55:27 oleg421-client systemd[1]: session-423.scope: Succeeded. Apr 3 02:55:27 oleg421-client systemd-logind[1011]: Removed session 423. Apr 3 02:55:39 oleg421-client sshd[82600]: Accepted publickey for root from 192.168.204.21 port 56384 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:55:39 oleg421-client systemd[1]: Started Session 424 of user root. Apr 3 02:55:39 oleg421-client systemd-logind[1011]: New session 424 of user root. Apr 3 02:55:39 oleg421-client sshd[82600]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:55:39 oleg421-client sshd[82614]: Received disconnect from 192.168.204.21 port 56384:11: disconnected by user Apr 3 02:55:39 oleg421-client sshd[82614]: Disconnected from user root 192.168.204.21 port 56384 Apr 3 02:55:39 oleg421-client sshd[82600]: pam_unix(sshd:session): session closed for user root Apr 3 02:55:40 oleg421-client systemd-logind[1011]: Session 424 logged out. Waiting for processes to exit. Apr 3 02:55:40 oleg421-client systemd[1]: session-424.scope: Succeeded. Apr 3 02:55:40 oleg421-client systemd-logind[1011]: Removed session 424. Apr 3 02:55:41 oleg421-client sshd[82740]: Accepted publickey for root from 192.168.204.21 port 56388 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:55:41 oleg421-client systemd-logind[1011]: New session 425 of user root. Apr 3 02:55:41 oleg421-client systemd[1]: Started Session 425 of user root. Apr 3 02:55:41 oleg421-client sshd[82740]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:55:41 oleg421-client sshd[82753]: Received disconnect from 192.168.204.21 port 56388:11: disconnected by user Apr 3 02:55:41 oleg421-client sshd[82753]: Disconnected from user root 192.168.204.21 port 56388 Apr 3 02:55:41 oleg421-client sshd[82740]: pam_unix(sshd:session): session closed for user root Apr 3 02:55:41 oleg421-client systemd[1]: session-425.scope: Succeeded. Apr 3 02:55:41 oleg421-client systemd-logind[1011]: Session 425 logged out. Waiting for processes to exit. Apr 3 02:55:41 oleg421-client systemd-logind[1011]: Removed session 425. Apr 3 02:55:43 oleg421-client sshd[82886]: Accepted publickey for root from 192.168.204.21 port 56398 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:55:43 oleg421-client systemd-logind[1011]: New session 426 of user root. Apr 3 02:55:43 oleg421-client systemd[1]: Started Session 426 of user root. Apr 3 02:55:43 oleg421-client sshd[82886]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:55:43 oleg421-client sshd[82899]: Received disconnect from 192.168.204.21 port 56398:11: disconnected by user Apr 3 02:55:43 oleg421-client sshd[82899]: Disconnected from user root 192.168.204.21 port 56398 Apr 3 02:55:43 oleg421-client sshd[82886]: pam_unix(sshd:session): session closed for user root Apr 3 02:55:43 oleg421-client systemd[1]: session-426.scope: Succeeded. Apr 3 02:55:43 oleg421-client systemd-logind[1011]: Session 426 logged out. Waiting for processes to exit. Apr 3 02:55:43 oleg421-client systemd-logind[1011]: Removed session 426. Apr 3 02:55:45 oleg421-client sshd[83041]: Accepted publickey for root from 192.168.204.21 port 56414 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:55:45 oleg421-client systemd-logind[1011]: New session 427 of user root. Apr 3 02:55:45 oleg421-client systemd[1]: Started Session 427 of user root. Apr 3 02:55:45 oleg421-client sshd[83041]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:55:45 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 111: mdd setup fail should not cause umount oops ========================================================== 02:55:44 (1775199344) Apr 3 02:55:45 oleg421-client sshd[83055]: Received disconnect from 192.168.204.21 port 56414:11: disconnected by user Apr 3 02:55:45 oleg421-client sshd[83055]: Disconnected from user root 192.168.204.21 port 56414 Apr 3 02:55:45 oleg421-client sshd[83041]: pam_unix(sshd:session): session closed for user root Apr 3 02:55:46 oleg421-client systemd[1]: session-427.scope: Succeeded. Apr 3 02:55:46 oleg421-client systemd-logind[1011]: Session 427 logged out. Waiting for processes to exit. Apr 3 02:55:46 oleg421-client systemd-logind[1011]: Removed session 427. Apr 3 02:56:06 oleg421-client kernel: LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 192.168.204.121@tcp) was lost; in progress operations using this service will fail Apr 3 02:56:06 oleg421-client kernel: LustreError: Skipped 1 previous similar message Apr 3 02:56:17 oleg421-client kernel: Lustre: Evicted from MGS (at 192.168.204.121@tcp) after server handle changed from 0x1d1756950d13ea56 to 0x1d1756950d13efab Apr 3 02:56:17 oleg421-client kernel: Lustre: Skipped 1 previous similar message Apr 3 02:56:25 oleg421-client sshd[83520]: Accepted publickey for root from 192.168.204.21 port 35102 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:56:25 oleg421-client systemd-logind[1011]: New session 428 of user root. Apr 3 02:56:25 oleg421-client systemd[1]: Started Session 428 of user root. Apr 3 02:56:25 oleg421-client sshd[83520]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:56:26 oleg421-client sshd[83533]: Received disconnect from 192.168.204.21 port 35102:11: disconnected by user Apr 3 02:56:26 oleg421-client sshd[83533]: Disconnected from user root 192.168.204.21 port 35102 Apr 3 02:56:26 oleg421-client sshd[83520]: pam_unix(sshd:session): session closed for user root Apr 3 02:56:26 oleg421-client systemd-logind[1011]: Session 428 logged out. Waiting for processes to exit. Apr 3 02:56:26 oleg421-client systemd[1]: session-428.scope: Succeeded. Apr 3 02:56:26 oleg421-client systemd-logind[1011]: Removed session 428. Apr 3 02:56:27 oleg421-client sshd[83659]: Accepted publickey for root from 192.168.204.21 port 35116 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:56:27 oleg421-client systemd-logind[1011]: New session 429 of user root. Apr 3 02:56:27 oleg421-client systemd[1]: Started Session 429 of user root. Apr 3 02:56:27 oleg421-client sshd[83659]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:56:27 oleg421-client sshd[83672]: Received disconnect from 192.168.204.21 port 35116:11: disconnected by user Apr 3 02:56:27 oleg421-client sshd[83672]: Disconnected from user root 192.168.204.21 port 35116 Apr 3 02:56:27 oleg421-client sshd[83659]: pam_unix(sshd:session): session closed for user root Apr 3 02:56:28 oleg421-client systemd[1]: session-429.scope: Succeeded. Apr 3 02:56:28 oleg421-client systemd-logind[1011]: Session 429 logged out. Waiting for processes to exit. Apr 3 02:56:28 oleg421-client systemd-logind[1011]: Removed session 429. Apr 3 02:56:29 oleg421-client sshd[83807]: Accepted publickey for root from 192.168.204.21 port 41470 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:56:29 oleg421-client systemd-logind[1011]: New session 430 of user root. Apr 3 02:56:29 oleg421-client systemd[1]: Started Session 430 of user root. Apr 3 02:56:29 oleg421-client sshd[83807]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:56:29 oleg421-client sshd[83820]: Received disconnect from 192.168.204.21 port 41470:11: disconnected by user Apr 3 02:56:29 oleg421-client sshd[83820]: Disconnected from user root 192.168.204.21 port 41470 Apr 3 02:56:29 oleg421-client sshd[83807]: pam_unix(sshd:session): session closed for user root Apr 3 02:56:30 oleg421-client systemd-logind[1011]: Session 430 logged out. Waiting for processes to exit. Apr 3 02:56:30 oleg421-client systemd[1]: session-430.scope: Succeeded. Apr 3 02:56:30 oleg421-client systemd-logind[1011]: Removed session 430. Apr 3 02:56:32 oleg421-client sshd[83962]: Accepted publickey for root from 192.168.204.21 port 41484 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:56:32 oleg421-client systemd-logind[1011]: New session 431 of user root. Apr 3 02:56:32 oleg421-client systemd[1]: Started Session 431 of user root. Apr 3 02:56:32 oleg421-client sshd[83962]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:56:32 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 112a: bulk resend while orignal request is in progress ========================================================== 02:56:30 (1775199390) Apr 3 02:56:32 oleg421-client sshd[83975]: Received disconnect from 192.168.204.21 port 41484:11: disconnected by user Apr 3 02:56:32 oleg421-client sshd[83975]: Disconnected from user root 192.168.204.21 port 41484 Apr 3 02:56:32 oleg421-client sshd[83962]: pam_unix(sshd:session): session closed for user root Apr 3 02:56:33 oleg421-client systemd[1]: session-431.scope: Succeeded. Apr 3 02:56:33 oleg421-client systemd-logind[1011]: Session 431 logged out. Waiting for processes to exit. Apr 3 02:56:33 oleg421-client systemd-logind[1011]: Removed session 431. Apr 3 02:56:58 oleg421-client sshd[84171]: Accepted publickey for root from 192.168.204.21 port 58794 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:56:58 oleg421-client systemd-logind[1011]: New session 432 of user root. Apr 3 02:56:58 oleg421-client systemd[1]: Started Session 432 of user root. Apr 3 02:56:58 oleg421-client sshd[84171]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:56:58 oleg421-client sshd[84184]: Received disconnect from 192.168.204.21 port 58794:11: disconnected by user Apr 3 02:56:58 oleg421-client sshd[84184]: Disconnected from user root 192.168.204.21 port 58794 Apr 3 02:56:58 oleg421-client sshd[84171]: pam_unix(sshd:session): session closed for user root Apr 3 02:56:59 oleg421-client systemd[1]: session-432.scope: Succeeded. Apr 3 02:56:59 oleg421-client systemd-logind[1011]: Session 432 logged out. Waiting for processes to exit. Apr 3 02:56:59 oleg421-client systemd-logind[1011]: Removed session 432. Apr 3 02:57:00 oleg421-client sshd[84310]: Accepted publickey for root from 192.168.204.21 port 58796 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:57:00 oleg421-client systemd-logind[1011]: New session 433 of user root. Apr 3 02:57:00 oleg421-client systemd[1]: Started Session 433 of user root. Apr 3 02:57:00 oleg421-client sshd[84310]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:57:00 oleg421-client sshd[84323]: Received disconnect from 192.168.204.21 port 58796:11: disconnected by user Apr 3 02:57:00 oleg421-client sshd[84323]: Disconnected from user root 192.168.204.21 port 58796 Apr 3 02:57:00 oleg421-client sshd[84310]: pam_unix(sshd:session): session closed for user root Apr 3 02:57:00 oleg421-client systemd[1]: session-433.scope: Succeeded. Apr 3 02:57:00 oleg421-client systemd-logind[1011]: Session 433 logged out. Waiting for processes to exit. Apr 3 02:57:00 oleg421-client systemd-logind[1011]: Removed session 433. Apr 3 02:57:02 oleg421-client sshd[84456]: Accepted publickey for root from 192.168.204.21 port 58810 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:57:02 oleg421-client systemd[1]: Started Session 434 of user root. Apr 3 02:57:02 oleg421-client systemd-logind[1011]: New session 434 of user root. Apr 3 02:57:02 oleg421-client sshd[84456]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:57:02 oleg421-client sshd[84469]: Received disconnect from 192.168.204.21 port 58810:11: disconnected by user Apr 3 02:57:02 oleg421-client sshd[84469]: Disconnected from user root 192.168.204.21 port 58810 Apr 3 02:57:02 oleg421-client sshd[84456]: pam_unix(sshd:session): session closed for user root Apr 3 02:57:02 oleg421-client systemd[1]: session-434.scope: Succeeded. Apr 3 02:57:02 oleg421-client systemd-logind[1011]: Session 434 logged out. Waiting for processes to exit. Apr 3 02:57:02 oleg421-client systemd-logind[1011]: Removed session 434. Apr 3 02:57:04 oleg421-client sshd[84612]: Accepted publickey for root from 192.168.204.21 port 58816 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:57:04 oleg421-client systemd-logind[1011]: New session 435 of user root. Apr 3 02:57:04 oleg421-client systemd[1]: Started Session 435 of user root. Apr 3 02:57:04 oleg421-client sshd[84612]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:57:05 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115a: read: late REQ MDunlink and no bulk ========================================================== 02:57:03 (1775199423) Apr 3 02:57:05 oleg421-client sshd[84625]: Received disconnect from 192.168.204.21 port 58816:11: disconnected by user Apr 3 02:57:05 oleg421-client sshd[84625]: Disconnected from user root 192.168.204.21 port 58816 Apr 3 02:57:05 oleg421-client sshd[84612]: pam_unix(sshd:session): session closed for user root Apr 3 02:57:05 oleg421-client systemd[1]: session-435.scope: Succeeded. Apr 3 02:57:05 oleg421-client systemd-logind[1011]: Session 435 logged out. Waiting for processes to exit. Apr 3 02:57:05 oleg421-client systemd-logind[1011]: Removed session 435. Apr 3 02:57:05 oleg421-client kernel: Lustre: *** cfs_fail_loc=51b, val=3*** Apr 3 02:57:11 oleg421-client sshd[84828]: Accepted publickey for root from 192.168.204.21 port 53110 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:57:11 oleg421-client systemd-logind[1011]: New session 436 of user root. Apr 3 02:57:11 oleg421-client systemd[1]: Started Session 436 of user root. Apr 3 02:57:11 oleg421-client sshd[84828]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:57:11 oleg421-client sshd[84841]: Received disconnect from 192.168.204.21 port 53110:11: disconnected by user Apr 3 02:57:11 oleg421-client sshd[84841]: Disconnected from user root 192.168.204.21 port 53110 Apr 3 02:57:11 oleg421-client sshd[84828]: pam_unix(sshd:session): session closed for user root Apr 3 02:57:12 oleg421-client systemd[1]: session-436.scope: Succeeded. Apr 3 02:57:12 oleg421-client systemd-logind[1011]: Session 436 logged out. Waiting for processes to exit. Apr 3 02:57:12 oleg421-client systemd-logind[1011]: Removed session 436. Apr 3 02:57:13 oleg421-client sshd[84967]: Accepted publickey for root from 192.168.204.21 port 53114 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:57:13 oleg421-client systemd[1]: Started Session 437 of user root. Apr 3 02:57:13 oleg421-client systemd-logind[1011]: New session 437 of user root. Apr 3 02:57:13 oleg421-client sshd[84967]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:57:14 oleg421-client sshd[84980]: Received disconnect from 192.168.204.21 port 53114:11: disconnected by user Apr 3 02:57:14 oleg421-client sshd[84980]: Disconnected from user root 192.168.204.21 port 53114 Apr 3 02:57:14 oleg421-client sshd[84967]: pam_unix(sshd:session): session closed for user root Apr 3 02:57:14 oleg421-client systemd[1]: session-437.scope: Succeeded. Apr 3 02:57:14 oleg421-client systemd-logind[1011]: Session 437 logged out. Waiting for processes to exit. Apr 3 02:57:14 oleg421-client systemd-logind[1011]: Removed session 437. Apr 3 02:57:15 oleg421-client sshd[85114]: Accepted publickey for root from 192.168.204.21 port 53116 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:57:16 oleg421-client systemd-logind[1011]: New session 438 of user root. Apr 3 02:57:16 oleg421-client systemd[1]: Started Session 438 of user root. Apr 3 02:57:16 oleg421-client sshd[85114]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:57:16 oleg421-client sshd[85127]: Received disconnect from 192.168.204.21 port 53116:11: disconnected by user Apr 3 02:57:16 oleg421-client sshd[85127]: Disconnected from user root 192.168.204.21 port 53116 Apr 3 02:57:16 oleg421-client sshd[85114]: pam_unix(sshd:session): session closed for user root Apr 3 02:57:16 oleg421-client systemd-logind[1011]: Session 438 logged out. Waiting for processes to exit. Apr 3 02:57:16 oleg421-client systemd[1]: session-438.scope: Succeeded. Apr 3 02:57:16 oleg421-client systemd-logind[1011]: Removed session 438. Apr 3 02:57:18 oleg421-client sshd[85269]: Accepted publickey for root from 192.168.204.21 port 54310 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:57:18 oleg421-client systemd-logind[1011]: New session 439 of user root. Apr 3 02:57:18 oleg421-client systemd[1]: Started Session 439 of user root. Apr 3 02:57:18 oleg421-client sshd[85269]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:57:19 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115b: write: late REQ MDunlink and no bulk ========================================================== 02:57:17 (1775199437) Apr 3 02:57:19 oleg421-client sshd[85282]: Received disconnect from 192.168.204.21 port 54310:11: disconnected by user Apr 3 02:57:19 oleg421-client sshd[85282]: Disconnected from user root 192.168.204.21 port 54310 Apr 3 02:57:19 oleg421-client sshd[85269]: pam_unix(sshd:session): session closed for user root Apr 3 02:57:19 oleg421-client systemd[1]: session-439.scope: Succeeded. Apr 3 02:57:19 oleg421-client systemd-logind[1011]: Session 439 logged out. Waiting for processes to exit. Apr 3 02:57:19 oleg421-client systemd-logind[1011]: Removed session 439. Apr 3 02:57:19 oleg421-client kernel: Lustre: *** cfs_fail_loc=51b, val=4*** Apr 3 02:57:25 oleg421-client sshd[85481]: Accepted publickey for root from 192.168.204.21 port 54322 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:57:25 oleg421-client systemd-logind[1011]: New session 440 of user root. Apr 3 02:57:25 oleg421-client systemd[1]: Started Session 440 of user root. Apr 3 02:57:25 oleg421-client sshd[85481]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:57:25 oleg421-client sshd[85495]: Received disconnect from 192.168.204.21 port 54322:11: disconnected by user Apr 3 02:57:25 oleg421-client sshd[85495]: Disconnected from user root 192.168.204.21 port 54322 Apr 3 02:57:25 oleg421-client sshd[85481]: pam_unix(sshd:session): session closed for user root Apr 3 02:57:26 oleg421-client systemd-logind[1011]: Session 440 logged out. Waiting for processes to exit. Apr 3 02:57:26 oleg421-client systemd[1]: session-440.scope: Succeeded. Apr 3 02:57:26 oleg421-client systemd-logind[1011]: Removed session 440. Apr 3 02:57:27 oleg421-client sshd[85621]: Accepted publickey for root from 192.168.204.21 port 54326 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:57:27 oleg421-client systemd-logind[1011]: New session 441 of user root. Apr 3 02:57:27 oleg421-client systemd[1]: Started Session 441 of user root. Apr 3 02:57:27 oleg421-client sshd[85621]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:57:27 oleg421-client sshd[85634]: Received disconnect from 192.168.204.21 port 54326:11: disconnected by user Apr 3 02:57:27 oleg421-client sshd[85634]: Disconnected from user root 192.168.204.21 port 54326 Apr 3 02:57:27 oleg421-client sshd[85621]: pam_unix(sshd:session): session closed for user root Apr 3 02:57:27 oleg421-client systemd[1]: session-441.scope: Succeeded. Apr 3 02:57:27 oleg421-client systemd-logind[1011]: Session 441 logged out. Waiting for processes to exit. Apr 3 02:57:27 oleg421-client systemd-logind[1011]: Removed session 441. Apr 3 02:57:29 oleg421-client sshd[85767]: Accepted publickey for root from 192.168.204.21 port 37582 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:57:29 oleg421-client systemd-logind[1011]: New session 442 of user root. Apr 3 02:57:29 oleg421-client systemd[1]: Started Session 442 of user root. Apr 3 02:57:29 oleg421-client sshd[85767]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:57:29 oleg421-client sshd[85780]: Received disconnect from 192.168.204.21 port 37582:11: disconnected by user Apr 3 02:57:29 oleg421-client sshd[85780]: Disconnected from user root 192.168.204.21 port 37582 Apr 3 02:57:29 oleg421-client sshd[85767]: pam_unix(sshd:session): session closed for user root Apr 3 02:57:29 oleg421-client systemd-logind[1011]: Session 442 logged out. Waiting for processes to exit. Apr 3 02:57:29 oleg421-client systemd[1]: session-442.scope: Succeeded. Apr 3 02:57:29 oleg421-client systemd-logind[1011]: Removed session 442. Apr 3 02:57:31 oleg421-client sshd[85923]: Accepted publickey for root from 192.168.204.21 port 37598 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:57:31 oleg421-client systemd-logind[1011]: New session 443 of user root. Apr 3 02:57:31 oleg421-client systemd[1]: Started Session 443 of user root. Apr 3 02:57:31 oleg421-client sshd[85923]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:57:31 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115c: read: late Reply MDunlink and no bulk ========================================================== 02:57:30 (1775199450) Apr 3 02:57:31 oleg421-client sshd[85936]: Received disconnect from 192.168.204.21 port 37598:11: disconnected by user Apr 3 02:57:31 oleg421-client sshd[85936]: Disconnected from user root 192.168.204.21 port 37598 Apr 3 02:57:31 oleg421-client sshd[85923]: pam_unix(sshd:session): session closed for user root Apr 3 02:57:32 oleg421-client systemd[1]: session-443.scope: Succeeded. Apr 3 02:57:32 oleg421-client systemd-logind[1011]: Session 443 logged out. Waiting for processes to exit. Apr 3 02:57:32 oleg421-client systemd-logind[1011]: Removed session 443. Apr 3 02:57:32 oleg421-client kernel: Lustre: *** cfs_fail_loc=50f, val=3*** Apr 3 02:57:36 oleg421-client sshd[86139]: Accepted publickey for root from 192.168.204.21 port 37614 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:57:36 oleg421-client systemd-logind[1011]: New session 444 of user root. Apr 3 02:57:36 oleg421-client systemd[1]: Started Session 444 of user root. Apr 3 02:57:36 oleg421-client sshd[86139]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:57:36 oleg421-client sshd[86152]: Received disconnect from 192.168.204.21 port 37614:11: disconnected by user Apr 3 02:57:36 oleg421-client sshd[86152]: Disconnected from user root 192.168.204.21 port 37614 Apr 3 02:57:36 oleg421-client sshd[86139]: pam_unix(sshd:session): session closed for user root Apr 3 02:57:36 oleg421-client systemd-logind[1011]: Session 444 logged out. Waiting for processes to exit. Apr 3 02:57:36 oleg421-client systemd[1]: session-444.scope: Succeeded. Apr 3 02:57:36 oleg421-client systemd-logind[1011]: Removed session 444. Apr 3 02:57:37 oleg421-client sshd[86279]: Accepted publickey for root from 192.168.204.21 port 39240 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:57:37 oleg421-client systemd-logind[1011]: New session 445 of user root. Apr 3 02:57:37 oleg421-client systemd[1]: Started Session 445 of user root. Apr 3 02:57:37 oleg421-client sshd[86279]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:57:38 oleg421-client sshd[86292]: Received disconnect from 192.168.204.21 port 39240:11: disconnected by user Apr 3 02:57:38 oleg421-client sshd[86292]: Disconnected from user root 192.168.204.21 port 39240 Apr 3 02:57:38 oleg421-client sshd[86279]: pam_unix(sshd:session): session closed for user root Apr 3 02:57:38 oleg421-client systemd-logind[1011]: Session 445 logged out. Waiting for processes to exit. Apr 3 02:57:38 oleg421-client systemd[1]: session-445.scope: Succeeded. Apr 3 02:57:38 oleg421-client systemd-logind[1011]: Removed session 445. Apr 3 02:57:39 oleg421-client sshd[86425]: Accepted publickey for root from 192.168.204.21 port 39242 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:57:39 oleg421-client systemd[1]: Started Session 446 of user root. Apr 3 02:57:39 oleg421-client systemd-logind[1011]: New session 446 of user root. Apr 3 02:57:39 oleg421-client sshd[86425]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:57:40 oleg421-client sshd[86438]: Received disconnect from 192.168.204.21 port 39242:11: disconnected by user Apr 3 02:57:40 oleg421-client sshd[86438]: Disconnected from user root 192.168.204.21 port 39242 Apr 3 02:57:40 oleg421-client sshd[86425]: pam_unix(sshd:session): session closed for user root Apr 3 02:57:40 oleg421-client systemd[1]: session-446.scope: Succeeded. Apr 3 02:57:40 oleg421-client systemd-logind[1011]: Session 446 logged out. Waiting for processes to exit. Apr 3 02:57:40 oleg421-client systemd-logind[1011]: Removed session 446. Apr 3 02:57:42 oleg421-client sshd[86580]: Accepted publickey for root from 192.168.204.21 port 39254 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:57:42 oleg421-client systemd-logind[1011]: New session 447 of user root. Apr 3 02:57:42 oleg421-client systemd[1]: Started Session 447 of user root. Apr 3 02:57:42 oleg421-client sshd[86580]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:57:42 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115d: write: late Reply MDunlink and no bulk ========================================================== 02:57:40 (1775199460) Apr 3 02:57:42 oleg421-client sshd[86593]: Received disconnect from 192.168.204.21 port 39254:11: disconnected by user Apr 3 02:57:42 oleg421-client sshd[86593]: Disconnected from user root 192.168.204.21 port 39254 Apr 3 02:57:42 oleg421-client sshd[86580]: pam_unix(sshd:session): session closed for user root Apr 3 02:57:43 oleg421-client systemd[1]: session-447.scope: Succeeded. Apr 3 02:57:43 oleg421-client systemd-logind[1011]: Session 447 logged out. Waiting for processes to exit. Apr 3 02:57:43 oleg421-client systemd-logind[1011]: Removed session 447. Apr 3 02:57:43 oleg421-client kernel: Lustre: *** cfs_fail_loc=50f, val=4*** Apr 3 02:57:48 oleg421-client sshd[86792]: Accepted publickey for root from 192.168.204.21 port 49472 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:57:48 oleg421-client systemd[1]: Started Session 448 of user root. Apr 3 02:57:48 oleg421-client systemd-logind[1011]: New session 448 of user root. Apr 3 02:57:48 oleg421-client sshd[86792]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:57:48 oleg421-client sshd[86805]: Received disconnect from 192.168.204.21 port 49472:11: disconnected by user Apr 3 02:57:49 oleg421-client sshd[86805]: Disconnected from user root 192.168.204.21 port 49472 Apr 3 02:57:49 oleg421-client sshd[86792]: pam_unix(sshd:session): session closed for user root Apr 3 02:57:49 oleg421-client systemd[1]: session-448.scope: Succeeded. Apr 3 02:57:49 oleg421-client systemd-logind[1011]: Session 448 logged out. Waiting for processes to exit. Apr 3 02:57:49 oleg421-client systemd-logind[1011]: Removed session 448. Apr 3 02:57:50 oleg421-client sshd[86931]: Accepted publickey for root from 192.168.204.21 port 49486 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:57:50 oleg421-client systemd[1]: Started Session 449 of user root. Apr 3 02:57:50 oleg421-client systemd-logind[1011]: New session 449 of user root. Apr 3 02:57:50 oleg421-client sshd[86931]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:57:51 oleg421-client sshd[86945]: Received disconnect from 192.168.204.21 port 49486:11: disconnected by user Apr 3 02:57:51 oleg421-client sshd[86945]: Disconnected from user root 192.168.204.21 port 49486 Apr 3 02:57:51 oleg421-client sshd[86931]: pam_unix(sshd:session): session closed for user root Apr 3 02:57:51 oleg421-client systemd[1]: session-449.scope: Succeeded. Apr 3 02:57:51 oleg421-client systemd-logind[1011]: Session 449 logged out. Waiting for processes to exit. Apr 3 02:57:51 oleg421-client systemd-logind[1011]: Removed session 449. Apr 3 02:57:53 oleg421-client sshd[87078]: Accepted publickey for root from 192.168.204.21 port 49494 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:57:53 oleg421-client systemd-logind[1011]: New session 450 of user root. Apr 3 02:57:53 oleg421-client systemd[1]: Started Session 450 of user root. Apr 3 02:57:53 oleg421-client sshd[87078]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:57:53 oleg421-client sshd[87091]: Received disconnect from 192.168.204.21 port 49494:11: disconnected by user Apr 3 02:57:53 oleg421-client sshd[87091]: Disconnected from user root 192.168.204.21 port 49494 Apr 3 02:57:53 oleg421-client sshd[87078]: pam_unix(sshd:session): session closed for user root Apr 3 02:57:53 oleg421-client systemd[1]: session-450.scope: Succeeded. Apr 3 02:57:54 oleg421-client systemd-logind[1011]: Session 450 logged out. Waiting for processes to exit. Apr 3 02:57:54 oleg421-client systemd-logind[1011]: Removed session 450. Apr 3 02:57:55 oleg421-client sshd[87233]: Accepted publickey for root from 192.168.204.21 port 49496 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:57:55 oleg421-client systemd-logind[1011]: New session 451 of user root. Apr 3 02:57:56 oleg421-client systemd[1]: Started Session 451 of user root. Apr 3 02:57:56 oleg421-client sshd[87233]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:57:56 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115e: read: late Bulk MDunlink and no reply ========================================================== 02:57:54 (1775199474) Apr 3 02:57:56 oleg421-client sshd[87247]: Received disconnect from 192.168.204.21 port 49496:11: disconnected by user Apr 3 02:57:56 oleg421-client sshd[87247]: Disconnected from user root 192.168.204.21 port 49496 Apr 3 02:57:56 oleg421-client sshd[87233]: pam_unix(sshd:session): session closed for user root Apr 3 02:57:56 oleg421-client systemd-logind[1011]: Session 451 logged out. Waiting for processes to exit. Apr 3 02:57:56 oleg421-client systemd[1]: session-451.scope: Succeeded. Apr 3 02:57:56 oleg421-client systemd-logind[1011]: Removed session 451. Apr 3 02:57:57 oleg421-client kernel: Lustre: *** cfs_fail_loc=510, val=3*** Apr 3 02:58:02 oleg421-client sshd[87450]: Accepted publickey for root from 192.168.204.21 port 48018 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:58:02 oleg421-client systemd[1]: Started Session 452 of user root. Apr 3 02:58:02 oleg421-client systemd-logind[1011]: New session 452 of user root. Apr 3 02:58:02 oleg421-client sshd[87450]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:58:02 oleg421-client sshd[87463]: Received disconnect from 192.168.204.21 port 48018:11: disconnected by user Apr 3 02:58:02 oleg421-client sshd[87463]: Disconnected from user root 192.168.204.21 port 48018 Apr 3 02:58:02 oleg421-client sshd[87450]: pam_unix(sshd:session): session closed for user root Apr 3 02:58:02 oleg421-client systemd-logind[1011]: Session 452 logged out. Waiting for processes to exit. Apr 3 02:58:02 oleg421-client systemd[1]: session-452.scope: Succeeded. Apr 3 02:58:02 oleg421-client systemd-logind[1011]: Removed session 452. Apr 3 02:58:03 oleg421-client sshd[87589]: Accepted publickey for root from 192.168.204.21 port 48034 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:58:03 oleg421-client systemd-logind[1011]: New session 453 of user root. Apr 3 02:58:03 oleg421-client systemd[1]: Started Session 453 of user root. Apr 3 02:58:03 oleg421-client sshd[87589]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:58:04 oleg421-client sshd[87602]: Received disconnect from 192.168.204.21 port 48034:11: disconnected by user Apr 3 02:58:04 oleg421-client sshd[87602]: Disconnected from user root 192.168.204.21 port 48034 Apr 3 02:58:04 oleg421-client sshd[87589]: pam_unix(sshd:session): session closed for user root Apr 3 02:58:04 oleg421-client systemd-logind[1011]: Session 453 logged out. Waiting for processes to exit. Apr 3 02:58:04 oleg421-client systemd[1]: session-453.scope: Succeeded. Apr 3 02:58:04 oleg421-client systemd-logind[1011]: Removed session 453. Apr 3 02:58:05 oleg421-client sshd[87735]: Accepted publickey for root from 192.168.204.21 port 48046 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:58:05 oleg421-client systemd-logind[1011]: New session 454 of user root. Apr 3 02:58:05 oleg421-client systemd[1]: Started Session 454 of user root. Apr 3 02:58:05 oleg421-client sshd[87735]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:58:06 oleg421-client sshd[87748]: Received disconnect from 192.168.204.21 port 48046:11: disconnected by user Apr 3 02:58:06 oleg421-client sshd[87748]: Disconnected from user root 192.168.204.21 port 48046 Apr 3 02:58:06 oleg421-client sshd[87735]: pam_unix(sshd:session): session closed for user root Apr 3 02:58:06 oleg421-client systemd[1]: session-454.scope: Succeeded. Apr 3 02:58:06 oleg421-client systemd-logind[1011]: Session 454 logged out. Waiting for processes to exit. Apr 3 02:58:06 oleg421-client systemd-logind[1011]: Removed session 454. Apr 3 02:58:08 oleg421-client sshd[87891]: Accepted publickey for root from 192.168.204.21 port 58094 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:58:08 oleg421-client systemd-logind[1011]: New session 455 of user root. Apr 3 02:58:08 oleg421-client systemd[1]: Started Session 455 of user root. Apr 3 02:58:08 oleg421-client sshd[87891]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:58:08 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115f: read: late REQ MDunlink and no reply ========================================================== 02:58:06 (1775199486) Apr 3 02:58:08 oleg421-client sshd[87904]: Received disconnect from 192.168.204.21 port 58094:11: disconnected by user Apr 3 02:58:08 oleg421-client sshd[87904]: Disconnected from user root 192.168.204.21 port 58094 Apr 3 02:58:08 oleg421-client sshd[87891]: pam_unix(sshd:session): session closed for user root Apr 3 02:58:08 oleg421-client systemd[1]: session-455.scope: Succeeded. Apr 3 02:58:08 oleg421-client systemd-logind[1011]: Session 455 logged out. Waiting for processes to exit. Apr 3 02:58:08 oleg421-client systemd-logind[1011]: Removed session 455. Apr 3 02:58:08 oleg421-client kernel: Lustre: *** cfs_fail_loc=51b, val=3*** Apr 3 02:58:14 oleg421-client sshd[88107]: Accepted publickey for root from 192.168.204.21 port 58106 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:58:14 oleg421-client systemd-logind[1011]: New session 456 of user root. Apr 3 02:58:14 oleg421-client systemd[1]: Started Session 456 of user root. Apr 3 02:58:14 oleg421-client sshd[88107]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:58:15 oleg421-client sshd[88120]: Received disconnect from 192.168.204.21 port 58106:11: disconnected by user Apr 3 02:58:15 oleg421-client sshd[88120]: Disconnected from user root 192.168.204.21 port 58106 Apr 3 02:58:15 oleg421-client sshd[88107]: pam_unix(sshd:session): session closed for user root Apr 3 02:58:15 oleg421-client systemd[1]: session-456.scope: Succeeded. Apr 3 02:58:15 oleg421-client systemd-logind[1011]: Session 456 logged out. Waiting for processes to exit. Apr 3 02:58:15 oleg421-client systemd-logind[1011]: Removed session 456. Apr 3 02:58:16 oleg421-client sshd[88246]: Accepted publickey for root from 192.168.204.21 port 58110 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:58:16 oleg421-client systemd[1]: Started Session 457 of user root. Apr 3 02:58:16 oleg421-client systemd-logind[1011]: New session 457 of user root. Apr 3 02:58:16 oleg421-client sshd[88246]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:58:17 oleg421-client sshd[88260]: Received disconnect from 192.168.204.21 port 58110:11: disconnected by user Apr 3 02:58:17 oleg421-client sshd[88260]: Disconnected from user root 192.168.204.21 port 58110 Apr 3 02:58:17 oleg421-client sshd[88246]: pam_unix(sshd:session): session closed for user root Apr 3 02:58:17 oleg421-client systemd[1]: session-457.scope: Succeeded. Apr 3 02:58:17 oleg421-client systemd-logind[1011]: Session 457 logged out. Waiting for processes to exit. Apr 3 02:58:17 oleg421-client systemd-logind[1011]: Removed session 457. Apr 3 02:58:18 oleg421-client sshd[88393]: Accepted publickey for root from 192.168.204.21 port 43148 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:58:18 oleg421-client systemd[1]: Started Session 458 of user root. Apr 3 02:58:18 oleg421-client systemd-logind[1011]: New session 458 of user root. Apr 3 02:58:18 oleg421-client sshd[88393]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:58:19 oleg421-client sshd[88406]: Received disconnect from 192.168.204.21 port 43148:11: disconnected by user Apr 3 02:58:19 oleg421-client sshd[88406]: Disconnected from user root 192.168.204.21 port 43148 Apr 3 02:58:19 oleg421-client sshd[88393]: pam_unix(sshd:session): session closed for user root Apr 3 02:58:19 oleg421-client systemd[1]: session-458.scope: Succeeded. Apr 3 02:58:19 oleg421-client systemd-logind[1011]: Session 458 logged out. Waiting for processes to exit. Apr 3 02:58:19 oleg421-client systemd-logind[1011]: Removed session 458. Apr 3 02:58:21 oleg421-client sshd[88548]: Accepted publickey for root from 192.168.204.21 port 43152 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:58:21 oleg421-client systemd[1]: Started Session 459 of user root. Apr 3 02:58:21 oleg421-client systemd-logind[1011]: New session 459 of user root. Apr 3 02:58:21 oleg421-client sshd[88548]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:58:22 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115g: read: late REQ MDunlink and Reply MDunlink ========================================================== 02:58:20 (1775199500) Apr 3 02:58:22 oleg421-client sshd[88562]: Received disconnect from 192.168.204.21 port 43152:11: disconnected by user Apr 3 02:58:22 oleg421-client sshd[88562]: Disconnected from user root 192.168.204.21 port 43152 Apr 3 02:58:22 oleg421-client sshd[88548]: pam_unix(sshd:session): session closed for user root Apr 3 02:58:22 oleg421-client systemd[1]: session-459.scope: Succeeded. Apr 3 02:58:22 oleg421-client systemd-logind[1011]: Session 459 logged out. Waiting for processes to exit. Apr 3 02:58:22 oleg421-client systemd-logind[1011]: Removed session 459. Apr 3 02:58:22 oleg421-client kernel: Lustre: *** cfs_fail_loc=51c, val=3*** Apr 3 02:59:21 oleg421-client kernel: Lustre: 2403:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775199506/real 1775199506] req@ffff962445c44700 x1861425393760128/t0(0) o3->lustre-OST0001-osc-ffff962446a99800@192.168.204.121@tcp:6/4 lens 488/4536 e 0 to 1 dl 1775199561 ref 2 fl Rpc:RXQ/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 Apr 3 02:59:21 oleg421-client kernel: Lustre: 2403:0:(client.c:2479:ptlrpc_expire_one_request()) Skipped 4 previous similar messages Apr 3 02:59:21 oleg421-client kernel: Lustre: lustre-OST0001-osc-ffff962446a99800: Connection to lustre-OST0001 (at 192.168.204.121@tcp) was lost; in progress operations using this service will wait for recovery to complete Apr 3 02:59:21 oleg421-client kernel: Lustre: Skipped 5 previous similar messages Apr 3 02:59:22 oleg421-client sshd[88773]: Accepted publickey for root from 192.168.204.21 port 52036 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:59:22 oleg421-client systemd-logind[1011]: New session 460 of user root. Apr 3 02:59:22 oleg421-client systemd[1]: Started Session 460 of user root. Apr 3 02:59:22 oleg421-client sshd[88773]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:59:23 oleg421-client sshd[88786]: Received disconnect from 192.168.204.21 port 52036:11: disconnected by user Apr 3 02:59:23 oleg421-client sshd[88786]: Disconnected from user root 192.168.204.21 port 52036 Apr 3 02:59:23 oleg421-client sshd[88773]: pam_unix(sshd:session): session closed for user root Apr 3 02:59:23 oleg421-client systemd[1]: session-460.scope: Succeeded. Apr 3 02:59:23 oleg421-client systemd-logind[1011]: Session 460 logged out. Waiting for processes to exit. Apr 3 02:59:23 oleg421-client systemd-logind[1011]: Removed session 460. Apr 3 02:59:25 oleg421-client sshd[88912]: Accepted publickey for root from 192.168.204.21 port 52040 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:59:25 oleg421-client systemd-logind[1011]: New session 461 of user root. Apr 3 02:59:26 oleg421-client systemd[1]: Started Session 461 of user root. Apr 3 02:59:26 oleg421-client sshd[88912]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:59:26 oleg421-client sshd[88925]: Received disconnect from 192.168.204.21 port 52040:11: disconnected by user Apr 3 02:59:26 oleg421-client sshd[88925]: Disconnected from user root 192.168.204.21 port 52040 Apr 3 02:59:26 oleg421-client sshd[88912]: pam_unix(sshd:session): session closed for user root Apr 3 02:59:26 oleg421-client systemd[1]: session-461.scope: Succeeded. Apr 3 02:59:26 oleg421-client systemd-logind[1011]: Session 461 logged out. Waiting for processes to exit. Apr 3 02:59:26 oleg421-client systemd-logind[1011]: Removed session 461. Apr 3 02:59:28 oleg421-client sshd[89059]: Accepted publickey for root from 192.168.204.21 port 36766 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:59:28 oleg421-client systemd-logind[1011]: New session 462 of user root. Apr 3 02:59:28 oleg421-client systemd[1]: Started Session 462 of user root. Apr 3 02:59:28 oleg421-client sshd[89059]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:59:28 oleg421-client sshd[89072]: Received disconnect from 192.168.204.21 port 36766:11: disconnected by user Apr 3 02:59:28 oleg421-client sshd[89072]: Disconnected from user root 192.168.204.21 port 36766 Apr 3 02:59:28 oleg421-client sshd[89059]: pam_unix(sshd:session): session closed for user root Apr 3 02:59:28 oleg421-client systemd-logind[1011]: Session 462 logged out. Waiting for processes to exit. Apr 3 02:59:28 oleg421-client systemd[1]: session-462.scope: Succeeded. Apr 3 02:59:28 oleg421-client systemd-logind[1011]: Removed session 462. Apr 3 02:59:31 oleg421-client sshd[89215]: Accepted publickey for root from 192.168.204.21 port 36776 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 02:59:31 oleg421-client rsyslogd[1073]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Apr 3 02:59:31 oleg421-client systemd[1]: Started Session 463 of user root. Apr 3 02:59:31 oleg421-client systemd-logind[1011]: New session 463 of user root. Apr 3 02:59:31 oleg421-client sshd[89215]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 02:59:31 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 120: flock race: completion vs. evict ========================================================== 02:59:29 (1775199569) Apr 3 02:59:31 oleg421-client sshd[89229]: Received disconnect from 192.168.204.21 port 36776:11: disconnected by user Apr 3 02:59:31 oleg421-client sshd[89229]: Disconnected from user root 192.168.204.21 port 36776 Apr 3 02:59:31 oleg421-client sshd[89215]: pam_unix(sshd:session): session closed for user root Apr 3 02:59:32 oleg421-client systemd-logind[1011]: Session 463 logged out. Waiting for processes to exit. Apr 3 02:59:32 oleg421-client systemd[1]: session-463.scope: Succeeded. Apr 3 02:59:32 oleg421-client systemd-logind[1011]: Removed session 463. Apr 3 02:59:32 oleg421-client kernel: LustreError: 89270:0:(ldlm_flock.c:802:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 sleeping for 4000ms Apr 3 02:59:35 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962446a99800: operation ldlm_enqueue to node 192.168.204.121@tcp failed: rc = -107 Apr 3 02:59:35 oleg421-client kernel: LustreError: Skipped 3 previous similar messages Apr 3 02:59:35 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962446a99800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Apr 3 02:59:35 oleg421-client kernel: LustreError: 89286:0:(ldlm_resource.c:1170:ldlm_resource_complain()) lustre-MDT0000-mdc-ffff962446a99800: namespace resource [0x20000afe2:0xc:0x0].0xc (ffff962450b47800) refcount nonzero (1) after lock cleanup; forcing cleanup. Apr 3 02:59:35 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962446a99800: Connection restored to 192.168.204.121@tcp (at 192.168.204.121@tcp) Apr 3 02:59:35 oleg421-client kernel: Lustre: Skipped 5 previous similar messages Apr 3 02:59:36 oleg421-client kernel: LustreError: 89270:0:(ldlm_flock.c:802:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 awake Apr 3 02:59:38 oleg421-client kernel: LustreError: 89301:0:(ldlm_flock.c:802:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 sleeping for 4000ms Apr 3 02:59:41 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962446a99800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Apr 3 02:59:41 oleg421-client kernel: LustreError: 89316:0:(ldlm_resource.c:1170:ldlm_resource_complain()) lustre-MDT0000-mdc-ffff962446a99800: namespace resource [0x20000afe2:0xc:0x0].0xc (ffff962450a2d800) refcount nonzero (1) after lock cleanup; forcing cleanup. Apr 3 02:59:41 oleg421-client kernel: LustreError: 89316:0:(ldlm_resource.c:1170:ldlm_resource_complain()) Skipped 1 previous similar message Apr 3 02:59:42 oleg421-client kernel: LustreError: 89301:0:(ldlm_flock.c:802:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 awake Apr 3 02:59:49 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962446a99800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Apr 3 02:59:50 oleg421-client kernel: LustreError: 89358:0:(ldlm_flock.c:807:ldlm_flock_completion_ast()) cfs_fail_timeout id 321 sleeping for 4000ms Apr 3 02:59:53 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962446a99800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Apr 3 02:59:53 oleg421-client kernel: LustreError: 89377:0:(file.c:6097:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 Apr 3 02:59:53 oleg421-client kernel: LustreError: 89377:0:(file.c:6097:ll_inode_revalidate_fini()) Skipped 13 previous similar messages Apr 3 02:59:54 oleg421-client kernel: LustreError: 89358:0:(ldlm_flock.c:807:ldlm_flock_completion_ast()) cfs_fail_timeout id 321 awake Apr 3 02:59:54 oleg421-client kernel: LustreError: 89358:0:(file.c:251:ll_close_inode_openhandle()) lustre-clilmv-ffff962446a99800: inode [0x20000afe2:0xc:0x0] mdc close failed: rc = -108 Apr 3 02:59:54 oleg421-client kernel: LustreError: 89384:0:(file.c:6097:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 Apr 3 02:59:54 oleg421-client kernel: LustreError: 89384:0:(file.c:6097:ll_inode_revalidate_fini()) Skipped 5 previous similar messages Apr 3 02:59:57 oleg421-client kernel: LustreError: 89406:0:(file.c:6097:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 Apr 3 02:59:57 oleg421-client kernel: LustreError: 89406:0:(file.c:6097:ll_inode_revalidate_fini()) Skipped 13 previous similar messages Apr 3 03:00:01 oleg421-client kernel: LustreError: 89433:0:(ldlm_flock.c:807:ldlm_flock_completion_ast()) cfs_fail_timeout id 321 sleeping for 4000ms Apr 3 03:00:05 oleg421-client kernel: LustreError: 89433:0:(ldlm_flock.c:807:ldlm_flock_completion_ast()) cfs_fail_timeout id 321 awake Apr 3 03:00:05 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962446a99800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Apr 3 03:00:12 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962446a99800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Apr 3 03:00:13 oleg421-client kernel: LustreError: 89489:0:(ldlm_flock.c:856:ldlm_flock_completion_ast()) cfs_fail_timeout id 322 sleeping for 4000ms Apr 3 03:00:16 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962446a99800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Apr 3 03:00:16 oleg421-client kernel: LustreError: 89504:0:(ldlm_resource.c:1170:ldlm_resource_complain()) lustre-MDT0000-mdc-ffff962446a99800: namespace resource [0x20000afe2:0xc:0x0].0xc (ffff96244bbc6700) refcount nonzero (1) after lock cleanup; forcing cleanup. Apr 3 03:00:16 oleg421-client kernel: LustreError: 89504:0:(ldlm_resource.c:1170:ldlm_resource_complain()) Skipped 1 previous similar message Apr 3 03:00:17 oleg421-client kernel: LustreError: 89489:0:(ldlm_flock.c:856:ldlm_flock_completion_ast()) cfs_fail_timeout id 322 awake Apr 3 03:00:20 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962446a99800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Apr 3 03:00:20 oleg421-client kernel: LustreError: 89537:0:(file.c:6097:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 Apr 3 03:00:20 oleg421-client kernel: LustreError: 89537:0:(file.c:6097:ll_inode_revalidate_fini()) Skipped 6 previous similar messages Apr 3 03:00:21 oleg421-client kernel: LustreError: 89517:0:(file.c:251:ll_close_inode_openhandle()) lustre-clilmv-ffff962446a99800: inode [0x20000afe2:0xc:0x0] mdc close failed: rc = -108 Apr 3 03:00:30 oleg421-client kernel: LustreError: 89589:0:(ldlm_flock.c:802:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 sleeping for 4000ms Apr 3 03:00:30 oleg421-client kernel: LustreError: 89589:0:(ldlm_flock.c:802:ldlm_flock_completion_ast()) Skipped 1 previous similar message Apr 3 03:00:34 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962446a99800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Apr 3 03:00:34 oleg421-client kernel: LustreError: 89611:0:(file.c:6097:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 Apr 3 03:00:34 oleg421-client kernel: LustreError: 89611:0:(file.c:6097:ll_inode_revalidate_fini()) Skipped 22 previous similar messages Apr 3 03:00:34 oleg421-client kernel: LustreError: 89589:0:(ldlm_flock.c:802:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 awake Apr 3 03:00:34 oleg421-client kernel: LustreError: 89589:0:(ldlm_flock.c:802:ldlm_flock_completion_ast()) Skipped 1 previous similar message Apr 3 03:00:34 oleg421-client kernel: LustreError: 89589:0:(file.c:251:ll_close_inode_openhandle()) lustre-clilmv-ffff962446a99800: inode [0x20000afe2:0xc:0x0] mdc close failed: rc = -108 Apr 3 03:00:41 oleg421-client sshd[89750]: Accepted publickey for root from 192.168.204.21 port 53778 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:00:41 oleg421-client systemd-logind[1011]: New session 464 of user root. Apr 3 03:00:41 oleg421-client systemd[1]: Started Session 464 of user root. Apr 3 03:00:41 oleg421-client sshd[89750]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:00:42 oleg421-client sshd[89763]: Received disconnect from 192.168.204.21 port 53778:11: disconnected by user Apr 3 03:00:42 oleg421-client sshd[89763]: Disconnected from user root 192.168.204.21 port 53778 Apr 3 03:00:42 oleg421-client sshd[89750]: pam_unix(sshd:session): session closed for user root Apr 3 03:00:42 oleg421-client systemd[1]: session-464.scope: Succeeded. Apr 3 03:00:42 oleg421-client systemd-logind[1011]: Session 464 logged out. Waiting for processes to exit. Apr 3 03:00:42 oleg421-client systemd-logind[1011]: Removed session 464. Apr 3 03:00:44 oleg421-client sshd[89889]: Accepted publickey for root from 192.168.204.21 port 53780 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:00:44 oleg421-client systemd[1]: Started Session 465 of user root. Apr 3 03:00:44 oleg421-client systemd-logind[1011]: New session 465 of user root. Apr 3 03:00:44 oleg421-client sshd[89889]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:00:45 oleg421-client sshd[89902]: Received disconnect from 192.168.204.21 port 53780:11: disconnected by user Apr 3 03:00:45 oleg421-client sshd[89902]: Disconnected from user root 192.168.204.21 port 53780 Apr 3 03:00:45 oleg421-client sshd[89889]: pam_unix(sshd:session): session closed for user root Apr 3 03:00:45 oleg421-client systemd[1]: session-465.scope: Succeeded. Apr 3 03:00:45 oleg421-client systemd-logind[1011]: Session 465 logged out. Waiting for processes to exit. Apr 3 03:00:45 oleg421-client systemd-logind[1011]: Removed session 465. Apr 3 03:00:47 oleg421-client sshd[90036]: Accepted publickey for root from 192.168.204.21 port 53782 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:00:47 oleg421-client systemd[1]: Started Session 466 of user root. Apr 3 03:00:47 oleg421-client systemd-logind[1011]: New session 466 of user root. Apr 3 03:00:47 oleg421-client sshd[90036]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:00:48 oleg421-client sshd[90049]: Received disconnect from 192.168.204.21 port 53782:11: disconnected by user Apr 3 03:00:48 oleg421-client sshd[90049]: Disconnected from user root 192.168.204.21 port 53782 Apr 3 03:00:48 oleg421-client sshd[90036]: pam_unix(sshd:session): session closed for user root Apr 3 03:00:48 oleg421-client systemd[1]: session-466.scope: Succeeded. Apr 3 03:00:48 oleg421-client systemd-logind[1011]: Session 466 logged out. Waiting for processes to exit. Apr 3 03:00:48 oleg421-client systemd-logind[1011]: Removed session 466. Apr 3 03:00:50 oleg421-client sshd[90191]: Accepted publickey for root from 192.168.204.21 port 47532 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:00:50 oleg421-client systemd-logind[1011]: New session 467 of user root. Apr 3 03:00:50 oleg421-client systemd[1]: Started Session 467 of user root. Apr 3 03:00:51 oleg421-client sshd[90191]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:00:51 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 113: ldlm enqueue dropped reply should not cause deadlocks ========================================================== 03:00:48 (1775199648) Apr 3 03:00:51 oleg421-client sshd[90205]: Received disconnect from 192.168.204.21 port 47532:11: disconnected by user Apr 3 03:00:51 oleg421-client sshd[90205]: Disconnected from user root 192.168.204.21 port 47532 Apr 3 03:00:51 oleg421-client sshd[90191]: pam_unix(sshd:session): session closed for user root Apr 3 03:00:52 oleg421-client systemd[1]: session-467.scope: Succeeded. Apr 3 03:00:52 oleg421-client systemd-logind[1011]: Session 467 logged out. Waiting for processes to exit. Apr 3 03:00:52 oleg421-client systemd-logind[1011]: Removed session 467. Apr 3 03:01:01 oleg421-client CROND[90314]: (root) CMD (run-parts /etc/cron.hourly) Apr 3 03:01:01 oleg421-client run-parts[90314]: (/etc/cron.hourly) starting 0anacron Apr 3 03:01:01 oleg421-client run-parts[90314]: (/etc/cron.hourly) finished 0anacron Apr 3 03:01:51 oleg421-client kernel: LustreError: 85979:0:(ldlm_lockd.c:2883:ldlm_bl_thread_blwi()) cfs_fail_timeout id 31f sleeping for 4000ms Apr 3 03:01:51 oleg421-client kernel: LustreError: 85979:0:(ldlm_lockd.c:2883:ldlm_bl_thread_blwi()) Skipped 1 previous similar message Apr 3 03:01:55 oleg421-client kernel: LustreError: 85979:0:(ldlm_lockd.c:2883:ldlm_bl_thread_blwi()) cfs_fail_timeout id 31f awake Apr 3 03:01:55 oleg421-client kernel: LustreError: 85979:0:(ldlm_lockd.c:2883:ldlm_bl_thread_blwi()) Skipped 1 previous similar message Apr 3 03:01:57 oleg421-client sshd[90471]: Accepted publickey for root from 192.168.204.21 port 36674 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:01:57 oleg421-client systemd-logind[1011]: New session 468 of user root. Apr 3 03:01:57 oleg421-client systemd[1]: Started Session 468 of user root. Apr 3 03:01:57 oleg421-client sshd[90471]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:01:58 oleg421-client sshd[90484]: Received disconnect from 192.168.204.21 port 36674:11: disconnected by user Apr 3 03:01:58 oleg421-client sshd[90484]: Disconnected from user root 192.168.204.21 port 36674 Apr 3 03:01:58 oleg421-client sshd[90471]: pam_unix(sshd:session): session closed for user root Apr 3 03:01:58 oleg421-client systemd-logind[1011]: Session 468 logged out. Waiting for processes to exit. Apr 3 03:01:58 oleg421-client systemd[1]: session-468.scope: Succeeded. Apr 3 03:01:58 oleg421-client systemd-logind[1011]: Removed session 468. Apr 3 03:01:59 oleg421-client sshd[90610]: Accepted publickey for root from 192.168.204.21 port 36684 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:01:59 oleg421-client systemd-logind[1011]: New session 469 of user root. Apr 3 03:01:59 oleg421-client systemd[1]: Started Session 469 of user root. Apr 3 03:01:59 oleg421-client sshd[90610]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:02:00 oleg421-client sshd[90623]: Received disconnect from 192.168.204.21 port 36684:11: disconnected by user Apr 3 03:02:00 oleg421-client sshd[90623]: Disconnected from user root 192.168.204.21 port 36684 Apr 3 03:02:00 oleg421-client sshd[90610]: pam_unix(sshd:session): session closed for user root Apr 3 03:02:00 oleg421-client systemd[1]: session-469.scope: Succeeded. Apr 3 03:02:00 oleg421-client systemd-logind[1011]: Session 469 logged out. Waiting for processes to exit. Apr 3 03:02:00 oleg421-client systemd-logind[1011]: Removed session 469. Apr 3 03:02:01 oleg421-client sshd[90756]: Accepted publickey for root from 192.168.204.21 port 36688 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:02:01 oleg421-client systemd-logind[1011]: New session 470 of user root. Apr 3 03:02:01 oleg421-client systemd[1]: Started Session 470 of user root. Apr 3 03:02:01 oleg421-client sshd[90756]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:02:02 oleg421-client sshd[90770]: Received disconnect from 192.168.204.21 port 36688:11: disconnected by user Apr 3 03:02:02 oleg421-client sshd[90770]: Disconnected from user root 192.168.204.21 port 36688 Apr 3 03:02:02 oleg421-client sshd[90756]: pam_unix(sshd:session): session closed for user root Apr 3 03:02:02 oleg421-client systemd[1]: session-470.scope: Succeeded. Apr 3 03:02:02 oleg421-client systemd-logind[1011]: Session 470 logged out. Waiting for processes to exit. Apr 3 03:02:02 oleg421-client systemd-logind[1011]: Removed session 470. Apr 3 03:02:04 oleg421-client sshd[90912]: Accepted publickey for root from 192.168.204.21 port 36690 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:02:04 oleg421-client systemd-logind[1011]: New session 471 of user root. Apr 3 03:02:04 oleg421-client systemd[1]: Started Session 471 of user root. Apr 3 03:02:04 oleg421-client sshd[90912]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:02:04 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 130a: enqueue resend on not existing file ========================================================== 03:02:02 (1775199722) Apr 3 03:02:04 oleg421-client sshd[90925]: Received disconnect from 192.168.204.21 port 36690:11: disconnected by user Apr 3 03:02:05 oleg421-client sshd[90925]: Disconnected from user root 192.168.204.21 port 36690 Apr 3 03:02:05 oleg421-client sshd[90912]: pam_unix(sshd:session): session closed for user root Apr 3 03:02:05 oleg421-client systemd[1]: session-471.scope: Succeeded. Apr 3 03:02:05 oleg421-client systemd-logind[1011]: Session 471 logged out. Waiting for processes to exit. Apr 3 03:02:05 oleg421-client systemd-logind[1011]: Removed session 471. Apr 3 03:03:04 oleg421-client sshd[91221]: Accepted publickey for root from 192.168.204.21 port 43618 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:03:04 oleg421-client systemd-logind[1011]: New session 472 of user root. Apr 3 03:03:04 oleg421-client systemd[1]: Started Session 472 of user root. Apr 3 03:03:04 oleg421-client sshd[91221]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:03:05 oleg421-client sshd[91234]: Received disconnect from 192.168.204.21 port 43618:11: disconnected by user Apr 3 03:03:05 oleg421-client sshd[91234]: Disconnected from user root 192.168.204.21 port 43618 Apr 3 03:03:05 oleg421-client sshd[91221]: pam_unix(sshd:session): session closed for user root Apr 3 03:03:05 oleg421-client systemd[1]: session-472.scope: Succeeded. Apr 3 03:03:05 oleg421-client systemd-logind[1011]: Session 472 logged out. Waiting for processes to exit. Apr 3 03:03:05 oleg421-client systemd-logind[1011]: Removed session 472. Apr 3 03:03:07 oleg421-client sshd[91360]: Accepted publickey for root from 192.168.204.21 port 58788 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:03:07 oleg421-client systemd[1]: Started Session 473 of user root. Apr 3 03:03:07 oleg421-client systemd-logind[1011]: New session 473 of user root. Apr 3 03:03:07 oleg421-client sshd[91360]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:03:08 oleg421-client sshd[91373]: Received disconnect from 192.168.204.21 port 58788:11: disconnected by user Apr 3 03:03:08 oleg421-client sshd[91373]: Disconnected from user root 192.168.204.21 port 58788 Apr 3 03:03:08 oleg421-client sshd[91360]: pam_unix(sshd:session): session closed for user root Apr 3 03:03:08 oleg421-client systemd[1]: session-473.scope: Succeeded. Apr 3 03:03:08 oleg421-client systemd-logind[1011]: Session 473 logged out. Waiting for processes to exit. Apr 3 03:03:08 oleg421-client systemd-logind[1011]: Removed session 473. Apr 3 03:03:10 oleg421-client sshd[91507]: Accepted publickey for root from 192.168.204.21 port 58798 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:03:10 oleg421-client systemd[1]: Started Session 474 of user root. Apr 3 03:03:10 oleg421-client systemd-logind[1011]: New session 474 of user root. Apr 3 03:03:10 oleg421-client sshd[91507]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:03:10 oleg421-client sshd[91520]: Received disconnect from 192.168.204.21 port 58798:11: disconnected by user Apr 3 03:03:11 oleg421-client sshd[91520]: Disconnected from user root 192.168.204.21 port 58798 Apr 3 03:03:11 oleg421-client sshd[91507]: pam_unix(sshd:session): session closed for user root Apr 3 03:03:11 oleg421-client systemd[1]: session-474.scope: Succeeded. Apr 3 03:03:11 oleg421-client systemd-logind[1011]: Session 474 logged out. Waiting for processes to exit. Apr 3 03:03:11 oleg421-client systemd-logind[1011]: Removed session 474. Apr 3 03:03:12 oleg421-client sshd[91663]: Accepted publickey for root from 192.168.204.21 port 58800 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:03:12 oleg421-client systemd[1]: Started Session 475 of user root. Apr 3 03:03:12 oleg421-client systemd-logind[1011]: New session 475 of user root. Apr 3 03:03:13 oleg421-client sshd[91663]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:03:13 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 130b: enqueue resend on a stale inode ========================================================== 03:03:11 (1775199791) Apr 3 03:03:13 oleg421-client sshd[91676]: Received disconnect from 192.168.204.21 port 58800:11: disconnected by user Apr 3 03:03:13 oleg421-client sshd[91676]: Disconnected from user root 192.168.204.21 port 58800 Apr 3 03:03:13 oleg421-client sshd[91663]: pam_unix(sshd:session): session closed for user root Apr 3 03:03:14 oleg421-client systemd-logind[1011]: Session 475 logged out. Waiting for processes to exit. Apr 3 03:03:14 oleg421-client systemd[1]: session-475.scope: Succeeded. Apr 3 03:03:14 oleg421-client systemd-logind[1011]: Removed session 475. Apr 3 03:04:14 oleg421-client sshd[92041]: Accepted publickey for root from 192.168.204.21 port 49180 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:04:14 oleg421-client systemd[1]: Started Session 476 of user root. Apr 3 03:04:14 oleg421-client systemd-logind[1011]: New session 476 of user root. Apr 3 03:04:14 oleg421-client sshd[92041]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:04:15 oleg421-client sshd[92054]: Received disconnect from 192.168.204.21 port 49180:11: disconnected by user Apr 3 03:04:15 oleg421-client sshd[92054]: Disconnected from user root 192.168.204.21 port 49180 Apr 3 03:04:15 oleg421-client sshd[92041]: pam_unix(sshd:session): session closed for user root Apr 3 03:04:15 oleg421-client systemd[1]: session-476.scope: Succeeded. Apr 3 03:04:15 oleg421-client systemd-logind[1011]: Session 476 logged out. Waiting for processes to exit. Apr 3 03:04:15 oleg421-client systemd-logind[1011]: Removed session 476. Apr 3 03:04:18 oleg421-client sshd[92181]: Accepted publickey for root from 192.168.204.21 port 43512 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:04:18 oleg421-client systemd-logind[1011]: New session 477 of user root. Apr 3 03:04:18 oleg421-client systemd[1]: Started Session 477 of user root. Apr 3 03:04:18 oleg421-client sshd[92181]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:04:18 oleg421-client sshd[92194]: Received disconnect from 192.168.204.21 port 43512:11: disconnected by user Apr 3 03:04:19 oleg421-client sshd[92194]: Disconnected from user root 192.168.204.21 port 43512 Apr 3 03:04:19 oleg421-client sshd[92181]: pam_unix(sshd:session): session closed for user root Apr 3 03:04:19 oleg421-client systemd[1]: session-477.scope: Succeeded. Apr 3 03:04:19 oleg421-client systemd-logind[1011]: Session 477 logged out. Waiting for processes to exit. Apr 3 03:04:19 oleg421-client systemd-logind[1011]: Removed session 477. Apr 3 03:04:21 oleg421-client sshd[92327]: Accepted publickey for root from 192.168.204.21 port 43520 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:04:21 oleg421-client systemd-logind[1011]: New session 478 of user root. Apr 3 03:04:21 oleg421-client systemd[1]: Started Session 478 of user root. Apr 3 03:04:21 oleg421-client sshd[92327]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:04:21 oleg421-client sshd[92340]: Received disconnect from 192.168.204.21 port 43520:11: disconnected by user Apr 3 03:04:21 oleg421-client sshd[92340]: Disconnected from user root 192.168.204.21 port 43520 Apr 3 03:04:21 oleg421-client sshd[92327]: pam_unix(sshd:session): session closed for user root Apr 3 03:04:21 oleg421-client systemd[1]: session-478.scope: Succeeded. Apr 3 03:04:21 oleg421-client systemd-logind[1011]: Session 478 logged out. Waiting for processes to exit. Apr 3 03:04:21 oleg421-client systemd-logind[1011]: Removed session 478. Apr 3 03:04:23 oleg421-client sshd[92482]: Accepted publickey for root from 192.168.204.21 port 43528 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:04:23 oleg421-client systemd-logind[1011]: New session 479 of user root. Apr 3 03:04:23 oleg421-client systemd[1]: Started Session 479 of user root. Apr 3 03:04:23 oleg421-client sshd[92482]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:04:23 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 130c: layout intent resend on a stale inode ========================================================== 03:04:22 (1775199862) Apr 3 03:04:23 oleg421-client sshd[92495]: Received disconnect from 192.168.204.21 port 43528:11: disconnected by user Apr 3 03:04:23 oleg421-client sshd[92495]: Disconnected from user root 192.168.204.21 port 43528 Apr 3 03:04:23 oleg421-client sshd[92482]: pam_unix(sshd:session): session closed for user root Apr 3 03:04:23 oleg421-client systemd[1]: session-479.scope: Succeeded. Apr 3 03:04:23 oleg421-client systemd-logind[1011]: Session 479 logged out. Waiting for processes to exit. Apr 3 03:04:23 oleg421-client systemd-logind[1011]: Removed session 479. Apr 3 03:04:54 oleg421-client sshd[92816]: Accepted publickey for root from 192.168.204.21 port 55676 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:04:54 oleg421-client systemd-logind[1011]: New session 480 of user root. Apr 3 03:04:54 oleg421-client systemd[1]: Started Session 480 of user root. Apr 3 03:04:54 oleg421-client sshd[92816]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:04:55 oleg421-client sshd[92829]: Received disconnect from 192.168.204.21 port 55676:11: disconnected by user Apr 3 03:04:55 oleg421-client sshd[92829]: Disconnected from user root 192.168.204.21 port 55676 Apr 3 03:04:55 oleg421-client sshd[92816]: pam_unix(sshd:session): session closed for user root Apr 3 03:04:55 oleg421-client systemd[1]: session-480.scope: Succeeded. Apr 3 03:04:55 oleg421-client systemd-logind[1011]: Session 480 logged out. Waiting for processes to exit. Apr 3 03:04:55 oleg421-client systemd-logind[1011]: Removed session 480. Apr 3 03:04:56 oleg421-client sshd[92956]: Accepted publickey for root from 192.168.204.21 port 55692 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:04:56 oleg421-client systemd-logind[1011]: New session 481 of user root. Apr 3 03:04:56 oleg421-client systemd[1]: Started Session 481 of user root. Apr 3 03:04:56 oleg421-client sshd[92956]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:04:57 oleg421-client sshd[92970]: Received disconnect from 192.168.204.21 port 55692:11: disconnected by user Apr 3 03:04:57 oleg421-client sshd[92970]: Disconnected from user root 192.168.204.21 port 55692 Apr 3 03:04:57 oleg421-client sshd[92956]: pam_unix(sshd:session): session closed for user root Apr 3 03:04:57 oleg421-client systemd[1]: session-481.scope: Succeeded. Apr 3 03:04:57 oleg421-client systemd-logind[1011]: Session 481 logged out. Waiting for processes to exit. Apr 3 03:04:57 oleg421-client systemd-logind[1011]: Removed session 481. Apr 3 03:04:59 oleg421-client sshd[93103]: Accepted publickey for root from 192.168.204.21 port 39140 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:04:59 oleg421-client systemd-logind[1011]: New session 482 of user root. Apr 3 03:04:59 oleg421-client systemd[1]: Started Session 482 of user root. Apr 3 03:04:59 oleg421-client sshd[93103]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:04:59 oleg421-client sshd[93116]: Received disconnect from 192.168.204.21 port 39140:11: disconnected by user Apr 3 03:04:59 oleg421-client sshd[93116]: Disconnected from user root 192.168.204.21 port 39140 Apr 3 03:04:59 oleg421-client sshd[93103]: pam_unix(sshd:session): session closed for user root Apr 3 03:05:00 oleg421-client systemd[1]: session-482.scope: Succeeded. Apr 3 03:05:00 oleg421-client systemd-logind[1011]: Session 482 logged out. Waiting for processes to exit. Apr 3 03:05:00 oleg421-client systemd-logind[1011]: Removed session 482. Apr 3 03:05:01 oleg421-client sshd[93258]: Accepted publickey for root from 192.168.204.21 port 39156 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:05:02 oleg421-client systemd-logind[1011]: New session 483 of user root. Apr 3 03:05:02 oleg421-client systemd[1]: Started Session 483 of user root. Apr 3 03:05:02 oleg421-client sshd[93258]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:05:02 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 132: long punch =================== 03:05:00 (1775199900) Apr 3 03:05:02 oleg421-client sshd[93271]: Received disconnect from 192.168.204.21 port 39156:11: disconnected by user Apr 3 03:05:02 oleg421-client sshd[93271]: Disconnected from user root 192.168.204.21 port 39156 Apr 3 03:05:02 oleg421-client sshd[93258]: pam_unix(sshd:session): session closed for user root Apr 3 03:05:02 oleg421-client systemd[1]: session-483.scope: Succeeded. Apr 3 03:05:02 oleg421-client systemd-logind[1011]: Session 483 logged out. Waiting for processes to exit. Apr 3 03:05:02 oleg421-client systemd-logind[1011]: Removed session 483. Apr 3 03:05:03 oleg421-client systemd-udevd[93326]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Apr 3 03:05:03 oleg421-client kernel: Lustre: Mounted lustre-client Apr 3 03:07:08 oleg421-client systemd[1]: mnt-lustre2.mount: Succeeded. Apr 3 03:07:08 oleg421-client kernel: LustreError: 93399:0:(lov_obd.c:786:lov_cleanup()) lustre-clilov-ffff962444bd8800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Apr 3 03:07:08 oleg421-client kernel: LustreError: 93399:0:(lov_obd.c:786:lov_cleanup()) Skipped 1 previous similar message Apr 3 03:07:08 oleg421-client kernel: Lustre: Unmounted lustre-client Apr 3 03:07:11 oleg421-client sshd[93497]: Accepted publickey for root from 192.168.204.21 port 57460 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:07:11 oleg421-client systemd-logind[1011]: New session 484 of user root. Apr 3 03:07:11 oleg421-client systemd[1]: Started Session 484 of user root. Apr 3 03:07:11 oleg421-client sshd[93497]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:07:11 oleg421-client sshd[93510]: Received disconnect from 192.168.204.21 port 57460:11: disconnected by user Apr 3 03:07:12 oleg421-client sshd[93510]: Disconnected from user root 192.168.204.21 port 57460 Apr 3 03:07:12 oleg421-client sshd[93497]: pam_unix(sshd:session): session closed for user root Apr 3 03:07:12 oleg421-client systemd[1]: session-484.scope: Succeeded. Apr 3 03:07:12 oleg421-client systemd-logind[1011]: Session 484 logged out. Waiting for processes to exit. Apr 3 03:07:13 oleg421-client systemd-logind[1011]: Removed session 484. Apr 3 03:07:14 oleg421-client sshd[93636]: Accepted publickey for root from 192.168.204.21 port 57472 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:07:15 oleg421-client systemd-logind[1011]: New session 485 of user root. Apr 3 03:07:15 oleg421-client systemd[1]: Started Session 485 of user root. Apr 3 03:07:15 oleg421-client sshd[93636]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:07:15 oleg421-client sshd[93650]: Received disconnect from 192.168.204.21 port 57472:11: disconnected by user Apr 3 03:07:15 oleg421-client sshd[93650]: Disconnected from user root 192.168.204.21 port 57472 Apr 3 03:07:15 oleg421-client sshd[93636]: pam_unix(sshd:session): session closed for user root Apr 3 03:07:15 oleg421-client systemd-logind[1011]: Session 485 logged out. Waiting for processes to exit. Apr 3 03:07:15 oleg421-client systemd[1]: session-485.scope: Succeeded. Apr 3 03:07:15 oleg421-client systemd-logind[1011]: Removed session 485. Apr 3 03:07:17 oleg421-client sshd[93783]: Accepted publickey for root from 192.168.204.21 port 35268 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:07:18 oleg421-client systemd[1]: Started Session 486 of user root. Apr 3 03:07:18 oleg421-client systemd-logind[1011]: New session 486 of user root. Apr 3 03:07:18 oleg421-client sshd[93783]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:07:18 oleg421-client sshd[93796]: Received disconnect from 192.168.204.21 port 35268:11: disconnected by user Apr 3 03:07:18 oleg421-client sshd[93796]: Disconnected from user root 192.168.204.21 port 35268 Apr 3 03:07:18 oleg421-client sshd[93783]: pam_unix(sshd:session): session closed for user root Apr 3 03:07:18 oleg421-client systemd-logind[1011]: Session 486 logged out. Waiting for processes to exit. Apr 3 03:07:18 oleg421-client systemd[1]: session-486.scope: Succeeded. Apr 3 03:07:18 oleg421-client systemd-logind[1011]: Removed session 486. Apr 3 03:07:21 oleg421-client sshd[93938]: Accepted publickey for root from 192.168.204.21 port 35272 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:07:21 oleg421-client systemd[1]: Started Session 487 of user root. Apr 3 03:07:21 oleg421-client systemd-logind[1011]: New session 487 of user root. Apr 3 03:07:21 oleg421-client sshd[93938]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:07:21 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 131: IO vs evict results to IO under staled lock ========================================================== 03:07:19 (1775200039) Apr 3 03:07:21 oleg421-client sshd[93951]: Received disconnect from 192.168.204.21 port 35272:11: disconnected by user Apr 3 03:07:21 oleg421-client sshd[93951]: Disconnected from user root 192.168.204.21 port 35272 Apr 3 03:07:21 oleg421-client sshd[93938]: pam_unix(sshd:session): session closed for user root Apr 3 03:07:22 oleg421-client systemd[1]: session-487.scope: Succeeded. Apr 3 03:07:22 oleg421-client systemd-logind[1011]: Session 487 logged out. Waiting for processes to exit. Apr 3 03:07:22 oleg421-client systemd-logind[1011]: Removed session 487. Apr 3 03:07:23 oleg421-client kernel: LustreError: 94022:0:(osc_request.c:2989:osc_build_rpc()) cfs_fail_timeout id 414 sleeping for 10000ms Apr 3 03:07:27 oleg421-client kernel: LustreError: lustre-OST0000-osc-ffff962446a99800: operation ldlm_enqueue to node 192.168.204.121@tcp failed: rc = -107 Apr 3 03:07:27 oleg421-client kernel: LustreError: Skipped 8 previous similar messages Apr 3 03:07:27 oleg421-client kernel: LustreError: lustre-OST0000-osc-ffff962446a99800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Apr 3 03:07:27 oleg421-client kernel: LustreError: 94104:0:(ldlm_resource.c:1170:ldlm_resource_complain()) lustre-OST0000-osc-ffff962446a99800: namespace resource [0x280000401:0x348d:0x0].0x0 (ffff962450b47a00) refcount nonzero (1) after lock cleanup; forcing cleanup. Apr 3 03:07:27 oleg421-client kernel: LustreError: 94104:0:(ldlm_resource.c:1170:ldlm_resource_complain()) Skipped 1 previous similar message Apr 3 03:07:27 oleg421-client kernel: LustreError: 94022:0:(osc_request.c:2989:osc_build_rpc()) cfs_fail_timeout interrupted Apr 3 03:07:27 oleg421-client kernel: Lustre: 2406:0:(llite_lib.c:4149:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.204.121@tcp:/lustre/fid: [0x20000bf89:0x9:0x0]// may get corrupted (rc -108) Apr 3 03:07:29 oleg421-client sshd[94202]: Accepted publickey for root from 192.168.204.21 port 39618 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:07:29 oleg421-client systemd-logind[1011]: New session 488 of user root. Apr 3 03:07:29 oleg421-client systemd[1]: Started Session 488 of user root. Apr 3 03:07:29 oleg421-client sshd[94202]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:07:30 oleg421-client sshd[94215]: Received disconnect from 192.168.204.21 port 39618:11: disconnected by user Apr 3 03:07:30 oleg421-client sshd[94215]: Disconnected from user root 192.168.204.21 port 39618 Apr 3 03:07:30 oleg421-client sshd[94202]: pam_unix(sshd:session): session closed for user root Apr 3 03:07:30 oleg421-client systemd[1]: session-488.scope: Succeeded. Apr 3 03:07:30 oleg421-client systemd-logind[1011]: Session 488 logged out. Waiting for processes to exit. Apr 3 03:07:30 oleg421-client systemd-logind[1011]: Removed session 488. Apr 3 03:07:31 oleg421-client sshd[94342]: Accepted publickey for root from 192.168.204.21 port 39628 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:07:31 oleg421-client systemd-logind[1011]: New session 489 of user root. Apr 3 03:07:31 oleg421-client systemd[1]: Started Session 489 of user root. Apr 3 03:07:31 oleg421-client sshd[94342]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:07:32 oleg421-client sshd[94355]: Received disconnect from 192.168.204.21 port 39628:11: disconnected by user Apr 3 03:07:32 oleg421-client sshd[94355]: Disconnected from user root 192.168.204.21 port 39628 Apr 3 03:07:32 oleg421-client sshd[94342]: pam_unix(sshd:session): session closed for user root Apr 3 03:07:32 oleg421-client systemd-logind[1011]: Session 489 logged out. Waiting for processes to exit. Apr 3 03:07:32 oleg421-client systemd[1]: session-489.scope: Succeeded. Apr 3 03:07:32 oleg421-client systemd-logind[1011]: Removed session 489. Apr 3 03:07:33 oleg421-client sshd[94489]: Accepted publickey for root from 192.168.204.21 port 39632 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:07:33 oleg421-client systemd-logind[1011]: New session 490 of user root. Apr 3 03:07:33 oleg421-client systemd[1]: Started Session 490 of user root. Apr 3 03:07:34 oleg421-client sshd[94489]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:07:34 oleg421-client sshd[94502]: Received disconnect from 192.168.204.21 port 39632:11: disconnected by user Apr 3 03:07:34 oleg421-client sshd[94502]: Disconnected from user root 192.168.204.21 port 39632 Apr 3 03:07:34 oleg421-client sshd[94489]: pam_unix(sshd:session): session closed for user root Apr 3 03:07:34 oleg421-client systemd-logind[1011]: Session 490 logged out. Waiting for processes to exit. Apr 3 03:07:34 oleg421-client systemd[1]: session-490.scope: Succeeded. Apr 3 03:07:34 oleg421-client systemd-logind[1011]: Removed session 490. Apr 3 03:07:36 oleg421-client sshd[94644]: Accepted publickey for root from 192.168.204.21 port 39642 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:07:36 oleg421-client systemd-logind[1011]: New session 491 of user root. Apr 3 03:07:36 oleg421-client systemd[1]: Started Session 491 of user root. Apr 3 03:07:36 oleg421-client sshd[94644]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:07:37 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 133: don't fail on flock resend === 03:07:34 (1775200054) Apr 3 03:07:37 oleg421-client sshd[94657]: Received disconnect from 192.168.204.21 port 39642:11: disconnected by user Apr 3 03:07:37 oleg421-client sshd[94657]: Disconnected from user root 192.168.204.21 port 39642 Apr 3 03:07:37 oleg421-client sshd[94644]: pam_unix(sshd:session): session closed for user root Apr 3 03:07:37 oleg421-client systemd-logind[1011]: Session 491 logged out. Waiting for processes to exit. Apr 3 03:07:37 oleg421-client systemd[1]: session-491.scope: Succeeded. Apr 3 03:07:37 oleg421-client systemd-logind[1011]: Removed session 491. Apr 3 03:08:19 oleg421-client sshd[94857]: Accepted publickey for root from 192.168.204.21 port 53328 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:08:19 oleg421-client systemd-logind[1011]: New session 492 of user root. Apr 3 03:08:19 oleg421-client systemd[1]: Started Session 492 of user root. Apr 3 03:08:19 oleg421-client sshd[94857]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:08:19 oleg421-client sshd[94870]: Received disconnect from 192.168.204.21 port 53328:11: disconnected by user Apr 3 03:08:19 oleg421-client sshd[94870]: Disconnected from user root 192.168.204.21 port 53328 Apr 3 03:08:19 oleg421-client sshd[94857]: pam_unix(sshd:session): session closed for user root Apr 3 03:08:19 oleg421-client systemd-logind[1011]: Session 492 logged out. Waiting for processes to exit. Apr 3 03:08:19 oleg421-client systemd[1]: session-492.scope: Succeeded. Apr 3 03:08:19 oleg421-client systemd-logind[1011]: Removed session 492. Apr 3 03:08:21 oleg421-client sshd[94996]: Accepted publickey for root from 192.168.204.21 port 53330 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:08:21 oleg421-client systemd-logind[1011]: New session 493 of user root. Apr 3 03:08:21 oleg421-client systemd[1]: Started Session 493 of user root. Apr 3 03:08:21 oleg421-client sshd[94996]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:08:21 oleg421-client sshd[95009]: Received disconnect from 192.168.204.21 port 53330:11: disconnected by user Apr 3 03:08:21 oleg421-client sshd[95009]: Disconnected from user root 192.168.204.21 port 53330 Apr 3 03:08:22 oleg421-client sshd[94996]: pam_unix(sshd:session): session closed for user root Apr 3 03:08:22 oleg421-client systemd[1]: session-493.scope: Succeeded. Apr 3 03:08:22 oleg421-client systemd-logind[1011]: Session 493 logged out. Waiting for processes to exit. Apr 3 03:08:22 oleg421-client systemd-logind[1011]: Removed session 493. Apr 3 03:08:23 oleg421-client sshd[95142]: Accepted publickey for root from 192.168.204.21 port 53338 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:08:23 oleg421-client systemd-logind[1011]: New session 494 of user root. Apr 3 03:08:23 oleg421-client systemd[1]: Started Session 494 of user root. Apr 3 03:08:23 oleg421-client sshd[95142]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:08:24 oleg421-client sshd[95155]: Received disconnect from 192.168.204.21 port 53338:11: disconnected by user Apr 3 03:08:24 oleg421-client sshd[95155]: Disconnected from user root 192.168.204.21 port 53338 Apr 3 03:08:24 oleg421-client sshd[95142]: pam_unix(sshd:session): session closed for user root Apr 3 03:08:24 oleg421-client systemd-logind[1011]: Session 494 logged out. Waiting for processes to exit. Apr 3 03:08:24 oleg421-client systemd[1]: session-494.scope: Succeeded. Apr 3 03:08:24 oleg421-client systemd-logind[1011]: Removed session 494. Apr 3 03:08:26 oleg421-client sshd[95298]: Accepted publickey for root from 192.168.204.21 port 53344 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:08:26 oleg421-client systemd[1]: Started Session 495 of user root. Apr 3 03:08:26 oleg421-client systemd-logind[1011]: New session 495 of user root. Apr 3 03:08:26 oleg421-client sshd[95298]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:08:26 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 134: race between failover and search for reply data free slot ========================================================== 03:08:24 (1775200104) Apr 3 03:08:26 oleg421-client sshd[95311]: Received disconnect from 192.168.204.21 port 53344:11: disconnected by user Apr 3 03:08:26 oleg421-client sshd[95311]: Disconnected from user root 192.168.204.21 port 53344 Apr 3 03:08:26 oleg421-client sshd[95298]: pam_unix(sshd:session): session closed for user root Apr 3 03:08:26 oleg421-client systemd-logind[1011]: Session 495 logged out. Waiting for processes to exit. Apr 3 03:08:26 oleg421-client systemd[1]: session-495.scope: Succeeded. Apr 3 03:08:26 oleg421-client systemd-logind[1011]: Removed session 495. Apr 3 03:08:27 oleg421-client sshd[95436]: Accepted publickey for root from 192.168.204.21 port 41360 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:08:27 oleg421-client systemd-logind[1011]: New session 496 of user root. Apr 3 03:08:27 oleg421-client systemd[1]: Started Session 496 of user root. Apr 3 03:08:27 oleg421-client sshd[95436]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:08:28 oleg421-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_134 Need 2+ clients, have 1 Apr 3 03:08:28 oleg421-client sshd[95449]: Received disconnect from 192.168.204.21 port 41360:11: disconnected by user Apr 3 03:08:28 oleg421-client sshd[95449]: Disconnected from user root 192.168.204.21 port 41360 Apr 3 03:08:28 oleg421-client sshd[95436]: pam_unix(sshd:session): session closed for user root Apr 3 03:08:28 oleg421-client systemd[1]: session-496.scope: Succeeded. Apr 3 03:08:28 oleg421-client systemd-logind[1011]: Session 496 logged out. Waiting for processes to exit. Apr 3 03:08:28 oleg421-client systemd-logind[1011]: Removed session 496. Apr 3 03:08:29 oleg421-client sshd[95590]: Accepted publickey for root from 192.168.204.21 port 41366 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:08:29 oleg421-client systemd-logind[1011]: New session 497 of user root. Apr 3 03:08:29 oleg421-client systemd[1]: Started Session 497 of user root. Apr 3 03:08:29 oleg421-client sshd[95590]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:08:30 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 135: DOM: open/create resend to return size ========================================================== 03:08:28 (1775200108) Apr 3 03:08:30 oleg421-client sshd[95603]: Received disconnect from 192.168.204.21 port 41366:11: disconnected by user Apr 3 03:08:30 oleg421-client sshd[95603]: Disconnected from user root 192.168.204.21 port 41366 Apr 3 03:08:30 oleg421-client sshd[95590]: pam_unix(sshd:session): session closed for user root Apr 3 03:08:30 oleg421-client systemd[1]: session-497.scope: Succeeded. Apr 3 03:08:30 oleg421-client systemd-logind[1011]: Session 497 logged out. Waiting for processes to exit. Apr 3 03:08:30 oleg421-client systemd-logind[1011]: Removed session 497. Apr 3 03:08:54 oleg421-client sshd[95798]: Accepted publickey for root from 192.168.204.21 port 50062 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:08:54 oleg421-client systemd-logind[1011]: New session 498 of user root. Apr 3 03:08:54 oleg421-client systemd[1]: Started Session 498 of user root. Apr 3 03:08:54 oleg421-client sshd[95798]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:08:54 oleg421-client sshd[95811]: Received disconnect from 192.168.204.21 port 50062:11: disconnected by user Apr 3 03:08:54 oleg421-client sshd[95811]: Disconnected from user root 192.168.204.21 port 50062 Apr 3 03:08:54 oleg421-client sshd[95798]: pam_unix(sshd:session): session closed for user root Apr 3 03:08:55 oleg421-client systemd[1]: session-498.scope: Succeeded. Apr 3 03:08:55 oleg421-client systemd-logind[1011]: Session 498 logged out. Waiting for processes to exit. Apr 3 03:08:55 oleg421-client systemd-logind[1011]: Removed session 498. Apr 3 03:08:56 oleg421-client sshd[95938]: Accepted publickey for root from 192.168.204.21 port 50072 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:08:56 oleg421-client systemd-logind[1011]: New session 499 of user root. Apr 3 03:08:56 oleg421-client systemd[1]: Started Session 499 of user root. Apr 3 03:08:56 oleg421-client sshd[95938]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:08:56 oleg421-client sshd[95951]: Received disconnect from 192.168.204.21 port 50072:11: disconnected by user Apr 3 03:08:56 oleg421-client sshd[95951]: Disconnected from user root 192.168.204.21 port 50072 Apr 3 03:08:56 oleg421-client sshd[95938]: pam_unix(sshd:session): session closed for user root Apr 3 03:08:57 oleg421-client systemd[1]: session-499.scope: Succeeded. Apr 3 03:08:57 oleg421-client systemd-logind[1011]: Session 499 logged out. Waiting for processes to exit. Apr 3 03:08:57 oleg421-client systemd-logind[1011]: Removed session 499. Apr 3 03:08:58 oleg421-client sshd[96084]: Accepted publickey for root from 192.168.204.21 port 38292 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:08:58 oleg421-client systemd[1]: Started Session 500 of user root. Apr 3 03:08:58 oleg421-client systemd-logind[1011]: New session 500 of user root. Apr 3 03:08:58 oleg421-client sshd[96084]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:08:59 oleg421-client sshd[96097]: Received disconnect from 192.168.204.21 port 38292:11: disconnected by user Apr 3 03:08:59 oleg421-client sshd[96097]: Disconnected from user root 192.168.204.21 port 38292 Apr 3 03:08:59 oleg421-client sshd[96084]: pam_unix(sshd:session): session closed for user root Apr 3 03:08:59 oleg421-client systemd-logind[1011]: Session 500 logged out. Waiting for processes to exit. Apr 3 03:08:59 oleg421-client systemd[1]: session-500.scope: Succeeded. Apr 3 03:08:59 oleg421-client systemd-logind[1011]: Removed session 500. Apr 3 03:09:00 oleg421-client sshd[96229]: Accepted publickey for root from 192.168.204.21 port 38300 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:09:00 oleg421-client systemd[1]: Started Session 501 of user root. Apr 3 03:09:00 oleg421-client systemd-logind[1011]: New session 501 of user root. Apr 3 03:09:00 oleg421-client sshd[96229]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:09:01 oleg421-client anacron[43564]: Job `cron.weekly' started Apr 3 03:09:01 oleg421-client anacron[43564]: Job `cron.weekly' terminated Apr 3 03:09:01 oleg421-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_136 skipping excluded test 136 Apr 3 03:09:01 oleg421-client sshd[96243]: Received disconnect from 192.168.204.21 port 38300:11: disconnected by user Apr 3 03:09:01 oleg421-client sshd[96243]: Disconnected from user root 192.168.204.21 port 38300 Apr 3 03:09:01 oleg421-client sshd[96229]: pam_unix(sshd:session): session closed for user root Apr 3 03:09:01 oleg421-client systemd-logind[1011]: Session 501 logged out. Waiting for processes to exit. Apr 3 03:09:01 oleg421-client systemd[1]: session-501.scope: Succeeded. Apr 3 03:09:01 oleg421-client systemd-logind[1011]: Removed session 501. Apr 3 03:09:02 oleg421-client sshd[96383]: Accepted publickey for root from 192.168.204.21 port 38306 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:09:02 oleg421-client systemd-logind[1011]: New session 502 of user root. Apr 3 03:09:02 oleg421-client systemd[1]: Started Session 502 of user root. Apr 3 03:09:02 oleg421-client sshd[96383]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:09:03 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 137: late resend must be skipped if already applied ========================================================== 03:09:01 (1775200141) Apr 3 03:09:03 oleg421-client sshd[96396]: Received disconnect from 192.168.204.21 port 38306:11: disconnected by user Apr 3 03:09:03 oleg421-client sshd[96396]: Disconnected from user root 192.168.204.21 port 38306 Apr 3 03:09:03 oleg421-client sshd[96383]: pam_unix(sshd:session): session closed for user root Apr 3 03:09:03 oleg421-client systemd[1]: session-502.scope: Succeeded. Apr 3 03:09:03 oleg421-client systemd-logind[1011]: Session 502 logged out. Waiting for processes to exit. Apr 3 03:09:03 oleg421-client systemd-logind[1011]: Removed session 502. Apr 3 03:09:17 oleg421-client sshd[96545]: Accepted publickey for root from 192.168.204.21 port 44630 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:09:17 oleg421-client systemd-logind[1011]: New session 503 of user root. Apr 3 03:09:17 oleg421-client systemd[1]: Started Session 503 of user root. Apr 3 03:09:17 oleg421-client sshd[96545]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:09:18 oleg421-client sshd[96558]: Received disconnect from 192.168.204.21 port 44630:11: disconnected by user Apr 3 03:09:18 oleg421-client sshd[96558]: Disconnected from user root 192.168.204.21 port 44630 Apr 3 03:09:18 oleg421-client sshd[96545]: pam_unix(sshd:session): session closed for user root Apr 3 03:09:18 oleg421-client systemd[1]: session-503.scope: Succeeded. Apr 3 03:09:18 oleg421-client systemd-logind[1011]: Session 503 logged out. Waiting for processes to exit. Apr 3 03:09:18 oleg421-client systemd-logind[1011]: Removed session 503. Apr 3 03:09:20 oleg421-client sshd[96684]: Accepted publickey for root from 192.168.204.21 port 44646 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:09:20 oleg421-client systemd-logind[1011]: New session 504 of user root. Apr 3 03:09:20 oleg421-client systemd[1]: Started Session 504 of user root. Apr 3 03:09:20 oleg421-client sshd[96684]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:09:20 oleg421-client sshd[96697]: Received disconnect from 192.168.204.21 port 44646:11: disconnected by user Apr 3 03:09:20 oleg421-client sshd[96697]: Disconnected from user root 192.168.204.21 port 44646 Apr 3 03:09:20 oleg421-client sshd[96684]: pam_unix(sshd:session): session closed for user root Apr 3 03:09:20 oleg421-client systemd[1]: session-504.scope: Succeeded. Apr 3 03:09:20 oleg421-client systemd-logind[1011]: Session 504 logged out. Waiting for processes to exit. Apr 3 03:09:20 oleg421-client systemd-logind[1011]: Removed session 504. Apr 3 03:09:21 oleg421-client sshd[96830]: Accepted publickey for root from 192.168.204.21 port 44660 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:09:21 oleg421-client systemd-logind[1011]: New session 505 of user root. Apr 3 03:09:21 oleg421-client systemd[1]: Started Session 505 of user root. Apr 3 03:09:21 oleg421-client sshd[96830]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:09:22 oleg421-client sshd[96843]: Received disconnect from 192.168.204.21 port 44660:11: disconnected by user Apr 3 03:09:22 oleg421-client sshd[96843]: Disconnected from user root 192.168.204.21 port 44660 Apr 3 03:09:22 oleg421-client sshd[96830]: pam_unix(sshd:session): session closed for user root Apr 3 03:09:22 oleg421-client systemd[1]: session-505.scope: Succeeded. Apr 3 03:09:22 oleg421-client systemd-logind[1011]: Session 505 logged out. Waiting for processes to exit. Apr 3 03:09:22 oleg421-client systemd-logind[1011]: Removed session 505. Apr 3 03:09:27 oleg421-client kernel: Lustre: 96450:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775200145/real 1775200145] req@ffff96244435df80 x1861425393931136/t0(0) o36->lustre-MDT0000-mdc-ffff962446a99800@192.168.204.121@tcp:12/10 lens 496/440 e 0 to 1 dl 1775200167 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'ln.0' uid:0 gid:0 projid:4294967295 Apr 3 03:09:27 oleg421-client kernel: Lustre: 96450:0:(client.c:2479:ptlrpc_expire_one_request()) Skipped 5 previous similar messages Apr 3 03:09:27 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962446a99800: Connection to lustre-MDT0000 (at 192.168.204.121@tcp) was lost; in progress operations using this service will wait for recovery to complete Apr 3 03:09:27 oleg421-client kernel: Lustre: Skipped 15 previous similar messages Apr 3 03:09:29 oleg421-client sshd[96988]: Accepted publickey for root from 192.168.204.21 port 46222 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:09:29 oleg421-client systemd-logind[1011]: New session 506 of user root. Apr 3 03:09:29 oleg421-client systemd[1]: Started Session 506 of user root. Apr 3 03:09:29 oleg421-client sshd[96988]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:09:29 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 138: Umount MDT during recovery === 03:09:27 (1775200167) Apr 3 03:09:29 oleg421-client sshd[97001]: Received disconnect from 192.168.204.21 port 46222:11: disconnected by user Apr 3 03:09:29 oleg421-client sshd[97001]: Disconnected from user root 192.168.204.21 port 46222 Apr 3 03:09:29 oleg421-client sshd[96988]: pam_unix(sshd:session): session closed for user root Apr 3 03:09:29 oleg421-client systemd-logind[1011]: Session 506 logged out. Waiting for processes to exit. Apr 3 03:09:29 oleg421-client systemd[1]: session-506.scope: Succeeded. Apr 3 03:09:29 oleg421-client systemd-logind[1011]: Removed session 506. Apr 3 03:09:32 oleg421-client systemd[1]: mnt-lustre.mount: Succeeded. Apr 3 03:09:32 oleg421-client kernel: LustreError: 97081:0:(lov_obd.c:786:lov_cleanup()) lustre-clilov-ffff962446a99800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Apr 3 03:09:32 oleg421-client kernel: LustreError: 97081:0:(lov_obd.c:786:lov_cleanup()) Skipped 1 previous similar message Apr 3 03:09:32 oleg421-client kernel: Lustre: Unmounted lustre-client Apr 3 03:11:46 oleg421-client systemd-udevd[97628]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Apr 3 03:11:47 oleg421-client kernel: Lustre: Mounted lustre-client Apr 3 03:11:49 oleg421-client sshd[97736]: Accepted publickey for root from 192.168.204.21 port 58710 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:11:49 oleg421-client systemd[1]: Started Session 507 of user root. Apr 3 03:11:49 oleg421-client systemd-logind[1011]: New session 507 of user root. Apr 3 03:11:49 oleg421-client sshd[97736]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:11:49 oleg421-client sshd[97749]: Received disconnect from 192.168.204.21 port 58710:11: disconnected by user Apr 3 03:11:49 oleg421-client sshd[97749]: Disconnected from user root 192.168.204.21 port 58710 Apr 3 03:11:49 oleg421-client sshd[97736]: pam_unix(sshd:session): session closed for user root Apr 3 03:11:50 oleg421-client systemd[1]: session-507.scope: Succeeded. Apr 3 03:11:50 oleg421-client systemd-logind[1011]: Session 507 logged out. Waiting for processes to exit. Apr 3 03:11:50 oleg421-client systemd-logind[1011]: Removed session 507. Apr 3 03:11:52 oleg421-client sshd[97876]: Accepted publickey for root from 192.168.204.21 port 58726 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:11:52 oleg421-client systemd-logind[1011]: New session 508 of user root. Apr 3 03:11:52 oleg421-client systemd[1]: Started Session 508 of user root. Apr 3 03:11:52 oleg421-client sshd[97876]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:11:52 oleg421-client sshd[97889]: Received disconnect from 192.168.204.21 port 58726:11: disconnected by user Apr 3 03:11:52 oleg421-client sshd[97889]: Disconnected from user root 192.168.204.21 port 58726 Apr 3 03:11:52 oleg421-client rsyslogd[1073]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Apr 3 03:11:53 oleg421-client sshd[97876]: pam_unix(sshd:session): session closed for user root Apr 3 03:11:53 oleg421-client systemd-logind[1011]: Session 508 logged out. Waiting for processes to exit. Apr 3 03:11:53 oleg421-client systemd[1]: session-508.scope: Succeeded. Apr 3 03:11:53 oleg421-client systemd-logind[1011]: Removed session 508. Apr 3 03:11:55 oleg421-client sshd[98023]: Accepted publickey for root from 192.168.204.21 port 58732 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:11:55 oleg421-client systemd-logind[1011]: New session 509 of user root. Apr 3 03:11:55 oleg421-client systemd[1]: Started Session 509 of user root. Apr 3 03:11:55 oleg421-client sshd[98023]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:11:56 oleg421-client sshd[98037]: Received disconnect from 192.168.204.21 port 58732:11: disconnected by user Apr 3 03:11:56 oleg421-client sshd[98037]: Disconnected from user root 192.168.204.21 port 58732 Apr 3 03:11:56 oleg421-client sshd[98023]: pam_unix(sshd:session): session closed for user root Apr 3 03:11:56 oleg421-client systemd[1]: session-509.scope: Succeeded. Apr 3 03:11:56 oleg421-client systemd-logind[1011]: Session 509 logged out. Waiting for processes to exit. Apr 3 03:11:56 oleg421-client systemd-logind[1011]: Removed session 509. Apr 3 03:11:58 oleg421-client sshd[98179]: Accepted publickey for root from 192.168.204.21 port 46090 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:11:58 oleg421-client systemd[1]: Started Session 510 of user root. Apr 3 03:11:58 oleg421-client systemd-logind[1011]: New session 510 of user root. Apr 3 03:11:58 oleg421-client sshd[98179]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:11:59 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 139: corrupted catid won't cause crash ========================================================== 03:11:56 (1775200316) Apr 3 03:11:59 oleg421-client sshd[98192]: Received disconnect from 192.168.204.21 port 46090:11: disconnected by user Apr 3 03:11:59 oleg421-client sshd[98192]: Disconnected from user root 192.168.204.21 port 46090 Apr 3 03:11:59 oleg421-client sshd[98179]: pam_unix(sshd:session): session closed for user root Apr 3 03:11:59 oleg421-client systemd-logind[1011]: Session 510 logged out. Waiting for processes to exit. Apr 3 03:11:59 oleg421-client systemd[1]: session-510.scope: Succeeded. Apr 3 03:11:59 oleg421-client systemd-logind[1011]: Removed session 510. Apr 3 03:12:18 oleg421-client kernel: LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 192.168.204.121@tcp) was lost; in progress operations using this service will fail Apr 3 03:12:18 oleg421-client kernel: Lustre: Evicted from MGS (at 192.168.204.121@tcp) after server handle changed from 0x1d1756950d140ba4 to 0x1d1756950d140c99 Apr 3 03:12:18 oleg421-client kernel: Lustre: MGC192.168.204.121@tcp: Connection restored to 192.168.204.121@tcp (at 192.168.204.121@tcp) Apr 3 03:12:18 oleg421-client kernel: Lustre: Skipped 14 previous similar messages Apr 3 03:12:27 oleg421-client sshd[98547]: Accepted publickey for root from 192.168.204.21 port 37190 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:12:27 oleg421-client systemd-logind[1011]: New session 511 of user root. Apr 3 03:12:27 oleg421-client systemd[1]: Started Session 511 of user root. Apr 3 03:12:27 oleg421-client sshd[98547]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:12:27 oleg421-client sshd[98560]: Received disconnect from 192.168.204.21 port 37190:11: disconnected by user Apr 3 03:12:27 oleg421-client sshd[98560]: Disconnected from user root 192.168.204.21 port 37190 Apr 3 03:12:27 oleg421-client sshd[98547]: pam_unix(sshd:session): session closed for user root Apr 3 03:12:28 oleg421-client systemd-logind[1011]: Session 511 logged out. Waiting for processes to exit. Apr 3 03:12:28 oleg421-client systemd[1]: session-511.scope: Succeeded. Apr 3 03:12:28 oleg421-client systemd-logind[1011]: Removed session 511. Apr 3 03:12:29 oleg421-client sshd[98686]: Accepted publickey for root from 192.168.204.21 port 41458 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:12:29 oleg421-client systemd-logind[1011]: New session 512 of user root. Apr 3 03:12:29 oleg421-client systemd[1]: Started Session 512 of user root. Apr 3 03:12:29 oleg421-client sshd[98686]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:12:29 oleg421-client sshd[98699]: Received disconnect from 192.168.204.21 port 41458:11: disconnected by user Apr 3 03:12:30 oleg421-client sshd[98699]: Disconnected from user root 192.168.204.21 port 41458 Apr 3 03:12:30 oleg421-client sshd[98686]: pam_unix(sshd:session): session closed for user root Apr 3 03:12:30 oleg421-client systemd[1]: session-512.scope: Succeeded. Apr 3 03:12:30 oleg421-client systemd-logind[1011]: Session 512 logged out. Waiting for processes to exit. Apr 3 03:12:30 oleg421-client systemd-logind[1011]: Removed session 512. Apr 3 03:12:31 oleg421-client sshd[98832]: Accepted publickey for root from 192.168.204.21 port 41468 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:12:31 oleg421-client systemd-logind[1011]: New session 513 of user root. Apr 3 03:12:31 oleg421-client systemd[1]: Started Session 513 of user root. Apr 3 03:12:31 oleg421-client sshd[98832]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:12:32 oleg421-client sshd[98845]: Received disconnect from 192.168.204.21 port 41468:11: disconnected by user Apr 3 03:12:32 oleg421-client sshd[98845]: Disconnected from user root 192.168.204.21 port 41468 Apr 3 03:12:32 oleg421-client sshd[98832]: pam_unix(sshd:session): session closed for user root Apr 3 03:12:32 oleg421-client systemd[1]: session-513.scope: Succeeded. Apr 3 03:12:32 oleg421-client systemd-logind[1011]: Session 513 logged out. Waiting for processes to exit. Apr 3 03:12:32 oleg421-client systemd-logind[1011]: Removed session 513. Apr 3 03:12:34 oleg421-client sshd[98988]: Accepted publickey for root from 192.168.204.21 port 41470 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:12:34 oleg421-client systemd-logind[1011]: New session 514 of user root. Apr 3 03:12:34 oleg421-client systemd[1]: Started Session 514 of user root. Apr 3 03:12:34 oleg421-client sshd[98988]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:12:34 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 140a: local mount is flagged properly ========================================================== 03:12:32 (1775200352) Apr 3 03:12:34 oleg421-client sshd[99001]: Received disconnect from 192.168.204.21 port 41470:11: disconnected by user Apr 3 03:12:34 oleg421-client sshd[99001]: Disconnected from user root 192.168.204.21 port 41470 Apr 3 03:12:34 oleg421-client sshd[98988]: pam_unix(sshd:session): session closed for user root Apr 3 03:12:34 oleg421-client systemd-logind[1011]: Session 514 logged out. Waiting for processes to exit. Apr 3 03:12:35 oleg421-client systemd[1]: session-514.scope: Succeeded. Apr 3 03:12:35 oleg421-client systemd-logind[1011]: Removed session 514. Apr 3 03:13:06 oleg421-client sshd[99342]: Accepted publickey for root from 192.168.204.21 port 35932 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:13:06 oleg421-client systemd-logind[1011]: New session 515 of user root. Apr 3 03:13:06 oleg421-client systemd[1]: Started Session 515 of user root. Apr 3 03:13:06 oleg421-client sshd[99342]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:13:06 oleg421-client sshd[99356]: Received disconnect from 192.168.204.21 port 35932:11: disconnected by user Apr 3 03:13:06 oleg421-client sshd[99356]: Disconnected from user root 192.168.204.21 port 35932 Apr 3 03:13:06 oleg421-client sshd[99342]: pam_unix(sshd:session): session closed for user root Apr 3 03:13:06 oleg421-client systemd[1]: session-515.scope: Succeeded. Apr 3 03:13:06 oleg421-client systemd-logind[1011]: Session 515 logged out. Waiting for processes to exit. Apr 3 03:13:06 oleg421-client systemd-logind[1011]: Removed session 515. Apr 3 03:13:07 oleg421-client sshd[99482]: Accepted publickey for root from 192.168.204.21 port 43858 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:13:07 oleg421-client systemd-logind[1011]: New session 516 of user root. Apr 3 03:13:08 oleg421-client systemd[1]: Started Session 516 of user root. Apr 3 03:13:08 oleg421-client sshd[99482]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:13:08 oleg421-client sshd[99495]: Received disconnect from 192.168.204.21 port 43858:11: disconnected by user Apr 3 03:13:08 oleg421-client sshd[99495]: Disconnected from user root 192.168.204.21 port 43858 Apr 3 03:13:08 oleg421-client sshd[99482]: pam_unix(sshd:session): session closed for user root Apr 3 03:13:08 oleg421-client systemd-logind[1011]: Session 516 logged out. Waiting for processes to exit. Apr 3 03:13:08 oleg421-client systemd[1]: session-516.scope: Succeeded. Apr 3 03:13:08 oleg421-client systemd-logind[1011]: Removed session 516. Apr 3 03:13:10 oleg421-client sshd[99628]: Accepted publickey for root from 192.168.204.21 port 43870 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:13:10 oleg421-client systemd[1]: Started Session 517 of user root. Apr 3 03:13:10 oleg421-client systemd-logind[1011]: New session 517 of user root. Apr 3 03:13:10 oleg421-client sshd[99628]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:13:10 oleg421-client sshd[99641]: Received disconnect from 192.168.204.21 port 43870:11: disconnected by user Apr 3 03:13:10 oleg421-client sshd[99641]: Disconnected from user root 192.168.204.21 port 43870 Apr 3 03:13:10 oleg421-client sshd[99628]: pam_unix(sshd:session): session closed for user root Apr 3 03:13:10 oleg421-client systemd-logind[1011]: Session 517 logged out. Waiting for processes to exit. Apr 3 03:13:10 oleg421-client systemd[1]: session-517.scope: Succeeded. Apr 3 03:13:10 oleg421-client systemd-logind[1011]: Removed session 517. Apr 3 03:13:13 oleg421-client sshd[99792]: Accepted publickey for root from 192.168.204.21 port 43884 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:13:13 oleg421-client systemd-logind[1011]: New session 518 of user root. Apr 3 03:13:13 oleg421-client systemd[1]: Started Session 518 of user root. Apr 3 03:13:13 oleg421-client sshd[99792]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:13:13 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 140b: local mount is excluded from recovery ========================================================== 03:13:12 (1775200392) Apr 3 03:13:13 oleg421-client sshd[99805]: Received disconnect from 192.168.204.21 port 43884:11: disconnected by user Apr 3 03:13:13 oleg421-client sshd[99805]: Disconnected from user root 192.168.204.21 port 43884 Apr 3 03:13:13 oleg421-client sshd[99792]: pam_unix(sshd:session): session closed for user root Apr 3 03:13:14 oleg421-client systemd[1]: session-518.scope: Succeeded. Apr 3 03:13:14 oleg421-client systemd-logind[1011]: Session 518 logged out. Waiting for processes to exit. Apr 3 03:13:14 oleg421-client systemd-logind[1011]: Removed session 518. Apr 3 03:13:29 oleg421-client kernel: Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 Apr 3 03:14:16 oleg421-client sshd[100347]: Accepted publickey for root from 192.168.204.21 port 58952 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:14:16 oleg421-client systemd-logind[1011]: New session 519 of user root. Apr 3 03:14:16 oleg421-client systemd[1]: Started Session 519 of user root. Apr 3 03:14:16 oleg421-client sshd[100347]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:14:17 oleg421-client sshd[100360]: Received disconnect from 192.168.204.21 port 58952:11: disconnected by user Apr 3 03:14:17 oleg421-client sshd[100360]: Disconnected from user root 192.168.204.21 port 58952 Apr 3 03:14:17 oleg421-client sshd[100347]: pam_unix(sshd:session): session closed for user root Apr 3 03:14:17 oleg421-client systemd[1]: session-519.scope: Succeeded. Apr 3 03:14:17 oleg421-client systemd-logind[1011]: Session 519 logged out. Waiting for processes to exit. Apr 3 03:14:17 oleg421-client systemd-logind[1011]: Removed session 519. Apr 3 03:14:21 oleg421-client sshd[100584]: Accepted publickey for root from 192.168.204.21 port 41782 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:14:21 oleg421-client systemd-logind[1011]: New session 520 of user root. Apr 3 03:14:21 oleg421-client systemd[1]: Started Session 520 of user root. Apr 3 03:14:21 oleg421-client sshd[100584]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:14:21 oleg421-client kernel: Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid Apr 3 03:14:21 oleg421-client sshd[100597]: Received disconnect from 192.168.204.21 port 41782:11: disconnected by user Apr 3 03:14:21 oleg421-client sshd[100597]: Disconnected from user root 192.168.204.21 port 41782 Apr 3 03:14:21 oleg421-client sshd[100584]: pam_unix(sshd:session): session closed for user root Apr 3 03:14:22 oleg421-client systemd[1]: session-520.scope: Succeeded. Apr 3 03:14:22 oleg421-client systemd-logind[1011]: Session 520 logged out. Waiting for processes to exit. Apr 3 03:14:22 oleg421-client systemd-logind[1011]: Removed session 520. Apr 3 03:14:23 oleg421-client sshd[100740]: Accepted publickey for root from 192.168.204.21 port 41790 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:14:23 oleg421-client systemd[1]: Started Session 521 of user root. Apr 3 03:14:23 oleg421-client systemd-logind[1011]: New session 521 of user root. Apr 3 03:14:23 oleg421-client sshd[100740]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:14:23 oleg421-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Apr 3 03:14:23 oleg421-client sshd[100753]: Received disconnect from 192.168.204.21 port 41790:11: disconnected by user Apr 3 03:14:23 oleg421-client sshd[100753]: Disconnected from user root 192.168.204.21 port 41790 Apr 3 03:14:23 oleg421-client sshd[100740]: pam_unix(sshd:session): session closed for user root Apr 3 03:14:24 oleg421-client systemd[1]: session-521.scope: Succeeded. Apr 3 03:14:24 oleg421-client systemd-logind[1011]: Session 521 logged out. Waiting for processes to exit. Apr 3 03:14:24 oleg421-client systemd-logind[1011]: Removed session 521. Apr 3 03:14:25 oleg421-client sshd[100795]: Accepted publickey for root from 192.168.204.21 port 41804 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:14:25 oleg421-client systemd-logind[1011]: New session 522 of user root. Apr 3 03:14:25 oleg421-client systemd[1]: Started Session 522 of user root. Apr 3 03:14:25 oleg421-client sshd[100795]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:14:25 oleg421-client sshd[100808]: Received disconnect from 192.168.204.21 port 41804:11: disconnected by user Apr 3 03:14:25 oleg421-client sshd[100808]: Disconnected from user root 192.168.204.21 port 41804 Apr 3 03:14:25 oleg421-client sshd[100795]: pam_unix(sshd:session): session closed for user root Apr 3 03:14:26 oleg421-client systemd[1]: session-522.scope: Succeeded. Apr 3 03:14:26 oleg421-client systemd-logind[1011]: Session 522 logged out. Waiting for processes to exit. Apr 3 03:14:26 oleg421-client systemd-logind[1011]: Removed session 522. Apr 3 03:14:28 oleg421-client sshd[100941]: Accepted publickey for root from 192.168.204.21 port 34464 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:14:28 oleg421-client systemd-logind[1011]: New session 523 of user root. Apr 3 03:14:28 oleg421-client systemd[1]: Started Session 523 of user root. Apr 3 03:14:28 oleg421-client sshd[100941]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:14:28 oleg421-client sshd[100954]: Received disconnect from 192.168.204.21 port 34464:11: disconnected by user Apr 3 03:14:28 oleg421-client sshd[100954]: Disconnected from user root 192.168.204.21 port 34464 Apr 3 03:14:29 oleg421-client sshd[100941]: pam_unix(sshd:session): session closed for user root Apr 3 03:14:29 oleg421-client systemd[1]: session-523.scope: Succeeded. Apr 3 03:14:29 oleg421-client systemd-logind[1011]: Session 523 logged out. Waiting for processes to exit. Apr 3 03:14:29 oleg421-client systemd-logind[1011]: Removed session 523. Apr 3 03:14:30 oleg421-client sshd[101081]: Accepted publickey for root from 192.168.204.21 port 34466 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:14:30 oleg421-client systemd-logind[1011]: New session 524 of user root. Apr 3 03:14:30 oleg421-client systemd[1]: Started Session 524 of user root. Apr 3 03:14:30 oleg421-client sshd[101081]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:14:30 oleg421-client sshd[101094]: Received disconnect from 192.168.204.21 port 34466:11: disconnected by user Apr 3 03:14:30 oleg421-client sshd[101094]: Disconnected from user root 192.168.204.21 port 34466 Apr 3 03:14:30 oleg421-client sshd[101081]: pam_unix(sshd:session): session closed for user root Apr 3 03:14:30 oleg421-client systemd[1]: session-524.scope: Succeeded. Apr 3 03:14:30 oleg421-client systemd-logind[1011]: Session 524 logged out. Waiting for processes to exit. Apr 3 03:14:30 oleg421-client systemd-logind[1011]: Removed session 524. Apr 3 03:14:31 oleg421-client sshd[101227]: Accepted publickey for root from 192.168.204.21 port 34478 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:14:31 oleg421-client systemd-logind[1011]: New session 525 of user root. Apr 3 03:14:31 oleg421-client systemd[1]: Started Session 525 of user root. Apr 3 03:14:31 oleg421-client sshd[101227]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:14:31 oleg421-client sshd[101240]: Received disconnect from 192.168.204.21 port 34478:11: disconnected by user Apr 3 03:14:31 oleg421-client sshd[101240]: Disconnected from user root 192.168.204.21 port 34478 Apr 3 03:14:32 oleg421-client sshd[101227]: pam_unix(sshd:session): session closed for user root Apr 3 03:14:32 oleg421-client systemd[1]: session-525.scope: Succeeded. Apr 3 03:14:32 oleg421-client systemd-logind[1011]: Session 525 logged out. Waiting for processes to exit. Apr 3 03:14:32 oleg421-client systemd-logind[1011]: Removed session 525. Apr 3 03:14:34 oleg421-client sshd[101391]: Accepted publickey for root from 192.168.204.21 port 34490 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:14:34 oleg421-client systemd-logind[1011]: New session 526 of user root. Apr 3 03:14:34 oleg421-client systemd[1]: Started Session 526 of user root. Apr 3 03:14:34 oleg421-client sshd[101391]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:14:35 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 141: do not lose locks on MGS restart ========================================================== 03:14:33 (1775200473) Apr 3 03:14:35 oleg421-client sshd[101404]: Received disconnect from 192.168.204.21 port 34490:11: disconnected by user Apr 3 03:14:35 oleg421-client sshd[101404]: Disconnected from user root 192.168.204.21 port 34490 Apr 3 03:14:35 oleg421-client sshd[101391]: pam_unix(sshd:session): session closed for user root Apr 3 03:14:35 oleg421-client systemd[1]: session-526.scope: Succeeded. Apr 3 03:14:35 oleg421-client systemd-logind[1011]: Session 526 logged out. Waiting for processes to exit. Apr 3 03:14:35 oleg421-client systemd-logind[1011]: Removed session 526. Apr 3 03:14:37 oleg421-client sshd[101657]: Accepted publickey for root from 192.168.204.21 port 34494 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:14:37 oleg421-client systemd[1]: Started Session 527 of user root. Apr 3 03:14:37 oleg421-client systemd-logind[1011]: New session 527 of user root. Apr 3 03:14:37 oleg421-client sshd[101657]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:14:37 oleg421-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_141 cannot run in local mode or from build tree Apr 3 03:14:37 oleg421-client sshd[101670]: Received disconnect from 192.168.204.21 port 34494:11: disconnected by user Apr 3 03:14:37 oleg421-client sshd[101670]: Disconnected from user root 192.168.204.21 port 34494 Apr 3 03:14:37 oleg421-client sshd[101657]: pam_unix(sshd:session): session closed for user root Apr 3 03:14:38 oleg421-client systemd-logind[1011]: Session 527 logged out. Waiting for processes to exit. Apr 3 03:14:38 oleg421-client systemd[1]: session-527.scope: Succeeded. Apr 3 03:14:38 oleg421-client systemd-logind[1011]: Removed session 527. Apr 3 03:14:39 oleg421-client sshd[101811]: Accepted publickey for root from 192.168.204.21 port 52638 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:14:39 oleg421-client systemd-logind[1011]: New session 528 of user root. Apr 3 03:14:39 oleg421-client systemd[1]: Started Session 528 of user root. Apr 3 03:14:39 oleg421-client sshd[101811]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:14:39 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 142: orphan name stub can be cleaned up in startup ========================================================== 03:14:38 (1775200478) Apr 3 03:14:39 oleg421-client sshd[101824]: Received disconnect from 192.168.204.21 port 52638:11: disconnected by user Apr 3 03:14:39 oleg421-client sshd[101824]: Disconnected from user root 192.168.204.21 port 52638 Apr 3 03:14:40 oleg421-client sshd[101811]: pam_unix(sshd:session): session closed for user root Apr 3 03:14:40 oleg421-client systemd[1]: session-528.scope: Succeeded. Apr 3 03:14:40 oleg421-client systemd-logind[1011]: Session 528 logged out. Waiting for processes to exit. Apr 3 03:14:40 oleg421-client systemd-logind[1011]: Removed session 528. Apr 3 03:15:04 oleg421-client sshd[102189]: Accepted publickey for root from 192.168.204.21 port 52882 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:15:05 oleg421-client systemd[1]: Started Session 529 of user root. Apr 3 03:15:05 oleg421-client systemd-logind[1011]: New session 529 of user root. Apr 3 03:15:05 oleg421-client sshd[102189]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:15:05 oleg421-client sshd[102203]: Received disconnect from 192.168.204.21 port 52882:11: disconnected by user Apr 3 03:15:05 oleg421-client sshd[102203]: Disconnected from user root 192.168.204.21 port 52882 Apr 3 03:15:05 oleg421-client sshd[102189]: pam_unix(sshd:session): session closed for user root Apr 3 03:15:05 oleg421-client systemd[1]: session-529.scope: Succeeded. Apr 3 03:15:05 oleg421-client systemd-logind[1011]: Session 529 logged out. Waiting for processes to exit. Apr 3 03:15:05 oleg421-client systemd-logind[1011]: Removed session 529. Apr 3 03:15:07 oleg421-client sshd[102329]: Accepted publickey for root from 192.168.204.21 port 52898 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:15:07 oleg421-client systemd-logind[1011]: New session 530 of user root. Apr 3 03:15:07 oleg421-client systemd[1]: Started Session 530 of user root. Apr 3 03:15:07 oleg421-client sshd[102329]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:15:07 oleg421-client sshd[102342]: Received disconnect from 192.168.204.21 port 52898:11: disconnected by user Apr 3 03:15:07 oleg421-client sshd[102342]: Disconnected from user root 192.168.204.21 port 52898 Apr 3 03:15:07 oleg421-client sshd[102329]: pam_unix(sshd:session): session closed for user root Apr 3 03:15:07 oleg421-client systemd[1]: session-530.scope: Succeeded. Apr 3 03:15:07 oleg421-client systemd-logind[1011]: Session 530 logged out. Waiting for processes to exit. Apr 3 03:15:07 oleg421-client systemd-logind[1011]: Removed session 530. Apr 3 03:15:09 oleg421-client sshd[102475]: Accepted publickey for root from 192.168.204.21 port 60032 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:15:09 oleg421-client systemd-logind[1011]: New session 531 of user root. Apr 3 03:15:09 oleg421-client systemd[1]: Started Session 531 of user root. Apr 3 03:15:09 oleg421-client sshd[102475]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:15:09 oleg421-client sshd[102488]: Received disconnect from 192.168.204.21 port 60032:11: disconnected by user Apr 3 03:15:09 oleg421-client sshd[102488]: Disconnected from user root 192.168.204.21 port 60032 Apr 3 03:15:09 oleg421-client sshd[102475]: pam_unix(sshd:session): session closed for user root Apr 3 03:15:09 oleg421-client systemd-logind[1011]: Session 531 logged out. Waiting for processes to exit. Apr 3 03:15:09 oleg421-client systemd[1]: session-531.scope: Succeeded. Apr 3 03:15:09 oleg421-client systemd-logind[1011]: Removed session 531. Apr 3 03:15:11 oleg421-client sshd[102631]: Accepted publickey for root from 192.168.204.21 port 60038 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:15:11 oleg421-client systemd-logind[1011]: New session 532 of user root. Apr 3 03:15:11 oleg421-client systemd[1]: Started Session 532 of user root. Apr 3 03:15:11 oleg421-client sshd[102631]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:15:11 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 143: orphan cleanup thread shouldn't be blocked even delete failed ========================================================== 03:15:10 (1775200510) Apr 3 03:15:11 oleg421-client sshd[102644]: Received disconnect from 192.168.204.21 port 60038:11: disconnected by user Apr 3 03:15:11 oleg421-client sshd[102644]: Disconnected from user root 192.168.204.21 port 60038 Apr 3 03:15:11 oleg421-client sshd[102631]: pam_unix(sshd:session): session closed for user root Apr 3 03:15:12 oleg421-client systemd[1]: session-532.scope: Succeeded. Apr 3 03:15:12 oleg421-client systemd-logind[1011]: Session 532 logged out. Waiting for processes to exit. Apr 3 03:15:12 oleg421-client systemd-logind[1011]: Removed session 532. Apr 3 03:15:45 oleg421-client sshd[103129]: Accepted publickey for root from 192.168.204.21 port 37064 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:15:45 oleg421-client systemd-logind[1011]: New session 533 of user root. Apr 3 03:15:45 oleg421-client systemd[1]: Started Session 533 of user root. Apr 3 03:15:45 oleg421-client sshd[103129]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:15:45 oleg421-client sshd[103142]: Received disconnect from 192.168.204.21 port 37064:11: disconnected by user Apr 3 03:15:45 oleg421-client sshd[103142]: Disconnected from user root 192.168.204.21 port 37064 Apr 3 03:15:45 oleg421-client sshd[103129]: pam_unix(sshd:session): session closed for user root Apr 3 03:15:45 oleg421-client systemd[1]: session-533.scope: Succeeded. Apr 3 03:15:45 oleg421-client systemd-logind[1011]: Session 533 logged out. Waiting for processes to exit. Apr 3 03:15:45 oleg421-client systemd-logind[1011]: Removed session 533. Apr 3 03:15:46 oleg421-client sshd[103268]: Accepted publickey for root from 192.168.204.21 port 37080 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:15:46 oleg421-client systemd-logind[1011]: New session 534 of user root. Apr 3 03:15:46 oleg421-client systemd[1]: Started Session 534 of user root. Apr 3 03:15:46 oleg421-client sshd[103268]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:15:47 oleg421-client sshd[103281]: Received disconnect from 192.168.204.21 port 37080:11: disconnected by user Apr 3 03:15:47 oleg421-client sshd[103281]: Disconnected from user root 192.168.204.21 port 37080 Apr 3 03:15:47 oleg421-client sshd[103268]: pam_unix(sshd:session): session closed for user root Apr 3 03:15:47 oleg421-client systemd[1]: session-534.scope: Succeeded. Apr 3 03:15:47 oleg421-client systemd-logind[1011]: Session 534 logged out. Waiting for processes to exit. Apr 3 03:15:47 oleg421-client systemd-logind[1011]: Removed session 534. Apr 3 03:15:48 oleg421-client sshd[103415]: Accepted publickey for root from 192.168.204.21 port 52270 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:15:48 oleg421-client systemd[1]: Started Session 535 of user root. Apr 3 03:15:48 oleg421-client systemd-logind[1011]: New session 535 of user root. Apr 3 03:15:48 oleg421-client sshd[103415]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:15:48 oleg421-client sshd[103428]: Received disconnect from 192.168.204.21 port 52270:11: disconnected by user Apr 3 03:15:48 oleg421-client sshd[103428]: Disconnected from user root 192.168.204.21 port 52270 Apr 3 03:15:48 oleg421-client sshd[103415]: pam_unix(sshd:session): session closed for user root Apr 3 03:15:48 oleg421-client systemd-logind[1011]: Session 535 logged out. Waiting for processes to exit. Apr 3 03:15:48 oleg421-client systemd[1]: session-535.scope: Succeeded. Apr 3 03:15:48 oleg421-client systemd-logind[1011]: Removed session 535. Apr 3 03:15:50 oleg421-client sshd[103570]: Accepted publickey for root from 192.168.204.21 port 52286 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:15:50 oleg421-client systemd-logind[1011]: New session 536 of user root. Apr 3 03:15:50 oleg421-client systemd[1]: Started Session 536 of user root. Apr 3 03:15:50 oleg421-client sshd[103570]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:15:50 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 144a: MDT failover should stop precreation threads ========================================================== 03:15:49 (1775200549) Apr 3 03:15:50 oleg421-client sshd[103584]: Received disconnect from 192.168.204.21 port 52286:11: disconnected by user Apr 3 03:15:50 oleg421-client sshd[103584]: Disconnected from user root 192.168.204.21 port 52286 Apr 3 03:15:50 oleg421-client sshd[103570]: pam_unix(sshd:session): session closed for user root Apr 3 03:15:50 oleg421-client systemd-logind[1011]: Session 536 logged out. Waiting for processes to exit. Apr 3 03:15:50 oleg421-client systemd[1]: session-536.scope: Succeeded. Apr 3 03:15:50 oleg421-client systemd-logind[1011]: Removed session 536. Apr 3 03:16:01 oleg421-client kernel: LustreError: lustre-OST0000-osc-ffff962450e3f000: operation ost_setattr to node 192.168.204.121@tcp failed: rc = -107 Apr 3 03:16:41 oleg421-client sshd[104042]: Accepted publickey for root from 192.168.204.21 port 54716 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:16:41 oleg421-client systemd-logind[1011]: New session 537 of user root. Apr 3 03:16:41 oleg421-client systemd[1]: Started Session 537 of user root. Apr 3 03:16:41 oleg421-client sshd[104042]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:16:42 oleg421-client sshd[104055]: Received disconnect from 192.168.204.21 port 54716:11: disconnected by user Apr 3 03:16:42 oleg421-client sshd[104055]: Disconnected from user root 192.168.204.21 port 54716 Apr 3 03:16:42 oleg421-client sshd[104042]: pam_unix(sshd:session): session closed for user root Apr 3 03:16:42 oleg421-client systemd[1]: session-537.scope: Succeeded. Apr 3 03:16:42 oleg421-client systemd-logind[1011]: Session 537 logged out. Waiting for processes to exit. Apr 3 03:16:42 oleg421-client systemd-logind[1011]: Removed session 537. Apr 3 03:16:49 oleg421-client sshd[104279]: Accepted publickey for root from 192.168.204.21 port 32954 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:16:50 oleg421-client systemd[1]: Started Session 538 of user root. Apr 3 03:16:50 oleg421-client systemd-logind[1011]: New session 538 of user root. Apr 3 03:16:50 oleg421-client sshd[104279]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:16:50 oleg421-client kernel: Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid Apr 3 03:16:51 oleg421-client sshd[104292]: Received disconnect from 192.168.204.21 port 32954:11: disconnected by user Apr 3 03:16:51 oleg421-client sshd[104292]: Disconnected from user root 192.168.204.21 port 32954 Apr 3 03:16:51 oleg421-client sshd[104279]: pam_unix(sshd:session): session closed for user root Apr 3 03:16:51 oleg421-client systemd[1]: session-538.scope: Succeeded. Apr 3 03:16:51 oleg421-client systemd-logind[1011]: Session 538 logged out. Waiting for processes to exit. Apr 3 03:16:51 oleg421-client systemd-logind[1011]: Removed session 538. Apr 3 03:16:54 oleg421-client sshd[104436]: Accepted publickey for root from 192.168.204.21 port 32962 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:16:54 oleg421-client systemd-logind[1011]: New session 539 of user root. Apr 3 03:16:54 oleg421-client systemd[1]: Started Session 539 of user root. Apr 3 03:16:54 oleg421-client sshd[104436]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:16:54 oleg421-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec Apr 3 03:16:54 oleg421-client sshd[104449]: Received disconnect from 192.168.204.21 port 32962:11: disconnected by user Apr 3 03:16:54 oleg421-client sshd[104449]: Disconnected from user root 192.168.204.21 port 32962 Apr 3 03:16:54 oleg421-client sshd[104436]: pam_unix(sshd:session): session closed for user root Apr 3 03:16:54 oleg421-client systemd-logind[1011]: Session 539 logged out. Waiting for processes to exit. Apr 3 03:16:54 oleg421-client systemd[1]: session-539.scope: Succeeded. Apr 3 03:16:54 oleg421-client systemd-logind[1011]: Removed session 539. Apr 3 03:16:57 oleg421-client sshd[104490]: Accepted publickey for root from 192.168.204.21 port 32978 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:16:57 oleg421-client systemd-logind[1011]: New session 540 of user root. Apr 3 03:16:57 oleg421-client sshd[104490]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:16:57 oleg421-client systemd[1]: Started Session 540 of user root. Apr 3 03:16:58 oleg421-client sshd[104503]: Received disconnect from 192.168.204.21 port 32978:11: disconnected by user Apr 3 03:16:58 oleg421-client sshd[104503]: Disconnected from user root 192.168.204.21 port 32978 Apr 3 03:16:58 oleg421-client sshd[104490]: pam_unix(sshd:session): session closed for user root Apr 3 03:16:59 oleg421-client systemd[1]: session-540.scope: Succeeded. Apr 3 03:16:59 oleg421-client systemd-logind[1011]: Session 540 logged out. Waiting for processes to exit. Apr 3 03:16:59 oleg421-client systemd-logind[1011]: Removed session 540. Apr 3 03:18:30 oleg421-client kernel: Lustre: 97609:0:(mgc_request.c:1917:mgc_process_log()) MGC192.168.204.121@tcp: IR log lustre-cliir failed, not fatal: rc = -2 Apr 3 03:18:40 oleg421-client sshd[104824]: Accepted publickey for root from 192.168.204.21 port 33780 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:18:40 oleg421-client systemd-logind[1011]: New session 541 of user root. Apr 3 03:18:40 oleg421-client systemd[1]: Started Session 541 of user root. Apr 3 03:18:40 oleg421-client sshd[104824]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:18:41 oleg421-client sshd[104837]: Received disconnect from 192.168.204.21 port 33780:11: disconnected by user Apr 3 03:18:41 oleg421-client sshd[104837]: Disconnected from user root 192.168.204.21 port 33780 Apr 3 03:18:41 oleg421-client sshd[104824]: pam_unix(sshd:session): session closed for user root Apr 3 03:18:41 oleg421-client systemd[1]: session-541.scope: Succeeded. Apr 3 03:18:41 oleg421-client systemd-logind[1011]: Session 541 logged out. Waiting for processes to exit. Apr 3 03:18:41 oleg421-client systemd-logind[1011]: Removed session 541. Apr 3 03:18:45 oleg421-client sshd[105060]: Accepted publickey for root from 192.168.204.21 port 33790 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:18:45 oleg421-client systemd-logind[1011]: New session 542 of user root. Apr 3 03:18:45 oleg421-client systemd[1]: Started Session 542 of user root. Apr 3 03:18:45 oleg421-client sshd[105060]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:18:46 oleg421-client kernel: Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid Apr 3 03:18:46 oleg421-client sshd[105073]: Received disconnect from 192.168.204.21 port 33790:11: disconnected by user Apr 3 03:18:46 oleg421-client sshd[105073]: Disconnected from user root 192.168.204.21 port 33790 Apr 3 03:18:46 oleg421-client sshd[105060]: pam_unix(sshd:session): session closed for user root Apr 3 03:18:46 oleg421-client systemd[1]: session-542.scope: Succeeded. Apr 3 03:18:46 oleg421-client systemd-logind[1011]: Session 542 logged out. Waiting for processes to exit. Apr 3 03:18:46 oleg421-client systemd-logind[1011]: Removed session 542. Apr 3 03:18:48 oleg421-client sshd[105217]: Accepted publickey for root from 192.168.204.21 port 53290 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:18:48 oleg421-client systemd[1]: Started Session 543 of user root. Apr 3 03:18:48 oleg421-client systemd-logind[1011]: New session 543 of user root. Apr 3 03:18:48 oleg421-client sshd[105217]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:18:48 oleg421-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Apr 3 03:18:48 oleg421-client sshd[105230]: Received disconnect from 192.168.204.21 port 53290:11: disconnected by user Apr 3 03:18:48 oleg421-client sshd[105230]: Disconnected from user root 192.168.204.21 port 53290 Apr 3 03:18:48 oleg421-client sshd[105217]: pam_unix(sshd:session): session closed for user root Apr 3 03:18:49 oleg421-client systemd-logind[1011]: Session 543 logged out. Waiting for processes to exit. Apr 3 03:18:49 oleg421-client systemd[1]: session-543.scope: Succeeded. Apr 3 03:18:49 oleg421-client systemd-logind[1011]: Removed session 543. Apr 3 03:18:50 oleg421-client sshd[105271]: Accepted publickey for root from 192.168.204.21 port 53294 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:18:50 oleg421-client systemd-logind[1011]: New session 544 of user root. Apr 3 03:18:50 oleg421-client systemd[1]: Started Session 544 of user root. Apr 3 03:18:50 oleg421-client sshd[105271]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:18:50 oleg421-client sshd[105284]: Received disconnect from 192.168.204.21 port 53294:11: disconnected by user Apr 3 03:18:50 oleg421-client sshd[105284]: Disconnected from user root 192.168.204.21 port 53294 Apr 3 03:18:51 oleg421-client sshd[105271]: pam_unix(sshd:session): session closed for user root Apr 3 03:18:51 oleg421-client systemd-logind[1011]: Session 544 logged out. Waiting for processes to exit. Apr 3 03:18:51 oleg421-client systemd[1]: session-544.scope: Succeeded. Apr 3 03:18:51 oleg421-client systemd-logind[1011]: Removed session 544. Apr 3 03:19:15 oleg421-client kernel: Lustre: 97609:0:(mgc_request.c:1917:mgc_process_log()) MGC192.168.204.121@tcp: IR log lustre-cliir failed, not fatal: rc = -2 Apr 3 03:19:32 oleg421-client sshd[105596]: Accepted publickey for root from 192.168.204.21 port 39280 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:19:32 oleg421-client systemd-logind[1011]: New session 545 of user root. Apr 3 03:19:32 oleg421-client systemd[1]: Started Session 545 of user root. Apr 3 03:19:32 oleg421-client sshd[105596]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:19:32 oleg421-client sshd[105609]: Received disconnect from 192.168.204.21 port 39280:11: disconnected by user Apr 3 03:19:32 oleg421-client sshd[105609]: Disconnected from user root 192.168.204.21 port 39280 Apr 3 03:19:33 oleg421-client sshd[105596]: pam_unix(sshd:session): session closed for user root Apr 3 03:19:33 oleg421-client systemd[1]: session-545.scope: Succeeded. Apr 3 03:19:33 oleg421-client systemd-logind[1011]: Session 545 logged out. Waiting for processes to exit. Apr 3 03:19:33 oleg421-client systemd-logind[1011]: Removed session 545. Apr 3 03:19:37 oleg421-client sshd[105832]: Accepted publickey for root from 192.168.204.21 port 39294 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:19:37 oleg421-client systemd-logind[1011]: New session 546 of user root. Apr 3 03:19:37 oleg421-client systemd[1]: Started Session 546 of user root. Apr 3 03:19:37 oleg421-client sshd[105832]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:19:37 oleg421-client kernel: Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid Apr 3 03:19:37 oleg421-client sshd[105845]: Received disconnect from 192.168.204.21 port 39294:11: disconnected by user Apr 3 03:19:37 oleg421-client sshd[105845]: Disconnected from user root 192.168.204.21 port 39294 Apr 3 03:19:37 oleg421-client sshd[105832]: pam_unix(sshd:session): session closed for user root Apr 3 03:19:38 oleg421-client systemd[1]: session-546.scope: Succeeded. Apr 3 03:19:38 oleg421-client systemd-logind[1011]: Session 546 logged out. Waiting for processes to exit. Apr 3 03:19:38 oleg421-client systemd-logind[1011]: Removed session 546. Apr 3 03:19:39 oleg421-client sshd[105988]: Accepted publickey for root from 192.168.204.21 port 44728 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:19:39 oleg421-client systemd-logind[1011]: New session 547 of user root. Apr 3 03:19:39 oleg421-client systemd[1]: Started Session 547 of user root. Apr 3 03:19:39 oleg421-client sshd[105988]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:19:39 oleg421-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Apr 3 03:19:39 oleg421-client sshd[106001]: Received disconnect from 192.168.204.21 port 44728:11: disconnected by user Apr 3 03:19:39 oleg421-client sshd[106001]: Disconnected from user root 192.168.204.21 port 44728 Apr 3 03:19:39 oleg421-client sshd[105988]: pam_unix(sshd:session): session closed for user root Apr 3 03:19:39 oleg421-client systemd[1]: session-547.scope: Succeeded. Apr 3 03:19:39 oleg421-client systemd-logind[1011]: Session 547 logged out. Waiting for processes to exit. Apr 3 03:19:39 oleg421-client systemd-logind[1011]: Removed session 547. Apr 3 03:19:41 oleg421-client sshd[106043]: Accepted publickey for root from 192.168.204.21 port 44732 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:19:41 oleg421-client systemd-logind[1011]: New session 548 of user root. Apr 3 03:19:41 oleg421-client systemd[1]: Started Session 548 of user root. Apr 3 03:19:41 oleg421-client sshd[106043]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:19:41 oleg421-client sshd[106056]: Received disconnect from 192.168.204.21 port 44732:11: disconnected by user Apr 3 03:19:41 oleg421-client sshd[106056]: Disconnected from user root 192.168.204.21 port 44732 Apr 3 03:19:41 oleg421-client sshd[106043]: pam_unix(sshd:session): session closed for user root Apr 3 03:19:42 oleg421-client systemd-logind[1011]: Session 548 logged out. Waiting for processes to exit. Apr 3 03:19:42 oleg421-client systemd[1]: session-548.scope: Succeeded. Apr 3 03:19:42 oleg421-client systemd-logind[1011]: Removed session 548. Apr 3 03:19:43 oleg421-client sshd[106176]: Accepted publickey for root from 192.168.204.21 port 44742 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:19:43 oleg421-client systemd-logind[1011]: New session 549 of user root. Apr 3 03:19:43 oleg421-client systemd[1]: Started Session 549 of user root. Apr 3 03:19:43 oleg421-client sshd[106176]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:19:43 oleg421-client sshd[106189]: Received disconnect from 192.168.204.21 port 44742:11: disconnected by user Apr 3 03:19:43 oleg421-client sshd[106189]: Disconnected from user root 192.168.204.21 port 44742 Apr 3 03:19:43 oleg421-client sshd[106176]: pam_unix(sshd:session): session closed for user root Apr 3 03:19:43 oleg421-client systemd[1]: session-549.scope: Succeeded. Apr 3 03:19:43 oleg421-client systemd-logind[1011]: Session 549 logged out. Waiting for processes to exit. Apr 3 03:19:43 oleg421-client systemd-logind[1011]: Removed session 549. Apr 3 03:19:44 oleg421-client sshd[106316]: Accepted publickey for root from 192.168.204.21 port 44756 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:19:45 oleg421-client systemd[1]: Started Session 550 of user root. Apr 3 03:19:45 oleg421-client systemd-logind[1011]: New session 550 of user root. Apr 3 03:19:45 oleg421-client sshd[106316]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:19:45 oleg421-client sshd[106329]: Received disconnect from 192.168.204.21 port 44756:11: disconnected by user Apr 3 03:19:45 oleg421-client sshd[106329]: Disconnected from user root 192.168.204.21 port 44756 Apr 3 03:19:45 oleg421-client sshd[106316]: pam_unix(sshd:session): session closed for user root Apr 3 03:19:45 oleg421-client systemd[1]: session-550.scope: Succeeded. Apr 3 03:19:45 oleg421-client systemd-logind[1011]: Session 550 logged out. Waiting for processes to exit. Apr 3 03:19:45 oleg421-client systemd-logind[1011]: Removed session 550. Apr 3 03:19:46 oleg421-client sshd[106463]: Accepted publickey for root from 192.168.204.21 port 44772 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:19:47 oleg421-client systemd-logind[1011]: New session 551 of user root. Apr 3 03:19:47 oleg421-client systemd[1]: Started Session 551 of user root. Apr 3 03:19:47 oleg421-client sshd[106463]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:19:47 oleg421-client sshd[106476]: Received disconnect from 192.168.204.21 port 44772:11: disconnected by user Apr 3 03:19:47 oleg421-client sshd[106476]: Disconnected from user root 192.168.204.21 port 44772 Apr 3 03:19:47 oleg421-client sshd[106463]: pam_unix(sshd:session): session closed for user root Apr 3 03:19:47 oleg421-client systemd[1]: session-551.scope: Succeeded. Apr 3 03:19:47 oleg421-client systemd-logind[1011]: Session 551 logged out. Waiting for processes to exit. Apr 3 03:19:47 oleg421-client systemd-logind[1011]: Removed session 551. Apr 3 03:21:22 oleg421-client sshd[106667]: Accepted publickey for root from 192.168.204.21 port 45676 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:21:22 oleg421-client systemd-logind[1011]: New session 552 of user root. Apr 3 03:21:22 oleg421-client systemd[1]: Started Session 552 of user root. Apr 3 03:21:22 oleg421-client sshd[106667]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:21:22 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 144b: orphan cleanup shouldn't be blocked for no objects+failover situation ========================================================== 03:21:21 (1775200881) Apr 3 03:21:22 oleg421-client sshd[106680]: Received disconnect from 192.168.204.21 port 45676:11: disconnected by user Apr 3 03:21:22 oleg421-client sshd[106680]: Disconnected from user root 192.168.204.21 port 45676 Apr 3 03:21:22 oleg421-client sshd[106667]: pam_unix(sshd:session): session closed for user root Apr 3 03:21:23 oleg421-client systemd[1]: session-552.scope: Succeeded. Apr 3 03:21:23 oleg421-client systemd-logind[1011]: Session 552 logged out. Waiting for processes to exit. Apr 3 03:21:23 oleg421-client systemd-logind[1011]: Removed session 552. Apr 3 03:21:44 oleg421-client kernel: LustreError: lustre-OST0000-osc-ffff962450e3f000: operation ost_setattr to node 192.168.204.121@tcp failed: rc = -107 Apr 3 03:21:44 oleg421-client kernel: LustreError: Skipped 39 previous similar messages Apr 3 03:21:44 oleg421-client kernel: Lustre: lustre-OST0000-osc-ffff962450e3f000: Connection to lustre-OST0000 (at 192.168.204.121@tcp) was lost; in progress operations using this service will wait for recovery to complete Apr 3 03:21:44 oleg421-client kernel: Lustre: Skipped 7 previous similar messages Apr 3 03:22:35 oleg421-client sshd[107143]: Accepted publickey for root from 192.168.204.21 port 58680 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:22:35 oleg421-client systemd-logind[1011]: New session 553 of user root. Apr 3 03:22:35 oleg421-client systemd[1]: Started Session 553 of user root. Apr 3 03:22:35 oleg421-client sshd[107143]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:22:36 oleg421-client sshd[107156]: Received disconnect from 192.168.204.21 port 58680:11: disconnected by user Apr 3 03:22:36 oleg421-client sshd[107156]: Disconnected from user root 192.168.204.21 port 58680 Apr 3 03:22:36 oleg421-client sshd[107143]: pam_unix(sshd:session): session closed for user root Apr 3 03:22:36 oleg421-client systemd[1]: session-553.scope: Succeeded. Apr 3 03:22:36 oleg421-client systemd-logind[1011]: Session 553 logged out. Waiting for processes to exit. Apr 3 03:22:36 oleg421-client systemd-logind[1011]: Removed session 553. Apr 3 03:22:42 oleg421-client sshd[107380]: Accepted publickey for root from 192.168.204.21 port 59016 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:22:42 oleg421-client systemd[1]: Started Session 554 of user root. Apr 3 03:22:42 oleg421-client systemd-logind[1011]: New session 554 of user root. Apr 3 03:22:42 oleg421-client sshd[107380]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:22:43 oleg421-client kernel: Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid Apr 3 03:22:43 oleg421-client sshd[107393]: Received disconnect from 192.168.204.21 port 59016:11: disconnected by user Apr 3 03:22:43 oleg421-client sshd[107393]: Disconnected from user root 192.168.204.21 port 59016 Apr 3 03:22:43 oleg421-client sshd[107380]: pam_unix(sshd:session): session closed for user root Apr 3 03:22:43 oleg421-client systemd[1]: session-554.scope: Succeeded. Apr 3 03:22:43 oleg421-client systemd-logind[1011]: Session 554 logged out. Waiting for processes to exit. Apr 3 03:22:43 oleg421-client systemd-logind[1011]: Removed session 554. Apr 3 03:22:47 oleg421-client sshd[107537]: Accepted publickey for root from 192.168.204.21 port 50850 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:22:47 oleg421-client systemd[1]: Started Session 555 of user root. Apr 3 03:22:47 oleg421-client systemd-logind[1011]: New session 555 of user root. Apr 3 03:22:47 oleg421-client sshd[107537]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:22:48 oleg421-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec Apr 3 03:22:48 oleg421-client sshd[107550]: Received disconnect from 192.168.204.21 port 50850:11: disconnected by user Apr 3 03:22:48 oleg421-client sshd[107550]: Disconnected from user root 192.168.204.21 port 50850 Apr 3 03:22:48 oleg421-client sshd[107537]: pam_unix(sshd:session): session closed for user root Apr 3 03:22:48 oleg421-client systemd[1]: session-555.scope: Succeeded. Apr 3 03:22:48 oleg421-client systemd-logind[1011]: Session 555 logged out. Waiting for processes to exit. Apr 3 03:22:48 oleg421-client systemd-logind[1011]: Removed session 555. Apr 3 03:22:51 oleg421-client sshd[107591]: Accepted publickey for root from 192.168.204.21 port 50858 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:22:51 oleg421-client systemd[1]: Started Session 556 of user root. Apr 3 03:22:51 oleg421-client systemd-logind[1011]: New session 556 of user root. Apr 3 03:22:51 oleg421-client sshd[107591]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:22:53 oleg421-client sshd[107605]: Received disconnect from 192.168.204.21 port 50858:11: disconnected by user Apr 3 03:22:53 oleg421-client sshd[107605]: Disconnected from user root 192.168.204.21 port 50858 Apr 3 03:22:53 oleg421-client sshd[107591]: pam_unix(sshd:session): session closed for user root Apr 3 03:22:53 oleg421-client systemd[1]: session-556.scope: Succeeded. Apr 3 03:22:53 oleg421-client systemd-logind[1011]: Session 556 logged out. Waiting for processes to exit. Apr 3 03:22:53 oleg421-client systemd-logind[1011]: Removed session 556. Apr 3 03:23:57 oleg421-client sshd[107784]: Accepted publickey for root from 192.168.204.21 port 59894 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:23:57 oleg421-client systemd[1]: Started Session 557 of user root. Apr 3 03:23:57 oleg421-client systemd-logind[1011]: New session 557 of user root. Apr 3 03:23:57 oleg421-client sshd[107784]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:23:58 oleg421-client sshd[107797]: Received disconnect from 192.168.204.21 port 59894:11: disconnected by user Apr 3 03:23:58 oleg421-client sshd[107797]: Disconnected from user root 192.168.204.21 port 59894 Apr 3 03:23:58 oleg421-client sshd[107784]: pam_unix(sshd:session): session closed for user root Apr 3 03:23:58 oleg421-client systemd-logind[1011]: Session 557 logged out. Waiting for processes to exit. Apr 3 03:23:58 oleg421-client systemd[1]: session-557.scope: Succeeded. Apr 3 03:23:58 oleg421-client systemd-logind[1011]: Removed session 557. Apr 3 03:24:00 oleg421-client sshd[107923]: Accepted publickey for root from 192.168.204.21 port 59896 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:24:00 oleg421-client systemd[1]: Started Session 558 of user root. Apr 3 03:24:00 oleg421-client systemd-logind[1011]: New session 558 of user root. Apr 3 03:24:00 oleg421-client sshd[107923]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:24:01 oleg421-client sshd[107936]: Received disconnect from 192.168.204.21 port 59896:11: disconnected by user Apr 3 03:24:01 oleg421-client sshd[107936]: Disconnected from user root 192.168.204.21 port 59896 Apr 3 03:24:01 oleg421-client sshd[107923]: pam_unix(sshd:session): session closed for user root Apr 3 03:24:01 oleg421-client systemd-logind[1011]: Session 558 logged out. Waiting for processes to exit. Apr 3 03:24:01 oleg421-client systemd[1]: session-558.scope: Succeeded. Apr 3 03:24:01 oleg421-client systemd-logind[1011]: Removed session 558. Apr 3 03:24:02 oleg421-client sshd[108069]: Accepted publickey for root from 192.168.204.21 port 59912 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:24:02 oleg421-client rsyslogd[1073]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Apr 3 03:24:02 oleg421-client rsyslogd[1073]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Apr 3 03:24:02 oleg421-client systemd-logind[1011]: New session 559 of user root. Apr 3 03:24:02 oleg421-client systemd[1]: Started Session 559 of user root. Apr 3 03:24:02 oleg421-client sshd[108069]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:24:03 oleg421-client sshd[108083]: Received disconnect from 192.168.204.21 port 59912:11: disconnected by user Apr 3 03:24:03 oleg421-client sshd[108083]: Disconnected from user root 192.168.204.21 port 59912 Apr 3 03:24:03 oleg421-client sshd[108069]: pam_unix(sshd:session): session closed for user root Apr 3 03:24:03 oleg421-client systemd[1]: session-559.scope: Succeeded. Apr 3 03:24:03 oleg421-client systemd-logind[1011]: Session 559 logged out. Waiting for processes to exit. Apr 3 03:24:03 oleg421-client systemd-logind[1011]: Removed session 559. Apr 3 03:25:27 oleg421-client sshd[108273]: Accepted publickey for root from 192.168.204.21 port 56106 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:25:27 oleg421-client systemd[1]: Started Session 560 of user root. Apr 3 03:25:27 oleg421-client systemd-logind[1011]: New session 560 of user root. Apr 3 03:25:27 oleg421-client sshd[108273]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:25:27 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 144c: reconnection during orphan cleanup shouldn't lose LAST_ID synchronization ========================================================== 03:25:25 (1775201125) Apr 3 03:25:27 oleg421-client sshd[108286]: Received disconnect from 192.168.204.21 port 56106:11: disconnected by user Apr 3 03:25:27 oleg421-client sshd[108286]: Disconnected from user root 192.168.204.21 port 56106 Apr 3 03:25:27 oleg421-client sshd[108273]: pam_unix(sshd:session): session closed for user root Apr 3 03:25:27 oleg421-client systemd-logind[1011]: Session 560 logged out. Waiting for processes to exit. Apr 3 03:25:27 oleg421-client systemd[1]: session-560.scope: Succeeded. Apr 3 03:25:27 oleg421-client systemd-logind[1011]: Removed session 560. Apr 3 03:25:37 oleg421-client sshd[108468]: Accepted publickey for root from 192.168.204.21 port 33732 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:25:37 oleg421-client systemd-logind[1011]: New session 561 of user root. Apr 3 03:25:37 oleg421-client systemd[1]: Started Session 561 of user root. Apr 3 03:25:37 oleg421-client sshd[108468]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:25:37 oleg421-client sshd[108481]: Received disconnect from 192.168.204.21 port 33732:11: disconnected by user Apr 3 03:25:37 oleg421-client sshd[108481]: Disconnected from user root 192.168.204.21 port 33732 Apr 3 03:25:37 oleg421-client sshd[108468]: pam_unix(sshd:session): session closed for user root Apr 3 03:25:38 oleg421-client systemd-logind[1011]: Session 561 logged out. Waiting for processes to exit. Apr 3 03:25:38 oleg421-client systemd[1]: session-561.scope: Succeeded. Apr 3 03:25:38 oleg421-client systemd-logind[1011]: Removed session 561. Apr 3 03:28:01 oleg421-client kernel: LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 192.168.204.121@tcp) was lost; in progress operations using this service will fail Apr 3 03:28:01 oleg421-client kernel: LustreError: Skipped 5 previous similar messages Apr 3 03:28:01 oleg421-client kernel: Lustre: Evicted from MGS (at 192.168.204.121@tcp) after server handle changed from 0x1d1756950d142dbd to 0x1d1756950d23d2e3 Apr 3 03:28:01 oleg421-client kernel: Lustre: Skipped 5 previous similar messages Apr 3 03:28:01 oleg421-client kernel: Lustre: MGC192.168.204.121@tcp: Connection restored to 192.168.204.121@tcp (at 192.168.204.121@tcp) Apr 3 03:28:01 oleg421-client kernel: Lustre: Skipped 11 previous similar messages Apr 3 03:28:27 oleg421-client sshd[108991]: Accepted publickey for root from 192.168.204.21 port 45336 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:28:28 oleg421-client systemd[1]: Started Session 562 of user root. Apr 3 03:28:28 oleg421-client systemd-logind[1011]: New session 562 of user root. Apr 3 03:28:28 oleg421-client sshd[108991]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:28:28 oleg421-client sshd[109004]: Received disconnect from 192.168.204.21 port 45336:11: disconnected by user Apr 3 03:28:28 oleg421-client sshd[109004]: Disconnected from user root 192.168.204.21 port 45336 Apr 3 03:28:28 oleg421-client sshd[108991]: pam_unix(sshd:session): session closed for user root Apr 3 03:28:28 oleg421-client systemd-logind[1011]: Session 562 logged out. Waiting for processes to exit. Apr 3 03:28:28 oleg421-client systemd[1]: session-562.scope: Succeeded. Apr 3 03:28:28 oleg421-client systemd-logind[1011]: Removed session 562. Apr 3 03:28:30 oleg421-client sshd[109130]: Accepted publickey for root from 192.168.204.21 port 45346 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:28:30 oleg421-client systemd[1]: Started Session 563 of user root. Apr 3 03:28:30 oleg421-client systemd-logind[1011]: New session 563 of user root. Apr 3 03:28:30 oleg421-client sshd[109130]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:28:30 oleg421-client sshd[109143]: Received disconnect from 192.168.204.21 port 45346:11: disconnected by user Apr 3 03:28:30 oleg421-client sshd[109143]: Disconnected from user root 192.168.204.21 port 45346 Apr 3 03:28:30 oleg421-client sshd[109130]: pam_unix(sshd:session): session closed for user root Apr 3 03:28:30 oleg421-client systemd-logind[1011]: Session 563 logged out. Waiting for processes to exit. Apr 3 03:28:30 oleg421-client systemd[1]: session-563.scope: Succeeded. Apr 3 03:28:30 oleg421-client systemd-logind[1011]: Removed session 563. Apr 3 03:28:31 oleg421-client sshd[109276]: Accepted publickey for root from 192.168.204.21 port 45350 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:28:31 oleg421-client systemd-logind[1011]: New session 564 of user root. Apr 3 03:28:31 oleg421-client systemd[1]: Started Session 564 of user root. Apr 3 03:28:31 oleg421-client sshd[109276]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:28:32 oleg421-client sshd[109289]: Received disconnect from 192.168.204.21 port 45350:11: disconnected by user Apr 3 03:28:32 oleg421-client sshd[109289]: Disconnected from user root 192.168.204.21 port 45350 Apr 3 03:28:32 oleg421-client sshd[109276]: pam_unix(sshd:session): session closed for user root Apr 3 03:28:32 oleg421-client systemd[1]: session-564.scope: Succeeded. Apr 3 03:28:32 oleg421-client systemd-logind[1011]: Session 564 logged out. Waiting for processes to exit. Apr 3 03:28:32 oleg421-client systemd-logind[1011]: Removed session 564. Apr 3 03:28:34 oleg421-client sshd[109432]: Accepted publickey for root from 192.168.204.21 port 45366 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:28:34 oleg421-client systemd-logind[1011]: New session 565 of user root. Apr 3 03:28:34 oleg421-client systemd[1]: Started Session 565 of user root. Apr 3 03:28:34 oleg421-client sshd[109432]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:28:34 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 145: connect mdtlovs and process update logs after recovery expire ========================================================== 03:28:32 (1775201312) Apr 3 03:28:34 oleg421-client sshd[109445]: Received disconnect from 192.168.204.21 port 45366:11: disconnected by user Apr 3 03:28:34 oleg421-client sshd[109445]: Disconnected from user root 192.168.204.21 port 45366 Apr 3 03:28:34 oleg421-client sshd[109432]: pam_unix(sshd:session): session closed for user root Apr 3 03:28:34 oleg421-client systemd[1]: session-565.scope: Succeeded. Apr 3 03:28:34 oleg421-client systemd-logind[1011]: Session 565 logged out. Waiting for processes to exit. Apr 3 03:28:34 oleg421-client systemd-logind[1011]: Removed session 565. Apr 3 03:28:35 oleg421-client sshd[109570]: Accepted publickey for root from 192.168.204.21 port 45372 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:28:35 oleg421-client systemd-logind[1011]: New session 566 of user root. Apr 3 03:28:35 oleg421-client systemd[1]: Started Session 566 of user root. Apr 3 03:28:35 oleg421-client sshd[109570]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:28:36 oleg421-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_145 needs >= 3 MDTs Apr 3 03:28:36 oleg421-client sshd[109583]: Received disconnect from 192.168.204.21 port 45372:11: disconnected by user Apr 3 03:28:36 oleg421-client sshd[109583]: Disconnected from user root 192.168.204.21 port 45372 Apr 3 03:28:36 oleg421-client sshd[109570]: pam_unix(sshd:session): session closed for user root Apr 3 03:28:36 oleg421-client systemd-logind[1011]: Session 566 logged out. Waiting for processes to exit. Apr 3 03:28:36 oleg421-client systemd[1]: session-566.scope: Succeeded. Apr 3 03:28:36 oleg421-client systemd-logind[1011]: Removed session 566. Apr 3 03:28:37 oleg421-client sshd[109725]: Accepted publickey for root from 192.168.204.21 port 41560 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:28:37 oleg421-client systemd-logind[1011]: New session 567 of user root. Apr 3 03:28:37 oleg421-client systemd[1]: Started Session 567 of user root. Apr 3 03:28:37 oleg421-client sshd[109725]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:28:38 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 146: test eviction is counted properly ========================================================== 03:28:36 (1775201316) Apr 3 03:28:38 oleg421-client sshd[109738]: Received disconnect from 192.168.204.21 port 41560:11: disconnected by user Apr 3 03:28:38 oleg421-client sshd[109738]: Disconnected from user root 192.168.204.21 port 41560 Apr 3 03:28:38 oleg421-client sshd[109725]: pam_unix(sshd:session): session closed for user root Apr 3 03:28:38 oleg421-client systemd-logind[1011]: Session 567 logged out. Waiting for processes to exit. Apr 3 03:28:38 oleg421-client systemd[1]: session-567.scope: Succeeded. Apr 3 03:28:38 oleg421-client systemd-logind[1011]: Removed session 567. Apr 3 03:28:40 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962450e3f000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Apr 3 03:28:42 oleg421-client sshd[109904]: Accepted publickey for root from 192.168.204.21 port 41564 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:28:43 oleg421-client systemd-logind[1011]: New session 568 of user root. Apr 3 03:28:43 oleg421-client systemd[1]: Started Session 568 of user root. Apr 3 03:28:43 oleg421-client sshd[109904]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:28:43 oleg421-client sshd[109917]: Received disconnect from 192.168.204.21 port 41564:11: disconnected by user Apr 3 03:28:43 oleg421-client sshd[109917]: Disconnected from user root 192.168.204.21 port 41564 Apr 3 03:28:43 oleg421-client sshd[109904]: pam_unix(sshd:session): session closed for user root Apr 3 03:28:43 oleg421-client systemd-logind[1011]: Session 568 logged out. Waiting for processes to exit. Apr 3 03:28:43 oleg421-client systemd[1]: session-568.scope: Succeeded. Apr 3 03:28:43 oleg421-client systemd-logind[1011]: Removed session 568. Apr 3 03:28:44 oleg421-client sshd[110043]: Accepted publickey for root from 192.168.204.21 port 41578 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:28:44 oleg421-client systemd[1]: Started Session 569 of user root. Apr 3 03:28:44 oleg421-client systemd-logind[1011]: New session 569 of user root. Apr 3 03:28:44 oleg421-client sshd[110043]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:28:45 oleg421-client sshd[110057]: Received disconnect from 192.168.204.21 port 41578:11: disconnected by user Apr 3 03:28:45 oleg421-client sshd[110057]: Disconnected from user root 192.168.204.21 port 41578 Apr 3 03:28:45 oleg421-client sshd[110043]: pam_unix(sshd:session): session closed for user root Apr 3 03:28:45 oleg421-client systemd[1]: session-569.scope: Succeeded. Apr 3 03:28:45 oleg421-client systemd-logind[1011]: Session 569 logged out. Waiting for processes to exit. Apr 3 03:28:45 oleg421-client systemd-logind[1011]: Removed session 569. Apr 3 03:28:46 oleg421-client sshd[110190]: Accepted publickey for root from 192.168.204.21 port 41592 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:28:46 oleg421-client systemd-logind[1011]: New session 570 of user root. Apr 3 03:28:46 oleg421-client systemd[1]: Started Session 570 of user root. Apr 3 03:28:46 oleg421-client sshd[110190]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:28:47 oleg421-client sshd[110203]: Received disconnect from 192.168.204.21 port 41592:11: disconnected by user Apr 3 03:28:47 oleg421-client sshd[110203]: Disconnected from user root 192.168.204.21 port 41592 Apr 3 03:28:47 oleg421-client sshd[110190]: pam_unix(sshd:session): session closed for user root Apr 3 03:28:47 oleg421-client systemd-logind[1011]: Session 570 logged out. Waiting for processes to exit. Apr 3 03:28:47 oleg421-client systemd[1]: session-570.scope: Succeeded. Apr 3 03:28:47 oleg421-client systemd-logind[1011]: Removed session 570. Apr 3 03:28:49 oleg421-client sshd[110345]: Accepted publickey for root from 192.168.204.21 port 47220 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:28:49 oleg421-client systemd-logind[1011]: New session 571 of user root. Apr 3 03:28:49 oleg421-client systemd[1]: Started Session 571 of user root. Apr 3 03:28:49 oleg421-client sshd[110345]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:28:49 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 147: Check client reconnect ======= 03:28:47 (1775201327) Apr 3 03:28:49 oleg421-client sshd[110358]: Received disconnect from 192.168.204.21 port 47220:11: disconnected by user Apr 3 03:28:49 oleg421-client sshd[110358]: Disconnected from user root 192.168.204.21 port 47220 Apr 3 03:28:49 oleg421-client sshd[110345]: pam_unix(sshd:session): session closed for user root Apr 3 03:28:49 oleg421-client systemd-logind[1011]: Session 571 logged out. Waiting for processes to exit. Apr 3 03:28:49 oleg421-client systemd[1]: session-571.scope: Succeeded. Apr 3 03:28:49 oleg421-client systemd-logind[1011]: Removed session 571. Apr 3 03:29:01 oleg421-client anacron[43564]: Job `cron.monthly' started Apr 3 03:29:01 oleg421-client anacron[43564]: Job `cron.monthly' terminated Apr 3 03:29:01 oleg421-client anacron[43564]: Normal exit (3 jobs run) Apr 3 03:31:23 oleg421-client sshd[110539]: Accepted publickey for root from 192.168.204.21 port 57852 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:31:23 oleg421-client systemd-logind[1011]: New session 572 of user root. Apr 3 03:31:23 oleg421-client systemd[1]: Started Session 572 of user root. Apr 3 03:31:23 oleg421-client sshd[110539]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:31:23 oleg421-client sshd[110552]: Received disconnect from 192.168.204.21 port 57852:11: disconnected by user Apr 3 03:31:23 oleg421-client sshd[110552]: Disconnected from user root 192.168.204.21 port 57852 Apr 3 03:31:23 oleg421-client sshd[110539]: pam_unix(sshd:session): session closed for user root Apr 3 03:31:23 oleg421-client systemd[1]: session-572.scope: Succeeded. Apr 3 03:31:23 oleg421-client systemd-logind[1011]: Session 572 logged out. Waiting for processes to exit. Apr 3 03:31:23 oleg421-client systemd-logind[1011]: Removed session 572. Apr 3 03:31:25 oleg421-client sshd[110680]: Accepted publickey for root from 192.168.204.21 port 57862 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:31:25 oleg421-client systemd-logind[1011]: New session 573 of user root. Apr 3 03:31:25 oleg421-client systemd[1]: Started Session 573 of user root. Apr 3 03:31:25 oleg421-client sshd[110680]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:31:25 oleg421-client sshd[110693]: Received disconnect from 192.168.204.21 port 57862:11: disconnected by user Apr 3 03:31:25 oleg421-client sshd[110693]: Disconnected from user root 192.168.204.21 port 57862 Apr 3 03:31:25 oleg421-client sshd[110680]: pam_unix(sshd:session): session closed for user root Apr 3 03:31:25 oleg421-client systemd[1]: session-573.scope: Succeeded. Apr 3 03:31:25 oleg421-client systemd-logind[1011]: Session 573 logged out. Waiting for processes to exit. Apr 3 03:31:25 oleg421-client systemd-logind[1011]: Removed session 573. Apr 3 03:31:26 oleg421-client sshd[110826]: Accepted publickey for root from 192.168.204.21 port 57868 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:31:26 oleg421-client systemd-logind[1011]: New session 574 of user root. Apr 3 03:31:26 oleg421-client systemd[1]: Started Session 574 of user root. Apr 3 03:31:26 oleg421-client sshd[110826]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:31:26 oleg421-client sshd[110839]: Received disconnect from 192.168.204.21 port 57868:11: disconnected by user Apr 3 03:31:27 oleg421-client sshd[110839]: Disconnected from user root 192.168.204.21 port 57868 Apr 3 03:31:27 oleg421-client sshd[110826]: pam_unix(sshd:session): session closed for user root Apr 3 03:31:27 oleg421-client systemd[1]: session-574.scope: Succeeded. Apr 3 03:31:27 oleg421-client systemd-logind[1011]: Session 574 logged out. Waiting for processes to exit. Apr 3 03:31:27 oleg421-client systemd-logind[1011]: Removed session 574. Apr 3 03:31:37 oleg421-client kernel: LustreError: lustre-OST0000-osc-ffff962450e3f000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Apr 3 03:31:39 oleg421-client sshd[111004]: Accepted publickey for root from 192.168.204.21 port 49132 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:31:39 oleg421-client systemd-logind[1011]: New session 575 of user root. Apr 3 03:31:39 oleg421-client systemd[1]: Started Session 575 of user root. Apr 3 03:31:39 oleg421-client sshd[111004]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:31:39 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 148: data corruption through resend ========================================================== 03:31:37 (1775201497) Apr 3 03:31:39 oleg421-client sshd[111017]: Received disconnect from 192.168.204.21 port 49132:11: disconnected by user Apr 3 03:31:39 oleg421-client sshd[111017]: Disconnected from user root 192.168.204.21 port 49132 Apr 3 03:31:39 oleg421-client sshd[111004]: pam_unix(sshd:session): session closed for user root Apr 3 03:31:39 oleg421-client systemd-logind[1011]: Session 575 logged out. Waiting for processes to exit. Apr 3 03:31:39 oleg421-client systemd[1]: session-575.scope: Succeeded. Apr 3 03:31:39 oleg421-client systemd-logind[1011]: Removed session 575. Apr 3 03:32:08 oleg421-client kernel: Lustre: 2403:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775201508/real 1775201508] req@ffff9624481f1880 x1861425411643776/t0(0) o4->lustre-OST0000-osc-ffff962450e3f000@192.168.204.121@tcp:6/4 lens 4584/448 e 0 to 1 dl 1775201528 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 Apr 3 03:32:08 oleg421-client kernel: Lustre: 2403:0:(client.c:2479:ptlrpc_expire_one_request()) Skipped 2 previous similar messages Apr 3 03:32:08 oleg421-client kernel: Lustre: lustre-OST0000-osc-ffff962450e3f000: Connection to lustre-OST0000 (at 192.168.204.121@tcp) was lost; in progress operations using this service will wait for recovery to complete Apr 3 03:32:08 oleg421-client kernel: Lustre: Skipped 3 previous similar messages Apr 3 03:32:24 oleg421-client sshd[111397]: Accepted publickey for root from 192.168.204.21 port 51274 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:32:24 oleg421-client systemd[1]: Started Session 576 of user root. Apr 3 03:32:24 oleg421-client systemd-logind[1011]: New session 576 of user root. Apr 3 03:32:24 oleg421-client sshd[111397]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:32:25 oleg421-client sshd[111410]: Received disconnect from 192.168.204.21 port 51274:11: disconnected by user Apr 3 03:32:25 oleg421-client sshd[111410]: Disconnected from user root 192.168.204.21 port 51274 Apr 3 03:32:25 oleg421-client sshd[111397]: pam_unix(sshd:session): session closed for user root Apr 3 03:32:25 oleg421-client systemd-logind[1011]: Session 576 logged out. Waiting for processes to exit. Apr 3 03:32:25 oleg421-client systemd[1]: session-576.scope: Succeeded. Apr 3 03:32:25 oleg421-client systemd-logind[1011]: Removed session 576. Apr 3 03:32:27 oleg421-client sshd[111536]: Accepted publickey for root from 192.168.204.21 port 51276 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:32:27 oleg421-client systemd-logind[1011]: New session 577 of user root. Apr 3 03:32:27 oleg421-client systemd[1]: Started Session 577 of user root. Apr 3 03:32:27 oleg421-client sshd[111536]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:32:27 oleg421-client sshd[111549]: Received disconnect from 192.168.204.21 port 51276:11: disconnected by user Apr 3 03:32:27 oleg421-client sshd[111549]: Disconnected from user root 192.168.204.21 port 51276 Apr 3 03:32:27 oleg421-client sshd[111536]: pam_unix(sshd:session): session closed for user root Apr 3 03:32:28 oleg421-client systemd[1]: session-577.scope: Succeeded. Apr 3 03:32:28 oleg421-client systemd-logind[1011]: Session 577 logged out. Waiting for processes to exit. Apr 3 03:32:28 oleg421-client systemd-logind[1011]: Removed session 577. Apr 3 03:32:29 oleg421-client sshd[111682]: Accepted publickey for root from 192.168.204.21 port 50288 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:32:29 oleg421-client systemd-logind[1011]: New session 578 of user root. Apr 3 03:32:29 oleg421-client systemd[1]: Started Session 578 of user root. Apr 3 03:32:29 oleg421-client sshd[111682]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:32:30 oleg421-client sshd[111695]: Received disconnect from 192.168.204.21 port 50288:11: disconnected by user Apr 3 03:32:30 oleg421-client sshd[111695]: Disconnected from user root 192.168.204.21 port 50288 Apr 3 03:32:30 oleg421-client sshd[111682]: pam_unix(sshd:session): session closed for user root Apr 3 03:32:30 oleg421-client systemd-logind[1011]: Session 578 logged out. Waiting for processes to exit. Apr 3 03:32:30 oleg421-client systemd[1]: session-578.scope: Succeeded. Apr 3 03:32:30 oleg421-client systemd-logind[1011]: Removed session 578. Apr 3 03:32:31 oleg421-client sshd[111839]: Accepted publickey for root from 192.168.204.21 port 50290 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:32:31 oleg421-client systemd[1]: Started Session 579 of user root. Apr 3 03:32:31 oleg421-client systemd-logind[1011]: New session 579 of user root. Apr 3 03:32:31 oleg421-client sshd[111839]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:32:32 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 149: skip orphan removal at umount ========================================================== 03:32:30 (1775201550) Apr 3 03:32:32 oleg421-client sshd[111852]: Received disconnect from 192.168.204.21 port 50290:11: disconnected by user Apr 3 03:32:32 oleg421-client sshd[111852]: Disconnected from user root 192.168.204.21 port 50290 Apr 3 03:32:32 oleg421-client sshd[111839]: pam_unix(sshd:session): session closed for user root Apr 3 03:32:32 oleg421-client systemd-logind[1011]: Session 579 logged out. Waiting for processes to exit. Apr 3 03:32:32 oleg421-client systemd[1]: session-579.scope: Succeeded. Apr 3 03:32:32 oleg421-client systemd-logind[1011]: Removed session 579. Apr 3 03:33:19 oleg421-client kernel: LustreError: lustre-MDT0001-mdc-ffff962450e3f000: This client was evicted by lustre-MDT0001; in progress operations using this service will fail. Apr 3 03:33:24 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962450e3f000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Apr 3 03:33:27 oleg421-client sshd[112356]: Accepted publickey for root from 192.168.204.21 port 54364 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:33:27 oleg421-client systemd-logind[1011]: New session 580 of user root. Apr 3 03:33:27 oleg421-client systemd[1]: Started Session 580 of user root. Apr 3 03:33:27 oleg421-client sshd[112356]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:33:28 oleg421-client sshd[112369]: Received disconnect from 192.168.204.21 port 54364:11: disconnected by user Apr 3 03:33:28 oleg421-client sshd[112369]: Disconnected from user root 192.168.204.21 port 54364 Apr 3 03:33:28 oleg421-client sshd[112356]: pam_unix(sshd:session): session closed for user root Apr 3 03:33:28 oleg421-client systemd[1]: session-580.scope: Succeeded. Apr 3 03:33:28 oleg421-client systemd-logind[1011]: Session 580 logged out. Waiting for processes to exit. Apr 3 03:33:28 oleg421-client systemd-logind[1011]: Removed session 580. Apr 3 03:33:29 oleg421-client sshd[112488]: Accepted publickey for root from 192.168.204.21 port 54370 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:33:29 oleg421-client systemd[1]: Started Session 581 of user root. Apr 3 03:33:29 oleg421-client systemd-logind[1011]: New session 581 of user root. Apr 3 03:33:29 oleg421-client sshd[112488]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:33:29 oleg421-client sshd[112501]: Received disconnect from 192.168.204.21 port 54370:11: disconnected by user Apr 3 03:33:29 oleg421-client sshd[112501]: Disconnected from user root 192.168.204.21 port 54370 Apr 3 03:33:29 oleg421-client sshd[112488]: pam_unix(sshd:session): session closed for user root Apr 3 03:33:29 oleg421-client systemd-logind[1011]: Session 581 logged out. Waiting for processes to exit. Apr 3 03:33:29 oleg421-client systemd[1]: session-581.scope: Succeeded. Apr 3 03:33:29 oleg421-client systemd-logind[1011]: Removed session 581. Apr 3 03:33:31 oleg421-client sshd[112627]: Accepted publickey for root from 192.168.204.21 port 54376 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:33:31 oleg421-client systemd[1]: Started Session 582 of user root. Apr 3 03:33:31 oleg421-client systemd-logind[1011]: New session 582 of user root. Apr 3 03:33:31 oleg421-client sshd[112627]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:33:31 oleg421-client sshd[112640]: Received disconnect from 192.168.204.21 port 54376:11: disconnected by user Apr 3 03:33:31 oleg421-client sshd[112640]: Disconnected from user root 192.168.204.21 port 54376 Apr 3 03:33:31 oleg421-client sshd[112627]: pam_unix(sshd:session): session closed for user root Apr 3 03:33:31 oleg421-client systemd[1]: session-582.scope: Succeeded. Apr 3 03:33:31 oleg421-client systemd-logind[1011]: Session 582 logged out. Waiting for processes to exit. Apr 3 03:33:31 oleg421-client systemd-logind[1011]: Removed session 582. Apr 3 03:33:32 oleg421-client sshd[112775]: Accepted publickey for root from 192.168.204.21 port 54388 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:33:32 oleg421-client systemd-logind[1011]: New session 583 of user root. Apr 3 03:33:32 oleg421-client systemd[1]: Started Session 583 of user root. Apr 3 03:33:32 oleg421-client sshd[112775]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:33:33 oleg421-client sshd[112788]: Received disconnect from 192.168.204.21 port 54388:11: disconnected by user Apr 3 03:33:33 oleg421-client sshd[112788]: Disconnected from user root 192.168.204.21 port 54388 Apr 3 03:33:33 oleg421-client sshd[112775]: pam_unix(sshd:session): session closed for user root Apr 3 03:33:33 oleg421-client systemd[1]: session-583.scope: Succeeded. Apr 3 03:33:33 oleg421-client systemd-logind[1011]: Session 583 logged out. Waiting for processes to exit. Apr 3 03:33:33 oleg421-client systemd-logind[1011]: Removed session 583. Apr 3 03:33:34 oleg421-client sshd[112930]: Accepted publickey for root from 192.168.204.21 port 54400 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:33:34 oleg421-client systemd-logind[1011]: New session 584 of user root. Apr 3 03:33:34 oleg421-client systemd[1]: Started Session 584 of user root. Apr 3 03:33:34 oleg421-client sshd[112930]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:33:35 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 150: statfs when MDT0 offline with lazystatfs option ========================================================== 03:33:33 (1775201613) Apr 3 03:33:35 oleg421-client sshd[112943]: Received disconnect from 192.168.204.21 port 54400:11: disconnected by user Apr 3 03:33:35 oleg421-client sshd[112943]: Disconnected from user root 192.168.204.21 port 54400 Apr 3 03:33:35 oleg421-client sshd[112930]: pam_unix(sshd:session): session closed for user root Apr 3 03:33:35 oleg421-client systemd[1]: session-584.scope: Succeeded. Apr 3 03:33:35 oleg421-client systemd-logind[1011]: Session 584 logged out. Waiting for processes to exit. Apr 3 03:33:35 oleg421-client systemd-logind[1011]: Removed session 584. Apr 3 03:33:40 oleg421-client kernel: LustreError: 113033:0:(lmv_obd.c:1437:lmv_statfs()) lustre-MDT0000-mdc-ffff962450e3f000: can't stat MDS #0: rc = -19 Apr 3 03:33:41 oleg421-client sshd[113120]: Accepted publickey for root from 192.168.204.21 port 49112 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:33:41 oleg421-client systemd-logind[1011]: New session 585 of user root. Apr 3 03:33:41 oleg421-client systemd[1]: Started Session 585 of user root. Apr 3 03:33:41 oleg421-client sshd[113120]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:33:42 oleg421-client sshd[113133]: Received disconnect from 192.168.204.21 port 49112:11: disconnected by user Apr 3 03:33:42 oleg421-client sshd[113133]: Disconnected from user root 192.168.204.21 port 49112 Apr 3 03:33:42 oleg421-client sshd[113120]: pam_unix(sshd:session): session closed for user root Apr 3 03:33:42 oleg421-client systemd[1]: session-585.scope: Succeeded. Apr 3 03:33:42 oleg421-client systemd-logind[1011]: Session 585 logged out. Waiting for processes to exit. Apr 3 03:33:42 oleg421-client systemd-logind[1011]: Removed session 585. Apr 3 03:33:43 oleg421-client sshd[113260]: Accepted publickey for root from 192.168.204.21 port 49118 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:33:43 oleg421-client systemd-logind[1011]: New session 586 of user root. Apr 3 03:33:43 oleg421-client systemd[1]: Started Session 586 of user root. Apr 3 03:33:43 oleg421-client sshd[113260]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:33:43 oleg421-client sshd[113273]: Received disconnect from 192.168.204.21 port 49118:11: disconnected by user Apr 3 03:33:43 oleg421-client sshd[113273]: Disconnected from user root 192.168.204.21 port 49118 Apr 3 03:33:43 oleg421-client sshd[113260]: pam_unix(sshd:session): session closed for user root Apr 3 03:33:43 oleg421-client systemd[1]: session-586.scope: Succeeded. Apr 3 03:33:44 oleg421-client systemd-logind[1011]: Session 586 logged out. Waiting for processes to exit. Apr 3 03:33:44 oleg421-client systemd-logind[1011]: Removed session 586. Apr 3 03:33:44 oleg421-client sshd[113407]: Accepted publickey for root from 192.168.204.21 port 49128 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:33:45 oleg421-client systemd-logind[1011]: New session 587 of user root. Apr 3 03:33:45 oleg421-client systemd[1]: Started Session 587 of user root. Apr 3 03:33:45 oleg421-client sshd[113407]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:33:45 oleg421-client sshd[113420]: Received disconnect from 192.168.204.21 port 49128:11: disconnected by user Apr 3 03:33:45 oleg421-client sshd[113420]: Disconnected from user root 192.168.204.21 port 49128 Apr 3 03:33:45 oleg421-client sshd[113407]: pam_unix(sshd:session): session closed for user root Apr 3 03:33:45 oleg421-client systemd-logind[1011]: Session 587 logged out. Waiting for processes to exit. Apr 3 03:33:45 oleg421-client systemd[1]: session-587.scope: Succeeded. Apr 3 03:33:45 oleg421-client systemd-logind[1011]: Removed session 587. Apr 3 03:34:05 oleg421-client sshd[113690]: Accepted publickey for root from 192.168.204.21 port 60206 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:34:05 oleg421-client systemd-logind[1011]: New session 588 of user root. Apr 3 03:34:05 oleg421-client systemd[1]: Started Session 588 of user root. Apr 3 03:34:05 oleg421-client sshd[113690]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:34:06 oleg421-client sshd[113703]: Received disconnect from 192.168.204.21 port 60206:11: disconnected by user Apr 3 03:34:06 oleg421-client sshd[113703]: Disconnected from user root 192.168.204.21 port 60206 Apr 3 03:34:06 oleg421-client sshd[113690]: pam_unix(sshd:session): session closed for user root Apr 3 03:34:06 oleg421-client systemd-logind[1011]: Session 588 logged out. Waiting for processes to exit. Apr 3 03:34:06 oleg421-client systemd[1]: session-588.scope: Succeeded. Apr 3 03:34:06 oleg421-client systemd-logind[1011]: Removed session 588. Apr 3 03:34:07 oleg421-client sshd[113842]: Accepted publickey for root from 192.168.204.21 port 52030 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:34:07 oleg421-client systemd[1]: Started Session 589 of user root. Apr 3 03:34:07 oleg421-client systemd-logind[1011]: New session 589 of user root. Apr 3 03:34:07 oleg421-client sshd[113842]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:34:08 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 152: QoS object allocation could be awakened in case of OST failover ========================================================== 03:34:06 (1775201646) Apr 3 03:34:08 oleg421-client sshd[113855]: Received disconnect from 192.168.204.21 port 52030:11: disconnected by user Apr 3 03:34:08 oleg421-client sshd[113855]: Disconnected from user root 192.168.204.21 port 52030 Apr 3 03:34:08 oleg421-client sshd[113842]: pam_unix(sshd:session): session closed for user root Apr 3 03:34:08 oleg421-client systemd[1]: session-589.scope: Succeeded. Apr 3 03:34:08 oleg421-client systemd-logind[1011]: Session 589 logged out. Waiting for processes to exit. Apr 3 03:34:08 oleg421-client systemd-logind[1011]: Removed session 589. Apr 3 03:34:35 oleg421-client sshd[114076]: Accepted publickey for root from 192.168.204.21 port 41062 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:34:35 oleg421-client systemd-logind[1011]: New session 590 of user root. Apr 3 03:34:35 oleg421-client systemd[1]: Started Session 590 of user root. Apr 3 03:34:35 oleg421-client sshd[114076]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:34:36 oleg421-client sshd[114089]: Received disconnect from 192.168.204.21 port 41062:11: disconnected by user Apr 3 03:34:36 oleg421-client sshd[114089]: Disconnected from user root 192.168.204.21 port 41062 Apr 3 03:34:36 oleg421-client sshd[114076]: pam_unix(sshd:session): session closed for user root Apr 3 03:34:36 oleg421-client systemd[1]: session-590.scope: Succeeded. Apr 3 03:34:36 oleg421-client systemd-logind[1011]: Session 590 logged out. Waiting for processes to exit. Apr 3 03:34:36 oleg421-client systemd-logind[1011]: Removed session 590. Apr 3 03:34:38 oleg421-client sshd[114215]: Accepted publickey for root from 192.168.204.21 port 47646 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:34:38 oleg421-client systemd-logind[1011]: New session 591 of user root. Apr 3 03:34:38 oleg421-client systemd[1]: Started Session 591 of user root. Apr 3 03:34:38 oleg421-client sshd[114215]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:34:38 oleg421-client sshd[114228]: Received disconnect from 192.168.204.21 port 47646:11: disconnected by user Apr 3 03:34:38 oleg421-client sshd[114228]: Disconnected from user root 192.168.204.21 port 47646 Apr 3 03:34:38 oleg421-client sshd[114215]: pam_unix(sshd:session): session closed for user root Apr 3 03:34:39 oleg421-client systemd-logind[1011]: Session 591 logged out. Waiting for processes to exit. Apr 3 03:34:39 oleg421-client systemd[1]: session-591.scope: Succeeded. Apr 3 03:34:39 oleg421-client systemd-logind[1011]: Removed session 591. Apr 3 03:34:40 oleg421-client sshd[114361]: Accepted publickey for root from 192.168.204.21 port 47658 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:34:40 oleg421-client systemd-logind[1011]: New session 592 of user root. Apr 3 03:34:40 oleg421-client systemd[1]: Started Session 592 of user root. Apr 3 03:34:40 oleg421-client sshd[114361]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:34:40 oleg421-client sshd[114374]: Received disconnect from 192.168.204.21 port 47658:11: disconnected by user Apr 3 03:34:40 oleg421-client sshd[114374]: Disconnected from user root 192.168.204.21 port 47658 Apr 3 03:34:40 oleg421-client sshd[114361]: pam_unix(sshd:session): session closed for user root Apr 3 03:34:40 oleg421-client systemd[1]: session-592.scope: Succeeded. Apr 3 03:34:40 oleg421-client systemd-logind[1011]: Session 592 logged out. Waiting for processes to exit. Apr 3 03:34:40 oleg421-client systemd-logind[1011]: Removed session 592. Apr 3 03:34:44 oleg421-client sshd[114528]: Accepted publickey for root from 192.168.204.21 port 47664 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:34:45 oleg421-client systemd-logind[1011]: New session 593 of user root. Apr 3 03:34:45 oleg421-client systemd[1]: Started Session 593 of user root. Apr 3 03:34:45 oleg421-client sshd[114528]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:34:45 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 153: evict vs reconnect race ====== 03:34:43 (1775201683) Apr 3 03:34:45 oleg421-client sshd[114541]: Received disconnect from 192.168.204.21 port 47664:11: disconnected by user Apr 3 03:34:45 oleg421-client sshd[114541]: Disconnected from user root 192.168.204.21 port 47664 Apr 3 03:34:45 oleg421-client sshd[114528]: pam_unix(sshd:session): session closed for user root Apr 3 03:34:45 oleg421-client systemd-logind[1011]: Session 593 logged out. Waiting for processes to exit. Apr 3 03:34:45 oleg421-client systemd[1]: session-593.scope: Succeeded. Apr 3 03:34:45 oleg421-client systemd-logind[1011]: Removed session 593. Apr 3 03:35:37 oleg421-client sshd[114953]: Accepted publickey for root from 192.168.204.21 port 46036 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:35:37 oleg421-client systemd[1]: Started Session 594 of user root. Apr 3 03:35:37 oleg421-client systemd-logind[1011]: New session 594 of user root. Apr 3 03:35:37 oleg421-client sshd[114953]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:35:37 oleg421-client sshd[114966]: Received disconnect from 192.168.204.21 port 46036:11: disconnected by user Apr 3 03:35:37 oleg421-client sshd[114966]: Disconnected from user root 192.168.204.21 port 46036 Apr 3 03:35:37 oleg421-client sshd[114953]: pam_unix(sshd:session): session closed for user root Apr 3 03:35:37 oleg421-client systemd-logind[1011]: Session 594 logged out. Waiting for processes to exit. Apr 3 03:35:37 oleg421-client systemd[1]: session-594.scope: Succeeded. Apr 3 03:35:37 oleg421-client systemd-logind[1011]: Removed session 594. Apr 3 03:35:38 oleg421-client sshd[115093]: Accepted publickey for root from 192.168.204.21 port 36574 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:35:38 oleg421-client systemd-logind[1011]: New session 595 of user root. Apr 3 03:35:38 oleg421-client systemd[1]: Started Session 595 of user root. Apr 3 03:35:38 oleg421-client sshd[115093]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:35:39 oleg421-client sshd[115106]: Received disconnect from 192.168.204.21 port 36574:11: disconnected by user Apr 3 03:35:39 oleg421-client sshd[115106]: Disconnected from user root 192.168.204.21 port 36574 Apr 3 03:35:39 oleg421-client sshd[115093]: pam_unix(sshd:session): session closed for user root Apr 3 03:35:39 oleg421-client systemd[1]: session-595.scope: Succeeded. Apr 3 03:35:39 oleg421-client systemd-logind[1011]: Session 595 logged out. Waiting for processes to exit. Apr 3 03:35:39 oleg421-client systemd-logind[1011]: Removed session 595. Apr 3 03:35:40 oleg421-client sshd[115239]: Accepted publickey for root from 192.168.204.21 port 36584 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:35:40 oleg421-client systemd-logind[1011]: New session 596 of user root. Apr 3 03:35:40 oleg421-client systemd[1]: Started Session 596 of user root. Apr 3 03:35:40 oleg421-client sshd[115239]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:35:40 oleg421-client sshd[115252]: Received disconnect from 192.168.204.21 port 36584:11: disconnected by user Apr 3 03:35:40 oleg421-client sshd[115252]: Disconnected from user root 192.168.204.21 port 36584 Apr 3 03:35:40 oleg421-client sshd[115239]: pam_unix(sshd:session): session closed for user root Apr 3 03:35:40 oleg421-client systemd-logind[1011]: Session 596 logged out. Waiting for processes to exit. Apr 3 03:35:40 oleg421-client systemd[1]: session-596.scope: Succeeded. Apr 3 03:35:40 oleg421-client systemd-logind[1011]: Removed session 596. Apr 3 03:35:42 oleg421-client sshd[115394]: Accepted publickey for root from 192.168.204.21 port 36586 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:35:42 oleg421-client systemd-logind[1011]: New session 597 of user root. Apr 3 03:35:42 oleg421-client systemd[1]: Started Session 597 of user root. Apr 3 03:35:42 oleg421-client sshd[115394]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:35:42 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 154a: corruption update llog can be skipped ========================================================== 03:35:41 (1775201741) Apr 3 03:35:42 oleg421-client sshd[115407]: Received disconnect from 192.168.204.21 port 36586:11: disconnected by user Apr 3 03:35:42 oleg421-client sshd[115407]: Disconnected from user root 192.168.204.21 port 36586 Apr 3 03:35:42 oleg421-client sshd[115394]: pam_unix(sshd:session): session closed for user root Apr 3 03:35:42 oleg421-client systemd[1]: session-597.scope: Succeeded. Apr 3 03:35:42 oleg421-client systemd-logind[1011]: Session 597 logged out. Waiting for processes to exit. Apr 3 03:35:42 oleg421-client systemd-logind[1011]: Removed session 597. Apr 3 03:36:39 oleg421-client sshd[116140]: Accepted publickey for root from 192.168.204.21 port 35178 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:36:39 oleg421-client systemd[1]: Started Session 598 of user root. Apr 3 03:36:39 oleg421-client systemd-logind[1011]: New session 598 of user root. Apr 3 03:36:39 oleg421-client sshd[116140]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:36:40 oleg421-client sshd[116153]: Received disconnect from 192.168.204.21 port 35178:11: disconnected by user Apr 3 03:36:40 oleg421-client sshd[116153]: Disconnected from user root 192.168.204.21 port 35178 Apr 3 03:36:40 oleg421-client sshd[116140]: pam_unix(sshd:session): session closed for user root Apr 3 03:36:40 oleg421-client systemd-logind[1011]: Session 598 logged out. Waiting for processes to exit. Apr 3 03:36:40 oleg421-client systemd[1]: session-598.scope: Succeeded. Apr 3 03:36:40 oleg421-client systemd-logind[1011]: Removed session 598. Apr 3 03:36:41 oleg421-client sshd[116279]: Accepted publickey for root from 192.168.204.21 port 35184 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:36:41 oleg421-client systemd-logind[1011]: New session 599 of user root. Apr 3 03:36:41 oleg421-client systemd[1]: Started Session 599 of user root. Apr 3 03:36:41 oleg421-client sshd[116279]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:36:41 oleg421-client sshd[116292]: Received disconnect from 192.168.204.21 port 35184:11: disconnected by user Apr 3 03:36:41 oleg421-client sshd[116292]: Disconnected from user root 192.168.204.21 port 35184 Apr 3 03:36:41 oleg421-client sshd[116279]: pam_unix(sshd:session): session closed for user root Apr 3 03:36:42 oleg421-client systemd[1]: session-599.scope: Succeeded. Apr 3 03:36:42 oleg421-client systemd-logind[1011]: Session 599 logged out. Waiting for processes to exit. Apr 3 03:36:42 oleg421-client systemd-logind[1011]: Removed session 599. Apr 3 03:36:43 oleg421-client sshd[116426]: Accepted publickey for root from 192.168.204.21 port 35186 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:36:43 oleg421-client systemd[1]: Started Session 600 of user root. Apr 3 03:36:43 oleg421-client systemd-logind[1011]: New session 600 of user root. Apr 3 03:36:43 oleg421-client sshd[116426]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:36:43 oleg421-client sshd[116439]: Received disconnect from 192.168.204.21 port 35186:11: disconnected by user Apr 3 03:36:43 oleg421-client sshd[116439]: Disconnected from user root 192.168.204.21 port 35186 Apr 3 03:36:43 oleg421-client sshd[116426]: pam_unix(sshd:session): session closed for user root Apr 3 03:36:43 oleg421-client systemd[1]: session-600.scope: Succeeded. Apr 3 03:36:43 oleg421-client systemd-logind[1011]: Session 600 logged out. Waiting for processes to exit. Apr 3 03:36:43 oleg421-client systemd-logind[1011]: Removed session 600. Apr 3 03:36:46 oleg421-client sshd[116581]: Accepted publickey for root from 192.168.204.21 port 35194 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:36:46 oleg421-client systemd-logind[1011]: New session 601 of user root. Apr 3 03:36:46 oleg421-client systemd[1]: Started Session 601 of user root. Apr 3 03:36:46 oleg421-client sshd[116581]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:36:46 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 154b: restore update llog after failed recovery ========================================================== 03:36:44 (1775201804) Apr 3 03:36:46 oleg421-client sshd[116594]: Received disconnect from 192.168.204.21 port 35194:11: disconnected by user Apr 3 03:36:46 oleg421-client sshd[116594]: Disconnected from user root 192.168.204.21 port 35194 Apr 3 03:36:46 oleg421-client sshd[116581]: pam_unix(sshd:session): session closed for user root Apr 3 03:36:47 oleg421-client systemd[1]: session-601.scope: Succeeded. Apr 3 03:36:47 oleg421-client systemd-logind[1011]: Session 601 logged out. Waiting for processes to exit. Apr 3 03:36:47 oleg421-client systemd-logind[1011]: Removed session 601. Apr 3 03:37:11 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962450e3f000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Apr 3 03:37:21 oleg421-client systemd-udevd[116940]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Apr 3 03:37:21 oleg421-client kernel: Lustre: Mounted lustre-client Apr 3 03:37:24 oleg421-client systemd[1]: mnt-lustre2.mount: Succeeded. Apr 3 03:37:24 oleg421-client kernel: LustreError: 116975:0:(lov_obd.c:786:lov_cleanup()) lustre-clilov-ffff962446922000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Apr 3 03:37:24 oleg421-client kernel: LustreError: 116975:0:(lov_obd.c:786:lov_cleanup()) Skipped 1 previous similar message Apr 3 03:37:24 oleg421-client kernel: Lustre: Unmounted lustre-client Apr 3 03:37:26 oleg421-client systemd[1]: mnt-lustre.mount: Succeeded. Apr 3 03:37:40 oleg421-client kernel: LustreError: 116994:0:(lov_obd.c:786:lov_cleanup()) lustre-clilov-ffff962450e3f000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Apr 3 03:37:40 oleg421-client kernel: LustreError: 116994:0:(lov_obd.c:786:lov_cleanup()) Skipped 1 previous similar message Apr 3 03:37:40 oleg421-client kernel: Lustre: Unmounted lustre-client Apr 3 03:37:41 oleg421-client systemd-udevd[117035]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Apr 3 03:37:42 oleg421-client sshd[117144]: Accepted publickey for root from 192.168.204.21 port 48862 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:37:42 oleg421-client systemd-logind[1011]: New session 602 of user root. Apr 3 03:37:42 oleg421-client systemd[1]: Started Session 602 of user root. Apr 3 03:37:42 oleg421-client sshd[117144]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:37:43 oleg421-client sshd[117157]: Received disconnect from 192.168.204.21 port 48862:11: disconnected by user Apr 3 03:37:43 oleg421-client sshd[117157]: Disconnected from user root 192.168.204.21 port 48862 Apr 3 03:37:43 oleg421-client sshd[117144]: pam_unix(sshd:session): session closed for user root Apr 3 03:37:43 oleg421-client systemd[1]: session-602.scope: Succeeded. Apr 3 03:37:43 oleg421-client systemd-logind[1011]: Session 602 logged out. Waiting for processes to exit. Apr 3 03:37:43 oleg421-client systemd-logind[1011]: Removed session 602. Apr 3 03:37:45 oleg421-client sshd[117283]: Accepted publickey for root from 192.168.204.21 port 48872 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:37:45 oleg421-client systemd[1]: Started Session 603 of user root. Apr 3 03:37:45 oleg421-client systemd-logind[1011]: New session 603 of user root. Apr 3 03:37:45 oleg421-client sshd[117283]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:37:45 oleg421-client sshd[117296]: Received disconnect from 192.168.204.21 port 48872:11: disconnected by user Apr 3 03:37:45 oleg421-client sshd[117296]: Disconnected from user root 192.168.204.21 port 48872 Apr 3 03:37:45 oleg421-client sshd[117283]: pam_unix(sshd:session): session closed for user root Apr 3 03:37:45 oleg421-client systemd[1]: session-603.scope: Succeeded. Apr 3 03:37:45 oleg421-client systemd-logind[1011]: Session 603 logged out. Waiting for processes to exit. Apr 3 03:37:45 oleg421-client systemd-logind[1011]: Removed session 603. Apr 3 03:37:46 oleg421-client sshd[117430]: Accepted publickey for root from 192.168.204.21 port 48876 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:37:46 oleg421-client systemd-logind[1011]: New session 604 of user root. Apr 3 03:37:46 oleg421-client systemd[1]: Started Session 604 of user root. Apr 3 03:37:46 oleg421-client sshd[117430]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:37:47 oleg421-client sshd[117443]: Received disconnect from 192.168.204.21 port 48876:11: disconnected by user Apr 3 03:37:47 oleg421-client sshd[117443]: Disconnected from user root 192.168.204.21 port 48876 Apr 3 03:37:47 oleg421-client sshd[117430]: pam_unix(sshd:session): session closed for user root Apr 3 03:37:47 oleg421-client systemd-logind[1011]: Session 604 logged out. Waiting for processes to exit. Apr 3 03:37:47 oleg421-client systemd[1]: session-604.scope: Succeeded. Apr 3 03:37:47 oleg421-client systemd-logind[1011]: Removed session 604. Apr 3 03:37:50 oleg421-client sshd[117594]: Accepted publickey for root from 192.168.204.21 port 53334 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:37:50 oleg421-client systemd-logind[1011]: New session 605 of user root. Apr 3 03:37:50 oleg421-client systemd[1]: Started Session 605 of user root. Apr 3 03:37:50 oleg421-client sshd[117594]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:37:50 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 155: failover after client remount ========================================================== 03:37:48 (1775201868) Apr 3 03:37:50 oleg421-client sshd[117607]: Received disconnect from 192.168.204.21 port 53334:11: disconnected by user Apr 3 03:37:50 oleg421-client sshd[117607]: Disconnected from user root 192.168.204.21 port 53334 Apr 3 03:37:50 oleg421-client sshd[117594]: pam_unix(sshd:session): session closed for user root Apr 3 03:37:50 oleg421-client systemd-logind[1011]: Session 605 logged out. Waiting for processes to exit. Apr 3 03:37:50 oleg421-client systemd[1]: session-605.scope: Succeeded. Apr 3 03:37:50 oleg421-client systemd-logind[1011]: Removed session 605. Apr 3 03:37:54 oleg421-client systemd[1]: mnt-lustre.mount: Succeeded. Apr 3 03:37:55 oleg421-client kernel: LustreError: 117676:0:(lov_obd.c:786:lov_cleanup()) lustre-clilov-ffff962443e14800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Apr 3 03:37:55 oleg421-client kernel: LustreError: 117676:0:(lov_obd.c:786:lov_cleanup()) Skipped 1 previous similar message Apr 3 03:37:55 oleg421-client kernel: Lustre: Unmounted lustre-client Apr 3 03:37:57 oleg421-client systemd-udevd[117728]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Apr 3 03:37:57 oleg421-client kernel: Lustre: Mounted lustre-client Apr 3 03:37:57 oleg421-client kernel: Lustre: Skipped 1 previous similar message Apr 3 03:38:04 oleg421-client kernel: Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 Apr 3 03:38:23 oleg421-client kernel: Lustre: 2403:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775201887/real 1775201887] req@ffff962447ef6300 x1861425411877760/t0(0) o400->MGC192.168.204.121@tcp@192.168.204.121@tcp:26/25 lens 224/224 e 0 to 1 dl 1775201903 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 Apr 3 03:38:23 oleg421-client kernel: LustreError: MGC192.168.204.121@tcp: Connection to MGS (at 192.168.204.121@tcp) was lost; in progress operations using this service will fail Apr 3 03:38:23 oleg421-client kernel: LustreError: Skipped 5 previous similar messages Apr 3 03:38:49 oleg421-client kernel: Lustre: Evicted from MGS (at 192.168.204.121@tcp) after server handle changed from 0x1d1756950d241d35 to 0x1d1756950d242983 Apr 3 03:38:49 oleg421-client kernel: Lustre: Skipped 6 previous similar messages Apr 3 03:38:49 oleg421-client kernel: Lustre: MGC192.168.204.121@tcp: Connection restored to 192.168.204.121@tcp (at 192.168.204.121@tcp) Apr 3 03:38:49 oleg421-client kernel: Lustre: Skipped 15 previous similar messages Apr 3 03:38:49 oleg421-client sshd[118188]: Accepted publickey for root from 192.168.204.21 port 44594 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:38:49 oleg421-client systemd[1]: Started Session 606 of user root. Apr 3 03:38:49 oleg421-client systemd-logind[1011]: New session 606 of user root. Apr 3 03:38:49 oleg421-client sshd[118188]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:38:50 oleg421-client sshd[118201]: Received disconnect from 192.168.204.21 port 44594:11: disconnected by user Apr 3 03:38:50 oleg421-client sshd[118201]: Disconnected from user root 192.168.204.21 port 44594 Apr 3 03:38:50 oleg421-client sshd[118188]: pam_unix(sshd:session): session closed for user root Apr 3 03:38:50 oleg421-client systemd[1]: session-606.scope: Succeeded. Apr 3 03:38:50 oleg421-client systemd-logind[1011]: Session 606 logged out. Waiting for processes to exit. Apr 3 03:38:50 oleg421-client systemd-logind[1011]: Removed session 606. Apr 3 03:38:51 oleg421-client sshd[118337]: Accepted publickey for root from 192.168.204.21 port 44610 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:38:51 oleg421-client systemd-logind[1011]: New session 607 of user root. Apr 3 03:38:51 oleg421-client systemd[1]: Started Session 607 of user root. Apr 3 03:38:51 oleg421-client rsyslogd[1073]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Apr 3 03:38:51 oleg421-client sshd[118337]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:38:51 oleg421-client sshd[118351]: Received disconnect from 192.168.204.21 port 44610:11: disconnected by user Apr 3 03:38:51 oleg421-client sshd[118351]: Disconnected from user root 192.168.204.21 port 44610 Apr 3 03:38:51 oleg421-client sshd[118337]: pam_unix(sshd:session): session closed for user root Apr 3 03:38:52 oleg421-client systemd-logind[1011]: Session 607 logged out. Waiting for processes to exit. Apr 3 03:38:52 oleg421-client systemd[1]: session-607.scope: Succeeded. Apr 3 03:38:52 oleg421-client systemd-logind[1011]: Removed session 607. Apr 3 03:38:53 oleg421-client sshd[118485]: Accepted publickey for root from 192.168.204.21 port 44616 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:38:53 oleg421-client systemd-logind[1011]: New session 608 of user root. Apr 3 03:38:53 oleg421-client systemd[1]: Started Session 608 of user root. Apr 3 03:38:53 oleg421-client sshd[118485]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:38:53 oleg421-client sshd[118498]: Received disconnect from 192.168.204.21 port 44616:11: disconnected by user Apr 3 03:38:53 oleg421-client sshd[118498]: Disconnected from user root 192.168.204.21 port 44616 Apr 3 03:38:53 oleg421-client sshd[118485]: pam_unix(sshd:session): session closed for user root Apr 3 03:38:53 oleg421-client systemd[1]: session-608.scope: Succeeded. Apr 3 03:38:53 oleg421-client systemd-logind[1011]: Session 608 logged out. Waiting for processes to exit. Apr 3 03:38:53 oleg421-client systemd-logind[1011]: Removed session 608. Apr 3 03:38:55 oleg421-client sshd[118641]: Accepted publickey for root from 192.168.204.21 port 44624 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:38:55 oleg421-client systemd-logind[1011]: New session 609 of user root. Apr 3 03:38:55 oleg421-client systemd[1]: Started Session 609 of user root. Apr 3 03:38:55 oleg421-client sshd[118641]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:38:55 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 156: tot_granted miscount after client eviction ========================================================== 03:38:54 (1775201934) Apr 3 03:38:55 oleg421-client sshd[118654]: Received disconnect from 192.168.204.21 port 44624:11: disconnected by user Apr 3 03:38:55 oleg421-client sshd[118654]: Disconnected from user root 192.168.204.21 port 44624 Apr 3 03:38:55 oleg421-client sshd[118641]: pam_unix(sshd:session): session closed for user root Apr 3 03:38:55 oleg421-client systemd[1]: session-609.scope: Succeeded. Apr 3 03:38:55 oleg421-client systemd-logind[1011]: Session 609 logged out. Waiting for processes to exit. Apr 3 03:38:56 oleg421-client systemd-logind[1011]: Removed session 609. Apr 3 03:39:08 oleg421-client kernel: Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-OST0000 Apr 3 03:39:38 oleg421-client kernel: LustreError: 2402:0:(client.c:3504:ptlrpc_replay_req()) cfs_fail_timeout id 536 sleeping for 45000ms Apr 3 03:39:49 oleg421-client sshd[119121]: Accepted publickey for root from 192.168.204.21 port 36622 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:39:49 oleg421-client systemd-logind[1011]: New session 610 of user root. Apr 3 03:39:49 oleg421-client systemd[1]: Started Session 610 of user root. Apr 3 03:39:49 oleg421-client sshd[119121]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:40:23 oleg421-client kernel: LustreError: 2402:0:(client.c:3504:ptlrpc_replay_req()) cfs_fail_timeout id 536 awake Apr 3 03:40:23 oleg421-client kernel: LustreError: lustre-OST0000-osc-ffff962450e38000: operation ost_write to node 192.168.204.121@tcp failed: rc = -107 Apr 3 03:40:23 oleg421-client kernel: LustreError: Skipped 13 previous similar messages Apr 3 03:40:23 oleg421-client kernel: LustreError: lustre-OST0000-osc-ffff962450e38000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Apr 3 03:40:23 oleg421-client sshd[119134]: Received disconnect from 192.168.204.21 port 36622:11: disconnected by user Apr 3 03:40:23 oleg421-client sshd[119134]: Disconnected from user root 192.168.204.21 port 36622 Apr 3 03:40:23 oleg421-client sshd[119121]: pam_unix(sshd:session): session closed for user root Apr 3 03:40:24 oleg421-client systemd-logind[1011]: Session 610 logged out. Waiting for processes to exit. Apr 3 03:40:24 oleg421-client systemd[1]: session-610.scope: Succeeded. Apr 3 03:40:24 oleg421-client systemd-logind[1011]: Removed session 610. Apr 3 03:40:28 oleg421-client sshd[119364]: Accepted publickey for root from 192.168.204.21 port 57146 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:40:28 oleg421-client systemd[1]: Started Session 611 of user root. Apr 3 03:40:28 oleg421-client systemd-logind[1011]: New session 611 of user root. Apr 3 03:40:28 oleg421-client sshd[119364]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:40:28 oleg421-client kernel: Lustre: DEBUG MARKER: oleg421-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid Apr 3 03:40:28 oleg421-client sshd[119377]: Received disconnect from 192.168.204.21 port 57146:11: disconnected by user Apr 3 03:40:28 oleg421-client sshd[119377]: Disconnected from user root 192.168.204.21 port 57146 Apr 3 03:40:28 oleg421-client sshd[119364]: pam_unix(sshd:session): session closed for user root Apr 3 03:40:29 oleg421-client systemd-logind[1011]: Session 611 logged out. Waiting for processes to exit. Apr 3 03:40:29 oleg421-client systemd[1]: session-611.scope: Succeeded. Apr 3 03:40:29 oleg421-client systemd-logind[1011]: Removed session 611. Apr 3 03:40:30 oleg421-client sshd[119520]: Accepted publickey for root from 192.168.204.21 port 57162 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:40:30 oleg421-client systemd-logind[1011]: New session 612 of user root. Apr 3 03:40:30 oleg421-client systemd[1]: Started Session 612 of user root. Apr 3 03:40:30 oleg421-client sshd[119520]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:40:30 oleg421-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec Apr 3 03:40:30 oleg421-client sshd[119534]: Received disconnect from 192.168.204.21 port 57162:11: disconnected by user Apr 3 03:40:30 oleg421-client sshd[119534]: Disconnected from user root 192.168.204.21 port 57162 Apr 3 03:40:30 oleg421-client sshd[119520]: pam_unix(sshd:session): session closed for user root Apr 3 03:40:31 oleg421-client systemd[1]: session-612.scope: Succeeded. Apr 3 03:40:31 oleg421-client systemd-logind[1011]: Session 612 logged out. Waiting for processes to exit. Apr 3 03:40:31 oleg421-client systemd-logind[1011]: Removed session 612. Apr 3 03:40:32 oleg421-client sshd[119575]: Accepted publickey for root from 192.168.204.21 port 57164 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:40:32 oleg421-client systemd-logind[1011]: New session 613 of user root. Apr 3 03:40:32 oleg421-client systemd[1]: Started Session 613 of user root. Apr 3 03:40:32 oleg421-client sshd[119575]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:40:33 oleg421-client sshd[119588]: Received disconnect from 192.168.204.21 port 57164:11: disconnected by user Apr 3 03:40:33 oleg421-client sshd[119588]: Disconnected from user root 192.168.204.21 port 57164 Apr 3 03:40:33 oleg421-client sshd[119575]: pam_unix(sshd:session): session closed for user root Apr 3 03:40:33 oleg421-client systemd[1]: session-613.scope: Succeeded. Apr 3 03:40:33 oleg421-client systemd-logind[1011]: Session 613 logged out. Waiting for processes to exit. Apr 3 03:40:33 oleg421-client systemd-logind[1011]: Removed session 613. Apr 3 03:40:37 oleg421-client sshd[119734]: Accepted publickey for root from 192.168.204.21 port 57174 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:40:37 oleg421-client systemd[1]: Started Session 614 of user root. Apr 3 03:40:37 oleg421-client systemd-logind[1011]: New session 614 of user root. Apr 3 03:40:37 oleg421-client sshd[119734]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:40:37 oleg421-client sshd[119747]: Received disconnect from 192.168.204.21 port 57174:11: disconnected by user Apr 3 03:40:37 oleg421-client sshd[119747]: Disconnected from user root 192.168.204.21 port 57174 Apr 3 03:40:37 oleg421-client sshd[119734]: pam_unix(sshd:session): session closed for user root Apr 3 03:40:37 oleg421-client systemd-logind[1011]: Session 614 logged out. Waiting for processes to exit. Apr 3 03:40:37 oleg421-client systemd[1]: session-614.scope: Succeeded. Apr 3 03:40:38 oleg421-client systemd-logind[1011]: Removed session 614. Apr 3 03:40:39 oleg421-client sshd[119874]: Accepted publickey for root from 192.168.204.21 port 53892 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:40:39 oleg421-client systemd[1]: Started Session 615 of user root. Apr 3 03:40:39 oleg421-client systemd-logind[1011]: New session 615 of user root. Apr 3 03:40:39 oleg421-client sshd[119874]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:40:39 oleg421-client sshd[119887]: Received disconnect from 192.168.204.21 port 53892:11: disconnected by user Apr 3 03:40:39 oleg421-client sshd[119887]: Disconnected from user root 192.168.204.21 port 53892 Apr 3 03:40:39 oleg421-client sshd[119874]: pam_unix(sshd:session): session closed for user root Apr 3 03:40:39 oleg421-client systemd[1]: session-615.scope: Succeeded. Apr 3 03:40:39 oleg421-client systemd-logind[1011]: Session 615 logged out. Waiting for processes to exit. Apr 3 03:40:39 oleg421-client systemd-logind[1011]: Removed session 615. Apr 3 03:40:41 oleg421-client sshd[120020]: Accepted publickey for root from 192.168.204.21 port 53894 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:40:41 oleg421-client systemd-logind[1011]: New session 616 of user root. Apr 3 03:40:41 oleg421-client systemd[1]: Started Session 616 of user root. Apr 3 03:40:41 oleg421-client sshd[120020]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:40:41 oleg421-client sshd[120033]: Received disconnect from 192.168.204.21 port 53894:11: disconnected by user Apr 3 03:40:41 oleg421-client sshd[120033]: Disconnected from user root 192.168.204.21 port 53894 Apr 3 03:40:41 oleg421-client sshd[120020]: pam_unix(sshd:session): session closed for user root Apr 3 03:40:42 oleg421-client systemd[1]: session-616.scope: Succeeded. Apr 3 03:40:42 oleg421-client systemd-logind[1011]: Session 616 logged out. Waiting for processes to exit. Apr 3 03:40:42 oleg421-client systemd-logind[1011]: Removed session 616. Apr 3 03:40:44 oleg421-client sshd[120185]: Accepted publickey for root from 192.168.204.21 port 53896 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:40:44 oleg421-client systemd[1]: Started Session 617 of user root. Apr 3 03:40:44 oleg421-client systemd-logind[1011]: New session 617 of user root. Apr 3 03:40:44 oleg421-client sshd[120185]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:40:45 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 157: eviction during mmaped i/o === 03:40:43 (1775202043) Apr 3 03:40:45 oleg421-client sshd[120200]: Received disconnect from 192.168.204.21 port 53896:11: disconnected by user Apr 3 03:40:45 oleg421-client sshd[120200]: Disconnected from user root 192.168.204.21 port 53896 Apr 3 03:40:45 oleg421-client sshd[120185]: pam_unix(sshd:session): session closed for user root Apr 3 03:40:45 oleg421-client systemd[1]: session-617.scope: Succeeded. Apr 3 03:40:45 oleg421-client systemd-logind[1011]: Session 617 logged out. Waiting for processes to exit. Apr 3 03:40:45 oleg421-client systemd-logind[1011]: Removed session 617. Apr 3 03:40:45 oleg421-client kernel: LustreError: 120247:0:(vvp_io.c:1485:vvp_io_fault_start()) cfs_fail_timeout id 1432 sleeping for 3000ms Apr 3 03:40:48 oleg421-client kernel: LustreError: 120247:0:(vvp_io.c:1485:vvp_io_fault_start()) cfs_fail_timeout id 1432 awake Apr 3 03:40:48 oleg421-client kernel: LustreError: lustre-OST0000-osc-ffff962450e38000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Apr 3 03:40:49 oleg421-client kernel: LustreError: 120260:0:(ldlm_resource.c:1170:ldlm_resource_complain()) lustre-OST0000-osc-ffff962450e38000: namespace resource [0x280000402:0x1fa3:0x0].0x0 (ffff96244281fd00) refcount nonzero (1) after lock cleanup; forcing cleanup. Apr 3 03:40:49 oleg421-client kernel: LustreError: 120260:0:(ldlm_resource.c:1170:ldlm_resource_complain()) Skipped 1 previous similar message Apr 3 03:40:49 oleg421-client systemd[1]: Created slice system-systemd\x2dcoredump.slice. Apr 3 03:40:49 oleg421-client systemd[1]: Started Process Core Dump (PID 120261/UID 0). Apr 3 03:40:49 oleg421-client systemd[120262]: systemd-coredump@0-120261-0.service: Failed to set up special execution directory in /var/lib: Read-only file system Apr 3 03:40:49 oleg421-client systemd[120262]: systemd-coredump@0-120261-0.service: Failed at step STATE_DIRECTORY spawning /usr/lib/systemd/systemd-coredump: Read-only file system Apr 3 03:40:49 oleg421-client systemd[1]: systemd-coredump@0-120261-0.service: Succeeded. Apr 3 03:40:50 oleg421-client sshd[120355]: Accepted publickey for root from 192.168.204.21 port 60084 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:40:50 oleg421-client systemd-logind[1011]: New session 618 of user root. Apr 3 03:40:50 oleg421-client systemd[1]: Started Session 618 of user root. Apr 3 03:40:50 oleg421-client sshd[120355]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:40:51 oleg421-client sshd[120368]: Received disconnect from 192.168.204.21 port 60084:11: disconnected by user Apr 3 03:40:51 oleg421-client sshd[120368]: Disconnected from user root 192.168.204.21 port 60084 Apr 3 03:40:51 oleg421-client sshd[120355]: pam_unix(sshd:session): session closed for user root Apr 3 03:40:51 oleg421-client systemd[1]: session-618.scope: Succeeded. Apr 3 03:40:51 oleg421-client systemd-logind[1011]: Session 618 logged out. Waiting for processes to exit. Apr 3 03:40:51 oleg421-client systemd-logind[1011]: Removed session 618. Apr 3 03:40:52 oleg421-client sshd[120494]: Accepted publickey for root from 192.168.204.21 port 60086 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:40:52 oleg421-client systemd-logind[1011]: New session 619 of user root. Apr 3 03:40:52 oleg421-client systemd[1]: Started Session 619 of user root. Apr 3 03:40:52 oleg421-client sshd[120494]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:40:53 oleg421-client sshd[120507]: Received disconnect from 192.168.204.21 port 60086:11: disconnected by user Apr 3 03:40:53 oleg421-client sshd[120507]: Disconnected from user root 192.168.204.21 port 60086 Apr 3 03:40:53 oleg421-client sshd[120494]: pam_unix(sshd:session): session closed for user root Apr 3 03:40:53 oleg421-client systemd[1]: session-619.scope: Succeeded. Apr 3 03:40:53 oleg421-client systemd-logind[1011]: Session 619 logged out. Waiting for processes to exit. Apr 3 03:40:53 oleg421-client systemd-logind[1011]: Removed session 619. Apr 3 03:40:55 oleg421-client sshd[120640]: Accepted publickey for root from 192.168.204.21 port 60098 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:40:55 oleg421-client systemd[1]: Started Session 620 of user root. Apr 3 03:40:55 oleg421-client systemd-logind[1011]: New session 620 of user root. Apr 3 03:40:55 oleg421-client sshd[120640]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:40:56 oleg421-client sshd[120653]: Received disconnect from 192.168.204.21 port 60098:11: disconnected by user Apr 3 03:40:56 oleg421-client sshd[120653]: Disconnected from user root 192.168.204.21 port 60098 Apr 3 03:40:56 oleg421-client sshd[120640]: pam_unix(sshd:session): session closed for user root Apr 3 03:40:56 oleg421-client systemd[1]: session-620.scope: Succeeded. Apr 3 03:40:56 oleg421-client systemd-logind[1011]: Session 620 logged out. Waiting for processes to exit. Apr 3 03:40:56 oleg421-client systemd-logind[1011]: Removed session 620. Apr 3 03:40:57 oleg421-client sshd[120796]: Accepted publickey for root from 192.168.204.21 port 57470 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:40:57 oleg421-client systemd-logind[1011]: New session 621 of user root. Apr 3 03:40:57 oleg421-client systemd[1]: Started Session 621 of user root. Apr 3 03:40:57 oleg421-client sshd[120796]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:40:58 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 158a: connect without access right ========================================================== 03:40:56 (1775202056) Apr 3 03:40:58 oleg421-client sshd[120809]: Received disconnect from 192.168.204.21 port 57470:11: disconnected by user Apr 3 03:40:58 oleg421-client sshd[120809]: Disconnected from user root 192.168.204.21 port 57470 Apr 3 03:40:58 oleg421-client sshd[120796]: pam_unix(sshd:session): session closed for user root Apr 3 03:40:58 oleg421-client systemd[1]: session-621.scope: Succeeded. Apr 3 03:40:58 oleg421-client systemd-logind[1011]: Session 621 logged out. Waiting for processes to exit. Apr 3 03:40:58 oleg421-client systemd-logind[1011]: Removed session 621. Apr 3 03:41:00 oleg421-client systemd[1]: mnt-lustre.mount: Succeeded. Apr 3 03:41:00 oleg421-client kernel: LustreError: 120864:0:(lov_obd.c:786:lov_cleanup()) lustre-clilov-ffff962450e38000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Apr 3 03:41:00 oleg421-client kernel: LustreError: 120864:0:(lov_obd.c:786:lov_cleanup()) Skipped 1 previous similar message Apr 3 03:41:00 oleg421-client kernel: Lustre: Unmounted lustre-client Apr 3 03:41:01 oleg421-client systemd-udevd[120910]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Apr 3 03:41:01 oleg421-client kernel: Lustre: Mounted lustre-client Apr 3 03:41:27 oleg421-client kernel: Lustre: lustre-MDT0001-mdc-ffff96244461f000: connection denied by lustre-MDT0001_UUID: rc = -13 Apr 3 03:41:27 oleg421-client kernel: LustreError: lustre-MDT0001-mdc-ffff96244461f000: This client was evicted by lustre-MDT0001; in progress operations using this service will fail. Apr 3 03:41:54 oleg421-client kernel: LustreError: lustre-MDT0001-mdc-ffff96244461f000: This client was evicted by lustre-MDT0001; in progress operations using this service will fail. Apr 3 03:41:55 oleg421-client sshd[121357]: Accepted publickey for root from 192.168.204.21 port 42496 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:41:55 oleg421-client systemd-logind[1011]: New session 622 of user root. Apr 3 03:41:55 oleg421-client systemd[1]: Started Session 622 of user root. Apr 3 03:41:55 oleg421-client sshd[121357]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:41:56 oleg421-client sshd[121370]: Received disconnect from 192.168.204.21 port 42496:11: disconnected by user Apr 3 03:41:56 oleg421-client sshd[121370]: Disconnected from user root 192.168.204.21 port 42496 Apr 3 03:41:56 oleg421-client sshd[121357]: pam_unix(sshd:session): session closed for user root Apr 3 03:41:56 oleg421-client systemd[1]: session-622.scope: Succeeded. Apr 3 03:41:56 oleg421-client systemd-logind[1011]: Session 622 logged out. Waiting for processes to exit. Apr 3 03:41:56 oleg421-client systemd-logind[1011]: Removed session 622. Apr 3 03:41:57 oleg421-client sshd[121497]: Accepted publickey for root from 192.168.204.21 port 42506 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:41:57 oleg421-client systemd-logind[1011]: New session 623 of user root. Apr 3 03:41:57 oleg421-client systemd[1]: Started Session 623 of user root. Apr 3 03:41:57 oleg421-client sshd[121497]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:41:57 oleg421-client sshd[121510]: Received disconnect from 192.168.204.21 port 42506:11: disconnected by user Apr 3 03:41:57 oleg421-client sshd[121510]: Disconnected from user root 192.168.204.21 port 42506 Apr 3 03:41:57 oleg421-client sshd[121497]: pam_unix(sshd:session): session closed for user root Apr 3 03:41:58 oleg421-client systemd[1]: session-623.scope: Succeeded. Apr 3 03:41:58 oleg421-client systemd-logind[1011]: Session 623 logged out. Waiting for processes to exit. Apr 3 03:41:58 oleg421-client systemd-logind[1011]: Removed session 623. Apr 3 03:41:58 oleg421-client sshd[121643]: Accepted publickey for root from 192.168.204.21 port 51088 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:41:59 oleg421-client systemd-logind[1011]: New session 624 of user root. Apr 3 03:41:59 oleg421-client systemd[1]: Started Session 624 of user root. Apr 3 03:41:59 oleg421-client sshd[121643]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:41:59 oleg421-client sshd[121656]: Received disconnect from 192.168.204.21 port 51088:11: disconnected by user Apr 3 03:41:59 oleg421-client sshd[121656]: Disconnected from user root 192.168.204.21 port 51088 Apr 3 03:41:59 oleg421-client sshd[121643]: pam_unix(sshd:session): session closed for user root Apr 3 03:41:59 oleg421-client systemd[1]: session-624.scope: Succeeded. Apr 3 03:41:59 oleg421-client systemd-logind[1011]: Session 624 logged out. Waiting for processes to exit. Apr 3 03:41:59 oleg421-client systemd-logind[1011]: Removed session 624. Apr 3 03:42:03 oleg421-client systemd[1]: mnt-lustre.mount: Succeeded. Apr 3 03:42:03 oleg421-client kernel: LustreError: 121712:0:(lov_obd.c:786:lov_cleanup()) lustre-clilov-ffff96244461f000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Apr 3 03:42:03 oleg421-client kernel: LustreError: 121712:0:(lov_obd.c:786:lov_cleanup()) Skipped 1 previous similar message Apr 3 03:42:03 oleg421-client kernel: Lustre: Unmounted lustre-client Apr 3 03:42:04 oleg421-client systemd-udevd[121753]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Apr 3 03:42:06 oleg421-client sshd[121812]: Accepted publickey for root from 192.168.204.21 port 51102 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:42:06 oleg421-client systemd[1]: Started Session 625 of user root. Apr 3 03:42:06 oleg421-client systemd-logind[1011]: New session 625 of user root. Apr 3 03:42:06 oleg421-client sshd[121812]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:42:06 oleg421-client sshd[121825]: Received disconnect from 192.168.204.21 port 51102:11: disconnected by user Apr 3 03:42:06 oleg421-client sshd[121825]: Disconnected from user root 192.168.204.21 port 51102 Apr 3 03:42:06 oleg421-client sshd[121812]: pam_unix(sshd:session): session closed for user root Apr 3 03:42:07 oleg421-client systemd-logind[1011]: Session 625 logged out. Waiting for processes to exit. Apr 3 03:42:07 oleg421-client systemd[1]: session-625.scope: Succeeded. Apr 3 03:42:07 oleg421-client systemd-logind[1011]: Removed session 625. Apr 3 03:42:08 oleg421-client sshd[121962]: Accepted publickey for root from 192.168.204.21 port 43816 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:42:08 oleg421-client systemd-logind[1011]: New session 626 of user root. Apr 3 03:42:08 oleg421-client systemd[1]: Started Session 626 of user root. Apr 3 03:42:08 oleg421-client sshd[121962]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:42:09 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 160: MDT destroys are blocked by grouplocks ========================================================== 03:42:07 (1775202127) Apr 3 03:42:09 oleg421-client sshd[121975]: Received disconnect from 192.168.204.21 port 43816:11: disconnected by user Apr 3 03:42:09 oleg421-client sshd[121975]: Disconnected from user root 192.168.204.21 port 43816 Apr 3 03:42:09 oleg421-client sshd[121962]: pam_unix(sshd:session): session closed for user root Apr 3 03:42:09 oleg421-client systemd-logind[1011]: Session 626 logged out. Waiting for processes to exit. Apr 3 03:42:09 oleg421-client systemd[1]: session-626.scope: Succeeded. Apr 3 03:42:09 oleg421-client systemd-logind[1011]: Removed session 626. Apr 3 03:42:12 oleg421-client kernel: Lustre: lustre-MDT0000-mdc-ffff962446925800: Connection to lustre-MDT0000 (at 192.168.204.121@tcp) was lost; in progress operations using this service will wait for recovery to complete Apr 3 03:42:12 oleg421-client kernel: Lustre: Skipped 11 previous similar messages Apr 3 03:42:12 oleg421-client kernel: LustreError: lustre-MDT0000-mdc-ffff962446925800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Apr 3 03:42:57 oleg421-client sshd[122220]: Accepted publickey for root from 192.168.204.21 port 40024 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:42:57 oleg421-client systemd[1]: Started Session 627 of user root. Apr 3 03:42:57 oleg421-client systemd-logind[1011]: New session 627 of user root. Apr 3 03:42:57 oleg421-client sshd[122220]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:42:57 oleg421-client sshd[122233]: Received disconnect from 192.168.204.21 port 40024:11: disconnected by user Apr 3 03:42:58 oleg421-client sshd[122233]: Disconnected from user root 192.168.204.21 port 40024 Apr 3 03:42:58 oleg421-client sshd[122220]: pam_unix(sshd:session): session closed for user root Apr 3 03:42:58 oleg421-client systemd[1]: session-627.scope: Succeeded. Apr 3 03:42:58 oleg421-client systemd-logind[1011]: Session 627 logged out. Waiting for processes to exit. Apr 3 03:42:58 oleg421-client systemd-logind[1011]: Removed session 627. Apr 3 03:42:59 oleg421-client sshd[122360]: Accepted publickey for root from 192.168.204.21 port 35830 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:42:59 oleg421-client systemd-logind[1011]: New session 628 of user root. Apr 3 03:42:59 oleg421-client systemd[1]: Started Session 628 of user root. Apr 3 03:42:59 oleg421-client sshd[122360]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:42:59 oleg421-client sshd[122373]: Received disconnect from 192.168.204.21 port 35830:11: disconnected by user Apr 3 03:42:59 oleg421-client sshd[122373]: Disconnected from user root 192.168.204.21 port 35830 Apr 3 03:42:59 oleg421-client sshd[122360]: pam_unix(sshd:session): session closed for user root Apr 3 03:42:59 oleg421-client systemd[1]: session-628.scope: Succeeded. Apr 3 03:42:59 oleg421-client systemd-logind[1011]: Session 628 logged out. Waiting for processes to exit. Apr 3 03:42:59 oleg421-client systemd-logind[1011]: Removed session 628. Apr 3 03:43:01 oleg421-client sshd[122506]: Accepted publickey for root from 192.168.204.21 port 35842 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:43:01 oleg421-client systemd-logind[1011]: New session 629 of user root. Apr 3 03:43:01 oleg421-client systemd[1]: Started Session 629 of user root. Apr 3 03:43:01 oleg421-client sshd[122506]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:43:01 oleg421-client sshd[122519]: Received disconnect from 192.168.204.21 port 35842:11: disconnected by user Apr 3 03:43:02 oleg421-client sshd[122519]: Disconnected from user root 192.168.204.21 port 35842 Apr 3 03:43:02 oleg421-client sshd[122506]: pam_unix(sshd:session): session closed for user root Apr 3 03:43:02 oleg421-client systemd-logind[1011]: Session 629 logged out. Waiting for processes to exit. Apr 3 03:43:02 oleg421-client systemd[1]: session-629.scope: Succeeded. Apr 3 03:43:02 oleg421-client systemd-logind[1011]: Removed session 629. Apr 3 03:43:04 oleg421-client sshd[122661]: Accepted publickey for root from 192.168.204.21 port 35852 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:43:04 oleg421-client systemd-logind[1011]: New session 630 of user root. Apr 3 03:43:04 oleg421-client systemd[1]: Started Session 630 of user root. Apr 3 03:43:04 oleg421-client sshd[122661]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:43:05 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 161: evict osp by ping evictor ==== 03:43:02 (1775202182) Apr 3 03:43:05 oleg421-client sshd[122674]: Received disconnect from 192.168.204.21 port 35852:11: disconnected by user Apr 3 03:43:05 oleg421-client sshd[122674]: Disconnected from user root 192.168.204.21 port 35852 Apr 3 03:43:05 oleg421-client sshd[122661]: pam_unix(sshd:session): session closed for user root Apr 3 03:43:05 oleg421-client systemd[1]: session-630.scope: Succeeded. Apr 3 03:43:05 oleg421-client systemd-logind[1011]: Session 630 logged out. Waiting for processes to exit. Apr 3 03:43:05 oleg421-client systemd-logind[1011]: Removed session 630. Apr 3 03:43:18 oleg421-client sshd[122811]: Accepted publickey for root from 192.168.204.21 port 44876 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:43:18 oleg421-client systemd-logind[1011]: New session 631 of user root. Apr 3 03:43:18 oleg421-client systemd[1]: Started Session 631 of user root. Apr 3 03:43:18 oleg421-client sshd[122811]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:43:18 oleg421-client sshd[122825]: Received disconnect from 192.168.204.21 port 44876:11: disconnected by user Apr 3 03:43:18 oleg421-client sshd[122825]: Disconnected from user root 192.168.204.21 port 44876 Apr 3 03:43:18 oleg421-client sshd[122811]: pam_unix(sshd:session): session closed for user root Apr 3 03:43:18 oleg421-client systemd[1]: session-631.scope: Succeeded. Apr 3 03:43:18 oleg421-client systemd-logind[1011]: Session 631 logged out. Waiting for processes to exit. Apr 3 03:43:18 oleg421-client systemd-logind[1011]: Removed session 631. Apr 3 03:43:20 oleg421-client sshd[122951]: Accepted publickey for root from 192.168.204.21 port 44892 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:43:20 oleg421-client systemd[1]: Started Session 632 of user root. Apr 3 03:43:20 oleg421-client systemd-logind[1011]: New session 632 of user root. Apr 3 03:43:20 oleg421-client sshd[122951]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:43:21 oleg421-client sshd[122964]: Received disconnect from 192.168.204.21 port 44892:11: disconnected by user Apr 3 03:43:21 oleg421-client sshd[122964]: Disconnected from user root 192.168.204.21 port 44892 Apr 3 03:43:21 oleg421-client sshd[122951]: pam_unix(sshd:session): session closed for user root Apr 3 03:43:21 oleg421-client systemd[1]: session-632.scope: Succeeded. Apr 3 03:43:21 oleg421-client systemd-logind[1011]: Session 632 logged out. Waiting for processes to exit. Apr 3 03:43:21 oleg421-client systemd-logind[1011]: Removed session 632. Apr 3 03:43:22 oleg421-client sshd[123097]: Accepted publickey for root from 192.168.204.21 port 44896 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:43:22 oleg421-client systemd-logind[1011]: New session 633 of user root. Apr 3 03:43:22 oleg421-client systemd[1]: Started Session 633 of user root. Apr 3 03:43:22 oleg421-client sshd[123097]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:43:23 oleg421-client sshd[123110]: Received disconnect from 192.168.204.21 port 44896:11: disconnected by user Apr 3 03:43:23 oleg421-client sshd[123110]: Disconnected from user root 192.168.204.21 port 44896 Apr 3 03:43:23 oleg421-client sshd[123097]: pam_unix(sshd:session): session closed for user root Apr 3 03:43:23 oleg421-client systemd[1]: session-633.scope: Succeeded. Apr 3 03:43:23 oleg421-client systemd-logind[1011]: Session 633 logged out. Waiting for processes to exit. Apr 3 03:43:23 oleg421-client systemd-logind[1011]: Removed session 633. Apr 3 03:43:25 oleg421-client sshd[123253]: Accepted publickey for root from 192.168.204.21 port 44910 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:43:25 oleg421-client systemd-logind[1011]: New session 634 of user root. Apr 3 03:43:25 oleg421-client systemd[1]: Started Session 634 of user root. Apr 3 03:43:25 oleg421-client sshd[123253]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:43:25 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 162: File attributes should be persisted after MDS failover ========================================================== 03:43:23 (1775202203) Apr 3 03:43:25 oleg421-client sshd[123266]: Received disconnect from 192.168.204.21 port 44910:11: disconnected by user Apr 3 03:43:25 oleg421-client sshd[123266]: Disconnected from user root 192.168.204.21 port 44910 Apr 3 03:43:25 oleg421-client sshd[123253]: pam_unix(sshd:session): session closed for user root Apr 3 03:43:25 oleg421-client systemd-logind[1011]: Session 634 logged out. Waiting for processes to exit. Apr 3 03:43:25 oleg421-client systemd[1]: session-634.scope: Succeeded. Apr 3 03:43:25 oleg421-client systemd-logind[1011]: Removed session 634. Apr 3 03:43:43 oleg421-client kernel: LustreError: 2402:0:(client.c:3419:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff962447ef4380 x1861425412028928/t163208757318(163208757318) o101->lustre-MDT0000-mdc-ffff962446925800@192.168.204.121@tcp:12/10 lens 576/608 e 0 to 0 dl 1775202278 ref 2 fl Interpret:RPQU/604/0 rc 301/301 job:'chattr.0' uid:0 gid:0 projid:0 Apr 3 03:43:54 oleg421-client sshd[123680]: Accepted publickey for root from 192.168.204.21 port 49164 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:43:54 oleg421-client systemd[1]: Started Session 635 of user root. Apr 3 03:43:54 oleg421-client systemd-logind[1011]: New session 635 of user root. Apr 3 03:43:54 oleg421-client sshd[123680]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:43:54 oleg421-client sshd[123693]: Received disconnect from 192.168.204.21 port 49164:11: disconnected by user Apr 3 03:43:54 oleg421-client sshd[123693]: Disconnected from user root 192.168.204.21 port 49164 Apr 3 03:43:54 oleg421-client sshd[123680]: pam_unix(sshd:session): session closed for user root Apr 3 03:43:54 oleg421-client systemd[1]: session-635.scope: Succeeded. Apr 3 03:43:54 oleg421-client systemd-logind[1011]: Session 635 logged out. Waiting for processes to exit. Apr 3 03:43:54 oleg421-client systemd-logind[1011]: Removed session 635. Apr 3 03:43:55 oleg421-client sshd[123819]: Accepted publickey for root from 192.168.204.21 port 49172 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:43:55 oleg421-client systemd-logind[1011]: New session 636 of user root. Apr 3 03:43:55 oleg421-client systemd[1]: Started Session 636 of user root. Apr 3 03:43:55 oleg421-client sshd[123819]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:43:56 oleg421-client sshd[123832]: Received disconnect from 192.168.204.21 port 49172:11: disconnected by user Apr 3 03:43:56 oleg421-client sshd[123832]: Disconnected from user root 192.168.204.21 port 49172 Apr 3 03:43:56 oleg421-client sshd[123819]: pam_unix(sshd:session): session closed for user root Apr 3 03:43:56 oleg421-client systemd[1]: session-636.scope: Succeeded. Apr 3 03:43:56 oleg421-client systemd-logind[1011]: Session 636 logged out. Waiting for processes to exit. Apr 3 03:43:56 oleg421-client systemd-logind[1011]: Removed session 636. Apr 3 03:43:57 oleg421-client sshd[123965]: Accepted publickey for root from 192.168.204.21 port 38308 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:43:57 oleg421-client systemd[1]: Started Session 637 of user root. Apr 3 03:43:57 oleg421-client systemd-logind[1011]: New session 637 of user root. Apr 3 03:43:57 oleg421-client sshd[123965]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:43:58 oleg421-client sshd[123978]: Received disconnect from 192.168.204.21 port 38308:11: disconnected by user Apr 3 03:43:58 oleg421-client sshd[123978]: Disconnected from user root 192.168.204.21 port 38308 Apr 3 03:43:58 oleg421-client sshd[123965]: pam_unix(sshd:session): session closed for user root Apr 3 03:43:58 oleg421-client systemd[1]: session-637.scope: Succeeded. Apr 3 03:43:58 oleg421-client systemd-logind[1011]: Session 637 logged out. Waiting for processes to exit. Apr 3 03:43:58 oleg421-client systemd-logind[1011]: Removed session 637. Apr 3 03:44:00 oleg421-client sshd[124123]: Accepted publickey for root from 192.168.204.21 port 38320 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:44:00 oleg421-client systemd-logind[1011]: New session 638 of user root. Apr 3 03:44:00 oleg421-client systemd[1]: Started Session 638 of user root. Apr 3 03:44:00 oleg421-client sshd[124123]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:44:00 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test 163: changelog check for fail write and processing records ========================================================== 03:43:58 (1775202238) Apr 3 03:44:00 oleg421-client sshd[124136]: Received disconnect from 192.168.204.21 port 38320:11: disconnected by user Apr 3 03:44:00 oleg421-client sshd[124136]: Disconnected from user root 192.168.204.21 port 38320 Apr 3 03:44:00 oleg421-client sshd[124123]: pam_unix(sshd:session): session closed for user root Apr 3 03:44:00 oleg421-client systemd[1]: session-638.scope: Succeeded. Apr 3 03:44:00 oleg421-client systemd-logind[1011]: Session 638 logged out. Waiting for processes to exit. Apr 3 03:44:00 oleg421-client systemd-logind[1011]: Removed session 638. Apr 3 03:44:14 oleg421-client sshd[124488]: Accepted publickey for root from 192.168.204.21 port 38942 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:44:14 oleg421-client systemd-logind[1011]: New session 639 of user root. Apr 3 03:44:14 oleg421-client systemd[1]: Started Session 639 of user root. Apr 3 03:44:14 oleg421-client sshd[124488]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:44:14 oleg421-client sshd[124501]: Received disconnect from 192.168.204.21 port 38942:11: disconnected by user Apr 3 03:44:14 oleg421-client sshd[124501]: Disconnected from user root 192.168.204.21 port 38942 Apr 3 03:44:14 oleg421-client sshd[124488]: pam_unix(sshd:session): session closed for user root Apr 3 03:44:15 oleg421-client systemd[1]: session-639.scope: Succeeded. Apr 3 03:44:15 oleg421-client systemd-logind[1011]: Session 639 logged out. Waiting for processes to exit. Apr 3 03:44:15 oleg421-client systemd-logind[1011]: Removed session 639. Apr 3 03:44:16 oleg421-client sshd[124627]: Accepted publickey for root from 192.168.204.21 port 38946 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:44:16 oleg421-client systemd[1]: Started Session 640 of user root. Apr 3 03:44:16 oleg421-client systemd-logind[1011]: New session 640 of user root. Apr 3 03:44:16 oleg421-client sshd[124627]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:44:17 oleg421-client sshd[124640]: Received disconnect from 192.168.204.21 port 38946:11: disconnected by user Apr 3 03:44:17 oleg421-client sshd[124640]: Disconnected from user root 192.168.204.21 port 38946 Apr 3 03:44:17 oleg421-client sshd[124627]: pam_unix(sshd:session): session closed for user root Apr 3 03:44:17 oleg421-client systemd[1]: session-640.scope: Succeeded. Apr 3 03:44:17 oleg421-client systemd-logind[1011]: Session 640 logged out. Waiting for processes to exit. Apr 3 03:44:17 oleg421-client systemd-logind[1011]: Removed session 640. Apr 3 03:44:18 oleg421-client sshd[124773]: Accepted publickey for root from 192.168.204.21 port 36734 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:44:18 oleg421-client systemd[1]: Started Session 641 of user root. Apr 3 03:44:18 oleg421-client systemd-logind[1011]: New session 641 of user root. Apr 3 03:44:18 oleg421-client sshd[124773]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:44:19 oleg421-client sshd[124786]: Received disconnect from 192.168.204.21 port 36734:11: disconnected by user Apr 3 03:44:19 oleg421-client sshd[124786]: Disconnected from user root 192.168.204.21 port 36734 Apr 3 03:44:19 oleg421-client sshd[124773]: pam_unix(sshd:session): session closed for user root Apr 3 03:44:19 oleg421-client systemd[1]: session-641.scope: Succeeded. Apr 3 03:44:19 oleg421-client systemd-logind[1011]: Session 641 logged out. Waiting for processes to exit. Apr 3 03:44:19 oleg421-client systemd-logind[1011]: Removed session 641. Apr 3 03:44:30 oleg421-client sshd[125030]: Accepted publickey for root from 192.168.204.21 port 39464 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:44:30 oleg421-client systemd[1]: Started Session 642 of user root. Apr 3 03:44:30 oleg421-client systemd-logind[1011]: New session 642 of user root. Apr 3 03:44:30 oleg421-client sshd[125030]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:44:31 oleg421-client kernel: Lustre: DEBUG MARKER: == recovery-small test complete, duration 8485 sec ======= 03:44:29 (1775202269) Apr 3 03:44:31 oleg421-client sshd[125043]: Received disconnect from 192.168.204.21 port 39464:11: disconnected by user Apr 3 03:44:31 oleg421-client sshd[125043]: Disconnected from user root 192.168.204.21 port 39464 Apr 3 03:44:31 oleg421-client sshd[125030]: pam_unix(sshd:session): session closed for user root Apr 3 03:44:31 oleg421-client systemd-logind[1011]: Session 642 logged out. Waiting for processes to exit. Apr 3 03:44:31 oleg421-client systemd[1]: session-642.scope: Succeeded. Apr 3 03:44:31 oleg421-client systemd-logind[1011]: Removed session 642. Apr 3 03:44:32 oleg421-client sshd[125176]: Accepted publickey for root from 192.168.204.21 port 39478 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:44:32 oleg421-client systemd-logind[1011]: New session 643 of user root. Apr 3 03:44:32 oleg421-client systemd[1]: Started Session 643 of user root. Apr 3 03:44:32 oleg421-client sshd[125176]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:44:33 oleg421-client kernel: Lustre: DEBUG MARKER: === recovery-small: start cleanup 03:44:31 (1775202271) === Apr 3 03:44:33 oleg421-client sshd[125189]: Received disconnect from 192.168.204.21 port 39478:11: disconnected by user Apr 3 03:44:33 oleg421-client sshd[125189]: Disconnected from user root 192.168.204.21 port 39478 Apr 3 03:44:33 oleg421-client sshd[125176]: pam_unix(sshd:session): session closed for user root Apr 3 03:44:33 oleg421-client systemd-logind[1011]: Session 643 logged out. Waiting for processes to exit. Apr 3 03:44:33 oleg421-client systemd[1]: session-643.scope: Succeeded. Apr 3 03:44:33 oleg421-client systemd-logind[1011]: Removed session 643. Apr 3 03:49:37 oleg421-client sshd[125377]: Accepted publickey for root from 192.168.204.21 port 58452 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:49:37 oleg421-client systemd-logind[1011]: New session 644 of user root. Apr 3 03:49:37 oleg421-client systemd[1]: Started Session 644 of user root. Apr 3 03:49:37 oleg421-client sshd[125377]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:49:38 oleg421-client sshd[125390]: Received disconnect from 192.168.204.21 port 58452:11: disconnected by user Apr 3 03:49:38 oleg421-client sshd[125390]: Disconnected from user root 192.168.204.21 port 58452 Apr 3 03:49:38 oleg421-client sshd[125377]: pam_unix(sshd:session): session closed for user root Apr 3 03:49:38 oleg421-client systemd-logind[1011]: Session 644 logged out. Waiting for processes to exit. Apr 3 03:49:38 oleg421-client systemd[1]: session-644.scope: Succeeded. Apr 3 03:49:38 oleg421-client systemd-logind[1011]: Removed session 644. Apr 3 03:49:40 oleg421-client sshd[125518]: Accepted publickey for root from 192.168.204.21 port 58466 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Apr 3 03:49:40 oleg421-client systemd-logind[1011]: New session 645 of user root. Apr 3 03:49:40 oleg421-client systemd[1]: Started Session 645 of user root. Apr 3 03:49:40 oleg421-client sshd[125518]: pam_unix(sshd:session): session opened for user root by (uid=0) Apr 3 03:49:40 oleg421-client kernel: Lustre: DEBUG MARKER: === recovery-small: finish cleanup 03:49:39 (1775202579) === Apr 3 03:49:40 oleg421-client sshd[125531]: Received disconnect from 192.168.204.21 port 58466:11: disconnected by user Apr 3 03:49:40 oleg421-client sshd[125531]: Disconnected from user root 192.168.204.21 port 58466 Apr 3 03:49:40 oleg421-client sshd[125518]: pam_unix(sshd:session): session closed for user root Apr 3 03:49:40 oleg421-client systemd[1]: session-645.scope: Succeeded. Apr 3 03:49:40 oleg421-client systemd-logind[1011]: Session 645 logged out. Waiting for processes to exit. Apr 3 03:49:41 oleg421-client systemd-logind[1011]: Removed session 645. Apr 3 03:49:43 oleg421-client systemd[1]: mnt-lustre.mount: Succeeded. Apr 3 03:49:43 oleg421-client kernel: LustreError: 125591:0:(lov_obd.c:786:lov_cleanup()) lustre-clilov-ffff962446925800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Apr 3 03:49:43 oleg421-client kernel: LustreError: 125591:0:(lov_obd.c:786:lov_cleanup()) Skipped 1 previous similar message Apr 3 03:49:43 oleg421-client kernel: Lustre: Unmounted lustre-client Apr 3 03:50:51 oleg421-client kernel: Key type lgssc unregistered Apr 3 03:50:52 oleg421-client kernel: LNet: 126279:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Apr 3 03:50:52 oleg421-client kernel: LNetError: 126279:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found Apr 3 03:50:52 oleg421-client kernel: LNet: Removed LNI 192.168.204.21@tcp Apr 3 03:50:52 oleg421-client kernel: Key type .llcrypt unregistered Apr 3 03:50:52 oleg421-client kernel: Key type ._llcrypt unregistered Apr 3 03:50:53 oleg421-client systemd-logind[1011]: Watching system buttons on /dev/input/event0 (Power Button) Apr 3 03:50:53 oleg421-client systemd-udevd[126347]: Using default interface naming scheme 'rhel-8.0'. Apr 3 03:50:53 oleg421-client systemd-logind[1011]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Apr 3 03:51:04 oleg421-client systemd[1]: usr-sbin-mount.lustre.mount: Succeeded. Apr 3 03:51:04 oleg421-client sshd[1534]: Received disconnect from 192.168.200.253 port 43922:11: disconnected by user Apr 3 03:51:04 oleg421-client sshd[1534]: Disconnected from user root 192.168.200.253 port 43922 Apr 3 03:51:04 oleg421-client sshd[1512]: pam_unix(sshd:session): session closed for user root Apr 3 03:51:04 oleg421-client systemd[1]: session-3.scope: Succeeded.